2024-09-12T18:21:28.484 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T18:21:28.500 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T18:21:28.594 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901181 branch: main description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-snappy powercycle/default supported-distros/ubuntu_latest tasks/admin_socket_objecter_requests thrashosds-health} email: bhubbard@redhat.com first_in_suite: false job_id: '7901181' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi no_nested_subset: false os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: main ceph: conf: client.0: admin socket: /var/run/ceph/ceph-$name.asok mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression algorithm: snappy bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: 46406987da2067f022005d68ecbb989daaabb837 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 46406987da2067f022005d68ecbb989daaabb837 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 0d61375b8ab53be4c233f5b93e463edfdff9316a owner: scheduled_bhubbard@teuthology priority: 150 repo: https://github.com/ceph/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 245 sha1: 46406987da2067f022005d68ecbb989daaabb837 sleep_before_teardown: 0 subset: 2/4 suite: powercycle suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph_0d61375b8ab53be4c233f5b93e463edfdff9316a/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph.git suite_sha1: 0d61375b8ab53be4c233f5b93e463edfdff9316a targets: smithi073.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDwxeoN9EHHTpfjebiLUj0tbQOWss2lzdAWV6+Ye+WiADG0+BBzkSqbRCSm2ui8vHBG3nv5b8Yafro+XE4+MfRg= smithi114.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOgUNu9k1/6BpP8cPYm0rPQonz/JvNYmdpR2gHrvVI27NDDaY9TikO6C6Bk8ttuSXPkt0hZi42tgEtO0QEg42v8= smithi143.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMQaxlkp9gRe82Fkanf7MSTAX2tc5ktmlAak5fmyGjGPTAX6gAKs43793LDwT7SF85me5GXOuB/AJJ460+EsTkM= smithi162.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJSHIlYNd5FIvlQ+zvkmcw12hCHX/pgPr+t6xMe0kukXxZUMiF5+vOP3DoLxVdWRbA0kpppAKjJ3LwcqcghqAyE= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - radosbench: clients: - client.0 time: 60 - admin_socket: client.0: objecter_requests: test: http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch} teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_02:37:30 tube: smithi user: bhubbard verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T18:21:28.594 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_0d61375b8ab53be4c233f5b93e463edfdff9316a/qa; will attempt to use it 2024-09-12T18:21:28.595 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_0d61375b8ab53be4c233f5b93e463edfdff9316a/qa/tasks 2024-09-12T18:21:28.595 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T18:21:28.597 INFO:teuthology.task.internal:Checking packages... 2024-09-12T18:21:28.620 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '46406987da2067f022005d68ecbb989daaabb837' 2024-09-12T18:21:28.620 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T18:21:28.620 INFO:teuthology.packaging:ref: None 2024-09-12T18:21:28.621 INFO:teuthology.packaging:tag: None 2024-09-12T18:21:28.621 INFO:teuthology.packaging:branch: main 2024-09-12T18:21:28.621 INFO:teuthology.packaging:sha1: 46406987da2067f022005d68ecbb989daaabb837 2024-09-12T18:21:28.621 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=main 2024-09-12T18:21:28.829 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4881-ge5d6b434-1jammy 2024-09-12T18:21:28.831 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T18:21:28.838 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T18:21:28.838 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T18:21:28.867 INFO:teuthology.task.internal:Saving configuration 2024-09-12T18:21:28.879 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T18:21:28.901 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T18:21:28.924 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901181', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 18:15:44.152128', 'locked_by': 'scheduled_bhubbard@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF8eNbssYg8cvQob5llhEfVcRXTnZWIX5g34FIrvyIYa'} 2024-09-12T18:21:28.946 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi114.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901181', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 18:15:44.150603', 'locked_by': 'scheduled_bhubbard@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIASrRDgM+aT84Q4FJVxA0ZET+dbxgpW1MSGPmscC9lAT'} 2024-09-12T18:21:28.971 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi143.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901181', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 18:15:44.148632', 'locked_by': 'scheduled_bhubbard@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMXeCFJRFOjTCwkY8L2GZ5OmV5rdg63FPXabtlNXdUT2'} 2024-09-12T18:21:28.996 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi162.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901181', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 18:15:44.153170', 'locked_by': 'scheduled_bhubbard@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIA0bys/4QcSGYseHhYPKsDDtX6n6Mf3BmM4K2kJgoMcd'} 2024-09-12T18:21:28.996 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T18:21:29.006 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2024-09-12T18:21:29.006 INFO:teuthology.task.internal:roles: ubuntu@smithi114.front.sepia.ceph.com - ['osd.0'] 2024-09-12T18:21:29.007 INFO:teuthology.task.internal:roles: ubuntu@smithi143.front.sepia.ceph.com - ['osd.1'] 2024-09-12T18:21:29.007 INFO:teuthology.task.internal:roles: ubuntu@smithi162.front.sepia.ceph.com - ['osd.2'] 2024-09-12T18:21:29.007 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T18:21:29.156 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4ab12a2e60>, signals=[15]) 2024-09-12T18:21:29.156 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T18:21:29.163 INFO:teuthology.task.internal:Opening connections... 2024-09-12T18:21:29.163 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi073.front.sepia.ceph.com 2024-09-12T18:21:29.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:21:29.247 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi114.front.sepia.ceph.com 2024-09-12T18:21:29.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:21:29.330 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi143.front.sepia.ceph.com 2024-09-12T18:21:29.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:21:29.411 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi162.front.sepia.ceph.com 2024-09-12T18:21:29.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:21:29.492 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T18:21:29.499 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2024-09-12T18:21:29.505 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2024-09-12T18:21:29.505 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2024-09-12T18:21:29.554 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T18:21:29.554 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="Ubuntu" 2024-09-12T18:21:29.554 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="22.04" 2024-09-12T18:21:29.554 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T18:21:29.554 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_CODENAME=jammy 2024-09-12T18:21:29.555 INFO:teuthology.orchestra.run.smithi073.stdout:ID=ubuntu 2024-09-12T18:21:29.555 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE=debian 2024-09-12T18:21:29.555 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T18:21:29.555 INFO:teuthology.orchestra.run.smithi073.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T18:21:29.555 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T18:21:29.555 INFO:teuthology.orchestra.run.smithi073.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T18:21:29.555 INFO:teuthology.orchestra.run.smithi073.stdout:UBUNTU_CODENAME=jammy 2024-09-12T18:21:29.556 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2024-09-12T18:21:29.587 DEBUG:teuthology.orchestra.run.smithi114:> uname -m 2024-09-12T18:21:29.593 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64 2024-09-12T18:21:29.593 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release 2024-09-12T18:21:29.641 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T18:21:29.642 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="Ubuntu" 2024-09-12T18:21:29.642 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="22.04" 2024-09-12T18:21:29.642 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T18:21:29.642 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_CODENAME=jammy 2024-09-12T18:21:29.642 INFO:teuthology.orchestra.run.smithi114.stdout:ID=ubuntu 2024-09-12T18:21:29.642 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE=debian 2024-09-12T18:21:29.643 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T18:21:29.643 INFO:teuthology.orchestra.run.smithi114.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T18:21:29.643 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T18:21:29.643 INFO:teuthology.orchestra.run.smithi114.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T18:21:29.643 INFO:teuthology.orchestra.run.smithi114.stdout:UBUNTU_CODENAME=jammy 2024-09-12T18:21:29.643 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2024-09-12T18:21:29.671 DEBUG:teuthology.orchestra.run.smithi143:> uname -m 2024-09-12T18:21:29.677 INFO:teuthology.orchestra.run.smithi143.stdout:x86_64 2024-09-12T18:21:29.677 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2024-09-12T18:21:29.722 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T18:21:29.722 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="Ubuntu" 2024-09-12T18:21:29.723 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="22.04" 2024-09-12T18:21:29.723 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T18:21:29.723 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_CODENAME=jammy 2024-09-12T18:21:29.723 INFO:teuthology.orchestra.run.smithi143.stdout:ID=ubuntu 2024-09-12T18:21:29.723 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE=debian 2024-09-12T18:21:29.723 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T18:21:29.723 INFO:teuthology.orchestra.run.smithi143.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T18:21:29.723 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T18:21:29.723 INFO:teuthology.orchestra.run.smithi143.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T18:21:29.723 INFO:teuthology.orchestra.run.smithi143.stdout:UBUNTU_CODENAME=jammy 2024-09-12T18:21:29.724 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2024-09-12T18:21:29.762 DEBUG:teuthology.orchestra.run.smithi162:> uname -m 2024-09-12T18:21:29.768 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64 2024-09-12T18:21:29.769 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2024-09-12T18:21:29.816 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T18:21:29.816 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="Ubuntu" 2024-09-12T18:21:29.816 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="22.04" 2024-09-12T18:21:29.816 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T18:21:29.816 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_CODENAME=jammy 2024-09-12T18:21:29.816 INFO:teuthology.orchestra.run.smithi162.stdout:ID=ubuntu 2024-09-12T18:21:29.816 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE=debian 2024-09-12T18:21:29.816 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T18:21:29.816 INFO:teuthology.orchestra.run.smithi162.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T18:21:29.817 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T18:21:29.817 INFO:teuthology.orchestra.run.smithi162.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T18:21:29.817 INFO:teuthology.orchestra.run.smithi162.stdout:UBUNTU_CODENAME=jammy 2024-09-12T18:21:29.817 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2024-09-12T18:21:29.946 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T18:21:29.955 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T18:21:29.992 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T18:21:29.993 DEBUG:teuthology.orchestra.run.smithi073:> test '!' -e /home/ubuntu/cephtest 2024-09-12T18:21:29.995 DEBUG:teuthology.orchestra.run.smithi114:> test '!' -e /home/ubuntu/cephtest 2024-09-12T18:21:29.999 DEBUG:teuthology.orchestra.run.smithi143:> test '!' -e /home/ubuntu/cephtest 2024-09-12T18:21:30.001 DEBUG:teuthology.orchestra.run.smithi162:> test '!' -e /home/ubuntu/cephtest 2024-09-12T18:21:30.007 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T18:21:30.017 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T18:21:30.017 DEBUG:teuthology.orchestra.run.smithi073:> test -z $(ls -A /var/lib/ceph) 2024-09-12T18:21:30.042 DEBUG:teuthology.orchestra.run.smithi114:> test -z $(ls -A /var/lib/ceph) 2024-09-12T18:21:30.046 DEBUG:teuthology.orchestra.run.smithi143:> test -z $(ls -A /var/lib/ceph) 2024-09-12T18:21:30.048 DEBUG:teuthology.orchestra.run.smithi162:> test -z $(ls -A /var/lib/ceph) 2024-09-12T18:21:30.067 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T18:21:30.166 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T18:21:30.180 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-12T18:21:30.180 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'osd.0': {'kdb': 1, 'sha1': 'distro'}, 'osd.1': {'kdb': 1, 'sha1': 'distro'}, 'osd.2': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-12T18:21:30.181 DEBUG:teuthology.orchestra.run.smithi073:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T18:21:30.181 DEBUG:teuthology.orchestra.run.smithi114:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T18:21:30.182 DEBUG:teuthology.orchestra.run.smithi143:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T18:21:30.182 DEBUG:teuthology.orchestra.run.smithi162:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T18:21:30.187 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:21:30.187 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:21:30.188 DEBUG:teuthology.orchestra.run.smithi143:> uname -r 2024-09-12T18:21:30.188 DEBUG:teuthology.orchestra.run.smithi114:> uname -r 2024-09-12T18:21:30.189 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:21:30.189 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:21:30.190 DEBUG:teuthology.orchestra.run.smithi162:> uname -r 2024-09-12T18:21:30.190 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2024-09-12T18:21:30.235 INFO:teuthology.orchestra.run.smithi143.stdout:5.15.0-56-generic 2024-09-12T18:21:30.235 INFO:teuthology.task.kernel:Running kernel on smithi143: 5.15.0-56-generic 2024-09-12T18:21:30.235 DEBUG:teuthology.orchestra.run.smithi143:> sudo apt-get clean 2024-09-12T18:21:30.236 INFO:teuthology.orchestra.run.smithi162.stdout:5.15.0-56-generic 2024-09-12T18:21:30.237 INFO:teuthology.task.kernel:Running kernel on smithi162: 5.15.0-56-generic 2024-09-12T18:21:30.237 DEBUG:teuthology.orchestra.run.smithi162:> sudo apt-get clean 2024-09-12T18:21:30.238 INFO:teuthology.orchestra.run.smithi114.stdout:5.15.0-56-generic 2024-09-12T18:21:30.238 INFO:teuthology.orchestra.run.smithi073.stdout:5.15.0-56-generic 2024-09-12T18:21:30.239 INFO:teuthology.task.kernel:Running kernel on smithi114: 5.15.0-56-generic 2024-09-12T18:21:30.239 DEBUG:teuthology.orchestra.run.smithi114:> sudo apt-get clean 2024-09-12T18:21:30.239 INFO:teuthology.task.kernel:Running kernel on smithi073: 5.15.0-56-generic 2024-09-12T18:21:30.239 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get clean 2024-09-12T18:21:30.363 DEBUG:teuthology.orchestra.run.smithi143:> sudo apt-get update 2024-09-12T18:21:30.373 DEBUG:teuthology.orchestra.run.smithi162:> sudo apt-get update 2024-09-12T18:21:30.387 DEBUG:teuthology.orchestra.run.smithi114:> sudo apt-get update 2024-09-12T18:21:30.388 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get update 2024-09-12T18:21:30.514 INFO:teuthology.orchestra.run.smithi143.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T18:21:30.539 INFO:teuthology.orchestra.run.smithi114.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T18:21:30.559 INFO:teuthology.orchestra.run.smithi114.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T18:21:30.625 INFO:teuthology.orchestra.run.smithi114.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T18:21:30.629 INFO:teuthology.orchestra.run.smithi143.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T18:21:30.638 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T18:21:30.639 INFO:teuthology.orchestra.run.smithi162.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T18:21:30.654 INFO:teuthology.orchestra.run.smithi114.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T18:21:30.675 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T18:21:30.675 INFO:teuthology.orchestra.run.smithi073.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T18:21:30.701 INFO:teuthology.orchestra.run.smithi162.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T18:21:30.711 INFO:teuthology.orchestra.run.smithi143.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T18:21:30.714 INFO:teuthology.orchestra.run.smithi143.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T18:21:30.731 INFO:teuthology.orchestra.run.smithi073.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T18:21:30.781 INFO:teuthology.orchestra.run.smithi143.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T18:21:30.800 INFO:teuthology.orchestra.run.smithi114.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T18:21:30.818 INFO:teuthology.orchestra.run.smithi143.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T18:21:30.821 INFO:teuthology.orchestra.run.smithi143.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T18:21:30.822 INFO:teuthology.orchestra.run.smithi143.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T18:21:30.822 INFO:teuthology.orchestra.run.smithi143.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T18:21:30.840 INFO:teuthology.orchestra.run.smithi143.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T18:21:30.844 INFO:teuthology.orchestra.run.smithi143.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T18:21:30.844 INFO:teuthology.orchestra.run.smithi143.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T18:21:30.849 INFO:teuthology.orchestra.run.smithi143.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T18:21:30.855 INFO:teuthology.orchestra.run.smithi143.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T18:21:30.857 INFO:teuthology.orchestra.run.smithi143.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T18:21:30.857 INFO:teuthology.orchestra.run.smithi143.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T18:21:30.857 INFO:teuthology.orchestra.run.smithi143.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T18:21:30.861 INFO:teuthology.orchestra.run.smithi114.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T18:21:30.880 INFO:teuthology.orchestra.run.smithi143.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T18:21:30.881 INFO:teuthology.orchestra.run.smithi143.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T18:21:30.894 INFO:teuthology.orchestra.run.smithi114.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T18:21:30.898 INFO:teuthology.orchestra.run.smithi114.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T18:21:30.898 INFO:teuthology.orchestra.run.smithi114.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T18:21:30.899 INFO:teuthology.orchestra.run.smithi114.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T18:21:30.919 INFO:teuthology.orchestra.run.smithi114.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T18:21:30.923 INFO:teuthology.orchestra.run.smithi114.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T18:21:30.923 INFO:teuthology.orchestra.run.smithi114.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T18:21:30.932 INFO:teuthology.orchestra.run.smithi114.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T18:21:30.938 INFO:teuthology.orchestra.run.smithi114.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T18:21:30.940 INFO:teuthology.orchestra.run.smithi114.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T18:21:30.940 INFO:teuthology.orchestra.run.smithi114.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T18:21:30.965 INFO:teuthology.orchestra.run.smithi114.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T18:21:30.965 INFO:teuthology.orchestra.run.smithi114.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T18:21:30.966 INFO:teuthology.orchestra.run.smithi114.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T18:21:30.966 INFO:teuthology.orchestra.run.smithi114.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T18:21:30.966 INFO:teuthology.orchestra.run.smithi114.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T18:21:30.967 INFO:teuthology.orchestra.run.smithi114.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T18:21:30.967 INFO:teuthology.orchestra.run.smithi114.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T18:21:30.982 INFO:teuthology.orchestra.run.smithi114.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T18:21:30.982 INFO:teuthology.orchestra.run.smithi114.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T18:21:30.983 INFO:teuthology.orchestra.run.smithi114.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T18:21:30.999 INFO:teuthology.orchestra.run.smithi114.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T18:21:31.056 INFO:teuthology.orchestra.run.smithi162.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T18:21:31.066 INFO:teuthology.orchestra.run.smithi143.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T18:21:31.082 INFO:teuthology.orchestra.run.smithi162.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T18:21:31.087 INFO:teuthology.orchestra.run.smithi073.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T18:21:31.109 INFO:teuthology.orchestra.run.smithi073.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T18:21:31.117 INFO:teuthology.orchestra.run.smithi114.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T18:21:31.195 INFO:teuthology.orchestra.run.smithi162.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T18:21:31.205 INFO:teuthology.orchestra.run.smithi143.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T18:21:31.226 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T18:21:31.379 INFO:teuthology.orchestra.run.smithi162.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T18:21:31.389 INFO:teuthology.orchestra.run.smithi162.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T18:21:31.400 INFO:teuthology.orchestra.run.smithi114.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T18:21:31.402 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T18:21:31.520 INFO:teuthology.orchestra.run.smithi143.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T18:21:31.543 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T18:21:31.547 INFO:teuthology.orchestra.run.smithi162.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T18:21:31.554 INFO:teuthology.orchestra.run.smithi162.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T18:21:31.555 INFO:teuthology.orchestra.run.smithi143.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T18:21:31.561 INFO:teuthology.orchestra.run.smithi162.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T18:21:31.562 INFO:teuthology.orchestra.run.smithi162.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T18:21:31.566 INFO:teuthology.orchestra.run.smithi162.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T18:21:31.567 INFO:teuthology.orchestra.run.smithi162.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T18:21:31.569 INFO:teuthology.orchestra.run.smithi162.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T18:21:31.570 INFO:teuthology.orchestra.run.smithi143.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T18:21:31.571 INFO:teuthology.orchestra.run.smithi143.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T18:21:31.572 INFO:teuthology.orchestra.run.smithi114.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T18:21:31.572 INFO:teuthology.orchestra.run.smithi143.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T18:21:31.577 INFO:teuthology.orchestra.run.smithi073.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T18:21:31.578 INFO:teuthology.orchestra.run.smithi073.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T18:21:31.585 INFO:teuthology.orchestra.run.smithi114.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T18:21:31.586 INFO:teuthology.orchestra.run.smithi114.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T18:21:31.586 INFO:teuthology.orchestra.run.smithi073.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T18:21:31.587 INFO:teuthology.orchestra.run.smithi073.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T18:21:31.589 INFO:teuthology.orchestra.run.smithi073.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T18:21:31.593 INFO:teuthology.orchestra.run.smithi073.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T18:21:31.593 INFO:teuthology.orchestra.run.smithi073.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T18:21:31.629 INFO:teuthology.orchestra.run.smithi162.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T18:21:31.638 INFO:teuthology.orchestra.run.smithi143.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T18:21:31.653 INFO:teuthology.orchestra.run.smithi143.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T18:21:31.653 INFO:teuthology.orchestra.run.smithi143.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T18:21:31.660 INFO:teuthology.orchestra.run.smithi073.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T18:21:31.663 INFO:teuthology.orchestra.run.smithi073.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T18:21:31.670 INFO:teuthology.orchestra.run.smithi114.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T18:21:31.671 INFO:teuthology.orchestra.run.smithi114.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T18:21:31.679 INFO:teuthology.orchestra.run.smithi143.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T18:21:31.680 INFO:teuthology.orchestra.run.smithi114.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T18:21:31.680 INFO:teuthology.orchestra.run.smithi114.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T18:21:31.690 INFO:teuthology.orchestra.run.smithi162.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T18:21:31.690 INFO:teuthology.orchestra.run.smithi162.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T18:21:31.701 INFO:teuthology.orchestra.run.smithi162.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T18:21:31.701 INFO:teuthology.orchestra.run.smithi162.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T18:21:31.701 INFO:teuthology.orchestra.run.smithi162.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T18:21:31.702 INFO:teuthology.orchestra.run.smithi162.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T18:21:31.704 INFO:teuthology.orchestra.run.smithi114.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T18:21:31.708 INFO:teuthology.orchestra.run.smithi143.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T18:21:31.709 INFO:teuthology.orchestra.run.smithi073.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T18:21:31.709 INFO:teuthology.orchestra.run.smithi073.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T18:21:31.710 INFO:teuthology.orchestra.run.smithi073.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T18:21:31.713 INFO:teuthology.orchestra.run.smithi143.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T18:21:31.714 INFO:teuthology.orchestra.run.smithi143.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T18:21:31.715 INFO:teuthology.orchestra.run.smithi143.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T18:21:31.716 INFO:teuthology.orchestra.run.smithi143.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T18:21:31.717 INFO:teuthology.orchestra.run.smithi073.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T18:21:31.718 INFO:teuthology.orchestra.run.smithi073.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T18:21:31.719 INFO:teuthology.orchestra.run.smithi162.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T18:21:31.722 INFO:teuthology.orchestra.run.smithi162.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T18:21:31.723 INFO:teuthology.orchestra.run.smithi073.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T18:21:31.728 INFO:teuthology.orchestra.run.smithi162.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T18:21:31.731 INFO:teuthology.orchestra.run.smithi162.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T18:21:31.731 INFO:teuthology.orchestra.run.smithi162.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T18:21:31.731 INFO:teuthology.orchestra.run.smithi114.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T18:21:31.732 INFO:teuthology.orchestra.run.smithi162.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T18:21:31.732 INFO:teuthology.orchestra.run.smithi162.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T18:21:31.732 INFO:teuthology.orchestra.run.smithi162.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T18:21:31.734 INFO:teuthology.orchestra.run.smithi073.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T18:21:31.735 INFO:teuthology.orchestra.run.smithi114.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T18:21:31.736 INFO:teuthology.orchestra.run.smithi162.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T18:21:31.736 INFO:teuthology.orchestra.run.smithi114.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T18:21:31.736 INFO:teuthology.orchestra.run.smithi162.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T18:21:31.737 INFO:teuthology.orchestra.run.smithi114.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T18:21:31.737 INFO:teuthology.orchestra.run.smithi162.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T18:21:31.738 INFO:teuthology.orchestra.run.smithi162.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T18:21:31.742 INFO:teuthology.orchestra.run.smithi073.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T18:21:31.745 INFO:teuthology.orchestra.run.smithi073.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T18:21:31.745 INFO:teuthology.orchestra.run.smithi073.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T18:21:31.746 INFO:teuthology.orchestra.run.smithi073.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T18:21:31.747 INFO:teuthology.orchestra.run.smithi073.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T18:21:31.749 INFO:teuthology.orchestra.run.smithi073.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T18:21:31.749 INFO:teuthology.orchestra.run.smithi073.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T18:21:31.750 INFO:teuthology.orchestra.run.smithi073.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T18:21:31.750 INFO:teuthology.orchestra.run.smithi073.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T18:21:31.765 INFO:teuthology.orchestra.run.smithi143.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T18:21:31.765 INFO:teuthology.orchestra.run.smithi143.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T18:21:31.767 INFO:teuthology.orchestra.run.smithi143.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T18:21:31.768 INFO:teuthology.orchestra.run.smithi143.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T18:21:31.788 INFO:teuthology.orchestra.run.smithi073.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T18:21:31.789 INFO:teuthology.orchestra.run.smithi073.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T18:21:31.793 INFO:teuthology.orchestra.run.smithi162.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T18:21:31.793 INFO:teuthology.orchestra.run.smithi162.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T18:21:31.794 INFO:teuthology.orchestra.run.smithi162.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T18:21:31.801 INFO:teuthology.orchestra.run.smithi162.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T18:21:31.817 INFO:teuthology.orchestra.run.smithi114.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T18:21:31.818 INFO:teuthology.orchestra.run.smithi114.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T18:21:31.819 INFO:teuthology.orchestra.run.smithi073.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T18:21:31.819 INFO:teuthology.orchestra.run.smithi162.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T18:21:31.820 INFO:teuthology.orchestra.run.smithi162.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T18:21:31.820 INFO:teuthology.orchestra.run.smithi162.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T18:21:31.820 INFO:teuthology.orchestra.run.smithi162.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T18:21:31.821 INFO:teuthology.orchestra.run.smithi162.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T18:21:31.829 INFO:teuthology.orchestra.run.smithi073.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T18:21:31.830 INFO:teuthology.orchestra.run.smithi073.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T18:21:31.832 INFO:teuthology.orchestra.run.smithi073.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T18:21:31.832 INFO:teuthology.orchestra.run.smithi073.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T18:21:31.833 INFO:teuthology.orchestra.run.smithi073.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T18:21:31.846 INFO:teuthology.orchestra.run.smithi143.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T18:21:31.846 INFO:teuthology.orchestra.run.smithi143.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T18:21:31.847 INFO:teuthology.orchestra.run.smithi143.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T18:21:31.847 INFO:teuthology.orchestra.run.smithi143.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T18:21:31.848 INFO:teuthology.orchestra.run.smithi143.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T18:21:31.869 INFO:teuthology.orchestra.run.smithi073.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T18:21:31.870 INFO:teuthology.orchestra.run.smithi073.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T18:21:31.870 INFO:teuthology.orchestra.run.smithi073.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T18:21:31.874 INFO:teuthology.orchestra.run.smithi162.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T18:21:37.120 INFO:teuthology.orchestra.run.smithi143.stdout:Fetched 15.8 MB in 2s (7,618 kB/s) 2024-09-12T18:21:37.229 INFO:teuthology.orchestra.run.smithi114.stdout:Fetched 15.8 MB in 2s (7,382 kB/s) 2024-09-12T18:21:37.768 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 15.8 MB in 3s (5,766 kB/s) 2024-09-12T18:21:37.779 INFO:teuthology.orchestra.run.smithi162.stdout:Fetched 15.8 MB in 3s (5,834 kB/s) 2024-09-12T18:21:38.555 INFO:teuthology.orchestra.run.smithi143.stdout:Reading package lists... 2024-09-12T18:21:38.573 DEBUG:teuthology.orchestra.run.smithi143:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T18:21:38.677 INFO:teuthology.orchestra.run.smithi143.stdout:Reading package lists... 2024-09-12T18:21:38.830 INFO:teuthology.orchestra.run.smithi114.stdout:Reading package lists... 2024-09-12T18:21:38.847 DEBUG:teuthology.orchestra.run.smithi114:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T18:21:38.886 INFO:teuthology.orchestra.run.smithi143.stdout:Building dependency tree... 2024-09-12T18:21:38.887 INFO:teuthology.orchestra.run.smithi143.stdout:Reading state information... 2024-09-12T18:21:38.909 INFO:teuthology.orchestra.run.smithi114.stdout:Reading package lists... 2024-09-12T18:21:39.072 INFO:teuthology.orchestra.run.smithi143.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:21:39.072 INFO:teuthology.orchestra.run.smithi143.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:21:39.072 INFO:teuthology.orchestra.run.smithi143.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:21:39.073 INFO:teuthology.orchestra.run.smithi143.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:21:39.073 INFO:teuthology.orchestra.run.smithi143.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T18:21:39.073 INFO:teuthology.orchestra.run.smithi143.stdout: python2.7-minimal 2024-09-12T18:21:39.073 INFO:teuthology.orchestra.run.smithi143.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:21:39.074 INFO:teuthology.orchestra.run.smithi143.stdout:The following additional packages will be installed: 2024-09-12T18:21:39.074 INFO:teuthology.orchestra.run.smithi143.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T18:21:39.074 INFO:teuthology.orchestra.run.smithi143.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T18:21:39.074 INFO:teuthology.orchestra.run.smithi143.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T18:21:39.076 INFO:teuthology.orchestra.run.smithi143.stdout:Suggested packages: 2024-09-12T18:21:39.076 INFO:teuthology.orchestra.run.smithi143.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T18:21:39.076 INFO:teuthology.orchestra.run.smithi143.stdout:Recommended packages: 2024-09-12T18:21:39.076 INFO:teuthology.orchestra.run.smithi143.stdout: thermald 2024-09-12T18:21:39.117 INFO:teuthology.orchestra.run.smithi114.stdout:Building dependency tree... 2024-09-12T18:21:39.118 INFO:teuthology.orchestra.run.smithi114.stdout:Reading state information... 2024-09-12T18:21:39.125 INFO:teuthology.orchestra.run.smithi143.stdout:The following NEW packages will be installed: 2024-09-12T18:21:39.125 INFO:teuthology.orchestra.run.smithi143.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T18:21:39.125 INFO:teuthology.orchestra.run.smithi143.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T18:21:39.125 INFO:teuthology.orchestra.run.smithi143.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T18:21:39.126 INFO:teuthology.orchestra.run.smithi143.stdout:The following packages will be upgraded: 2024-09-12T18:21:39.127 INFO:teuthology.orchestra.run.smithi143.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T18:21:39.279 INFO:teuthology.orchestra.run.smithi162.stdout:Reading package lists... 2024-09-12T18:21:39.294 INFO:teuthology.orchestra.run.smithi114.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:21:39.294 INFO:teuthology.orchestra.run.smithi114.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:21:39.294 INFO:teuthology.orchestra.run.smithi114.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:21:39.295 INFO:teuthology.orchestra.run.smithi114.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:21:39.295 INFO:teuthology.orchestra.run.smithi114.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T18:21:39.295 INFO:teuthology.orchestra.run.smithi114.stdout: python2.7-minimal 2024-09-12T18:21:39.295 INFO:teuthology.orchestra.run.smithi114.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:21:39.296 INFO:teuthology.orchestra.run.smithi114.stdout:The following additional packages will be installed: 2024-09-12T18:21:39.296 INFO:teuthology.orchestra.run.smithi114.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T18:21:39.296 INFO:teuthology.orchestra.run.smithi114.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T18:21:39.297 INFO:teuthology.orchestra.run.smithi114.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T18:21:39.298 INFO:teuthology.orchestra.run.smithi114.stdout:Suggested packages: 2024-09-12T18:21:39.298 INFO:teuthology.orchestra.run.smithi114.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T18:21:39.298 INFO:teuthology.orchestra.run.smithi114.stdout:Recommended packages: 2024-09-12T18:21:39.298 INFO:teuthology.orchestra.run.smithi114.stdout: thermald 2024-09-12T18:21:39.299 DEBUG:teuthology.orchestra.run.smithi162:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T18:21:39.305 INFO:teuthology.orchestra.run.smithi143.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T18:21:39.305 INFO:teuthology.orchestra.run.smithi143.stdout:Need to get 113 MB of archives. 2024-09-12T18:21:39.305 INFO:teuthology.orchestra.run.smithi143.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T18:21:39.305 INFO:teuthology.orchestra.run.smithi143.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T18:21:39.353 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-09-12T18:21:39.364 INFO:teuthology.orchestra.run.smithi162.stdout:Reading package lists... 2024-09-12T18:21:39.370 INFO:teuthology.orchestra.run.smithi114.stdout:The following NEW packages will be installed: 2024-09-12T18:21:39.370 INFO:teuthology.orchestra.run.smithi114.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T18:21:39.370 INFO:teuthology.orchestra.run.smithi114.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T18:21:39.371 INFO:teuthology.orchestra.run.smithi114.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T18:21:39.372 DEBUG:teuthology.orchestra.run.smithi073:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T18:21:39.372 INFO:teuthology.orchestra.run.smithi114.stdout:The following packages will be upgraded: 2024-09-12T18:21:39.373 INFO:teuthology.orchestra.run.smithi114.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T18:21:39.433 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-09-12T18:21:39.555 INFO:teuthology.orchestra.run.smithi114.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T18:21:39.555 INFO:teuthology.orchestra.run.smithi114.stdout:Need to get 113 MB of archives. 2024-09-12T18:21:39.555 INFO:teuthology.orchestra.run.smithi114.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T18:21:39.555 INFO:teuthology.orchestra.run.smithi114.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T18:21:39.573 INFO:teuthology.orchestra.run.smithi162.stdout:Building dependency tree... 2024-09-12T18:21:39.574 INFO:teuthology.orchestra.run.smithi162.stdout:Reading state information... 2024-09-12T18:21:39.620 INFO:teuthology.orchestra.run.smithi073.stdout:Building dependency tree... 2024-09-12T18:21:39.621 INFO:teuthology.orchestra.run.smithi073.stdout:Reading state information... 2024-09-12T18:21:39.754 INFO:teuthology.orchestra.run.smithi162.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:21:39.754 INFO:teuthology.orchestra.run.smithi162.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:21:39.754 INFO:teuthology.orchestra.run.smithi162.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:21:39.755 INFO:teuthology.orchestra.run.smithi162.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:21:39.755 INFO:teuthology.orchestra.run.smithi162.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T18:21:39.755 INFO:teuthology.orchestra.run.smithi162.stdout: python2.7-minimal 2024-09-12T18:21:39.755 INFO:teuthology.orchestra.run.smithi162.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:21:39.756 INFO:teuthology.orchestra.run.smithi162.stdout:The following additional packages will be installed: 2024-09-12T18:21:39.756 INFO:teuthology.orchestra.run.smithi162.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T18:21:39.756 INFO:teuthology.orchestra.run.smithi162.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T18:21:39.757 INFO:teuthology.orchestra.run.smithi162.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T18:21:39.758 INFO:teuthology.orchestra.run.smithi162.stdout:Suggested packages: 2024-09-12T18:21:39.758 INFO:teuthology.orchestra.run.smithi162.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T18:21:39.758 INFO:teuthology.orchestra.run.smithi162.stdout:Recommended packages: 2024-09-12T18:21:39.758 INFO:teuthology.orchestra.run.smithi162.stdout: thermald 2024-09-12T18:21:39.784 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:21:39.785 INFO:teuthology.orchestra.run.smithi073.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:21:39.785 INFO:teuthology.orchestra.run.smithi073.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:21:39.785 INFO:teuthology.orchestra.run.smithi073.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:21:39.785 INFO:teuthology.orchestra.run.smithi073.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T18:21:39.785 INFO:teuthology.orchestra.run.smithi073.stdout: python2.7-minimal 2024-09-12T18:21:39.786 INFO:teuthology.orchestra.run.smithi073.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:21:39.787 INFO:teuthology.orchestra.run.smithi073.stdout:The following additional packages will be installed: 2024-09-12T18:21:39.787 INFO:teuthology.orchestra.run.smithi073.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T18:21:39.787 INFO:teuthology.orchestra.run.smithi073.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T18:21:39.787 INFO:teuthology.orchestra.run.smithi073.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T18:21:39.788 INFO:teuthology.orchestra.run.smithi073.stdout:Suggested packages: 2024-09-12T18:21:39.788 INFO:teuthology.orchestra.run.smithi073.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T18:21:39.788 INFO:teuthology.orchestra.run.smithi073.stdout:Recommended packages: 2024-09-12T18:21:39.789 INFO:teuthology.orchestra.run.smithi073.stdout: thermald 2024-09-12T18:21:39.801 INFO:teuthology.orchestra.run.smithi162.stdout:The following NEW packages will be installed: 2024-09-12T18:21:39.801 INFO:teuthology.orchestra.run.smithi162.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T18:21:39.801 INFO:teuthology.orchestra.run.smithi162.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T18:21:39.801 INFO:teuthology.orchestra.run.smithi162.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T18:21:39.803 INFO:teuthology.orchestra.run.smithi162.stdout:The following packages will be upgraded: 2024-09-12T18:21:39.803 INFO:teuthology.orchestra.run.smithi162.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T18:21:39.845 INFO:teuthology.orchestra.run.smithi073.stdout:The following NEW packages will be installed: 2024-09-12T18:21:39.845 INFO:teuthology.orchestra.run.smithi073.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T18:21:39.845 INFO:teuthology.orchestra.run.smithi073.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T18:21:39.846 INFO:teuthology.orchestra.run.smithi073.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T18:21:39.847 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages will be upgraded: 2024-09-12T18:21:39.847 INFO:teuthology.orchestra.run.smithi073.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T18:21:39.982 INFO:teuthology.orchestra.run.smithi162.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T18:21:39.982 INFO:teuthology.orchestra.run.smithi162.stdout:Need to get 113 MB of archives. 2024-09-12T18:21:39.983 INFO:teuthology.orchestra.run.smithi162.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T18:21:39.983 INFO:teuthology.orchestra.run.smithi162.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T18:21:40.028 INFO:teuthology.orchestra.run.smithi073.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T18:21:40.028 INFO:teuthology.orchestra.run.smithi073.stdout:Need to get 113 MB of archives. 2024-09-12T18:21:40.028 INFO:teuthology.orchestra.run.smithi073.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T18:21:40.028 INFO:teuthology.orchestra.run.smithi073.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T18:21:40.710 INFO:teuthology.orchestra.run.smithi143.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T18:21:40.902 INFO:teuthology.orchestra.run.smithi114.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T18:21:41.111 INFO:teuthology.orchestra.run.smithi143.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T18:21:41.250 INFO:teuthology.orchestra.run.smithi114.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T18:21:41.393 INFO:teuthology.orchestra.run.smithi073.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T18:21:41.398 INFO:teuthology.orchestra.run.smithi162.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T18:21:41.753 INFO:teuthology.orchestra.run.smithi162.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T18:21:41.817 INFO:teuthology.orchestra.run.smithi073.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T18:21:43.278 INFO:teuthology.orchestra.run.smithi143.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T18:21:43.279 INFO:teuthology.orchestra.run.smithi143.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T18:21:43.279 INFO:teuthology.orchestra.run.smithi143.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T18:21:43.447 INFO:teuthology.orchestra.run.smithi114.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T18:21:43.447 INFO:teuthology.orchestra.run.smithi114.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T18:21:43.447 INFO:teuthology.orchestra.run.smithi114.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T18:21:43.783 INFO:teuthology.orchestra.run.smithi114.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T18:21:43.864 INFO:teuthology.orchestra.run.smithi114.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T18:21:43.963 INFO:teuthology.orchestra.run.smithi143.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T18:21:43.990 INFO:teuthology.orchestra.run.smithi162.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T18:21:43.991 INFO:teuthology.orchestra.run.smithi162.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T18:21:43.991 INFO:teuthology.orchestra.run.smithi162.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T18:21:44.023 INFO:teuthology.orchestra.run.smithi073.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T18:21:44.053 INFO:teuthology.orchestra.run.smithi073.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T18:21:44.056 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T18:21:44.132 INFO:teuthology.orchestra.run.smithi143.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T18:21:44.287 INFO:teuthology.orchestra.run.smithi114.stdout:Fetched 113 MB in 4s (25.3 MB/s) 2024-09-12T18:21:44.331 INFO:teuthology.orchestra.run.smithi162.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T18:21:44.412 INFO:teuthology.orchestra.run.smithi162.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T18:21:44.490 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T18:21:44.541 INFO:teuthology.orchestra.run.smithi143.stdout:Fetched 113 MB in 5s (22.7 MB/s) 2024-09-12T18:21:44.547 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T18:21:44.636 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T18:21:44.726 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T18:21:44.819 INFO:teuthology.orchestra.run.smithi162.stdout:Fetched 113 MB in 5s (24.6 MB/s) 2024-09-12T18:21:45.014 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T18:21:45.036 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 113 MB in 5s (23.7 MB/s) 2024-09-12T18:21:45.224 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T18:21:46.528 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T18:21:46.532 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T18:21:46.662 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:21:46.870 INFO:teuthology.orchestra.run.smithi143.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T18:21:46.876 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T18:21:46.984 INFO:teuthology.orchestra.run.smithi162.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T18:21:46.989 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T18:21:47.102 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:21:47.289 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:21:47.312 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T18:21:47.316 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T18:21:47.439 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:21:48.896 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T18:21:48.918 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T18:21:49.008 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:21:49.450 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T18:21:49.470 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T18:21:49.497 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T18:21:49.516 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:21:49.518 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T18:21:49.607 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:21:49.644 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T18:21:49.666 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T18:21:49.760 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:21:50.058 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T18:21:50.079 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T18:21:50.113 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T18:21:50.116 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:21:50.134 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T18:21:50.231 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:21:50.281 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T18:21:50.302 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T18:21:50.339 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:21:50.727 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T18:21:50.748 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T18:21:50.819 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:21:56.732 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T18:21:56.754 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T18:21:56.859 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T18:21:56.872 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T18:21:57.132 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T18:21:57.163 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T18:21:57.235 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T18:21:57.248 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T18:21:57.292 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T18:21:57.356 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T18:21:57.388 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T18:21:57.474 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T18:21:57.581 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T18:21:57.604 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T18:21:57.626 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T18:21:57.724 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T18:21:57.727 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T18:21:57.735 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T18:21:57.774 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T18:21:57.781 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T18:21:57.793 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T18:21:57.903 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T18:21:58.063 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T18:21:58.085 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T18:21:58.129 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T18:21:58.223 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T18:21:58.245 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T18:21:58.289 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T18:22:03.457 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T18:22:03.495 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T18:22:03.531 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:22:03.596 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T18:22:03.633 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T18:22:03.671 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:22:04.113 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T18:22:04.150 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T18:22:04.188 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:22:04.550 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T18:22:04.588 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T18:22:04.624 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:22:07.113 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T18:22:07.244 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T18:22:07.627 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T18:22:07.740 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:22:07.867 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T18:22:07.908 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T18:22:07.996 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:22:08.010 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T18:22:08.051 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T18:22:08.142 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T18:22:08.425 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T18:22:08.447 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T18:22:08.517 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T18:22:08.547 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:22:08.562 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T18:22:08.613 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:22:08.673 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T18:22:08.797 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T18:22:08.819 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:22:08.911 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T18:22:08.934 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:22:09.049 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:22:09.176 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T18:22:09.296 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:22:09.314 INFO:teuthology.orchestra.run.smithi143.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T18:22:09.314 INFO:teuthology.orchestra.run.smithi143.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T18:22:09.314 INFO:teuthology.orchestra.run.smithi143.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T18:22:09.315 INFO:teuthology.orchestra.run.smithi143.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T18:22:09.473 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:22:10.176 INFO:teuthology.orchestra.run.smithi114.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T18:22:10.176 INFO:teuthology.orchestra.run.smithi114.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T18:22:10.176 INFO:teuthology.orchestra.run.smithi114.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T18:22:10.176 INFO:teuthology.orchestra.run.smithi114.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T18:22:10.323 INFO:teuthology.orchestra.run.smithi162.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T18:22:10.323 INFO:teuthology.orchestra.run.smithi162.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T18:22:10.323 INFO:teuthology.orchestra.run.smithi162.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T18:22:10.323 INFO:teuthology.orchestra.run.smithi162.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T18:22:10.337 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:22:10.520 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:22:10.655 INFO:teuthology.orchestra.run.smithi073.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T18:22:10.655 INFO:teuthology.orchestra.run.smithi073.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T18:22:10.655 INFO:teuthology.orchestra.run.smithi073.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T18:22:10.655 INFO:teuthology.orchestra.run.smithi073.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T18:22:10.823 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:22:10.883 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:22:11.822 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:22:12.229 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:22:12.868 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T18:22:12.967 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:22:12.994 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T18:22:13.145 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:22:13.225 INFO:teuthology.orchestra.run.smithi143.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T18:22:13.225 INFO:teuthology.orchestra.run.smithi143.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T18:22:13.323 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T18:22:13.449 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T18:22:13.609 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:22:13.678 INFO:teuthology.orchestra.run.smithi114.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T18:22:13.678 INFO:teuthology.orchestra.run.smithi114.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T18:22:14.264 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T18:22:14.335 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T18:22:14.390 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T18:22:14.461 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T18:22:14.525 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:22:14.570 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:22:14.599 INFO:teuthology.orchestra.run.smithi162.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T18:22:14.599 INFO:teuthology.orchestra.run.smithi162.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T18:22:14.625 INFO:teuthology.orchestra.run.smithi073.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T18:22:14.625 INFO:teuthology.orchestra.run.smithi073.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T18:22:27.365 INFO:teuthology.orchestra.run.smithi143.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T18:22:27.366 INFO:teuthology.orchestra.run.smithi143.stdout:Sourcing file `/etc/default/grub' 2024-09-12T18:22:27.375 INFO:teuthology.orchestra.run.smithi143.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T18:22:27.395 INFO:teuthology.orchestra.run.smithi143.stdout:Generating grub configuration file ... 2024-09-12T18:22:27.643 INFO:teuthology.orchestra.run.smithi143.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T18:22:27.661 INFO:teuthology.orchestra.run.smithi143.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T18:22:27.755 INFO:teuthology.orchestra.run.smithi114.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T18:22:27.755 INFO:teuthology.orchestra.run.smithi114.stdout:Sourcing file `/etc/default/grub' 2024-09-12T18:22:27.776 INFO:teuthology.orchestra.run.smithi114.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T18:22:27.802 INFO:teuthology.orchestra.run.smithi114.stdout:Generating grub configuration file ... 2024-09-12T18:22:27.973 INFO:teuthology.orchestra.run.smithi143.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T18:22:27.979 INFO:teuthology.orchestra.run.smithi143.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T18:22:28.049 INFO:teuthology.orchestra.run.smithi143.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T18:22:28.055 INFO:teuthology.orchestra.run.smithi143.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T18:22:28.097 INFO:teuthology.orchestra.run.smithi114.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T18:22:28.120 INFO:teuthology.orchestra.run.smithi114.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T18:22:28.197 INFO:teuthology.orchestra.run.smithi143.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T18:22:28.197 INFO:teuthology.orchestra.run.smithi143.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T18:22:28.197 INFO:teuthology.orchestra.run.smithi143.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T18:22:28.245 INFO:teuthology.orchestra.run.smithi143.stdout:done 2024-09-12T18:22:28.450 INFO:teuthology.orchestra.run.smithi114.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T18:22:28.455 INFO:teuthology.orchestra.run.smithi114.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T18:22:28.527 INFO:teuthology.orchestra.run.smithi114.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T18:22:28.532 INFO:teuthology.orchestra.run.smithi114.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T18:22:28.735 INFO:teuthology.orchestra.run.smithi114.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T18:22:28.735 INFO:teuthology.orchestra.run.smithi114.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T18:22:28.736 INFO:teuthology.orchestra.run.smithi114.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T18:22:28.746 INFO:teuthology.orchestra.run.smithi162.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T18:22:28.747 INFO:teuthology.orchestra.run.smithi162.stdout:Sourcing file `/etc/default/grub' 2024-09-12T18:22:28.753 DEBUG:teuthology.orchestra.run.smithi143:> dpkg -s linux-image-generic 2024-09-12T18:22:28.762 INFO:teuthology.orchestra.run.smithi162.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T18:22:28.775 INFO:teuthology.orchestra.run.smithi162.stdout:Generating grub configuration file ... 2024-09-12T18:22:28.776 INFO:teuthology.orchestra.run.smithi143.stdout:Package: linux-image-generic 2024-09-12T18:22:28.777 INFO:teuthology.orchestra.run.smithi143.stdout:Status: install ok installed 2024-09-12T18:22:28.777 INFO:teuthology.orchestra.run.smithi143.stdout:Priority: optional 2024-09-12T18:22:28.777 INFO:teuthology.orchestra.run.smithi143.stdout:Section: kernel 2024-09-12T18:22:28.777 INFO:teuthology.orchestra.run.smithi143.stdout:Installed-Size: 21 2024-09-12T18:22:28.777 INFO:teuthology.orchestra.run.smithi143.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T18:22:28.777 INFO:teuthology.orchestra.run.smithi143.stdout:Architecture: amd64 2024-09-12T18:22:28.777 INFO:teuthology.orchestra.run.smithi143.stdout:Source: linux-meta 2024-09-12T18:22:28.777 INFO:teuthology.orchestra.run.smithi143.stdout:Version: 5.15.0.119.119 2024-09-12T18:22:28.777 INFO:teuthology.orchestra.run.smithi143.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T18:22:28.777 INFO:teuthology.orchestra.run.smithi143.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T18:22:28.777 INFO:teuthology.orchestra.run.smithi143.stdout:Recommends: thermald 2024-09-12T18:22:28.777 INFO:teuthology.orchestra.run.smithi143.stdout:Description: Generic Linux kernel image 2024-09-12T18:22:28.777 INFO:teuthology.orchestra.run.smithi143.stdout: This package will always depend on the latest generic kernel image 2024-09-12T18:22:28.778 INFO:teuthology.orchestra.run.smithi143.stdout: available. 2024-09-12T18:22:28.778 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T18:22:28.778 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T18:22:28.778 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T18:22:28.778 INFO:teuthology.task.kernel:Installing distro kernel on osd.1... 2024-09-12T18:22:28.778 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi143.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T18:22:28.779 DEBUG:teuthology.orchestra.run.smithi143:> sudo apt-get clean 2024-09-12T18:22:28.780 INFO:teuthology.orchestra.run.smithi114.stdout:done 2024-09-12T18:22:28.799 INFO:teuthology.orchestra.run.smithi073.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T18:22:28.799 INFO:teuthology.orchestra.run.smithi073.stdout:Sourcing file `/etc/default/grub' 2024-09-12T18:22:28.830 INFO:teuthology.orchestra.run.smithi073.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T18:22:28.888 INFO:teuthology.orchestra.run.smithi073.stdout:Generating grub configuration file ... 2024-09-12T18:22:28.945 DEBUG:teuthology.orchestra.run.smithi143:> sudo apt-get update 2024-09-12T18:22:29.048 INFO:teuthology.orchestra.run.smithi162.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T18:22:29.063 INFO:teuthology.orchestra.run.smithi143.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T18:22:29.076 INFO:teuthology.orchestra.run.smithi162.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T18:22:29.205 INFO:teuthology.orchestra.run.smithi143.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T18:22:29.282 DEBUG:teuthology.orchestra.run.smithi114:> dpkg -s linux-image-generic 2024-09-12T18:22:29.286 INFO:teuthology.orchestra.run.smithi143.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T18:22:29.294 INFO:teuthology.orchestra.run.smithi073.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T18:22:29.302 INFO:teuthology.orchestra.run.smithi114.stdout:Package: linux-image-generic 2024-09-12T18:22:29.303 INFO:teuthology.orchestra.run.smithi114.stdout:Status: install ok installed 2024-09-12T18:22:29.303 INFO:teuthology.orchestra.run.smithi114.stdout:Priority: optional 2024-09-12T18:22:29.303 INFO:teuthology.orchestra.run.smithi114.stdout:Section: kernel 2024-09-12T18:22:29.303 INFO:teuthology.orchestra.run.smithi114.stdout:Installed-Size: 21 2024-09-12T18:22:29.303 INFO:teuthology.orchestra.run.smithi114.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T18:22:29.303 INFO:teuthology.orchestra.run.smithi114.stdout:Architecture: amd64 2024-09-12T18:22:29.303 INFO:teuthology.orchestra.run.smithi114.stdout:Source: linux-meta 2024-09-12T18:22:29.303 INFO:teuthology.orchestra.run.smithi114.stdout:Version: 5.15.0.119.119 2024-09-12T18:22:29.303 INFO:teuthology.orchestra.run.smithi114.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T18:22:29.303 INFO:teuthology.orchestra.run.smithi114.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T18:22:29.303 INFO:teuthology.orchestra.run.smithi114.stdout:Recommends: thermald 2024-09-12T18:22:29.303 INFO:teuthology.orchestra.run.smithi114.stdout:Description: Generic Linux kernel image 2024-09-12T18:22:29.304 INFO:teuthology.orchestra.run.smithi114.stdout: This package will always depend on the latest generic kernel image 2024-09-12T18:22:29.304 INFO:teuthology.orchestra.run.smithi114.stdout: available. 2024-09-12T18:22:29.304 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T18:22:29.304 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T18:22:29.304 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T18:22:29.304 INFO:teuthology.task.kernel:Installing distro kernel on osd.0... 2024-09-12T18:22:29.304 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi114.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T18:22:29.304 DEBUG:teuthology.orchestra.run.smithi114:> sudo apt-get clean 2024-09-12T18:22:29.315 INFO:teuthology.orchestra.run.smithi073.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T18:22:29.367 INFO:teuthology.orchestra.run.smithi143.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T18:22:29.396 INFO:teuthology.orchestra.run.smithi162.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T18:22:29.402 INFO:teuthology.orchestra.run.smithi162.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T18:22:29.478 INFO:teuthology.orchestra.run.smithi162.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T18:22:29.484 INFO:teuthology.orchestra.run.smithi162.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T18:22:29.495 DEBUG:teuthology.orchestra.run.smithi114:> sudo apt-get update 2024-09-12T18:22:29.617 INFO:teuthology.orchestra.run.smithi114.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T18:22:29.617 INFO:teuthology.orchestra.run.smithi114.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T18:22:29.626 INFO:teuthology.orchestra.run.smithi114.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T18:22:29.643 INFO:teuthology.orchestra.run.smithi162.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T18:22:29.643 INFO:teuthology.orchestra.run.smithi162.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T18:22:29.643 INFO:teuthology.orchestra.run.smithi162.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T18:22:29.643 INFO:teuthology.orchestra.run.smithi114.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T18:22:29.679 INFO:teuthology.orchestra.run.smithi162.stdout:done 2024-09-12T18:22:29.737 INFO:teuthology.orchestra.run.smithi073.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T18:22:29.743 INFO:teuthology.orchestra.run.smithi073.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T18:22:29.812 INFO:teuthology.orchestra.run.smithi073.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T18:22:29.817 INFO:teuthology.orchestra.run.smithi073.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T18:22:30.013 INFO:teuthology.orchestra.run.smithi073.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T18:22:30.014 INFO:teuthology.orchestra.run.smithi073.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T18:22:30.014 INFO:teuthology.orchestra.run.smithi073.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T18:22:30.050 INFO:teuthology.orchestra.run.smithi073.stdout:done 2024-09-12T18:22:30.197 DEBUG:teuthology.orchestra.run.smithi162:> dpkg -s linux-image-generic 2024-09-12T18:22:30.213 INFO:teuthology.orchestra.run.smithi162.stdout:Package: linux-image-generic 2024-09-12T18:22:30.213 INFO:teuthology.orchestra.run.smithi162.stdout:Status: install ok installed 2024-09-12T18:22:30.213 INFO:teuthology.orchestra.run.smithi162.stdout:Priority: optional 2024-09-12T18:22:30.213 INFO:teuthology.orchestra.run.smithi162.stdout:Section: kernel 2024-09-12T18:22:30.213 INFO:teuthology.orchestra.run.smithi162.stdout:Installed-Size: 21 2024-09-12T18:22:30.213 INFO:teuthology.orchestra.run.smithi162.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T18:22:30.213 INFO:teuthology.orchestra.run.smithi162.stdout:Architecture: amd64 2024-09-12T18:22:30.213 INFO:teuthology.orchestra.run.smithi162.stdout:Source: linux-meta 2024-09-12T18:22:30.214 INFO:teuthology.orchestra.run.smithi162.stdout:Version: 5.15.0.119.119 2024-09-12T18:22:30.214 INFO:teuthology.orchestra.run.smithi162.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T18:22:30.214 INFO:teuthology.orchestra.run.smithi162.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T18:22:30.214 INFO:teuthology.orchestra.run.smithi162.stdout:Recommends: thermald 2024-09-12T18:22:30.214 INFO:teuthology.orchestra.run.smithi162.stdout:Description: Generic Linux kernel image 2024-09-12T18:22:30.214 INFO:teuthology.orchestra.run.smithi162.stdout: This package will always depend on the latest generic kernel image 2024-09-12T18:22:30.214 INFO:teuthology.orchestra.run.smithi162.stdout: available. 2024-09-12T18:22:30.214 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T18:22:30.214 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T18:22:30.214 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T18:22:30.215 INFO:teuthology.task.kernel:Installing distro kernel on osd.2... 2024-09-12T18:22:30.215 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi162.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T18:22:30.215 DEBUG:teuthology.orchestra.run.smithi162:> sudo apt-get clean 2024-09-12T18:22:30.403 DEBUG:teuthology.orchestra.run.smithi162:> sudo apt-get update 2024-09-12T18:22:30.511 INFO:teuthology.orchestra.run.smithi143.stdout:Reading package lists... 2024-09-12T18:22:30.533 DEBUG:teuthology.orchestra.run.smithi143:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T18:22:30.534 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T18:22:30.539 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T18:22:30.540 DEBUG:teuthology.orchestra.run.smithi073:> dpkg -s linux-image-generic 2024-09-12T18:22:30.556 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T18:22:30.601 INFO:teuthology.orchestra.run.smithi143.stdout:Reading package lists... 2024-09-12T18:22:30.603 INFO:teuthology.orchestra.run.smithi073.stdout:Package: linux-image-generic 2024-09-12T18:22:30.603 INFO:teuthology.orchestra.run.smithi073.stdout:Status: install ok installed 2024-09-12T18:22:30.603 INFO:teuthology.orchestra.run.smithi073.stdout:Priority: optional 2024-09-12T18:22:30.603 INFO:teuthology.orchestra.run.smithi073.stdout:Section: kernel 2024-09-12T18:22:30.603 INFO:teuthology.orchestra.run.smithi073.stdout:Installed-Size: 21 2024-09-12T18:22:30.603 INFO:teuthology.orchestra.run.smithi073.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T18:22:30.603 INFO:teuthology.orchestra.run.smithi073.stdout:Architecture: amd64 2024-09-12T18:22:30.604 INFO:teuthology.orchestra.run.smithi073.stdout:Source: linux-meta 2024-09-12T18:22:30.604 INFO:teuthology.orchestra.run.smithi073.stdout:Version: 5.15.0.119.119 2024-09-12T18:22:30.604 INFO:teuthology.orchestra.run.smithi073.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T18:22:30.604 INFO:teuthology.orchestra.run.smithi073.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T18:22:30.604 INFO:teuthology.orchestra.run.smithi073.stdout:Recommends: thermald 2024-09-12T18:22:30.604 INFO:teuthology.orchestra.run.smithi073.stdout:Description: Generic Linux kernel image 2024-09-12T18:22:30.604 INFO:teuthology.orchestra.run.smithi073.stdout: This package will always depend on the latest generic kernel image 2024-09-12T18:22:30.604 INFO:teuthology.orchestra.run.smithi073.stdout: available. 2024-09-12T18:22:30.604 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T18:22:30.604 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T18:22:30.604 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T18:22:30.605 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-12T18:22:30.605 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi073.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T18:22:30.605 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get clean 2024-09-12T18:22:30.648 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T18:22:30.788 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get update 2024-09-12T18:22:30.790 INFO:teuthology.orchestra.run.smithi143.stdout:Building dependency tree... 2024-09-12T18:22:30.791 INFO:teuthology.orchestra.run.smithi143.stdout:Reading state information... 2024-09-12T18:22:30.960 INFO:teuthology.orchestra.run.smithi143.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T18:22:30.960 INFO:teuthology.orchestra.run.smithi143.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:22:30.960 INFO:teuthology.orchestra.run.smithi143.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:22:30.960 INFO:teuthology.orchestra.run.smithi143.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:22:30.960 INFO:teuthology.orchestra.run.smithi143.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:22:30.961 INFO:teuthology.orchestra.run.smithi143.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T18:22:30.961 INFO:teuthology.orchestra.run.smithi143.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T18:22:30.961 INFO:teuthology.orchestra.run.smithi143.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:22:31.002 INFO:teuthology.orchestra.run.smithi143.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T18:22:31.003 DEBUG:teuthology.orchestra.run.smithi143:> dpkg -s linux-image-generic 2024-09-12T18:22:31.008 INFO:teuthology.orchestra.run.smithi114.stdout:Reading package lists... 2024-09-12T18:22:31.019 INFO:teuthology.orchestra.run.smithi143.stdout:Package: linux-image-generic 2024-09-12T18:22:31.019 INFO:teuthology.orchestra.run.smithi143.stdout:Status: install ok installed 2024-09-12T18:22:31.019 INFO:teuthology.orchestra.run.smithi143.stdout:Priority: optional 2024-09-12T18:22:31.020 INFO:teuthology.orchestra.run.smithi143.stdout:Section: kernel 2024-09-12T18:22:31.020 INFO:teuthology.orchestra.run.smithi143.stdout:Installed-Size: 21 2024-09-12T18:22:31.020 INFO:teuthology.orchestra.run.smithi143.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T18:22:31.020 INFO:teuthology.orchestra.run.smithi143.stdout:Architecture: amd64 2024-09-12T18:22:31.020 INFO:teuthology.orchestra.run.smithi143.stdout:Source: linux-meta 2024-09-12T18:22:31.020 INFO:teuthology.orchestra.run.smithi143.stdout:Version: 5.15.0.119.119 2024-09-12T18:22:31.020 INFO:teuthology.orchestra.run.smithi143.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T18:22:31.020 INFO:teuthology.orchestra.run.smithi143.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T18:22:31.020 INFO:teuthology.orchestra.run.smithi143.stdout:Recommends: thermald 2024-09-12T18:22:31.020 INFO:teuthology.orchestra.run.smithi143.stdout:Description: Generic Linux kernel image 2024-09-12T18:22:31.020 INFO:teuthology.orchestra.run.smithi143.stdout: This package will always depend on the latest generic kernel image 2024-09-12T18:22:31.020 INFO:teuthology.orchestra.run.smithi143.stdout: available. 2024-09-12T18:22:31.021 DEBUG:teuthology.orchestra.run.smithi143:> mktemp 2024-09-12T18:22:31.026 DEBUG:teuthology.orchestra.run.smithi114:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T18:22:31.038 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T18:22:31.065 INFO:teuthology.orchestra.run.smithi143.stdout:/tmp/tmp.iD0LEvLBlk 2024-09-12T18:22:31.065 DEBUG:teuthology.orchestra.run.smithi143:> sudo cp /boot/grub/grub.cfg /tmp/tmp.iD0LEvLBlk 2024-09-12T18:22:31.074 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T18:22:31.088 INFO:teuthology.orchestra.run.smithi114.stdout:Reading package lists... 2024-09-12T18:22:31.091 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T18:22:31.109 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T18:22:31.121 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 0666 /tmp/tmp.iD0LEvLBlk 2024-09-12T18:22:31.236 DEBUG:teuthology.orchestra.remote:smithi143:/tmp/tmp.iD0LEvLBlk is 10KB 2024-09-12T18:22:31.249 DEBUG:teuthology.orchestra.run.smithi143:> rm -fr /tmp/tmp.iD0LEvLBlk 2024-09-12T18:22:31.254 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T18:22:31.301 INFO:teuthology.orchestra.run.smithi114.stdout:Building dependency tree... 2024-09-12T18:22:31.303 INFO:teuthology.orchestra.run.smithi114.stdout:Reading state information... 2024-09-12T18:22:31.308 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-12T18:22:31.308 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T18:22:31.308 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T18:22:31.374 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T18:22:31.375 DEBUG:teuthology.orchestra.run.smithi143:> sudo update-grub 2024-09-12T18:22:31.483 INFO:teuthology.orchestra.run.smithi114.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T18:22:31.483 INFO:teuthology.orchestra.run.smithi114.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:22:31.484 INFO:teuthology.orchestra.run.smithi114.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:22:31.484 INFO:teuthology.orchestra.run.smithi114.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:22:31.484 INFO:teuthology.orchestra.run.smithi114.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:22:31.484 INFO:teuthology.orchestra.run.smithi114.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T18:22:31.484 INFO:teuthology.orchestra.run.smithi114.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T18:22:31.485 INFO:teuthology.orchestra.run.smithi114.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:22:31.526 INFO:teuthology.orchestra.run.smithi114.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T18:22:31.528 DEBUG:teuthology.orchestra.run.smithi114:> dpkg -s linux-image-generic 2024-09-12T18:22:31.540 INFO:teuthology.orchestra.run.smithi114.stdout:Package: linux-image-generic 2024-09-12T18:22:31.540 INFO:teuthology.orchestra.run.smithi114.stdout:Status: install ok installed 2024-09-12T18:22:31.541 INFO:teuthology.orchestra.run.smithi114.stdout:Priority: optional 2024-09-12T18:22:31.541 INFO:teuthology.orchestra.run.smithi114.stdout:Section: kernel 2024-09-12T18:22:31.541 INFO:teuthology.orchestra.run.smithi114.stdout:Installed-Size: 21 2024-09-12T18:22:31.541 INFO:teuthology.orchestra.run.smithi114.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T18:22:31.541 INFO:teuthology.orchestra.run.smithi114.stdout:Architecture: amd64 2024-09-12T18:22:31.541 INFO:teuthology.orchestra.run.smithi114.stdout:Source: linux-meta 2024-09-12T18:22:31.541 INFO:teuthology.orchestra.run.smithi114.stdout:Version: 5.15.0.119.119 2024-09-12T18:22:31.541 INFO:teuthology.orchestra.run.smithi114.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T18:22:31.542 INFO:teuthology.orchestra.run.smithi114.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T18:22:31.542 INFO:teuthology.orchestra.run.smithi114.stdout:Recommends: thermald 2024-09-12T18:22:31.542 INFO:teuthology.orchestra.run.smithi114.stdout:Description: Generic Linux kernel image 2024-09-12T18:22:31.542 INFO:teuthology.orchestra.run.smithi114.stdout: This package will always depend on the latest generic kernel image 2024-09-12T18:22:31.542 INFO:teuthology.orchestra.run.smithi114.stdout: available. 2024-09-12T18:22:31.542 DEBUG:teuthology.orchestra.run.smithi114:> mktemp 2024-09-12T18:22:31.591 INFO:teuthology.orchestra.run.smithi114.stdout:/tmp/tmp.Zop3Dqc2Fh 2024-09-12T18:22:31.591 DEBUG:teuthology.orchestra.run.smithi114:> sudo cp /boot/grub/grub.cfg /tmp/tmp.Zop3Dqc2Fh 2024-09-12T18:22:31.641 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0666 /tmp/tmp.Zop3Dqc2Fh 2024-09-12T18:22:31.767 DEBUG:teuthology.orchestra.remote:smithi114:/tmp/tmp.Zop3Dqc2Fh is 10KB 2024-09-12T18:22:31.779 DEBUG:teuthology.orchestra.run.smithi114:> rm -fr /tmp/tmp.Zop3Dqc2Fh 2024-09-12T18:22:31.784 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T18:22:31.839 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-12T18:22:31.839 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T18:22:31.839 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T18:22:31.915 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T18:22:31.916 DEBUG:teuthology.orchestra.run.smithi114:> sudo update-grub 2024-09-12T18:22:31.955 INFO:teuthology.orchestra.run.smithi162.stdout:Reading package lists... 2024-09-12T18:22:31.973 DEBUG:teuthology.orchestra.run.smithi162:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T18:22:32.035 INFO:teuthology.orchestra.run.smithi162.stdout:Reading package lists... 2024-09-12T18:22:32.245 INFO:teuthology.orchestra.run.smithi162.stdout:Building dependency tree... 2024-09-12T18:22:32.245 INFO:teuthology.orchestra.run.smithi162.stdout:Reading state information... 2024-09-12T18:22:32.431 INFO:teuthology.orchestra.run.smithi162.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T18:22:32.431 INFO:teuthology.orchestra.run.smithi162.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:22:32.431 INFO:teuthology.orchestra.run.smithi162.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:22:32.431 INFO:teuthology.orchestra.run.smithi162.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:22:32.432 INFO:teuthology.orchestra.run.smithi162.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:22:32.432 INFO:teuthology.orchestra.run.smithi162.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T18:22:32.432 INFO:teuthology.orchestra.run.smithi162.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T18:22:32.432 INFO:teuthology.orchestra.run.smithi162.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:22:32.475 INFO:teuthology.orchestra.run.smithi162.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T18:22:32.476 DEBUG:teuthology.orchestra.run.smithi162:> dpkg -s linux-image-generic 2024-09-12T18:22:32.492 INFO:teuthology.orchestra.run.smithi162.stdout:Package: linux-image-generic 2024-09-12T18:22:32.492 INFO:teuthology.orchestra.run.smithi162.stdout:Status: install ok installed 2024-09-12T18:22:32.492 INFO:teuthology.orchestra.run.smithi162.stdout:Priority: optional 2024-09-12T18:22:32.492 INFO:teuthology.orchestra.run.smithi162.stdout:Section: kernel 2024-09-12T18:22:32.492 INFO:teuthology.orchestra.run.smithi162.stdout:Installed-Size: 21 2024-09-12T18:22:32.492 INFO:teuthology.orchestra.run.smithi162.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T18:22:32.492 INFO:teuthology.orchestra.run.smithi162.stdout:Architecture: amd64 2024-09-12T18:22:32.493 INFO:teuthology.orchestra.run.smithi162.stdout:Source: linux-meta 2024-09-12T18:22:32.493 INFO:teuthology.orchestra.run.smithi162.stdout:Version: 5.15.0.119.119 2024-09-12T18:22:32.493 INFO:teuthology.orchestra.run.smithi162.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T18:22:32.493 INFO:teuthology.orchestra.run.smithi162.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T18:22:32.493 INFO:teuthology.orchestra.run.smithi162.stdout:Recommends: thermald 2024-09-12T18:22:32.493 INFO:teuthology.orchestra.run.smithi162.stdout:Description: Generic Linux kernel image 2024-09-12T18:22:32.493 INFO:teuthology.orchestra.run.smithi162.stdout: This package will always depend on the latest generic kernel image 2024-09-12T18:22:32.493 INFO:teuthology.orchestra.run.smithi162.stdout: available. 2024-09-12T18:22:32.494 DEBUG:teuthology.orchestra.run.smithi162:> mktemp 2024-09-12T18:22:32.527 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-09-12T18:22:32.538 INFO:teuthology.orchestra.run.smithi162.stdout:/tmp/tmp.M9mMFLKUHp 2024-09-12T18:22:32.538 DEBUG:teuthology.orchestra.run.smithi162:> sudo cp /boot/grub/grub.cfg /tmp/tmp.M9mMFLKUHp 2024-09-12T18:22:32.544 DEBUG:teuthology.orchestra.run.smithi073:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T18:22:32.595 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0666 /tmp/tmp.M9mMFLKUHp 2024-09-12T18:22:32.597 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-09-12T18:22:32.635 INFO:teuthology.orchestra.run.smithi143.stderr:Sourcing file `/etc/default/grub' 2024-09-12T18:22:32.636 INFO:teuthology.orchestra.run.smithi143.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T18:22:32.638 INFO:teuthology.orchestra.run.smithi143.stderr:Generating grub configuration file ... 2024-09-12T18:22:32.712 DEBUG:teuthology.orchestra.remote:smithi162:/tmp/tmp.M9mMFLKUHp is 10KB 2024-09-12T18:22:32.725 DEBUG:teuthology.orchestra.run.smithi162:> rm -fr /tmp/tmp.M9mMFLKUHp 2024-09-12T18:22:32.730 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T18:22:32.781 INFO:teuthology.orchestra.run.smithi073.stdout:Building dependency tree... 2024-09-12T18:22:32.782 INFO:teuthology.orchestra.run.smithi073.stdout:Reading state information... 2024-09-12T18:22:32.783 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-12T18:22:32.783 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T18:22:32.783 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T18:22:32.810 INFO:teuthology.orchestra.run.smithi143.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T18:22:32.816 INFO:teuthology.orchestra.run.smithi143.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T18:22:32.861 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T18:22:32.862 DEBUG:teuthology.orchestra.run.smithi162:> sudo update-grub 2024-09-12T18:22:32.948 INFO:teuthology.orchestra.run.smithi073.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T18:22:32.948 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:22:32.948 INFO:teuthology.orchestra.run.smithi073.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:22:32.948 INFO:teuthology.orchestra.run.smithi073.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:22:32.948 INFO:teuthology.orchestra.run.smithi073.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:22:32.949 INFO:teuthology.orchestra.run.smithi073.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T18:22:32.949 INFO:teuthology.orchestra.run.smithi073.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T18:22:32.949 INFO:teuthology.orchestra.run.smithi073.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:22:32.989 INFO:teuthology.orchestra.run.smithi073.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T18:22:32.990 DEBUG:teuthology.orchestra.run.smithi073:> dpkg -s linux-image-generic 2024-09-12T18:22:33.046 INFO:teuthology.orchestra.run.smithi073.stdout:Package: linux-image-generic 2024-09-12T18:22:33.047 INFO:teuthology.orchestra.run.smithi073.stdout:Status: install ok installed 2024-09-12T18:22:33.047 INFO:teuthology.orchestra.run.smithi073.stdout:Priority: optional 2024-09-12T18:22:33.047 INFO:teuthology.orchestra.run.smithi073.stdout:Section: kernel 2024-09-12T18:22:33.047 INFO:teuthology.orchestra.run.smithi073.stdout:Installed-Size: 21 2024-09-12T18:22:33.047 INFO:teuthology.orchestra.run.smithi073.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T18:22:33.047 INFO:teuthology.orchestra.run.smithi073.stdout:Architecture: amd64 2024-09-12T18:22:33.047 INFO:teuthology.orchestra.run.smithi073.stdout:Source: linux-meta 2024-09-12T18:22:33.047 INFO:teuthology.orchestra.run.smithi073.stdout:Version: 5.15.0.119.119 2024-09-12T18:22:33.047 INFO:teuthology.orchestra.run.smithi073.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T18:22:33.047 INFO:teuthology.orchestra.run.smithi073.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T18:22:33.047 INFO:teuthology.orchestra.run.smithi073.stdout:Recommends: thermald 2024-09-12T18:22:33.047 INFO:teuthology.orchestra.run.smithi073.stdout:Description: Generic Linux kernel image 2024-09-12T18:22:33.048 INFO:teuthology.orchestra.run.smithi073.stdout: This package will always depend on the latest generic kernel image 2024-09-12T18:22:33.048 INFO:teuthology.orchestra.run.smithi073.stdout: available. 2024-09-12T18:22:33.048 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-09-12T18:22:33.052 INFO:teuthology.orchestra.run.smithi143.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T18:22:33.058 INFO:teuthology.orchestra.run.smithi143.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T18:22:33.092 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.lIDuN1tWeo 2024-09-12T18:22:33.092 DEBUG:teuthology.orchestra.run.smithi073:> sudo cp /boot/grub/grub.cfg /tmp/tmp.lIDuN1tWeo 2024-09-12T18:22:33.100 INFO:teuthology.orchestra.run.smithi143.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T18:22:33.106 INFO:teuthology.orchestra.run.smithi143.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T18:22:33.148 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.lIDuN1tWeo 2024-09-12T18:22:33.222 INFO:teuthology.orchestra.run.smithi114.stderr:Sourcing file `/etc/default/grub' 2024-09-12T18:22:33.223 INFO:teuthology.orchestra.run.smithi114.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T18:22:33.230 INFO:teuthology.orchestra.run.smithi114.stderr:Generating grub configuration file ... 2024-09-12T18:22:33.256 INFO:teuthology.orchestra.run.smithi143.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T18:22:33.256 INFO:teuthology.orchestra.run.smithi143.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T18:22:33.256 INFO:teuthology.orchestra.run.smithi143.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T18:22:33.277 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.lIDuN1tWeo is 10KB 2024-09-12T18:22:33.287 INFO:teuthology.orchestra.run.smithi143.stderr:done 2024-09-12T18:22:33.291 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.lIDuN1tWeo 2024-09-12T18:22:33.295 DEBUG:teuthology.orchestra.run.smithi143:> sudo shutdown -r now 2024-09-12T18:22:33.296 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T18:22:33.352 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T18:22:33.353 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T18:22:33.353 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T18:22:33.421 INFO:teuthology.orchestra.run.smithi114.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T18:22:33.427 INFO:teuthology.orchestra.run.smithi114.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T18:22:33.430 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T18:22:33.431 DEBUG:teuthology.orchestra.run.smithi073:> sudo update-grub 2024-09-12T18:22:33.682 INFO:teuthology.orchestra.run.smithi114.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T18:22:33.687 INFO:teuthology.orchestra.run.smithi114.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T18:22:33.727 INFO:teuthology.orchestra.run.smithi114.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T18:22:33.733 INFO:teuthology.orchestra.run.smithi114.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T18:22:33.873 INFO:teuthology.orchestra.run.smithi114.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T18:22:33.874 INFO:teuthology.orchestra.run.smithi114.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T18:22:33.874 INFO:teuthology.orchestra.run.smithi114.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T18:22:33.885 INFO:teuthology.orchestra.run.smithi114.stderr:done 2024-09-12T18:22:33.889 DEBUG:teuthology.orchestra.run.smithi114:> sudo shutdown -r now 2024-09-12T18:22:34.254 INFO:teuthology.orchestra.run.smithi162.stderr:Sourcing file `/etc/default/grub' 2024-09-12T18:22:34.255 INFO:teuthology.orchestra.run.smithi162.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T18:22:34.259 INFO:teuthology.orchestra.run.smithi162.stderr:Generating grub configuration file ... 2024-09-12T18:22:34.440 INFO:teuthology.orchestra.run.smithi162.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T18:22:34.446 INFO:teuthology.orchestra.run.smithi162.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T18:22:34.672 INFO:teuthology.orchestra.run.smithi162.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T18:22:34.677 INFO:teuthology.orchestra.run.smithi162.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T18:22:34.715 INFO:teuthology.orchestra.run.smithi162.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T18:22:34.720 INFO:teuthology.orchestra.run.smithi162.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T18:22:34.800 INFO:teuthology.orchestra.run.smithi073.stderr:Sourcing file `/etc/default/grub' 2024-09-12T18:22:34.801 INFO:teuthology.orchestra.run.smithi073.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T18:22:34.807 INFO:teuthology.orchestra.run.smithi073.stderr:Generating grub configuration file ... 2024-09-12T18:22:34.826 INFO:teuthology.orchestra.run.smithi162.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T18:22:34.826 INFO:teuthology.orchestra.run.smithi162.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T18:22:34.826 INFO:teuthology.orchestra.run.smithi162.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T18:22:34.845 INFO:teuthology.orchestra.run.smithi162.stderr:done 2024-09-12T18:22:34.854 DEBUG:teuthology.orchestra.run.smithi162:> sudo shutdown -r now 2024-09-12T18:22:35.040 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T18:22:35.045 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T18:22:35.352 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T18:22:35.358 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T18:22:35.402 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T18:22:35.407 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T18:22:35.550 INFO:teuthology.orchestra.run.smithi073.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T18:22:35.551 INFO:teuthology.orchestra.run.smithi073.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T18:22:35.551 INFO:teuthology.orchestra.run.smithi073.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T18:22:35.581 INFO:teuthology.orchestra.run.smithi073.stderr:done 2024-09-12T18:22:35.589 DEBUG:teuthology.orchestra.run.smithi073:> sudo shutdown -r now 2024-09-12T18:23:03.325 INFO:teuthology.task.kernel:Checking client osd.1 for new kernel version... 2024-09-12T18:23:03.325 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-09-12T18:23:03.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:23:03.892 INFO:teuthology.task.kernel:Checking client osd.0 for new kernel version... 2024-09-12T18:23:03.892 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-09-12T18:23:03.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:23:04.858 INFO:teuthology.task.kernel:Checking client osd.2 for new kernel version... 2024-09-12T18:23:04.858 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-12T18:23:04.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:23:05.593 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-12T18:23:05.594 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-12T18:23:05.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:23:37.790 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.143 2024-09-12T18:23:38.557 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.114 2024-09-12T18:23:39.325 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-09-12T18:23:46.797 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-09-12T18:23:46.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:23:47.559 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-09-12T18:23:47.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:23:48.327 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-12T18:23:48.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:23:50.621 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.114 2024-09-12T18:24:02.636 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-09-12T18:24:02.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:24:05.600 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T18:24:05.697 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.114 2024-09-12T18:24:06.717 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-09-12T18:24:14.609 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-12T18:24:14.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:24:15.613 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-09-12T18:24:18.486 ERROR:teuthology.orchestra.connection:Error authenticating with smithi143.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2024-09-12T18:24:18.718 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-12T18:24:18.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:24:20.699 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-09-12T18:24:20.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:24:20.788 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-09-12T18:24:21.253 DEBUG:teuthology.orchestra.run.smithi114:> true 2024-09-12T18:24:21.785 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-09-12T18:24:21.786 INFO:teuthology.task.kernel:Checking kernel version of osd.0, want "5.15.0-119-generic"... 2024-09-12T18:24:21.786 DEBUG:teuthology.orchestra.run.smithi114:> uname -r 2024-09-12T18:24:21.834 INFO:teuthology.orchestra.run.smithi114.stdout:5.15.0-119-generic 2024-09-12T18:24:21.835 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T18:24:21.835 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T18:24:21.835 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T18:24:22.570 DEBUG:teuthology.orchestra.run.smithi143:> true 2024-09-12T18:24:22.836 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2024-09-12T18:24:22.836 DEBUG:teuthology.orchestra.run.smithi114:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T18:24:22.907 INFO:teuthology.orchestra.run.smithi114.stdout:ttyS1 2024-09-12T18:24:22.932 DEBUG:teuthology.parallel:result is None 2024-09-12T18:24:23.777 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-09-12T18:24:23.777 INFO:teuthology.task.kernel:Checking kernel version of osd.1, want "5.15.0-119-generic"... 2024-09-12T18:24:23.777 DEBUG:teuthology.orchestra.run.smithi143:> uname -r 2024-09-12T18:24:23.824 INFO:teuthology.orchestra.run.smithi143.stdout:5.15.0-119-generic 2024-09-12T18:24:23.825 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T18:24:23.825 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T18:24:23.825 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T18:24:24.826 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2024-09-12T18:24:24.826 DEBUG:teuthology.orchestra.run.smithi143:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T18:24:24.918 INFO:teuthology.orchestra.run.smithi143.stdout:ttyS1 2024-09-12T18:24:24.955 DEBUG:teuthology.parallel:result is None 2024-09-12T18:24:27.614 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-12T18:24:27.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:24:27.915 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-09-12T18:24:28.549 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-12T18:24:28.549 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-119-generic"... 2024-09-12T18:24:28.549 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2024-09-12T18:24:28.595 INFO:teuthology.orchestra.run.smithi073.stdout:5.15.0-119-generic 2024-09-12T18:24:28.595 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T18:24:28.595 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T18:24:28.595 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T18:24:29.596 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-12T18:24:29.596 DEBUG:teuthology.orchestra.run.smithi073:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T18:24:29.934 INFO:teuthology.orchestra.run.smithi073.stdout:ttyS1 2024-09-12T18:24:29.956 DEBUG:teuthology.parallel:result is None 2024-09-12T18:24:35.789 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-12T18:24:35.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:24:36.011 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-09-12T18:24:36.617 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-12T18:24:36.618 INFO:teuthology.task.kernel:Checking kernel version of osd.2, want "5.15.0-119-generic"... 2024-09-12T18:24:36.618 DEBUG:teuthology.orchestra.run.smithi162:> uname -r 2024-09-12T18:24:36.663 INFO:teuthology.orchestra.run.smithi162.stdout:5.15.0-119-generic 2024-09-12T18:24:36.663 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T18:24:36.663 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T18:24:36.663 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T18:24:37.664 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2024-09-12T18:24:37.664 DEBUG:teuthology.orchestra.run.smithi162:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T18:24:37.990 INFO:teuthology.orchestra.run.smithi162.stdout:ttyS1 2024-09-12T18:24:38.029 DEBUG:teuthology.parallel:result is None 2024-09-12T18:24:38.029 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T18:24:38.037 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T18:24:38.037 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T18:24:38.040 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T18:24:38.042 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T18:24:38.045 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T18:24:38.050 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T18:24:38.074 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T18:24:38.108 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T18:24:38.109 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T18:24:38.111 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T18:24:38.113 DEBUG:teuthology.orchestra.run.smithi143:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T18:24:38.116 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T18:24:38.210 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T18:24:38.218 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T18:24:38.218 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T18:24:38.221 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T18:24:38.223 DEBUG:teuthology.orchestra.run.smithi143:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T18:24:38.226 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T18:24:38.240 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T18:24:38.248 INFO:teuthology.orchestra.run.smithi143.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T18:24:38.248 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T18:24:38.249 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T18:24:38.251 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T18:24:38.256 INFO:teuthology.orchestra.run.smithi143.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T18:24:38.257 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T18:24:38.259 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T18:24:38.260 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T18:24:38.267 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T18:24:38.268 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T18:24:38.296 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T18:24:38.303 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T18:24:38.308 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T18:24:38.320 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T18:24:38.330 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T18:24:38.330 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T18:24:38.356 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T18:24:38.359 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T18:24:38.362 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T18:24:38.368 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T18:24:38.408 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T18:24:38.455 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T18:24:38.455 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T18:24:38.520 DEBUG:teuthology.orchestra.run.smithi114:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T18:24:38.526 DEBUG:teuthology.orchestra.run.smithi114:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T18:24:38.575 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-12T18:24:38.575 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T18:24:38.636 DEBUG:teuthology.orchestra.run.smithi143:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T18:24:38.642 DEBUG:teuthology.orchestra.run.smithi143:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T18:24:38.689 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-12T18:24:38.689 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T18:24:38.752 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T18:24:38.758 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T18:24:38.804 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-12T18:24:38.804 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T18:24:38.859 DEBUG:teuthology.orchestra.run.smithi073:> sudo service rsyslog restart 2024-09-12T18:24:38.862 DEBUG:teuthology.orchestra.run.smithi114:> sudo service rsyslog restart 2024-09-12T18:24:38.864 DEBUG:teuthology.orchestra.run.smithi143:> sudo service rsyslog restart 2024-09-12T18:24:38.866 DEBUG:teuthology.orchestra.run.smithi162:> sudo service rsyslog restart 2024-09-12T18:24:38.942 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T18:24:38.949 INFO:teuthology.task.internal:Starting timer... 2024-09-12T18:24:38.949 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T18:24:38.994 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T18:24:39.027 DEBUG:teuthology.task.selinux:Excluding smithi073: OS 'ubuntu' does not support SELinux 2024-09-12T18:24:39.028 DEBUG:teuthology.task.selinux:Excluding smithi114: OS 'ubuntu' does not support SELinux 2024-09-12T18:24:39.028 DEBUG:teuthology.task.selinux:Excluding smithi143: OS 'ubuntu' does not support SELinux 2024-09-12T18:24:39.028 DEBUG:teuthology.task.selinux:Excluding smithi162: OS 'ubuntu' does not support SELinux 2024-09-12T18:24:39.028 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T18:24:39.028 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-12T18:24:39.028 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T18:24:39.028 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T18:24:39.060 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-12T18:24:39.063 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-12T18:24:39.167 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T18:24:39.197 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T18:24:39.198 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi073.front.sepia.ceph.com,smithi114.front.sepia.ceph.com,smithi143.front.sepia.ceph.com,smithi162.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T18:32:18.148 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi073.front.sepia.ceph.com'), Remote(name='ubuntu@smithi114.front.sepia.ceph.com'), Remote(name='ubuntu@smithi143.front.sepia.ceph.com'), Remote(name='ubuntu@smithi162.front.sepia.ceph.com')] 2024-09-12T18:32:18.149 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-12T18:32:18.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:32:18.237 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-09-12T18:32:18.313 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-12T18:32:18.314 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-09-12T18:32:18.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:32:18.394 DEBUG:teuthology.orchestra.run.smithi114:> true 2024-09-12T18:32:18.473 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-09-12T18:32:18.473 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-09-12T18:32:18.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:32:18.555 DEBUG:teuthology.orchestra.run.smithi143:> true 2024-09-12T18:32:18.632 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-09-12T18:32:18.633 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-12T18:32:18.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:32:18.715 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-09-12T18:32:18.793 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-12T18:32:18.794 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T18:32:18.805 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T18:32:18.805 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T18:32:18.806 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T18:32:18.808 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T18:32:18.808 DEBUG:teuthology.orchestra.run.smithi114:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T18:32:18.812 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T18:32:18.812 DEBUG:teuthology.orchestra.run.smithi143:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T18:32:18.815 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T18:32:18.815 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T18:32:18.832 INFO:teuthology.orchestra.run.smithi073.stdout:12 Sep 18:32:18 ntpd[18459]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T18:32:18.833 INFO:teuthology.orchestra.run.smithi073.stdout:12 Sep 18:32:18 ntpd[18459]: Command line: ntpd -gq 2024-09-12T18:32:18.833 INFO:teuthology.orchestra.run.smithi073.stdout:12 Sep 18:32:18 ntpd[18459]: ---------------------------------------------------- 2024-09-12T18:32:18.833 INFO:teuthology.orchestra.run.smithi073.stdout:12 Sep 18:32:18 ntpd[18459]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T18:32:18.833 INFO:teuthology.orchestra.run.smithi073.stdout:12 Sep 18:32:18 ntpd[18459]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T18:32:18.833 INFO:teuthology.orchestra.run.smithi073.stdout:12 Sep 18:32:18 ntpd[18459]: corporation. Support and training for ntp-4 are 2024-09-12T18:32:18.833 INFO:teuthology.orchestra.run.smithi073.stdout:12 Sep 18:32:18 ntpd[18459]: available at https://www.nwtime.org/support 2024-09-12T18:32:18.833 INFO:teuthology.orchestra.run.smithi073.stdout:12 Sep 18:32:18 ntpd[18459]: ---------------------------------------------------- 2024-09-12T18:32:18.834 INFO:teuthology.orchestra.run.smithi073.stdout:12 Sep 18:32:18 ntpd[18459]: proto: precision = 0.072 usec (-24) 2024-09-12T18:32:18.834 INFO:teuthology.orchestra.run.smithi073.stdout:12 Sep 18:32:18 ntpd[18459]: basedate set to 2022-02-04 2024-09-12T18:32:18.834 INFO:teuthology.orchestra.run.smithi073.stdout:12 Sep 18:32:18 ntpd[18459]: gps base set to 2022-02-06 (week 2196) 2024-09-12T18:32:18.834 INFO:teuthology.orchestra.run.smithi073.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T18:32:18.834 INFO:teuthology.orchestra.run.smithi073.stdout:12 Sep 18:32:18 ntpd[18459]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T18:32:18.835 INFO:teuthology.orchestra.run.smithi073.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T18:32:18.836 INFO:teuthology.orchestra.run.smithi073.stdout:12 Sep 18:32:18 ntpd[18459]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T18:32:18.836 INFO:teuthology.orchestra.run.smithi073.stdout:12 Sep 18:32:18 ntpd[18459]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T18:32:18.836 INFO:teuthology.orchestra.run.smithi073.stdout:12 Sep 18:32:18 ntpd[18459]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T18:32:18.836 INFO:teuthology.orchestra.run.smithi073.stdout:12 Sep 18:32:18 ntpd[18459]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T18:32:18.836 INFO:teuthology.orchestra.run.smithi073.stdout:12 Sep 18:32:18 ntpd[18459]: Listen normally on 3 enp3s0f1 172.21.15.73:123 2024-09-12T18:32:18.836 INFO:teuthology.orchestra.run.smithi073.stdout:12 Sep 18:32:18 ntpd[18459]: Listen normally on 4 lo [::1]:123 2024-09-12T18:32:18.836 INFO:teuthology.orchestra.run.smithi073.stdout:12 Sep 18:32:18 ntpd[18459]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:ce7d%5]:123 2024-09-12T18:32:18.836 INFO:teuthology.orchestra.run.smithi073.stdout:12 Sep 18:32:18 ntpd[18459]: Listening on routing socket on fd #22 for interface updates 2024-09-12T18:32:18.837 INFO:teuthology.orchestra.run.smithi114.stdout:12 Sep 18:32:18 ntpd[18487]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T18:32:18.838 INFO:teuthology.orchestra.run.smithi114.stdout:12 Sep 18:32:18 ntpd[18487]: Command line: ntpd -gq 2024-09-12T18:32:18.838 INFO:teuthology.orchestra.run.smithi114.stdout:12 Sep 18:32:18 ntpd[18487]: ---------------------------------------------------- 2024-09-12T18:32:18.838 INFO:teuthology.orchestra.run.smithi114.stdout:12 Sep 18:32:18 ntpd[18487]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T18:32:18.838 INFO:teuthology.orchestra.run.smithi114.stdout:12 Sep 18:32:18 ntpd[18487]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T18:32:18.838 INFO:teuthology.orchestra.run.smithi114.stdout:12 Sep 18:32:18 ntpd[18487]: corporation. Support and training for ntp-4 are 2024-09-12T18:32:18.838 INFO:teuthology.orchestra.run.smithi114.stdout:12 Sep 18:32:18 ntpd[18487]: available at https://www.nwtime.org/support 2024-09-12T18:32:18.838 INFO:teuthology.orchestra.run.smithi114.stdout:12 Sep 18:32:18 ntpd[18487]: ---------------------------------------------------- 2024-09-12T18:32:18.838 INFO:teuthology.orchestra.run.smithi114.stdout:12 Sep 18:32:18 ntpd[18487]: proto: precision = 0.043 usec (-24) 2024-09-12T18:32:18.838 INFO:teuthology.orchestra.run.smithi114.stdout:12 Sep 18:32:18 ntpd[18487]: basedate set to 2022-02-04 2024-09-12T18:32:18.838 INFO:teuthology.orchestra.run.smithi114.stdout:12 Sep 18:32:18 ntpd[18487]: gps base set to 2022-02-06 (week 2196) 2024-09-12T18:32:18.838 INFO:teuthology.orchestra.run.smithi114.stdout:12 Sep 18:32:18 ntpd[18487]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T18:32:18.839 INFO:teuthology.orchestra.run.smithi114.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T18:32:18.839 INFO:teuthology.orchestra.run.smithi114.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T18:32:18.840 INFO:teuthology.orchestra.run.smithi114.stdout:12 Sep 18:32:18 ntpd[18487]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T18:32:18.840 INFO:teuthology.orchestra.run.smithi114.stdout:12 Sep 18:32:18 ntpd[18487]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T18:32:18.840 INFO:teuthology.orchestra.run.smithi114.stdout:12 Sep 18:32:18 ntpd[18487]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T18:32:18.840 INFO:teuthology.orchestra.run.smithi114.stdout:12 Sep 18:32:18 ntpd[18487]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T18:32:18.840 INFO:teuthology.orchestra.run.smithi114.stdout:12 Sep 18:32:18 ntpd[18487]: Listen normally on 3 enp3s0f1 172.21.15.114:123 2024-09-12T18:32:18.840 INFO:teuthology.orchestra.run.smithi114.stdout:12 Sep 18:32:18 ntpd[18487]: Listen normally on 4 lo [::1]:123 2024-09-12T18:32:18.840 INFO:teuthology.orchestra.run.smithi114.stdout:12 Sep 18:32:18 ntpd[18487]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cb63%5]:123 2024-09-12T18:32:18.840 INFO:teuthology.orchestra.run.smithi114.stdout:12 Sep 18:32:18 ntpd[18487]: Listening on routing socket on fd #22 for interface updates 2024-09-12T18:32:18.843 INFO:teuthology.orchestra.run.smithi143.stdout:12 Sep 18:32:18 ntpd[18477]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T18:32:18.843 INFO:teuthology.orchestra.run.smithi143.stdout:12 Sep 18:32:18 ntpd[18477]: Command line: ntpd -gq 2024-09-12T18:32:18.843 INFO:teuthology.orchestra.run.smithi143.stdout:12 Sep 18:32:18 ntpd[18477]: ---------------------------------------------------- 2024-09-12T18:32:18.843 INFO:teuthology.orchestra.run.smithi143.stdout:12 Sep 18:32:18 ntpd[18477]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T18:32:18.843 INFO:teuthology.orchestra.run.smithi143.stdout:12 Sep 18:32:18 ntpd[18477]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T18:32:18.844 INFO:teuthology.orchestra.run.smithi143.stdout:12 Sep 18:32:18 ntpd[18477]: corporation. Support and training for ntp-4 are 2024-09-12T18:32:18.844 INFO:teuthology.orchestra.run.smithi143.stdout:12 Sep 18:32:18 ntpd[18477]: available at https://www.nwtime.org/support 2024-09-12T18:32:18.844 INFO:teuthology.orchestra.run.smithi143.stdout:12 Sep 18:32:18 ntpd[18477]: ---------------------------------------------------- 2024-09-12T18:32:18.844 INFO:teuthology.orchestra.run.smithi143.stdout:12 Sep 18:32:18 ntpd[18477]: proto: precision = 0.061 usec (-24) 2024-09-12T18:32:18.844 INFO:teuthology.orchestra.run.smithi143.stdout:12 Sep 18:32:18 ntpd[18477]: basedate set to 2022-02-04 2024-09-12T18:32:18.844 INFO:teuthology.orchestra.run.smithi143.stdout:12 Sep 18:32:18 ntpd[18477]: gps base set to 2022-02-06 (week 2196) 2024-09-12T18:32:18.845 INFO:teuthology.orchestra.run.smithi143.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T18:32:18.845 INFO:teuthology.orchestra.run.smithi143.stdout:12 Sep 18:32:18 ntpd[18477]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T18:32:18.845 INFO:teuthology.orchestra.run.smithi143.stdout:12 Sep 18:32:18 ntpd[18477]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T18:32:18.845 INFO:teuthology.orchestra.run.smithi143.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T18:32:18.846 INFO:teuthology.orchestra.run.smithi143.stdout:12 Sep 18:32:18 ntpd[18477]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T18:32:18.846 INFO:teuthology.orchestra.run.smithi143.stdout:12 Sep 18:32:18 ntpd[18477]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T18:32:18.846 INFO:teuthology.orchestra.run.smithi143.stdout:12 Sep 18:32:18 ntpd[18477]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T18:32:18.846 INFO:teuthology.orchestra.run.smithi143.stdout:12 Sep 18:32:18 ntpd[18477]: Listen normally on 3 enp3s0f1 172.21.15.143:123 2024-09-12T18:32:18.847 INFO:teuthology.orchestra.run.smithi143.stdout:12 Sep 18:32:18 ntpd[18477]: Listen normally on 4 lo [::1]:123 2024-09-12T18:32:18.847 INFO:teuthology.orchestra.run.smithi143.stdout:12 Sep 18:32:18 ntpd[18477]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7783%5]:123 2024-09-12T18:32:18.847 INFO:teuthology.orchestra.run.smithi143.stdout:12 Sep 18:32:18 ntpd[18477]: Listening on routing socket on fd #22 for interface updates 2024-09-12T18:32:18.860 INFO:teuthology.orchestra.run.smithi162.stdout:12 Sep 18:32:18 ntpd[18501]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T18:32:18.860 INFO:teuthology.orchestra.run.smithi162.stdout:12 Sep 18:32:18 ntpd[18501]: Command line: ntpd -gq 2024-09-12T18:32:18.860 INFO:teuthology.orchestra.run.smithi162.stdout:12 Sep 18:32:18 ntpd[18501]: ---------------------------------------------------- 2024-09-12T18:32:18.860 INFO:teuthology.orchestra.run.smithi162.stdout:12 Sep 18:32:18 ntpd[18501]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T18:32:18.860 INFO:teuthology.orchestra.run.smithi162.stdout:12 Sep 18:32:18 ntpd[18501]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T18:32:18.860 INFO:teuthology.orchestra.run.smithi162.stdout:12 Sep 18:32:18 ntpd[18501]: corporation. Support and training for ntp-4 are 2024-09-12T18:32:18.860 INFO:teuthology.orchestra.run.smithi162.stdout:12 Sep 18:32:18 ntpd[18501]: available at https://www.nwtime.org/support 2024-09-12T18:32:18.860 INFO:teuthology.orchestra.run.smithi162.stdout:12 Sep 18:32:18 ntpd[18501]: ---------------------------------------------------- 2024-09-12T18:32:18.860 INFO:teuthology.orchestra.run.smithi162.stdout:12 Sep 18:32:18 ntpd[18501]: proto: precision = 0.062 usec (-24) 2024-09-12T18:32:18.860 INFO:teuthology.orchestra.run.smithi162.stdout:12 Sep 18:32:18 ntpd[18501]: basedate set to 2022-02-04 2024-09-12T18:32:18.860 INFO:teuthology.orchestra.run.smithi162.stdout:12 Sep 18:32:18 ntpd[18501]: gps base set to 2022-02-06 (week 2196) 2024-09-12T18:32:18.861 INFO:teuthology.orchestra.run.smithi162.stdout:12 Sep 18:32:18 ntpd[18501]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T18:32:18.861 INFO:teuthology.orchestra.run.smithi162.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T18:32:18.861 INFO:teuthology.orchestra.run.smithi162.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T18:32:18.862 INFO:teuthology.orchestra.run.smithi162.stdout:12 Sep 18:32:18 ntpd[18501]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T18:32:18.862 INFO:teuthology.orchestra.run.smithi162.stdout:12 Sep 18:32:18 ntpd[18501]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T18:32:18.862 INFO:teuthology.orchestra.run.smithi162.stdout:12 Sep 18:32:18 ntpd[18501]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T18:32:18.862 INFO:teuthology.orchestra.run.smithi162.stdout:12 Sep 18:32:18 ntpd[18501]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T18:32:18.862 INFO:teuthology.orchestra.run.smithi162.stdout:12 Sep 18:32:18 ntpd[18501]: Listen normally on 3 enp3s0f1 172.21.15.162:123 2024-09-12T18:32:18.862 INFO:teuthology.orchestra.run.smithi162.stdout:12 Sep 18:32:18 ntpd[18501]: Listen normally on 4 lo [::1]:123 2024-09-12T18:32:18.862 INFO:teuthology.orchestra.run.smithi162.stdout:12 Sep 18:32:18 ntpd[18501]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f41%5]:123 2024-09-12T18:32:18.862 INFO:teuthology.orchestra.run.smithi162.stdout:12 Sep 18:32:18 ntpd[18501]: Listening on routing socket on fd #22 for interface updates 2024-09-12T18:32:19.860 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:19 ntpd[18501]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:19.860 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:19 ntpd[18501]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:19.860 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:19 ntpd[18501]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:19.860 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:19 ntpd[18501]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:19.860 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:19 ntpd[18501]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:19.860 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:19 ntpd[18501]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:19.860 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:19 ntpd[18501]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:32:19.860 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:19 ntpd[18501]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:32:20.835 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:20 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:20.836 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:20 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:20.836 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:20 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:20.836 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:20 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:20.836 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:20 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:32:20.836 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:20 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:32:20.861 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:20 ntpd[18501]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:20.861 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:20 ntpd[18501]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:20.861 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:20 ntpd[18501]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:20.861 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:20 ntpd[18501]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:20.861 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:20 ntpd[18501]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:32:20.861 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:20 ntpd[18501]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:32:21.834 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:21 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:21.834 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:21 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:21.834 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:21 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:21.834 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:21 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:21.834 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:21 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:21.834 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:21 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:21.834 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:21 ntpd[18459]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:32:21.834 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:21 ntpd[18459]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:32:21.834 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:21 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:21.835 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:21 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:21.835 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:21 ntpd[18459]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:32:21.835 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:21 ntpd[18459]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:32:21.835 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:21 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:21.835 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:21 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:21.836 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:21 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:21.836 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:21 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:21.836 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:21 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:32:21.836 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:21 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:32:21.860 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:21 ntpd[18501]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:21.860 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:21 ntpd[18501]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:21.860 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:21 ntpd[18501]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:21.860 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:21 ntpd[18501]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:21.860 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:21 ntpd[18501]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:21.861 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:21 ntpd[18501]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:21.861 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:21 ntpd[18501]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:32:21.861 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:21 ntpd[18501]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:32:21.861 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:21 ntpd[18501]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:21.861 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:21 ntpd[18501]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:21.861 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:21 ntpd[18501]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:32:21.862 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:21 ntpd[18501]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:32:22.833 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:22 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:22.834 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:22 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:22.834 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:22 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:22.834 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:22 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:22.834 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:22 ntpd[18459]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:32:22.834 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:22 ntpd[18459]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:32:22.836 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:22 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:22.836 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:22 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:22.836 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:22 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:22.837 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:22 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:22.837 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:22 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:22.837 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:22 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:22.837 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:22 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:22.837 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:22 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:22.837 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:22 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:32:22.837 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:22 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:32:22.837 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:22 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:22.837 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:22 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:22.837 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:22 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:32:22.837 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:22 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:32:22.845 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:22 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:22.845 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:22 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:22.845 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:22 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:22.845 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:22 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:22.845 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:22 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:22.845 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:22 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:22.845 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:22 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:22.845 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:22 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:22.845 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:22 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:22.846 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:22 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:22.846 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:22 ntpd[18477]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:32:22.846 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:22 ntpd[18477]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:32:22.846 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:22 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:22.846 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:22 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:22.846 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:22 ntpd[18477]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:32:22.846 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:22 ntpd[18477]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:32:22.846 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:22 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:22.846 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:22 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:22.846 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:22 ntpd[18477]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:32:22.846 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:22 ntpd[18477]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:32:22.862 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:22 ntpd[18501]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:22.929 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:22 ntpd[18501]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:22.929 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:22 ntpd[18501]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:22.930 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:22 ntpd[18501]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:22.930 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:22 ntpd[18501]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:32:22.930 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:22 ntpd[18501]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:32:23.834 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:23 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:23.834 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:23 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:23.834 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:23 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:23.835 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:23 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:23.835 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:23 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:23.835 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:23 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:23.835 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:23 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:23.835 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:23 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:23.835 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:23 ntpd[18459]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:32:23.835 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:23 ntpd[18459]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:32:23.835 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:23 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:23.835 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:23 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:23.835 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:23 ntpd[18459]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:32:23.835 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:23 ntpd[18459]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:32:23.836 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:23 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:23.836 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:23 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:23.836 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:23 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:23.837 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:23 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:23.837 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:23 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:32:23.837 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:23 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:32:23.860 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:23 ntpd[18501]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:23.861 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:23 ntpd[18501]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:23.861 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:23 ntpd[18501]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:23.861 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:23 ntpd[18501]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:23.861 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:23 ntpd[18501]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:23.861 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:23 ntpd[18501]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:23.862 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:23 ntpd[18501]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:32:23.862 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:23 ntpd[18501]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:32:23.862 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:23 ntpd[18501]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:23.862 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:23 ntpd[18501]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:23.862 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:23 ntpd[18501]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:32:23.862 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:23 ntpd[18501]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:32:24.833 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:24 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:24.833 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:24 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:24.833 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:24 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:24.833 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:24 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:24.834 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:24 ntpd[18459]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:32:24.834 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:24 ntpd[18459]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:32:24.835 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:24 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:24.836 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:24 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:24.836 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:24 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:24.836 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:24 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:24.836 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:24 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:24.836 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:24 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:24.836 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:24 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:32:24.836 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:24 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:32:24.836 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:24 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:24.836 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:24 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:24.836 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:24 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:32:24.836 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:24 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:32:24.844 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:24 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:24.844 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:24 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:24.844 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:24 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:24.844 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:24 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:24.844 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:24 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:24.844 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:24 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:24.844 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:24 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:24.844 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:24 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:24.845 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:24 ntpd[18477]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:32:24.845 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:24 ntpd[18477]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:32:24.845 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:24 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:24.845 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:24 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:24.845 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:24 ntpd[18477]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:32:24.845 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:24 ntpd[18477]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:32:24.845 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:24 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:24.845 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:24 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:24.845 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:24 ntpd[18477]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:32:24.845 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:24 ntpd[18477]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:32:24.859 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:24 ntpd[18501]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:24.859 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:24 ntpd[18501]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:24.860 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:24 ntpd[18501]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:24.860 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:24 ntpd[18501]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:24.860 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:24 ntpd[18501]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:32:24.860 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:24 ntpd[18501]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:32:25.834 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:25 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:25.834 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:25 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:25.835 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:25 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:25.835 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:25 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:25.835 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:25 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:25.835 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:25 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:25.835 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:25 ntpd[18459]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:32:25.835 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:25 ntpd[18459]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:32:25.835 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:25 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:25.835 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:25 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:25.835 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:25 ntpd[18459]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:32:25.835 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:25 ntpd[18459]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:32:25.836 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:25 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:25.836 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:25 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:25.836 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:25 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:25.836 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:25 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:25.836 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:25 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:32:25.837 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:25 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:32:25.860 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:25 ntpd[18501]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:25.860 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:25 ntpd[18501]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:25.860 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:25 ntpd[18501]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:25.860 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:25 ntpd[18501]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:25.860 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:25 ntpd[18501]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:25.860 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:25 ntpd[18501]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:25.860 INFO:teuthology.orchestra.run.smithi162.stdout:12 Sep 18:32:25 ntpd[18501]: ntpd: time slew +0.000676 s 2024-09-12T18:32:25.861 INFO:teuthology.orchestra.run.smithi162.stdout:ntpd: time slew +0.000676s 2024-09-12T18:32:25.861 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:25 ntpd[18501]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:32:25.861 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:25 ntpd[18501]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:32:25.861 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:25 ntpd[18501]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T18:32:25.861 INFO:teuthology.orchestra.run.smithi162.stderr:12 Sep 18:32:25 ntpd[18501]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T18:32:25.910 INFO:teuthology.orchestra.run.smithi162.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T18:32:25.910 INFO:teuthology.orchestra.run.smithi162.stdout:============================================================================== 2024-09-12T18:32:25.911 INFO:teuthology.orchestra.run.smithi162.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:32:25.911 INFO:teuthology.orchestra.run.smithi162.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:32:25.911 INFO:teuthology.orchestra.run.smithi162.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:32:25.911 INFO:teuthology.orchestra.run.smithi162.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:32:26.833 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:26 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:26.833 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:26 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:26.833 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:26 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:26.833 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:26 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:26.834 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:26 ntpd[18459]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:32:26.834 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:26 ntpd[18459]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:32:26.836 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:26 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:26.836 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:26 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:26.836 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:26 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:26.836 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:26 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:26.836 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:26 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:26.836 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:26 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:26.836 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:26 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:32:26.836 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:26 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:32:26.836 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:26 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:26.836 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:26 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:26.836 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:26 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:32:26.837 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:26 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:32:26.837 INFO:teuthology.orchestra.run.smithi114.stdout:12 Sep 18:32:26 ntpd[18487]: ntpd: time slew -0.003539 s 2024-09-12T18:32:26.837 INFO:teuthology.orchestra.run.smithi114.stdout:ntpd: time slew -0.003539s 2024-09-12T18:32:26.837 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:26 ntpd[18487]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T18:32:26.837 INFO:teuthology.orchestra.run.smithi114.stderr:12 Sep 18:32:26 ntpd[18487]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T18:32:26.844 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:26 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:26.844 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:26 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:26.844 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:26 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:26.844 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:26 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:26.844 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:26 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:26.844 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:26 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:26.844 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:26 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:26.844 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:26 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:26.845 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:26 ntpd[18477]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:32:26.845 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:26 ntpd[18477]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:32:26.845 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:26 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:26.845 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:26 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:26.845 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:26 ntpd[18477]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:32:26.845 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:26 ntpd[18477]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:32:26.845 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:26 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:26.845 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:26 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:26.845 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:26 ntpd[18477]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:32:26.845 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:26 ntpd[18477]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:32:26.898 INFO:teuthology.orchestra.run.smithi114.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T18:32:26.898 INFO:teuthology.orchestra.run.smithi114.stdout:============================================================================== 2024-09-12T18:32:26.899 INFO:teuthology.orchestra.run.smithi114.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:32:26.899 INFO:teuthology.orchestra.run.smithi114.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:32:26.899 INFO:teuthology.orchestra.run.smithi114.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:32:26.899 INFO:teuthology.orchestra.run.smithi114.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:32:27.833 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:27 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:27.834 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:27 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:27.834 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:27 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:27.834 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:27 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:27.834 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:27 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:27.834 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:27 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:27.834 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:27 ntpd[18459]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:32:27.834 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:27 ntpd[18459]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:32:27.834 INFO:teuthology.orchestra.run.smithi073.stdout:12 Sep 18:32:27 ntpd[18459]: ntpd: time slew -0.001384 s 2024-09-12T18:32:27.834 INFO:teuthology.orchestra.run.smithi073.stdout:ntpd: time slew -0.001384s 2024-09-12T18:32:27.835 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:27 ntpd[18459]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T18:32:27.835 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 18:32:27 ntpd[18459]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T18:32:27.889 INFO:teuthology.orchestra.run.smithi073.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T18:32:27.889 INFO:teuthology.orchestra.run.smithi073.stdout:============================================================================== 2024-09-12T18:32:27.889 INFO:teuthology.orchestra.run.smithi073.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:32:27.889 INFO:teuthology.orchestra.run.smithi073.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:32:27.889 INFO:teuthology.orchestra.run.smithi073.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:32:27.889 INFO:teuthology.orchestra.run.smithi073.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:32:28.844 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:28 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:28.844 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:28 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:28.844 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:28 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:28.844 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:28 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:28.844 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:28 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:28.844 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:28 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:28.844 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:28 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:32:28.844 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:28 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:32:28.844 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:28 ntpd[18477]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:32:28.845 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:28 ntpd[18477]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:32:28.845 INFO:teuthology.orchestra.run.smithi143.stdout:12 Sep 18:32:28 ntpd[18477]: ntpd: time slew +0.000055 s 2024-09-12T18:32:28.845 INFO:teuthology.orchestra.run.smithi143.stdout:ntpd: time slew +0.000055s 2024-09-12T18:32:28.845 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:28 ntpd[18477]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T18:32:28.846 INFO:teuthology.orchestra.run.smithi143.stderr:12 Sep 18:32:28 ntpd[18477]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T18:32:28.900 INFO:teuthology.orchestra.run.smithi143.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T18:32:28.900 INFO:teuthology.orchestra.run.smithi143.stdout:============================================================================== 2024-09-12T18:32:28.900 INFO:teuthology.orchestra.run.smithi143.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:32:28.900 INFO:teuthology.orchestra.run.smithi143.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:32:28.900 INFO:teuthology.orchestra.run.smithi143.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:32:28.900 INFO:teuthology.orchestra.run.smithi143.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:32:28.901 INFO:teuthology.run_tasks:Running task install... 2024-09-12T18:32:28.913 DEBUG:teuthology.task.install:project ceph 2024-09-12T18:32:28.913 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '46406987da2067f022005d68ecbb989daaabb837'}} 2024-09-12T18:32:28.913 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '46406987da2067f022005d68ecbb989daaabb837'} 2024-09-12T18:32:28.913 INFO:teuthology.task.install:Using flavor: default 2024-09-12T18:32:28.919 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T18:32:28.919 INFO:teuthology.task.install:extra packages: [] 2024-09-12T18:32:28.919 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-key list | grep Ceph 2024-09-12T18:32:28.920 DEBUG:teuthology.orchestra.run.smithi114:> sudo apt-key list | grep Ceph 2024-09-12T18:32:28.920 DEBUG:teuthology.orchestra.run.smithi143:> sudo apt-key list | grep Ceph 2024-09-12T18:32:28.921 DEBUG:teuthology.orchestra.run.smithi162:> sudo apt-key list | grep Ceph 2024-09-12T18:32:28.984 INFO:teuthology.orchestra.run.smithi162.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T18:32:28.984 INFO:teuthology.orchestra.run.smithi114.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T18:32:28.985 INFO:teuthology.orchestra.run.smithi073.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T18:32:29.004 INFO:teuthology.orchestra.run.smithi143.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T18:32:29.011 INFO:teuthology.orchestra.run.smithi162.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T18:32:29.011 INFO:teuthology.orchestra.run.smithi162.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T18:32:29.012 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T18:32:29.012 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-09-12T18:32:29.013 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=46406987da2067f022005d68ecbb989daaabb837 2024-09-12T18:32:29.018 INFO:teuthology.orchestra.run.smithi073.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T18:32:29.018 INFO:teuthology.orchestra.run.smithi073.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T18:32:29.018 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T18:32:29.018 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-09-12T18:32:29.018 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=46406987da2067f022005d68ecbb989daaabb837 2024-09-12T18:32:29.034 INFO:teuthology.orchestra.run.smithi143.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T18:32:29.034 INFO:teuthology.orchestra.run.smithi143.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T18:32:29.034 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T18:32:29.034 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-09-12T18:32:29.034 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=46406987da2067f022005d68ecbb989daaabb837 2024-09-12T18:32:29.057 INFO:teuthology.orchestra.run.smithi114.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T18:32:29.057 INFO:teuthology.orchestra.run.smithi114.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T18:32:29.057 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T18:32:29.057 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-09-12T18:32:29.058 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=46406987da2067f022005d68ecbb989daaabb837 2024-09-12T18:32:29.154 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default/ 2024-09-12T18:32:29.154 INFO:teuthology.task.install.deb:Package version is 19.3.0-4870-g46406987-1jammy 2024-09-12T18:32:29.162 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default/ 2024-09-12T18:32:29.162 INFO:teuthology.task.install.deb:Package version is 19.3.0-4870-g46406987-1jammy 2024-09-12T18:32:29.168 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default/ 2024-09-12T18:32:29.168 INFO:teuthology.task.install.deb:Package version is 19.3.0-4870-g46406987-1jammy 2024-09-12T18:32:29.202 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default/ 2024-09-12T18:32:29.202 INFO:teuthology.task.install.deb:Package version is 19.3.0-4870-g46406987-1jammy 2024-09-12T18:32:29.273 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-12T18:32:29.273 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T18:32:29.275 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T18:32:29.275 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T18:32:29.280 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-12T18:32:29.280 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T18:32:29.290 DEBUG:teuthology.orchestra.run.smithi162:> sudo apt-get update 2024-09-12T18:32:29.291 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get update 2024-09-12T18:32:29.295 DEBUG:teuthology.orchestra.run.smithi143:> sudo apt-get update 2024-09-12T18:32:29.316 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-12T18:32:29.316 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T18:32:29.330 DEBUG:teuthology.orchestra.run.smithi114:> sudo apt-get update 2024-09-12T18:32:29.455 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T18:32:29.456 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T18:32:29.457 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T18:32:29.466 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T18:32:29.466 INFO:teuthology.orchestra.run.smithi143.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T18:32:29.467 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T18:32:29.483 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T18:32:29.485 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T18:32:29.499 INFO:teuthology.orchestra.run.smithi114.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T18:32:29.499 INFO:teuthology.orchestra.run.smithi114.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T18:32:29.509 INFO:teuthology.orchestra.run.smithi114.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T18:32:29.510 INFO:teuthology.orchestra.run.smithi073.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T18:32:29.510 INFO:teuthology.orchestra.run.smithi162.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T18:32:29.517 INFO:teuthology.orchestra.run.smithi143.stdout:Ign:2 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T18:32:29.532 INFO:teuthology.orchestra.run.smithi162.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-12T18:32:29.533 INFO:teuthology.orchestra.run.smithi073.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-12T18:32:29.533 INFO:teuthology.orchestra.run.smithi114.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T18:32:29.538 INFO:teuthology.orchestra.run.smithi143.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-12T18:32:29.551 INFO:teuthology.orchestra.run.smithi114.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T18:32:29.553 INFO:teuthology.orchestra.run.smithi162.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T18:32:29.554 INFO:teuthology.orchestra.run.smithi073.stdout:Ign:6 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T18:32:29.560 INFO:teuthology.orchestra.run.smithi143.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T18:32:29.573 INFO:teuthology.orchestra.run.smithi114.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-12T18:32:29.574 INFO:teuthology.orchestra.run.smithi162.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-12T18:32:29.575 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-12T18:32:29.581 INFO:teuthology.orchestra.run.smithi143.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-12T18:32:29.582 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T18:32:29.587 INFO:teuthology.orchestra.run.smithi143.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T18:32:29.594 INFO:teuthology.orchestra.run.smithi114.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T18:32:29.600 INFO:teuthology.orchestra.run.smithi162.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,429 B] 2024-09-12T18:32:29.603 INFO:teuthology.orchestra.run.smithi073.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,429 B] 2024-09-12T18:32:29.608 INFO:teuthology.orchestra.run.smithi143.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,429 B] 2024-09-12T18:32:29.615 INFO:teuthology.orchestra.run.smithi114.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,429 B] 2024-09-12T18:32:29.644 INFO:teuthology.orchestra.run.smithi114.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-12T18:32:29.668 INFO:teuthology.orchestra.run.smithi143.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T18:32:29.796 INFO:teuthology.orchestra.run.smithi162.stdout:Fetched 29.3 kB in 0s (90.2 kB/s) 2024-09-12T18:32:29.844 INFO:teuthology.orchestra.run.smithi114.stdout:Fetched 29.3 kB in 0s (87.6 kB/s) 2024-09-12T18:32:30.024 INFO:teuthology.orchestra.run.smithi143.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T18:32:30.043 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 158 kB in 1s (284 kB/s) 2024-09-12T18:32:30.115 INFO:teuthology.orchestra.run.smithi143.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,990 kB] 2024-09-12T18:32:30.547 INFO:teuthology.orchestra.run.smithi143.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T18:32:30.557 INFO:teuthology.orchestra.run.smithi143.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,390 kB] 2024-09-12T18:32:30.647 INFO:teuthology.orchestra.run.smithi143.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [412 kB] 2024-09-12T18:32:30.816 INFO:teuthology.orchestra.run.smithi114.stdout:Reading package lists... 2024-09-12T18:32:30.833 DEBUG:teuthology.orchestra.run.smithi114:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4870-g46406987-1jammy cephadm=19.3.0-4870-g46406987-1jammy ceph-mds=19.3.0-4870-g46406987-1jammy ceph-mgr=19.3.0-4870-g46406987-1jammy ceph-common=19.3.0-4870-g46406987-1jammy ceph-fuse=19.3.0-4870-g46406987-1jammy ceph-test=19.3.0-4870-g46406987-1jammy ceph-volume=19.3.0-4870-g46406987-1jammy radosgw=19.3.0-4870-g46406987-1jammy python3-rados=19.3.0-4870-g46406987-1jammy python3-rgw=19.3.0-4870-g46406987-1jammy python3-cephfs=19.3.0-4870-g46406987-1jammy python3-rbd=19.3.0-4870-g46406987-1jammy libcephfs2=19.3.0-4870-g46406987-1jammy libcephfs-dev=19.3.0-4870-g46406987-1jammy librados2=19.3.0-4870-g46406987-1jammy librbd1=19.3.0-4870-g46406987-1jammy rbd-fuse=19.3.0-4870-g46406987-1jammy 2024-09-12T18:32:30.870 INFO:teuthology.orchestra.run.smithi162.stdout:Reading package lists... 2024-09-12T18:32:30.887 DEBUG:teuthology.orchestra.run.smithi162:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4870-g46406987-1jammy cephadm=19.3.0-4870-g46406987-1jammy ceph-mds=19.3.0-4870-g46406987-1jammy ceph-mgr=19.3.0-4870-g46406987-1jammy ceph-common=19.3.0-4870-g46406987-1jammy ceph-fuse=19.3.0-4870-g46406987-1jammy ceph-test=19.3.0-4870-g46406987-1jammy ceph-volume=19.3.0-4870-g46406987-1jammy radosgw=19.3.0-4870-g46406987-1jammy python3-rados=19.3.0-4870-g46406987-1jammy python3-rgw=19.3.0-4870-g46406987-1jammy python3-cephfs=19.3.0-4870-g46406987-1jammy python3-rbd=19.3.0-4870-g46406987-1jammy libcephfs2=19.3.0-4870-g46406987-1jammy libcephfs-dev=19.3.0-4870-g46406987-1jammy librados2=19.3.0-4870-g46406987-1jammy librbd1=19.3.0-4870-g46406987-1jammy rbd-fuse=19.3.0-4870-g46406987-1jammy 2024-09-12T18:32:30.899 INFO:teuthology.orchestra.run.smithi114.stdout:Reading package lists... 2024-09-12T18:32:30.952 INFO:teuthology.orchestra.run.smithi162.stdout:Reading package lists... 2024-09-12T18:32:31.058 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-09-12T18:32:31.074 DEBUG:teuthology.orchestra.run.smithi073:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4870-g46406987-1jammy cephadm=19.3.0-4870-g46406987-1jammy ceph-mds=19.3.0-4870-g46406987-1jammy ceph-mgr=19.3.0-4870-g46406987-1jammy ceph-common=19.3.0-4870-g46406987-1jammy ceph-fuse=19.3.0-4870-g46406987-1jammy ceph-test=19.3.0-4870-g46406987-1jammy ceph-volume=19.3.0-4870-g46406987-1jammy radosgw=19.3.0-4870-g46406987-1jammy python3-rados=19.3.0-4870-g46406987-1jammy python3-rgw=19.3.0-4870-g46406987-1jammy python3-cephfs=19.3.0-4870-g46406987-1jammy python3-rbd=19.3.0-4870-g46406987-1jammy libcephfs2=19.3.0-4870-g46406987-1jammy libcephfs-dev=19.3.0-4870-g46406987-1jammy librados2=19.3.0-4870-g46406987-1jammy librbd1=19.3.0-4870-g46406987-1jammy rbd-fuse=19.3.0-4870-g46406987-1jammy 2024-09-12T18:32:31.107 INFO:teuthology.orchestra.run.smithi114.stdout:Building dependency tree... 2024-09-12T18:32:31.108 INFO:teuthology.orchestra.run.smithi114.stdout:Reading state information... 2024-09-12T18:32:31.136 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-09-12T18:32:31.165 INFO:teuthology.orchestra.run.smithi162.stdout:Building dependency tree... 2024-09-12T18:32:31.165 INFO:teuthology.orchestra.run.smithi162.stdout:Reading state information... 2024-09-12T18:32:31.206 INFO:teuthology.orchestra.run.smithi143.stdout:Fetched 5,298 kB in 2s (3,090 kB/s) 2024-09-12T18:32:31.313 INFO:teuthology.orchestra.run.smithi114.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:32:31.313 INFO:teuthology.orchestra.run.smithi114.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:32:31.313 INFO:teuthology.orchestra.run.smithi114.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:32:31.313 INFO:teuthology.orchestra.run.smithi114.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:32:31.313 INFO:teuthology.orchestra.run.smithi114.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T18:32:31.313 INFO:teuthology.orchestra.run.smithi114.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T18:32:31.314 INFO:teuthology.orchestra.run.smithi114.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:32:31.314 INFO:teuthology.orchestra.run.smithi114.stdout:The following additional packages will be installed: 2024-09-12T18:32:31.314 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T18:32:31.314 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T18:32:31.315 INFO:teuthology.orchestra.run.smithi114.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-12T18:32:31.315 INFO:teuthology.orchestra.run.smithi114.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-12T18:32:31.316 INFO:teuthology.orchestra.run.smithi114.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-12T18:32:31.316 INFO:teuthology.orchestra.run.smithi114.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-12T18:32:31.316 INFO:teuthology.orchestra.run.smithi114.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-12T18:32:31.316 INFO:teuthology.orchestra.run.smithi114.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-12T18:32:31.316 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-12T18:32:31.316 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-12T18:32:31.316 INFO:teuthology.orchestra.run.smithi114.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-12T18:32:31.316 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-12T18:32:31.316 INFO:teuthology.orchestra.run.smithi114.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-12T18:32:31.316 INFO:teuthology.orchestra.run.smithi114.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-12T18:32:31.316 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-12T18:32:31.316 INFO:teuthology.orchestra.run.smithi114.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-12T18:32:31.317 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-12T18:32:31.317 INFO:teuthology.orchestra.run.smithi114.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-12T18:32:31.317 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T18:32:31.317 INFO:teuthology.orchestra.run.smithi114.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T18:32:31.317 INFO:teuthology.orchestra.run.smithi114.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T18:32:31.317 INFO:teuthology.orchestra.run.smithi114.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T18:32:31.317 INFO:teuthology.orchestra.run.smithi114.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T18:32:31.317 INFO:teuthology.orchestra.run.smithi114.stdout: xmlstarlet zip 2024-09-12T18:32:31.318 INFO:teuthology.orchestra.run.smithi114.stdout:Suggested packages: 2024-09-12T18:32:31.318 INFO:teuthology.orchestra.run.smithi114.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T18:32:31.318 INFO:teuthology.orchestra.run.smithi114.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T18:32:31.318 INFO:teuthology.orchestra.run.smithi114.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T18:32:31.318 INFO:teuthology.orchestra.run.smithi114.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T18:32:31.318 INFO:teuthology.orchestra.run.smithi114.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T18:32:31.318 INFO:teuthology.orchestra.run.smithi114.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T18:32:31.318 INFO:teuthology.orchestra.run.smithi114.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T18:32:31.318 INFO:teuthology.orchestra.run.smithi114.stdout:Recommended packages: 2024-09-12T18:32:31.319 INFO:teuthology.orchestra.run.smithi114.stdout: btrfs-tools 2024-09-12T18:32:31.345 INFO:teuthology.orchestra.run.smithi073.stdout:Building dependency tree... 2024-09-12T18:32:31.346 INFO:teuthology.orchestra.run.smithi073.stdout:Reading state information... 2024-09-12T18:32:31.364 INFO:teuthology.orchestra.run.smithi162.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:32:31.364 INFO:teuthology.orchestra.run.smithi162.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:32:31.364 INFO:teuthology.orchestra.run.smithi162.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:32:31.365 INFO:teuthology.orchestra.run.smithi162.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:32:31.365 INFO:teuthology.orchestra.run.smithi162.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T18:32:31.365 INFO:teuthology.orchestra.run.smithi162.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T18:32:31.365 INFO:teuthology.orchestra.run.smithi162.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:32:31.367 INFO:teuthology.orchestra.run.smithi162.stdout:The following additional packages will be installed: 2024-09-12T18:32:31.367 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T18:32:31.367 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T18:32:31.367 INFO:teuthology.orchestra.run.smithi162.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-12T18:32:31.367 INFO:teuthology.orchestra.run.smithi162.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-12T18:32:31.367 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-12T18:32:31.368 INFO:teuthology.orchestra.run.smithi162.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-12T18:32:31.368 INFO:teuthology.orchestra.run.smithi162.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-12T18:32:31.368 INFO:teuthology.orchestra.run.smithi162.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-12T18:32:31.368 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-12T18:32:31.368 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-12T18:32:31.368 INFO:teuthology.orchestra.run.smithi162.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-12T18:32:31.368 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-12T18:32:31.368 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-12T18:32:31.368 INFO:teuthology.orchestra.run.smithi162.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-12T18:32:31.368 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-12T18:32:31.368 INFO:teuthology.orchestra.run.smithi162.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-12T18:32:31.368 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-12T18:32:31.368 INFO:teuthology.orchestra.run.smithi162.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-12T18:32:31.369 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T18:32:31.369 INFO:teuthology.orchestra.run.smithi162.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T18:32:31.369 INFO:teuthology.orchestra.run.smithi162.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T18:32:31.369 INFO:teuthology.orchestra.run.smithi162.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T18:32:31.369 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T18:32:31.370 INFO:teuthology.orchestra.run.smithi162.stdout: xmlstarlet zip 2024-09-12T18:32:31.370 INFO:teuthology.orchestra.run.smithi162.stdout:Suggested packages: 2024-09-12T18:32:31.371 INFO:teuthology.orchestra.run.smithi162.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T18:32:31.371 INFO:teuthology.orchestra.run.smithi162.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T18:32:31.371 INFO:teuthology.orchestra.run.smithi162.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T18:32:31.371 INFO:teuthology.orchestra.run.smithi162.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T18:32:31.371 INFO:teuthology.orchestra.run.smithi162.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T18:32:31.371 INFO:teuthology.orchestra.run.smithi162.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T18:32:31.371 INFO:teuthology.orchestra.run.smithi162.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T18:32:31.371 INFO:teuthology.orchestra.run.smithi162.stdout:Recommended packages: 2024-09-12T18:32:31.372 INFO:teuthology.orchestra.run.smithi162.stdout: btrfs-tools 2024-09-12T18:32:31.422 INFO:teuthology.orchestra.run.smithi114.stdout:The following NEW packages will be installed: 2024-09-12T18:32:31.422 INFO:teuthology.orchestra.run.smithi114.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T18:32:31.422 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T18:32:31.422 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T18:32:31.423 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T18:32:31.423 INFO:teuthology.orchestra.run.smithi114.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-12T18:32:31.423 INFO:teuthology.orchestra.run.smithi114.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T18:32:31.424 INFO:teuthology.orchestra.run.smithi114.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T18:32:31.424 INFO:teuthology.orchestra.run.smithi114.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T18:32:31.424 INFO:teuthology.orchestra.run.smithi114.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T18:32:31.424 INFO:teuthology.orchestra.run.smithi114.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T18:32:31.424 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T18:32:31.424 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T18:32:31.424 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T18:32:31.424 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T18:32:31.425 INFO:teuthology.orchestra.run.smithi114.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T18:32:31.425 INFO:teuthology.orchestra.run.smithi114.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T18:32:31.425 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T18:32:31.425 INFO:teuthology.orchestra.run.smithi114.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T18:32:31.425 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T18:32:31.425 INFO:teuthology.orchestra.run.smithi114.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T18:32:31.425 INFO:teuthology.orchestra.run.smithi114.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T18:32:31.425 INFO:teuthology.orchestra.run.smithi114.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T18:32:31.425 INFO:teuthology.orchestra.run.smithi114.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T18:32:31.426 INFO:teuthology.orchestra.run.smithi114.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T18:32:31.426 INFO:teuthology.orchestra.run.smithi114.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T18:32:31.426 INFO:teuthology.orchestra.run.smithi114.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T18:32:31.472 INFO:teuthology.orchestra.run.smithi162.stdout:The following NEW packages will be installed: 2024-09-12T18:32:31.472 INFO:teuthology.orchestra.run.smithi162.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T18:32:31.472 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T18:32:31.472 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T18:32:31.472 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T18:32:31.472 INFO:teuthology.orchestra.run.smithi162.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-12T18:32:31.473 INFO:teuthology.orchestra.run.smithi162.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T18:32:31.474 INFO:teuthology.orchestra.run.smithi162.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T18:32:31.474 INFO:teuthology.orchestra.run.smithi162.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T18:32:31.474 INFO:teuthology.orchestra.run.smithi162.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T18:32:31.474 INFO:teuthology.orchestra.run.smithi162.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T18:32:31.474 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T18:32:31.474 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T18:32:31.474 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T18:32:31.474 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T18:32:31.474 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T18:32:31.474 INFO:teuthology.orchestra.run.smithi162.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T18:32:31.475 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T18:32:31.475 INFO:teuthology.orchestra.run.smithi162.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T18:32:31.475 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T18:32:31.475 INFO:teuthology.orchestra.run.smithi162.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T18:32:31.475 INFO:teuthology.orchestra.run.smithi162.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T18:32:31.475 INFO:teuthology.orchestra.run.smithi162.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T18:32:31.475 INFO:teuthology.orchestra.run.smithi162.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T18:32:31.475 INFO:teuthology.orchestra.run.smithi162.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T18:32:31.475 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T18:32:31.475 INFO:teuthology.orchestra.run.smithi162.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T18:32:31.532 INFO:teuthology.orchestra.run.smithi162.stdout:0 upgraded, 119 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T18:32:31.532 INFO:teuthology.orchestra.run.smithi162.stdout:Need to get 251 MB of archives. 2024-09-12T18:32:31.532 INFO:teuthology.orchestra.run.smithi162.stdout:After this operation, 934 MB of additional disk space will be used. 2024-09-12T18:32:31.532 INFO:teuthology.orchestra.run.smithi162.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T18:32:31.543 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:32:31.543 INFO:teuthology.orchestra.run.smithi073.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:32:31.543 INFO:teuthology.orchestra.run.smithi073.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:32:31.543 INFO:teuthology.orchestra.run.smithi073.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:32:31.544 INFO:teuthology.orchestra.run.smithi073.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T18:32:31.544 INFO:teuthology.orchestra.run.smithi073.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T18:32:31.544 INFO:teuthology.orchestra.run.smithi073.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:32:31.545 INFO:teuthology.orchestra.run.smithi073.stdout:The following additional packages will be installed: 2024-09-12T18:32:31.545 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T18:32:31.545 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T18:32:31.545 INFO:teuthology.orchestra.run.smithi073.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-12T18:32:31.545 INFO:teuthology.orchestra.run.smithi073.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-12T18:32:31.545 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-12T18:32:31.546 INFO:teuthology.orchestra.run.smithi073.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-12T18:32:31.546 INFO:teuthology.orchestra.run.smithi073.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-12T18:32:31.546 INFO:teuthology.orchestra.run.smithi073.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-12T18:32:31.546 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-12T18:32:31.546 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-12T18:32:31.546 INFO:teuthology.orchestra.run.smithi073.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-12T18:32:31.547 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-12T18:32:31.547 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-12T18:32:31.547 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-12T18:32:31.547 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-12T18:32:31.547 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-12T18:32:31.547 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-12T18:32:31.547 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-12T18:32:31.547 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T18:32:31.547 INFO:teuthology.orchestra.run.smithi073.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T18:32:31.547 INFO:teuthology.orchestra.run.smithi073.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T18:32:31.547 INFO:teuthology.orchestra.run.smithi073.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T18:32:31.547 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T18:32:31.547 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet zip 2024-09-12T18:32:31.548 INFO:teuthology.orchestra.run.smithi073.stdout:Suggested packages: 2024-09-12T18:32:31.548 INFO:teuthology.orchestra.run.smithi073.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T18:32:31.548 INFO:teuthology.orchestra.run.smithi073.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T18:32:31.548 INFO:teuthology.orchestra.run.smithi073.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T18:32:31.548 INFO:teuthology.orchestra.run.smithi073.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T18:32:31.548 INFO:teuthology.orchestra.run.smithi073.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T18:32:31.548 INFO:teuthology.orchestra.run.smithi073.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T18:32:31.548 INFO:teuthology.orchestra.run.smithi073.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T18:32:31.548 INFO:teuthology.orchestra.run.smithi073.stdout:Recommended packages: 2024-09-12T18:32:31.548 INFO:teuthology.orchestra.run.smithi073.stdout: btrfs-tools 2024-09-12T18:32:31.565 INFO:teuthology.orchestra.run.smithi114.stdout:0 upgraded, 119 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T18:32:31.565 INFO:teuthology.orchestra.run.smithi114.stdout:Need to get 251 MB of archives. 2024-09-12T18:32:31.565 INFO:teuthology.orchestra.run.smithi114.stdout:After this operation, 934 MB of additional disk space will be used. 2024-09-12T18:32:31.565 INFO:teuthology.orchestra.run.smithi114.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4870-g46406987-1jammy [3,623 kB] 2024-09-12T18:32:31.612 INFO:teuthology.orchestra.run.smithi114.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T18:32:31.614 INFO:teuthology.orchestra.run.smithi162.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4870-g46406987-1jammy [3,623 kB] 2024-09-12T18:32:31.619 INFO:teuthology.orchestra.run.smithi162.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T18:32:31.622 INFO:teuthology.orchestra.run.smithi162.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T18:32:31.639 INFO:teuthology.orchestra.run.smithi162.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T18:32:31.649 INFO:teuthology.orchestra.run.smithi073.stdout:The following NEW packages will be installed: 2024-09-12T18:32:31.650 INFO:teuthology.orchestra.run.smithi073.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T18:32:31.650 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T18:32:31.650 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T18:32:31.651 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T18:32:31.651 INFO:teuthology.orchestra.run.smithi073.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-12T18:32:31.652 INFO:teuthology.orchestra.run.smithi073.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T18:32:31.652 INFO:teuthology.orchestra.run.smithi073.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T18:32:31.652 INFO:teuthology.orchestra.run.smithi073.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T18:32:31.652 INFO:teuthology.orchestra.run.smithi073.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T18:32:31.652 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T18:32:31.652 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T18:32:31.652 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T18:32:31.652 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T18:32:31.652 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T18:32:31.653 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T18:32:31.653 INFO:teuthology.orchestra.run.smithi073.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T18:32:31.653 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T18:32:31.653 INFO:teuthology.orchestra.run.smithi073.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T18:32:31.653 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T18:32:31.653 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T18:32:31.653 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T18:32:31.653 INFO:teuthology.orchestra.run.smithi073.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T18:32:31.653 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T18:32:31.653 INFO:teuthology.orchestra.run.smithi073.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T18:32:31.653 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T18:32:31.653 INFO:teuthology.orchestra.run.smithi073.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T18:32:31.699 INFO:teuthology.orchestra.run.smithi162.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T18:32:31.703 INFO:teuthology.orchestra.run.smithi162.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T18:32:31.713 INFO:teuthology.orchestra.run.smithi073.stdout:0 upgraded, 119 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T18:32:31.713 INFO:teuthology.orchestra.run.smithi073.stdout:Need to get 251 MB of archives. 2024-09-12T18:32:31.713 INFO:teuthology.orchestra.run.smithi073.stdout:After this operation, 934 MB of additional disk space will be used. 2024-09-12T18:32:31.713 INFO:teuthology.orchestra.run.smithi073.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T18:32:31.715 INFO:teuthology.orchestra.run.smithi162.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T18:32:31.719 INFO:teuthology.orchestra.run.smithi162.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-12T18:32:31.720 INFO:teuthology.orchestra.run.smithi162.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T18:32:31.721 INFO:teuthology.orchestra.run.smithi162.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T18:32:31.722 INFO:teuthology.orchestra.run.smithi162.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T18:32:31.730 INFO:teuthology.orchestra.run.smithi162.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T18:32:31.732 INFO:teuthology.orchestra.run.smithi162.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T18:32:31.734 INFO:teuthology.orchestra.run.smithi162.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T18:32:31.736 INFO:teuthology.orchestra.run.smithi162.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T18:32:31.737 INFO:teuthology.orchestra.run.smithi162.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T18:32:31.753 INFO:teuthology.orchestra.run.smithi162.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T18:32:31.755 INFO:teuthology.orchestra.run.smithi162.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T18:32:31.757 INFO:teuthology.orchestra.run.smithi162.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T18:32:31.758 INFO:teuthology.orchestra.run.smithi162.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T18:32:31.758 INFO:teuthology.orchestra.run.smithi162.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T18:32:31.759 INFO:teuthology.orchestra.run.smithi162.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T18:32:31.760 INFO:teuthology.orchestra.run.smithi162.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T18:32:31.760 INFO:teuthology.orchestra.run.smithi162.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T18:32:31.770 INFO:teuthology.orchestra.run.smithi162.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T18:32:31.771 INFO:teuthology.orchestra.run.smithi162.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T18:32:31.787 INFO:teuthology.orchestra.run.smithi162.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T18:32:31.788 INFO:teuthology.orchestra.run.smithi162.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T18:32:31.790 INFO:teuthology.orchestra.run.smithi162.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T18:32:31.791 INFO:teuthology.orchestra.run.smithi162.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T18:32:31.791 INFO:teuthology.orchestra.run.smithi162.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T18:32:31.791 INFO:teuthology.orchestra.run.smithi162.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T18:32:31.792 INFO:teuthology.orchestra.run.smithi162.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T18:32:31.793 INFO:teuthology.orchestra.run.smithi162.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T18:32:31.795 INFO:teuthology.orchestra.run.smithi114.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4870-g46406987-1jammy [3,334 kB] 2024-09-12T18:32:31.796 INFO:teuthology.orchestra.run.smithi073.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4870-g46406987-1jammy [3,623 kB] 2024-09-12T18:32:31.803 INFO:teuthology.orchestra.run.smithi073.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T18:32:31.804 INFO:teuthology.orchestra.run.smithi162.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T18:32:31.805 INFO:teuthology.orchestra.run.smithi162.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T18:32:31.806 INFO:teuthology.orchestra.run.smithi073.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T18:32:31.821 INFO:teuthology.orchestra.run.smithi162.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T18:32:31.822 INFO:teuthology.orchestra.run.smithi162.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T18:32:31.823 INFO:teuthology.orchestra.run.smithi073.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T18:32:31.828 INFO:teuthology.orchestra.run.smithi162.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T18:32:31.829 INFO:teuthology.orchestra.run.smithi162.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T18:32:31.830 INFO:teuthology.orchestra.run.smithi162.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T18:32:31.831 INFO:teuthology.orchestra.run.smithi162.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T18:32:31.834 INFO:teuthology.orchestra.run.smithi162.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T18:32:31.837 INFO:teuthology.orchestra.run.smithi162.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T18:32:31.839 INFO:teuthology.orchestra.run.smithi162.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T18:32:31.842 INFO:teuthology.orchestra.run.smithi162.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T18:32:31.846 INFO:teuthology.orchestra.run.smithi162.stdout:Get:48 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4870-g46406987-1jammy [3,334 kB] 2024-09-12T18:32:31.856 INFO:teuthology.orchestra.run.smithi162.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T18:32:31.860 INFO:teuthology.orchestra.run.smithi162.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T18:32:31.861 INFO:teuthology.orchestra.run.smithi162.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T18:32:31.862 INFO:teuthology.orchestra.run.smithi162.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T18:32:31.866 INFO:teuthology.orchestra.run.smithi162.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T18:32:31.883 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T18:32:31.888 INFO:teuthology.orchestra.run.smithi114.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4870-g46406987-1jammy [722 kB] 2024-09-12T18:32:31.889 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T18:32:31.901 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T18:32:31.905 INFO:teuthology.orchestra.run.smithi073.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-12T18:32:31.906 INFO:teuthology.orchestra.run.smithi073.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T18:32:31.907 INFO:teuthology.orchestra.run.smithi073.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T18:32:31.907 INFO:teuthology.orchestra.run.smithi073.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T18:32:31.916 INFO:teuthology.orchestra.run.smithi073.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T18:32:31.917 INFO:teuthology.orchestra.run.smithi114.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4870-g46406987-1jammy [356 kB] 2024-09-12T18:32:31.918 INFO:teuthology.orchestra.run.smithi073.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T18:32:31.920 INFO:teuthology.orchestra.run.smithi073.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T18:32:31.922 INFO:teuthology.orchestra.run.smithi073.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T18:32:31.923 INFO:teuthology.orchestra.run.smithi073.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T18:32:31.925 INFO:teuthology.orchestra.run.smithi114.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4870-g46406987-1jammy [32.8 kB] 2024-09-12T18:32:31.926 INFO:teuthology.orchestra.run.smithi114.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4870-g46406987-1jammy [180 kB] 2024-09-12T18:32:31.930 INFO:teuthology.orchestra.run.smithi162.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T18:32:31.931 INFO:teuthology.orchestra.run.smithi162.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T18:32:31.932 INFO:teuthology.orchestra.run.smithi162.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T18:32:31.933 INFO:teuthology.orchestra.run.smithi162.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T18:32:31.934 INFO:teuthology.orchestra.run.smithi162.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T18:32:31.939 INFO:teuthology.orchestra.run.smithi114.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4870-g46406987-1jammy [71.2 kB] 2024-09-12T18:32:31.940 INFO:teuthology.orchestra.run.smithi073.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T18:32:31.942 INFO:teuthology.orchestra.run.smithi073.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T18:32:31.944 INFO:teuthology.orchestra.run.smithi073.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T18:32:31.944 INFO:teuthology.orchestra.run.smithi073.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T18:32:31.945 INFO:teuthology.orchestra.run.smithi073.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T18:32:31.946 INFO:teuthology.orchestra.run.smithi073.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T18:32:31.946 INFO:teuthology.orchestra.run.smithi073.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T18:32:31.946 INFO:teuthology.orchestra.run.smithi073.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T18:32:31.948 INFO:teuthology.orchestra.run.smithi114.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4870-g46406987-1jammy [338 kB] 2024-09-12T18:32:31.951 INFO:teuthology.orchestra.run.smithi162.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T18:32:31.953 INFO:teuthology.orchestra.run.smithi162.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T18:32:31.953 INFO:teuthology.orchestra.run.smithi162.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T18:32:31.955 INFO:teuthology.orchestra.run.smithi114.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4870-g46406987-1jammy [7,987 kB] 2024-09-12T18:32:31.958 INFO:teuthology.orchestra.run.smithi073.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T18:32:31.959 INFO:teuthology.orchestra.run.smithi073.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T18:32:31.967 INFO:teuthology.orchestra.run.smithi162.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T18:32:31.968 INFO:teuthology.orchestra.run.smithi162.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T18:32:31.968 INFO:teuthology.orchestra.run.smithi162.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T18:32:31.968 INFO:teuthology.orchestra.run.smithi162.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T18:32:31.969 INFO:teuthology.orchestra.run.smithi162.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T18:32:31.969 INFO:teuthology.orchestra.run.smithi162.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T18:32:31.970 INFO:teuthology.orchestra.run.smithi162.stdout:Get:68 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4870-g46406987-1jammy [722 kB] 2024-09-12T18:32:31.975 INFO:teuthology.orchestra.run.smithi073.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T18:32:31.976 INFO:teuthology.orchestra.run.smithi073.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T18:32:31.978 INFO:teuthology.orchestra.run.smithi073.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T18:32:31.978 INFO:teuthology.orchestra.run.smithi073.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T18:32:31.979 INFO:teuthology.orchestra.run.smithi073.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T18:32:31.979 INFO:teuthology.orchestra.run.smithi073.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T18:32:31.980 INFO:teuthology.orchestra.run.smithi073.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T18:32:31.980 INFO:teuthology.orchestra.run.smithi073.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T18:32:31.983 INFO:teuthology.orchestra.run.smithi162.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T18:32:31.984 INFO:teuthology.orchestra.run.smithi162.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T18:32:31.987 INFO:teuthology.orchestra.run.smithi162.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T18:32:31.993 INFO:teuthology.orchestra.run.smithi073.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T18:32:31.993 INFO:teuthology.orchestra.run.smithi073.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T18:32:32.000 INFO:teuthology.orchestra.run.smithi162.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T18:32:32.001 INFO:teuthology.orchestra.run.smithi162.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T18:32:32.002 INFO:teuthology.orchestra.run.smithi162.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T18:32:32.005 INFO:teuthology.orchestra.run.smithi162.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T18:32:32.006 INFO:teuthology.orchestra.run.smithi162.stdout:Get:76 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4870-g46406987-1jammy [356 kB] 2024-09-12T18:32:32.007 INFO:teuthology.orchestra.run.smithi162.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T18:32:32.008 INFO:teuthology.orchestra.run.smithi162.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T18:32:32.008 INFO:teuthology.orchestra.run.smithi162.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T18:32:32.010 INFO:teuthology.orchestra.run.smithi073.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T18:32:32.011 INFO:teuthology.orchestra.run.smithi073.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T18:32:32.013 INFO:teuthology.orchestra.run.smithi162.stdout:Get:80 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4870-g46406987-1jammy [32.8 kB] 2024-09-12T18:32:32.014 INFO:teuthology.orchestra.run.smithi162.stdout:Get:81 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4870-g46406987-1jammy [180 kB] 2024-09-12T18:32:32.016 INFO:teuthology.orchestra.run.smithi073.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T18:32:32.016 INFO:teuthology.orchestra.run.smithi073.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T18:32:32.016 INFO:teuthology.orchestra.run.smithi073.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T18:32:32.016 INFO:teuthology.orchestra.run.smithi073.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T18:32:32.017 INFO:teuthology.orchestra.run.smithi162.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T18:32:32.018 INFO:teuthology.orchestra.run.smithi073.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T18:32:32.018 INFO:teuthology.orchestra.run.smithi162.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T18:32:32.019 INFO:teuthology.orchestra.run.smithi073.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T18:32:32.020 INFO:teuthology.orchestra.run.smithi162.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T18:32:32.027 INFO:teuthology.orchestra.run.smithi073.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T18:32:32.029 INFO:teuthology.orchestra.run.smithi073.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T18:32:32.034 INFO:teuthology.orchestra.run.smithi162.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T18:32:32.035 INFO:teuthology.orchestra.run.smithi162.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T18:32:32.035 INFO:teuthology.orchestra.run.smithi162.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T18:32:32.036 INFO:teuthology.orchestra.run.smithi162.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T18:32:32.036 INFO:teuthology.orchestra.run.smithi114.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T18:32:32.037 INFO:teuthology.orchestra.run.smithi162.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T18:32:32.037 INFO:teuthology.orchestra.run.smithi162.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4870-g46406987-1jammy [71.2 kB] 2024-09-12T18:32:32.038 INFO:teuthology.orchestra.run.smithi073.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T18:32:32.039 INFO:teuthology.orchestra.run.smithi162.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4870-g46406987-1jammy [338 kB] 2024-09-12T18:32:32.040 INFO:teuthology.orchestra.run.smithi073.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T18:32:32.041 INFO:teuthology.orchestra.run.smithi073.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T18:32:32.042 INFO:teuthology.orchestra.run.smithi073.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T18:32:32.043 INFO:teuthology.orchestra.run.smithi162.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T18:32:32.043 INFO:teuthology.orchestra.run.smithi162.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T18:32:32.044 INFO:teuthology.orchestra.run.smithi073.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T18:32:32.047 INFO:teuthology.orchestra.run.smithi162.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4870-g46406987-1jammy [7,987 kB] 2024-09-12T18:32:32.049 INFO:teuthology.orchestra.run.smithi114.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T18:32:32.051 INFO:teuthology.orchestra.run.smithi162.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T18:32:32.052 INFO:teuthology.orchestra.run.smithi162.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T18:32:32.053 INFO:teuthology.orchestra.run.smithi162.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T18:32:32.096 INFO:teuthology.orchestra.run.smithi073.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T18:32:32.097 INFO:teuthology.orchestra.run.smithi073.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T18:32:32.098 INFO:teuthology.orchestra.run.smithi073.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T18:32:32.099 INFO:teuthology.orchestra.run.smithi073.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T18:32:32.100 INFO:teuthology.orchestra.run.smithi073.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T18:32:32.116 INFO:teuthology.orchestra.run.smithi073.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T18:32:32.125 INFO:teuthology.orchestra.run.smithi073.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T18:32:32.126 INFO:teuthology.orchestra.run.smithi073.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T18:32:32.130 INFO:teuthology.orchestra.run.smithi114.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T18:32:32.133 INFO:teuthology.orchestra.run.smithi073.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T18:32:32.133 INFO:teuthology.orchestra.run.smithi073.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T18:32:32.133 INFO:teuthology.orchestra.run.smithi073.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T18:32:32.134 INFO:teuthology.orchestra.run.smithi073.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T18:32:32.134 INFO:teuthology.orchestra.run.smithi073.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T18:32:32.135 INFO:teuthology.orchestra.run.smithi073.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T18:32:32.150 INFO:teuthology.orchestra.run.smithi073.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T18:32:32.151 INFO:teuthology.orchestra.run.smithi073.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T18:32:32.154 INFO:teuthology.orchestra.run.smithi073.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T18:32:32.169 INFO:teuthology.orchestra.run.smithi073.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T18:32:32.170 INFO:teuthology.orchestra.run.smithi073.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T18:32:32.170 INFO:teuthology.orchestra.run.smithi073.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T18:32:32.171 INFO:teuthology.orchestra.run.smithi073.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T18:32:32.174 INFO:teuthology.orchestra.run.smithi073.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T18:32:32.174 INFO:teuthology.orchestra.run.smithi073.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T18:32:32.175 INFO:teuthology.orchestra.run.smithi073.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T18:32:32.182 INFO:teuthology.orchestra.run.smithi073.stdout:Get:77 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4870-g46406987-1jammy [3,334 kB] 2024-09-12T18:32:32.184 INFO:teuthology.orchestra.run.smithi073.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T18:32:32.185 INFO:teuthology.orchestra.run.smithi073.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T18:32:32.187 INFO:teuthology.orchestra.run.smithi073.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T18:32:32.202 INFO:teuthology.orchestra.run.smithi073.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T18:32:32.203 INFO:teuthology.orchestra.run.smithi073.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T18:32:32.203 INFO:teuthology.orchestra.run.smithi073.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T18:32:32.204 INFO:teuthology.orchestra.run.smithi073.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T18:32:32.204 INFO:teuthology.orchestra.run.smithi073.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T18:32:32.211 INFO:teuthology.orchestra.run.smithi073.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T18:32:32.211 INFO:teuthology.orchestra.run.smithi073.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T18:32:32.219 INFO:teuthology.orchestra.run.smithi073.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T18:32:32.221 INFO:teuthology.orchestra.run.smithi073.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T18:32:32.222 INFO:teuthology.orchestra.run.smithi073.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T18:32:32.242 INFO:teuthology.orchestra.run.smithi143.stdout:Reading package lists... 2024-09-12T18:32:32.258 INFO:teuthology.orchestra.run.smithi114.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4870-g46406987-1jammy [112 kB] 2024-09-12T18:32:32.260 DEBUG:teuthology.orchestra.run.smithi143:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4870-g46406987-1jammy cephadm=19.3.0-4870-g46406987-1jammy ceph-mds=19.3.0-4870-g46406987-1jammy ceph-mgr=19.3.0-4870-g46406987-1jammy ceph-common=19.3.0-4870-g46406987-1jammy ceph-fuse=19.3.0-4870-g46406987-1jammy ceph-test=19.3.0-4870-g46406987-1jammy ceph-volume=19.3.0-4870-g46406987-1jammy radosgw=19.3.0-4870-g46406987-1jammy python3-rados=19.3.0-4870-g46406987-1jammy python3-rgw=19.3.0-4870-g46406987-1jammy python3-cephfs=19.3.0-4870-g46406987-1jammy python3-rbd=19.3.0-4870-g46406987-1jammy libcephfs2=19.3.0-4870-g46406987-1jammy libcephfs-dev=19.3.0-4870-g46406987-1jammy librados2=19.3.0-4870-g46406987-1jammy librbd1=19.3.0-4870-g46406987-1jammy rbd-fuse=19.3.0-4870-g46406987-1jammy 2024-09-12T18:32:32.265 INFO:teuthology.orchestra.run.smithi114.stdout:Get:15 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4870-g46406987-1jammy [473 kB] 2024-09-12T18:32:32.294 INFO:teuthology.orchestra.run.smithi114.stdout:Get:16 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4870-g46406987-1jammy [28.3 MB] 2024-09-12T18:32:32.323 INFO:teuthology.orchestra.run.smithi143.stdout:Reading package lists... 2024-09-12T18:32:32.358 INFO:teuthology.orchestra.run.smithi114.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T18:32:32.370 INFO:teuthology.orchestra.run.smithi114.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T18:32:32.386 INFO:teuthology.orchestra.run.smithi162.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4870-g46406987-1jammy [112 kB] 2024-09-12T18:32:32.388 INFO:teuthology.orchestra.run.smithi162.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4870-g46406987-1jammy [473 kB] 2024-09-12T18:32:32.399 INFO:teuthology.orchestra.run.smithi114.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T18:32:32.404 INFO:teuthology.orchestra.run.smithi073.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4870-g46406987-1jammy [722 kB] 2024-09-12T18:32:32.408 INFO:teuthology.orchestra.run.smithi114.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-12T18:32:32.411 INFO:teuthology.orchestra.run.smithi114.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T18:32:32.411 INFO:teuthology.orchestra.run.smithi114.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T18:32:32.415 INFO:teuthology.orchestra.run.smithi114.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T18:32:32.427 INFO:teuthology.orchestra.run.smithi162.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4870-g46406987-1jammy [28.3 MB] 2024-09-12T18:32:32.430 INFO:teuthology.orchestra.run.smithi114.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T18:32:32.434 INFO:teuthology.orchestra.run.smithi114.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T18:32:32.441 INFO:teuthology.orchestra.run.smithi114.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T18:32:32.461 INFO:teuthology.orchestra.run.smithi073.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4870-g46406987-1jammy [356 kB] 2024-09-12T18:32:32.513 INFO:teuthology.orchestra.run.smithi073.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4870-g46406987-1jammy [32.8 kB] 2024-09-12T18:32:32.515 INFO:teuthology.orchestra.run.smithi073.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4870-g46406987-1jammy [180 kB] 2024-09-12T18:32:32.519 INFO:teuthology.orchestra.run.smithi073.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4870-g46406987-1jammy [71.2 kB] 2024-09-12T18:32:32.520 INFO:teuthology.orchestra.run.smithi114.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T18:32:32.521 INFO:teuthology.orchestra.run.smithi114.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T18:32:32.521 INFO:teuthology.orchestra.run.smithi073.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4870-g46406987-1jammy [338 kB] 2024-09-12T18:32:32.525 INFO:teuthology.orchestra.run.smithi114.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T18:32:32.529 INFO:teuthology.orchestra.run.smithi114.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T18:32:32.533 INFO:teuthology.orchestra.run.smithi114.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T18:32:32.533 INFO:teuthology.orchestra.run.smithi143.stdout:Building dependency tree... 2024-09-12T18:32:32.534 INFO:teuthology.orchestra.run.smithi143.stdout:Reading state information... 2024-09-12T18:32:32.534 INFO:teuthology.orchestra.run.smithi114.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T18:32:32.535 INFO:teuthology.orchestra.run.smithi114.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T18:32:32.537 INFO:teuthology.orchestra.run.smithi114.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T18:32:32.537 INFO:teuthology.orchestra.run.smithi114.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T18:32:32.572 INFO:teuthology.orchestra.run.smithi073.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4870-g46406987-1jammy [7,987 kB] 2024-09-12T18:32:32.603 INFO:teuthology.orchestra.run.smithi114.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T18:32:32.620 INFO:teuthology.orchestra.run.smithi114.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T18:32:32.621 INFO:teuthology.orchestra.run.smithi114.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T18:32:32.622 INFO:teuthology.orchestra.run.smithi114.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T18:32:32.622 INFO:teuthology.orchestra.run.smithi114.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T18:32:32.627 INFO:teuthology.orchestra.run.smithi114.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T18:32:32.629 INFO:teuthology.orchestra.run.smithi114.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T18:32:32.685 INFO:teuthology.orchestra.run.smithi114.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T18:32:32.686 INFO:teuthology.orchestra.run.smithi114.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T18:32:32.688 INFO:teuthology.orchestra.run.smithi114.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T18:32:32.726 INFO:teuthology.orchestra.run.smithi143.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:32:32.727 INFO:teuthology.orchestra.run.smithi143.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:32:32.727 INFO:teuthology.orchestra.run.smithi143.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:32:32.727 INFO:teuthology.orchestra.run.smithi143.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:32:32.727 INFO:teuthology.orchestra.run.smithi143.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T18:32:32.727 INFO:teuthology.orchestra.run.smithi143.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T18:32:32.727 INFO:teuthology.orchestra.run.smithi143.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:32:32.728 INFO:teuthology.orchestra.run.smithi143.stdout:The following additional packages will be installed: 2024-09-12T18:32:32.728 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T18:32:32.728 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T18:32:32.729 INFO:teuthology.orchestra.run.smithi143.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-12T18:32:32.729 INFO:teuthology.orchestra.run.smithi143.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-12T18:32:32.729 INFO:teuthology.orchestra.run.smithi143.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-12T18:32:32.730 INFO:teuthology.orchestra.run.smithi143.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-12T18:32:32.730 INFO:teuthology.orchestra.run.smithi143.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-12T18:32:32.730 INFO:teuthology.orchestra.run.smithi143.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-12T18:32:32.730 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-12T18:32:32.730 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-12T18:32:32.730 INFO:teuthology.orchestra.run.smithi143.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-12T18:32:32.730 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-12T18:32:32.730 INFO:teuthology.orchestra.run.smithi143.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-12T18:32:32.730 INFO:teuthology.orchestra.run.smithi143.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-12T18:32:32.730 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-12T18:32:32.730 INFO:teuthology.orchestra.run.smithi143.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-12T18:32:32.730 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-12T18:32:32.731 INFO:teuthology.orchestra.run.smithi143.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-12T18:32:32.731 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T18:32:32.731 INFO:teuthology.orchestra.run.smithi143.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T18:32:32.731 INFO:teuthology.orchestra.run.smithi143.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T18:32:32.731 INFO:teuthology.orchestra.run.smithi143.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T18:32:32.731 INFO:teuthology.orchestra.run.smithi143.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T18:32:32.731 INFO:teuthology.orchestra.run.smithi143.stdout: xmlstarlet zip 2024-09-12T18:32:32.732 INFO:teuthology.orchestra.run.smithi143.stdout:Suggested packages: 2024-09-12T18:32:32.732 INFO:teuthology.orchestra.run.smithi143.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T18:32:32.732 INFO:teuthology.orchestra.run.smithi143.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T18:32:32.732 INFO:teuthology.orchestra.run.smithi143.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T18:32:32.732 INFO:teuthology.orchestra.run.smithi143.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T18:32:32.732 INFO:teuthology.orchestra.run.smithi143.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T18:32:32.732 INFO:teuthology.orchestra.run.smithi143.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T18:32:32.732 INFO:teuthology.orchestra.run.smithi143.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T18:32:32.732 INFO:teuthology.orchestra.run.smithi143.stdout:Recommended packages: 2024-09-12T18:32:32.733 INFO:teuthology.orchestra.run.smithi143.stdout: btrfs-tools 2024-09-12T18:32:32.766 INFO:teuthology.orchestra.run.smithi114.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T18:32:32.766 INFO:teuthology.orchestra.run.smithi114.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T18:32:32.769 INFO:teuthology.orchestra.run.smithi114.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T18:32:32.771 INFO:teuthology.orchestra.run.smithi114.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T18:32:32.771 INFO:teuthology.orchestra.run.smithi114.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T18:32:32.782 INFO:teuthology.orchestra.run.smithi114.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T18:32:32.834 INFO:teuthology.orchestra.run.smithi143.stdout:The following NEW packages will be installed: 2024-09-12T18:32:32.834 INFO:teuthology.orchestra.run.smithi143.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T18:32:32.834 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T18:32:32.834 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T18:32:32.834 INFO:teuthology.orchestra.run.smithi143.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T18:32:32.835 INFO:teuthology.orchestra.run.smithi143.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-12T18:32:32.835 INFO:teuthology.orchestra.run.smithi143.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T18:32:32.836 INFO:teuthology.orchestra.run.smithi143.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T18:32:32.836 INFO:teuthology.orchestra.run.smithi143.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T18:32:32.836 INFO:teuthology.orchestra.run.smithi143.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T18:32:32.836 INFO:teuthology.orchestra.run.smithi143.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T18:32:32.836 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T18:32:32.836 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T18:32:32.836 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T18:32:32.836 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T18:32:32.836 INFO:teuthology.orchestra.run.smithi143.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T18:32:32.837 INFO:teuthology.orchestra.run.smithi143.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T18:32:32.837 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T18:32:32.837 INFO:teuthology.orchestra.run.smithi143.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T18:32:32.837 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T18:32:32.837 INFO:teuthology.orchestra.run.smithi143.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T18:32:32.837 INFO:teuthology.orchestra.run.smithi143.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T18:32:32.837 INFO:teuthology.orchestra.run.smithi143.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T18:32:32.837 INFO:teuthology.orchestra.run.smithi143.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T18:32:32.837 INFO:teuthology.orchestra.run.smithi143.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T18:32:32.837 INFO:teuthology.orchestra.run.smithi143.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T18:32:32.838 INFO:teuthology.orchestra.run.smithi143.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T18:32:32.847 INFO:teuthology.orchestra.run.smithi114.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T18:32:32.848 INFO:teuthology.orchestra.run.smithi114.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T18:32:32.849 INFO:teuthology.orchestra.run.smithi114.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T18:32:32.852 INFO:teuthology.orchestra.run.smithi114.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T18:32:32.895 INFO:teuthology.orchestra.run.smithi143.stdout:0 upgraded, 119 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T18:32:32.895 INFO:teuthology.orchestra.run.smithi143.stdout:Need to get 251 MB of archives. 2024-09-12T18:32:32.896 INFO:teuthology.orchestra.run.smithi143.stdout:After this operation, 934 MB of additional disk space will be used. 2024-09-12T18:32:32.896 INFO:teuthology.orchestra.run.smithi143.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T18:32:32.929 INFO:teuthology.orchestra.run.smithi114.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T18:32:32.930 INFO:teuthology.orchestra.run.smithi114.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T18:32:32.933 INFO:teuthology.orchestra.run.smithi114.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T18:32:32.934 INFO:teuthology.orchestra.run.smithi114.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T18:32:32.939 INFO:teuthology.orchestra.run.smithi114.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T18:32:32.940 INFO:teuthology.orchestra.run.smithi114.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T18:32:32.985 INFO:teuthology.orchestra.run.smithi143.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T18:32:32.988 INFO:teuthology.orchestra.run.smithi143.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T18:32:33.005 INFO:teuthology.orchestra.run.smithi143.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T18:32:33.010 INFO:teuthology.orchestra.run.smithi114.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T18:32:33.014 INFO:teuthology.orchestra.run.smithi114.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T18:32:33.066 INFO:teuthology.orchestra.run.smithi143.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T18:32:33.071 INFO:teuthology.orchestra.run.smithi143.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T18:32:33.085 INFO:teuthology.orchestra.run.smithi143.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T18:32:33.089 INFO:teuthology.orchestra.run.smithi143.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-12T18:32:33.090 INFO:teuthology.orchestra.run.smithi143.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T18:32:33.091 INFO:teuthology.orchestra.run.smithi143.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T18:32:33.091 INFO:teuthology.orchestra.run.smithi143.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T18:32:33.101 INFO:teuthology.orchestra.run.smithi143.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T18:32:33.103 INFO:teuthology.orchestra.run.smithi143.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T18:32:33.105 INFO:teuthology.orchestra.run.smithi143.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T18:32:33.106 INFO:teuthology.orchestra.run.smithi143.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T18:32:33.118 INFO:teuthology.orchestra.run.smithi073.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4870-g46406987-1jammy [112 kB] 2024-09-12T18:32:33.123 INFO:teuthology.orchestra.run.smithi143.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T18:32:33.125 INFO:teuthology.orchestra.run.smithi143.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T18:32:33.127 INFO:teuthology.orchestra.run.smithi143.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T18:32:33.129 INFO:teuthology.orchestra.run.smithi143.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T18:32:33.129 INFO:teuthology.orchestra.run.smithi143.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T18:32:33.130 INFO:teuthology.orchestra.run.smithi143.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T18:32:33.140 INFO:teuthology.orchestra.run.smithi143.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T18:32:33.141 INFO:teuthology.orchestra.run.smithi143.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T18:32:33.141 INFO:teuthology.orchestra.run.smithi143.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T18:32:33.141 INFO:teuthology.orchestra.run.smithi143.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T18:32:33.157 INFO:teuthology.orchestra.run.smithi143.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T18:32:33.158 INFO:teuthology.orchestra.run.smithi143.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T18:32:33.158 INFO:teuthology.orchestra.run.smithi143.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T18:32:33.160 INFO:teuthology.orchestra.run.smithi143.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T18:32:33.161 INFO:teuthology.orchestra.run.smithi143.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T18:32:33.161 INFO:teuthology.orchestra.run.smithi143.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T18:32:33.162 INFO:teuthology.orchestra.run.smithi073.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4870-g46406987-1jammy [473 kB] 2024-09-12T18:32:33.164 INFO:teuthology.orchestra.run.smithi143.stdout:Get:32 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4870-g46406987-1jammy [3,623 kB] 2024-09-12T18:32:33.172 INFO:teuthology.orchestra.run.smithi073.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4870-g46406987-1jammy [28.3 MB] 2024-09-12T18:32:33.174 INFO:teuthology.orchestra.run.smithi143.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T18:32:33.176 INFO:teuthology.orchestra.run.smithi143.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T18:32:33.176 INFO:teuthology.orchestra.run.smithi143.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T18:32:33.176 INFO:teuthology.orchestra.run.smithi143.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T18:32:33.177 INFO:teuthology.orchestra.run.smithi114.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T18:32:33.179 INFO:teuthology.orchestra.run.smithi114.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T18:32:33.181 INFO:teuthology.orchestra.run.smithi114.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T18:32:33.182 INFO:teuthology.orchestra.run.smithi114.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T18:32:33.184 INFO:teuthology.orchestra.run.smithi114.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T18:32:33.192 INFO:teuthology.orchestra.run.smithi143.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T18:32:33.192 INFO:teuthology.orchestra.run.smithi143.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T18:32:33.193 INFO:teuthology.orchestra.run.smithi143.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T18:32:33.199 INFO:teuthology.orchestra.run.smithi143.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T18:32:33.199 INFO:teuthology.orchestra.run.smithi143.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T18:32:33.199 INFO:teuthology.orchestra.run.smithi143.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T18:32:33.209 INFO:teuthology.orchestra.run.smithi143.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T18:32:33.210 INFO:teuthology.orchestra.run.smithi143.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T18:32:33.212 INFO:teuthology.orchestra.run.smithi143.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T18:32:33.213 INFO:teuthology.orchestra.run.smithi143.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T18:32:33.218 INFO:teuthology.orchestra.run.smithi114.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T18:32:33.221 INFO:teuthology.orchestra.run.smithi114.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T18:32:33.221 INFO:teuthology.orchestra.run.smithi114.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T18:32:33.227 INFO:teuthology.orchestra.run.smithi143.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T18:32:33.228 INFO:teuthology.orchestra.run.smithi143.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T18:32:33.229 INFO:teuthology.orchestra.run.smithi143.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T18:32:33.230 INFO:teuthology.orchestra.run.smithi143.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T18:32:33.231 INFO:teuthology.orchestra.run.smithi143.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T18:32:33.233 INFO:teuthology.orchestra.run.smithi143.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T18:32:33.281 INFO:teuthology.orchestra.run.smithi114.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T18:32:33.281 INFO:teuthology.orchestra.run.smithi114.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T18:32:33.289 INFO:teuthology.orchestra.run.smithi143.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T18:32:33.289 INFO:teuthology.orchestra.run.smithi143.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T18:32:33.289 INFO:teuthology.orchestra.run.smithi143.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T18:32:33.289 INFO:teuthology.orchestra.run.smithi143.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T18:32:33.289 INFO:teuthology.orchestra.run.smithi143.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T18:32:33.306 INFO:teuthology.orchestra.run.smithi143.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T18:32:33.307 INFO:teuthology.orchestra.run.smithi143.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T18:32:33.308 INFO:teuthology.orchestra.run.smithi143.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T18:32:33.322 INFO:teuthology.orchestra.run.smithi143.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T18:32:33.323 INFO:teuthology.orchestra.run.smithi143.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T18:32:33.323 INFO:teuthology.orchestra.run.smithi143.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T18:32:33.323 INFO:teuthology.orchestra.run.smithi143.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T18:32:33.323 INFO:teuthology.orchestra.run.smithi143.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T18:32:33.324 INFO:teuthology.orchestra.run.smithi143.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T18:32:33.341 INFO:teuthology.orchestra.run.smithi143.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T18:32:33.342 INFO:teuthology.orchestra.run.smithi143.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T18:32:33.344 INFO:teuthology.orchestra.run.smithi114.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T18:32:33.345 INFO:teuthology.orchestra.run.smithi114.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T18:32:33.345 INFO:teuthology.orchestra.run.smithi143.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T18:32:33.345 INFO:teuthology.orchestra.run.smithi114.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T18:32:33.346 INFO:teuthology.orchestra.run.smithi114.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T18:32:33.347 INFO:teuthology.orchestra.run.smithi114.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T18:32:33.348 INFO:teuthology.orchestra.run.smithi114.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T18:32:33.354 INFO:teuthology.orchestra.run.smithi114.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T18:32:33.359 INFO:teuthology.orchestra.run.smithi143.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T18:32:33.360 INFO:teuthology.orchestra.run.smithi143.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T18:32:33.361 INFO:teuthology.orchestra.run.smithi143.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T18:32:33.364 INFO:teuthology.orchestra.run.smithi143.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T18:32:33.366 INFO:teuthology.orchestra.run.smithi143.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T18:32:33.367 INFO:teuthology.orchestra.run.smithi143.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T18:32:33.367 INFO:teuthology.orchestra.run.smithi143.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T18:32:33.376 INFO:teuthology.orchestra.run.smithi143.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T18:32:33.377 INFO:teuthology.orchestra.run.smithi143.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T18:32:33.379 INFO:teuthology.orchestra.run.smithi143.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T18:32:33.393 INFO:teuthology.orchestra.run.smithi143.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T18:32:33.394 INFO:teuthology.orchestra.run.smithi143.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T18:32:33.395 INFO:teuthology.orchestra.run.smithi143.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T18:32:33.396 INFO:teuthology.orchestra.run.smithi143.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T18:32:33.396 INFO:teuthology.orchestra.run.smithi143.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T18:32:33.407 INFO:teuthology.orchestra.run.smithi143.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T18:32:33.407 INFO:teuthology.orchestra.run.smithi143.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T18:32:33.410 INFO:teuthology.orchestra.run.smithi143.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T18:32:33.412 INFO:teuthology.orchestra.run.smithi143.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T18:32:33.413 INFO:teuthology.orchestra.run.smithi143.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T18:32:33.425 INFO:teuthology.orchestra.run.smithi114.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T18:32:33.428 INFO:teuthology.orchestra.run.smithi114.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T18:32:33.430 INFO:teuthology.orchestra.run.smithi114.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T18:32:33.507 INFO:teuthology.orchestra.run.smithi114.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T18:32:33.513 INFO:teuthology.orchestra.run.smithi114.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T18:32:33.515 INFO:teuthology.orchestra.run.smithi114.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T18:32:33.516 INFO:teuthology.orchestra.run.smithi114.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T18:32:33.528 INFO:teuthology.orchestra.run.smithi114.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T18:32:33.529 INFO:teuthology.orchestra.run.smithi114.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T18:32:33.537 INFO:teuthology.orchestra.run.smithi114.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T18:32:33.588 INFO:teuthology.orchestra.run.smithi114.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T18:32:33.590 INFO:teuthology.orchestra.run.smithi114.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T18:32:33.591 INFO:teuthology.orchestra.run.smithi114.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T18:32:33.670 INFO:teuthology.orchestra.run.smithi114.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T18:32:33.670 INFO:teuthology.orchestra.run.smithi162.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4870-g46406987-1jammy [5,206 kB] 2024-09-12T18:32:33.735 INFO:teuthology.orchestra.run.smithi114.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4870-g46406987-1jammy [5,206 kB] 2024-09-12T18:32:33.735 INFO:teuthology.orchestra.run.smithi114.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T18:32:33.751 INFO:teuthology.orchestra.run.smithi114.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T18:32:33.752 INFO:teuthology.orchestra.run.smithi114.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T18:32:33.753 INFO:teuthology.orchestra.run.smithi114.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T18:32:33.758 INFO:teuthology.orchestra.run.smithi114.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T18:32:33.760 INFO:teuthology.orchestra.run.smithi114.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T18:32:33.778 INFO:teuthology.orchestra.run.smithi162.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4870-g46406987-1jammy [251 kB] 2024-09-12T18:32:33.794 INFO:teuthology.orchestra.run.smithi162.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4870-g46406987-1jammy [124 kB] 2024-09-12T18:32:33.797 INFO:teuthology.orchestra.run.smithi162.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4870-g46406987-1jammy [1,561 kB] 2024-09-12T18:32:33.856 INFO:teuthology.orchestra.run.smithi162.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4870-g46406987-1jammy [6,309 kB] 2024-09-12T18:32:33.942 INFO:teuthology.orchestra.run.smithi114.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4870-g46406987-1jammy [251 kB] 2024-09-12T18:32:33.953 INFO:teuthology.orchestra.run.smithi114.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4870-g46406987-1jammy [124 kB] 2024-09-12T18:32:33.956 INFO:teuthology.orchestra.run.smithi114.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4870-g46406987-1jammy [1,561 kB] 2024-09-12T18:32:34.024 INFO:teuthology.orchestra.run.smithi114.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4870-g46406987-1jammy [6,309 kB] 2024-09-12T18:32:34.112 INFO:teuthology.orchestra.run.smithi162.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4870-g46406987-1jammy [23.1 MB] 2024-09-12T18:32:34.385 INFO:teuthology.orchestra.run.smithi114.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4870-g46406987-1jammy [23.1 MB] 2024-09-12T18:32:34.664 INFO:teuthology.orchestra.run.smithi143.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4870-g46406987-1jammy [3,334 kB] 2024-09-12T18:32:35.146 INFO:teuthology.orchestra.run.smithi073.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4870-g46406987-1jammy [5,206 kB] 2024-09-12T18:32:35.162 INFO:teuthology.orchestra.run.smithi162.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4870-g46406987-1jammy [14.0 kB] 2024-09-12T18:32:35.163 INFO:teuthology.orchestra.run.smithi162.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4870-g46406987-1jammy [880 kB] 2024-09-12T18:32:35.179 INFO:teuthology.orchestra.run.smithi162.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4870-g46406987-1jammy [2,454 kB] 2024-09-12T18:32:35.222 INFO:teuthology.orchestra.run.smithi162.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4870-g46406987-1jammy [813 kB] 2024-09-12T18:32:35.253 INFO:teuthology.orchestra.run.smithi162.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4870-g46406987-1jammy [160 kB] 2024-09-12T18:32:35.257 INFO:teuthology.orchestra.run.smithi162.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4870-g46406987-1jammy [61.5 MB] 2024-09-12T18:32:35.341 INFO:teuthology.orchestra.run.smithi143.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4870-g46406987-1jammy [722 kB] 2024-09-12T18:32:35.390 INFO:teuthology.orchestra.run.smithi073.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4870-g46406987-1jammy [251 kB] 2024-09-12T18:32:35.395 INFO:teuthology.orchestra.run.smithi073.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4870-g46406987-1jammy [124 kB] 2024-09-12T18:32:35.421 INFO:teuthology.orchestra.run.smithi073.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4870-g46406987-1jammy [1,561 kB] 2024-09-12T18:32:35.483 INFO:teuthology.orchestra.run.smithi143.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4870-g46406987-1jammy [356 kB] 2024-09-12T18:32:35.491 INFO:teuthology.orchestra.run.smithi143.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4870-g46406987-1jammy [32.8 kB] 2024-09-12T18:32:35.492 INFO:teuthology.orchestra.run.smithi143.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4870-g46406987-1jammy [180 kB] 2024-09-12T18:32:35.507 INFO:teuthology.orchestra.run.smithi073.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4870-g46406987-1jammy [6,309 kB] 2024-09-12T18:32:35.560 INFO:teuthology.orchestra.run.smithi143.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4870-g46406987-1jammy [71.2 kB] 2024-09-12T18:32:35.563 INFO:teuthology.orchestra.run.smithi143.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4870-g46406987-1jammy [338 kB] 2024-09-12T18:32:35.634 INFO:teuthology.orchestra.run.smithi143.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4870-g46406987-1jammy [7,987 kB] 2024-09-12T18:32:35.922 INFO:teuthology.orchestra.run.smithi114.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4870-g46406987-1jammy [14.0 kB] 2024-09-12T18:32:35.923 INFO:teuthology.orchestra.run.smithi114.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4870-g46406987-1jammy [880 kB] 2024-09-12T18:32:35.937 INFO:teuthology.orchestra.run.smithi073.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4870-g46406987-1jammy [23.1 MB] 2024-09-12T18:32:35.940 INFO:teuthology.orchestra.run.smithi114.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4870-g46406987-1jammy [2,454 kB] 2024-09-12T18:32:35.982 INFO:teuthology.orchestra.run.smithi114.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4870-g46406987-1jammy [813 kB] 2024-09-12T18:32:35.993 INFO:teuthology.orchestra.run.smithi114.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4870-g46406987-1jammy [160 kB] 2024-09-12T18:32:35.994 INFO:teuthology.orchestra.run.smithi114.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4870-g46406987-1jammy [61.5 MB] 2024-09-12T18:32:36.471 INFO:teuthology.orchestra.run.smithi143.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4870-g46406987-1jammy [112 kB] 2024-09-12T18:32:36.474 INFO:teuthology.orchestra.run.smithi143.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4870-g46406987-1jammy [473 kB] 2024-09-12T18:32:36.485 INFO:teuthology.orchestra.run.smithi143.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4870-g46406987-1jammy [28.3 MB] 2024-09-12T18:32:38.101 INFO:teuthology.orchestra.run.smithi162.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4870-g46406987-1jammy [8,625 kB] 2024-09-12T18:32:38.312 INFO:teuthology.orchestra.run.smithi073.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4870-g46406987-1jammy [14.0 kB] 2024-09-12T18:32:38.313 INFO:teuthology.orchestra.run.smithi073.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4870-g46406987-1jammy [880 kB] 2024-09-12T18:32:38.317 INFO:teuthology.orchestra.run.smithi162.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4870-g46406987-1jammy [14.2 kB] 2024-09-12T18:32:38.318 INFO:teuthology.orchestra.run.smithi162.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4870-g46406987-1jammy [55.8 MB] 2024-09-12T18:32:38.345 INFO:teuthology.orchestra.run.smithi073.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4870-g46406987-1jammy [2,454 kB] 2024-09-12T18:32:38.410 INFO:teuthology.orchestra.run.smithi143.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4870-g46406987-1jammy [5,206 kB] 2024-09-12T18:32:38.627 INFO:teuthology.orchestra.run.smithi073.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4870-g46406987-1jammy [813 kB] 2024-09-12T18:32:38.687 INFO:teuthology.orchestra.run.smithi143.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4870-g46406987-1jammy [251 kB] 2024-09-12T18:32:38.704 INFO:teuthology.orchestra.run.smithi143.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4870-g46406987-1jammy [124 kB] 2024-09-12T18:32:38.707 INFO:teuthology.orchestra.run.smithi143.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4870-g46406987-1jammy [1,561 kB] 2024-09-12T18:32:38.707 INFO:teuthology.orchestra.run.smithi073.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4870-g46406987-1jammy [160 kB] 2024-09-12T18:32:38.764 INFO:teuthology.orchestra.run.smithi073.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4870-g46406987-1jammy [61.5 MB] 2024-09-12T18:32:38.828 INFO:teuthology.orchestra.run.smithi143.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4870-g46406987-1jammy [6,309 kB] 2024-09-12T18:32:39.302 INFO:teuthology.orchestra.run.smithi143.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4870-g46406987-1jammy [23.1 MB] 2024-09-12T18:32:41.241 INFO:teuthology.orchestra.run.smithi143.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4870-g46406987-1jammy [14.0 kB] 2024-09-12T18:32:41.242 INFO:teuthology.orchestra.run.smithi143.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4870-g46406987-1jammy [880 kB] 2024-09-12T18:32:41.259 INFO:teuthology.orchestra.run.smithi143.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4870-g46406987-1jammy [2,454 kB] 2024-09-12T18:32:41.263 INFO:teuthology.orchestra.run.smithi114.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4870-g46406987-1jammy [8,625 kB] 2024-09-12T18:32:41.417 INFO:teuthology.orchestra.run.smithi162.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4870-g46406987-1jammy [130 kB] 2024-09-12T18:32:41.420 INFO:teuthology.orchestra.run.smithi162.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4870-g46406987-1jammy [39.0 kB] 2024-09-12T18:32:41.480 INFO:teuthology.orchestra.run.smithi162.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4870-g46406987-1jammy [15.9 MB] 2024-09-12T18:32:41.487 INFO:teuthology.orchestra.run.smithi143.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4870-g46406987-1jammy [813 kB] 2024-09-12T18:32:41.569 INFO:teuthology.orchestra.run.smithi143.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4870-g46406987-1jammy [160 kB] 2024-09-12T18:32:41.573 INFO:teuthology.orchestra.run.smithi143.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4870-g46406987-1jammy [61.5 MB] 2024-09-12T18:32:41.926 INFO:teuthology.orchestra.run.smithi114.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4870-g46406987-1jammy [14.2 kB] 2024-09-12T18:32:41.927 INFO:teuthology.orchestra.run.smithi114.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4870-g46406987-1jammy [55.8 MB] 2024-09-12T18:32:42.617 INFO:teuthology.orchestra.run.smithi162.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4870-g46406987-1jammy [91.2 kB] 2024-09-12T18:32:43.188 INFO:teuthology.orchestra.run.smithi162.stdout:Fetched 251 MB in 11s (22.5 MB/s) 2024-09-12T18:32:43.422 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T18:32:43.523 INFO:teuthology.orchestra.run.smithi162.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T18:32:43.528 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T18:32:43.628 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T18:32:44.048 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T18:32:44.075 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T18:32:44.123 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T18:32:44.460 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T18:32:44.486 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T18:32:44.535 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T18:32:45.072 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T18:32:45.098 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T18:32:45.155 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:32:45.625 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T18:32:45.651 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T18:32:45.692 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:32:46.052 INFO:teuthology.orchestra.run.smithi073.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4870-g46406987-1jammy [8,625 kB] 2024-09-12T18:32:46.087 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T18:32:46.113 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T18:32:46.162 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:32:46.705 INFO:teuthology.orchestra.run.smithi073.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4870-g46406987-1jammy [14.2 kB] 2024-09-12T18:32:46.705 INFO:teuthology.orchestra.run.smithi073.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4870-g46406987-1jammy [55.8 MB] 2024-09-12T18:32:46.816 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T18:32:46.842 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T18:32:46.890 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T18:32:46.955 INFO:teuthology.orchestra.run.smithi114.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4870-g46406987-1jammy [130 kB] 2024-09-12T18:32:46.957 INFO:teuthology.orchestra.run.smithi114.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4870-g46406987-1jammy [39.0 kB] 2024-09-12T18:32:46.958 INFO:teuthology.orchestra.run.smithi114.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4870-g46406987-1jammy [15.9 MB] 2024-09-12T18:32:47.210 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package librados2. 2024-09-12T18:32:47.225 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../007-librados2_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:32:47.260 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking librados2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:32:47.564 INFO:teuthology.orchestra.run.smithi143.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4870-g46406987-1jammy [8,625 kB] 2024-09-12T18:32:47.722 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libnbd0. 2024-09-12T18:32:47.748 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-12T18:32:47.766 INFO:teuthology.orchestra.run.smithi114.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4870-g46406987-1jammy [91.2 kB] 2024-09-12T18:32:47.788 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-12T18:32:47.838 INFO:teuthology.orchestra.run.smithi143.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4870-g46406987-1jammy [14.2 kB] 2024-09-12T18:32:47.839 INFO:teuthology.orchestra.run.smithi143.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4870-g46406987-1jammy [55.8 MB] 2024-09-12T18:32:48.091 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package librbd1. 2024-09-12T18:32:48.118 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../009-librbd1_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:32:48.157 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking librbd1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:32:48.341 INFO:teuthology.orchestra.run.smithi114.stdout:Fetched 251 MB in 16s (15.4 MB/s) 2024-09-12T18:32:48.508 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T18:32:48.606 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T18:32:48.611 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T18:32:48.612 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T18:32:48.637 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:32:48.669 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libcephfs2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:32:48.704 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T18:32:48.930 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-rados. 2024-09-12T18:32:48.957 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../011-python3-rados_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:32:48.996 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-rados (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:32:49.050 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T18:32:49.076 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T18:32:49.116 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T18:32:49.316 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T18:32:49.342 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:32:49.382 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-ceph-argparse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:32:49.453 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T18:32:49.479 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T18:32:49.519 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T18:32:49.618 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T18:32:49.645 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:32:49.685 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-cephfs (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:32:49.843 INFO:teuthology.orchestra.run.smithi073.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4870-g46406987-1jammy [130 kB] 2024-09-12T18:32:49.846 INFO:teuthology.orchestra.run.smithi073.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4870-g46406987-1jammy [39.0 kB] 2024-09-12T18:32:49.847 INFO:teuthology.orchestra.run.smithi073.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4870-g46406987-1jammy [15.9 MB] 2024-09-12T18:32:49.923 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T18:32:49.949 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T18:32:49.988 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T18:32:49.989 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:32:50.014 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:32:50.054 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:32:50.366 INFO:teuthology.orchestra.run.smithi073.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4870-g46406987-1jammy [91.2 kB] 2024-09-12T18:32:50.374 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T18:32:50.401 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T18:32:50.401 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T18:32:50.404 INFO:teuthology.orchestra.run.smithi143.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4870-g46406987-1jammy [130 kB] 2024-09-12T18:32:50.407 INFO:teuthology.orchestra.run.smithi143.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4870-g46406987-1jammy [39.0 kB] 2024-09-12T18:32:50.428 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T18:32:50.441 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T18:32:50.467 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:32:50.473 INFO:teuthology.orchestra.run.smithi143.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4870-g46406987-1jammy [15.9 MB] 2024-09-12T18:32:50.803 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T18:32:50.820 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T18:32:50.829 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T18:32:50.846 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T18:32:50.869 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T18:32:50.887 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:32:50.941 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 251 MB in 19s (13.4 MB/s) 2024-09-12T18:32:50.961 INFO:teuthology.orchestra.run.smithi143.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4870-g46406987-1jammy [91.2 kB] 2024-09-12T18:32:51.097 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T18:32:51.108 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T18:32:51.123 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:32:51.163 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-rbd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:32:51.208 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T18:32:51.214 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T18:32:51.298 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T18:32:51.373 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T18:32:51.388 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T18:32:51.423 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T18:32:51.500 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T18:32:51.526 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T18:32:51.531 INFO:teuthology.orchestra.run.smithi143.stdout:Fetched 251 MB in 18s (13.9 MB/s) 2024-09-12T18:32:51.566 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T18:32:51.699 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T18:32:51.742 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package librados2. 2024-09-12T18:32:51.768 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../007-librados2_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:32:51.799 INFO:teuthology.orchestra.run.smithi143.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T18:32:51.804 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T18:32:51.809 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking librados2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:32:51.847 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T18:32:51.870 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T18:32:51.889 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T18:32:51.910 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T18:32:51.962 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T18:32:51.988 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T18:32:52.027 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T18:32:52.209 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T18:32:52.235 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T18:32:52.247 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T18:32:52.273 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T18:32:52.276 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T18:32:52.295 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libnbd0. 2024-09-12T18:32:52.306 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T18:32:52.313 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T18:32:52.321 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-12T18:32:52.329 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T18:32:52.372 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T18:32:52.386 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-12T18:32:52.587 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T18:32:52.613 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T18:32:52.653 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T18:32:52.692 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T18:32:52.701 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package lua5.1. 2024-09-12T18:32:52.706 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package librbd1. 2024-09-12T18:32:52.718 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T18:32:52.727 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T18:32:52.732 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../009-librbd1_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:32:52.767 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:32:52.767 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T18:32:52.772 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking librbd1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:32:53.087 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package lua-any. 2024-09-12T18:32:53.102 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-12T18:32:53.107 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T18:32:53.133 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T18:32:53.145 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T18:32:53.182 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:32:53.187 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T18:32:53.214 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T18:32:53.225 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T18:32:53.252 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:32:53.254 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:32:53.292 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libcephfs2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:32:53.365 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package zip. 2024-09-12T18:32:53.380 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-12T18:32:53.416 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T18:32:53.565 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T18:32:53.569 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-rados. 2024-09-12T18:32:53.592 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T18:32:53.593 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T18:32:53.596 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../011-python3-rados_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:32:53.621 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T18:32:53.624 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:32:53.637 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-rados (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:32:53.660 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:32:53.719 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package unzip. 2024-09-12T18:32:53.745 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T18:32:53.785 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T18:32:53.964 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T18:32:53.971 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T18:32:53.985 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T18:32:53.990 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:32:53.997 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T18:32:54.012 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T18:32:54.032 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-ceph-argparse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:32:54.046 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:32:54.051 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T18:32:54.206 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package luarocks. 2024-09-12T18:32:54.232 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T18:32:54.272 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T18:32:54.283 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T18:32:54.309 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:32:54.358 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-cephfs (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:32:54.388 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librados2. 2024-09-12T18:32:54.390 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T18:32:54.415 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../007-librados2_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:32:54.416 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T18:32:54.455 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librados2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:32:54.457 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T18:32:54.622 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package librgw2. 2024-09-12T18:32:54.644 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T18:32:54.645 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../026-librgw2_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:32:54.670 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:32:54.680 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking librgw2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:32:54.702 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:32:54.743 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package librados2. 2024-09-12T18:32:54.758 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../007-librados2_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:32:54.793 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking librados2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:32:54.941 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libnbd0. 2024-09-12T18:32:54.967 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-12T18:32:54.971 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T18:32:54.998 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T18:32:54.999 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-12T18:32:55.038 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T18:32:55.264 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libnbd0. 2024-09-12T18:32:55.283 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T18:32:55.288 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-12T18:32:55.298 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:32:55.319 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librbd1. 2024-09-12T18:32:55.328 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-12T18:32:55.341 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-rgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:32:55.346 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../009-librbd1_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:32:55.375 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T18:32:55.386 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librbd1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:32:55.401 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T18:32:55.441 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T18:32:55.640 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package librbd1. 2024-09-12T18:32:55.666 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../009-librbd1_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:32:55.686 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T18:32:55.706 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking librbd1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:32:55.710 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T18:32:55.712 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T18:32:55.725 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:32:55.752 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T18:32:55.768 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-rbd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:32:55.838 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T18:32:55.865 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:32:55.905 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libcephfs2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:32:56.030 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T18:32:56.057 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:32:56.088 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T18:32:56.089 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libradosstriper1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:32:56.114 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T18:32:56.155 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T18:32:56.168 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T18:32:56.183 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rados. 2024-09-12T18:32:56.194 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:32:56.209 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../011-python3-rados_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:32:56.234 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libcephfs2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:32:56.249 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rados (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:32:56.407 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T18:32:56.433 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T18:32:56.484 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-common. 2024-09-12T18:32:56.510 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../030-ceph-common_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:32:56.550 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:32:56.594 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T18:32:56.599 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T18:32:56.620 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:32:56.653 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-rados. 2024-09-12T18:32:56.660 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-ceph-argparse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:32:56.679 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../011-python3-rados_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:32:56.719 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-rados (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:32:56.910 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T18:32:56.925 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T18:32:56.968 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T18:32:57.047 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T18:32:57.073 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T18:32:57.074 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:32:57.087 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:32:57.114 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-ceph-argparse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:32:57.130 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cephfs (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:32:57.313 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package lua5.1. 2024-09-12T18:32:57.339 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T18:32:57.341 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T18:32:57.356 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:32:57.380 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T18:32:57.391 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-cephfs (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:32:57.424 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T18:32:57.450 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:32:57.482 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:32:57.683 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package lua-any. 2024-09-12T18:32:57.709 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-12T18:32:57.710 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T18:32:57.737 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:32:57.741 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T18:32:57.761 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T18:32:57.777 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:32:57.787 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T18:32:57.827 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T18:32:57.985 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package zip. 2024-09-12T18:32:58.000 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-12T18:32:58.043 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T18:32:58.123 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-base. 2024-09-12T18:32:58.132 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T18:32:58.139 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T18:32:58.149 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../031-ceph-base_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:32:58.156 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T18:32:58.165 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T18:32:58.196 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T18:32:58.199 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-base (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:32:58.205 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T18:32:58.372 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package unzip. 2024-09-12T18:32:58.398 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T18:32:58.438 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T18:32:58.483 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T18:32:58.509 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:32:58.524 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T18:32:58.550 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rbd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:32:58.550 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T18:32:58.591 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T18:32:58.785 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T18:32:58.809 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package luarocks. 2024-09-12T18:32:58.811 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T18:32:58.835 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T18:32:58.843 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T18:32:58.858 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:32:58.860 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T18:32:58.869 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T18:32:58.875 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T18:32:58.893 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-rbd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:32:58.896 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T18:32:58.928 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T18:32:59.121 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T18:32:59.148 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T18:32:59.180 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T18:32:59.189 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T18:32:59.199 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package librgw2. 2024-09-12T18:32:59.204 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T18:32:59.212 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T18:32:59.214 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../026-librgw2_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:32:59.240 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T18:32:59.247 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T18:32:59.249 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking librgw2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:32:59.279 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T18:32:59.516 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T18:32:59.543 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T18:32:59.550 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T18:32:59.556 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T18:32:59.576 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T18:32:59.582 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T18:32:59.583 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T18:32:59.617 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T18:32:59.648 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T18:32:59.843 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T18:32:59.858 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:32:59.878 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T18:32:59.902 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-rgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:32:59.904 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T18:32:59.944 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T18:32:59.945 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package lua5.1. 2024-09-12T18:32:59.959 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T18:32:59.972 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T18:32:59.974 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T18:33:00.012 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T18:33:00.018 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T18:33:00.197 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T18:33:00.224 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T18:33:00.255 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T18:33:00.255 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T18:33:00.281 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T18:33:00.321 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T18:33:00.356 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package lua-any. 2024-09-12T18:33:00.362 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package lua5.1. 2024-09-12T18:33:00.383 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-12T18:33:00.388 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T18:33:00.423 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T18:33:00.428 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T18:33:00.542 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T18:33:00.568 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T18:33:00.608 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T18:33:00.632 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T18:33:00.651 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package zip. 2024-09-12T18:33:00.659 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:00.677 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-12T18:33:00.690 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libradosstriper1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:00.709 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T18:33:00.740 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package lua-any. 2024-09-12T18:33:00.766 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-12T18:33:00.806 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T18:33:00.920 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-portend. 2024-09-12T18:33:00.946 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-12T18:33:00.986 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T18:33:01.037 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package unzip. 2024-09-12T18:33:01.050 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package zip. 2024-09-12T18:33:01.064 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T18:33:01.066 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-12T18:33:01.104 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T18:33:01.109 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T18:33:01.111 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-common. 2024-09-12T18:33:01.137 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../030-ceph-common_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:01.193 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:01.293 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T18:33:01.319 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T18:33:01.356 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T18:33:01.483 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package luarocks. 2024-09-12T18:33:01.509 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T18:33:01.549 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T18:33:01.553 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package unzip. 2024-09-12T18:33:01.580 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T18:33:01.620 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T18:33:01.626 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T18:33:01.653 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T18:33:01.692 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T18:33:01.899 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librgw2. 2024-09-12T18:33:01.914 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../026-librgw2_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:01.949 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librgw2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:01.982 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package luarocks. 2024-09-12T18:33:01.996 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T18:33:02.008 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T18:33:02.012 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T18:33:02.049 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T18:33:02.057 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T18:33:02.324 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T18:33:02.351 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T18:33:02.382 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T18:33:02.481 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package librgw2. 2024-09-12T18:33:02.507 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../026-librgw2_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:02.535 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T18:33:02.547 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking librgw2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:02.550 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:02.593 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:02.685 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T18:33:02.712 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T18:33:02.760 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T18:33:02.774 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-base. 2024-09-12T18:33:02.800 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../031-ceph-base_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:02.946 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T18:33:02.973 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T18:33:03.013 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T18:33:03.067 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-base (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:03.168 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T18:33:03.183 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:03.218 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-rgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:03.238 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-mako. 2024-09-12T18:33:03.265 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T18:33:03.299 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T18:33:03.305 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T18:33:03.314 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:03.349 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libradosstriper1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:03.529 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T18:33:03.556 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T18:33:03.596 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T18:33:03.633 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T18:33:03.660 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T18:33:03.700 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T18:33:03.907 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T18:33:03.923 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:03.966 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libradosstriper1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:04.011 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T18:33:04.038 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T18:33:04.078 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T18:33:04.112 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T18:33:04.138 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T18:33:04.178 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T18:33:04.348 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-webob. 2024-09-12T18:33:04.369 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-common. 2024-09-12T18:33:04.374 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T18:33:04.396 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../030-ceph-common_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:04.405 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T18:33:04.428 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:04.481 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T18:33:04.507 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T18:33:04.548 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T18:33:04.637 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-common. 2024-09-12T18:33:04.664 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../030-ceph-common_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:04.703 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:04.734 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T18:33:04.760 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T18:33:04.803 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T18:33:04.909 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T18:33:04.935 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T18:33:04.984 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T18:33:05.137 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T18:33:05.164 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T18:33:05.203 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T18:33:05.345 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T18:33:05.372 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T18:33:05.420 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T18:33:05.506 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-paste. 2024-09-12T18:33:05.533 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T18:33:05.573 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T18:33:05.747 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T18:33:05.774 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T18:33:05.814 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T18:33:05.876 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T18:33:05.903 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T18:33:05.943 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T18:33:06.152 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T18:33:06.179 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T18:33:06.227 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T18:33:06.242 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-base. 2024-09-12T18:33:06.254 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T18:33:06.269 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../031-ceph-base_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:06.282 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T18:33:06.318 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-base (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:06.320 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T18:33:06.597 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-portend. 2024-09-12T18:33:06.607 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T18:33:06.623 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-12T18:33:06.634 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T18:33:06.674 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T18:33:06.674 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T18:33:06.863 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T18:33:06.890 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T18:33:06.930 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T18:33:06.945 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T18:33:06.967 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-base. 2024-09-12T18:33:06.970 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T18:33:06.993 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../031-ceph-base_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:07.018 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T18:33:07.043 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-base (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:07.149 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T18:33:07.176 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T18:33:07.216 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T18:33:07.332 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T18:33:07.361 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T18:33:07.390 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T18:33:07.458 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T18:33:07.485 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T18:33:07.502 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T18:33:07.529 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T18:33:07.549 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T18:33:07.569 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T18:33:07.630 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T18:33:07.656 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T18:33:07.696 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T18:33:07.701 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-idna. 2024-09-12T18:33:07.728 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T18:33:07.768 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T18:33:07.861 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T18:33:07.887 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T18:33:07.936 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T18:33:07.939 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T18:33:07.966 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T18:33:07.974 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T18:33:08.001 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T18:33:08.005 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T18:33:08.033 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T18:33:08.071 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T18:33:08.098 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T18:33:08.137 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T18:33:08.239 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T18:33:08.265 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T18:33:08.275 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T18:33:08.291 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T18:33:08.306 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T18:33:08.325 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T18:33:08.344 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T18:33:08.371 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T18:33:08.411 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T18:33:08.566 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-requests. 2024-09-12T18:33:08.583 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T18:33:08.593 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T18:33:08.603 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T18:33:08.610 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T18:33:08.629 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T18:33:08.632 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T18:33:08.641 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T18:33:08.669 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T18:33:08.714 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T18:33:08.740 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T18:33:08.781 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T18:33:08.911 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T18:33:08.919 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T18:33:08.937 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T18:33:08.946 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T18:33:08.977 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T18:33:08.986 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T18:33:08.997 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-mako. 2024-09-12T18:33:09.024 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T18:33:09.064 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T18:33:09.083 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T18:33:09.110 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T18:33:09.159 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T18:33:09.280 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T18:33:09.289 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-portend. 2024-09-12T18:33:09.296 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:33:09.315 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-12T18:33:09.339 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:09.356 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T18:33:09.384 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T18:33:09.410 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T18:33:09.420 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T18:33:09.447 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T18:33:09.450 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T18:33:09.487 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T18:33:09.659 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T18:33:09.685 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T18:33:09.726 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T18:33:09.728 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T18:33:09.736 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T18:33:09.754 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:09.763 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T18:33:09.790 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-portend. 2024-09-12T18:33:09.793 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:09.803 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T18:33:09.816 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-12T18:33:09.856 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T18:33:09.995 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T18:33:10.022 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T18:33:10.062 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T18:33:10.064 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-webob. 2024-09-12T18:33:10.091 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T18:33:10.105 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T18:33:10.131 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T18:33:10.132 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T18:33:10.151 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T18:33:10.171 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T18:33:10.178 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T18:33:10.218 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T18:33:10.407 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T18:33:10.433 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T18:33:10.433 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T18:33:10.449 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T18:33:10.458 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T18:33:10.473 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T18:33:10.483 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T18:33:10.485 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T18:33:10.513 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T18:33:10.528 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T18:33:10.539 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T18:33:10.571 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T18:33:10.752 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T18:33:10.778 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T18:33:10.810 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T18:33:10.811 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T18:33:10.838 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:10.862 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T18:33:10.880 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:10.888 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T18:33:10.891 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T18:33:10.918 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T18:33:10.928 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T18:33:10.949 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T18:33:11.122 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T18:33:11.148 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T18:33:11.188 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T18:33:11.231 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-paste. 2024-09-12T18:33:11.253 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T18:33:11.256 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T18:33:11.257 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T18:33:11.280 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T18:33:11.283 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:11.297 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T18:33:11.320 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T18:33:11.322 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mon (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:11.491 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-mako. 2024-09-12T18:33:11.517 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T18:33:11.557 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T18:33:11.606 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T18:33:11.625 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T18:33:11.632 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T18:33:11.651 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T18:33:11.692 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T18:33:11.803 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T18:33:11.860 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T18:33:11.886 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:11.886 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T18:33:11.912 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T18:33:11.917 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-osd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:11.952 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T18:33:12.003 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T18:33:12.030 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T18:33:12.070 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T18:33:12.159 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-mako. 2024-09-12T18:33:12.185 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T18:33:12.214 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T18:33:12.225 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T18:33:12.240 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T18:33:12.272 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T18:33:12.331 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T18:33:12.357 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T18:33:12.397 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T18:33:12.562 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T18:33:12.583 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-webob. 2024-09-12T18:33:12.589 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T18:33:12.609 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T18:33:12.629 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T18:33:12.650 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T18:33:12.658 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T18:33:12.685 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T18:33:12.717 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T18:33:12.933 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T18:33:12.958 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T18:33:12.998 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T18:33:13.003 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T18:33:13.029 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T18:33:13.037 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph. 2024-09-12T18:33:13.053 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../067-ceph_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:13.072 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T18:33:13.096 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:13.105 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T18:33:13.132 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T18:33:13.171 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T18:33:13.268 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-webob. 2024-09-12T18:33:13.283 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T18:33:13.327 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T18:33:13.381 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T18:33:13.409 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T18:33:13.448 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T18:33:13.499 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-idna. 2024-09-12T18:33:13.526 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T18:33:13.565 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T18:33:13.566 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T18:33:13.592 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:13.631 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:13.647 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T18:33:13.673 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T18:33:13.700 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-paste. 2024-09-12T18:33:13.716 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T18:33:13.716 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T18:33:13.753 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T18:33:13.944 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T18:33:13.960 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T18:33:13.971 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T18:33:13.986 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:14.010 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T18:33:14.018 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mds (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:14.024 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T18:33:14.051 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T18:33:14.087 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T18:33:14.091 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T18:33:14.114 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T18:33:14.154 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T18:33:14.339 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-requests. 2024-09-12T18:33:14.365 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T18:33:14.396 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package cephadm. 2024-09-12T18:33:14.398 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T18:33:14.402 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-paste. 2024-09-12T18:33:14.405 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T18:33:14.414 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T18:33:14.423 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../070-cephadm_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:14.429 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T18:33:14.448 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T18:33:14.463 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:14.494 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T18:33:14.691 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T18:33:14.718 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T18:33:14.743 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T18:33:14.758 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T18:33:14.770 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T18:33:14.774 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T18:33:14.801 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T18:33:14.809 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T18:33:14.814 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T18:33:14.840 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T18:33:14.841 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T18:33:14.881 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T18:33:15.027 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T18:33:15.042 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:33:15.094 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:15.121 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T18:33:15.143 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T18:33:15.148 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T18:33:15.170 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T18:33:15.184 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T18:33:15.187 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T18:33:15.210 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T18:33:15.210 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T18:33:15.250 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T18:33:15.482 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T18:33:15.509 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:15.526 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T18:33:15.529 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T18:33:15.544 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T18:33:15.553 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T18:33:15.557 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:15.579 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T18:33:15.592 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T18:33:15.848 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T18:33:15.875 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T18:33:15.915 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T18:33:15.922 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-idna. 2024-09-12T18:33:15.935 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T18:33:15.949 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T18:33:15.961 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T18:33:15.980 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T18:33:16.009 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T18:33:16.224 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-babel. 2024-09-12T18:33:16.251 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T18:33:16.262 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T18:33:16.289 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T18:33:16.290 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T18:33:16.292 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T18:33:16.319 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T18:33:16.328 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T18:33:16.346 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T18:33:16.358 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T18:33:16.372 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T18:33:16.412 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T18:33:16.593 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T18:33:16.620 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T18:33:16.657 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-idna. 2024-09-12T18:33:16.659 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T18:33:16.678 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-requests. 2024-09-12T18:33:16.683 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T18:33:16.705 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T18:33:16.723 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T18:33:16.744 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T18:33:16.749 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T18:33:16.775 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:16.815 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mgr (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:17.013 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T18:33:17.040 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:33:17.056 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T18:33:17.060 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T18:33:17.079 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:17.083 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T18:33:17.086 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T18:33:17.122 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T18:33:17.127 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T18:33:17.409 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T18:33:17.413 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-requests. 2024-09-12T18:33:17.424 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:33:17.425 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T18:33:17.440 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T18:33:17.452 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T18:33:17.468 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T18:33:17.472 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:17.479 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T18:33:17.491 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T18:33:17.495 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:17.543 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mon (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:17.752 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-routes. 2024-09-12T18:33:17.758 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T18:33:17.768 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T18:33:17.774 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T18:33:17.802 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T18:33:17.808 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T18:33:17.964 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T18:33:17.990 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:18.030 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:18.094 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T18:33:18.106 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T18:33:18.110 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:33:18.118 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:33:18.145 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:18.147 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:18.247 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T18:33:18.274 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:18.313 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-osd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:18.342 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T18:33:18.368 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T18:33:18.399 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T18:33:18.533 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T18:33:18.560 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:18.625 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:18.677 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T18:33:18.704 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T18:33:18.744 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T18:33:18.911 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T18:33:18.927 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T18:33:18.961 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T18:33:19.080 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T18:33:19.107 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:19.146 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:19.206 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T18:33:19.234 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T18:33:19.264 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T18:33:19.400 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph. 2024-09-12T18:33:19.426 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../067-ceph_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:19.466 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:19.558 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T18:33:19.585 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:19.601 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T18:33:19.625 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mon (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:19.627 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:19.667 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mgr (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:19.802 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T18:33:19.829 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:19.877 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:20.062 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T18:33:20.089 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:20.129 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mon (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:20.237 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T18:33:20.263 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:20.304 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-osd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:20.322 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T18:33:20.349 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:20.397 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mds (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:20.666 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T18:33:20.693 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:20.732 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-osd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:20.800 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package cephadm. 2024-09-12T18:33:20.811 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T18:33:20.827 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../070-cephadm_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:20.841 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T18:33:20.866 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:20.886 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T18:33:21.219 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T18:33:21.246 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T18:33:21.285 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T18:33:21.357 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T18:33:21.381 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph. 2024-09-12T18:33:21.384 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T18:33:21.397 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../067-ceph_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:21.423 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T18:33:21.439 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:21.605 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T18:33:21.620 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T18:33:21.663 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T18:33:21.752 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T18:33:21.759 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T18:33:21.779 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T18:33:21.785 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:21.786 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph. 2024-09-12T18:33:21.809 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T18:33:21.813 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../067-ceph_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:21.849 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:21.853 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:22.106 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T18:33:22.134 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T18:33:22.187 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T18:33:22.213 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:22.244 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mds (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:22.258 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T18:33:22.347 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T18:33:22.374 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:22.413 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:22.664 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package cephadm. 2024-09-12T18:33:22.691 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../070-cephadm_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:22.731 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:22.735 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-babel. 2024-09-12T18:33:22.762 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T18:33:22.800 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T18:33:22.827 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:22.856 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T18:33:22.859 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mds (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:23.101 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T18:33:23.129 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:33:23.167 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:23.213 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T18:33:23.229 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T18:33:23.250 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T18:33:23.271 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T18:33:23.277 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T18:33:23.317 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T18:33:23.320 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package cephadm. 2024-09-12T18:33:23.347 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../070-cephadm_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:23.386 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:23.582 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T18:33:23.609 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:33:23.649 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:23.661 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T18:33:23.688 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T18:33:23.706 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T18:33:23.727 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T18:33:23.733 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T18:33:23.772 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T18:33:23.985 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T18:33:24.012 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T18:33:24.052 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T18:33:24.092 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T18:33:24.119 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T18:33:24.159 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T18:33:24.304 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-routes. 2024-09-12T18:33:24.320 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T18:33:24.354 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T18:33:24.387 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T18:33:24.415 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T18:33:24.453 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T18:33:24.683 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T18:33:24.710 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:33:24.741 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:24.741 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-babel. 2024-09-12T18:33:24.757 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T18:33:24.768 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T18:33:24.784 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T18:33:24.807 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T18:33:24.823 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T18:33:25.119 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T18:33:25.145 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T18:33:25.160 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T18:33:25.188 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T18:33:25.193 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T18:33:25.198 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-babel. 2024-09-12T18:33:25.225 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T18:33:25.226 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T18:33:25.264 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T18:33:25.521 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T18:33:25.538 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T18:33:25.549 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-12T18:33:25.565 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:33:25.575 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T18:33:25.587 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T18:33:25.603 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T18:33:25.604 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:25.642 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T18:33:25.866 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T18:33:25.894 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T18:33:25.900 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T18:33:25.915 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T18:33:25.933 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T18:33:25.958 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T18:33:26.004 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T18:33:26.032 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:33:26.070 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:26.261 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-routes. 2024-09-12T18:33:26.261 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T18:33:26.288 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T18:33:26.289 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T18:33:26.327 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T18:33:26.328 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T18:33:26.416 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T18:33:26.442 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T18:33:26.482 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T18:33:26.664 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T18:33:26.681 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T18:33:26.691 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:33:26.708 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T18:33:26.730 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:26.747 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T18:33:26.775 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-routes. 2024-09-12T18:33:26.803 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T18:33:26.843 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T18:33:27.050 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T18:33:27.078 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T18:33:27.117 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T18:33:27.155 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T18:33:27.183 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:33:27.213 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:27.253 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T18:33:27.271 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T18:33:27.312 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T18:33:27.764 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T18:33:27.793 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:33:27.831 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:28.032 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T18:33:28.059 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T18:33:28.098 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T18:33:28.133 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T18:33:28.161 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T18:33:28.200 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T18:33:28.443 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T18:33:28.471 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T18:33:28.495 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T18:33:28.510 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T18:33:28.523 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T18:33:28.553 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T18:33:28.804 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T18:33:28.805 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package jq. 2024-09-12T18:33:28.822 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T18:33:28.832 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T18:33:28.864 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T18:33:28.956 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T18:33:29.117 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package socat. 2024-09-12T18:33:29.144 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T18:33:29.327 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T18:33:29.628 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T18:33:29.644 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T18:33:29.649 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T18:33:29.677 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:33:29.686 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T18:33:29.710 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T18:33:29.715 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:29.740 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T18:33:29.785 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T18:33:29.978 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T18:33:29.995 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T18:33:30.036 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T18:33:30.040 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-test. 2024-09-12T18:33:30.057 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../098-ceph-test_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:30.099 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-test (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:30.297 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T18:33:30.324 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T18:33:30.363 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T18:33:30.540 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T18:33:30.567 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T18:33:30.606 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T18:33:30.700 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T18:33:30.709 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T18:33:30.727 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T18:33:30.737 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T18:33:30.766 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T18:33:30.776 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T18:33:30.960 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T18:33:30.987 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T18:33:31.019 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T18:33:31.026 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T18:33:31.046 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T18:33:31.079 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T18:33:31.107 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T18:33:31.146 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T18:33:31.179 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T18:33:31.329 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T18:33:31.357 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T18:33:31.474 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T18:33:31.481 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T18:33:31.502 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T18:33:31.541 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T18:33:31.822 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T18:33:31.838 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:33:31.852 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T18:33:31.880 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:31.880 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-12T18:33:31.918 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T18:33:32.117 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T18:33:32.145 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:33:32.184 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:32.189 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T18:33:32.205 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T18:33:32.239 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T18:33:32.509 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T18:33:32.536 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T18:33:32.553 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T18:33:32.566 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T18:33:32.581 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:33:32.611 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-volume (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:32.867 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T18:33:32.894 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T18:33:32.903 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T18:33:32.907 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T18:33:32.931 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T18:33:32.933 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T18:33:32.934 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:32.969 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T18:33:32.973 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libcephfs-dev (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:33.253 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T18:33:33.280 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T18:33:33.281 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T18:33:33.293 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T18:33:33.309 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T18:33:33.312 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T18:33:33.319 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T18:33:33.321 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T18:33:33.340 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T18:33:33.356 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T18:33:33.359 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T18:33:33.378 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T18:33:33.622 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T18:33:33.638 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T18:33:33.672 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T18:33:33.681 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T18:33:33.709 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T18:33:33.722 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T18:33:33.748 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T18:33:33.750 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T18:33:33.789 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T18:33:33.942 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T18:33:33.958 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-12T18:33:33.986 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T18:33:34.000 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T18:33:34.003 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:33:34.044 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:34.051 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T18:33:34.068 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T18:33:34.101 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T18:33:34.134 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T18:33:34.162 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T18:33:34.201 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T18:33:34.289 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T18:33:34.317 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T18:33:34.321 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T18:33:34.347 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T18:33:34.348 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T18:33:34.363 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T18:33:34.379 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-12T18:33:34.387 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T18:33:34.413 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T18:33:34.623 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package pkg-config. 2024-09-12T18:33:34.651 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T18:33:34.690 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T18:33:34.692 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T18:33:34.716 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T18:33:34.720 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T18:33:34.734 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T18:33:34.743 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T18:33:34.758 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T18:33:34.762 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T18:33:34.782 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T18:33:34.800 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T18:33:34.959 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T18:33:34.987 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T18:33:35.025 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T18:33:35.027 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package jq. 2024-09-12T18:33:35.044 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T18:33:35.085 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T18:33:35.093 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T18:33:35.121 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T18:33:35.146 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T18:33:35.168 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T18:33:35.174 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T18:33:35.212 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T18:33:35.322 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package socat. 2024-09-12T18:33:35.338 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T18:33:35.372 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T18:33:35.412 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T18:33:35.440 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T18:33:35.478 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T18:33:35.479 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T18:33:35.507 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T18:33:35.507 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T18:33:35.535 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T18:33:35.537 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T18:33:35.573 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T18:33:35.633 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T18:33:35.650 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T18:33:35.683 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T18:33:35.756 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T18:33:35.784 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T18:33:35.823 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T18:33:35.877 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T18:33:35.905 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T18:33:35.935 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T18:33:36.046 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-test. 2024-09-12T18:33:36.062 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../098-ceph-test_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:36.104 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-test (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:36.143 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T18:33:36.171 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T18:33:36.209 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T18:33:36.277 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T18:33:36.293 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:33:36.335 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:36.520 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T18:33:36.533 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T18:33:36.548 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T18:33:36.549 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:33:36.582 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:36.595 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T18:33:36.663 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T18:33:36.690 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T18:33:36.729 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T18:33:36.886 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T18:33:36.914 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T18:33:36.915 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-py. 2024-09-12T18:33:36.943 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-12T18:33:36.960 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T18:33:36.983 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T18:33:37.082 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T18:33:37.110 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T18:33:37.149 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T18:33:37.297 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T18:33:37.301 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T18:33:37.317 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T18:33:37.326 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T18:33:37.351 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T18:33:37.364 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T18:33:37.393 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package jq. 2024-09-12T18:33:37.409 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T18:33:37.443 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T18:33:37.608 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package jq. 2024-09-12T18:33:37.625 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T18:33:37.645 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package socat. 2024-09-12T18:33:37.658 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T18:33:37.673 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T18:33:37.712 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T18:33:37.781 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T18:33:37.809 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T18:33:37.847 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T18:33:37.887 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package socat. 2024-09-12T18:33:37.915 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T18:33:37.953 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T18:33:38.049 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T18:33:38.065 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T18:33:38.107 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T18:33:38.158 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-toml. 2024-09-12T18:33:38.186 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-12T18:33:38.224 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T18:33:38.273 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T18:33:38.289 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T18:33:38.331 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T18:33:38.502 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T18:33:38.503 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-test. 2024-09-12T18:33:38.530 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T18:33:38.531 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../098-ceph-test_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:38.560 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T18:33:38.569 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-test (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:38.669 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-test. 2024-09-12T18:33:38.686 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../098-ceph-test_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:38.717 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T18:33:38.727 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-test (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:38.744 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:33:38.783 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-volume (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:38.923 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T18:33:38.951 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T18:33:38.989 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T18:33:39.103 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T18:33:39.119 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:39.164 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libcephfs-dev (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:39.266 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T18:33:39.295 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T18:33:39.333 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T18:33:39.448 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T18:33:39.464 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T18:33:39.498 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T18:33:39.827 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T18:33:39.855 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T18:33:39.893 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T18:33:40.037 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package radosgw. 2024-09-12T18:33:40.066 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../117-radosgw_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:40.103 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking radosgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:40.264 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T18:33:40.292 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T18:33:40.331 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T18:33:40.744 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package pkg-config. 2024-09-12T18:33:40.772 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T18:33:40.810 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T18:33:41.032 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T18:33:41.048 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:41.055 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T18:33:41.071 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T18:33:41.090 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking rbd-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:41.105 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T18:33:41.207 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T18:33:41.235 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:33:41.273 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-volume (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:41.374 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T18:33:41.386 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T18:33:41.402 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:33:41.440 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-volume (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:41.525 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T18:33:41.553 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T18:33:41.583 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T18:33:41.594 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T18:33:41.620 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T18:33:41.622 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:41.669 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libcephfs-dev (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:41.753 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T18:33:41.754 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T18:33:41.768 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:41.819 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libcephfs-dev (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:41.852 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T18:33:41.880 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T18:33:41.919 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T18:33:41.955 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T18:33:41.971 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T18:33:42.005 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T18:33:42.015 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T18:33:42.139 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T18:33:42.167 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T18:33:42.207 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T18:33:42.247 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T18:33:42.275 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T18:33:42.301 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T18:33:42.313 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T18:33:42.329 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T18:33:42.348 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T18:33:42.367 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T18:33:42.527 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T18:33:42.543 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T18:33:42.577 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T18:33:42.625 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T18:33:42.653 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T18:33:42.691 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T18:33:42.730 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T18:33:42.758 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T18:33:42.789 INFO:teuthology.orchestra.run.smithi162.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T18:33:42.796 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T18:33:42.864 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:42.932 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T18:33:42.959 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T18:33:42.998 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T18:33:43.028 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-py. 2024-09-12T18:33:43.056 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-12T18:33:43.094 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T18:33:43.210 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package pkg-config. 2024-09-12T18:33:43.238 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T18:33:43.276 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T18:33:43.364 INFO:teuthology.orchestra.run.smithi162.stdout:Adding system user cephadm....done 2024-09-12T18:33:43.423 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T18:33:43.451 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T18:33:43.464 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package pkg-config. 2024-09-12T18:33:43.489 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T18:33:43.492 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T18:33:43.512 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T18:33:43.530 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T18:33:43.554 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T18:33:43.570 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T18:33:43.612 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T18:33:43.759 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T18:33:43.775 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T18:33:43.797 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T18:33:43.808 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T18:33:43.926 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T18:33:43.955 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T18:33:43.984 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T18:33:44.032 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T18:33:44.039 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T18:33:44.048 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T18:33:44.090 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T18:33:44.140 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T18:33:44.212 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T18:33:44.228 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T18:33:44.261 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T18:33:44.287 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-toml. 2024-09-12T18:33:44.315 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-12T18:33:44.335 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T18:33:44.353 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T18:33:44.362 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T18:33:44.383 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T18:33:44.401 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T18:33:44.548 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T18:33:44.576 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T18:33:44.614 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T18:33:44.634 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T18:33:44.657 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T18:33:44.685 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T18:33:44.713 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T18:33:44.723 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T18:33:44.741 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T18:33:44.760 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T18:33:44.779 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T18:33:44.918 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T18:33:44.946 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T18:33:44.985 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T18:33:45.060 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T18:33:45.079 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T18:33:45.088 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T18:33:45.091 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T18:33:45.121 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T18:33:45.134 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T18:33:45.157 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T18:33:45.313 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T18:33:45.341 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T18:33:45.379 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T18:33:45.404 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T18:33:45.420 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T18:33:45.456 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T18:33:45.462 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T18:33:45.485 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-py. 2024-09-12T18:33:45.513 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-12T18:33:45.551 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T18:33:45.707 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T18:33:45.733 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-py. 2024-09-12T18:33:45.761 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-12T18:33:45.808 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T18:33:45.880 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T18:33:45.908 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T18:33:45.946 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T18:33:45.975 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T18:33:46.128 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T18:33:46.156 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T18:33:46.194 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T18:33:46.210 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package radosgw. 2024-09-12T18:33:46.234 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T18:33:46.238 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../117-radosgw_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:46.276 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking radosgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:46.400 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T18:33:46.429 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T18:33:46.467 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T18:33:46.486 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T18:33:46.641 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T18:33:46.669 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T18:33:46.707 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T18:33:46.728 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-toml. 2024-09-12T18:33:46.744 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-12T18:33:46.762 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T18:33:46.777 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T18:33:46.968 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-toml. 2024-09-12T18:33:46.996 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-12T18:33:47.013 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-ceph-argparse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:47.035 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T18:33:47.097 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T18:33:47.125 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T18:33:47.163 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T18:33:47.221 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T18:33:47.237 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:47.270 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking rbd-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:47.349 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T18:33:47.356 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T18:33:47.374 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T18:33:47.412 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T18:33:47.457 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-12T18:33:47.475 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T18:33:47.492 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T18:33:47.525 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T18:33:47.550 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T18:33:47.558 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T18:33:47.676 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T18:33:47.708 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T18:33:47.736 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T18:33:47.753 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T18:33:47.766 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T18:33:47.769 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T18:33:47.801 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T18:33:47.801 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T18:33:47.802 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T18:33:47.944 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T18:33:48.028 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T18:33:48.056 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T18:33:48.077 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T18:33:48.094 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T18:33:48.209 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T18:33:48.483 INFO:teuthology.orchestra.run.smithi162.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T18:33:48.531 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T18:33:48.534 INFO:teuthology.orchestra.run.smithi162.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T18:33:48.540 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package radosgw. 2024-09-12T18:33:48.569 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../117-radosgw_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:48.589 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T18:33:48.606 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking radosgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:48.715 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T18:33:48.882 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package radosgw. 2024-09-12T18:33:48.910 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../117-radosgw_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:48.948 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking radosgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:48.967 INFO:teuthology.orchestra.run.smithi114.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T18:33:49.037 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:49.075 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T18:33:49.201 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T18:33:49.468 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T18:33:49.518 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T18:33:49.534 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:49.567 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking rbd-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:49.603 INFO:teuthology.orchestra.run.smithi114.stdout:Adding system user cephadm....done 2024-09-12T18:33:49.728 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T18:33:49.785 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T18:33:49.839 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T18:33:49.910 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T18:33:49.926 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:33:49.968 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking rbd-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:50.022 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T18:33:50.061 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T18:33:50.089 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T18:33:50.130 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T18:33:50.207 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T18:33:50.274 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T18:33:50.321 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T18:33:50.430 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T18:33:50.446 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T18:33:50.557 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T18:33:50.665 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T18:33:50.666 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T18:33:50.756 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T18:33:50.807 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T18:33:50.897 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T18:33:50.924 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T18:33:51.050 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T18:33:51.067 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T18:33:51.185 INFO:teuthology.orchestra.run.smithi073.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T18:33:51.193 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T18:33:51.218 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T18:33:51.301 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:51.310 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T18:33:51.352 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T18:33:51.603 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T18:33:51.681 INFO:teuthology.orchestra.run.smithi143.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T18:33:51.720 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T18:33:51.751 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:51.926 INFO:teuthology.orchestra.run.smithi073.stdout:Adding system user cephadm....done 2024-09-12T18:33:51.971 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T18:33:51.979 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T18:33:52.116 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T18:33:52.210 INFO:teuthology.orchestra.run.smithi143.stdout:Adding system user cephadm....done 2024-09-12T18:33:52.222 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T18:33:52.240 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T18:33:52.333 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T18:33:52.533 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T18:33:52.591 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T18:33:52.593 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T18:33:52.601 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T18:33:52.817 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T18:33:52.844 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T18:33:52.867 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T18:33:52.869 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T18:33:52.971 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T18:33:52.995 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T18:33:53.085 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T18:33:53.201 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T18:33:53.230 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T18:33:53.263 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T18:33:53.420 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-ceph-argparse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:53.453 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T18:33:53.490 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T18:33:53.539 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T18:33:53.570 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:53.599 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T18:33:53.679 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T18:33:53.690 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T18:33:53.830 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-12T18:33:53.863 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T18:33:53.901 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T18:33:53.973 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T18:33:54.009 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T18:33:54.141 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T18:33:54.181 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T18:33:54.278 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T18:33:54.291 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T18:33:54.403 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T18:33:54.521 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T18:33:54.567 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T18:33:54.654 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T18:33:54.798 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T18:33:54.938 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T18:33:54.985 INFO:teuthology.orchestra.run.smithi114.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T18:33:55.016 INFO:teuthology.orchestra.run.smithi114.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T18:33:55.058 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T18:33:55.079 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T18:33:55.148 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T18:33:55.180 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T18:33:55.318 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T18:33:55.321 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T18:33:55.408 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T18:33:55.531 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T18:33:55.555 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:33:55.577 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T18:33:55.682 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T18:33:55.689 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T18:33:55.767 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T18:33:55.836 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-ceph-argparse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:55.949 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T18:33:55.969 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T18:33:56.051 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-ceph-argparse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:33:56.075 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T18:33:56.079 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T18:33:56.197 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-12T18:33:56.201 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T18:33:56.226 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T18:33:56.323 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T18:33:56.335 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T18:33:56.449 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T18:33:56.470 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-12T18:33:56.494 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T18:33:56.536 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T18:33:56.575 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T18:33:56.596 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T18:33:56.662 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T18:33:56.722 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T18:33:56.728 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T18:33:56.818 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T18:33:56.848 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T18:33:56.971 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:33:57.097 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T18:33:57.107 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T18:33:57.207 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T18:33:57.241 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T18:33:57.288 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T18:33:57.314 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T18:33:57.399 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T18:33:57.408 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T18:33:57.461 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T18:33:57.488 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T18:33:57.552 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T18:33:57.557 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T18:33:57.650 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T18:33:57.703 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T18:33:57.708 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T18:33:57.782 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T18:33:57.859 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T18:33:57.908 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T18:33:57.909 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T18:33:58.071 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T18:33:58.176 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T18:33:58.185 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T18:33:58.185 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T18:33:58.197 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T18:33:58.437 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T18:33:58.444 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T18:33:58.464 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T18:33:58.561 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T18:33:58.696 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T18:33:58.737 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T18:33:58.742 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T18:33:58.812 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T18:33:58.813 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T18:33:58.880 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T18:33:59.052 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T18:33:59.098 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T18:33:59.178 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T18:33:59.189 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T18:33:59.224 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T18:33:59.524 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T18:33:59.533 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T18:33:59.574 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T18:33:59.817 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T18:33:59.826 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T18:33:59.863 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T18:33:59.883 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T18:33:59.917 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T18:34:00.044 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T18:34:00.134 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T18:34:00.148 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T18:34:00.260 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:00.299 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T18:34:00.335 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T18:34:00.344 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T18:34:00.450 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T18:34:00.488 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T18:34:00.570 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T18:34:00.621 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T18:34:00.702 INFO:teuthology.orchestra.run.smithi162.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T18:34:00.729 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T18:34:00.768 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T18:34:00.896 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T18:34:00.947 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T18:34:00.989 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T18:34:01.073 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T18:34:01.178 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T18:34:01.374 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T18:34:01.453 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T18:34:01.467 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T18:34:01.675 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T18:34:01.717 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T18:34:01.838 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T18:34:01.852 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T18:34:02.010 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T18:34:02.086 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:34:02.102 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T18:34:02.140 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T18:34:02.237 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T18:34:02.253 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T18:34:02.354 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:34:02.354 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:02.477 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T18:34:02.488 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T18:34:02.563 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T18:34:02.647 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T18:34:02.717 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T18:34:02.748 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T18:34:02.843 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:02.873 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T18:34:02.874 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T18:34:02.973 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T18:34:03.017 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T18:34:03.141 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T18:34:03.144 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T18:34:03.267 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T18:34:03.310 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T18:34:03.463 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T18:34:03.534 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T18:34:03.569 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T18:34:03.820 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:34:03.871 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T18:34:03.946 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T18:34:04.131 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T18:34:04.151 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T18:34:04.239 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T18:34:04.407 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:34:04.507 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T18:34:04.516 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T18:34:04.541 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T18:34:04.668 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T18:34:04.759 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T18:34:04.792 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T18:34:04.817 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T18:34:04.885 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T18:34:04.928 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:34:05.003 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T18:34:05.068 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T18:34:05.071 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T18:34:05.120 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T18:34:05.246 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up librados2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:05.304 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T18:34:05.327 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T18:34:05.364 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T18:34:05.372 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:05.473 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T18:34:05.498 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T18:34:05.564 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T18:34:05.574 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T18:34:05.586 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T18:34:05.713 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T18:34:05.815 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:34:05.867 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T18:34:05.868 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libcephfs2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:05.941 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T18:34:05.977 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libradosstriper1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:06.009 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T18:34:06.103 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T18:34:06.135 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T18:34:06.173 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T18:34:06.235 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T18:34:06.379 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up librbd1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:06.411 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:34:06.483 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T18:34:06.485 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T18:34:06.506 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr-modules-core (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:06.537 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T18:34:06.632 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:06.737 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T18:34:06.800 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T18:34:06.844 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T18:34:06.844 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T18:34:06.846 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T18:34:06.971 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T18:34:07.068 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T18:34:07.123 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T18:34:07.194 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T18:34:07.222 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T18:34:07.283 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libcephfs-dev (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:07.320 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T18:34:07.390 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T18:34:07.392 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-rados (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:07.392 INFO:teuthology.orchestra.run.smithi114.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T18:34:07.474 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T18:34:07.493 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up librgw2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:07.575 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T18:34:07.621 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T18:34:07.622 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T18:34:07.658 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T18:34:07.773 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T18:34:07.843 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T18:34:07.917 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T18:34:07.969 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T18:34:08.191 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T18:34:08.202 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T18:34:08.261 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T18:34:08.328 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T18:34:08.442 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T18:34:08.554 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T18:34:08.577 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T18:34:08.612 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T18:34:08.763 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T18:34:08.806 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T18:34:08.844 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:34:08.900 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-rbd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:08.932 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T18:34:08.970 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T18:34:09.026 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up rbd-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:09.033 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T18:34:09.084 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T18:34:09.105 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T18:34:09.143 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-rgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:09.252 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-cephfs (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:09.271 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T18:34:09.335 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T18:34:09.375 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:09.416 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T18:34:09.461 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T18:34:09.700 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T18:34:09.787 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T18:34:09.821 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T18:34:09.826 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T18:34:09.921 INFO:teuthology.orchestra.run.smithi162.stdout:Adding group ceph....done 2024-09-12T18:34:09.952 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T18:34:10.041 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T18:34:10.066 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T18:34:10.081 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T18:34:10.206 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T18:34:10.233 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T18:34:10.256 INFO:teuthology.orchestra.run.smithi162.stdout:Adding system user ceph....done 2024-09-12T18:34:10.279 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T18:34:10.416 INFO:teuthology.orchestra.run.smithi162.stdout:Setting system user ceph properties....done 2024-09-12T18:34:10.430 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T18:34:10.432 INFO:teuthology.orchestra.run.smithi162.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T18:34:10.466 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:34:10.526 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T18:34:10.567 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T18:34:10.592 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T18:34:10.831 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T18:34:10.878 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T18:34:10.896 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T18:34:10.910 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T18:34:11.057 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T18:34:11.147 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T18:34:11.167 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T18:34:11.211 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T18:34:11.371 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-test (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:11.418 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:34:11.470 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T18:34:11.497 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up radosgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:11.549 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T18:34:11.552 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T18:34:11.597 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T18:34:11.834 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T18:34:11.878 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T18:34:11.881 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T18:34:11.967 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T18:34:11.967 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T18:34:12.188 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T18:34:12.195 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T18:34:12.243 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T18:34:12.304 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up librados2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:12.405 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:12.457 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-base (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:12.472 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T18:34:12.511 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T18:34:12.515 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T18:34:12.623 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T18:34:12.796 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T18:34:12.851 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libcephfs2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:12.888 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T18:34:12.908 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T18:34:12.977 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libradosstriper1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:13.103 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T18:34:13.182 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T18:34:13.258 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mds (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:13.278 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T18:34:13.379 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up librbd1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:13.481 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T18:34:13.481 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T18:34:13.501 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T18:34:13.506 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mgr-modules-core (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:13.546 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T18:34:13.627 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up librados2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:13.665 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:13.736 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:13.837 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T18:34:13.896 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T18:34:13.896 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T18:34:13.939 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T18:34:13.968 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:14.157 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libcephfs2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:14.183 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T18:34:14.183 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T18:34:14.224 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T18:34:14.300 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libradosstriper1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:14.367 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libcephfs-dev (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:14.451 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T18:34:14.518 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-rados (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:14.585 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T18:34:14.644 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up librgw2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:14.670 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-osd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:14.711 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librados2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:14.737 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up librbd1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:14.770 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T18:34:14.837 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:14.863 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mgr-modules-core (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:14.947 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T18:34:14.948 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T18:34:14.963 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T18:34:14.997 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:15.209 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T18:34:15.210 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T18:34:15.257 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libcephfs2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:15.455 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:15.580 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:15.595 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libradosstriper1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:15.731 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mon (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:15.732 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libcephfs-dev (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:15.858 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-rados (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:15.958 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T18:34:15.958 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T18:34:15.976 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T18:34:16.009 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up librgw2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:16.015 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-rbd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:16.135 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T18:34:16.141 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up rbd-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:16.261 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librbd1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:16.300 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-rgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:16.387 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-modules-core (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:16.435 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-cephfs (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:16.460 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr-cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:16.513 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:16.561 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:16.610 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:16.711 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr-dashboard (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:16.729 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T18:34:16.729 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T18:34:16.872 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-volume (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:17.121 INFO:teuthology.orchestra.run.smithi114.stdout:Adding group ceph....done 2024-09-12T18:34:17.231 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libcephfs-dev (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:17.231 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T18:34:17.332 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rados (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:17.340 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T18:34:17.347 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-rbd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:17.433 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librgw2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:17.457 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up rbd-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:17.476 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T18:34:17.559 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T18:34:17.573 INFO:teuthology.orchestra.run.smithi114.stdout:Adding system user ceph....done 2024-09-12T18:34:17.574 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-rgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:17.684 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-cephfs (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:17.741 INFO:teuthology.orchestra.run.smithi114.stdout:Setting system user ceph properties....done 2024-09-12T18:34:17.752 INFO:teuthology.orchestra.run.smithi114.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T18:34:17.810 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:17.897 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T18:34:18.202 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T18:34:18.354 INFO:teuthology.orchestra.run.smithi143.stdout:Adding group ceph....done 2024-09-12T18:34:18.601 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T18:34:18.662 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-test (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:18.722 INFO:teuthology.orchestra.run.smithi143.stdout:Adding system user ceph....done 2024-09-12T18:34:18.763 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up radosgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:18.788 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rbd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:18.899 INFO:teuthology.orchestra.run.smithi143.stdout:Setting system user ceph properties....done 2024-09-12T18:34:18.914 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up rbd-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:18.916 INFO:teuthology.orchestra.run.smithi143.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T18:34:19.031 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:19.051 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T18:34:19.132 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cephfs (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:19.199 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T18:34:19.200 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T18:34:19.227 INFO:teuthology.orchestra.run.smithi162.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T18:34:19.231 DEBUG:teuthology.orchestra.run.smithi162:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-09-12T18:34:19.267 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:19.288 INFO:teuthology.orchestra.run.smithi162.stdout:Reading package lists... 2024-09-12T18:34:19.365 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T18:34:19.509 INFO:teuthology.orchestra.run.smithi162.stdout:Building dependency tree... 2024-09-12T18:34:19.510 INFO:teuthology.orchestra.run.smithi162.stdout:Reading state information... 2024-09-12T18:34:19.666 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-base (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:19.713 INFO:teuthology.orchestra.run.smithi162.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-12T18:34:19.713 INFO:teuthology.orchestra.run.smithi162.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-12T18:34:19.714 INFO:teuthology.orchestra.run.smithi162.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:34:19.714 INFO:teuthology.orchestra.run.smithi162.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:34:19.714 INFO:teuthology.orchestra.run.smithi162.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:34:19.714 INFO:teuthology.orchestra.run.smithi162.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:34:19.714 INFO:teuthology.orchestra.run.smithi162.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T18:34:19.715 INFO:teuthology.orchestra.run.smithi162.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T18:34:19.715 INFO:teuthology.orchestra.run.smithi162.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:34:19.715 INFO:teuthology.orchestra.run.smithi162.stdout:The following additional packages will be installed: 2024-09-12T18:34:19.716 INFO:teuthology.orchestra.run.smithi162.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-09-12T18:34:19.717 INFO:teuthology.orchestra.run.smithi162.stdout:Suggested packages: 2024-09-12T18:34:19.717 INFO:teuthology.orchestra.run.smithi162.stdout: bison-doc flex-doc libssl-doc 2024-09-12T18:34:19.748 INFO:teuthology.orchestra.run.smithi162.stdout:The following NEW packages will be installed: 2024-09-12T18:34:19.749 INFO:teuthology.orchestra.run.smithi162.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-09-12T18:34:19.751 INFO:teuthology.orchestra.run.smithi162.stdout:The following packages will be upgraded: 2024-09-12T18:34:19.751 INFO:teuthology.orchestra.run.smithi162.stdout: libssl3 libuuid1 uuid-dev 2024-09-12T18:34:19.826 INFO:teuthology.orchestra.run.smithi073.stdout:Adding group ceph....done 2024-09-12T18:34:19.870 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-test (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:19.932 INFO:teuthology.orchestra.run.smithi162.stdout:3 upgraded, 7 newly installed, 0 to remove and 328 not upgraded. 2024-09-12T18:34:19.932 INFO:teuthology.orchestra.run.smithi162.stdout:Need to get 5,494 kB of archives. 2024-09-12T18:34:19.933 INFO:teuthology.orchestra.run.smithi162.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-09-12T18:34:19.933 INFO:teuthology.orchestra.run.smithi162.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-12T18:34:20.017 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up radosgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:20.049 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T18:34:20.186 INFO:teuthology.orchestra.run.smithi073.stdout:Adding system user ceph....done 2024-09-12T18:34:20.346 INFO:teuthology.orchestra.run.smithi073.stdout:Setting system user ceph properties....done 2024-09-12T18:34:20.364 INFO:teuthology.orchestra.run.smithi073.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T18:34:20.403 INFO:teuthology.orchestra.run.smithi162.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-12T18:34:20.484 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mds (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:20.501 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T18:34:20.502 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T18:34:20.509 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T18:34:20.657 INFO:teuthology.orchestra.run.smithi162.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-12T18:34:20.658 INFO:teuthology.orchestra.run.smithi162.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-12T18:34:20.659 INFO:teuthology.orchestra.run.smithi162.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-12T18:34:20.693 INFO:teuthology.orchestra.run.smithi162.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-12T18:34:20.694 INFO:teuthology.orchestra.run.smithi162.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-12T18:34:20.696 INFO:teuthology.orchestra.run.smithi162.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-12T18:34:20.697 INFO:teuthology.orchestra.run.smithi162.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-12T18:34:20.697 INFO:teuthology.orchestra.run.smithi162.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-12T18:34:20.710 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T18:34:20.710 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T18:34:20.821 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T18:34:20.982 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-base (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:21.108 INFO:teuthology.orchestra.run.smithi162.stdout:Preconfiguring packages ... 2024-09-12T18:34:21.237 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mgr (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:21.256 INFO:teuthology.orchestra.run.smithi162.stdout:Fetched 5,494 kB in 1s (5,443 kB/s) 2024-09-12T18:34:21.276 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-test (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:21.293 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T18:34:21.399 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package flex. 2024-09-12T18:34:21.402 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up radosgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:21.475 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T18:34:21.475 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T18:34:21.500 INFO:teuthology.orchestra.run.smithi162.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176253 files and directories currently installed.) 2024-09-12T18:34:21.506 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-12T18:34:21.547 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-12T18:34:21.809 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mds (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:21.985 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T18:34:21.985 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T18:34:22.006 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-osd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:22.040 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T18:34:22.040 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T18:34:22.055 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-12T18:34:22.290 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T18:34:22.291 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T18:34:22.338 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-12T18:34:22.421 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-base (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:22.519 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mgr (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:22.741 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T18:34:22.746 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T18:34:22.746 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T18:34:22.781 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:22.822 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T18:34:23.016 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:23.208 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mds (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:23.251 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mon (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:23.262 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-osd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:23.325 INFO:teuthology.orchestra.run.smithi162.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176326 files and directories currently installed.) 2024-09-12T18:34:23.330 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-12T18:34:23.414 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T18:34:23.414 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T18:34:23.443 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-12T18:34:23.495 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T18:34:23.495 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T18:34:23.531 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T18:34:23.531 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T18:34:23.852 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-12T18:34:23.866 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:23.970 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mgr-cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:23.982 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-12T18:34:24.039 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:24.090 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T18:34:24.090 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T18:34:24.121 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:24.173 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:24.248 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mgr-dashboard (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:24.285 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-12T18:34:24.300 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mon (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:24.415 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-volume (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:24.499 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T18:34:24.500 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T18:34:24.559 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-osd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:24.633 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package bison. 2024-09-12T18:34:24.738 INFO:teuthology.orchestra.run.smithi162.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176326 files and directories currently installed.) 2024-09-12T18:34:24.744 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-12T18:34:24.777 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T18:34:24.794 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-12T18:34:24.832 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T18:34:24.833 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T18:34:24.902 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T18:34:24.960 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mgr-cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:25.103 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:25.118 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-12T18:34:25.135 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-12T18:34:25.176 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-12T18:34:25.216 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T18:34:25.229 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mgr-dashboard (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:25.269 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:25.380 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-volume (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:25.395 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:25.414 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-12T18:34:25.442 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-12T18:34:25.472 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-12T18:34:25.546 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mon (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:25.725 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T18:34:25.749 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T18:34:25.750 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T18:34:25.792 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-12T18:34:25.819 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-12T18:34:25.834 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T18:34:25.859 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-12T18:34:25.978 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T18:34:26.049 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T18:34:26.094 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-12T18:34:26.110 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-12T18:34:26.144 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-12T18:34:26.206 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:26.408 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:26.542 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-dashboard (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:26.590 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-12T18:34:26.607 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-12T18:34:26.649 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T18:34:26.693 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-volume (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:34:26.737 INFO:teuthology.orchestra.run.smithi114.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T18:34:26.741 DEBUG:teuthology.orchestra.run.smithi114:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-09-12T18:34:26.797 INFO:teuthology.orchestra.run.smithi114.stdout:Reading package lists... 2024-09-12T18:34:27.009 INFO:teuthology.orchestra.run.smithi114.stdout:Building dependency tree... 2024-09-12T18:34:27.010 INFO:teuthology.orchestra.run.smithi114.stdout:Reading state information... 2024-09-12T18:34:27.062 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T18:34:27.101 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-12T18:34:27.163 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T18:34:27.197 INFO:teuthology.orchestra.run.smithi114.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-12T18:34:27.197 INFO:teuthology.orchestra.run.smithi114.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-12T18:34:27.197 INFO:teuthology.orchestra.run.smithi114.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:34:27.197 INFO:teuthology.orchestra.run.smithi114.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:34:27.197 INFO:teuthology.orchestra.run.smithi114.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:34:27.197 INFO:teuthology.orchestra.run.smithi114.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:34:27.198 INFO:teuthology.orchestra.run.smithi114.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T18:34:27.198 INFO:teuthology.orchestra.run.smithi114.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T18:34:27.198 INFO:teuthology.orchestra.run.smithi114.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:34:27.198 INFO:teuthology.orchestra.run.smithi114.stdout:The following additional packages will be installed: 2024-09-12T18:34:27.199 INFO:teuthology.orchestra.run.smithi114.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-09-12T18:34:27.200 INFO:teuthology.orchestra.run.smithi114.stdout:Suggested packages: 2024-09-12T18:34:27.201 INFO:teuthology.orchestra.run.smithi114.stdout: bison-doc flex-doc libssl-doc 2024-09-12T18:34:27.228 INFO:teuthology.orchestra.run.smithi114.stdout:The following NEW packages will be installed: 2024-09-12T18:34:27.229 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-12T18:34:27.230 INFO:teuthology.orchestra.run.smithi114.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-09-12T18:34:27.231 INFO:teuthology.orchestra.run.smithi114.stdout:The following packages will be upgraded: 2024-09-12T18:34:27.231 INFO:teuthology.orchestra.run.smithi114.stdout: libssl3 libuuid1 uuid-dev 2024-09-12T18:34:27.283 INFO:teuthology.orchestra.run.smithi114.stdout:3 upgraded, 7 newly installed, 0 to remove and 328 not upgraded. 2024-09-12T18:34:27.283 INFO:teuthology.orchestra.run.smithi114.stdout:Need to get 5,494 kB of archives. 2024-09-12T18:34:27.283 INFO:teuthology.orchestra.run.smithi114.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-09-12T18:34:27.284 INFO:teuthology.orchestra.run.smithi114.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-12T18:34:27.288 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T18:34:27.379 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-12T18:34:27.386 INFO:teuthology.orchestra.run.smithi114.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-12T18:34:27.447 INFO:teuthology.orchestra.run.smithi114.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-12T18:34:27.448 INFO:teuthology.orchestra.run.smithi114.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-12T18:34:27.449 INFO:teuthology.orchestra.run.smithi114.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-12T18:34:27.457 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T18:34:27.462 INFO:teuthology.orchestra.run.smithi114.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-12T18:34:27.463 INFO:teuthology.orchestra.run.smithi114.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-12T18:34:27.464 INFO:teuthology.orchestra.run.smithi114.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-12T18:34:27.465 INFO:teuthology.orchestra.run.smithi114.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-12T18:34:27.465 INFO:teuthology.orchestra.run.smithi114.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-12T18:34:27.505 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T18:34:27.631 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-12T18:34:27.757 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-12T18:34:27.807 INFO:teuthology.orchestra.run.smithi143.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T18:34:27.809 DEBUG:teuthology.orchestra.run.smithi143:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-09-12T18:34:27.835 INFO:teuthology.orchestra.run.smithi114.stdout:Preconfiguring packages ... 2024-09-12T18:34:27.858 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-12T18:34:27.863 INFO:teuthology.orchestra.run.smithi143.stdout:Reading package lists... 2024-09-12T18:34:27.932 INFO:teuthology.orchestra.run.smithi162.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-12T18:34:27.936 INFO:teuthology.orchestra.run.smithi114.stdout:Fetched 5,494 kB in 0s (21.6 MB/s) 2024-09-12T18:34:27.993 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-12T18:34:28.073 INFO:teuthology.orchestra.run.smithi143.stdout:Building dependency tree... 2024-09-12T18:34:28.074 INFO:teuthology.orchestra.run.smithi143.stdout:Reading state information... 2024-09-12T18:34:28.111 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T18:34:28.117 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package flex. 2024-09-12T18:34:28.219 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176253 files and directories currently installed.) 2024-09-12T18:34:28.225 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-12T18:34:28.263 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T18:34:28.278 INFO:teuthology.orchestra.run.smithi143.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-12T18:34:28.279 INFO:teuthology.orchestra.run.smithi143.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-12T18:34:28.279 INFO:teuthology.orchestra.run.smithi143.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:34:28.279 INFO:teuthology.orchestra.run.smithi143.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:34:28.279 INFO:teuthology.orchestra.run.smithi143.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:34:28.279 INFO:teuthology.orchestra.run.smithi143.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:34:28.279 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-12T18:34:28.280 INFO:teuthology.orchestra.run.smithi143.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T18:34:28.280 INFO:teuthology.orchestra.run.smithi143.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T18:34:28.280 INFO:teuthology.orchestra.run.smithi143.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:34:28.280 INFO:teuthology.orchestra.run.smithi143.stdout:The following additional packages will be installed: 2024-09-12T18:34:28.281 INFO:teuthology.orchestra.run.smithi143.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-09-12T18:34:28.283 INFO:teuthology.orchestra.run.smithi143.stdout:Suggested packages: 2024-09-12T18:34:28.283 INFO:teuthology.orchestra.run.smithi143.stdout: bison-doc flex-doc libssl-doc 2024-09-12T18:34:28.314 INFO:teuthology.orchestra.run.smithi143.stdout:The following NEW packages will be installed: 2024-09-12T18:34:28.316 INFO:teuthology.orchestra.run.smithi143.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-09-12T18:34:28.317 INFO:teuthology.orchestra.run.smithi143.stdout:The following packages will be upgraded: 2024-09-12T18:34:28.320 INFO:teuthology.orchestra.run.smithi143.stdout: libssl3 libuuid1 uuid-dev 2024-09-12T18:34:28.500 INFO:teuthology.orchestra.run.smithi143.stdout:3 upgraded, 7 newly installed, 0 to remove and 328 not upgraded. 2024-09-12T18:34:28.500 INFO:teuthology.orchestra.run.smithi143.stdout:Need to get 5,494 kB of archives. 2024-09-12T18:34:28.500 INFO:teuthology.orchestra.run.smithi143.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-09-12T18:34:28.500 INFO:teuthology.orchestra.run.smithi143.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-12T18:34:28.558 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T18:34:28.920 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-12T18:34:28.978 INFO:teuthology.orchestra.run.smithi143.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-12T18:34:29.109 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-12T18:34:29.228 INFO:teuthology.orchestra.run.smithi073.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T18:34:29.231 DEBUG:teuthology.orchestra.run.smithi073:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-09-12T18:34:29.232 INFO:teuthology.orchestra.run.smithi143.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-12T18:34:29.232 INFO:teuthology.orchestra.run.smithi143.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-12T18:34:29.234 INFO:teuthology.orchestra.run.smithi143.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-12T18:34:29.267 INFO:teuthology.orchestra.run.smithi143.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-12T18:34:29.268 INFO:teuthology.orchestra.run.smithi143.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-12T18:34:29.270 INFO:teuthology.orchestra.run.smithi143.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-12T18:34:29.271 INFO:teuthology.orchestra.run.smithi143.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-12T18:34:29.271 INFO:teuthology.orchestra.run.smithi143.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-12T18:34:29.287 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-09-12T18:34:29.446 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T18:34:29.487 INFO:teuthology.orchestra.run.smithi073.stdout:Building dependency tree... 2024-09-12T18:34:29.487 INFO:teuthology.orchestra.run.smithi073.stdout:Reading state information... 2024-09-12T18:34:29.529 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T18:34:29.667 INFO:teuthology.orchestra.run.smithi073.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-12T18:34:29.667 INFO:teuthology.orchestra.run.smithi073.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-12T18:34:29.667 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:34:29.667 INFO:teuthology.orchestra.run.smithi073.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:34:29.667 INFO:teuthology.orchestra.run.smithi073.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:34:29.668 INFO:teuthology.orchestra.run.smithi073.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:34:29.668 INFO:teuthology.orchestra.run.smithi073.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T18:34:29.668 INFO:teuthology.orchestra.run.smithi073.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T18:34:29.668 INFO:teuthology.orchestra.run.smithi073.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:34:29.668 INFO:teuthology.orchestra.run.smithi073.stdout:The following additional packages will be installed: 2024-09-12T18:34:29.669 INFO:teuthology.orchestra.run.smithi073.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-09-12T18:34:29.670 INFO:teuthology.orchestra.run.smithi073.stdout:Suggested packages: 2024-09-12T18:34:29.671 INFO:teuthology.orchestra.run.smithi073.stdout: bison-doc flex-doc libssl-doc 2024-09-12T18:34:29.685 INFO:teuthology.orchestra.run.smithi143.stdout:Preconfiguring packages ... 2024-09-12T18:34:29.700 INFO:teuthology.orchestra.run.smithi073.stdout:The following NEW packages will be installed: 2024-09-12T18:34:29.701 INFO:teuthology.orchestra.run.smithi073.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-09-12T18:34:29.702 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages will be upgraded: 2024-09-12T18:34:29.702 INFO:teuthology.orchestra.run.smithi073.stdout: libssl3 libuuid1 uuid-dev 2024-09-12T18:34:29.754 INFO:teuthology.orchestra.run.smithi073.stdout:3 upgraded, 7 newly installed, 0 to remove and 328 not upgraded. 2024-09-12T18:34:29.754 INFO:teuthology.orchestra.run.smithi073.stdout:Need to get 5,494 kB of archives. 2024-09-12T18:34:29.754 INFO:teuthology.orchestra.run.smithi073.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-09-12T18:34:29.755 INFO:teuthology.orchestra.run.smithi073.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-12T18:34:29.839 INFO:teuthology.orchestra.run.smithi143.stdout:Fetched 5,494 kB in 1s (5,405 kB/s) 2024-09-12T18:34:29.855 INFO:teuthology.orchestra.run.smithi073.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-12T18:34:29.917 INFO:teuthology.orchestra.run.smithi073.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-12T18:34:29.919 INFO:teuthology.orchestra.run.smithi073.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-12T18:34:29.919 INFO:teuthology.orchestra.run.smithi073.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-12T18:34:29.935 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-12T18:34:29.936 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-12T18:34:29.937 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-12T18:34:29.937 INFO:teuthology.orchestra.run.smithi073.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-12T18:34:29.938 INFO:teuthology.orchestra.run.smithi073.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-12T18:34:29.940 INFO:teuthology.orchestra.run.smithi162.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T18:34:29.947 DEBUG:teuthology.parallel:result is None 2024-09-12T18:34:29.980 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package flex. 2024-09-12T18:34:30.071 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176326 files and directories currently installed.) 2024-09-12T18:34:30.077 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-12T18:34:30.083 INFO:teuthology.orchestra.run.smithi143.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176253 files and directories currently installed.) 2024-09-12T18:34:30.089 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-12T18:34:30.136 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-12T18:34:30.225 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-12T18:34:30.293 INFO:teuthology.orchestra.run.smithi073.stdout:Preconfiguring packages ... 2024-09-12T18:34:30.403 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 5,494 kB in 0s (21.5 MB/s) 2024-09-12T18:34:30.496 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package flex. 2024-09-12T18:34:30.557 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176253 files and directories currently installed.) 2024-09-12T18:34:30.562 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-12T18:34:30.604 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-12T18:34:30.711 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-12T18:34:30.859 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-12T18:34:31.130 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-12T18:34:31.264 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-12T18:34:31.288 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T18:34:31.386 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-12T18:34:31.394 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-12T18:34:31.688 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-12T18:34:31.797 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T18:34:31.819 INFO:teuthology.orchestra.run.smithi143.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176326 files and directories currently installed.) 2024-09-12T18:34:31.825 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-12T18:34:31.951 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-12T18:34:32.078 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package bison. 2024-09-12T18:34:32.182 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176326 files and directories currently installed.) 2024-09-12T18:34:32.188 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-12T18:34:32.247 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-12T18:34:32.353 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-12T18:34:32.359 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176326 files and directories currently installed.) 2024-09-12T18:34:32.365 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-12T18:34:32.466 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-12T18:34:32.494 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-12T18:34:32.580 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-12T18:34:32.596 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-12T18:34:32.638 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-12T18:34:32.795 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-12T18:34:32.875 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-12T18:34:32.878 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-12T18:34:32.892 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-12T18:34:32.934 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-12T18:34:32.983 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-12T18:34:33.167 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package bison. 2024-09-12T18:34:33.195 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-12T18:34:33.224 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-12T18:34:33.253 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-12T18:34:33.270 INFO:teuthology.orchestra.run.smithi143.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176326 files and directories currently installed.) 2024-09-12T18:34:33.276 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-12T18:34:33.319 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-12T18:34:33.328 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-12T18:34:33.506 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-12T18:34:33.523 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-12T18:34:33.564 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-12T18:34:33.629 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-12T18:34:33.642 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package bison. 2024-09-12T18:34:33.645 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-12T18:34:33.678 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-12T18:34:33.740 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176326 files and directories currently installed.) 2024-09-12T18:34:33.746 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-12T18:34:33.811 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-12T18:34:33.817 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-12T18:34:33.845 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-12T18:34:33.883 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T18:34:33.918 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-12T18:34:33.934 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-12T18:34:33.976 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-12T18:34:34.170 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-12T18:34:34.198 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-12T18:34:34.236 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-12T18:34:34.271 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-12T18:34:34.298 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-12T18:34:34.311 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-12T18:34:34.329 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-12T18:34:34.413 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-12T18:34:34.523 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-12T18:34:34.523 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-12T18:34:34.552 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-12T18:34:34.573 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-12T18:34:34.590 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-12T18:34:34.601 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-12T18:34:34.639 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-12T18:34:34.648 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T18:34:34.800 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-12T18:34:34.926 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-12T18:34:34.935 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-12T18:34:34.963 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-12T18:34:35.002 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-12T18:34:35.052 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-12T18:34:35.141 INFO:teuthology.orchestra.run.smithi114.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-12T18:34:35.195 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-12T18:34:35.203 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-12T18:34:35.225 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-12T18:34:35.254 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-12T18:34:35.270 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-12T18:34:35.312 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-12T18:34:35.313 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T18:34:35.460 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T18:34:35.465 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T18:34:35.540 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-12T18:34:35.556 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-12T18:34:35.589 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T18:34:35.896 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-12T18:34:36.023 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-12T18:34:36.059 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-12T18:34:36.132 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-12T18:34:36.186 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-12T18:34:36.242 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T18:34:36.312 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-12T18:34:36.367 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-12T18:34:36.518 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-12T18:34:36.540 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T18:34:36.641 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-12T18:34:36.644 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-12T18:34:36.685 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T18:34:36.733 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-12T18:34:36.741 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-12T18:34:36.796 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-12T18:34:36.876 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-12T18:34:36.925 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T18:34:36.965 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-12T18:34:37.028 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-12T18:34:37.073 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T18:34:37.180 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T18:34:37.213 INFO:teuthology.orchestra.run.smithi114.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T18:34:37.217 DEBUG:teuthology.parallel:result is None 2024-09-12T18:34:37.314 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T18:34:38.282 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T18:34:38.540 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T18:34:38.752 INFO:teuthology.orchestra.run.smithi143.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T18:34:38.760 DEBUG:teuthology.parallel:result is None 2024-09-12T18:34:39.057 INFO:teuthology.orchestra.run.smithi073.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T18:34:39.062 DEBUG:teuthology.parallel:result is None 2024-09-12T18:34:39.063 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=46406987da2067f022005d68ecbb989daaabb837 2024-09-12T18:34:39.209 DEBUG:teuthology.orchestra.run.smithi073:> dpkg-query -W -f '${Version}' ceph 2024-09-12T18:34:39.227 INFO:teuthology.orchestra.run.smithi073.stdout:19.3.0-4870-g46406987-1jammy 2024-09-12T18:34:39.228 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4870-g46406987-1jammy 2024-09-12T18:34:39.228 INFO:teuthology.task.install:The correct ceph version 19.3.0-4870-g46406987-1jammy is installed. 2024-09-12T18:34:39.230 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=46406987da2067f022005d68ecbb989daaabb837 2024-09-12T18:34:39.376 DEBUG:teuthology.orchestra.run.smithi114:> dpkg-query -W -f '${Version}' ceph 2024-09-12T18:34:39.395 INFO:teuthology.orchestra.run.smithi114.stdout:19.3.0-4870-g46406987-1jammy 2024-09-12T18:34:39.396 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4870-g46406987-1jammy 2024-09-12T18:34:39.396 INFO:teuthology.task.install:The correct ceph version 19.3.0-4870-g46406987-1jammy is installed. 2024-09-12T18:34:39.398 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=46406987da2067f022005d68ecbb989daaabb837 2024-09-12T18:34:39.539 DEBUG:teuthology.orchestra.run.smithi143:> dpkg-query -W -f '${Version}' ceph 2024-09-12T18:34:39.558 INFO:teuthology.orchestra.run.smithi143.stdout:19.3.0-4870-g46406987-1jammy 2024-09-12T18:34:39.558 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4870-g46406987-1jammy 2024-09-12T18:34:39.558 INFO:teuthology.task.install:The correct ceph version 19.3.0-4870-g46406987-1jammy is installed. 2024-09-12T18:34:39.560 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=46406987da2067f022005d68ecbb989daaabb837 2024-09-12T18:34:39.703 DEBUG:teuthology.orchestra.run.smithi162:> dpkg-query -W -f '${Version}' ceph 2024-09-12T18:34:39.722 INFO:teuthology.orchestra.run.smithi162.stdout:19.3.0-4870-g46406987-1jammy 2024-09-12T18:34:39.723 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4870-g46406987-1jammy 2024-09-12T18:34:39.723 INFO:teuthology.task.install:The correct ceph version 19.3.0-4870-g46406987-1jammy is installed. 2024-09-12T18:34:39.725 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T18:34:39.726 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T18:34:39.726 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T18:34:39.740 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-12T18:34:39.740 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T18:34:39.755 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-12T18:34:39.755 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T18:34:39.770 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-12T18:34:39.770 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T18:34:39.785 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T18:34:39.785 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T18:34:39.785 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T18:34:39.798 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T18:34:39.854 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-12T18:34:39.854 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T18:34:39.867 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T18:34:39.923 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-12T18:34:39.923 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T18:34:39.937 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T18:34:39.989 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-12T18:34:39.989 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T18:34:40.003 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T18:34:40.059 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T18:34:40.060 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T18:34:40.060 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T18:34:40.074 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T18:34:40.130 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-12T18:34:40.130 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T18:34:40.144 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T18:34:40.197 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-12T18:34:40.198 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T18:34:40.211 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T18:34:40.267 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-12T18:34:40.267 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T18:34:40.281 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T18:34:40.336 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T18:34:40.337 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T18:34:40.337 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T18:34:40.350 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T18:34:40.406 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-12T18:34:40.406 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T18:34:40.420 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T18:34:40.475 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-12T18:34:40.475 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T18:34:40.488 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T18:34:40.541 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-12T18:34:40.541 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T18:34:40.555 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T18:34:40.612 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T18:34:40.694 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T18:34:40.694 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 777 /var/log/ceph 2024-09-12T18:34:40.697 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 777 /var/log/ceph 2024-09-12T18:34:40.699 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 777 /var/log/ceph 2024-09-12T18:34:40.701 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 777 /var/log/ceph 2024-09-12T18:34:40.714 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T18:34:40.715 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T18:34:40.752 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T18:34:40.754 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T18:34:40.756 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T18:34:40.768 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T18:34:40.769 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T18:34:40.804 DEBUG:teuthology.orchestra.run.smithi114:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T18:34:40.808 DEBUG:teuthology.orchestra.run.smithi143:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T18:34:40.812 DEBUG:teuthology.orchestra.run.smithi162:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T18:34:40.834 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T18:34:40.834 INFO:tasks.ceph:config {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T18:34:40.834 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901181', 'branch': 'main', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-snappy powercycle/default supported-distros/ubuntu_latest tasks/admin_socket_objecter_requests thrashosds-health}', 'email': 'bhubbard@redhat.com', 'first_in_suite': False, 'job_id': '7901181', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi', 'no_nested_subset': False, 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '46406987da2067f022005d68ecbb989daaabb837'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '46406987da2067f022005d68ecbb989daaabb837'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '0d61375b8ab53be4c233f5b93e463edfdff9316a'}}, 'owner': 'scheduled_bhubbard@teuthology', 'priority': 150, 'repo': 'https://github.com/ceph/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 245, 'sha1': '46406987da2067f022005d68ecbb989daaabb837', 'sleep_before_teardown': 0, 'subset': '2/4', 'suite': 'powercycle', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_0d61375b8ab53be4c233f5b93e463edfdff9316a/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph.git', 'suite_sha1': '0d61375b8ab53be4c233f5b93e463edfdff9316a', 'targets': {'smithi073.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDwxeoN9EHHTpfjebiLUj0tbQOWss2lzdAWV6+Ye+WiADG0+BBzkSqbRCSm2ui8vHBG3nv5b8Yafro+XE4+MfRg=', 'smithi114.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOgUNu9k1/6BpP8cPYm0rPQonz/JvNYmdpR2gHrvVI27NDDaY9TikO6C6Bk8ttuSXPkt0hZi42tgEtO0QEg42v8=', 'smithi143.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMQaxlkp9gRe82Fkanf7MSTAX2tc5ktmlAak5fmyGjGPTAX6gAKs43793LDwT7SF85me5GXOuB/AJJ460+EsTkM=', 'smithi162.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJSHIlYNd5FIvlQ+zvkmcw12hCHX/pgPr+t6xMe0kukXxZUMiF5+vOP3DoLxVdWRbA0kpppAKjJ3LwcqcghqAyE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '46406987da2067f022005d68ecbb989daaabb837'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'radosbench': {'clients': ['client.0'], 'time': 60}}, {'admin_socket': {'client.0': {'objecter_requests': {'test': 'http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch}'}}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-11_02:37:30', 'tube': 'smithi', 'user': 'bhubbard', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T18:34:40.834 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T18:34:40.855 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T18:34:40.864 DEBUG:teuthology.orchestra.run.smithi143:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T18:34:40.868 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T18:34:40.873 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T18:34:40.904 DEBUG:teuthology.orchestra.run.smithi114:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T18:34:40.912 DEBUG:teuthology.orchestra.run.smithi143:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T18:34:40.915 DEBUG:teuthology.orchestra.run.smithi162:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T18:34:40.929 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-12T18:34:40.930 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T18:34:40.971 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T18:34:40.971 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_1 2024-09-12T18:34:41.019 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T18:34:41.019 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:34:41.019 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 877 Links: 1 2024-09-12T18:34:41.019 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:34:41.020 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-09-12 18:28:40.777708134 +0000 2024-09-12T18:34:41.020 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-09-12 18:28:40.533710314 +0000 2024-09-12T18:34:41.020 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-09-12 18:28:40.533710314 +0000 2024-09-12T18:34:41.020 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: - 2024-09-12T18:34:41.020 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T18:34:41.073 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-09-12T18:34:41.073 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-09-12T18:34:41.073 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000459863 s, 1.1 MB/s 2024-09-12T18:34:41.075 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T18:34:41.128 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_2 2024-09-12T18:34:41.179 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T18:34:41.180 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:34:41.180 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 892 Links: 1 2024-09-12T18:34:41.180 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:34:41.180 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-09-12 18:28:41.297703490 +0000 2024-09-12T18:34:41.180 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-09-12 18:28:41.037705812 +0000 2024-09-12T18:34:41.180 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-09-12 18:28:41.037705812 +0000 2024-09-12T18:34:41.180 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: - 2024-09-12T18:34:41.180 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T18:34:41.233 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-09-12T18:34:41.233 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-09-12T18:34:41.233 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000331392 s, 1.5 MB/s 2024-09-12T18:34:41.235 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T18:34:41.285 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_3 2024-09-12T18:34:41.331 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T18:34:41.331 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:34:41.331 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 909 Links: 1 2024-09-12T18:34:41.331 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:34:41.332 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-09-12 18:28:41.773699239 +0000 2024-09-12T18:34:41.332 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-09-12 18:28:41.521701489 +0000 2024-09-12T18:34:41.332 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-09-12 18:28:41.521701489 +0000 2024-09-12T18:34:41.332 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: - 2024-09-12T18:34:41.332 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T18:34:41.385 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-09-12T18:34:41.386 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-09-12T18:34:41.386 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000382252 s, 1.3 MB/s 2024-09-12T18:34:41.387 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T18:34:41.436 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_4 2024-09-12T18:34:41.487 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T18:34:41.488 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:34:41.488 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 926 Links: 1 2024-09-12T18:34:41.488 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:34:41.488 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-09-12 18:28:42.289694629 +0000 2024-09-12T18:34:41.488 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-09-12 18:28:42.017697059 +0000 2024-09-12T18:34:41.488 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-09-12 18:28:42.017697059 +0000 2024-09-12T18:34:41.488 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: - 2024-09-12T18:34:41.488 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T18:34:41.541 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-09-12T18:34:41.541 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-09-12T18:34:41.542 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000375491 s, 1.4 MB/s 2024-09-12T18:34:41.543 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T18:34:41.596 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-12T18:34:41.597 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-12T18:34:41.597 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T18:34:41.603 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T18:34:41.603 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_1 2024-09-12T18:34:41.651 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T18:34:41.651 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:34:41.651 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 878 Links: 1 2024-09-12T18:34:41.651 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:34:41.651 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2024-09-12 18:28:44.487053098 +0000 2024-09-12T18:34:41.651 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2024-09-12 18:28:44.255055166 +0000 2024-09-12T18:34:41.652 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2024-09-12 18:28:44.255055166 +0000 2024-09-12T18:34:41.652 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: - 2024-09-12T18:34:41.652 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T18:34:41.705 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2024-09-12T18:34:41.706 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2024-09-12T18:34:41.706 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.000453056 s, 1.1 MB/s 2024-09-12T18:34:41.707 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T18:34:41.756 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_2 2024-09-12T18:34:41.803 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T18:34:41.803 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:34:41.803 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 897 Links: 1 2024-09-12T18:34:41.803 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:34:41.803 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2024-09-12 18:28:44.987048640 +0000 2024-09-12T18:34:41.803 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2024-09-12 18:28:44.767050601 +0000 2024-09-12T18:34:41.803 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2024-09-12 18:28:44.767050601 +0000 2024-09-12T18:34:41.803 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: - 2024-09-12T18:34:41.804 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T18:34:41.857 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2024-09-12T18:34:41.857 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2024-09-12T18:34:41.857 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.000424057 s, 1.2 MB/s 2024-09-12T18:34:41.858 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T18:34:41.908 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_3 2024-09-12T18:34:41.955 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T18:34:41.955 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:34:41.955 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 914 Links: 1 2024-09-12T18:34:41.955 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:34:41.955 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2024-09-12 18:28:45.475044290 +0000 2024-09-12T18:34:41.955 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2024-09-12 18:28:45.231046465 +0000 2024-09-12T18:34:41.955 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2024-09-12 18:28:45.231046465 +0000 2024-09-12T18:34:41.955 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: - 2024-09-12T18:34:41.956 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T18:34:42.009 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2024-09-12T18:34:42.009 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2024-09-12T18:34:42.009 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.000441563 s, 1.2 MB/s 2024-09-12T18:34:42.011 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T18:34:42.060 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_4 2024-09-12T18:34:42.107 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T18:34:42.107 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:34:42.107 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 932 Links: 1 2024-09-12T18:34:42.107 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:34:42.107 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2024-09-12 18:28:45.935040189 +0000 2024-09-12T18:34:42.107 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2024-09-12 18:28:45.699042293 +0000 2024-09-12T18:34:42.107 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2024-09-12 18:28:45.699042293 +0000 2024-09-12T18:34:42.107 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: - 2024-09-12T18:34:42.108 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T18:34:42.164 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2024-09-12T18:34:42.165 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2024-09-12T18:34:42.165 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.000330011 s, 1.6 MB/s 2024-09-12T18:34:42.166 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T18:34:42.216 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-09-12T18:34:42.216 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-12T18:34:42.216 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T18:34:42.223 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T18:34:42.223 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_1 2024-09-12T18:34:42.268 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T18:34:42.269 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:34:42.269 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 874 Links: 1 2024-09-12T18:34:42.269 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:34:42.269 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-12 18:28:42.570615560 +0000 2024-09-12T18:34:42.269 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-12 18:28:42.326617738 +0000 2024-09-12T18:34:42.269 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-12 18:28:42.326617738 +0000 2024-09-12T18:34:42.269 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: - 2024-09-12T18:34:42.269 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T18:34:42.323 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-12T18:34:42.323 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-12T18:34:42.323 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000462275 s, 1.1 MB/s 2024-09-12T18:34:42.324 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T18:34:42.374 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_2 2024-09-12T18:34:42.421 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T18:34:42.421 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:34:42.421 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 889 Links: 1 2024-09-12T18:34:42.421 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:34:42.421 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-12 18:28:42.822613308 +0000 2024-09-12T18:34:42.421 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-12 18:28:42.818613344 +0000 2024-09-12T18:34:42.421 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-12 18:28:42.818613344 +0000 2024-09-12T18:34:42.421 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: - 2024-09-12T18:34:42.421 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T18:34:42.475 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-12T18:34:42.475 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-12T18:34:42.475 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000384319 s, 1.3 MB/s 2024-09-12T18:34:42.476 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T18:34:42.525 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_3 2024-09-12T18:34:42.572 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T18:34:42.572 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:34:42.572 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 905 Links: 1 2024-09-12T18:34:42.572 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:34:42.572 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-12 18:28:43.606606305 +0000 2024-09-12T18:34:42.572 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-12 18:28:43.338608700 +0000 2024-09-12T18:34:42.573 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-12 18:28:43.338608700 +0000 2024-09-12T18:34:42.573 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: - 2024-09-12T18:34:42.573 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T18:34:42.626 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-12T18:34:42.626 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-12T18:34:42.626 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000393297 s, 1.3 MB/s 2024-09-12T18:34:42.628 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T18:34:42.677 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_4 2024-09-12T18:34:42.724 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T18:34:42.724 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:34:42.724 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 926 Links: 1 2024-09-12T18:34:42.724 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:34:42.724 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-12 18:28:44.094601947 +0000 2024-09-12T18:34:42.724 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-12 18:28:43.830604304 +0000 2024-09-12T18:34:42.724 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-12 18:28:43.830604304 +0000 2024-09-12T18:34:42.725 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: - 2024-09-12T18:34:42.725 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T18:34:42.778 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-12T18:34:42.778 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-12T18:34:42.778 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.00038249 s, 1.3 MB/s 2024-09-12T18:34:42.779 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T18:34:42.830 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-09-12T18:34:42.830 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi114.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi143.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi162.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-09-12T18:34:42.830 INFO:tasks.ceph:Generating config... 2024-09-12T18:34:42.831 INFO:tasks.ceph:[client.0] admin socket = /var/run/ceph/ceph-$name.asok 2024-09-12T18:34:42.831 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T18:34:42.831 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T18:34:42.831 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T18:34:42.831 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T18:34:42.832 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T18:34:42.832 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T18:34:42.832 INFO:tasks.ceph:[osd] bluestore compression algorithm = snappy 2024-09-12T18:34:42.832 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-12T18:34:42.832 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T18:34:42.832 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T18:34:42.832 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T18:34:42.832 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T18:34:42.832 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T18:34:42.832 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T18:34:42.832 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T18:34:42.832 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T18:34:42.833 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T18:34:42.833 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-12T18:34:42.833 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T18:34:42.833 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-12T18:34:42.833 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T18:34:42.833 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T18:34:42.833 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T18:34:42.867 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T18:34:42.884 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T18:34:42.960 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T18:34:43.014 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.73'), ('mon.b', '[v2:172.21.15.73:3301,v1:172.21.15.73:6790]'), ('mon.c', '[v2:172.21.15.73:3302,v1:172.21.15.73:6791]')] 2024-09-12T18:34:43.014 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790],[v2:172.21.15.73:3302,v1:172.21.15.73:6791]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}} 2024-09-12T18:34:43.015 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T18:34:43.015 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T18:34:43.063 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.73 --addv b '[v2:172.21.15.73:3301,v1:172.21.15.73:6790]' --addv c '[v2:172.21.15.73:3302,v1:172.21.15.73:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:34:43.149 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:34:43.149 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: generated fsid c08d5a84-711b-44bf-bdf1-e06ecc2c7c00 2024-09-12T18:34:43.149 INFO:teuthology.orchestra.run.smithi073.stdout:setting min_mon_release = quincy 2024-09-12T18:34:43.149 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 0 2024-09-12T18:34:43.149 INFO:teuthology.orchestra.run.smithi073.stdout:fsid c08d5a84-711b-44bf-bdf1-e06ecc2c7c00 2024-09-12T18:34:43.150 INFO:teuthology.orchestra.run.smithi073.stdout:last_changed 2024-09-12T18:34:43.149027+0000 2024-09-12T18:34:43.150 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-09-12T18:34:43.149027+0000 2024-09-12T18:34:43.150 INFO:teuthology.orchestra.run.smithi073.stdout:min_mon_release 17 (quincy) 2024-09-12T18:34:43.150 INFO:teuthology.orchestra.run.smithi073.stdout:election_strategy: 1 2024-09-12T18:34:43.150 INFO:teuthology.orchestra.run.smithi073.stdout:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T18:34:43.150 INFO:teuthology.orchestra.run.smithi073.stdout:1: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.b 2024-09-12T18:34:43.150 INFO:teuthology.orchestra.run.smithi073.stdout:2: [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] mon.c 2024-09-12T18:34:43.150 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T18:34:43.151 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T18:34:43.198 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c08d5a84-711b-44bf-bdf1-e06ecc2c7c00... 2024-09-12T18:34:43.199 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T18:34:43.244 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T18:34:43.246 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T18:34:43.248 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T18:34:43.272 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2024-09-12T18:34:43.272 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2024-09-12T18:34:43.272 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T18:34:43.273 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2024-09-12T18:34:43.273 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:34:43.273 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2024-09-12T18:34:43.273 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:34:43.273 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2024-09-12T18:34:43.273 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:34:43.273 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2024-09-12T18:34:43.273 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2024-09-12T18:34:43.273 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:34:43.273 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2024-09-12T18:34:43.273 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2024-09-12T18:34:43.274 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:34:43.274 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T18:34:43.274 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2024-09-12T18:34:43.274 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:34:43.275 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T18:34:43.275 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T18:34:43.275 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:34:43.275 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2024-09-12T18:34:43.275 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:34:43.276 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2024-09-12T18:34:43.276 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2024-09-12T18:34:43.276 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2024-09-12T18:34:43.276 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2024-09-12T18:34:43.276 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2024-09-12T18:34:43.276 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2024-09-12T18:34:43.276 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2024-09-12T18:34:43.276 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T18:34:43.276 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T18:34:43.276 INFO:teuthology.orchestra.run.smithi073.stdout: mon_allow_pool_size_one = true 2024-09-12T18:34:43.276 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:34:43.276 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T18:34:43.276 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:34:43.277 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2024-09-12T18:34:43.277 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:34:43.277 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2024-09-12T18:34:43.277 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:34:43.277 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2024-09-12T18:34:43.277 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2024-09-12T18:34:43.277 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2024-09-12T18:34:43.277 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = "172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790],[v2:172.21.15.73:3302,v1:172.21.15.73:6791]" 2024-09-12T18:34:43.277 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = c08d5a84-711b-44bf-bdf1-e06ecc2c7c00 2024-09-12T18:34:43.277 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:34:43.277 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2024-09-12T18:34:43.277 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2024-09-12T18:34:43.277 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:34:43.278 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2024-09-12T18:34:43.278 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2024-09-12T18:34:43.278 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock profile = high_recovery_ops 2024-09-12T18:34:43.278 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:34:43.278 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2024-09-12T18:34:43.278 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2024-09-12T18:34:43.278 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:34:43.278 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2024-09-12T18:34:43.278 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2024-09-12T18:34:43.278 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2024-09-12T18:34:43.278 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug trim objects = true 2024-09-12T18:34:43.278 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:34:43.279 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2024-09-12T18:34:43.279 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2024-09-12T18:34:43.279 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:34:43.279 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2024-09-12T18:34:43.279 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:34:43.279 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2024-09-12T18:34:43.279 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:34:43.279 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2024-09-12T18:34:43.279 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:34:43.279 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2024-09-12T18:34:43.279 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2024-09-12T18:34:43.279 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:34:43.279 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2024-09-12T18:34:43.279 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2024-09-12T18:34:43.279 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore block size = 96636764160 2024-09-12T18:34:43.280 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore compression algorithm = snappy 2024-09-12T18:34:43.280 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore compression mode = aggressive 2024-09-12T18:34:43.280 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore fsck on mount = True 2024-09-12T18:34:43.280 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluefs = 1/20 2024-09-12T18:34:43.280 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluestore = 1/20 2024-09-12T18:34:43.280 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-09-12T18:34:43.280 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 20 2024-09-12T18:34:43.280 INFO:teuthology.orchestra.run.smithi073.stdout: debug rocksdb = 4/10 2024-09-12T18:34:43.280 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T18:34:43.280 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd full ratio = 0.9 2024-09-12T18:34:43.280 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd nearfull ratio = 0.8 2024-09-12T18:34:43.280 INFO:teuthology.orchestra.run.smithi073.stdout: osd blocked scrub grace period = 3600 2024-09-12T18:34:43.280 INFO:teuthology.orchestra.run.smithi073.stdout: osd failsafe full ratio = 0.95 2024-09-12T18:34:43.280 INFO:teuthology.orchestra.run.smithi073.stdout: osd max markdown count = 1000 2024-09-12T18:34:43.281 INFO:teuthology.orchestra.run.smithi073.stdout: osd objectstore = bluestore 2024-09-12T18:34:43.281 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:34:43.281 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2024-09-12T18:34:43.281 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-09-12T18:34:43.281 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2024-09-12T18:34:43.281 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2024-09-12T18:34:43.281 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2024-09-12T18:34:43.281 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2024-09-12T18:34:43.281 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2024-09-12T18:34:43.281 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2024-09-12T18:34:43.281 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:34:43.281 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2024-09-12T18:34:43.281 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-09-12T18:34:43.281 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2024-09-12T18:34:43.281 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2024-09-12T18:34:43.282 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2024-09-12T18:34:43.282 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2024-09-12T18:34:43.282 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2024-09-12T18:34:43.282 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2024-09-12T18:34:43.282 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2024-09-12T18:34:43.282 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2024-09-12T18:34:43.282 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2024-09-12T18:34:43.282 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:34:43.282 INFO:teuthology.orchestra.run.smithi073.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T18:34:43.282 INFO:teuthology.orchestra.run.smithi073.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T18:34:43.282 INFO:teuthology.orchestra.run.smithi073.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T18:34:43.282 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:34:43.282 INFO:teuthology.orchestra.run.smithi073.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T18:34:43.283 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T18:34:43.283 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T18:34:43.283 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:34:43.283 INFO:teuthology.orchestra.run.smithi073.stdout: # 1m isn't quite enough 2024-09-12T18:34:43.283 INFO:teuthology.orchestra.run.smithi073.stdout: mon_down_mkfs_grace = 2m 2024-09-12T18:34:43.283 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:34:43.283 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_filestore_osds = false 2024-09-12T18:34:43.283 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:34:43.283 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2024-09-12T18:34:43.283 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2024-09-12T18:34:43.283 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2024-09-12T18:34:43.283 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2024-09-12T18:34:43.283 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T18:34:43.283 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T18:34:43.283 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2024-09-12T18:34:43.284 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.b] 2024-09-12T18:34:43.284 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.c] 2024-09-12T18:34:43.284 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2024-09-12T18:34:43.284 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2024-09-12T18:34:43.284 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-09-12T18:34:43.285 INFO:teuthology.orchestra.run.smithi162.stdout:[global] 2024-09-12T18:34:43.285 INFO:teuthology.orchestra.run.smithi162.stdout: chdir = "" 2024-09-12T18:34:43.285 INFO:teuthology.orchestra.run.smithi162.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T18:34:43.285 INFO:teuthology.orchestra.run.smithi162.stdout: auth supported = cephx 2024-09-12T18:34:43.285 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T18:34:43.285 INFO:teuthology.orchestra.run.smithi162.stdout: filestore xattr use omap = true 2024-09-12T18:34:43.286 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T18:34:43.286 INFO:teuthology.orchestra.run.smithi162.stdout: mon clock drift allowed = 1.000 2024-09-12T18:34:43.286 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T18:34:43.286 INFO:teuthology.orchestra.run.smithi162.stdout: osd crush chooseleaf type = 0 2024-09-12T18:34:43.286 INFO:teuthology.orchestra.run.smithi162.stdout: auth debug = true 2024-09-12T18:34:43.286 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T18:34:43.286 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on old message = true 2024-09-12T18:34:43.286 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on bug = true 2024-09-12T18:34:43.286 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T18:34:43.286 INFO:teuthology.orchestra.run.smithi162.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T18:34:43.286 INFO:teuthology.orchestra.run.smithi162.stdout: mon pg warn max object skew = 0 2024-09-12T18:34:43.286 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T18:34:43.286 INFO:teuthology.orchestra.run.smithi162.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T18:34:43.286 INFO:teuthology.orchestra.run.smithi162.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T18:34:43.287 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T18:34:43.287 INFO:teuthology.orchestra.run.smithi162.stdout: osd pool default size = 2 2024-09-12T18:34:43.287 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T18:34:43.287 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd allow primary affinity = true 2024-09-12T18:34:43.287 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd allow pg remap = true 2024-09-12T18:34:43.287 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on legacy crush tunables = false 2024-09-12T18:34:43.287 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on crush straw calc version zero = false 2024-09-12T18:34:43.287 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on no sortbitwise = false 2024-09-12T18:34:43.287 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on osd down out interval zero = false 2024-09-12T18:34:43.287 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on too few osds = false 2024-09-12T18:34:43.287 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T18:34:43.287 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T18:34:43.287 INFO:teuthology.orchestra.run.smithi162.stdout: mon_allow_pool_size_one = true 2024-09-12T18:34:43.287 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T18:34:43.288 INFO:teuthology.orchestra.run.smithi162.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T18:34:43.288 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T18:34:43.288 INFO:teuthology.orchestra.run.smithi162.stdout: osd default data pool replay window = 5 2024-09-12T18:34:43.288 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T18:34:43.288 INFO:teuthology.orchestra.run.smithi162.stdout: mon allow pool delete = true 2024-09-12T18:34:43.288 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T18:34:43.288 INFO:teuthology.orchestra.run.smithi162.stdout: mon cluster log file level = debug 2024-09-12T18:34:43.288 INFO:teuthology.orchestra.run.smithi162.stdout: debug asserts on shutdown = true 2024-09-12T18:34:43.288 INFO:teuthology.orchestra.run.smithi162.stdout: mon health detail to clog = false 2024-09-12T18:34:43.288 INFO:teuthology.orchestra.run.smithi162.stdout: mon host = "172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790],[v2:172.21.15.73:3302,v1:172.21.15.73:6791]" 2024-09-12T18:34:43.288 INFO:teuthology.orchestra.run.smithi162.stdout: fsid = c08d5a84-711b-44bf-bdf1-e06ecc2c7c00 2024-09-12T18:34:43.288 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T18:34:43.288 INFO:teuthology.orchestra.run.smithi162.stdout:[osd] 2024-09-12T18:34:43.288 INFO:teuthology.orchestra.run.smithi162.stdout: osd journal size = 100 2024-09-12T18:34:43.288 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T18:34:43.289 INFO:teuthology.orchestra.run.smithi162.stdout: osd scrub load threshold = 5.0 2024-09-12T18:34:43.289 INFO:teuthology.orchestra.run.smithi162.stdout: osd scrub max interval = 600 2024-09-12T18:34:43.289 INFO:teuthology.orchestra.run.smithi162.stdout: osd mclock profile = high_recovery_ops 2024-09-12T18:34:43.289 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T18:34:43.289 INFO:teuthology.orchestra.run.smithi162.stdout: osd recover clone overlap = true 2024-09-12T18:34:43.289 INFO:teuthology.orchestra.run.smithi162.stdout: osd recovery max chunk = 1048576 2024-09-12T18:34:43.289 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T18:34:43.289 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug shutdown = true 2024-09-12T18:34:43.289 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug op order = true 2024-09-12T18:34:43.289 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug verify stray on activate = true 2024-09-12T18:34:43.289 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug trim objects = true 2024-09-12T18:34:43.289 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T18:34:43.289 INFO:teuthology.orchestra.run.smithi162.stdout: osd open classes on start = true 2024-09-12T18:34:43.290 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug pg log writeout = true 2024-09-12T18:34:43.290 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T18:34:43.290 INFO:teuthology.orchestra.run.smithi162.stdout: osd deep scrub update digest min age = 30 2024-09-12T18:34:43.290 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T18:34:43.290 INFO:teuthology.orchestra.run.smithi162.stdout: osd map max advance = 10 2024-09-12T18:34:43.290 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T18:34:43.290 INFO:teuthology.orchestra.run.smithi162.stdout: journal zero on create = true 2024-09-12T18:34:43.290 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T18:34:43.290 INFO:teuthology.orchestra.run.smithi162.stdout: filestore ondisk finisher threads = 3 2024-09-12T18:34:43.290 INFO:teuthology.orchestra.run.smithi162.stdout: filestore apply finisher threads = 3 2024-09-12T18:34:43.290 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T18:34:43.290 INFO:teuthology.orchestra.run.smithi162.stdout: bdev debug aio = true 2024-09-12T18:34:43.290 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug misdirected ops = true 2024-09-12T18:34:43.291 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore block size = 96636764160 2024-09-12T18:34:43.291 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore compression algorithm = snappy 2024-09-12T18:34:43.291 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore compression mode = aggressive 2024-09-12T18:34:43.291 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore fsck on mount = True 2024-09-12T18:34:43.291 INFO:teuthology.orchestra.run.smithi162.stdout: debug bluefs = 1/20 2024-09-12T18:34:43.291 INFO:teuthology.orchestra.run.smithi162.stdout: debug bluestore = 1/20 2024-09-12T18:34:43.291 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-09-12T18:34:43.291 INFO:teuthology.orchestra.run.smithi162.stdout: debug osd = 20 2024-09-12T18:34:43.291 INFO:teuthology.orchestra.run.smithi162.stdout: debug rocksdb = 4/10 2024-09-12T18:34:43.291 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T18:34:43.291 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd full ratio = 0.9 2024-09-12T18:34:43.291 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd nearfull ratio = 0.8 2024-09-12T18:34:43.291 INFO:teuthology.orchestra.run.smithi162.stdout: osd blocked scrub grace period = 3600 2024-09-12T18:34:43.291 INFO:teuthology.orchestra.run.smithi162.stdout: osd failsafe full ratio = 0.95 2024-09-12T18:34:43.292 INFO:teuthology.orchestra.run.smithi162.stdout: osd max markdown count = 1000 2024-09-12T18:34:43.292 INFO:teuthology.orchestra.run.smithi162.stdout: osd objectstore = bluestore 2024-09-12T18:34:43.292 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T18:34:43.292 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr] 2024-09-12T18:34:43.292 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-09-12T18:34:43.292 INFO:teuthology.orchestra.run.smithi162.stdout: debug mgr = 20 2024-09-12T18:34:43.292 INFO:teuthology.orchestra.run.smithi162.stdout: debug mon = 20 2024-09-12T18:34:43.292 INFO:teuthology.orchestra.run.smithi162.stdout: debug auth = 20 2024-09-12T18:34:43.292 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min pgs per osd = 4 2024-09-12T18:34:43.292 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min bytes per osd = 10 2024-09-12T18:34:43.292 INFO:teuthology.orchestra.run.smithi162.stdout: mgr/telemetry/nag = false 2024-09-12T18:34:43.292 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T18:34:43.292 INFO:teuthology.orchestra.run.smithi162.stdout:[mon] 2024-09-12T18:34:43.292 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-09-12T18:34:43.293 INFO:teuthology.orchestra.run.smithi162.stdout: debug mon = 20 2024-09-12T18:34:43.293 INFO:teuthology.orchestra.run.smithi162.stdout: debug paxos = 20 2024-09-12T18:34:43.293 INFO:teuthology.orchestra.run.smithi162.stdout: debug auth = 20 2024-09-12T18:34:43.293 INFO:teuthology.orchestra.run.smithi162.stdout: mon data avail warn = 5 2024-09-12T18:34:43.293 INFO:teuthology.orchestra.run.smithi162.stdout: mon mgr mkfs grace = 240 2024-09-12T18:34:43.293 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min pgs per osd = 4 2024-09-12T18:34:43.293 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd reporter subtree level = osd 2024-09-12T18:34:43.293 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd prime pg temp = true 2024-09-12T18:34:43.293 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min bytes per osd = 10 2024-09-12T18:34:43.293 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T18:34:43.293 INFO:teuthology.orchestra.run.smithi162.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T18:34:43.293 INFO:teuthology.orchestra.run.smithi162.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T18:34:43.293 INFO:teuthology.orchestra.run.smithi162.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T18:34:43.293 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T18:34:43.294 INFO:teuthology.orchestra.run.smithi162.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T18:34:43.294 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T18:34:43.294 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T18:34:43.294 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T18:34:43.294 INFO:teuthology.orchestra.run.smithi162.stdout: # 1m isn't quite enough 2024-09-12T18:34:43.294 INFO:teuthology.orchestra.run.smithi162.stdout: mon_down_mkfs_grace = 2m 2024-09-12T18:34:43.294 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T18:34:43.294 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_filestore_osds = false 2024-09-12T18:34:43.294 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T18:34:43.294 INFO:teuthology.orchestra.run.smithi162.stdout:[client] 2024-09-12T18:34:43.294 INFO:teuthology.orchestra.run.smithi162.stdout: rgw cache enabled = true 2024-09-12T18:34:43.294 INFO:teuthology.orchestra.run.smithi162.stdout: rgw enable ops log = true 2024-09-12T18:34:43.294 INFO:teuthology.orchestra.run.smithi162.stdout: rgw enable usage log = true 2024-09-12T18:34:43.294 INFO:teuthology.orchestra.run.smithi162.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T18:34:43.294 INFO:teuthology.orchestra.run.smithi162.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T18:34:43.295 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.a] 2024-09-12T18:34:43.295 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.b] 2024-09-12T18:34:43.295 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.c] 2024-09-12T18:34:43.295 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.a] 2024-09-12T18:34:43.295 INFO:teuthology.orchestra.run.smithi162.stdout:[client.0] 2024-09-12T18:34:43.295 INFO:teuthology.orchestra.run.smithi162.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-09-12T18:34:43.295 INFO:teuthology.orchestra.run.smithi143.stdout:[global] 2024-09-12T18:34:43.295 INFO:teuthology.orchestra.run.smithi143.stdout: chdir = "" 2024-09-12T18:34:43.295 INFO:teuthology.orchestra.run.smithi143.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T18:34:43.295 INFO:teuthology.orchestra.run.smithi143.stdout: auth supported = cephx 2024-09-12T18:34:43.295 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-12T18:34:43.296 INFO:teuthology.orchestra.run.smithi143.stdout: filestore xattr use omap = true 2024-09-12T18:34:43.296 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-12T18:34:43.296 INFO:teuthology.orchestra.run.smithi143.stdout: mon clock drift allowed = 1.000 2024-09-12T18:34:43.296 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-12T18:34:43.296 INFO:teuthology.orchestra.run.smithi143.stdout: osd crush chooseleaf type = 0 2024-09-12T18:34:43.296 INFO:teuthology.orchestra.run.smithi143.stdout: auth debug = true 2024-09-12T18:34:43.296 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-12T18:34:43.296 INFO:teuthology.orchestra.run.smithi143.stdout: ms die on old message = true 2024-09-12T18:34:43.296 INFO:teuthology.orchestra.run.smithi143.stdout: ms die on bug = true 2024-09-12T18:34:43.296 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-12T18:34:43.296 INFO:teuthology.orchestra.run.smithi143.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T18:34:43.296 INFO:teuthology.orchestra.run.smithi143.stdout: mon pg warn max object skew = 0 2024-09-12T18:34:43.296 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-12T18:34:43.296 INFO:teuthology.orchestra.run.smithi143.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T18:34:43.297 INFO:teuthology.orchestra.run.smithi143.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T18:34:43.297 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-12T18:34:43.297 INFO:teuthology.orchestra.run.smithi143.stdout: osd pool default size = 2 2024-09-12T18:34:43.297 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-12T18:34:43.297 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd allow primary affinity = true 2024-09-12T18:34:43.297 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd allow pg remap = true 2024-09-12T18:34:43.297 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on legacy crush tunables = false 2024-09-12T18:34:43.297 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on crush straw calc version zero = false 2024-09-12T18:34:43.297 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on no sortbitwise = false 2024-09-12T18:34:43.297 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on osd down out interval zero = false 2024-09-12T18:34:43.297 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on too few osds = false 2024-09-12T18:34:43.297 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T18:34:43.297 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T18:34:43.297 INFO:teuthology.orchestra.run.smithi143.stdout: mon_allow_pool_size_one = true 2024-09-12T18:34:43.298 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-12T18:34:43.298 INFO:teuthology.orchestra.run.smithi143.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T18:34:43.298 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-12T18:34:43.298 INFO:teuthology.orchestra.run.smithi143.stdout: osd default data pool replay window = 5 2024-09-12T18:34:43.298 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-12T18:34:43.298 INFO:teuthology.orchestra.run.smithi143.stdout: mon allow pool delete = true 2024-09-12T18:34:43.298 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-12T18:34:43.298 INFO:teuthology.orchestra.run.smithi143.stdout: mon cluster log file level = debug 2024-09-12T18:34:43.298 INFO:teuthology.orchestra.run.smithi143.stdout: debug asserts on shutdown = true 2024-09-12T18:34:43.298 INFO:teuthology.orchestra.run.smithi143.stdout: mon health detail to clog = false 2024-09-12T18:34:43.298 INFO:teuthology.orchestra.run.smithi143.stdout: mon host = "172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790],[v2:172.21.15.73:3302,v1:172.21.15.73:6791]" 2024-09-12T18:34:43.298 INFO:teuthology.orchestra.run.smithi143.stdout: fsid = c08d5a84-711b-44bf-bdf1-e06ecc2c7c00 2024-09-12T18:34:43.298 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-12T18:34:43.298 INFO:teuthology.orchestra.run.smithi143.stdout:[osd] 2024-09-12T18:34:43.298 INFO:teuthology.orchestra.run.smithi143.stdout: osd journal size = 100 2024-09-12T18:34:43.299 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-12T18:34:43.299 INFO:teuthology.orchestra.run.smithi143.stdout: osd scrub load threshold = 5.0 2024-09-12T18:34:43.299 INFO:teuthology.orchestra.run.smithi143.stdout: osd scrub max interval = 600 2024-09-12T18:34:43.299 INFO:teuthology.orchestra.run.smithi143.stdout: osd mclock profile = high_recovery_ops 2024-09-12T18:34:43.299 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-12T18:34:43.299 INFO:teuthology.orchestra.run.smithi143.stdout: osd recover clone overlap = true 2024-09-12T18:34:43.299 INFO:teuthology.orchestra.run.smithi143.stdout: osd recovery max chunk = 1048576 2024-09-12T18:34:43.299 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-12T18:34:43.299 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug shutdown = true 2024-09-12T18:34:43.299 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug op order = true 2024-09-12T18:34:43.299 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug verify stray on activate = true 2024-09-12T18:34:43.299 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug trim objects = true 2024-09-12T18:34:43.299 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-12T18:34:43.299 INFO:teuthology.orchestra.run.smithi143.stdout: osd open classes on start = true 2024-09-12T18:34:43.300 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug pg log writeout = true 2024-09-12T18:34:43.300 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-12T18:34:43.300 INFO:teuthology.orchestra.run.smithi143.stdout: osd deep scrub update digest min age = 30 2024-09-12T18:34:43.300 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-12T18:34:43.300 INFO:teuthology.orchestra.run.smithi143.stdout: osd map max advance = 10 2024-09-12T18:34:43.300 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-12T18:34:43.300 INFO:teuthology.orchestra.run.smithi143.stdout: journal zero on create = true 2024-09-12T18:34:43.300 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-12T18:34:43.300 INFO:teuthology.orchestra.run.smithi143.stdout: filestore ondisk finisher threads = 3 2024-09-12T18:34:43.300 INFO:teuthology.orchestra.run.smithi143.stdout: filestore apply finisher threads = 3 2024-09-12T18:34:43.300 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-12T18:34:43.300 INFO:teuthology.orchestra.run.smithi143.stdout: bdev debug aio = true 2024-09-12T18:34:43.300 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug misdirected ops = true 2024-09-12T18:34:43.301 INFO:teuthology.orchestra.run.smithi143.stdout: bluestore block size = 96636764160 2024-09-12T18:34:43.301 INFO:teuthology.orchestra.run.smithi143.stdout: bluestore compression algorithm = snappy 2024-09-12T18:34:43.301 INFO:teuthology.orchestra.run.smithi143.stdout: bluestore compression mode = aggressive 2024-09-12T18:34:43.301 INFO:teuthology.orchestra.run.smithi143.stdout: bluestore fsck on mount = True 2024-09-12T18:34:43.301 INFO:teuthology.orchestra.run.smithi143.stdout: debug bluefs = 1/20 2024-09-12T18:34:43.301 INFO:teuthology.orchestra.run.smithi143.stdout: debug bluestore = 1/20 2024-09-12T18:34:43.301 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-09-12T18:34:43.301 INFO:teuthology.orchestra.run.smithi143.stdout: debug osd = 20 2024-09-12T18:34:43.301 INFO:teuthology.orchestra.run.smithi143.stdout: debug rocksdb = 4/10 2024-09-12T18:34:43.301 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T18:34:43.301 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd full ratio = 0.9 2024-09-12T18:34:43.301 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd nearfull ratio = 0.8 2024-09-12T18:34:43.301 INFO:teuthology.orchestra.run.smithi143.stdout: osd blocked scrub grace period = 3600 2024-09-12T18:34:43.302 INFO:teuthology.orchestra.run.smithi143.stdout: osd failsafe full ratio = 0.95 2024-09-12T18:34:43.302 INFO:teuthology.orchestra.run.smithi143.stdout: osd max markdown count = 1000 2024-09-12T18:34:43.302 INFO:teuthology.orchestra.run.smithi143.stdout: osd objectstore = bluestore 2024-09-12T18:34:43.302 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-12T18:34:43.302 INFO:teuthology.orchestra.run.smithi143.stdout:[mgr] 2024-09-12T18:34:43.302 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-09-12T18:34:43.302 INFO:teuthology.orchestra.run.smithi143.stdout: debug mgr = 20 2024-09-12T18:34:43.302 INFO:teuthology.orchestra.run.smithi143.stdout: debug mon = 20 2024-09-12T18:34:43.302 INFO:teuthology.orchestra.run.smithi143.stdout: debug auth = 20 2024-09-12T18:34:43.302 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min pgs per osd = 4 2024-09-12T18:34:43.302 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min bytes per osd = 10 2024-09-12T18:34:43.302 INFO:teuthology.orchestra.run.smithi143.stdout: mgr/telemetry/nag = false 2024-09-12T18:34:43.303 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-12T18:34:43.303 INFO:teuthology.orchestra.run.smithi143.stdout:[mon] 2024-09-12T18:34:43.303 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-09-12T18:34:43.303 INFO:teuthology.orchestra.run.smithi143.stdout: debug mon = 20 2024-09-12T18:34:43.303 INFO:teuthology.orchestra.run.smithi143.stdout: debug paxos = 20 2024-09-12T18:34:43.303 INFO:teuthology.orchestra.run.smithi143.stdout: debug auth = 20 2024-09-12T18:34:43.303 INFO:teuthology.orchestra.run.smithi143.stdout: mon data avail warn = 5 2024-09-12T18:34:43.303 INFO:teuthology.orchestra.run.smithi143.stdout: mon mgr mkfs grace = 240 2024-09-12T18:34:43.303 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min pgs per osd = 4 2024-09-12T18:34:43.303 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd reporter subtree level = osd 2024-09-12T18:34:43.303 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd prime pg temp = true 2024-09-12T18:34:43.303 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min bytes per osd = 10 2024-09-12T18:34:43.304 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-12T18:34:43.304 INFO:teuthology.orchestra.run.smithi143.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T18:34:43.304 INFO:teuthology.orchestra.run.smithi143.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T18:34:43.304 INFO:teuthology.orchestra.run.smithi143.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T18:34:43.304 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-12T18:34:43.304 INFO:teuthology.orchestra.run.smithi143.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T18:34:43.304 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T18:34:43.304 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T18:34:43.304 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-12T18:34:43.304 INFO:teuthology.orchestra.run.smithi143.stdout: # 1m isn't quite enough 2024-09-12T18:34:43.304 INFO:teuthology.orchestra.run.smithi143.stdout: mon_down_mkfs_grace = 2m 2024-09-12T18:34:43.304 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-12T18:34:43.304 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_filestore_osds = false 2024-09-12T18:34:43.305 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-12T18:34:43.305 INFO:teuthology.orchestra.run.smithi143.stdout:[client] 2024-09-12T18:34:43.305 INFO:teuthology.orchestra.run.smithi143.stdout: rgw cache enabled = true 2024-09-12T18:34:43.305 INFO:teuthology.orchestra.run.smithi143.stdout: rgw enable ops log = true 2024-09-12T18:34:43.305 INFO:teuthology.orchestra.run.smithi143.stdout: rgw enable usage log = true 2024-09-12T18:34:43.305 INFO:teuthology.orchestra.run.smithi143.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T18:34:43.305 INFO:teuthology.orchestra.run.smithi143.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T18:34:43.305 INFO:teuthology.orchestra.run.smithi143.stdout:[mon.a] 2024-09-12T18:34:43.305 INFO:teuthology.orchestra.run.smithi143.stdout:[mon.b] 2024-09-12T18:34:43.305 INFO:teuthology.orchestra.run.smithi143.stdout:[mon.c] 2024-09-12T18:34:43.305 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.a] 2024-09-12T18:34:43.305 INFO:teuthology.orchestra.run.smithi143.stdout:[client.0] 2024-09-12T18:34:43.306 INFO:teuthology.orchestra.run.smithi143.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-09-12T18:34:43.307 INFO:teuthology.orchestra.run.smithi114.stdout:[global] 2024-09-12T18:34:43.307 INFO:teuthology.orchestra.run.smithi114.stdout: chdir = "" 2024-09-12T18:34:43.307 INFO:teuthology.orchestra.run.smithi114.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T18:34:43.307 INFO:teuthology.orchestra.run.smithi114.stdout: auth supported = cephx 2024-09-12T18:34:43.307 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-12T18:34:43.307 INFO:teuthology.orchestra.run.smithi114.stdout: filestore xattr use omap = true 2024-09-12T18:34:43.307 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-12T18:34:43.307 INFO:teuthology.orchestra.run.smithi114.stdout: mon clock drift allowed = 1.000 2024-09-12T18:34:43.307 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-12T18:34:43.308 INFO:teuthology.orchestra.run.smithi114.stdout: osd crush chooseleaf type = 0 2024-09-12T18:34:43.308 INFO:teuthology.orchestra.run.smithi114.stdout: auth debug = true 2024-09-12T18:34:43.308 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-12T18:34:43.308 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on old message = true 2024-09-12T18:34:43.308 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on bug = true 2024-09-12T18:34:43.308 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-12T18:34:43.308 INFO:teuthology.orchestra.run.smithi114.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T18:34:43.308 INFO:teuthology.orchestra.run.smithi114.stdout: mon pg warn max object skew = 0 2024-09-12T18:34:43.308 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-12T18:34:43.308 INFO:teuthology.orchestra.run.smithi114.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T18:34:43.308 INFO:teuthology.orchestra.run.smithi114.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T18:34:43.308 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-12T18:34:43.308 INFO:teuthology.orchestra.run.smithi114.stdout: osd pool default size = 2 2024-09-12T18:34:43.309 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-12T18:34:43.309 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd allow primary affinity = true 2024-09-12T18:34:43.309 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd allow pg remap = true 2024-09-12T18:34:43.309 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on legacy crush tunables = false 2024-09-12T18:34:43.309 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on crush straw calc version zero = false 2024-09-12T18:34:43.309 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on no sortbitwise = false 2024-09-12T18:34:43.309 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on osd down out interval zero = false 2024-09-12T18:34:43.309 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on too few osds = false 2024-09-12T18:34:43.309 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T18:34:43.309 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T18:34:43.309 INFO:teuthology.orchestra.run.smithi114.stdout: mon_allow_pool_size_one = true 2024-09-12T18:34:43.309 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-12T18:34:43.310 INFO:teuthology.orchestra.run.smithi114.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T18:34:43.310 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-12T18:34:43.310 INFO:teuthology.orchestra.run.smithi114.stdout: osd default data pool replay window = 5 2024-09-12T18:34:43.310 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-12T18:34:43.310 INFO:teuthology.orchestra.run.smithi114.stdout: mon allow pool delete = true 2024-09-12T18:34:43.310 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-12T18:34:43.310 INFO:teuthology.orchestra.run.smithi114.stdout: mon cluster log file level = debug 2024-09-12T18:34:43.310 INFO:teuthology.orchestra.run.smithi114.stdout: debug asserts on shutdown = true 2024-09-12T18:34:43.310 INFO:teuthology.orchestra.run.smithi114.stdout: mon health detail to clog = false 2024-09-12T18:34:43.310 INFO:teuthology.orchestra.run.smithi114.stdout: mon host = "172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790],[v2:172.21.15.73:3302,v1:172.21.15.73:6791]" 2024-09-12T18:34:43.310 INFO:teuthology.orchestra.run.smithi114.stdout: fsid = c08d5a84-711b-44bf-bdf1-e06ecc2c7c00 2024-09-12T18:34:43.310 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-12T18:34:43.310 INFO:teuthology.orchestra.run.smithi114.stdout:[osd] 2024-09-12T18:34:43.311 INFO:teuthology.orchestra.run.smithi114.stdout: osd journal size = 100 2024-09-12T18:34:43.311 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-12T18:34:43.311 INFO:teuthology.orchestra.run.smithi114.stdout: osd scrub load threshold = 5.0 2024-09-12T18:34:43.311 INFO:teuthology.orchestra.run.smithi114.stdout: osd scrub max interval = 600 2024-09-12T18:34:43.311 INFO:teuthology.orchestra.run.smithi114.stdout: osd mclock profile = high_recovery_ops 2024-09-12T18:34:43.311 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-12T18:34:43.311 INFO:teuthology.orchestra.run.smithi114.stdout: osd recover clone overlap = true 2024-09-12T18:34:43.311 INFO:teuthology.orchestra.run.smithi114.stdout: osd recovery max chunk = 1048576 2024-09-12T18:34:43.311 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-12T18:34:43.311 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug shutdown = true 2024-09-12T18:34:43.311 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug op order = true 2024-09-12T18:34:43.311 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug verify stray on activate = true 2024-09-12T18:34:43.311 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug trim objects = true 2024-09-12T18:34:43.311 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-12T18:34:43.312 INFO:teuthology.orchestra.run.smithi114.stdout: osd open classes on start = true 2024-09-12T18:34:43.312 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug pg log writeout = true 2024-09-12T18:34:43.312 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-12T18:34:43.312 INFO:teuthology.orchestra.run.smithi114.stdout: osd deep scrub update digest min age = 30 2024-09-12T18:34:43.312 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-12T18:34:43.312 INFO:teuthology.orchestra.run.smithi114.stdout: osd map max advance = 10 2024-09-12T18:34:43.312 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-12T18:34:43.312 INFO:teuthology.orchestra.run.smithi114.stdout: journal zero on create = true 2024-09-12T18:34:43.312 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-12T18:34:43.312 INFO:teuthology.orchestra.run.smithi114.stdout: filestore ondisk finisher threads = 3 2024-09-12T18:34:43.312 INFO:teuthology.orchestra.run.smithi114.stdout: filestore apply finisher threads = 3 2024-09-12T18:34:43.312 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-12T18:34:43.312 INFO:teuthology.orchestra.run.smithi114.stdout: bdev debug aio = true 2024-09-12T18:34:43.312 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug misdirected ops = true 2024-09-12T18:34:43.313 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore block size = 96636764160 2024-09-12T18:34:43.313 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore compression algorithm = snappy 2024-09-12T18:34:43.313 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore compression mode = aggressive 2024-09-12T18:34:43.313 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore fsck on mount = True 2024-09-12T18:34:43.313 INFO:teuthology.orchestra.run.smithi114.stdout: debug bluefs = 1/20 2024-09-12T18:34:43.313 INFO:teuthology.orchestra.run.smithi114.stdout: debug bluestore = 1/20 2024-09-12T18:34:43.313 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-09-12T18:34:43.313 INFO:teuthology.orchestra.run.smithi114.stdout: debug osd = 20 2024-09-12T18:34:43.313 INFO:teuthology.orchestra.run.smithi114.stdout: debug rocksdb = 4/10 2024-09-12T18:34:43.313 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T18:34:43.313 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd full ratio = 0.9 2024-09-12T18:34:43.313 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd nearfull ratio = 0.8 2024-09-12T18:34:43.313 INFO:teuthology.orchestra.run.smithi114.stdout: osd blocked scrub grace period = 3600 2024-09-12T18:34:43.314 INFO:teuthology.orchestra.run.smithi114.stdout: osd failsafe full ratio = 0.95 2024-09-12T18:34:43.314 INFO:teuthology.orchestra.run.smithi114.stdout: osd max markdown count = 1000 2024-09-12T18:34:43.314 INFO:teuthology.orchestra.run.smithi114.stdout: osd objectstore = bluestore 2024-09-12T18:34:43.314 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-12T18:34:43.314 INFO:teuthology.orchestra.run.smithi114.stdout:[mgr] 2024-09-12T18:34:43.314 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-09-12T18:34:43.314 INFO:teuthology.orchestra.run.smithi114.stdout: debug mgr = 20 2024-09-12T18:34:43.314 INFO:teuthology.orchestra.run.smithi114.stdout: debug mon = 20 2024-09-12T18:34:43.314 INFO:teuthology.orchestra.run.smithi114.stdout: debug auth = 20 2024-09-12T18:34:43.314 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min pgs per osd = 4 2024-09-12T18:34:43.314 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min bytes per osd = 10 2024-09-12T18:34:43.314 INFO:teuthology.orchestra.run.smithi114.stdout: mgr/telemetry/nag = false 2024-09-12T18:34:43.314 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-12T18:34:43.315 INFO:teuthology.orchestra.run.smithi114.stdout:[mon] 2024-09-12T18:34:43.315 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-09-12T18:34:43.315 INFO:teuthology.orchestra.run.smithi114.stdout: debug mon = 20 2024-09-12T18:34:43.315 INFO:teuthology.orchestra.run.smithi114.stdout: debug paxos = 20 2024-09-12T18:34:43.315 INFO:teuthology.orchestra.run.smithi114.stdout: debug auth = 20 2024-09-12T18:34:43.315 INFO:teuthology.orchestra.run.smithi114.stdout: mon data avail warn = 5 2024-09-12T18:34:43.315 INFO:teuthology.orchestra.run.smithi114.stdout: mon mgr mkfs grace = 240 2024-09-12T18:34:43.315 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min pgs per osd = 4 2024-09-12T18:34:43.315 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd reporter subtree level = osd 2024-09-12T18:34:43.315 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd prime pg temp = true 2024-09-12T18:34:43.315 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min bytes per osd = 10 2024-09-12T18:34:43.315 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-12T18:34:43.316 INFO:teuthology.orchestra.run.smithi114.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T18:34:43.316 INFO:teuthology.orchestra.run.smithi114.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T18:34:43.316 INFO:teuthology.orchestra.run.smithi114.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T18:34:43.316 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-12T18:34:43.316 INFO:teuthology.orchestra.run.smithi114.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T18:34:43.316 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T18:34:43.316 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T18:34:43.316 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-12T18:34:43.316 INFO:teuthology.orchestra.run.smithi114.stdout: # 1m isn't quite enough 2024-09-12T18:34:43.316 INFO:teuthology.orchestra.run.smithi114.stdout: mon_down_mkfs_grace = 2m 2024-09-12T18:34:43.316 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-12T18:34:43.316 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_filestore_osds = false 2024-09-12T18:34:43.316 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-12T18:34:43.316 INFO:teuthology.orchestra.run.smithi114.stdout:[client] 2024-09-12T18:34:43.317 INFO:teuthology.orchestra.run.smithi114.stdout: rgw cache enabled = true 2024-09-12T18:34:43.317 INFO:teuthology.orchestra.run.smithi114.stdout: rgw enable ops log = true 2024-09-12T18:34:43.317 INFO:teuthology.orchestra.run.smithi114.stdout: rgw enable usage log = true 2024-09-12T18:34:43.317 INFO:teuthology.orchestra.run.smithi114.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T18:34:43.317 INFO:teuthology.orchestra.run.smithi114.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T18:34:43.317 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.a] 2024-09-12T18:34:43.317 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.b] 2024-09-12T18:34:43.317 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.c] 2024-09-12T18:34:43.317 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.a] 2024-09-12T18:34:43.317 INFO:teuthology.orchestra.run.smithi114.stdout:[client.0] 2024-09-12T18:34:43.317 INFO:teuthology.orchestra.run.smithi114.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-09-12T18:34:43.319 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T18:34:43.319 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T18:34:43.398 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T18:34:43.398 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T18:34:43.399 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T18:34:43.404 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T18:34:43.404 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T18:34:43.451 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi073.front.sepia.ceph.com 2024-09-12T18:34:43.451 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T18:34:43.451 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T18:34:43.451 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T18:34:43.515 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T18:34:43.515 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:34:43.563 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi114.front.sepia.ceph.com 2024-09-12T18:34:43.563 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-12T18:34:43.563 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T18:34:43.563 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T18:34:43.586 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-12T18:34:43.586 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:34:43.635 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi143.front.sepia.ceph.com 2024-09-12T18:34:43.635 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-12T18:34:43.635 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T18:34:43.635 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T18:34:43.659 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-12T18:34:43.659 DEBUG:teuthology.orchestra.run.smithi143:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:34:43.707 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi162.front.sepia.ceph.com 2024-09-12T18:34:43.707 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-12T18:34:43.707 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T18:34:43.707 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T18:34:43.731 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-12T18:34:43.731 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:34:43.777 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T18:34:43.777 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T18:34:43.777 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T18:34:43.821 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T18:34:43.824 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T18:34:43.907 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T18:34:43.910 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T18:34:43.910 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-12T18:34:43.992 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-12T18:34:43.995 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-12T18:34:44.051 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T18:34:44.052 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T18:34:44.131 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T18:34:44.142 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T18:34:44.143 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi114.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi143.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi162.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-09-12T18:34:44.143 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T18:34:44.156 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-12T18:34:44.157 INFO:tasks.ceph:role: osd.0 2024-09-12T18:34:44.157 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi114.front.sepia.ceph.com 2024-09-12T18:34:44.157 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T18:34:44.222 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T18:34:44.222 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T18:34:44.222 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T18:34:44.222 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T18:34:44.222 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T18:34:44.223 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2024-09-12T18:34:44.223 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T18:34:44.223 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T18:34:44.223 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T18:34:44.223 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T18:34:44.687 INFO:teuthology.orchestra.run.smithi114.stdout:Discarding blocks...Done. 2024-09-12T18:34:44.689 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2024-09-12T18:34:44.689 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T18:34:44.778 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T18:34:44.789 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:34:44.790 INFO:teuthology.orchestra.run.smithi114.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T18:34:44.790 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:34:44.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-12T18:34:44.898+0000 7f1bc9b2f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T18:34:44.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-12T18:34:44.906+0000 7f1bc9b2f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T18:34:44.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-12T18:34:44.906+0000 7f1bc9b2f7c0 -1 bdev(0x55c345c9f800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T18:34:44.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-12T18:34:44.906+0000 7f1bc9b2f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T18:34:48.071 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T18:34:48.084 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T18:34:48.098 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-09-12T18:34:48.099 INFO:tasks.ceph:role: osd.1 2024-09-12T18:34:48.099 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi143.front.sepia.ceph.com 2024-09-12T18:34:48.099 DEBUG:teuthology.orchestra.run.smithi143:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T18:34:48.162 INFO:teuthology.orchestra.run.smithi143.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T18:34:48.162 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T18:34:48.162 INFO:teuthology.orchestra.run.smithi143.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T18:34:48.162 INFO:teuthology.orchestra.run.smithi143.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T18:34:48.162 INFO:teuthology.orchestra.run.smithi143.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T18:34:48.162 INFO:teuthology.orchestra.run.smithi143.stdout: = sunit=0 swidth=0 blks 2024-09-12T18:34:48.162 INFO:teuthology.orchestra.run.smithi143.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T18:34:48.162 INFO:teuthology.orchestra.run.smithi143.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T18:34:48.163 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T18:34:48.163 INFO:teuthology.orchestra.run.smithi143.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T18:34:48.616 INFO:teuthology.orchestra.run.smithi143.stdout:Discarding blocks...Done. 2024-09-12T18:34:48.618 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi143.front.sepia.ceph.com -o noatime 2024-09-12T18:34:48.618 DEBUG:teuthology.orchestra.run.smithi143:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-12T18:34:48.711 DEBUG:teuthology.orchestra.run.smithi143:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T18:34:48.722 INFO:teuthology.orchestra.run.smithi143.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T18:34:48.723 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:34:48.723 DEBUG:teuthology.orchestra.run.smithi143:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:34:48.831 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-12T18:34:48.832+0000 7fab612b77c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T18:34:48.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-12T18:34:48.836+0000 7fab612b77c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T18:34:48.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-12T18:34:48.836+0000 7fab612b77c0 -1 bdev(0x55d62ba79800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T18:34:48.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-12T18:34:48.836+0000 7fab612b77c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T18:34:51.987 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T18:34:52.000 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T18:34:52.014 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-09-12T18:34:52.014 INFO:tasks.ceph:role: osd.2 2024-09-12T18:34:52.014 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi162.front.sepia.ceph.com 2024-09-12T18:34:52.014 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T18:34:52.075 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T18:34:52.075 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T18:34:52.075 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T18:34:52.076 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T18:34:52.076 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T18:34:52.076 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-09-12T18:34:52.076 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T18:34:52.076 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T18:34:52.076 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T18:34:52.076 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T18:34:52.527 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-09-12T18:34:52.530 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-09-12T18:34:52.530 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-09-12T18:34:52.626 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T18:34:52.635 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:34:52.636 INFO:teuthology.orchestra.run.smithi162.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T18:34:52.636 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:34:52.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-12T18:34:52.740+0000 7f0ce1d6d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T18:34:52.749 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-12T18:34:52.748+0000 7f0ce1d6d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T18:34:52.749 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-12T18:34:52.748+0000 7f0ce1d6d7c0 -1 bdev(0x5601604ed800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T18:34:52.749 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-12T18:34:52.748+0000 7f0ce1d6d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T18:34:55.939 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T18:34:55.953 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T18:34:55.953 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T18:34:55.953 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T18:34:55.967 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T18:34:55.967 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T18:34:56.022 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T18:34:56.022 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-12T18:34:56.082 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-12T18:34:56.082 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T18:34:56.096 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-12T18:34:56.097 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T18:34:56.112 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-12T18:34:56.112 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T18:34:56.125 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T18:34:56.125 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T18:34:56.134 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T18:34:56.134 DEBUG:teuthology.orchestra.run.smithi073:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T18:34:56.188 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.x] 2024-09-12T18:34:56.188 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBDNONmcqPvMBAAjb8iNBLVPohYIKKD4pEh3w== 2024-09-12T18:34:56.188 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.y] 2024-09-12T18:34:56.188 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBDNONm4ScONhAAec8Wil22kFPSNmtdSO0ywg== 2024-09-12T18:34:56.189 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2024-09-12T18:34:56.189 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBDNONmCSMgOxAAbyCiDCPwwLuhSiVlN82nsw== 2024-09-12T18:34:56.189 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.0] 2024-09-12T18:34:56.189 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBENONmfyT2NRAAXaZlRqT1fb4mxGq6lLuEng== 2024-09-12T18:34:56.189 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.1] 2024-09-12T18:34:56.189 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBINONm9vWnMRAA6xqsk+meFEunqNyS0kXuwg== 2024-09-12T18:34:56.189 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.2] 2024-09-12T18:34:56.189 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBMNONmY6FkLBAAIiiHYEUEH/8mnkrXrX55hg== 2024-09-12T18:34:56.189 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2024-09-12T18:34:56.189 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBENONmt8jVBxAAVAxQa6Da02FjJ9eRBgw0iA== 2024-09-12T18:34:56.190 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T18:34:56.280 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T18:34:56.322 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T18:34:56.415 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T18:34:56.496 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T18:34:56.580 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T18:34:56.661 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T18:34:56.743 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T18:34:56.743 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T18:34:56.797 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T18:34:56.907 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T18:34:56.917 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T18:34:56.968 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T18:34:57.060 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T18:34:57.071 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T18:34:57.123 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T18:34:57.213 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T18:34:57.224 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:34:57.270 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T18:34:57.271 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T18:34:57.271 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T18:34:57.315 INFO:tasks.ceph.mon.a:Started 2024-09-12T18:34:57.316 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T18:34:57.316 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T18:34:57.318 INFO:tasks.ceph.mon.b:Started 2024-09-12T18:34:57.318 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T18:34:57.318 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T18:34:57.321 INFO:tasks.ceph.mon.c:Started 2024-09-12T18:34:57.321 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T18:34:57.321 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T18:34:57.321 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T18:34:57.325 INFO:tasks.ceph.mgr.x:Started 2024-09-12T18:34:57.325 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T18:34:57.325 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T18:34:57.328 INFO:tasks.ceph.mgr.y:Started 2024-09-12T18:34:57.328 DEBUG:tasks.ceph:set 0 configs 2024-09-12T18:34:57.329 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T18:34:57.329 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T18:35:03.576 INFO:teuthology.orchestra.run.smithi073.stderr:adjusted tunables profile to default 2024-09-12T18:35:03.596 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T18:35:03.596 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T18:35:03.597 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-12T18:35:03.597 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T18:35:03.611 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-12T18:35:03.611 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T18:35:03.625 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-12T18:35:03.626 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T18:35:03.640 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new f1cf24e8-6179-4666-a444-fa81ef0d7482 0 2024-09-12T18:35:03.906 INFO:teuthology.orchestra.run.smithi162.stdout:0 2024-09-12T18:35:03.924 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 3fdb0044-2820-4411-978b-4b6e94fbf0b1 1 2024-09-12T18:35:04.133 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-09-12T18:35:04.150 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 6fb554da-561f-4aa2-b855-0e3adb98b057 2 2024-09-12T18:35:04.360 INFO:teuthology.orchestra.run.smithi162.stdout:2 2024-09-12T18:35:04.377 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T18:35:04.377 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T18:35:04.380 INFO:tasks.ceph.osd.0:Started 2024-09-12T18:35:04.380 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T18:35:04.380 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T18:35:04.383 INFO:tasks.ceph.osd.1:Started 2024-09-12T18:35:04.383 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T18:35:04.383 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T18:35:04.385 INFO:tasks.ceph.osd.2:Started 2024-09-12T18:35:04.386 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T18:35:04.570 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:35:04.570 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"fsid":"c08d5a84-711b-44bf-bdf1-e06ecc2c7c00","created":"2024-09-12T18:35:02.695853+0000","modified":"2024-09-12T18:35:04.352525+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T18:35:04.352525+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f1cf24e8-6179-4666-a444-fa81ef0d7482","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3fdb0044-2820-4411-978b-4b6e94fbf0b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6fb554da-561f-4aa2-b855-0e3adb98b057","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:35:04.591 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T18:35:04.591 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T18:35:04.893 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T18:35:05.077 INFO:teuthology.misc.health.smithi073.stdout: 2024-09-12T18:35:05.077 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":5,"fsid":"c08d5a84-711b-44bf-bdf1-e06ecc2c7c00","created":"2024-09-12T18:35:02.695853+0000","modified":"2024-09-12T18:35:04.352525+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T18:35:04.352525+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f1cf24e8-6179-4666-a444-fa81ef0d7482","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3fdb0044-2820-4411-978b-4b6e94fbf0b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6fb554da-561f-4aa2-b855-0e3adb98b057","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:35:05.092 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-12T18:35:05.449 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:05.447+0000 7f9d020257c0 -1 Falling back to public interface 2024-09-12T18:35:05.460 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:05.454+0000 7f71ac3257c0 -1 Falling back to public interface 2024-09-12T18:35:05.792 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:05.792+0000 7ff33ba757c0 -1 Falling back to public interface 2024-09-12T18:35:06.463 INFO:tasks.ceph.mgr.x.smithi073.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T18:35:06.463 INFO:tasks.ceph.mgr.x.smithi073.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T18:35:06.463 INFO:tasks.ceph.mgr.x.smithi073.stderr: from numpy import show_config as show_numpy_config 2024-09-12T18:35:06.464 INFO:tasks.ceph.mgr.y.smithi073.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T18:35:06.464 INFO:tasks.ceph.mgr.y.smithi073.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T18:35:06.464 INFO:tasks.ceph.mgr.y.smithi073.stderr: from numpy import show_config as show_numpy_config 2024-09-12T18:35:09.285 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:09.278+0000 7f71ac3257c0 -1 osd.0 0 log_to_monitors true 2024-09-12T18:35:09.312 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:09.311+0000 7f9d020257c0 -1 osd.2 0 log_to_monitors true 2024-09-12T18:35:09.395 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-09-12T18:35:09.390+0000 7fe304e30640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T18:35:09.396 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-09-12T18:35:09.390+0000 7fe304e30640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T18:35:09.869 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:09.868+0000 7ff33ba757c0 -1 osd.1 0 log_to_monitors true 2024-09-12T18:35:11.260 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:11.254+0000 7f71a8ae0640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T18:35:11.287 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:11.282+0000 7f71a0100640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T18:35:11.301 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:11.299+0000 7f9cfdfce640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T18:35:11.328 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:11.327+0000 7f9cf5e00640 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T18:35:11.395 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T18:35:11.706 INFO:teuthology.misc.health.smithi073.stdout: 2024-09-12T18:35:11.706 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":8,"fsid":"c08d5a84-711b-44bf-bdf1-e06ecc2c7c00","created":"2024-09-12T18:35:02.695853+0000","modified":"2024-09-12T18:35:11.442708+0000","last_up_change":"2024-09-12T18:35:11.442708+0000","last_in_change":"2024-09-12T18:35:04.352525+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f1cf24e8-6179-4666-a444-fa81ef0d7482","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6801","nonce":2710632206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6803","nonce":2710632206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6807","nonce":2710632206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6805","nonce":2710632206}]},"public_addr":"172.21.15.114:6801/2710632206","cluster_addr":"172.21.15.114:6803/2710632206","heartbeat_back_addr":"172.21.15.114:6807/2710632206","heartbeat_front_addr":"172.21.15.114:6805/2710632206","state":["exists","up"]},{"osd":1,"uuid":"3fdb0044-2820-4411-978b-4b6e94fbf0b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6fb554da-561f-4aa2-b855-0e3adb98b057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6801","nonce":1397104153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6803","nonce":1397104153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6807","nonce":1397104153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6805","nonce":1397104153}]},"public_addr":"172.21.15.162:6801/1397104153","cluster_addr":"172.21.15.162:6803/1397104153","heartbeat_back_addr":"172.21.15.162:6807/1397104153","heartbeat_front_addr":"172.21.15.162:6805/1397104153","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:35:11.725 DEBUG:teuthology.misc:2 of 3 OSDs are up 2024-09-12T18:35:12.311 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:12.312+0000 7ff338230640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T18:35:12.334 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:12.336+0000 7ff32f850640 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T18:35:18.027 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T18:35:18.334 INFO:teuthology.misc.health.smithi073.stdout: 2024-09-12T18:35:18.334 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":11,"fsid":"c08d5a84-711b-44bf-bdf1-e06ecc2c7c00","created":"2024-09-12T18:35:02.695853+0000","modified":"2024-09-12T18:35:14.473614+0000","last_up_change":"2024-09-12T18:35:12.464628+0000","last_in_change":"2024-09-12T18:35:04.352525+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T18:35:12.418430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f1cf24e8-6179-4666-a444-fa81ef0d7482","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6801","nonce":2710632206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6803","nonce":2710632206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6807","nonce":2710632206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6805","nonce":2710632206}]},"public_addr":"172.21.15.114:6801/2710632206","cluster_addr":"172.21.15.114:6803/2710632206","heartbeat_back_addr":"172.21.15.114:6807/2710632206","heartbeat_front_addr":"172.21.15.114:6805/2710632206","state":["exists","up"]},{"osd":1,"uuid":"3fdb0044-2820-4411-978b-4b6e94fbf0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6801","nonce":862189968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6803","nonce":862189968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6807","nonce":862189968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6805","nonce":862189968}]},"public_addr":"172.21.15.143:6801/862189968","cluster_addr":"172.21.15.143:6803/862189968","heartbeat_back_addr":"172.21.15.143:6807/862189968","heartbeat_front_addr":"172.21.15.143:6805/862189968","state":["exists","up"]},{"osd":2,"uuid":"6fb554da-561f-4aa2-b855-0e3adb98b057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6801","nonce":1397104153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6803","nonce":1397104153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6807","nonce":1397104153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6805","nonce":1397104153}]},"public_addr":"172.21.15.162:6801/1397104153","cluster_addr":"172.21.15.162:6803/1397104153","heartbeat_back_addr":"172.21.15.162:6807/1397104153","heartbeat_front_addr":"172.21.15.162:6805/1397104153","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:35:10.239320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:35:10.861760+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:35:10.355997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:35:18.351 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-09-12T18:35:18.352 INFO:tasks.ceph:Creating RBD pool 2024-09-12T18:35:18.352 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-12T18:35:19.437 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'rbd' created 2024-09-12T18:35:19.461 DEBUG:teuthology.orchestra.run.smithi073:> rbd --cluster ceph pool init rbd 2024-09-12T18:35:22.494 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T18:35:22.495 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T18:35:22.495 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T18:35:22.498 INFO:tasks.ceph.mds.a:Started 2024-09-12T18:35:22.498 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-12T18:35:22.498 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T18:35:22.575 INFO:tasks.ceph.mds.a.smithi073.stdout:starting mds.a at 2024-09-12T18:35:22.828 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:35:22.828 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":2,"btime":"2024-09-12T18:35:22:594822+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4211,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6803/322019923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":322019923},{"type":"v1","addr":"172.21.15.73:6803","nonce":322019923}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T18:35:22.828 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 2 2024-09-12T18:35:22.846 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T18:35:23.132 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:35:23.132 INFO:teuthology.orchestra.run.smithi073.stdout:[ 2024-09-12T18:35:23.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:35:23.132 INFO:teuthology.orchestra.run.smithi073.stdout: "poolnum": 1, 2024-09-12T18:35:23.133 INFO:teuthology.orchestra.run.smithi073.stdout: "poolname": ".mgr" 2024-09-12T18:35:23.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:35:23.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:35:23.133 INFO:teuthology.orchestra.run.smithi073.stdout: "poolnum": 2, 2024-09-12T18:35:23.133 INFO:teuthology.orchestra.run.smithi073.stdout: "poolname": "rbd" 2024-09-12T18:35:23.133 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:35:23.133 INFO:teuthology.orchestra.run.smithi073.stdout:] 2024-09-12T18:35:23.149 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T18:35:23.149 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T18:35:23.614 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' created 2024-09-12T18:35:23.636 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T18:35:24.630 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' created 2024-09-12T18:35:24.659 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T18:35:25.628 INFO:teuthology.orchestra.run.smithi073.stderr:new fs with metadata pool 3 and data pool 4 2024-09-12T18:35:25.651 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T18:35:25.943 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:35:25.943 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":18,"fsid":"c08d5a84-711b-44bf-bdf1-e06ecc2c7c00","created":"2024-09-12T18:35:02.695853+0000","modified":"2024-09-12T18:35:25.000945+0000","last_up_change":"2024-09-12T18:35:12.464628+0000","last_in_change":"2024-09-12T18:35:04.352525+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T18:35:12.418430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T18:35:18.665309+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T18:35:23.447845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T18:35:23.959973+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f1cf24e8-6179-4666-a444-fa81ef0d7482","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6801","nonce":2710632206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6803","nonce":2710632206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6807","nonce":2710632206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6805","nonce":2710632206}]},"public_addr":"172.21.15.114:6801/2710632206","cluster_addr":"172.21.15.114:6803/2710632206","heartbeat_back_addr":"172.21.15.114:6807/2710632206","heartbeat_front_addr":"172.21.15.114:6805/2710632206","state":["exists","up"]},{"osd":1,"uuid":"3fdb0044-2820-4411-978b-4b6e94fbf0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6801","nonce":862189968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6803","nonce":862189968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6807","nonce":862189968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6805","nonce":862189968}]},"public_addr":"172.21.15.143:6801/862189968","cluster_addr":"172.21.15.143:6803/862189968","heartbeat_back_addr":"172.21.15.143:6807/862189968","heartbeat_front_addr":"172.21.15.143:6805/862189968","state":["exists","up"]},{"osd":2,"uuid":"6fb554da-561f-4aa2-b855-0e3adb98b057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6801","nonce":1397104153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6803","nonce":1397104153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6807","nonce":1397104153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6805","nonce":1397104153}]},"public_addr":"172.21.15.162:6801/1397104153","cluster_addr":"172.21.15.162:6803/1397104153","heartbeat_back_addr":"172.21.15.162:6807/1397104153","heartbeat_front_addr":"172.21.15.162:6805/1397104153","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:35:10.239320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:35:10.861760+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:35:10.355997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:35:25.961 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T18:35:26.249 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:35:26.249 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":18,"fsid":"c08d5a84-711b-44bf-bdf1-e06ecc2c7c00","created":"2024-09-12T18:35:02.695853+0000","modified":"2024-09-12T18:35:25.000945+0000","last_up_change":"2024-09-12T18:35:12.464628+0000","last_in_change":"2024-09-12T18:35:04.352525+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T18:35:12.418430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T18:35:18.665309+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T18:35:23.447845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T18:35:23.959973+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f1cf24e8-6179-4666-a444-fa81ef0d7482","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6801","nonce":2710632206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6803","nonce":2710632206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6807","nonce":2710632206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6805","nonce":2710632206}]},"public_addr":"172.21.15.114:6801/2710632206","cluster_addr":"172.21.15.114:6803/2710632206","heartbeat_back_addr":"172.21.15.114:6807/2710632206","heartbeat_front_addr":"172.21.15.114:6805/2710632206","state":["exists","up"]},{"osd":1,"uuid":"3fdb0044-2820-4411-978b-4b6e94fbf0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6801","nonce":862189968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6803","nonce":862189968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6807","nonce":862189968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6805","nonce":862189968}]},"public_addr":"172.21.15.143:6801/862189968","cluster_addr":"172.21.15.143:6803/862189968","heartbeat_back_addr":"172.21.15.143:6807/862189968","heartbeat_front_addr":"172.21.15.143:6805/862189968","state":["exists","up"]},{"osd":2,"uuid":"6fb554da-561f-4aa2-b855-0e3adb98b057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6801","nonce":1397104153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6803","nonce":1397104153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6807","nonce":1397104153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6805","nonce":1397104153}]},"public_addr":"172.21.15.162:6801/1397104153","cluster_addr":"172.21.15.162:6803/1397104153","heartbeat_back_addr":"172.21.15.162:6807/1397104153","heartbeat_front_addr":"172.21.15.162:6805/1397104153","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:35:10.239320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:35:10.861760+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:35:10.355997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:35:26.266 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T18:35:26.659 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T18:35:26.660 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T18:35:27.601 INFO:tasks.ceph.mds.a.smithi073.stderr:2024-09-12T18:35:27.598+0000 7f8b55ae6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T18:35:27.669 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T18:35:27.670 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T18:35:28.010 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:35:28.010 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"btime":"2024-09-12T18:35:27:637181+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T18:35:25.000900+0000","modified":"2024-09-12T18:35:26.979639+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4211":{"gid":4211,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.73:6803/322019923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":322019923},{"type":"v1","addr":"172.21.15.73:6803","nonce":322019923}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4211,"qdb_cluster":[4211]},"id":1}]} 2024-09-12T18:35:28.011 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 5 2024-09-12T18:35:28.028 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T18:35:28.303 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:35:28.303 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":19,"fsid":"c08d5a84-711b-44bf-bdf1-e06ecc2c7c00","created":"2024-09-12T18:35:02.695853+0000","modified":"2024-09-12T18:35:26.630140+0000","last_up_change":"2024-09-12T18:35:12.464628+0000","last_in_change":"2024-09-12T18:35:04.352525+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T18:35:12.418430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T18:35:18.665309+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T18:35:23.447845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T18:35:23.959973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f1cf24e8-6179-4666-a444-fa81ef0d7482","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6801","nonce":2710632206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6803","nonce":2710632206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6807","nonce":2710632206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6805","nonce":2710632206}]},"public_addr":"172.21.15.114:6801/2710632206","cluster_addr":"172.21.15.114:6803/2710632206","heartbeat_back_addr":"172.21.15.114:6807/2710632206","heartbeat_front_addr":"172.21.15.114:6805/2710632206","state":["exists","up"]},{"osd":1,"uuid":"3fdb0044-2820-4411-978b-4b6e94fbf0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6801","nonce":862189968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6803","nonce":862189968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6807","nonce":862189968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6805","nonce":862189968}]},"public_addr":"172.21.15.143:6801/862189968","cluster_addr":"172.21.15.143:6803/862189968","heartbeat_back_addr":"172.21.15.143:6807/862189968","heartbeat_front_addr":"172.21.15.143:6805/862189968","state":["exists","up"]},{"osd":2,"uuid":"6fb554da-561f-4aa2-b855-0e3adb98b057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6801","nonce":1397104153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6803","nonce":1397104153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6807","nonce":1397104153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6805","nonce":1397104153}]},"public_addr":"172.21.15.162:6801/1397104153","cluster_addr":"172.21.15.162:6803/1397104153","heartbeat_back_addr":"172.21.15.162:6807/1397104153","heartbeat_front_addr":"172.21.15.162:6805/1397104153","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:35:10.239320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:35:10.861760+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:35:10.355997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:35:28.320 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T18:35:28.320 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:35:28.610 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:35:28.612 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T18:35:28.625 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-12T18:35:28.376312+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592707,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":181,"num_write_kb":2687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":144,"acting":144,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":72,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":85872,"kb_used_data":608,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283029648,"statfs":{"total":289910292480,"available":289822359552,"internally_reserved":0,"allocated":622592,"data_stored":1334036,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4783,"internal_metadata":87223633},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2331,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.765854"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.670958+0000","last_change":"2024-09-12T18:35:25.659460+0000","last_active":"2024-09-12T18:35:25.670958+0000","last_peered":"2024-09-12T18:35:25.670958+0000","last_clean":"2024-09-12T18:35:25.670958+0000","last_became_active":"2024-09-12T18:35:25.657782+0000","last_became_peered":"2024-09-12T18:35:25.657782+0000","last_unstale":"2024-09-12T18:35:25.670958+0000","last_undegraded":"2024-09-12T18:35:25.670958+0000","last_fullsized":"2024-09-12T18:35:25.670958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:56.799067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671805+0000","last_change":"2024-09-12T18:35:25.663617+0000","last_active":"2024-09-12T18:35:25.671805+0000","last_peered":"2024-09-12T18:35:25.671805+0000","last_clean":"2024-09-12T18:35:25.671805+0000","last_became_active":"2024-09-12T18:35:25.661977+0000","last_became_peered":"2024-09-12T18:35:25.661977+0000","last_unstale":"2024-09-12T18:35:25.671805+0000","last_undegraded":"2024-09-12T18:35:25.671805+0000","last_fullsized":"2024-09-12T18:35:25.671805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:02.792152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.655766+0000","last_change":"2024-09-12T18:35:25.652754+0000","last_active":"2024-09-12T18:35:25.655766+0000","last_peered":"2024-09-12T18:35:25.655766+0000","last_clean":"2024-09-12T18:35:25.655766+0000","last_became_active":"2024-09-12T18:35:25.651217+0000","last_became_peered":"2024-09-12T18:35:25.651217+0000","last_unstale":"2024-09-12T18:35:25.655766+0000","last_undegraded":"2024-09-12T18:35:25.655766+0000","last_fullsized":"2024-09-12T18:35:25.655766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:17.007002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671054+0000","last_change":"2024-09-12T18:35:25.659811+0000","last_active":"2024-09-12T18:35:25.671054+0000","last_peered":"2024-09-12T18:35:25.671054+0000","last_clean":"2024-09-12T18:35:25.671054+0000","last_became_active":"2024-09-12T18:35:25.658998+0000","last_became_peered":"2024-09-12T18:35:25.658998+0000","last_unstale":"2024-09-12T18:35:25.671054+0000","last_undegraded":"2024-09-12T18:35:25.671054+0000","last_fullsized":"2024-09-12T18:35:25.671054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:12.891661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.655902+0000","last_change":"2024-09-12T18:35:25.653999+0000","last_active":"2024-09-12T18:35:25.655902+0000","last_peered":"2024-09-12T18:35:25.655902+0000","last_clean":"2024-09-12T18:35:25.655902+0000","last_became_active":"2024-09-12T18:35:25.653319+0000","last_became_peered":"2024-09-12T18:35:25.653319+0000","last_unstale":"2024-09-12T18:35:25.655902+0000","last_undegraded":"2024-09-12T18:35:25.655902+0000","last_fullsized":"2024-09-12T18:35:25.655902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:31.096877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.670527+0000","last_change":"2024-09-12T18:35:25.668339+0000","last_active":"2024-09-12T18:35:25.670527+0000","last_peered":"2024-09-12T18:35:25.670527+0000","last_clean":"2024-09-12T18:35:25.670527+0000","last_became_active":"2024-09-12T18:35:25.667608+0000","last_became_peered":"2024-09-12T18:35:25.667608+0000","last_unstale":"2024-09-12T18:35:25.670527+0000","last_undegraded":"2024-09-12T18:35:25.670527+0000","last_fullsized":"2024-09-12T18:35:25.670527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:52.466349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.655517+0000","last_change":"2024-09-12T18:35:25.649858+0000","last_active":"2024-09-12T18:35:25.655517+0000","last_peered":"2024-09-12T18:35:25.655517+0000","last_clean":"2024-09-12T18:35:25.655517+0000","last_became_active":"2024-09-12T18:35:25.649090+0000","last_became_peered":"2024-09-12T18:35:25.649090+0000","last_unstale":"2024-09-12T18:35:25.655517+0000","last_undegraded":"2024-09-12T18:35:25.655517+0000","last_fullsized":"2024-09-12T18:35:25.655517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:42.675921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.666461+0000","last_change":"2024-09-12T18:35:25.657913+0000","last_active":"2024-09-12T18:35:25.666461+0000","last_peered":"2024-09-12T18:35:25.666461+0000","last_clean":"2024-09-12T18:35:25.666461+0000","last_became_active":"2024-09-12T18:35:25.657082+0000","last_became_peered":"2024-09-12T18:35:25.657082+0000","last_unstale":"2024-09-12T18:35:25.666461+0000","last_undegraded":"2024-09-12T18:35:25.666461+0000","last_fullsized":"2024-09-12T18:35:25.666461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:36.452006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.670741+0000","last_change":"2024-09-12T18:35:25.658763+0000","last_active":"2024-09-12T18:35:25.670741+0000","last_peered":"2024-09-12T18:35:25.670741+0000","last_clean":"2024-09-12T18:35:25.670741+0000","last_became_active":"2024-09-12T18:35:25.657508+0000","last_became_peered":"2024-09-12T18:35:25.657508+0000","last_unstale":"2024-09-12T18:35:25.670741+0000","last_undegraded":"2024-09-12T18:35:25.670741+0000","last_fullsized":"2024-09-12T18:35:25.670741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:14.134808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.655848+0000","last_change":"2024-09-12T18:35:25.653730+0000","last_active":"2024-09-12T18:35:25.655848+0000","last_peered":"2024-09-12T18:35:25.655848+0000","last_clean":"2024-09-12T18:35:25.655848+0000","last_became_active":"2024-09-12T18:35:25.651535+0000","last_became_peered":"2024-09-12T18:35:25.651535+0000","last_unstale":"2024-09-12T18:35:25.655848+0000","last_undegraded":"2024-09-12T18:35:25.655848+0000","last_fullsized":"2024-09-12T18:35:25.655848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:37.514843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.666868+0000","last_change":"2024-09-12T18:35:25.656513+0000","last_active":"2024-09-12T18:35:25.666868+0000","last_peered":"2024-09-12T18:35:25.666868+0000","last_clean":"2024-09-12T18:35:25.666868+0000","last_became_active":"2024-09-12T18:35:25.653440+0000","last_became_peered":"2024-09-12T18:35:25.653440+0000","last_unstale":"2024-09-12T18:35:25.666868+0000","last_undegraded":"2024-09-12T18:35:25.666868+0000","last_fullsized":"2024-09-12T18:35:25.666868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:26.721698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.665394+0000","last_change":"2024-09-12T18:35:25.658819+0000","last_active":"2024-09-12T18:35:25.665394+0000","last_peered":"2024-09-12T18:35:25.665394+0000","last_clean":"2024-09-12T18:35:25.665394+0000","last_became_active":"2024-09-12T18:35:25.656843+0000","last_became_peered":"2024-09-12T18:35:25.656843+0000","last_unstale":"2024-09-12T18:35:25.665394+0000","last_undegraded":"2024-09-12T18:35:25.665394+0000","last_fullsized":"2024-09-12T18:35:25.665394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:27:44.442447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671733+0000","last_change":"2024-09-12T18:35:25.661176+0000","last_active":"2024-09-12T18:35:25.671733+0000","last_peered":"2024-09-12T18:35:25.671733+0000","last_clean":"2024-09-12T18:35:25.671733+0000","last_became_active":"2024-09-12T18:35:25.659534+0000","last_became_peered":"2024-09-12T18:35:25.659534+0000","last_unstale":"2024-09-12T18:35:25.671733+0000","last_undegraded":"2024-09-12T18:35:25.671733+0000","last_fullsized":"2024-09-12T18:35:25.671733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:54.580837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.655660+0000","last_change":"2024-09-12T18:35:25.650632+0000","last_active":"2024-09-12T18:35:25.655660+0000","last_peered":"2024-09-12T18:35:25.655660+0000","last_clean":"2024-09-12T18:35:25.655660+0000","last_became_active":"2024-09-12T18:35:25.649333+0000","last_became_peered":"2024-09-12T18:35:25.649333+0000","last_unstale":"2024-09-12T18:35:25.655660+0000","last_undegraded":"2024-09-12T18:35:25.655660+0000","last_fullsized":"2024-09-12T18:35:25.655660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:20.136271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.667558+0000","last_change":"2024-09-12T18:35:25.661613+0000","last_active":"2024-09-12T18:35:25.667558+0000","last_peered":"2024-09-12T18:35:25.667558+0000","last_clean":"2024-09-12T18:35:25.667558+0000","last_became_active":"2024-09-12T18:35:25.658833+0000","last_became_peered":"2024-09-12T18:35:25.658833+0000","last_unstale":"2024-09-12T18:35:25.667558+0000","last_undegraded":"2024-09-12T18:35:25.667558+0000","last_fullsized":"2024-09-12T18:35:25.667558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:37.514843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671782+0000","last_change":"2024-09-12T18:35:25.662414+0000","last_active":"2024-09-12T18:35:25.671782+0000","last_peered":"2024-09-12T18:35:25.671782+0000","last_clean":"2024-09-12T18:35:25.671782+0000","last_became_active":"2024-09-12T18:35:25.660126+0000","last_became_peered":"2024-09-12T18:35:25.660126+0000","last_unstale":"2024-09-12T18:35:25.671782+0000","last_undegraded":"2024-09-12T18:35:25.671782+0000","last_fullsized":"2024-09-12T18:35:25.671782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:05.136469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671510+0000","last_change":"2024-09-12T18:35:25.661523+0000","last_active":"2024-09-12T18:35:25.671510+0000","last_peered":"2024-09-12T18:35:25.671510+0000","last_clean":"2024-09-12T18:35:25.671510+0000","last_became_active":"2024-09-12T18:35:25.659338+0000","last_became_peered":"2024-09-12T18:35:25.659338+0000","last_unstale":"2024-09-12T18:35:25.671510+0000","last_undegraded":"2024-09-12T18:35:25.671510+0000","last_fullsized":"2024-09-12T18:35:25.671510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:12.762819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.667865+0000","last_change":"2024-09-12T18:35:25.662519+0000","last_active":"2024-09-12T18:35:25.667865+0000","last_peered":"2024-09-12T18:35:25.667865+0000","last_clean":"2024-09-12T18:35:25.667865+0000","last_became_active":"2024-09-12T18:35:25.652964+0000","last_became_peered":"2024-09-12T18:35:25.652964+0000","last_unstale":"2024-09-12T18:35:25.667865+0000","last_undegraded":"2024-09-12T18:35:25.667865+0000","last_fullsized":"2024-09-12T18:35:25.667865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:02.929063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.662850+0000","last_change":"2024-09-12T18:35:25.653949+0000","last_active":"2024-09-12T18:35:25.662850+0000","last_peered":"2024-09-12T18:35:25.662850+0000","last_clean":"2024-09-12T18:35:25.662850+0000","last_became_active":"2024-09-12T18:35:25.652992+0000","last_became_peered":"2024-09-12T18:35:25.652992+0000","last_unstale":"2024-09-12T18:35:25.662850+0000","last_undegraded":"2024-09-12T18:35:25.662850+0000","last_fullsized":"2024-09-12T18:35:25.662850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:20.448219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.655784+0000","last_change":"2024-09-12T18:35:25.653159+0000","last_active":"2024-09-12T18:35:25.655784+0000","last_peered":"2024-09-12T18:35:25.655784+0000","last_clean":"2024-09-12T18:35:25.655784+0000","last_became_active":"2024-09-12T18:35:25.650551+0000","last_became_peered":"2024-09-12T18:35:25.650551+0000","last_unstale":"2024-09-12T18:35:25.655784+0000","last_undegraded":"2024-09-12T18:35:25.655784+0000","last_fullsized":"2024-09-12T18:35:25.655784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:45.453862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.667164+0000","last_change":"2024-09-12T18:35:24.657739+0000","last_active":"2024-09-12T18:35:25.667164+0000","last_peered":"2024-09-12T18:35:25.667164+0000","last_clean":"2024-09-12T18:35:25.667164+0000","last_became_active":"2024-09-12T18:35:24.656208+0000","last_became_peered":"2024-09-12T18:35:24.656208+0000","last_unstale":"2024-09-12T18:35:25.667164+0000","last_undegraded":"2024-09-12T18:35:25.667164+0000","last_fullsized":"2024-09-12T18:35:25.667164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:50.073716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.645957+0000","last_change":"2024-09-12T18:35:24.656119+0000","last_active":"2024-09-12T18:35:25.645957+0000","last_peered":"2024-09-12T18:35:25.645957+0000","last_clean":"2024-09-12T18:35:25.645957+0000","last_became_active":"2024-09-12T18:35:24.653175+0000","last_became_peered":"2024-09-12T18:35:24.653175+0000","last_unstale":"2024-09-12T18:35:25.645957+0000","last_undegraded":"2024-09-12T18:35:25.645957+0000","last_fullsized":"2024-09-12T18:35:25.645957+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:00.551165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.663487+0000","last_change":"2024-09-12T18:35:25.655723+0000","last_active":"2024-09-12T18:35:25.663487+0000","last_peered":"2024-09-12T18:35:25.663487+0000","last_clean":"2024-09-12T18:35:25.663487+0000","last_became_active":"2024-09-12T18:35:25.653630+0000","last_became_peered":"2024-09-12T18:35:25.653630+0000","last_unstale":"2024-09-12T18:35:25.663487+0000","last_undegraded":"2024-09-12T18:35:25.663487+0000","last_fullsized":"2024-09-12T18:35:25.663487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:18.567270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:23.596638+0000","last_change":"2024-09-12T18:35:23.596638+0000","last_active":"2024-09-12T18:35:23.596638+0000","last_peered":"2024-09-12T18:35:23.596638+0000","last_clean":"2024-09-12T18:35:23.596638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:23.596638+0000","last_undegraded":"2024-09-12T18:35:23.596638+0000","last_fullsized":"2024-09-12T18:35:23.596638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.669610+0000","last_change":"2024-09-12T18:35:25.662692+0000","last_active":"2024-09-12T18:35:25.669610+0000","last_peered":"2024-09-12T18:35:25.669610+0000","last_clean":"2024-09-12T18:35:25.669610+0000","last_became_active":"2024-09-12T18:35:25.661885+0000","last_became_peered":"2024-09-12T18:35:25.661885+0000","last_unstale":"2024-09-12T18:35:25.669610+0000","last_undegraded":"2024-09-12T18:35:25.669610+0000","last_fullsized":"2024-09-12T18:35:25.669610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:17.050672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.668729+0000","last_change":"2024-09-12T18:35:24.653610+0000","last_active":"2024-09-12T18:35:25.668729+0000","last_peered":"2024-09-12T18:35:25.668729+0000","last_clean":"2024-09-12T18:35:25.668729+0000","last_became_active":"2024-09-12T18:35:24.652880+0000","last_became_peered":"2024-09-12T18:35:24.652880+0000","last_unstale":"2024-09-12T18:35:25.668729+0000","last_undegraded":"2024-09-12T18:35:25.668729+0000","last_fullsized":"2024-09-12T18:35:25.668729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:57.636251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.665457+0000","last_change":"2024-09-12T18:35:24.653465+0000","last_active":"2024-09-12T18:35:25.665457+0000","last_peered":"2024-09-12T18:35:25.665457+0000","last_clean":"2024-09-12T18:35:25.665457+0000","last_became_active":"2024-09-12T18:35:24.652792+0000","last_became_peered":"2024-09-12T18:35:24.652792+0000","last_unstale":"2024-09-12T18:35:25.665457+0000","last_undegraded":"2024-09-12T18:35:25.665457+0000","last_fullsized":"2024-09-12T18:35:25.665457+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:14.588993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:23.596638+0000","last_change":"2024-09-12T18:35:23.596638+0000","last_active":"2024-09-12T18:35:23.596638+0000","last_peered":"2024-09-12T18:35:23.596638+0000","last_clean":"2024-09-12T18:35:23.596638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:23.596638+0000","last_undegraded":"2024-09-12T18:35:23.596638+0000","last_fullsized":"2024-09-12T18:35:23.596638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.665427+0000","last_change":"2024-09-12T18:35:24.654976+0000","last_active":"2024-09-12T18:35:25.665427+0000","last_peered":"2024-09-12T18:35:25.665427+0000","last_clean":"2024-09-12T18:35:25.665427+0000","last_became_active":"2024-09-12T18:35:24.654264+0000","last_became_peered":"2024-09-12T18:35:24.654264+0000","last_unstale":"2024-09-12T18:35:25.665427+0000","last_undegraded":"2024-09-12T18:35:25.665427+0000","last_fullsized":"2024-09-12T18:35:25.665427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:00.115408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.655595+0000","last_change":"2024-09-12T18:35:25.650577+0000","last_active":"2024-09-12T18:35:25.655595+0000","last_peered":"2024-09-12T18:35:25.655595+0000","last_clean":"2024-09-12T18:35:25.655595+0000","last_became_active":"2024-09-12T18:35:25.649172+0000","last_became_peered":"2024-09-12T18:35:25.649172+0000","last_unstale":"2024-09-12T18:35:25.655595+0000","last_undegraded":"2024-09-12T18:35:25.655595+0000","last_fullsized":"2024-09-12T18:35:25.655595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:21.445401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.635569+0000","last_change":"2024-09-12T18:35:24.657665+0000","last_active":"2024-09-12T18:35:25.635569+0000","last_peered":"2024-09-12T18:35:25.635569+0000","last_clean":"2024-09-12T18:35:25.635569+0000","last_became_active":"2024-09-12T18:35:24.657015+0000","last_became_peered":"2024-09-12T18:35:24.657015+0000","last_unstale":"2024-09-12T18:35:25.635569+0000","last_undegraded":"2024-09-12T18:35:25.635569+0000","last_fullsized":"2024-09-12T18:35:25.635569+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:03.171326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.668848+0000","last_change":"2024-09-12T18:35:25.665275+0000","last_active":"2024-09-12T18:35:25.668848+0000","last_peered":"2024-09-12T18:35:25.668848+0000","last_clean":"2024-09-12T18:35:25.668848+0000","last_became_active":"2024-09-12T18:35:25.659511+0000","last_became_peered":"2024-09-12T18:35:25.659511+0000","last_unstale":"2024-09-12T18:35:25.668848+0000","last_undegraded":"2024-09-12T18:35:25.668848+0000","last_fullsized":"2024-09-12T18:35:25.668848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:39.035368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.670534+0000","last_change":"2024-09-12T18:35:24.651913+0000","last_active":"2024-09-12T18:35:25.670534+0000","last_peered":"2024-09-12T18:35:25.670534+0000","last_clean":"2024-09-12T18:35:25.670534+0000","last_became_active":"2024-09-12T18:35:24.650421+0000","last_became_peered":"2024-09-12T18:35:24.650421+0000","last_unstale":"2024-09-12T18:35:25.670534+0000","last_undegraded":"2024-09-12T18:35:25.670534+0000","last_fullsized":"2024-09-12T18:35:25.670534+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:57.685312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.655649+0000","last_change":"2024-09-12T18:35:25.651138+0000","last_active":"2024-09-12T18:35:25.655649+0000","last_peered":"2024-09-12T18:35:25.655649+0000","last_clean":"2024-09-12T18:35:25.655649+0000","last_became_active":"2024-09-12T18:35:25.650617+0000","last_became_peered":"2024-09-12T18:35:25.650617+0000","last_unstale":"2024-09-12T18:35:25.655649+0000","last_undegraded":"2024-09-12T18:35:25.655649+0000","last_fullsized":"2024-09-12T18:35:25.655649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:59.531762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.629899+0000","last_change":"2024-09-12T18:35:24.659019+0000","last_active":"2024-09-12T18:35:25.629899+0000","last_peered":"2024-09-12T18:35:25.629899+0000","last_clean":"2024-09-12T18:35:25.629899+0000","last_became_active":"2024-09-12T18:35:24.658423+0000","last_became_peered":"2024-09-12T18:35:24.658423+0000","last_unstale":"2024-09-12T18:35:25.629899+0000","last_undegraded":"2024-09-12T18:35:25.629899+0000","last_fullsized":"2024-09-12T18:35:25.629899+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:37.668417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671592+0000","last_change":"2024-09-12T18:35:25.662287+0000","last_active":"2024-09-12T18:35:25.671592+0000","last_peered":"2024-09-12T18:35:25.671592+0000","last_clean":"2024-09-12T18:35:25.671592+0000","last_became_active":"2024-09-12T18:35:25.660372+0000","last_became_peered":"2024-09-12T18:35:25.660372+0000","last_unstale":"2024-09-12T18:35:25.671592+0000","last_undegraded":"2024-09-12T18:35:25.671592+0000","last_fullsized":"2024-09-12T18:35:25.671592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:14.114092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:23.596638+0000","last_change":"2024-09-12T18:35:23.596638+0000","last_active":"2024-09-12T18:35:23.596638+0000","last_peered":"2024-09-12T18:35:23.596638+0000","last_clean":"2024-09-12T18:35:23.596638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:23.596638+0000","last_undegraded":"2024-09-12T18:35:23.596638+0000","last_fullsized":"2024-09-12T18:35:23.596638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.670729+0000","last_change":"2024-09-12T18:35:25.658674+0000","last_active":"2024-09-12T18:35:25.670729+0000","last_peered":"2024-09-12T18:35:25.670729+0000","last_clean":"2024-09-12T18:35:25.670729+0000","last_became_active":"2024-09-12T18:35:25.657386+0000","last_became_peered":"2024-09-12T18:35:25.657386+0000","last_unstale":"2024-09-12T18:35:25.670729+0000","last_undegraded":"2024-09-12T18:35:25.670729+0000","last_fullsized":"2024-09-12T18:35:25.670729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:40.531922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:23.596638+0000","last_change":"2024-09-12T18:35:23.596638+0000","last_active":"2024-09-12T18:35:23.596638+0000","last_peered":"2024-09-12T18:35:23.596638+0000","last_clean":"2024-09-12T18:35:23.596638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:23.596638+0000","last_undegraded":"2024-09-12T18:35:23.596638+0000","last_fullsized":"2024-09-12T18:35:23.596638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.670432+0000","last_change":"2024-09-12T18:35:25.667710+0000","last_active":"2024-09-12T18:35:25.670432+0000","last_peered":"2024-09-12T18:35:25.670432+0000","last_clean":"2024-09-12T18:35:25.670432+0000","last_became_active":"2024-09-12T18:35:25.666940+0000","last_became_peered":"2024-09-12T18:35:25.666940+0000","last_unstale":"2024-09-12T18:35:25.670432+0000","last_undegraded":"2024-09-12T18:35:25.670432+0000","last_fullsized":"2024-09-12T18:35:25.670432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:16.315533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":163,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.635860+0000","last_change":"2024-09-12T18:35:13.489018+0000","last_active":"2024-09-12T18:35:25.635860+0000","last_peered":"2024-09-12T18:35:25.635860+0000","last_clean":"2024-09-12T18:35:25.635860+0000","last_became_active":"2024-09-12T18:35:13.488346+0000","last_became_peered":"2024-09-12T18:35:13.488346+0000","last_unstale":"2024-09-12T18:35:25.635860+0000","last_undegraded":"2024-09-12T18:35:25.635860+0000","last_fullsized":"2024-09-12T18:35:25.635860+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_clean_scrub_stamp":"2024-09-12T18:35:12.464628+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:54.864640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":27,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.635387+0000","last_change":"2024-09-12T18:35:22.459694+0000","last_active":"2024-09-12T18:35:25.635387+0000","last_peered":"2024-09-12T18:35:25.635387+0000","last_clean":"2024-09-12T18:35:25.635387+0000","last_became_active":"2024-09-12T18:35:20.446796+0000","last_became_peered":"2024-09-12T18:35:20.446796+0000","last_unstale":"2024-09-12T18:35:25.635387+0000","last_undegraded":"2024-09-12T18:35:25.635387+0000","last_fullsized":"2024-09-12T18:35:25.635387+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:21.506024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016291610000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.645967+0000","last_change":"2024-09-12T18:35:24.651749+0000","last_active":"2024-09-12T18:35:25.645967+0000","last_peered":"2024-09-12T18:35:25.645967+0000","last_clean":"2024-09-12T18:35:25.645967+0000","last_became_active":"2024-09-12T18:35:24.649860+0000","last_became_peered":"2024-09-12T18:35:24.649860+0000","last_unstale":"2024-09-12T18:35:25.645967+0000","last_undegraded":"2024-09-12T18:35:25.645967+0000","last_fullsized":"2024-09-12T18:35:25.645967+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:35.430065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671637+0000","last_change":"2024-09-12T18:35:25.662424+0000","last_active":"2024-09-12T18:35:25.671637+0000","last_peered":"2024-09-12T18:35:25.671637+0000","last_clean":"2024-09-12T18:35:25.671637+0000","last_became_active":"2024-09-12T18:35:25.661043+0000","last_became_peered":"2024-09-12T18:35:25.661043+0000","last_unstale":"2024-09-12T18:35:25.671637+0000","last_undegraded":"2024-09-12T18:35:25.671637+0000","last_fullsized":"2024-09-12T18:35:25.671637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:05.846676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.632239+0000","last_change":"2024-09-12T18:35:22.459090+0000","last_active":"2024-09-12T18:35:25.632239+0000","last_peered":"2024-09-12T18:35:25.632239+0000","last_clean":"2024-09-12T18:35:25.632239+0000","last_became_active":"2024-09-12T18:35:20.448553+0000","last_became_peered":"2024-09-12T18:35:20.448553+0000","last_unstale":"2024-09-12T18:35:25.632239+0000","last_undegraded":"2024-09-12T18:35:25.632239+0000","last_fullsized":"2024-09-12T18:35:25.632239+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:56.834808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001030836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.645664+0000","last_change":"2024-09-12T18:35:24.651597+0000","last_active":"2024-09-12T18:35:25.645664+0000","last_peered":"2024-09-12T18:35:25.645664+0000","last_clean":"2024-09-12T18:35:25.645664+0000","last_became_active":"2024-09-12T18:35:24.649940+0000","last_became_peered":"2024-09-12T18:35:24.649940+0000","last_unstale":"2024-09-12T18:35:25.645664+0000","last_undegraded":"2024-09-12T18:35:25.645664+0000","last_fullsized":"2024-09-12T18:35:25.645664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:36.822432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.645308+0000","last_change":"2024-09-12T18:35:22.464179+0000","last_active":"2024-09-12T18:35:25.645308+0000","last_peered":"2024-09-12T18:35:25.645308+0000","last_clean":"2024-09-12T18:35:25.645308+0000","last_became_active":"2024-09-12T18:35:20.442613+0000","last_became_peered":"2024-09-12T18:35:20.442613+0000","last_unstale":"2024-09-12T18:35:25.645308+0000","last_undegraded":"2024-09-12T18:35:25.645308+0000","last_fullsized":"2024-09-12T18:35:25.645308+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:17.636537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014134620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:23.596638+0000","last_change":"2024-09-12T18:35:23.596638+0000","last_active":"2024-09-12T18:35:23.596638+0000","last_peered":"2024-09-12T18:35:23.596638+0000","last_clean":"2024-09-12T18:35:23.596638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:23.596638+0000","last_undegraded":"2024-09-12T18:35:23.596638+0000","last_fullsized":"2024-09-12T18:35:23.596638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.666913+0000","last_change":"2024-09-12T18:35:25.659209+0000","last_active":"2024-09-12T18:35:25.666913+0000","last_peered":"2024-09-12T18:35:25.666913+0000","last_clean":"2024-09-12T18:35:25.666913+0000","last_became_active":"2024-09-12T18:35:25.656170+0000","last_became_peered":"2024-09-12T18:35:25.656170+0000","last_unstale":"2024-09-12T18:35:25.666913+0000","last_undegraded":"2024-09-12T18:35:25.666913+0000","last_fullsized":"2024-09-12T18:35:25.666913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:40.344068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":28,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.629469+0000","last_change":"2024-09-12T18:35:22.459049+0000","last_active":"2024-09-12T18:35:25.629469+0000","last_peered":"2024-09-12T18:35:25.629469+0000","last_clean":"2024-09-12T18:35:25.629469+0000","last_became_active":"2024-09-12T18:35:20.446814+0000","last_became_peered":"2024-09-12T18:35:20.446814+0000","last_unstale":"2024-09-12T18:35:25.629469+0000","last_undegraded":"2024-09-12T18:35:25.629469+0000","last_fullsized":"2024-09-12T18:35:25.629469+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:18.033595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010716149999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.635381+0000","last_change":"2024-09-12T18:35:24.658273+0000","last_active":"2024-09-12T18:35:25.635381+0000","last_peered":"2024-09-12T18:35:25.635381+0000","last_clean":"2024-09-12T18:35:25.635381+0000","last_became_active":"2024-09-12T18:35:24.657433+0000","last_became_peered":"2024-09-12T18:35:24.657433+0000","last_unstale":"2024-09-12T18:35:25.635381+0000","last_undegraded":"2024-09-12T18:35:25.635381+0000","last_fullsized":"2024-09-12T18:35:25.635381+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:48.497218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.663537+0000","last_change":"2024-09-12T18:35:25.655830+0000","last_active":"2024-09-12T18:35:25.663537+0000","last_peered":"2024-09-12T18:35:25.663537+0000","last_clean":"2024-09-12T18:35:25.663537+0000","last_became_active":"2024-09-12T18:35:25.652126+0000","last_became_peered":"2024-09-12T18:35:25.652126+0000","last_unstale":"2024-09-12T18:35:25.663537+0000","last_undegraded":"2024-09-12T18:35:25.663537+0000","last_fullsized":"2024-09-12T18:35:25.663537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:33.679281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.635489+0000","last_change":"2024-09-12T18:35:24.657618+0000","last_active":"2024-09-12T18:35:25.635489+0000","last_peered":"2024-09-12T18:35:25.635489+0000","last_clean":"2024-09-12T18:35:25.635489+0000","last_became_active":"2024-09-12T18:35:24.656741+0000","last_became_peered":"2024-09-12T18:35:24.656741+0000","last_unstale":"2024-09-12T18:35:25.635489+0000","last_undegraded":"2024-09-12T18:35:25.635489+0000","last_fullsized":"2024-09-12T18:35:25.635489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:43.113104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.647145+0000","last_change":"2024-09-12T18:35:22.464180+0000","last_active":"2024-09-12T18:35:25.647145+0000","last_peered":"2024-09-12T18:35:25.647145+0000","last_clean":"2024-09-12T18:35:25.647145+0000","last_became_active":"2024-09-12T18:35:20.442566+0000","last_became_peered":"2024-09-12T18:35:20.442566+0000","last_unstale":"2024-09-12T18:35:25.647145+0000","last_undegraded":"2024-09-12T18:35:25.647145+0000","last_fullsized":"2024-09-12T18:35:25.647145+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:29.021710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001325786,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.647793+0000","last_change":"2024-09-12T18:35:24.649669+0000","last_active":"2024-09-12T18:35:25.647793+0000","last_peered":"2024-09-12T18:35:25.647793+0000","last_clean":"2024-09-12T18:35:25.647793+0000","last_became_active":"2024-09-12T18:35:24.648881+0000","last_became_peered":"2024-09-12T18:35:24.648881+0000","last_unstale":"2024-09-12T18:35:25.647793+0000","last_undegraded":"2024-09-12T18:35:25.647793+0000","last_fullsized":"2024-09-12T18:35:25.647793+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:23.614734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-12T18:35:22.458666+0000","last_change":"2024-09-12T18:35:22.458666+0000","last_active":"2024-09-12T18:35:22.458666+0000","last_peered":"2024-09-12T18:35:22.458666+0000","last_clean":"2024-09-12T18:35:22.458666+0000","last_became_active":"2024-09-12T18:35:20.442394+0000","last_became_peered":"2024-09-12T18:35:20.442394+0000","last_unstale":"2024-09-12T18:35:22.458666+0000","last_undegraded":"2024-09-12T18:35:22.458666+0000","last_fullsized":"2024-09-12T18:35:22.458666+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:51.840246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080163599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.674332+0000","last_change":"2024-09-12T18:35:24.657234+0000","last_active":"2024-09-12T18:35:25.674332+0000","last_peered":"2024-09-12T18:35:25.674332+0000","last_clean":"2024-09-12T18:35:25.674332+0000","last_became_active":"2024-09-12T18:35:24.655950+0000","last_became_peered":"2024-09-12T18:35:24.655950+0000","last_unstale":"2024-09-12T18:35:25.674332+0000","last_undegraded":"2024-09-12T18:35:25.674332+0000","last_fullsized":"2024-09-12T18:35:25.674332+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:17.466623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.647896+0000","last_change":"2024-09-12T18:35:22.464656+0000","last_active":"2024-09-12T18:35:25.647896+0000","last_peered":"2024-09-12T18:35:25.647896+0000","last_clean":"2024-09-12T18:35:25.647896+0000","last_became_active":"2024-09-12T18:35:20.445470+0000","last_became_peered":"2024-09-12T18:35:20.445470+0000","last_unstale":"2024-09-12T18:35:25.647896+0000","last_undegraded":"2024-09-12T18:35:25.647896+0000","last_fullsized":"2024-09-12T18:35:25.647896+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:58.947359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001742681,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.665411+0000","last_change":"2024-09-12T18:35:25.658887+0000","last_active":"2024-09-12T18:35:25.665411+0000","last_peered":"2024-09-12T18:35:25.665411+0000","last_clean":"2024-09-12T18:35:25.665411+0000","last_became_active":"2024-09-12T18:35:25.656829+0000","last_became_peered":"2024-09-12T18:35:25.656829+0000","last_unstale":"2024-09-12T18:35:25.665411+0000","last_undegraded":"2024-09-12T18:35:25.665411+0000","last_fullsized":"2024-09-12T18:35:25.665411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:16.495586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.647739+0000","last_change":"2024-09-12T18:35:24.654518+0000","last_active":"2024-09-12T18:35:25.647739+0000","last_peered":"2024-09-12T18:35:25.647739+0000","last_clean":"2024-09-12T18:35:25.647739+0000","last_became_active":"2024-09-12T18:35:24.650309+0000","last_became_peered":"2024-09-12T18:35:24.650309+0000","last_unstale":"2024-09-12T18:35:25.647739+0000","last_undegraded":"2024-09-12T18:35:25.647739+0000","last_fullsized":"2024-09-12T18:35:25.647739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:16.669035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.629046+0000","last_change":"2024-09-12T18:35:22.459767+0000","last_active":"2024-09-12T18:35:25.629046+0000","last_peered":"2024-09-12T18:35:25.629046+0000","last_clean":"2024-09-12T18:35:25.629046+0000","last_became_active":"2024-09-12T18:35:20.448521+0000","last_became_peered":"2024-09-12T18:35:20.448521+0000","last_unstale":"2024-09-12T18:35:25.629046+0000","last_undegraded":"2024-09-12T18:35:25.629046+0000","last_fullsized":"2024-09-12T18:35:25.629046+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:33.463792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017009670000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671289+0000","last_change":"2024-09-12T18:35:25.660696+0000","last_active":"2024-09-12T18:35:25.671289+0000","last_peered":"2024-09-12T18:35:25.671289+0000","last_clean":"2024-09-12T18:35:25.671289+0000","last_became_active":"2024-09-12T18:35:25.659827+0000","last_became_peered":"2024-09-12T18:35:25.659827+0000","last_unstale":"2024-09-12T18:35:25.671289+0000","last_undegraded":"2024-09-12T18:35:25.671289+0000","last_fullsized":"2024-09-12T18:35:25.671289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:32.995388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.675858+0000","last_change":"2024-09-12T18:35:24.655051+0000","last_active":"2024-09-12T18:35:25.675858+0000","last_peered":"2024-09-12T18:35:25.675858+0000","last_clean":"2024-09-12T18:35:25.675858+0000","last_became_active":"2024-09-12T18:35:24.654282+0000","last_became_peered":"2024-09-12T18:35:24.654282+0000","last_unstale":"2024-09-12T18:35:25.675858+0000","last_undegraded":"2024-09-12T18:35:25.675858+0000","last_fullsized":"2024-09-12T18:35:25.675858+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:08.159799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.665292+0000","last_change":"2024-09-12T18:35:25.659237+0000","last_active":"2024-09-12T18:35:25.665292+0000","last_peered":"2024-09-12T18:35:25.665292+0000","last_clean":"2024-09-12T18:35:25.665292+0000","last_became_active":"2024-09-12T18:35:25.658423+0000","last_became_peered":"2024-09-12T18:35:25.658423+0000","last_unstale":"2024-09-12T18:35:25.665292+0000","last_undegraded":"2024-09-12T18:35:25.665292+0000","last_fullsized":"2024-09-12T18:35:25.665292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:53.450092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:23.596638+0000","last_change":"2024-09-12T18:35:23.596638+0000","last_active":"2024-09-12T18:35:23.596638+0000","last_peered":"2024-09-12T18:35:23.596638+0000","last_clean":"2024-09-12T18:35:23.596638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:23.596638+0000","last_undegraded":"2024-09-12T18:35:23.596638+0000","last_fullsized":"2024-09-12T18:35:23.596638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.628799+0000","last_change":"2024-09-12T18:35:24.656855+0000","last_active":"2024-09-12T18:35:25.628799+0000","last_peered":"2024-09-12T18:35:25.628799+0000","last_clean":"2024-09-12T18:35:25.628799+0000","last_became_active":"2024-09-12T18:35:24.655935+0000","last_became_peered":"2024-09-12T18:35:24.655935+0000","last_unstale":"2024-09-12T18:35:25.628799+0000","last_undegraded":"2024-09-12T18:35:25.628799+0000","last_fullsized":"2024-09-12T18:35:25.628799+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:35.430065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.667632+0000","last_change":"2024-09-12T18:35:25.661801+0000","last_active":"2024-09-12T18:35:25.667632+0000","last_peered":"2024-09-12T18:35:25.667632+0000","last_clean":"2024-09-12T18:35:25.667632+0000","last_became_active":"2024-09-12T18:35:25.658476+0000","last_became_peered":"2024-09-12T18:35:25.658476+0000","last_unstale":"2024-09-12T18:35:25.667632+0000","last_undegraded":"2024-09-12T18:35:25.667632+0000","last_fullsized":"2024-09-12T18:35:25.667632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:22.078004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.650423+0000","last_change":"2024-09-12T18:35:24.652399+0000","last_active":"2024-09-12T18:35:25.650423+0000","last_peered":"2024-09-12T18:35:25.650423+0000","last_clean":"2024-09-12T18:35:25.650423+0000","last_became_active":"2024-09-12T18:35:24.651416+0000","last_became_peered":"2024-09-12T18:35:24.651416+0000","last_unstale":"2024-09-12T18:35:25.650423+0000","last_undegraded":"2024-09-12T18:35:25.650423+0000","last_fullsized":"2024-09-12T18:35:25.650423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:32.594978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.665313+0000","last_change":"2024-09-12T18:35:25.658570+0000","last_active":"2024-09-12T18:35:25.665313+0000","last_peered":"2024-09-12T18:35:25.665313+0000","last_clean":"2024-09-12T18:35:25.665313+0000","last_became_active":"2024-09-12T18:35:25.656561+0000","last_became_peered":"2024-09-12T18:35:25.656561+0000","last_unstale":"2024-09-12T18:35:25.665313+0000","last_undegraded":"2024-09-12T18:35:25.665313+0000","last_fullsized":"2024-09-12T18:35:25.665313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:46.305988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.644984+0000","last_change":"2024-09-12T18:35:24.657489+0000","last_active":"2024-09-12T18:35:25.644984+0000","last_peered":"2024-09-12T18:35:25.644984+0000","last_clean":"2024-09-12T18:35:25.644984+0000","last_became_active":"2024-09-12T18:35:24.656030+0000","last_became_peered":"2024-09-12T18:35:24.656030+0000","last_unstale":"2024-09-12T18:35:25.644984+0000","last_undegraded":"2024-09-12T18:35:25.644984+0000","last_fullsized":"2024-09-12T18:35:25.644984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:11.362759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671748+0000","last_change":"2024-09-12T18:35:25.661544+0000","last_active":"2024-09-12T18:35:25.671748+0000","last_peered":"2024-09-12T18:35:25.671748+0000","last_clean":"2024-09-12T18:35:25.671748+0000","last_became_active":"2024-09-12T18:35:25.656985+0000","last_became_peered":"2024-09-12T18:35:25.656985+0000","last_unstale":"2024-09-12T18:35:25.671748+0000","last_undegraded":"2024-09-12T18:35:25.671748+0000","last_fullsized":"2024-09-12T18:35:25.671748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:31.078781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.645078+0000","last_change":"2024-09-12T18:35:24.646342+0000","last_active":"2024-09-12T18:35:25.645078+0000","last_peered":"2024-09-12T18:35:25.645078+0000","last_clean":"2024-09-12T18:35:25.645078+0000","last_became_active":"2024-09-12T18:35:24.644773+0000","last_became_peered":"2024-09-12T18:35:24.644773+0000","last_unstale":"2024-09-12T18:35:25.645078+0000","last_undegraded":"2024-09-12T18:35:25.645078+0000","last_fullsized":"2024-09-12T18:35:25.645078+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:17.011231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:23.596638+0000","last_change":"2024-09-12T18:35:23.596638+0000","last_active":"2024-09-12T18:35:23.596638+0000","last_peered":"2024-09-12T18:35:23.596638+0000","last_clean":"2024-09-12T18:35:23.596638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:23.596638+0000","last_undegraded":"2024-09-12T18:35:23.596638+0000","last_fullsized":"2024-09-12T18:35:23.596638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:23.596638+0000","last_change":"2024-09-12T18:35:23.596638+0000","last_active":"2024-09-12T18:35:23.596638+0000","last_peered":"2024-09-12T18:35:23.596638+0000","last_clean":"2024-09-12T18:35:23.596638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:23.596638+0000","last_undegraded":"2024-09-12T18:35:23.596638+0000","last_fullsized":"2024-09-12T18:35:23.596638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671662+0000","last_change":"2024-09-12T18:35:25.662537+0000","last_active":"2024-09-12T18:35:25.671662+0000","last_peered":"2024-09-12T18:35:25.671662+0000","last_clean":"2024-09-12T18:35:25.671662+0000","last_became_active":"2024-09-12T18:35:25.661441+0000","last_became_peered":"2024-09-12T18:35:25.661441+0000","last_unstale":"2024-09-12T18:35:25.671662+0000","last_undegraded":"2024-09-12T18:35:25.671662+0000","last_fullsized":"2024-09-12T18:35:25.671662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:34.445331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.667700+0000","last_change":"2024-09-12T18:35:24.657635+0000","last_active":"2024-09-12T18:35:25.667700+0000","last_peered":"2024-09-12T18:35:25.667700+0000","last_clean":"2024-09-12T18:35:25.667700+0000","last_became_active":"2024-09-12T18:35:24.655992+0000","last_became_peered":"2024-09-12T18:35:24.655992+0000","last_unstale":"2024-09-12T18:35:25.667700+0000","last_undegraded":"2024-09-12T18:35:25.667700+0000","last_fullsized":"2024-09-12T18:35:25.667700+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:33.536755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.655697+0000","last_change":"2024-09-12T18:35:25.651406+0000","last_active":"2024-09-12T18:35:25.655697+0000","last_peered":"2024-09-12T18:35:25.655697+0000","last_clean":"2024-09-12T18:35:25.655697+0000","last_became_active":"2024-09-12T18:35:25.649728+0000","last_became_peered":"2024-09-12T18:35:25.649728+0000","last_unstale":"2024-09-12T18:35:25.655697+0000","last_undegraded":"2024-09-12T18:35:25.655697+0000","last_fullsized":"2024-09-12T18:35:25.655697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:53.450092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:23.596638+0000","last_change":"2024-09-12T18:35:23.596638+0000","last_active":"2024-09-12T18:35:23.596638+0000","last_peered":"2024-09-12T18:35:23.596638+0000","last_clean":"2024-09-12T18:35:23.596638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:23.596638+0000","last_undegraded":"2024-09-12T18:35:23.596638+0000","last_fullsized":"2024-09-12T18:35:23.596638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.666379+0000","last_change":"2024-09-12T18:35:24.656268+0000","last_active":"2024-09-12T18:35:25.666379+0000","last_peered":"2024-09-12T18:35:25.666379+0000","last_clean":"2024-09-12T18:35:25.666379+0000","last_became_active":"2024-09-12T18:35:24.655420+0000","last_became_peered":"2024-09-12T18:35:24.655420+0000","last_unstale":"2024-09-12T18:35:25.666379+0000","last_undegraded":"2024-09-12T18:35:25.666379+0000","last_fullsized":"2024-09-12T18:35:25.666379+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:04.654666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671307+0000","last_change":"2024-09-12T18:35:25.661042+0000","last_active":"2024-09-12T18:35:25.671307+0000","last_peered":"2024-09-12T18:35:25.671307+0000","last_clean":"2024-09-12T18:35:25.671307+0000","last_became_active":"2024-09-12T18:35:25.660163+0000","last_became_peered":"2024-09-12T18:35:25.660163+0000","last_unstale":"2024-09-12T18:35:25.671307+0000","last_undegraded":"2024-09-12T18:35:25.671307+0000","last_fullsized":"2024-09-12T18:35:25.671307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:25.387564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.675465+0000","last_change":"2024-09-12T18:35:24.652304+0000","last_active":"2024-09-12T18:35:25.675465+0000","last_peered":"2024-09-12T18:35:25.675465+0000","last_clean":"2024-09-12T18:35:25.675465+0000","last_became_active":"2024-09-12T18:35:24.651460+0000","last_became_peered":"2024-09-12T18:35:24.651460+0000","last_unstale":"2024-09-12T18:35:25.675465+0000","last_undegraded":"2024-09-12T18:35:25.675465+0000","last_fullsized":"2024-09-12T18:35:25.675465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:42.050557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":80,"acting":80,"num_store_stats":2},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2320,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":46,"acting":46,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":196608,"data_stored":631260,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":258048,"data_stored":647469,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":167936,"data_stored":55307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:35:28.630 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:35:28.973 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:35:28.975 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T18:35:28.992 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-12T18:35:28.376312+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592707,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":181,"num_write_kb":2687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":144,"acting":144,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":72,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":85872,"kb_used_data":608,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283029648,"statfs":{"total":289910292480,"available":289822359552,"internally_reserved":0,"allocated":622592,"data_stored":1334036,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4783,"internal_metadata":87223633},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2331,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.765854"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.670958+0000","last_change":"2024-09-12T18:35:25.659460+0000","last_active":"2024-09-12T18:35:25.670958+0000","last_peered":"2024-09-12T18:35:25.670958+0000","last_clean":"2024-09-12T18:35:25.670958+0000","last_became_active":"2024-09-12T18:35:25.657782+0000","last_became_peered":"2024-09-12T18:35:25.657782+0000","last_unstale":"2024-09-12T18:35:25.670958+0000","last_undegraded":"2024-09-12T18:35:25.670958+0000","last_fullsized":"2024-09-12T18:35:25.670958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:56.799067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671805+0000","last_change":"2024-09-12T18:35:25.663617+0000","last_active":"2024-09-12T18:35:25.671805+0000","last_peered":"2024-09-12T18:35:25.671805+0000","last_clean":"2024-09-12T18:35:25.671805+0000","last_became_active":"2024-09-12T18:35:25.661977+0000","last_became_peered":"2024-09-12T18:35:25.661977+0000","last_unstale":"2024-09-12T18:35:25.671805+0000","last_undegraded":"2024-09-12T18:35:25.671805+0000","last_fullsized":"2024-09-12T18:35:25.671805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:02.792152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.655766+0000","last_change":"2024-09-12T18:35:25.652754+0000","last_active":"2024-09-12T18:35:25.655766+0000","last_peered":"2024-09-12T18:35:25.655766+0000","last_clean":"2024-09-12T18:35:25.655766+0000","last_became_active":"2024-09-12T18:35:25.651217+0000","last_became_peered":"2024-09-12T18:35:25.651217+0000","last_unstale":"2024-09-12T18:35:25.655766+0000","last_undegraded":"2024-09-12T18:35:25.655766+0000","last_fullsized":"2024-09-12T18:35:25.655766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:17.007002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671054+0000","last_change":"2024-09-12T18:35:25.659811+0000","last_active":"2024-09-12T18:35:25.671054+0000","last_peered":"2024-09-12T18:35:25.671054+0000","last_clean":"2024-09-12T18:35:25.671054+0000","last_became_active":"2024-09-12T18:35:25.658998+0000","last_became_peered":"2024-09-12T18:35:25.658998+0000","last_unstale":"2024-09-12T18:35:25.671054+0000","last_undegraded":"2024-09-12T18:35:25.671054+0000","last_fullsized":"2024-09-12T18:35:25.671054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:12.891661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.655902+0000","last_change":"2024-09-12T18:35:25.653999+0000","last_active":"2024-09-12T18:35:25.655902+0000","last_peered":"2024-09-12T18:35:25.655902+0000","last_clean":"2024-09-12T18:35:25.655902+0000","last_became_active":"2024-09-12T18:35:25.653319+0000","last_became_peered":"2024-09-12T18:35:25.653319+0000","last_unstale":"2024-09-12T18:35:25.655902+0000","last_undegraded":"2024-09-12T18:35:25.655902+0000","last_fullsized":"2024-09-12T18:35:25.655902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:31.096877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.670527+0000","last_change":"2024-09-12T18:35:25.668339+0000","last_active":"2024-09-12T18:35:25.670527+0000","last_peered":"2024-09-12T18:35:25.670527+0000","last_clean":"2024-09-12T18:35:25.670527+0000","last_became_active":"2024-09-12T18:35:25.667608+0000","last_became_peered":"2024-09-12T18:35:25.667608+0000","last_unstale":"2024-09-12T18:35:25.670527+0000","last_undegraded":"2024-09-12T18:35:25.670527+0000","last_fullsized":"2024-09-12T18:35:25.670527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:52.466349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.655517+0000","last_change":"2024-09-12T18:35:25.649858+0000","last_active":"2024-09-12T18:35:25.655517+0000","last_peered":"2024-09-12T18:35:25.655517+0000","last_clean":"2024-09-12T18:35:25.655517+0000","last_became_active":"2024-09-12T18:35:25.649090+0000","last_became_peered":"2024-09-12T18:35:25.649090+0000","last_unstale":"2024-09-12T18:35:25.655517+0000","last_undegraded":"2024-09-12T18:35:25.655517+0000","last_fullsized":"2024-09-12T18:35:25.655517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:42.675921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.666461+0000","last_change":"2024-09-12T18:35:25.657913+0000","last_active":"2024-09-12T18:35:25.666461+0000","last_peered":"2024-09-12T18:35:25.666461+0000","last_clean":"2024-09-12T18:35:25.666461+0000","last_became_active":"2024-09-12T18:35:25.657082+0000","last_became_peered":"2024-09-12T18:35:25.657082+0000","last_unstale":"2024-09-12T18:35:25.666461+0000","last_undegraded":"2024-09-12T18:35:25.666461+0000","last_fullsized":"2024-09-12T18:35:25.666461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:36.452006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.670741+0000","last_change":"2024-09-12T18:35:25.658763+0000","last_active":"2024-09-12T18:35:25.670741+0000","last_peered":"2024-09-12T18:35:25.670741+0000","last_clean":"2024-09-12T18:35:25.670741+0000","last_became_active":"2024-09-12T18:35:25.657508+0000","last_became_peered":"2024-09-12T18:35:25.657508+0000","last_unstale":"2024-09-12T18:35:25.670741+0000","last_undegraded":"2024-09-12T18:35:25.670741+0000","last_fullsized":"2024-09-12T18:35:25.670741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:14.134808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.655848+0000","last_change":"2024-09-12T18:35:25.653730+0000","last_active":"2024-09-12T18:35:25.655848+0000","last_peered":"2024-09-12T18:35:25.655848+0000","last_clean":"2024-09-12T18:35:25.655848+0000","last_became_active":"2024-09-12T18:35:25.651535+0000","last_became_peered":"2024-09-12T18:35:25.651535+0000","last_unstale":"2024-09-12T18:35:25.655848+0000","last_undegraded":"2024-09-12T18:35:25.655848+0000","last_fullsized":"2024-09-12T18:35:25.655848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:37.514843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.666868+0000","last_change":"2024-09-12T18:35:25.656513+0000","last_active":"2024-09-12T18:35:25.666868+0000","last_peered":"2024-09-12T18:35:25.666868+0000","last_clean":"2024-09-12T18:35:25.666868+0000","last_became_active":"2024-09-12T18:35:25.653440+0000","last_became_peered":"2024-09-12T18:35:25.653440+0000","last_unstale":"2024-09-12T18:35:25.666868+0000","last_undegraded":"2024-09-12T18:35:25.666868+0000","last_fullsized":"2024-09-12T18:35:25.666868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:26.721698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.665394+0000","last_change":"2024-09-12T18:35:25.658819+0000","last_active":"2024-09-12T18:35:25.665394+0000","last_peered":"2024-09-12T18:35:25.665394+0000","last_clean":"2024-09-12T18:35:25.665394+0000","last_became_active":"2024-09-12T18:35:25.656843+0000","last_became_peered":"2024-09-12T18:35:25.656843+0000","last_unstale":"2024-09-12T18:35:25.665394+0000","last_undegraded":"2024-09-12T18:35:25.665394+0000","last_fullsized":"2024-09-12T18:35:25.665394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:27:44.442447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671733+0000","last_change":"2024-09-12T18:35:25.661176+0000","last_active":"2024-09-12T18:35:25.671733+0000","last_peered":"2024-09-12T18:35:25.671733+0000","last_clean":"2024-09-12T18:35:25.671733+0000","last_became_active":"2024-09-12T18:35:25.659534+0000","last_became_peered":"2024-09-12T18:35:25.659534+0000","last_unstale":"2024-09-12T18:35:25.671733+0000","last_undegraded":"2024-09-12T18:35:25.671733+0000","last_fullsized":"2024-09-12T18:35:25.671733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:54.580837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.655660+0000","last_change":"2024-09-12T18:35:25.650632+0000","last_active":"2024-09-12T18:35:25.655660+0000","last_peered":"2024-09-12T18:35:25.655660+0000","last_clean":"2024-09-12T18:35:25.655660+0000","last_became_active":"2024-09-12T18:35:25.649333+0000","last_became_peered":"2024-09-12T18:35:25.649333+0000","last_unstale":"2024-09-12T18:35:25.655660+0000","last_undegraded":"2024-09-12T18:35:25.655660+0000","last_fullsized":"2024-09-12T18:35:25.655660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:20.136271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.667558+0000","last_change":"2024-09-12T18:35:25.661613+0000","last_active":"2024-09-12T18:35:25.667558+0000","last_peered":"2024-09-12T18:35:25.667558+0000","last_clean":"2024-09-12T18:35:25.667558+0000","last_became_active":"2024-09-12T18:35:25.658833+0000","last_became_peered":"2024-09-12T18:35:25.658833+0000","last_unstale":"2024-09-12T18:35:25.667558+0000","last_undegraded":"2024-09-12T18:35:25.667558+0000","last_fullsized":"2024-09-12T18:35:25.667558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:37.514843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671782+0000","last_change":"2024-09-12T18:35:25.662414+0000","last_active":"2024-09-12T18:35:25.671782+0000","last_peered":"2024-09-12T18:35:25.671782+0000","last_clean":"2024-09-12T18:35:25.671782+0000","last_became_active":"2024-09-12T18:35:25.660126+0000","last_became_peered":"2024-09-12T18:35:25.660126+0000","last_unstale":"2024-09-12T18:35:25.671782+0000","last_undegraded":"2024-09-12T18:35:25.671782+0000","last_fullsized":"2024-09-12T18:35:25.671782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:05.136469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671510+0000","last_change":"2024-09-12T18:35:25.661523+0000","last_active":"2024-09-12T18:35:25.671510+0000","last_peered":"2024-09-12T18:35:25.671510+0000","last_clean":"2024-09-12T18:35:25.671510+0000","last_became_active":"2024-09-12T18:35:25.659338+0000","last_became_peered":"2024-09-12T18:35:25.659338+0000","last_unstale":"2024-09-12T18:35:25.671510+0000","last_undegraded":"2024-09-12T18:35:25.671510+0000","last_fullsized":"2024-09-12T18:35:25.671510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:12.762819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.667865+0000","last_change":"2024-09-12T18:35:25.662519+0000","last_active":"2024-09-12T18:35:25.667865+0000","last_peered":"2024-09-12T18:35:25.667865+0000","last_clean":"2024-09-12T18:35:25.667865+0000","last_became_active":"2024-09-12T18:35:25.652964+0000","last_became_peered":"2024-09-12T18:35:25.652964+0000","last_unstale":"2024-09-12T18:35:25.667865+0000","last_undegraded":"2024-09-12T18:35:25.667865+0000","last_fullsized":"2024-09-12T18:35:25.667865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:02.929063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.662850+0000","last_change":"2024-09-12T18:35:25.653949+0000","last_active":"2024-09-12T18:35:25.662850+0000","last_peered":"2024-09-12T18:35:25.662850+0000","last_clean":"2024-09-12T18:35:25.662850+0000","last_became_active":"2024-09-12T18:35:25.652992+0000","last_became_peered":"2024-09-12T18:35:25.652992+0000","last_unstale":"2024-09-12T18:35:25.662850+0000","last_undegraded":"2024-09-12T18:35:25.662850+0000","last_fullsized":"2024-09-12T18:35:25.662850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:20.448219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.655784+0000","last_change":"2024-09-12T18:35:25.653159+0000","last_active":"2024-09-12T18:35:25.655784+0000","last_peered":"2024-09-12T18:35:25.655784+0000","last_clean":"2024-09-12T18:35:25.655784+0000","last_became_active":"2024-09-12T18:35:25.650551+0000","last_became_peered":"2024-09-12T18:35:25.650551+0000","last_unstale":"2024-09-12T18:35:25.655784+0000","last_undegraded":"2024-09-12T18:35:25.655784+0000","last_fullsized":"2024-09-12T18:35:25.655784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:45.453862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.667164+0000","last_change":"2024-09-12T18:35:24.657739+0000","last_active":"2024-09-12T18:35:25.667164+0000","last_peered":"2024-09-12T18:35:25.667164+0000","last_clean":"2024-09-12T18:35:25.667164+0000","last_became_active":"2024-09-12T18:35:24.656208+0000","last_became_peered":"2024-09-12T18:35:24.656208+0000","last_unstale":"2024-09-12T18:35:25.667164+0000","last_undegraded":"2024-09-12T18:35:25.667164+0000","last_fullsized":"2024-09-12T18:35:25.667164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:50.073716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.645957+0000","last_change":"2024-09-12T18:35:24.656119+0000","last_active":"2024-09-12T18:35:25.645957+0000","last_peered":"2024-09-12T18:35:25.645957+0000","last_clean":"2024-09-12T18:35:25.645957+0000","last_became_active":"2024-09-12T18:35:24.653175+0000","last_became_peered":"2024-09-12T18:35:24.653175+0000","last_unstale":"2024-09-12T18:35:25.645957+0000","last_undegraded":"2024-09-12T18:35:25.645957+0000","last_fullsized":"2024-09-12T18:35:25.645957+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:00.551165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.663487+0000","last_change":"2024-09-12T18:35:25.655723+0000","last_active":"2024-09-12T18:35:25.663487+0000","last_peered":"2024-09-12T18:35:25.663487+0000","last_clean":"2024-09-12T18:35:25.663487+0000","last_became_active":"2024-09-12T18:35:25.653630+0000","last_became_peered":"2024-09-12T18:35:25.653630+0000","last_unstale":"2024-09-12T18:35:25.663487+0000","last_undegraded":"2024-09-12T18:35:25.663487+0000","last_fullsized":"2024-09-12T18:35:25.663487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:18.567270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:23.596638+0000","last_change":"2024-09-12T18:35:23.596638+0000","last_active":"2024-09-12T18:35:23.596638+0000","last_peered":"2024-09-12T18:35:23.596638+0000","last_clean":"2024-09-12T18:35:23.596638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:23.596638+0000","last_undegraded":"2024-09-12T18:35:23.596638+0000","last_fullsized":"2024-09-12T18:35:23.596638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.669610+0000","last_change":"2024-09-12T18:35:25.662692+0000","last_active":"2024-09-12T18:35:25.669610+0000","last_peered":"2024-09-12T18:35:25.669610+0000","last_clean":"2024-09-12T18:35:25.669610+0000","last_became_active":"2024-09-12T18:35:25.661885+0000","last_became_peered":"2024-09-12T18:35:25.661885+0000","last_unstale":"2024-09-12T18:35:25.669610+0000","last_undegraded":"2024-09-12T18:35:25.669610+0000","last_fullsized":"2024-09-12T18:35:25.669610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:17.050672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.668729+0000","last_change":"2024-09-12T18:35:24.653610+0000","last_active":"2024-09-12T18:35:25.668729+0000","last_peered":"2024-09-12T18:35:25.668729+0000","last_clean":"2024-09-12T18:35:25.668729+0000","last_became_active":"2024-09-12T18:35:24.652880+0000","last_became_peered":"2024-09-12T18:35:24.652880+0000","last_unstale":"2024-09-12T18:35:25.668729+0000","last_undegraded":"2024-09-12T18:35:25.668729+0000","last_fullsized":"2024-09-12T18:35:25.668729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:57.636251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.665457+0000","last_change":"2024-09-12T18:35:24.653465+0000","last_active":"2024-09-12T18:35:25.665457+0000","last_peered":"2024-09-12T18:35:25.665457+0000","last_clean":"2024-09-12T18:35:25.665457+0000","last_became_active":"2024-09-12T18:35:24.652792+0000","last_became_peered":"2024-09-12T18:35:24.652792+0000","last_unstale":"2024-09-12T18:35:25.665457+0000","last_undegraded":"2024-09-12T18:35:25.665457+0000","last_fullsized":"2024-09-12T18:35:25.665457+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:14.588993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:23.596638+0000","last_change":"2024-09-12T18:35:23.596638+0000","last_active":"2024-09-12T18:35:23.596638+0000","last_peered":"2024-09-12T18:35:23.596638+0000","last_clean":"2024-09-12T18:35:23.596638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:23.596638+0000","last_undegraded":"2024-09-12T18:35:23.596638+0000","last_fullsized":"2024-09-12T18:35:23.596638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.665427+0000","last_change":"2024-09-12T18:35:24.654976+0000","last_active":"2024-09-12T18:35:25.665427+0000","last_peered":"2024-09-12T18:35:25.665427+0000","last_clean":"2024-09-12T18:35:25.665427+0000","last_became_active":"2024-09-12T18:35:24.654264+0000","last_became_peered":"2024-09-12T18:35:24.654264+0000","last_unstale":"2024-09-12T18:35:25.665427+0000","last_undegraded":"2024-09-12T18:35:25.665427+0000","last_fullsized":"2024-09-12T18:35:25.665427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:00.115408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.655595+0000","last_change":"2024-09-12T18:35:25.650577+0000","last_active":"2024-09-12T18:35:25.655595+0000","last_peered":"2024-09-12T18:35:25.655595+0000","last_clean":"2024-09-12T18:35:25.655595+0000","last_became_active":"2024-09-12T18:35:25.649172+0000","last_became_peered":"2024-09-12T18:35:25.649172+0000","last_unstale":"2024-09-12T18:35:25.655595+0000","last_undegraded":"2024-09-12T18:35:25.655595+0000","last_fullsized":"2024-09-12T18:35:25.655595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:21.445401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.635569+0000","last_change":"2024-09-12T18:35:24.657665+0000","last_active":"2024-09-12T18:35:25.635569+0000","last_peered":"2024-09-12T18:35:25.635569+0000","last_clean":"2024-09-12T18:35:25.635569+0000","last_became_active":"2024-09-12T18:35:24.657015+0000","last_became_peered":"2024-09-12T18:35:24.657015+0000","last_unstale":"2024-09-12T18:35:25.635569+0000","last_undegraded":"2024-09-12T18:35:25.635569+0000","last_fullsized":"2024-09-12T18:35:25.635569+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:03.171326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.668848+0000","last_change":"2024-09-12T18:35:25.665275+0000","last_active":"2024-09-12T18:35:25.668848+0000","last_peered":"2024-09-12T18:35:25.668848+0000","last_clean":"2024-09-12T18:35:25.668848+0000","last_became_active":"2024-09-12T18:35:25.659511+0000","last_became_peered":"2024-09-12T18:35:25.659511+0000","last_unstale":"2024-09-12T18:35:25.668848+0000","last_undegraded":"2024-09-12T18:35:25.668848+0000","last_fullsized":"2024-09-12T18:35:25.668848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:39.035368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.670534+0000","last_change":"2024-09-12T18:35:24.651913+0000","last_active":"2024-09-12T18:35:25.670534+0000","last_peered":"2024-09-12T18:35:25.670534+0000","last_clean":"2024-09-12T18:35:25.670534+0000","last_became_active":"2024-09-12T18:35:24.650421+0000","last_became_peered":"2024-09-12T18:35:24.650421+0000","last_unstale":"2024-09-12T18:35:25.670534+0000","last_undegraded":"2024-09-12T18:35:25.670534+0000","last_fullsized":"2024-09-12T18:35:25.670534+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:57.685312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.655649+0000","last_change":"2024-09-12T18:35:25.651138+0000","last_active":"2024-09-12T18:35:25.655649+0000","last_peered":"2024-09-12T18:35:25.655649+0000","last_clean":"2024-09-12T18:35:25.655649+0000","last_became_active":"2024-09-12T18:35:25.650617+0000","last_became_peered":"2024-09-12T18:35:25.650617+0000","last_unstale":"2024-09-12T18:35:25.655649+0000","last_undegraded":"2024-09-12T18:35:25.655649+0000","last_fullsized":"2024-09-12T18:35:25.655649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:59.531762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.629899+0000","last_change":"2024-09-12T18:35:24.659019+0000","last_active":"2024-09-12T18:35:25.629899+0000","last_peered":"2024-09-12T18:35:25.629899+0000","last_clean":"2024-09-12T18:35:25.629899+0000","last_became_active":"2024-09-12T18:35:24.658423+0000","last_became_peered":"2024-09-12T18:35:24.658423+0000","last_unstale":"2024-09-12T18:35:25.629899+0000","last_undegraded":"2024-09-12T18:35:25.629899+0000","last_fullsized":"2024-09-12T18:35:25.629899+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:37.668417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671592+0000","last_change":"2024-09-12T18:35:25.662287+0000","last_active":"2024-09-12T18:35:25.671592+0000","last_peered":"2024-09-12T18:35:25.671592+0000","last_clean":"2024-09-12T18:35:25.671592+0000","last_became_active":"2024-09-12T18:35:25.660372+0000","last_became_peered":"2024-09-12T18:35:25.660372+0000","last_unstale":"2024-09-12T18:35:25.671592+0000","last_undegraded":"2024-09-12T18:35:25.671592+0000","last_fullsized":"2024-09-12T18:35:25.671592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:14.114092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:23.596638+0000","last_change":"2024-09-12T18:35:23.596638+0000","last_active":"2024-09-12T18:35:23.596638+0000","last_peered":"2024-09-12T18:35:23.596638+0000","last_clean":"2024-09-12T18:35:23.596638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:23.596638+0000","last_undegraded":"2024-09-12T18:35:23.596638+0000","last_fullsized":"2024-09-12T18:35:23.596638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.670729+0000","last_change":"2024-09-12T18:35:25.658674+0000","last_active":"2024-09-12T18:35:25.670729+0000","last_peered":"2024-09-12T18:35:25.670729+0000","last_clean":"2024-09-12T18:35:25.670729+0000","last_became_active":"2024-09-12T18:35:25.657386+0000","last_became_peered":"2024-09-12T18:35:25.657386+0000","last_unstale":"2024-09-12T18:35:25.670729+0000","last_undegraded":"2024-09-12T18:35:25.670729+0000","last_fullsized":"2024-09-12T18:35:25.670729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:40.531922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:23.596638+0000","last_change":"2024-09-12T18:35:23.596638+0000","last_active":"2024-09-12T18:35:23.596638+0000","last_peered":"2024-09-12T18:35:23.596638+0000","last_clean":"2024-09-12T18:35:23.596638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:23.596638+0000","last_undegraded":"2024-09-12T18:35:23.596638+0000","last_fullsized":"2024-09-12T18:35:23.596638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.670432+0000","last_change":"2024-09-12T18:35:25.667710+0000","last_active":"2024-09-12T18:35:25.670432+0000","last_peered":"2024-09-12T18:35:25.670432+0000","last_clean":"2024-09-12T18:35:25.670432+0000","last_became_active":"2024-09-12T18:35:25.666940+0000","last_became_peered":"2024-09-12T18:35:25.666940+0000","last_unstale":"2024-09-12T18:35:25.670432+0000","last_undegraded":"2024-09-12T18:35:25.670432+0000","last_fullsized":"2024-09-12T18:35:25.670432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:16.315533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":163,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.635860+0000","last_change":"2024-09-12T18:35:13.489018+0000","last_active":"2024-09-12T18:35:25.635860+0000","last_peered":"2024-09-12T18:35:25.635860+0000","last_clean":"2024-09-12T18:35:25.635860+0000","last_became_active":"2024-09-12T18:35:13.488346+0000","last_became_peered":"2024-09-12T18:35:13.488346+0000","last_unstale":"2024-09-12T18:35:25.635860+0000","last_undegraded":"2024-09-12T18:35:25.635860+0000","last_fullsized":"2024-09-12T18:35:25.635860+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_clean_scrub_stamp":"2024-09-12T18:35:12.464628+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:54.864640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":27,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.635387+0000","last_change":"2024-09-12T18:35:22.459694+0000","last_active":"2024-09-12T18:35:25.635387+0000","last_peered":"2024-09-12T18:35:25.635387+0000","last_clean":"2024-09-12T18:35:25.635387+0000","last_became_active":"2024-09-12T18:35:20.446796+0000","last_became_peered":"2024-09-12T18:35:20.446796+0000","last_unstale":"2024-09-12T18:35:25.635387+0000","last_undegraded":"2024-09-12T18:35:25.635387+0000","last_fullsized":"2024-09-12T18:35:25.635387+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:21.506024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016291610000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.645967+0000","last_change":"2024-09-12T18:35:24.651749+0000","last_active":"2024-09-12T18:35:25.645967+0000","last_peered":"2024-09-12T18:35:25.645967+0000","last_clean":"2024-09-12T18:35:25.645967+0000","last_became_active":"2024-09-12T18:35:24.649860+0000","last_became_peered":"2024-09-12T18:35:24.649860+0000","last_unstale":"2024-09-12T18:35:25.645967+0000","last_undegraded":"2024-09-12T18:35:25.645967+0000","last_fullsized":"2024-09-12T18:35:25.645967+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:35.430065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671637+0000","last_change":"2024-09-12T18:35:25.662424+0000","last_active":"2024-09-12T18:35:25.671637+0000","last_peered":"2024-09-12T18:35:25.671637+0000","last_clean":"2024-09-12T18:35:25.671637+0000","last_became_active":"2024-09-12T18:35:25.661043+0000","last_became_peered":"2024-09-12T18:35:25.661043+0000","last_unstale":"2024-09-12T18:35:25.671637+0000","last_undegraded":"2024-09-12T18:35:25.671637+0000","last_fullsized":"2024-09-12T18:35:25.671637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:05.846676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.632239+0000","last_change":"2024-09-12T18:35:22.459090+0000","last_active":"2024-09-12T18:35:25.632239+0000","last_peered":"2024-09-12T18:35:25.632239+0000","last_clean":"2024-09-12T18:35:25.632239+0000","last_became_active":"2024-09-12T18:35:20.448553+0000","last_became_peered":"2024-09-12T18:35:20.448553+0000","last_unstale":"2024-09-12T18:35:25.632239+0000","last_undegraded":"2024-09-12T18:35:25.632239+0000","last_fullsized":"2024-09-12T18:35:25.632239+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:56.834808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001030836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.645664+0000","last_change":"2024-09-12T18:35:24.651597+0000","last_active":"2024-09-12T18:35:25.645664+0000","last_peered":"2024-09-12T18:35:25.645664+0000","last_clean":"2024-09-12T18:35:25.645664+0000","last_became_active":"2024-09-12T18:35:24.649940+0000","last_became_peered":"2024-09-12T18:35:24.649940+0000","last_unstale":"2024-09-12T18:35:25.645664+0000","last_undegraded":"2024-09-12T18:35:25.645664+0000","last_fullsized":"2024-09-12T18:35:25.645664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:36.822432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.645308+0000","last_change":"2024-09-12T18:35:22.464179+0000","last_active":"2024-09-12T18:35:25.645308+0000","last_peered":"2024-09-12T18:35:25.645308+0000","last_clean":"2024-09-12T18:35:25.645308+0000","last_became_active":"2024-09-12T18:35:20.442613+0000","last_became_peered":"2024-09-12T18:35:20.442613+0000","last_unstale":"2024-09-12T18:35:25.645308+0000","last_undegraded":"2024-09-12T18:35:25.645308+0000","last_fullsized":"2024-09-12T18:35:25.645308+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:17.636537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014134620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:23.596638+0000","last_change":"2024-09-12T18:35:23.596638+0000","last_active":"2024-09-12T18:35:23.596638+0000","last_peered":"2024-09-12T18:35:23.596638+0000","last_clean":"2024-09-12T18:35:23.596638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:23.596638+0000","last_undegraded":"2024-09-12T18:35:23.596638+0000","last_fullsized":"2024-09-12T18:35:23.596638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.666913+0000","last_change":"2024-09-12T18:35:25.659209+0000","last_active":"2024-09-12T18:35:25.666913+0000","last_peered":"2024-09-12T18:35:25.666913+0000","last_clean":"2024-09-12T18:35:25.666913+0000","last_became_active":"2024-09-12T18:35:25.656170+0000","last_became_peered":"2024-09-12T18:35:25.656170+0000","last_unstale":"2024-09-12T18:35:25.666913+0000","last_undegraded":"2024-09-12T18:35:25.666913+0000","last_fullsized":"2024-09-12T18:35:25.666913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:40.344068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":28,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.629469+0000","last_change":"2024-09-12T18:35:22.459049+0000","last_active":"2024-09-12T18:35:25.629469+0000","last_peered":"2024-09-12T18:35:25.629469+0000","last_clean":"2024-09-12T18:35:25.629469+0000","last_became_active":"2024-09-12T18:35:20.446814+0000","last_became_peered":"2024-09-12T18:35:20.446814+0000","last_unstale":"2024-09-12T18:35:25.629469+0000","last_undegraded":"2024-09-12T18:35:25.629469+0000","last_fullsized":"2024-09-12T18:35:25.629469+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:18.033595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010716149999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.635381+0000","last_change":"2024-09-12T18:35:24.658273+0000","last_active":"2024-09-12T18:35:25.635381+0000","last_peered":"2024-09-12T18:35:25.635381+0000","last_clean":"2024-09-12T18:35:25.635381+0000","last_became_active":"2024-09-12T18:35:24.657433+0000","last_became_peered":"2024-09-12T18:35:24.657433+0000","last_unstale":"2024-09-12T18:35:25.635381+0000","last_undegraded":"2024-09-12T18:35:25.635381+0000","last_fullsized":"2024-09-12T18:35:25.635381+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:48.497218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.663537+0000","last_change":"2024-09-12T18:35:25.655830+0000","last_active":"2024-09-12T18:35:25.663537+0000","last_peered":"2024-09-12T18:35:25.663537+0000","last_clean":"2024-09-12T18:35:25.663537+0000","last_became_active":"2024-09-12T18:35:25.652126+0000","last_became_peered":"2024-09-12T18:35:25.652126+0000","last_unstale":"2024-09-12T18:35:25.663537+0000","last_undegraded":"2024-09-12T18:35:25.663537+0000","last_fullsized":"2024-09-12T18:35:25.663537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:33.679281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.635489+0000","last_change":"2024-09-12T18:35:24.657618+0000","last_active":"2024-09-12T18:35:25.635489+0000","last_peered":"2024-09-12T18:35:25.635489+0000","last_clean":"2024-09-12T18:35:25.635489+0000","last_became_active":"2024-09-12T18:35:24.656741+0000","last_became_peered":"2024-09-12T18:35:24.656741+0000","last_unstale":"2024-09-12T18:35:25.635489+0000","last_undegraded":"2024-09-12T18:35:25.635489+0000","last_fullsized":"2024-09-12T18:35:25.635489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:43.113104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.647145+0000","last_change":"2024-09-12T18:35:22.464180+0000","last_active":"2024-09-12T18:35:25.647145+0000","last_peered":"2024-09-12T18:35:25.647145+0000","last_clean":"2024-09-12T18:35:25.647145+0000","last_became_active":"2024-09-12T18:35:20.442566+0000","last_became_peered":"2024-09-12T18:35:20.442566+0000","last_unstale":"2024-09-12T18:35:25.647145+0000","last_undegraded":"2024-09-12T18:35:25.647145+0000","last_fullsized":"2024-09-12T18:35:25.647145+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:29.021710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001325786,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.647793+0000","last_change":"2024-09-12T18:35:24.649669+0000","last_active":"2024-09-12T18:35:25.647793+0000","last_peered":"2024-09-12T18:35:25.647793+0000","last_clean":"2024-09-12T18:35:25.647793+0000","last_became_active":"2024-09-12T18:35:24.648881+0000","last_became_peered":"2024-09-12T18:35:24.648881+0000","last_unstale":"2024-09-12T18:35:25.647793+0000","last_undegraded":"2024-09-12T18:35:25.647793+0000","last_fullsized":"2024-09-12T18:35:25.647793+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:23.614734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-12T18:35:22.458666+0000","last_change":"2024-09-12T18:35:22.458666+0000","last_active":"2024-09-12T18:35:22.458666+0000","last_peered":"2024-09-12T18:35:22.458666+0000","last_clean":"2024-09-12T18:35:22.458666+0000","last_became_active":"2024-09-12T18:35:20.442394+0000","last_became_peered":"2024-09-12T18:35:20.442394+0000","last_unstale":"2024-09-12T18:35:22.458666+0000","last_undegraded":"2024-09-12T18:35:22.458666+0000","last_fullsized":"2024-09-12T18:35:22.458666+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:51.840246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080163599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.674332+0000","last_change":"2024-09-12T18:35:24.657234+0000","last_active":"2024-09-12T18:35:25.674332+0000","last_peered":"2024-09-12T18:35:25.674332+0000","last_clean":"2024-09-12T18:35:25.674332+0000","last_became_active":"2024-09-12T18:35:24.655950+0000","last_became_peered":"2024-09-12T18:35:24.655950+0000","last_unstale":"2024-09-12T18:35:25.674332+0000","last_undegraded":"2024-09-12T18:35:25.674332+0000","last_fullsized":"2024-09-12T18:35:25.674332+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:17.466623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.647896+0000","last_change":"2024-09-12T18:35:22.464656+0000","last_active":"2024-09-12T18:35:25.647896+0000","last_peered":"2024-09-12T18:35:25.647896+0000","last_clean":"2024-09-12T18:35:25.647896+0000","last_became_active":"2024-09-12T18:35:20.445470+0000","last_became_peered":"2024-09-12T18:35:20.445470+0000","last_unstale":"2024-09-12T18:35:25.647896+0000","last_undegraded":"2024-09-12T18:35:25.647896+0000","last_fullsized":"2024-09-12T18:35:25.647896+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:58.947359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001742681,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.665411+0000","last_change":"2024-09-12T18:35:25.658887+0000","last_active":"2024-09-12T18:35:25.665411+0000","last_peered":"2024-09-12T18:35:25.665411+0000","last_clean":"2024-09-12T18:35:25.665411+0000","last_became_active":"2024-09-12T18:35:25.656829+0000","last_became_peered":"2024-09-12T18:35:25.656829+0000","last_unstale":"2024-09-12T18:35:25.665411+0000","last_undegraded":"2024-09-12T18:35:25.665411+0000","last_fullsized":"2024-09-12T18:35:25.665411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:16.495586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.647739+0000","last_change":"2024-09-12T18:35:24.654518+0000","last_active":"2024-09-12T18:35:25.647739+0000","last_peered":"2024-09-12T18:35:25.647739+0000","last_clean":"2024-09-12T18:35:25.647739+0000","last_became_active":"2024-09-12T18:35:24.650309+0000","last_became_peered":"2024-09-12T18:35:24.650309+0000","last_unstale":"2024-09-12T18:35:25.647739+0000","last_undegraded":"2024-09-12T18:35:25.647739+0000","last_fullsized":"2024-09-12T18:35:25.647739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:16.669035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.629046+0000","last_change":"2024-09-12T18:35:22.459767+0000","last_active":"2024-09-12T18:35:25.629046+0000","last_peered":"2024-09-12T18:35:25.629046+0000","last_clean":"2024-09-12T18:35:25.629046+0000","last_became_active":"2024-09-12T18:35:20.448521+0000","last_became_peered":"2024-09-12T18:35:20.448521+0000","last_unstale":"2024-09-12T18:35:25.629046+0000","last_undegraded":"2024-09-12T18:35:25.629046+0000","last_fullsized":"2024-09-12T18:35:25.629046+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:33.463792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017009670000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671289+0000","last_change":"2024-09-12T18:35:25.660696+0000","last_active":"2024-09-12T18:35:25.671289+0000","last_peered":"2024-09-12T18:35:25.671289+0000","last_clean":"2024-09-12T18:35:25.671289+0000","last_became_active":"2024-09-12T18:35:25.659827+0000","last_became_peered":"2024-09-12T18:35:25.659827+0000","last_unstale":"2024-09-12T18:35:25.671289+0000","last_undegraded":"2024-09-12T18:35:25.671289+0000","last_fullsized":"2024-09-12T18:35:25.671289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:32.995388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.675858+0000","last_change":"2024-09-12T18:35:24.655051+0000","last_active":"2024-09-12T18:35:25.675858+0000","last_peered":"2024-09-12T18:35:25.675858+0000","last_clean":"2024-09-12T18:35:25.675858+0000","last_became_active":"2024-09-12T18:35:24.654282+0000","last_became_peered":"2024-09-12T18:35:24.654282+0000","last_unstale":"2024-09-12T18:35:25.675858+0000","last_undegraded":"2024-09-12T18:35:25.675858+0000","last_fullsized":"2024-09-12T18:35:25.675858+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:08.159799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.665292+0000","last_change":"2024-09-12T18:35:25.659237+0000","last_active":"2024-09-12T18:35:25.665292+0000","last_peered":"2024-09-12T18:35:25.665292+0000","last_clean":"2024-09-12T18:35:25.665292+0000","last_became_active":"2024-09-12T18:35:25.658423+0000","last_became_peered":"2024-09-12T18:35:25.658423+0000","last_unstale":"2024-09-12T18:35:25.665292+0000","last_undegraded":"2024-09-12T18:35:25.665292+0000","last_fullsized":"2024-09-12T18:35:25.665292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:53.450092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:23.596638+0000","last_change":"2024-09-12T18:35:23.596638+0000","last_active":"2024-09-12T18:35:23.596638+0000","last_peered":"2024-09-12T18:35:23.596638+0000","last_clean":"2024-09-12T18:35:23.596638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:23.596638+0000","last_undegraded":"2024-09-12T18:35:23.596638+0000","last_fullsized":"2024-09-12T18:35:23.596638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.628799+0000","last_change":"2024-09-12T18:35:24.656855+0000","last_active":"2024-09-12T18:35:25.628799+0000","last_peered":"2024-09-12T18:35:25.628799+0000","last_clean":"2024-09-12T18:35:25.628799+0000","last_became_active":"2024-09-12T18:35:24.655935+0000","last_became_peered":"2024-09-12T18:35:24.655935+0000","last_unstale":"2024-09-12T18:35:25.628799+0000","last_undegraded":"2024-09-12T18:35:25.628799+0000","last_fullsized":"2024-09-12T18:35:25.628799+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:35.430065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.667632+0000","last_change":"2024-09-12T18:35:25.661801+0000","last_active":"2024-09-12T18:35:25.667632+0000","last_peered":"2024-09-12T18:35:25.667632+0000","last_clean":"2024-09-12T18:35:25.667632+0000","last_became_active":"2024-09-12T18:35:25.658476+0000","last_became_peered":"2024-09-12T18:35:25.658476+0000","last_unstale":"2024-09-12T18:35:25.667632+0000","last_undegraded":"2024-09-12T18:35:25.667632+0000","last_fullsized":"2024-09-12T18:35:25.667632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:22.078004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.650423+0000","last_change":"2024-09-12T18:35:24.652399+0000","last_active":"2024-09-12T18:35:25.650423+0000","last_peered":"2024-09-12T18:35:25.650423+0000","last_clean":"2024-09-12T18:35:25.650423+0000","last_became_active":"2024-09-12T18:35:24.651416+0000","last_became_peered":"2024-09-12T18:35:24.651416+0000","last_unstale":"2024-09-12T18:35:25.650423+0000","last_undegraded":"2024-09-12T18:35:25.650423+0000","last_fullsized":"2024-09-12T18:35:25.650423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:32.594978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.665313+0000","last_change":"2024-09-12T18:35:25.658570+0000","last_active":"2024-09-12T18:35:25.665313+0000","last_peered":"2024-09-12T18:35:25.665313+0000","last_clean":"2024-09-12T18:35:25.665313+0000","last_became_active":"2024-09-12T18:35:25.656561+0000","last_became_peered":"2024-09-12T18:35:25.656561+0000","last_unstale":"2024-09-12T18:35:25.665313+0000","last_undegraded":"2024-09-12T18:35:25.665313+0000","last_fullsized":"2024-09-12T18:35:25.665313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:46.305988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.644984+0000","last_change":"2024-09-12T18:35:24.657489+0000","last_active":"2024-09-12T18:35:25.644984+0000","last_peered":"2024-09-12T18:35:25.644984+0000","last_clean":"2024-09-12T18:35:25.644984+0000","last_became_active":"2024-09-12T18:35:24.656030+0000","last_became_peered":"2024-09-12T18:35:24.656030+0000","last_unstale":"2024-09-12T18:35:25.644984+0000","last_undegraded":"2024-09-12T18:35:25.644984+0000","last_fullsized":"2024-09-12T18:35:25.644984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:11.362759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671748+0000","last_change":"2024-09-12T18:35:25.661544+0000","last_active":"2024-09-12T18:35:25.671748+0000","last_peered":"2024-09-12T18:35:25.671748+0000","last_clean":"2024-09-12T18:35:25.671748+0000","last_became_active":"2024-09-12T18:35:25.656985+0000","last_became_peered":"2024-09-12T18:35:25.656985+0000","last_unstale":"2024-09-12T18:35:25.671748+0000","last_undegraded":"2024-09-12T18:35:25.671748+0000","last_fullsized":"2024-09-12T18:35:25.671748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:31.078781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.645078+0000","last_change":"2024-09-12T18:35:24.646342+0000","last_active":"2024-09-12T18:35:25.645078+0000","last_peered":"2024-09-12T18:35:25.645078+0000","last_clean":"2024-09-12T18:35:25.645078+0000","last_became_active":"2024-09-12T18:35:24.644773+0000","last_became_peered":"2024-09-12T18:35:24.644773+0000","last_unstale":"2024-09-12T18:35:25.645078+0000","last_undegraded":"2024-09-12T18:35:25.645078+0000","last_fullsized":"2024-09-12T18:35:25.645078+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:17.011231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:23.596638+0000","last_change":"2024-09-12T18:35:23.596638+0000","last_active":"2024-09-12T18:35:23.596638+0000","last_peered":"2024-09-12T18:35:23.596638+0000","last_clean":"2024-09-12T18:35:23.596638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:23.596638+0000","last_undegraded":"2024-09-12T18:35:23.596638+0000","last_fullsized":"2024-09-12T18:35:23.596638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:23.596638+0000","last_change":"2024-09-12T18:35:23.596638+0000","last_active":"2024-09-12T18:35:23.596638+0000","last_peered":"2024-09-12T18:35:23.596638+0000","last_clean":"2024-09-12T18:35:23.596638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:23.596638+0000","last_undegraded":"2024-09-12T18:35:23.596638+0000","last_fullsized":"2024-09-12T18:35:23.596638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671662+0000","last_change":"2024-09-12T18:35:25.662537+0000","last_active":"2024-09-12T18:35:25.671662+0000","last_peered":"2024-09-12T18:35:25.671662+0000","last_clean":"2024-09-12T18:35:25.671662+0000","last_became_active":"2024-09-12T18:35:25.661441+0000","last_became_peered":"2024-09-12T18:35:25.661441+0000","last_unstale":"2024-09-12T18:35:25.671662+0000","last_undegraded":"2024-09-12T18:35:25.671662+0000","last_fullsized":"2024-09-12T18:35:25.671662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:34.445331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.667700+0000","last_change":"2024-09-12T18:35:24.657635+0000","last_active":"2024-09-12T18:35:25.667700+0000","last_peered":"2024-09-12T18:35:25.667700+0000","last_clean":"2024-09-12T18:35:25.667700+0000","last_became_active":"2024-09-12T18:35:24.655992+0000","last_became_peered":"2024-09-12T18:35:24.655992+0000","last_unstale":"2024-09-12T18:35:25.667700+0000","last_undegraded":"2024-09-12T18:35:25.667700+0000","last_fullsized":"2024-09-12T18:35:25.667700+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:33.536755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.655697+0000","last_change":"2024-09-12T18:35:25.651406+0000","last_active":"2024-09-12T18:35:25.655697+0000","last_peered":"2024-09-12T18:35:25.655697+0000","last_clean":"2024-09-12T18:35:25.655697+0000","last_became_active":"2024-09-12T18:35:25.649728+0000","last_became_peered":"2024-09-12T18:35:25.649728+0000","last_unstale":"2024-09-12T18:35:25.655697+0000","last_undegraded":"2024-09-12T18:35:25.655697+0000","last_fullsized":"2024-09-12T18:35:25.655697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:53.450092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:23.596638+0000","last_change":"2024-09-12T18:35:23.596638+0000","last_active":"2024-09-12T18:35:23.596638+0000","last_peered":"2024-09-12T18:35:23.596638+0000","last_clean":"2024-09-12T18:35:23.596638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:23.596638+0000","last_undegraded":"2024-09-12T18:35:23.596638+0000","last_fullsized":"2024-09-12T18:35:23.596638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.666379+0000","last_change":"2024-09-12T18:35:24.656268+0000","last_active":"2024-09-12T18:35:25.666379+0000","last_peered":"2024-09-12T18:35:25.666379+0000","last_clean":"2024-09-12T18:35:25.666379+0000","last_became_active":"2024-09-12T18:35:24.655420+0000","last_became_peered":"2024-09-12T18:35:24.655420+0000","last_unstale":"2024-09-12T18:35:25.666379+0000","last_undegraded":"2024-09-12T18:35:25.666379+0000","last_fullsized":"2024-09-12T18:35:25.666379+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:04.654666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671307+0000","last_change":"2024-09-12T18:35:25.661042+0000","last_active":"2024-09-12T18:35:25.671307+0000","last_peered":"2024-09-12T18:35:25.671307+0000","last_clean":"2024-09-12T18:35:25.671307+0000","last_became_active":"2024-09-12T18:35:25.660163+0000","last_became_peered":"2024-09-12T18:35:25.660163+0000","last_unstale":"2024-09-12T18:35:25.671307+0000","last_undegraded":"2024-09-12T18:35:25.671307+0000","last_fullsized":"2024-09-12T18:35:25.671307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:25.387564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.675465+0000","last_change":"2024-09-12T18:35:24.652304+0000","last_active":"2024-09-12T18:35:25.675465+0000","last_peered":"2024-09-12T18:35:25.675465+0000","last_clean":"2024-09-12T18:35:25.675465+0000","last_became_active":"2024-09-12T18:35:24.651460+0000","last_became_peered":"2024-09-12T18:35:24.651460+0000","last_unstale":"2024-09-12T18:35:25.675465+0000","last_undegraded":"2024-09-12T18:35:25.675465+0000","last_fullsized":"2024-09-12T18:35:25.675465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:42.050557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":80,"acting":80,"num_store_stats":2},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2320,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":46,"acting":46,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":196608,"data_stored":631260,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":258048,"data_stored":647469,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":167936,"data_stored":55307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:35:28.996 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:35:29.331 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:35:29.333 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T18:35:29.346 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-12T18:35:28.376312+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592707,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":181,"num_write_kb":2687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":144,"acting":144,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":72,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":85872,"kb_used_data":608,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283029648,"statfs":{"total":289910292480,"available":289822359552,"internally_reserved":0,"allocated":622592,"data_stored":1334036,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4783,"internal_metadata":87223633},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2331,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.765854"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.670958+0000","last_change":"2024-09-12T18:35:25.659460+0000","last_active":"2024-09-12T18:35:25.670958+0000","last_peered":"2024-09-12T18:35:25.670958+0000","last_clean":"2024-09-12T18:35:25.670958+0000","last_became_active":"2024-09-12T18:35:25.657782+0000","last_became_peered":"2024-09-12T18:35:25.657782+0000","last_unstale":"2024-09-12T18:35:25.670958+0000","last_undegraded":"2024-09-12T18:35:25.670958+0000","last_fullsized":"2024-09-12T18:35:25.670958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:56.799067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671805+0000","last_change":"2024-09-12T18:35:25.663617+0000","last_active":"2024-09-12T18:35:25.671805+0000","last_peered":"2024-09-12T18:35:25.671805+0000","last_clean":"2024-09-12T18:35:25.671805+0000","last_became_active":"2024-09-12T18:35:25.661977+0000","last_became_peered":"2024-09-12T18:35:25.661977+0000","last_unstale":"2024-09-12T18:35:25.671805+0000","last_undegraded":"2024-09-12T18:35:25.671805+0000","last_fullsized":"2024-09-12T18:35:25.671805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:02.792152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.655766+0000","last_change":"2024-09-12T18:35:25.652754+0000","last_active":"2024-09-12T18:35:25.655766+0000","last_peered":"2024-09-12T18:35:25.655766+0000","last_clean":"2024-09-12T18:35:25.655766+0000","last_became_active":"2024-09-12T18:35:25.651217+0000","last_became_peered":"2024-09-12T18:35:25.651217+0000","last_unstale":"2024-09-12T18:35:25.655766+0000","last_undegraded":"2024-09-12T18:35:25.655766+0000","last_fullsized":"2024-09-12T18:35:25.655766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:17.007002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671054+0000","last_change":"2024-09-12T18:35:25.659811+0000","last_active":"2024-09-12T18:35:25.671054+0000","last_peered":"2024-09-12T18:35:25.671054+0000","last_clean":"2024-09-12T18:35:25.671054+0000","last_became_active":"2024-09-12T18:35:25.658998+0000","last_became_peered":"2024-09-12T18:35:25.658998+0000","last_unstale":"2024-09-12T18:35:25.671054+0000","last_undegraded":"2024-09-12T18:35:25.671054+0000","last_fullsized":"2024-09-12T18:35:25.671054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:12.891661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.655902+0000","last_change":"2024-09-12T18:35:25.653999+0000","last_active":"2024-09-12T18:35:25.655902+0000","last_peered":"2024-09-12T18:35:25.655902+0000","last_clean":"2024-09-12T18:35:25.655902+0000","last_became_active":"2024-09-12T18:35:25.653319+0000","last_became_peered":"2024-09-12T18:35:25.653319+0000","last_unstale":"2024-09-12T18:35:25.655902+0000","last_undegraded":"2024-09-12T18:35:25.655902+0000","last_fullsized":"2024-09-12T18:35:25.655902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:31.096877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.670527+0000","last_change":"2024-09-12T18:35:25.668339+0000","last_active":"2024-09-12T18:35:25.670527+0000","last_peered":"2024-09-12T18:35:25.670527+0000","last_clean":"2024-09-12T18:35:25.670527+0000","last_became_active":"2024-09-12T18:35:25.667608+0000","last_became_peered":"2024-09-12T18:35:25.667608+0000","last_unstale":"2024-09-12T18:35:25.670527+0000","last_undegraded":"2024-09-12T18:35:25.670527+0000","last_fullsized":"2024-09-12T18:35:25.670527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:52.466349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.655517+0000","last_change":"2024-09-12T18:35:25.649858+0000","last_active":"2024-09-12T18:35:25.655517+0000","last_peered":"2024-09-12T18:35:25.655517+0000","last_clean":"2024-09-12T18:35:25.655517+0000","last_became_active":"2024-09-12T18:35:25.649090+0000","last_became_peered":"2024-09-12T18:35:25.649090+0000","last_unstale":"2024-09-12T18:35:25.655517+0000","last_undegraded":"2024-09-12T18:35:25.655517+0000","last_fullsized":"2024-09-12T18:35:25.655517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:42.675921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.666461+0000","last_change":"2024-09-12T18:35:25.657913+0000","last_active":"2024-09-12T18:35:25.666461+0000","last_peered":"2024-09-12T18:35:25.666461+0000","last_clean":"2024-09-12T18:35:25.666461+0000","last_became_active":"2024-09-12T18:35:25.657082+0000","last_became_peered":"2024-09-12T18:35:25.657082+0000","last_unstale":"2024-09-12T18:35:25.666461+0000","last_undegraded":"2024-09-12T18:35:25.666461+0000","last_fullsized":"2024-09-12T18:35:25.666461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:36.452006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.670741+0000","last_change":"2024-09-12T18:35:25.658763+0000","last_active":"2024-09-12T18:35:25.670741+0000","last_peered":"2024-09-12T18:35:25.670741+0000","last_clean":"2024-09-12T18:35:25.670741+0000","last_became_active":"2024-09-12T18:35:25.657508+0000","last_became_peered":"2024-09-12T18:35:25.657508+0000","last_unstale":"2024-09-12T18:35:25.670741+0000","last_undegraded":"2024-09-12T18:35:25.670741+0000","last_fullsized":"2024-09-12T18:35:25.670741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:14.134808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.655848+0000","last_change":"2024-09-12T18:35:25.653730+0000","last_active":"2024-09-12T18:35:25.655848+0000","last_peered":"2024-09-12T18:35:25.655848+0000","last_clean":"2024-09-12T18:35:25.655848+0000","last_became_active":"2024-09-12T18:35:25.651535+0000","last_became_peered":"2024-09-12T18:35:25.651535+0000","last_unstale":"2024-09-12T18:35:25.655848+0000","last_undegraded":"2024-09-12T18:35:25.655848+0000","last_fullsized":"2024-09-12T18:35:25.655848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:37.514843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.666868+0000","last_change":"2024-09-12T18:35:25.656513+0000","last_active":"2024-09-12T18:35:25.666868+0000","last_peered":"2024-09-12T18:35:25.666868+0000","last_clean":"2024-09-12T18:35:25.666868+0000","last_became_active":"2024-09-12T18:35:25.653440+0000","last_became_peered":"2024-09-12T18:35:25.653440+0000","last_unstale":"2024-09-12T18:35:25.666868+0000","last_undegraded":"2024-09-12T18:35:25.666868+0000","last_fullsized":"2024-09-12T18:35:25.666868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:26.721698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.665394+0000","last_change":"2024-09-12T18:35:25.658819+0000","last_active":"2024-09-12T18:35:25.665394+0000","last_peered":"2024-09-12T18:35:25.665394+0000","last_clean":"2024-09-12T18:35:25.665394+0000","last_became_active":"2024-09-12T18:35:25.656843+0000","last_became_peered":"2024-09-12T18:35:25.656843+0000","last_unstale":"2024-09-12T18:35:25.665394+0000","last_undegraded":"2024-09-12T18:35:25.665394+0000","last_fullsized":"2024-09-12T18:35:25.665394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:27:44.442447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671733+0000","last_change":"2024-09-12T18:35:25.661176+0000","last_active":"2024-09-12T18:35:25.671733+0000","last_peered":"2024-09-12T18:35:25.671733+0000","last_clean":"2024-09-12T18:35:25.671733+0000","last_became_active":"2024-09-12T18:35:25.659534+0000","last_became_peered":"2024-09-12T18:35:25.659534+0000","last_unstale":"2024-09-12T18:35:25.671733+0000","last_undegraded":"2024-09-12T18:35:25.671733+0000","last_fullsized":"2024-09-12T18:35:25.671733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:54.580837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.655660+0000","last_change":"2024-09-12T18:35:25.650632+0000","last_active":"2024-09-12T18:35:25.655660+0000","last_peered":"2024-09-12T18:35:25.655660+0000","last_clean":"2024-09-12T18:35:25.655660+0000","last_became_active":"2024-09-12T18:35:25.649333+0000","last_became_peered":"2024-09-12T18:35:25.649333+0000","last_unstale":"2024-09-12T18:35:25.655660+0000","last_undegraded":"2024-09-12T18:35:25.655660+0000","last_fullsized":"2024-09-12T18:35:25.655660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:20.136271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.667558+0000","last_change":"2024-09-12T18:35:25.661613+0000","last_active":"2024-09-12T18:35:25.667558+0000","last_peered":"2024-09-12T18:35:25.667558+0000","last_clean":"2024-09-12T18:35:25.667558+0000","last_became_active":"2024-09-12T18:35:25.658833+0000","last_became_peered":"2024-09-12T18:35:25.658833+0000","last_unstale":"2024-09-12T18:35:25.667558+0000","last_undegraded":"2024-09-12T18:35:25.667558+0000","last_fullsized":"2024-09-12T18:35:25.667558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:37.514843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671782+0000","last_change":"2024-09-12T18:35:25.662414+0000","last_active":"2024-09-12T18:35:25.671782+0000","last_peered":"2024-09-12T18:35:25.671782+0000","last_clean":"2024-09-12T18:35:25.671782+0000","last_became_active":"2024-09-12T18:35:25.660126+0000","last_became_peered":"2024-09-12T18:35:25.660126+0000","last_unstale":"2024-09-12T18:35:25.671782+0000","last_undegraded":"2024-09-12T18:35:25.671782+0000","last_fullsized":"2024-09-12T18:35:25.671782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:05.136469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671510+0000","last_change":"2024-09-12T18:35:25.661523+0000","last_active":"2024-09-12T18:35:25.671510+0000","last_peered":"2024-09-12T18:35:25.671510+0000","last_clean":"2024-09-12T18:35:25.671510+0000","last_became_active":"2024-09-12T18:35:25.659338+0000","last_became_peered":"2024-09-12T18:35:25.659338+0000","last_unstale":"2024-09-12T18:35:25.671510+0000","last_undegraded":"2024-09-12T18:35:25.671510+0000","last_fullsized":"2024-09-12T18:35:25.671510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:12.762819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.667865+0000","last_change":"2024-09-12T18:35:25.662519+0000","last_active":"2024-09-12T18:35:25.667865+0000","last_peered":"2024-09-12T18:35:25.667865+0000","last_clean":"2024-09-12T18:35:25.667865+0000","last_became_active":"2024-09-12T18:35:25.652964+0000","last_became_peered":"2024-09-12T18:35:25.652964+0000","last_unstale":"2024-09-12T18:35:25.667865+0000","last_undegraded":"2024-09-12T18:35:25.667865+0000","last_fullsized":"2024-09-12T18:35:25.667865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:02.929063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.662850+0000","last_change":"2024-09-12T18:35:25.653949+0000","last_active":"2024-09-12T18:35:25.662850+0000","last_peered":"2024-09-12T18:35:25.662850+0000","last_clean":"2024-09-12T18:35:25.662850+0000","last_became_active":"2024-09-12T18:35:25.652992+0000","last_became_peered":"2024-09-12T18:35:25.652992+0000","last_unstale":"2024-09-12T18:35:25.662850+0000","last_undegraded":"2024-09-12T18:35:25.662850+0000","last_fullsized":"2024-09-12T18:35:25.662850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:20.448219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.655784+0000","last_change":"2024-09-12T18:35:25.653159+0000","last_active":"2024-09-12T18:35:25.655784+0000","last_peered":"2024-09-12T18:35:25.655784+0000","last_clean":"2024-09-12T18:35:25.655784+0000","last_became_active":"2024-09-12T18:35:25.650551+0000","last_became_peered":"2024-09-12T18:35:25.650551+0000","last_unstale":"2024-09-12T18:35:25.655784+0000","last_undegraded":"2024-09-12T18:35:25.655784+0000","last_fullsized":"2024-09-12T18:35:25.655784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:45.453862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.667164+0000","last_change":"2024-09-12T18:35:24.657739+0000","last_active":"2024-09-12T18:35:25.667164+0000","last_peered":"2024-09-12T18:35:25.667164+0000","last_clean":"2024-09-12T18:35:25.667164+0000","last_became_active":"2024-09-12T18:35:24.656208+0000","last_became_peered":"2024-09-12T18:35:24.656208+0000","last_unstale":"2024-09-12T18:35:25.667164+0000","last_undegraded":"2024-09-12T18:35:25.667164+0000","last_fullsized":"2024-09-12T18:35:25.667164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:50.073716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.645957+0000","last_change":"2024-09-12T18:35:24.656119+0000","last_active":"2024-09-12T18:35:25.645957+0000","last_peered":"2024-09-12T18:35:25.645957+0000","last_clean":"2024-09-12T18:35:25.645957+0000","last_became_active":"2024-09-12T18:35:24.653175+0000","last_became_peered":"2024-09-12T18:35:24.653175+0000","last_unstale":"2024-09-12T18:35:25.645957+0000","last_undegraded":"2024-09-12T18:35:25.645957+0000","last_fullsized":"2024-09-12T18:35:25.645957+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:00.551165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.663487+0000","last_change":"2024-09-12T18:35:25.655723+0000","last_active":"2024-09-12T18:35:25.663487+0000","last_peered":"2024-09-12T18:35:25.663487+0000","last_clean":"2024-09-12T18:35:25.663487+0000","last_became_active":"2024-09-12T18:35:25.653630+0000","last_became_peered":"2024-09-12T18:35:25.653630+0000","last_unstale":"2024-09-12T18:35:25.663487+0000","last_undegraded":"2024-09-12T18:35:25.663487+0000","last_fullsized":"2024-09-12T18:35:25.663487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:18.567270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:23.596638+0000","last_change":"2024-09-12T18:35:23.596638+0000","last_active":"2024-09-12T18:35:23.596638+0000","last_peered":"2024-09-12T18:35:23.596638+0000","last_clean":"2024-09-12T18:35:23.596638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:23.596638+0000","last_undegraded":"2024-09-12T18:35:23.596638+0000","last_fullsized":"2024-09-12T18:35:23.596638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.669610+0000","last_change":"2024-09-12T18:35:25.662692+0000","last_active":"2024-09-12T18:35:25.669610+0000","last_peered":"2024-09-12T18:35:25.669610+0000","last_clean":"2024-09-12T18:35:25.669610+0000","last_became_active":"2024-09-12T18:35:25.661885+0000","last_became_peered":"2024-09-12T18:35:25.661885+0000","last_unstale":"2024-09-12T18:35:25.669610+0000","last_undegraded":"2024-09-12T18:35:25.669610+0000","last_fullsized":"2024-09-12T18:35:25.669610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:17.050672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.668729+0000","last_change":"2024-09-12T18:35:24.653610+0000","last_active":"2024-09-12T18:35:25.668729+0000","last_peered":"2024-09-12T18:35:25.668729+0000","last_clean":"2024-09-12T18:35:25.668729+0000","last_became_active":"2024-09-12T18:35:24.652880+0000","last_became_peered":"2024-09-12T18:35:24.652880+0000","last_unstale":"2024-09-12T18:35:25.668729+0000","last_undegraded":"2024-09-12T18:35:25.668729+0000","last_fullsized":"2024-09-12T18:35:25.668729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:57.636251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.665457+0000","last_change":"2024-09-12T18:35:24.653465+0000","last_active":"2024-09-12T18:35:25.665457+0000","last_peered":"2024-09-12T18:35:25.665457+0000","last_clean":"2024-09-12T18:35:25.665457+0000","last_became_active":"2024-09-12T18:35:24.652792+0000","last_became_peered":"2024-09-12T18:35:24.652792+0000","last_unstale":"2024-09-12T18:35:25.665457+0000","last_undegraded":"2024-09-12T18:35:25.665457+0000","last_fullsized":"2024-09-12T18:35:25.665457+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:14.588993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:23.596638+0000","last_change":"2024-09-12T18:35:23.596638+0000","last_active":"2024-09-12T18:35:23.596638+0000","last_peered":"2024-09-12T18:35:23.596638+0000","last_clean":"2024-09-12T18:35:23.596638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:23.596638+0000","last_undegraded":"2024-09-12T18:35:23.596638+0000","last_fullsized":"2024-09-12T18:35:23.596638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.665427+0000","last_change":"2024-09-12T18:35:24.654976+0000","last_active":"2024-09-12T18:35:25.665427+0000","last_peered":"2024-09-12T18:35:25.665427+0000","last_clean":"2024-09-12T18:35:25.665427+0000","last_became_active":"2024-09-12T18:35:24.654264+0000","last_became_peered":"2024-09-12T18:35:24.654264+0000","last_unstale":"2024-09-12T18:35:25.665427+0000","last_undegraded":"2024-09-12T18:35:25.665427+0000","last_fullsized":"2024-09-12T18:35:25.665427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:00.115408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.655595+0000","last_change":"2024-09-12T18:35:25.650577+0000","last_active":"2024-09-12T18:35:25.655595+0000","last_peered":"2024-09-12T18:35:25.655595+0000","last_clean":"2024-09-12T18:35:25.655595+0000","last_became_active":"2024-09-12T18:35:25.649172+0000","last_became_peered":"2024-09-12T18:35:25.649172+0000","last_unstale":"2024-09-12T18:35:25.655595+0000","last_undegraded":"2024-09-12T18:35:25.655595+0000","last_fullsized":"2024-09-12T18:35:25.655595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:21.445401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.635569+0000","last_change":"2024-09-12T18:35:24.657665+0000","last_active":"2024-09-12T18:35:25.635569+0000","last_peered":"2024-09-12T18:35:25.635569+0000","last_clean":"2024-09-12T18:35:25.635569+0000","last_became_active":"2024-09-12T18:35:24.657015+0000","last_became_peered":"2024-09-12T18:35:24.657015+0000","last_unstale":"2024-09-12T18:35:25.635569+0000","last_undegraded":"2024-09-12T18:35:25.635569+0000","last_fullsized":"2024-09-12T18:35:25.635569+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:03.171326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.668848+0000","last_change":"2024-09-12T18:35:25.665275+0000","last_active":"2024-09-12T18:35:25.668848+0000","last_peered":"2024-09-12T18:35:25.668848+0000","last_clean":"2024-09-12T18:35:25.668848+0000","last_became_active":"2024-09-12T18:35:25.659511+0000","last_became_peered":"2024-09-12T18:35:25.659511+0000","last_unstale":"2024-09-12T18:35:25.668848+0000","last_undegraded":"2024-09-12T18:35:25.668848+0000","last_fullsized":"2024-09-12T18:35:25.668848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:39.035368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.670534+0000","last_change":"2024-09-12T18:35:24.651913+0000","last_active":"2024-09-12T18:35:25.670534+0000","last_peered":"2024-09-12T18:35:25.670534+0000","last_clean":"2024-09-12T18:35:25.670534+0000","last_became_active":"2024-09-12T18:35:24.650421+0000","last_became_peered":"2024-09-12T18:35:24.650421+0000","last_unstale":"2024-09-12T18:35:25.670534+0000","last_undegraded":"2024-09-12T18:35:25.670534+0000","last_fullsized":"2024-09-12T18:35:25.670534+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:57.685312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.655649+0000","last_change":"2024-09-12T18:35:25.651138+0000","last_active":"2024-09-12T18:35:25.655649+0000","last_peered":"2024-09-12T18:35:25.655649+0000","last_clean":"2024-09-12T18:35:25.655649+0000","last_became_active":"2024-09-12T18:35:25.650617+0000","last_became_peered":"2024-09-12T18:35:25.650617+0000","last_unstale":"2024-09-12T18:35:25.655649+0000","last_undegraded":"2024-09-12T18:35:25.655649+0000","last_fullsized":"2024-09-12T18:35:25.655649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:59.531762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.629899+0000","last_change":"2024-09-12T18:35:24.659019+0000","last_active":"2024-09-12T18:35:25.629899+0000","last_peered":"2024-09-12T18:35:25.629899+0000","last_clean":"2024-09-12T18:35:25.629899+0000","last_became_active":"2024-09-12T18:35:24.658423+0000","last_became_peered":"2024-09-12T18:35:24.658423+0000","last_unstale":"2024-09-12T18:35:25.629899+0000","last_undegraded":"2024-09-12T18:35:25.629899+0000","last_fullsized":"2024-09-12T18:35:25.629899+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:37.668417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671592+0000","last_change":"2024-09-12T18:35:25.662287+0000","last_active":"2024-09-12T18:35:25.671592+0000","last_peered":"2024-09-12T18:35:25.671592+0000","last_clean":"2024-09-12T18:35:25.671592+0000","last_became_active":"2024-09-12T18:35:25.660372+0000","last_became_peered":"2024-09-12T18:35:25.660372+0000","last_unstale":"2024-09-12T18:35:25.671592+0000","last_undegraded":"2024-09-12T18:35:25.671592+0000","last_fullsized":"2024-09-12T18:35:25.671592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:14.114092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:23.596638+0000","last_change":"2024-09-12T18:35:23.596638+0000","last_active":"2024-09-12T18:35:23.596638+0000","last_peered":"2024-09-12T18:35:23.596638+0000","last_clean":"2024-09-12T18:35:23.596638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:23.596638+0000","last_undegraded":"2024-09-12T18:35:23.596638+0000","last_fullsized":"2024-09-12T18:35:23.596638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.670729+0000","last_change":"2024-09-12T18:35:25.658674+0000","last_active":"2024-09-12T18:35:25.670729+0000","last_peered":"2024-09-12T18:35:25.670729+0000","last_clean":"2024-09-12T18:35:25.670729+0000","last_became_active":"2024-09-12T18:35:25.657386+0000","last_became_peered":"2024-09-12T18:35:25.657386+0000","last_unstale":"2024-09-12T18:35:25.670729+0000","last_undegraded":"2024-09-12T18:35:25.670729+0000","last_fullsized":"2024-09-12T18:35:25.670729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:40.531922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:23.596638+0000","last_change":"2024-09-12T18:35:23.596638+0000","last_active":"2024-09-12T18:35:23.596638+0000","last_peered":"2024-09-12T18:35:23.596638+0000","last_clean":"2024-09-12T18:35:23.596638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:23.596638+0000","last_undegraded":"2024-09-12T18:35:23.596638+0000","last_fullsized":"2024-09-12T18:35:23.596638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.670432+0000","last_change":"2024-09-12T18:35:25.667710+0000","last_active":"2024-09-12T18:35:25.670432+0000","last_peered":"2024-09-12T18:35:25.670432+0000","last_clean":"2024-09-12T18:35:25.670432+0000","last_became_active":"2024-09-12T18:35:25.666940+0000","last_became_peered":"2024-09-12T18:35:25.666940+0000","last_unstale":"2024-09-12T18:35:25.670432+0000","last_undegraded":"2024-09-12T18:35:25.670432+0000","last_fullsized":"2024-09-12T18:35:25.670432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:16.315533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":163,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.635860+0000","last_change":"2024-09-12T18:35:13.489018+0000","last_active":"2024-09-12T18:35:25.635860+0000","last_peered":"2024-09-12T18:35:25.635860+0000","last_clean":"2024-09-12T18:35:25.635860+0000","last_became_active":"2024-09-12T18:35:13.488346+0000","last_became_peered":"2024-09-12T18:35:13.488346+0000","last_unstale":"2024-09-12T18:35:25.635860+0000","last_undegraded":"2024-09-12T18:35:25.635860+0000","last_fullsized":"2024-09-12T18:35:25.635860+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_clean_scrub_stamp":"2024-09-12T18:35:12.464628+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:54.864640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":27,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.635387+0000","last_change":"2024-09-12T18:35:22.459694+0000","last_active":"2024-09-12T18:35:25.635387+0000","last_peered":"2024-09-12T18:35:25.635387+0000","last_clean":"2024-09-12T18:35:25.635387+0000","last_became_active":"2024-09-12T18:35:20.446796+0000","last_became_peered":"2024-09-12T18:35:20.446796+0000","last_unstale":"2024-09-12T18:35:25.635387+0000","last_undegraded":"2024-09-12T18:35:25.635387+0000","last_fullsized":"2024-09-12T18:35:25.635387+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:21.506024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016291610000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.645967+0000","last_change":"2024-09-12T18:35:24.651749+0000","last_active":"2024-09-12T18:35:25.645967+0000","last_peered":"2024-09-12T18:35:25.645967+0000","last_clean":"2024-09-12T18:35:25.645967+0000","last_became_active":"2024-09-12T18:35:24.649860+0000","last_became_peered":"2024-09-12T18:35:24.649860+0000","last_unstale":"2024-09-12T18:35:25.645967+0000","last_undegraded":"2024-09-12T18:35:25.645967+0000","last_fullsized":"2024-09-12T18:35:25.645967+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:35.430065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671637+0000","last_change":"2024-09-12T18:35:25.662424+0000","last_active":"2024-09-12T18:35:25.671637+0000","last_peered":"2024-09-12T18:35:25.671637+0000","last_clean":"2024-09-12T18:35:25.671637+0000","last_became_active":"2024-09-12T18:35:25.661043+0000","last_became_peered":"2024-09-12T18:35:25.661043+0000","last_unstale":"2024-09-12T18:35:25.671637+0000","last_undegraded":"2024-09-12T18:35:25.671637+0000","last_fullsized":"2024-09-12T18:35:25.671637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:05.846676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.632239+0000","last_change":"2024-09-12T18:35:22.459090+0000","last_active":"2024-09-12T18:35:25.632239+0000","last_peered":"2024-09-12T18:35:25.632239+0000","last_clean":"2024-09-12T18:35:25.632239+0000","last_became_active":"2024-09-12T18:35:20.448553+0000","last_became_peered":"2024-09-12T18:35:20.448553+0000","last_unstale":"2024-09-12T18:35:25.632239+0000","last_undegraded":"2024-09-12T18:35:25.632239+0000","last_fullsized":"2024-09-12T18:35:25.632239+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:56.834808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001030836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.645664+0000","last_change":"2024-09-12T18:35:24.651597+0000","last_active":"2024-09-12T18:35:25.645664+0000","last_peered":"2024-09-12T18:35:25.645664+0000","last_clean":"2024-09-12T18:35:25.645664+0000","last_became_active":"2024-09-12T18:35:24.649940+0000","last_became_peered":"2024-09-12T18:35:24.649940+0000","last_unstale":"2024-09-12T18:35:25.645664+0000","last_undegraded":"2024-09-12T18:35:25.645664+0000","last_fullsized":"2024-09-12T18:35:25.645664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:36.822432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.645308+0000","last_change":"2024-09-12T18:35:22.464179+0000","last_active":"2024-09-12T18:35:25.645308+0000","last_peered":"2024-09-12T18:35:25.645308+0000","last_clean":"2024-09-12T18:35:25.645308+0000","last_became_active":"2024-09-12T18:35:20.442613+0000","last_became_peered":"2024-09-12T18:35:20.442613+0000","last_unstale":"2024-09-12T18:35:25.645308+0000","last_undegraded":"2024-09-12T18:35:25.645308+0000","last_fullsized":"2024-09-12T18:35:25.645308+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:17.636537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014134620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:23.596638+0000","last_change":"2024-09-12T18:35:23.596638+0000","last_active":"2024-09-12T18:35:23.596638+0000","last_peered":"2024-09-12T18:35:23.596638+0000","last_clean":"2024-09-12T18:35:23.596638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:23.596638+0000","last_undegraded":"2024-09-12T18:35:23.596638+0000","last_fullsized":"2024-09-12T18:35:23.596638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.666913+0000","last_change":"2024-09-12T18:35:25.659209+0000","last_active":"2024-09-12T18:35:25.666913+0000","last_peered":"2024-09-12T18:35:25.666913+0000","last_clean":"2024-09-12T18:35:25.666913+0000","last_became_active":"2024-09-12T18:35:25.656170+0000","last_became_peered":"2024-09-12T18:35:25.656170+0000","last_unstale":"2024-09-12T18:35:25.666913+0000","last_undegraded":"2024-09-12T18:35:25.666913+0000","last_fullsized":"2024-09-12T18:35:25.666913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:40.344068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":28,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.629469+0000","last_change":"2024-09-12T18:35:22.459049+0000","last_active":"2024-09-12T18:35:25.629469+0000","last_peered":"2024-09-12T18:35:25.629469+0000","last_clean":"2024-09-12T18:35:25.629469+0000","last_became_active":"2024-09-12T18:35:20.446814+0000","last_became_peered":"2024-09-12T18:35:20.446814+0000","last_unstale":"2024-09-12T18:35:25.629469+0000","last_undegraded":"2024-09-12T18:35:25.629469+0000","last_fullsized":"2024-09-12T18:35:25.629469+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:18.033595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010716149999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.635381+0000","last_change":"2024-09-12T18:35:24.658273+0000","last_active":"2024-09-12T18:35:25.635381+0000","last_peered":"2024-09-12T18:35:25.635381+0000","last_clean":"2024-09-12T18:35:25.635381+0000","last_became_active":"2024-09-12T18:35:24.657433+0000","last_became_peered":"2024-09-12T18:35:24.657433+0000","last_unstale":"2024-09-12T18:35:25.635381+0000","last_undegraded":"2024-09-12T18:35:25.635381+0000","last_fullsized":"2024-09-12T18:35:25.635381+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:48.497218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.663537+0000","last_change":"2024-09-12T18:35:25.655830+0000","last_active":"2024-09-12T18:35:25.663537+0000","last_peered":"2024-09-12T18:35:25.663537+0000","last_clean":"2024-09-12T18:35:25.663537+0000","last_became_active":"2024-09-12T18:35:25.652126+0000","last_became_peered":"2024-09-12T18:35:25.652126+0000","last_unstale":"2024-09-12T18:35:25.663537+0000","last_undegraded":"2024-09-12T18:35:25.663537+0000","last_fullsized":"2024-09-12T18:35:25.663537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:33.679281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.635489+0000","last_change":"2024-09-12T18:35:24.657618+0000","last_active":"2024-09-12T18:35:25.635489+0000","last_peered":"2024-09-12T18:35:25.635489+0000","last_clean":"2024-09-12T18:35:25.635489+0000","last_became_active":"2024-09-12T18:35:24.656741+0000","last_became_peered":"2024-09-12T18:35:24.656741+0000","last_unstale":"2024-09-12T18:35:25.635489+0000","last_undegraded":"2024-09-12T18:35:25.635489+0000","last_fullsized":"2024-09-12T18:35:25.635489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:43.113104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.647145+0000","last_change":"2024-09-12T18:35:22.464180+0000","last_active":"2024-09-12T18:35:25.647145+0000","last_peered":"2024-09-12T18:35:25.647145+0000","last_clean":"2024-09-12T18:35:25.647145+0000","last_became_active":"2024-09-12T18:35:20.442566+0000","last_became_peered":"2024-09-12T18:35:20.442566+0000","last_unstale":"2024-09-12T18:35:25.647145+0000","last_undegraded":"2024-09-12T18:35:25.647145+0000","last_fullsized":"2024-09-12T18:35:25.647145+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:29.021710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001325786,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.647793+0000","last_change":"2024-09-12T18:35:24.649669+0000","last_active":"2024-09-12T18:35:25.647793+0000","last_peered":"2024-09-12T18:35:25.647793+0000","last_clean":"2024-09-12T18:35:25.647793+0000","last_became_active":"2024-09-12T18:35:24.648881+0000","last_became_peered":"2024-09-12T18:35:24.648881+0000","last_unstale":"2024-09-12T18:35:25.647793+0000","last_undegraded":"2024-09-12T18:35:25.647793+0000","last_fullsized":"2024-09-12T18:35:25.647793+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:23.614734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-12T18:35:22.458666+0000","last_change":"2024-09-12T18:35:22.458666+0000","last_active":"2024-09-12T18:35:22.458666+0000","last_peered":"2024-09-12T18:35:22.458666+0000","last_clean":"2024-09-12T18:35:22.458666+0000","last_became_active":"2024-09-12T18:35:20.442394+0000","last_became_peered":"2024-09-12T18:35:20.442394+0000","last_unstale":"2024-09-12T18:35:22.458666+0000","last_undegraded":"2024-09-12T18:35:22.458666+0000","last_fullsized":"2024-09-12T18:35:22.458666+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:51.840246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080163599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.674332+0000","last_change":"2024-09-12T18:35:24.657234+0000","last_active":"2024-09-12T18:35:25.674332+0000","last_peered":"2024-09-12T18:35:25.674332+0000","last_clean":"2024-09-12T18:35:25.674332+0000","last_became_active":"2024-09-12T18:35:24.655950+0000","last_became_peered":"2024-09-12T18:35:24.655950+0000","last_unstale":"2024-09-12T18:35:25.674332+0000","last_undegraded":"2024-09-12T18:35:25.674332+0000","last_fullsized":"2024-09-12T18:35:25.674332+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:17.466623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.647896+0000","last_change":"2024-09-12T18:35:22.464656+0000","last_active":"2024-09-12T18:35:25.647896+0000","last_peered":"2024-09-12T18:35:25.647896+0000","last_clean":"2024-09-12T18:35:25.647896+0000","last_became_active":"2024-09-12T18:35:20.445470+0000","last_became_peered":"2024-09-12T18:35:20.445470+0000","last_unstale":"2024-09-12T18:35:25.647896+0000","last_undegraded":"2024-09-12T18:35:25.647896+0000","last_fullsized":"2024-09-12T18:35:25.647896+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:58.947359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001742681,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.665411+0000","last_change":"2024-09-12T18:35:25.658887+0000","last_active":"2024-09-12T18:35:25.665411+0000","last_peered":"2024-09-12T18:35:25.665411+0000","last_clean":"2024-09-12T18:35:25.665411+0000","last_became_active":"2024-09-12T18:35:25.656829+0000","last_became_peered":"2024-09-12T18:35:25.656829+0000","last_unstale":"2024-09-12T18:35:25.665411+0000","last_undegraded":"2024-09-12T18:35:25.665411+0000","last_fullsized":"2024-09-12T18:35:25.665411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:16.495586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.647739+0000","last_change":"2024-09-12T18:35:24.654518+0000","last_active":"2024-09-12T18:35:25.647739+0000","last_peered":"2024-09-12T18:35:25.647739+0000","last_clean":"2024-09-12T18:35:25.647739+0000","last_became_active":"2024-09-12T18:35:24.650309+0000","last_became_peered":"2024-09-12T18:35:24.650309+0000","last_unstale":"2024-09-12T18:35:25.647739+0000","last_undegraded":"2024-09-12T18:35:25.647739+0000","last_fullsized":"2024-09-12T18:35:25.647739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:16.669035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.629046+0000","last_change":"2024-09-12T18:35:22.459767+0000","last_active":"2024-09-12T18:35:25.629046+0000","last_peered":"2024-09-12T18:35:25.629046+0000","last_clean":"2024-09-12T18:35:25.629046+0000","last_became_active":"2024-09-12T18:35:20.448521+0000","last_became_peered":"2024-09-12T18:35:20.448521+0000","last_unstale":"2024-09-12T18:35:25.629046+0000","last_undegraded":"2024-09-12T18:35:25.629046+0000","last_fullsized":"2024-09-12T18:35:25.629046+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:33.463792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017009670000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671289+0000","last_change":"2024-09-12T18:35:25.660696+0000","last_active":"2024-09-12T18:35:25.671289+0000","last_peered":"2024-09-12T18:35:25.671289+0000","last_clean":"2024-09-12T18:35:25.671289+0000","last_became_active":"2024-09-12T18:35:25.659827+0000","last_became_peered":"2024-09-12T18:35:25.659827+0000","last_unstale":"2024-09-12T18:35:25.671289+0000","last_undegraded":"2024-09-12T18:35:25.671289+0000","last_fullsized":"2024-09-12T18:35:25.671289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:32.995388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.675858+0000","last_change":"2024-09-12T18:35:24.655051+0000","last_active":"2024-09-12T18:35:25.675858+0000","last_peered":"2024-09-12T18:35:25.675858+0000","last_clean":"2024-09-12T18:35:25.675858+0000","last_became_active":"2024-09-12T18:35:24.654282+0000","last_became_peered":"2024-09-12T18:35:24.654282+0000","last_unstale":"2024-09-12T18:35:25.675858+0000","last_undegraded":"2024-09-12T18:35:25.675858+0000","last_fullsized":"2024-09-12T18:35:25.675858+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:08.159799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.665292+0000","last_change":"2024-09-12T18:35:25.659237+0000","last_active":"2024-09-12T18:35:25.665292+0000","last_peered":"2024-09-12T18:35:25.665292+0000","last_clean":"2024-09-12T18:35:25.665292+0000","last_became_active":"2024-09-12T18:35:25.658423+0000","last_became_peered":"2024-09-12T18:35:25.658423+0000","last_unstale":"2024-09-12T18:35:25.665292+0000","last_undegraded":"2024-09-12T18:35:25.665292+0000","last_fullsized":"2024-09-12T18:35:25.665292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:53.450092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:23.596638+0000","last_change":"2024-09-12T18:35:23.596638+0000","last_active":"2024-09-12T18:35:23.596638+0000","last_peered":"2024-09-12T18:35:23.596638+0000","last_clean":"2024-09-12T18:35:23.596638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:23.596638+0000","last_undegraded":"2024-09-12T18:35:23.596638+0000","last_fullsized":"2024-09-12T18:35:23.596638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.628799+0000","last_change":"2024-09-12T18:35:24.656855+0000","last_active":"2024-09-12T18:35:25.628799+0000","last_peered":"2024-09-12T18:35:25.628799+0000","last_clean":"2024-09-12T18:35:25.628799+0000","last_became_active":"2024-09-12T18:35:24.655935+0000","last_became_peered":"2024-09-12T18:35:24.655935+0000","last_unstale":"2024-09-12T18:35:25.628799+0000","last_undegraded":"2024-09-12T18:35:25.628799+0000","last_fullsized":"2024-09-12T18:35:25.628799+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:35.430065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.667632+0000","last_change":"2024-09-12T18:35:25.661801+0000","last_active":"2024-09-12T18:35:25.667632+0000","last_peered":"2024-09-12T18:35:25.667632+0000","last_clean":"2024-09-12T18:35:25.667632+0000","last_became_active":"2024-09-12T18:35:25.658476+0000","last_became_peered":"2024-09-12T18:35:25.658476+0000","last_unstale":"2024-09-12T18:35:25.667632+0000","last_undegraded":"2024-09-12T18:35:25.667632+0000","last_fullsized":"2024-09-12T18:35:25.667632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:22.078004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.650423+0000","last_change":"2024-09-12T18:35:24.652399+0000","last_active":"2024-09-12T18:35:25.650423+0000","last_peered":"2024-09-12T18:35:25.650423+0000","last_clean":"2024-09-12T18:35:25.650423+0000","last_became_active":"2024-09-12T18:35:24.651416+0000","last_became_peered":"2024-09-12T18:35:24.651416+0000","last_unstale":"2024-09-12T18:35:25.650423+0000","last_undegraded":"2024-09-12T18:35:25.650423+0000","last_fullsized":"2024-09-12T18:35:25.650423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:32.594978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.665313+0000","last_change":"2024-09-12T18:35:25.658570+0000","last_active":"2024-09-12T18:35:25.665313+0000","last_peered":"2024-09-12T18:35:25.665313+0000","last_clean":"2024-09-12T18:35:25.665313+0000","last_became_active":"2024-09-12T18:35:25.656561+0000","last_became_peered":"2024-09-12T18:35:25.656561+0000","last_unstale":"2024-09-12T18:35:25.665313+0000","last_undegraded":"2024-09-12T18:35:25.665313+0000","last_fullsized":"2024-09-12T18:35:25.665313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:46.305988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.644984+0000","last_change":"2024-09-12T18:35:24.657489+0000","last_active":"2024-09-12T18:35:25.644984+0000","last_peered":"2024-09-12T18:35:25.644984+0000","last_clean":"2024-09-12T18:35:25.644984+0000","last_became_active":"2024-09-12T18:35:24.656030+0000","last_became_peered":"2024-09-12T18:35:24.656030+0000","last_unstale":"2024-09-12T18:35:25.644984+0000","last_undegraded":"2024-09-12T18:35:25.644984+0000","last_fullsized":"2024-09-12T18:35:25.644984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:11.362759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671748+0000","last_change":"2024-09-12T18:35:25.661544+0000","last_active":"2024-09-12T18:35:25.671748+0000","last_peered":"2024-09-12T18:35:25.671748+0000","last_clean":"2024-09-12T18:35:25.671748+0000","last_became_active":"2024-09-12T18:35:25.656985+0000","last_became_peered":"2024-09-12T18:35:25.656985+0000","last_unstale":"2024-09-12T18:35:25.671748+0000","last_undegraded":"2024-09-12T18:35:25.671748+0000","last_fullsized":"2024-09-12T18:35:25.671748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:31.078781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.645078+0000","last_change":"2024-09-12T18:35:24.646342+0000","last_active":"2024-09-12T18:35:25.645078+0000","last_peered":"2024-09-12T18:35:25.645078+0000","last_clean":"2024-09-12T18:35:25.645078+0000","last_became_active":"2024-09-12T18:35:24.644773+0000","last_became_peered":"2024-09-12T18:35:24.644773+0000","last_unstale":"2024-09-12T18:35:25.645078+0000","last_undegraded":"2024-09-12T18:35:25.645078+0000","last_fullsized":"2024-09-12T18:35:25.645078+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:17.011231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:23.596638+0000","last_change":"2024-09-12T18:35:23.596638+0000","last_active":"2024-09-12T18:35:23.596638+0000","last_peered":"2024-09-12T18:35:23.596638+0000","last_clean":"2024-09-12T18:35:23.596638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:23.596638+0000","last_undegraded":"2024-09-12T18:35:23.596638+0000","last_fullsized":"2024-09-12T18:35:23.596638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:23.596638+0000","last_change":"2024-09-12T18:35:23.596638+0000","last_active":"2024-09-12T18:35:23.596638+0000","last_peered":"2024-09-12T18:35:23.596638+0000","last_clean":"2024-09-12T18:35:23.596638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:23.596638+0000","last_undegraded":"2024-09-12T18:35:23.596638+0000","last_fullsized":"2024-09-12T18:35:23.596638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671662+0000","last_change":"2024-09-12T18:35:25.662537+0000","last_active":"2024-09-12T18:35:25.671662+0000","last_peered":"2024-09-12T18:35:25.671662+0000","last_clean":"2024-09-12T18:35:25.671662+0000","last_became_active":"2024-09-12T18:35:25.661441+0000","last_became_peered":"2024-09-12T18:35:25.661441+0000","last_unstale":"2024-09-12T18:35:25.671662+0000","last_undegraded":"2024-09-12T18:35:25.671662+0000","last_fullsized":"2024-09-12T18:35:25.671662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:34.445331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.667700+0000","last_change":"2024-09-12T18:35:24.657635+0000","last_active":"2024-09-12T18:35:25.667700+0000","last_peered":"2024-09-12T18:35:25.667700+0000","last_clean":"2024-09-12T18:35:25.667700+0000","last_became_active":"2024-09-12T18:35:24.655992+0000","last_became_peered":"2024-09-12T18:35:24.655992+0000","last_unstale":"2024-09-12T18:35:25.667700+0000","last_undegraded":"2024-09-12T18:35:25.667700+0000","last_fullsized":"2024-09-12T18:35:25.667700+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:33.536755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.655697+0000","last_change":"2024-09-12T18:35:25.651406+0000","last_active":"2024-09-12T18:35:25.655697+0000","last_peered":"2024-09-12T18:35:25.655697+0000","last_clean":"2024-09-12T18:35:25.655697+0000","last_became_active":"2024-09-12T18:35:25.649728+0000","last_became_peered":"2024-09-12T18:35:25.649728+0000","last_unstale":"2024-09-12T18:35:25.655697+0000","last_undegraded":"2024-09-12T18:35:25.655697+0000","last_fullsized":"2024-09-12T18:35:25.655697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:53.450092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:23.596638+0000","last_change":"2024-09-12T18:35:23.596638+0000","last_active":"2024-09-12T18:35:23.596638+0000","last_peered":"2024-09-12T18:35:23.596638+0000","last_clean":"2024-09-12T18:35:23.596638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:23.596638+0000","last_undegraded":"2024-09-12T18:35:23.596638+0000","last_fullsized":"2024-09-12T18:35:23.596638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.666379+0000","last_change":"2024-09-12T18:35:24.656268+0000","last_active":"2024-09-12T18:35:25.666379+0000","last_peered":"2024-09-12T18:35:25.666379+0000","last_clean":"2024-09-12T18:35:25.666379+0000","last_became_active":"2024-09-12T18:35:24.655420+0000","last_became_peered":"2024-09-12T18:35:24.655420+0000","last_unstale":"2024-09-12T18:35:25.666379+0000","last_undegraded":"2024-09-12T18:35:25.666379+0000","last_fullsized":"2024-09-12T18:35:25.666379+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:04.654666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671307+0000","last_change":"2024-09-12T18:35:25.661042+0000","last_active":"2024-09-12T18:35:25.671307+0000","last_peered":"2024-09-12T18:35:25.671307+0000","last_clean":"2024-09-12T18:35:25.671307+0000","last_became_active":"2024-09-12T18:35:25.660163+0000","last_became_peered":"2024-09-12T18:35:25.660163+0000","last_unstale":"2024-09-12T18:35:25.671307+0000","last_undegraded":"2024-09-12T18:35:25.671307+0000","last_fullsized":"2024-09-12T18:35:25.671307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:25.387564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.675465+0000","last_change":"2024-09-12T18:35:24.652304+0000","last_active":"2024-09-12T18:35:25.675465+0000","last_peered":"2024-09-12T18:35:25.675465+0000","last_clean":"2024-09-12T18:35:25.675465+0000","last_became_active":"2024-09-12T18:35:24.651460+0000","last_became_peered":"2024-09-12T18:35:24.651460+0000","last_unstale":"2024-09-12T18:35:25.675465+0000","last_undegraded":"2024-09-12T18:35:25.675465+0000","last_fullsized":"2024-09-12T18:35:25.675465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:42.050557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":80,"acting":80,"num_store_stats":2},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2320,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":46,"acting":46,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":196608,"data_stored":631260,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":258048,"data_stored":647469,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":167936,"data_stored":55307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:35:29.354 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3f is not active+clean 2024-09-12T18:35:29.354 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T18:35:24.607229+0000', 'last_change': '2024-09-12T18:35:24.607229+0000', 'last_active': '2024-09-12T18:35:24.607229+0000', 'last_peered': '2024-09-12T18:35:24.607229+0000', 'last_clean': '2024-09-12T18:35:24.607229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T18:35:24.607229+0000', 'last_undegraded': '2024-09-12T18:35:24.607229+0000', 'last_fullsized': '2024-09-12T18:35:24.607229+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_clean_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T18:35:29.354 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3e is not active+clean 2024-09-12T18:35:29.354 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T18:35:24.607229+0000', 'last_change': '2024-09-12T18:35:24.607229+0000', 'last_active': '2024-09-12T18:35:24.607229+0000', 'last_peered': '2024-09-12T18:35:24.607229+0000', 'last_clean': '2024-09-12T18:35:24.607229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T18:35:24.607229+0000', 'last_undegraded': '2024-09-12T18:35:24.607229+0000', 'last_fullsized': '2024-09-12T18:35:24.607229+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_clean_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T18:35:29.354 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3b is not active+clean 2024-09-12T18:35:29.355 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T18:35:24.607229+0000', 'last_change': '2024-09-12T18:35:24.607229+0000', 'last_active': '2024-09-12T18:35:24.607229+0000', 'last_peered': '2024-09-12T18:35:24.607229+0000', 'last_clean': '2024-09-12T18:35:24.607229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T18:35:24.607229+0000', 'last_undegraded': '2024-09-12T18:35:24.607229+0000', 'last_fullsized': '2024-09-12T18:35:24.607229+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_clean_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T18:35:29.355 INFO:tasks.ceph.ceph_manager.ceph:PG 4.36 is not active+clean 2024-09-12T18:35:29.355 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T18:35:24.607229+0000', 'last_change': '2024-09-12T18:35:24.607229+0000', 'last_active': '2024-09-12T18:35:24.607229+0000', 'last_peered': '2024-09-12T18:35:24.607229+0000', 'last_clean': '2024-09-12T18:35:24.607229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T18:35:24.607229+0000', 'last_undegraded': '2024-09-12T18:35:24.607229+0000', 'last_fullsized': '2024-09-12T18:35:24.607229+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_clean_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T18:35:29.355 INFO:tasks.ceph.ceph_manager.ceph:PG 4.34 is not active+clean 2024-09-12T18:35:29.355 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T18:35:24.607229+0000', 'last_change': '2024-09-12T18:35:24.607229+0000', 'last_active': '2024-09-12T18:35:24.607229+0000', 'last_peered': '2024-09-12T18:35:24.607229+0000', 'last_clean': '2024-09-12T18:35:24.607229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T18:35:24.607229+0000', 'last_undegraded': '2024-09-12T18:35:24.607229+0000', 'last_fullsized': '2024-09-12T18:35:24.607229+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_clean_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T18:35:29.356 INFO:tasks.ceph.ceph_manager.ceph:PG 4.33 is not active+clean 2024-09-12T18:35:29.356 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T18:35:24.607229+0000', 'last_change': '2024-09-12T18:35:24.607229+0000', 'last_active': '2024-09-12T18:35:24.607229+0000', 'last_peered': '2024-09-12T18:35:24.607229+0000', 'last_clean': '2024-09-12T18:35:24.607229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T18:35:24.607229+0000', 'last_undegraded': '2024-09-12T18:35:24.607229+0000', 'last_fullsized': '2024-09-12T18:35:24.607229+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_clean_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T18:35:29.356 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2e is not active+clean 2024-09-12T18:35:29.356 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T18:35:24.607229+0000', 'last_change': '2024-09-12T18:35:24.607229+0000', 'last_active': '2024-09-12T18:35:24.607229+0000', 'last_peered': '2024-09-12T18:35:24.607229+0000', 'last_clean': '2024-09-12T18:35:24.607229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T18:35:24.607229+0000', 'last_undegraded': '2024-09-12T18:35:24.607229+0000', 'last_fullsized': '2024-09-12T18:35:24.607229+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_clean_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T18:35:29.356 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2a is not active+clean 2024-09-12T18:35:29.356 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T18:35:24.607229+0000', 'last_change': '2024-09-12T18:35:24.607229+0000', 'last_active': '2024-09-12T18:35:24.607229+0000', 'last_peered': '2024-09-12T18:35:24.607229+0000', 'last_clean': '2024-09-12T18:35:24.607229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T18:35:24.607229+0000', 'last_undegraded': '2024-09-12T18:35:24.607229+0000', 'last_fullsized': '2024-09-12T18:35:24.607229+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_clean_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T18:35:29.356 INFO:tasks.ceph.ceph_manager.ceph:PG 4.28 is not active+clean 2024-09-12T18:35:29.356 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T18:35:24.607229+0000', 'last_change': '2024-09-12T18:35:24.607229+0000', 'last_active': '2024-09-12T18:35:24.607229+0000', 'last_peered': '2024-09-12T18:35:24.607229+0000', 'last_clean': '2024-09-12T18:35:24.607229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T18:35:24.607229+0000', 'last_undegraded': '2024-09-12T18:35:24.607229+0000', 'last_fullsized': '2024-09-12T18:35:24.607229+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_clean_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T18:35:29.356 INFO:tasks.ceph.ceph_manager.ceph:PG 4.27 is not active+clean 2024-09-12T18:35:29.356 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T18:35:24.607229+0000', 'last_change': '2024-09-12T18:35:24.607229+0000', 'last_active': '2024-09-12T18:35:24.607229+0000', 'last_peered': '2024-09-12T18:35:24.607229+0000', 'last_clean': '2024-09-12T18:35:24.607229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T18:35:24.607229+0000', 'last_undegraded': '2024-09-12T18:35:24.607229+0000', 'last_fullsized': '2024-09-12T18:35:24.607229+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_clean_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T18:35:29.357 INFO:tasks.ceph.ceph_manager.ceph:PG 4.24 is not active+clean 2024-09-12T18:35:29.357 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T18:35:24.607229+0000', 'last_change': '2024-09-12T18:35:24.607229+0000', 'last_active': '2024-09-12T18:35:24.607229+0000', 'last_peered': '2024-09-12T18:35:24.607229+0000', 'last_clean': '2024-09-12T18:35:24.607229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T18:35:24.607229+0000', 'last_undegraded': '2024-09-12T18:35:24.607229+0000', 'last_fullsized': '2024-09-12T18:35:24.607229+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_clean_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T18:35:29.357 INFO:tasks.ceph.ceph_manager.ceph:PG 4.22 is not active+clean 2024-09-12T18:35:29.357 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T18:35:24.607229+0000', 'last_change': '2024-09-12T18:35:24.607229+0000', 'last_active': '2024-09-12T18:35:24.607229+0000', 'last_peered': '2024-09-12T18:35:24.607229+0000', 'last_clean': '2024-09-12T18:35:24.607229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T18:35:24.607229+0000', 'last_undegraded': '2024-09-12T18:35:24.607229+0000', 'last_fullsized': '2024-09-12T18:35:24.607229+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_clean_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T18:35:29.357 INFO:tasks.ceph.ceph_manager.ceph:PG 4.14 is not active+clean 2024-09-12T18:35:29.357 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T18:35:24.607229+0000', 'last_change': '2024-09-12T18:35:24.607229+0000', 'last_active': '2024-09-12T18:35:24.607229+0000', 'last_peered': '2024-09-12T18:35:24.607229+0000', 'last_clean': '2024-09-12T18:35:24.607229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T18:35:24.607229+0000', 'last_undegraded': '2024-09-12T18:35:24.607229+0000', 'last_fullsized': '2024-09-12T18:35:24.607229+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_clean_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T18:35:29.357 INFO:tasks.ceph.ceph_manager.ceph:PG 4.15 is not active+clean 2024-09-12T18:35:29.357 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T18:35:24.607229+0000', 'last_change': '2024-09-12T18:35:24.607229+0000', 'last_active': '2024-09-12T18:35:24.607229+0000', 'last_peered': '2024-09-12T18:35:24.607229+0000', 'last_clean': '2024-09-12T18:35:24.607229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T18:35:24.607229+0000', 'last_undegraded': '2024-09-12T18:35:24.607229+0000', 'last_fullsized': '2024-09-12T18:35:24.607229+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_clean_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T18:35:29.358 INFO:tasks.ceph.ceph_manager.ceph:PG 3.11 is not active+clean 2024-09-12T18:35:29.358 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T18:35:23.596638+0000', 'last_change': '2024-09-12T18:35:23.596638+0000', 'last_active': '2024-09-12T18:35:23.596638+0000', 'last_peered': '2024-09-12T18:35:23.596638+0000', 'last_clean': '2024-09-12T18:35:23.596638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T18:35:23.596638+0000', 'last_undegraded': '2024-09-12T18:35:23.596638+0000', 'last_fullsized': '2024-09-12T18:35:23.596638+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T18:35:23.596638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T18:35:23.596638+0000', 'last_clean_scrub_stamp': '2024-09-12T18:35:23.596638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T18:35:29.358 INFO:tasks.ceph.ceph_manager.ceph:PG 4.8 is not active+clean 2024-09-12T18:35:29.359 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T18:35:24.607229+0000', 'last_change': '2024-09-12T18:35:24.607229+0000', 'last_active': '2024-09-12T18:35:24.607229+0000', 'last_peered': '2024-09-12T18:35:24.607229+0000', 'last_clean': '2024-09-12T18:35:24.607229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T18:35:24.607229+0000', 'last_undegraded': '2024-09-12T18:35:24.607229+0000', 'last_fullsized': '2024-09-12T18:35:24.607229+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_clean_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T18:35:29.359 INFO:tasks.ceph.ceph_manager.ceph:PG 3.e is not active+clean 2024-09-12T18:35:29.359 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T18:35:23.596638+0000', 'last_change': '2024-09-12T18:35:23.596638+0000', 'last_active': '2024-09-12T18:35:23.596638+0000', 'last_peered': '2024-09-12T18:35:23.596638+0000', 'last_clean': '2024-09-12T18:35:23.596638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T18:35:23.596638+0000', 'last_undegraded': '2024-09-12T18:35:23.596638+0000', 'last_fullsized': '2024-09-12T18:35:23.596638+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T18:35:23.596638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T18:35:23.596638+0000', 'last_clean_scrub_stamp': '2024-09-12T18:35:23.596638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T18:35:29.359 INFO:tasks.ceph.ceph_manager.ceph:PG 4.9 is not active+clean 2024-09-12T18:35:29.359 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T18:35:24.607229+0000', 'last_change': '2024-09-12T18:35:24.607229+0000', 'last_active': '2024-09-12T18:35:24.607229+0000', 'last_peered': '2024-09-12T18:35:24.607229+0000', 'last_clean': '2024-09-12T18:35:24.607229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T18:35:24.607229+0000', 'last_undegraded': '2024-09-12T18:35:24.607229+0000', 'last_fullsized': '2024-09-12T18:35:24.607229+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_clean_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T18:35:29.360 INFO:tasks.ceph.ceph_manager.ceph:PG 3.9 is not active+clean 2024-09-12T18:35:29.360 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T18:35:23.596638+0000', 'last_change': '2024-09-12T18:35:23.596638+0000', 'last_active': '2024-09-12T18:35:23.596638+0000', 'last_peered': '2024-09-12T18:35:23.596638+0000', 'last_clean': '2024-09-12T18:35:23.596638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T18:35:23.596638+0000', 'last_undegraded': '2024-09-12T18:35:23.596638+0000', 'last_fullsized': '2024-09-12T18:35:23.596638+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T18:35:23.596638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T18:35:23.596638+0000', 'last_clean_scrub_stamp': '2024-09-12T18:35:23.596638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T18:35:29.360 INFO:tasks.ceph.ceph_manager.ceph:PG 3.8 is not active+clean 2024-09-12T18:35:29.360 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T18:35:23.596638+0000', 'last_change': '2024-09-12T18:35:23.596638+0000', 'last_active': '2024-09-12T18:35:23.596638+0000', 'last_peered': '2024-09-12T18:35:23.596638+0000', 'last_clean': '2024-09-12T18:35:23.596638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T18:35:23.596638+0000', 'last_undegraded': '2024-09-12T18:35:23.596638+0000', 'last_fullsized': '2024-09-12T18:35:23.596638+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T18:35:23.596638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T18:35:23.596638+0000', 'last_clean_scrub_stamp': '2024-09-12T18:35:23.596638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T18:35:29.360 INFO:tasks.ceph.ceph_manager.ceph:PG 4.6 is not active+clean 2024-09-12T18:35:29.360 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T18:35:24.607229+0000', 'last_change': '2024-09-12T18:35:24.607229+0000', 'last_active': '2024-09-12T18:35:24.607229+0000', 'last_peered': '2024-09-12T18:35:24.607229+0000', 'last_clean': '2024-09-12T18:35:24.607229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T18:35:24.607229+0000', 'last_undegraded': '2024-09-12T18:35:24.607229+0000', 'last_fullsized': '2024-09-12T18:35:24.607229+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_clean_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T18:35:29.361 INFO:tasks.ceph.ceph_manager.ceph:PG 3.0 is not active+clean 2024-09-12T18:35:29.361 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T18:35:23.596638+0000', 'last_change': '2024-09-12T18:35:23.596638+0000', 'last_active': '2024-09-12T18:35:23.596638+0000', 'last_peered': '2024-09-12T18:35:23.596638+0000', 'last_clean': '2024-09-12T18:35:23.596638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T18:35:23.596638+0000', 'last_undegraded': '2024-09-12T18:35:23.596638+0000', 'last_fullsized': '2024-09-12T18:35:23.596638+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T18:35:23.596638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T18:35:23.596638+0000', 'last_clean_scrub_stamp': '2024-09-12T18:35:23.596638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T18:35:29.361 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2 is not active+clean 2024-09-12T18:35:29.361 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T18:35:24.607229+0000', 'last_change': '2024-09-12T18:35:24.607229+0000', 'last_active': '2024-09-12T18:35:24.607229+0000', 'last_peered': '2024-09-12T18:35:24.607229+0000', 'last_clean': '2024-09-12T18:35:24.607229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T18:35:24.607229+0000', 'last_undegraded': '2024-09-12T18:35:24.607229+0000', 'last_fullsized': '2024-09-12T18:35:24.607229+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_clean_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T18:35:29.361 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3 is not active+clean 2024-09-12T18:35:29.361 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T18:35:24.607229+0000', 'last_change': '2024-09-12T18:35:24.607229+0000', 'last_active': '2024-09-12T18:35:24.607229+0000', 'last_peered': '2024-09-12T18:35:24.607229+0000', 'last_clean': '2024-09-12T18:35:24.607229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T18:35:24.607229+0000', 'last_undegraded': '2024-09-12T18:35:24.607229+0000', 'last_fullsized': '2024-09-12T18:35:24.607229+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_clean_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T18:35:29.361 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1 is not active+clean 2024-09-12T18:35:29.361 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T18:35:24.607229+0000', 'last_change': '2024-09-12T18:35:24.607229+0000', 'last_active': '2024-09-12T18:35:24.607229+0000', 'last_peered': '2024-09-12T18:35:24.607229+0000', 'last_clean': '2024-09-12T18:35:24.607229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T18:35:24.607229+0000', 'last_undegraded': '2024-09-12T18:35:24.607229+0000', 'last_fullsized': '2024-09-12T18:35:24.607229+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_clean_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T18:35:29.361 INFO:tasks.ceph.ceph_manager.ceph:PG 3.15 is not active+clean 2024-09-12T18:35:29.362 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T18:35:23.596638+0000', 'last_change': '2024-09-12T18:35:23.596638+0000', 'last_active': '2024-09-12T18:35:23.596638+0000', 'last_peered': '2024-09-12T18:35:23.596638+0000', 'last_clean': '2024-09-12T18:35:23.596638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T18:35:23.596638+0000', 'last_undegraded': '2024-09-12T18:35:23.596638+0000', 'last_fullsized': '2024-09-12T18:35:23.596638+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T18:35:23.596638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T18:35:23.596638+0000', 'last_clean_scrub_stamp': '2024-09-12T18:35:23.596638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T18:35:29.362 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1f is not active+clean 2024-09-12T18:35:29.362 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T18:35:24.607229+0000', 'last_change': '2024-09-12T18:35:24.607229+0000', 'last_active': '2024-09-12T18:35:24.607229+0000', 'last_peered': '2024-09-12T18:35:24.607229+0000', 'last_clean': '2024-09-12T18:35:24.607229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T18:35:24.607229+0000', 'last_undegraded': '2024-09-12T18:35:24.607229+0000', 'last_fullsized': '2024-09-12T18:35:24.607229+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_clean_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T18:35:29.362 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1d is not active+clean 2024-09-12T18:35:29.362 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T18:35:24.607229+0000', 'last_change': '2024-09-12T18:35:24.607229+0000', 'last_active': '2024-09-12T18:35:24.607229+0000', 'last_peered': '2024-09-12T18:35:24.607229+0000', 'last_clean': '2024-09-12T18:35:24.607229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T18:35:24.607229+0000', 'last_undegraded': '2024-09-12T18:35:24.607229+0000', 'last_fullsized': '2024-09-12T18:35:24.607229+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_clean_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T18:35:29.362 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1a is not active+clean 2024-09-12T18:35:29.362 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T18:35:23.596638+0000', 'last_change': '2024-09-12T18:35:23.596638+0000', 'last_active': '2024-09-12T18:35:23.596638+0000', 'last_peered': '2024-09-12T18:35:23.596638+0000', 'last_clean': '2024-09-12T18:35:23.596638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T18:35:23.596638+0000', 'last_undegraded': '2024-09-12T18:35:23.596638+0000', 'last_fullsized': '2024-09-12T18:35:23.596638+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T18:35:23.596638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T18:35:23.596638+0000', 'last_clean_scrub_stamp': '2024-09-12T18:35:23.596638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T18:35:29.362 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1c is not active+clean 2024-09-12T18:35:29.362 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T18:35:24.607229+0000', 'last_change': '2024-09-12T18:35:24.607229+0000', 'last_active': '2024-09-12T18:35:24.607229+0000', 'last_peered': '2024-09-12T18:35:24.607229+0000', 'last_clean': '2024-09-12T18:35:24.607229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T18:35:24.607229+0000', 'last_undegraded': '2024-09-12T18:35:24.607229+0000', 'last_fullsized': '2024-09-12T18:35:24.607229+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_clean_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T18:35:29.362 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1b is not active+clean 2024-09-12T18:35:29.362 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T18:35:23.596638+0000', 'last_change': '2024-09-12T18:35:23.596638+0000', 'last_active': '2024-09-12T18:35:23.596638+0000', 'last_peered': '2024-09-12T18:35:23.596638+0000', 'last_clean': '2024-09-12T18:35:23.596638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T18:35:23.596638+0000', 'last_undegraded': '2024-09-12T18:35:23.596638+0000', 'last_fullsized': '2024-09-12T18:35:23.596638+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T18:35:23.596638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T18:35:23.596638+0000', 'last_clean_scrub_stamp': '2024-09-12T18:35:23.596638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T18:35:29.363 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1d is not active+clean 2024-09-12T18:35:29.363 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T18:35:23.596638+0000', 'last_change': '2024-09-12T18:35:23.596638+0000', 'last_active': '2024-09-12T18:35:23.596638+0000', 'last_peered': '2024-09-12T18:35:23.596638+0000', 'last_clean': '2024-09-12T18:35:23.596638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T18:35:23.596638+0000', 'last_undegraded': '2024-09-12T18:35:23.596638+0000', 'last_fullsized': '2024-09-12T18:35:23.596638+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T18:35:23.596638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T18:35:23.596638+0000', 'last_clean_scrub_stamp': '2024-09-12T18:35:23.596638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T18:35:29.363 INFO:tasks.ceph.ceph_manager.ceph:PG 4.19 is not active+clean 2024-09-12T18:35:29.363 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T18:35:24.607229+0000', 'last_change': '2024-09-12T18:35:24.607229+0000', 'last_active': '2024-09-12T18:35:24.607229+0000', 'last_peered': '2024-09-12T18:35:24.607229+0000', 'last_clean': '2024-09-12T18:35:24.607229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T18:35:24.607229+0000', 'last_undegraded': '2024-09-12T18:35:24.607229+0000', 'last_fullsized': '2024-09-12T18:35:24.607229+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'last_clean_scrub_stamp': '2024-09-12T18:35:24.607229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T18:35:29.363 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T18:35:29.743 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:35:29.743 INFO:teuthology.orchestra.run.smithi073.stdout:{"fsid":"c08d5a84-711b-44bf-bdf1-e06ecc2c7c00","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":27,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":19,"num_osds":3,"num_up_osds":3,"osd_up_since":1726166112,"num_in_osds":3,"osd_in_since":1726166104,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":72},{"state_name":"unknown","count":33}],"num_pgs":105,"num_pools":4,"num_objects":21,"data_bytes":592707,"bytes_used":87932928,"bytes_avail":289822359552,"bytes_total":289910292480,"unknown_pgs_ratio":0.31428572535514832,"write_bytes_sec":3008,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":5,"btime":"2024-09-12T18:35:27:637181+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4211}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-12T18:35:02.697924+0000","services":{}},"progress_events":{}} 2024-09-12T18:35:29.760 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-12T18:35:29.760 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:35:30.044 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:35:30.046 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T18:35:30.060 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-12T18:35:28.376312+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592707,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":181,"num_write_kb":2687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":144,"acting":144,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":72,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":85872,"kb_used_data":608,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283029648,"statfs":{"total":289910292480,"available":289822359552,"internally_reserved":0,"allocated":622592,"data_stored":1334036,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4783,"internal_metadata":87223633},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2331,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.765854"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.670958+0000","last_change":"2024-09-12T18:35:25.659460+0000","last_active":"2024-09-12T18:35:25.670958+0000","last_peered":"2024-09-12T18:35:25.670958+0000","last_clean":"2024-09-12T18:35:25.670958+0000","last_became_active":"2024-09-12T18:35:25.657782+0000","last_became_peered":"2024-09-12T18:35:25.657782+0000","last_unstale":"2024-09-12T18:35:25.670958+0000","last_undegraded":"2024-09-12T18:35:25.670958+0000","last_fullsized":"2024-09-12T18:35:25.670958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:56.799067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671805+0000","last_change":"2024-09-12T18:35:25.663617+0000","last_active":"2024-09-12T18:35:25.671805+0000","last_peered":"2024-09-12T18:35:25.671805+0000","last_clean":"2024-09-12T18:35:25.671805+0000","last_became_active":"2024-09-12T18:35:25.661977+0000","last_became_peered":"2024-09-12T18:35:25.661977+0000","last_unstale":"2024-09-12T18:35:25.671805+0000","last_undegraded":"2024-09-12T18:35:25.671805+0000","last_fullsized":"2024-09-12T18:35:25.671805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:02.792152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.655766+0000","last_change":"2024-09-12T18:35:25.652754+0000","last_active":"2024-09-12T18:35:25.655766+0000","last_peered":"2024-09-12T18:35:25.655766+0000","last_clean":"2024-09-12T18:35:25.655766+0000","last_became_active":"2024-09-12T18:35:25.651217+0000","last_became_peered":"2024-09-12T18:35:25.651217+0000","last_unstale":"2024-09-12T18:35:25.655766+0000","last_undegraded":"2024-09-12T18:35:25.655766+0000","last_fullsized":"2024-09-12T18:35:25.655766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:17.007002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671054+0000","last_change":"2024-09-12T18:35:25.659811+0000","last_active":"2024-09-12T18:35:25.671054+0000","last_peered":"2024-09-12T18:35:25.671054+0000","last_clean":"2024-09-12T18:35:25.671054+0000","last_became_active":"2024-09-12T18:35:25.658998+0000","last_became_peered":"2024-09-12T18:35:25.658998+0000","last_unstale":"2024-09-12T18:35:25.671054+0000","last_undegraded":"2024-09-12T18:35:25.671054+0000","last_fullsized":"2024-09-12T18:35:25.671054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:12.891661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.655902+0000","last_change":"2024-09-12T18:35:25.653999+0000","last_active":"2024-09-12T18:35:25.655902+0000","last_peered":"2024-09-12T18:35:25.655902+0000","last_clean":"2024-09-12T18:35:25.655902+0000","last_became_active":"2024-09-12T18:35:25.653319+0000","last_became_peered":"2024-09-12T18:35:25.653319+0000","last_unstale":"2024-09-12T18:35:25.655902+0000","last_undegraded":"2024-09-12T18:35:25.655902+0000","last_fullsized":"2024-09-12T18:35:25.655902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:31.096877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.670527+0000","last_change":"2024-09-12T18:35:25.668339+0000","last_active":"2024-09-12T18:35:25.670527+0000","last_peered":"2024-09-12T18:35:25.670527+0000","last_clean":"2024-09-12T18:35:25.670527+0000","last_became_active":"2024-09-12T18:35:25.667608+0000","last_became_peered":"2024-09-12T18:35:25.667608+0000","last_unstale":"2024-09-12T18:35:25.670527+0000","last_undegraded":"2024-09-12T18:35:25.670527+0000","last_fullsized":"2024-09-12T18:35:25.670527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:52.466349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.655517+0000","last_change":"2024-09-12T18:35:25.649858+0000","last_active":"2024-09-12T18:35:25.655517+0000","last_peered":"2024-09-12T18:35:25.655517+0000","last_clean":"2024-09-12T18:35:25.655517+0000","last_became_active":"2024-09-12T18:35:25.649090+0000","last_became_peered":"2024-09-12T18:35:25.649090+0000","last_unstale":"2024-09-12T18:35:25.655517+0000","last_undegraded":"2024-09-12T18:35:25.655517+0000","last_fullsized":"2024-09-12T18:35:25.655517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:42.675921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.666461+0000","last_change":"2024-09-12T18:35:25.657913+0000","last_active":"2024-09-12T18:35:25.666461+0000","last_peered":"2024-09-12T18:35:25.666461+0000","last_clean":"2024-09-12T18:35:25.666461+0000","last_became_active":"2024-09-12T18:35:25.657082+0000","last_became_peered":"2024-09-12T18:35:25.657082+0000","last_unstale":"2024-09-12T18:35:25.666461+0000","last_undegraded":"2024-09-12T18:35:25.666461+0000","last_fullsized":"2024-09-12T18:35:25.666461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:36.452006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.670741+0000","last_change":"2024-09-12T18:35:25.658763+0000","last_active":"2024-09-12T18:35:25.670741+0000","last_peered":"2024-09-12T18:35:25.670741+0000","last_clean":"2024-09-12T18:35:25.670741+0000","last_became_active":"2024-09-12T18:35:25.657508+0000","last_became_peered":"2024-09-12T18:35:25.657508+0000","last_unstale":"2024-09-12T18:35:25.670741+0000","last_undegraded":"2024-09-12T18:35:25.670741+0000","last_fullsized":"2024-09-12T18:35:25.670741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:14.134808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.655848+0000","last_change":"2024-09-12T18:35:25.653730+0000","last_active":"2024-09-12T18:35:25.655848+0000","last_peered":"2024-09-12T18:35:25.655848+0000","last_clean":"2024-09-12T18:35:25.655848+0000","last_became_active":"2024-09-12T18:35:25.651535+0000","last_became_peered":"2024-09-12T18:35:25.651535+0000","last_unstale":"2024-09-12T18:35:25.655848+0000","last_undegraded":"2024-09-12T18:35:25.655848+0000","last_fullsized":"2024-09-12T18:35:25.655848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:37.514843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.666868+0000","last_change":"2024-09-12T18:35:25.656513+0000","last_active":"2024-09-12T18:35:25.666868+0000","last_peered":"2024-09-12T18:35:25.666868+0000","last_clean":"2024-09-12T18:35:25.666868+0000","last_became_active":"2024-09-12T18:35:25.653440+0000","last_became_peered":"2024-09-12T18:35:25.653440+0000","last_unstale":"2024-09-12T18:35:25.666868+0000","last_undegraded":"2024-09-12T18:35:25.666868+0000","last_fullsized":"2024-09-12T18:35:25.666868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:26.721698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.665394+0000","last_change":"2024-09-12T18:35:25.658819+0000","last_active":"2024-09-12T18:35:25.665394+0000","last_peered":"2024-09-12T18:35:25.665394+0000","last_clean":"2024-09-12T18:35:25.665394+0000","last_became_active":"2024-09-12T18:35:25.656843+0000","last_became_peered":"2024-09-12T18:35:25.656843+0000","last_unstale":"2024-09-12T18:35:25.665394+0000","last_undegraded":"2024-09-12T18:35:25.665394+0000","last_fullsized":"2024-09-12T18:35:25.665394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:27:44.442447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671733+0000","last_change":"2024-09-12T18:35:25.661176+0000","last_active":"2024-09-12T18:35:25.671733+0000","last_peered":"2024-09-12T18:35:25.671733+0000","last_clean":"2024-09-12T18:35:25.671733+0000","last_became_active":"2024-09-12T18:35:25.659534+0000","last_became_peered":"2024-09-12T18:35:25.659534+0000","last_unstale":"2024-09-12T18:35:25.671733+0000","last_undegraded":"2024-09-12T18:35:25.671733+0000","last_fullsized":"2024-09-12T18:35:25.671733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:54.580837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.655660+0000","last_change":"2024-09-12T18:35:25.650632+0000","last_active":"2024-09-12T18:35:25.655660+0000","last_peered":"2024-09-12T18:35:25.655660+0000","last_clean":"2024-09-12T18:35:25.655660+0000","last_became_active":"2024-09-12T18:35:25.649333+0000","last_became_peered":"2024-09-12T18:35:25.649333+0000","last_unstale":"2024-09-12T18:35:25.655660+0000","last_undegraded":"2024-09-12T18:35:25.655660+0000","last_fullsized":"2024-09-12T18:35:25.655660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:20.136271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.667558+0000","last_change":"2024-09-12T18:35:25.661613+0000","last_active":"2024-09-12T18:35:25.667558+0000","last_peered":"2024-09-12T18:35:25.667558+0000","last_clean":"2024-09-12T18:35:25.667558+0000","last_became_active":"2024-09-12T18:35:25.658833+0000","last_became_peered":"2024-09-12T18:35:25.658833+0000","last_unstale":"2024-09-12T18:35:25.667558+0000","last_undegraded":"2024-09-12T18:35:25.667558+0000","last_fullsized":"2024-09-12T18:35:25.667558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:37.514843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671782+0000","last_change":"2024-09-12T18:35:25.662414+0000","last_active":"2024-09-12T18:35:25.671782+0000","last_peered":"2024-09-12T18:35:25.671782+0000","last_clean":"2024-09-12T18:35:25.671782+0000","last_became_active":"2024-09-12T18:35:25.660126+0000","last_became_peered":"2024-09-12T18:35:25.660126+0000","last_unstale":"2024-09-12T18:35:25.671782+0000","last_undegraded":"2024-09-12T18:35:25.671782+0000","last_fullsized":"2024-09-12T18:35:25.671782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:05.136469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671510+0000","last_change":"2024-09-12T18:35:25.661523+0000","last_active":"2024-09-12T18:35:25.671510+0000","last_peered":"2024-09-12T18:35:25.671510+0000","last_clean":"2024-09-12T18:35:25.671510+0000","last_became_active":"2024-09-12T18:35:25.659338+0000","last_became_peered":"2024-09-12T18:35:25.659338+0000","last_unstale":"2024-09-12T18:35:25.671510+0000","last_undegraded":"2024-09-12T18:35:25.671510+0000","last_fullsized":"2024-09-12T18:35:25.671510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:12.762819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.667865+0000","last_change":"2024-09-12T18:35:25.662519+0000","last_active":"2024-09-12T18:35:25.667865+0000","last_peered":"2024-09-12T18:35:25.667865+0000","last_clean":"2024-09-12T18:35:25.667865+0000","last_became_active":"2024-09-12T18:35:25.652964+0000","last_became_peered":"2024-09-12T18:35:25.652964+0000","last_unstale":"2024-09-12T18:35:25.667865+0000","last_undegraded":"2024-09-12T18:35:25.667865+0000","last_fullsized":"2024-09-12T18:35:25.667865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:02.929063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.662850+0000","last_change":"2024-09-12T18:35:25.653949+0000","last_active":"2024-09-12T18:35:25.662850+0000","last_peered":"2024-09-12T18:35:25.662850+0000","last_clean":"2024-09-12T18:35:25.662850+0000","last_became_active":"2024-09-12T18:35:25.652992+0000","last_became_peered":"2024-09-12T18:35:25.652992+0000","last_unstale":"2024-09-12T18:35:25.662850+0000","last_undegraded":"2024-09-12T18:35:25.662850+0000","last_fullsized":"2024-09-12T18:35:25.662850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:20.448219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.655784+0000","last_change":"2024-09-12T18:35:25.653159+0000","last_active":"2024-09-12T18:35:25.655784+0000","last_peered":"2024-09-12T18:35:25.655784+0000","last_clean":"2024-09-12T18:35:25.655784+0000","last_became_active":"2024-09-12T18:35:25.650551+0000","last_became_peered":"2024-09-12T18:35:25.650551+0000","last_unstale":"2024-09-12T18:35:25.655784+0000","last_undegraded":"2024-09-12T18:35:25.655784+0000","last_fullsized":"2024-09-12T18:35:25.655784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:45.453862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.667164+0000","last_change":"2024-09-12T18:35:24.657739+0000","last_active":"2024-09-12T18:35:25.667164+0000","last_peered":"2024-09-12T18:35:25.667164+0000","last_clean":"2024-09-12T18:35:25.667164+0000","last_became_active":"2024-09-12T18:35:24.656208+0000","last_became_peered":"2024-09-12T18:35:24.656208+0000","last_unstale":"2024-09-12T18:35:25.667164+0000","last_undegraded":"2024-09-12T18:35:25.667164+0000","last_fullsized":"2024-09-12T18:35:25.667164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:50.073716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.645957+0000","last_change":"2024-09-12T18:35:24.656119+0000","last_active":"2024-09-12T18:35:25.645957+0000","last_peered":"2024-09-12T18:35:25.645957+0000","last_clean":"2024-09-12T18:35:25.645957+0000","last_became_active":"2024-09-12T18:35:24.653175+0000","last_became_peered":"2024-09-12T18:35:24.653175+0000","last_unstale":"2024-09-12T18:35:25.645957+0000","last_undegraded":"2024-09-12T18:35:25.645957+0000","last_fullsized":"2024-09-12T18:35:25.645957+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:00.551165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.663487+0000","last_change":"2024-09-12T18:35:25.655723+0000","last_active":"2024-09-12T18:35:25.663487+0000","last_peered":"2024-09-12T18:35:25.663487+0000","last_clean":"2024-09-12T18:35:25.663487+0000","last_became_active":"2024-09-12T18:35:25.653630+0000","last_became_peered":"2024-09-12T18:35:25.653630+0000","last_unstale":"2024-09-12T18:35:25.663487+0000","last_undegraded":"2024-09-12T18:35:25.663487+0000","last_fullsized":"2024-09-12T18:35:25.663487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:18.567270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:23.596638+0000","last_change":"2024-09-12T18:35:23.596638+0000","last_active":"2024-09-12T18:35:23.596638+0000","last_peered":"2024-09-12T18:35:23.596638+0000","last_clean":"2024-09-12T18:35:23.596638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:23.596638+0000","last_undegraded":"2024-09-12T18:35:23.596638+0000","last_fullsized":"2024-09-12T18:35:23.596638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.669610+0000","last_change":"2024-09-12T18:35:25.662692+0000","last_active":"2024-09-12T18:35:25.669610+0000","last_peered":"2024-09-12T18:35:25.669610+0000","last_clean":"2024-09-12T18:35:25.669610+0000","last_became_active":"2024-09-12T18:35:25.661885+0000","last_became_peered":"2024-09-12T18:35:25.661885+0000","last_unstale":"2024-09-12T18:35:25.669610+0000","last_undegraded":"2024-09-12T18:35:25.669610+0000","last_fullsized":"2024-09-12T18:35:25.669610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:17.050672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.668729+0000","last_change":"2024-09-12T18:35:24.653610+0000","last_active":"2024-09-12T18:35:25.668729+0000","last_peered":"2024-09-12T18:35:25.668729+0000","last_clean":"2024-09-12T18:35:25.668729+0000","last_became_active":"2024-09-12T18:35:24.652880+0000","last_became_peered":"2024-09-12T18:35:24.652880+0000","last_unstale":"2024-09-12T18:35:25.668729+0000","last_undegraded":"2024-09-12T18:35:25.668729+0000","last_fullsized":"2024-09-12T18:35:25.668729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:57.636251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.665457+0000","last_change":"2024-09-12T18:35:24.653465+0000","last_active":"2024-09-12T18:35:25.665457+0000","last_peered":"2024-09-12T18:35:25.665457+0000","last_clean":"2024-09-12T18:35:25.665457+0000","last_became_active":"2024-09-12T18:35:24.652792+0000","last_became_peered":"2024-09-12T18:35:24.652792+0000","last_unstale":"2024-09-12T18:35:25.665457+0000","last_undegraded":"2024-09-12T18:35:25.665457+0000","last_fullsized":"2024-09-12T18:35:25.665457+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:14.588993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:23.596638+0000","last_change":"2024-09-12T18:35:23.596638+0000","last_active":"2024-09-12T18:35:23.596638+0000","last_peered":"2024-09-12T18:35:23.596638+0000","last_clean":"2024-09-12T18:35:23.596638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:23.596638+0000","last_undegraded":"2024-09-12T18:35:23.596638+0000","last_fullsized":"2024-09-12T18:35:23.596638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.665427+0000","last_change":"2024-09-12T18:35:24.654976+0000","last_active":"2024-09-12T18:35:25.665427+0000","last_peered":"2024-09-12T18:35:25.665427+0000","last_clean":"2024-09-12T18:35:25.665427+0000","last_became_active":"2024-09-12T18:35:24.654264+0000","last_became_peered":"2024-09-12T18:35:24.654264+0000","last_unstale":"2024-09-12T18:35:25.665427+0000","last_undegraded":"2024-09-12T18:35:25.665427+0000","last_fullsized":"2024-09-12T18:35:25.665427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:00.115408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.655595+0000","last_change":"2024-09-12T18:35:25.650577+0000","last_active":"2024-09-12T18:35:25.655595+0000","last_peered":"2024-09-12T18:35:25.655595+0000","last_clean":"2024-09-12T18:35:25.655595+0000","last_became_active":"2024-09-12T18:35:25.649172+0000","last_became_peered":"2024-09-12T18:35:25.649172+0000","last_unstale":"2024-09-12T18:35:25.655595+0000","last_undegraded":"2024-09-12T18:35:25.655595+0000","last_fullsized":"2024-09-12T18:35:25.655595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:21.445401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.635569+0000","last_change":"2024-09-12T18:35:24.657665+0000","last_active":"2024-09-12T18:35:25.635569+0000","last_peered":"2024-09-12T18:35:25.635569+0000","last_clean":"2024-09-12T18:35:25.635569+0000","last_became_active":"2024-09-12T18:35:24.657015+0000","last_became_peered":"2024-09-12T18:35:24.657015+0000","last_unstale":"2024-09-12T18:35:25.635569+0000","last_undegraded":"2024-09-12T18:35:25.635569+0000","last_fullsized":"2024-09-12T18:35:25.635569+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:03.171326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.668848+0000","last_change":"2024-09-12T18:35:25.665275+0000","last_active":"2024-09-12T18:35:25.668848+0000","last_peered":"2024-09-12T18:35:25.668848+0000","last_clean":"2024-09-12T18:35:25.668848+0000","last_became_active":"2024-09-12T18:35:25.659511+0000","last_became_peered":"2024-09-12T18:35:25.659511+0000","last_unstale":"2024-09-12T18:35:25.668848+0000","last_undegraded":"2024-09-12T18:35:25.668848+0000","last_fullsized":"2024-09-12T18:35:25.668848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:39.035368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.670534+0000","last_change":"2024-09-12T18:35:24.651913+0000","last_active":"2024-09-12T18:35:25.670534+0000","last_peered":"2024-09-12T18:35:25.670534+0000","last_clean":"2024-09-12T18:35:25.670534+0000","last_became_active":"2024-09-12T18:35:24.650421+0000","last_became_peered":"2024-09-12T18:35:24.650421+0000","last_unstale":"2024-09-12T18:35:25.670534+0000","last_undegraded":"2024-09-12T18:35:25.670534+0000","last_fullsized":"2024-09-12T18:35:25.670534+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:57.685312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.655649+0000","last_change":"2024-09-12T18:35:25.651138+0000","last_active":"2024-09-12T18:35:25.655649+0000","last_peered":"2024-09-12T18:35:25.655649+0000","last_clean":"2024-09-12T18:35:25.655649+0000","last_became_active":"2024-09-12T18:35:25.650617+0000","last_became_peered":"2024-09-12T18:35:25.650617+0000","last_unstale":"2024-09-12T18:35:25.655649+0000","last_undegraded":"2024-09-12T18:35:25.655649+0000","last_fullsized":"2024-09-12T18:35:25.655649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:59.531762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.629899+0000","last_change":"2024-09-12T18:35:24.659019+0000","last_active":"2024-09-12T18:35:25.629899+0000","last_peered":"2024-09-12T18:35:25.629899+0000","last_clean":"2024-09-12T18:35:25.629899+0000","last_became_active":"2024-09-12T18:35:24.658423+0000","last_became_peered":"2024-09-12T18:35:24.658423+0000","last_unstale":"2024-09-12T18:35:25.629899+0000","last_undegraded":"2024-09-12T18:35:25.629899+0000","last_fullsized":"2024-09-12T18:35:25.629899+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:37.668417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671592+0000","last_change":"2024-09-12T18:35:25.662287+0000","last_active":"2024-09-12T18:35:25.671592+0000","last_peered":"2024-09-12T18:35:25.671592+0000","last_clean":"2024-09-12T18:35:25.671592+0000","last_became_active":"2024-09-12T18:35:25.660372+0000","last_became_peered":"2024-09-12T18:35:25.660372+0000","last_unstale":"2024-09-12T18:35:25.671592+0000","last_undegraded":"2024-09-12T18:35:25.671592+0000","last_fullsized":"2024-09-12T18:35:25.671592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:14.114092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:23.596638+0000","last_change":"2024-09-12T18:35:23.596638+0000","last_active":"2024-09-12T18:35:23.596638+0000","last_peered":"2024-09-12T18:35:23.596638+0000","last_clean":"2024-09-12T18:35:23.596638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:23.596638+0000","last_undegraded":"2024-09-12T18:35:23.596638+0000","last_fullsized":"2024-09-12T18:35:23.596638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.670729+0000","last_change":"2024-09-12T18:35:25.658674+0000","last_active":"2024-09-12T18:35:25.670729+0000","last_peered":"2024-09-12T18:35:25.670729+0000","last_clean":"2024-09-12T18:35:25.670729+0000","last_became_active":"2024-09-12T18:35:25.657386+0000","last_became_peered":"2024-09-12T18:35:25.657386+0000","last_unstale":"2024-09-12T18:35:25.670729+0000","last_undegraded":"2024-09-12T18:35:25.670729+0000","last_fullsized":"2024-09-12T18:35:25.670729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:40.531922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:23.596638+0000","last_change":"2024-09-12T18:35:23.596638+0000","last_active":"2024-09-12T18:35:23.596638+0000","last_peered":"2024-09-12T18:35:23.596638+0000","last_clean":"2024-09-12T18:35:23.596638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:23.596638+0000","last_undegraded":"2024-09-12T18:35:23.596638+0000","last_fullsized":"2024-09-12T18:35:23.596638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.670432+0000","last_change":"2024-09-12T18:35:25.667710+0000","last_active":"2024-09-12T18:35:25.670432+0000","last_peered":"2024-09-12T18:35:25.670432+0000","last_clean":"2024-09-12T18:35:25.670432+0000","last_became_active":"2024-09-12T18:35:25.666940+0000","last_became_peered":"2024-09-12T18:35:25.666940+0000","last_unstale":"2024-09-12T18:35:25.670432+0000","last_undegraded":"2024-09-12T18:35:25.670432+0000","last_fullsized":"2024-09-12T18:35:25.670432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:16.315533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":163,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.635860+0000","last_change":"2024-09-12T18:35:13.489018+0000","last_active":"2024-09-12T18:35:25.635860+0000","last_peered":"2024-09-12T18:35:25.635860+0000","last_clean":"2024-09-12T18:35:25.635860+0000","last_became_active":"2024-09-12T18:35:13.488346+0000","last_became_peered":"2024-09-12T18:35:13.488346+0000","last_unstale":"2024-09-12T18:35:25.635860+0000","last_undegraded":"2024-09-12T18:35:25.635860+0000","last_fullsized":"2024-09-12T18:35:25.635860+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_clean_scrub_stamp":"2024-09-12T18:35:12.464628+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:54.864640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":27,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.635387+0000","last_change":"2024-09-12T18:35:22.459694+0000","last_active":"2024-09-12T18:35:25.635387+0000","last_peered":"2024-09-12T18:35:25.635387+0000","last_clean":"2024-09-12T18:35:25.635387+0000","last_became_active":"2024-09-12T18:35:20.446796+0000","last_became_peered":"2024-09-12T18:35:20.446796+0000","last_unstale":"2024-09-12T18:35:25.635387+0000","last_undegraded":"2024-09-12T18:35:25.635387+0000","last_fullsized":"2024-09-12T18:35:25.635387+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:21.506024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016291610000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.645967+0000","last_change":"2024-09-12T18:35:24.651749+0000","last_active":"2024-09-12T18:35:25.645967+0000","last_peered":"2024-09-12T18:35:25.645967+0000","last_clean":"2024-09-12T18:35:25.645967+0000","last_became_active":"2024-09-12T18:35:24.649860+0000","last_became_peered":"2024-09-12T18:35:24.649860+0000","last_unstale":"2024-09-12T18:35:25.645967+0000","last_undegraded":"2024-09-12T18:35:25.645967+0000","last_fullsized":"2024-09-12T18:35:25.645967+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:35.430065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671637+0000","last_change":"2024-09-12T18:35:25.662424+0000","last_active":"2024-09-12T18:35:25.671637+0000","last_peered":"2024-09-12T18:35:25.671637+0000","last_clean":"2024-09-12T18:35:25.671637+0000","last_became_active":"2024-09-12T18:35:25.661043+0000","last_became_peered":"2024-09-12T18:35:25.661043+0000","last_unstale":"2024-09-12T18:35:25.671637+0000","last_undegraded":"2024-09-12T18:35:25.671637+0000","last_fullsized":"2024-09-12T18:35:25.671637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:05.846676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.632239+0000","last_change":"2024-09-12T18:35:22.459090+0000","last_active":"2024-09-12T18:35:25.632239+0000","last_peered":"2024-09-12T18:35:25.632239+0000","last_clean":"2024-09-12T18:35:25.632239+0000","last_became_active":"2024-09-12T18:35:20.448553+0000","last_became_peered":"2024-09-12T18:35:20.448553+0000","last_unstale":"2024-09-12T18:35:25.632239+0000","last_undegraded":"2024-09-12T18:35:25.632239+0000","last_fullsized":"2024-09-12T18:35:25.632239+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:56.834808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001030836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.645664+0000","last_change":"2024-09-12T18:35:24.651597+0000","last_active":"2024-09-12T18:35:25.645664+0000","last_peered":"2024-09-12T18:35:25.645664+0000","last_clean":"2024-09-12T18:35:25.645664+0000","last_became_active":"2024-09-12T18:35:24.649940+0000","last_became_peered":"2024-09-12T18:35:24.649940+0000","last_unstale":"2024-09-12T18:35:25.645664+0000","last_undegraded":"2024-09-12T18:35:25.645664+0000","last_fullsized":"2024-09-12T18:35:25.645664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:36.822432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.645308+0000","last_change":"2024-09-12T18:35:22.464179+0000","last_active":"2024-09-12T18:35:25.645308+0000","last_peered":"2024-09-12T18:35:25.645308+0000","last_clean":"2024-09-12T18:35:25.645308+0000","last_became_active":"2024-09-12T18:35:20.442613+0000","last_became_peered":"2024-09-12T18:35:20.442613+0000","last_unstale":"2024-09-12T18:35:25.645308+0000","last_undegraded":"2024-09-12T18:35:25.645308+0000","last_fullsized":"2024-09-12T18:35:25.645308+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:17.636537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014134620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:23.596638+0000","last_change":"2024-09-12T18:35:23.596638+0000","last_active":"2024-09-12T18:35:23.596638+0000","last_peered":"2024-09-12T18:35:23.596638+0000","last_clean":"2024-09-12T18:35:23.596638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:23.596638+0000","last_undegraded":"2024-09-12T18:35:23.596638+0000","last_fullsized":"2024-09-12T18:35:23.596638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.666913+0000","last_change":"2024-09-12T18:35:25.659209+0000","last_active":"2024-09-12T18:35:25.666913+0000","last_peered":"2024-09-12T18:35:25.666913+0000","last_clean":"2024-09-12T18:35:25.666913+0000","last_became_active":"2024-09-12T18:35:25.656170+0000","last_became_peered":"2024-09-12T18:35:25.656170+0000","last_unstale":"2024-09-12T18:35:25.666913+0000","last_undegraded":"2024-09-12T18:35:25.666913+0000","last_fullsized":"2024-09-12T18:35:25.666913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:40.344068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":28,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.629469+0000","last_change":"2024-09-12T18:35:22.459049+0000","last_active":"2024-09-12T18:35:25.629469+0000","last_peered":"2024-09-12T18:35:25.629469+0000","last_clean":"2024-09-12T18:35:25.629469+0000","last_became_active":"2024-09-12T18:35:20.446814+0000","last_became_peered":"2024-09-12T18:35:20.446814+0000","last_unstale":"2024-09-12T18:35:25.629469+0000","last_undegraded":"2024-09-12T18:35:25.629469+0000","last_fullsized":"2024-09-12T18:35:25.629469+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:18.033595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010716149999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.635381+0000","last_change":"2024-09-12T18:35:24.658273+0000","last_active":"2024-09-12T18:35:25.635381+0000","last_peered":"2024-09-12T18:35:25.635381+0000","last_clean":"2024-09-12T18:35:25.635381+0000","last_became_active":"2024-09-12T18:35:24.657433+0000","last_became_peered":"2024-09-12T18:35:24.657433+0000","last_unstale":"2024-09-12T18:35:25.635381+0000","last_undegraded":"2024-09-12T18:35:25.635381+0000","last_fullsized":"2024-09-12T18:35:25.635381+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:48.497218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.663537+0000","last_change":"2024-09-12T18:35:25.655830+0000","last_active":"2024-09-12T18:35:25.663537+0000","last_peered":"2024-09-12T18:35:25.663537+0000","last_clean":"2024-09-12T18:35:25.663537+0000","last_became_active":"2024-09-12T18:35:25.652126+0000","last_became_peered":"2024-09-12T18:35:25.652126+0000","last_unstale":"2024-09-12T18:35:25.663537+0000","last_undegraded":"2024-09-12T18:35:25.663537+0000","last_fullsized":"2024-09-12T18:35:25.663537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:33.679281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.635489+0000","last_change":"2024-09-12T18:35:24.657618+0000","last_active":"2024-09-12T18:35:25.635489+0000","last_peered":"2024-09-12T18:35:25.635489+0000","last_clean":"2024-09-12T18:35:25.635489+0000","last_became_active":"2024-09-12T18:35:24.656741+0000","last_became_peered":"2024-09-12T18:35:24.656741+0000","last_unstale":"2024-09-12T18:35:25.635489+0000","last_undegraded":"2024-09-12T18:35:25.635489+0000","last_fullsized":"2024-09-12T18:35:25.635489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:43.113104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.647145+0000","last_change":"2024-09-12T18:35:22.464180+0000","last_active":"2024-09-12T18:35:25.647145+0000","last_peered":"2024-09-12T18:35:25.647145+0000","last_clean":"2024-09-12T18:35:25.647145+0000","last_became_active":"2024-09-12T18:35:20.442566+0000","last_became_peered":"2024-09-12T18:35:20.442566+0000","last_unstale":"2024-09-12T18:35:25.647145+0000","last_undegraded":"2024-09-12T18:35:25.647145+0000","last_fullsized":"2024-09-12T18:35:25.647145+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:29.021710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001325786,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.647793+0000","last_change":"2024-09-12T18:35:24.649669+0000","last_active":"2024-09-12T18:35:25.647793+0000","last_peered":"2024-09-12T18:35:25.647793+0000","last_clean":"2024-09-12T18:35:25.647793+0000","last_became_active":"2024-09-12T18:35:24.648881+0000","last_became_peered":"2024-09-12T18:35:24.648881+0000","last_unstale":"2024-09-12T18:35:25.647793+0000","last_undegraded":"2024-09-12T18:35:25.647793+0000","last_fullsized":"2024-09-12T18:35:25.647793+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:23.614734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-12T18:35:22.458666+0000","last_change":"2024-09-12T18:35:22.458666+0000","last_active":"2024-09-12T18:35:22.458666+0000","last_peered":"2024-09-12T18:35:22.458666+0000","last_clean":"2024-09-12T18:35:22.458666+0000","last_became_active":"2024-09-12T18:35:20.442394+0000","last_became_peered":"2024-09-12T18:35:20.442394+0000","last_unstale":"2024-09-12T18:35:22.458666+0000","last_undegraded":"2024-09-12T18:35:22.458666+0000","last_fullsized":"2024-09-12T18:35:22.458666+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:51.840246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080163599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.674332+0000","last_change":"2024-09-12T18:35:24.657234+0000","last_active":"2024-09-12T18:35:25.674332+0000","last_peered":"2024-09-12T18:35:25.674332+0000","last_clean":"2024-09-12T18:35:25.674332+0000","last_became_active":"2024-09-12T18:35:24.655950+0000","last_became_peered":"2024-09-12T18:35:24.655950+0000","last_unstale":"2024-09-12T18:35:25.674332+0000","last_undegraded":"2024-09-12T18:35:25.674332+0000","last_fullsized":"2024-09-12T18:35:25.674332+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:17.466623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.647896+0000","last_change":"2024-09-12T18:35:22.464656+0000","last_active":"2024-09-12T18:35:25.647896+0000","last_peered":"2024-09-12T18:35:25.647896+0000","last_clean":"2024-09-12T18:35:25.647896+0000","last_became_active":"2024-09-12T18:35:20.445470+0000","last_became_peered":"2024-09-12T18:35:20.445470+0000","last_unstale":"2024-09-12T18:35:25.647896+0000","last_undegraded":"2024-09-12T18:35:25.647896+0000","last_fullsized":"2024-09-12T18:35:25.647896+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:58.947359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001742681,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.665411+0000","last_change":"2024-09-12T18:35:25.658887+0000","last_active":"2024-09-12T18:35:25.665411+0000","last_peered":"2024-09-12T18:35:25.665411+0000","last_clean":"2024-09-12T18:35:25.665411+0000","last_became_active":"2024-09-12T18:35:25.656829+0000","last_became_peered":"2024-09-12T18:35:25.656829+0000","last_unstale":"2024-09-12T18:35:25.665411+0000","last_undegraded":"2024-09-12T18:35:25.665411+0000","last_fullsized":"2024-09-12T18:35:25.665411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:16.495586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.647739+0000","last_change":"2024-09-12T18:35:24.654518+0000","last_active":"2024-09-12T18:35:25.647739+0000","last_peered":"2024-09-12T18:35:25.647739+0000","last_clean":"2024-09-12T18:35:25.647739+0000","last_became_active":"2024-09-12T18:35:24.650309+0000","last_became_peered":"2024-09-12T18:35:24.650309+0000","last_unstale":"2024-09-12T18:35:25.647739+0000","last_undegraded":"2024-09-12T18:35:25.647739+0000","last_fullsized":"2024-09-12T18:35:25.647739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:16.669035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.629046+0000","last_change":"2024-09-12T18:35:22.459767+0000","last_active":"2024-09-12T18:35:25.629046+0000","last_peered":"2024-09-12T18:35:25.629046+0000","last_clean":"2024-09-12T18:35:25.629046+0000","last_became_active":"2024-09-12T18:35:20.448521+0000","last_became_peered":"2024-09-12T18:35:20.448521+0000","last_unstale":"2024-09-12T18:35:25.629046+0000","last_undegraded":"2024-09-12T18:35:25.629046+0000","last_fullsized":"2024-09-12T18:35:25.629046+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:33.463792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017009670000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671289+0000","last_change":"2024-09-12T18:35:25.660696+0000","last_active":"2024-09-12T18:35:25.671289+0000","last_peered":"2024-09-12T18:35:25.671289+0000","last_clean":"2024-09-12T18:35:25.671289+0000","last_became_active":"2024-09-12T18:35:25.659827+0000","last_became_peered":"2024-09-12T18:35:25.659827+0000","last_unstale":"2024-09-12T18:35:25.671289+0000","last_undegraded":"2024-09-12T18:35:25.671289+0000","last_fullsized":"2024-09-12T18:35:25.671289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:32.995388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.675858+0000","last_change":"2024-09-12T18:35:24.655051+0000","last_active":"2024-09-12T18:35:25.675858+0000","last_peered":"2024-09-12T18:35:25.675858+0000","last_clean":"2024-09-12T18:35:25.675858+0000","last_became_active":"2024-09-12T18:35:24.654282+0000","last_became_peered":"2024-09-12T18:35:24.654282+0000","last_unstale":"2024-09-12T18:35:25.675858+0000","last_undegraded":"2024-09-12T18:35:25.675858+0000","last_fullsized":"2024-09-12T18:35:25.675858+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:08.159799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.665292+0000","last_change":"2024-09-12T18:35:25.659237+0000","last_active":"2024-09-12T18:35:25.665292+0000","last_peered":"2024-09-12T18:35:25.665292+0000","last_clean":"2024-09-12T18:35:25.665292+0000","last_became_active":"2024-09-12T18:35:25.658423+0000","last_became_peered":"2024-09-12T18:35:25.658423+0000","last_unstale":"2024-09-12T18:35:25.665292+0000","last_undegraded":"2024-09-12T18:35:25.665292+0000","last_fullsized":"2024-09-12T18:35:25.665292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:53.450092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:23.596638+0000","last_change":"2024-09-12T18:35:23.596638+0000","last_active":"2024-09-12T18:35:23.596638+0000","last_peered":"2024-09-12T18:35:23.596638+0000","last_clean":"2024-09-12T18:35:23.596638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:23.596638+0000","last_undegraded":"2024-09-12T18:35:23.596638+0000","last_fullsized":"2024-09-12T18:35:23.596638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.628799+0000","last_change":"2024-09-12T18:35:24.656855+0000","last_active":"2024-09-12T18:35:25.628799+0000","last_peered":"2024-09-12T18:35:25.628799+0000","last_clean":"2024-09-12T18:35:25.628799+0000","last_became_active":"2024-09-12T18:35:24.655935+0000","last_became_peered":"2024-09-12T18:35:24.655935+0000","last_unstale":"2024-09-12T18:35:25.628799+0000","last_undegraded":"2024-09-12T18:35:25.628799+0000","last_fullsized":"2024-09-12T18:35:25.628799+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:35.430065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.667632+0000","last_change":"2024-09-12T18:35:25.661801+0000","last_active":"2024-09-12T18:35:25.667632+0000","last_peered":"2024-09-12T18:35:25.667632+0000","last_clean":"2024-09-12T18:35:25.667632+0000","last_became_active":"2024-09-12T18:35:25.658476+0000","last_became_peered":"2024-09-12T18:35:25.658476+0000","last_unstale":"2024-09-12T18:35:25.667632+0000","last_undegraded":"2024-09-12T18:35:25.667632+0000","last_fullsized":"2024-09-12T18:35:25.667632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:22.078004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.650423+0000","last_change":"2024-09-12T18:35:24.652399+0000","last_active":"2024-09-12T18:35:25.650423+0000","last_peered":"2024-09-12T18:35:25.650423+0000","last_clean":"2024-09-12T18:35:25.650423+0000","last_became_active":"2024-09-12T18:35:24.651416+0000","last_became_peered":"2024-09-12T18:35:24.651416+0000","last_unstale":"2024-09-12T18:35:25.650423+0000","last_undegraded":"2024-09-12T18:35:25.650423+0000","last_fullsized":"2024-09-12T18:35:25.650423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:32.594978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.665313+0000","last_change":"2024-09-12T18:35:25.658570+0000","last_active":"2024-09-12T18:35:25.665313+0000","last_peered":"2024-09-12T18:35:25.665313+0000","last_clean":"2024-09-12T18:35:25.665313+0000","last_became_active":"2024-09-12T18:35:25.656561+0000","last_became_peered":"2024-09-12T18:35:25.656561+0000","last_unstale":"2024-09-12T18:35:25.665313+0000","last_undegraded":"2024-09-12T18:35:25.665313+0000","last_fullsized":"2024-09-12T18:35:25.665313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:46.305988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.644984+0000","last_change":"2024-09-12T18:35:24.657489+0000","last_active":"2024-09-12T18:35:25.644984+0000","last_peered":"2024-09-12T18:35:25.644984+0000","last_clean":"2024-09-12T18:35:25.644984+0000","last_became_active":"2024-09-12T18:35:24.656030+0000","last_became_peered":"2024-09-12T18:35:24.656030+0000","last_unstale":"2024-09-12T18:35:25.644984+0000","last_undegraded":"2024-09-12T18:35:25.644984+0000","last_fullsized":"2024-09-12T18:35:25.644984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:11.362759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671748+0000","last_change":"2024-09-12T18:35:25.661544+0000","last_active":"2024-09-12T18:35:25.671748+0000","last_peered":"2024-09-12T18:35:25.671748+0000","last_clean":"2024-09-12T18:35:25.671748+0000","last_became_active":"2024-09-12T18:35:25.656985+0000","last_became_peered":"2024-09-12T18:35:25.656985+0000","last_unstale":"2024-09-12T18:35:25.671748+0000","last_undegraded":"2024-09-12T18:35:25.671748+0000","last_fullsized":"2024-09-12T18:35:25.671748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:31.078781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.645078+0000","last_change":"2024-09-12T18:35:24.646342+0000","last_active":"2024-09-12T18:35:25.645078+0000","last_peered":"2024-09-12T18:35:25.645078+0000","last_clean":"2024-09-12T18:35:25.645078+0000","last_became_active":"2024-09-12T18:35:24.644773+0000","last_became_peered":"2024-09-12T18:35:24.644773+0000","last_unstale":"2024-09-12T18:35:25.645078+0000","last_undegraded":"2024-09-12T18:35:25.645078+0000","last_fullsized":"2024-09-12T18:35:25.645078+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:17.011231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:23.596638+0000","last_change":"2024-09-12T18:35:23.596638+0000","last_active":"2024-09-12T18:35:23.596638+0000","last_peered":"2024-09-12T18:35:23.596638+0000","last_clean":"2024-09-12T18:35:23.596638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:23.596638+0000","last_undegraded":"2024-09-12T18:35:23.596638+0000","last_fullsized":"2024-09-12T18:35:23.596638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:23.596638+0000","last_change":"2024-09-12T18:35:23.596638+0000","last_active":"2024-09-12T18:35:23.596638+0000","last_peered":"2024-09-12T18:35:23.596638+0000","last_clean":"2024-09-12T18:35:23.596638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:23.596638+0000","last_undegraded":"2024-09-12T18:35:23.596638+0000","last_fullsized":"2024-09-12T18:35:23.596638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671662+0000","last_change":"2024-09-12T18:35:25.662537+0000","last_active":"2024-09-12T18:35:25.671662+0000","last_peered":"2024-09-12T18:35:25.671662+0000","last_clean":"2024-09-12T18:35:25.671662+0000","last_became_active":"2024-09-12T18:35:25.661441+0000","last_became_peered":"2024-09-12T18:35:25.661441+0000","last_unstale":"2024-09-12T18:35:25.671662+0000","last_undegraded":"2024-09-12T18:35:25.671662+0000","last_fullsized":"2024-09-12T18:35:25.671662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:34.445331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.667700+0000","last_change":"2024-09-12T18:35:24.657635+0000","last_active":"2024-09-12T18:35:25.667700+0000","last_peered":"2024-09-12T18:35:25.667700+0000","last_clean":"2024-09-12T18:35:25.667700+0000","last_became_active":"2024-09-12T18:35:24.655992+0000","last_became_peered":"2024-09-12T18:35:24.655992+0000","last_unstale":"2024-09-12T18:35:25.667700+0000","last_undegraded":"2024-09-12T18:35:25.667700+0000","last_fullsized":"2024-09-12T18:35:25.667700+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:33.536755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.655697+0000","last_change":"2024-09-12T18:35:25.651406+0000","last_active":"2024-09-12T18:35:25.655697+0000","last_peered":"2024-09-12T18:35:25.655697+0000","last_clean":"2024-09-12T18:35:25.655697+0000","last_became_active":"2024-09-12T18:35:25.649728+0000","last_became_peered":"2024-09-12T18:35:25.649728+0000","last_unstale":"2024-09-12T18:35:25.655697+0000","last_undegraded":"2024-09-12T18:35:25.655697+0000","last_fullsized":"2024-09-12T18:35:25.655697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:53.450092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:23.596638+0000","last_change":"2024-09-12T18:35:23.596638+0000","last_active":"2024-09-12T18:35:23.596638+0000","last_peered":"2024-09-12T18:35:23.596638+0000","last_clean":"2024-09-12T18:35:23.596638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:23.596638+0000","last_undegraded":"2024-09-12T18:35:23.596638+0000","last_fullsized":"2024-09-12T18:35:23.596638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T18:35:24.607229+0000","last_change":"2024-09-12T18:35:24.607229+0000","last_active":"2024-09-12T18:35:24.607229+0000","last_peered":"2024-09-12T18:35:24.607229+0000","last_clean":"2024-09-12T18:35:24.607229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:35:24.607229+0000","last_undegraded":"2024-09-12T18:35:24.607229+0000","last_fullsized":"2024-09-12T18:35:24.607229+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.666379+0000","last_change":"2024-09-12T18:35:24.656268+0000","last_active":"2024-09-12T18:35:25.666379+0000","last_peered":"2024-09-12T18:35:25.666379+0000","last_clean":"2024-09-12T18:35:25.666379+0000","last_became_active":"2024-09-12T18:35:24.655420+0000","last_became_peered":"2024-09-12T18:35:24.655420+0000","last_unstale":"2024-09-12T18:35:25.666379+0000","last_undegraded":"2024-09-12T18:35:25.666379+0000","last_fullsized":"2024-09-12T18:35:25.666379+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:04.654666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.671307+0000","last_change":"2024-09-12T18:35:25.661042+0000","last_active":"2024-09-12T18:35:25.671307+0000","last_peered":"2024-09-12T18:35:25.671307+0000","last_clean":"2024-09-12T18:35:25.671307+0000","last_became_active":"2024-09-12T18:35:25.660163+0000","last_became_peered":"2024-09-12T18:35:25.660163+0000","last_unstale":"2024-09-12T18:35:25.671307+0000","last_undegraded":"2024-09-12T18:35:25.671307+0000","last_fullsized":"2024-09-12T18:35:25.671307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:25.387564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:35:25.675465+0000","last_change":"2024-09-12T18:35:24.652304+0000","last_active":"2024-09-12T18:35:25.675465+0000","last_peered":"2024-09-12T18:35:25.675465+0000","last_clean":"2024-09-12T18:35:25.675465+0000","last_became_active":"2024-09-12T18:35:24.651460+0000","last_became_peered":"2024-09-12T18:35:24.651460+0000","last_unstale":"2024-09-12T18:35:25.675465+0000","last_undegraded":"2024-09-12T18:35:25.675465+0000","last_fullsized":"2024-09-12T18:35:25.675465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:42.050557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":80,"acting":80,"num_store_stats":2},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2320,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":46,"acting":46,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":196608,"data_stored":631260,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":258048,"data_stored":647469,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":167936,"data_stored":55307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:35:33.065 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:35:33.384 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:35:33.386 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T18:35:33.401 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-09-12T18:35:32.403408+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":192,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":192,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90092,"kb_used_data":680,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025428,"statfs":{"total":289910292480,"available":289818038272,"internally_reserved":0,"allocated":696320,"data_stored":1363503,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4783,"internal_metadata":91483473},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2421,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.780316"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.646546+0000","last_change":"2024-09-12T18:35:25.657389+0000","last_active":"2024-09-12T18:35:26.646546+0000","last_peered":"2024-09-12T18:35:26.646546+0000","last_clean":"2024-09-12T18:35:26.646546+0000","last_became_active":"2024-09-12T18:35:25.651857+0000","last_became_peered":"2024-09-12T18:35:25.651857+0000","last_unstale":"2024-09-12T18:35:26.646546+0000","last_undegraded":"2024-09-12T18:35:26.646546+0000","last_fullsized":"2024-09-12T18:35:26.646546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:50.264536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.646863+0000","last_change":"2024-09-12T18:35:25.659760+0000","last_active":"2024-09-12T18:35:26.646863+0000","last_peered":"2024-09-12T18:35:26.646863+0000","last_clean":"2024-09-12T18:35:26.646863+0000","last_became_active":"2024-09-12T18:35:25.654920+0000","last_became_peered":"2024-09-12T18:35:25.654920+0000","last_unstale":"2024-09-12T18:35:26.646863+0000","last_undegraded":"2024-09-12T18:35:26.646863+0000","last_fullsized":"2024-09-12T18:35:26.646863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:21.519881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.645475+0000","last_change":"2024-09-12T18:35:25.659460+0000","last_active":"2024-09-12T18:35:26.645475+0000","last_peered":"2024-09-12T18:35:26.645475+0000","last_clean":"2024-09-12T18:35:26.645475+0000","last_became_active":"2024-09-12T18:35:25.657782+0000","last_became_peered":"2024-09-12T18:35:25.657782+0000","last_unstale":"2024-09-12T18:35:26.645475+0000","last_undegraded":"2024-09-12T18:35:26.645475+0000","last_fullsized":"2024-09-12T18:35:26.645475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:38.544284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.646368+0000","last_change":"2024-09-12T18:35:25.663617+0000","last_active":"2024-09-12T18:35:26.646368+0000","last_peered":"2024-09-12T18:35:26.646368+0000","last_clean":"2024-09-12T18:35:26.646368+0000","last_became_active":"2024-09-12T18:35:25.661977+0000","last_became_peered":"2024-09-12T18:35:25.661977+0000","last_unstale":"2024-09-12T18:35:26.646368+0000","last_undegraded":"2024-09-12T18:35:26.646368+0000","last_fullsized":"2024-09-12T18:35:26.646368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:14.748234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.645598+0000","last_change":"2024-09-12T18:35:25.656566+0000","last_active":"2024-09-12T18:35:26.645598+0000","last_peered":"2024-09-12T18:35:26.645598+0000","last_clean":"2024-09-12T18:35:26.645598+0000","last_became_active":"2024-09-12T18:35:25.654898+0000","last_became_peered":"2024-09-12T18:35:25.654898+0000","last_unstale":"2024-09-12T18:35:26.645598+0000","last_undegraded":"2024-09-12T18:35:26.645598+0000","last_fullsized":"2024-09-12T18:35:26.645598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:36.113250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.644026+0000","last_change":"2024-09-12T18:35:25.652754+0000","last_active":"2024-09-12T18:35:26.644026+0000","last_peered":"2024-09-12T18:35:26.644026+0000","last_clean":"2024-09-12T18:35:26.644026+0000","last_became_active":"2024-09-12T18:35:25.651217+0000","last_became_peered":"2024-09-12T18:35:25.651217+0000","last_unstale":"2024-09-12T18:35:26.644026+0000","last_undegraded":"2024-09-12T18:35:26.644026+0000","last_fullsized":"2024-09-12T18:35:26.644026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:24.585774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.643904+0000","last_change":"2024-09-12T18:35:25.659811+0000","last_active":"2024-09-12T18:35:26.643904+0000","last_peered":"2024-09-12T18:35:26.643904+0000","last_clean":"2024-09-12T18:35:26.643904+0000","last_became_active":"2024-09-12T18:35:25.658998+0000","last_became_peered":"2024-09-12T18:35:25.658998+0000","last_unstale":"2024-09-12T18:35:26.643904+0000","last_undegraded":"2024-09-12T18:35:26.643904+0000","last_fullsized":"2024-09-12T18:35:26.643904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.643487+0000","last_change":"2024-09-12T18:35:25.653999+0000","last_active":"2024-09-12T18:35:26.643487+0000","last_peered":"2024-09-12T18:35:26.643487+0000","last_clean":"2024-09-12T18:35:26.643487+0000","last_became_active":"2024-09-12T18:35:25.653319+0000","last_became_peered":"2024-09-12T18:35:25.653319+0000","last_unstale":"2024-09-12T18:35:26.643487+0000","last_undegraded":"2024-09-12T18:35:26.643487+0000","last_fullsized":"2024-09-12T18:35:26.643487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:04.718000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:27.632263+0000","last_change":"2024-09-12T18:35:25.668339+0000","last_active":"2024-09-12T18:35:27.632263+0000","last_peered":"2024-09-12T18:35:27.632263+0000","last_clean":"2024-09-12T18:35:27.632263+0000","last_became_active":"2024-09-12T18:35:25.667608+0000","last_became_peered":"2024-09-12T18:35:25.667608+0000","last_unstale":"2024-09-12T18:35:27.632263+0000","last_undegraded":"2024-09-12T18:35:27.632263+0000","last_fullsized":"2024-09-12T18:35:27.632263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:15.699745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.645140+0000","last_change":"2024-09-12T18:35:25.660174+0000","last_active":"2024-09-12T18:35:26.645140+0000","last_peered":"2024-09-12T18:35:26.645140+0000","last_clean":"2024-09-12T18:35:26.645140+0000","last_became_active":"2024-09-12T18:35:25.656560+0000","last_became_peered":"2024-09-12T18:35:25.656560+0000","last_unstale":"2024-09-12T18:35:26.645140+0000","last_undegraded":"2024-09-12T18:35:26.645140+0000","last_fullsized":"2024-09-12T18:35:26.645140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:47.268505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.645515+0000","last_change":"2024-09-12T18:35:25.649858+0000","last_active":"2024-09-12T18:35:26.645515+0000","last_peered":"2024-09-12T18:35:26.645515+0000","last_clean":"2024-09-12T18:35:26.645515+0000","last_became_active":"2024-09-12T18:35:25.649090+0000","last_became_peered":"2024-09-12T18:35:25.649090+0000","last_unstale":"2024-09-12T18:35:26.645515+0000","last_undegraded":"2024-09-12T18:35:26.645515+0000","last_fullsized":"2024-09-12T18:35:26.645515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:33.158421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.645061+0000","last_change":"2024-09-12T18:35:25.649885+0000","last_active":"2024-09-12T18:35:26.645061+0000","last_peered":"2024-09-12T18:35:26.645061+0000","last_clean":"2024-09-12T18:35:26.645061+0000","last_became_active":"2024-09-12T18:35:25.649111+0000","last_became_peered":"2024-09-12T18:35:25.649111+0000","last_unstale":"2024-09-12T18:35:26.645061+0000","last_undegraded":"2024-09-12T18:35:26.645061+0000","last_fullsized":"2024-09-12T18:35:26.645061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:17.162410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.644885+0000","last_change":"2024-09-12T18:35:25.651541+0000","last_active":"2024-09-12T18:35:26.644885+0000","last_peered":"2024-09-12T18:35:26.644885+0000","last_clean":"2024-09-12T18:35:26.644885+0000","last_became_active":"2024-09-12T18:35:25.650661+0000","last_became_peered":"2024-09-12T18:35:25.650661+0000","last_unstale":"2024-09-12T18:35:26.644885+0000","last_undegraded":"2024-09-12T18:35:26.644885+0000","last_fullsized":"2024-09-12T18:35:26.644885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:52.082734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.644291+0000","last_change":"2024-09-12T18:35:25.657913+0000","last_active":"2024-09-12T18:35:26.644291+0000","last_peered":"2024-09-12T18:35:26.644291+0000","last_clean":"2024-09-12T18:35:26.644291+0000","last_became_active":"2024-09-12T18:35:25.657082+0000","last_became_peered":"2024-09-12T18:35:25.657082+0000","last_unstale":"2024-09-12T18:35:26.644291+0000","last_undegraded":"2024-09-12T18:35:26.644291+0000","last_fullsized":"2024-09-12T18:35:26.644291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:21.538633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.643886+0000","last_change":"2024-09-12T18:35:25.658763+0000","last_active":"2024-09-12T18:35:26.643886+0000","last_peered":"2024-09-12T18:35:26.643886+0000","last_clean":"2024-09-12T18:35:26.643886+0000","last_became_active":"2024-09-12T18:35:25.657508+0000","last_became_peered":"2024-09-12T18:35:25.657508+0000","last_unstale":"2024-09-12T18:35:26.643886+0000","last_undegraded":"2024-09-12T18:35:26.643886+0000","last_fullsized":"2024-09-12T18:35:26.643886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:13.170519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.643559+0000","last_change":"2024-09-12T18:35:25.653730+0000","last_active":"2024-09-12T18:35:26.643559+0000","last_peered":"2024-09-12T18:35:26.643559+0000","last_clean":"2024-09-12T18:35:26.643559+0000","last_became_active":"2024-09-12T18:35:25.651535+0000","last_became_peered":"2024-09-12T18:35:25.651535+0000","last_unstale":"2024-09-12T18:35:26.643559+0000","last_undegraded":"2024-09-12T18:35:26.643559+0000","last_fullsized":"2024-09-12T18:35:26.643559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:27.634246+0000","last_change":"2024-09-12T18:35:25.656513+0000","last_active":"2024-09-12T18:35:27.634246+0000","last_peered":"2024-09-12T18:35:27.634246+0000","last_clean":"2024-09-12T18:35:27.634246+0000","last_became_active":"2024-09-12T18:35:25.653440+0000","last_became_peered":"2024-09-12T18:35:25.653440+0000","last_unstale":"2024-09-12T18:35:27.634246+0000","last_undegraded":"2024-09-12T18:35:27.634246+0000","last_fullsized":"2024-09-12T18:35:27.634246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:18.693161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.645931+0000","last_change":"2024-09-12T18:35:25.657991+0000","last_active":"2024-09-12T18:35:26.645931+0000","last_peered":"2024-09-12T18:35:26.645931+0000","last_clean":"2024-09-12T18:35:26.645931+0000","last_became_active":"2024-09-12T18:35:25.653934+0000","last_became_peered":"2024-09-12T18:35:25.653934+0000","last_unstale":"2024-09-12T18:35:26.645931+0000","last_undegraded":"2024-09-12T18:35:26.645931+0000","last_fullsized":"2024-09-12T18:35:26.645931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:05.418901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:27.632171+0000","last_change":"2024-09-12T18:35:25.658819+0000","last_active":"2024-09-12T18:35:27.632171+0000","last_peered":"2024-09-12T18:35:27.632171+0000","last_clean":"2024-09-12T18:35:27.632171+0000","last_became_active":"2024-09-12T18:35:25.656843+0000","last_became_peered":"2024-09-12T18:35:25.656843+0000","last_unstale":"2024-09-12T18:35:27.632171+0000","last_undegraded":"2024-09-12T18:35:27.632171+0000","last_fullsized":"2024-09-12T18:35:27.632171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:55.291963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.645005+0000","last_change":"2024-09-12T18:35:25.661176+0000","last_active":"2024-09-12T18:35:26.645005+0000","last_peered":"2024-09-12T18:35:26.645005+0000","last_clean":"2024-09-12T18:35:26.645005+0000","last_became_active":"2024-09-12T18:35:25.659534+0000","last_became_peered":"2024-09-12T18:35:25.659534+0000","last_unstale":"2024-09-12T18:35:26.645005+0000","last_undegraded":"2024-09-12T18:35:26.645005+0000","last_fullsized":"2024-09-12T18:35:26.645005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:40.145442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.645305+0000","last_change":"2024-09-12T18:35:25.650632+0000","last_active":"2024-09-12T18:35:26.645305+0000","last_peered":"2024-09-12T18:35:26.645305+0000","last_clean":"2024-09-12T18:35:26.645305+0000","last_became_active":"2024-09-12T18:35:25.649333+0000","last_became_peered":"2024-09-12T18:35:25.649333+0000","last_unstale":"2024-09-12T18:35:26.645305+0000","last_undegraded":"2024-09-12T18:35:26.645305+0000","last_fullsized":"2024-09-12T18:35:26.645305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:30.537572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.644226+0000","last_change":"2024-09-12T18:35:25.648245+0000","last_active":"2024-09-12T18:35:26.644226+0000","last_peered":"2024-09-12T18:35:26.644226+0000","last_clean":"2024-09-12T18:35:26.644226+0000","last_became_active":"2024-09-12T18:35:25.646357+0000","last_became_peered":"2024-09-12T18:35:25.646357+0000","last_unstale":"2024-09-12T18:35:26.644226+0000","last_undegraded":"2024-09-12T18:35:26.644226+0000","last_fullsized":"2024-09-12T18:35:26.644226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:05.662140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:27.630215+0000","last_change":"2024-09-12T18:35:25.661613+0000","last_active":"2024-09-12T18:35:27.630215+0000","last_peered":"2024-09-12T18:35:27.630215+0000","last_clean":"2024-09-12T18:35:27.630215+0000","last_became_active":"2024-09-12T18:35:25.658833+0000","last_became_peered":"2024-09-12T18:35:25.658833+0000","last_unstale":"2024-09-12T18:35:27.630215+0000","last_undegraded":"2024-09-12T18:35:27.630215+0000","last_fullsized":"2024-09-12T18:35:27.630215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:51.064080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.643575+0000","last_change":"2024-09-12T18:35:25.657782+0000","last_active":"2024-09-12T18:35:26.643575+0000","last_peered":"2024-09-12T18:35:26.643575+0000","last_clean":"2024-09-12T18:35:26.643575+0000","last_became_active":"2024-09-12T18:35:25.655295+0000","last_became_peered":"2024-09-12T18:35:25.655295+0000","last_unstale":"2024-09-12T18:35:26.643575+0000","last_undegraded":"2024-09-12T18:35:26.643575+0000","last_fullsized":"2024-09-12T18:35:26.643575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:37.744175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.646285+0000","last_change":"2024-09-12T18:35:25.654863+0000","last_active":"2024-09-12T18:35:26.646285+0000","last_peered":"2024-09-12T18:35:26.646285+0000","last_clean":"2024-09-12T18:35:26.646285+0000","last_became_active":"2024-09-12T18:35:25.650407+0000","last_became_peered":"2024-09-12T18:35:25.650407+0000","last_unstale":"2024-09-12T18:35:26.646285+0000","last_undegraded":"2024-09-12T18:35:26.646285+0000","last_fullsized":"2024-09-12T18:35:26.646285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:38.395666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:27.632660+0000","last_change":"2024-09-12T18:35:25.662414+0000","last_active":"2024-09-12T18:35:27.632660+0000","last_peered":"2024-09-12T18:35:27.632660+0000","last_clean":"2024-09-12T18:35:27.632660+0000","last_became_active":"2024-09-12T18:35:25.660126+0000","last_became_peered":"2024-09-12T18:35:25.660126+0000","last_unstale":"2024-09-12T18:35:27.632660+0000","last_undegraded":"2024-09-12T18:35:27.632660+0000","last_fullsized":"2024-09-12T18:35:27.632660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:48.437139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.646430+0000","last_change":"2024-09-12T18:35:25.661523+0000","last_active":"2024-09-12T18:35:26.646430+0000","last_peered":"2024-09-12T18:35:26.646430+0000","last_clean":"2024-09-12T18:35:26.646430+0000","last_became_active":"2024-09-12T18:35:25.659338+0000","last_became_peered":"2024-09-12T18:35:25.659338+0000","last_unstale":"2024-09-12T18:35:26.646430+0000","last_undegraded":"2024-09-12T18:35:26.646430+0000","last_fullsized":"2024-09-12T18:35:26.646430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:37.083820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.646529+0000","last_change":"2024-09-12T18:35:25.662445+0000","last_active":"2024-09-12T18:35:26.646529+0000","last_peered":"2024-09-12T18:35:26.646529+0000","last_clean":"2024-09-12T18:35:26.646529+0000","last_became_active":"2024-09-12T18:35:25.659496+0000","last_became_peered":"2024-09-12T18:35:25.659496+0000","last_unstale":"2024-09-12T18:35:26.646529+0000","last_undegraded":"2024-09-12T18:35:26.646529+0000","last_fullsized":"2024-09-12T18:35:26.646529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:03.270420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:27.632335+0000","last_change":"2024-09-12T18:35:25.662519+0000","last_active":"2024-09-12T18:35:27.632335+0000","last_peered":"2024-09-12T18:35:27.632335+0000","last_clean":"2024-09-12T18:35:27.632335+0000","last_became_active":"2024-09-12T18:35:25.652964+0000","last_became_peered":"2024-09-12T18:35:25.652964+0000","last_unstale":"2024-09-12T18:35:27.632335+0000","last_undegraded":"2024-09-12T18:35:27.632335+0000","last_fullsized":"2024-09-12T18:35:27.632335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:37.923468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.644911+0000","last_change":"2024-09-12T18:35:25.650507+0000","last_active":"2024-09-12T18:35:26.644911+0000","last_peered":"2024-09-12T18:35:26.644911+0000","last_clean":"2024-09-12T18:35:26.644911+0000","last_became_active":"2024-09-12T18:35:25.649415+0000","last_became_peered":"2024-09-12T18:35:25.649415+0000","last_unstale":"2024-09-12T18:35:26.644911+0000","last_undegraded":"2024-09-12T18:35:26.644911+0000","last_fullsized":"2024-09-12T18:35:26.644911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:23.081416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:27.630415+0000","last_change":"2024-09-12T18:35:25.653949+0000","last_active":"2024-09-12T18:35:27.630415+0000","last_peered":"2024-09-12T18:35:27.630415+0000","last_clean":"2024-09-12T18:35:27.630415+0000","last_became_active":"2024-09-12T18:35:25.652992+0000","last_became_peered":"2024-09-12T18:35:25.652992+0000","last_unstale":"2024-09-12T18:35:27.630415+0000","last_undegraded":"2024-09-12T18:35:27.630415+0000","last_fullsized":"2024-09-12T18:35:27.630415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:47.687372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.644097+0000","last_change":"2024-09-12T18:35:25.653159+0000","last_active":"2024-09-12T18:35:26.644097+0000","last_peered":"2024-09-12T18:35:26.644097+0000","last_clean":"2024-09-12T18:35:26.644097+0000","last_became_active":"2024-09-12T18:35:25.650551+0000","last_became_peered":"2024-09-12T18:35:25.650551+0000","last_unstale":"2024-09-12T18:35:26.644097+0000","last_undegraded":"2024-09-12T18:35:26.644097+0000","last_fullsized":"2024-09-12T18:35:26.644097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:16.245302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.646239+0000","last_change":"2024-09-12T18:35:25.651877+0000","last_active":"2024-09-12T18:35:26.646239+0000","last_peered":"2024-09-12T18:35:26.646239+0000","last_clean":"2024-09-12T18:35:26.646239+0000","last_became_active":"2024-09-12T18:35:25.651055+0000","last_became_peered":"2024-09-12T18:35:25.651055+0000","last_unstale":"2024-09-12T18:35:26.646239+0000","last_undegraded":"2024-09-12T18:35:26.646239+0000","last_fullsized":"2024-09-12T18:35:26.646239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:14.200080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.646478+0000","last_change":"2024-09-12T18:35:24.657739+0000","last_active":"2024-09-12T18:35:26.646478+0000","last_peered":"2024-09-12T18:35:26.646478+0000","last_clean":"2024-09-12T18:35:26.646478+0000","last_became_active":"2024-09-12T18:35:24.656208+0000","last_became_peered":"2024-09-12T18:35:24.656208+0000","last_unstale":"2024-09-12T18:35:26.646478+0000","last_undegraded":"2024-09-12T18:35:26.646478+0000","last_fullsized":"2024-09-12T18:35:26.646478+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:50.073716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.646254+0000","last_change":"2024-09-12T18:35:25.651651+0000","last_active":"2024-09-12T18:35:26.646254+0000","last_peered":"2024-09-12T18:35:26.646254+0000","last_clean":"2024-09-12T18:35:26.646254+0000","last_became_active":"2024-09-12T18:35:25.650849+0000","last_became_peered":"2024-09-12T18:35:25.650849+0000","last_unstale":"2024-09-12T18:35:26.646254+0000","last_undegraded":"2024-09-12T18:35:26.646254+0000","last_fullsized":"2024-09-12T18:35:26.646254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:18.555827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:27.630952+0000","last_change":"2024-09-12T18:35:24.656119+0000","last_active":"2024-09-12T18:35:27.630952+0000","last_peered":"2024-09-12T18:35:27.630952+0000","last_clean":"2024-09-12T18:35:27.630952+0000","last_became_active":"2024-09-12T18:35:24.653175+0000","last_became_peered":"2024-09-12T18:35:24.653175+0000","last_unstale":"2024-09-12T18:35:27.630952+0000","last_undegraded":"2024-09-12T18:35:27.630952+0000","last_fullsized":"2024-09-12T18:35:27.630952+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:00.551165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:27.633727+0000","last_change":"2024-09-12T18:35:25.655723+0000","last_active":"2024-09-12T18:35:27.633727+0000","last_peered":"2024-09-12T18:35:27.633727+0000","last_clean":"2024-09-12T18:35:27.633727+0000","last_became_active":"2024-09-12T18:35:25.653630+0000","last_became_peered":"2024-09-12T18:35:25.653630+0000","last_unstale":"2024-09-12T18:35:27.633727+0000","last_undegraded":"2024-09-12T18:35:27.633727+0000","last_fullsized":"2024-09-12T18:35:27.633727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:07.655792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.644545+0000","last_change":"2024-09-12T18:35:24.640096+0000","last_active":"2024-09-12T18:35:26.644545+0000","last_peered":"2024-09-12T18:35:26.644545+0000","last_clean":"2024-09-12T18:35:26.644545+0000","last_became_active":"2024-09-12T18:35:24.638230+0000","last_became_peered":"2024-09-12T18:35:24.638230+0000","last_unstale":"2024-09-12T18:35:26.644545+0000","last_undegraded":"2024-09-12T18:35:26.644545+0000","last_fullsized":"2024-09-12T18:35:26.644545+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:38.435296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:27.632462+0000","last_change":"2024-09-12T18:35:25.662692+0000","last_active":"2024-09-12T18:35:27.632462+0000","last_peered":"2024-09-12T18:35:27.632462+0000","last_clean":"2024-09-12T18:35:27.632462+0000","last_became_active":"2024-09-12T18:35:25.661885+0000","last_became_peered":"2024-09-12T18:35:25.661885+0000","last_unstale":"2024-09-12T18:35:27.632462+0000","last_undegraded":"2024-09-12T18:35:27.632462+0000","last_fullsized":"2024-09-12T18:35:27.632462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:41.264425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.644736+0000","last_change":"2024-09-12T18:35:24.653610+0000","last_active":"2024-09-12T18:35:26.644736+0000","last_peered":"2024-09-12T18:35:26.644736+0000","last_clean":"2024-09-12T18:35:26.644736+0000","last_became_active":"2024-09-12T18:35:24.652880+0000","last_became_peered":"2024-09-12T18:35:24.652880+0000","last_unstale":"2024-09-12T18:35:26.644736+0000","last_undegraded":"2024-09-12T18:35:26.644736+0000","last_fullsized":"2024-09-12T18:35:26.644736+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:57.636251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.645092+0000","last_change":"2024-09-12T18:35:24.653465+0000","last_active":"2024-09-12T18:35:26.645092+0000","last_peered":"2024-09-12T18:35:26.645092+0000","last_clean":"2024-09-12T18:35:26.645092+0000","last_became_active":"2024-09-12T18:35:24.652792+0000","last_became_peered":"2024-09-12T18:35:24.652792+0000","last_unstale":"2024-09-12T18:35:26.645092+0000","last_undegraded":"2024-09-12T18:35:26.645092+0000","last_fullsized":"2024-09-12T18:35:26.645092+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:14.588993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.643675+0000","last_change":"2024-09-12T18:35:25.655426+0000","last_active":"2024-09-12T18:35:26.643675+0000","last_peered":"2024-09-12T18:35:26.643675+0000","last_clean":"2024-09-12T18:35:26.643675+0000","last_became_active":"2024-09-12T18:35:25.648186+0000","last_became_peered":"2024-09-12T18:35:25.648186+0000","last_unstale":"2024-09-12T18:35:26.643675+0000","last_undegraded":"2024-09-12T18:35:26.643675+0000","last_fullsized":"2024-09-12T18:35:26.643675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:48.802815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.646736+0000","last_change":"2024-09-12T18:35:24.648439+0000","last_active":"2024-09-12T18:35:26.646736+0000","last_peered":"2024-09-12T18:35:26.646736+0000","last_clean":"2024-09-12T18:35:26.646736+0000","last_became_active":"2024-09-12T18:35:24.647629+0000","last_became_peered":"2024-09-12T18:35:24.647629+0000","last_unstale":"2024-09-12T18:35:26.646736+0000","last_undegraded":"2024-09-12T18:35:26.646736+0000","last_fullsized":"2024-09-12T18:35:26.646736+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:45.428223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.643793+0000","last_change":"2024-09-12T18:35:25.652496+0000","last_active":"2024-09-12T18:35:26.643793+0000","last_peered":"2024-09-12T18:35:26.643793+0000","last_clean":"2024-09-12T18:35:26.643793+0000","last_became_active":"2024-09-12T18:35:25.651628+0000","last_became_peered":"2024-09-12T18:35:25.651628+0000","last_unstale":"2024-09-12T18:35:26.643793+0000","last_undegraded":"2024-09-12T18:35:26.643793+0000","last_fullsized":"2024-09-12T18:35:26.643793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:44.920448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.647051+0000","last_change":"2024-09-12T18:35:24.654976+0000","last_active":"2024-09-12T18:35:26.647051+0000","last_peered":"2024-09-12T18:35:26.647051+0000","last_clean":"2024-09-12T18:35:26.647051+0000","last_became_active":"2024-09-12T18:35:24.654264+0000","last_became_peered":"2024-09-12T18:35:24.654264+0000","last_unstale":"2024-09-12T18:35:26.647051+0000","last_undegraded":"2024-09-12T18:35:26.647051+0000","last_fullsized":"2024-09-12T18:35:26.647051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:00.115408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.644889+0000","last_change":"2024-09-12T18:35:25.650577+0000","last_active":"2024-09-12T18:35:26.644889+0000","last_peered":"2024-09-12T18:35:26.644889+0000","last_clean":"2024-09-12T18:35:26.644889+0000","last_became_active":"2024-09-12T18:35:25.649172+0000","last_became_peered":"2024-09-12T18:35:25.649172+0000","last_unstale":"2024-09-12T18:35:26.644889+0000","last_undegraded":"2024-09-12T18:35:26.644889+0000","last_fullsized":"2024-09-12T18:35:26.644889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:55.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.647264+0000","last_change":"2024-09-12T18:35:24.657665+0000","last_active":"2024-09-12T18:35:26.647264+0000","last_peered":"2024-09-12T18:35:26.647264+0000","last_clean":"2024-09-12T18:35:26.647264+0000","last_became_active":"2024-09-12T18:35:24.657015+0000","last_became_peered":"2024-09-12T18:35:24.657015+0000","last_unstale":"2024-09-12T18:35:26.647264+0000","last_undegraded":"2024-09-12T18:35:26.647264+0000","last_fullsized":"2024-09-12T18:35:26.647264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:03.171326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:27.632287+0000","last_change":"2024-09-12T18:35:25.665275+0000","last_active":"2024-09-12T18:35:27.632287+0000","last_peered":"2024-09-12T18:35:27.632287+0000","last_clean":"2024-09-12T18:35:27.632287+0000","last_became_active":"2024-09-12T18:35:25.659511+0000","last_became_peered":"2024-09-12T18:35:25.659511+0000","last_unstale":"2024-09-12T18:35:27.632287+0000","last_undegraded":"2024-09-12T18:35:27.632287+0000","last_fullsized":"2024-09-12T18:35:27.632287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:27.632815+0000","last_change":"2024-09-12T18:35:24.651913+0000","last_active":"2024-09-12T18:35:27.632815+0000","last_peered":"2024-09-12T18:35:27.632815+0000","last_clean":"2024-09-12T18:35:27.632815+0000","last_became_active":"2024-09-12T18:35:24.650421+0000","last_became_peered":"2024-09-12T18:35:24.650421+0000","last_unstale":"2024-09-12T18:35:27.632815+0000","last_undegraded":"2024-09-12T18:35:27.632815+0000","last_fullsized":"2024-09-12T18:35:27.632815+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:57.685312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.646856+0000","last_change":"2024-09-12T18:35:25.651138+0000","last_active":"2024-09-12T18:35:26.646856+0000","last_peered":"2024-09-12T18:35:26.646856+0000","last_clean":"2024-09-12T18:35:26.646856+0000","last_became_active":"2024-09-12T18:35:25.650617+0000","last_became_peered":"2024-09-12T18:35:25.650617+0000","last_unstale":"2024-09-12T18:35:26.646856+0000","last_undegraded":"2024-09-12T18:35:26.646856+0000","last_fullsized":"2024-09-12T18:35:26.646856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:58.535066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.646448+0000","last_change":"2024-09-12T18:35:24.659019+0000","last_active":"2024-09-12T18:35:26.646448+0000","last_peered":"2024-09-12T18:35:26.646448+0000","last_clean":"2024-09-12T18:35:26.646448+0000","last_became_active":"2024-09-12T18:35:24.658423+0000","last_became_peered":"2024-09-12T18:35:24.658423+0000","last_unstale":"2024-09-12T18:35:26.646448+0000","last_undegraded":"2024-09-12T18:35:26.646448+0000","last_fullsized":"2024-09-12T18:35:26.646448+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:37.668417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.646563+0000","last_change":"2024-09-12T18:35:25.662287+0000","last_active":"2024-09-12T18:35:26.646563+0000","last_peered":"2024-09-12T18:35:26.646563+0000","last_clean":"2024-09-12T18:35:26.646563+0000","last_became_active":"2024-09-12T18:35:25.660372+0000","last_became_peered":"2024-09-12T18:35:25.660372+0000","last_unstale":"2024-09-12T18:35:26.646563+0000","last_undegraded":"2024-09-12T18:35:26.646563+0000","last_fullsized":"2024-09-12T18:35:26.646563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:08.729541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.644244+0000","last_change":"2024-09-12T18:35:24.648330+0000","last_active":"2024-09-12T18:35:26.644244+0000","last_peered":"2024-09-12T18:35:26.644244+0000","last_clean":"2024-09-12T18:35:26.644244+0000","last_became_active":"2024-09-12T18:35:24.647520+0000","last_became_peered":"2024-09-12T18:35:24.647520+0000","last_unstale":"2024-09-12T18:35:26.644244+0000","last_undegraded":"2024-09-12T18:35:26.644244+0000","last_fullsized":"2024-09-12T18:35:26.644244+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:25.552055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.645820+0000","last_change":"2024-09-12T18:35:25.658674+0000","last_active":"2024-09-12T18:35:26.645820+0000","last_peered":"2024-09-12T18:35:26.645820+0000","last_clean":"2024-09-12T18:35:26.645820+0000","last_became_active":"2024-09-12T18:35:25.657386+0000","last_became_peered":"2024-09-12T18:35:25.657386+0000","last_unstale":"2024-09-12T18:35:26.645820+0000","last_undegraded":"2024-09-12T18:35:26.645820+0000","last_fullsized":"2024-09-12T18:35:26.645820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:48.037086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.643866+0000","last_change":"2024-09-12T18:35:24.646810+0000","last_active":"2024-09-12T18:35:26.643866+0000","last_peered":"2024-09-12T18:35:26.643866+0000","last_clean":"2024-09-12T18:35:26.643866+0000","last_became_active":"2024-09-12T18:35:24.646008+0000","last_became_peered":"2024-09-12T18:35:24.646008+0000","last_unstale":"2024-09-12T18:35:26.643866+0000","last_undegraded":"2024-09-12T18:35:26.643866+0000","last_fullsized":"2024-09-12T18:35:26.643866+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:43.888776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:27.633225+0000","last_change":"2024-09-12T18:35:25.667710+0000","last_active":"2024-09-12T18:35:27.633225+0000","last_peered":"2024-09-12T18:35:27.633225+0000","last_clean":"2024-09-12T18:35:27.633225+0000","last_became_active":"2024-09-12T18:35:25.666940+0000","last_became_peered":"2024-09-12T18:35:25.666940+0000","last_unstale":"2024-09-12T18:35:27.633225+0000","last_undegraded":"2024-09-12T18:35:27.633225+0000","last_fullsized":"2024-09-12T18:35:27.633225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:09.823085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.645976+0000","last_change":"2024-09-12T18:35:13.489018+0000","last_active":"2024-09-12T18:35:26.645976+0000","last_peered":"2024-09-12T18:35:26.645976+0000","last_clean":"2024-09-12T18:35:26.645976+0000","last_became_active":"2024-09-12T18:35:13.488346+0000","last_became_peered":"2024-09-12T18:35:13.488346+0000","last_unstale":"2024-09-12T18:35:26.645976+0000","last_undegraded":"2024-09-12T18:35:26.645976+0000","last_fullsized":"2024-09-12T18:35:26.645976+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_clean_scrub_stamp":"2024-09-12T18:35:12.464628+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:54.864640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.646734+0000","last_change":"2024-09-12T18:35:22.459694+0000","last_active":"2024-09-12T18:35:26.646734+0000","last_peered":"2024-09-12T18:35:26.646734+0000","last_clean":"2024-09-12T18:35:26.646734+0000","last_became_active":"2024-09-12T18:35:20.446796+0000","last_became_peered":"2024-09-12T18:35:20.446796+0000","last_unstale":"2024-09-12T18:35:26.646734+0000","last_undegraded":"2024-09-12T18:35:26.646734+0000","last_fullsized":"2024-09-12T18:35:26.646734+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:21.506024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016291610000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:27.631281+0000","last_change":"2024-09-12T18:35:24.651749+0000","last_active":"2024-09-12T18:35:27.631281+0000","last_peered":"2024-09-12T18:35:27.631281+0000","last_clean":"2024-09-12T18:35:27.631281+0000","last_became_active":"2024-09-12T18:35:24.649860+0000","last_became_peered":"2024-09-12T18:35:24.649860+0000","last_unstale":"2024-09-12T18:35:27.631281+0000","last_undegraded":"2024-09-12T18:35:27.631281+0000","last_fullsized":"2024-09-12T18:35:27.631281+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:35.430065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.647148+0000","last_change":"2024-09-12T18:35:25.662424+0000","last_active":"2024-09-12T18:35:26.647148+0000","last_peered":"2024-09-12T18:35:26.647148+0000","last_clean":"2024-09-12T18:35:26.647148+0000","last_became_active":"2024-09-12T18:35:25.661043+0000","last_became_peered":"2024-09-12T18:35:25.661043+0000","last_unstale":"2024-09-12T18:35:26.647148+0000","last_undegraded":"2024-09-12T18:35:26.647148+0000","last_fullsized":"2024-09-12T18:35:26.647148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:52.551802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.645688+0000","last_change":"2024-09-12T18:35:22.459090+0000","last_active":"2024-09-12T18:35:26.645688+0000","last_peered":"2024-09-12T18:35:26.645688+0000","last_clean":"2024-09-12T18:35:26.645688+0000","last_became_active":"2024-09-12T18:35:20.448553+0000","last_became_peered":"2024-09-12T18:35:20.448553+0000","last_unstale":"2024-09-12T18:35:26.645688+0000","last_undegraded":"2024-09-12T18:35:26.645688+0000","last_fullsized":"2024-09-12T18:35:26.645688+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:56.834808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001030836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:27.631814+0000","last_change":"2024-09-12T18:35:24.651597+0000","last_active":"2024-09-12T18:35:27.631814+0000","last_peered":"2024-09-12T18:35:27.631814+0000","last_clean":"2024-09-12T18:35:27.631814+0000","last_became_active":"2024-09-12T18:35:24.649940+0000","last_became_peered":"2024-09-12T18:35:24.649940+0000","last_unstale":"2024-09-12T18:35:27.631814+0000","last_undegraded":"2024-09-12T18:35:27.631814+0000","last_fullsized":"2024-09-12T18:35:27.631814+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:36.822432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.646469+0000","last_change":"2024-09-12T18:35:25.660529+0000","last_active":"2024-09-12T18:35:26.646469+0000","last_peered":"2024-09-12T18:35:26.646469+0000","last_clean":"2024-09-12T18:35:26.646469+0000","last_became_active":"2024-09-12T18:35:25.659537+0000","last_became_peered":"2024-09-12T18:35:25.659537+0000","last_unstale":"2024-09-12T18:35:26.646469+0000","last_undegraded":"2024-09-12T18:35:26.646469+0000","last_fullsized":"2024-09-12T18:35:26.646469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:51.790349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:27.631581+0000","last_change":"2024-09-12T18:35:22.464179+0000","last_active":"2024-09-12T18:35:27.631581+0000","last_peered":"2024-09-12T18:35:27.631581+0000","last_clean":"2024-09-12T18:35:27.631581+0000","last_became_active":"2024-09-12T18:35:20.442613+0000","last_became_peered":"2024-09-12T18:35:20.442613+0000","last_unstale":"2024-09-12T18:35:27.631581+0000","last_undegraded":"2024-09-12T18:35:27.631581+0000","last_fullsized":"2024-09-12T18:35:27.631581+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:17.636537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014134620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.643981+0000","last_change":"2024-09-12T18:35:24.641297+0000","last_active":"2024-09-12T18:35:26.643981+0000","last_peered":"2024-09-12T18:35:26.643981+0000","last_clean":"2024-09-12T18:35:26.643981+0000","last_became_active":"2024-09-12T18:35:24.637334+0000","last_became_peered":"2024-09-12T18:35:24.637334+0000","last_unstale":"2024-09-12T18:35:26.643981+0000","last_undegraded":"2024-09-12T18:35:26.643981+0000","last_fullsized":"2024-09-12T18:35:26.643981+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:50.772074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:27.633456+0000","last_change":"2024-09-12T18:35:25.659209+0000","last_active":"2024-09-12T18:35:27.633456+0000","last_peered":"2024-09-12T18:35:27.633456+0000","last_clean":"2024-09-12T18:35:27.633456+0000","last_became_active":"2024-09-12T18:35:25.656170+0000","last_became_peered":"2024-09-12T18:35:25.656170+0000","last_unstale":"2024-09-12T18:35:27.633456+0000","last_undegraded":"2024-09-12T18:35:27.633456+0000","last_fullsized":"2024-09-12T18:35:27.633456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:40.925757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":30,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.646731+0000","last_change":"2024-09-12T18:35:22.459049+0000","last_active":"2024-09-12T18:35:26.646731+0000","last_peered":"2024-09-12T18:35:26.646731+0000","last_clean":"2024-09-12T18:35:26.646731+0000","last_became_active":"2024-09-12T18:35:20.446814+0000","last_became_peered":"2024-09-12T18:35:20.446814+0000","last_unstale":"2024-09-12T18:35:26.646731+0000","last_undegraded":"2024-09-12T18:35:26.646731+0000","last_fullsized":"2024-09-12T18:35:26.646731+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:18.033595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010716149999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.646652+0000","last_change":"2024-09-12T18:35:24.658273+0000","last_active":"2024-09-12T18:35:26.646652+0000","last_peered":"2024-09-12T18:35:26.646652+0000","last_clean":"2024-09-12T18:35:26.646652+0000","last_became_active":"2024-09-12T18:35:24.657433+0000","last_became_peered":"2024-09-12T18:35:24.657433+0000","last_unstale":"2024-09-12T18:35:26.646652+0000","last_undegraded":"2024-09-12T18:35:26.646652+0000","last_fullsized":"2024-09-12T18:35:26.646652+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:48.497218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:27.633411+0000","last_change":"2024-09-12T18:35:25.655830+0000","last_active":"2024-09-12T18:35:27.633411+0000","last_peered":"2024-09-12T18:35:27.633411+0000","last_clean":"2024-09-12T18:35:27.633411+0000","last_became_active":"2024-09-12T18:35:25.652126+0000","last_became_peered":"2024-09-12T18:35:25.652126+0000","last_unstale":"2024-09-12T18:35:27.633411+0000","last_undegraded":"2024-09-12T18:35:27.633411+0000","last_fullsized":"2024-09-12T18:35:27.633411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:04.080721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.647292+0000","last_change":"2024-09-12T18:35:24.657618+0000","last_active":"2024-09-12T18:35:26.647292+0000","last_peered":"2024-09-12T18:35:26.647292+0000","last_clean":"2024-09-12T18:35:26.647292+0000","last_became_active":"2024-09-12T18:35:24.656741+0000","last_became_peered":"2024-09-12T18:35:24.656741+0000","last_unstale":"2024-09-12T18:35:26.647292+0000","last_undegraded":"2024-09-12T18:35:26.647292+0000","last_fullsized":"2024-09-12T18:35:26.647292+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:43.113104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:27.633547+0000","last_change":"2024-09-12T18:35:22.464180+0000","last_active":"2024-09-12T18:35:27.633547+0000","last_peered":"2024-09-12T18:35:27.633547+0000","last_clean":"2024-09-12T18:35:27.633547+0000","last_became_active":"2024-09-12T18:35:20.442566+0000","last_became_peered":"2024-09-12T18:35:20.442566+0000","last_unstale":"2024-09-12T18:35:27.633547+0000","last_undegraded":"2024-09-12T18:35:27.633547+0000","last_fullsized":"2024-09-12T18:35:27.633547+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:29.021710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001325786,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.645115+0000","last_change":"2024-09-12T18:35:25.650458+0000","last_active":"2024-09-12T18:35:26.645115+0000","last_peered":"2024-09-12T18:35:26.645115+0000","last_clean":"2024-09-12T18:35:26.645115+0000","last_became_active":"2024-09-12T18:35:25.648761+0000","last_became_peered":"2024-09-12T18:35:25.648761+0000","last_unstale":"2024-09-12T18:35:26.645115+0000","last_undegraded":"2024-09-12T18:35:26.645115+0000","last_fullsized":"2024-09-12T18:35:26.645115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:53.026950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:27.633236+0000","last_change":"2024-09-12T18:35:24.649669+0000","last_active":"2024-09-12T18:35:27.633236+0000","last_peered":"2024-09-12T18:35:27.633236+0000","last_clean":"2024-09-12T18:35:27.633236+0000","last_became_active":"2024-09-12T18:35:24.648881+0000","last_became_peered":"2024-09-12T18:35:24.648881+0000","last_unstale":"2024-09-12T18:35:27.633236+0000","last_undegraded":"2024-09-12T18:35:27.633236+0000","last_fullsized":"2024-09-12T18:35:27.633236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:23.614734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.646942+0000","last_change":"2024-09-12T18:35:22.458666+0000","last_active":"2024-09-12T18:35:26.646942+0000","last_peered":"2024-09-12T18:35:26.646942+0000","last_clean":"2024-09-12T18:35:26.646942+0000","last_became_active":"2024-09-12T18:35:20.442394+0000","last_became_peered":"2024-09-12T18:35:20.442394+0000","last_unstale":"2024-09-12T18:35:26.646942+0000","last_undegraded":"2024-09-12T18:35:26.646942+0000","last_fullsized":"2024-09-12T18:35:26.646942+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:51.840246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080163599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.645240+0000","last_change":"2024-09-12T18:35:25.650717+0000","last_active":"2024-09-12T18:35:26.645240+0000","last_peered":"2024-09-12T18:35:26.645240+0000","last_clean":"2024-09-12T18:35:26.645240+0000","last_became_active":"2024-09-12T18:35:25.649147+0000","last_became_peered":"2024-09-12T18:35:25.649147+0000","last_unstale":"2024-09-12T18:35:26.645240+0000","last_undegraded":"2024-09-12T18:35:26.645240+0000","last_fullsized":"2024-09-12T18:35:26.645240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:07.365888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:27.634285+0000","last_change":"2024-09-12T18:35:24.657234+0000","last_active":"2024-09-12T18:35:27.634285+0000","last_peered":"2024-09-12T18:35:27.634285+0000","last_clean":"2024-09-12T18:35:27.634285+0000","last_became_active":"2024-09-12T18:35:24.655950+0000","last_became_peered":"2024-09-12T18:35:24.655950+0000","last_unstale":"2024-09-12T18:35:27.634285+0000","last_undegraded":"2024-09-12T18:35:27.634285+0000","last_fullsized":"2024-09-12T18:35:27.634285+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:17.466623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:27.633869+0000","last_change":"2024-09-12T18:35:22.464656+0000","last_active":"2024-09-12T18:35:27.633869+0000","last_peered":"2024-09-12T18:35:27.633869+0000","last_clean":"2024-09-12T18:35:27.633869+0000","last_became_active":"2024-09-12T18:35:20.445470+0000","last_became_peered":"2024-09-12T18:35:20.445470+0000","last_unstale":"2024-09-12T18:35:27.633869+0000","last_undegraded":"2024-09-12T18:35:27.633869+0000","last_fullsized":"2024-09-12T18:35:27.633869+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:58.947359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001742681,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:27.630384+0000","last_change":"2024-09-12T18:35:25.658887+0000","last_active":"2024-09-12T18:35:27.630384+0000","last_peered":"2024-09-12T18:35:27.630384+0000","last_clean":"2024-09-12T18:35:27.630384+0000","last_became_active":"2024-09-12T18:35:25.656829+0000","last_became_peered":"2024-09-12T18:35:25.656829+0000","last_unstale":"2024-09-12T18:35:27.630384+0000","last_undegraded":"2024-09-12T18:35:27.630384+0000","last_fullsized":"2024-09-12T18:35:27.630384+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:50.109858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:27.633705+0000","last_change":"2024-09-12T18:35:24.654518+0000","last_active":"2024-09-12T18:35:27.633705+0000","last_peered":"2024-09-12T18:35:27.633705+0000","last_clean":"2024-09-12T18:35:27.633705+0000","last_became_active":"2024-09-12T18:35:24.650309+0000","last_became_peered":"2024-09-12T18:35:24.650309+0000","last_unstale":"2024-09-12T18:35:27.633705+0000","last_undegraded":"2024-09-12T18:35:27.633705+0000","last_fullsized":"2024-09-12T18:35:27.633705+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:16.669035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.645310+0000","last_change":"2024-09-12T18:35:22.459767+0000","last_active":"2024-09-12T18:35:26.645310+0000","last_peered":"2024-09-12T18:35:26.645310+0000","last_clean":"2024-09-12T18:35:26.645310+0000","last_became_active":"2024-09-12T18:35:20.448521+0000","last_became_peered":"2024-09-12T18:35:20.448521+0000","last_unstale":"2024-09-12T18:35:26.645310+0000","last_undegraded":"2024-09-12T18:35:26.645310+0000","last_fullsized":"2024-09-12T18:35:26.645310+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:33.463792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017009670000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.643932+0000","last_change":"2024-09-12T18:35:25.648150+0000","last_active":"2024-09-12T18:35:26.643932+0000","last_peered":"2024-09-12T18:35:26.643932+0000","last_clean":"2024-09-12T18:35:26.643932+0000","last_became_active":"2024-09-12T18:35:25.647347+0000","last_became_peered":"2024-09-12T18:35:25.647347+0000","last_unstale":"2024-09-12T18:35:26.643932+0000","last_undegraded":"2024-09-12T18:35:26.643932+0000","last_fullsized":"2024-09-12T18:35:26.643932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:48.968336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.645878+0000","last_change":"2024-09-12T18:35:25.660696+0000","last_active":"2024-09-12T18:35:26.645878+0000","last_peered":"2024-09-12T18:35:26.645878+0000","last_clean":"2024-09-12T18:35:26.645878+0000","last_became_active":"2024-09-12T18:35:25.659827+0000","last_became_peered":"2024-09-12T18:35:25.659827+0000","last_unstale":"2024-09-12T18:35:26.645878+0000","last_undegraded":"2024-09-12T18:35:26.645878+0000","last_fullsized":"2024-09-12T18:35:26.645878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:15.678289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.647112+0000","last_change":"2024-09-12T18:35:24.655051+0000","last_active":"2024-09-12T18:35:26.647112+0000","last_peered":"2024-09-12T18:35:26.647112+0000","last_clean":"2024-09-12T18:35:26.647112+0000","last_became_active":"2024-09-12T18:35:24.654282+0000","last_became_peered":"2024-09-12T18:35:24.654282+0000","last_unstale":"2024-09-12T18:35:26.647112+0000","last_undegraded":"2024-09-12T18:35:26.647112+0000","last_fullsized":"2024-09-12T18:35:26.647112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:08.159799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:27.630760+0000","last_change":"2024-09-12T18:35:25.659237+0000","last_active":"2024-09-12T18:35:27.630760+0000","last_peered":"2024-09-12T18:35:27.630760+0000","last_clean":"2024-09-12T18:35:27.630760+0000","last_became_active":"2024-09-12T18:35:25.658423+0000","last_became_peered":"2024-09-12T18:35:25.658423+0000","last_unstale":"2024-09-12T18:35:27.630760+0000","last_undegraded":"2024-09-12T18:35:27.630760+0000","last_fullsized":"2024-09-12T18:35:27.630760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:42.956934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.646971+0000","last_change":"2024-09-12T18:35:24.648658+0000","last_active":"2024-09-12T18:35:26.646971+0000","last_peered":"2024-09-12T18:35:26.646971+0000","last_clean":"2024-09-12T18:35:26.646971+0000","last_became_active":"2024-09-12T18:35:24.647826+0000","last_became_peered":"2024-09-12T18:35:24.647826+0000","last_unstale":"2024-09-12T18:35:26.646971+0000","last_undegraded":"2024-09-12T18:35:26.646971+0000","last_fullsized":"2024-09-12T18:35:26.646971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:24.167549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.645433+0000","last_change":"2024-09-12T18:35:24.656855+0000","last_active":"2024-09-12T18:35:26.645433+0000","last_peered":"2024-09-12T18:35:26.645433+0000","last_clean":"2024-09-12T18:35:26.645433+0000","last_became_active":"2024-09-12T18:35:24.655935+0000","last_became_peered":"2024-09-12T18:35:24.655935+0000","last_unstale":"2024-09-12T18:35:26.645433+0000","last_undegraded":"2024-09-12T18:35:26.645433+0000","last_fullsized":"2024-09-12T18:35:26.645433+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:35.430065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:27.630874+0000","last_change":"2024-09-12T18:35:25.661801+0000","last_active":"2024-09-12T18:35:27.630874+0000","last_peered":"2024-09-12T18:35:27.630874+0000","last_clean":"2024-09-12T18:35:27.630874+0000","last_became_active":"2024-09-12T18:35:25.658476+0000","last_became_peered":"2024-09-12T18:35:25.658476+0000","last_unstale":"2024-09-12T18:35:27.630874+0000","last_undegraded":"2024-09-12T18:35:27.630874+0000","last_fullsized":"2024-09-12T18:35:27.630874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:58.246449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:27.634041+0000","last_change":"2024-09-12T18:35:24.652399+0000","last_active":"2024-09-12T18:35:27.634041+0000","last_peered":"2024-09-12T18:35:27.634041+0000","last_clean":"2024-09-12T18:35:27.634041+0000","last_became_active":"2024-09-12T18:35:24.651416+0000","last_became_peered":"2024-09-12T18:35:24.651416+0000","last_unstale":"2024-09-12T18:35:27.634041+0000","last_undegraded":"2024-09-12T18:35:27.634041+0000","last_fullsized":"2024-09-12T18:35:27.634041+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:32.594978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:27.630281+0000","last_change":"2024-09-12T18:35:25.658570+0000","last_active":"2024-09-12T18:35:27.630281+0000","last_peered":"2024-09-12T18:35:27.630281+0000","last_clean":"2024-09-12T18:35:27.630281+0000","last_became_active":"2024-09-12T18:35:25.656561+0000","last_became_peered":"2024-09-12T18:35:25.656561+0000","last_unstale":"2024-09-12T18:35:27.630281+0000","last_undegraded":"2024-09-12T18:35:27.630281+0000","last_fullsized":"2024-09-12T18:35:27.630281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:22.225756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.646690+0000","last_change":"2024-09-12T18:35:25.651217+0000","last_active":"2024-09-12T18:35:26.646690+0000","last_peered":"2024-09-12T18:35:26.646690+0000","last_clean":"2024-09-12T18:35:26.646690+0000","last_became_active":"2024-09-12T18:35:25.649544+0000","last_became_peered":"2024-09-12T18:35:25.649544+0000","last_unstale":"2024-09-12T18:35:26.646690+0000","last_undegraded":"2024-09-12T18:35:26.646690+0000","last_fullsized":"2024-09-12T18:35:26.646690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:41.601376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:27.630760+0000","last_change":"2024-09-12T18:35:24.657489+0000","last_active":"2024-09-12T18:35:27.630760+0000","last_peered":"2024-09-12T18:35:27.630760+0000","last_clean":"2024-09-12T18:35:27.630760+0000","last_became_active":"2024-09-12T18:35:24.656030+0000","last_became_peered":"2024-09-12T18:35:24.656030+0000","last_unstale":"2024-09-12T18:35:27.630760+0000","last_undegraded":"2024-09-12T18:35:27.630760+0000","last_fullsized":"2024-09-12T18:35:27.630760+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:11.362759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:27.632376+0000","last_change":"2024-09-12T18:35:25.661544+0000","last_active":"2024-09-12T18:35:27.632376+0000","last_peered":"2024-09-12T18:35:27.632376+0000","last_clean":"2024-09-12T18:35:27.632376+0000","last_became_active":"2024-09-12T18:35:25.656985+0000","last_became_peered":"2024-09-12T18:35:25.656985+0000","last_unstale":"2024-09-12T18:35:27.632376+0000","last_undegraded":"2024-09-12T18:35:27.632376+0000","last_fullsized":"2024-09-12T18:35:27.632376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:27.631086+0000","last_change":"2024-09-12T18:35:24.646342+0000","last_active":"2024-09-12T18:35:27.631086+0000","last_peered":"2024-09-12T18:35:27.631086+0000","last_clean":"2024-09-12T18:35:27.631086+0000","last_became_active":"2024-09-12T18:35:24.644773+0000","last_became_peered":"2024-09-12T18:35:24.644773+0000","last_unstale":"2024-09-12T18:35:27.631086+0000","last_undegraded":"2024-09-12T18:35:27.631086+0000","last_fullsized":"2024-09-12T18:35:27.631086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:17.011231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.645854+0000","last_change":"2024-09-12T18:35:25.656712+0000","last_active":"2024-09-12T18:35:26.645854+0000","last_peered":"2024-09-12T18:35:26.645854+0000","last_clean":"2024-09-12T18:35:26.645854+0000","last_became_active":"2024-09-12T18:35:25.654473+0000","last_became_peered":"2024-09-12T18:35:25.654473+0000","last_unstale":"2024-09-12T18:35:26.645854+0000","last_undegraded":"2024-09-12T18:35:26.645854+0000","last_fullsized":"2024-09-12T18:35:26.645854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:01.464680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.645208+0000","last_change":"2024-09-12T18:35:24.659935+0000","last_active":"2024-09-12T18:35:26.645208+0000","last_peered":"2024-09-12T18:35:26.645208+0000","last_clean":"2024-09-12T18:35:26.645208+0000","last_became_active":"2024-09-12T18:35:24.659111+0000","last_became_peered":"2024-09-12T18:35:24.659111+0000","last_unstale":"2024-09-12T18:35:26.645208+0000","last_undegraded":"2024-09-12T18:35:26.645208+0000","last_fullsized":"2024-09-12T18:35:26.645208+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:11.480154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.645912+0000","last_change":"2024-09-12T18:35:25.660557+0000","last_active":"2024-09-12T18:35:26.645912+0000","last_peered":"2024-09-12T18:35:26.645912+0000","last_clean":"2024-09-12T18:35:26.645912+0000","last_became_active":"2024-09-12T18:35:25.652300+0000","last_became_peered":"2024-09-12T18:35:25.652300+0000","last_unstale":"2024-09-12T18:35:26.645912+0000","last_undegraded":"2024-09-12T18:35:26.645912+0000","last_fullsized":"2024-09-12T18:35:26.645912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:10:59.995841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.645554+0000","last_change":"2024-09-12T18:35:24.638538+0000","last_active":"2024-09-12T18:35:26.645554+0000","last_peered":"2024-09-12T18:35:26.645554+0000","last_clean":"2024-09-12T18:35:26.645554+0000","last_became_active":"2024-09-12T18:35:24.637242+0000","last_became_peered":"2024-09-12T18:35:24.637242+0000","last_unstale":"2024-09-12T18:35:26.645554+0000","last_undegraded":"2024-09-12T18:35:26.645554+0000","last_fullsized":"2024-09-12T18:35:26.645554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:26.877441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.645693+0000","last_change":"2024-09-12T18:35:25.662537+0000","last_active":"2024-09-12T18:35:26.645693+0000","last_peered":"2024-09-12T18:35:26.645693+0000","last_clean":"2024-09-12T18:35:26.645693+0000","last_became_active":"2024-09-12T18:35:25.661441+0000","last_became_peered":"2024-09-12T18:35:25.661441+0000","last_unstale":"2024-09-12T18:35:26.645693+0000","last_undegraded":"2024-09-12T18:35:26.645693+0000","last_fullsized":"2024-09-12T18:35:26.645693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:14.397867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.646830+0000","last_change":"2024-09-12T18:35:24.657635+0000","last_active":"2024-09-12T18:35:26.646830+0000","last_peered":"2024-09-12T18:35:26.646830+0000","last_clean":"2024-09-12T18:35:26.646830+0000","last_became_active":"2024-09-12T18:35:24.655992+0000","last_became_peered":"2024-09-12T18:35:24.655992+0000","last_unstale":"2024-09-12T18:35:26.646830+0000","last_undegraded":"2024-09-12T18:35:26.646830+0000","last_fullsized":"2024-09-12T18:35:26.646830+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:33.536755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.645717+0000","last_change":"2024-09-12T18:35:25.651406+0000","last_active":"2024-09-12T18:35:26.645717+0000","last_peered":"2024-09-12T18:35:26.645717+0000","last_clean":"2024-09-12T18:35:26.645717+0000","last_became_active":"2024-09-12T18:35:25.649728+0000","last_became_peered":"2024-09-12T18:35:25.649728+0000","last_unstale":"2024-09-12T18:35:26.645717+0000","last_undegraded":"2024-09-12T18:35:26.645717+0000","last_fullsized":"2024-09-12T18:35:26.645717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:41.773283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.646697+0000","last_change":"2024-09-12T18:35:24.649153+0000","last_active":"2024-09-12T18:35:26.646697+0000","last_peered":"2024-09-12T18:35:26.646697+0000","last_clean":"2024-09-12T18:35:26.646697+0000","last_became_active":"2024-09-12T18:35:24.648512+0000","last_became_peered":"2024-09-12T18:35:24.648512+0000","last_unstale":"2024-09-12T18:35:26.646697+0000","last_undegraded":"2024-09-12T18:35:26.646697+0000","last_fullsized":"2024-09-12T18:35:26.646697+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:07.810456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.646353+0000","last_change":"2024-09-12T18:35:25.656799+0000","last_active":"2024-09-12T18:35:26.646353+0000","last_peered":"2024-09-12T18:35:26.646353+0000","last_clean":"2024-09-12T18:35:26.646353+0000","last_became_active":"2024-09-12T18:35:25.654980+0000","last_became_peered":"2024-09-12T18:35:25.654980+0000","last_unstale":"2024-09-12T18:35:26.646353+0000","last_undegraded":"2024-09-12T18:35:26.646353+0000","last_fullsized":"2024-09-12T18:35:26.646353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:10.735439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:27.633236+0000","last_change":"2024-09-12T18:35:24.656268+0000","last_active":"2024-09-12T18:35:27.633236+0000","last_peered":"2024-09-12T18:35:27.633236+0000","last_clean":"2024-09-12T18:35:27.633236+0000","last_became_active":"2024-09-12T18:35:24.655420+0000","last_became_peered":"2024-09-12T18:35:24.655420+0000","last_unstale":"2024-09-12T18:35:27.633236+0000","last_undegraded":"2024-09-12T18:35:27.633236+0000","last_fullsized":"2024-09-12T18:35:27.633236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:04.654666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:26.645232+0000","last_change":"2024-09-12T18:35:25.661042+0000","last_active":"2024-09-12T18:35:26.645232+0000","last_peered":"2024-09-12T18:35:26.645232+0000","last_clean":"2024-09-12T18:35:26.645232+0000","last_became_active":"2024-09-12T18:35:25.660163+0000","last_became_peered":"2024-09-12T18:35:25.660163+0000","last_unstale":"2024-09-12T18:35:26.645232+0000","last_undegraded":"2024-09-12T18:35:26.645232+0000","last_fullsized":"2024-09-12T18:35:26.645232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:37.682184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:35:27.633726+0000","last_change":"2024-09-12T18:35:24.652304+0000","last_active":"2024-09-12T18:35:27.633726+0000","last_peered":"2024-09-12T18:35:27.633726+0000","last_clean":"2024-09-12T18:35:27.633726+0000","last_became_active":"2024-09-12T18:35:24.651460+0000","last_became_peered":"2024-09-12T18:35:24.651460+0000","last_unstale":"2024-09-12T18:35:27.633726+0000","last_undegraded":"2024-09-12T18:35:27.633726+0000","last_fullsized":"2024-09-12T18:35:27.633726+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:42.050557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":253952,"data_stored":651465,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":266240,"data_stored":652100,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":176128,"data_stored":59938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:35:33.406 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T18:35:33.406 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-12T18:35:33.407 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T18:35:33.755 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:35:33.774 INFO:teuthology.orchestra.run.smithi073.stdout:[{"version":4,"timestamp":"2024-09-12T18:35:12.311670+0000","name":"","changes":[{"name":"osd.1/osd_mclock_max_capacity_iops_ssd","new_value":"6492.405483"}]}] 2024-09-12T18:35:33.775 INFO:tasks.ceph_manager:config epoch is 4 2024-09-12T18:35:33.775 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T18:35:33.775 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T18:35:33.775 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T18:35:34.110 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:35:34.126 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3717209446},{"type":"v1","addr":"172.21.15.73:6801","nonce":3717209446}]},"active_addr":"172.21.15.73:6801/3717209446","active_change":"2024-09-12T18:35:08.363638+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4105,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":1673024914}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":745129001}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":3390513668}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":2636842715}]}]} 2024-09-12T18:35:34.131 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T18:35:34.132 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T18:35:34.132 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T18:35:34.416 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:35:34.416 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":20,"fsid":"c08d5a84-711b-44bf-bdf1-e06ecc2c7c00","created":"2024-09-12T18:35:02.695853+0000","modified":"2024-09-12T18:35:32.399204+0000","last_up_change":"2024-09-12T18:35:12.464628+0000","last_in_change":"2024-09-12T18:35:04.352525+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T18:35:12.418430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T18:35:18.665309+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T18:35:23.447845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T18:35:23.959973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f1cf24e8-6179-4666-a444-fa81ef0d7482","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6801","nonce":2710632206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6803","nonce":2710632206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6807","nonce":2710632206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6805","nonce":2710632206}]},"public_addr":"172.21.15.114:6801/2710632206","cluster_addr":"172.21.15.114:6803/2710632206","heartbeat_back_addr":"172.21.15.114:6807/2710632206","heartbeat_front_addr":"172.21.15.114:6805/2710632206","state":["exists","up"]},{"osd":1,"uuid":"3fdb0044-2820-4411-978b-4b6e94fbf0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6801","nonce":862189968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6803","nonce":862189968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6807","nonce":862189968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6805","nonce":862189968}]},"public_addr":"172.21.15.143:6801/862189968","cluster_addr":"172.21.15.143:6803/862189968","heartbeat_back_addr":"172.21.15.143:6807/862189968","heartbeat_front_addr":"172.21.15.143:6805/862189968","state":["exists","up"]},{"osd":2,"uuid":"6fb554da-561f-4aa2-b855-0e3adb98b057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6801","nonce":1397104153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6803","nonce":1397104153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6807","nonce":1397104153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6805","nonce":1397104153}]},"public_addr":"172.21.15.162:6801/1397104153","cluster_addr":"172.21.15.162:6803/1397104153","heartbeat_back_addr":"172.21.15.162:6807/1397104153","heartbeat_front_addr":"172.21.15.162:6805/1397104153","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:35:10.239320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:35:10.861760+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:35:10.355997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:35:34.433 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T18:35:34.433 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T18:35:34.721 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:35:34.721 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":20,"fsid":"c08d5a84-711b-44bf-bdf1-e06ecc2c7c00","created":"2024-09-12T18:35:02.695853+0000","modified":"2024-09-12T18:35:32.399204+0000","last_up_change":"2024-09-12T18:35:12.464628+0000","last_in_change":"2024-09-12T18:35:04.352525+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T18:35:12.418430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T18:35:18.665309+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T18:35:23.447845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T18:35:23.959973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f1cf24e8-6179-4666-a444-fa81ef0d7482","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6801","nonce":2710632206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6803","nonce":2710632206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6807","nonce":2710632206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6805","nonce":2710632206}]},"public_addr":"172.21.15.114:6801/2710632206","cluster_addr":"172.21.15.114:6803/2710632206","heartbeat_back_addr":"172.21.15.114:6807/2710632206","heartbeat_front_addr":"172.21.15.114:6805/2710632206","state":["exists","up"]},{"osd":1,"uuid":"3fdb0044-2820-4411-978b-4b6e94fbf0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6801","nonce":862189968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6803","nonce":862189968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6807","nonce":862189968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6805","nonce":862189968}]},"public_addr":"172.21.15.143:6801/862189968","cluster_addr":"172.21.15.143:6803/862189968","heartbeat_back_addr":"172.21.15.143:6807/862189968","heartbeat_front_addr":"172.21.15.143:6805/862189968","state":["exists","up"]},{"osd":2,"uuid":"6fb554da-561f-4aa2-b855-0e3adb98b057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6801","nonce":1397104153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6803","nonce":1397104153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6807","nonce":1397104153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6805","nonce":1397104153}]},"public_addr":"172.21.15.162:6801/1397104153","cluster_addr":"172.21.15.162:6803/1397104153","heartbeat_back_addr":"172.21.15.162:6807/1397104153","heartbeat_front_addr":"172.21.15.162:6805/1397104153","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:35:10.239320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:35:10.861760+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:35:10.355997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:35:34.739 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T18:35:34.739 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T18:35:34.739 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T18:35:34.907 INFO:teuthology.orchestra.run.smithi073.stdout:38654705671 2024-09-12T18:35:34.908 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T18:35:34.910 INFO:teuthology.orchestra.run.smithi073.stdout:34359738375 2024-09-12T18:35:34.911 INFO:teuthology.orchestra.run.smithi073.stdout:34359738375 2024-09-12T18:35:34.911 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T18:35:34.912 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T18:35:35.198 INFO:teuthology.orchestra.run.smithi073.stdout:38654705670 2024-09-12T18:35:35.221 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705670 for osd.1 2024-09-12T18:35:35.248 INFO:teuthology.orchestra.run.smithi073.stdout:34359738374 2024-09-12T18:35:35.260 INFO:teuthology.orchestra.run.smithi073.stdout:34359738374 2024-09-12T18:35:35.265 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738374 for osd.0 2024-09-12T18:35:35.277 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738374 for osd.2 2024-09-12T18:35:36.222 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T18:35:36.266 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T18:35:36.278 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T18:35:36.544 INFO:teuthology.orchestra.run.smithi073.stdout:38654705671 2024-09-12T18:35:36.561 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.1 2024-09-12T18:35:36.561 DEBUG:teuthology.parallel:result is None 2024-09-12T18:35:36.586 INFO:teuthology.orchestra.run.smithi073.stdout:34359738375 2024-09-12T18:35:36.604 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738375 for osd.0 2024-09-12T18:35:36.604 DEBUG:teuthology.parallel:result is None 2024-09-12T18:35:36.621 INFO:teuthology.orchestra.run.smithi073.stdout:34359738375 2024-09-12T18:35:36.638 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738375 for osd.2 2024-09-12T18:35:36.638 DEBUG:teuthology.parallel:result is None 2024-09-12T18:35:36.638 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T18:35:36.639 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:35:36.976 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:35:36.977 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T18:35:36.993 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-09-12T18:35:36.379037+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":192,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90104,"kb_used_data":704,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025416,"statfs":{"total":289910292480,"available":289818025984,"internally_reserved":0,"allocated":720896,"data_stored":1376307,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4783,"internal_metadata":91483473},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":90,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.740051"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410091+0000","last_change":"2024-09-12T18:35:25.657389+0000","last_active":"2024-09-12T18:35:32.410091+0000","last_peered":"2024-09-12T18:35:32.410091+0000","last_clean":"2024-09-12T18:35:32.410091+0000","last_became_active":"2024-09-12T18:35:25.651857+0000","last_became_peered":"2024-09-12T18:35:25.651857+0000","last_unstale":"2024-09-12T18:35:32.410091+0000","last_undegraded":"2024-09-12T18:35:32.410091+0000","last_fullsized":"2024-09-12T18:35:32.410091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:50.264536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409235+0000","last_change":"2024-09-12T18:35:25.659760+0000","last_active":"2024-09-12T18:35:32.409235+0000","last_peered":"2024-09-12T18:35:32.409235+0000","last_clean":"2024-09-12T18:35:32.409235+0000","last_became_active":"2024-09-12T18:35:25.654920+0000","last_became_peered":"2024-09-12T18:35:25.654920+0000","last_unstale":"2024-09-12T18:35:32.409235+0000","last_undegraded":"2024-09-12T18:35:32.409235+0000","last_fullsized":"2024-09-12T18:35:32.409235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:21.519881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408918+0000","last_change":"2024-09-12T18:35:25.659460+0000","last_active":"2024-09-12T18:35:32.408918+0000","last_peered":"2024-09-12T18:35:32.408918+0000","last_clean":"2024-09-12T18:35:32.408918+0000","last_became_active":"2024-09-12T18:35:25.657782+0000","last_became_peered":"2024-09-12T18:35:25.657782+0000","last_unstale":"2024-09-12T18:35:32.408918+0000","last_undegraded":"2024-09-12T18:35:32.408918+0000","last_fullsized":"2024-09-12T18:35:32.408918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:38.544284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408838+0000","last_change":"2024-09-12T18:35:25.663617+0000","last_active":"2024-09-12T18:35:32.408838+0000","last_peered":"2024-09-12T18:35:32.408838+0000","last_clean":"2024-09-12T18:35:32.408838+0000","last_became_active":"2024-09-12T18:35:25.661977+0000","last_became_peered":"2024-09-12T18:35:25.661977+0000","last_unstale":"2024-09-12T18:35:32.408838+0000","last_undegraded":"2024-09-12T18:35:32.408838+0000","last_fullsized":"2024-09-12T18:35:32.408838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:14.748234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408831+0000","last_change":"2024-09-12T18:35:25.656566+0000","last_active":"2024-09-12T18:35:32.408831+0000","last_peered":"2024-09-12T18:35:32.408831+0000","last_clean":"2024-09-12T18:35:32.408831+0000","last_became_active":"2024-09-12T18:35:25.654898+0000","last_became_peered":"2024-09-12T18:35:25.654898+0000","last_unstale":"2024-09-12T18:35:32.408831+0000","last_undegraded":"2024-09-12T18:35:32.408831+0000","last_fullsized":"2024-09-12T18:35:32.408831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:36.113250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408286+0000","last_change":"2024-09-12T18:35:25.652754+0000","last_active":"2024-09-12T18:35:32.408286+0000","last_peered":"2024-09-12T18:35:32.408286+0000","last_clean":"2024-09-12T18:35:32.408286+0000","last_became_active":"2024-09-12T18:35:25.651217+0000","last_became_peered":"2024-09-12T18:35:25.651217+0000","last_unstale":"2024-09-12T18:35:32.408286+0000","last_undegraded":"2024-09-12T18:35:32.408286+0000","last_fullsized":"2024-09-12T18:35:32.408286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:24.585774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408085+0000","last_change":"2024-09-12T18:35:25.659811+0000","last_active":"2024-09-12T18:35:32.408085+0000","last_peered":"2024-09-12T18:35:32.408085+0000","last_clean":"2024-09-12T18:35:32.408085+0000","last_became_active":"2024-09-12T18:35:25.658998+0000","last_became_peered":"2024-09-12T18:35:25.658998+0000","last_unstale":"2024-09-12T18:35:32.408085+0000","last_undegraded":"2024-09-12T18:35:32.408085+0000","last_fullsized":"2024-09-12T18:35:32.408085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.407720+0000","last_change":"2024-09-12T18:35:25.653999+0000","last_active":"2024-09-12T18:35:32.407720+0000","last_peered":"2024-09-12T18:35:32.407720+0000","last_clean":"2024-09-12T18:35:32.407720+0000","last_became_active":"2024-09-12T18:35:25.653319+0000","last_became_peered":"2024-09-12T18:35:25.653319+0000","last_unstale":"2024-09-12T18:35:32.407720+0000","last_undegraded":"2024-09-12T18:35:32.407720+0000","last_fullsized":"2024-09-12T18:35:32.407720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:04.718000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095705+0000","last_change":"2024-09-12T18:35:25.668339+0000","last_active":"2024-09-12T18:35:33.095705+0000","last_peered":"2024-09-12T18:35:33.095705+0000","last_clean":"2024-09-12T18:35:33.095705+0000","last_became_active":"2024-09-12T18:35:25.667608+0000","last_became_peered":"2024-09-12T18:35:25.667608+0000","last_unstale":"2024-09-12T18:35:33.095705+0000","last_undegraded":"2024-09-12T18:35:33.095705+0000","last_fullsized":"2024-09-12T18:35:33.095705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:15.699745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409709+0000","last_change":"2024-09-12T18:35:25.660174+0000","last_active":"2024-09-12T18:35:32.409709+0000","last_peered":"2024-09-12T18:35:32.409709+0000","last_clean":"2024-09-12T18:35:32.409709+0000","last_became_active":"2024-09-12T18:35:25.656560+0000","last_became_peered":"2024-09-12T18:35:25.656560+0000","last_unstale":"2024-09-12T18:35:32.409709+0000","last_undegraded":"2024-09-12T18:35:32.409709+0000","last_fullsized":"2024-09-12T18:35:32.409709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:47.268505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409405+0000","last_change":"2024-09-12T18:35:25.649858+0000","last_active":"2024-09-12T18:35:32.409405+0000","last_peered":"2024-09-12T18:35:32.409405+0000","last_clean":"2024-09-12T18:35:32.409405+0000","last_became_active":"2024-09-12T18:35:25.649090+0000","last_became_peered":"2024-09-12T18:35:25.649090+0000","last_unstale":"2024-09-12T18:35:32.409405+0000","last_undegraded":"2024-09-12T18:35:32.409405+0000","last_fullsized":"2024-09-12T18:35:32.409405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:33.158421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409039+0000","last_change":"2024-09-12T18:35:25.649885+0000","last_active":"2024-09-12T18:35:32.409039+0000","last_peered":"2024-09-12T18:35:32.409039+0000","last_clean":"2024-09-12T18:35:32.409039+0000","last_became_active":"2024-09-12T18:35:25.649111+0000","last_became_peered":"2024-09-12T18:35:25.649111+0000","last_unstale":"2024-09-12T18:35:32.409039+0000","last_undegraded":"2024-09-12T18:35:32.409039+0000","last_fullsized":"2024-09-12T18:35:32.409039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:17.162410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408499+0000","last_change":"2024-09-12T18:35:25.651541+0000","last_active":"2024-09-12T18:35:32.408499+0000","last_peered":"2024-09-12T18:35:32.408499+0000","last_clean":"2024-09-12T18:35:32.408499+0000","last_became_active":"2024-09-12T18:35:25.650661+0000","last_became_peered":"2024-09-12T18:35:25.650661+0000","last_unstale":"2024-09-12T18:35:32.408499+0000","last_undegraded":"2024-09-12T18:35:32.408499+0000","last_fullsized":"2024-09-12T18:35:32.408499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:52.082734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408701+0000","last_change":"2024-09-12T18:35:25.657913+0000","last_active":"2024-09-12T18:35:32.408701+0000","last_peered":"2024-09-12T18:35:32.408701+0000","last_clean":"2024-09-12T18:35:32.408701+0000","last_became_active":"2024-09-12T18:35:25.657082+0000","last_became_peered":"2024-09-12T18:35:25.657082+0000","last_unstale":"2024-09-12T18:35:32.408701+0000","last_undegraded":"2024-09-12T18:35:32.408701+0000","last_fullsized":"2024-09-12T18:35:32.408701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:21.538633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408174+0000","last_change":"2024-09-12T18:35:25.658763+0000","last_active":"2024-09-12T18:35:32.408174+0000","last_peered":"2024-09-12T18:35:32.408174+0000","last_clean":"2024-09-12T18:35:32.408174+0000","last_became_active":"2024-09-12T18:35:25.657508+0000","last_became_peered":"2024-09-12T18:35:25.657508+0000","last_unstale":"2024-09-12T18:35:32.408174+0000","last_undegraded":"2024-09-12T18:35:32.408174+0000","last_fullsized":"2024-09-12T18:35:32.408174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:13.170519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.407720+0000","last_change":"2024-09-12T18:35:25.653730+0000","last_active":"2024-09-12T18:35:32.407720+0000","last_peered":"2024-09-12T18:35:32.407720+0000","last_clean":"2024-09-12T18:35:32.407720+0000","last_became_active":"2024-09-12T18:35:25.651535+0000","last_became_peered":"2024-09-12T18:35:25.651535+0000","last_unstale":"2024-09-12T18:35:32.407720+0000","last_undegraded":"2024-09-12T18:35:32.407720+0000","last_fullsized":"2024-09-12T18:35:32.407720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.096263+0000","last_change":"2024-09-12T18:35:25.656513+0000","last_active":"2024-09-12T18:35:33.096263+0000","last_peered":"2024-09-12T18:35:33.096263+0000","last_clean":"2024-09-12T18:35:33.096263+0000","last_became_active":"2024-09-12T18:35:25.653440+0000","last_became_peered":"2024-09-12T18:35:25.653440+0000","last_unstale":"2024-09-12T18:35:33.096263+0000","last_undegraded":"2024-09-12T18:35:33.096263+0000","last_fullsized":"2024-09-12T18:35:33.096263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:18.693161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409944+0000","last_change":"2024-09-12T18:35:25.657991+0000","last_active":"2024-09-12T18:35:32.409944+0000","last_peered":"2024-09-12T18:35:32.409944+0000","last_clean":"2024-09-12T18:35:32.409944+0000","last_became_active":"2024-09-12T18:35:25.653934+0000","last_became_peered":"2024-09-12T18:35:25.653934+0000","last_unstale":"2024-09-12T18:35:32.409944+0000","last_undegraded":"2024-09-12T18:35:32.409944+0000","last_fullsized":"2024-09-12T18:35:32.409944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:05.418901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095481+0000","last_change":"2024-09-12T18:35:25.658819+0000","last_active":"2024-09-12T18:35:33.095481+0000","last_peered":"2024-09-12T18:35:33.095481+0000","last_clean":"2024-09-12T18:35:33.095481+0000","last_became_active":"2024-09-12T18:35:25.656843+0000","last_became_peered":"2024-09-12T18:35:25.656843+0000","last_unstale":"2024-09-12T18:35:33.095481+0000","last_undegraded":"2024-09-12T18:35:33.095481+0000","last_fullsized":"2024-09-12T18:35:33.095481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:55.291963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409642+0000","last_change":"2024-09-12T18:35:25.661176+0000","last_active":"2024-09-12T18:35:32.409642+0000","last_peered":"2024-09-12T18:35:32.409642+0000","last_clean":"2024-09-12T18:35:32.409642+0000","last_became_active":"2024-09-12T18:35:25.659534+0000","last_became_peered":"2024-09-12T18:35:25.659534+0000","last_unstale":"2024-09-12T18:35:32.409642+0000","last_undegraded":"2024-09-12T18:35:32.409642+0000","last_fullsized":"2024-09-12T18:35:32.409642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:40.145442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408508+0000","last_change":"2024-09-12T18:35:25.650632+0000","last_active":"2024-09-12T18:35:32.408508+0000","last_peered":"2024-09-12T18:35:32.408508+0000","last_clean":"2024-09-12T18:35:32.408508+0000","last_became_active":"2024-09-12T18:35:25.649333+0000","last_became_peered":"2024-09-12T18:35:25.649333+0000","last_unstale":"2024-09-12T18:35:32.408508+0000","last_undegraded":"2024-09-12T18:35:32.408508+0000","last_fullsized":"2024-09-12T18:35:32.408508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:30.537572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408378+0000","last_change":"2024-09-12T18:35:25.648245+0000","last_active":"2024-09-12T18:35:32.408378+0000","last_peered":"2024-09-12T18:35:32.408378+0000","last_clean":"2024-09-12T18:35:32.408378+0000","last_became_active":"2024-09-12T18:35:25.646357+0000","last_became_peered":"2024-09-12T18:35:25.646357+0000","last_unstale":"2024-09-12T18:35:32.408378+0000","last_undegraded":"2024-09-12T18:35:32.408378+0000","last_fullsized":"2024-09-12T18:35:32.408378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:05.662140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.094206+0000","last_change":"2024-09-12T18:35:25.661613+0000","last_active":"2024-09-12T18:35:33.094206+0000","last_peered":"2024-09-12T18:35:33.094206+0000","last_clean":"2024-09-12T18:35:33.094206+0000","last_became_active":"2024-09-12T18:35:25.658833+0000","last_became_peered":"2024-09-12T18:35:25.658833+0000","last_unstale":"2024-09-12T18:35:33.094206+0000","last_undegraded":"2024-09-12T18:35:33.094206+0000","last_fullsized":"2024-09-12T18:35:33.094206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:51.064080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.407827+0000","last_change":"2024-09-12T18:35:25.657782+0000","last_active":"2024-09-12T18:35:32.407827+0000","last_peered":"2024-09-12T18:35:32.407827+0000","last_clean":"2024-09-12T18:35:32.407827+0000","last_became_active":"2024-09-12T18:35:25.655295+0000","last_became_peered":"2024-09-12T18:35:25.655295+0000","last_unstale":"2024-09-12T18:35:32.407827+0000","last_undegraded":"2024-09-12T18:35:32.407827+0000","last_fullsized":"2024-09-12T18:35:32.407827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:37.744175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410219+0000","last_change":"2024-09-12T18:35:25.654863+0000","last_active":"2024-09-12T18:35:32.410219+0000","last_peered":"2024-09-12T18:35:32.410219+0000","last_clean":"2024-09-12T18:35:32.410219+0000","last_became_active":"2024-09-12T18:35:25.650407+0000","last_became_peered":"2024-09-12T18:35:25.650407+0000","last_unstale":"2024-09-12T18:35:32.410219+0000","last_undegraded":"2024-09-12T18:35:32.410219+0000","last_fullsized":"2024-09-12T18:35:32.410219+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:38.395666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095956+0000","last_change":"2024-09-12T18:35:25.662414+0000","last_active":"2024-09-12T18:35:33.095956+0000","last_peered":"2024-09-12T18:35:33.095956+0000","last_clean":"2024-09-12T18:35:33.095956+0000","last_became_active":"2024-09-12T18:35:25.660126+0000","last_became_peered":"2024-09-12T18:35:25.660126+0000","last_unstale":"2024-09-12T18:35:33.095956+0000","last_undegraded":"2024-09-12T18:35:33.095956+0000","last_fullsized":"2024-09-12T18:35:33.095956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:48.437139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409715+0000","last_change":"2024-09-12T18:35:25.661523+0000","last_active":"2024-09-12T18:35:32.409715+0000","last_peered":"2024-09-12T18:35:32.409715+0000","last_clean":"2024-09-12T18:35:32.409715+0000","last_became_active":"2024-09-12T18:35:25.659338+0000","last_became_peered":"2024-09-12T18:35:25.659338+0000","last_unstale":"2024-09-12T18:35:32.409715+0000","last_undegraded":"2024-09-12T18:35:32.409715+0000","last_fullsized":"2024-09-12T18:35:32.409715+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:37.083820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409590+0000","last_change":"2024-09-12T18:35:25.662445+0000","last_active":"2024-09-12T18:35:32.409590+0000","last_peered":"2024-09-12T18:35:32.409590+0000","last_clean":"2024-09-12T18:35:32.409590+0000","last_became_active":"2024-09-12T18:35:25.659496+0000","last_became_peered":"2024-09-12T18:35:25.659496+0000","last_unstale":"2024-09-12T18:35:32.409590+0000","last_undegraded":"2024-09-12T18:35:32.409590+0000","last_fullsized":"2024-09-12T18:35:32.409590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:03.270420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095459+0000","last_change":"2024-09-12T18:35:25.662519+0000","last_active":"2024-09-12T18:35:33.095459+0000","last_peered":"2024-09-12T18:35:33.095459+0000","last_clean":"2024-09-12T18:35:33.095459+0000","last_became_active":"2024-09-12T18:35:25.652964+0000","last_became_peered":"2024-09-12T18:35:25.652964+0000","last_unstale":"2024-09-12T18:35:33.095459+0000","last_undegraded":"2024-09-12T18:35:33.095459+0000","last_fullsized":"2024-09-12T18:35:33.095459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:37.923468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408671+0000","last_change":"2024-09-12T18:35:25.650507+0000","last_active":"2024-09-12T18:35:32.408671+0000","last_peered":"2024-09-12T18:35:32.408671+0000","last_clean":"2024-09-12T18:35:32.408671+0000","last_became_active":"2024-09-12T18:35:25.649415+0000","last_became_peered":"2024-09-12T18:35:25.649415+0000","last_unstale":"2024-09-12T18:35:32.408671+0000","last_undegraded":"2024-09-12T18:35:32.408671+0000","last_fullsized":"2024-09-12T18:35:32.408671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:23.081416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.094335+0000","last_change":"2024-09-12T18:35:25.653949+0000","last_active":"2024-09-12T18:35:33.094335+0000","last_peered":"2024-09-12T18:35:33.094335+0000","last_clean":"2024-09-12T18:35:33.094335+0000","last_became_active":"2024-09-12T18:35:25.652992+0000","last_became_peered":"2024-09-12T18:35:25.652992+0000","last_unstale":"2024-09-12T18:35:33.094335+0000","last_undegraded":"2024-09-12T18:35:33.094335+0000","last_fullsized":"2024-09-12T18:35:33.094335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:47.687372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.407991+0000","last_change":"2024-09-12T18:35:25.653159+0000","last_active":"2024-09-12T18:35:32.407991+0000","last_peered":"2024-09-12T18:35:32.407991+0000","last_clean":"2024-09-12T18:35:32.407991+0000","last_became_active":"2024-09-12T18:35:25.650551+0000","last_became_peered":"2024-09-12T18:35:25.650551+0000","last_unstale":"2024-09-12T18:35:32.407991+0000","last_undegraded":"2024-09-12T18:35:32.407991+0000","last_fullsized":"2024-09-12T18:35:32.407991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:16.245302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409338+0000","last_change":"2024-09-12T18:35:25.651877+0000","last_active":"2024-09-12T18:35:32.409338+0000","last_peered":"2024-09-12T18:35:32.409338+0000","last_clean":"2024-09-12T18:35:32.409338+0000","last_became_active":"2024-09-12T18:35:25.651055+0000","last_became_peered":"2024-09-12T18:35:25.651055+0000","last_unstale":"2024-09-12T18:35:32.409338+0000","last_undegraded":"2024-09-12T18:35:32.409338+0000","last_fullsized":"2024-09-12T18:35:32.409338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:14.200080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409200+0000","last_change":"2024-09-12T18:35:24.657739+0000","last_active":"2024-09-12T18:35:32.409200+0000","last_peered":"2024-09-12T18:35:32.409200+0000","last_clean":"2024-09-12T18:35:32.409200+0000","last_became_active":"2024-09-12T18:35:24.656208+0000","last_became_peered":"2024-09-12T18:35:24.656208+0000","last_unstale":"2024-09-12T18:35:32.409200+0000","last_undegraded":"2024-09-12T18:35:32.409200+0000","last_fullsized":"2024-09-12T18:35:32.409200+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:50.073716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409601+0000","last_change":"2024-09-12T18:35:25.651651+0000","last_active":"2024-09-12T18:35:32.409601+0000","last_peered":"2024-09-12T18:35:32.409601+0000","last_clean":"2024-09-12T18:35:32.409601+0000","last_became_active":"2024-09-12T18:35:25.650849+0000","last_became_peered":"2024-09-12T18:35:25.650849+0000","last_unstale":"2024-09-12T18:35:32.409601+0000","last_undegraded":"2024-09-12T18:35:32.409601+0000","last_fullsized":"2024-09-12T18:35:32.409601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:18.555827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.092714+0000","last_change":"2024-09-12T18:35:24.656119+0000","last_active":"2024-09-12T18:35:33.092714+0000","last_peered":"2024-09-12T18:35:33.092714+0000","last_clean":"2024-09-12T18:35:33.092714+0000","last_became_active":"2024-09-12T18:35:24.653175+0000","last_became_peered":"2024-09-12T18:35:24.653175+0000","last_unstale":"2024-09-12T18:35:33.092714+0000","last_undegraded":"2024-09-12T18:35:33.092714+0000","last_fullsized":"2024-09-12T18:35:33.092714+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:00.551165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.096293+0000","last_change":"2024-09-12T18:35:25.655723+0000","last_active":"2024-09-12T18:35:33.096293+0000","last_peered":"2024-09-12T18:35:33.096293+0000","last_clean":"2024-09-12T18:35:33.096293+0000","last_became_active":"2024-09-12T18:35:25.653630+0000","last_became_peered":"2024-09-12T18:35:25.653630+0000","last_unstale":"2024-09-12T18:35:33.096293+0000","last_undegraded":"2024-09-12T18:35:33.096293+0000","last_fullsized":"2024-09-12T18:35:33.096293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:07.655792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408416+0000","last_change":"2024-09-12T18:35:24.640096+0000","last_active":"2024-09-12T18:35:32.408416+0000","last_peered":"2024-09-12T18:35:32.408416+0000","last_clean":"2024-09-12T18:35:32.408416+0000","last_became_active":"2024-09-12T18:35:24.638230+0000","last_became_peered":"2024-09-12T18:35:24.638230+0000","last_unstale":"2024-09-12T18:35:32.408416+0000","last_undegraded":"2024-09-12T18:35:32.408416+0000","last_fullsized":"2024-09-12T18:35:32.408416+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:38.435296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095745+0000","last_change":"2024-09-12T18:35:25.662692+0000","last_active":"2024-09-12T18:35:33.095745+0000","last_peered":"2024-09-12T18:35:33.095745+0000","last_clean":"2024-09-12T18:35:33.095745+0000","last_became_active":"2024-09-12T18:35:25.661885+0000","last_became_peered":"2024-09-12T18:35:25.661885+0000","last_unstale":"2024-09-12T18:35:33.095745+0000","last_undegraded":"2024-09-12T18:35:33.095745+0000","last_fullsized":"2024-09-12T18:35:33.095745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:41.264425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408266+0000","last_change":"2024-09-12T18:35:24.653610+0000","last_active":"2024-09-12T18:35:32.408266+0000","last_peered":"2024-09-12T18:35:32.408266+0000","last_clean":"2024-09-12T18:35:32.408266+0000","last_became_active":"2024-09-12T18:35:24.652880+0000","last_became_peered":"2024-09-12T18:35:24.652880+0000","last_unstale":"2024-09-12T18:35:32.408266+0000","last_undegraded":"2024-09-12T18:35:32.408266+0000","last_fullsized":"2024-09-12T18:35:32.408266+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:57.636251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410248+0000","last_change":"2024-09-12T18:35:24.653465+0000","last_active":"2024-09-12T18:35:32.410248+0000","last_peered":"2024-09-12T18:35:32.410248+0000","last_clean":"2024-09-12T18:35:32.410248+0000","last_became_active":"2024-09-12T18:35:24.652792+0000","last_became_peered":"2024-09-12T18:35:24.652792+0000","last_unstale":"2024-09-12T18:35:32.410248+0000","last_undegraded":"2024-09-12T18:35:32.410248+0000","last_fullsized":"2024-09-12T18:35:32.410248+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:14.588993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.407906+0000","last_change":"2024-09-12T18:35:25.655426+0000","last_active":"2024-09-12T18:35:32.407906+0000","last_peered":"2024-09-12T18:35:32.407906+0000","last_clean":"2024-09-12T18:35:32.407906+0000","last_became_active":"2024-09-12T18:35:25.648186+0000","last_became_peered":"2024-09-12T18:35:25.648186+0000","last_unstale":"2024-09-12T18:35:32.407906+0000","last_undegraded":"2024-09-12T18:35:32.407906+0000","last_fullsized":"2024-09-12T18:35:32.407906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:48.802815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410238+0000","last_change":"2024-09-12T18:35:24.648439+0000","last_active":"2024-09-12T18:35:32.410238+0000","last_peered":"2024-09-12T18:35:32.410238+0000","last_clean":"2024-09-12T18:35:32.410238+0000","last_became_active":"2024-09-12T18:35:24.647629+0000","last_became_peered":"2024-09-12T18:35:24.647629+0000","last_unstale":"2024-09-12T18:35:32.410238+0000","last_undegraded":"2024-09-12T18:35:32.410238+0000","last_fullsized":"2024-09-12T18:35:32.410238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:45.428223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408106+0000","last_change":"2024-09-12T18:35:25.652496+0000","last_active":"2024-09-12T18:35:32.408106+0000","last_peered":"2024-09-12T18:35:32.408106+0000","last_clean":"2024-09-12T18:35:32.408106+0000","last_became_active":"2024-09-12T18:35:25.651628+0000","last_became_peered":"2024-09-12T18:35:25.651628+0000","last_unstale":"2024-09-12T18:35:32.408106+0000","last_undegraded":"2024-09-12T18:35:32.408106+0000","last_fullsized":"2024-09-12T18:35:32.408106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:44.920448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410714+0000","last_change":"2024-09-12T18:35:24.654976+0000","last_active":"2024-09-12T18:35:32.410714+0000","last_peered":"2024-09-12T18:35:32.410714+0000","last_clean":"2024-09-12T18:35:32.410714+0000","last_became_active":"2024-09-12T18:35:24.654264+0000","last_became_peered":"2024-09-12T18:35:24.654264+0000","last_unstale":"2024-09-12T18:35:32.410714+0000","last_undegraded":"2024-09-12T18:35:32.410714+0000","last_fullsized":"2024-09-12T18:35:32.410714+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:00.115408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408935+0000","last_change":"2024-09-12T18:35:25.650577+0000","last_active":"2024-09-12T18:35:32.408935+0000","last_peered":"2024-09-12T18:35:32.408935+0000","last_clean":"2024-09-12T18:35:32.408935+0000","last_became_active":"2024-09-12T18:35:25.649172+0000","last_became_peered":"2024-09-12T18:35:25.649172+0000","last_unstale":"2024-09-12T18:35:32.408935+0000","last_undegraded":"2024-09-12T18:35:32.408935+0000","last_fullsized":"2024-09-12T18:35:32.408935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:55.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410258+0000","last_change":"2024-09-12T18:35:24.657665+0000","last_active":"2024-09-12T18:35:32.410258+0000","last_peered":"2024-09-12T18:35:32.410258+0000","last_clean":"2024-09-12T18:35:32.410258+0000","last_became_active":"2024-09-12T18:35:24.657015+0000","last_became_peered":"2024-09-12T18:35:24.657015+0000","last_unstale":"2024-09-12T18:35:32.410258+0000","last_undegraded":"2024-09-12T18:35:32.410258+0000","last_fullsized":"2024-09-12T18:35:32.410258+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:03.171326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095182+0000","last_change":"2024-09-12T18:35:25.665275+0000","last_active":"2024-09-12T18:35:33.095182+0000","last_peered":"2024-09-12T18:35:33.095182+0000","last_clean":"2024-09-12T18:35:33.095182+0000","last_became_active":"2024-09-12T18:35:25.659511+0000","last_became_peered":"2024-09-12T18:35:25.659511+0000","last_unstale":"2024-09-12T18:35:33.095182+0000","last_undegraded":"2024-09-12T18:35:33.095182+0000","last_fullsized":"2024-09-12T18:35:33.095182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.093733+0000","last_change":"2024-09-12T18:35:24.651913+0000","last_active":"2024-09-12T18:35:33.093733+0000","last_peered":"2024-09-12T18:35:33.093733+0000","last_clean":"2024-09-12T18:35:33.093733+0000","last_became_active":"2024-09-12T18:35:24.650421+0000","last_became_peered":"2024-09-12T18:35:24.650421+0000","last_unstale":"2024-09-12T18:35:33.093733+0000","last_undegraded":"2024-09-12T18:35:33.093733+0000","last_fullsized":"2024-09-12T18:35:33.093733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:57.685312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409119+0000","last_change":"2024-09-12T18:35:25.651138+0000","last_active":"2024-09-12T18:35:32.409119+0000","last_peered":"2024-09-12T18:35:32.409119+0000","last_clean":"2024-09-12T18:35:32.409119+0000","last_became_active":"2024-09-12T18:35:25.650617+0000","last_became_peered":"2024-09-12T18:35:25.650617+0000","last_unstale":"2024-09-12T18:35:32.409119+0000","last_undegraded":"2024-09-12T18:35:32.409119+0000","last_fullsized":"2024-09-12T18:35:32.409119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:58.535066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410319+0000","last_change":"2024-09-12T18:35:24.659019+0000","last_active":"2024-09-12T18:35:32.410319+0000","last_peered":"2024-09-12T18:35:32.410319+0000","last_clean":"2024-09-12T18:35:32.410319+0000","last_became_active":"2024-09-12T18:35:24.658423+0000","last_became_peered":"2024-09-12T18:35:24.658423+0000","last_unstale":"2024-09-12T18:35:32.410319+0000","last_undegraded":"2024-09-12T18:35:32.410319+0000","last_fullsized":"2024-09-12T18:35:32.410319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:37.668417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410270+0000","last_change":"2024-09-12T18:35:25.662287+0000","last_active":"2024-09-12T18:35:32.410270+0000","last_peered":"2024-09-12T18:35:32.410270+0000","last_clean":"2024-09-12T18:35:32.410270+0000","last_became_active":"2024-09-12T18:35:25.660372+0000","last_became_peered":"2024-09-12T18:35:25.660372+0000","last_unstale":"2024-09-12T18:35:32.410270+0000","last_undegraded":"2024-09-12T18:35:32.410270+0000","last_fullsized":"2024-09-12T18:35:32.410270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:08.729541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409339+0000","last_change":"2024-09-12T18:35:24.648330+0000","last_active":"2024-09-12T18:35:32.409339+0000","last_peered":"2024-09-12T18:35:32.409339+0000","last_clean":"2024-09-12T18:35:32.409339+0000","last_became_active":"2024-09-12T18:35:24.647520+0000","last_became_peered":"2024-09-12T18:35:24.647520+0000","last_unstale":"2024-09-12T18:35:32.409339+0000","last_undegraded":"2024-09-12T18:35:32.409339+0000","last_fullsized":"2024-09-12T18:35:32.409339+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:25.552055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409423+0000","last_change":"2024-09-12T18:35:25.658674+0000","last_active":"2024-09-12T18:35:32.409423+0000","last_peered":"2024-09-12T18:35:32.409423+0000","last_clean":"2024-09-12T18:35:32.409423+0000","last_became_active":"2024-09-12T18:35:25.657386+0000","last_became_peered":"2024-09-12T18:35:25.657386+0000","last_unstale":"2024-09-12T18:35:32.409423+0000","last_undegraded":"2024-09-12T18:35:32.409423+0000","last_fullsized":"2024-09-12T18:35:32.409423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:48.037086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408029+0000","last_change":"2024-09-12T18:35:24.646810+0000","last_active":"2024-09-12T18:35:32.408029+0000","last_peered":"2024-09-12T18:35:32.408029+0000","last_clean":"2024-09-12T18:35:32.408029+0000","last_became_active":"2024-09-12T18:35:24.646008+0000","last_became_peered":"2024-09-12T18:35:24.646008+0000","last_unstale":"2024-09-12T18:35:32.408029+0000","last_undegraded":"2024-09-12T18:35:32.408029+0000","last_fullsized":"2024-09-12T18:35:32.408029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:43.888776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095907+0000","last_change":"2024-09-12T18:35:25.667710+0000","last_active":"2024-09-12T18:35:33.095907+0000","last_peered":"2024-09-12T18:35:33.095907+0000","last_clean":"2024-09-12T18:35:33.095907+0000","last_became_active":"2024-09-12T18:35:25.666940+0000","last_became_peered":"2024-09-12T18:35:25.666940+0000","last_unstale":"2024-09-12T18:35:33.095907+0000","last_undegraded":"2024-09-12T18:35:33.095907+0000","last_fullsized":"2024-09-12T18:35:33.095907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:09.823085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":167,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409297+0000","last_change":"2024-09-12T18:35:13.489018+0000","last_active":"2024-09-12T18:35:32.409297+0000","last_peered":"2024-09-12T18:35:32.409297+0000","last_clean":"2024-09-12T18:35:32.409297+0000","last_became_active":"2024-09-12T18:35:13.488346+0000","last_became_peered":"2024-09-12T18:35:13.488346+0000","last_unstale":"2024-09-12T18:35:32.409297+0000","last_undegraded":"2024-09-12T18:35:32.409297+0000","last_fullsized":"2024-09-12T18:35:32.409297+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_clean_scrub_stamp":"2024-09-12T18:35:12.464628+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:54.864640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410021+0000","last_change":"2024-09-12T18:35:22.459694+0000","last_active":"2024-09-12T18:35:32.410021+0000","last_peered":"2024-09-12T18:35:32.410021+0000","last_clean":"2024-09-12T18:35:32.410021+0000","last_became_active":"2024-09-12T18:35:20.446796+0000","last_became_peered":"2024-09-12T18:35:20.446796+0000","last_unstale":"2024-09-12T18:35:32.410021+0000","last_undegraded":"2024-09-12T18:35:32.410021+0000","last_fullsized":"2024-09-12T18:35:32.410021+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:21.506024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016291610000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.092256+0000","last_change":"2024-09-12T18:35:24.651749+0000","last_active":"2024-09-12T18:35:33.092256+0000","last_peered":"2024-09-12T18:35:33.092256+0000","last_clean":"2024-09-12T18:35:33.092256+0000","last_became_active":"2024-09-12T18:35:24.649860+0000","last_became_peered":"2024-09-12T18:35:24.649860+0000","last_unstale":"2024-09-12T18:35:33.092256+0000","last_undegraded":"2024-09-12T18:35:33.092256+0000","last_fullsized":"2024-09-12T18:35:33.092256+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:35.430065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410595+0000","last_change":"2024-09-12T18:35:25.662424+0000","last_active":"2024-09-12T18:35:32.410595+0000","last_peered":"2024-09-12T18:35:32.410595+0000","last_clean":"2024-09-12T18:35:32.410595+0000","last_became_active":"2024-09-12T18:35:25.661043+0000","last_became_peered":"2024-09-12T18:35:25.661043+0000","last_unstale":"2024-09-12T18:35:32.410595+0000","last_undegraded":"2024-09-12T18:35:32.410595+0000","last_fullsized":"2024-09-12T18:35:32.410595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:52.551802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408682+0000","last_change":"2024-09-12T18:35:22.459090+0000","last_active":"2024-09-12T18:35:32.408682+0000","last_peered":"2024-09-12T18:35:32.408682+0000","last_clean":"2024-09-12T18:35:32.408682+0000","last_became_active":"2024-09-12T18:35:20.448553+0000","last_became_peered":"2024-09-12T18:35:20.448553+0000","last_unstale":"2024-09-12T18:35:32.408682+0000","last_undegraded":"2024-09-12T18:35:32.408682+0000","last_fullsized":"2024-09-12T18:35:32.408682+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:56.834808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001030836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.092165+0000","last_change":"2024-09-12T18:35:24.651597+0000","last_active":"2024-09-12T18:35:33.092165+0000","last_peered":"2024-09-12T18:35:33.092165+0000","last_clean":"2024-09-12T18:35:33.092165+0000","last_became_active":"2024-09-12T18:35:24.649940+0000","last_became_peered":"2024-09-12T18:35:24.649940+0000","last_unstale":"2024-09-12T18:35:33.092165+0000","last_undegraded":"2024-09-12T18:35:33.092165+0000","last_fullsized":"2024-09-12T18:35:33.092165+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:36.822432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410101+0000","last_change":"2024-09-12T18:35:25.660529+0000","last_active":"2024-09-12T18:35:32.410101+0000","last_peered":"2024-09-12T18:35:32.410101+0000","last_clean":"2024-09-12T18:35:32.410101+0000","last_became_active":"2024-09-12T18:35:25.659537+0000","last_became_peered":"2024-09-12T18:35:25.659537+0000","last_unstale":"2024-09-12T18:35:32.410101+0000","last_undegraded":"2024-09-12T18:35:32.410101+0000","last_fullsized":"2024-09-12T18:35:32.410101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:51.790349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095003+0000","last_change":"2024-09-12T18:35:22.464179+0000","last_active":"2024-09-12T18:35:33.095003+0000","last_peered":"2024-09-12T18:35:33.095003+0000","last_clean":"2024-09-12T18:35:33.095003+0000","last_became_active":"2024-09-12T18:35:20.442613+0000","last_became_peered":"2024-09-12T18:35:20.442613+0000","last_unstale":"2024-09-12T18:35:33.095003+0000","last_undegraded":"2024-09-12T18:35:33.095003+0000","last_fullsized":"2024-09-12T18:35:33.095003+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:17.636537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014134620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408165+0000","last_change":"2024-09-12T18:35:24.641297+0000","last_active":"2024-09-12T18:35:32.408165+0000","last_peered":"2024-09-12T18:35:32.408165+0000","last_clean":"2024-09-12T18:35:32.408165+0000","last_became_active":"2024-09-12T18:35:24.637334+0000","last_became_peered":"2024-09-12T18:35:24.637334+0000","last_unstale":"2024-09-12T18:35:32.408165+0000","last_undegraded":"2024-09-12T18:35:32.408165+0000","last_fullsized":"2024-09-12T18:35:32.408165+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:50.772074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095958+0000","last_change":"2024-09-12T18:35:25.659209+0000","last_active":"2024-09-12T18:35:33.095958+0000","last_peered":"2024-09-12T18:35:33.095958+0000","last_clean":"2024-09-12T18:35:33.095958+0000","last_became_active":"2024-09-12T18:35:25.656170+0000","last_became_peered":"2024-09-12T18:35:25.656170+0000","last_unstale":"2024-09-12T18:35:33.095958+0000","last_undegraded":"2024-09-12T18:35:33.095958+0000","last_fullsized":"2024-09-12T18:35:33.095958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:40.925757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":32,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410589+0000","last_change":"2024-09-12T18:35:22.459049+0000","last_active":"2024-09-12T18:35:32.410589+0000","last_peered":"2024-09-12T18:35:32.410589+0000","last_clean":"2024-09-12T18:35:32.410589+0000","last_became_active":"2024-09-12T18:35:20.446814+0000","last_became_peered":"2024-09-12T18:35:20.446814+0000","last_unstale":"2024-09-12T18:35:32.410589+0000","last_undegraded":"2024-09-12T18:35:32.410589+0000","last_fullsized":"2024-09-12T18:35:32.410589+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:18.033595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010716149999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409453+0000","last_change":"2024-09-12T18:35:24.658273+0000","last_active":"2024-09-12T18:35:32.409453+0000","last_peered":"2024-09-12T18:35:32.409453+0000","last_clean":"2024-09-12T18:35:32.409453+0000","last_became_active":"2024-09-12T18:35:24.657433+0000","last_became_peered":"2024-09-12T18:35:24.657433+0000","last_unstale":"2024-09-12T18:35:32.409453+0000","last_undegraded":"2024-09-12T18:35:32.409453+0000","last_fullsized":"2024-09-12T18:35:32.409453+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:48.497218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095434+0000","last_change":"2024-09-12T18:35:25.655830+0000","last_active":"2024-09-12T18:35:33.095434+0000","last_peered":"2024-09-12T18:35:33.095434+0000","last_clean":"2024-09-12T18:35:33.095434+0000","last_became_active":"2024-09-12T18:35:25.652126+0000","last_became_peered":"2024-09-12T18:35:25.652126+0000","last_unstale":"2024-09-12T18:35:33.095434+0000","last_undegraded":"2024-09-12T18:35:33.095434+0000","last_fullsized":"2024-09-12T18:35:33.095434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:04.080721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410902+0000","last_change":"2024-09-12T18:35:24.657618+0000","last_active":"2024-09-12T18:35:32.410902+0000","last_peered":"2024-09-12T18:35:32.410902+0000","last_clean":"2024-09-12T18:35:32.410902+0000","last_became_active":"2024-09-12T18:35:24.656741+0000","last_became_peered":"2024-09-12T18:35:24.656741+0000","last_unstale":"2024-09-12T18:35:32.410902+0000","last_undegraded":"2024-09-12T18:35:32.410902+0000","last_fullsized":"2024-09-12T18:35:32.410902+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:43.113104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095849+0000","last_change":"2024-09-12T18:35:22.464180+0000","last_active":"2024-09-12T18:35:33.095849+0000","last_peered":"2024-09-12T18:35:33.095849+0000","last_clean":"2024-09-12T18:35:33.095849+0000","last_became_active":"2024-09-12T18:35:20.442566+0000","last_became_peered":"2024-09-12T18:35:20.442566+0000","last_unstale":"2024-09-12T18:35:33.095849+0000","last_undegraded":"2024-09-12T18:35:33.095849+0000","last_fullsized":"2024-09-12T18:35:33.095849+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:29.021710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001325786,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408521+0000","last_change":"2024-09-12T18:35:25.650458+0000","last_active":"2024-09-12T18:35:32.408521+0000","last_peered":"2024-09-12T18:35:32.408521+0000","last_clean":"2024-09-12T18:35:32.408521+0000","last_became_active":"2024-09-12T18:35:25.648761+0000","last_became_peered":"2024-09-12T18:35:25.648761+0000","last_unstale":"2024-09-12T18:35:32.408521+0000","last_undegraded":"2024-09-12T18:35:32.408521+0000","last_fullsized":"2024-09-12T18:35:32.408521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:53.026950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.092506+0000","last_change":"2024-09-12T18:35:24.649669+0000","last_active":"2024-09-12T18:35:33.092506+0000","last_peered":"2024-09-12T18:35:33.092506+0000","last_clean":"2024-09-12T18:35:33.092506+0000","last_became_active":"2024-09-12T18:35:24.648881+0000","last_became_peered":"2024-09-12T18:35:24.648881+0000","last_unstale":"2024-09-12T18:35:33.092506+0000","last_undegraded":"2024-09-12T18:35:33.092506+0000","last_fullsized":"2024-09-12T18:35:33.092506+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:23.614734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410493+0000","last_change":"2024-09-12T18:35:22.458666+0000","last_active":"2024-09-12T18:35:32.410493+0000","last_peered":"2024-09-12T18:35:32.410493+0000","last_clean":"2024-09-12T18:35:32.410493+0000","last_became_active":"2024-09-12T18:35:20.442394+0000","last_became_peered":"2024-09-12T18:35:20.442394+0000","last_unstale":"2024-09-12T18:35:32.410493+0000","last_undegraded":"2024-09-12T18:35:32.410493+0000","last_fullsized":"2024-09-12T18:35:32.410493+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:51.840246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080163599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408846+0000","last_change":"2024-09-12T18:35:25.650717+0000","last_active":"2024-09-12T18:35:32.408846+0000","last_peered":"2024-09-12T18:35:32.408846+0000","last_clean":"2024-09-12T18:35:32.408846+0000","last_became_active":"2024-09-12T18:35:25.649147+0000","last_became_peered":"2024-09-12T18:35:25.649147+0000","last_unstale":"2024-09-12T18:35:32.408846+0000","last_undegraded":"2024-09-12T18:35:32.408846+0000","last_fullsized":"2024-09-12T18:35:32.408846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:07.365888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.093028+0000","last_change":"2024-09-12T18:35:24.657234+0000","last_active":"2024-09-12T18:35:33.093028+0000","last_peered":"2024-09-12T18:35:33.093028+0000","last_clean":"2024-09-12T18:35:33.093028+0000","last_became_active":"2024-09-12T18:35:24.655950+0000","last_became_peered":"2024-09-12T18:35:24.655950+0000","last_unstale":"2024-09-12T18:35:33.093028+0000","last_undegraded":"2024-09-12T18:35:33.093028+0000","last_fullsized":"2024-09-12T18:35:33.093028+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:17.466623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.096388+0000","last_change":"2024-09-12T18:35:22.464656+0000","last_active":"2024-09-12T18:35:33.096388+0000","last_peered":"2024-09-12T18:35:33.096388+0000","last_clean":"2024-09-12T18:35:33.096388+0000","last_became_active":"2024-09-12T18:35:20.445470+0000","last_became_peered":"2024-09-12T18:35:20.445470+0000","last_unstale":"2024-09-12T18:35:33.096388+0000","last_undegraded":"2024-09-12T18:35:33.096388+0000","last_fullsized":"2024-09-12T18:35:33.096388+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:58.947359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001742681,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.094350+0000","last_change":"2024-09-12T18:35:25.658887+0000","last_active":"2024-09-12T18:35:33.094350+0000","last_peered":"2024-09-12T18:35:33.094350+0000","last_clean":"2024-09-12T18:35:33.094350+0000","last_became_active":"2024-09-12T18:35:25.656829+0000","last_became_peered":"2024-09-12T18:35:25.656829+0000","last_unstale":"2024-09-12T18:35:33.094350+0000","last_undegraded":"2024-09-12T18:35:33.094350+0000","last_fullsized":"2024-09-12T18:35:33.094350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:50.109858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.092649+0000","last_change":"2024-09-12T18:35:24.654518+0000","last_active":"2024-09-12T18:35:33.092649+0000","last_peered":"2024-09-12T18:35:33.092649+0000","last_clean":"2024-09-12T18:35:33.092649+0000","last_became_active":"2024-09-12T18:35:24.650309+0000","last_became_peered":"2024-09-12T18:35:24.650309+0000","last_unstale":"2024-09-12T18:35:33.092649+0000","last_undegraded":"2024-09-12T18:35:33.092649+0000","last_fullsized":"2024-09-12T18:35:33.092649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:16.669035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410632+0000","last_change":"2024-09-12T18:35:22.459767+0000","last_active":"2024-09-12T18:35:32.410632+0000","last_peered":"2024-09-12T18:35:32.410632+0000","last_clean":"2024-09-12T18:35:32.410632+0000","last_became_active":"2024-09-12T18:35:20.448521+0000","last_became_peered":"2024-09-12T18:35:20.448521+0000","last_unstale":"2024-09-12T18:35:32.410632+0000","last_undegraded":"2024-09-12T18:35:32.410632+0000","last_fullsized":"2024-09-12T18:35:32.410632+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:33.463792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017009670000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408128+0000","last_change":"2024-09-12T18:35:25.648150+0000","last_active":"2024-09-12T18:35:32.408128+0000","last_peered":"2024-09-12T18:35:32.408128+0000","last_clean":"2024-09-12T18:35:32.408128+0000","last_became_active":"2024-09-12T18:35:25.647347+0000","last_became_peered":"2024-09-12T18:35:25.647347+0000","last_unstale":"2024-09-12T18:35:32.408128+0000","last_undegraded":"2024-09-12T18:35:32.408128+0000","last_fullsized":"2024-09-12T18:35:32.408128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:48.968336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408750+0000","last_change":"2024-09-12T18:35:25.660696+0000","last_active":"2024-09-12T18:35:32.408750+0000","last_peered":"2024-09-12T18:35:32.408750+0000","last_clean":"2024-09-12T18:35:32.408750+0000","last_became_active":"2024-09-12T18:35:25.659827+0000","last_became_peered":"2024-09-12T18:35:25.659827+0000","last_unstale":"2024-09-12T18:35:32.408750+0000","last_undegraded":"2024-09-12T18:35:32.408750+0000","last_fullsized":"2024-09-12T18:35:32.408750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:15.678289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":23,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409994+0000","last_change":"2024-09-12T18:35:24.655051+0000","last_active":"2024-09-12T18:35:32.409994+0000","last_peered":"2024-09-12T18:35:32.409994+0000","last_clean":"2024-09-12T18:35:32.409994+0000","last_became_active":"2024-09-12T18:35:24.654282+0000","last_became_peered":"2024-09-12T18:35:24.654282+0000","last_unstale":"2024-09-12T18:35:32.409994+0000","last_undegraded":"2024-09-12T18:35:32.409994+0000","last_fullsized":"2024-09-12T18:35:32.409994+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:08.159799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.094530+0000","last_change":"2024-09-12T18:35:25.659237+0000","last_active":"2024-09-12T18:35:33.094530+0000","last_peered":"2024-09-12T18:35:33.094530+0000","last_clean":"2024-09-12T18:35:33.094530+0000","last_became_active":"2024-09-12T18:35:25.658423+0000","last_became_peered":"2024-09-12T18:35:25.658423+0000","last_unstale":"2024-09-12T18:35:33.094530+0000","last_undegraded":"2024-09-12T18:35:33.094530+0000","last_fullsized":"2024-09-12T18:35:33.094530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:42.956934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410294+0000","last_change":"2024-09-12T18:35:24.648658+0000","last_active":"2024-09-12T18:35:32.410294+0000","last_peered":"2024-09-12T18:35:32.410294+0000","last_clean":"2024-09-12T18:35:32.410294+0000","last_became_active":"2024-09-12T18:35:24.647826+0000","last_became_peered":"2024-09-12T18:35:24.647826+0000","last_unstale":"2024-09-12T18:35:32.410294+0000","last_undegraded":"2024-09-12T18:35:32.410294+0000","last_fullsized":"2024-09-12T18:35:32.410294+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:24.167549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410026+0000","last_change":"2024-09-12T18:35:24.656855+0000","last_active":"2024-09-12T18:35:32.410026+0000","last_peered":"2024-09-12T18:35:32.410026+0000","last_clean":"2024-09-12T18:35:32.410026+0000","last_became_active":"2024-09-12T18:35:24.655935+0000","last_became_peered":"2024-09-12T18:35:24.655935+0000","last_unstale":"2024-09-12T18:35:32.410026+0000","last_undegraded":"2024-09-12T18:35:32.410026+0000","last_fullsized":"2024-09-12T18:35:32.410026+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:35.430065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.094515+0000","last_change":"2024-09-12T18:35:25.661801+0000","last_active":"2024-09-12T18:35:33.094515+0000","last_peered":"2024-09-12T18:35:33.094515+0000","last_clean":"2024-09-12T18:35:33.094515+0000","last_became_active":"2024-09-12T18:35:25.658476+0000","last_became_peered":"2024-09-12T18:35:25.658476+0000","last_unstale":"2024-09-12T18:35:33.094515+0000","last_undegraded":"2024-09-12T18:35:33.094515+0000","last_fullsized":"2024-09-12T18:35:33.094515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:58.246449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.092953+0000","last_change":"2024-09-12T18:35:24.652399+0000","last_active":"2024-09-12T18:35:33.092953+0000","last_peered":"2024-09-12T18:35:33.092953+0000","last_clean":"2024-09-12T18:35:33.092953+0000","last_became_active":"2024-09-12T18:35:24.651416+0000","last_became_peered":"2024-09-12T18:35:24.651416+0000","last_unstale":"2024-09-12T18:35:33.092953+0000","last_undegraded":"2024-09-12T18:35:33.092953+0000","last_fullsized":"2024-09-12T18:35:33.092953+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:32.594978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.094275+0000","last_change":"2024-09-12T18:35:25.658570+0000","last_active":"2024-09-12T18:35:33.094275+0000","last_peered":"2024-09-12T18:35:33.094275+0000","last_clean":"2024-09-12T18:35:33.094275+0000","last_became_active":"2024-09-12T18:35:25.656561+0000","last_became_peered":"2024-09-12T18:35:25.656561+0000","last_unstale":"2024-09-12T18:35:33.094275+0000","last_undegraded":"2024-09-12T18:35:33.094275+0000","last_fullsized":"2024-09-12T18:35:33.094275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:22.225756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410369+0000","last_change":"2024-09-12T18:35:25.651217+0000","last_active":"2024-09-12T18:35:32.410369+0000","last_peered":"2024-09-12T18:35:32.410369+0000","last_clean":"2024-09-12T18:35:32.410369+0000","last_became_active":"2024-09-12T18:35:25.649544+0000","last_became_peered":"2024-09-12T18:35:25.649544+0000","last_unstale":"2024-09-12T18:35:32.410369+0000","last_undegraded":"2024-09-12T18:35:32.410369+0000","last_fullsized":"2024-09-12T18:35:32.410369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:41.601376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.093421+0000","last_change":"2024-09-12T18:35:24.657489+0000","last_active":"2024-09-12T18:35:33.093421+0000","last_peered":"2024-09-12T18:35:33.093421+0000","last_clean":"2024-09-12T18:35:33.093421+0000","last_became_active":"2024-09-12T18:35:24.656030+0000","last_became_peered":"2024-09-12T18:35:24.656030+0000","last_unstale":"2024-09-12T18:35:33.093421+0000","last_undegraded":"2024-09-12T18:35:33.093421+0000","last_fullsized":"2024-09-12T18:35:33.093421+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:11.362759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095761+0000","last_change":"2024-09-12T18:35:25.661544+0000","last_active":"2024-09-12T18:35:33.095761+0000","last_peered":"2024-09-12T18:35:33.095761+0000","last_clean":"2024-09-12T18:35:33.095761+0000","last_became_active":"2024-09-12T18:35:25.656985+0000","last_became_peered":"2024-09-12T18:35:25.656985+0000","last_unstale":"2024-09-12T18:35:33.095761+0000","last_undegraded":"2024-09-12T18:35:33.095761+0000","last_fullsized":"2024-09-12T18:35:33.095761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.092175+0000","last_change":"2024-09-12T18:35:24.646342+0000","last_active":"2024-09-12T18:35:33.092175+0000","last_peered":"2024-09-12T18:35:33.092175+0000","last_clean":"2024-09-12T18:35:33.092175+0000","last_became_active":"2024-09-12T18:35:24.644773+0000","last_became_peered":"2024-09-12T18:35:24.644773+0000","last_unstale":"2024-09-12T18:35:33.092175+0000","last_undegraded":"2024-09-12T18:35:33.092175+0000","last_fullsized":"2024-09-12T18:35:33.092175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:17.011231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409241+0000","last_change":"2024-09-12T18:35:25.656712+0000","last_active":"2024-09-12T18:35:32.409241+0000","last_peered":"2024-09-12T18:35:32.409241+0000","last_clean":"2024-09-12T18:35:32.409241+0000","last_became_active":"2024-09-12T18:35:25.654473+0000","last_became_peered":"2024-09-12T18:35:25.654473+0000","last_unstale":"2024-09-12T18:35:32.409241+0000","last_undegraded":"2024-09-12T18:35:32.409241+0000","last_fullsized":"2024-09-12T18:35:32.409241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:01.464680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408790+0000","last_change":"2024-09-12T18:35:24.659935+0000","last_active":"2024-09-12T18:35:32.408790+0000","last_peered":"2024-09-12T18:35:32.408790+0000","last_clean":"2024-09-12T18:35:32.408790+0000","last_became_active":"2024-09-12T18:35:24.659111+0000","last_became_peered":"2024-09-12T18:35:24.659111+0000","last_unstale":"2024-09-12T18:35:32.408790+0000","last_undegraded":"2024-09-12T18:35:32.408790+0000","last_fullsized":"2024-09-12T18:35:32.408790+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:11.480154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409283+0000","last_change":"2024-09-12T18:35:25.660557+0000","last_active":"2024-09-12T18:35:32.409283+0000","last_peered":"2024-09-12T18:35:32.409283+0000","last_clean":"2024-09-12T18:35:32.409283+0000","last_became_active":"2024-09-12T18:35:25.652300+0000","last_became_peered":"2024-09-12T18:35:25.652300+0000","last_unstale":"2024-09-12T18:35:32.409283+0000","last_undegraded":"2024-09-12T18:35:32.409283+0000","last_fullsized":"2024-09-12T18:35:32.409283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:10:59.995841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409107+0000","last_change":"2024-09-12T18:35:24.638538+0000","last_active":"2024-09-12T18:35:32.409107+0000","last_peered":"2024-09-12T18:35:32.409107+0000","last_clean":"2024-09-12T18:35:32.409107+0000","last_became_active":"2024-09-12T18:35:24.637242+0000","last_became_peered":"2024-09-12T18:35:24.637242+0000","last_unstale":"2024-09-12T18:35:32.409107+0000","last_undegraded":"2024-09-12T18:35:32.409107+0000","last_fullsized":"2024-09-12T18:35:32.409107+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:26.877441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408680+0000","last_change":"2024-09-12T18:35:25.662537+0000","last_active":"2024-09-12T18:35:32.408680+0000","last_peered":"2024-09-12T18:35:32.408680+0000","last_clean":"2024-09-12T18:35:32.408680+0000","last_became_active":"2024-09-12T18:35:25.661441+0000","last_became_peered":"2024-09-12T18:35:25.661441+0000","last_unstale":"2024-09-12T18:35:32.408680+0000","last_undegraded":"2024-09-12T18:35:32.408680+0000","last_fullsized":"2024-09-12T18:35:32.408680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:14.397867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409631+0000","last_change":"2024-09-12T18:35:24.657635+0000","last_active":"2024-09-12T18:35:32.409631+0000","last_peered":"2024-09-12T18:35:32.409631+0000","last_clean":"2024-09-12T18:35:32.409631+0000","last_became_active":"2024-09-12T18:35:24.655992+0000","last_became_peered":"2024-09-12T18:35:24.655992+0000","last_unstale":"2024-09-12T18:35:32.409631+0000","last_undegraded":"2024-09-12T18:35:32.409631+0000","last_fullsized":"2024-09-12T18:35:32.409631+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:33.536755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409233+0000","last_change":"2024-09-12T18:35:25.651406+0000","last_active":"2024-09-12T18:35:32.409233+0000","last_peered":"2024-09-12T18:35:32.409233+0000","last_clean":"2024-09-12T18:35:32.409233+0000","last_became_active":"2024-09-12T18:35:25.649728+0000","last_became_peered":"2024-09-12T18:35:25.649728+0000","last_unstale":"2024-09-12T18:35:32.409233+0000","last_undegraded":"2024-09-12T18:35:32.409233+0000","last_fullsized":"2024-09-12T18:35:32.409233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:41.773283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409723+0000","last_change":"2024-09-12T18:35:24.649153+0000","last_active":"2024-09-12T18:35:32.409723+0000","last_peered":"2024-09-12T18:35:32.409723+0000","last_clean":"2024-09-12T18:35:32.409723+0000","last_became_active":"2024-09-12T18:35:24.648512+0000","last_became_peered":"2024-09-12T18:35:24.648512+0000","last_unstale":"2024-09-12T18:35:32.409723+0000","last_undegraded":"2024-09-12T18:35:32.409723+0000","last_fullsized":"2024-09-12T18:35:32.409723+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:07.810456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409441+0000","last_change":"2024-09-12T18:35:25.656799+0000","last_active":"2024-09-12T18:35:32.409441+0000","last_peered":"2024-09-12T18:35:32.409441+0000","last_clean":"2024-09-12T18:35:32.409441+0000","last_became_active":"2024-09-12T18:35:25.654980+0000","last_became_peered":"2024-09-12T18:35:25.654980+0000","last_unstale":"2024-09-12T18:35:32.409441+0000","last_undegraded":"2024-09-12T18:35:32.409441+0000","last_fullsized":"2024-09-12T18:35:32.409441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:10.735439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.092729+0000","last_change":"2024-09-12T18:35:24.656268+0000","last_active":"2024-09-12T18:35:33.092729+0000","last_peered":"2024-09-12T18:35:33.092729+0000","last_clean":"2024-09-12T18:35:33.092729+0000","last_became_active":"2024-09-12T18:35:24.655420+0000","last_became_peered":"2024-09-12T18:35:24.655420+0000","last_unstale":"2024-09-12T18:35:33.092729+0000","last_undegraded":"2024-09-12T18:35:33.092729+0000","last_fullsized":"2024-09-12T18:35:33.092729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:04.654666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408359+0000","last_change":"2024-09-12T18:35:25.661042+0000","last_active":"2024-09-12T18:35:32.408359+0000","last_peered":"2024-09-12T18:35:32.408359+0000","last_clean":"2024-09-12T18:35:32.408359+0000","last_became_active":"2024-09-12T18:35:25.660163+0000","last_became_peered":"2024-09-12T18:35:25.660163+0000","last_unstale":"2024-09-12T18:35:32.408359+0000","last_undegraded":"2024-09-12T18:35:32.408359+0000","last_fullsized":"2024-09-12T18:35:32.408359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:37.682184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.093423+0000","last_change":"2024-09-12T18:35:24.652304+0000","last_active":"2024-09-12T18:35:33.093423+0000","last_peered":"2024-09-12T18:35:33.093423+0000","last_clean":"2024-09-12T18:35:33.093423+0000","last_became_active":"2024-09-12T18:35:24.651460+0000","last_became_peered":"2024-09-12T18:35:24.651460+0000","last_unstale":"2024-09-12T18:35:33.093423+0000","last_undegraded":"2024-09-12T18:35:33.093423+0000","last_fullsized":"2024-09-12T18:35:33.093423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:42.050557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":262144,"data_stored":655733,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":274432,"data_stored":656368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":64206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:35:36.997 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:35:37.334 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:35:37.335 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T18:35:37.351 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-09-12T18:35:36.379037+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":192,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90104,"kb_used_data":704,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025416,"statfs":{"total":289910292480,"available":289818025984,"internally_reserved":0,"allocated":720896,"data_stored":1376307,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4783,"internal_metadata":91483473},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":90,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.740051"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410091+0000","last_change":"2024-09-12T18:35:25.657389+0000","last_active":"2024-09-12T18:35:32.410091+0000","last_peered":"2024-09-12T18:35:32.410091+0000","last_clean":"2024-09-12T18:35:32.410091+0000","last_became_active":"2024-09-12T18:35:25.651857+0000","last_became_peered":"2024-09-12T18:35:25.651857+0000","last_unstale":"2024-09-12T18:35:32.410091+0000","last_undegraded":"2024-09-12T18:35:32.410091+0000","last_fullsized":"2024-09-12T18:35:32.410091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:50.264536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409235+0000","last_change":"2024-09-12T18:35:25.659760+0000","last_active":"2024-09-12T18:35:32.409235+0000","last_peered":"2024-09-12T18:35:32.409235+0000","last_clean":"2024-09-12T18:35:32.409235+0000","last_became_active":"2024-09-12T18:35:25.654920+0000","last_became_peered":"2024-09-12T18:35:25.654920+0000","last_unstale":"2024-09-12T18:35:32.409235+0000","last_undegraded":"2024-09-12T18:35:32.409235+0000","last_fullsized":"2024-09-12T18:35:32.409235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:21.519881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408918+0000","last_change":"2024-09-12T18:35:25.659460+0000","last_active":"2024-09-12T18:35:32.408918+0000","last_peered":"2024-09-12T18:35:32.408918+0000","last_clean":"2024-09-12T18:35:32.408918+0000","last_became_active":"2024-09-12T18:35:25.657782+0000","last_became_peered":"2024-09-12T18:35:25.657782+0000","last_unstale":"2024-09-12T18:35:32.408918+0000","last_undegraded":"2024-09-12T18:35:32.408918+0000","last_fullsized":"2024-09-12T18:35:32.408918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:38.544284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408838+0000","last_change":"2024-09-12T18:35:25.663617+0000","last_active":"2024-09-12T18:35:32.408838+0000","last_peered":"2024-09-12T18:35:32.408838+0000","last_clean":"2024-09-12T18:35:32.408838+0000","last_became_active":"2024-09-12T18:35:25.661977+0000","last_became_peered":"2024-09-12T18:35:25.661977+0000","last_unstale":"2024-09-12T18:35:32.408838+0000","last_undegraded":"2024-09-12T18:35:32.408838+0000","last_fullsized":"2024-09-12T18:35:32.408838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:14.748234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408831+0000","last_change":"2024-09-12T18:35:25.656566+0000","last_active":"2024-09-12T18:35:32.408831+0000","last_peered":"2024-09-12T18:35:32.408831+0000","last_clean":"2024-09-12T18:35:32.408831+0000","last_became_active":"2024-09-12T18:35:25.654898+0000","last_became_peered":"2024-09-12T18:35:25.654898+0000","last_unstale":"2024-09-12T18:35:32.408831+0000","last_undegraded":"2024-09-12T18:35:32.408831+0000","last_fullsized":"2024-09-12T18:35:32.408831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:36.113250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408286+0000","last_change":"2024-09-12T18:35:25.652754+0000","last_active":"2024-09-12T18:35:32.408286+0000","last_peered":"2024-09-12T18:35:32.408286+0000","last_clean":"2024-09-12T18:35:32.408286+0000","last_became_active":"2024-09-12T18:35:25.651217+0000","last_became_peered":"2024-09-12T18:35:25.651217+0000","last_unstale":"2024-09-12T18:35:32.408286+0000","last_undegraded":"2024-09-12T18:35:32.408286+0000","last_fullsized":"2024-09-12T18:35:32.408286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:24.585774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408085+0000","last_change":"2024-09-12T18:35:25.659811+0000","last_active":"2024-09-12T18:35:32.408085+0000","last_peered":"2024-09-12T18:35:32.408085+0000","last_clean":"2024-09-12T18:35:32.408085+0000","last_became_active":"2024-09-12T18:35:25.658998+0000","last_became_peered":"2024-09-12T18:35:25.658998+0000","last_unstale":"2024-09-12T18:35:32.408085+0000","last_undegraded":"2024-09-12T18:35:32.408085+0000","last_fullsized":"2024-09-12T18:35:32.408085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.407720+0000","last_change":"2024-09-12T18:35:25.653999+0000","last_active":"2024-09-12T18:35:32.407720+0000","last_peered":"2024-09-12T18:35:32.407720+0000","last_clean":"2024-09-12T18:35:32.407720+0000","last_became_active":"2024-09-12T18:35:25.653319+0000","last_became_peered":"2024-09-12T18:35:25.653319+0000","last_unstale":"2024-09-12T18:35:32.407720+0000","last_undegraded":"2024-09-12T18:35:32.407720+0000","last_fullsized":"2024-09-12T18:35:32.407720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:04.718000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095705+0000","last_change":"2024-09-12T18:35:25.668339+0000","last_active":"2024-09-12T18:35:33.095705+0000","last_peered":"2024-09-12T18:35:33.095705+0000","last_clean":"2024-09-12T18:35:33.095705+0000","last_became_active":"2024-09-12T18:35:25.667608+0000","last_became_peered":"2024-09-12T18:35:25.667608+0000","last_unstale":"2024-09-12T18:35:33.095705+0000","last_undegraded":"2024-09-12T18:35:33.095705+0000","last_fullsized":"2024-09-12T18:35:33.095705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:15.699745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409709+0000","last_change":"2024-09-12T18:35:25.660174+0000","last_active":"2024-09-12T18:35:32.409709+0000","last_peered":"2024-09-12T18:35:32.409709+0000","last_clean":"2024-09-12T18:35:32.409709+0000","last_became_active":"2024-09-12T18:35:25.656560+0000","last_became_peered":"2024-09-12T18:35:25.656560+0000","last_unstale":"2024-09-12T18:35:32.409709+0000","last_undegraded":"2024-09-12T18:35:32.409709+0000","last_fullsized":"2024-09-12T18:35:32.409709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:47.268505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409405+0000","last_change":"2024-09-12T18:35:25.649858+0000","last_active":"2024-09-12T18:35:32.409405+0000","last_peered":"2024-09-12T18:35:32.409405+0000","last_clean":"2024-09-12T18:35:32.409405+0000","last_became_active":"2024-09-12T18:35:25.649090+0000","last_became_peered":"2024-09-12T18:35:25.649090+0000","last_unstale":"2024-09-12T18:35:32.409405+0000","last_undegraded":"2024-09-12T18:35:32.409405+0000","last_fullsized":"2024-09-12T18:35:32.409405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:33.158421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409039+0000","last_change":"2024-09-12T18:35:25.649885+0000","last_active":"2024-09-12T18:35:32.409039+0000","last_peered":"2024-09-12T18:35:32.409039+0000","last_clean":"2024-09-12T18:35:32.409039+0000","last_became_active":"2024-09-12T18:35:25.649111+0000","last_became_peered":"2024-09-12T18:35:25.649111+0000","last_unstale":"2024-09-12T18:35:32.409039+0000","last_undegraded":"2024-09-12T18:35:32.409039+0000","last_fullsized":"2024-09-12T18:35:32.409039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:17.162410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408499+0000","last_change":"2024-09-12T18:35:25.651541+0000","last_active":"2024-09-12T18:35:32.408499+0000","last_peered":"2024-09-12T18:35:32.408499+0000","last_clean":"2024-09-12T18:35:32.408499+0000","last_became_active":"2024-09-12T18:35:25.650661+0000","last_became_peered":"2024-09-12T18:35:25.650661+0000","last_unstale":"2024-09-12T18:35:32.408499+0000","last_undegraded":"2024-09-12T18:35:32.408499+0000","last_fullsized":"2024-09-12T18:35:32.408499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:52.082734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408701+0000","last_change":"2024-09-12T18:35:25.657913+0000","last_active":"2024-09-12T18:35:32.408701+0000","last_peered":"2024-09-12T18:35:32.408701+0000","last_clean":"2024-09-12T18:35:32.408701+0000","last_became_active":"2024-09-12T18:35:25.657082+0000","last_became_peered":"2024-09-12T18:35:25.657082+0000","last_unstale":"2024-09-12T18:35:32.408701+0000","last_undegraded":"2024-09-12T18:35:32.408701+0000","last_fullsized":"2024-09-12T18:35:32.408701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:21.538633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408174+0000","last_change":"2024-09-12T18:35:25.658763+0000","last_active":"2024-09-12T18:35:32.408174+0000","last_peered":"2024-09-12T18:35:32.408174+0000","last_clean":"2024-09-12T18:35:32.408174+0000","last_became_active":"2024-09-12T18:35:25.657508+0000","last_became_peered":"2024-09-12T18:35:25.657508+0000","last_unstale":"2024-09-12T18:35:32.408174+0000","last_undegraded":"2024-09-12T18:35:32.408174+0000","last_fullsized":"2024-09-12T18:35:32.408174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:13.170519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.407720+0000","last_change":"2024-09-12T18:35:25.653730+0000","last_active":"2024-09-12T18:35:32.407720+0000","last_peered":"2024-09-12T18:35:32.407720+0000","last_clean":"2024-09-12T18:35:32.407720+0000","last_became_active":"2024-09-12T18:35:25.651535+0000","last_became_peered":"2024-09-12T18:35:25.651535+0000","last_unstale":"2024-09-12T18:35:32.407720+0000","last_undegraded":"2024-09-12T18:35:32.407720+0000","last_fullsized":"2024-09-12T18:35:32.407720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.096263+0000","last_change":"2024-09-12T18:35:25.656513+0000","last_active":"2024-09-12T18:35:33.096263+0000","last_peered":"2024-09-12T18:35:33.096263+0000","last_clean":"2024-09-12T18:35:33.096263+0000","last_became_active":"2024-09-12T18:35:25.653440+0000","last_became_peered":"2024-09-12T18:35:25.653440+0000","last_unstale":"2024-09-12T18:35:33.096263+0000","last_undegraded":"2024-09-12T18:35:33.096263+0000","last_fullsized":"2024-09-12T18:35:33.096263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:18.693161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409944+0000","last_change":"2024-09-12T18:35:25.657991+0000","last_active":"2024-09-12T18:35:32.409944+0000","last_peered":"2024-09-12T18:35:32.409944+0000","last_clean":"2024-09-12T18:35:32.409944+0000","last_became_active":"2024-09-12T18:35:25.653934+0000","last_became_peered":"2024-09-12T18:35:25.653934+0000","last_unstale":"2024-09-12T18:35:32.409944+0000","last_undegraded":"2024-09-12T18:35:32.409944+0000","last_fullsized":"2024-09-12T18:35:32.409944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:05.418901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095481+0000","last_change":"2024-09-12T18:35:25.658819+0000","last_active":"2024-09-12T18:35:33.095481+0000","last_peered":"2024-09-12T18:35:33.095481+0000","last_clean":"2024-09-12T18:35:33.095481+0000","last_became_active":"2024-09-12T18:35:25.656843+0000","last_became_peered":"2024-09-12T18:35:25.656843+0000","last_unstale":"2024-09-12T18:35:33.095481+0000","last_undegraded":"2024-09-12T18:35:33.095481+0000","last_fullsized":"2024-09-12T18:35:33.095481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:55.291963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409642+0000","last_change":"2024-09-12T18:35:25.661176+0000","last_active":"2024-09-12T18:35:32.409642+0000","last_peered":"2024-09-12T18:35:32.409642+0000","last_clean":"2024-09-12T18:35:32.409642+0000","last_became_active":"2024-09-12T18:35:25.659534+0000","last_became_peered":"2024-09-12T18:35:25.659534+0000","last_unstale":"2024-09-12T18:35:32.409642+0000","last_undegraded":"2024-09-12T18:35:32.409642+0000","last_fullsized":"2024-09-12T18:35:32.409642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:40.145442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408508+0000","last_change":"2024-09-12T18:35:25.650632+0000","last_active":"2024-09-12T18:35:32.408508+0000","last_peered":"2024-09-12T18:35:32.408508+0000","last_clean":"2024-09-12T18:35:32.408508+0000","last_became_active":"2024-09-12T18:35:25.649333+0000","last_became_peered":"2024-09-12T18:35:25.649333+0000","last_unstale":"2024-09-12T18:35:32.408508+0000","last_undegraded":"2024-09-12T18:35:32.408508+0000","last_fullsized":"2024-09-12T18:35:32.408508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:30.537572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408378+0000","last_change":"2024-09-12T18:35:25.648245+0000","last_active":"2024-09-12T18:35:32.408378+0000","last_peered":"2024-09-12T18:35:32.408378+0000","last_clean":"2024-09-12T18:35:32.408378+0000","last_became_active":"2024-09-12T18:35:25.646357+0000","last_became_peered":"2024-09-12T18:35:25.646357+0000","last_unstale":"2024-09-12T18:35:32.408378+0000","last_undegraded":"2024-09-12T18:35:32.408378+0000","last_fullsized":"2024-09-12T18:35:32.408378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:05.662140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.094206+0000","last_change":"2024-09-12T18:35:25.661613+0000","last_active":"2024-09-12T18:35:33.094206+0000","last_peered":"2024-09-12T18:35:33.094206+0000","last_clean":"2024-09-12T18:35:33.094206+0000","last_became_active":"2024-09-12T18:35:25.658833+0000","last_became_peered":"2024-09-12T18:35:25.658833+0000","last_unstale":"2024-09-12T18:35:33.094206+0000","last_undegraded":"2024-09-12T18:35:33.094206+0000","last_fullsized":"2024-09-12T18:35:33.094206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:51.064080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.407827+0000","last_change":"2024-09-12T18:35:25.657782+0000","last_active":"2024-09-12T18:35:32.407827+0000","last_peered":"2024-09-12T18:35:32.407827+0000","last_clean":"2024-09-12T18:35:32.407827+0000","last_became_active":"2024-09-12T18:35:25.655295+0000","last_became_peered":"2024-09-12T18:35:25.655295+0000","last_unstale":"2024-09-12T18:35:32.407827+0000","last_undegraded":"2024-09-12T18:35:32.407827+0000","last_fullsized":"2024-09-12T18:35:32.407827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:37.744175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410219+0000","last_change":"2024-09-12T18:35:25.654863+0000","last_active":"2024-09-12T18:35:32.410219+0000","last_peered":"2024-09-12T18:35:32.410219+0000","last_clean":"2024-09-12T18:35:32.410219+0000","last_became_active":"2024-09-12T18:35:25.650407+0000","last_became_peered":"2024-09-12T18:35:25.650407+0000","last_unstale":"2024-09-12T18:35:32.410219+0000","last_undegraded":"2024-09-12T18:35:32.410219+0000","last_fullsized":"2024-09-12T18:35:32.410219+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:38.395666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095956+0000","last_change":"2024-09-12T18:35:25.662414+0000","last_active":"2024-09-12T18:35:33.095956+0000","last_peered":"2024-09-12T18:35:33.095956+0000","last_clean":"2024-09-12T18:35:33.095956+0000","last_became_active":"2024-09-12T18:35:25.660126+0000","last_became_peered":"2024-09-12T18:35:25.660126+0000","last_unstale":"2024-09-12T18:35:33.095956+0000","last_undegraded":"2024-09-12T18:35:33.095956+0000","last_fullsized":"2024-09-12T18:35:33.095956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:48.437139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409715+0000","last_change":"2024-09-12T18:35:25.661523+0000","last_active":"2024-09-12T18:35:32.409715+0000","last_peered":"2024-09-12T18:35:32.409715+0000","last_clean":"2024-09-12T18:35:32.409715+0000","last_became_active":"2024-09-12T18:35:25.659338+0000","last_became_peered":"2024-09-12T18:35:25.659338+0000","last_unstale":"2024-09-12T18:35:32.409715+0000","last_undegraded":"2024-09-12T18:35:32.409715+0000","last_fullsized":"2024-09-12T18:35:32.409715+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:37.083820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409590+0000","last_change":"2024-09-12T18:35:25.662445+0000","last_active":"2024-09-12T18:35:32.409590+0000","last_peered":"2024-09-12T18:35:32.409590+0000","last_clean":"2024-09-12T18:35:32.409590+0000","last_became_active":"2024-09-12T18:35:25.659496+0000","last_became_peered":"2024-09-12T18:35:25.659496+0000","last_unstale":"2024-09-12T18:35:32.409590+0000","last_undegraded":"2024-09-12T18:35:32.409590+0000","last_fullsized":"2024-09-12T18:35:32.409590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:03.270420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095459+0000","last_change":"2024-09-12T18:35:25.662519+0000","last_active":"2024-09-12T18:35:33.095459+0000","last_peered":"2024-09-12T18:35:33.095459+0000","last_clean":"2024-09-12T18:35:33.095459+0000","last_became_active":"2024-09-12T18:35:25.652964+0000","last_became_peered":"2024-09-12T18:35:25.652964+0000","last_unstale":"2024-09-12T18:35:33.095459+0000","last_undegraded":"2024-09-12T18:35:33.095459+0000","last_fullsized":"2024-09-12T18:35:33.095459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:37.923468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408671+0000","last_change":"2024-09-12T18:35:25.650507+0000","last_active":"2024-09-12T18:35:32.408671+0000","last_peered":"2024-09-12T18:35:32.408671+0000","last_clean":"2024-09-12T18:35:32.408671+0000","last_became_active":"2024-09-12T18:35:25.649415+0000","last_became_peered":"2024-09-12T18:35:25.649415+0000","last_unstale":"2024-09-12T18:35:32.408671+0000","last_undegraded":"2024-09-12T18:35:32.408671+0000","last_fullsized":"2024-09-12T18:35:32.408671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:23.081416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.094335+0000","last_change":"2024-09-12T18:35:25.653949+0000","last_active":"2024-09-12T18:35:33.094335+0000","last_peered":"2024-09-12T18:35:33.094335+0000","last_clean":"2024-09-12T18:35:33.094335+0000","last_became_active":"2024-09-12T18:35:25.652992+0000","last_became_peered":"2024-09-12T18:35:25.652992+0000","last_unstale":"2024-09-12T18:35:33.094335+0000","last_undegraded":"2024-09-12T18:35:33.094335+0000","last_fullsized":"2024-09-12T18:35:33.094335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:47.687372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.407991+0000","last_change":"2024-09-12T18:35:25.653159+0000","last_active":"2024-09-12T18:35:32.407991+0000","last_peered":"2024-09-12T18:35:32.407991+0000","last_clean":"2024-09-12T18:35:32.407991+0000","last_became_active":"2024-09-12T18:35:25.650551+0000","last_became_peered":"2024-09-12T18:35:25.650551+0000","last_unstale":"2024-09-12T18:35:32.407991+0000","last_undegraded":"2024-09-12T18:35:32.407991+0000","last_fullsized":"2024-09-12T18:35:32.407991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:16.245302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409338+0000","last_change":"2024-09-12T18:35:25.651877+0000","last_active":"2024-09-12T18:35:32.409338+0000","last_peered":"2024-09-12T18:35:32.409338+0000","last_clean":"2024-09-12T18:35:32.409338+0000","last_became_active":"2024-09-12T18:35:25.651055+0000","last_became_peered":"2024-09-12T18:35:25.651055+0000","last_unstale":"2024-09-12T18:35:32.409338+0000","last_undegraded":"2024-09-12T18:35:32.409338+0000","last_fullsized":"2024-09-12T18:35:32.409338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:14.200080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409200+0000","last_change":"2024-09-12T18:35:24.657739+0000","last_active":"2024-09-12T18:35:32.409200+0000","last_peered":"2024-09-12T18:35:32.409200+0000","last_clean":"2024-09-12T18:35:32.409200+0000","last_became_active":"2024-09-12T18:35:24.656208+0000","last_became_peered":"2024-09-12T18:35:24.656208+0000","last_unstale":"2024-09-12T18:35:32.409200+0000","last_undegraded":"2024-09-12T18:35:32.409200+0000","last_fullsized":"2024-09-12T18:35:32.409200+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:50.073716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409601+0000","last_change":"2024-09-12T18:35:25.651651+0000","last_active":"2024-09-12T18:35:32.409601+0000","last_peered":"2024-09-12T18:35:32.409601+0000","last_clean":"2024-09-12T18:35:32.409601+0000","last_became_active":"2024-09-12T18:35:25.650849+0000","last_became_peered":"2024-09-12T18:35:25.650849+0000","last_unstale":"2024-09-12T18:35:32.409601+0000","last_undegraded":"2024-09-12T18:35:32.409601+0000","last_fullsized":"2024-09-12T18:35:32.409601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:18.555827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.092714+0000","last_change":"2024-09-12T18:35:24.656119+0000","last_active":"2024-09-12T18:35:33.092714+0000","last_peered":"2024-09-12T18:35:33.092714+0000","last_clean":"2024-09-12T18:35:33.092714+0000","last_became_active":"2024-09-12T18:35:24.653175+0000","last_became_peered":"2024-09-12T18:35:24.653175+0000","last_unstale":"2024-09-12T18:35:33.092714+0000","last_undegraded":"2024-09-12T18:35:33.092714+0000","last_fullsized":"2024-09-12T18:35:33.092714+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:00.551165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.096293+0000","last_change":"2024-09-12T18:35:25.655723+0000","last_active":"2024-09-12T18:35:33.096293+0000","last_peered":"2024-09-12T18:35:33.096293+0000","last_clean":"2024-09-12T18:35:33.096293+0000","last_became_active":"2024-09-12T18:35:25.653630+0000","last_became_peered":"2024-09-12T18:35:25.653630+0000","last_unstale":"2024-09-12T18:35:33.096293+0000","last_undegraded":"2024-09-12T18:35:33.096293+0000","last_fullsized":"2024-09-12T18:35:33.096293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:07.655792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408416+0000","last_change":"2024-09-12T18:35:24.640096+0000","last_active":"2024-09-12T18:35:32.408416+0000","last_peered":"2024-09-12T18:35:32.408416+0000","last_clean":"2024-09-12T18:35:32.408416+0000","last_became_active":"2024-09-12T18:35:24.638230+0000","last_became_peered":"2024-09-12T18:35:24.638230+0000","last_unstale":"2024-09-12T18:35:32.408416+0000","last_undegraded":"2024-09-12T18:35:32.408416+0000","last_fullsized":"2024-09-12T18:35:32.408416+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:38.435296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095745+0000","last_change":"2024-09-12T18:35:25.662692+0000","last_active":"2024-09-12T18:35:33.095745+0000","last_peered":"2024-09-12T18:35:33.095745+0000","last_clean":"2024-09-12T18:35:33.095745+0000","last_became_active":"2024-09-12T18:35:25.661885+0000","last_became_peered":"2024-09-12T18:35:25.661885+0000","last_unstale":"2024-09-12T18:35:33.095745+0000","last_undegraded":"2024-09-12T18:35:33.095745+0000","last_fullsized":"2024-09-12T18:35:33.095745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:41.264425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408266+0000","last_change":"2024-09-12T18:35:24.653610+0000","last_active":"2024-09-12T18:35:32.408266+0000","last_peered":"2024-09-12T18:35:32.408266+0000","last_clean":"2024-09-12T18:35:32.408266+0000","last_became_active":"2024-09-12T18:35:24.652880+0000","last_became_peered":"2024-09-12T18:35:24.652880+0000","last_unstale":"2024-09-12T18:35:32.408266+0000","last_undegraded":"2024-09-12T18:35:32.408266+0000","last_fullsized":"2024-09-12T18:35:32.408266+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:57.636251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410248+0000","last_change":"2024-09-12T18:35:24.653465+0000","last_active":"2024-09-12T18:35:32.410248+0000","last_peered":"2024-09-12T18:35:32.410248+0000","last_clean":"2024-09-12T18:35:32.410248+0000","last_became_active":"2024-09-12T18:35:24.652792+0000","last_became_peered":"2024-09-12T18:35:24.652792+0000","last_unstale":"2024-09-12T18:35:32.410248+0000","last_undegraded":"2024-09-12T18:35:32.410248+0000","last_fullsized":"2024-09-12T18:35:32.410248+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:14.588993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.407906+0000","last_change":"2024-09-12T18:35:25.655426+0000","last_active":"2024-09-12T18:35:32.407906+0000","last_peered":"2024-09-12T18:35:32.407906+0000","last_clean":"2024-09-12T18:35:32.407906+0000","last_became_active":"2024-09-12T18:35:25.648186+0000","last_became_peered":"2024-09-12T18:35:25.648186+0000","last_unstale":"2024-09-12T18:35:32.407906+0000","last_undegraded":"2024-09-12T18:35:32.407906+0000","last_fullsized":"2024-09-12T18:35:32.407906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:48.802815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410238+0000","last_change":"2024-09-12T18:35:24.648439+0000","last_active":"2024-09-12T18:35:32.410238+0000","last_peered":"2024-09-12T18:35:32.410238+0000","last_clean":"2024-09-12T18:35:32.410238+0000","last_became_active":"2024-09-12T18:35:24.647629+0000","last_became_peered":"2024-09-12T18:35:24.647629+0000","last_unstale":"2024-09-12T18:35:32.410238+0000","last_undegraded":"2024-09-12T18:35:32.410238+0000","last_fullsized":"2024-09-12T18:35:32.410238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:45.428223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408106+0000","last_change":"2024-09-12T18:35:25.652496+0000","last_active":"2024-09-12T18:35:32.408106+0000","last_peered":"2024-09-12T18:35:32.408106+0000","last_clean":"2024-09-12T18:35:32.408106+0000","last_became_active":"2024-09-12T18:35:25.651628+0000","last_became_peered":"2024-09-12T18:35:25.651628+0000","last_unstale":"2024-09-12T18:35:32.408106+0000","last_undegraded":"2024-09-12T18:35:32.408106+0000","last_fullsized":"2024-09-12T18:35:32.408106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:44.920448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410714+0000","last_change":"2024-09-12T18:35:24.654976+0000","last_active":"2024-09-12T18:35:32.410714+0000","last_peered":"2024-09-12T18:35:32.410714+0000","last_clean":"2024-09-12T18:35:32.410714+0000","last_became_active":"2024-09-12T18:35:24.654264+0000","last_became_peered":"2024-09-12T18:35:24.654264+0000","last_unstale":"2024-09-12T18:35:32.410714+0000","last_undegraded":"2024-09-12T18:35:32.410714+0000","last_fullsized":"2024-09-12T18:35:32.410714+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:00.115408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408935+0000","last_change":"2024-09-12T18:35:25.650577+0000","last_active":"2024-09-12T18:35:32.408935+0000","last_peered":"2024-09-12T18:35:32.408935+0000","last_clean":"2024-09-12T18:35:32.408935+0000","last_became_active":"2024-09-12T18:35:25.649172+0000","last_became_peered":"2024-09-12T18:35:25.649172+0000","last_unstale":"2024-09-12T18:35:32.408935+0000","last_undegraded":"2024-09-12T18:35:32.408935+0000","last_fullsized":"2024-09-12T18:35:32.408935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:55.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410258+0000","last_change":"2024-09-12T18:35:24.657665+0000","last_active":"2024-09-12T18:35:32.410258+0000","last_peered":"2024-09-12T18:35:32.410258+0000","last_clean":"2024-09-12T18:35:32.410258+0000","last_became_active":"2024-09-12T18:35:24.657015+0000","last_became_peered":"2024-09-12T18:35:24.657015+0000","last_unstale":"2024-09-12T18:35:32.410258+0000","last_undegraded":"2024-09-12T18:35:32.410258+0000","last_fullsized":"2024-09-12T18:35:32.410258+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:03.171326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095182+0000","last_change":"2024-09-12T18:35:25.665275+0000","last_active":"2024-09-12T18:35:33.095182+0000","last_peered":"2024-09-12T18:35:33.095182+0000","last_clean":"2024-09-12T18:35:33.095182+0000","last_became_active":"2024-09-12T18:35:25.659511+0000","last_became_peered":"2024-09-12T18:35:25.659511+0000","last_unstale":"2024-09-12T18:35:33.095182+0000","last_undegraded":"2024-09-12T18:35:33.095182+0000","last_fullsized":"2024-09-12T18:35:33.095182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.093733+0000","last_change":"2024-09-12T18:35:24.651913+0000","last_active":"2024-09-12T18:35:33.093733+0000","last_peered":"2024-09-12T18:35:33.093733+0000","last_clean":"2024-09-12T18:35:33.093733+0000","last_became_active":"2024-09-12T18:35:24.650421+0000","last_became_peered":"2024-09-12T18:35:24.650421+0000","last_unstale":"2024-09-12T18:35:33.093733+0000","last_undegraded":"2024-09-12T18:35:33.093733+0000","last_fullsized":"2024-09-12T18:35:33.093733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:57.685312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409119+0000","last_change":"2024-09-12T18:35:25.651138+0000","last_active":"2024-09-12T18:35:32.409119+0000","last_peered":"2024-09-12T18:35:32.409119+0000","last_clean":"2024-09-12T18:35:32.409119+0000","last_became_active":"2024-09-12T18:35:25.650617+0000","last_became_peered":"2024-09-12T18:35:25.650617+0000","last_unstale":"2024-09-12T18:35:32.409119+0000","last_undegraded":"2024-09-12T18:35:32.409119+0000","last_fullsized":"2024-09-12T18:35:32.409119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:58.535066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410319+0000","last_change":"2024-09-12T18:35:24.659019+0000","last_active":"2024-09-12T18:35:32.410319+0000","last_peered":"2024-09-12T18:35:32.410319+0000","last_clean":"2024-09-12T18:35:32.410319+0000","last_became_active":"2024-09-12T18:35:24.658423+0000","last_became_peered":"2024-09-12T18:35:24.658423+0000","last_unstale":"2024-09-12T18:35:32.410319+0000","last_undegraded":"2024-09-12T18:35:32.410319+0000","last_fullsized":"2024-09-12T18:35:32.410319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:37.668417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410270+0000","last_change":"2024-09-12T18:35:25.662287+0000","last_active":"2024-09-12T18:35:32.410270+0000","last_peered":"2024-09-12T18:35:32.410270+0000","last_clean":"2024-09-12T18:35:32.410270+0000","last_became_active":"2024-09-12T18:35:25.660372+0000","last_became_peered":"2024-09-12T18:35:25.660372+0000","last_unstale":"2024-09-12T18:35:32.410270+0000","last_undegraded":"2024-09-12T18:35:32.410270+0000","last_fullsized":"2024-09-12T18:35:32.410270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:08.729541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409339+0000","last_change":"2024-09-12T18:35:24.648330+0000","last_active":"2024-09-12T18:35:32.409339+0000","last_peered":"2024-09-12T18:35:32.409339+0000","last_clean":"2024-09-12T18:35:32.409339+0000","last_became_active":"2024-09-12T18:35:24.647520+0000","last_became_peered":"2024-09-12T18:35:24.647520+0000","last_unstale":"2024-09-12T18:35:32.409339+0000","last_undegraded":"2024-09-12T18:35:32.409339+0000","last_fullsized":"2024-09-12T18:35:32.409339+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:25.552055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409423+0000","last_change":"2024-09-12T18:35:25.658674+0000","last_active":"2024-09-12T18:35:32.409423+0000","last_peered":"2024-09-12T18:35:32.409423+0000","last_clean":"2024-09-12T18:35:32.409423+0000","last_became_active":"2024-09-12T18:35:25.657386+0000","last_became_peered":"2024-09-12T18:35:25.657386+0000","last_unstale":"2024-09-12T18:35:32.409423+0000","last_undegraded":"2024-09-12T18:35:32.409423+0000","last_fullsized":"2024-09-12T18:35:32.409423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:48.037086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408029+0000","last_change":"2024-09-12T18:35:24.646810+0000","last_active":"2024-09-12T18:35:32.408029+0000","last_peered":"2024-09-12T18:35:32.408029+0000","last_clean":"2024-09-12T18:35:32.408029+0000","last_became_active":"2024-09-12T18:35:24.646008+0000","last_became_peered":"2024-09-12T18:35:24.646008+0000","last_unstale":"2024-09-12T18:35:32.408029+0000","last_undegraded":"2024-09-12T18:35:32.408029+0000","last_fullsized":"2024-09-12T18:35:32.408029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:43.888776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095907+0000","last_change":"2024-09-12T18:35:25.667710+0000","last_active":"2024-09-12T18:35:33.095907+0000","last_peered":"2024-09-12T18:35:33.095907+0000","last_clean":"2024-09-12T18:35:33.095907+0000","last_became_active":"2024-09-12T18:35:25.666940+0000","last_became_peered":"2024-09-12T18:35:25.666940+0000","last_unstale":"2024-09-12T18:35:33.095907+0000","last_undegraded":"2024-09-12T18:35:33.095907+0000","last_fullsized":"2024-09-12T18:35:33.095907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:09.823085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":167,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409297+0000","last_change":"2024-09-12T18:35:13.489018+0000","last_active":"2024-09-12T18:35:32.409297+0000","last_peered":"2024-09-12T18:35:32.409297+0000","last_clean":"2024-09-12T18:35:32.409297+0000","last_became_active":"2024-09-12T18:35:13.488346+0000","last_became_peered":"2024-09-12T18:35:13.488346+0000","last_unstale":"2024-09-12T18:35:32.409297+0000","last_undegraded":"2024-09-12T18:35:32.409297+0000","last_fullsized":"2024-09-12T18:35:32.409297+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_clean_scrub_stamp":"2024-09-12T18:35:12.464628+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:54.864640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410021+0000","last_change":"2024-09-12T18:35:22.459694+0000","last_active":"2024-09-12T18:35:32.410021+0000","last_peered":"2024-09-12T18:35:32.410021+0000","last_clean":"2024-09-12T18:35:32.410021+0000","last_became_active":"2024-09-12T18:35:20.446796+0000","last_became_peered":"2024-09-12T18:35:20.446796+0000","last_unstale":"2024-09-12T18:35:32.410021+0000","last_undegraded":"2024-09-12T18:35:32.410021+0000","last_fullsized":"2024-09-12T18:35:32.410021+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:21.506024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016291610000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.092256+0000","last_change":"2024-09-12T18:35:24.651749+0000","last_active":"2024-09-12T18:35:33.092256+0000","last_peered":"2024-09-12T18:35:33.092256+0000","last_clean":"2024-09-12T18:35:33.092256+0000","last_became_active":"2024-09-12T18:35:24.649860+0000","last_became_peered":"2024-09-12T18:35:24.649860+0000","last_unstale":"2024-09-12T18:35:33.092256+0000","last_undegraded":"2024-09-12T18:35:33.092256+0000","last_fullsized":"2024-09-12T18:35:33.092256+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:35.430065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410595+0000","last_change":"2024-09-12T18:35:25.662424+0000","last_active":"2024-09-12T18:35:32.410595+0000","last_peered":"2024-09-12T18:35:32.410595+0000","last_clean":"2024-09-12T18:35:32.410595+0000","last_became_active":"2024-09-12T18:35:25.661043+0000","last_became_peered":"2024-09-12T18:35:25.661043+0000","last_unstale":"2024-09-12T18:35:32.410595+0000","last_undegraded":"2024-09-12T18:35:32.410595+0000","last_fullsized":"2024-09-12T18:35:32.410595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:52.551802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408682+0000","last_change":"2024-09-12T18:35:22.459090+0000","last_active":"2024-09-12T18:35:32.408682+0000","last_peered":"2024-09-12T18:35:32.408682+0000","last_clean":"2024-09-12T18:35:32.408682+0000","last_became_active":"2024-09-12T18:35:20.448553+0000","last_became_peered":"2024-09-12T18:35:20.448553+0000","last_unstale":"2024-09-12T18:35:32.408682+0000","last_undegraded":"2024-09-12T18:35:32.408682+0000","last_fullsized":"2024-09-12T18:35:32.408682+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:56.834808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001030836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.092165+0000","last_change":"2024-09-12T18:35:24.651597+0000","last_active":"2024-09-12T18:35:33.092165+0000","last_peered":"2024-09-12T18:35:33.092165+0000","last_clean":"2024-09-12T18:35:33.092165+0000","last_became_active":"2024-09-12T18:35:24.649940+0000","last_became_peered":"2024-09-12T18:35:24.649940+0000","last_unstale":"2024-09-12T18:35:33.092165+0000","last_undegraded":"2024-09-12T18:35:33.092165+0000","last_fullsized":"2024-09-12T18:35:33.092165+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:36.822432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410101+0000","last_change":"2024-09-12T18:35:25.660529+0000","last_active":"2024-09-12T18:35:32.410101+0000","last_peered":"2024-09-12T18:35:32.410101+0000","last_clean":"2024-09-12T18:35:32.410101+0000","last_became_active":"2024-09-12T18:35:25.659537+0000","last_became_peered":"2024-09-12T18:35:25.659537+0000","last_unstale":"2024-09-12T18:35:32.410101+0000","last_undegraded":"2024-09-12T18:35:32.410101+0000","last_fullsized":"2024-09-12T18:35:32.410101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:51.790349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095003+0000","last_change":"2024-09-12T18:35:22.464179+0000","last_active":"2024-09-12T18:35:33.095003+0000","last_peered":"2024-09-12T18:35:33.095003+0000","last_clean":"2024-09-12T18:35:33.095003+0000","last_became_active":"2024-09-12T18:35:20.442613+0000","last_became_peered":"2024-09-12T18:35:20.442613+0000","last_unstale":"2024-09-12T18:35:33.095003+0000","last_undegraded":"2024-09-12T18:35:33.095003+0000","last_fullsized":"2024-09-12T18:35:33.095003+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:17.636537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014134620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408165+0000","last_change":"2024-09-12T18:35:24.641297+0000","last_active":"2024-09-12T18:35:32.408165+0000","last_peered":"2024-09-12T18:35:32.408165+0000","last_clean":"2024-09-12T18:35:32.408165+0000","last_became_active":"2024-09-12T18:35:24.637334+0000","last_became_peered":"2024-09-12T18:35:24.637334+0000","last_unstale":"2024-09-12T18:35:32.408165+0000","last_undegraded":"2024-09-12T18:35:32.408165+0000","last_fullsized":"2024-09-12T18:35:32.408165+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:50.772074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095958+0000","last_change":"2024-09-12T18:35:25.659209+0000","last_active":"2024-09-12T18:35:33.095958+0000","last_peered":"2024-09-12T18:35:33.095958+0000","last_clean":"2024-09-12T18:35:33.095958+0000","last_became_active":"2024-09-12T18:35:25.656170+0000","last_became_peered":"2024-09-12T18:35:25.656170+0000","last_unstale":"2024-09-12T18:35:33.095958+0000","last_undegraded":"2024-09-12T18:35:33.095958+0000","last_fullsized":"2024-09-12T18:35:33.095958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:40.925757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":32,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410589+0000","last_change":"2024-09-12T18:35:22.459049+0000","last_active":"2024-09-12T18:35:32.410589+0000","last_peered":"2024-09-12T18:35:32.410589+0000","last_clean":"2024-09-12T18:35:32.410589+0000","last_became_active":"2024-09-12T18:35:20.446814+0000","last_became_peered":"2024-09-12T18:35:20.446814+0000","last_unstale":"2024-09-12T18:35:32.410589+0000","last_undegraded":"2024-09-12T18:35:32.410589+0000","last_fullsized":"2024-09-12T18:35:32.410589+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:18.033595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010716149999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409453+0000","last_change":"2024-09-12T18:35:24.658273+0000","last_active":"2024-09-12T18:35:32.409453+0000","last_peered":"2024-09-12T18:35:32.409453+0000","last_clean":"2024-09-12T18:35:32.409453+0000","last_became_active":"2024-09-12T18:35:24.657433+0000","last_became_peered":"2024-09-12T18:35:24.657433+0000","last_unstale":"2024-09-12T18:35:32.409453+0000","last_undegraded":"2024-09-12T18:35:32.409453+0000","last_fullsized":"2024-09-12T18:35:32.409453+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:48.497218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095434+0000","last_change":"2024-09-12T18:35:25.655830+0000","last_active":"2024-09-12T18:35:33.095434+0000","last_peered":"2024-09-12T18:35:33.095434+0000","last_clean":"2024-09-12T18:35:33.095434+0000","last_became_active":"2024-09-12T18:35:25.652126+0000","last_became_peered":"2024-09-12T18:35:25.652126+0000","last_unstale":"2024-09-12T18:35:33.095434+0000","last_undegraded":"2024-09-12T18:35:33.095434+0000","last_fullsized":"2024-09-12T18:35:33.095434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:04.080721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410902+0000","last_change":"2024-09-12T18:35:24.657618+0000","last_active":"2024-09-12T18:35:32.410902+0000","last_peered":"2024-09-12T18:35:32.410902+0000","last_clean":"2024-09-12T18:35:32.410902+0000","last_became_active":"2024-09-12T18:35:24.656741+0000","last_became_peered":"2024-09-12T18:35:24.656741+0000","last_unstale":"2024-09-12T18:35:32.410902+0000","last_undegraded":"2024-09-12T18:35:32.410902+0000","last_fullsized":"2024-09-12T18:35:32.410902+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:43.113104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095849+0000","last_change":"2024-09-12T18:35:22.464180+0000","last_active":"2024-09-12T18:35:33.095849+0000","last_peered":"2024-09-12T18:35:33.095849+0000","last_clean":"2024-09-12T18:35:33.095849+0000","last_became_active":"2024-09-12T18:35:20.442566+0000","last_became_peered":"2024-09-12T18:35:20.442566+0000","last_unstale":"2024-09-12T18:35:33.095849+0000","last_undegraded":"2024-09-12T18:35:33.095849+0000","last_fullsized":"2024-09-12T18:35:33.095849+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:29.021710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001325786,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408521+0000","last_change":"2024-09-12T18:35:25.650458+0000","last_active":"2024-09-12T18:35:32.408521+0000","last_peered":"2024-09-12T18:35:32.408521+0000","last_clean":"2024-09-12T18:35:32.408521+0000","last_became_active":"2024-09-12T18:35:25.648761+0000","last_became_peered":"2024-09-12T18:35:25.648761+0000","last_unstale":"2024-09-12T18:35:32.408521+0000","last_undegraded":"2024-09-12T18:35:32.408521+0000","last_fullsized":"2024-09-12T18:35:32.408521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:53.026950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.092506+0000","last_change":"2024-09-12T18:35:24.649669+0000","last_active":"2024-09-12T18:35:33.092506+0000","last_peered":"2024-09-12T18:35:33.092506+0000","last_clean":"2024-09-12T18:35:33.092506+0000","last_became_active":"2024-09-12T18:35:24.648881+0000","last_became_peered":"2024-09-12T18:35:24.648881+0000","last_unstale":"2024-09-12T18:35:33.092506+0000","last_undegraded":"2024-09-12T18:35:33.092506+0000","last_fullsized":"2024-09-12T18:35:33.092506+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:23.614734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410493+0000","last_change":"2024-09-12T18:35:22.458666+0000","last_active":"2024-09-12T18:35:32.410493+0000","last_peered":"2024-09-12T18:35:32.410493+0000","last_clean":"2024-09-12T18:35:32.410493+0000","last_became_active":"2024-09-12T18:35:20.442394+0000","last_became_peered":"2024-09-12T18:35:20.442394+0000","last_unstale":"2024-09-12T18:35:32.410493+0000","last_undegraded":"2024-09-12T18:35:32.410493+0000","last_fullsized":"2024-09-12T18:35:32.410493+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:51.840246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080163599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408846+0000","last_change":"2024-09-12T18:35:25.650717+0000","last_active":"2024-09-12T18:35:32.408846+0000","last_peered":"2024-09-12T18:35:32.408846+0000","last_clean":"2024-09-12T18:35:32.408846+0000","last_became_active":"2024-09-12T18:35:25.649147+0000","last_became_peered":"2024-09-12T18:35:25.649147+0000","last_unstale":"2024-09-12T18:35:32.408846+0000","last_undegraded":"2024-09-12T18:35:32.408846+0000","last_fullsized":"2024-09-12T18:35:32.408846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:07.365888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.093028+0000","last_change":"2024-09-12T18:35:24.657234+0000","last_active":"2024-09-12T18:35:33.093028+0000","last_peered":"2024-09-12T18:35:33.093028+0000","last_clean":"2024-09-12T18:35:33.093028+0000","last_became_active":"2024-09-12T18:35:24.655950+0000","last_became_peered":"2024-09-12T18:35:24.655950+0000","last_unstale":"2024-09-12T18:35:33.093028+0000","last_undegraded":"2024-09-12T18:35:33.093028+0000","last_fullsized":"2024-09-12T18:35:33.093028+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:17.466623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.096388+0000","last_change":"2024-09-12T18:35:22.464656+0000","last_active":"2024-09-12T18:35:33.096388+0000","last_peered":"2024-09-12T18:35:33.096388+0000","last_clean":"2024-09-12T18:35:33.096388+0000","last_became_active":"2024-09-12T18:35:20.445470+0000","last_became_peered":"2024-09-12T18:35:20.445470+0000","last_unstale":"2024-09-12T18:35:33.096388+0000","last_undegraded":"2024-09-12T18:35:33.096388+0000","last_fullsized":"2024-09-12T18:35:33.096388+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:58.947359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001742681,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.094350+0000","last_change":"2024-09-12T18:35:25.658887+0000","last_active":"2024-09-12T18:35:33.094350+0000","last_peered":"2024-09-12T18:35:33.094350+0000","last_clean":"2024-09-12T18:35:33.094350+0000","last_became_active":"2024-09-12T18:35:25.656829+0000","last_became_peered":"2024-09-12T18:35:25.656829+0000","last_unstale":"2024-09-12T18:35:33.094350+0000","last_undegraded":"2024-09-12T18:35:33.094350+0000","last_fullsized":"2024-09-12T18:35:33.094350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:50.109858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.092649+0000","last_change":"2024-09-12T18:35:24.654518+0000","last_active":"2024-09-12T18:35:33.092649+0000","last_peered":"2024-09-12T18:35:33.092649+0000","last_clean":"2024-09-12T18:35:33.092649+0000","last_became_active":"2024-09-12T18:35:24.650309+0000","last_became_peered":"2024-09-12T18:35:24.650309+0000","last_unstale":"2024-09-12T18:35:33.092649+0000","last_undegraded":"2024-09-12T18:35:33.092649+0000","last_fullsized":"2024-09-12T18:35:33.092649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:16.669035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410632+0000","last_change":"2024-09-12T18:35:22.459767+0000","last_active":"2024-09-12T18:35:32.410632+0000","last_peered":"2024-09-12T18:35:32.410632+0000","last_clean":"2024-09-12T18:35:32.410632+0000","last_became_active":"2024-09-12T18:35:20.448521+0000","last_became_peered":"2024-09-12T18:35:20.448521+0000","last_unstale":"2024-09-12T18:35:32.410632+0000","last_undegraded":"2024-09-12T18:35:32.410632+0000","last_fullsized":"2024-09-12T18:35:32.410632+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:33.463792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017009670000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408128+0000","last_change":"2024-09-12T18:35:25.648150+0000","last_active":"2024-09-12T18:35:32.408128+0000","last_peered":"2024-09-12T18:35:32.408128+0000","last_clean":"2024-09-12T18:35:32.408128+0000","last_became_active":"2024-09-12T18:35:25.647347+0000","last_became_peered":"2024-09-12T18:35:25.647347+0000","last_unstale":"2024-09-12T18:35:32.408128+0000","last_undegraded":"2024-09-12T18:35:32.408128+0000","last_fullsized":"2024-09-12T18:35:32.408128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:48.968336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408750+0000","last_change":"2024-09-12T18:35:25.660696+0000","last_active":"2024-09-12T18:35:32.408750+0000","last_peered":"2024-09-12T18:35:32.408750+0000","last_clean":"2024-09-12T18:35:32.408750+0000","last_became_active":"2024-09-12T18:35:25.659827+0000","last_became_peered":"2024-09-12T18:35:25.659827+0000","last_unstale":"2024-09-12T18:35:32.408750+0000","last_undegraded":"2024-09-12T18:35:32.408750+0000","last_fullsized":"2024-09-12T18:35:32.408750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:15.678289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":23,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409994+0000","last_change":"2024-09-12T18:35:24.655051+0000","last_active":"2024-09-12T18:35:32.409994+0000","last_peered":"2024-09-12T18:35:32.409994+0000","last_clean":"2024-09-12T18:35:32.409994+0000","last_became_active":"2024-09-12T18:35:24.654282+0000","last_became_peered":"2024-09-12T18:35:24.654282+0000","last_unstale":"2024-09-12T18:35:32.409994+0000","last_undegraded":"2024-09-12T18:35:32.409994+0000","last_fullsized":"2024-09-12T18:35:32.409994+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:08.159799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.094530+0000","last_change":"2024-09-12T18:35:25.659237+0000","last_active":"2024-09-12T18:35:33.094530+0000","last_peered":"2024-09-12T18:35:33.094530+0000","last_clean":"2024-09-12T18:35:33.094530+0000","last_became_active":"2024-09-12T18:35:25.658423+0000","last_became_peered":"2024-09-12T18:35:25.658423+0000","last_unstale":"2024-09-12T18:35:33.094530+0000","last_undegraded":"2024-09-12T18:35:33.094530+0000","last_fullsized":"2024-09-12T18:35:33.094530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:42.956934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410294+0000","last_change":"2024-09-12T18:35:24.648658+0000","last_active":"2024-09-12T18:35:32.410294+0000","last_peered":"2024-09-12T18:35:32.410294+0000","last_clean":"2024-09-12T18:35:32.410294+0000","last_became_active":"2024-09-12T18:35:24.647826+0000","last_became_peered":"2024-09-12T18:35:24.647826+0000","last_unstale":"2024-09-12T18:35:32.410294+0000","last_undegraded":"2024-09-12T18:35:32.410294+0000","last_fullsized":"2024-09-12T18:35:32.410294+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:24.167549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410026+0000","last_change":"2024-09-12T18:35:24.656855+0000","last_active":"2024-09-12T18:35:32.410026+0000","last_peered":"2024-09-12T18:35:32.410026+0000","last_clean":"2024-09-12T18:35:32.410026+0000","last_became_active":"2024-09-12T18:35:24.655935+0000","last_became_peered":"2024-09-12T18:35:24.655935+0000","last_unstale":"2024-09-12T18:35:32.410026+0000","last_undegraded":"2024-09-12T18:35:32.410026+0000","last_fullsized":"2024-09-12T18:35:32.410026+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:35.430065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.094515+0000","last_change":"2024-09-12T18:35:25.661801+0000","last_active":"2024-09-12T18:35:33.094515+0000","last_peered":"2024-09-12T18:35:33.094515+0000","last_clean":"2024-09-12T18:35:33.094515+0000","last_became_active":"2024-09-12T18:35:25.658476+0000","last_became_peered":"2024-09-12T18:35:25.658476+0000","last_unstale":"2024-09-12T18:35:33.094515+0000","last_undegraded":"2024-09-12T18:35:33.094515+0000","last_fullsized":"2024-09-12T18:35:33.094515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:58.246449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.092953+0000","last_change":"2024-09-12T18:35:24.652399+0000","last_active":"2024-09-12T18:35:33.092953+0000","last_peered":"2024-09-12T18:35:33.092953+0000","last_clean":"2024-09-12T18:35:33.092953+0000","last_became_active":"2024-09-12T18:35:24.651416+0000","last_became_peered":"2024-09-12T18:35:24.651416+0000","last_unstale":"2024-09-12T18:35:33.092953+0000","last_undegraded":"2024-09-12T18:35:33.092953+0000","last_fullsized":"2024-09-12T18:35:33.092953+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:32.594978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.094275+0000","last_change":"2024-09-12T18:35:25.658570+0000","last_active":"2024-09-12T18:35:33.094275+0000","last_peered":"2024-09-12T18:35:33.094275+0000","last_clean":"2024-09-12T18:35:33.094275+0000","last_became_active":"2024-09-12T18:35:25.656561+0000","last_became_peered":"2024-09-12T18:35:25.656561+0000","last_unstale":"2024-09-12T18:35:33.094275+0000","last_undegraded":"2024-09-12T18:35:33.094275+0000","last_fullsized":"2024-09-12T18:35:33.094275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:22.225756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410369+0000","last_change":"2024-09-12T18:35:25.651217+0000","last_active":"2024-09-12T18:35:32.410369+0000","last_peered":"2024-09-12T18:35:32.410369+0000","last_clean":"2024-09-12T18:35:32.410369+0000","last_became_active":"2024-09-12T18:35:25.649544+0000","last_became_peered":"2024-09-12T18:35:25.649544+0000","last_unstale":"2024-09-12T18:35:32.410369+0000","last_undegraded":"2024-09-12T18:35:32.410369+0000","last_fullsized":"2024-09-12T18:35:32.410369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:41.601376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.093421+0000","last_change":"2024-09-12T18:35:24.657489+0000","last_active":"2024-09-12T18:35:33.093421+0000","last_peered":"2024-09-12T18:35:33.093421+0000","last_clean":"2024-09-12T18:35:33.093421+0000","last_became_active":"2024-09-12T18:35:24.656030+0000","last_became_peered":"2024-09-12T18:35:24.656030+0000","last_unstale":"2024-09-12T18:35:33.093421+0000","last_undegraded":"2024-09-12T18:35:33.093421+0000","last_fullsized":"2024-09-12T18:35:33.093421+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:11.362759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095761+0000","last_change":"2024-09-12T18:35:25.661544+0000","last_active":"2024-09-12T18:35:33.095761+0000","last_peered":"2024-09-12T18:35:33.095761+0000","last_clean":"2024-09-12T18:35:33.095761+0000","last_became_active":"2024-09-12T18:35:25.656985+0000","last_became_peered":"2024-09-12T18:35:25.656985+0000","last_unstale":"2024-09-12T18:35:33.095761+0000","last_undegraded":"2024-09-12T18:35:33.095761+0000","last_fullsized":"2024-09-12T18:35:33.095761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.092175+0000","last_change":"2024-09-12T18:35:24.646342+0000","last_active":"2024-09-12T18:35:33.092175+0000","last_peered":"2024-09-12T18:35:33.092175+0000","last_clean":"2024-09-12T18:35:33.092175+0000","last_became_active":"2024-09-12T18:35:24.644773+0000","last_became_peered":"2024-09-12T18:35:24.644773+0000","last_unstale":"2024-09-12T18:35:33.092175+0000","last_undegraded":"2024-09-12T18:35:33.092175+0000","last_fullsized":"2024-09-12T18:35:33.092175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:17.011231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409241+0000","last_change":"2024-09-12T18:35:25.656712+0000","last_active":"2024-09-12T18:35:32.409241+0000","last_peered":"2024-09-12T18:35:32.409241+0000","last_clean":"2024-09-12T18:35:32.409241+0000","last_became_active":"2024-09-12T18:35:25.654473+0000","last_became_peered":"2024-09-12T18:35:25.654473+0000","last_unstale":"2024-09-12T18:35:32.409241+0000","last_undegraded":"2024-09-12T18:35:32.409241+0000","last_fullsized":"2024-09-12T18:35:32.409241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:01.464680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408790+0000","last_change":"2024-09-12T18:35:24.659935+0000","last_active":"2024-09-12T18:35:32.408790+0000","last_peered":"2024-09-12T18:35:32.408790+0000","last_clean":"2024-09-12T18:35:32.408790+0000","last_became_active":"2024-09-12T18:35:24.659111+0000","last_became_peered":"2024-09-12T18:35:24.659111+0000","last_unstale":"2024-09-12T18:35:32.408790+0000","last_undegraded":"2024-09-12T18:35:32.408790+0000","last_fullsized":"2024-09-12T18:35:32.408790+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:11.480154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409283+0000","last_change":"2024-09-12T18:35:25.660557+0000","last_active":"2024-09-12T18:35:32.409283+0000","last_peered":"2024-09-12T18:35:32.409283+0000","last_clean":"2024-09-12T18:35:32.409283+0000","last_became_active":"2024-09-12T18:35:25.652300+0000","last_became_peered":"2024-09-12T18:35:25.652300+0000","last_unstale":"2024-09-12T18:35:32.409283+0000","last_undegraded":"2024-09-12T18:35:32.409283+0000","last_fullsized":"2024-09-12T18:35:32.409283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:10:59.995841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409107+0000","last_change":"2024-09-12T18:35:24.638538+0000","last_active":"2024-09-12T18:35:32.409107+0000","last_peered":"2024-09-12T18:35:32.409107+0000","last_clean":"2024-09-12T18:35:32.409107+0000","last_became_active":"2024-09-12T18:35:24.637242+0000","last_became_peered":"2024-09-12T18:35:24.637242+0000","last_unstale":"2024-09-12T18:35:32.409107+0000","last_undegraded":"2024-09-12T18:35:32.409107+0000","last_fullsized":"2024-09-12T18:35:32.409107+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:26.877441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408680+0000","last_change":"2024-09-12T18:35:25.662537+0000","last_active":"2024-09-12T18:35:32.408680+0000","last_peered":"2024-09-12T18:35:32.408680+0000","last_clean":"2024-09-12T18:35:32.408680+0000","last_became_active":"2024-09-12T18:35:25.661441+0000","last_became_peered":"2024-09-12T18:35:25.661441+0000","last_unstale":"2024-09-12T18:35:32.408680+0000","last_undegraded":"2024-09-12T18:35:32.408680+0000","last_fullsized":"2024-09-12T18:35:32.408680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:14.397867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409631+0000","last_change":"2024-09-12T18:35:24.657635+0000","last_active":"2024-09-12T18:35:32.409631+0000","last_peered":"2024-09-12T18:35:32.409631+0000","last_clean":"2024-09-12T18:35:32.409631+0000","last_became_active":"2024-09-12T18:35:24.655992+0000","last_became_peered":"2024-09-12T18:35:24.655992+0000","last_unstale":"2024-09-12T18:35:32.409631+0000","last_undegraded":"2024-09-12T18:35:32.409631+0000","last_fullsized":"2024-09-12T18:35:32.409631+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:33.536755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409233+0000","last_change":"2024-09-12T18:35:25.651406+0000","last_active":"2024-09-12T18:35:32.409233+0000","last_peered":"2024-09-12T18:35:32.409233+0000","last_clean":"2024-09-12T18:35:32.409233+0000","last_became_active":"2024-09-12T18:35:25.649728+0000","last_became_peered":"2024-09-12T18:35:25.649728+0000","last_unstale":"2024-09-12T18:35:32.409233+0000","last_undegraded":"2024-09-12T18:35:32.409233+0000","last_fullsized":"2024-09-12T18:35:32.409233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:41.773283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409723+0000","last_change":"2024-09-12T18:35:24.649153+0000","last_active":"2024-09-12T18:35:32.409723+0000","last_peered":"2024-09-12T18:35:32.409723+0000","last_clean":"2024-09-12T18:35:32.409723+0000","last_became_active":"2024-09-12T18:35:24.648512+0000","last_became_peered":"2024-09-12T18:35:24.648512+0000","last_unstale":"2024-09-12T18:35:32.409723+0000","last_undegraded":"2024-09-12T18:35:32.409723+0000","last_fullsized":"2024-09-12T18:35:32.409723+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:07.810456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409441+0000","last_change":"2024-09-12T18:35:25.656799+0000","last_active":"2024-09-12T18:35:32.409441+0000","last_peered":"2024-09-12T18:35:32.409441+0000","last_clean":"2024-09-12T18:35:32.409441+0000","last_became_active":"2024-09-12T18:35:25.654980+0000","last_became_peered":"2024-09-12T18:35:25.654980+0000","last_unstale":"2024-09-12T18:35:32.409441+0000","last_undegraded":"2024-09-12T18:35:32.409441+0000","last_fullsized":"2024-09-12T18:35:32.409441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:10.735439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.092729+0000","last_change":"2024-09-12T18:35:24.656268+0000","last_active":"2024-09-12T18:35:33.092729+0000","last_peered":"2024-09-12T18:35:33.092729+0000","last_clean":"2024-09-12T18:35:33.092729+0000","last_became_active":"2024-09-12T18:35:24.655420+0000","last_became_peered":"2024-09-12T18:35:24.655420+0000","last_unstale":"2024-09-12T18:35:33.092729+0000","last_undegraded":"2024-09-12T18:35:33.092729+0000","last_fullsized":"2024-09-12T18:35:33.092729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:04.654666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408359+0000","last_change":"2024-09-12T18:35:25.661042+0000","last_active":"2024-09-12T18:35:32.408359+0000","last_peered":"2024-09-12T18:35:32.408359+0000","last_clean":"2024-09-12T18:35:32.408359+0000","last_became_active":"2024-09-12T18:35:25.660163+0000","last_became_peered":"2024-09-12T18:35:25.660163+0000","last_unstale":"2024-09-12T18:35:32.408359+0000","last_undegraded":"2024-09-12T18:35:32.408359+0000","last_fullsized":"2024-09-12T18:35:32.408359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:37.682184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.093423+0000","last_change":"2024-09-12T18:35:24.652304+0000","last_active":"2024-09-12T18:35:33.093423+0000","last_peered":"2024-09-12T18:35:33.093423+0000","last_clean":"2024-09-12T18:35:33.093423+0000","last_became_active":"2024-09-12T18:35:24.651460+0000","last_became_peered":"2024-09-12T18:35:24.651460+0000","last_unstale":"2024-09-12T18:35:33.093423+0000","last_undegraded":"2024-09-12T18:35:33.093423+0000","last_fullsized":"2024-09-12T18:35:33.093423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:42.050557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":262144,"data_stored":655733,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":274432,"data_stored":656368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":64206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:35:37.355 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T18:35:37.355 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T18:35:37.355 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T18:35:37.355 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T18:35:37.731 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:35:37.731 INFO:teuthology.orchestra.run.smithi073.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T18:35:37.750 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T18:35:37.750 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T18:35:38.065 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:35:38.066 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"btime":"2024-09-12T18:35:27:637181+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T18:35:25.000900+0000","modified":"2024-09-12T18:35:26.979639+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4211":{"gid":4211,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.73:6803/322019923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":322019923},{"type":"v1","addr":"172.21.15.73:6803","nonce":322019923}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4211,"qdb_cluster":[4211]},"id":1}]} 2024-09-12T18:35:38.066 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 5 2024-09-12T18:35:38.082 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T18:35:38.405 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:35:38.405 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"btime":"2024-09-12T18:35:27:637181+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T18:35:25.000900+0000","modified":"2024-09-12T18:35:26.979639+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4211":{"gid":4211,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.73:6803/322019923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":322019923},{"type":"v1","addr":"172.21.15.73:6803","nonce":322019923}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4211,"qdb_cluster":[4211]},"id":1}]} 2024-09-12T18:35:38.405 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 5 2024-09-12T18:35:38.424 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T18:35:38.722 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:35:38.722 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":20,"fsid":"c08d5a84-711b-44bf-bdf1-e06ecc2c7c00","created":"2024-09-12T18:35:02.695853+0000","modified":"2024-09-12T18:35:32.399204+0000","last_up_change":"2024-09-12T18:35:12.464628+0000","last_in_change":"2024-09-12T18:35:04.352525+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T18:35:12.418430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T18:35:18.665309+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T18:35:23.447845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T18:35:23.959973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f1cf24e8-6179-4666-a444-fa81ef0d7482","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6801","nonce":2710632206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6803","nonce":2710632206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6807","nonce":2710632206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6805","nonce":2710632206}]},"public_addr":"172.21.15.114:6801/2710632206","cluster_addr":"172.21.15.114:6803/2710632206","heartbeat_back_addr":"172.21.15.114:6807/2710632206","heartbeat_front_addr":"172.21.15.114:6805/2710632206","state":["exists","up"]},{"osd":1,"uuid":"3fdb0044-2820-4411-978b-4b6e94fbf0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6801","nonce":862189968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6803","nonce":862189968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6807","nonce":862189968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6805","nonce":862189968}]},"public_addr":"172.21.15.143:6801/862189968","cluster_addr":"172.21.15.143:6803/862189968","heartbeat_back_addr":"172.21.15.143:6807/862189968","heartbeat_front_addr":"172.21.15.143:6805/862189968","state":["exists","up"]},{"osd":2,"uuid":"6fb554da-561f-4aa2-b855-0e3adb98b057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6801","nonce":1397104153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6803","nonce":1397104153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6807","nonce":1397104153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6805","nonce":1397104153}]},"public_addr":"172.21.15.162:6801/1397104153","cluster_addr":"172.21.15.162:6803/1397104153","heartbeat_back_addr":"172.21.15.162:6807/1397104153","heartbeat_front_addr":"172.21.15.162:6805/1397104153","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:35:10.239320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:35:10.861760+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:35:10.355997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:35:38.741 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T18:35:39.076 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:35:39.076 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"btime":"2024-09-12T18:35:27:637181+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T18:35:25.000900+0000","modified":"2024-09-12T18:35:26.979639+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4211":{"gid":4211,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.73:6803/322019923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":322019923},{"type":"v1","addr":"172.21.15.73:6803","nonce":322019923}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4211,"qdb_cluster":[4211]},"id":1}]} 2024-09-12T18:35:39.076 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 5 2024-09-12T18:35:39.196 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T18:35:25.000900+0000', 'modified': '2024-09-12T18:35:26.979639+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4211}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4211': {'gid': 4211, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.73:6803/322019923', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6802', 'nonce': 322019923}, {'type': 'v1', 'addr': '172.21.15.73:6803', 'nonce': 322019923}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4211, 'qdb_cluster': [4211]} 2024-09-12T18:35:39.196 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T18:35:39.196 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-12T18:35:39.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T18:35:39.334+0000 7f5000ff9640 0 client.4506 ms_handle_reset on v2:172.21.15.73:6802/322019923 2024-09-12T18:35:39.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T18:35:39.354+0000 7f5000ff9640 0 client.4512 ms_handle_reset on v2:172.21.15.73:6802/322019923 2024-09-12T18:35:39.356 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T18:35:39.356 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "c08d5a84-711b-44bf-bdf1-e06ecc2c7c00", 2024-09-12T18:35:39.356 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 0, 2024-09-12T18:35:39.356 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 4211, 2024-09-12T18:35:39.356 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2024-09-12T18:35:39.357 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2024-09-12T18:35:39.357 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2024-09-12T18:35:39.357 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 13.733496066000001, 2024-09-12T18:35:39.357 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 5, 2024-09-12T18:35:39.357 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 20, 2024-09-12T18:35:39.357 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 19, 2024-09-12T18:35:39.357 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 16.780323788 2024-09-12T18:35:39.357 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T18:35:39.371 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-12T18:35:39.384 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-12T18:35:39.384 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '46406987da2067f022005d68ecbb989daaabb837'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '46406987da2067f022005d68ecbb989daaabb837'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '0d61375b8ab53be4c233f5b93e463edfdff9316a'}} 2024-09-12T18:35:39.384 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-12T18:35:39.384 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2024-09-12T18:35:39.385 DEBUG:teuthology.orchestra.run.smithi073:> sync 2024-09-12T18:35:39.802 DEBUG:teuthology.orchestra.run.smithi114:> sync 2024-09-12T18:35:39.957 DEBUG:teuthology.orchestra.run.smithi143:> sync 2024-09-12T18:35:40.098 DEBUG:teuthology.orchestra.run.smithi162:> sync 2024-09-12T18:35:40.274 DEBUG:tasks.thrashosds:checking console status of smithi073 2024-09-12T18:35:40.274 DEBUG:teuthology.orchestra.console.smithi073:Waiting for login prompt 2024-09-12T18:35:40.274 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi073 2024-09-12T18:35:40.407 DEBUG:teuthology.orchestra.console.smithi073:expect before: [Enter `^Ec?' for help] 2024-09-12T18:35:40.408 DEBUG:teuthology.orchestra.console.smithi073:expect after: smithi073 login: 2024-09-12T18:35:40.459 DEBUG:teuthology.orchestra.console.smithi073:console disconnect output: [Enter `^Ec?' for help] smithi073 login: [disconnect] 2024-09-12T18:35:40.560 DEBUG:tasks.thrashosds:checking console status of smithi114 2024-09-12T18:35:40.560 DEBUG:teuthology.orchestra.console.smithi114:Waiting for login prompt 2024-09-12T18:35:40.560 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi114 2024-09-12T18:35:40.645 DEBUG:teuthology.orchestra.console.smithi114:expect before: [Enter `^Ec?' for help] 2024-09-12T18:35:40.645 DEBUG:teuthology.orchestra.console.smithi114:expect after: smithi114 login: 2024-09-12T18:35:40.697 DEBUG:teuthology.orchestra.console.smithi114:console disconnect output: [Enter `^Ec?' for help] smithi114 login: [disconnect] 2024-09-12T18:35:40.799 DEBUG:tasks.thrashosds:checking console status of smithi143 2024-09-12T18:35:40.799 DEBUG:teuthology.orchestra.console.smithi143:Waiting for login prompt 2024-09-12T18:35:40.799 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi143 2024-09-12T18:35:40.933 DEBUG:teuthology.orchestra.console.smithi143:expect before: [Enter `^Ec?' for help] 2024-09-12T18:35:40.934 DEBUG:teuthology.orchestra.console.smithi143:expect after: smithi143 login: 2024-09-12T18:35:40.989 DEBUG:teuthology.orchestra.console.smithi143:console disconnect output: [Enter `^Ec?' for help] smithi143 login: [disconnect] 2024-09-12T18:35:41.091 DEBUG:tasks.thrashosds:checking console status of smithi162 2024-09-12T18:35:41.091 DEBUG:teuthology.orchestra.console.smithi162:Waiting for login prompt 2024-09-12T18:35:41.091 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi162 2024-09-12T18:35:41.247 DEBUG:teuthology.orchestra.console.smithi162:expect before: [Enter `^Ec?' for help] 2024-09-12T18:35:41.247 DEBUG:teuthology.orchestra.console.smithi162:expect after: smithi162 login: 2024-09-12T18:35:41.299 DEBUG:teuthology.orchestra.console.smithi162:console disconnect output: [Enter `^Ec?' for help] smithi162 login: [disconnect] 2024-09-12T18:35:41.401 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-12T18:35:41.747 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-12T18:35:41.748 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T18:35:41.748 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:35:42.056 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:35:42.059 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T18:35:42.074 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-09-12T18:35:40.380519+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":192,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90104,"kb_used_data":704,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025416,"statfs":{"total":289910292480,"available":289818025984,"internally_reserved":0,"allocated":720896,"data_stored":1376307,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4783,"internal_metadata":91483473},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003763"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410091+0000","last_change":"2024-09-12T18:35:25.657389+0000","last_active":"2024-09-12T18:35:32.410091+0000","last_peered":"2024-09-12T18:35:32.410091+0000","last_clean":"2024-09-12T18:35:32.410091+0000","last_became_active":"2024-09-12T18:35:25.651857+0000","last_became_peered":"2024-09-12T18:35:25.651857+0000","last_unstale":"2024-09-12T18:35:32.410091+0000","last_undegraded":"2024-09-12T18:35:32.410091+0000","last_fullsized":"2024-09-12T18:35:32.410091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:50.264536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409235+0000","last_change":"2024-09-12T18:35:25.659760+0000","last_active":"2024-09-12T18:35:32.409235+0000","last_peered":"2024-09-12T18:35:32.409235+0000","last_clean":"2024-09-12T18:35:32.409235+0000","last_became_active":"2024-09-12T18:35:25.654920+0000","last_became_peered":"2024-09-12T18:35:25.654920+0000","last_unstale":"2024-09-12T18:35:32.409235+0000","last_undegraded":"2024-09-12T18:35:32.409235+0000","last_fullsized":"2024-09-12T18:35:32.409235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:21.519881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408918+0000","last_change":"2024-09-12T18:35:25.659460+0000","last_active":"2024-09-12T18:35:32.408918+0000","last_peered":"2024-09-12T18:35:32.408918+0000","last_clean":"2024-09-12T18:35:32.408918+0000","last_became_active":"2024-09-12T18:35:25.657782+0000","last_became_peered":"2024-09-12T18:35:25.657782+0000","last_unstale":"2024-09-12T18:35:32.408918+0000","last_undegraded":"2024-09-12T18:35:32.408918+0000","last_fullsized":"2024-09-12T18:35:32.408918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:38.544284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408838+0000","last_change":"2024-09-12T18:35:25.663617+0000","last_active":"2024-09-12T18:35:32.408838+0000","last_peered":"2024-09-12T18:35:32.408838+0000","last_clean":"2024-09-12T18:35:32.408838+0000","last_became_active":"2024-09-12T18:35:25.661977+0000","last_became_peered":"2024-09-12T18:35:25.661977+0000","last_unstale":"2024-09-12T18:35:32.408838+0000","last_undegraded":"2024-09-12T18:35:32.408838+0000","last_fullsized":"2024-09-12T18:35:32.408838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:14.748234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408831+0000","last_change":"2024-09-12T18:35:25.656566+0000","last_active":"2024-09-12T18:35:32.408831+0000","last_peered":"2024-09-12T18:35:32.408831+0000","last_clean":"2024-09-12T18:35:32.408831+0000","last_became_active":"2024-09-12T18:35:25.654898+0000","last_became_peered":"2024-09-12T18:35:25.654898+0000","last_unstale":"2024-09-12T18:35:32.408831+0000","last_undegraded":"2024-09-12T18:35:32.408831+0000","last_fullsized":"2024-09-12T18:35:32.408831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:36.113250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408286+0000","last_change":"2024-09-12T18:35:25.652754+0000","last_active":"2024-09-12T18:35:32.408286+0000","last_peered":"2024-09-12T18:35:32.408286+0000","last_clean":"2024-09-12T18:35:32.408286+0000","last_became_active":"2024-09-12T18:35:25.651217+0000","last_became_peered":"2024-09-12T18:35:25.651217+0000","last_unstale":"2024-09-12T18:35:32.408286+0000","last_undegraded":"2024-09-12T18:35:32.408286+0000","last_fullsized":"2024-09-12T18:35:32.408286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:24.585774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408085+0000","last_change":"2024-09-12T18:35:25.659811+0000","last_active":"2024-09-12T18:35:32.408085+0000","last_peered":"2024-09-12T18:35:32.408085+0000","last_clean":"2024-09-12T18:35:32.408085+0000","last_became_active":"2024-09-12T18:35:25.658998+0000","last_became_peered":"2024-09-12T18:35:25.658998+0000","last_unstale":"2024-09-12T18:35:32.408085+0000","last_undegraded":"2024-09-12T18:35:32.408085+0000","last_fullsized":"2024-09-12T18:35:32.408085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.407720+0000","last_change":"2024-09-12T18:35:25.653999+0000","last_active":"2024-09-12T18:35:32.407720+0000","last_peered":"2024-09-12T18:35:32.407720+0000","last_clean":"2024-09-12T18:35:32.407720+0000","last_became_active":"2024-09-12T18:35:25.653319+0000","last_became_peered":"2024-09-12T18:35:25.653319+0000","last_unstale":"2024-09-12T18:35:32.407720+0000","last_undegraded":"2024-09-12T18:35:32.407720+0000","last_fullsized":"2024-09-12T18:35:32.407720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:04.718000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095705+0000","last_change":"2024-09-12T18:35:25.668339+0000","last_active":"2024-09-12T18:35:33.095705+0000","last_peered":"2024-09-12T18:35:33.095705+0000","last_clean":"2024-09-12T18:35:33.095705+0000","last_became_active":"2024-09-12T18:35:25.667608+0000","last_became_peered":"2024-09-12T18:35:25.667608+0000","last_unstale":"2024-09-12T18:35:33.095705+0000","last_undegraded":"2024-09-12T18:35:33.095705+0000","last_fullsized":"2024-09-12T18:35:33.095705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:15.699745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409709+0000","last_change":"2024-09-12T18:35:25.660174+0000","last_active":"2024-09-12T18:35:32.409709+0000","last_peered":"2024-09-12T18:35:32.409709+0000","last_clean":"2024-09-12T18:35:32.409709+0000","last_became_active":"2024-09-12T18:35:25.656560+0000","last_became_peered":"2024-09-12T18:35:25.656560+0000","last_unstale":"2024-09-12T18:35:32.409709+0000","last_undegraded":"2024-09-12T18:35:32.409709+0000","last_fullsized":"2024-09-12T18:35:32.409709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:47.268505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409405+0000","last_change":"2024-09-12T18:35:25.649858+0000","last_active":"2024-09-12T18:35:32.409405+0000","last_peered":"2024-09-12T18:35:32.409405+0000","last_clean":"2024-09-12T18:35:32.409405+0000","last_became_active":"2024-09-12T18:35:25.649090+0000","last_became_peered":"2024-09-12T18:35:25.649090+0000","last_unstale":"2024-09-12T18:35:32.409405+0000","last_undegraded":"2024-09-12T18:35:32.409405+0000","last_fullsized":"2024-09-12T18:35:32.409405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:33.158421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409039+0000","last_change":"2024-09-12T18:35:25.649885+0000","last_active":"2024-09-12T18:35:32.409039+0000","last_peered":"2024-09-12T18:35:32.409039+0000","last_clean":"2024-09-12T18:35:32.409039+0000","last_became_active":"2024-09-12T18:35:25.649111+0000","last_became_peered":"2024-09-12T18:35:25.649111+0000","last_unstale":"2024-09-12T18:35:32.409039+0000","last_undegraded":"2024-09-12T18:35:32.409039+0000","last_fullsized":"2024-09-12T18:35:32.409039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:17.162410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408499+0000","last_change":"2024-09-12T18:35:25.651541+0000","last_active":"2024-09-12T18:35:32.408499+0000","last_peered":"2024-09-12T18:35:32.408499+0000","last_clean":"2024-09-12T18:35:32.408499+0000","last_became_active":"2024-09-12T18:35:25.650661+0000","last_became_peered":"2024-09-12T18:35:25.650661+0000","last_unstale":"2024-09-12T18:35:32.408499+0000","last_undegraded":"2024-09-12T18:35:32.408499+0000","last_fullsized":"2024-09-12T18:35:32.408499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:52.082734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408701+0000","last_change":"2024-09-12T18:35:25.657913+0000","last_active":"2024-09-12T18:35:32.408701+0000","last_peered":"2024-09-12T18:35:32.408701+0000","last_clean":"2024-09-12T18:35:32.408701+0000","last_became_active":"2024-09-12T18:35:25.657082+0000","last_became_peered":"2024-09-12T18:35:25.657082+0000","last_unstale":"2024-09-12T18:35:32.408701+0000","last_undegraded":"2024-09-12T18:35:32.408701+0000","last_fullsized":"2024-09-12T18:35:32.408701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:21.538633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408174+0000","last_change":"2024-09-12T18:35:25.658763+0000","last_active":"2024-09-12T18:35:32.408174+0000","last_peered":"2024-09-12T18:35:32.408174+0000","last_clean":"2024-09-12T18:35:32.408174+0000","last_became_active":"2024-09-12T18:35:25.657508+0000","last_became_peered":"2024-09-12T18:35:25.657508+0000","last_unstale":"2024-09-12T18:35:32.408174+0000","last_undegraded":"2024-09-12T18:35:32.408174+0000","last_fullsized":"2024-09-12T18:35:32.408174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:13.170519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.407720+0000","last_change":"2024-09-12T18:35:25.653730+0000","last_active":"2024-09-12T18:35:32.407720+0000","last_peered":"2024-09-12T18:35:32.407720+0000","last_clean":"2024-09-12T18:35:32.407720+0000","last_became_active":"2024-09-12T18:35:25.651535+0000","last_became_peered":"2024-09-12T18:35:25.651535+0000","last_unstale":"2024-09-12T18:35:32.407720+0000","last_undegraded":"2024-09-12T18:35:32.407720+0000","last_fullsized":"2024-09-12T18:35:32.407720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.096263+0000","last_change":"2024-09-12T18:35:25.656513+0000","last_active":"2024-09-12T18:35:33.096263+0000","last_peered":"2024-09-12T18:35:33.096263+0000","last_clean":"2024-09-12T18:35:33.096263+0000","last_became_active":"2024-09-12T18:35:25.653440+0000","last_became_peered":"2024-09-12T18:35:25.653440+0000","last_unstale":"2024-09-12T18:35:33.096263+0000","last_undegraded":"2024-09-12T18:35:33.096263+0000","last_fullsized":"2024-09-12T18:35:33.096263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:18.693161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409944+0000","last_change":"2024-09-12T18:35:25.657991+0000","last_active":"2024-09-12T18:35:32.409944+0000","last_peered":"2024-09-12T18:35:32.409944+0000","last_clean":"2024-09-12T18:35:32.409944+0000","last_became_active":"2024-09-12T18:35:25.653934+0000","last_became_peered":"2024-09-12T18:35:25.653934+0000","last_unstale":"2024-09-12T18:35:32.409944+0000","last_undegraded":"2024-09-12T18:35:32.409944+0000","last_fullsized":"2024-09-12T18:35:32.409944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:05.418901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095481+0000","last_change":"2024-09-12T18:35:25.658819+0000","last_active":"2024-09-12T18:35:33.095481+0000","last_peered":"2024-09-12T18:35:33.095481+0000","last_clean":"2024-09-12T18:35:33.095481+0000","last_became_active":"2024-09-12T18:35:25.656843+0000","last_became_peered":"2024-09-12T18:35:25.656843+0000","last_unstale":"2024-09-12T18:35:33.095481+0000","last_undegraded":"2024-09-12T18:35:33.095481+0000","last_fullsized":"2024-09-12T18:35:33.095481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:55.291963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409642+0000","last_change":"2024-09-12T18:35:25.661176+0000","last_active":"2024-09-12T18:35:32.409642+0000","last_peered":"2024-09-12T18:35:32.409642+0000","last_clean":"2024-09-12T18:35:32.409642+0000","last_became_active":"2024-09-12T18:35:25.659534+0000","last_became_peered":"2024-09-12T18:35:25.659534+0000","last_unstale":"2024-09-12T18:35:32.409642+0000","last_undegraded":"2024-09-12T18:35:32.409642+0000","last_fullsized":"2024-09-12T18:35:32.409642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:40.145442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408508+0000","last_change":"2024-09-12T18:35:25.650632+0000","last_active":"2024-09-12T18:35:32.408508+0000","last_peered":"2024-09-12T18:35:32.408508+0000","last_clean":"2024-09-12T18:35:32.408508+0000","last_became_active":"2024-09-12T18:35:25.649333+0000","last_became_peered":"2024-09-12T18:35:25.649333+0000","last_unstale":"2024-09-12T18:35:32.408508+0000","last_undegraded":"2024-09-12T18:35:32.408508+0000","last_fullsized":"2024-09-12T18:35:32.408508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:30.537572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408378+0000","last_change":"2024-09-12T18:35:25.648245+0000","last_active":"2024-09-12T18:35:32.408378+0000","last_peered":"2024-09-12T18:35:32.408378+0000","last_clean":"2024-09-12T18:35:32.408378+0000","last_became_active":"2024-09-12T18:35:25.646357+0000","last_became_peered":"2024-09-12T18:35:25.646357+0000","last_unstale":"2024-09-12T18:35:32.408378+0000","last_undegraded":"2024-09-12T18:35:32.408378+0000","last_fullsized":"2024-09-12T18:35:32.408378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:05.662140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.094206+0000","last_change":"2024-09-12T18:35:25.661613+0000","last_active":"2024-09-12T18:35:33.094206+0000","last_peered":"2024-09-12T18:35:33.094206+0000","last_clean":"2024-09-12T18:35:33.094206+0000","last_became_active":"2024-09-12T18:35:25.658833+0000","last_became_peered":"2024-09-12T18:35:25.658833+0000","last_unstale":"2024-09-12T18:35:33.094206+0000","last_undegraded":"2024-09-12T18:35:33.094206+0000","last_fullsized":"2024-09-12T18:35:33.094206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:51.064080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.407827+0000","last_change":"2024-09-12T18:35:25.657782+0000","last_active":"2024-09-12T18:35:32.407827+0000","last_peered":"2024-09-12T18:35:32.407827+0000","last_clean":"2024-09-12T18:35:32.407827+0000","last_became_active":"2024-09-12T18:35:25.655295+0000","last_became_peered":"2024-09-12T18:35:25.655295+0000","last_unstale":"2024-09-12T18:35:32.407827+0000","last_undegraded":"2024-09-12T18:35:32.407827+0000","last_fullsized":"2024-09-12T18:35:32.407827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:37.744175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410219+0000","last_change":"2024-09-12T18:35:25.654863+0000","last_active":"2024-09-12T18:35:32.410219+0000","last_peered":"2024-09-12T18:35:32.410219+0000","last_clean":"2024-09-12T18:35:32.410219+0000","last_became_active":"2024-09-12T18:35:25.650407+0000","last_became_peered":"2024-09-12T18:35:25.650407+0000","last_unstale":"2024-09-12T18:35:32.410219+0000","last_undegraded":"2024-09-12T18:35:32.410219+0000","last_fullsized":"2024-09-12T18:35:32.410219+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:38.395666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095956+0000","last_change":"2024-09-12T18:35:25.662414+0000","last_active":"2024-09-12T18:35:33.095956+0000","last_peered":"2024-09-12T18:35:33.095956+0000","last_clean":"2024-09-12T18:35:33.095956+0000","last_became_active":"2024-09-12T18:35:25.660126+0000","last_became_peered":"2024-09-12T18:35:25.660126+0000","last_unstale":"2024-09-12T18:35:33.095956+0000","last_undegraded":"2024-09-12T18:35:33.095956+0000","last_fullsized":"2024-09-12T18:35:33.095956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:48.437139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409715+0000","last_change":"2024-09-12T18:35:25.661523+0000","last_active":"2024-09-12T18:35:32.409715+0000","last_peered":"2024-09-12T18:35:32.409715+0000","last_clean":"2024-09-12T18:35:32.409715+0000","last_became_active":"2024-09-12T18:35:25.659338+0000","last_became_peered":"2024-09-12T18:35:25.659338+0000","last_unstale":"2024-09-12T18:35:32.409715+0000","last_undegraded":"2024-09-12T18:35:32.409715+0000","last_fullsized":"2024-09-12T18:35:32.409715+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:37.083820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409590+0000","last_change":"2024-09-12T18:35:25.662445+0000","last_active":"2024-09-12T18:35:32.409590+0000","last_peered":"2024-09-12T18:35:32.409590+0000","last_clean":"2024-09-12T18:35:32.409590+0000","last_became_active":"2024-09-12T18:35:25.659496+0000","last_became_peered":"2024-09-12T18:35:25.659496+0000","last_unstale":"2024-09-12T18:35:32.409590+0000","last_undegraded":"2024-09-12T18:35:32.409590+0000","last_fullsized":"2024-09-12T18:35:32.409590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:03.270420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095459+0000","last_change":"2024-09-12T18:35:25.662519+0000","last_active":"2024-09-12T18:35:33.095459+0000","last_peered":"2024-09-12T18:35:33.095459+0000","last_clean":"2024-09-12T18:35:33.095459+0000","last_became_active":"2024-09-12T18:35:25.652964+0000","last_became_peered":"2024-09-12T18:35:25.652964+0000","last_unstale":"2024-09-12T18:35:33.095459+0000","last_undegraded":"2024-09-12T18:35:33.095459+0000","last_fullsized":"2024-09-12T18:35:33.095459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:37.923468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408671+0000","last_change":"2024-09-12T18:35:25.650507+0000","last_active":"2024-09-12T18:35:32.408671+0000","last_peered":"2024-09-12T18:35:32.408671+0000","last_clean":"2024-09-12T18:35:32.408671+0000","last_became_active":"2024-09-12T18:35:25.649415+0000","last_became_peered":"2024-09-12T18:35:25.649415+0000","last_unstale":"2024-09-12T18:35:32.408671+0000","last_undegraded":"2024-09-12T18:35:32.408671+0000","last_fullsized":"2024-09-12T18:35:32.408671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:23.081416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.094335+0000","last_change":"2024-09-12T18:35:25.653949+0000","last_active":"2024-09-12T18:35:33.094335+0000","last_peered":"2024-09-12T18:35:33.094335+0000","last_clean":"2024-09-12T18:35:33.094335+0000","last_became_active":"2024-09-12T18:35:25.652992+0000","last_became_peered":"2024-09-12T18:35:25.652992+0000","last_unstale":"2024-09-12T18:35:33.094335+0000","last_undegraded":"2024-09-12T18:35:33.094335+0000","last_fullsized":"2024-09-12T18:35:33.094335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:47.687372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.407991+0000","last_change":"2024-09-12T18:35:25.653159+0000","last_active":"2024-09-12T18:35:32.407991+0000","last_peered":"2024-09-12T18:35:32.407991+0000","last_clean":"2024-09-12T18:35:32.407991+0000","last_became_active":"2024-09-12T18:35:25.650551+0000","last_became_peered":"2024-09-12T18:35:25.650551+0000","last_unstale":"2024-09-12T18:35:32.407991+0000","last_undegraded":"2024-09-12T18:35:32.407991+0000","last_fullsized":"2024-09-12T18:35:32.407991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:16.245302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409338+0000","last_change":"2024-09-12T18:35:25.651877+0000","last_active":"2024-09-12T18:35:32.409338+0000","last_peered":"2024-09-12T18:35:32.409338+0000","last_clean":"2024-09-12T18:35:32.409338+0000","last_became_active":"2024-09-12T18:35:25.651055+0000","last_became_peered":"2024-09-12T18:35:25.651055+0000","last_unstale":"2024-09-12T18:35:32.409338+0000","last_undegraded":"2024-09-12T18:35:32.409338+0000","last_fullsized":"2024-09-12T18:35:32.409338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:14.200080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409200+0000","last_change":"2024-09-12T18:35:24.657739+0000","last_active":"2024-09-12T18:35:32.409200+0000","last_peered":"2024-09-12T18:35:32.409200+0000","last_clean":"2024-09-12T18:35:32.409200+0000","last_became_active":"2024-09-12T18:35:24.656208+0000","last_became_peered":"2024-09-12T18:35:24.656208+0000","last_unstale":"2024-09-12T18:35:32.409200+0000","last_undegraded":"2024-09-12T18:35:32.409200+0000","last_fullsized":"2024-09-12T18:35:32.409200+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:50.073716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409601+0000","last_change":"2024-09-12T18:35:25.651651+0000","last_active":"2024-09-12T18:35:32.409601+0000","last_peered":"2024-09-12T18:35:32.409601+0000","last_clean":"2024-09-12T18:35:32.409601+0000","last_became_active":"2024-09-12T18:35:25.650849+0000","last_became_peered":"2024-09-12T18:35:25.650849+0000","last_unstale":"2024-09-12T18:35:32.409601+0000","last_undegraded":"2024-09-12T18:35:32.409601+0000","last_fullsized":"2024-09-12T18:35:32.409601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:18.555827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.092714+0000","last_change":"2024-09-12T18:35:24.656119+0000","last_active":"2024-09-12T18:35:33.092714+0000","last_peered":"2024-09-12T18:35:33.092714+0000","last_clean":"2024-09-12T18:35:33.092714+0000","last_became_active":"2024-09-12T18:35:24.653175+0000","last_became_peered":"2024-09-12T18:35:24.653175+0000","last_unstale":"2024-09-12T18:35:33.092714+0000","last_undegraded":"2024-09-12T18:35:33.092714+0000","last_fullsized":"2024-09-12T18:35:33.092714+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:00.551165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.096293+0000","last_change":"2024-09-12T18:35:25.655723+0000","last_active":"2024-09-12T18:35:33.096293+0000","last_peered":"2024-09-12T18:35:33.096293+0000","last_clean":"2024-09-12T18:35:33.096293+0000","last_became_active":"2024-09-12T18:35:25.653630+0000","last_became_peered":"2024-09-12T18:35:25.653630+0000","last_unstale":"2024-09-12T18:35:33.096293+0000","last_undegraded":"2024-09-12T18:35:33.096293+0000","last_fullsized":"2024-09-12T18:35:33.096293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:07.655792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408416+0000","last_change":"2024-09-12T18:35:24.640096+0000","last_active":"2024-09-12T18:35:32.408416+0000","last_peered":"2024-09-12T18:35:32.408416+0000","last_clean":"2024-09-12T18:35:32.408416+0000","last_became_active":"2024-09-12T18:35:24.638230+0000","last_became_peered":"2024-09-12T18:35:24.638230+0000","last_unstale":"2024-09-12T18:35:32.408416+0000","last_undegraded":"2024-09-12T18:35:32.408416+0000","last_fullsized":"2024-09-12T18:35:32.408416+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:38.435296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095745+0000","last_change":"2024-09-12T18:35:25.662692+0000","last_active":"2024-09-12T18:35:33.095745+0000","last_peered":"2024-09-12T18:35:33.095745+0000","last_clean":"2024-09-12T18:35:33.095745+0000","last_became_active":"2024-09-12T18:35:25.661885+0000","last_became_peered":"2024-09-12T18:35:25.661885+0000","last_unstale":"2024-09-12T18:35:33.095745+0000","last_undegraded":"2024-09-12T18:35:33.095745+0000","last_fullsized":"2024-09-12T18:35:33.095745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:41.264425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408266+0000","last_change":"2024-09-12T18:35:24.653610+0000","last_active":"2024-09-12T18:35:32.408266+0000","last_peered":"2024-09-12T18:35:32.408266+0000","last_clean":"2024-09-12T18:35:32.408266+0000","last_became_active":"2024-09-12T18:35:24.652880+0000","last_became_peered":"2024-09-12T18:35:24.652880+0000","last_unstale":"2024-09-12T18:35:32.408266+0000","last_undegraded":"2024-09-12T18:35:32.408266+0000","last_fullsized":"2024-09-12T18:35:32.408266+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:57.636251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410248+0000","last_change":"2024-09-12T18:35:24.653465+0000","last_active":"2024-09-12T18:35:32.410248+0000","last_peered":"2024-09-12T18:35:32.410248+0000","last_clean":"2024-09-12T18:35:32.410248+0000","last_became_active":"2024-09-12T18:35:24.652792+0000","last_became_peered":"2024-09-12T18:35:24.652792+0000","last_unstale":"2024-09-12T18:35:32.410248+0000","last_undegraded":"2024-09-12T18:35:32.410248+0000","last_fullsized":"2024-09-12T18:35:32.410248+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:14.588993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.407906+0000","last_change":"2024-09-12T18:35:25.655426+0000","last_active":"2024-09-12T18:35:32.407906+0000","last_peered":"2024-09-12T18:35:32.407906+0000","last_clean":"2024-09-12T18:35:32.407906+0000","last_became_active":"2024-09-12T18:35:25.648186+0000","last_became_peered":"2024-09-12T18:35:25.648186+0000","last_unstale":"2024-09-12T18:35:32.407906+0000","last_undegraded":"2024-09-12T18:35:32.407906+0000","last_fullsized":"2024-09-12T18:35:32.407906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:48.802815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410238+0000","last_change":"2024-09-12T18:35:24.648439+0000","last_active":"2024-09-12T18:35:32.410238+0000","last_peered":"2024-09-12T18:35:32.410238+0000","last_clean":"2024-09-12T18:35:32.410238+0000","last_became_active":"2024-09-12T18:35:24.647629+0000","last_became_peered":"2024-09-12T18:35:24.647629+0000","last_unstale":"2024-09-12T18:35:32.410238+0000","last_undegraded":"2024-09-12T18:35:32.410238+0000","last_fullsized":"2024-09-12T18:35:32.410238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:45.428223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408106+0000","last_change":"2024-09-12T18:35:25.652496+0000","last_active":"2024-09-12T18:35:32.408106+0000","last_peered":"2024-09-12T18:35:32.408106+0000","last_clean":"2024-09-12T18:35:32.408106+0000","last_became_active":"2024-09-12T18:35:25.651628+0000","last_became_peered":"2024-09-12T18:35:25.651628+0000","last_unstale":"2024-09-12T18:35:32.408106+0000","last_undegraded":"2024-09-12T18:35:32.408106+0000","last_fullsized":"2024-09-12T18:35:32.408106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:44.920448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410714+0000","last_change":"2024-09-12T18:35:24.654976+0000","last_active":"2024-09-12T18:35:32.410714+0000","last_peered":"2024-09-12T18:35:32.410714+0000","last_clean":"2024-09-12T18:35:32.410714+0000","last_became_active":"2024-09-12T18:35:24.654264+0000","last_became_peered":"2024-09-12T18:35:24.654264+0000","last_unstale":"2024-09-12T18:35:32.410714+0000","last_undegraded":"2024-09-12T18:35:32.410714+0000","last_fullsized":"2024-09-12T18:35:32.410714+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:00.115408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408935+0000","last_change":"2024-09-12T18:35:25.650577+0000","last_active":"2024-09-12T18:35:32.408935+0000","last_peered":"2024-09-12T18:35:32.408935+0000","last_clean":"2024-09-12T18:35:32.408935+0000","last_became_active":"2024-09-12T18:35:25.649172+0000","last_became_peered":"2024-09-12T18:35:25.649172+0000","last_unstale":"2024-09-12T18:35:32.408935+0000","last_undegraded":"2024-09-12T18:35:32.408935+0000","last_fullsized":"2024-09-12T18:35:32.408935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:55.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410258+0000","last_change":"2024-09-12T18:35:24.657665+0000","last_active":"2024-09-12T18:35:32.410258+0000","last_peered":"2024-09-12T18:35:32.410258+0000","last_clean":"2024-09-12T18:35:32.410258+0000","last_became_active":"2024-09-12T18:35:24.657015+0000","last_became_peered":"2024-09-12T18:35:24.657015+0000","last_unstale":"2024-09-12T18:35:32.410258+0000","last_undegraded":"2024-09-12T18:35:32.410258+0000","last_fullsized":"2024-09-12T18:35:32.410258+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:03.171326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095182+0000","last_change":"2024-09-12T18:35:25.665275+0000","last_active":"2024-09-12T18:35:33.095182+0000","last_peered":"2024-09-12T18:35:33.095182+0000","last_clean":"2024-09-12T18:35:33.095182+0000","last_became_active":"2024-09-12T18:35:25.659511+0000","last_became_peered":"2024-09-12T18:35:25.659511+0000","last_unstale":"2024-09-12T18:35:33.095182+0000","last_undegraded":"2024-09-12T18:35:33.095182+0000","last_fullsized":"2024-09-12T18:35:33.095182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.093733+0000","last_change":"2024-09-12T18:35:24.651913+0000","last_active":"2024-09-12T18:35:33.093733+0000","last_peered":"2024-09-12T18:35:33.093733+0000","last_clean":"2024-09-12T18:35:33.093733+0000","last_became_active":"2024-09-12T18:35:24.650421+0000","last_became_peered":"2024-09-12T18:35:24.650421+0000","last_unstale":"2024-09-12T18:35:33.093733+0000","last_undegraded":"2024-09-12T18:35:33.093733+0000","last_fullsized":"2024-09-12T18:35:33.093733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:57.685312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409119+0000","last_change":"2024-09-12T18:35:25.651138+0000","last_active":"2024-09-12T18:35:32.409119+0000","last_peered":"2024-09-12T18:35:32.409119+0000","last_clean":"2024-09-12T18:35:32.409119+0000","last_became_active":"2024-09-12T18:35:25.650617+0000","last_became_peered":"2024-09-12T18:35:25.650617+0000","last_unstale":"2024-09-12T18:35:32.409119+0000","last_undegraded":"2024-09-12T18:35:32.409119+0000","last_fullsized":"2024-09-12T18:35:32.409119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:58.535066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410319+0000","last_change":"2024-09-12T18:35:24.659019+0000","last_active":"2024-09-12T18:35:32.410319+0000","last_peered":"2024-09-12T18:35:32.410319+0000","last_clean":"2024-09-12T18:35:32.410319+0000","last_became_active":"2024-09-12T18:35:24.658423+0000","last_became_peered":"2024-09-12T18:35:24.658423+0000","last_unstale":"2024-09-12T18:35:32.410319+0000","last_undegraded":"2024-09-12T18:35:32.410319+0000","last_fullsized":"2024-09-12T18:35:32.410319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:37.668417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410270+0000","last_change":"2024-09-12T18:35:25.662287+0000","last_active":"2024-09-12T18:35:32.410270+0000","last_peered":"2024-09-12T18:35:32.410270+0000","last_clean":"2024-09-12T18:35:32.410270+0000","last_became_active":"2024-09-12T18:35:25.660372+0000","last_became_peered":"2024-09-12T18:35:25.660372+0000","last_unstale":"2024-09-12T18:35:32.410270+0000","last_undegraded":"2024-09-12T18:35:32.410270+0000","last_fullsized":"2024-09-12T18:35:32.410270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:08.729541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409339+0000","last_change":"2024-09-12T18:35:24.648330+0000","last_active":"2024-09-12T18:35:32.409339+0000","last_peered":"2024-09-12T18:35:32.409339+0000","last_clean":"2024-09-12T18:35:32.409339+0000","last_became_active":"2024-09-12T18:35:24.647520+0000","last_became_peered":"2024-09-12T18:35:24.647520+0000","last_unstale":"2024-09-12T18:35:32.409339+0000","last_undegraded":"2024-09-12T18:35:32.409339+0000","last_fullsized":"2024-09-12T18:35:32.409339+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:25.552055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409423+0000","last_change":"2024-09-12T18:35:25.658674+0000","last_active":"2024-09-12T18:35:32.409423+0000","last_peered":"2024-09-12T18:35:32.409423+0000","last_clean":"2024-09-12T18:35:32.409423+0000","last_became_active":"2024-09-12T18:35:25.657386+0000","last_became_peered":"2024-09-12T18:35:25.657386+0000","last_unstale":"2024-09-12T18:35:32.409423+0000","last_undegraded":"2024-09-12T18:35:32.409423+0000","last_fullsized":"2024-09-12T18:35:32.409423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:48.037086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408029+0000","last_change":"2024-09-12T18:35:24.646810+0000","last_active":"2024-09-12T18:35:32.408029+0000","last_peered":"2024-09-12T18:35:32.408029+0000","last_clean":"2024-09-12T18:35:32.408029+0000","last_became_active":"2024-09-12T18:35:24.646008+0000","last_became_peered":"2024-09-12T18:35:24.646008+0000","last_unstale":"2024-09-12T18:35:32.408029+0000","last_undegraded":"2024-09-12T18:35:32.408029+0000","last_fullsized":"2024-09-12T18:35:32.408029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:43.888776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095907+0000","last_change":"2024-09-12T18:35:25.667710+0000","last_active":"2024-09-12T18:35:33.095907+0000","last_peered":"2024-09-12T18:35:33.095907+0000","last_clean":"2024-09-12T18:35:33.095907+0000","last_became_active":"2024-09-12T18:35:25.666940+0000","last_became_peered":"2024-09-12T18:35:25.666940+0000","last_unstale":"2024-09-12T18:35:33.095907+0000","last_undegraded":"2024-09-12T18:35:33.095907+0000","last_fullsized":"2024-09-12T18:35:33.095907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:09.823085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":167,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409297+0000","last_change":"2024-09-12T18:35:13.489018+0000","last_active":"2024-09-12T18:35:32.409297+0000","last_peered":"2024-09-12T18:35:32.409297+0000","last_clean":"2024-09-12T18:35:32.409297+0000","last_became_active":"2024-09-12T18:35:13.488346+0000","last_became_peered":"2024-09-12T18:35:13.488346+0000","last_unstale":"2024-09-12T18:35:32.409297+0000","last_undegraded":"2024-09-12T18:35:32.409297+0000","last_fullsized":"2024-09-12T18:35:32.409297+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_clean_scrub_stamp":"2024-09-12T18:35:12.464628+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:54.864640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410021+0000","last_change":"2024-09-12T18:35:22.459694+0000","last_active":"2024-09-12T18:35:32.410021+0000","last_peered":"2024-09-12T18:35:32.410021+0000","last_clean":"2024-09-12T18:35:32.410021+0000","last_became_active":"2024-09-12T18:35:20.446796+0000","last_became_peered":"2024-09-12T18:35:20.446796+0000","last_unstale":"2024-09-12T18:35:32.410021+0000","last_undegraded":"2024-09-12T18:35:32.410021+0000","last_fullsized":"2024-09-12T18:35:32.410021+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:21.506024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016291610000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.092256+0000","last_change":"2024-09-12T18:35:24.651749+0000","last_active":"2024-09-12T18:35:33.092256+0000","last_peered":"2024-09-12T18:35:33.092256+0000","last_clean":"2024-09-12T18:35:33.092256+0000","last_became_active":"2024-09-12T18:35:24.649860+0000","last_became_peered":"2024-09-12T18:35:24.649860+0000","last_unstale":"2024-09-12T18:35:33.092256+0000","last_undegraded":"2024-09-12T18:35:33.092256+0000","last_fullsized":"2024-09-12T18:35:33.092256+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:35.430065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410595+0000","last_change":"2024-09-12T18:35:25.662424+0000","last_active":"2024-09-12T18:35:32.410595+0000","last_peered":"2024-09-12T18:35:32.410595+0000","last_clean":"2024-09-12T18:35:32.410595+0000","last_became_active":"2024-09-12T18:35:25.661043+0000","last_became_peered":"2024-09-12T18:35:25.661043+0000","last_unstale":"2024-09-12T18:35:32.410595+0000","last_undegraded":"2024-09-12T18:35:32.410595+0000","last_fullsized":"2024-09-12T18:35:32.410595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:52.551802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408682+0000","last_change":"2024-09-12T18:35:22.459090+0000","last_active":"2024-09-12T18:35:32.408682+0000","last_peered":"2024-09-12T18:35:32.408682+0000","last_clean":"2024-09-12T18:35:32.408682+0000","last_became_active":"2024-09-12T18:35:20.448553+0000","last_became_peered":"2024-09-12T18:35:20.448553+0000","last_unstale":"2024-09-12T18:35:32.408682+0000","last_undegraded":"2024-09-12T18:35:32.408682+0000","last_fullsized":"2024-09-12T18:35:32.408682+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:56.834808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001030836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.092165+0000","last_change":"2024-09-12T18:35:24.651597+0000","last_active":"2024-09-12T18:35:33.092165+0000","last_peered":"2024-09-12T18:35:33.092165+0000","last_clean":"2024-09-12T18:35:33.092165+0000","last_became_active":"2024-09-12T18:35:24.649940+0000","last_became_peered":"2024-09-12T18:35:24.649940+0000","last_unstale":"2024-09-12T18:35:33.092165+0000","last_undegraded":"2024-09-12T18:35:33.092165+0000","last_fullsized":"2024-09-12T18:35:33.092165+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:36.822432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410101+0000","last_change":"2024-09-12T18:35:25.660529+0000","last_active":"2024-09-12T18:35:32.410101+0000","last_peered":"2024-09-12T18:35:32.410101+0000","last_clean":"2024-09-12T18:35:32.410101+0000","last_became_active":"2024-09-12T18:35:25.659537+0000","last_became_peered":"2024-09-12T18:35:25.659537+0000","last_unstale":"2024-09-12T18:35:32.410101+0000","last_undegraded":"2024-09-12T18:35:32.410101+0000","last_fullsized":"2024-09-12T18:35:32.410101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:51.790349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095003+0000","last_change":"2024-09-12T18:35:22.464179+0000","last_active":"2024-09-12T18:35:33.095003+0000","last_peered":"2024-09-12T18:35:33.095003+0000","last_clean":"2024-09-12T18:35:33.095003+0000","last_became_active":"2024-09-12T18:35:20.442613+0000","last_became_peered":"2024-09-12T18:35:20.442613+0000","last_unstale":"2024-09-12T18:35:33.095003+0000","last_undegraded":"2024-09-12T18:35:33.095003+0000","last_fullsized":"2024-09-12T18:35:33.095003+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:17.636537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014134620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408165+0000","last_change":"2024-09-12T18:35:24.641297+0000","last_active":"2024-09-12T18:35:32.408165+0000","last_peered":"2024-09-12T18:35:32.408165+0000","last_clean":"2024-09-12T18:35:32.408165+0000","last_became_active":"2024-09-12T18:35:24.637334+0000","last_became_peered":"2024-09-12T18:35:24.637334+0000","last_unstale":"2024-09-12T18:35:32.408165+0000","last_undegraded":"2024-09-12T18:35:32.408165+0000","last_fullsized":"2024-09-12T18:35:32.408165+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:50.772074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095958+0000","last_change":"2024-09-12T18:35:25.659209+0000","last_active":"2024-09-12T18:35:33.095958+0000","last_peered":"2024-09-12T18:35:33.095958+0000","last_clean":"2024-09-12T18:35:33.095958+0000","last_became_active":"2024-09-12T18:35:25.656170+0000","last_became_peered":"2024-09-12T18:35:25.656170+0000","last_unstale":"2024-09-12T18:35:33.095958+0000","last_undegraded":"2024-09-12T18:35:33.095958+0000","last_fullsized":"2024-09-12T18:35:33.095958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:40.925757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":32,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410589+0000","last_change":"2024-09-12T18:35:22.459049+0000","last_active":"2024-09-12T18:35:32.410589+0000","last_peered":"2024-09-12T18:35:32.410589+0000","last_clean":"2024-09-12T18:35:32.410589+0000","last_became_active":"2024-09-12T18:35:20.446814+0000","last_became_peered":"2024-09-12T18:35:20.446814+0000","last_unstale":"2024-09-12T18:35:32.410589+0000","last_undegraded":"2024-09-12T18:35:32.410589+0000","last_fullsized":"2024-09-12T18:35:32.410589+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:18.033595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010716149999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409453+0000","last_change":"2024-09-12T18:35:24.658273+0000","last_active":"2024-09-12T18:35:32.409453+0000","last_peered":"2024-09-12T18:35:32.409453+0000","last_clean":"2024-09-12T18:35:32.409453+0000","last_became_active":"2024-09-12T18:35:24.657433+0000","last_became_peered":"2024-09-12T18:35:24.657433+0000","last_unstale":"2024-09-12T18:35:32.409453+0000","last_undegraded":"2024-09-12T18:35:32.409453+0000","last_fullsized":"2024-09-12T18:35:32.409453+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:48.497218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095434+0000","last_change":"2024-09-12T18:35:25.655830+0000","last_active":"2024-09-12T18:35:33.095434+0000","last_peered":"2024-09-12T18:35:33.095434+0000","last_clean":"2024-09-12T18:35:33.095434+0000","last_became_active":"2024-09-12T18:35:25.652126+0000","last_became_peered":"2024-09-12T18:35:25.652126+0000","last_unstale":"2024-09-12T18:35:33.095434+0000","last_undegraded":"2024-09-12T18:35:33.095434+0000","last_fullsized":"2024-09-12T18:35:33.095434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:04.080721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410902+0000","last_change":"2024-09-12T18:35:24.657618+0000","last_active":"2024-09-12T18:35:32.410902+0000","last_peered":"2024-09-12T18:35:32.410902+0000","last_clean":"2024-09-12T18:35:32.410902+0000","last_became_active":"2024-09-12T18:35:24.656741+0000","last_became_peered":"2024-09-12T18:35:24.656741+0000","last_unstale":"2024-09-12T18:35:32.410902+0000","last_undegraded":"2024-09-12T18:35:32.410902+0000","last_fullsized":"2024-09-12T18:35:32.410902+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:43.113104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095849+0000","last_change":"2024-09-12T18:35:22.464180+0000","last_active":"2024-09-12T18:35:33.095849+0000","last_peered":"2024-09-12T18:35:33.095849+0000","last_clean":"2024-09-12T18:35:33.095849+0000","last_became_active":"2024-09-12T18:35:20.442566+0000","last_became_peered":"2024-09-12T18:35:20.442566+0000","last_unstale":"2024-09-12T18:35:33.095849+0000","last_undegraded":"2024-09-12T18:35:33.095849+0000","last_fullsized":"2024-09-12T18:35:33.095849+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:29.021710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001325786,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408521+0000","last_change":"2024-09-12T18:35:25.650458+0000","last_active":"2024-09-12T18:35:32.408521+0000","last_peered":"2024-09-12T18:35:32.408521+0000","last_clean":"2024-09-12T18:35:32.408521+0000","last_became_active":"2024-09-12T18:35:25.648761+0000","last_became_peered":"2024-09-12T18:35:25.648761+0000","last_unstale":"2024-09-12T18:35:32.408521+0000","last_undegraded":"2024-09-12T18:35:32.408521+0000","last_fullsized":"2024-09-12T18:35:32.408521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:53.026950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.092506+0000","last_change":"2024-09-12T18:35:24.649669+0000","last_active":"2024-09-12T18:35:33.092506+0000","last_peered":"2024-09-12T18:35:33.092506+0000","last_clean":"2024-09-12T18:35:33.092506+0000","last_became_active":"2024-09-12T18:35:24.648881+0000","last_became_peered":"2024-09-12T18:35:24.648881+0000","last_unstale":"2024-09-12T18:35:33.092506+0000","last_undegraded":"2024-09-12T18:35:33.092506+0000","last_fullsized":"2024-09-12T18:35:33.092506+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:23.614734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410493+0000","last_change":"2024-09-12T18:35:22.458666+0000","last_active":"2024-09-12T18:35:32.410493+0000","last_peered":"2024-09-12T18:35:32.410493+0000","last_clean":"2024-09-12T18:35:32.410493+0000","last_became_active":"2024-09-12T18:35:20.442394+0000","last_became_peered":"2024-09-12T18:35:20.442394+0000","last_unstale":"2024-09-12T18:35:32.410493+0000","last_undegraded":"2024-09-12T18:35:32.410493+0000","last_fullsized":"2024-09-12T18:35:32.410493+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:51.840246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080163599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408846+0000","last_change":"2024-09-12T18:35:25.650717+0000","last_active":"2024-09-12T18:35:32.408846+0000","last_peered":"2024-09-12T18:35:32.408846+0000","last_clean":"2024-09-12T18:35:32.408846+0000","last_became_active":"2024-09-12T18:35:25.649147+0000","last_became_peered":"2024-09-12T18:35:25.649147+0000","last_unstale":"2024-09-12T18:35:32.408846+0000","last_undegraded":"2024-09-12T18:35:32.408846+0000","last_fullsized":"2024-09-12T18:35:32.408846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:07.365888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.093028+0000","last_change":"2024-09-12T18:35:24.657234+0000","last_active":"2024-09-12T18:35:33.093028+0000","last_peered":"2024-09-12T18:35:33.093028+0000","last_clean":"2024-09-12T18:35:33.093028+0000","last_became_active":"2024-09-12T18:35:24.655950+0000","last_became_peered":"2024-09-12T18:35:24.655950+0000","last_unstale":"2024-09-12T18:35:33.093028+0000","last_undegraded":"2024-09-12T18:35:33.093028+0000","last_fullsized":"2024-09-12T18:35:33.093028+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:17.466623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.096388+0000","last_change":"2024-09-12T18:35:22.464656+0000","last_active":"2024-09-12T18:35:33.096388+0000","last_peered":"2024-09-12T18:35:33.096388+0000","last_clean":"2024-09-12T18:35:33.096388+0000","last_became_active":"2024-09-12T18:35:20.445470+0000","last_became_peered":"2024-09-12T18:35:20.445470+0000","last_unstale":"2024-09-12T18:35:33.096388+0000","last_undegraded":"2024-09-12T18:35:33.096388+0000","last_fullsized":"2024-09-12T18:35:33.096388+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:58.947359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001742681,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.094350+0000","last_change":"2024-09-12T18:35:25.658887+0000","last_active":"2024-09-12T18:35:33.094350+0000","last_peered":"2024-09-12T18:35:33.094350+0000","last_clean":"2024-09-12T18:35:33.094350+0000","last_became_active":"2024-09-12T18:35:25.656829+0000","last_became_peered":"2024-09-12T18:35:25.656829+0000","last_unstale":"2024-09-12T18:35:33.094350+0000","last_undegraded":"2024-09-12T18:35:33.094350+0000","last_fullsized":"2024-09-12T18:35:33.094350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:50.109858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.092649+0000","last_change":"2024-09-12T18:35:24.654518+0000","last_active":"2024-09-12T18:35:33.092649+0000","last_peered":"2024-09-12T18:35:33.092649+0000","last_clean":"2024-09-12T18:35:33.092649+0000","last_became_active":"2024-09-12T18:35:24.650309+0000","last_became_peered":"2024-09-12T18:35:24.650309+0000","last_unstale":"2024-09-12T18:35:33.092649+0000","last_undegraded":"2024-09-12T18:35:33.092649+0000","last_fullsized":"2024-09-12T18:35:33.092649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:16.669035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410632+0000","last_change":"2024-09-12T18:35:22.459767+0000","last_active":"2024-09-12T18:35:32.410632+0000","last_peered":"2024-09-12T18:35:32.410632+0000","last_clean":"2024-09-12T18:35:32.410632+0000","last_became_active":"2024-09-12T18:35:20.448521+0000","last_became_peered":"2024-09-12T18:35:20.448521+0000","last_unstale":"2024-09-12T18:35:32.410632+0000","last_undegraded":"2024-09-12T18:35:32.410632+0000","last_fullsized":"2024-09-12T18:35:32.410632+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:33.463792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017009670000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408128+0000","last_change":"2024-09-12T18:35:25.648150+0000","last_active":"2024-09-12T18:35:32.408128+0000","last_peered":"2024-09-12T18:35:32.408128+0000","last_clean":"2024-09-12T18:35:32.408128+0000","last_became_active":"2024-09-12T18:35:25.647347+0000","last_became_peered":"2024-09-12T18:35:25.647347+0000","last_unstale":"2024-09-12T18:35:32.408128+0000","last_undegraded":"2024-09-12T18:35:32.408128+0000","last_fullsized":"2024-09-12T18:35:32.408128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:48.968336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408750+0000","last_change":"2024-09-12T18:35:25.660696+0000","last_active":"2024-09-12T18:35:32.408750+0000","last_peered":"2024-09-12T18:35:32.408750+0000","last_clean":"2024-09-12T18:35:32.408750+0000","last_became_active":"2024-09-12T18:35:25.659827+0000","last_became_peered":"2024-09-12T18:35:25.659827+0000","last_unstale":"2024-09-12T18:35:32.408750+0000","last_undegraded":"2024-09-12T18:35:32.408750+0000","last_fullsized":"2024-09-12T18:35:32.408750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:15.678289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":23,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409994+0000","last_change":"2024-09-12T18:35:24.655051+0000","last_active":"2024-09-12T18:35:32.409994+0000","last_peered":"2024-09-12T18:35:32.409994+0000","last_clean":"2024-09-12T18:35:32.409994+0000","last_became_active":"2024-09-12T18:35:24.654282+0000","last_became_peered":"2024-09-12T18:35:24.654282+0000","last_unstale":"2024-09-12T18:35:32.409994+0000","last_undegraded":"2024-09-12T18:35:32.409994+0000","last_fullsized":"2024-09-12T18:35:32.409994+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:08.159799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.094530+0000","last_change":"2024-09-12T18:35:25.659237+0000","last_active":"2024-09-12T18:35:33.094530+0000","last_peered":"2024-09-12T18:35:33.094530+0000","last_clean":"2024-09-12T18:35:33.094530+0000","last_became_active":"2024-09-12T18:35:25.658423+0000","last_became_peered":"2024-09-12T18:35:25.658423+0000","last_unstale":"2024-09-12T18:35:33.094530+0000","last_undegraded":"2024-09-12T18:35:33.094530+0000","last_fullsized":"2024-09-12T18:35:33.094530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:42.956934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410294+0000","last_change":"2024-09-12T18:35:24.648658+0000","last_active":"2024-09-12T18:35:32.410294+0000","last_peered":"2024-09-12T18:35:32.410294+0000","last_clean":"2024-09-12T18:35:32.410294+0000","last_became_active":"2024-09-12T18:35:24.647826+0000","last_became_peered":"2024-09-12T18:35:24.647826+0000","last_unstale":"2024-09-12T18:35:32.410294+0000","last_undegraded":"2024-09-12T18:35:32.410294+0000","last_fullsized":"2024-09-12T18:35:32.410294+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:24.167549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410026+0000","last_change":"2024-09-12T18:35:24.656855+0000","last_active":"2024-09-12T18:35:32.410026+0000","last_peered":"2024-09-12T18:35:32.410026+0000","last_clean":"2024-09-12T18:35:32.410026+0000","last_became_active":"2024-09-12T18:35:24.655935+0000","last_became_peered":"2024-09-12T18:35:24.655935+0000","last_unstale":"2024-09-12T18:35:32.410026+0000","last_undegraded":"2024-09-12T18:35:32.410026+0000","last_fullsized":"2024-09-12T18:35:32.410026+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:35.430065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.094515+0000","last_change":"2024-09-12T18:35:25.661801+0000","last_active":"2024-09-12T18:35:33.094515+0000","last_peered":"2024-09-12T18:35:33.094515+0000","last_clean":"2024-09-12T18:35:33.094515+0000","last_became_active":"2024-09-12T18:35:25.658476+0000","last_became_peered":"2024-09-12T18:35:25.658476+0000","last_unstale":"2024-09-12T18:35:33.094515+0000","last_undegraded":"2024-09-12T18:35:33.094515+0000","last_fullsized":"2024-09-12T18:35:33.094515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:58.246449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.092953+0000","last_change":"2024-09-12T18:35:24.652399+0000","last_active":"2024-09-12T18:35:33.092953+0000","last_peered":"2024-09-12T18:35:33.092953+0000","last_clean":"2024-09-12T18:35:33.092953+0000","last_became_active":"2024-09-12T18:35:24.651416+0000","last_became_peered":"2024-09-12T18:35:24.651416+0000","last_unstale":"2024-09-12T18:35:33.092953+0000","last_undegraded":"2024-09-12T18:35:33.092953+0000","last_fullsized":"2024-09-12T18:35:33.092953+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:32.594978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.094275+0000","last_change":"2024-09-12T18:35:25.658570+0000","last_active":"2024-09-12T18:35:33.094275+0000","last_peered":"2024-09-12T18:35:33.094275+0000","last_clean":"2024-09-12T18:35:33.094275+0000","last_became_active":"2024-09-12T18:35:25.656561+0000","last_became_peered":"2024-09-12T18:35:25.656561+0000","last_unstale":"2024-09-12T18:35:33.094275+0000","last_undegraded":"2024-09-12T18:35:33.094275+0000","last_fullsized":"2024-09-12T18:35:33.094275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:22.225756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410369+0000","last_change":"2024-09-12T18:35:25.651217+0000","last_active":"2024-09-12T18:35:32.410369+0000","last_peered":"2024-09-12T18:35:32.410369+0000","last_clean":"2024-09-12T18:35:32.410369+0000","last_became_active":"2024-09-12T18:35:25.649544+0000","last_became_peered":"2024-09-12T18:35:25.649544+0000","last_unstale":"2024-09-12T18:35:32.410369+0000","last_undegraded":"2024-09-12T18:35:32.410369+0000","last_fullsized":"2024-09-12T18:35:32.410369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:41.601376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.093421+0000","last_change":"2024-09-12T18:35:24.657489+0000","last_active":"2024-09-12T18:35:33.093421+0000","last_peered":"2024-09-12T18:35:33.093421+0000","last_clean":"2024-09-12T18:35:33.093421+0000","last_became_active":"2024-09-12T18:35:24.656030+0000","last_became_peered":"2024-09-12T18:35:24.656030+0000","last_unstale":"2024-09-12T18:35:33.093421+0000","last_undegraded":"2024-09-12T18:35:33.093421+0000","last_fullsized":"2024-09-12T18:35:33.093421+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:11.362759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095761+0000","last_change":"2024-09-12T18:35:25.661544+0000","last_active":"2024-09-12T18:35:33.095761+0000","last_peered":"2024-09-12T18:35:33.095761+0000","last_clean":"2024-09-12T18:35:33.095761+0000","last_became_active":"2024-09-12T18:35:25.656985+0000","last_became_peered":"2024-09-12T18:35:25.656985+0000","last_unstale":"2024-09-12T18:35:33.095761+0000","last_undegraded":"2024-09-12T18:35:33.095761+0000","last_fullsized":"2024-09-12T18:35:33.095761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.092175+0000","last_change":"2024-09-12T18:35:24.646342+0000","last_active":"2024-09-12T18:35:33.092175+0000","last_peered":"2024-09-12T18:35:33.092175+0000","last_clean":"2024-09-12T18:35:33.092175+0000","last_became_active":"2024-09-12T18:35:24.644773+0000","last_became_peered":"2024-09-12T18:35:24.644773+0000","last_unstale":"2024-09-12T18:35:33.092175+0000","last_undegraded":"2024-09-12T18:35:33.092175+0000","last_fullsized":"2024-09-12T18:35:33.092175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:17.011231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409241+0000","last_change":"2024-09-12T18:35:25.656712+0000","last_active":"2024-09-12T18:35:32.409241+0000","last_peered":"2024-09-12T18:35:32.409241+0000","last_clean":"2024-09-12T18:35:32.409241+0000","last_became_active":"2024-09-12T18:35:25.654473+0000","last_became_peered":"2024-09-12T18:35:25.654473+0000","last_unstale":"2024-09-12T18:35:32.409241+0000","last_undegraded":"2024-09-12T18:35:32.409241+0000","last_fullsized":"2024-09-12T18:35:32.409241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:01.464680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408790+0000","last_change":"2024-09-12T18:35:24.659935+0000","last_active":"2024-09-12T18:35:32.408790+0000","last_peered":"2024-09-12T18:35:32.408790+0000","last_clean":"2024-09-12T18:35:32.408790+0000","last_became_active":"2024-09-12T18:35:24.659111+0000","last_became_peered":"2024-09-12T18:35:24.659111+0000","last_unstale":"2024-09-12T18:35:32.408790+0000","last_undegraded":"2024-09-12T18:35:32.408790+0000","last_fullsized":"2024-09-12T18:35:32.408790+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:11.480154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409283+0000","last_change":"2024-09-12T18:35:25.660557+0000","last_active":"2024-09-12T18:35:32.409283+0000","last_peered":"2024-09-12T18:35:32.409283+0000","last_clean":"2024-09-12T18:35:32.409283+0000","last_became_active":"2024-09-12T18:35:25.652300+0000","last_became_peered":"2024-09-12T18:35:25.652300+0000","last_unstale":"2024-09-12T18:35:32.409283+0000","last_undegraded":"2024-09-12T18:35:32.409283+0000","last_fullsized":"2024-09-12T18:35:32.409283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:10:59.995841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409107+0000","last_change":"2024-09-12T18:35:24.638538+0000","last_active":"2024-09-12T18:35:32.409107+0000","last_peered":"2024-09-12T18:35:32.409107+0000","last_clean":"2024-09-12T18:35:32.409107+0000","last_became_active":"2024-09-12T18:35:24.637242+0000","last_became_peered":"2024-09-12T18:35:24.637242+0000","last_unstale":"2024-09-12T18:35:32.409107+0000","last_undegraded":"2024-09-12T18:35:32.409107+0000","last_fullsized":"2024-09-12T18:35:32.409107+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:26.877441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408680+0000","last_change":"2024-09-12T18:35:25.662537+0000","last_active":"2024-09-12T18:35:32.408680+0000","last_peered":"2024-09-12T18:35:32.408680+0000","last_clean":"2024-09-12T18:35:32.408680+0000","last_became_active":"2024-09-12T18:35:25.661441+0000","last_became_peered":"2024-09-12T18:35:25.661441+0000","last_unstale":"2024-09-12T18:35:32.408680+0000","last_undegraded":"2024-09-12T18:35:32.408680+0000","last_fullsized":"2024-09-12T18:35:32.408680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:14.397867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409631+0000","last_change":"2024-09-12T18:35:24.657635+0000","last_active":"2024-09-12T18:35:32.409631+0000","last_peered":"2024-09-12T18:35:32.409631+0000","last_clean":"2024-09-12T18:35:32.409631+0000","last_became_active":"2024-09-12T18:35:24.655992+0000","last_became_peered":"2024-09-12T18:35:24.655992+0000","last_unstale":"2024-09-12T18:35:32.409631+0000","last_undegraded":"2024-09-12T18:35:32.409631+0000","last_fullsized":"2024-09-12T18:35:32.409631+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:33.536755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409233+0000","last_change":"2024-09-12T18:35:25.651406+0000","last_active":"2024-09-12T18:35:32.409233+0000","last_peered":"2024-09-12T18:35:32.409233+0000","last_clean":"2024-09-12T18:35:32.409233+0000","last_became_active":"2024-09-12T18:35:25.649728+0000","last_became_peered":"2024-09-12T18:35:25.649728+0000","last_unstale":"2024-09-12T18:35:32.409233+0000","last_undegraded":"2024-09-12T18:35:32.409233+0000","last_fullsized":"2024-09-12T18:35:32.409233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:41.773283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409723+0000","last_change":"2024-09-12T18:35:24.649153+0000","last_active":"2024-09-12T18:35:32.409723+0000","last_peered":"2024-09-12T18:35:32.409723+0000","last_clean":"2024-09-12T18:35:32.409723+0000","last_became_active":"2024-09-12T18:35:24.648512+0000","last_became_peered":"2024-09-12T18:35:24.648512+0000","last_unstale":"2024-09-12T18:35:32.409723+0000","last_undegraded":"2024-09-12T18:35:32.409723+0000","last_fullsized":"2024-09-12T18:35:32.409723+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:07.810456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409441+0000","last_change":"2024-09-12T18:35:25.656799+0000","last_active":"2024-09-12T18:35:32.409441+0000","last_peered":"2024-09-12T18:35:32.409441+0000","last_clean":"2024-09-12T18:35:32.409441+0000","last_became_active":"2024-09-12T18:35:25.654980+0000","last_became_peered":"2024-09-12T18:35:25.654980+0000","last_unstale":"2024-09-12T18:35:32.409441+0000","last_undegraded":"2024-09-12T18:35:32.409441+0000","last_fullsized":"2024-09-12T18:35:32.409441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:10.735439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.092729+0000","last_change":"2024-09-12T18:35:24.656268+0000","last_active":"2024-09-12T18:35:33.092729+0000","last_peered":"2024-09-12T18:35:33.092729+0000","last_clean":"2024-09-12T18:35:33.092729+0000","last_became_active":"2024-09-12T18:35:24.655420+0000","last_became_peered":"2024-09-12T18:35:24.655420+0000","last_unstale":"2024-09-12T18:35:33.092729+0000","last_undegraded":"2024-09-12T18:35:33.092729+0000","last_fullsized":"2024-09-12T18:35:33.092729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:04.654666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408359+0000","last_change":"2024-09-12T18:35:25.661042+0000","last_active":"2024-09-12T18:35:32.408359+0000","last_peered":"2024-09-12T18:35:32.408359+0000","last_clean":"2024-09-12T18:35:32.408359+0000","last_became_active":"2024-09-12T18:35:25.660163+0000","last_became_peered":"2024-09-12T18:35:25.660163+0000","last_unstale":"2024-09-12T18:35:32.408359+0000","last_undegraded":"2024-09-12T18:35:32.408359+0000","last_fullsized":"2024-09-12T18:35:32.408359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:37.682184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.093423+0000","last_change":"2024-09-12T18:35:24.652304+0000","last_active":"2024-09-12T18:35:33.093423+0000","last_peered":"2024-09-12T18:35:33.093423+0000","last_clean":"2024-09-12T18:35:33.093423+0000","last_became_active":"2024-09-12T18:35:24.651460+0000","last_became_peered":"2024-09-12T18:35:24.651460+0000","last_unstale":"2024-09-12T18:35:33.093423+0000","last_undegraded":"2024-09-12T18:35:33.093423+0000","last_fullsized":"2024-09-12T18:35:33.093423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:42.050557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705672,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":262144,"data_stored":655733,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":274432,"data_stored":656368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":64206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:35:42.079 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:35:42.421 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:35:42.423 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T18:35:42.439 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-09-12T18:35:42.381223+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":192,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90104,"kb_used_data":704,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025416,"statfs":{"total":289910292480,"available":289818025984,"internally_reserved":0,"allocated":720896,"data_stored":1376307,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4783,"internal_metadata":91483473},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003794"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410091+0000","last_change":"2024-09-12T18:35:25.657389+0000","last_active":"2024-09-12T18:35:32.410091+0000","last_peered":"2024-09-12T18:35:32.410091+0000","last_clean":"2024-09-12T18:35:32.410091+0000","last_became_active":"2024-09-12T18:35:25.651857+0000","last_became_peered":"2024-09-12T18:35:25.651857+0000","last_unstale":"2024-09-12T18:35:32.410091+0000","last_undegraded":"2024-09-12T18:35:32.410091+0000","last_fullsized":"2024-09-12T18:35:32.410091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:50.264536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409235+0000","last_change":"2024-09-12T18:35:25.659760+0000","last_active":"2024-09-12T18:35:32.409235+0000","last_peered":"2024-09-12T18:35:32.409235+0000","last_clean":"2024-09-12T18:35:32.409235+0000","last_became_active":"2024-09-12T18:35:25.654920+0000","last_became_peered":"2024-09-12T18:35:25.654920+0000","last_unstale":"2024-09-12T18:35:32.409235+0000","last_undegraded":"2024-09-12T18:35:32.409235+0000","last_fullsized":"2024-09-12T18:35:32.409235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:21.519881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408918+0000","last_change":"2024-09-12T18:35:25.659460+0000","last_active":"2024-09-12T18:35:32.408918+0000","last_peered":"2024-09-12T18:35:32.408918+0000","last_clean":"2024-09-12T18:35:32.408918+0000","last_became_active":"2024-09-12T18:35:25.657782+0000","last_became_peered":"2024-09-12T18:35:25.657782+0000","last_unstale":"2024-09-12T18:35:32.408918+0000","last_undegraded":"2024-09-12T18:35:32.408918+0000","last_fullsized":"2024-09-12T18:35:32.408918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:38.544284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408838+0000","last_change":"2024-09-12T18:35:25.663617+0000","last_active":"2024-09-12T18:35:32.408838+0000","last_peered":"2024-09-12T18:35:32.408838+0000","last_clean":"2024-09-12T18:35:32.408838+0000","last_became_active":"2024-09-12T18:35:25.661977+0000","last_became_peered":"2024-09-12T18:35:25.661977+0000","last_unstale":"2024-09-12T18:35:32.408838+0000","last_undegraded":"2024-09-12T18:35:32.408838+0000","last_fullsized":"2024-09-12T18:35:32.408838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:14.748234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408831+0000","last_change":"2024-09-12T18:35:25.656566+0000","last_active":"2024-09-12T18:35:32.408831+0000","last_peered":"2024-09-12T18:35:32.408831+0000","last_clean":"2024-09-12T18:35:32.408831+0000","last_became_active":"2024-09-12T18:35:25.654898+0000","last_became_peered":"2024-09-12T18:35:25.654898+0000","last_unstale":"2024-09-12T18:35:32.408831+0000","last_undegraded":"2024-09-12T18:35:32.408831+0000","last_fullsized":"2024-09-12T18:35:32.408831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:36.113250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408286+0000","last_change":"2024-09-12T18:35:25.652754+0000","last_active":"2024-09-12T18:35:32.408286+0000","last_peered":"2024-09-12T18:35:32.408286+0000","last_clean":"2024-09-12T18:35:32.408286+0000","last_became_active":"2024-09-12T18:35:25.651217+0000","last_became_peered":"2024-09-12T18:35:25.651217+0000","last_unstale":"2024-09-12T18:35:32.408286+0000","last_undegraded":"2024-09-12T18:35:32.408286+0000","last_fullsized":"2024-09-12T18:35:32.408286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:24.585774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408085+0000","last_change":"2024-09-12T18:35:25.659811+0000","last_active":"2024-09-12T18:35:32.408085+0000","last_peered":"2024-09-12T18:35:32.408085+0000","last_clean":"2024-09-12T18:35:32.408085+0000","last_became_active":"2024-09-12T18:35:25.658998+0000","last_became_peered":"2024-09-12T18:35:25.658998+0000","last_unstale":"2024-09-12T18:35:32.408085+0000","last_undegraded":"2024-09-12T18:35:32.408085+0000","last_fullsized":"2024-09-12T18:35:32.408085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.407720+0000","last_change":"2024-09-12T18:35:25.653999+0000","last_active":"2024-09-12T18:35:32.407720+0000","last_peered":"2024-09-12T18:35:32.407720+0000","last_clean":"2024-09-12T18:35:32.407720+0000","last_became_active":"2024-09-12T18:35:25.653319+0000","last_became_peered":"2024-09-12T18:35:25.653319+0000","last_unstale":"2024-09-12T18:35:32.407720+0000","last_undegraded":"2024-09-12T18:35:32.407720+0000","last_fullsized":"2024-09-12T18:35:32.407720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:04.718000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095705+0000","last_change":"2024-09-12T18:35:25.668339+0000","last_active":"2024-09-12T18:35:33.095705+0000","last_peered":"2024-09-12T18:35:33.095705+0000","last_clean":"2024-09-12T18:35:33.095705+0000","last_became_active":"2024-09-12T18:35:25.667608+0000","last_became_peered":"2024-09-12T18:35:25.667608+0000","last_unstale":"2024-09-12T18:35:33.095705+0000","last_undegraded":"2024-09-12T18:35:33.095705+0000","last_fullsized":"2024-09-12T18:35:33.095705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:15.699745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409709+0000","last_change":"2024-09-12T18:35:25.660174+0000","last_active":"2024-09-12T18:35:32.409709+0000","last_peered":"2024-09-12T18:35:32.409709+0000","last_clean":"2024-09-12T18:35:32.409709+0000","last_became_active":"2024-09-12T18:35:25.656560+0000","last_became_peered":"2024-09-12T18:35:25.656560+0000","last_unstale":"2024-09-12T18:35:32.409709+0000","last_undegraded":"2024-09-12T18:35:32.409709+0000","last_fullsized":"2024-09-12T18:35:32.409709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:47.268505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409405+0000","last_change":"2024-09-12T18:35:25.649858+0000","last_active":"2024-09-12T18:35:32.409405+0000","last_peered":"2024-09-12T18:35:32.409405+0000","last_clean":"2024-09-12T18:35:32.409405+0000","last_became_active":"2024-09-12T18:35:25.649090+0000","last_became_peered":"2024-09-12T18:35:25.649090+0000","last_unstale":"2024-09-12T18:35:32.409405+0000","last_undegraded":"2024-09-12T18:35:32.409405+0000","last_fullsized":"2024-09-12T18:35:32.409405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:33.158421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409039+0000","last_change":"2024-09-12T18:35:25.649885+0000","last_active":"2024-09-12T18:35:32.409039+0000","last_peered":"2024-09-12T18:35:32.409039+0000","last_clean":"2024-09-12T18:35:32.409039+0000","last_became_active":"2024-09-12T18:35:25.649111+0000","last_became_peered":"2024-09-12T18:35:25.649111+0000","last_unstale":"2024-09-12T18:35:32.409039+0000","last_undegraded":"2024-09-12T18:35:32.409039+0000","last_fullsized":"2024-09-12T18:35:32.409039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:17.162410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408499+0000","last_change":"2024-09-12T18:35:25.651541+0000","last_active":"2024-09-12T18:35:32.408499+0000","last_peered":"2024-09-12T18:35:32.408499+0000","last_clean":"2024-09-12T18:35:32.408499+0000","last_became_active":"2024-09-12T18:35:25.650661+0000","last_became_peered":"2024-09-12T18:35:25.650661+0000","last_unstale":"2024-09-12T18:35:32.408499+0000","last_undegraded":"2024-09-12T18:35:32.408499+0000","last_fullsized":"2024-09-12T18:35:32.408499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:52.082734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408701+0000","last_change":"2024-09-12T18:35:25.657913+0000","last_active":"2024-09-12T18:35:32.408701+0000","last_peered":"2024-09-12T18:35:32.408701+0000","last_clean":"2024-09-12T18:35:32.408701+0000","last_became_active":"2024-09-12T18:35:25.657082+0000","last_became_peered":"2024-09-12T18:35:25.657082+0000","last_unstale":"2024-09-12T18:35:32.408701+0000","last_undegraded":"2024-09-12T18:35:32.408701+0000","last_fullsized":"2024-09-12T18:35:32.408701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:21.538633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408174+0000","last_change":"2024-09-12T18:35:25.658763+0000","last_active":"2024-09-12T18:35:32.408174+0000","last_peered":"2024-09-12T18:35:32.408174+0000","last_clean":"2024-09-12T18:35:32.408174+0000","last_became_active":"2024-09-12T18:35:25.657508+0000","last_became_peered":"2024-09-12T18:35:25.657508+0000","last_unstale":"2024-09-12T18:35:32.408174+0000","last_undegraded":"2024-09-12T18:35:32.408174+0000","last_fullsized":"2024-09-12T18:35:32.408174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:13.170519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.407720+0000","last_change":"2024-09-12T18:35:25.653730+0000","last_active":"2024-09-12T18:35:32.407720+0000","last_peered":"2024-09-12T18:35:32.407720+0000","last_clean":"2024-09-12T18:35:32.407720+0000","last_became_active":"2024-09-12T18:35:25.651535+0000","last_became_peered":"2024-09-12T18:35:25.651535+0000","last_unstale":"2024-09-12T18:35:32.407720+0000","last_undegraded":"2024-09-12T18:35:32.407720+0000","last_fullsized":"2024-09-12T18:35:32.407720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.096263+0000","last_change":"2024-09-12T18:35:25.656513+0000","last_active":"2024-09-12T18:35:33.096263+0000","last_peered":"2024-09-12T18:35:33.096263+0000","last_clean":"2024-09-12T18:35:33.096263+0000","last_became_active":"2024-09-12T18:35:25.653440+0000","last_became_peered":"2024-09-12T18:35:25.653440+0000","last_unstale":"2024-09-12T18:35:33.096263+0000","last_undegraded":"2024-09-12T18:35:33.096263+0000","last_fullsized":"2024-09-12T18:35:33.096263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:18.693161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409944+0000","last_change":"2024-09-12T18:35:25.657991+0000","last_active":"2024-09-12T18:35:32.409944+0000","last_peered":"2024-09-12T18:35:32.409944+0000","last_clean":"2024-09-12T18:35:32.409944+0000","last_became_active":"2024-09-12T18:35:25.653934+0000","last_became_peered":"2024-09-12T18:35:25.653934+0000","last_unstale":"2024-09-12T18:35:32.409944+0000","last_undegraded":"2024-09-12T18:35:32.409944+0000","last_fullsized":"2024-09-12T18:35:32.409944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:05.418901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095481+0000","last_change":"2024-09-12T18:35:25.658819+0000","last_active":"2024-09-12T18:35:33.095481+0000","last_peered":"2024-09-12T18:35:33.095481+0000","last_clean":"2024-09-12T18:35:33.095481+0000","last_became_active":"2024-09-12T18:35:25.656843+0000","last_became_peered":"2024-09-12T18:35:25.656843+0000","last_unstale":"2024-09-12T18:35:33.095481+0000","last_undegraded":"2024-09-12T18:35:33.095481+0000","last_fullsized":"2024-09-12T18:35:33.095481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:55.291963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409642+0000","last_change":"2024-09-12T18:35:25.661176+0000","last_active":"2024-09-12T18:35:32.409642+0000","last_peered":"2024-09-12T18:35:32.409642+0000","last_clean":"2024-09-12T18:35:32.409642+0000","last_became_active":"2024-09-12T18:35:25.659534+0000","last_became_peered":"2024-09-12T18:35:25.659534+0000","last_unstale":"2024-09-12T18:35:32.409642+0000","last_undegraded":"2024-09-12T18:35:32.409642+0000","last_fullsized":"2024-09-12T18:35:32.409642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:40.145442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408508+0000","last_change":"2024-09-12T18:35:25.650632+0000","last_active":"2024-09-12T18:35:32.408508+0000","last_peered":"2024-09-12T18:35:32.408508+0000","last_clean":"2024-09-12T18:35:32.408508+0000","last_became_active":"2024-09-12T18:35:25.649333+0000","last_became_peered":"2024-09-12T18:35:25.649333+0000","last_unstale":"2024-09-12T18:35:32.408508+0000","last_undegraded":"2024-09-12T18:35:32.408508+0000","last_fullsized":"2024-09-12T18:35:32.408508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:30.537572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408378+0000","last_change":"2024-09-12T18:35:25.648245+0000","last_active":"2024-09-12T18:35:32.408378+0000","last_peered":"2024-09-12T18:35:32.408378+0000","last_clean":"2024-09-12T18:35:32.408378+0000","last_became_active":"2024-09-12T18:35:25.646357+0000","last_became_peered":"2024-09-12T18:35:25.646357+0000","last_unstale":"2024-09-12T18:35:32.408378+0000","last_undegraded":"2024-09-12T18:35:32.408378+0000","last_fullsized":"2024-09-12T18:35:32.408378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:05.662140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.094206+0000","last_change":"2024-09-12T18:35:25.661613+0000","last_active":"2024-09-12T18:35:33.094206+0000","last_peered":"2024-09-12T18:35:33.094206+0000","last_clean":"2024-09-12T18:35:33.094206+0000","last_became_active":"2024-09-12T18:35:25.658833+0000","last_became_peered":"2024-09-12T18:35:25.658833+0000","last_unstale":"2024-09-12T18:35:33.094206+0000","last_undegraded":"2024-09-12T18:35:33.094206+0000","last_fullsized":"2024-09-12T18:35:33.094206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:51.064080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.407827+0000","last_change":"2024-09-12T18:35:25.657782+0000","last_active":"2024-09-12T18:35:32.407827+0000","last_peered":"2024-09-12T18:35:32.407827+0000","last_clean":"2024-09-12T18:35:32.407827+0000","last_became_active":"2024-09-12T18:35:25.655295+0000","last_became_peered":"2024-09-12T18:35:25.655295+0000","last_unstale":"2024-09-12T18:35:32.407827+0000","last_undegraded":"2024-09-12T18:35:32.407827+0000","last_fullsized":"2024-09-12T18:35:32.407827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:37.744175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410219+0000","last_change":"2024-09-12T18:35:25.654863+0000","last_active":"2024-09-12T18:35:32.410219+0000","last_peered":"2024-09-12T18:35:32.410219+0000","last_clean":"2024-09-12T18:35:32.410219+0000","last_became_active":"2024-09-12T18:35:25.650407+0000","last_became_peered":"2024-09-12T18:35:25.650407+0000","last_unstale":"2024-09-12T18:35:32.410219+0000","last_undegraded":"2024-09-12T18:35:32.410219+0000","last_fullsized":"2024-09-12T18:35:32.410219+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:38.395666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095956+0000","last_change":"2024-09-12T18:35:25.662414+0000","last_active":"2024-09-12T18:35:33.095956+0000","last_peered":"2024-09-12T18:35:33.095956+0000","last_clean":"2024-09-12T18:35:33.095956+0000","last_became_active":"2024-09-12T18:35:25.660126+0000","last_became_peered":"2024-09-12T18:35:25.660126+0000","last_unstale":"2024-09-12T18:35:33.095956+0000","last_undegraded":"2024-09-12T18:35:33.095956+0000","last_fullsized":"2024-09-12T18:35:33.095956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:48.437139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409715+0000","last_change":"2024-09-12T18:35:25.661523+0000","last_active":"2024-09-12T18:35:32.409715+0000","last_peered":"2024-09-12T18:35:32.409715+0000","last_clean":"2024-09-12T18:35:32.409715+0000","last_became_active":"2024-09-12T18:35:25.659338+0000","last_became_peered":"2024-09-12T18:35:25.659338+0000","last_unstale":"2024-09-12T18:35:32.409715+0000","last_undegraded":"2024-09-12T18:35:32.409715+0000","last_fullsized":"2024-09-12T18:35:32.409715+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:37.083820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409590+0000","last_change":"2024-09-12T18:35:25.662445+0000","last_active":"2024-09-12T18:35:32.409590+0000","last_peered":"2024-09-12T18:35:32.409590+0000","last_clean":"2024-09-12T18:35:32.409590+0000","last_became_active":"2024-09-12T18:35:25.659496+0000","last_became_peered":"2024-09-12T18:35:25.659496+0000","last_unstale":"2024-09-12T18:35:32.409590+0000","last_undegraded":"2024-09-12T18:35:32.409590+0000","last_fullsized":"2024-09-12T18:35:32.409590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:03.270420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095459+0000","last_change":"2024-09-12T18:35:25.662519+0000","last_active":"2024-09-12T18:35:33.095459+0000","last_peered":"2024-09-12T18:35:33.095459+0000","last_clean":"2024-09-12T18:35:33.095459+0000","last_became_active":"2024-09-12T18:35:25.652964+0000","last_became_peered":"2024-09-12T18:35:25.652964+0000","last_unstale":"2024-09-12T18:35:33.095459+0000","last_undegraded":"2024-09-12T18:35:33.095459+0000","last_fullsized":"2024-09-12T18:35:33.095459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:37.923468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408671+0000","last_change":"2024-09-12T18:35:25.650507+0000","last_active":"2024-09-12T18:35:32.408671+0000","last_peered":"2024-09-12T18:35:32.408671+0000","last_clean":"2024-09-12T18:35:32.408671+0000","last_became_active":"2024-09-12T18:35:25.649415+0000","last_became_peered":"2024-09-12T18:35:25.649415+0000","last_unstale":"2024-09-12T18:35:32.408671+0000","last_undegraded":"2024-09-12T18:35:32.408671+0000","last_fullsized":"2024-09-12T18:35:32.408671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:23.081416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.094335+0000","last_change":"2024-09-12T18:35:25.653949+0000","last_active":"2024-09-12T18:35:33.094335+0000","last_peered":"2024-09-12T18:35:33.094335+0000","last_clean":"2024-09-12T18:35:33.094335+0000","last_became_active":"2024-09-12T18:35:25.652992+0000","last_became_peered":"2024-09-12T18:35:25.652992+0000","last_unstale":"2024-09-12T18:35:33.094335+0000","last_undegraded":"2024-09-12T18:35:33.094335+0000","last_fullsized":"2024-09-12T18:35:33.094335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:47.687372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.407991+0000","last_change":"2024-09-12T18:35:25.653159+0000","last_active":"2024-09-12T18:35:32.407991+0000","last_peered":"2024-09-12T18:35:32.407991+0000","last_clean":"2024-09-12T18:35:32.407991+0000","last_became_active":"2024-09-12T18:35:25.650551+0000","last_became_peered":"2024-09-12T18:35:25.650551+0000","last_unstale":"2024-09-12T18:35:32.407991+0000","last_undegraded":"2024-09-12T18:35:32.407991+0000","last_fullsized":"2024-09-12T18:35:32.407991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:16.245302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409338+0000","last_change":"2024-09-12T18:35:25.651877+0000","last_active":"2024-09-12T18:35:32.409338+0000","last_peered":"2024-09-12T18:35:32.409338+0000","last_clean":"2024-09-12T18:35:32.409338+0000","last_became_active":"2024-09-12T18:35:25.651055+0000","last_became_peered":"2024-09-12T18:35:25.651055+0000","last_unstale":"2024-09-12T18:35:32.409338+0000","last_undegraded":"2024-09-12T18:35:32.409338+0000","last_fullsized":"2024-09-12T18:35:32.409338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:14.200080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409200+0000","last_change":"2024-09-12T18:35:24.657739+0000","last_active":"2024-09-12T18:35:32.409200+0000","last_peered":"2024-09-12T18:35:32.409200+0000","last_clean":"2024-09-12T18:35:32.409200+0000","last_became_active":"2024-09-12T18:35:24.656208+0000","last_became_peered":"2024-09-12T18:35:24.656208+0000","last_unstale":"2024-09-12T18:35:32.409200+0000","last_undegraded":"2024-09-12T18:35:32.409200+0000","last_fullsized":"2024-09-12T18:35:32.409200+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:50.073716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409601+0000","last_change":"2024-09-12T18:35:25.651651+0000","last_active":"2024-09-12T18:35:32.409601+0000","last_peered":"2024-09-12T18:35:32.409601+0000","last_clean":"2024-09-12T18:35:32.409601+0000","last_became_active":"2024-09-12T18:35:25.650849+0000","last_became_peered":"2024-09-12T18:35:25.650849+0000","last_unstale":"2024-09-12T18:35:32.409601+0000","last_undegraded":"2024-09-12T18:35:32.409601+0000","last_fullsized":"2024-09-12T18:35:32.409601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:18.555827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.092714+0000","last_change":"2024-09-12T18:35:24.656119+0000","last_active":"2024-09-12T18:35:33.092714+0000","last_peered":"2024-09-12T18:35:33.092714+0000","last_clean":"2024-09-12T18:35:33.092714+0000","last_became_active":"2024-09-12T18:35:24.653175+0000","last_became_peered":"2024-09-12T18:35:24.653175+0000","last_unstale":"2024-09-12T18:35:33.092714+0000","last_undegraded":"2024-09-12T18:35:33.092714+0000","last_fullsized":"2024-09-12T18:35:33.092714+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:00.551165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.096293+0000","last_change":"2024-09-12T18:35:25.655723+0000","last_active":"2024-09-12T18:35:33.096293+0000","last_peered":"2024-09-12T18:35:33.096293+0000","last_clean":"2024-09-12T18:35:33.096293+0000","last_became_active":"2024-09-12T18:35:25.653630+0000","last_became_peered":"2024-09-12T18:35:25.653630+0000","last_unstale":"2024-09-12T18:35:33.096293+0000","last_undegraded":"2024-09-12T18:35:33.096293+0000","last_fullsized":"2024-09-12T18:35:33.096293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:07.655792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408416+0000","last_change":"2024-09-12T18:35:24.640096+0000","last_active":"2024-09-12T18:35:32.408416+0000","last_peered":"2024-09-12T18:35:32.408416+0000","last_clean":"2024-09-12T18:35:32.408416+0000","last_became_active":"2024-09-12T18:35:24.638230+0000","last_became_peered":"2024-09-12T18:35:24.638230+0000","last_unstale":"2024-09-12T18:35:32.408416+0000","last_undegraded":"2024-09-12T18:35:32.408416+0000","last_fullsized":"2024-09-12T18:35:32.408416+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:38.435296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095745+0000","last_change":"2024-09-12T18:35:25.662692+0000","last_active":"2024-09-12T18:35:33.095745+0000","last_peered":"2024-09-12T18:35:33.095745+0000","last_clean":"2024-09-12T18:35:33.095745+0000","last_became_active":"2024-09-12T18:35:25.661885+0000","last_became_peered":"2024-09-12T18:35:25.661885+0000","last_unstale":"2024-09-12T18:35:33.095745+0000","last_undegraded":"2024-09-12T18:35:33.095745+0000","last_fullsized":"2024-09-12T18:35:33.095745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:41.264425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408266+0000","last_change":"2024-09-12T18:35:24.653610+0000","last_active":"2024-09-12T18:35:32.408266+0000","last_peered":"2024-09-12T18:35:32.408266+0000","last_clean":"2024-09-12T18:35:32.408266+0000","last_became_active":"2024-09-12T18:35:24.652880+0000","last_became_peered":"2024-09-12T18:35:24.652880+0000","last_unstale":"2024-09-12T18:35:32.408266+0000","last_undegraded":"2024-09-12T18:35:32.408266+0000","last_fullsized":"2024-09-12T18:35:32.408266+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:57.636251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410248+0000","last_change":"2024-09-12T18:35:24.653465+0000","last_active":"2024-09-12T18:35:32.410248+0000","last_peered":"2024-09-12T18:35:32.410248+0000","last_clean":"2024-09-12T18:35:32.410248+0000","last_became_active":"2024-09-12T18:35:24.652792+0000","last_became_peered":"2024-09-12T18:35:24.652792+0000","last_unstale":"2024-09-12T18:35:32.410248+0000","last_undegraded":"2024-09-12T18:35:32.410248+0000","last_fullsized":"2024-09-12T18:35:32.410248+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:14.588993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.407906+0000","last_change":"2024-09-12T18:35:25.655426+0000","last_active":"2024-09-12T18:35:32.407906+0000","last_peered":"2024-09-12T18:35:32.407906+0000","last_clean":"2024-09-12T18:35:32.407906+0000","last_became_active":"2024-09-12T18:35:25.648186+0000","last_became_peered":"2024-09-12T18:35:25.648186+0000","last_unstale":"2024-09-12T18:35:32.407906+0000","last_undegraded":"2024-09-12T18:35:32.407906+0000","last_fullsized":"2024-09-12T18:35:32.407906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:48.802815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410238+0000","last_change":"2024-09-12T18:35:24.648439+0000","last_active":"2024-09-12T18:35:32.410238+0000","last_peered":"2024-09-12T18:35:32.410238+0000","last_clean":"2024-09-12T18:35:32.410238+0000","last_became_active":"2024-09-12T18:35:24.647629+0000","last_became_peered":"2024-09-12T18:35:24.647629+0000","last_unstale":"2024-09-12T18:35:32.410238+0000","last_undegraded":"2024-09-12T18:35:32.410238+0000","last_fullsized":"2024-09-12T18:35:32.410238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:45.428223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408106+0000","last_change":"2024-09-12T18:35:25.652496+0000","last_active":"2024-09-12T18:35:32.408106+0000","last_peered":"2024-09-12T18:35:32.408106+0000","last_clean":"2024-09-12T18:35:32.408106+0000","last_became_active":"2024-09-12T18:35:25.651628+0000","last_became_peered":"2024-09-12T18:35:25.651628+0000","last_unstale":"2024-09-12T18:35:32.408106+0000","last_undegraded":"2024-09-12T18:35:32.408106+0000","last_fullsized":"2024-09-12T18:35:32.408106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:44.920448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410714+0000","last_change":"2024-09-12T18:35:24.654976+0000","last_active":"2024-09-12T18:35:32.410714+0000","last_peered":"2024-09-12T18:35:32.410714+0000","last_clean":"2024-09-12T18:35:32.410714+0000","last_became_active":"2024-09-12T18:35:24.654264+0000","last_became_peered":"2024-09-12T18:35:24.654264+0000","last_unstale":"2024-09-12T18:35:32.410714+0000","last_undegraded":"2024-09-12T18:35:32.410714+0000","last_fullsized":"2024-09-12T18:35:32.410714+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:00.115408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408935+0000","last_change":"2024-09-12T18:35:25.650577+0000","last_active":"2024-09-12T18:35:32.408935+0000","last_peered":"2024-09-12T18:35:32.408935+0000","last_clean":"2024-09-12T18:35:32.408935+0000","last_became_active":"2024-09-12T18:35:25.649172+0000","last_became_peered":"2024-09-12T18:35:25.649172+0000","last_unstale":"2024-09-12T18:35:32.408935+0000","last_undegraded":"2024-09-12T18:35:32.408935+0000","last_fullsized":"2024-09-12T18:35:32.408935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:55.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410258+0000","last_change":"2024-09-12T18:35:24.657665+0000","last_active":"2024-09-12T18:35:32.410258+0000","last_peered":"2024-09-12T18:35:32.410258+0000","last_clean":"2024-09-12T18:35:32.410258+0000","last_became_active":"2024-09-12T18:35:24.657015+0000","last_became_peered":"2024-09-12T18:35:24.657015+0000","last_unstale":"2024-09-12T18:35:32.410258+0000","last_undegraded":"2024-09-12T18:35:32.410258+0000","last_fullsized":"2024-09-12T18:35:32.410258+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:03.171326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095182+0000","last_change":"2024-09-12T18:35:25.665275+0000","last_active":"2024-09-12T18:35:33.095182+0000","last_peered":"2024-09-12T18:35:33.095182+0000","last_clean":"2024-09-12T18:35:33.095182+0000","last_became_active":"2024-09-12T18:35:25.659511+0000","last_became_peered":"2024-09-12T18:35:25.659511+0000","last_unstale":"2024-09-12T18:35:33.095182+0000","last_undegraded":"2024-09-12T18:35:33.095182+0000","last_fullsized":"2024-09-12T18:35:33.095182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.093733+0000","last_change":"2024-09-12T18:35:24.651913+0000","last_active":"2024-09-12T18:35:33.093733+0000","last_peered":"2024-09-12T18:35:33.093733+0000","last_clean":"2024-09-12T18:35:33.093733+0000","last_became_active":"2024-09-12T18:35:24.650421+0000","last_became_peered":"2024-09-12T18:35:24.650421+0000","last_unstale":"2024-09-12T18:35:33.093733+0000","last_undegraded":"2024-09-12T18:35:33.093733+0000","last_fullsized":"2024-09-12T18:35:33.093733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:57.685312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409119+0000","last_change":"2024-09-12T18:35:25.651138+0000","last_active":"2024-09-12T18:35:32.409119+0000","last_peered":"2024-09-12T18:35:32.409119+0000","last_clean":"2024-09-12T18:35:32.409119+0000","last_became_active":"2024-09-12T18:35:25.650617+0000","last_became_peered":"2024-09-12T18:35:25.650617+0000","last_unstale":"2024-09-12T18:35:32.409119+0000","last_undegraded":"2024-09-12T18:35:32.409119+0000","last_fullsized":"2024-09-12T18:35:32.409119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:58.535066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410319+0000","last_change":"2024-09-12T18:35:24.659019+0000","last_active":"2024-09-12T18:35:32.410319+0000","last_peered":"2024-09-12T18:35:32.410319+0000","last_clean":"2024-09-12T18:35:32.410319+0000","last_became_active":"2024-09-12T18:35:24.658423+0000","last_became_peered":"2024-09-12T18:35:24.658423+0000","last_unstale":"2024-09-12T18:35:32.410319+0000","last_undegraded":"2024-09-12T18:35:32.410319+0000","last_fullsized":"2024-09-12T18:35:32.410319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:37.668417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410270+0000","last_change":"2024-09-12T18:35:25.662287+0000","last_active":"2024-09-12T18:35:32.410270+0000","last_peered":"2024-09-12T18:35:32.410270+0000","last_clean":"2024-09-12T18:35:32.410270+0000","last_became_active":"2024-09-12T18:35:25.660372+0000","last_became_peered":"2024-09-12T18:35:25.660372+0000","last_unstale":"2024-09-12T18:35:32.410270+0000","last_undegraded":"2024-09-12T18:35:32.410270+0000","last_fullsized":"2024-09-12T18:35:32.410270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:08.729541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409339+0000","last_change":"2024-09-12T18:35:24.648330+0000","last_active":"2024-09-12T18:35:32.409339+0000","last_peered":"2024-09-12T18:35:32.409339+0000","last_clean":"2024-09-12T18:35:32.409339+0000","last_became_active":"2024-09-12T18:35:24.647520+0000","last_became_peered":"2024-09-12T18:35:24.647520+0000","last_unstale":"2024-09-12T18:35:32.409339+0000","last_undegraded":"2024-09-12T18:35:32.409339+0000","last_fullsized":"2024-09-12T18:35:32.409339+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:25.552055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409423+0000","last_change":"2024-09-12T18:35:25.658674+0000","last_active":"2024-09-12T18:35:32.409423+0000","last_peered":"2024-09-12T18:35:32.409423+0000","last_clean":"2024-09-12T18:35:32.409423+0000","last_became_active":"2024-09-12T18:35:25.657386+0000","last_became_peered":"2024-09-12T18:35:25.657386+0000","last_unstale":"2024-09-12T18:35:32.409423+0000","last_undegraded":"2024-09-12T18:35:32.409423+0000","last_fullsized":"2024-09-12T18:35:32.409423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:48.037086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408029+0000","last_change":"2024-09-12T18:35:24.646810+0000","last_active":"2024-09-12T18:35:32.408029+0000","last_peered":"2024-09-12T18:35:32.408029+0000","last_clean":"2024-09-12T18:35:32.408029+0000","last_became_active":"2024-09-12T18:35:24.646008+0000","last_became_peered":"2024-09-12T18:35:24.646008+0000","last_unstale":"2024-09-12T18:35:32.408029+0000","last_undegraded":"2024-09-12T18:35:32.408029+0000","last_fullsized":"2024-09-12T18:35:32.408029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:43.888776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095907+0000","last_change":"2024-09-12T18:35:25.667710+0000","last_active":"2024-09-12T18:35:33.095907+0000","last_peered":"2024-09-12T18:35:33.095907+0000","last_clean":"2024-09-12T18:35:33.095907+0000","last_became_active":"2024-09-12T18:35:25.666940+0000","last_became_peered":"2024-09-12T18:35:25.666940+0000","last_unstale":"2024-09-12T18:35:33.095907+0000","last_undegraded":"2024-09-12T18:35:33.095907+0000","last_fullsized":"2024-09-12T18:35:33.095907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:09.823085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":167,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409297+0000","last_change":"2024-09-12T18:35:13.489018+0000","last_active":"2024-09-12T18:35:32.409297+0000","last_peered":"2024-09-12T18:35:32.409297+0000","last_clean":"2024-09-12T18:35:32.409297+0000","last_became_active":"2024-09-12T18:35:13.488346+0000","last_became_peered":"2024-09-12T18:35:13.488346+0000","last_unstale":"2024-09-12T18:35:32.409297+0000","last_undegraded":"2024-09-12T18:35:32.409297+0000","last_fullsized":"2024-09-12T18:35:32.409297+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_clean_scrub_stamp":"2024-09-12T18:35:12.464628+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:54.864640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410021+0000","last_change":"2024-09-12T18:35:22.459694+0000","last_active":"2024-09-12T18:35:32.410021+0000","last_peered":"2024-09-12T18:35:32.410021+0000","last_clean":"2024-09-12T18:35:32.410021+0000","last_became_active":"2024-09-12T18:35:20.446796+0000","last_became_peered":"2024-09-12T18:35:20.446796+0000","last_unstale":"2024-09-12T18:35:32.410021+0000","last_undegraded":"2024-09-12T18:35:32.410021+0000","last_fullsized":"2024-09-12T18:35:32.410021+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:21.506024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016291610000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.092256+0000","last_change":"2024-09-12T18:35:24.651749+0000","last_active":"2024-09-12T18:35:33.092256+0000","last_peered":"2024-09-12T18:35:33.092256+0000","last_clean":"2024-09-12T18:35:33.092256+0000","last_became_active":"2024-09-12T18:35:24.649860+0000","last_became_peered":"2024-09-12T18:35:24.649860+0000","last_unstale":"2024-09-12T18:35:33.092256+0000","last_undegraded":"2024-09-12T18:35:33.092256+0000","last_fullsized":"2024-09-12T18:35:33.092256+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:35.430065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410595+0000","last_change":"2024-09-12T18:35:25.662424+0000","last_active":"2024-09-12T18:35:32.410595+0000","last_peered":"2024-09-12T18:35:32.410595+0000","last_clean":"2024-09-12T18:35:32.410595+0000","last_became_active":"2024-09-12T18:35:25.661043+0000","last_became_peered":"2024-09-12T18:35:25.661043+0000","last_unstale":"2024-09-12T18:35:32.410595+0000","last_undegraded":"2024-09-12T18:35:32.410595+0000","last_fullsized":"2024-09-12T18:35:32.410595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:52.551802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408682+0000","last_change":"2024-09-12T18:35:22.459090+0000","last_active":"2024-09-12T18:35:32.408682+0000","last_peered":"2024-09-12T18:35:32.408682+0000","last_clean":"2024-09-12T18:35:32.408682+0000","last_became_active":"2024-09-12T18:35:20.448553+0000","last_became_peered":"2024-09-12T18:35:20.448553+0000","last_unstale":"2024-09-12T18:35:32.408682+0000","last_undegraded":"2024-09-12T18:35:32.408682+0000","last_fullsized":"2024-09-12T18:35:32.408682+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:56.834808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001030836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.092165+0000","last_change":"2024-09-12T18:35:24.651597+0000","last_active":"2024-09-12T18:35:33.092165+0000","last_peered":"2024-09-12T18:35:33.092165+0000","last_clean":"2024-09-12T18:35:33.092165+0000","last_became_active":"2024-09-12T18:35:24.649940+0000","last_became_peered":"2024-09-12T18:35:24.649940+0000","last_unstale":"2024-09-12T18:35:33.092165+0000","last_undegraded":"2024-09-12T18:35:33.092165+0000","last_fullsized":"2024-09-12T18:35:33.092165+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:36.822432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410101+0000","last_change":"2024-09-12T18:35:25.660529+0000","last_active":"2024-09-12T18:35:32.410101+0000","last_peered":"2024-09-12T18:35:32.410101+0000","last_clean":"2024-09-12T18:35:32.410101+0000","last_became_active":"2024-09-12T18:35:25.659537+0000","last_became_peered":"2024-09-12T18:35:25.659537+0000","last_unstale":"2024-09-12T18:35:32.410101+0000","last_undegraded":"2024-09-12T18:35:32.410101+0000","last_fullsized":"2024-09-12T18:35:32.410101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:51.790349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095003+0000","last_change":"2024-09-12T18:35:22.464179+0000","last_active":"2024-09-12T18:35:33.095003+0000","last_peered":"2024-09-12T18:35:33.095003+0000","last_clean":"2024-09-12T18:35:33.095003+0000","last_became_active":"2024-09-12T18:35:20.442613+0000","last_became_peered":"2024-09-12T18:35:20.442613+0000","last_unstale":"2024-09-12T18:35:33.095003+0000","last_undegraded":"2024-09-12T18:35:33.095003+0000","last_fullsized":"2024-09-12T18:35:33.095003+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:17.636537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014134620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408165+0000","last_change":"2024-09-12T18:35:24.641297+0000","last_active":"2024-09-12T18:35:32.408165+0000","last_peered":"2024-09-12T18:35:32.408165+0000","last_clean":"2024-09-12T18:35:32.408165+0000","last_became_active":"2024-09-12T18:35:24.637334+0000","last_became_peered":"2024-09-12T18:35:24.637334+0000","last_unstale":"2024-09-12T18:35:32.408165+0000","last_undegraded":"2024-09-12T18:35:32.408165+0000","last_fullsized":"2024-09-12T18:35:32.408165+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:50.772074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095958+0000","last_change":"2024-09-12T18:35:25.659209+0000","last_active":"2024-09-12T18:35:33.095958+0000","last_peered":"2024-09-12T18:35:33.095958+0000","last_clean":"2024-09-12T18:35:33.095958+0000","last_became_active":"2024-09-12T18:35:25.656170+0000","last_became_peered":"2024-09-12T18:35:25.656170+0000","last_unstale":"2024-09-12T18:35:33.095958+0000","last_undegraded":"2024-09-12T18:35:33.095958+0000","last_fullsized":"2024-09-12T18:35:33.095958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:40.925757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":32,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410589+0000","last_change":"2024-09-12T18:35:22.459049+0000","last_active":"2024-09-12T18:35:32.410589+0000","last_peered":"2024-09-12T18:35:32.410589+0000","last_clean":"2024-09-12T18:35:32.410589+0000","last_became_active":"2024-09-12T18:35:20.446814+0000","last_became_peered":"2024-09-12T18:35:20.446814+0000","last_unstale":"2024-09-12T18:35:32.410589+0000","last_undegraded":"2024-09-12T18:35:32.410589+0000","last_fullsized":"2024-09-12T18:35:32.410589+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:18.033595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010716149999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409453+0000","last_change":"2024-09-12T18:35:24.658273+0000","last_active":"2024-09-12T18:35:32.409453+0000","last_peered":"2024-09-12T18:35:32.409453+0000","last_clean":"2024-09-12T18:35:32.409453+0000","last_became_active":"2024-09-12T18:35:24.657433+0000","last_became_peered":"2024-09-12T18:35:24.657433+0000","last_unstale":"2024-09-12T18:35:32.409453+0000","last_undegraded":"2024-09-12T18:35:32.409453+0000","last_fullsized":"2024-09-12T18:35:32.409453+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:48.497218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095434+0000","last_change":"2024-09-12T18:35:25.655830+0000","last_active":"2024-09-12T18:35:33.095434+0000","last_peered":"2024-09-12T18:35:33.095434+0000","last_clean":"2024-09-12T18:35:33.095434+0000","last_became_active":"2024-09-12T18:35:25.652126+0000","last_became_peered":"2024-09-12T18:35:25.652126+0000","last_unstale":"2024-09-12T18:35:33.095434+0000","last_undegraded":"2024-09-12T18:35:33.095434+0000","last_fullsized":"2024-09-12T18:35:33.095434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:04.080721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410902+0000","last_change":"2024-09-12T18:35:24.657618+0000","last_active":"2024-09-12T18:35:32.410902+0000","last_peered":"2024-09-12T18:35:32.410902+0000","last_clean":"2024-09-12T18:35:32.410902+0000","last_became_active":"2024-09-12T18:35:24.656741+0000","last_became_peered":"2024-09-12T18:35:24.656741+0000","last_unstale":"2024-09-12T18:35:32.410902+0000","last_undegraded":"2024-09-12T18:35:32.410902+0000","last_fullsized":"2024-09-12T18:35:32.410902+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:43.113104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095849+0000","last_change":"2024-09-12T18:35:22.464180+0000","last_active":"2024-09-12T18:35:33.095849+0000","last_peered":"2024-09-12T18:35:33.095849+0000","last_clean":"2024-09-12T18:35:33.095849+0000","last_became_active":"2024-09-12T18:35:20.442566+0000","last_became_peered":"2024-09-12T18:35:20.442566+0000","last_unstale":"2024-09-12T18:35:33.095849+0000","last_undegraded":"2024-09-12T18:35:33.095849+0000","last_fullsized":"2024-09-12T18:35:33.095849+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:29.021710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001325786,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408521+0000","last_change":"2024-09-12T18:35:25.650458+0000","last_active":"2024-09-12T18:35:32.408521+0000","last_peered":"2024-09-12T18:35:32.408521+0000","last_clean":"2024-09-12T18:35:32.408521+0000","last_became_active":"2024-09-12T18:35:25.648761+0000","last_became_peered":"2024-09-12T18:35:25.648761+0000","last_unstale":"2024-09-12T18:35:32.408521+0000","last_undegraded":"2024-09-12T18:35:32.408521+0000","last_fullsized":"2024-09-12T18:35:32.408521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:53.026950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.092506+0000","last_change":"2024-09-12T18:35:24.649669+0000","last_active":"2024-09-12T18:35:33.092506+0000","last_peered":"2024-09-12T18:35:33.092506+0000","last_clean":"2024-09-12T18:35:33.092506+0000","last_became_active":"2024-09-12T18:35:24.648881+0000","last_became_peered":"2024-09-12T18:35:24.648881+0000","last_unstale":"2024-09-12T18:35:33.092506+0000","last_undegraded":"2024-09-12T18:35:33.092506+0000","last_fullsized":"2024-09-12T18:35:33.092506+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:23.614734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410493+0000","last_change":"2024-09-12T18:35:22.458666+0000","last_active":"2024-09-12T18:35:32.410493+0000","last_peered":"2024-09-12T18:35:32.410493+0000","last_clean":"2024-09-12T18:35:32.410493+0000","last_became_active":"2024-09-12T18:35:20.442394+0000","last_became_peered":"2024-09-12T18:35:20.442394+0000","last_unstale":"2024-09-12T18:35:32.410493+0000","last_undegraded":"2024-09-12T18:35:32.410493+0000","last_fullsized":"2024-09-12T18:35:32.410493+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:51.840246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080163599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408846+0000","last_change":"2024-09-12T18:35:25.650717+0000","last_active":"2024-09-12T18:35:32.408846+0000","last_peered":"2024-09-12T18:35:32.408846+0000","last_clean":"2024-09-12T18:35:32.408846+0000","last_became_active":"2024-09-12T18:35:25.649147+0000","last_became_peered":"2024-09-12T18:35:25.649147+0000","last_unstale":"2024-09-12T18:35:32.408846+0000","last_undegraded":"2024-09-12T18:35:32.408846+0000","last_fullsized":"2024-09-12T18:35:32.408846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:07.365888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.093028+0000","last_change":"2024-09-12T18:35:24.657234+0000","last_active":"2024-09-12T18:35:33.093028+0000","last_peered":"2024-09-12T18:35:33.093028+0000","last_clean":"2024-09-12T18:35:33.093028+0000","last_became_active":"2024-09-12T18:35:24.655950+0000","last_became_peered":"2024-09-12T18:35:24.655950+0000","last_unstale":"2024-09-12T18:35:33.093028+0000","last_undegraded":"2024-09-12T18:35:33.093028+0000","last_fullsized":"2024-09-12T18:35:33.093028+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:17.466623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.096388+0000","last_change":"2024-09-12T18:35:22.464656+0000","last_active":"2024-09-12T18:35:33.096388+0000","last_peered":"2024-09-12T18:35:33.096388+0000","last_clean":"2024-09-12T18:35:33.096388+0000","last_became_active":"2024-09-12T18:35:20.445470+0000","last_became_peered":"2024-09-12T18:35:20.445470+0000","last_unstale":"2024-09-12T18:35:33.096388+0000","last_undegraded":"2024-09-12T18:35:33.096388+0000","last_fullsized":"2024-09-12T18:35:33.096388+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:58.947359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001742681,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.094350+0000","last_change":"2024-09-12T18:35:25.658887+0000","last_active":"2024-09-12T18:35:33.094350+0000","last_peered":"2024-09-12T18:35:33.094350+0000","last_clean":"2024-09-12T18:35:33.094350+0000","last_became_active":"2024-09-12T18:35:25.656829+0000","last_became_peered":"2024-09-12T18:35:25.656829+0000","last_unstale":"2024-09-12T18:35:33.094350+0000","last_undegraded":"2024-09-12T18:35:33.094350+0000","last_fullsized":"2024-09-12T18:35:33.094350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:50.109858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.092649+0000","last_change":"2024-09-12T18:35:24.654518+0000","last_active":"2024-09-12T18:35:33.092649+0000","last_peered":"2024-09-12T18:35:33.092649+0000","last_clean":"2024-09-12T18:35:33.092649+0000","last_became_active":"2024-09-12T18:35:24.650309+0000","last_became_peered":"2024-09-12T18:35:24.650309+0000","last_unstale":"2024-09-12T18:35:33.092649+0000","last_undegraded":"2024-09-12T18:35:33.092649+0000","last_fullsized":"2024-09-12T18:35:33.092649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:16.669035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410632+0000","last_change":"2024-09-12T18:35:22.459767+0000","last_active":"2024-09-12T18:35:32.410632+0000","last_peered":"2024-09-12T18:35:32.410632+0000","last_clean":"2024-09-12T18:35:32.410632+0000","last_became_active":"2024-09-12T18:35:20.448521+0000","last_became_peered":"2024-09-12T18:35:20.448521+0000","last_unstale":"2024-09-12T18:35:32.410632+0000","last_undegraded":"2024-09-12T18:35:32.410632+0000","last_fullsized":"2024-09-12T18:35:32.410632+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:33.463792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017009670000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408128+0000","last_change":"2024-09-12T18:35:25.648150+0000","last_active":"2024-09-12T18:35:32.408128+0000","last_peered":"2024-09-12T18:35:32.408128+0000","last_clean":"2024-09-12T18:35:32.408128+0000","last_became_active":"2024-09-12T18:35:25.647347+0000","last_became_peered":"2024-09-12T18:35:25.647347+0000","last_unstale":"2024-09-12T18:35:32.408128+0000","last_undegraded":"2024-09-12T18:35:32.408128+0000","last_fullsized":"2024-09-12T18:35:32.408128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:48.968336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408750+0000","last_change":"2024-09-12T18:35:25.660696+0000","last_active":"2024-09-12T18:35:32.408750+0000","last_peered":"2024-09-12T18:35:32.408750+0000","last_clean":"2024-09-12T18:35:32.408750+0000","last_became_active":"2024-09-12T18:35:25.659827+0000","last_became_peered":"2024-09-12T18:35:25.659827+0000","last_unstale":"2024-09-12T18:35:32.408750+0000","last_undegraded":"2024-09-12T18:35:32.408750+0000","last_fullsized":"2024-09-12T18:35:32.408750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:15.678289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":23,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409994+0000","last_change":"2024-09-12T18:35:24.655051+0000","last_active":"2024-09-12T18:35:32.409994+0000","last_peered":"2024-09-12T18:35:32.409994+0000","last_clean":"2024-09-12T18:35:32.409994+0000","last_became_active":"2024-09-12T18:35:24.654282+0000","last_became_peered":"2024-09-12T18:35:24.654282+0000","last_unstale":"2024-09-12T18:35:32.409994+0000","last_undegraded":"2024-09-12T18:35:32.409994+0000","last_fullsized":"2024-09-12T18:35:32.409994+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:08.159799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.094530+0000","last_change":"2024-09-12T18:35:25.659237+0000","last_active":"2024-09-12T18:35:33.094530+0000","last_peered":"2024-09-12T18:35:33.094530+0000","last_clean":"2024-09-12T18:35:33.094530+0000","last_became_active":"2024-09-12T18:35:25.658423+0000","last_became_peered":"2024-09-12T18:35:25.658423+0000","last_unstale":"2024-09-12T18:35:33.094530+0000","last_undegraded":"2024-09-12T18:35:33.094530+0000","last_fullsized":"2024-09-12T18:35:33.094530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:42.956934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410294+0000","last_change":"2024-09-12T18:35:24.648658+0000","last_active":"2024-09-12T18:35:32.410294+0000","last_peered":"2024-09-12T18:35:32.410294+0000","last_clean":"2024-09-12T18:35:32.410294+0000","last_became_active":"2024-09-12T18:35:24.647826+0000","last_became_peered":"2024-09-12T18:35:24.647826+0000","last_unstale":"2024-09-12T18:35:32.410294+0000","last_undegraded":"2024-09-12T18:35:32.410294+0000","last_fullsized":"2024-09-12T18:35:32.410294+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:24.167549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410026+0000","last_change":"2024-09-12T18:35:24.656855+0000","last_active":"2024-09-12T18:35:32.410026+0000","last_peered":"2024-09-12T18:35:32.410026+0000","last_clean":"2024-09-12T18:35:32.410026+0000","last_became_active":"2024-09-12T18:35:24.655935+0000","last_became_peered":"2024-09-12T18:35:24.655935+0000","last_unstale":"2024-09-12T18:35:32.410026+0000","last_undegraded":"2024-09-12T18:35:32.410026+0000","last_fullsized":"2024-09-12T18:35:32.410026+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:35.430065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.094515+0000","last_change":"2024-09-12T18:35:25.661801+0000","last_active":"2024-09-12T18:35:33.094515+0000","last_peered":"2024-09-12T18:35:33.094515+0000","last_clean":"2024-09-12T18:35:33.094515+0000","last_became_active":"2024-09-12T18:35:25.658476+0000","last_became_peered":"2024-09-12T18:35:25.658476+0000","last_unstale":"2024-09-12T18:35:33.094515+0000","last_undegraded":"2024-09-12T18:35:33.094515+0000","last_fullsized":"2024-09-12T18:35:33.094515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:58.246449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.092953+0000","last_change":"2024-09-12T18:35:24.652399+0000","last_active":"2024-09-12T18:35:33.092953+0000","last_peered":"2024-09-12T18:35:33.092953+0000","last_clean":"2024-09-12T18:35:33.092953+0000","last_became_active":"2024-09-12T18:35:24.651416+0000","last_became_peered":"2024-09-12T18:35:24.651416+0000","last_unstale":"2024-09-12T18:35:33.092953+0000","last_undegraded":"2024-09-12T18:35:33.092953+0000","last_fullsized":"2024-09-12T18:35:33.092953+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:32.594978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.094275+0000","last_change":"2024-09-12T18:35:25.658570+0000","last_active":"2024-09-12T18:35:33.094275+0000","last_peered":"2024-09-12T18:35:33.094275+0000","last_clean":"2024-09-12T18:35:33.094275+0000","last_became_active":"2024-09-12T18:35:25.656561+0000","last_became_peered":"2024-09-12T18:35:25.656561+0000","last_unstale":"2024-09-12T18:35:33.094275+0000","last_undegraded":"2024-09-12T18:35:33.094275+0000","last_fullsized":"2024-09-12T18:35:33.094275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:22.225756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.410369+0000","last_change":"2024-09-12T18:35:25.651217+0000","last_active":"2024-09-12T18:35:32.410369+0000","last_peered":"2024-09-12T18:35:32.410369+0000","last_clean":"2024-09-12T18:35:32.410369+0000","last_became_active":"2024-09-12T18:35:25.649544+0000","last_became_peered":"2024-09-12T18:35:25.649544+0000","last_unstale":"2024-09-12T18:35:32.410369+0000","last_undegraded":"2024-09-12T18:35:32.410369+0000","last_fullsized":"2024-09-12T18:35:32.410369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:41.601376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.093421+0000","last_change":"2024-09-12T18:35:24.657489+0000","last_active":"2024-09-12T18:35:33.093421+0000","last_peered":"2024-09-12T18:35:33.093421+0000","last_clean":"2024-09-12T18:35:33.093421+0000","last_became_active":"2024-09-12T18:35:24.656030+0000","last_became_peered":"2024-09-12T18:35:24.656030+0000","last_unstale":"2024-09-12T18:35:33.093421+0000","last_undegraded":"2024-09-12T18:35:33.093421+0000","last_fullsized":"2024-09-12T18:35:33.093421+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:11.362759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.095761+0000","last_change":"2024-09-12T18:35:25.661544+0000","last_active":"2024-09-12T18:35:33.095761+0000","last_peered":"2024-09-12T18:35:33.095761+0000","last_clean":"2024-09-12T18:35:33.095761+0000","last_became_active":"2024-09-12T18:35:25.656985+0000","last_became_peered":"2024-09-12T18:35:25.656985+0000","last_unstale":"2024-09-12T18:35:33.095761+0000","last_undegraded":"2024-09-12T18:35:33.095761+0000","last_fullsized":"2024-09-12T18:35:33.095761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.092175+0000","last_change":"2024-09-12T18:35:24.646342+0000","last_active":"2024-09-12T18:35:33.092175+0000","last_peered":"2024-09-12T18:35:33.092175+0000","last_clean":"2024-09-12T18:35:33.092175+0000","last_became_active":"2024-09-12T18:35:24.644773+0000","last_became_peered":"2024-09-12T18:35:24.644773+0000","last_unstale":"2024-09-12T18:35:33.092175+0000","last_undegraded":"2024-09-12T18:35:33.092175+0000","last_fullsized":"2024-09-12T18:35:33.092175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:17.011231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409241+0000","last_change":"2024-09-12T18:35:25.656712+0000","last_active":"2024-09-12T18:35:32.409241+0000","last_peered":"2024-09-12T18:35:32.409241+0000","last_clean":"2024-09-12T18:35:32.409241+0000","last_became_active":"2024-09-12T18:35:25.654473+0000","last_became_peered":"2024-09-12T18:35:25.654473+0000","last_unstale":"2024-09-12T18:35:32.409241+0000","last_undegraded":"2024-09-12T18:35:32.409241+0000","last_fullsized":"2024-09-12T18:35:32.409241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:01.464680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408790+0000","last_change":"2024-09-12T18:35:24.659935+0000","last_active":"2024-09-12T18:35:32.408790+0000","last_peered":"2024-09-12T18:35:32.408790+0000","last_clean":"2024-09-12T18:35:32.408790+0000","last_became_active":"2024-09-12T18:35:24.659111+0000","last_became_peered":"2024-09-12T18:35:24.659111+0000","last_unstale":"2024-09-12T18:35:32.408790+0000","last_undegraded":"2024-09-12T18:35:32.408790+0000","last_fullsized":"2024-09-12T18:35:32.408790+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:11.480154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409283+0000","last_change":"2024-09-12T18:35:25.660557+0000","last_active":"2024-09-12T18:35:32.409283+0000","last_peered":"2024-09-12T18:35:32.409283+0000","last_clean":"2024-09-12T18:35:32.409283+0000","last_became_active":"2024-09-12T18:35:25.652300+0000","last_became_peered":"2024-09-12T18:35:25.652300+0000","last_unstale":"2024-09-12T18:35:32.409283+0000","last_undegraded":"2024-09-12T18:35:32.409283+0000","last_fullsized":"2024-09-12T18:35:32.409283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:10:59.995841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409107+0000","last_change":"2024-09-12T18:35:24.638538+0000","last_active":"2024-09-12T18:35:32.409107+0000","last_peered":"2024-09-12T18:35:32.409107+0000","last_clean":"2024-09-12T18:35:32.409107+0000","last_became_active":"2024-09-12T18:35:24.637242+0000","last_became_peered":"2024-09-12T18:35:24.637242+0000","last_unstale":"2024-09-12T18:35:32.409107+0000","last_undegraded":"2024-09-12T18:35:32.409107+0000","last_fullsized":"2024-09-12T18:35:32.409107+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:26.877441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408680+0000","last_change":"2024-09-12T18:35:25.662537+0000","last_active":"2024-09-12T18:35:32.408680+0000","last_peered":"2024-09-12T18:35:32.408680+0000","last_clean":"2024-09-12T18:35:32.408680+0000","last_became_active":"2024-09-12T18:35:25.661441+0000","last_became_peered":"2024-09-12T18:35:25.661441+0000","last_unstale":"2024-09-12T18:35:32.408680+0000","last_undegraded":"2024-09-12T18:35:32.408680+0000","last_fullsized":"2024-09-12T18:35:32.408680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:14.397867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409631+0000","last_change":"2024-09-12T18:35:24.657635+0000","last_active":"2024-09-12T18:35:32.409631+0000","last_peered":"2024-09-12T18:35:32.409631+0000","last_clean":"2024-09-12T18:35:32.409631+0000","last_became_active":"2024-09-12T18:35:24.655992+0000","last_became_peered":"2024-09-12T18:35:24.655992+0000","last_unstale":"2024-09-12T18:35:32.409631+0000","last_undegraded":"2024-09-12T18:35:32.409631+0000","last_fullsized":"2024-09-12T18:35:32.409631+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:33.536755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409233+0000","last_change":"2024-09-12T18:35:25.651406+0000","last_active":"2024-09-12T18:35:32.409233+0000","last_peered":"2024-09-12T18:35:32.409233+0000","last_clean":"2024-09-12T18:35:32.409233+0000","last_became_active":"2024-09-12T18:35:25.649728+0000","last_became_peered":"2024-09-12T18:35:25.649728+0000","last_unstale":"2024-09-12T18:35:32.409233+0000","last_undegraded":"2024-09-12T18:35:32.409233+0000","last_fullsized":"2024-09-12T18:35:32.409233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:41.773283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409723+0000","last_change":"2024-09-12T18:35:24.649153+0000","last_active":"2024-09-12T18:35:32.409723+0000","last_peered":"2024-09-12T18:35:32.409723+0000","last_clean":"2024-09-12T18:35:32.409723+0000","last_became_active":"2024-09-12T18:35:24.648512+0000","last_became_peered":"2024-09-12T18:35:24.648512+0000","last_unstale":"2024-09-12T18:35:32.409723+0000","last_undegraded":"2024-09-12T18:35:32.409723+0000","last_fullsized":"2024-09-12T18:35:32.409723+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:07.810456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.409441+0000","last_change":"2024-09-12T18:35:25.656799+0000","last_active":"2024-09-12T18:35:32.409441+0000","last_peered":"2024-09-12T18:35:32.409441+0000","last_clean":"2024-09-12T18:35:32.409441+0000","last_became_active":"2024-09-12T18:35:25.654980+0000","last_became_peered":"2024-09-12T18:35:25.654980+0000","last_unstale":"2024-09-12T18:35:32.409441+0000","last_undegraded":"2024-09-12T18:35:32.409441+0000","last_fullsized":"2024-09-12T18:35:32.409441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:10.735439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.092729+0000","last_change":"2024-09-12T18:35:24.656268+0000","last_active":"2024-09-12T18:35:33.092729+0000","last_peered":"2024-09-12T18:35:33.092729+0000","last_clean":"2024-09-12T18:35:33.092729+0000","last_became_active":"2024-09-12T18:35:24.655420+0000","last_became_peered":"2024-09-12T18:35:24.655420+0000","last_unstale":"2024-09-12T18:35:33.092729+0000","last_undegraded":"2024-09-12T18:35:33.092729+0000","last_fullsized":"2024-09-12T18:35:33.092729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:04.654666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:32.408359+0000","last_change":"2024-09-12T18:35:25.661042+0000","last_active":"2024-09-12T18:35:32.408359+0000","last_peered":"2024-09-12T18:35:32.408359+0000","last_clean":"2024-09-12T18:35:32.408359+0000","last_became_active":"2024-09-12T18:35:25.660163+0000","last_became_peered":"2024-09-12T18:35:25.660163+0000","last_unstale":"2024-09-12T18:35:32.408359+0000","last_undegraded":"2024-09-12T18:35:32.408359+0000","last_fullsized":"2024-09-12T18:35:32.408359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:37.682184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:35:33.093423+0000","last_change":"2024-09-12T18:35:24.652304+0000","last_active":"2024-09-12T18:35:33.093423+0000","last_peered":"2024-09-12T18:35:33.093423+0000","last_clean":"2024-09-12T18:35:33.093423+0000","last_became_active":"2024-09-12T18:35:24.651460+0000","last_became_peered":"2024-09-12T18:35:24.651460+0000","last_unstale":"2024-09-12T18:35:33.093423+0000","last_undegraded":"2024-09-12T18:35:33.093423+0000","last_fullsized":"2024-09-12T18:35:33.093423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:42.050557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705672,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":262144,"data_stored":655733,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738377,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":274432,"data_stored":656368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":64206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:35:42.444 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T18:35:42.444 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-12T18:35:42.774 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 20 2024-09-12T18:35:42.775 INFO:teuthology.orchestra.run.smithi073.stdout:fsid c08d5a84-711b-44bf-bdf1-e06ecc2c7c00 2024-09-12T18:35:42.775 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-09-12T18:35:02.695853+0000 2024-09-12T18:35:42.775 INFO:teuthology.orchestra.run.smithi073.stdout:modified 2024-09-12T18:35:32.399204+0000 2024-09-12T18:35:42.775 INFO:teuthology.orchestra.run.smithi073.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-12T18:35:42.775 INFO:teuthology.orchestra.run.smithi073.stdout:crush_version 5 2024-09-12T18:35:42.775 INFO:teuthology.orchestra.run.smithi073.stdout:full_ratio 0.95 2024-09-12T18:35:42.775 INFO:teuthology.orchestra.run.smithi073.stdout:backfillfull_ratio 0.9 2024-09-12T18:35:42.775 INFO:teuthology.orchestra.run.smithi073.stdout:nearfull_ratio 0.85 2024-09-12T18:35:42.775 INFO:teuthology.orchestra.run.smithi073.stdout:require_min_compat_client luminous 2024-09-12T18:35:42.775 INFO:teuthology.orchestra.run.smithi073.stdout:min_compat_client jewel 2024-09-12T18:35:42.775 INFO:teuthology.orchestra.run.smithi073.stdout:require_osd_release squid 2024-09-12T18:35:42.775 INFO:teuthology.orchestra.run.smithi073.stdout:stretch_mode_enabled false 2024-09-12T18:35:42.775 INFO:teuthology.orchestra.run.smithi073.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 11 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 2.99 2024-09-12T18:35:42.776 INFO:teuthology.orchestra.run.smithi073.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 15 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 1.50 2024-09-12T18:35:42.776 INFO:teuthology.orchestra.run.smithi073.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 18 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.13 2024-09-12T18:35:42.776 INFO:teuthology.orchestra.run.smithi073.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 19 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.13 2024-09-12T18:35:42.776 INFO:teuthology.orchestra.run.smithi073.stdout:max_osd 3 2024-09-12T18:35:42.776 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.114:6800/2710632206,v1:172.21.15.114:6801/2710632206] [v2:172.21.15.114:6802/2710632206,v1:172.21.15.114:6803/2710632206] exists,up f1cf24e8-6179-4666-a444-fa81ef0d7482 2024-09-12T18:35:42.776 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1 up in weight 1 up_from 9 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.143:6800/862189968,v1:172.21.15.143:6801/862189968] [v2:172.21.15.143:6802/862189968,v1:172.21.15.143:6803/862189968] exists,up 3fdb0044-2820-4411-978b-4b6e94fbf0b1 2024-09-12T18:35:42.776 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.162:6800/1397104153,v1:172.21.15.162:6801/1397104153] [v2:172.21.15.162:6802/1397104153,v1:172.21.15.162:6803/1397104153] exists,up 6fb554da-561f-4aa2-b855-0e3adb98b057 2024-09-12T18:35:42.792 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.114:6800/2710632206,v1:172.21.15.114:6801/2710632206] [v2:172.21.15.114:6802/2710632206,v1:172.21.15.114:6803/2710632206] exists,up f1cf24e8-6179-4666-a444-fa81ef0d7482', 'osd.1 up in weight 1 up_from 9 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.143:6800/862189968,v1:172.21.15.143:6801/862189968] [v2:172.21.15.143:6802/862189968,v1:172.21.15.143:6803/862189968] exists,up 3fdb0044-2820-4411-978b-4b6e94fbf0b1', 'osd.2 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.162:6800/1397104153,v1:172.21.15.162:6801/1397104153] [v2:172.21.15.162:6802/1397104153,v1:172.21.15.162:6803/1397104153] exists,up 6fb554da-561f-4aa2-b855-0e3adb98b057'] 2024-09-12T18:35:42.792 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-12T18:35:42.905 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T18:35:42.905 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mon.a", 2024-09-12T18:35:42.905 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster": "ceph", 2024-09-12T18:35:42.905 INFO:teuthology.orchestra.run.smithi073.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-12T18:35:42.905 INFO:teuthology.orchestra.run.smithi073.stdout: "admin_socket_mode": "", 2024-09-12T18:35:42.905 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-12T18:35:42.906 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_client_required": "cephx, none", 2024-09-12T18:35:42.906 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_cluster_required": "cephx", 2024-09-12T18:35:42.906 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_debug": "true", 2024-09-12T18:35:42.906 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-12T18:35:42.906 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-12T18:35:42.906 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_service_required": "cephx", 2024-09-12T18:35:42.906 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-12T18:35:42.906 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_supported": "cephx", 2024-09-12T18:35:42.906 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_aio": "true", 2024-09-12T18:35:42.906 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-12T18:35:42.906 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_aio_poll_ms": "250", 2024-09-12T18:35:42.906 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_aio_reap_max": "16", 2024-09-12T18:35:42.906 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_async_discard_threads": "0", 2024-09-12T18:35:42.907 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_block_size": "4096", 2024-09-12T18:35:42.907 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_debug_aio": "false", 2024-09-12T18:35:42.907 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-12T18:35:42.907 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-12T18:35:42.907 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_debug_inflight_ios": "false", 2024-09-12T18:35:42.907 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_enable_discard": "false", 2024-09-12T18:35:42.907 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_flock_retry": "3", 2024-09-12T18:35:42.907 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-12T18:35:42.907 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_inject_crash": "0", 2024-09-12T18:35:42.907 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-12T18:35:42.907 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_ioring": "false", 2024-09-12T18:35:42.907 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_ioring_hipri": "false", 2024-09-12T18:35:42.907 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-12T18:35:42.908 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-12T18:35:42.908 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-12T18:35:42.908 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-12T18:35:42.908 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-12T18:35:42.908 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-12T18:35:42.908 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_type": "", 2024-09-12T18:35:42.908 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_alloc_size": "1048576", 2024-09-12T18:35:42.908 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_allocator": "hybrid", 2024-09-12T18:35:42.908 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_buffered_io": "true", 2024-09-12T18:35:42.908 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_check_for_zeros": "false", 2024-09-12T18:35:42.908 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-12T18:35:42.908 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-12T18:35:42.908 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_compact_log_sync": "false", 2024-09-12T18:35:42.908 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-12T18:35:42.909 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-12T18:35:42.909 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-12T18:35:42.909 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-12T18:35:42.909 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_max_log_runway": "4194304", 2024-09-12T18:35:42.909 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_max_prefetch": "1048576", 2024-09-12T18:35:42.909 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_min_flush_size": "524288", 2024-09-12T18:35:42.909 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_min_log_runway": "1048576", 2024-09-12T18:35:42.909 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_replay_recovery": "false", 2024-09-12T18:35:42.909 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-12T18:35:42.909 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-12T18:35:42.909 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_sync_write": "false", 2024-09-12T18:35:42.909 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-12T18:35:42.909 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-12T18:35:42.910 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-12T18:35:42.910 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_allocation_from_file": "true", 2024-09-12T18:35:42.910 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_allocator": "hybrid", 2024-09-12T18:35:42.910 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_async_db_compaction": "true", 2024-09-12T18:35:42.910 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-12T18:35:42.910 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-12T18:35:42.910 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-12T18:35:42.910 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-12T18:35:42.910 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_bdev_label_multi": "true", 2024-09-12T18:35:42.910 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-12T18:35:42.910 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-12T18:35:42.910 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-12T18:35:42.910 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-12T18:35:42.910 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-12T18:35:42.911 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_block_create": "true", 2024-09-12T18:35:42.911 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_block_db_create": "false", 2024-09-12T18:35:42.911 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_block_db_path": "", 2024-09-12T18:35:42.911 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_block_db_size": "0", 2024-09-12T18:35:42.911 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_block_path": "", 2024-09-12T18:35:42.911 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_block_preallocate_file": "false", 2024-09-12T18:35:42.911 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_block_size": "107374182400", 2024-09-12T18:35:42.911 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_block_wal_create": "false", 2024-09-12T18:35:42.911 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_block_wal_path": "", 2024-09-12T18:35:42.911 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_block_wal_size": "100663296", 2024-09-12T18:35:42.911 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_bluefs": "true", 2024-09-12T18:35:42.911 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-12T18:35:42.912 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-12T18:35:42.912 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-12T18:35:42.912 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_btree2_alloc_weight_factor": "2.000000", 2024-09-12T18:35:42.912 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-12T18:35:42.912 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-12T18:35:42.912 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-12T18:35:42.912 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-12T18:35:42.912 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-12T18:35:42.912 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_autotune": "true", 2024-09-12T18:35:42.912 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-12T18:35:42.912 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-12T18:35:42.912 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-12T18:35:42.912 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-12T18:35:42.913 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_size": "0", 2024-09-12T18:35:42.913 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-12T18:35:42.913 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-12T18:35:42.913 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-12T18:35:42.913 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-12T18:35:42.913 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_type": "2q", 2024-09-12T18:35:42.913 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-12T18:35:42.913 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_clone_cow": "true", 2024-09-12T18:35:42.913 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-12T18:35:42.913 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-12T18:35:42.913 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-12T18:35:42.913 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-12T18:35:42.913 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-12T18:35:42.914 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-12T18:35:42.914 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-12T18:35:42.914 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_compression_mode": "none", 2024-09-12T18:35:42.914 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-12T18:35:42.914 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_csum_type": "crc32c", 2024-09-12T18:35:42.914 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2024-09-12T18:35:42.915 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-12T18:35:42.915 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_freelist": "false", 2024-09-12T18:35:42.915 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-12T18:35:42.915 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-12T18:35:42.915 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-12T18:35:42.915 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-12T18:35:42.915 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-12T18:35:42.916 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-12T18:35:42.916 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-12T18:35:42.916 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-12T18:35:42.916 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-12T18:35:42.916 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-12T18:35:42.916 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-12T18:35:42.916 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-12T18:35:42.916 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_small_allocations": "0", 2024-09-12T18:35:42.916 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-12T18:35:42.916 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_default_buffered_read": "true", 2024-09-12T18:35:42.916 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_default_buffered_write": "false", 2024-09-12T18:35:42.916 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-12T18:35:42.916 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-12T18:35:42.917 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-12T18:35:42.917 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-12T18:35:42.917 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-12T18:35:42.917 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-12T18:35:42.917 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-12T18:35:42.917 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-12T18:35:42.917 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-12T18:35:42.917 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fail_eio": "false", 2024-09-12T18:35:42.917 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-12T18:35:42.917 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-12T18:35:42.917 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-12T18:35:42.917 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-12T18:35:42.917 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-12T18:35:42.918 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-12T18:35:42.918 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_on_mount": "false", 2024-09-12T18:35:42.918 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-12T18:35:42.918 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_on_umount": "false", 2024-09-12T18:35:42.918 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-12T18:35:42.918 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-12T18:35:42.918 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-12T18:35:42.919 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-12T18:35:42.919 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-12T18:35:42.919 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-12T18:35:42.919 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-12T18:35:42.919 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-12T18:35:42.919 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_ignore_data_csum": "false", 2024-09-12T18:35:42.919 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-12T18:35:42.919 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-12T18:35:42.919 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-12T18:35:42.919 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-12T18:35:42.920 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_log_op_age": "5.000000", 2024-09-12T18:35:42.920 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_max_alloc_size": "0", 2024-09-12T18:35:42.920 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_max_blob_size": "0", 2024-09-12T18:35:42.920 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-12T18:35:42.920 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-12T18:35:42.920 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-12T18:35:42.920 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_max_deferred_txc": "32", 2024-09-12T18:35:42.920 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_min_alloc_size": "0", 2024-09-12T18:35:42.920 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-12T18:35:42.920 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-12T18:35:42.920 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_nid_prealloc": "1024", 2024-09-12T18:35:42.920 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-12T18:35:42.920 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-12T18:35:42.921 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-12T18:35:42.921 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-12T18:35:42.921 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_retry_disk_reads": "3", 2024-09-12T18:35:42.921 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_rocksdb_cf": "true", 2024-09-12T18:35:42.921 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-12T18:35:42.921 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-12T18:35:42.921 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-12T18:35:42.921 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-12T18:35:42.921 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-12T18:35:42.921 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-12T18:35:42.921 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-12T18:35:42.921 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-12T18:35:42.921 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_spdk_mem": "512", 2024-09-12T18:35:42.922 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-12T18:35:42.922 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-12T18:35:42.922 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-12T18:35:42.922 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-12T18:35:42.922 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-12T18:35:42.922 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-12T18:35:42.922 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-12T18:35:42.922 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_tracing": "false", 2024-09-12T18:35:42.922 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-12T18:35:42.922 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-12T18:35:42.922 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-12T18:35:42.922 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-12T18:35:42.922 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-12T18:35:42.923 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-12T18:35:42.923 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-12T18:35:42.923 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-12T18:35:42.923 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-12T18:35:42.923 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_write_v2": "false", 2024-09-12T18:35:42.923 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_write_v2_random": "false", 2024-09-12T18:35:42.923 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_zero_block_detection": "false", 2024-09-12T18:35:42.923 INFO:teuthology.orchestra.run.smithi073.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-12T18:35:42.923 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-12T18:35:42.924 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-12T18:35:42.924 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-12T18:35:42.924 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-12T18:35:42.924 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-12T18:35:42.924 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-12T18:35:42.924 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-12T18:35:42.924 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-12T18:35:42.924 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-12T18:35:42.924 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-12T18:35:42.924 INFO:teuthology.orchestra.run.smithi073.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-12T18:35:42.925 INFO:teuthology.orchestra.run.smithi073.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-12T18:35:42.925 INFO:teuthology.orchestra.run.smithi073.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-12T18:35:42.925 INFO:teuthology.orchestra.run.smithi073.stdout: "cephx_cluster_require_signatures": "false", 2024-09-12T18:35:42.925 INFO:teuthology.orchestra.run.smithi073.stdout: "cephx_cluster_require_version": "2", 2024-09-12T18:35:42.925 INFO:teuthology.orchestra.run.smithi073.stdout: "cephx_require_signatures": "false", 2024-09-12T18:35:42.925 INFO:teuthology.orchestra.run.smithi073.stdout: "cephx_require_version": "2", 2024-09-12T18:35:42.925 INFO:teuthology.orchestra.run.smithi073.stdout: "cephx_service_require_signatures": "false", 2024-09-12T18:35:42.925 INFO:teuthology.orchestra.run.smithi073.stdout: "cephx_service_require_version": "2", 2024-09-12T18:35:42.926 INFO:teuthology.orchestra.run.smithi073.stdout: "cephx_sign_messages": "true", 2024-09-12T18:35:42.926 INFO:teuthology.orchestra.run.smithi073.stdout: "chdir": "", 2024-09-12T18:35:42.926 INFO:teuthology.orchestra.run.smithi073.stdout: "client_acl_type": "", 2024-09-12T18:35:42.926 INFO:teuthology.orchestra.run.smithi073.stdout: "client_asio_thread_count": "2", 2024-09-12T18:35:42.926 INFO:teuthology.orchestra.run.smithi073.stdout: "client_cache_mid": "0.750000", 2024-09-12T18:35:42.926 INFO:teuthology.orchestra.run.smithi073.stdout: "client_cache_size": "16384", 2024-09-12T18:35:42.926 INFO:teuthology.orchestra.run.smithi073.stdout: "client_caps_release_delay": "5", 2024-09-12T18:35:42.926 INFO:teuthology.orchestra.run.smithi073.stdout: "client_check_pool_perm": "true", 2024-09-12T18:35:42.926 INFO:teuthology.orchestra.run.smithi073.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-12T18:35:42.926 INFO:teuthology.orchestra.run.smithi073.stdout: "client_debug_force_sync_read": "false", 2024-09-12T18:35:42.926 INFO:teuthology.orchestra.run.smithi073.stdout: "client_debug_getattr_caps": "false", 2024-09-12T18:35:42.926 INFO:teuthology.orchestra.run.smithi073.stdout: "client_debug_inject_features": "", 2024-09-12T18:35:42.926 INFO:teuthology.orchestra.run.smithi073.stdout: "client_debug_inject_tick_delay": "0", 2024-09-12T18:35:42.926 INFO:teuthology.orchestra.run.smithi073.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-12T18:35:42.927 INFO:teuthology.orchestra.run.smithi073.stdout: "client_die_on_failed_remount": "false", 2024-09-12T18:35:42.927 INFO:teuthology.orchestra.run.smithi073.stdout: "client_dirsize_rbytes": "true", 2024-09-12T18:35:42.927 INFO:teuthology.orchestra.run.smithi073.stdout: "client_force_lazyio": "false", 2024-09-12T18:35:42.927 INFO:teuthology.orchestra.run.smithi073.stdout: "client_fs": "", 2024-09-12T18:35:42.927 INFO:teuthology.orchestra.run.smithi073.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-12T18:35:42.927 INFO:teuthology.orchestra.run.smithi073.stdout: "client_inject_release_failure": "false", 2024-09-12T18:35:42.927 INFO:teuthology.orchestra.run.smithi073.stdout: "client_max_inline_size": "4096", 2024-09-12T18:35:42.927 INFO:teuthology.orchestra.run.smithi073.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-12T18:35:42.927 INFO:teuthology.orchestra.run.smithi073.stdout: "client_mds_namespace": "", 2024-09-12T18:35:42.927 INFO:teuthology.orchestra.run.smithi073.stdout: "client_metadata": "", 2024-09-12T18:35:42.927 INFO:teuthology.orchestra.run.smithi073.stdout: "client_mount_gid": "-1", 2024-09-12T18:35:42.927 INFO:teuthology.orchestra.run.smithi073.stdout: "client_mount_timeout": "300", 2024-09-12T18:35:42.927 INFO:teuthology.orchestra.run.smithi073.stdout: "client_mount_uid": "-1", 2024-09-12T18:35:42.928 INFO:teuthology.orchestra.run.smithi073.stdout: "client_mountpoint": "/", 2024-09-12T18:35:42.928 INFO:teuthology.orchestra.run.smithi073.stdout: "client_notify_timeout": "10", 2024-09-12T18:35:42.928 INFO:teuthology.orchestra.run.smithi073.stdout: "client_oc": "true", 2024-09-12T18:35:42.928 INFO:teuthology.orchestra.run.smithi073.stdout: "client_oc_max_dirty": "104857600", 2024-09-12T18:35:42.928 INFO:teuthology.orchestra.run.smithi073.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-12T18:35:42.928 INFO:teuthology.orchestra.run.smithi073.stdout: "client_oc_max_objects": "1000", 2024-09-12T18:35:42.928 INFO:teuthology.orchestra.run.smithi073.stdout: "client_oc_size": "209715200", 2024-09-12T18:35:42.928 INFO:teuthology.orchestra.run.smithi073.stdout: "client_oc_target_dirty": "8388608", 2024-09-12T18:35:42.928 INFO:teuthology.orchestra.run.smithi073.stdout: "client_permissions": "true", 2024-09-12T18:35:42.928 INFO:teuthology.orchestra.run.smithi073.stdout: "client_quota": "true", 2024-09-12T18:35:42.928 INFO:teuthology.orchestra.run.smithi073.stdout: "client_quota_df": "true", 2024-09-12T18:35:42.928 INFO:teuthology.orchestra.run.smithi073.stdout: "client_readahead_max_bytes": "0", 2024-09-12T18:35:42.928 INFO:teuthology.orchestra.run.smithi073.stdout: "client_readahead_max_periods": "4", 2024-09-12T18:35:42.929 INFO:teuthology.orchestra.run.smithi073.stdout: "client_readahead_min": "131072", 2024-09-12T18:35:42.929 INFO:teuthology.orchestra.run.smithi073.stdout: "client_reconnect_stale": "false", 2024-09-12T18:35:42.929 INFO:teuthology.orchestra.run.smithi073.stdout: "client_shutdown_timeout": "30", 2024-09-12T18:35:42.929 INFO:teuthology.orchestra.run.smithi073.stdout: "client_snapdir": ".snap", 2024-09-12T18:35:42.929 INFO:teuthology.orchestra.run.smithi073.stdout: "client_tick_interval": "1", 2024-09-12T18:35:42.929 INFO:teuthology.orchestra.run.smithi073.stdout: "client_trace": "", 2024-09-12T18:35:42.929 INFO:teuthology.orchestra.run.smithi073.stdout: "client_try_dentry_invalidate": "false", 2024-09-12T18:35:42.929 INFO:teuthology.orchestra.run.smithi073.stdout: "client_use_faked_inos": "false", 2024-09-12T18:35:42.929 INFO:teuthology.orchestra.run.smithi073.stdout: "client_use_random_mds": "false", 2024-09-12T18:35:42.929 INFO:teuthology.orchestra.run.smithi073.stdout: "clog_to_graylog": "false", 2024-09-12T18:35:42.929 INFO:teuthology.orchestra.run.smithi073.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-12T18:35:42.929 INFO:teuthology.orchestra.run.smithi073.stdout: "clog_to_graylog_port": "12201", 2024-09-12T18:35:42.929 INFO:teuthology.orchestra.run.smithi073.stdout: "clog_to_monitors": "default=true", 2024-09-12T18:35:42.930 INFO:teuthology.orchestra.run.smithi073.stdout: "clog_to_syslog": "false", 2024-09-12T18:35:42.930 INFO:teuthology.orchestra.run.smithi073.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-12T18:35:42.930 INFO:teuthology.orchestra.run.smithi073.stdout: "clog_to_syslog_level": "info", 2024-09-12T18:35:42.930 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "-", 2024-09-12T18:35:42.930 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_network": "", 2024-09-12T18:35:42.930 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_network_interface": "", 2024-09-12T18:35:42.930 INFO:teuthology.orchestra.run.smithi073.stdout: "compressor_zlib_isal": "false", 2024-09-12T18:35:42.930 INFO:teuthology.orchestra.run.smithi073.stdout: "compressor_zlib_level": "5", 2024-09-12T18:35:42.930 INFO:teuthology.orchestra.run.smithi073.stdout: "compressor_zlib_winsize": "-15", 2024-09-12T18:35:42.930 INFO:teuthology.orchestra.run.smithi073.stdout: "compressor_zstd_level": "1", 2024-09-12T18:35:42.930 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-12T18:35:42.930 INFO:teuthology.orchestra.run.smithi073.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-12T18:35:42.930 INFO:teuthology.orchestra.run.smithi073.stdout: "crimson_alien_op_num_threads": "6", 2024-09-12T18:35:42.930 INFO:teuthology.orchestra.run.smithi073.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-12T18:35:42.931 INFO:teuthology.orchestra.run.smithi073.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-12T18:35:42.931 INFO:teuthology.orchestra.run.smithi073.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-12T18:35:42.931 INFO:teuthology.orchestra.run.smithi073.stdout: "crimson_osd_stat_interval": "0", 2024-09-12T18:35:42.931 INFO:teuthology.orchestra.run.smithi073.stdout: "crimson_seastar_cpu_cores": "", 2024-09-12T18:35:42.931 INFO:teuthology.orchestra.run.smithi073.stdout: "crimson_seastar_num_threads": "0", 2024-09-12T18:35:42.931 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "", 2024-09-12T18:35:42.931 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location_hook": "", 2024-09-12T18:35:42.931 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location_hook_timeout": "10", 2024-09-12T18:35:42.931 INFO:teuthology.orchestra.run.smithi073.stdout: "daemonize": "false", 2024-09-12T18:35:42.931 INFO:teuthology.orchestra.run.smithi073.stdout: "daos_pool": "tank", 2024-09-12T18:35:42.931 INFO:teuthology.orchestra.run.smithi073.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-12T18:35:42.931 INFO:teuthology.orchestra.run.smithi073.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-12T18:35:42.931 INFO:teuthology.orchestra.run.smithi073.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-12T18:35:42.932 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_alienstore": "0/5", 2024-09-12T18:35:42.932 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_allow_any_pool_priority": "false", 2024-09-12T18:35:42.932 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_asok": "1/5", 2024-09-12T18:35:42.932 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_asok_assert_abort": "false", 2024-09-12T18:35:42.932 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_asserts_on_shutdown": "true", 2024-09-12T18:35:42.932 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_auth": "20/20", 2024-09-12T18:35:42.932 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_bdev": "1/3", 2024-09-12T18:35:42.932 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_bluefs": "1/5", 2024-09-12T18:35:42.932 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_bluestore": "1/5", 2024-09-12T18:35:42.932 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_buffer": "0/1", 2024-09-12T18:35:42.932 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_ceph_dedup": "0/5", 2024-09-12T18:35:42.932 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_ceph_exporter": "1/5", 2024-09-12T18:35:42.932 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_cephfs_mirror": "0/5", 2024-09-12T18:35:42.932 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_cephsqlite": "0/5", 2024-09-12T18:35:42.933 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_client": "0/5", 2024-09-12T18:35:42.933 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_compressor": "1/5", 2024-09-12T18:35:42.933 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_context": "0/1", 2024-09-12T18:35:42.933 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_crimson_interrupt": "0/5", 2024-09-12T18:35:42.933 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_crush": "1/1", 2024-09-12T18:35:42.933 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_crypto": "1/5", 2024-09-12T18:35:42.933 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_cyanstore": "0/5", 2024-09-12T18:35:42.933 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_deliberately_leak_memory": "false", 2024-09-12T18:35:42.933 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_disable_randomized_ping": "false", 2024-09-12T18:35:42.933 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_dpdk": "1/5", 2024-09-12T18:35:42.933 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_eventtrace": "1/5", 2024-09-12T18:35:42.933 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_filer": "0/1", 2024-09-12T18:35:42.933 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_filestore": "1/3", 2024-09-12T18:35:42.934 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_finisher": "1/1", 2024-09-12T18:35:42.934 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_fuse": "1/5", 2024-09-12T18:35:42.934 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_heartbeat_testing_span": "0", 2024-09-12T18:35:42.934 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_heartbeatmap": "1/5", 2024-09-12T18:35:42.934 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-12T18:35:42.934 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_javaclient": "1/5", 2024-09-12T18:35:42.934 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_journal": "1/3", 2024-09-12T18:35:42.934 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_journaler": "0/5", 2024-09-12T18:35:42.934 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_kstore": "1/5", 2024-09-12T18:35:42.934 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_lockdep": "0/1", 2024-09-12T18:35:42.934 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_mclock": "1/5", 2024-09-12T18:35:42.934 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_mds": "1/5", 2024-09-12T18:35:42.934 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_mds_balancer": "1/5", 2024-09-12T18:35:42.934 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_mds_locker": "1/5", 2024-09-12T18:35:42.935 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_mds_log": "1/5", 2024-09-12T18:35:42.935 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_mds_log_expire": "1/5", 2024-09-12T18:35:42.935 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_mds_migrator": "1/5", 2024-09-12T18:35:42.935 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_mds_quiesce": "3/5", 2024-09-12T18:35:42.935 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_memstore": "1/5", 2024-09-12T18:35:42.935 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_mgr": "2/5", 2024-09-12T18:35:42.935 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_mgrc": "1/5", 2024-09-12T18:35:42.935 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_mon": "20/20", 2024-09-12T18:35:42.935 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_monc": "0/10", 2024-09-12T18:35:42.936 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_ms": "1/1", 2024-09-12T18:35:42.936 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_none": "0/5", 2024-09-12T18:35:42.936 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_objclass": "0/5", 2024-09-12T18:35:42.936 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_objectcacher": "0/5", 2024-09-12T18:35:42.936 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_objecter": "0/1", 2024-09-12T18:35:42.936 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_optracker": "0/5", 2024-09-12T18:35:42.936 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_osd": "1/5", 2024-09-12T18:35:42.936 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_paxos": "20/20", 2024-09-12T18:35:42.936 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_perfcounter": "1/5", 2024-09-12T18:35:42.936 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_prioritycache": "1/5", 2024-09-12T18:35:42.936 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rados": "0/5", 2024-09-12T18:35:42.936 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rbd": "0/5", 2024-09-12T18:35:42.937 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rbd_mirror": "0/5", 2024-09-12T18:35:42.937 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rbd_pwl": "0/5", 2024-09-12T18:35:42.937 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rbd_replay": "0/5", 2024-09-12T18:35:42.937 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_refs": "0/0", 2024-09-12T18:35:42.937 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_reserver": "1/1", 2024-09-12T18:35:42.937 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rgw": "1/5", 2024-09-12T18:35:42.937 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rgw_access": "1/5", 2024-09-12T18:35:42.937 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rgw_datacache": "1/5", 2024-09-12T18:35:42.937 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rgw_dbstore": "1/5", 2024-09-12T18:35:42.937 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rgw_flight": "1/5", 2024-09-12T18:35:42.937 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-12T18:35:42.937 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rgw_notification": "1/5", 2024-09-12T18:35:42.937 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rgw_sync": "1/5", 2024-09-12T18:35:42.937 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rocksdb": "4/5", 2024-09-12T18:35:42.938 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore": "0/5", 2024-09-12T18:35:42.938 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_backref": "0/5", 2024-09-12T18:35:42.938 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_cache": "0/5", 2024-09-12T18:35:42.938 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_cleaner": "0/5", 2024-09-12T18:35:42.938 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_device": "0/5", 2024-09-12T18:35:42.938 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_epm": "0/5", 2024-09-12T18:35:42.938 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-12T18:35:42.938 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_journal": "0/5", 2024-09-12T18:35:42.938 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_lba": "0/5", 2024-09-12T18:35:42.938 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_odata": "0/5", 2024-09-12T18:35:42.938 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_omap": "0/5", 2024-09-12T18:35:42.938 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_onode": "0/5", 2024-09-12T18:35:42.938 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_t": "0/5", 2024-09-12T18:35:42.939 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_tm": "0/5", 2024-09-12T18:35:42.939 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_striper": "0/1", 2024-09-12T18:35:42.939 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_test": "0/5", 2024-09-12T18:35:42.939 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_throttle": "1/1", 2024-09-12T18:35:42.940 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_timer": "0/1", 2024-09-12T18:35:42.940 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_tp": "0/5", 2024-09-12T18:35:42.940 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_trace": "1/5", 2024-09-12T18:35:42.940 INFO:teuthology.orchestra.run.smithi073.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-12T18:35:42.940 INFO:teuthology.orchestra.run.smithi073.stdout: "device_failure_prediction_mode": "none", 2024-09-12T18:35:42.940 INFO:teuthology.orchestra.run.smithi073.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-12T18:35:42.940 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-09-12T18:35:42.940 INFO:teuthology.orchestra.run.smithi073.stdout: "err_to_graylog": "false", 2024-09-12T18:35:42.940 INFO:teuthology.orchestra.run.smithi073.stdout: "err_to_journald": "false", 2024-09-12T18:35:42.940 INFO:teuthology.orchestra.run.smithi073.stdout: "err_to_stderr": "true", 2024-09-12T18:35:42.940 INFO:teuthology.orchestra.run.smithi073.stdout: "err_to_syslog": "false", 2024-09-12T18:35:42.940 INFO:teuthology.orchestra.run.smithi073.stdout: "event_tracing": "false", 2024-09-12T18:35:42.940 INFO:teuthology.orchestra.run.smithi073.stdout: "exporter_addr": "0.0.0.0", 2024-09-12T18:35:42.941 INFO:teuthology.orchestra.run.smithi073.stdout: "exporter_cert_file": "", 2024-09-12T18:35:42.941 INFO:teuthology.orchestra.run.smithi073.stdout: "exporter_http_port": "9926", 2024-09-12T18:35:42.941 INFO:teuthology.orchestra.run.smithi073.stdout: "exporter_key_file": "", 2024-09-12T18:35:42.941 INFO:teuthology.orchestra.run.smithi073.stdout: "exporter_prio_limit": "5", 2024-09-12T18:35:42.941 INFO:teuthology.orchestra.run.smithi073.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-12T18:35:42.941 INFO:teuthology.orchestra.run.smithi073.stdout: "exporter_sort_metrics": "true", 2024-09-12T18:35:42.941 INFO:teuthology.orchestra.run.smithi073.stdout: "exporter_stats_period": "5", 2024-09-12T18:35:42.941 INFO:teuthology.orchestra.run.smithi073.stdout: "fake_statfs_for_testing": "0", 2024-09-12T18:35:42.941 INFO:teuthology.orchestra.run.smithi073.stdout: "fatal_signal_handlers": "true", 2024-09-12T18:35:42.941 INFO:teuthology.orchestra.run.smithi073.stdout: "filer_max_purge_ops": "10", 2024-09-12T18:35:42.941 INFO:teuthology.orchestra.run.smithi073.stdout: "filer_max_truncate_ops": "128", 2024-09-12T18:35:42.941 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_apply_finisher_threads": "1", 2024-09-12T18:35:42.942 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_blackhole": "false", 2024-09-12T18:35:42.942 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_btrfs_clone_range": "true", 2024-09-12T18:35:42.942 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_btrfs_snap": "true", 2024-09-12T18:35:42.942 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_caller_concurrency": "10", 2024-09-12T18:35:42.942 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_collect_device_partition_information": "true", 2024-09-12T18:35:42.942 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_commit_timeout": "600.000000", 2024-09-12T18:35:42.942 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_debug_inject_read_err": "false", 2024-09-12T18:35:42.942 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_debug_omap_check": "false", 2024-09-12T18:35:42.942 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_debug_verify_split": "false", 2024-09-12T18:35:42.942 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_dump_file": "", 2024-09-12T18:35:42.942 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-12T18:35:42.942 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-12T18:35:42.942 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_fadvise": "true", 2024-09-12T18:35:42.942 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_fail_eio": "true", 2024-09-12T18:35:42.943 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_fd_cache_shards": "16", 2024-09-12T18:35:42.943 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_fd_cache_size": "128", 2024-09-12T18:35:42.943 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_fiemap": "false", 2024-09-12T18:35:42.943 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_fiemap_threshold": "4096", 2024-09-12T18:35:42.943 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-12T18:35:42.943 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-12T18:35:42.943 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_inject_stall": "0", 2024-09-12T18:35:42.943 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_journal_parallel": "false", 2024-09-12T18:35:42.943 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_journal_trailing": "false", 2024-09-12T18:35:42.944 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_journal_writeahead": "false", 2024-09-12T18:35:42.944 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_kill_at": "0", 2024-09-12T18:35:42.944 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-12T18:35:42.944 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-12T18:35:42.944 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-12T18:35:42.944 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-12T18:35:42.944 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-12T18:35:42.944 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_inline_xattrs": "0", 2024-09-12T18:35:42.944 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-12T18:35:42.944 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-12T18:35:42.944 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-12T18:35:42.944 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-12T18:35:42.944 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_xattr_value_size": "0", 2024-09-12T18:35:42.945 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-12T18:35:42.945 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-12T18:35:42.945 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-12T18:35:42.945 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_merge_threshold": "-10", 2024-09-12T18:35:42.945 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-12T18:35:42.945 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_odsync_write": "false", 2024-09-12T18:35:42.945 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_omap_backend": "rocksdb", 2024-09-12T18:35:42.945 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_omap_backend_path": "", 2024-09-12T18:35:42.945 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-12T18:35:42.945 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-12T18:35:42.945 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-12T18:35:42.945 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_op_thread_timeout": "60", 2024-09-12T18:35:42.945 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_op_threads": "2", 2024-09-12T18:35:42.946 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_punch_hole": "false", 2024-09-12T18:35:42.946 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-12T18:35:42.946 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-12T18:35:42.946 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-12T18:35:42.946 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-12T18:35:42.946 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-12T18:35:42.946 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-12T18:35:42.946 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-12T18:35:42.947 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-12T18:35:42.947 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-12T18:35:42.947 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_queue_max_ops": "50", 2024-09-12T18:35:42.947 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-12T18:35:42.947 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_seek_data_hole": "false", 2024-09-12T18:35:42.947 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_sloppy_crc": "false", 2024-09-12T18:35:42.947 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-12T18:35:42.947 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_splice": "false", 2024-09-12T18:35:42.947 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_split_multiple": "2", 2024-09-12T18:35:42.947 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_split_rand_factor": "20", 2024-09-12T18:35:42.947 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_update_to": "1000", 2024-09-12T18:35:42.947 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-12T18:35:42.947 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-12T18:35:42.948 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-12T18:35:42.948 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-12T18:35:42.948 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-12T18:35:42.948 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-12T18:35:42.948 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_enable": "true", 2024-09-12T18:35:42.948 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-12T18:35:42.948 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-12T18:35:42.948 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-12T18:35:42.948 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-12T18:35:42.948 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-12T18:35:42.948 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-12T18:35:42.948 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_xfs_extsize": "false", 2024-09-12T18:35:42.948 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_zfs_snap": "false", 2024-09-12T18:35:42.949 INFO:teuthology.orchestra.run.smithi073.stdout: "fio_dir": "/tmp/fio", 2024-09-12T18:35:42.949 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "c08d5a84-711b-44bf-bdf1-e06ecc2c7c00", 2024-09-12T18:35:42.949 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_allow_other": "true", 2024-09-12T18:35:42.949 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_atomic_o_trunc": "true", 2024-09-12T18:35:42.949 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_big_writes": "true", 2024-09-12T18:35:42.949 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_debug": "false", 2024-09-12T18:35:42.949 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_default_permissions": "false", 2024-09-12T18:35:42.949 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_disable_pagecache": "false", 2024-09-12T18:35:42.949 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_max_write": "0", 2024-09-12T18:35:42.949 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_multithreaded": "true", 2024-09-12T18:35:42.949 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_require_active_mds": "true", 2024-09-12T18:35:42.949 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_set_user_groups": "true", 2024-09-12T18:35:42.949 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_splice_move": "true", 2024-09-12T18:35:42.950 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_splice_read": "true", 2024-09-12T18:35:42.950 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_splice_write": "true", 2024-09-12T18:35:42.950 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-12T18:35:42.950 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_use_invalidate_cb": "true", 2024-09-12T18:35:42.950 INFO:teuthology.orchestra.run.smithi073.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-12T18:35:42.950 INFO:teuthology.orchestra.run.smithi073.stdout: "gss_target_name": "ceph", 2024-09-12T18:35:42.950 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_file": "", 2024-09-12T18:35:42.950 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_inject_failure": "0", 2024-09-12T18:35:42.950 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_interval": "5", 2024-09-12T18:35:42.950 INFO:teuthology.orchestra.run.smithi073.stdout: "host": "smithi073", 2024-09-12T18:35:42.950 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-12T18:35:42.950 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-12T18:35:42.950 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-12T18:35:42.950 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-12T18:35:42.951 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-12T18:35:42.951 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-12T18:35:42.951 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-12T18:35:42.951 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-12T18:35:42.951 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-12T18:35:42.951 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-12T18:35:42.951 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-12T18:35:42.951 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-12T18:35:42.951 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-12T18:35:42.951 INFO:teuthology.orchestra.run.smithi073.stdout: "inject_early_sigterm": "false", 2024-09-12T18:35:42.951 INFO:teuthology.orchestra.run.smithi073.stdout: "jaeger_agent_port": "6799", 2024-09-12T18:35:42.951 INFO:teuthology.orchestra.run.smithi073.stdout: "jaeger_tracing_enable": "false", 2024-09-12T18:35:42.951 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_aio": "true", 2024-09-12T18:35:42.952 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_align_min_size": "65536", 2024-09-12T18:35:42.952 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_block_align": "true", 2024-09-12T18:35:42.952 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_block_size": "4096", 2024-09-12T18:35:42.952 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_dio": "true", 2024-09-12T18:35:42.952 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_discard": "false", 2024-09-12T18:35:42.952 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_force_aio": "false", 2024-09-12T18:35:42.952 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_ignore_corruption": "false", 2024-09-12T18:35:42.952 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_max_write_bytes": "10485760", 2024-09-12T18:35:42.952 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_max_write_entries": "100", 2024-09-12T18:35:42.952 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_replay_from": "0", 2024-09-12T18:35:42.952 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-12T18:35:42.952 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-12T18:35:42.952 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-12T18:35:42.952 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-12T18:35:42.953 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_write_header_frequency": "0", 2024-09-12T18:35:42.953 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_zero_on_create": "false", 2024-09-12T18:35:42.953 INFO:teuthology.orchestra.run.smithi073.stdout: "journaler_prefetch_periods": "10", 2024-09-12T18:35:42.953 INFO:teuthology.orchestra.run.smithi073.stdout: "journaler_prezero_periods": "5", 2024-09-12T18:35:42.953 INFO:teuthology.orchestra.run.smithi073.stdout: "journaler_write_head_interval": "15", 2024-09-12T18:35:42.953 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "", 2024-09-12T18:35:42.953 INFO:teuthology.orchestra.run.smithi073.stdout: "keyfile": "", 2024-09-12T18:35:42.953 INFO:teuthology.orchestra.run.smithi073.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-12T18:35:42.953 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_backend": "rocksdb", 2024-09-12T18:35:42.953 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_default_stripe_size": "65536", 2024-09-12T18:35:42.953 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_fsck_on_mount": "false", 2024-09-12T18:35:42.953 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-12T18:35:42.953 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_max_bytes": "67108864", 2024-09-12T18:35:42.954 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_max_ops": "512", 2024-09-12T18:35:42.954 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_nid_prealloc": "1024", 2024-09-12T18:35:42.954 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_onode_map_size": "1024", 2024-09-12T18:35:42.954 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-12T18:35:42.954 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_sync_submit_transaction": "false", 2024-09-12T18:35:42.954 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_sync_transaction": "false", 2024-09-12T18:35:42.954 INFO:teuthology.orchestra.run.smithi073.stdout: "librados_thread_count": "2", 2024-09-12T18:35:42.954 INFO:teuthology.orchestra.run.smithi073.stdout: "lockdep": "false", 2024-09-12T18:35:42.954 INFO:teuthology.orchestra.run.smithi073.stdout: "lockdep_force_backtrace": "false", 2024-09-12T18:35:42.954 INFO:teuthology.orchestra.run.smithi073.stdout: "log_coarse_timestamps": "true", 2024-09-12T18:35:42.954 INFO:teuthology.orchestra.run.smithi073.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-12T18:35:42.954 INFO:teuthology.orchestra.run.smithi073.stdout: "log_flush_on_exit": "false", 2024-09-12T18:35:42.954 INFO:teuthology.orchestra.run.smithi073.stdout: "log_graylog_host": "127.0.0.1", 2024-09-12T18:35:42.954 INFO:teuthology.orchestra.run.smithi073.stdout: "log_graylog_port": "12201", 2024-09-12T18:35:42.955 INFO:teuthology.orchestra.run.smithi073.stdout: "log_max_new": "1000", 2024-09-12T18:35:42.955 INFO:teuthology.orchestra.run.smithi073.stdout: "log_max_recent": "10000", 2024-09-12T18:35:42.955 INFO:teuthology.orchestra.run.smithi073.stdout: "log_stderr_prefix": "", 2024-09-12T18:35:42.955 INFO:teuthology.orchestra.run.smithi073.stdout: "log_stop_at_utilization": "0.970000", 2024-09-12T18:35:42.955 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": "true", 2024-09-12T18:35:42.955 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_graylog": "false", 2024-09-12T18:35:42.955 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_journald": "false", 2024-09-12T18:35:42.955 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_stderr": "false", 2024-09-12T18:35:42.955 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_syslog": "false", 2024-09-12T18:35:42.955 INFO:teuthology.orchestra.run.smithi073.stdout: "max_rotating_auth_attempts": "10", 2024-09-12T18:35:42.955 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-12T18:35:42.955 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_action_on_write_error": "1", 2024-09-12T18:35:42.955 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_alternate_name_max": "8192", 2024-09-12T18:35:42.955 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_asio_thread_count": "2", 2024-09-12T18:35:42.956 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_export_pin": "true", 2024-09-12T18:35:42.956 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_fragment_dirs": "true", 2024-09-12T18:35:42.956 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-12T18:35:42.956 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_fragment_interval": "5", 2024-09-12T18:35:42.956 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-12T18:35:42.956 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-12T18:35:42.956 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_interval": "10", 2024-09-12T18:35:42.956 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_max": "-1", 2024-09-12T18:35:42.956 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_max_until": "-1", 2024-09-12T18:35:42.956 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_merge_size": "50", 2024-09-12T18:35:42.956 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_midchunk": "0.300000", 2024-09-12T18:35:42.956 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-12T18:35:42.956 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_min_start": "0.200000", 2024-09-12T18:35:42.957 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_minchunk": "0.001000", 2024-09-12T18:35:42.957 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_mode": "0", 2024-09-12T18:35:42.957 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_need_max": "1.200000", 2024-09-12T18:35:42.957 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_need_min": "0.800000", 2024-09-12T18:35:42.957 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_overload_epochs": "2", 2024-09-12T18:35:42.957 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-12T18:35:42.957 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-12T18:35:42.957 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_split_bits": "3", 2024-09-12T18:35:42.957 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-12T18:35:42.957 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_split_size": "10000", 2024-09-12T18:35:42.957 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-12T18:35:42.957 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_target_decay": "10.000000", 2024-09-12T18:35:42.957 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-12T18:35:42.958 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_beacon_grace": "15.000000", 2024-09-12T18:35:42.958 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_beacon_interval": "4.000000", 2024-09-12T18:35:42.958 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-12T18:35:42.958 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-12T18:35:42.958 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache_mid": "0.700000", 2024-09-12T18:35:42.958 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-12T18:35:42.958 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache_quiesce_delay": "0", 2024-09-12T18:35:42.958 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-12T18:35:42.958 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-12T18:35:42.958 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-12T18:35:42.958 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache_release_free_interval": "10", 2024-09-12T18:35:42.958 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache_reservation": "0.050000", 2024-09-12T18:35:42.958 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-12T18:35:42.958 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache_trim_interval": "1", 2024-09-12T18:35:42.959 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache_trim_threshold": "262144", 2024-09-12T18:35:42.959 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-12T18:35:42.959 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-12T18:35:42.959 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-12T18:35:42.959 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_client_prealloc_inos": "1000", 2024-09-12T18:35:42.959 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-12T18:35:42.959 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_connect_bootstrapping": "false", 2024-09-12T18:35:42.959 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_damage_table_max_entries": "10000", 2024-09-12T18:35:42.959 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-12T18:35:42.959 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_debug_auth_pins": "false", 2024-09-12T18:35:42.959 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_debug_frag": "false", 2024-09-12T18:35:42.959 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_debug_scatterstat": "false", 2024-09-12T18:35:42.959 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_debug_subtrees": "false", 2024-09-12T18:35:42.960 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_decay_halflife": "5.000000", 2024-09-12T18:35:42.960 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_default_dir_hash": "2", 2024-09-12T18:35:42.960 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_defer_session_stale": "true", 2024-09-12T18:35:42.960 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_deny_all_reconnect": "false", 2024-09-12T18:35:42.960 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_dir_keys_per_op": "16384", 2024-09-12T18:35:42.960 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_dir_max_commit_size": "10", 2024-09-12T18:35:42.960 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_dir_max_entries": "0", 2024-09-12T18:35:42.960 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_dir_prefetch": "true", 2024-09-12T18:35:42.960 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-12T18:35:42.960 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-12T18:35:42.960 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_dump_cache_on_map": "false", 2024-09-12T18:35:42.960 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-12T18:35:42.960 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-12T18:35:42.960 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_early_reply": "true", 2024-09-12T18:35:42.961 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_enable_op_tracker": "true", 2024-09-12T18:35:42.961 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_enforce_unique_name": "true", 2024-09-12T18:35:42.961 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-12T18:35:42.961 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-12T18:35:42.961 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_export_ephemeral_random": "true", 2024-09-12T18:35:42.961 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-12T18:35:42.961 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-12T18:35:42.961 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-12T18:35:42.961 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-12T18:35:42.961 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-12T18:35:42.961 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-12T18:35:42.961 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-12T18:35:42.961 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-12T18:35:42.962 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_health_summarize_threshold": "10", 2024-09-12T18:35:42.962 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-12T18:35:42.962 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-12T18:35:42.962 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_inject_health_dummy": "false", 2024-09-12T18:35:42.962 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-12T18:35:42.962 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_inject_migrator_session_race": "false", 2024-09-12T18:35:42.962 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-12T18:35:42.962 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-12T18:35:42.962 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-12T18:35:42.962 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_join_fs": "", 2024-09-12T18:35:42.962 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_journal_format": "1", 2024-09-12T18:35:42.962 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-12T18:35:42.962 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_create_at": "0", 2024-09-12T18:35:42.962 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_dirfrag_at": "0", 2024-09-12T18:35:42.963 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_export_at": "0", 2024-09-12T18:35:42.963 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_import_at": "0", 2024-09-12T18:35:42.963 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_journal_at": "0", 2024-09-12T18:35:42.963 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_journal_expire_at": "0", 2024-09-12T18:35:42.963 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_journal_replay_at": "0", 2024-09-12T18:35:42.963 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_link_at": "0", 2024-09-12T18:35:42.963 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_mdstable_at": "0", 2024-09-12T18:35:42.963 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_openc_at": "0", 2024-09-12T18:35:42.963 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_rename_at": "0", 2024-09-12T18:35:42.963 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_shutdown_at": "0", 2024-09-12T18:35:42.963 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log_event_large_threshold": "524288", 2024-09-12T18:35:42.963 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log_events_per_segment": "1024", 2024-09-12T18:35:42.963 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-12T18:35:42.963 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log_max_events": "-1", 2024-09-12T18:35:42.964 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log_max_segments": "128", 2024-09-12T18:35:42.964 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log_pause": "false", 2024-09-12T18:35:42.964 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log_segment_size": "0", 2024-09-12T18:35:42.964 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-12T18:35:42.964 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-12T18:35:42.964 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-12T18:35:42.964 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log_trim_threshold": "128", 2024-09-12T18:35:42.964 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-12T18:35:42.964 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log_warn_factor": "2.000000", 2024-09-12T18:35:42.964 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_max_caps_per_client": "1048576", 2024-09-12T18:35:42.964 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_max_completed_flushes": "100000", 2024-09-12T18:35:42.964 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_max_completed_requests": "100000", 2024-09-12T18:35:42.964 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_max_export_size": "20971520", 2024-09-12T18:35:42.965 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_max_file_recover": "32", 2024-09-12T18:35:42.965 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_max_purge_files": "64", 2024-09-12T18:35:42.965 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_max_purge_ops": "8192", 2024-09-12T18:35:42.965 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-12T18:35:42.965 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-12T18:35:42.965 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_max_snaps_per_dir": "100", 2024-09-12T18:35:42.965 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_metrics_update_interval": "2", 2024-09-12T18:35:42.965 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_min_caps_per_client": "100", 2024-09-12T18:35:42.965 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_min_caps_working_set": "10000", 2024-09-12T18:35:42.965 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-12T18:35:42.965 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_numa_node": "-1", 2024-09-12T18:35:42.965 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-12T18:35:42.965 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_op_complaint_time": "30.000000", 2024-09-12T18:35:42.965 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_op_history_duration": "600", 2024-09-12T18:35:42.966 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_op_history_size": "20", 2024-09-12T18:35:42.966 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_op_history_slow_op_size": "20", 2024-09-12T18:35:42.966 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-12T18:35:42.966 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_op_log_threshold": "5", 2024-09-12T18:35:42.966 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_ping_grace": "15", 2024-09-12T18:35:42.966 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_ping_interval": "5", 2024-09-12T18:35:42.966 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-12T18:35:42.966 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-12T18:35:42.966 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_recall_max_caps": "30000", 2024-09-12T18:35:42.966 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-12T18:35:42.966 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-12T18:35:42.966 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-12T18:35:42.966 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_recall_warning_threshold": "262144", 2024-09-12T18:35:42.967 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-12T18:35:42.967 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_replay_interval": "1.000000", 2024-09-12T18:35:42.967 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-12T18:35:42.967 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-12T18:35:42.967 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_root_ino_gid": "0", 2024-09-12T18:35:42.967 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_root_ino_uid": "0", 2024-09-12T18:35:42.967 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-12T18:35:42.967 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_scrub_stats_review_period": "1", 2024-09-12T18:35:42.967 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_server_dispatch_client_request_delay": "0", 2024-09-12T18:35:42.967 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_server_dispatch_killpoint_random": "0.000000", 2024-09-12T18:35:42.967 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-12T18:35:42.967 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-12T18:35:42.967 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-12T18:35:42.967 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-12T18:35:42.968 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-12T18:35:42.968 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-12T18:35:42.968 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-12T18:35:42.968 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-12T18:35:42.968 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-12T18:35:42.968 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_shutdown_check": "0", 2024-09-12T18:35:42.968 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_skip_ino": "0", 2024-09-12T18:35:42.968 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-12T18:35:42.968 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_snap_max_uid": "4294967294", 2024-09-12T18:35:42.968 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_snap_min_uid": "0", 2024-09-12T18:35:42.968 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_snap_rstat": "false", 2024-09-12T18:35:42.968 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_standby_replay_damaged": "false", 2024-09-12T18:35:42.968 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_symlink_recovery": "true", 2024-09-12T18:35:42.969 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-12T18:35:42.969 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_thrash_exports": "0", 2024-09-12T18:35:42.969 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_thrash_fragments": "0", 2024-09-12T18:35:42.969 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_tick_interval": "5.000000", 2024-09-12T18:35:42.969 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_valgrind_exit": "false", 2024-09-12T18:35:42.969 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_verify_backtrace": "1", 2024-09-12T18:35:42.969 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_verify_scatter": "false", 2024-09-12T18:35:42.969 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-12T18:35:42.969 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_wipe_sessions": "false", 2024-09-12T18:35:42.969 INFO:teuthology.orchestra.run.smithi073.stdout: "mempool_debug": "false", 2024-09-12T18:35:42.969 INFO:teuthology.orchestra.run.smithi073.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-12T18:35:42.969 INFO:teuthology.orchestra.run.smithi073.stdout: "memstore_device_bytes": "1073741824", 2024-09-12T18:35:42.970 INFO:teuthology.orchestra.run.smithi073.stdout: "memstore_page_set": "false", 2024-09-12T18:35:42.970 INFO:teuthology.orchestra.run.smithi073.stdout: "memstore_page_size": "65536", 2024-09-12T18:35:42.970 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_client_bytes": "134217728", 2024-09-12T18:35:42.970 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_client_messages": "512", 2024-09-12T18:35:42.970 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-12T18:35:42.970 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-12T18:35:42.970 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-12T18:35:42.970 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-12T18:35:42.970 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_disabled_modules": "", 2024-09-12T18:35:42.970 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_enable_op_tracker": "true", 2024-09-12T18:35:42.970 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-12T18:35:42.970 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_max_pg_creating": "1024", 2024-09-12T18:35:42.970 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_max_pg_num_change": "128", 2024-09-12T18:35:42.971 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_mds_bytes": "134217728", 2024-09-12T18:35:42.971 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_mds_messages": "128", 2024-09-12T18:35:42.971 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-12T18:35:42.971 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_mon_bytes": "134217728", 2024-09-12T18:35:42.971 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_mon_messages": "128", 2024-09-12T18:35:42.971 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-12T18:35:42.971 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-12T18:35:42.971 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_op_history_duration": "600", 2024-09-12T18:35:42.971 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_op_history_size": "20", 2024-09-12T18:35:42.971 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-12T18:35:42.971 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-12T18:35:42.971 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_op_log_threshold": "5", 2024-09-12T18:35:42.971 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_osd_bytes": "536870912", 2024-09-12T18:35:42.971 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_osd_messages": "8192", 2024-09-12T18:35:42.972 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_pool": "true", 2024-09-12T18:35:42.972 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-12T18:35:42.972 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_standby_modules": "true", 2024-09-12T18:35:42.972 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_stats_period": "5", 2024-09-12T18:35:42.972 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_stats_threshold": "5", 2024-09-12T18:35:42.972 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_tick_period": "2", 2024-09-12T18:35:42.972 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-12T18:35:42.972 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-12T18:35:42.972 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_allow_pool_delete": "true", 2024-09-12T18:35:42.972 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_allow_pool_size_one": "true", 2024-09-12T18:35:42.972 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_auth_validate_all_caps": "true", 2024-09-12T18:35:42.972 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-12T18:35:42.972 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-12T18:35:42.973 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_bytes": "104857600", 2024-09-12T18:35:42.973 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_directed_command_retry": "2", 2024-09-12T18:35:42.973 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-12T18:35:42.973 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-12T18:35:42.973 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-12T18:35:42.973 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-12T18:35:42.973 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_hunt_parallel": "3", 2024-09-12T18:35:42.973 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_log_interval": "1.000000", 2024-09-12T18:35:42.973 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-12T18:35:42.973 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_ping_interval": "10.000000", 2024-09-12T18:35:42.973 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-12T18:35:42.973 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_target_rank": "-1", 2024-09-12T18:35:42.973 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-12T18:35:42.973 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-12T18:35:42.974 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-12T18:35:42.974 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cluster_log_level": "debug", 2024-09-12T18:35:42.974 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cluster_log_to_file": "true", 2024-09-12T18:35:42.974 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-12T18:35:42.974 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-12T18:35:42.974 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-12T18:35:42.974 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cluster_log_to_journald": "false", 2024-09-12T18:35:42.974 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-12T18:35:42.974 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-12T18:35:42.974 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-12T18:35:42.974 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_compact_on_bootstrap": "false", 2024-09-12T18:35:42.974 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_compact_on_start": "false", 2024-09-12T18:35:42.974 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_compact_on_trim": "true", 2024-09-12T18:35:42.975 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-12T18:35:42.975 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-12T18:35:42.975 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-12T18:35:42.975 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cpu_threads": "4", 2024-09-12T18:35:42.975 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_crush_min_required_version": "hammer", 2024-09-12T18:35:42.975 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_daemon_bytes": "419430400", 2024-09-12T18:35:42.975 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-12T18:35:42.975 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_data_avail_crit": "5", 2024-09-12T18:35:42.975 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_data_avail_warn": "5", 2024-09-12T18:35:42.975 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_data_size_warn": "16106127360", 2024-09-12T18:35:42.975 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-12T18:35:42.975 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-12T18:35:42.975 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_dump_json": "false", 2024-09-12T18:35:42.975 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-12T18:35:42.976 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_dump_transactions": "false", 2024-09-12T18:35:42.976 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_extra_checks": "false", 2024-09-12T18:35:42.976 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-12T18:35:42.976 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-12T18:35:42.976 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_no_require_reef": "false", 2024-09-12T18:35:42.976 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_no_require_squid": "false", 2024-09-12T18:35:42.976 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-12T18:35:42.976 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-12T18:35:42.976 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-12T18:35:42.976 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_down_mkfs_grace": "120", 2024-09-12T18:35:42.976 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_down_uptime_grace": "60", 2024-09-12T18:35:42.976 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_election_default_strategy": "1", 2024-09-12T18:35:42.976 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_election_timeout": "5.000000", 2024-09-12T18:35:42.977 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-12T18:35:42.977 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_elector_ping_divisor": "2", 2024-09-12T18:35:42.977 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-12T18:35:42.977 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_enable_op_tracker": "true", 2024-09-12T18:35:42.977 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_fake_pool_delete": "false", 2024-09-12T18:35:42.977 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_force_quorum_join": "false", 2024-09-12T18:35:42.977 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-12T18:35:42.977 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_globalid_prealloc": "10000", 2024-09-12T18:35:42.977 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_health_detail_to_clog": "false", 2024-09-12T18:35:42.977 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_health_log_update_period": "5", 2024-09-12T18:35:42.977 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_health_max_detail": "50", 2024-09-12T18:35:42.977 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_health_to_clog": "true", 2024-09-12T18:35:42.977 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_health_to_clog_interval": "600", 2024-09-12T18:35:42.977 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-12T18:35:42.978 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_host": "172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790],[v2:172.21.15.73:3302,v1:172.21.15.73:6791]", 2024-09-12T18:35:42.978 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_host_override": "", 2024-09-12T18:35:42.978 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_initial_members": "", 2024-09-12T18:35:42.978 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-12T18:35:42.978 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-12T18:35:42.978 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-12T18:35:42.978 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-12T18:35:42.978 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-12T18:35:42.978 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_lease": "5.000000", 2024-09-12T18:35:42.978 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-12T18:35:42.978 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-12T18:35:42.978 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_log_full_interval": "50", 2024-09-12T18:35:42.978 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_log_max": "10000", 2024-09-12T18:35:42.979 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_log_max_summary": "50", 2024-09-12T18:35:42.979 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-12T18:35:42.979 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_max_log_epochs": "500", 2024-09-12T18:35:42.979 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-12T18:35:42.979 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-12T18:35:42.979 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_max_nvmeof_epochs": "500", 2024-09-12T18:35:42.979 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_max_osd": "10000", 2024-09-12T18:35:42.979 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_max_pg_per_osd": "10000", 2024-09-12T18:35:42.979 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_max_pool_pg_num": "65536", 2024-09-12T18:35:42.979 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-12T18:35:42.979 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-12T18:35:42.979 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_mds_force_trim_to": "0", 2024-09-12T18:35:42.979 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_mds_skip_sanity": "false", 2024-09-12T18:35:42.979 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_memory_autotune": "true", 2024-09-12T18:35:42.980 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_memory_target": "2147483648", 2024-09-12T18:35:42.980 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_mgr_beacon_grace": "30", 2024-09-12T18:35:42.980 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-12T18:35:42.980 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_mgr_digest_period": "5", 2024-09-12T18:35:42.980 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_mgr_inactive_grace": "60", 2024-09-12T18:35:42.980 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-12T18:35:42.980 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-12T18:35:42.980 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_min_osdmap_epochs": "500", 2024-09-12T18:35:42.980 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_nvmeofgw_beacon_grace": "10", 2024-09-12T18:35:42.980 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_nvmeofgw_set_group_id_retry": "1000", 2024-09-12T18:35:42.980 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_op_complaint_time": "30", 2024-09-12T18:35:42.980 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_op_history_duration": "600", 2024-09-12T18:35:42.980 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_op_history_size": "20", 2024-09-12T18:35:42.981 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_op_history_slow_op_size": "20", 2024-09-12T18:35:42.981 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-12T18:35:42.981 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_op_log_threshold": "5", 2024-09-12T18:35:42.981 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-12T18:35:42.981 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-12T18:35:42.981 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-12T18:35:42.981 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_auto_mark_in": "false", 2024-09-12T18:35:42.981 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-12T18:35:42.981 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-12T18:35:42.981 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-12T18:35:42.981 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_cache_size": "500", 2024-09-12T18:35:42.981 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-12T18:35:42.981 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-12T18:35:42.981 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-12T18:35:42.982 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_down_out_interval": "600", 2024-09-12T18:35:42.982 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-12T18:35:42.982 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-12T18:35:42.982 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_force_trim_to": "0", 2024-09-12T18:35:42.982 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-12T18:35:42.982 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-12T18:35:42.982 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-12T18:35:42.982 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-12T18:35:42.982 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-12T18:35:42.982 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-12T18:35:42.982 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-12T18:35:42.982 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_min_down_reporters": "2", 2024-09-12T18:35:42.982 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-12T18:35:42.982 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-12T18:35:42.983 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-12T18:35:42.983 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-12T18:35:42.983 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-12T18:35:42.983 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-12T18:35:42.983 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_report_timeout": "900", 2024-09-12T18:35:42.983 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-12T18:35:42.983 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-12T18:35:42.983 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-12T18:35:42.983 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-12T18:35:42.983 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-12T18:35:42.983 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-12T18:35:42.983 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-12T18:35:42.983 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-12T18:35:42.984 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-12T18:35:42.984 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_pg_stuck_threshold": "60", 2024-09-12T18:35:42.984 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-12T18:35:42.984 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-12T18:35:42.984 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-12T18:35:42.984 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-12T18:35:42.984 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-12T18:35:42.984 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-12T18:35:42.984 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_probe_timeout": "2.000000", 2024-09-12T18:35:42.984 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_reweight_max_change": "0.050000", 2024-09-12T18:35:42.984 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_reweight_max_osds": "4", 2024-09-12T18:35:42.984 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-12T18:35:42.984 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-12T18:35:42.985 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-12T18:35:42.985 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-12T18:35:42.985 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-12T18:35:42.985 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_scrub_interval": "86400", 2024-09-12T18:35:42.985 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_scrub_max_keys": "100", 2024-09-12T18:35:42.985 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_scrub_timeout": "300", 2024-09-12T18:35:42.985 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_session_timeout": "300", 2024-09-12T18:35:42.985 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_smart_report_timeout": "5", 2024-09-12T18:35:42.985 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_stat_smooth_intervals": "6", 2024-09-12T18:35:42.985 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-12T18:35:42.985 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_stretch_pool_min_size": "2", 2024-09-12T18:35:42.985 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_stretch_pool_size": "4", 2024-09-12T18:35:42.985 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-12T18:35:42.985 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-12T18:35:42.986 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_sync_debug": "false", 2024-09-12T18:35:42.986 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-12T18:35:42.986 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-12T18:35:42.986 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_sync_provider_kill_at": "0", 2024-09-12T18:35:42.986 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_sync_requester_kill_at": "0", 2024-09-12T18:35:42.986 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_sync_timeout": "60.000000", 2024-09-12T18:35:42.986 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_target_pg_per_osd": "100", 2024-09-12T18:35:42.986 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_tick_interval": "5", 2024-09-12T18:35:42.986 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_timecheck_interval": "300.000000", 2024-09-12T18:35:42.986 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-12T18:35:42.986 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_use_min_delay_socket": "false", 2024-09-12T18:35:42.986 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_older_version_delay": "604800", 2024-09-12T18:35:42.986 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-12T18:35:42.986 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-12T18:35:42.987 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-12T18:35:42.987 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-12T18:35:42.987 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-12T18:35:42.987 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-12T18:35:42.987 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-12T18:35:42.987 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_misplaced": "false", 2024-09-12T18:35:42.987 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-12T18:35:42.987 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_older_version": "true", 2024-09-12T18:35:42.987 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-12T18:35:42.987 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_pool_no_app": "true", 2024-09-12T18:35:42.987 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-12T18:35:42.987 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-12T18:35:42.987 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-12T18:35:42.988 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-12T18:35:42.988 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-12T18:35:42.988 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-12T18:35:42.988 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-12T18:35:42.988 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": "", 2024-09-12T18:35:42.988 INFO:teuthology.orchestra.run.smithi073.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-12T18:35:42.988 INFO:teuthology.orchestra.run.smithi073.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-12T18:35:42.988 INFO:teuthology.orchestra.run.smithi073.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-12T18:35:42.988 INFO:teuthology.orchestra.run.smithi073.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-12T18:35:42.988 INFO:teuthology.orchestra.run.smithi073.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-12T18:35:42.988 INFO:teuthology.orchestra.run.smithi073.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-12T18:35:42.988 INFO:teuthology.orchestra.run.smithi073.stdout: "motr_tracing_enabled": "false", 2024-09-12T18:35:42.988 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_op_threads": "3", 2024-09-12T18:35:42.988 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-12T18:35:42.989 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_cm": "false", 2024-09-12T18:35:42.989 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_device_name": "", 2024-09-12T18:35:42.989 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_dscp": "96", 2024-09-12T18:35:42.989 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-12T18:35:42.989 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-12T18:35:42.989 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_local_gid": "", 2024-09-12T18:35:42.989 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-12T18:35:42.989 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_port_num": "1", 2024-09-12T18:35:42.989 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-12T18:35:42.989 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-12T18:35:42.989 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-12T18:35:42.989 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-12T18:35:42.989 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_sl": "3", 2024-09-12T18:35:42.990 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_support_srq": "true", 2024-09-12T18:35:42.990 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_type": "ib", 2024-09-12T18:35:42.990 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_reap_threshold": "5", 2024-09-12T18:35:42.990 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_bind_before_connect": "false", 2024-09-12T18:35:42.990 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_bind_ipv4": "true", 2024-09-12T18:35:42.990 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_bind_ipv6": "false", 2024-09-12T18:35:42.990 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_bind_msgr1": "true", 2024-09-12T18:35:42.990 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_bind_msgr2": "true", 2024-09-12T18:35:42.990 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_bind_port_max": "7568", 2024-09-12T18:35:42.990 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_bind_port_min": "6800", 2024-09-12T18:35:42.990 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-12T18:35:42.990 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_bind_retry_count": "3", 2024-09-12T18:35:42.990 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_bind_retry_delay": "5", 2024-09-12T18:35:42.990 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_blackhole_client": "false", 2024-09-12T18:35:42.991 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_blackhole_mds": "false", 2024-09-12T18:35:42.991 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_blackhole_mgr": "false", 2024-09-12T18:35:42.991 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_blackhole_mon": "false", 2024-09-12T18:35:42.991 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_blackhole_osd": "false", 2024-09-12T18:35:42.991 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_client_mode": "crc secure", 2024-09-12T18:35:42.991 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_client_throttle_retry_time_interval": "5000", 2024-09-12T18:35:42.991 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_cluster_mode": "crc secure", 2024-09-12T18:35:42.991 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_cluster_type": "", 2024-09-12T18:35:42.991 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_compress_secure": "false", 2024-09-12T18:35:42.991 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_connection_idle_timeout": "900", 2024-09-12T18:35:42.991 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_connection_ready_timeout": "10", 2024-09-12T18:35:42.991 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_crc_data": "true", 2024-09-12T18:35:42.991 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_crc_header": "true", 2024-09-12T18:35:42.992 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_die_on_bad_msg": "false", 2024-09-12T18:35:42.992 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_die_on_bug": "true", 2024-09-12T18:35:42.992 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_die_on_old_message": "true", 2024-09-12T18:35:42.992 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_die_on_skipped_message": "false", 2024-09-12T18:35:42.992 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-12T18:35:42.992 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-12T18:35:42.992 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_coremask": "0xF", 2024-09-12T18:35:42.992 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-12T18:35:42.992 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-12T18:35:42.992 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_enable_tso": "true", 2024-09-12T18:35:42.992 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-12T18:35:42.993 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-12T18:35:42.993 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_hugepages": "", 2024-09-12T18:35:42.993 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-12T18:35:42.993 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-12T18:35:42.993 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_lro": "true", 2024-09-12T18:35:42.993 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_memory_channel": "4", 2024-09-12T18:35:42.993 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-12T18:35:42.993 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_pmd": "", 2024-09-12T18:35:42.993 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_port_id": "0", 2024-09-12T18:35:42.993 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-12T18:35:42.993 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-12T18:35:42.993 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dump_on_send": "false", 2024-09-12T18:35:42.993 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_initial_backoff": "0.200000", 2024-09-12T18:35:42.994 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_inject_delay_max": "1.000000", 2024-09-12T18:35:42.994 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-12T18:35:42.994 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_inject_delay_type": "", 2024-09-12T18:35:42.994 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-12T18:35:42.994 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_inject_network_congestion": "0", 2024-09-12T18:35:42.994 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_inject_socket_failures": "0", 2024-09-12T18:35:42.994 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_learn_addr_from_peer": "true", 2024-09-12T18:35:42.994 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_max_accept_failures": "4", 2024-09-12T18:35:42.994 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_max_backoff": "15.000000", 2024-09-12T18:35:42.994 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_mon_client_mode": "secure crc", 2024-09-12T18:35:42.994 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-12T18:35:42.994 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_mon_service_mode": "secure crc", 2024-09-12T18:35:42.994 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_osd_compress_min_size": "1024", 2024-09-12T18:35:42.994 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_osd_compress_mode": "none", 2024-09-12T18:35:42.995 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-12T18:35:42.995 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-12T18:35:42.995 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_pq_min_cost": "65536", 2024-09-12T18:35:42.995 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_public_type": "", 2024-09-12T18:35:42.995 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_service_mode": "crc secure", 2024-09-12T18:35:42.995 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_tcp_listen_backlog": "512", 2024-09-12T18:35:42.995 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_tcp_nodelay": "true", 2024-09-12T18:35:42.995 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-12T18:35:42.995 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_tcp_rcvbuf": "0", 2024-09-12T18:35:42.995 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_time_events_min_wait_interval": "1000", 2024-09-12T18:35:42.995 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_type": "async+posix", 2024-09-12T18:35:42.995 INFO:teuthology.orchestra.run.smithi073.stdout: "no_config_file": "false", 2024-09-12T18:35:42.995 INFO:teuthology.orchestra.run.smithi073.stdout: "nvmeof_mon_client_disconnect_panic": "100", 2024-09-12T18:35:42.995 INFO:teuthology.orchestra.run.smithi073.stdout: "nvmeof_mon_client_tick_period": "2", 2024-09-12T18:35:42.996 INFO:teuthology.orchestra.run.smithi073.stdout: "objecter_completion_locks_per_session": "32", 2024-09-12T18:35:42.996 INFO:teuthology.orchestra.run.smithi073.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-12T18:35:42.996 INFO:teuthology.orchestra.run.smithi073.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-12T18:35:42.996 INFO:teuthology.orchestra.run.smithi073.stdout: "objecter_inflight_ops": "1024", 2024-09-12T18:35:42.996 INFO:teuthology.orchestra.run.smithi073.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-12T18:35:42.996 INFO:teuthology.orchestra.run.smithi073.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-12T18:35:42.996 INFO:teuthology.orchestra.run.smithi073.stdout: "objecter_tick_interval": "5.000000", 2024-09-12T18:35:42.996 INFO:teuthology.orchestra.run.smithi073.stdout: "objecter_timeout": "10.000000", 2024-09-12T18:35:42.996 INFO:teuthology.orchestra.run.smithi073.stdout: "objectstore_blackhole": "false", 2024-09-12T18:35:42.996 INFO:teuthology.orchestra.run.smithi073.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-12T18:35:42.996 INFO:teuthology.orchestra.run.smithi073.stdout: "openssl_engine_opts": "", 2024-09-12T18:35:42.996 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_agent_delay_time": "5.000000", 2024-09-12T18:35:42.996 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_agent_hist_halflife": "1000", 2024-09-12T18:35:42.997 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_agent_max_low_ops": "2", 2024-09-12T18:35:42.997 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_agent_max_ops": "4", 2024-09-12T18:35:42.997 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-12T18:35:42.997 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-12T18:35:42.997 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_agent_slop": "0.020000", 2024-09-12T18:35:42.997 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-12T18:35:42.997 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-12T18:35:42.997 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_asio_thread_count": "2", 2024-09-12T18:35:42.997 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_async_recovery_min_cost": "100", 2024-09-12T18:35:42.997 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-12T18:35:42.997 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-12T18:35:42.997 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_backfill_scan_max": "512", 2024-09-12T18:35:42.997 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_backfill_scan_min": "64", 2024-09-12T18:35:42.997 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_backoff_on_degraded": "false", 2024-09-12T18:35:42.998 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_backoff_on_peering": "false", 2024-09-12T18:35:42.998 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_backoff_on_unfound": "true", 2024-09-12T18:35:42.998 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_beacon_report_interval": "300", 2024-09-12T18:35:42.998 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_bench_duration": "30", 2024-09-12T18:35:42.998 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-12T18:35:42.998 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_bench_max_block_size": "67108864", 2024-09-12T18:35:42.998 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-12T18:35:42.998 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_blkin_trace_all": "false", 2024-09-12T18:35:42.998 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-12T18:35:42.998 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-12T18:35:42.998 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-12T18:35:42.998 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-12T18:35:42.998 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_check_for_log_corruption": "false", 2024-09-12T18:35:42.999 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-12T18:35:42.999 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-12T18:35:42.999 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-09-12T18:35:42.999 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-12T18:35:42.999 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_class_update_on_start": "true", 2024-09-12T18:35:42.999 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_client_message_cap": "256", 2024-09-12T18:35:42.999 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_client_message_size_cap": "524288000", 2024-09-12T18:35:42.999 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_client_op_priority": "63", 2024-09-12T18:35:42.999 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_client_watch_timeout": "30", 2024-09-12T18:35:42.999 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_command_max_records": "256", 2024-09-12T18:35:42.999 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_compact_on_start": "false", 2024-09-12T18:35:42.999 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-12T18:35:42.999 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-12T18:35:42.999 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-12T18:35:43.000 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_crush_update_on_start": "true", 2024-09-12T18:35:43.000 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_crush_update_weight_set": "true", 2024-09-12T18:35:43.000 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-12T18:35:43.000 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-12T18:35:43.000 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-12T18:35:43.000 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-12T18:35:43.000 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-12T18:35:43.000 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_feed_pullee": "-1", 2024-09-12T18:35:43.000 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-12T18:35:43.000 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-12T18:35:43.000 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-12T18:35:43.000 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_misdirected_ops": "false", 2024-09-12T18:35:43.000 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_no_acting_change": "false", 2024-09-12T18:35:43.001 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_no_purge_strays": "false", 2024-09-12T18:35:43.001 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_op_order": "false", 2024-09-12T18:35:43.001 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-12T18:35:43.001 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-12T18:35:43.001 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-12T18:35:43.001 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-12T18:35:43.001 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_shutdown": "false", 2024-09-12T18:35:43.001 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-12T18:35:43.001 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-12T18:35:43.001 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_trim_objects": "false", 2024-09-12T18:35:43.001 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-12T18:35:43.001 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-12T18:35:43.001 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_verify_snaps": "false", 2024-09-12T18:35:43.001 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-12T18:35:43.002 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-12T18:35:43.002 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_deep_scrub_keys": "1024", 2024-09-12T18:35:43.002 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-12T18:35:43.002 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-12T18:35:43.002 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-12T18:35:43.002 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_deep_scrub_stride": "524288", 2024-09-12T18:35:43.002 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-12T18:35:43.002 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-12T18:35:43.002 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_default_notify_timeout": "30", 2024-09-12T18:35:43.002 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_delete_sleep": "0.000000", 2024-09-12T18:35:43.002 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-12T18:35:43.002 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-12T18:35:43.002 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-12T18:35:43.002 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_discard_disconnected_ops": "true", 2024-09-12T18:35:43.003 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_ec_partial_reads": "true", 2024-09-12T18:35:43.003 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_enable_op_tracker": "true", 2024-09-12T18:35:43.003 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-12T18:35:43.003 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-12T18:35:43.003 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-12T18:35:43.003 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-12T18:35:43.003 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_fast_info": "true", 2024-09-12T18:35:43.003 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_fast_shutdown": "true", 2024-09-12T18:35:43.003 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-12T18:35:43.003 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-12T18:35:43.003 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-12T18:35:43.003 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-12T18:35:43.003 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-12T18:35:43.004 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_function_tracing": "false", 2024-09-12T18:35:43.004 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_heartbeat_grace": "20", 2024-09-12T18:35:43.004 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_heartbeat_interval": "6", 2024-09-12T18:35:43.004 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-12T18:35:43.004 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_heartbeat_min_peers": "10", 2024-09-12T18:35:43.004 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_heartbeat_min_size": "2000", 2024-09-12T18:35:43.004 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_heartbeat_stale": "600", 2024-09-12T18:35:43.004 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-12T18:35:43.004 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_hit_set_max_size": "100000", 2024-09-12T18:35:43.004 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_hit_set_min_size": "1000", 2024-09-12T18:35:43.004 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-12T18:35:43.004 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-12T18:35:43.004 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-12T18:35:43.005 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-12T18:35:43.005 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-12T18:35:43.005 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-12T18:35:43.005 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_journal_size": "5120", 2024-09-12T18:35:43.005 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_kill_backfill_at": "0", 2024-09-12T18:35:43.005 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-12T18:35:43.005 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_map_cache_size": "50", 2024-09-12T18:35:43.005 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_map_dedup": "true", 2024-09-12T18:35:43.005 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_map_message_max": "40", 2024-09-12T18:35:43.005 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-12T18:35:43.005 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_map_share_max_epochs": "40", 2024-09-12T18:35:43.005 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_attr_name_len": "100", 2024-09-12T18:35:43.005 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_attr_size": "0", 2024-09-12T18:35:43.005 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_backfills": "1", 2024-09-12T18:35:43.006 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_markdown_count": "5", 2024-09-12T18:35:43.006 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_markdown_period": "600", 2024-09-12T18:35:43.006 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_object_name_len": "2048", 2024-09-12T18:35:43.006 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_object_namespace_len": "256", 2024-09-12T18:35:43.006 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_object_size": "134217728", 2024-09-12T18:35:43.006 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-12T18:35:43.006 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-12T18:35:43.006 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_pg_blocked_by": "16", 2024-09-12T18:35:43.006 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_pg_log_entries": "10000", 2024-09-12T18:35:43.006 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-12T18:35:43.006 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_pgls": "1024", 2024-09-12T18:35:43.006 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_push_cost": "8388608", 2024-09-12T18:35:43.006 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_push_objects": "10", 2024-09-12T18:35:43.007 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_scrubs": "3", 2024-09-12T18:35:43.007 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-12T18:35:43.007 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_trimming_pgs": "2", 2024-09-12T18:35:43.007 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_write_op_reply_len": "64", 2024-09-12T18:35:43.007 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_write_size": "90", 2024-09-12T18:35:43.007 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-12T18:35:43.007 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-12T18:35:43.007 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-12T18:35:43.007 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-12T18:35:43.007 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-12T18:35:43.007 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-12T18:35:43.007 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-12T18:35:43.007 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-12T18:35:43.008 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_profile": "balanced", 2024-09-12T18:35:43.008 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-12T18:35:43.008 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-12T18:35:43.008 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-12T18:35:43.008 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-12T18:35:43.008 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-12T18:35:43.008 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-12T18:35:43.008 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-12T18:35:43.008 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-12T18:35:43.008 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-12T18:35:43.008 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-12T18:35:43.008 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-12T18:35:43.008 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_memory_base": "805306368", 2024-09-12T18:35:43.009 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_memory_cache_min": "134217728", 2024-09-12T18:35:43.009 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-12T18:35:43.009 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-12T18:35:43.009 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_memory_target": "4294967296", 2024-09-12T18:35:43.009 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_memory_target_autotune": "false", 2024-09-12T18:35:43.009 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-12T18:35:43.009 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_min_pg_log_entries": "250", 2024-09-12T18:35:43.009 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_min_recovery_priority": "0", 2024-09-12T18:35:43.009 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-12T18:35:43.009 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-12T18:35:43.009 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mon_report_interval": "5", 2024-09-12T18:35:43.009 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-12T18:35:43.009 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-12T18:35:43.009 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_num_cache_shards": "32", 2024-09-12T18:35:43.010 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_num_op_tracker_shard": "32", 2024-09-12T18:35:43.010 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_numa_auto_affinity": "true", 2024-09-12T18:35:43.010 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_numa_node": "-1", 2024-09-12T18:35:43.010 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_numa_prefer_iface": "true", 2024-09-12T18:35:43.010 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-12T18:35:43.010 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_objecter_finishers": "1", 2024-09-12T18:35:43.010 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_objectstore": "bluestore", 2024-09-12T18:35:43.010 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_objectstore_fuse": "false", 2024-09-12T18:35:43.010 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_objectstore_ideal_list_max": "64", 2024-09-12T18:35:43.010 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_objectstore_tracing": "false", 2024-09-12T18:35:43.010 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_complaint_time": "30.000000", 2024-09-12T18:35:43.010 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_history_duration": "600", 2024-09-12T18:35:43.010 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_history_size": "20", 2024-09-12T18:35:43.010 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_history_slow_op_size": "20", 2024-09-12T18:35:43.011 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-12T18:35:43.011 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_log_threshold": "5", 2024-09-12T18:35:43.011 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_num_shards": "0", 2024-09-12T18:35:43.011 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_num_shards_hdd": "5", 2024-09-12T18:35:43.011 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_num_shards_ssd": "8", 2024-09-12T18:35:43.011 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-12T18:35:43.011 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-12T18:35:43.011 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-12T18:35:43.011 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-12T18:35:43.011 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_pq_min_cost": "65536", 2024-09-12T18:35:43.011 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-12T18:35:43.011 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_queue_cut_off": "high", 2024-09-12T18:35:43.011 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-12T18:35:43.011 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_thread_timeout": "15", 2024-09-12T18:35:43.012 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_open_classes_on_start": "true", 2024-09-12T18:35:43.012 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_os_flags": "0", 2024-09-12T18:35:43.012 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_peering_op_priority": "255", 2024-09-12T18:35:43.012 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pg_delete_cost": "1048576", 2024-09-12T18:35:43.012 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pg_delete_priority": "5", 2024-09-12T18:35:43.012 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-12T18:35:43.012 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-12T18:35:43.012 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-12T18:35:43.012 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pg_log_trim_max": "10000", 2024-09-12T18:35:43.012 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pg_log_trim_min": "100", 2024-09-12T18:35:43.012 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-12T18:35:43.012 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-12T18:35:43.012 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-12T18:35:43.013 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-12T18:35:43.013 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-12T18:35:43.013 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-12T18:35:43.013 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-12T18:35:43.013 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-12T18:35:43.013 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-12T18:35:43.013 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-12T18:35:43.013 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_crimson": "false", 2024-09-12T18:35:43.013 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-12T18:35:43.013 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-12T18:35:43.013 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-12T18:35:43.013 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-12T18:35:43.013 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-12T18:35:43.013 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-12T18:35:43.014 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-12T18:35:43.014 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-12T18:35:43.014 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_flags": "0", 2024-09-12T18:35:43.014 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-12T18:35:43.014 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_min_size": "0", 2024-09-12T18:35:43.014 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-12T18:35:43.014 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_pg_num": "32", 2024-09-12T18:35:43.014 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_pgp_num": "0", 2024-09-12T18:35:43.014 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-12T18:35:43.014 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_read_ratio": "70", 2024-09-12T18:35:43.014 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_size": "2", 2024-09-12T18:35:43.014 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_type": "replicated", 2024-09-12T18:35:43.014 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-12T18:35:43.014 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-12T18:35:43.015 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_push_per_object_cost": "1000", 2024-09-12T18:35:43.015 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-12T18:35:43.015 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recover_clone_overlap": "true", 2024-09-12T18:35:43.015 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-12T18:35:43.015 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_cost": "20971520", 2024-09-12T18:35:43.015 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-12T18:35:43.015 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_max_active": "0", 2024-09-12T18:35:43.015 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-12T18:35:43.015 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-12T18:35:43.015 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-12T18:35:43.015 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-12T18:35:43.015 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_max_single_start": "1", 2024-09-12T18:35:43.015 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_op_priority": "3", 2024-09-12T18:35:43.016 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-12T18:35:43.016 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_priority": "5", 2024-09-12T18:35:43.016 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-12T18:35:43.016 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_sleep": "0.000000", 2024-09-12T18:35:43.016 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-12T18:35:43.016 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-12T18:35:43.016 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-12T18:35:43.016 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_repair_during_recovery": "false", 2024-09-12T18:35:43.016 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_requested_scrub_priority": "120", 2024-09-12T18:35:43.016 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-12T18:35:43.016 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-12T18:35:43.016 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_auto_repair": "false", 2024-09-12T18:35:43.016 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-12T18:35:43.017 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-12T18:35:43.017 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_begin_hour": "0", 2024-09-12T18:35:43.017 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_begin_week_day": "0", 2024-09-12T18:35:43.017 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_chunk_max": "25", 2024-09-12T18:35:43.017 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_chunk_min": "5", 2024-09-12T18:35:43.017 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_cost": "52428800", 2024-09-12T18:35:43.017 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-12T18:35:43.017 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_during_recovery": "false", 2024-09-12T18:35:43.017 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_end_hour": "0", 2024-09-12T18:35:43.017 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_end_week_day": "0", 2024-09-12T18:35:43.017 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_event_cost": "4096", 2024-09-12T18:35:43.017 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-12T18:35:43.017 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-12T18:35:43.017 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_invalid_stats": "true", 2024-09-12T18:35:43.018 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-12T18:35:43.018 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-12T18:35:43.018 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_max_preemptions": "5", 2024-09-12T18:35:43.018 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-12T18:35:43.018 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_priority": "5", 2024-09-12T18:35:43.018 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_retry_after_noscrub": "60", 2024-09-12T18:35:43.018 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_retry_delay": "30", 2024-09-12T18:35:43.018 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_retry_new_interval": "10", 2024-09-12T18:35:43.018 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_retry_pg_state": "60", 2024-09-12T18:35:43.018 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_retry_trimming": "10", 2024-09-12T18:35:43.018 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_sleep": "0.000000", 2024-09-12T18:35:43.018 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-12T18:35:43.018 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-12T18:35:43.019 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-12T18:35:43.019 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_skip_check_past_interval_bounds": "false", 2024-09-12T18:35:43.019 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_skip_data_digest": "false", 2024-09-12T18:35:43.019 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_smart_report_timeout": "5", 2024-09-12T18:35:43.019 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_snap_trim_cost": "1048576", 2024-09-12T18:35:43.019 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_snap_trim_priority": "5", 2024-09-12T18:35:43.019 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-12T18:35:43.019 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-12T18:35:43.019 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-12T18:35:43.019 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-12T18:35:43.020 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-12T18:35:43.020 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-12T18:35:43.020 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-12T18:35:43.020 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_target_transaction_size": "30", 2024-09-12T18:35:43.020 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-12T18:35:43.020 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-12T18:35:43.020 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-12T18:35:43.020 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-12T18:35:43.020 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-12T18:35:43.020 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-12T18:35:43.020 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-12T18:35:43.020 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-12T18:35:43.020 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-12T18:35:43.021 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-12T18:35:43.021 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tracing": "false", 2024-09-12T18:35:43.021 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_use_stale_snap": "false", 2024-09-12T18:35:43.021 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T18:35:43.021 INFO:teuthology.orchestra.run.smithi073.stdout: "osdc_blkin_trace_all": "false", 2024-09-12T18:35:43.021 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_kill_at": "0", 2024-09-12T18:35:43.021 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_max_join_drift": "10", 2024-09-12T18:35:43.021 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_min": "500", 2024-09-12T18:35:43.021 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_min_wait": "0.050000", 2024-09-12T18:35:43.021 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_propose_interval": "1.000000", 2024-09-12T18:35:43.021 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_service_trim_max": "500", 2024-09-12T18:35:43.021 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-12T18:35:43.021 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_service_trim_min": "250", 2024-09-12T18:35:43.021 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_stash_full_interval": "25", 2024-09-12T18:35:43.022 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_trim_max": "500", 2024-09-12T18:35:43.022 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_trim_min": "250", 2024-09-12T18:35:43.022 INFO:teuthology.orchestra.run.smithi073.stdout: "perf": "true", 2024-09-12T18:35:43.022 INFO:teuthology.orchestra.run.smithi073.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-12T18:35:43.022 INFO:teuthology.orchestra.run.smithi073.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-12T18:35:43.022 INFO:teuthology.orchestra.run.smithi073.stdout: "plugin_dir": "/usr/lib/ceph", 2024-09-12T18:35:43.022 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "-", 2024-09-12T18:35:43.022 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrv": "", 2024-09-12T18:35:43.022 INFO:teuthology.orchestra.run.smithi073.stdout: "public_bind_addr": "-", 2024-09-12T18:35:43.022 INFO:teuthology.orchestra.run.smithi073.stdout: "public_network": "", 2024-09-12T18:35:43.022 INFO:teuthology.orchestra.run.smithi073.stdout: "public_network_interface": "", 2024-09-12T18:35:43.022 INFO:teuthology.orchestra.run.smithi073.stdout: "qat_compressor_busy_polling": "false", 2024-09-12T18:35:43.022 INFO:teuthology.orchestra.run.smithi073.stdout: "qat_compressor_enabled": "false", 2024-09-12T18:35:43.023 INFO:teuthology.orchestra.run.smithi073.stdout: "qat_compressor_session_max_number": "256", 2024-09-12T18:35:43.023 INFO:teuthology.orchestra.run.smithi073.stdout: "rados_mon_op_timeout": "0", 2024-09-12T18:35:43.023 INFO:teuthology.orchestra.run.smithi073.stdout: "rados_osd_op_timeout": "0", 2024-09-12T18:35:43.023 INFO:teuthology.orchestra.run.smithi073.stdout: "rados_tracing": "false", 2024-09-12T18:35:43.023 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_atime_update_interval": "60", 2024-09-12T18:35:43.023 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-12T18:35:43.023 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_balance_parent_reads": "false", 2024-09-12T18:35:43.023 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_balance_snap_reads": "false", 2024-09-12T18:35:43.023 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_blkin_trace_all": "false", 2024-09-12T18:35:43.023 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-12T18:35:43.023 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-12T18:35:43.023 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_cache": "true", 2024-09-12T18:35:43.023 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-12T18:35:43.023 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-12T18:35:43.024 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-12T18:35:43.024 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-12T18:35:43.024 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_cache_policy": "writearound", 2024-09-12T18:35:43.024 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_cache_size": "33554432", 2024-09-12T18:35:43.024 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-12T18:35:43.024 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-12T18:35:43.024 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_clone_copy_on_read": "false", 2024-09-12T18:35:43.024 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_compression_hint": "none", 2024-09-12T18:35:43.024 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_concurrent_management_ops": "10", 2024-09-12T18:35:43.024 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-12T18:35:43.024 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_default_clone_format": "auto", 2024-09-12T18:35:43.024 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_default_data_pool": "", 2024-09-12T18:35:43.024 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_default_features": "61", 2024-09-12T18:35:43.025 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_default_format": "2", 2024-09-12T18:35:43.025 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_default_map_options": "", 2024-09-12T18:35:43.025 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_default_order": "22", 2024-09-12T18:35:43.025 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_default_pool": "rbd", 2024-09-12T18:35:43.025 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-12T18:35:43.025 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_default_stripe_count": "0", 2024-09-12T18:35:43.025 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_default_stripe_unit": "0", 2024-09-12T18:35:43.025 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-12T18:35:43.025 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-12T18:35:43.025 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-12T18:35:43.025 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_enable_alloc_hint": "true", 2024-09-12T18:35:43.025 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-12T18:35:43.025 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_io_scheduler": "simple", 2024-09-12T18:35:43.025 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-12T18:35:43.026 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-12T18:35:43.026 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-12T18:35:43.026 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-12T18:35:43.026 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-12T18:35:43.026 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-12T18:35:43.026 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-12T18:35:43.026 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-12T18:35:43.026 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-12T18:35:43.026 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_order": "24", 2024-09-12T18:35:43.026 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_pool": "", 2024-09-12T18:35:43.026 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_splay_width": "4", 2024-09-12T18:35:43.026 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_localize_parent_reads": "false", 2024-09-12T18:35:43.028 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_localize_snap_reads": "false", 2024-09-12T18:35:43.028 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-12T18:35:43.028 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-12T18:35:43.028 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-12T18:35:43.028 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-12T18:35:43.028 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-12T18:35:43.028 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-12T18:35:43.028 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-12T18:35:43.028 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-12T18:35:43.029 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-12T18:35:43.029 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-12T18:35:43.029 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-12T18:35:43.029 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-12T18:35:43.029 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-12T18:35:43.029 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-12T18:35:43.029 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-12T18:35:43.029 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-12T18:35:43.029 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-12T18:35:43.029 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-12T18:35:43.029 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-12T18:35:43.029 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-12T18:35:43.029 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-12T18:35:43.029 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-12T18:35:43.030 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-12T18:35:43.030 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-12T18:35:43.030 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-12T18:35:43.030 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-12T18:35:43.030 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-12T18:35:43.030 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-12T18:35:43.030 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-12T18:35:43.030 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-12T18:35:43.030 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-12T18:35:43.030 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mtime_update_interval": "60", 2024-09-12T18:35:43.030 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_non_blocking_aio": "true", 2024-09-12T18:35:43.030 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_op_thread_timeout": "60", 2024-09-12T18:35:43.030 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_op_threads": "1", 2024-09-12T18:35:43.031 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_parent_cache_enabled": "false", 2024-09-12T18:35:43.031 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-12T18:35:43.031 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-12T18:35:43.031 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-12T18:35:43.031 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_plugins": "", 2024-09-12T18:35:43.031 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_bps_burst": "0", 2024-09-12T18:35:43.031 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-12T18:35:43.031 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_bps_limit": "0", 2024-09-12T18:35:43.031 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_exclude_ops": "0", 2024-09-12T18:35:43.031 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_iops_burst": "0", 2024-09-12T18:35:43.031 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-12T18:35:43.031 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_iops_limit": "0", 2024-09-12T18:35:43.031 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-12T18:35:43.031 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-12T18:35:43.032 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-12T18:35:43.032 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-12T18:35:43.032 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-12T18:35:43.032 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-12T18:35:43.032 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-12T18:35:43.032 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-12T18:35:43.032 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-12T18:35:43.032 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-12T18:35:43.032 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-12T18:35:43.032 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-12T18:35:43.032 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-12T18:35:43.032 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-12T18:35:43.032 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_read_from_replica_policy": "default", 2024-09-12T18:35:43.032 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-12T18:35:43.033 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-12T18:35:43.033 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-12T18:35:43.033 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-12T18:35:43.033 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_skip_partial_discard": "true", 2024-09-12T18:35:43.033 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-12T18:35:43.033 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_tracing": "false", 2024-09-12T18:35:43.033 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_validate_names": "true", 2024-09-12T18:35:43.033 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_validate_pool": "true", 2024-09-12T18:35:43.033 INFO:teuthology.orchestra.run.smithi073.stdout: "restapi_base_url": "", 2024-09-12T18:35:43.033 INFO:teuthology.orchestra.run.smithi073.stdout: "restapi_log_level": "", 2024-09-12T18:35:43.033 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-12T18:35:43.033 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-12T18:35:43.033 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_acl_grants_max_num": "100", 2024-09-12T18:35:43.034 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_admin_entry": "admin", 2024-09-12T18:35:43.034 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-12T18:35:43.034 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_asio_assert_yielding": "false", 2024-09-12T18:35:43.034 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_backend_store": "rados", 2024-09-12T18:35:43.034 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_barbican_url": "", 2024-09-12T18:35:43.034 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_beast_enable_async": "true", 2024-09-12T18:35:43.034 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_bucket_counters_cache": "false", 2024-09-12T18:35:43.034 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-12T18:35:43.034 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-12T18:35:43.034 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-12T18:35:43.034 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-12T18:35:43.034 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-12T18:35:43.034 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-12T18:35:43.035 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-12T18:35:43.035 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-12T18:35:43.035 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_cache_enabled": "true", 2024-09-12T18:35:43.035 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_cache_expiry_interval": "900", 2024-09-12T18:35:43.035 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_cache_lru_size": "25000", 2024-09-12T18:35:43.035 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_config_store": "rados", 2024-09-12T18:35:43.035 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_content_length_compat": "false", 2024-09-12T18:35:43.035 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_copy_obj_progress": "true", 2024-09-12T18:35:43.035 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-12T18:35:43.035 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_cors_rules_max_num": "100", 2024-09-12T18:35:43.035 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_cross_domain_policy": "", 2024-09-12T18:35:43.035 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-12T18:35:43.035 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_kmip_addr": "", 2024-09-12T18:35:43.035 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-12T18:35:43.036 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-12T18:35:43.036 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-12T18:35:43.036 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-12T18:35:43.036 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_kmip_password": "", 2024-09-12T18:35:43.036 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-12T18:35:43.036 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_kmip_username": "", 2024-09-12T18:35:43.036 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_require_ssl": "true", 2024-09-12T18:35:43.036 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-12T18:35:43.036 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-12T18:35:43.036 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-12T18:35:43.036 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-12T18:35:43.036 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-12T18:35:43.036 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-12T18:35:43.037 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-12T18:35:43.037 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-12T18:35:43.037 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-12T18:35:43.037 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-12T18:35:43.037 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-12T18:35:43.037 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-12T18:35:43.037 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-12T18:35:43.037 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-12T18:35:43.037 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-12T18:35:43.037 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_vault_addr": "", 2024-09-12T18:35:43.037 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_vault_auth": "token", 2024-09-12T18:35:43.037 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_vault_namespace": "", 2024-09-12T18:35:43.037 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_vault_prefix": "", 2024-09-12T18:35:43.038 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-12T18:35:43.038 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-12T18:35:43.038 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-12T18:35:43.038 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-12T18:35:43.038 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_vault_token_file": "", 2024-09-12T18:35:43.038 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-12T18:35:43.038 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_curl_buffersize": "524288", 2024-09-12T18:35:43.038 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-12T18:35:43.038 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_curl_low_speed_time": "300", 2024-09-12T18:35:43.038 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-12T18:35:43.038 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-12T18:35:43.038 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-12T18:35:43.038 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-12T18:35:43.038 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-12T18:35:43.039 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-12T18:35:43.039 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-12T18:35:43.039 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-12T18:35:43.039 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-12T18:35:43.039 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-12T18:35:43.039 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_d4n_address": "127.0.0.1:6379", 2024-09-12T18:35:43.039 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_d4n_l1_datacache_address": "127.0.0.1:6379", 2024-09-12T18:35:43.039 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2024-09-12T18:35:43.039 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_d4n_l1_datacache_size": "1073741824", 2024-09-12T18:35:43.039 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2024-09-12T18:35:43.039 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_d4n_l1_fadvise": "4", 2024-09-12T18:35:43.039 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_d4n_libaio_aio_num": "64", 2024-09-12T18:35:43.039 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_d4n_libaio_aio_threads": "20", 2024-09-12T18:35:43.040 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-12T18:35:43.040 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_data_log_changes_size": "1000", 2024-09-12T18:35:43.040 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_data_log_num_shards": "128", 2024-09-12T18:35:43.040 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-12T18:35:43.040 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_data_log_window": "30", 2024-09-12T18:35:43.040 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-12T18:35:43.040 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-12T18:35:43.040 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-12T18:35:43.040 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-12T18:35:43.040 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-12T18:35:43.040 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-12T18:35:43.040 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-12T18:35:43.040 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-12T18:35:43.040 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-12T18:35:43.041 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-12T18:35:43.041 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-12T18:35:43.041 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-12T18:35:43.041 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-12T18:35:43.041 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_disable_s3select": "false", 2024-09-12T18:35:43.041 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-12T18:35:43.041 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-12T18:35:43.041 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-12T18:35:43.041 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-12T18:35:43.041 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-12T18:35:43.041 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-12T18:35:43.041 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-12T18:35:43.041 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-12T18:35:43.042 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-12T18:35:43.042 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-12T18:35:43.042 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-12T18:35:43.042 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-12T18:35:43.042 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dns_name": "", 2024-09-12T18:35:43.042 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dns_s3website_name": "", 2024-09-12T18:35:43.042 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dynamic_resharding": "true", 2024-09-12T18:35:43.042 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dynamic_resharding_may_reduce": "true", 2024-09-12T18:35:43.042 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dynamic_resharding_reduction_wait": "120", 2024-09-12T18:35:43.042 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-12T18:35:43.042 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_enable_gc_threads": "true", 2024-09-12T18:35:43.042 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_enable_lc_threads": "true", 2024-09-12T18:35:43.042 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_enable_mdsearch": "true", 2024-09-12T18:35:43.043 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_enable_ops_log": "false", 2024-09-12T18:35:43.043 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_enable_quota_threads": "true", 2024-09-12T18:35:43.043 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_enable_static_website": "false", 2024-09-12T18:35:43.043 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_enable_usage_log": "false", 2024-09-12T18:35:43.043 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_enforce_swift_acls": "true", 2024-09-12T18:35:43.043 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_exit_timeout_secs": "120", 2024-09-12T18:35:43.043 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_expose_bucket": "false", 2024-09-12T18:35:43.043 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_extended_http_attrs": "", 2024-09-12T18:35:43.043 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_filter": "none", 2024-09-12T18:35:43.043 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-12T18:35:43.043 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_frontends": "beast port=7480", 2024-09-12T18:35:43.043 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-12T18:35:43.043 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_gc_max_deferred": "50", 2024-09-12T18:35:43.043 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-12T18:35:43.044 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_gc_max_objs": "32", 2024-09-12T18:35:43.044 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-12T18:35:43.044 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-12T18:35:43.044 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-12T18:35:43.044 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-12T18:35:43.044 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_gc_processor_period": "3600", 2024-09-12T18:35:43.044 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-12T18:35:43.044 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-12T18:35:43.044 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-12T18:35:43.045 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-12T18:35:43.045 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_init_timeout": "300", 2024-09-12T18:35:43.045 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-12T18:35:43.045 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-12T18:35:43.045 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_kafka_connection_idle": "300", 2024-09-12T18:35:43.045 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-12T18:35:43.045 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-12T18:35:43.045 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-12T18:35:43.045 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-12T18:35:43.045 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-12T18:35:43.045 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_admin_domain": "", 2024-09-12T18:35:43.045 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_admin_password": "", 2024-09-12T18:35:43.045 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_admin_password_path": "", 2024-09-12T18:35:43.046 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_admin_project": "", 2024-09-12T18:35:43.046 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_admin_tenant": "", 2024-09-12T18:35:43.046 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_admin_token": "", 2024-09-12T18:35:43.046 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_admin_token_path": "", 2024-09-12T18:35:43.046 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_admin_user": "", 2024-09-12T18:35:43.046 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_barbican_domain": "", 2024-09-12T18:35:43.046 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_barbican_password": "", 2024-09-12T18:35:43.046 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_barbican_project": "", 2024-09-12T18:35:43.046 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-12T18:35:43.046 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_barbican_user": "", 2024-09-12T18:35:43.046 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-12T18:35:43.046 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-12T18:35:43.046 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-12T18:35:43.047 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-12T18:35:43.047 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-12T18:35:43.047 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_url": "", 2024-09-12T18:35:43.047 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-12T18:35:43.047 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_lc_debug_interval": "-1", 2024-09-12T18:35:43.047 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_lc_lock_max_time": "90", 2024-09-12T18:35:43.047 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_lc_max_objs": "32", 2024-09-12T18:35:43.047 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_lc_max_rules": "1000", 2024-09-12T18:35:43.047 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_lc_max_worker": "3", 2024-09-12T18:35:43.047 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-12T18:35:43.047 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_lc_thread_delay": "0", 2024-09-12T18:35:43.047 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-12T18:35:43.047 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ldap_dnattr": "uid", 2024-09-12T18:35:43.047 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-12T18:35:43.048 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ldap_searchfilter": "", 2024-09-12T18:35:43.048 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-12T18:35:43.048 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ldap_uri": "", 2024-09-12T18:35:43.048 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_lfuda_sync_frequency": "60", 2024-09-12T18:35:43.048 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-12T18:35:43.048 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-12T18:35:43.048 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-12T18:35:43.048 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_log_http_headers": "", 2024-09-12T18:35:43.048 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-12T18:35:43.048 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-12T18:35:43.048 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_log_object_name_utc": "false", 2024-09-12T18:35:43.048 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-12T18:35:43.048 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-12T18:35:43.049 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_attr_name_len": "0", 2024-09-12T18:35:43.049 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_attr_size": "0", 2024-09-12T18:35:43.049 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-12T18:35:43.049 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_chunk_size": "4194304", 2024-09-12T18:35:43.049 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-12T18:35:43.049 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-12T18:35:43.049 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-12T18:35:43.049 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_listing_results": "5000", 2024-09-12T18:35:43.049 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_notify_retries": "10", 2024-09-12T18:35:43.049 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-12T18:35:43.049 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_put_param_size": "1048576", 2024-09-12T18:35:43.049 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_put_size": "5368709120", 2024-09-12T18:35:43.049 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_slo_entries": "1000", 2024-09-12T18:35:43.049 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_md_log_max_shards": "64", 2024-09-12T18:35:43.050 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-12T18:35:43.050 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-12T18:35:43.050 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-12T18:35:43.050 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-12T18:35:43.050 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_mp_lock_max_time": "600", 2024-09-12T18:35:43.050 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-12T18:35:43.050 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-12T18:35:43.050 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-12T18:35:43.050 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-12T18:35:43.050 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-12T18:35:43.050 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-12T18:35:43.050 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-12T18:35:43.050 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-12T18:35:43.050 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_max_gc": "300", 2024-09-12T18:35:43.051 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-12T18:35:43.051 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-12T18:35:43.051 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-12T18:35:43.051 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-12T18:35:43.051 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-12T18:35:43.051 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-12T18:35:43.051 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-12T18:35:43.051 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_num_async_rados_threads": "32", 2024-09-12T18:35:43.051 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_num_control_oids": "8", 2024-09-12T18:35:43.051 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_numa_node": "-1", 2024-09-12T18:35:43.051 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-12T18:35:43.051 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-12T18:35:43.051 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_objexp_chunk_size": "100", 2024-09-12T18:35:43.052 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_objexp_gc_interval": "600", 2024-09-12T18:35:43.052 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-12T18:35:43.052 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-12T18:35:43.052 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-12T18:35:43.052 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_op_thread_timeout": "600", 2024-09-12T18:35:43.052 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_op_tracing": "false", 2024-09-12T18:35:43.052 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_opa_token": "", 2024-09-12T18:35:43.052 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_opa_url": "", 2024-09-12T18:35:43.052 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_opa_verify_ssl": "true", 2024-09-12T18:35:43.052 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-12T18:35:43.052 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-12T18:35:43.052 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ops_log_rados": "false", 2024-09-12T18:35:43.052 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ops_log_socket_path": "", 2024-09-12T18:35:43.052 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-12T18:35:43.053 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-12T18:35:43.053 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-12T18:35:43.053 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_period_push_interval": "2.000000", 2024-09-12T18:35:43.053 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-12T18:35:43.053 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-12T18:35:43.053 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-12T18:35:43.053 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-12T18:35:43.053 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_posix_cache_lanes": "3", 2024-09-12T18:35:43.053 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-12T18:35:43.053 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-12T18:35:43.053 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_posix_cache_partitions": "3", 2024-09-12T18:35:43.053 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-12T18:35:43.053 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_print_continue": "true", 2024-09-12T18:35:43.054 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-12T18:35:43.054 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-12T18:35:43.054 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-12T18:35:43.054 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-12T18:35:43.054 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-12T18:35:43.054 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_rados_tracing": "false", 2024-09-12T18:35:43.054 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_realm": "", 2024-09-12T18:35:43.054 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_realm_id": "", 2024-09-12T18:35:43.054 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-12T18:35:43.054 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_region": "", 2024-09-12T18:35:43.054 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-12T18:35:43.054 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-12T18:35:43.054 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-12T18:35:43.054 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-12T18:35:43.055 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_request_uri": "", 2024-09-12T18:35:43.055 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_reshard_batch_size": "64", 2024-09-12T18:35:43.055 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-12T18:35:43.055 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_reshard_debug_interval": "-1", 2024-09-12T18:35:43.055 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_reshard_max_aio": "128", 2024-09-12T18:35:43.055 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_reshard_num_logs": "16", 2024-09-12T18:35:43.055 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_reshard_progress_judge_interval": "120", 2024-09-12T18:35:43.055 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_reshard_progress_judge_ratio": "0.500000", 2024-09-12T18:35:43.055 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_reshard_thread_interval": "600", 2024-09-12T18:35:43.055 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_reshardlog_threshold": "30000", 2024-09-12T18:35:43.055 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_resolve_cname": "false", 2024-09-12T18:35:43.055 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-12T18:35:43.055 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_run_sync_thread": "true", 2024-09-12T18:35:43.055 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-12T18:35:43.056 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-12T18:35:43.056 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-12T18:35:43.056 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-12T18:35:43.056 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-12T18:35:43.056 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-12T18:35:43.056 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-12T18:35:43.056 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-12T18:35:43.056 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-12T18:35:43.056 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_scheduler_type": "throttler", 2024-09-12T18:35:43.056 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_script_uri": "", 2024-09-12T18:35:43.056 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_service_provider_name": "", 2024-09-12T18:35:43.056 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-12T18:35:43.056 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sts_client_id": "", 2024-09-12T18:35:43.057 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sts_client_secret": "", 2024-09-12T18:35:43.057 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sts_entry": "sts", 2024-09-12T18:35:43.057 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sts_key": "sts", 2024-09-12T18:35:43.057 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-12T18:35:43.057 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sts_min_session_duration": "900", 2024-09-12T18:35:43.057 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sts_token_introspection_url": "", 2024-09-12T18:35:43.057 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_account_in_url": "false", 2024-09-12T18:35:43.057 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_auth_entry": "auth", 2024-09-12T18:35:43.057 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_auth_url": "", 2024-09-12T18:35:43.057 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_custom_header": "", 2024-09-12T18:35:43.057 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-12T18:35:43.057 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_need_stats": "true", 2024-09-12T18:35:43.057 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_tenant_name": "", 2024-09-12T18:35:43.057 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_token_expiration": "86400", 2024-09-12T18:35:43.058 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_url": "", 2024-09-12T18:35:43.058 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_url_prefix": "swift", 2024-09-12T18:35:43.058 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-12T18:35:43.058 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-12T18:35:43.058 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-12T18:35:43.058 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_lease_period": "120", 2024-09-12T18:35:43.058 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-12T18:35:43.058 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-12T18:35:43.058 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-12T18:35:43.058 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-12T18:35:43.058 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-12T18:35:43.058 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-12T18:35:43.058 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-12T18:35:43.059 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-12T18:35:43.059 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-12T18:35:43.059 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_thread_pool_size": "512", 2024-09-12T18:35:43.059 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-12T18:35:43.059 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-12T18:35:43.059 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-12T18:35:43.059 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-12T18:35:43.059 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_torrent_comment": "", 2024-09-12T18:35:43.059 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_torrent_createby": "", 2024-09-12T18:35:43.059 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_torrent_encoding": "", 2024-09-12T18:35:43.059 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_torrent_flag": "false", 2024-09-12T18:35:43.059 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-12T18:35:43.059 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_torrent_origin": "", 2024-09-12T18:35:43.059 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-12T18:35:43.060 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_torrent_tracker": "", 2024-09-12T18:35:43.060 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_trust_forwarded_https": "false", 2024-09-12T18:35:43.060 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-12T18:35:43.060 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-12T18:35:43.060 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_usage_max_shards": "32", 2024-09-12T18:35:43.060 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_usage_max_user_shards": "1", 2024-09-12T18:35:43.060 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_use_opa_authz": "false", 2024-09-12T18:35:43.060 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_user_counters_cache": "false", 2024-09-12T18:35:43.060 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-12T18:35:43.060 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-12T18:35:43.060 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-12T18:35:43.060 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_user_max_buckets": "1000", 2024-09-12T18:35:43.060 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_user_policies_max_num": "100", 2024-09-12T18:35:43.061 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-12T18:35:43.061 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-12T18:35:43.061 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-12T18:35:43.061 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-12T18:35:43.061 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_user_unique_email": "true", 2024-09-12T18:35:43.061 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_verify_ssl": "true", 2024-09-12T18:35:43.061 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-12T18:35:43.061 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_zone": "", 2024-09-12T18:35:43.061 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_zone_id": "", 2024-09-12T18:35:43.061 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-12T18:35:43.061 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_zonegroup": "", 2024-09-12T18:35:43.061 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_zonegroup_id": "", 2024-09-12T18:35:43.061 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-12T18:35:43.062 INFO:teuthology.orchestra.run.smithi073.stdout: "rgwlc_auto_session_clear": "true", 2024-09-12T18:35:43.062 INFO:teuthology.orchestra.run.smithi073.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-12T18:35:43.062 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_block_size": "4096", 2024-09-12T18:35:43.062 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-12T18:35:43.062 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-12T18:35:43.062 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-12T18:35:43.062 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-12T18:35:43.062 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-12T18:35:43.062 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_cache_size": "536870912", 2024-09-12T18:35:43.062 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-12T18:35:43.062 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-12T18:35:43.062 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-12T18:35:43.062 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-12T18:35:43.063 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-12T18:35:43.063 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-12T18:35:43.063 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-12T18:35:43.063 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-12T18:35:43.063 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_index_type": "binary_search", 2024-09-12T18:35:43.063 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-12T18:35:43.063 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-12T18:35:43.063 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_partition_filters": "false", 2024-09-12T18:35:43.063 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_perf": "false", 2024-09-12T18:35:43.063 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-12T18:35:43.063 INFO:teuthology.orchestra.run.smithi073.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-12T18:35:43.063 INFO:teuthology.orchestra.run.smithi073.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-12T18:35:43.063 INFO:teuthology.orchestra.run.smithi073.stdout: "run_dir": "/var/run/ceph", 2024-09-12T18:35:43.063 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_block_create": "true", 2024-09-12T18:35:43.064 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_cache_lru_size": "67108864", 2024-09-12T18:35:43.064 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-12T18:35:43.064 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-12T18:35:43.064 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_default_max_object_size": "16777216", 2024-09-12T18:35:43.064 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-12T18:35:43.064 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_device_size": "53687091200", 2024-09-12T18:35:43.064 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-12T18:35:43.064 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_full_integrity_check": "false", 2024-09-12T18:35:43.064 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_journal_batch_capacity": "16", 2024-09-12T18:35:43.064 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-12T18:35:43.064 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-12T18:35:43.064 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-12T18:35:43.064 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_main_device_type": "SSD", 2024-09-12T18:35:43.065 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-12T18:35:43.065 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-12T18:35:43.065 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-12T18:35:43.065 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-12T18:35:43.065 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-12T18:35:43.065 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-12T18:35:43.065 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_segment_size": "67108864", 2024-09-12T18:35:43.065 INFO:teuthology.orchestra.run.smithi073.stdout: "set_keepcaps": "false", 2024-09-12T18:35:43.065 INFO:teuthology.orchestra.run.smithi073.stdout: "setgroup": "", 2024-09-12T18:35:43.065 INFO:teuthology.orchestra.run.smithi073.stdout: "setuser": "", 2024-09-12T18:35:43.065 INFO:teuthology.orchestra.run.smithi073.stdout: "setuser_match_path": "", 2024-09-12T18:35:43.065 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-12T18:35:43.065 INFO:teuthology.orchestra.run.smithi073.stdout: "thp": "false", 2024-09-12T18:35:43.065 INFO:teuthology.orchestra.run.smithi073.stdout: "threadpool_default_timeout": "60", 2024-09-12T18:35:43.066 INFO:teuthology.orchestra.run.smithi073.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-12T18:35:43.066 INFO:teuthology.orchestra.run.smithi073.stdout: "throttler_perf_counter": "true", 2024-09-12T18:35:43.066 INFO:teuthology.orchestra.run.smithi073.stdout: "tmp_dir": "/tmp", 2024-09-12T18:35:43.066 INFO:teuthology.orchestra.run.smithi073.stdout: "tmp_file_template": "/tmp/ceph-mon.a.XXXXXX", 2024-09-12T18:35:43.066 INFO:teuthology.orchestra.run.smithi073.stdout: "uadk_compressor_enabled": "false", 2024-09-12T18:35:43.066 INFO:teuthology.orchestra.run.smithi073.stdout: "uadk_wd_sync_ctx_num": "2" 2024-09-12T18:35:43.066 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T18:35:43.067 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-12T18:35:43.208 INFO:teuthology.orchestra.run.smithi073.stdout:mon.a: {} 2024-09-12T18:35:43.208 INFO:teuthology.orchestra.run.smithi073.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T18:35:43.217 INFO:teuthology.orchestra.run.smithi073.stdout:mon.b: {} 2024-09-12T18:35:43.217 INFO:teuthology.orchestra.run.smithi073.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T18:35:43.226 INFO:teuthology.orchestra.run.smithi073.stdout:mon.c: {} 2024-09-12T18:35:43.226 INFO:teuthology.orchestra.run.smithi073.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T18:35:43.241 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2024-09-12T18:35:43.242 INFO:teuthology.run_tasks:Running task radosbench... 2024-09-12T18:35:43.252 INFO:tasks.radosbench:Beginning radosbench... 2024-09-12T18:35:43.253 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2024-09-12T18:35:43.253 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 2024-09-12T18:35:43.253 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-12T18:35:43.253 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:35:43.253 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:35:43.254 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-09-12T18:35:43.254 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-12T18:35:43.254 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-12T18:35:43.254 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-09-12T18:35:43.254 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-12T18:35:43.255 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-12T18:35:43.255 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:35:43.255 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-12T18:35:43.255 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:35:43.256 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-12T18:35:43.256 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T18:35:43.258 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:43.255+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:43.356 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:43.350+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:43.388 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:35:43.388 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2024-09-12T18:35:43.388 INFO:teuthology.orchestra.run.smithi114.stdout: "num_ops": 0 2024-09-12T18:35:43.388 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:35:43.389 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:35:43.389 INFO:teuthology.orchestra.run.smithi162.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-12T18:35:43.389 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:35:43.393 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:35:43.393 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:35:43.403 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:35:43.414 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:35:43.414 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:35:43.432 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:35:43.432 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:35:43.494 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:43.490+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:43.558 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:43.554+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:43.569 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:43.569 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:43.583 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:35:43.659 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:43.659+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:43.743 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'unique_pool_0' created 2024-09-12T18:35:43.749 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is set 2024-09-12T18:35:43.749 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:43.749 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:43.760 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:43.754+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:43.766 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:35:43.769 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2024-09-12T18:35:43.860 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:43.859+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:43.897 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:43.898 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:43.913 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:35:43.961 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:43.959+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:44.062 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:44.059+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:44.078 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:44.078 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:44.093 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:35:44.163 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:44.159+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:44.214 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:44.214 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:44.228 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:35:44.275 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:44.275+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:44.359 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:44.359 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:44.364 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:44.362+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:44.374 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:35:44.465 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:44.458+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:44.541 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:44.541 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:44.556 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:35:44.565 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:44.567+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:44.666 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:44.667+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:44.675 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:44.676 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:44.691 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:35:44.760 INFO:teuthology.orchestra.run.smithi073.stderr:enabled application 'rados' on pool 'unique_pool_0' 2024-09-12T18:35:44.768 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:44.767+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:44.825 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:44.825 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:44.839 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:35:44.868 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:44.867+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:44.962 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:44.962 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:44.970 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:44.971+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:44.977 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:35:45.071 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:45.067+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:45.098 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:45.098 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:45.112 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:35:45.172 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:45.171+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:45.242 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:45.242 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:45.256 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:35:45.272 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:45.271+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:45.372 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:45.373 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:45.373 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:45.370+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:45.386 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:35:45.448 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:35:45.473 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:45.471+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:45.503 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:45.503 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:45.517 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:35:45.575 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:45.570+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:45.605 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:35:45.605 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:35:45.628 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:35:45.628 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:35:45.650 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:35:45.650 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:35:45.650 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:35:45.651 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [], 2024-09-12T18:35:45.651 INFO:teuthology.orchestra.run.smithi162.stdout: "num_ops": 0 2024-09-12T18:35:45.651 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:35:45.665 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:35:45.675 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:45.675+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:45.771 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T18:35:45.776 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:45.775+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:45.785 DEBUG:teuthology.orchestra.run.smithi073:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_0 bench 60 write' 2024-09-12T18:35:45.786 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:35:45.787 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [], 2024-09-12T18:35:45.787 INFO:teuthology.orchestra.run.smithi162.stdout: "complaint_time": 30, 2024-09-12T18:35:45.787 INFO:teuthology.orchestra.run.smithi162.stdout: "num_blocked_ops": 0 2024-09-12T18:35:45.787 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:35:45.802 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:35:45.819 INFO:teuthology.run_tasks:Running task admin_socket... 2024-09-12T18:35:45.830 DEBUG:tasks.admin_socket:Running admin socket tests on client.0 2024-09-12T18:35:45.830 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -- /home/ubuntu/cephtest/admin_socket_client.0 && while test '!' -e /var/run/ceph/ceph-client.0.asok ; do sleep 1 ; done 2024-09-12T18:35:45.866 INFO:tasks.radosbench.radosbench.0.smithi073.stdout:hints = 1 2024-09-12T18:35:45.866 INFO:tasks.radosbench.radosbench.0.smithi073.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 60 seconds or 0 objects 2024-09-12T18:35:45.866 INFO:tasks.radosbench.radosbench.0.smithi073.stdout:Object prefix: benchmark_data_smithi073_23739 2024-09-12T18:35:45.867 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-12T18:35:45.867 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 0 0 0 0 0 0 - 0 2024-09-12T18:35:45.880 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:45.875+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:45.952 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:35:45.952 INFO:teuthology.orchestra.run.smithi162.stdout: "size": 20, 2024-09-12T18:35:45.952 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 600, 2024-09-12T18:35:45.952 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:35:45.953 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.953 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4154.0:123 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:35:45.953 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:35:45.953 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 31.973533278000001, 2024-09-12T18:35:45.953 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.022398096999999999, 2024-09-12T18:35:45.953 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:45.953 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:45.953 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:45.953 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:35:45.953 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4154", 2024-09-12T18:35:45.953 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/745129001", 2024-09-12T18:35:45.953 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 123 2024-09-12T18:35:45.953 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.954 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:45.954 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.954 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:45.954 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:35:45.954 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:45.954 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.954 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.954 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:45.954 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:35:45.954 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:45.954 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.954 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.954 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:45.955 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:35:45.955 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.8299999999999996e-07 2024-09-12T18:35:45.955 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.955 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.955 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:45.955 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976528+0000", 2024-09-12T18:35:45.955 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011393299999999999 2024-09-12T18:35:45.955 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.955 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.955 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:45.955 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976539+0000", 2024-09-12T18:35:45.955 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0763e-05 2024-09-12T18:35:45.955 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.956 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.956 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:45.956 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976547+0000", 2024-09-12T18:35:45.956 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8199999999999997e-06 2024-09-12T18:35:45.956 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.956 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.956 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:45.956 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.995057+0000", 2024-09-12T18:35:45.957 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.018510047000000002 2024-09-12T18:35:45.957 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.957 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.957 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:45.957 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.995301+0000", 2024-09-12T18:35:45.957 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00024375899999999999 2024-09-12T18:35:45.957 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.957 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.957 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:45.957 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.995642+0000", 2024-09-12T18:35:45.957 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00034121100000000001 2024-09-12T18:35:45.957 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.958 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.958 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:45.958 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998179+0000", 2024-09-12T18:35:45.958 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00253761 2024-09-12T18:35:45.958 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.958 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.958 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:45.958 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998665+0000", 2024-09-12T18:35:45.958 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00048574600000000001 2024-09-12T18:35:45.959 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.959 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.959 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:45.959 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998739+0000", 2024-09-12T18:35:45.959 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.4286e-05 2024-09-12T18:35:45.959 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.959 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.959 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:45.959 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998812+0000", 2024-09-12T18:35:45.959 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2238999999999997e-05 2024-09-12T18:35:45.959 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:45.959 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:45.959 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:45.959 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.960 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.960 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4154.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:35:45.960 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:35:45.960 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 31.973386046000002, 2024-09-12T18:35:45.960 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025950709999999998, 2024-09-12T18:35:45.960 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:45.960 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:45.960 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:45.960 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:35:45.960 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4154", 2024-09-12T18:35:45.960 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/745129001", 2024-09-12T18:35:45.960 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 124 2024-09-12T18:35:45.961 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.961 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:45.961 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.961 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:45.961 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:35:45.961 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:45.961 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.961 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.961 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:45.961 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:35:45.961 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:45.961 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.961 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.962 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:45.962 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976562+0000", 2024-09-12T18:35:45.962 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.2999999999999999e-07 2024-09-12T18:35:45.962 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.962 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.962 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:45.962 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976567+0000", 2024-09-12T18:35:45.962 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3430000000000003e-06 2024-09-12T18:35:45.962 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.962 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.962 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:45.962 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976576+0000", 2024-09-12T18:35:45.962 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8070000000000006e-06 2024-09-12T18:35:45.962 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.963 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.963 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:45.963 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976583+0000", 2024-09-12T18:35:45.963 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9959999999999996e-06 2024-09-12T18:35:45.963 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.963 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.963 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:45.963 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997107+0000", 2024-09-12T18:35:45.963 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.020524106 2024-09-12T18:35:45.963 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.963 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.963 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:45.963 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997225+0000", 2024-09-12T18:35:45.963 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000117909 2024-09-12T18:35:45.964 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.964 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.964 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:45.964 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997407+0000", 2024-09-12T18:35:45.964 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00018175900000000001 2024-09-12T18:35:45.964 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.964 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.964 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:45.964 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998839+0000", 2024-09-12T18:35:45.964 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001432539 2024-09-12T18:35:45.964 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.964 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.964 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:45.964 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002319+0000", 2024-09-12T18:35:45.965 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0034803529999999998 2024-09-12T18:35:45.965 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.965 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.965 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:45.965 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002405+0000", 2024-09-12T18:35:45.965 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5434999999999998e-05 2024-09-12T18:35:45.965 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.965 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.965 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:45.965 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002512+0000", 2024-09-12T18:35:45.965 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010663299999999999 2024-09-12T18:35:45.965 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:45.965 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:45.965 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:45.966 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.966 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.966 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:45.966 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:35:45.966 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 20.308588538999999, 2024-09-12T18:35:45.966 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025127867000000002, 2024-09-12T18:35:45.966 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:45.966 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:45.966 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:45.966 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:45.966 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.966 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:45.966 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:35:45.966 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:45.967 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.967 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.967 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:45.967 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:35:45.967 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:45.967 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.967 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.967 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:45.967 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641362+0000", 2024-09-12T18:35:45.967 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.2569999999999999e-06 2024-09-12T18:35:45.967 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.967 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.967 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:45.968 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641374+0000", 2024-09-12T18:35:45.968 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2696e-05 2024-09-12T18:35:45.968 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.968 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.968 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:45.968 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641403+0000", 2024-09-12T18:35:45.968 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.8756999999999999e-05 2024-09-12T18:35:45.968 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.968 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.968 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:45.968 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641430+0000", 2024-09-12T18:35:45.968 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.6452999999999999e-05 2024-09-12T18:35:45.968 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.969 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.969 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:45.969 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641585+0000", 2024-09-12T18:35:45.969 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000155799 2024-09-12T18:35:45.969 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.969 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.969 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:45.969 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641753+0000", 2024-09-12T18:35:45.969 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000167868 2024-09-12T18:35:45.969 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.969 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.969 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:45.969 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641916+0000", 2024-09-12T18:35:45.970 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000162903 2024-09-12T18:35:45.970 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.970 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.970 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:45.970 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653655+0000", 2024-09-12T18:35:45.970 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011738879000000001 2024-09-12T18:35:45.970 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.970 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.970 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:45.970 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665515+0000", 2024-09-12T18:35:45.970 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011859915 2024-09-12T18:35:45.970 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.970 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.971 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:45.971 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665646+0000", 2024-09-12T18:35:45.971 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013122599999999999 2024-09-12T18:35:45.971 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.971 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.971 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:45.971 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666486+0000", 2024-09-12T18:35:45.971 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00084011399999999999 2024-09-12T18:35:45.971 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:45.971 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:45.971 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:45.971 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.971 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.971 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:45.972 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:35:45.972 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 20.308474076, 2024-09-12T18:35:45.972 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025384584000000002, 2024-09-12T18:35:45.972 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:45.972 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:45.972 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:45.972 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:45.972 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.972 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:45.972 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:35:45.972 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:45.972 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.972 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.973 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:45.973 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:35:45.973 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:45.973 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.973 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.973 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:45.973 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641474+0000", 2024-09-12T18:35:45.973 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.39e-06 2024-09-12T18:35:45.973 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.973 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.973 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:45.973 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641482+0000", 2024-09-12T18:35:45.973 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3499999999999999e-06 2024-09-12T18:35:45.974 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.974 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.974 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:45.974 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641534+0000", 2024-09-12T18:35:45.974 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2533e-05 2024-09-12T18:35:45.974 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.974 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.974 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:45.974 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641551+0000", 2024-09-12T18:35:45.974 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6515999999999999e-05 2024-09-12T18:35:45.974 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.974 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.974 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:45.974 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642630+0000", 2024-09-12T18:35:45.975 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001079705 2024-09-12T18:35:45.975 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.975 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.975 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:45.975 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642909+0000", 2024-09-12T18:35:45.975 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027859800000000002 2024-09-12T18:35:45.975 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.975 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.975 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:45.975 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643137+0000", 2024-09-12T18:35:45.975 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022803799999999999 2024-09-12T18:35:45.975 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.975 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.976 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:45.976 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653669+0000", 2024-09-12T18:35:45.976 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010532032 2024-09-12T18:35:45.976 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.976 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.976 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:45.976 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666624+0000", 2024-09-12T18:35:45.976 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012954940999999999 2024-09-12T18:35:45.976 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.976 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.976 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:45.976 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666762+0000", 2024-09-12T18:35:45.976 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000137668 2024-09-12T18:35:45.976 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.977 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.977 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:45.977 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666857+0000", 2024-09-12T18:35:45.977 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.5812999999999999e-05 2024-09-12T18:35:45.977 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:45.977 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:45.977 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:45.977 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.977 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.977 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:45.977 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:35:45.977 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 20.308346280999999, 2024-09-12T18:35:45.977 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025661562999999998, 2024-09-12T18:35:45.977 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:45.978 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:45.978 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:45.978 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:45.978 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.978 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:45.978 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:35:45.978 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:45.978 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.978 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.978 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:45.978 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:35:45.978 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:45.978 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.978 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.979 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:45.979 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641602+0000", 2024-09-12T18:35:45.979 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3540000000000001e-06 2024-09-12T18:35:45.979 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.979 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.979 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:45.979 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641637+0000", 2024-09-12T18:35:45.979 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5145999999999999e-05 2024-09-12T18:35:45.979 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.979 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.979 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:45.979 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641659+0000", 2024-09-12T18:35:45.979 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2249999999999999e-05 2024-09-12T18:35:45.979 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.980 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.980 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:45.980 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641675+0000", 2024-09-12T18:35:45.980 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6059999999999999e-05 2024-09-12T18:35:45.980 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.980 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.980 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:45.980 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644570+0000", 2024-09-12T18:35:45.980 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028947069999999998 2024-09-12T18:35:45.980 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.980 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.980 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:45.980 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644900+0000", 2024-09-12T18:35:45.981 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000329401 2024-09-12T18:35:45.981 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.981 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.981 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:45.981 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645235+0000", 2024-09-12T18:35:45.981 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000335874 2024-09-12T18:35:45.981 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.981 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.981 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:45.981 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655459+0000", 2024-09-12T18:35:45.981 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010223441999999999 2024-09-12T18:35:45.981 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.981 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.981 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:45.982 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667028+0000", 2024-09-12T18:35:45.982 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011568673999999999 2024-09-12T18:35:45.982 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.982 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.982 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:45.982 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667163+0000", 2024-09-12T18:35:45.982 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013525500000000001 2024-09-12T18:35:45.982 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.982 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.982 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:45.982 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667262+0000", 2024-09-12T18:35:45.982 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9400000000000004e-05 2024-09-12T18:35:45.982 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:45.982 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:45.983 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:45.983 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.983 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.983 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:45.983 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:35:45.983 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 20.308244461000001, 2024-09-12T18:35:45.983 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025971339, 2024-09-12T18:35:45.983 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:45.983 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:45.983 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:45.983 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:45.983 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.983 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:45.983 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:35:45.984 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:45.984 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.984 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.984 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:45.984 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:35:45.984 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:45.984 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.984 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.984 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:45.984 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641704+0000", 2024-09-12T18:35:45.984 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.297e-06 2024-09-12T18:35:45.984 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.984 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.985 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:45.985 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641712+0000", 2024-09-12T18:35:45.985 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.9060000000000002e-06 2024-09-12T18:35:45.985 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.985 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.985 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:45.985 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641731+0000", 2024-09-12T18:35:45.985 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9083e-05 2024-09-12T18:35:45.985 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.985 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.985 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:45.985 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641745+0000", 2024-09-12T18:35:45.985 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4066999999999999e-05 2024-09-12T18:35:45.986 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.986 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.986 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:45.986 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646529+0000", 2024-09-12T18:35:45.986 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.004784033 2024-09-12T18:35:45.986 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.986 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.986 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:45.986 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646727+0000", 2024-09-12T18:35:45.986 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019841800000000001 2024-09-12T18:35:45.986 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.986 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.986 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:45.986 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647057+0000", 2024-09-12T18:35:45.987 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032926800000000002 2024-09-12T18:35:45.987 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.987 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.987 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:45.987 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655475+0000", 2024-09-12T18:35:45.987 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0084186250000000008 2024-09-12T18:35:45.987 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.987 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.987 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:45.987 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667424+0000", 2024-09-12T18:35:45.987 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011949257 2024-09-12T18:35:45.987 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.987 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.987 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:45.988 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667573+0000", 2024-09-12T18:35:45.988 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014851900000000001 2024-09-12T18:35:45.988 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.988 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.988 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:45.988 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667674+0000", 2024-09-12T18:35:45.988 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010086600000000001 2024-09-12T18:35:45.988 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:45.988 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:45.988 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:45.988 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.988 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.988 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:45.988 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:35:45.989 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 20.308182072000001, 2024-09-12T18:35:45.989 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026215008000000001, 2024-09-12T18:35:45.989 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:45.989 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:45.989 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:45.989 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:45.989 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.989 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:45.989 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:35:45.989 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:45.989 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.989 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.989 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:45.989 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:35:45.990 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:45.990 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.990 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.990 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:45.990 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641766+0000", 2024-09-12T18:35:45.990 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1200000000000001e-06 2024-09-12T18:35:45.990 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.990 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.990 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:45.990 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641775+0000", 2024-09-12T18:35:45.990 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.2499999999999995e-06 2024-09-12T18:35:45.990 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.990 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.991 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:45.991 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641793+0000", 2024-09-12T18:35:45.991 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7773000000000001e-05 2024-09-12T18:35:45.991 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.991 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.991 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:45.991 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641807+0000", 2024-09-12T18:35:45.991 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3814e-05 2024-09-12T18:35:45.991 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.991 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.991 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:45.991 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647626+0000", 2024-09-12T18:35:45.991 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0058193050000000003 2024-09-12T18:35:45.991 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.991 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.992 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:45.992 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647937+0000", 2024-09-12T18:35:45.992 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031112400000000003 2024-09-12T18:35:45.992 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.992 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.992 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:45.992 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648239+0000", 2024-09-12T18:35:45.992 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00030227500000000002 2024-09-12T18:35:45.992 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.992 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.992 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:45.992 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655487+0000", 2024-09-12T18:35:45.992 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072479129999999999 2024-09-12T18:35:45.992 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.993 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.993 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:45.993 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667823+0000", 2024-09-12T18:35:45.993 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012335505 2024-09-12T18:35:45.993 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.993 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.993 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:45.993 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667908+0000", 2024-09-12T18:35:45.993 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4843000000000001e-05 2024-09-12T18:35:45.993 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.993 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.993 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:45.993 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667980+0000", 2024-09-12T18:35:45.994 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2086000000000001e-05 2024-09-12T18:35:45.994 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:45.994 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:45.994 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:45.994 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.994 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.994 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:45.994 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:35:45.994 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 20.308121919000001, 2024-09-12T18:35:45.994 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026483236, 2024-09-12T18:35:45.994 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:45.994 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:45.994 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:45.994 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:45.994 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.995 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:45.995 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:35:45.995 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:45.995 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.995 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.995 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:45.995 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:35:45.995 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:45.995 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.995 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.995 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:45.995 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641826+0000", 2024-09-12T18:35:45.995 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:35:45.995 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.995 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.996 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:45.996 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641832+0000", 2024-09-12T18:35:45.996 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4199999999999998e-06 2024-09-12T18:35:45.996 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.996 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.996 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:45.996 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641848+0000", 2024-09-12T18:35:45.996 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6492999999999999e-05 2024-09-12T18:35:45.996 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.996 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.996 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:45.996 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641863+0000", 2024-09-12T18:35:45.996 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5427e-05 2024-09-12T18:35:45.996 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.997 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.997 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:45.997 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648887+0000", 2024-09-12T18:35:45.997 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0070230860000000004 2024-09-12T18:35:45.997 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.997 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.997 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:45.997 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649111+0000", 2024-09-12T18:35:45.997 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022425799999999999 2024-09-12T18:35:45.997 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.997 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.997 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:45.997 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649494+0000", 2024-09-12T18:35:45.997 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00038349400000000001 2024-09-12T18:35:45.998 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.998 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.998 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:45.998 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655499+0000", 2024-09-12T18:35:45.998 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0060047260000000002 2024-09-12T18:35:45.998 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.998 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.998 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:45.998 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668110+0000", 2024-09-12T18:35:45.998 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012610543 2024-09-12T18:35:45.998 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.998 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.998 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:45.998 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668252+0000", 2024-09-12T18:35:45.998 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014265600000000001 2024-09-12T18:35:45.999 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.999 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.999 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:45.999 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668308+0000", 2024-09-12T18:35:45.999 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5992999999999997e-05 2024-09-12T18:35:45.999 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:45.999 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:45.999 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:45.999 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:45.999 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:45.999 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:45.999 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:35:45.999 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 20.308066703000001, 2024-09-12T18:35:45.999 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026605302000000001, 2024-09-12T18:35:46.000 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:46.000 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:46.000 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:46.000 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:46.000 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.000 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:46.000 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:35:46.000 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:46.000 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.000 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.000 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:46.000 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:35:46.000 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:46.000 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.001 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.001 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:46.001 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641881+0000", 2024-09-12T18:35:46.001 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.057e-06 2024-09-12T18:35:46.001 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.001 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.001 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:46.001 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641887+0000", 2024-09-12T18:35:46.001 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.6629999999999998e-06 2024-09-12T18:35:46.001 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.001 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.001 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:46.001 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641903+0000", 2024-09-12T18:35:46.001 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6317e-05 2024-09-12T18:35:46.002 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.002 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.002 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.002 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641917+0000", 2024-09-12T18:35:46.002 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3339999999999999e-05 2024-09-12T18:35:46.002 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.002 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.002 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:46.002 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650708+0000", 2024-09-12T18:35:46.002 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.008791419 2024-09-12T18:35:46.002 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.002 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.002 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:46.002 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651021+0000", 2024-09-12T18:35:46.003 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031296699999999999 2024-09-12T18:35:46.003 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.003 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.003 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:46.003 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651349+0000", 2024-09-12T18:35:46.003 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032796499999999999 2024-09-12T18:35:46.003 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.003 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.003 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:46.003 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655742+0000", 2024-09-12T18:35:46.003 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0043934680000000002 2024-09-12T18:35:46.003 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.003 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.003 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:46.004 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668377+0000", 2024-09-12T18:35:46.004 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012634312999999999 2024-09-12T18:35:46.004 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.004 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.004 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:46.004 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668441+0000", 2024-09-12T18:35:46.004 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4369999999999995e-05 2024-09-12T18:35:46.004 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.004 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.004 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:46.004 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668485+0000", 2024-09-12T18:35:46.004 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4422999999999998e-05 2024-09-12T18:35:46.004 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:46.005 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:46.005 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:46.005 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.005 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.005 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:46.005 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:35:46.005 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 20.308009299999998, 2024-09-12T18:35:46.005 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026919499, 2024-09-12T18:35:46.005 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:46.005 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:46.005 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:46.005 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:46.005 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.006 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:46.006 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:35:46.006 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:46.006 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.006 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.006 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:46.006 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:35:46.006 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:46.006 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.006 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.006 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:46.006 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641939+0000", 2024-09-12T18:35:46.006 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9399999999999993e-07 2024-09-12T18:35:46.007 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.007 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.007 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:46.007 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641945+0000", 2024-09-12T18:35:46.007 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9200000000000001e-06 2024-09-12T18:35:46.007 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.007 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.007 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:46.007 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641961+0000", 2024-09-12T18:35:46.007 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6520000000000001e-05 2024-09-12T18:35:46.007 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.007 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.007 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.007 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641974+0000", 2024-09-12T18:35:46.007 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3413e-05 2024-09-12T18:35:46.008 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.008 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.008 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:46.008 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654560+0000", 2024-09-12T18:35:46.008 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012585308999999999 2024-09-12T18:35:46.008 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.008 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.008 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:46.008 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654822+0000", 2024-09-12T18:35:46.008 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026210099999999999 2024-09-12T18:35:46.008 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.008 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.008 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:46.009 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655059+0000", 2024-09-12T18:35:46.009 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00023747899999999999 2024-09-12T18:35:46.009 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.009 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.009 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:46.009 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.656315+0000", 2024-09-12T18:35:46.009 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0012555000000000001 2024-09-12T18:35:46.009 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.009 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.009 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:46.009 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668590+0000", 2024-09-12T18:35:46.009 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012274851999999999 2024-09-12T18:35:46.009 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.010 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.010 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:46.010 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668725+0000", 2024-09-12T18:35:46.010 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013524199999999999 2024-09-12T18:35:46.010 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.010 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.010 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:46.010 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668857+0000", 2024-09-12T18:35:46.010 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013216899999999999 2024-09-12T18:35:46.010 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:46.010 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:46.010 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:46.010 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.010 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.011 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:46.011 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:35:46.011 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 20.30795578, 2024-09-12T18:35:46.011 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023616723999999999, 2024-09-12T18:35:46.011 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:46.011 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:46.011 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:46.011 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:46.011 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.011 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:46.011 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:35:46.011 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:46.011 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.011 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.012 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:46.012 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:35:46.012 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:46.012 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.012 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.012 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:46.012 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641992+0000", 2024-09-12T18:35:46.012 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.08e-06 2024-09-12T18:35:46.012 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.012 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.013 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:46.013 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641998+0000", 2024-09-12T18:35:46.013 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4299999999999997e-06 2024-09-12T18:35:46.013 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.013 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.013 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:46.013 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642014+0000", 2024-09-12T18:35:46.013 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6266e-05 2024-09-12T18:35:46.013 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.013 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.014 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.014 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642026+0000", 2024-09-12T18:35:46.014 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2567e-05 2024-09-12T18:35:46.014 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.014 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.014 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:46.014 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642213+0000", 2024-09-12T18:35:46.014 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00018701899999999999 2024-09-12T18:35:46.014 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.014 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.014 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:46.014 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642507+0000", 2024-09-12T18:35:46.014 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00029394700000000002 2024-09-12T18:35:46.015 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.015 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.015 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:46.015 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642686+0000", 2024-09-12T18:35:46.015 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000178152 2024-09-12T18:35:46.015 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.015 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.015 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:46.015 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650952+0000", 2024-09-12T18:35:46.015 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0082663570000000002 2024-09-12T18:35:46.015 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.015 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.015 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:46.016 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665382+0000", 2024-09-12T18:35:46.016 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.014430111000000001 2024-09-12T18:35:46.016 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.016 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.016 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:46.016 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665508+0000", 2024-09-12T18:35:46.016 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000125986 2024-09-12T18:35:46.016 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.016 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.016 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:46.016 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665608+0000", 2024-09-12T18:35:46.016 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9809000000000006e-05 2024-09-12T18:35:46.016 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:46.017 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:46.017 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:46.017 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.017 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.017 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:46.017 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:35:46.017 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 20.307827915000001, 2024-09-12T18:35:46.017 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024670563, 2024-09-12T18:35:46.017 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:46.017 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:46.017 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:46.017 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:46.017 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.018 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:46.018 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:35:46.018 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:46.018 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.018 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.018 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:46.018 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:35:46.018 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:46.018 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.018 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.018 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:46.018 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642120+0000", 2024-09-12T18:35:46.018 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1769999999999999e-06 2024-09-12T18:35:46.019 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.019 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.019 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:46.019 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642128+0000", 2024-09-12T18:35:46.019 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3429999999999998e-06 2024-09-12T18:35:46.019 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.019 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.019 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:46.019 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642192+0000", 2024-09-12T18:35:46.019 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4406999999999995e-05 2024-09-12T18:35:46.019 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.019 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.019 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.019 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642223+0000", 2024-09-12T18:35:46.020 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.1266000000000002e-05 2024-09-12T18:35:46.020 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.020 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.020 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:46.020 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643201+0000", 2024-09-12T18:35:46.020 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0009778390000000001 2024-09-12T18:35:46.020 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.020 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.020 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:46.020 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643410+0000", 2024-09-12T18:35:46.020 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020874199999999999 2024-09-12T18:35:46.020 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.020 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.021 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:46.021 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643685+0000", 2024-09-12T18:35:46.021 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027520700000000002 2024-09-12T18:35:46.021 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.021 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.021 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:46.021 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650966+0000", 2024-09-12T18:35:46.021 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072810710000000001 2024-09-12T18:35:46.021 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.021 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.021 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:46.021 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666560+0000", 2024-09-12T18:35:46.021 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015594143 2024-09-12T18:35:46.021 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.022 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.022 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:46.022 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666691+0000", 2024-09-12T18:35:46.022 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000130359 2024-09-12T18:35:46.022 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.022 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.022 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:46.022 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666790+0000", 2024-09-12T18:35:46.022 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9009e-05 2024-09-12T18:35:46.022 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:46.022 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:46.022 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:46.022 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.022 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.023 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:46.023 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:35:46.023 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 20.307049627000001, 2024-09-12T18:35:46.023 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024891744, 2024-09-12T18:35:46.023 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:46.023 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:46.023 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:46.023 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:46.023 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.023 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:46.023 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:35:46.023 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:46.023 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.024 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.024 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:46.024 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:35:46.024 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:46.024 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.024 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.024 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:46.024 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642899+0000", 2024-09-12T18:35:46.024 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4729999999999999e-06 2024-09-12T18:35:46.024 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.024 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.024 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:46.024 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642912+0000", 2024-09-12T18:35:46.024 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3495999999999999e-05 2024-09-12T18:35:46.025 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.025 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.025 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:46.025 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642934+0000", 2024-09-12T18:35:46.025 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2033999999999999e-05 2024-09-12T18:35:46.025 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.025 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.025 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.025 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642949+0000", 2024-09-12T18:35:46.025 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4970000000000001e-05 2024-09-12T18:35:46.025 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.025 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.025 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:46.025 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644400+0000", 2024-09-12T18:35:46.026 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001450305 2024-09-12T18:35:46.026 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.026 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.026 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:46.026 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644617+0000", 2024-09-12T18:35:46.026 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000217302 2024-09-12T18:35:46.026 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.026 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.026 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:46.026 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645052+0000", 2024-09-12T18:35:46.026 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000434797 2024-09-12T18:35:46.026 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.026 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.027 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:46.027 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653860+0000", 2024-09-12T18:35:46.027 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0088082249999999994 2024-09-12T18:35:46.027 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.027 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.027 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:46.027 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667598+0000", 2024-09-12T18:35:46.027 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.013738451 2024-09-12T18:35:46.027 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.027 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.027 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:46.027 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667698+0000", 2024-09-12T18:35:46.027 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9854999999999999e-05 2024-09-12T18:35:46.027 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.027 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.028 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:46.028 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667789+0000", 2024-09-12T18:35:46.028 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0835999999999996e-05 2024-09-12T18:35:46.028 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:46.028 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:46.028 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:46.028 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.028 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.028 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:30 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:46.029 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:35:46.029 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 20.306974811, 2024-09-12T18:35:46.029 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023936852000000002, 2024-09-12T18:35:46.029 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:46.029 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:46.029 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:46.029 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:46.029 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.029 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:46.029 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:35:46.029 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:46.029 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.029 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.029 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:46.030 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:35:46.030 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:46.030 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.030 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.030 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:46.030 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642973+0000", 2024-09-12T18:35:46.030 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.11e-06 2024-09-12T18:35:46.030 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.030 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.030 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:46.030 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642994+0000", 2024-09-12T18:35:46.030 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.0699999999999998e-05 2024-09-12T18:35:46.030 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.031 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.031 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:46.031 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643011+0000", 2024-09-12T18:35:46.031 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7229999999999999e-05 2024-09-12T18:35:46.031 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.031 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.031 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.031 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643025+0000", 2024-09-12T18:35:46.031 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3803e-05 2024-09-12T18:35:46.031 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.031 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.031 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:46.031 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643143+0000", 2024-09-12T18:35:46.032 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000118225 2024-09-12T18:35:46.032 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.032 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.032 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:46.032 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643426+0000", 2024-09-12T18:35:46.032 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00028250500000000001 2024-09-12T18:35:46.032 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.032 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.032 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:46.032 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643864+0000", 2024-09-12T18:35:46.032 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00043856 2024-09-12T18:35:46.032 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.032 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.033 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:46.033 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651148+0000", 2024-09-12T18:35:46.033 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072836769999999997 2024-09-12T18:35:46.033 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.033 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.033 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:46.033 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666674+0000", 2024-09-12T18:35:46.033 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015525786999999999 2024-09-12T18:35:46.033 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.033 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.033 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:46.033 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666796+0000", 2024-09-12T18:35:46.033 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000122416 2024-09-12T18:35:46.034 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.034 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.034 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:46.034 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666909+0000", 2024-09-12T18:35:46.034 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011283899999999999 2024-09-12T18:35:46.034 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:46.034 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:46.034 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:46.034 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.034 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.034 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:46.034 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:35:46.034 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 20.306892104999999, 2024-09-12T18:35:46.035 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024100234000000002, 2024-09-12T18:35:46.035 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:46.035 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:46.035 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:46.035 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:46.035 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.035 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:46.035 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:35:46.035 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:46.035 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.035 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.035 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:46.035 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:35:46.036 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:46.036 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.036 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.036 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:46.036 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643056+0000", 2024-09-12T18:35:46.036 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.046e-06 2024-09-12T18:35:46.036 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.036 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.036 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:46.036 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643068+0000", 2024-09-12T18:35:46.036 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2106999999999999e-05 2024-09-12T18:35:46.036 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.036 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.037 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:46.037 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643085+0000", 2024-09-12T18:35:46.037 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7479999999999999e-05 2024-09-12T18:35:46.037 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.037 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.037 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.037 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643099+0000", 2024-09-12T18:35:46.037 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3730000000000001e-05 2024-09-12T18:35:46.037 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.037 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.037 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:46.037 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644623+0000", 2024-09-12T18:35:46.037 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0015236080000000001 2024-09-12T18:35:46.037 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.038 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.038 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:46.038 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644893+0000", 2024-09-12T18:35:46.038 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026990500000000003 2024-09-12T18:35:46.038 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.038 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.038 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:46.038 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645227+0000", 2024-09-12T18:35:46.038 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00033391300000000003 2024-09-12T18:35:46.038 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.038 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.038 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:46.038 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653926+0000", 2024-09-12T18:35:46.039 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0086993339999999995 2024-09-12T18:35:46.039 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.039 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.039 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:46.039 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666925+0000", 2024-09-12T18:35:46.039 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012998686000000001 2024-09-12T18:35:46.039 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.039 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.039 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:46.039 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667057+0000", 2024-09-12T18:35:46.039 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013255600000000001 2024-09-12T18:35:46.039 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.039 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.040 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:46.040 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667155+0000", 2024-09-12T18:35:46.040 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7868999999999994e-05 2024-09-12T18:35:46.040 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:46.040 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:46.040 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:46.040 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.040 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.040 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:46.040 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643139+0000", 2024-09-12T18:35:46.040 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 20.306807518999999, 2024-09-12T18:35:46.040 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.022417057000000001, 2024-09-12T18:35:46.040 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:46.040 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:46.041 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:46.041 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:46.041 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.041 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:46.041 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643139+0000", 2024-09-12T18:35:46.041 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:46.041 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.041 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.041 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:46.041 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643139+0000", 2024-09-12T18:35:46.041 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:46.041 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.041 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.042 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:46.042 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643140+0000", 2024-09-12T18:35:46.042 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0729999999999999e-06 2024-09-12T18:35:46.042 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.042 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.042 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:46.042 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643151+0000", 2024-09-12T18:35:46.042 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.039e-05 2024-09-12T18:35:46.042 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.042 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.042 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:46.042 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643168+0000", 2024-09-12T18:35:46.042 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7575999999999999e-05 2024-09-12T18:35:46.042 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.043 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.043 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.043 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643182+0000", 2024-09-12T18:35:46.043 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3224000000000001e-05 2024-09-12T18:35:46.043 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.043 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.043 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:46.043 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643358+0000", 2024-09-12T18:35:46.043 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00017676500000000001 2024-09-12T18:35:46.043 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.043 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.043 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:46.043 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643647+0000", 2024-09-12T18:35:46.043 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00028850499999999999 2024-09-12T18:35:46.044 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.044 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.044 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:46.044 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643924+0000", 2024-09-12T18:35:46.044 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000277547 2024-09-12T18:35:46.044 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.044 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.044 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:46.044 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650289+0000", 2024-09-12T18:35:46.044 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0063645350000000002 2024-09-12T18:35:46.044 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.044 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.044 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:46.045 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665333+0000", 2024-09-12T18:35:46.045 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015043531000000001 2024-09-12T18:35:46.045 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.045 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.045 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:46.045 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665454+0000", 2024-09-12T18:35:46.045 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000121302 2024-09-12T18:35:46.045 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.045 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.045 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:46.045 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665556+0000", 2024-09-12T18:35:46.045 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010260900000000001 2024-09-12T18:35:46.045 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:46.045 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:46.046 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:46.046 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.046 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.046 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:46.046 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:35:46.046 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 20.306696316, 2024-09-12T18:35:46.046 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024255982999999998, 2024-09-12T18:35:46.046 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:46.046 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:46.046 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:46.047 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:46.047 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.047 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:46.047 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:35:46.047 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:46.047 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.047 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.047 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:46.047 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:35:46.048 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:46.048 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.048 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.048 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:46.048 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643252+0000", 2024-09-12T18:35:46.048 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:35:46.048 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.048 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.048 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:46.048 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643287+0000", 2024-09-12T18:35:46.048 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5225999999999998e-05 2024-09-12T18:35:46.048 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.048 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.049 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:46.049 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643323+0000", 2024-09-12T18:35:46.049 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5488999999999999e-05 2024-09-12T18:35:46.049 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.049 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.049 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.049 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643357+0000", 2024-09-12T18:35:46.049 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.3853999999999998e-05 2024-09-12T18:35:46.049 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.049 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.049 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:46.049 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646716+0000", 2024-09-12T18:35:46.049 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003359 2024-09-12T18:35:46.049 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.050 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.050 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:46.050 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647037+0000", 2024-09-12T18:35:46.050 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032131800000000002 2024-09-12T18:35:46.050 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.050 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.050 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:46.050 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647337+0000", 2024-09-12T18:35:46.050 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000300208 2024-09-12T18:35:46.050 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.050 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.050 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:46.050 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654291+0000", 2024-09-12T18:35:46.050 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0069543089999999997 2024-09-12T18:35:46.051 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.051 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.051 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:46.051 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667297+0000", 2024-09-12T18:35:46.051 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.013005526 2024-09-12T18:35:46.051 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.051 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.051 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:46.051 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667416+0000", 2024-09-12T18:35:46.051 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000119416 2024-09-12T18:35:46.051 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.051 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.052 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:46.052 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667507+0000", 2024-09-12T18:35:46.052 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0206999999999999e-05 2024-09-12T18:35:46.052 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:46.052 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:46.052 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:46.052 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.052 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.052 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:46.052 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:35:46.052 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 20.306569221, 2024-09-12T18:35:46.052 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023888482999999999, 2024-09-12T18:35:46.052 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:46.052 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:46.053 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:46.053 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:46.053 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.053 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:46.053 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:35:46.053 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:46.053 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.053 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.053 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:46.053 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:35:46.053 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:46.053 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.054 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.054 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:46.054 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643379+0000", 2024-09-12T18:35:46.054 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.207e-06 2024-09-12T18:35:46.054 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.054 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.054 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:46.054 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643390+0000", 2024-09-12T18:35:46.054 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0696000000000001e-05 2024-09-12T18:35:46.054 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.054 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.054 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:46.054 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643407+0000", 2024-09-12T18:35:46.054 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7563000000000001e-05 2024-09-12T18:35:46.055 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.055 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.055 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.055 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643420+0000", 2024-09-12T18:35:46.055 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3277e-05 2024-09-12T18:35:46.055 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.055 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.055 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:46.055 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644906+0000", 2024-09-12T18:35:46.055 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001485945 2024-09-12T18:35:46.055 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.055 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.055 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:46.056 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645404+0000", 2024-09-12T18:35:46.056 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00049807599999999997 2024-09-12T18:35:46.056 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.056 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.056 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:46.056 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645846+0000", 2024-09-12T18:35:46.056 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00044190400000000002 2024-09-12T18:35:46.056 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.056 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.056 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:46.056 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654223+0000", 2024-09-12T18:35:46.056 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0083767419999999995 2024-09-12T18:35:46.056 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.056 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.057 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:46.057 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667026+0000", 2024-09-12T18:35:46.057 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012802531000000001 2024-09-12T18:35:46.057 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.057 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.057 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:46.057 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667162+0000", 2024-09-12T18:35:46.057 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000136112 2024-09-12T18:35:46.057 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.057 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.057 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:46.057 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667266+0000", 2024-09-12T18:35:46.057 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010443 2024-09-12T18:35:46.058 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:46.058 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:46.058 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:46.058 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.058 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.058 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:46.058 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643447+0000", 2024-09-12T18:35:46.058 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 20.306499694999999, 2024-09-12T18:35:46.058 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.022081562999999998, 2024-09-12T18:35:46.058 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:46.058 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:46.058 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:46.058 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:46.058 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.059 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:46.059 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643447+0000", 2024-09-12T18:35:46.059 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:46.059 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.059 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.059 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:46.059 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643447+0000", 2024-09-12T18:35:46.059 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:46.059 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.059 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.059 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:46.059 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643448+0000", 2024-09-12T18:35:46.059 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1629999999999999e-06 2024-09-12T18:35:46.059 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.060 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.060 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:46.060 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643458+0000", 2024-09-12T18:35:46.060 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.8400000000000007e-06 2024-09-12T18:35:46.060 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.060 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.060 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:46.060 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643475+0000", 2024-09-12T18:35:46.060 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6874000000000001e-05 2024-09-12T18:35:46.060 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.060 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.060 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.060 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643488+0000", 2024-09-12T18:35:46.061 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3026e-05 2024-09-12T18:35:46.061 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.061 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.061 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:46.061 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643931+0000", 2024-09-12T18:35:46.061 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00044307 2024-09-12T18:35:46.061 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.061 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.061 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:46.061 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644210+0000", 2024-09-12T18:35:46.061 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027908400000000003 2024-09-12T18:35:46.061 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.061 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.061 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:46.062 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644606+0000", 2024-09-12T18:35:46.062 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00039615400000000002 2024-09-12T18:35:46.062 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.062 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.062 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:46.062 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650552+0000", 2024-09-12T18:35:46.062 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0059455619999999997 2024-09-12T18:35:46.062 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.062 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.062 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:46.062 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665302+0000", 2024-09-12T18:35:46.062 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.014749962 2024-09-12T18:35:46.062 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.062 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.063 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:46.063 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665424+0000", 2024-09-12T18:35:46.063 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012214300000000001 2024-09-12T18:35:46.063 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.063 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.063 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:46.063 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665529+0000", 2024-09-12T18:35:46.063 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000104685 2024-09-12T18:35:46.063 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:46.063 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:46.063 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:46.063 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.063 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.064 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:46.064 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:35:46.064 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 20.306418502, 2024-09-12T18:35:46.064 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024222582999999999, 2024-09-12T18:35:46.064 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:46.064 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:46.064 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:35:46.064 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:46.064 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.064 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:46.064 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:35:46.064 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:46.064 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.064 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.065 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:46.065 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:35:46.065 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:46.065 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.065 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.065 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:46.065 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643530+0000", 2024-09-12T18:35:46.065 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.393e-06 2024-09-12T18:35:46.065 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.065 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.065 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:46.065 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643536+0000", 2024-09-12T18:35:46.065 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4130000000000003e-06 2024-09-12T18:35:46.066 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.066 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.066 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:46.066 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643554+0000", 2024-09-12T18:35:46.066 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7572999999999999e-05 2024-09-12T18:35:46.066 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.066 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.066 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.066 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643567+0000", 2024-09-12T18:35:46.066 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3393999999999999e-05 2024-09-12T18:35:46.066 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.066 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.066 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:46.066 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648198+0000", 2024-09-12T18:35:46.067 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0046304479999999997 2024-09-12T18:35:46.067 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.067 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.067 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:46.067 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648413+0000", 2024-09-12T18:35:46.067 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00021507500000000001 2024-09-12T18:35:46.067 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:46.067 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:46.067 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:46.067 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667751+0000", 2024-09-12T18:35:46.067 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.019338286999999999 2024-09-12T18:35:46.067 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:46.067 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:46.068 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:46.068 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:46.068 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:46.068 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:35:46.069 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:35:46.070 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:46.071+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:46.170 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:46.167+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:46.243 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:35:46.243 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:35:46.243 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.243 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:961 5.7 e23/21 5:ed034661:::benchmark_data_smithi073_23739_object960:head v 23'51, mlcod=23'49)", 2024-09-12T18:35:46.244 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:46.234662+0000", 2024-09-12T18:35:46.244 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0071558530000000002, 2024-09-12T18:35:46.244 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.007172327, 2024-09-12T18:35:46.244 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:46.244 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:46.244 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:35:46.244 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:46.244 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.244 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:46.244 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.234662+0000", 2024-09-12T18:35:46.244 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.244 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.244 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.245 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:46.245 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.234662+0000", 2024-09-12T18:35:46.245 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.245 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.245 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.245 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:46.245 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.234662+0000", 2024-09-12T18:35:46.245 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5300000000000004e-07 2024-09-12T18:35:46.245 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.245 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.245 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:46.245 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.234726+0000", 2024-09-12T18:35:46.245 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3392000000000006e-05 2024-09-12T18:35:46.245 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.246 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.246 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:46.246 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.234735+0000", 2024-09-12T18:35:46.246 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.6120000000000005e-06 2024-09-12T18:35:46.246 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.246 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.246 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.246 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.234744+0000", 2024-09-12T18:35:46.246 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1009999999999998e-06 2024-09-12T18:35:46.246 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.246 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.246 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.246 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.234799+0000", 2024-09-12T18:35:46.247 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.486e-05 2024-09-12T18:35:46.247 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.247 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.247 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:46.247 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.234818+0000", 2024-09-12T18:35:46.247 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8499999999999999e-05 2024-09-12T18:35:46.247 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.247 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:46.247 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.247 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.247 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.247 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:962 5.1 e23/21 5:8098da60:::benchmark_data_smithi073_23739_object961:head v 23'73, mlcod=23'70)", 2024-09-12T18:35:46.248 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:46.235002+0000", 2024-09-12T18:35:46.248 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0068152860000000003, 2024-09-12T18:35:46.248 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0068683010000000003, 2024-09-12T18:35:46.248 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:46.248 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:46.248 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:35:46.248 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:46.248 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.248 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:46.248 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.235002+0000", 2024-09-12T18:35:46.248 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.248 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.249 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.249 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:46.249 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.235002+0000", 2024-09-12T18:35:46.249 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.249 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.249 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.249 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:46.249 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.235003+0000", 2024-09-12T18:35:46.249 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1999999999999998e-07 2024-09-12T18:35:46.249 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.249 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.249 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:46.249 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.235097+0000", 2024-09-12T18:35:46.250 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.3961000000000004e-05 2024-09-12T18:35:46.250 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.250 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.250 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:46.250 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.235110+0000", 2024-09-12T18:35:46.250 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2564e-05 2024-09-12T18:35:46.250 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.250 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.250 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.250 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.235118+0000", 2024-09-12T18:35:46.250 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7679999999999997e-06 2024-09-12T18:35:46.250 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.250 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.250 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.250 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.235187+0000", 2024-09-12T18:35:46.251 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.9047000000000005e-05 2024-09-12T18:35:46.251 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.251 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.251 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:46.251 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.235210+0000", 2024-09-12T18:35:46.251 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2756e-05 2024-09-12T18:35:46.251 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.251 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:46.251 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.251 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.251 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.251 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:964 5.4 e23/21 5:280a7998:::benchmark_data_smithi073_23739_object963:head v 23'66, mlcod=23'61)", 2024-09-12T18:35:46.251 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:46.235306+0000", 2024-09-12T18:35:46.252 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0065111700000000002, 2024-09-12T18:35:46.252 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0065951209999999998, 2024-09-12T18:35:46.252 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:46.252 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:46.252 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:35:46.252 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:46.252 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.252 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:46.252 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.235306+0000", 2024-09-12T18:35:46.252 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.252 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.252 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.252 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:46.253 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.235306+0000", 2024-09-12T18:35:46.253 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.253 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.253 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.253 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:46.253 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.235307+0000", 2024-09-12T18:35:46.253 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.2399999999999997e-07 2024-09-12T18:35:46.253 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.253 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.253 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:46.253 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.235381+0000", 2024-09-12T18:35:46.253 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3980999999999995e-05 2024-09-12T18:35:46.253 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.254 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.254 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:46.254 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.235394+0000", 2024-09-12T18:35:46.254 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2775000000000001e-05 2024-09-12T18:35:46.254 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.254 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.254 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.254 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.235401+0000", 2024-09-12T18:35:46.254 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.2409999999999998e-06 2024-09-12T18:35:46.254 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.254 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.254 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.254 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.235449+0000", 2024-09-12T18:35:46.255 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8105000000000001e-05 2024-09-12T18:35:46.255 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.255 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.255 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:46.255 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.235467+0000", 2024-09-12T18:35:46.255 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7566000000000001e-05 2024-09-12T18:35:46.255 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.255 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:46.255 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.255 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.255 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.255 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:965 5.e e23/21 5:7af7d933:::benchmark_data_smithi073_23739_object964:head v 23'54, mlcod=23'52)", 2024-09-12T18:35:46.255 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:46.235961+0000", 2024-09-12T18:35:46.256 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0058564009999999998, 2024-09-12T18:35:46.256 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0059715840000000003, 2024-09-12T18:35:46.256 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:46.256 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:46.256 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:35:46.256 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:46.256 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.256 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:46.256 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.235961+0000", 2024-09-12T18:35:46.256 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.256 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.256 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.256 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:46.257 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.235961+0000", 2024-09-12T18:35:46.257 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.257 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.257 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.257 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:46.257 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.235961+0000", 2024-09-12T18:35:46.257 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0600000000000001e-07 2024-09-12T18:35:46.257 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.257 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.257 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:46.257 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236016+0000", 2024-09-12T18:35:46.257 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4434000000000001e-05 2024-09-12T18:35:46.258 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.258 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.258 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:46.258 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236023+0000", 2024-09-12T18:35:46.258 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3379999999999999e-06 2024-09-12T18:35:46.258 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.258 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.258 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.258 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236028+0000", 2024-09-12T18:35:46.258 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4850000000000003e-06 2024-09-12T18:35:46.258 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.258 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.259 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.259 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236079+0000", 2024-09-12T18:35:46.259 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1124e-05 2024-09-12T18:35:46.259 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.259 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.259 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:46.259 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236100+0000", 2024-09-12T18:35:46.259 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.065e-05 2024-09-12T18:35:46.259 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.259 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:46.259 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.259 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.260 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.260 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:967 5.5 5:ad9f07ed:::benchmark_data_smithi073_23739_object966:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:35:46.260 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:46.236129+0000", 2024-09-12T18:35:46.260 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0056881170000000003, 2024-09-12T18:35:46.260 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0058396990000000003, 2024-09-12T18:35:46.260 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:46.260 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:46.260 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:46.260 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:35:46.260 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:35:46.260 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:46.260 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 967 2024-09-12T18:35:46.260 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.261 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:46.261 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.261 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:46.261 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236129+0000", 2024-09-12T18:35:46.261 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.261 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.261 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.261 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:46.261 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236129+0000", 2024-09-12T18:35:46.261 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.261 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.261 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.261 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:46.261 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236130+0000", 2024-09-12T18:35:46.262 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6899999999999996e-07 2024-09-12T18:35:46.262 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.262 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.262 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:46.262 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236272+0000", 2024-09-12T18:35:46.262 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014230699999999999 2024-09-12T18:35:46.262 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.262 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.262 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:46.262 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236282+0000", 2024-09-12T18:35:46.262 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.5899999999999997e-06 2024-09-12T18:35:46.262 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.262 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.262 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.263 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236287+0000", 2024-09-12T18:35:46.263 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.3340000000000001e-06 2024-09-12T18:35:46.263 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.263 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.263 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.263 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236349+0000", 2024-09-12T18:35:46.263 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2045000000000007e-05 2024-09-12T18:35:46.263 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.263 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.263 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:46.263 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236465+0000", 2024-09-12T18:35:46.263 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00011592200000000001 2024-09-12T18:35:46.263 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.263 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.263 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:46.264 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236563+0000", 2024-09-12T18:35:46.264 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.7465000000000003e-05 2024-09-12T18:35:46.264 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.264 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.264 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:46.264 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.238730+0000", 2024-09-12T18:35:46.264 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0021674709999999998 2024-09-12T18:35:46.264 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.264 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:46.264 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.264 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.264 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.264 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:968 5.5 5:a0146288:::benchmark_data_smithi073_23739_object967:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:35:46.265 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:46.236302+0000", 2024-09-12T18:35:46.265 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0055150470000000004, 2024-09-12T18:35:46.265 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.005723807, 2024-09-12T18:35:46.265 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:46.265 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:46.265 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:46.265 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:35:46.265 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:35:46.265 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:46.265 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 968 2024-09-12T18:35:46.265 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.265 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:46.265 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.266 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:46.266 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236302+0000", 2024-09-12T18:35:46.266 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.266 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.266 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.266 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:46.266 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236302+0000", 2024-09-12T18:35:46.266 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.266 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.266 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.266 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:46.266 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236303+0000", 2024-09-12T18:35:46.266 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2899999999999999e-07 2024-09-12T18:35:46.267 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.267 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.267 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:46.267 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236352+0000", 2024-09-12T18:35:46.267 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8922999999999999e-05 2024-09-12T18:35:46.267 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.267 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.267 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:46.267 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236358+0000", 2024-09-12T18:35:46.267 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2500000000000003e-06 2024-09-12T18:35:46.267 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.267 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.267 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.267 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236362+0000", 2024-09-12T18:35:46.268 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.019e-06 2024-09-12T18:35:46.268 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.268 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.268 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.268 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.237027+0000", 2024-09-12T18:35:46.268 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00066535400000000005 2024-09-12T18:35:46.268 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.268 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.268 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:46.268 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.237151+0000", 2024-09-12T18:35:46.268 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000123571 2024-09-12T18:35:46.268 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.269 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.269 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:46.269 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.237249+0000", 2024-09-12T18:35:46.269 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.8062999999999999e-05 2024-09-12T18:35:46.269 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.269 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.269 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:46.269 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.241298+0000", 2024-09-12T18:35:46.269 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0040487860000000004 2024-09-12T18:35:46.269 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.269 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:46.269 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.269 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.269 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.270 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:973 5.c 5:364273e8:::benchmark_data_smithi073_23739_object972:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:35:46.270 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:46.236513+0000", 2024-09-12T18:35:46.270 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0053042289999999997, 2024-09-12T18:35:46.270 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0055555250000000004, 2024-09-12T18:35:46.270 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:46.270 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:46.270 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:46.270 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:35:46.270 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:35:46.270 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:46.270 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 973 2024-09-12T18:35:46.270 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.270 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:46.271 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.271 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:46.271 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236513+0000", 2024-09-12T18:35:46.271 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.271 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.271 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.271 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:46.271 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236513+0000", 2024-09-12T18:35:46.271 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.271 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.271 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.271 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:46.271 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236514+0000", 2024-09-12T18:35:46.271 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.01e-07 2024-09-12T18:35:46.272 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.272 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.272 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:46.272 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236637+0000", 2024-09-12T18:35:46.272 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000123631 2024-09-12T18:35:46.272 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.272 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.272 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:46.272 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236648+0000", 2024-09-12T18:35:46.272 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0528e-05 2024-09-12T18:35:46.272 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.272 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.272 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.272 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236655+0000", 2024-09-12T18:35:46.273 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7050000000000002e-06 2024-09-12T18:35:46.273 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.273 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.273 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.273 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236703+0000", 2024-09-12T18:35:46.273 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8702000000000002e-05 2024-09-12T18:35:46.273 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.273 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.273 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:46.273 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236817+0000", 2024-09-12T18:35:46.273 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000114072 2024-09-12T18:35:46.273 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.273 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.274 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:46.274 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236962+0000", 2024-09-12T18:35:46.274 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000144704 2024-09-12T18:35:46.274 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.274 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.274 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:46.274 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.241271+0000", 2024-09-12T18:35:46.274 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.004308933 2024-09-12T18:35:46.274 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.274 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:46.274 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.274 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.274 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.274 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:966 5.7 e23/21 5:ee66c6ac:::benchmark_data_smithi073_23739_object965:head v 23'52, mlcod=23'49)", 2024-09-12T18:35:46.275 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:46.236588+0000", 2024-09-12T18:35:46.275 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0052294999999999998, 2024-09-12T18:35:46.275 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0055222739999999998, 2024-09-12T18:35:46.275 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:46.275 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:46.275 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:35:46.275 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:46.275 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.275 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:46.275 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236588+0000", 2024-09-12T18:35:46.275 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.275 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.275 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.276 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:46.276 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236588+0000", 2024-09-12T18:35:46.276 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.276 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.276 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.276 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:46.276 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236589+0000", 2024-09-12T18:35:46.276 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.99e-07 2024-09-12T18:35:46.276 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.276 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.276 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:46.276 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236689+0000", 2024-09-12T18:35:46.276 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00010072 2024-09-12T18:35:46.277 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.277 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.277 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:46.277 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236696+0000", 2024-09-12T18:35:46.277 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5969999999999997e-06 2024-09-12T18:35:46.277 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.277 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.277 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.277 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236700+0000", 2024-09-12T18:35:46.277 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.1409999999999998e-06 2024-09-12T18:35:46.277 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.277 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.277 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.277 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236756+0000", 2024-09-12T18:35:46.278 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5999999999999999e-05 2024-09-12T18:35:46.278 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.278 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.278 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:46.278 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236778+0000", 2024-09-12T18:35:46.278 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1563e-05 2024-09-12T18:35:46.278 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.278 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:46.278 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.278 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.278 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.278 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:969 5.0 e23/21 5:04d8d5d8:::benchmark_data_smithi073_23739_object968:head v 23'65, mlcod=23'63)", 2024-09-12T18:35:46.278 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:46.236855+0000", 2024-09-12T18:35:46.279 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0049628420000000003, 2024-09-12T18:35:46.279 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0052848890000000001, 2024-09-12T18:35:46.279 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:46.279 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:46.279 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:35:46.279 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:46.279 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.279 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:46.279 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236855+0000", 2024-09-12T18:35:46.279 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.279 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.279 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.279 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:46.280 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236855+0000", 2024-09-12T18:35:46.280 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.280 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.280 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.280 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:46.280 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236855+0000", 2024-09-12T18:35:46.280 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5300000000000004e-07 2024-09-12T18:35:46.280 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.280 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.280 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:46.280 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236907+0000", 2024-09-12T18:35:46.280 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2162e-05 2024-09-12T18:35:46.280 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.281 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.281 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:46.281 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236915+0000", 2024-09-12T18:35:46.281 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.7559999999999999e-06 2024-09-12T18:35:46.281 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.281 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.281 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.281 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236919+0000", 2024-09-12T18:35:46.281 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0969999999999999e-06 2024-09-12T18:35:46.281 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.281 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.281 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.282 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236964+0000", 2024-09-12T18:35:46.282 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5077999999999998e-05 2024-09-12T18:35:46.282 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.282 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.282 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:46.282 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.236983+0000", 2024-09-12T18:35:46.282 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8464000000000001e-05 2024-09-12T18:35:46.282 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.282 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:46.282 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.282 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.282 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.282 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:972 5.2 e23/21 5:42f02990:::benchmark_data_smithi073_23739_object971:head v 23'60, mlcod=23'58)", 2024-09-12T18:35:46.283 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:46.237735+0000", 2024-09-12T18:35:46.283 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0040823550000000002, 2024-09-12T18:35:46.283 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0044329440000000003, 2024-09-12T18:35:46.283 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:46.283 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:46.283 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:35:46.283 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:46.283 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.283 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:46.283 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.237735+0000", 2024-09-12T18:35:46.283 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.283 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.283 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.283 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:46.284 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.237735+0000", 2024-09-12T18:35:46.284 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.284 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.284 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.284 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:46.284 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.237736+0000", 2024-09-12T18:35:46.284 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5099999999999999e-07 2024-09-12T18:35:46.284 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.284 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.284 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:46.284 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.237801+0000", 2024-09-12T18:35:46.284 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5452999999999998e-05 2024-09-12T18:35:46.284 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.285 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.285 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:46.285 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.237817+0000", 2024-09-12T18:35:46.285 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.526e-05 2024-09-12T18:35:46.285 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.285 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.285 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.285 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.237826+0000", 2024-09-12T18:35:46.285 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.0410000000000003e-06 2024-09-12T18:35:46.285 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.285 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.285 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.285 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.237871+0000", 2024-09-12T18:35:46.286 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5583e-05 2024-09-12T18:35:46.286 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.286 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.286 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:46.286 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.237887+0000", 2024-09-12T18:35:46.286 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5854000000000001e-05 2024-09-12T18:35:46.286 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.286 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:46.286 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.286 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.286 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.286 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:974 5.b e23/21 5:dddf723e:::benchmark_data_smithi073_23739_object973:head v 23'60, mlcod=23'58)", 2024-09-12T18:35:46.286 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:46.238571+0000", 2024-09-12T18:35:46.287 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.003246578, 2024-09-12T18:35:46.287 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0036258000000000002, 2024-09-12T18:35:46.287 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:46.287 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:46.287 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:35:46.287 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:46.287 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.287 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:46.287 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.238571+0000", 2024-09-12T18:35:46.287 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.287 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.287 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.287 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:46.287 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.238571+0000", 2024-09-12T18:35:46.288 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.288 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.288 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.288 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:46.288 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.238572+0000", 2024-09-12T18:35:46.288 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.0500000000000003e-07 2024-09-12T18:35:46.288 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.288 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.288 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:46.288 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.238639+0000", 2024-09-12T18:35:46.288 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7273000000000005e-05 2024-09-12T18:35:46.288 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.288 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.289 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:46.289 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.238648+0000", 2024-09-12T18:35:46.289 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2779999999999999e-06 2024-09-12T18:35:46.289 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.289 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.289 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.289 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.238653+0000", 2024-09-12T18:35:46.289 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.113e-06 2024-09-12T18:35:46.289 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.289 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.289 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.289 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.238711+0000", 2024-09-12T18:35:46.289 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8199999999999998e-05 2024-09-12T18:35:46.289 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.290 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.290 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:46.290 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.238739+0000", 2024-09-12T18:35:46.290 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7322999999999999e-05 2024-09-12T18:35:46.290 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.290 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:46.290 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.290 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.290 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.290 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:977 5.a 5:59e2dd06:::benchmark_data_smithi073_23739_object976:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:35:46.290 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:46.239037+0000", 2024-09-12T18:35:46.290 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.002780041, 2024-09-12T18:35:46.290 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0031907289999999998, 2024-09-12T18:35:46.291 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:46.291 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:46.291 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:46.291 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:35:46.291 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:35:46.291 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:46.291 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 977 2024-09-12T18:35:46.291 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.291 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:46.291 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.291 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:46.291 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.239037+0000", 2024-09-12T18:35:46.291 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.292 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.292 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.292 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:46.292 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.239037+0000", 2024-09-12T18:35:46.292 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.292 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.292 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.292 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:46.292 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.239038+0000", 2024-09-12T18:35:46.292 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.4600000000000003e-07 2024-09-12T18:35:46.292 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.292 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.293 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:46.293 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.239110+0000", 2024-09-12T18:35:46.293 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1530000000000001e-05 2024-09-12T18:35:46.293 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.293 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.293 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:46.293 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.239120+0000", 2024-09-12T18:35:46.293 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.8740000000000007e-06 2024-09-12T18:35:46.293 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.293 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.293 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.293 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.239125+0000", 2024-09-12T18:35:46.293 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9660000000000004e-06 2024-09-12T18:35:46.294 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.294 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.294 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.294 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.239180+0000", 2024-09-12T18:35:46.294 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4886999999999998e-05 2024-09-12T18:35:46.294 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.294 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.294 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:46.294 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.239322+0000", 2024-09-12T18:35:46.294 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014271100000000001 2024-09-12T18:35:46.294 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.294 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.294 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:46.294 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.239475+0000", 2024-09-12T18:35:46.295 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000153115 2024-09-12T18:35:46.295 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.295 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.295 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:46.295 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.240672+0000", 2024-09-12T18:35:46.295 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001196363 2024-09-12T18:35:46.295 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.295 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:46.295 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.295 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.295 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.295 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:975 5.e e23/21 5:7a53d780:::benchmark_data_smithi073_23739_object974:head v 23'55, mlcod=23'52)", 2024-09-12T18:35:46.295 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:46.239309+0000", 2024-09-12T18:35:46.295 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0025087199999999999, 2024-09-12T18:35:46.296 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.002961885, 2024-09-12T18:35:46.296 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:46.296 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:46.296 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:35:46.296 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:46.296 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.296 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:46.296 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.239309+0000", 2024-09-12T18:35:46.296 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.296 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.296 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.296 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:46.296 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.239309+0000", 2024-09-12T18:35:46.297 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.297 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.297 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.297 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:46.297 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.239309+0000", 2024-09-12T18:35:46.297 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.3499999999999996e-07 2024-09-12T18:35:46.297 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.297 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.297 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:46.297 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.239387+0000", 2024-09-12T18:35:46.297 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8092999999999999e-05 2024-09-12T18:35:46.297 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.297 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.298 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:46.298 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.239394+0000", 2024-09-12T18:35:46.298 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3890000000000002e-06 2024-09-12T18:35:46.298 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.298 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.298 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.298 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.239398+0000", 2024-09-12T18:35:46.298 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.7220000000000001e-06 2024-09-12T18:35:46.298 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.298 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.298 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.298 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.239440+0000", 2024-09-12T18:35:46.298 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2608999999999998e-05 2024-09-12T18:35:46.298 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.299 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.299 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:46.299 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.239453+0000", 2024-09-12T18:35:46.299 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3008e-05 2024-09-12T18:35:46.299 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.299 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:46.299 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.299 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.299 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.299 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:976 5.0 e23/21 5:090052a6:::benchmark_data_smithi073_23739_object975:head v 23'66, mlcod=23'63)", 2024-09-12T18:35:46.299 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:46.239806+0000", 2024-09-12T18:35:46.299 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0020112770000000001, 2024-09-12T18:35:46.300 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0024931770000000001, 2024-09-12T18:35:46.300 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:46.300 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:46.300 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:35:46.300 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:46.300 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.300 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:46.300 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.239806+0000", 2024-09-12T18:35:46.300 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.300 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.300 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.300 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:46.300 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.239806+0000", 2024-09-12T18:35:46.301 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.301 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.301 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.301 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:46.301 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.239807+0000", 2024-09-12T18:35:46.304 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4199999999999995e-07 2024-09-12T18:35:46.304 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.304 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.304 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:46.305 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.239868+0000", 2024-09-12T18:35:46.305 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1449000000000001e-05 2024-09-12T18:35:46.305 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.305 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.305 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:46.305 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.239878+0000", 2024-09-12T18:35:46.305 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4790000000000002e-06 2024-09-12T18:35:46.305 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.305 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.305 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.305 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.239883+0000", 2024-09-12T18:35:46.305 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0440000000000003e-06 2024-09-12T18:35:46.306 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.306 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.306 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.306 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.239921+0000", 2024-09-12T18:35:46.306 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.7764e-05 2024-09-12T18:35:46.306 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.306 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.306 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:46.306 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.239941+0000", 2024-09-12T18:35:46.306 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9939999999999999e-05 2024-09-12T18:35:46.306 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.306 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:46.306 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.307 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.307 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.307 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:978 5.b e23/21 5:d35a4f97:::benchmark_data_smithi073_23739_object977:head v 23'61, mlcod=23'58)", 2024-09-12T18:35:46.307 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:46.240494+0000", 2024-09-12T18:35:46.307 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.001323891, 2024-09-12T18:35:46.307 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0018545440000000001, 2024-09-12T18:35:46.307 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:46.307 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:46.307 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:35:46.307 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:46.307 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.307 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:46.307 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.240494+0000", 2024-09-12T18:35:46.308 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.308 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.308 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.308 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:46.308 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.240494+0000", 2024-09-12T18:35:46.308 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.308 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.308 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.308 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:46.308 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.240494+0000", 2024-09-12T18:35:46.308 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3499999999999995e-07 2024-09-12T18:35:46.308 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.308 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.309 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:46.309 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.240552+0000", 2024-09-12T18:35:46.309 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7713000000000001e-05 2024-09-12T18:35:46.309 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.309 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.309 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:46.309 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.240563+0000", 2024-09-12T18:35:46.309 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1269e-05 2024-09-12T18:35:46.309 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.309 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.309 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.309 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.240568+0000", 2024-09-12T18:35:46.310 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1159999999999998e-06 2024-09-12T18:35:46.310 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.310 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.310 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.310 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.240619+0000", 2024-09-12T18:35:46.310 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0145000000000002e-05 2024-09-12T18:35:46.310 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.310 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.310 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:46.310 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.240640+0000", 2024-09-12T18:35:46.310 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1132999999999999e-05 2024-09-12T18:35:46.310 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.310 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:46.311 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.311 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.311 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.311 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:979 5.b e23/21 5:d93be612:::benchmark_data_smithi073_23739_object978:head v 23'62, mlcod=23'58)", 2024-09-12T18:35:46.311 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:46.241558+0000", 2024-09-12T18:35:46.311 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00025960700000000002, 2024-09-12T18:35:46.311 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00081895899999999996, 2024-09-12T18:35:46.311 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:46.311 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:46.311 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:35:46.311 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:46.311 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.311 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:46.312 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.241558+0000", 2024-09-12T18:35:46.312 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.312 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.312 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.312 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:46.312 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.241558+0000", 2024-09-12T18:35:46.312 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.312 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.312 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.312 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:46.312 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.241558+0000", 2024-09-12T18:35:46.312 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4700000000000001e-07 2024-09-12T18:35:46.312 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.313 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.313 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:46.313 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.241625+0000", 2024-09-12T18:35:46.313 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6523e-05 2024-09-12T18:35:46.313 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.313 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.313 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:46.313 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.241633+0000", 2024-09-12T18:35:46.313 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.9899999999999997e-06 2024-09-12T18:35:46.313 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.313 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.313 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.313 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.241638+0000", 2024-09-12T18:35:46.314 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9790000000000001e-06 2024-09-12T18:35:46.314 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.314 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.314 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.314 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.241683+0000", 2024-09-12T18:35:46.314 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5145999999999998e-05 2024-09-12T18:35:46.314 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.314 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.314 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:46.314 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:46.241700+0000", 2024-09-12T18:35:46.314 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7099999999999999e-05 2024-09-12T18:35:46.314 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.314 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:46.314 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.315 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.315 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-12T18:35:46.315 INFO:teuthology.orchestra.run.smithi114.stdout: "num_ops": 16 2024-09-12T18:35:46.315 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:35:46.317 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:35:46.317 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:46.310+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:46.418 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:46.414+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:46.518 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:46.515+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:46.523 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:35:46.523 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2024-09-12T18:35:46.523 INFO:teuthology.orchestra.run.smithi114.stdout: "complaint_time": 30, 2024-09-12T18:35:46.524 INFO:teuthology.orchestra.run.smithi114.stdout: "num_blocked_ops": 0 2024-09-12T18:35:46.524 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:35:46.547 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:35:46.618 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:46.615+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:46.719 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:46.714+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:46.750 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:35:46.750 INFO:teuthology.orchestra.run.smithi114.stdout: "size": 20, 2024-09-12T18:35:46.751 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 600, 2024-09-12T18:35:46.751 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:35:46.751 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.751 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:46.751 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:35:46.751 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 21.119247642000001, 2024-09-12T18:35:46.751 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.042475618999999999, 2024-09-12T18:35:46.751 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:46.751 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:46.751 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:46.751 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:46.751 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.752 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:46.752 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:35:46.752 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.752 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.752 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.752 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:46.752 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:35:46.752 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.752 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.752 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.752 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:46.752 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628450+0000", 2024-09-12T18:35:46.752 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4212999999999999e-05 2024-09-12T18:35:46.753 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.753 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.753 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:46.753 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628463+0000", 2024-09-12T18:35:46.753 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2497000000000001e-05 2024-09-12T18:35:46.753 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.753 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.753 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:46.753 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628480+0000", 2024-09-12T18:35:46.753 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7232999999999999e-05 2024-09-12T18:35:46.753 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.753 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.753 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.753 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628496+0000", 2024-09-12T18:35:46.754 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6217000000000001e-05 2024-09-12T18:35:46.754 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.754 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.754 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.754 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628641+0000", 2024-09-12T18:35:46.754 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000144709 2024-09-12T18:35:46.754 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.754 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.754 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:35:46.754 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628657+0000", 2024-09-12T18:35:46.754 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6266e-05 2024-09-12T18:35:46.754 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.755 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.755 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.755 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663103+0000", 2024-09-12T18:35:46.755 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.034445523999999998 2024-09-12T18:35:46.755 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.755 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.755 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:46.755 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663373+0000", 2024-09-12T18:35:46.755 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00027085500000000002 2024-09-12T18:35:46.755 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.755 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.755 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:46.755 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663634+0000", 2024-09-12T18:35:46.756 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000260855 2024-09-12T18:35:46.756 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.756 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.756 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:35:46.756 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670294+0000", 2024-09-12T18:35:46.756 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0066597599999999998 2024-09-12T18:35:46.756 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.756 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.756 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:46.756 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670705+0000", 2024-09-12T18:35:46.756 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00041057099999999998 2024-09-12T18:35:46.756 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.756 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.757 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:46.757 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670820+0000", 2024-09-12T18:35:46.757 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000115111 2024-09-12T18:35:46.757 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.757 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.757 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:46.757 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670912+0000", 2024-09-12T18:35:46.757 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1807999999999999e-05 2024-09-12T18:35:46.757 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.757 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:46.757 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.758 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.758 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.758 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:46.758 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:35:46.758 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 21.119156896, 2024-09-12T18:35:46.758 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.044599273000000002, 2024-09-12T18:35:46.758 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:46.758 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:46.758 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:46.758 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:46.758 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.758 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:46.758 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:35:46.759 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.759 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.759 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.759 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:46.759 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:35:46.759 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.759 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.759 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.759 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:46.759 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628528+0000", 2024-09-12T18:35:46.759 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:35:46.759 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.759 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.760 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:46.760 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628537+0000", 2024-09-12T18:35:46.760 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6969999999999999e-06 2024-09-12T18:35:46.760 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.760 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.760 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:46.760 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628560+0000", 2024-09-12T18:35:46.760 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2889000000000001e-05 2024-09-12T18:35:46.760 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.760 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.760 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.760 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628576+0000", 2024-09-12T18:35:46.760 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.649e-05 2024-09-12T18:35:46.761 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.761 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.761 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.761 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628846+0000", 2024-09-12T18:35:46.761 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00026952500000000001 2024-09-12T18:35:46.761 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.761 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.761 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:35:46.761 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628853+0000", 2024-09-12T18:35:46.761 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6559999999999992e-06 2024-09-12T18:35:46.761 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.761 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.761 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.762 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665284+0000", 2024-09-12T18:35:46.762 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.036431140000000001 2024-09-12T18:35:46.762 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.762 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.762 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:46.762 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665494+0000", 2024-09-12T18:35:46.762 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000209762 2024-09-12T18:35:46.762 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.762 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.762 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:46.762 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665816+0000", 2024-09-12T18:35:46.762 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00032162299999999999 2024-09-12T18:35:46.762 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.762 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.763 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:35:46.763 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670382+0000", 2024-09-12T18:35:46.763 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0045656739999999996 2024-09-12T18:35:46.763 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.763 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.763 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:46.763 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.672978+0000", 2024-09-12T18:35:46.763 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.002596068 2024-09-12T18:35:46.763 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.763 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.763 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:46.763 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673058+0000", 2024-09-12T18:35:46.763 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0198999999999996e-05 2024-09-12T18:35:46.763 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.764 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.764 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:46.764 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673126+0000", 2024-09-12T18:35:46.764 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8120000000000005e-05 2024-09-12T18:35:46.764 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.764 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:46.764 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.764 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.764 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.764 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:23 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:46.764 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:35:46.764 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 21.11905909, 2024-09-12T18:35:46.764 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045539784, 2024-09-12T18:35:46.764 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:46.765 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:46.765 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:46.765 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:46.765 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.765 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:46.765 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:35:46.765 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.765 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.765 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.765 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:46.765 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:35:46.765 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.766 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.766 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.766 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:46.766 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628626+0000", 2024-09-12T18:35:46.766 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.573e-06 2024-09-12T18:35:46.766 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.766 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.766 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:46.766 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628640+0000", 2024-09-12T18:35:46.766 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3817e-05 2024-09-12T18:35:46.766 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.766 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.766 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:46.767 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628659+0000", 2024-09-12T18:35:46.767 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9539999999999999e-05 2024-09-12T18:35:46.767 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.767 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.767 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.767 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628675+0000", 2024-09-12T18:35:46.767 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5739e-05 2024-09-12T18:35:46.767 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.767 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.767 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.767 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628815+0000", 2024-09-12T18:35:46.767 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014003299999999999 2024-09-12T18:35:46.767 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.767 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.767 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:35:46.768 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628828+0000", 2024-09-12T18:35:46.768 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2849e-05 2024-09-12T18:35:46.768 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.768 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.768 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.768 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651162+0000", 2024-09-12T18:35:46.768 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.022334228000000001 2024-09-12T18:35:46.768 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.768 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.768 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:46.768 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651446+0000", 2024-09-12T18:35:46.768 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00028392800000000002 2024-09-12T18:35:46.768 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.769 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.769 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:46.769 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651746+0000", 2024-09-12T18:35:46.769 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000300091 2024-09-12T18:35:46.769 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.769 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.769 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:35:46.769 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665113+0000", 2024-09-12T18:35:46.769 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013366678 2024-09-12T18:35:46.769 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.769 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.769 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:46.769 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674010+0000", 2024-09-12T18:35:46.769 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0088970520000000008 2024-09-12T18:35:46.770 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.770 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.770 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:46.770 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674104+0000", 2024-09-12T18:35:46.770 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4124999999999998e-05 2024-09-12T18:35:46.770 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.770 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.770 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:46.770 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674164+0000", 2024-09-12T18:35:46.770 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.0130999999999997e-05 2024-09-12T18:35:46.770 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.770 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:46.771 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.771 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.771 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.771 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:26 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:46.771 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:35:46.771 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 21.118985884000001, 2024-09-12T18:35:46.771 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045702136999999997, 2024-09-12T18:35:46.771 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:46.771 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:46.771 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:46.771 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:46.771 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.771 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:46.772 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:35:46.772 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.772 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.772 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.772 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:46.772 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:35:46.772 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.772 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.772 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.772 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:46.772 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628699+0000", 2024-09-12T18:35:46.772 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3859999999999999e-06 2024-09-12T18:35:46.772 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.773 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.773 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:46.773 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628706+0000", 2024-09-12T18:35:46.773 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0169999999999999e-06 2024-09-12T18:35:46.773 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.773 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.773 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:46.773 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628725+0000", 2024-09-12T18:35:46.773 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8683000000000001e-05 2024-09-12T18:35:46.773 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.773 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.773 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.773 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628740+0000", 2024-09-12T18:35:46.774 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5413999999999998e-05 2024-09-12T18:35:46.774 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.774 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.774 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.774 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628907+0000", 2024-09-12T18:35:46.774 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00016670199999999999 2024-09-12T18:35:46.774 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.774 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.774 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:35:46.774 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628917+0000", 2024-09-12T18:35:46.774 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.046e-05 2024-09-12T18:35:46.774 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.774 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.774 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.775 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.660390+0000", 2024-09-12T18:35:46.775 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.031472364000000003 2024-09-12T18:35:46.775 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.775 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.775 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:46.775 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.661767+0000", 2024-09-12T18:35:46.775 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0013769190000000001 2024-09-12T18:35:46.775 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.775 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.775 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:46.775 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.662408+0000", 2024-09-12T18:35:46.775 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00064091099999999998 2024-09-12T18:35:46.775 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.776 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.776 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:35:46.776 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669577+0000", 2024-09-12T18:35:46.776 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.007169412 2024-09-12T18:35:46.776 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.776 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.776 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:46.776 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674244+0000", 2024-09-12T18:35:46.776 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0046671839999999996 2024-09-12T18:35:46.776 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.776 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.776 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:46.777 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674329+0000", 2024-09-12T18:35:46.777 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5276000000000001e-05 2024-09-12T18:35:46.777 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.777 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.777 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:46.777 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674400+0000", 2024-09-12T18:35:46.777 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0408999999999996e-05 2024-09-12T18:35:46.777 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.777 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:46.777 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.777 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.777 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.777 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:46.777 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:35:46.778 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 21.118878214999999, 2024-09-12T18:35:46.778 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.044572443000000003, 2024-09-12T18:35:46.778 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:46.778 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:46.778 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:46.778 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:46.778 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.778 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:46.778 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:35:46.778 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.778 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.778 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.778 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:46.779 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:35:46.779 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.779 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.779 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.779 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:46.779 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628807+0000", 2024-09-12T18:35:46.779 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3629999999999999e-06 2024-09-12T18:35:46.779 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.779 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.779 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:46.779 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628814+0000", 2024-09-12T18:35:46.779 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.2099999999999996e-06 2024-09-12T18:35:46.779 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.779 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.780 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:46.780 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628832+0000", 2024-09-12T18:35:46.780 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7972999999999999e-05 2024-09-12T18:35:46.780 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.780 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.780 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.780 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628854+0000", 2024-09-12T18:35:46.780 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1857000000000001e-05 2024-09-12T18:35:46.780 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.780 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.780 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.780 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628984+0000", 2024-09-12T18:35:46.780 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013013599999999999 2024-09-12T18:35:46.781 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.781 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.781 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:35:46.781 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628993+0000", 2024-09-12T18:35:46.781 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:35:46.781 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.781 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.781 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.781 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668176+0000", 2024-09-12T18:35:46.781 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.039182211000000002 2024-09-12T18:35:46.781 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.781 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.781 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:46.782 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668481+0000", 2024-09-12T18:35:46.782 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00030499200000000002 2024-09-12T18:35:46.782 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.782 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.782 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:46.782 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668771+0000", 2024-09-12T18:35:46.782 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00029018700000000002 2024-09-12T18:35:46.782 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.782 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.782 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:35:46.782 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.672674+0000", 2024-09-12T18:35:46.782 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0039031890000000001 2024-09-12T18:35:46.782 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.782 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.782 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:46.783 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673214+0000", 2024-09-12T18:35:46.783 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00053981600000000004 2024-09-12T18:35:46.783 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.783 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.783 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:46.783 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673310+0000", 2024-09-12T18:35:46.783 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.6682999999999996e-05 2024-09-12T18:35:46.783 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.783 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.783 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:46.783 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673378+0000", 2024-09-12T18:35:46.783 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7385999999999995e-05 2024-09-12T18:35:46.783 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.784 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:46.784 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.784 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.784 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.784 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:46.784 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:35:46.784 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 21.118742188999999, 2024-09-12T18:35:46.784 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.041480853999999998, 2024-09-12T18:35:46.784 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:46.784 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:46.784 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:46.784 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:46.785 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.785 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:46.785 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:35:46.785 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.785 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.785 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.785 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:46.785 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:35:46.785 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.785 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.785 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.785 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:46.785 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628943+0000", 2024-09-12T18:35:46.785 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.403e-06 2024-09-12T18:35:46.786 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.786 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.786 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:46.786 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628953+0000", 2024-09-12T18:35:46.786 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0273e-05 2024-09-12T18:35:46.786 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.786 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.786 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:46.786 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628973+0000", 2024-09-12T18:35:46.786 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9959999999999999e-05 2024-09-12T18:35:46.786 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.786 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.786 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.786 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628989+0000", 2024-09-12T18:35:46.787 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6447e-05 2024-09-12T18:35:46.787 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.787 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.787 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.787 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629144+0000", 2024-09-12T18:35:46.787 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015468900000000001 2024-09-12T18:35:46.787 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.787 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.787 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:35:46.787 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629162+0000", 2024-09-12T18:35:46.787 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7603000000000001e-05 2024-09-12T18:35:46.787 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.787 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.787 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.788 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.646927+0000", 2024-09-12T18:35:46.788 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.017765626 2024-09-12T18:35:46.788 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.788 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.788 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:46.788 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.647245+0000", 2024-09-12T18:35:46.788 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00031797699999999999 2024-09-12T18:35:46.788 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.788 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.788 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:46.788 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.647551+0000", 2024-09-12T18:35:46.788 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00030583500000000002 2024-09-12T18:35:46.789 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.789 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.789 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:35:46.789 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651738+0000", 2024-09-12T18:35:46.789 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0041864980000000003 2024-09-12T18:35:46.789 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.789 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.789 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:46.789 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670207+0000", 2024-09-12T18:35:46.789 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018469299000000002 2024-09-12T18:35:46.789 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.789 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.789 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:46.789 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670330+0000", 2024-09-12T18:35:46.790 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012284500000000001 2024-09-12T18:35:46.790 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.790 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.790 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:46.790 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670422+0000", 2024-09-12T18:35:46.790 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2398999999999994e-05 2024-09-12T18:35:46.790 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.790 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:46.790 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.790 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.790 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.790 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:46.790 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:35:46.791 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 21.118664935999998, 2024-09-12T18:35:46.791 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.041623741999999998, 2024-09-12T18:35:46.791 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:46.791 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:46.791 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:35:46.791 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:46.791 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.791 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:46.791 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:35:46.791 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.791 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.791 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.791 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:46.791 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:35:46.791 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.792 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.792 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.792 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:46.792 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629020+0000", 2024-09-12T18:35:46.792 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.15e-06 2024-09-12T18:35:46.792 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.792 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.792 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:46.792 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629023+0000", 2024-09-12T18:35:46.792 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4659999999999999e-06 2024-09-12T18:35:46.793 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.793 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.793 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:46.793 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629037+0000", 2024-09-12T18:35:46.793 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3857e-05 2024-09-12T18:35:46.793 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.793 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.793 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.793 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629062+0000", 2024-09-12T18:35:46.793 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4519999999999999e-05 2024-09-12T18:35:46.793 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.793 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.793 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.794 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629253+0000", 2024-09-12T18:35:46.794 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000191335 2024-09-12T18:35:46.794 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.794 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.794 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:35:46.794 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629266+0000", 2024-09-12T18:35:46.794 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3322999999999999e-05 2024-09-12T18:35:46.794 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.794 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.794 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.794 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648331+0000", 2024-09-12T18:35:46.794 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.019065060000000002 2024-09-12T18:35:46.795 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.795 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.795 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:46.795 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.650044+0000", 2024-09-12T18:35:46.795 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017123959999999999 2024-09-12T18:35:46.795 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.795 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.795 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:46.795 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670642+0000", 2024-09-12T18:35:46.795 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.020598635000000001 2024-09-12T18:35:46.795 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.795 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:46.795 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.796 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.796 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.796 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:46.796 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:35:46.796 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 21.118561604, 2024-09-12T18:35:46.796 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.046431252999999999, 2024-09-12T18:35:46.796 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:46.796 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:46.796 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:35:46.796 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:46.796 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.796 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:46.796 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:35:46.797 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.797 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.797 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.797 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:46.797 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:35:46.797 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.797 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.797 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.797 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:46.797 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629123+0000", 2024-09-12T18:35:46.797 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0899999999999999e-06 2024-09-12T18:35:46.797 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.797 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.797 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:46.798 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629138+0000", 2024-09-12T18:35:46.798 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4977000000000001e-05 2024-09-12T18:35:46.798 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.798 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.798 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:46.798 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629149+0000", 2024-09-12T18:35:46.798 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1182999999999999e-05 2024-09-12T18:35:46.798 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.798 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.798 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.798 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629157+0000", 2024-09-12T18:35:46.798 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8129999999999996e-06 2024-09-12T18:35:46.798 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.798 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.799 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.799 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629223+0000", 2024-09-12T18:35:46.799 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6463000000000004e-05 2024-09-12T18:35:46.799 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.799 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.799 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:35:46.799 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629230+0000", 2024-09-12T18:35:46.799 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1360000000000002e-06 2024-09-12T18:35:46.799 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.799 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.799 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.799 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669605+0000", 2024-09-12T18:35:46.799 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.040375518999999999 2024-09-12T18:35:46.800 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.800 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.800 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:46.800 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669840+0000", 2024-09-12T18:35:46.800 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00023520099999999999 2024-09-12T18:35:46.800 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.800 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.800 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:46.800 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.675553+0000", 2024-09-12T18:35:46.800 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0057128709999999996 2024-09-12T18:35:46.800 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.800 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:46.800 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.800 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.800 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.801 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:46.801 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:35:46.801 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 21.118506936999999, 2024-09-12T18:35:46.801 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.037357044999999998, 2024-09-12T18:35:46.801 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:46.801 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:46.801 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:35:46.801 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:46.801 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.801 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:46.801 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:35:46.801 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.801 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.801 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.802 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:46.802 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:35:46.802 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.802 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.802 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.802 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:46.802 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629178+0000", 2024-09-12T18:35:46.802 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.08e-06 2024-09-12T18:35:46.802 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.802 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.802 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:46.802 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629194+0000", 2024-09-12T18:35:46.802 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5899000000000001e-05 2024-09-12T18:35:46.803 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.803 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.803 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:46.803 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629211+0000", 2024-09-12T18:35:46.803 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7363e-05 2024-09-12T18:35:46.803 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.803 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.803 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.803 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629226+0000", 2024-09-12T18:35:46.803 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4567e-05 2024-09-12T18:35:46.803 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.803 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.803 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.804 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629299+0000", 2024-09-12T18:35:46.804 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3910000000000002e-05 2024-09-12T18:35:46.804 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.804 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.804 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:35:46.804 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629307+0000", 2024-09-12T18:35:46.804 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5299999999999999e-06 2024-09-12T18:35:46.804 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.804 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.804 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.804 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648185+0000", 2024-09-12T18:35:46.804 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018878533999999999 2024-09-12T18:35:46.804 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.805 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.805 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:46.805 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.649724+0000", 2024-09-12T18:35:46.805 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001538841 2024-09-12T18:35:46.805 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.805 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.805 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:46.805 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.666534+0000", 2024-09-12T18:35:46.805 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.016809320999999999 2024-09-12T18:35:46.805 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.805 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:46.805 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.805 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.806 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.806 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T18:35:46.806 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.634726+0000", 2024-09-12T18:35:46.806 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 21.112958017, 2024-09-12T18:35:46.806 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012351554000000001, 2024-09-12T18:35:46.806 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:46.806 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:46.806 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "reached pg", 2024-09-12T18:35:46.806 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:46.806 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.806 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:46.806 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.634726+0000", 2024-09-12T18:35:46.806 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.807 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.807 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.807 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:46.807 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.634726+0000", 2024-09-12T18:35:46.807 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.807 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.807 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.807 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:46.807 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.634726+0000", 2024-09-12T18:35:46.807 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7999999999999995e-07 2024-09-12T18:35:46.807 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.807 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.807 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:46.808 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.634742+0000", 2024-09-12T18:35:46.808 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.537e-05 2024-09-12T18:35:46.808 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.808 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.808 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:46.808 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.634788+0000", 2024-09-12T18:35:46.808 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.6059000000000001e-05 2024-09-12T18:35:46.808 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.808 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.808 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.808 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.634826+0000", 2024-09-12T18:35:46.808 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.7953000000000001e-05 2024-09-12T18:35:46.808 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.809 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.809 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.809 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.641962+0000", 2024-09-12T18:35:46.809 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0071361990000000002 2024-09-12T18:35:46.809 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.809 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.809 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:46.809 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.647077+0000", 2024-09-12T18:35:46.809 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0051152929999999999 2024-09-12T18:35:46.809 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.809 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:46.809 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.809 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.810 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.810 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:35:46.810 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.648091+0000", 2024-09-12T18:35:46.810 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 21.099592347000002, 2024-09-12T18:35:46.810 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015212766000000001, 2024-09-12T18:35:46.810 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:46.810 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:46.810 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:46.810 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:46.810 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.810 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:46.810 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648091+0000", 2024-09-12T18:35:46.811 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.811 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.811 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.811 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:46.811 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648091+0000", 2024-09-12T18:35:46.811 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.811 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.811 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.811 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:46.811 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648092+0000", 2024-09-12T18:35:46.811 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.26e-06 2024-09-12T18:35:46.811 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.811 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.811 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:46.812 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648123+0000", 2024-09-12T18:35:46.812 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.0719000000000002e-05 2024-09-12T18:35:46.812 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.812 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.812 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:46.812 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648140+0000", 2024-09-12T18:35:46.812 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6650000000000002e-05 2024-09-12T18:35:46.812 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.812 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.812 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.812 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648153+0000", 2024-09-12T18:35:46.812 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.278e-05 2024-09-12T18:35:46.812 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.813 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.813 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.813 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.649756+0000", 2024-09-12T18:35:46.813 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0016036379999999999 2024-09-12T18:35:46.813 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.813 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.813 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:46.813 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.649800+0000", 2024-09-12T18:35:46.813 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3748999999999997e-05 2024-09-12T18:35:46.813 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.813 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.813 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:46.813 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663215+0000", 2024-09-12T18:35:46.814 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013414733999999999 2024-09-12T18:35:46.814 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.814 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.814 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:46.814 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663304+0000", 2024-09-12T18:35:46.814 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.9235999999999997e-05 2024-09-12T18:35:46.814 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.814 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:46.814 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.814 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.814 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.814 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T18:35:46.814 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.648176+0000", 2024-09-12T18:35:46.815 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 21.099507937999999, 2024-09-12T18:35:46.815 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015315812, 2024-09-12T18:35:46.815 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:46.815 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:46.815 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:46.815 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:46.815 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.815 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:46.815 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648176+0000", 2024-09-12T18:35:46.815 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.815 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.815 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.815 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:46.816 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648176+0000", 2024-09-12T18:35:46.816 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.816 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.816 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.816 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:46.816 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648176+0000", 2024-09-12T18:35:46.816 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.9400000000000005e-07 2024-09-12T18:35:46.816 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.816 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.816 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:46.816 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648184+0000", 2024-09-12T18:35:46.816 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4730000000000003e-06 2024-09-12T18:35:46.817 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.817 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.817 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:46.817 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648201+0000", 2024-09-12T18:35:46.817 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7119999999999999e-05 2024-09-12T18:35:46.817 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.817 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.817 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.817 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648214+0000", 2024-09-12T18:35:46.817 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3343000000000001e-05 2024-09-12T18:35:46.817 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.817 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.817 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.818 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651085+0000", 2024-09-12T18:35:46.818 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0028710850000000002 2024-09-12T18:35:46.818 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.818 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.818 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:46.818 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651114+0000", 2024-09-12T18:35:46.818 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.8296000000000001e-05 2024-09-12T18:35:46.818 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.818 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.818 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:46.818 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663360+0000", 2024-09-12T18:35:46.819 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012246801999999999 2024-09-12T18:35:46.819 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.819 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.819 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:46.819 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663491+0000", 2024-09-12T18:35:46.819 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000130999 2024-09-12T18:35:46.819 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.819 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:46.819 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.819 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.819 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.819 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T18:35:46.819 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.648235+0000", 2024-09-12T18:35:46.820 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 21.099448398, 2024-09-12T18:35:46.820 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015168310000000001, 2024-09-12T18:35:46.820 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:46.820 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:46.820 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:46.820 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:46.820 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.820 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:46.820 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648235+0000", 2024-09-12T18:35:46.820 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.820 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.820 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.820 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:46.821 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648235+0000", 2024-09-12T18:35:46.821 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.821 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.821 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.821 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:46.821 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648236+0000", 2024-09-12T18:35:46.821 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5300000000000003e-07 2024-09-12T18:35:46.821 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.821 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.821 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:46.821 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648244+0000", 2024-09-12T18:35:46.821 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.7170000000000008e-06 2024-09-12T18:35:46.821 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.822 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.822 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:46.822 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648259+0000", 2024-09-12T18:35:46.822 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5126000000000001e-05 2024-09-12T18:35:46.822 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.822 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.822 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.822 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648270+0000", 2024-09-12T18:35:46.822 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0933e-05 2024-09-12T18:35:46.822 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.822 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.822 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.822 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.650395+0000", 2024-09-12T18:35:46.823 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0021251040000000001 2024-09-12T18:35:46.823 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.823 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.823 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:46.823 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.650444+0000", 2024-09-12T18:35:46.823 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9456000000000002e-05 2024-09-12T18:35:46.823 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.823 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.823 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:46.823 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663311+0000", 2024-09-12T18:35:46.823 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012866658 2024-09-12T18:35:46.823 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.823 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.824 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:46.824 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663403+0000", 2024-09-12T18:35:46.824 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2563000000000001e-05 2024-09-12T18:35:46.824 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.824 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:46.824 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.824 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.824 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.824 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T18:35:46.824 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:27.625852+0000", 2024-09-12T18:35:46.824 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 19.121831988, 2024-09-12T18:35:46.824 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011004888000000001, 2024-09-12T18:35:46.825 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:46.825 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:46.825 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:46.825 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:46.825 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.825 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:46.825 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:27.625852+0000", 2024-09-12T18:35:46.825 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.825 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.825 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.825 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:46.825 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:27.625852+0000", 2024-09-12T18:35:46.825 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.825 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.826 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.826 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:46.826 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:27.625854+0000", 2024-09-12T18:35:46.826 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.5000000000000002e-06 2024-09-12T18:35:46.826 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.826 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.826 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:46.826 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:27.625868+0000", 2024-09-12T18:35:46.826 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3689999999999999e-05 2024-09-12T18:35:46.826 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.826 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.826 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:46.826 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:27.625899+0000", 2024-09-12T18:35:46.827 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.0796000000000001e-05 2024-09-12T18:35:46.827 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.827 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.827 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.827 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:27.625913+0000", 2024-09-12T18:35:46.827 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4637000000000001e-05 2024-09-12T18:35:46.827 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.827 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.827 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.827 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:27.626065+0000", 2024-09-12T18:35:46.827 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015139799999999999 2024-09-12T18:35:46.827 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.827 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.828 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:35:46.828 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:27.626074+0000", 2024-09-12T18:35:46.828 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.6399999999999992e-06 2024-09-12T18:35:46.828 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.828 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.828 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.828 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:27.633983+0000", 2024-09-12T18:35:46.828 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0079088519999999992 2024-09-12T18:35:46.828 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.828 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.828 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:46.828 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:27.634198+0000", 2024-09-12T18:35:46.828 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00021542499999999999 2024-09-12T18:35:46.828 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.829 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.829 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:46.829 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:27.634372+0000", 2024-09-12T18:35:46.829 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000173022 2024-09-12T18:35:46.829 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.829 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.829 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:35:46.829 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:27.635551+0000", 2024-09-12T18:35:46.829 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001179561 2024-09-12T18:35:46.829 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.829 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.829 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:46.829 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:27.636721+0000", 2024-09-12T18:35:46.830 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001169738 2024-09-12T18:35:46.830 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.830 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.830 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:46.830 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:27.636794+0000", 2024-09-12T18:35:46.830 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3576000000000002e-05 2024-09-12T18:35:46.830 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.830 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.830 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:46.830 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:27.636856+0000", 2024-09-12T18:35:46.830 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2052999999999997e-05 2024-09-12T18:35:46.830 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.830 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:46.830 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.831 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.831 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.831 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:12 5.5 5:a9782381:::benchmark_data_smithi073_23739_object11:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:35:46.831 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:45.868934+0000", 2024-09-12T18:35:46.831 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.87874964600000005, 2024-09-12T18:35:46.831 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011258424, 2024-09-12T18:35:46.831 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:46.831 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:46.831 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:46.831 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:35:46.831 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:35:46.831 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:46.831 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 12 2024-09-12T18:35:46.832 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.832 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:46.832 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.832 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:46.832 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.868934+0000", 2024-09-12T18:35:46.832 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.832 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.832 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.832 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:46.832 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.868934+0000", 2024-09-12T18:35:46.832 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.832 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.832 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.833 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:46.833 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.868935+0000", 2024-09-12T18:35:46.833 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.64e-07 2024-09-12T18:35:46.833 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.833 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.833 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:46.833 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.869119+0000", 2024-09-12T18:35:46.833 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00018435500000000001 2024-09-12T18:35:46.833 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.833 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.833 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:46.833 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.869138+0000", 2024-09-12T18:35:46.834 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8295999999999999e-05 2024-09-12T18:35:46.834 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.834 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.834 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.834 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.869148+0000", 2024-09-12T18:35:46.834 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0074e-05 2024-09-12T18:35:46.834 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.834 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.834 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.834 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.870937+0000", 2024-09-12T18:35:46.834 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017889500000000001 2024-09-12T18:35:46.834 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.834 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.835 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:46.835 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.871253+0000", 2024-09-12T18:35:46.835 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000316294 2024-09-12T18:35:46.835 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.835 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.835 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:46.835 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.871703+0000", 2024-09-12T18:35:46.835 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00045021599999999997 2024-09-12T18:35:46.835 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.835 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.835 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:46.835 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.879053+0000", 2024-09-12T18:35:46.835 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0073496969999999997 2024-09-12T18:35:46.836 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.836 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.836 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:35:46.836 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.879940+0000", 2024-09-12T18:35:46.836 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00088750999999999999 2024-09-12T18:35:46.836 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.836 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.836 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:46.836 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.880089+0000", 2024-09-12T18:35:46.836 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000148842 2024-09-12T18:35:46.836 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.836 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.837 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:46.837 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.880192+0000", 2024-09-12T18:35:46.837 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000103226 2024-09-12T18:35:46.837 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.837 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:46.837 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.837 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.837 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.837 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:50 5.6 5:66213960:::benchmark_data_smithi073_23739_object49:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:35:46.837 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:45.893135+0000", 2024-09-12T18:35:46.837 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.85454879900000003, 2024-09-12T18:35:46.837 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011908922000000001, 2024-09-12T18:35:46.837 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:46.838 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:46.838 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:46.838 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:35:46.838 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:35:46.838 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:46.838 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 50 2024-09-12T18:35:46.838 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.838 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:46.838 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.838 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:46.838 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.893135+0000", 2024-09-12T18:35:46.838 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.838 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.839 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.839 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:46.839 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.893135+0000", 2024-09-12T18:35:46.839 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.839 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.839 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.839 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:46.839 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.893137+0000", 2024-09-12T18:35:46.839 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.3499999999999999e-06 2024-09-12T18:35:46.839 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.839 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.839 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:46.840 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.893304+0000", 2024-09-12T18:35:46.840 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000166859 2024-09-12T18:35:46.840 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.840 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.840 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:46.840 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.893329+0000", 2024-09-12T18:35:46.840 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.5386000000000001e-05 2024-09-12T18:35:46.840 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.840 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.840 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.840 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.893349+0000", 2024-09-12T18:35:46.840 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9547000000000001e-05 2024-09-12T18:35:46.840 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.841 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.841 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.841 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.894135+0000", 2024-09-12T18:35:46.841 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00078617699999999999 2024-09-12T18:35:46.841 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.841 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.841 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:46.841 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.894339+0000", 2024-09-12T18:35:46.841 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000203978 2024-09-12T18:35:46.841 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.841 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.841 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:46.841 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.894635+0000", 2024-09-12T18:35:46.842 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00029639500000000002 2024-09-12T18:35:46.842 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.842 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.842 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:46.842 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.897773+0000", 2024-09-12T18:35:46.842 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0031377990000000001 2024-09-12T18:35:46.842 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.842 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.842 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:35:46.842 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.904811+0000", 2024-09-12T18:35:46.842 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0070375860000000002 2024-09-12T18:35:46.842 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.843 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.843 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:46.843 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.904938+0000", 2024-09-12T18:35:46.843 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012709599999999999 2024-09-12T18:35:46.843 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.843 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.843 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:46.843 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.905044+0000", 2024-09-12T18:35:46.843 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00010574899999999999 2024-09-12T18:35:46.843 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.843 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:46.843 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.843 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.844 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.844 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:55 5.6 5:64da22f0:::benchmark_data_smithi073_23739_object54:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:35:46.844 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:45.896733+0000", 2024-09-12T18:35:46.844 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.85095068299999999, 2024-09-12T18:35:46.844 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012070236999999999, 2024-09-12T18:35:46.844 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:46.844 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:46.844 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:46.844 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:35:46.844 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:35:46.844 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:46.844 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 55 2024-09-12T18:35:46.844 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.845 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:46.845 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.845 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:46.845 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.896733+0000", 2024-09-12T18:35:46.845 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.845 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.845 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.845 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:46.845 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.896733+0000", 2024-09-12T18:35:46.845 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.845 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.845 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.846 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:46.846 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.896735+0000", 2024-09-12T18:35:46.846 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.6359999999999998e-06 2024-09-12T18:35:46.846 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.846 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.846 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:46.846 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.896832+0000", 2024-09-12T18:35:46.846 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.6885999999999994e-05 2024-09-12T18:35:46.846 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.846 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.846 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:46.846 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.896861+0000", 2024-09-12T18:35:46.846 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.8456999999999999e-05 2024-09-12T18:35:46.847 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.847 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.847 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.847 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.896912+0000", 2024-09-12T18:35:46.847 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1566000000000001e-05 2024-09-12T18:35:46.847 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.847 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.847 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.847 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.898239+0000", 2024-09-12T18:35:46.847 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001326886 2024-09-12T18:35:46.847 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.847 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.847 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:46.848 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.898578+0000", 2024-09-12T18:35:46.848 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00033859800000000001 2024-09-12T18:35:46.848 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.848 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.848 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:46.848 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.898959+0000", 2024-09-12T18:35:46.848 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00038096700000000001 2024-09-12T18:35:46.848 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.848 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.848 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:46.848 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.905356+0000", 2024-09-12T18:35:46.848 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0063968269999999999 2024-09-12T18:35:46.848 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.849 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.849 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:35:46.849 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.908620+0000", 2024-09-12T18:35:46.849 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.003263948 2024-09-12T18:35:46.849 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.849 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.849 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:46.849 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.908726+0000", 2024-09-12T18:35:46.849 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000106519 2024-09-12T18:35:46.849 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.849 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.849 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:46.850 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.908803+0000", 2024-09-12T18:35:46.850 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6946999999999994e-05 2024-09-12T18:35:46.850 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.850 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:46.850 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.850 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.850 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.850 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:62 5.6 5:67709b9f:::benchmark_data_smithi073_23739_object61:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:35:46.850 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:45.898027+0000", 2024-09-12T18:35:46.851 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.849656627, 2024-09-12T18:35:46.851 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.014007786, 2024-09-12T18:35:46.851 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:46.851 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:46.851 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:46.851 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:35:46.851 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:35:46.851 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:46.851 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 62 2024-09-12T18:35:46.851 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.851 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:46.851 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.851 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:46.852 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.898027+0000", 2024-09-12T18:35:46.852 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.852 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.852 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.852 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:46.852 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.898027+0000", 2024-09-12T18:35:46.852 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.852 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.852 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.852 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:46.852 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.898029+0000", 2024-09-12T18:35:46.852 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.554e-06 2024-09-12T18:35:46.852 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.853 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.853 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:46.853 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.898164+0000", 2024-09-12T18:35:46.853 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000134719 2024-09-12T18:35:46.853 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.853 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.853 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:46.853 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.898186+0000", 2024-09-12T18:35:46.853 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1449000000000001e-05 2024-09-12T18:35:46.853 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.853 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.853 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.853 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.898199+0000", 2024-09-12T18:35:46.854 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3403e-05 2024-09-12T18:35:46.854 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.854 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.854 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.854 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.900978+0000", 2024-09-12T18:35:46.854 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0027789260000000001 2024-09-12T18:35:46.854 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.854 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.854 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:46.854 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.901163+0000", 2024-09-12T18:35:46.854 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00018457200000000001 2024-09-12T18:35:46.854 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.854 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.855 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:46.855 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.901378+0000", 2024-09-12T18:35:46.855 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00021581500000000001 2024-09-12T18:35:46.855 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.855 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.855 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:46.855 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.905487+0000", 2024-09-12T18:35:46.855 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0041085679999999999 2024-09-12T18:35:46.855 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.855 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.855 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:35:46.855 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.911778+0000", 2024-09-12T18:35:46.856 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0062909690000000004 2024-09-12T18:35:46.856 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.856 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.856 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:46.856 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.911923+0000", 2024-09-12T18:35:46.856 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014524199999999999 2024-09-12T18:35:46.856 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.856 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.856 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:46.856 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.912035+0000", 2024-09-12T18:35:46.856 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000111569 2024-09-12T18:35:46.856 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.856 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:46.856 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.857 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.857 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.857 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:67 5.2 e23/21 5:4e4fb020:::benchmark_data_smithi073_23739_object66:head v 23'5, mlcod=23'3)", 2024-09-12T18:35:46.857 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:45.902451+0000", 2024-09-12T18:35:46.857 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.84523292999999999, 2024-09-12T18:35:46.857 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011085078, 2024-09-12T18:35:46.857 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:46.857 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:46.857 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:46.857 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:46.857 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.857 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:46.857 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.902451+0000", 2024-09-12T18:35:46.858 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.858 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.858 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.858 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:46.858 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.902451+0000", 2024-09-12T18:35:46.858 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.858 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.858 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.858 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:46.858 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.902452+0000", 2024-09-12T18:35:46.858 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.666e-06 2024-09-12T18:35:46.858 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.858 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.859 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:46.859 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.902533+0000", 2024-09-12T18:35:46.859 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0285999999999997e-05 2024-09-12T18:35:46.859 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.859 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.859 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:46.859 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.902550+0000", 2024-09-12T18:35:46.859 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7937000000000001e-05 2024-09-12T18:35:46.859 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.859 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.859 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.859 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.902564+0000", 2024-09-12T18:35:46.859 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3076e-05 2024-09-12T18:35:46.859 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.860 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.860 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.860 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.902673+0000", 2024-09-12T18:35:46.860 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000109206 2024-09-12T18:35:46.860 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.860 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.860 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:46.860 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.902708+0000", 2024-09-12T18:35:46.860 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.5689999999999999e-05 2024-09-12T18:35:46.860 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.860 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.860 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:46.860 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.913432+0000", 2024-09-12T18:35:46.861 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.010723926999999999 2024-09-12T18:35:46.861 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.861 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.861 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:46.861 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.913536+0000", 2024-09-12T18:35:46.861 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00010329 2024-09-12T18:35:46.861 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.861 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:46.861 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.861 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.861 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.861 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:214 5.3 5:c5bef8c1:::benchmark_data_smithi073_23739_object213:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:35:46.862 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:45.964844+0000", 2024-09-12T18:35:46.862 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.78283940200000002, 2024-09-12T18:35:46.862 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011440293000000001, 2024-09-12T18:35:46.862 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:46.862 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:46.862 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:46.862 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:35:46.862 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:35:46.862 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:46.862 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 214 2024-09-12T18:35:46.862 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.862 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:46.862 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.862 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:46.863 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.964844+0000", 2024-09-12T18:35:46.863 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.863 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.863 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.863 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:46.863 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.964844+0000", 2024-09-12T18:35:46.863 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:46.863 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.863 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.863 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:46.863 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.964845+0000", 2024-09-12T18:35:46.863 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2640000000000001e-06 2024-09-12T18:35:46.863 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.864 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.864 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:46.864 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.964896+0000", 2024-09-12T18:35:46.864 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.083e-05 2024-09-12T18:35:46.864 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.864 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.864 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:46.864 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.964916+0000", 2024-09-12T18:35:46.864 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.0148000000000001e-05 2024-09-12T18:35:46.864 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.864 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.864 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:46.864 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.964930+0000", 2024-09-12T18:35:46.865 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3515e-05 2024-09-12T18:35:46.865 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.865 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.865 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:46.865 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.966600+0000", 2024-09-12T18:35:46.865 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001669996 2024-09-12T18:35:46.865 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.865 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.865 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:46.865 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.966899+0000", 2024-09-12T18:35:46.865 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00029921400000000001 2024-09-12T18:35:46.865 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.865 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.866 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:46.866 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.967259+0000", 2024-09-12T18:35:46.866 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00035954100000000001 2024-09-12T18:35:46.866 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.866 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.866 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:46.866 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.971259+0000", 2024-09-12T18:35:46.866 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0040004410000000004 2024-09-12T18:35:46.866 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.866 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.866 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:35:46.866 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.976069+0000", 2024-09-12T18:35:46.866 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0048094949999999996 2024-09-12T18:35:46.866 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.867 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.867 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:46.867 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.976195+0000", 2024-09-12T18:35:46.867 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000126802 2024-09-12T18:35:46.867 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:46.867 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:46.867 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:46.867 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.976284+0000", 2024-09-12T18:35:46.867 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.9047000000000003e-05 2024-09-12T18:35:46.867 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.867 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:46.867 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.867 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:46.867 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:46.868 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:35:46.869 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:46.867+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:46.870 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is set 2024-09-12T18:35:46.870 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:35:46.871 DEBUG:tasks.admin_socket:Testing objecter_requests with config {'test': 'http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch}', 'branch': 'main'} 2024-09-12T18:35:46.872 DEBUG:teuthology.orchestra.run.smithi073:> wget -q -O /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests -- 'http://git.ceph.com/?p=ceph.git;a=blob_plain;f=src/test/admin_socket/objecter_requests;hb=main' && chmod u=rx -- /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests 2024-09-12T18:35:46.872 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 1 16 3492 3476 217.229 217.25 0.00207367 0.00459296 2024-09-12T18:35:46.969 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:46.967+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:47.034 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:35:47.034 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:35:47.034 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.034 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:4184 5.b 5:deca9010:::benchmark_data_smithi073_23739_object4183:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T18:35:47.034 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:47.031799+0000", 2024-09-12T18:35:47.035 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0044339100000000001, 2024-09-12T18:35:47.035 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0044530070000000001, 2024-09-12T18:35:47.035 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:47.035 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:47.035 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:47.035 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:47.035 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:47.035 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:47.035 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 4184 2024-09-12T18:35:47.035 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.035 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:47.035 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.035 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:47.036 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.031799+0000", 2024-09-12T18:35:47.036 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.036 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.036 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.036 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:47.036 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.031799+0000", 2024-09-12T18:35:47.036 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.036 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.036 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.036 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:47.036 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.031800+0000", 2024-09-12T18:35:47.036 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1399999999999996e-07 2024-09-12T18:35:47.036 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.036 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.037 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:47.037 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.031924+0000", 2024-09-12T18:35:47.037 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012365499999999999 2024-09-12T18:35:47.037 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.037 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.037 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:47.037 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.031933+0000", 2024-09-12T18:35:47.037 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.3940000000000002e-06 2024-09-12T18:35:47.037 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.037 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.037 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:47.037 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.031953+0000", 2024-09-12T18:35:47.037 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9741999999999998e-05 2024-09-12T18:35:47.038 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.038 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.038 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:47.038 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.032082+0000", 2024-09-12T18:35:47.038 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012871399999999999 2024-09-12T18:35:47.038 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.038 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.038 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:47.038 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.032239+0000", 2024-09-12T18:35:47.038 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015747600000000001 2024-09-12T18:35:47.038 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.038 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.038 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:47.039 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.032384+0000", 2024-09-12T18:35:47.039 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014476199999999999 2024-09-12T18:35:47.039 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.039 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.039 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:47.039 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.034835+0000", 2024-09-12T18:35:47.039 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0024514670000000001 2024-09-12T18:35:47.039 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.039 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:47.039 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.039 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.039 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.039 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:4186 5.8 5:118e6a72:::benchmark_data_smithi073_23739_object4185:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T18:35:47.040 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:47.031981+0000", 2024-09-12T18:35:47.040 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0042518900000000004, 2024-09-12T18:35:47.040 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0043374620000000003, 2024-09-12T18:35:47.040 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:47.040 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:47.040 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:47.040 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:47.040 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:47.040 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:47.040 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 4186 2024-09-12T18:35:47.040 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.041 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:47.041 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.041 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:47.041 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.031981+0000", 2024-09-12T18:35:47.041 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.041 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.042 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.042 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:47.042 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.031981+0000", 2024-09-12T18:35:47.042 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.042 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.042 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.042 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:47.042 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.031982+0000", 2024-09-12T18:35:47.042 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0100000000000004e-07 2024-09-12T18:35:47.042 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.042 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.043 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:47.043 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.032024+0000", 2024-09-12T18:35:47.043 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2052999999999999e-05 2024-09-12T18:35:47.043 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.043 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.043 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:47.043 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.032033+0000", 2024-09-12T18:35:47.043 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6980000000000004e-06 2024-09-12T18:35:47.043 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.043 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.043 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:47.043 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.032037+0000", 2024-09-12T18:35:47.043 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1640000000000003e-06 2024-09-12T18:35:47.044 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.044 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.044 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:47.044 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.032085+0000", 2024-09-12T18:35:47.044 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8047999999999998e-05 2024-09-12T18:35:47.044 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.044 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.044 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:47.045 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.032211+0000", 2024-09-12T18:35:47.045 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012581100000000001 2024-09-12T18:35:47.045 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.045 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.045 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:47.045 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.032356+0000", 2024-09-12T18:35:47.045 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000145203 2024-09-12T18:35:47.045 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.045 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.046 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:47.046 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.034806+0000", 2024-09-12T18:35:47.046 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0024494489999999998 2024-09-12T18:35:47.046 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.046 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:47.046 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.046 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.046 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.047 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:4188 5.4 5:2f40025a:::benchmark_data_smithi073_23739_object4187:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T18:35:47.047 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:47.032592+0000", 2024-09-12T18:35:47.047 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0036414289999999998, 2024-09-12T18:35:47.047 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0038006469999999999, 2024-09-12T18:35:47.047 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:47.047 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:47.047 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:47.047 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:47.047 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:47.047 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:47.047 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 4188 2024-09-12T18:35:47.047 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.047 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:47.047 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.047 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:47.048 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.032592+0000", 2024-09-12T18:35:47.048 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.048 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.048 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.048 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:47.048 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.032592+0000", 2024-09-12T18:35:47.048 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.048 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.048 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.048 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:47.048 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.032593+0000", 2024-09-12T18:35:47.048 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3200000000000004e-07 2024-09-12T18:35:47.048 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.049 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.049 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:47.049 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.032646+0000", 2024-09-12T18:35:47.049 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3560000000000002e-05 2024-09-12T18:35:47.049 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.049 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.049 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:47.049 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.032657+0000", 2024-09-12T18:35:47.049 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0431999999999999e-05 2024-09-12T18:35:47.049 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.049 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.049 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:47.050 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.032662+0000", 2024-09-12T18:35:47.050 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0100000000000003e-06 2024-09-12T18:35:47.050 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.050 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.050 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:47.050 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.032713+0000", 2024-09-12T18:35:47.050 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1298000000000003e-05 2024-09-12T18:35:47.050 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.050 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.050 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:47.050 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.032831+0000", 2024-09-12T18:35:47.050 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000118443 2024-09-12T18:35:47.050 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.050 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.051 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:47.051 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.032904+0000", 2024-09-12T18:35:47.051 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2706999999999994e-05 2024-09-12T18:35:47.051 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.051 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:47.052 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.052 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.052 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.052 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:4182 5.a e24/21 5:581d27a0:::benchmark_data_smithi073_23739_object4181:head v 24'247, mlcod=24'245)", 2024-09-12T18:35:47.052 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:47.032787+0000", 2024-09-12T18:35:47.052 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0034462759999999999, 2024-09-12T18:35:47.052 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036653039999999999, 2024-09-12T18:35:47.052 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:47.052 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:47.052 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:35:47.052 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:47.052 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.052 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:47.053 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.032787+0000", 2024-09-12T18:35:47.053 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.053 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.053 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.053 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:47.053 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.032787+0000", 2024-09-12T18:35:47.053 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.053 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.053 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.053 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:47.053 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.032788+0000", 2024-09-12T18:35:47.053 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.99e-07 2024-09-12T18:35:47.053 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.053 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.054 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:47.054 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.032888+0000", 2024-09-12T18:35:47.054 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9742999999999997e-05 2024-09-12T18:35:47.054 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.054 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.054 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:47.054 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.032897+0000", 2024-09-12T18:35:47.054 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.1919999999999994e-06 2024-09-12T18:35:47.054 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.054 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.054 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:47.054 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.032905+0000", 2024-09-12T18:35:47.054 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6260000000000001e-06 2024-09-12T18:35:47.055 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.055 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.055 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:47.055 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.032957+0000", 2024-09-12T18:35:47.055 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1931999999999997e-05 2024-09-12T18:35:47.055 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.055 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.056 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:47.056 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.032978+0000", 2024-09-12T18:35:47.056 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1233000000000002e-05 2024-09-12T18:35:47.056 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.056 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:47.057 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.057 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.057 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.057 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:4189 5.8 5:155abb66:::benchmark_data_smithi073_23739_object4188:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T18:35:47.057 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:47.032797+0000", 2024-09-12T18:35:47.058 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0034364220000000002, 2024-09-12T18:35:47.058 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036837950000000001, 2024-09-12T18:35:47.058 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:47.058 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:47.058 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:47.058 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:47.059 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:47.059 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:47.059 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 4189 2024-09-12T18:35:47.059 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.059 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:47.059 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.059 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:47.059 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.032797+0000", 2024-09-12T18:35:47.059 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.059 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.059 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.060 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:47.060 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.032797+0000", 2024-09-12T18:35:47.060 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.060 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.060 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.060 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:47.060 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.032798+0000", 2024-09-12T18:35:47.060 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.61e-07 2024-09-12T18:35:47.060 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.061 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.061 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:47.061 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.032915+0000", 2024-09-12T18:35:47.061 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000117769 2024-09-12T18:35:47.061 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.061 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.061 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:47.061 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.032935+0000", 2024-09-12T18:35:47.061 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0122000000000001e-05 2024-09-12T18:35:47.062 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.062 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.062 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:47.062 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.032942+0000", 2024-09-12T18:35:47.062 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6630000000000004e-06 2024-09-12T18:35:47.062 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.062 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.062 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:47.062 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.033003+0000", 2024-09-12T18:35:47.062 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0841000000000002e-05 2024-09-12T18:35:47.062 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.062 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.062 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:47.063 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.033150+0000", 2024-09-12T18:35:47.063 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014662099999999999 2024-09-12T18:35:47.063 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.063 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.063 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:47.063 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.033301+0000", 2024-09-12T18:35:47.063 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015126699999999999 2024-09-12T18:35:47.063 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.063 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:47.063 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.064 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.064 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.064 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:4190 5.a e24/21 5:54617672:::benchmark_data_smithi073_23739_object4189:head v 24'248, mlcod=24'245)", 2024-09-12T18:35:47.064 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:47.033646+0000", 2024-09-12T18:35:47.064 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0025874130000000002, 2024-09-12T18:35:47.064 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002867877, 2024-09-12T18:35:47.064 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:47.064 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:47.064 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:35:47.064 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:47.064 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.064 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:47.065 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.033646+0000", 2024-09-12T18:35:47.065 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.065 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.065 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.065 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:47.065 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.033646+0000", 2024-09-12T18:35:47.065 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.065 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.065 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.065 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:47.065 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.033647+0000", 2024-09-12T18:35:47.065 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7100000000000001e-07 2024-09-12T18:35:47.065 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.066 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.066 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:47.066 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.033730+0000", 2024-09-12T18:35:47.066 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3726000000000004e-05 2024-09-12T18:35:47.066 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.066 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.066 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:47.066 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.033738+0000", 2024-09-12T18:35:47.066 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4220000000000003e-06 2024-09-12T18:35:47.066 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.067 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.067 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:47.067 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.033742+0000", 2024-09-12T18:35:47.067 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3640000000000001e-06 2024-09-12T18:35:47.067 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.067 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.067 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:47.068 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.033791+0000", 2024-09-12T18:35:47.068 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8919999999999999e-05 2024-09-12T18:35:47.068 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.068 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.068 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:47.068 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:47.033810+0000", 2024-09-12T18:35:47.068 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8495000000000002e-05 2024-09-12T18:35:47.068 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.068 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:47.068 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.068 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.069 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-09-12T18:35:47.069 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 6 2024-09-12T18:35:47.069 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:35:47.070 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:35:47.071 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:47.071+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:47.173 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:47.171+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:47.231 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --admin-daemon /var/run/ceph/ceph-client.0.asok objecter_requests 2024-09-12T18:35:47.232 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:35:47.232 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-09-12T18:35:47.232 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-09-12T18:35:47.232 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-09-12T18:35:47.232 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:35:47.252 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:35:47.274 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:47.271+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:47.357 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T18:35:47.357 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-12T18:35:47.358 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:35:47.358 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 5576, 2024-09-12T18:35:47.358 INFO:teuthology.orchestra.run.smithi073.stdout: "pg": "5.8d53aa6c", 2024-09-12T18:35:47.358 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-09-12T18:35:47.358 INFO:teuthology.orchestra.run.smithi073.stdout: "object_id": "benchmark_data_smithi073_23739_object5575", 2024-09-12T18:35:47.359 INFO:teuthology.orchestra.run.smithi073.stdout: "object_locator": "@5", 2024-09-12T18:35:47.359 INFO:teuthology.orchestra.run.smithi073.stdout: "target_object_id": "benchmark_data_smithi073_23739_object5575", 2024-09-12T18:35:47.359 INFO:teuthology.orchestra.run.smithi073.stdout: "target_object_locator": "@5", 2024-09-12T18:35:47.359 INFO:teuthology.orchestra.run.smithi073.stdout: "paused": 0, 2024-09-12T18:35:47.359 INFO:teuthology.orchestra.run.smithi073.stdout: "used_replica": 0, 2024-09-12T18:35:47.360 INFO:teuthology.orchestra.run.smithi073.stdout: "precalc_pgid": 0, 2024-09-12T18:35:47.360 INFO:teuthology.orchestra.run.smithi073.stdout: "last_sent": "710.939884s", 2024-09-12T18:35:47.360 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 0.003999964, 2024-09-12T18:35:47.360 INFO:teuthology.orchestra.run.smithi073.stdout: "attempts": 1, 2024-09-12T18:35:47.360 INFO:teuthology.orchestra.run.smithi073.stdout: "snapid": "head", 2024-09-12T18:35:47.361 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_context": "0=[]", 2024-09-12T18:35:47.361 INFO:teuthology.orchestra.run.smithi073.stdout: "mtime": "2024-09-12T18:35:47.353782+0000", 2024-09-12T18:35:47.361 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_ops": [ 2024-09-12T18:35:47.361 INFO:teuthology.orchestra.run.smithi073.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T18:35:47.361 INFO:teuthology.orchestra.run.smithi073.stdout: "write 0~65536 in=65536b" 2024-09-12T18:35:47.361 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:35:47.362 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:35:47.362 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:35:47.362 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 5579, 2024-09-12T18:35:47.362 INFO:teuthology.orchestra.run.smithi073.stdout: "pg": "5.1de040f3", 2024-09-12T18:35:47.362 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-09-12T18:35:47.362 INFO:teuthology.orchestra.run.smithi073.stdout: "object_id": "benchmark_data_smithi073_23739_object5578", 2024-09-12T18:35:47.363 INFO:teuthology.orchestra.run.smithi073.stdout: "object_locator": "@5", 2024-09-12T18:35:47.363 INFO:teuthology.orchestra.run.smithi073.stdout: "target_object_id": "benchmark_data_smithi073_23739_object5578", 2024-09-12T18:35:47.363 INFO:teuthology.orchestra.run.smithi073.stdout: "target_object_locator": "@5", 2024-09-12T18:35:47.363 INFO:teuthology.orchestra.run.smithi073.stdout: "paused": 0, 2024-09-12T18:35:47.363 INFO:teuthology.orchestra.run.smithi073.stdout: "used_replica": 0, 2024-09-12T18:35:47.363 INFO:teuthology.orchestra.run.smithi073.stdout: "precalc_pgid": 0, 2024-09-12T18:35:47.363 INFO:teuthology.orchestra.run.smithi073.stdout: "last_sent": "710.943884s", 2024-09-12T18:35:47.363 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 0, 2024-09-12T18:35:47.363 INFO:teuthology.orchestra.run.smithi073.stdout: "attempts": 1, 2024-09-12T18:35:47.363 INFO:teuthology.orchestra.run.smithi073.stdout: "snapid": "head", 2024-09-12T18:35:47.363 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_context": "0=[]", 2024-09-12T18:35:47.363 INFO:teuthology.orchestra.run.smithi073.stdout: "mtime": "2024-09-12T18:35:47.354176+0000", 2024-09-12T18:35:47.363 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_ops": [ 2024-09-12T18:35:47.364 INFO:teuthology.orchestra.run.smithi073.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T18:35:47.364 INFO:teuthology.orchestra.run.smithi073.stdout: "write 0~65536 in=65536b" 2024-09-12T18:35:47.364 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:35:47.364 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:35:47.364 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:35:47.364 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 5580, 2024-09-12T18:35:47.364 INFO:teuthology.orchestra.run.smithi073.stdout: "pg": "5.1aff951c", 2024-09-12T18:35:47.364 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-09-12T18:35:47.364 INFO:teuthology.orchestra.run.smithi073.stdout: "object_id": "benchmark_data_smithi073_23739_object5579", 2024-09-12T18:35:47.365 INFO:teuthology.orchestra.run.smithi073.stdout: "object_locator": "@5", 2024-09-12T18:35:47.365 INFO:teuthology.orchestra.run.smithi073.stdout: "target_object_id": "benchmark_data_smithi073_23739_object5579", 2024-09-12T18:35:47.365 INFO:teuthology.orchestra.run.smithi073.stdout: "target_object_locator": "@5", 2024-09-12T18:35:47.365 INFO:teuthology.orchestra.run.smithi073.stdout: "paused": 0, 2024-09-12T18:35:47.365 INFO:teuthology.orchestra.run.smithi073.stdout: "used_replica": 0, 2024-09-12T18:35:47.365 INFO:teuthology.orchestra.run.smithi073.stdout: "precalc_pgid": 0, 2024-09-12T18:35:47.365 INFO:teuthology.orchestra.run.smithi073.stdout: "last_sent": "710.943884s", 2024-09-12T18:35:47.365 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 0, 2024-09-12T18:35:47.365 INFO:teuthology.orchestra.run.smithi073.stdout: "attempts": 1, 2024-09-12T18:35:47.365 INFO:teuthology.orchestra.run.smithi073.stdout: "snapid": "head", 2024-09-12T18:35:47.366 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_context": "0=[]", 2024-09-12T18:35:47.366 INFO:teuthology.orchestra.run.smithi073.stdout: "mtime": "2024-09-12T18:35:47.354210+0000", 2024-09-12T18:35:47.366 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_ops": [ 2024-09-12T18:35:47.366 INFO:teuthology.orchestra.run.smithi073.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T18:35:47.366 INFO:teuthology.orchestra.run.smithi073.stdout: "write 0~65536 in=65536b" 2024-09-12T18:35:47.366 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:35:47.366 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:35:47.366 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:35:47.366 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 5582, 2024-09-12T18:35:47.366 INFO:teuthology.orchestra.run.smithi073.stdout: "pg": "5.c673b846", 2024-09-12T18:35:47.366 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-09-12T18:35:47.366 INFO:teuthology.orchestra.run.smithi073.stdout: "object_id": "benchmark_data_smithi073_23739_object5581", 2024-09-12T18:35:47.366 INFO:teuthology.orchestra.run.smithi073.stdout: "object_locator": "@5", 2024-09-12T18:35:47.367 INFO:teuthology.orchestra.run.smithi073.stdout: "target_object_id": "benchmark_data_smithi073_23739_object5581", 2024-09-12T18:35:47.367 INFO:teuthology.orchestra.run.smithi073.stdout: "target_object_locator": "@5", 2024-09-12T18:35:47.367 INFO:teuthology.orchestra.run.smithi073.stdout: "paused": 0, 2024-09-12T18:35:47.367 INFO:teuthology.orchestra.run.smithi073.stdout: "used_replica": 0, 2024-09-12T18:35:47.367 INFO:teuthology.orchestra.run.smithi073.stdout: "precalc_pgid": 0, 2024-09-12T18:35:47.367 INFO:teuthology.orchestra.run.smithi073.stdout: "last_sent": "710.943884s", 2024-09-12T18:35:47.367 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 0, 2024-09-12T18:35:47.367 INFO:teuthology.orchestra.run.smithi073.stdout: "attempts": 1, 2024-09-12T18:35:47.367 INFO:teuthology.orchestra.run.smithi073.stdout: "snapid": "head", 2024-09-12T18:35:47.367 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_context": "0=[]", 2024-09-12T18:35:47.367 INFO:teuthology.orchestra.run.smithi073.stdout: "mtime": "2024-09-12T18:35:47.354301+0000", 2024-09-12T18:35:47.367 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_ops": [ 2024-09-12T18:35:47.367 INFO:teuthology.orchestra.run.smithi073.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T18:35:47.368 INFO:teuthology.orchestra.run.smithi073.stdout: "write 0~65536 in=65536b" 2024-09-12T18:35:47.368 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:35:47.368 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:35:47.368 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:35:47.368 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 5585, 2024-09-12T18:35:47.368 INFO:teuthology.orchestra.run.smithi073.stdout: "pg": "5.6285908a", 2024-09-12T18:35:47.368 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-09-12T18:35:47.368 INFO:teuthology.orchestra.run.smithi073.stdout: "object_id": "benchmark_data_smithi073_23739_object5584", 2024-09-12T18:35:47.368 INFO:teuthology.orchestra.run.smithi073.stdout: "object_locator": "@5", 2024-09-12T18:35:47.368 INFO:teuthology.orchestra.run.smithi073.stdout: "target_object_id": "benchmark_data_smithi073_23739_object5584", 2024-09-12T18:35:47.368 INFO:teuthology.orchestra.run.smithi073.stdout: "target_object_locator": "@5", 2024-09-12T18:35:47.368 INFO:teuthology.orchestra.run.smithi073.stdout: "paused": 0, 2024-09-12T18:35:47.369 INFO:teuthology.orchestra.run.smithi073.stdout: "used_replica": 0, 2024-09-12T18:35:47.369 INFO:teuthology.orchestra.run.smithi073.stdout: "precalc_pgid": 0, 2024-09-12T18:35:47.369 INFO:teuthology.orchestra.run.smithi073.stdout: "last_sent": "710.943884s", 2024-09-12T18:35:47.369 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 0, 2024-09-12T18:35:47.369 INFO:teuthology.orchestra.run.smithi073.stdout: "attempts": 1, 2024-09-12T18:35:47.369 INFO:teuthology.orchestra.run.smithi073.stdout: "snapid": "head", 2024-09-12T18:35:47.369 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_context": "0=[]", 2024-09-12T18:35:47.369 INFO:teuthology.orchestra.run.smithi073.stdout: "mtime": "2024-09-12T18:35:47.354523+0000", 2024-09-12T18:35:47.369 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_ops": [ 2024-09-12T18:35:47.369 INFO:teuthology.orchestra.run.smithi073.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T18:35:47.369 INFO:teuthology.orchestra.run.smithi073.stdout: "write 0~65536 in=65536b" 2024-09-12T18:35:47.369 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:35:47.369 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:35:47.370 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:35:47.370 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 5587, 2024-09-12T18:35:47.370 INFO:teuthology.orchestra.run.smithi073.stdout: "pg": "5.eb4918cc", 2024-09-12T18:35:47.370 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-09-12T18:35:47.370 INFO:teuthology.orchestra.run.smithi073.stdout: "object_id": "benchmark_data_smithi073_23739_object5586", 2024-09-12T18:35:47.370 INFO:teuthology.orchestra.run.smithi073.stdout: "object_locator": "@5", 2024-09-12T18:35:47.370 INFO:teuthology.orchestra.run.smithi073.stdout: "target_object_id": "benchmark_data_smithi073_23739_object5586", 2024-09-12T18:35:47.370 INFO:teuthology.orchestra.run.smithi073.stdout: "target_object_locator": "@5", 2024-09-12T18:35:47.370 INFO:teuthology.orchestra.run.smithi073.stdout: "paused": 0, 2024-09-12T18:35:47.370 INFO:teuthology.orchestra.run.smithi073.stdout: "used_replica": 0, 2024-09-12T18:35:47.370 INFO:teuthology.orchestra.run.smithi073.stdout: "precalc_pgid": 0, 2024-09-12T18:35:47.370 INFO:teuthology.orchestra.run.smithi073.stdout: "last_sent": "710.943884s", 2024-09-12T18:35:47.370 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 0, 2024-09-12T18:35:47.371 INFO:teuthology.orchestra.run.smithi073.stdout: "attempts": 1, 2024-09-12T18:35:47.371 INFO:teuthology.orchestra.run.smithi073.stdout: "snapid": "head", 2024-09-12T18:35:47.371 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_context": "0=[]", 2024-09-12T18:35:47.371 INFO:teuthology.orchestra.run.smithi073.stdout: "mtime": "2024-09-12T18:35:47.356279+0000", 2024-09-12T18:35:47.371 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_ops": [ 2024-09-12T18:35:47.371 INFO:teuthology.orchestra.run.smithi073.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T18:35:47.371 INFO:teuthology.orchestra.run.smithi073.stdout: "write 0~65536 in=65536b" 2024-09-12T18:35:47.371 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:35:47.371 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:35:47.371 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:35:47.371 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 5590, 2024-09-12T18:35:47.371 INFO:teuthology.orchestra.run.smithi073.stdout: "pg": "5.ee01e486", 2024-09-12T18:35:47.371 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-09-12T18:35:47.372 INFO:teuthology.orchestra.run.smithi073.stdout: "object_id": "benchmark_data_smithi073_23739_object5589", 2024-09-12T18:35:47.372 INFO:teuthology.orchestra.run.smithi073.stdout: "object_locator": "@5", 2024-09-12T18:35:47.372 INFO:teuthology.orchestra.run.smithi073.stdout: "target_object_id": "benchmark_data_smithi073_23739_object5589", 2024-09-12T18:35:47.372 INFO:teuthology.orchestra.run.smithi073.stdout: "target_object_locator": "@5", 2024-09-12T18:35:47.372 INFO:teuthology.orchestra.run.smithi073.stdout: "paused": 0, 2024-09-12T18:35:47.372 INFO:teuthology.orchestra.run.smithi073.stdout: "used_replica": 0, 2024-09-12T18:35:47.372 INFO:teuthology.orchestra.run.smithi073.stdout: "precalc_pgid": 0, 2024-09-12T18:35:47.372 INFO:teuthology.orchestra.run.smithi073.stdout: "last_sent": "710.943884s", 2024-09-12T18:35:47.372 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 0, 2024-09-12T18:35:47.372 INFO:teuthology.orchestra.run.smithi073.stdout: "attempts": 1, 2024-09-12T18:35:47.372 INFO:teuthology.orchestra.run.smithi073.stdout: "snapid": "head", 2024-09-12T18:35:47.372 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_context": "0=[]", 2024-09-12T18:35:47.372 INFO:teuthology.orchestra.run.smithi073.stdout: "mtime": "2024-09-12T18:35:47.356876+0000", 2024-09-12T18:35:47.373 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_ops": [ 2024-09-12T18:35:47.373 INFO:teuthology.orchestra.run.smithi073.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T18:35:47.373 INFO:teuthology.orchestra.run.smithi073.stdout: "write 0~65536 in=65536b" 2024-09-12T18:35:47.373 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:35:47.373 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:35:47.373 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:35:47.373 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 5581, 2024-09-12T18:35:47.373 INFO:teuthology.orchestra.run.smithi073.stdout: "pg": "5.4b59921e", 2024-09-12T18:35:47.373 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-09-12T18:35:47.373 INFO:teuthology.orchestra.run.smithi073.stdout: "object_id": "benchmark_data_smithi073_23739_object5580", 2024-09-12T18:35:47.373 INFO:teuthology.orchestra.run.smithi073.stdout: "object_locator": "@5", 2024-09-12T18:35:47.373 INFO:teuthology.orchestra.run.smithi073.stdout: "target_object_id": "benchmark_data_smithi073_23739_object5580", 2024-09-12T18:35:47.373 INFO:teuthology.orchestra.run.smithi073.stdout: "target_object_locator": "@5", 2024-09-12T18:35:47.374 INFO:teuthology.orchestra.run.smithi073.stdout: "paused": 0, 2024-09-12T18:35:47.374 INFO:teuthology.orchestra.run.smithi073.stdout: "used_replica": 0, 2024-09-12T18:35:47.374 INFO:teuthology.orchestra.run.smithi073.stdout: "precalc_pgid": 0, 2024-09-12T18:35:47.374 INFO:teuthology.orchestra.run.smithi073.stdout: "last_sent": "710.943884s", 2024-09-12T18:35:47.374 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 0, 2024-09-12T18:35:47.374 INFO:teuthology.orchestra.run.smithi073.stdout: "attempts": 1, 2024-09-12T18:35:47.374 INFO:teuthology.orchestra.run.smithi073.stdout: "snapid": "head", 2024-09-12T18:35:47.374 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_context": "0=[]", 2024-09-12T18:35:47.374 INFO:teuthology.orchestra.run.smithi073.stdout: "mtime": "2024-09-12T18:35:47.354227+0000", 2024-09-12T18:35:47.374 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_ops": [ 2024-09-12T18:35:47.374 INFO:teuthology.orchestra.run.smithi073.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T18:35:47.374 INFO:teuthology.orchestra.run.smithi073.stdout: "write 0~65536 in=65536b" 2024-09-12T18:35:47.374 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:35:47.375 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:35:47.375 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:35:47.375 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 5586, 2024-09-12T18:35:47.375 INFO:teuthology.orchestra.run.smithi073.stdout: "pg": "5.701c3998", 2024-09-12T18:35:47.375 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-09-12T18:35:47.375 INFO:teuthology.orchestra.run.smithi073.stdout: "object_id": "benchmark_data_smithi073_23739_object5585", 2024-09-12T18:35:47.375 INFO:teuthology.orchestra.run.smithi073.stdout: "object_locator": "@5", 2024-09-12T18:35:47.375 INFO:teuthology.orchestra.run.smithi073.stdout: "target_object_id": "benchmark_data_smithi073_23739_object5585", 2024-09-12T18:35:47.375 INFO:teuthology.orchestra.run.smithi073.stdout: "target_object_locator": "@5", 2024-09-12T18:35:47.375 INFO:teuthology.orchestra.run.smithi073.stdout: "paused": 0, 2024-09-12T18:35:47.375 INFO:teuthology.orchestra.run.smithi073.stdout: "used_replica": 0, 2024-09-12T18:35:47.375 INFO:teuthology.orchestra.run.smithi073.stdout: "precalc_pgid": 0, 2024-09-12T18:35:47.375 INFO:teuthology.orchestra.run.smithi073.stdout: "last_sent": "710.943884s", 2024-09-12T18:35:47.375 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 0, 2024-09-12T18:35:47.376 INFO:teuthology.orchestra.run.smithi073.stdout: "attempts": 1, 2024-09-12T18:35:47.376 INFO:teuthology.orchestra.run.smithi073.stdout: "snapid": "head", 2024-09-12T18:35:47.376 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_context": "0=[]", 2024-09-12T18:35:47.376 INFO:teuthology.orchestra.run.smithi073.stdout: "mtime": "2024-09-12T18:35:47.355254+0000", 2024-09-12T18:35:47.376 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_ops": [ 2024-09-12T18:35:47.376 INFO:teuthology.orchestra.run.smithi073.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T18:35:47.376 INFO:teuthology.orchestra.run.smithi073.stdout: "write 0~65536 in=65536b" 2024-09-12T18:35:47.376 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:35:47.376 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:35:47.376 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:35:47.376 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 5589, 2024-09-12T18:35:47.376 INFO:teuthology.orchestra.run.smithi073.stdout: "pg": "5.eb164d20", 2024-09-12T18:35:47.376 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-09-12T18:35:47.377 INFO:teuthology.orchestra.run.smithi073.stdout: "object_id": "benchmark_data_smithi073_23739_object5588", 2024-09-12T18:35:47.377 INFO:teuthology.orchestra.run.smithi073.stdout: "object_locator": "@5", 2024-09-12T18:35:47.377 INFO:teuthology.orchestra.run.smithi073.stdout: "target_object_id": "benchmark_data_smithi073_23739_object5588", 2024-09-12T18:35:47.377 INFO:teuthology.orchestra.run.smithi073.stdout: "target_object_locator": "@5", 2024-09-12T18:35:47.377 INFO:teuthology.orchestra.run.smithi073.stdout: "paused": 0, 2024-09-12T18:35:47.377 INFO:teuthology.orchestra.run.smithi073.stdout: "used_replica": 0, 2024-09-12T18:35:47.377 INFO:teuthology.orchestra.run.smithi073.stdout: "precalc_pgid": 0, 2024-09-12T18:35:47.377 INFO:teuthology.orchestra.run.smithi073.stdout: "last_sent": "710.943884s", 2024-09-12T18:35:47.377 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 0, 2024-09-12T18:35:47.377 INFO:teuthology.orchestra.run.smithi073.stdout: "attempts": 1, 2024-09-12T18:35:47.377 INFO:teuthology.orchestra.run.smithi073.stdout: "snapid": "head", 2024-09-12T18:35:47.377 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_context": "0=[]", 2024-09-12T18:35:47.377 INFO:teuthology.orchestra.run.smithi073.stdout: "mtime": "2024-09-12T18:35:47.356848+0000", 2024-09-12T18:35:47.378 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_ops": [ 2024-09-12T18:35:47.378 INFO:teuthology.orchestra.run.smithi073.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T18:35:47.378 INFO:teuthology.orchestra.run.smithi073.stdout: "write 0~65536 in=65536b" 2024-09-12T18:35:47.378 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:35:47.378 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:35:47.378 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:35:47.378 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 5591, 2024-09-12T18:35:47.378 INFO:teuthology.orchestra.run.smithi073.stdout: "pg": "5.69939420", 2024-09-12T18:35:47.378 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-09-12T18:35:47.378 INFO:teuthology.orchestra.run.smithi073.stdout: "object_id": "benchmark_data_smithi073_23739_object5590", 2024-09-12T18:35:47.378 INFO:teuthology.orchestra.run.smithi073.stdout: "object_locator": "@5", 2024-09-12T18:35:47.378 INFO:teuthology.orchestra.run.smithi073.stdout: "target_object_id": "benchmark_data_smithi073_23739_object5590", 2024-09-12T18:35:47.378 INFO:teuthology.orchestra.run.smithi073.stdout: "target_object_locator": "@5", 2024-09-12T18:35:47.378 INFO:teuthology.orchestra.run.smithi073.stdout: "paused": 0, 2024-09-12T18:35:47.379 INFO:teuthology.orchestra.run.smithi073.stdout: "used_replica": 0, 2024-09-12T18:35:47.379 INFO:teuthology.orchestra.run.smithi073.stdout: "precalc_pgid": 0, 2024-09-12T18:35:47.379 INFO:teuthology.orchestra.run.smithi073.stdout: "last_sent": "710.943884s", 2024-09-12T18:35:47.379 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 0, 2024-09-12T18:35:47.379 INFO:teuthology.orchestra.run.smithi073.stdout: "attempts": 1, 2024-09-12T18:35:47.379 INFO:teuthology.orchestra.run.smithi073.stdout: "snapid": "head", 2024-09-12T18:35:47.379 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_context": "0=[]", 2024-09-12T18:35:47.379 INFO:teuthology.orchestra.run.smithi073.stdout: "mtime": "2024-09-12T18:35:47.356894+0000", 2024-09-12T18:35:47.379 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_ops": [ 2024-09-12T18:35:47.379 INFO:teuthology.orchestra.run.smithi073.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T18:35:47.379 INFO:teuthology.orchestra.run.smithi073.stdout: "write 0~65536 in=65536b" 2024-09-12T18:35:47.379 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:35:47.380 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:35:47.380 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:35:47.380 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 5592, 2024-09-12T18:35:47.380 INFO:teuthology.orchestra.run.smithi073.stdout: "pg": "5.dea11550", 2024-09-12T18:35:47.380 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-09-12T18:35:47.380 INFO:teuthology.orchestra.run.smithi073.stdout: "object_id": "benchmark_data_smithi073_23739_object5591", 2024-09-12T18:35:47.380 INFO:teuthology.orchestra.run.smithi073.stdout: "object_locator": "@5", 2024-09-12T18:35:47.380 INFO:teuthology.orchestra.run.smithi073.stdout: "target_object_id": "benchmark_data_smithi073_23739_object5591", 2024-09-12T18:35:47.380 INFO:teuthology.orchestra.run.smithi073.stdout: "target_object_locator": "@5", 2024-09-12T18:35:47.380 INFO:teuthology.orchestra.run.smithi073.stdout: "paused": 0, 2024-09-12T18:35:47.380 INFO:teuthology.orchestra.run.smithi073.stdout: "used_replica": 0, 2024-09-12T18:35:47.380 INFO:teuthology.orchestra.run.smithi073.stdout: "precalc_pgid": 0, 2024-09-12T18:35:47.380 INFO:teuthology.orchestra.run.smithi073.stdout: "last_sent": "710.943884s", 2024-09-12T18:35:47.380 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 0, 2024-09-12T18:35:47.381 INFO:teuthology.orchestra.run.smithi073.stdout: "attempts": 1, 2024-09-12T18:35:47.381 INFO:teuthology.orchestra.run.smithi073.stdout: "snapid": "head", 2024-09-12T18:35:47.381 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_context": "0=[]", 2024-09-12T18:35:47.381 INFO:teuthology.orchestra.run.smithi073.stdout: "mtime": "2024-09-12T18:35:47.356909+0000", 2024-09-12T18:35:47.381 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_ops": [ 2024-09-12T18:35:47.381 INFO:teuthology.orchestra.run.smithi073.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T18:35:47.381 INFO:teuthology.orchestra.run.smithi073.stdout: "write 0~65536 in=65536b" 2024-09-12T18:35:47.381 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:35:47.381 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:35:47.381 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:35:47.381 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 5588, 2024-09-12T18:35:47.381 INFO:teuthology.orchestra.run.smithi073.stdout: "pg": "5.359df10f", 2024-09-12T18:35:47.381 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2024-09-12T18:35:47.382 INFO:teuthology.orchestra.run.smithi073.stdout: "object_id": "benchmark_data_smithi073_23739_object5587", 2024-09-12T18:35:47.382 INFO:teuthology.orchestra.run.smithi073.stdout: "object_locator": "@5", 2024-09-12T18:35:47.382 INFO:teuthology.orchestra.run.smithi073.stdout: "target_object_id": "benchmark_data_smithi073_23739_object5587", 2024-09-12T18:35:47.382 INFO:teuthology.orchestra.run.smithi073.stdout: "target_object_locator": "@5", 2024-09-12T18:35:47.382 INFO:teuthology.orchestra.run.smithi073.stdout: "paused": 0, 2024-09-12T18:35:47.382 INFO:teuthology.orchestra.run.smithi073.stdout: "used_replica": 0, 2024-09-12T18:35:47.382 INFO:teuthology.orchestra.run.smithi073.stdout: "precalc_pgid": 0, 2024-09-12T18:35:47.382 INFO:teuthology.orchestra.run.smithi073.stdout: "last_sent": "710.943884s", 2024-09-12T18:35:47.382 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 0, 2024-09-12T18:35:47.382 INFO:teuthology.orchestra.run.smithi073.stdout: "attempts": 1, 2024-09-12T18:35:47.382 INFO:teuthology.orchestra.run.smithi073.stdout: "snapid": "head", 2024-09-12T18:35:47.383 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_context": "0=[]", 2024-09-12T18:35:47.383 INFO:teuthology.orchestra.run.smithi073.stdout: "mtime": "2024-09-12T18:35:47.356330+0000", 2024-09-12T18:35:47.383 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_ops": [ 2024-09-12T18:35:47.383 INFO:teuthology.orchestra.run.smithi073.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T18:35:47.383 INFO:teuthology.orchestra.run.smithi073.stdout: "write 0~65536 in=65536b" 2024-09-12T18:35:47.383 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:35:47.383 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:35:47.383 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:35:47.383 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 5593, 2024-09-12T18:35:47.383 INFO:teuthology.orchestra.run.smithi073.stdout: "pg": "5.c803ae37", 2024-09-12T18:35:47.383 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2024-09-12T18:35:47.383 INFO:teuthology.orchestra.run.smithi073.stdout: "object_id": "benchmark_data_smithi073_23739_object5592", 2024-09-12T18:35:47.383 INFO:teuthology.orchestra.run.smithi073.stdout: "object_locator": "@5", 2024-09-12T18:35:47.384 INFO:teuthology.orchestra.run.smithi073.stdout: "target_object_id": "benchmark_data_smithi073_23739_object5592", 2024-09-12T18:35:47.384 INFO:teuthology.orchestra.run.smithi073.stdout: "target_object_locator": "@5", 2024-09-12T18:35:47.384 INFO:teuthology.orchestra.run.smithi073.stdout: "paused": 0, 2024-09-12T18:35:47.384 INFO:teuthology.orchestra.run.smithi073.stdout: "used_replica": 0, 2024-09-12T18:35:47.384 INFO:teuthology.orchestra.run.smithi073.stdout: "precalc_pgid": 0, 2024-09-12T18:35:47.384 INFO:teuthology.orchestra.run.smithi073.stdout: "last_sent": "710.943884s", 2024-09-12T18:35:47.384 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 0, 2024-09-12T18:35:47.384 INFO:teuthology.orchestra.run.smithi073.stdout: "attempts": 1, 2024-09-12T18:35:47.384 INFO:teuthology.orchestra.run.smithi073.stdout: "snapid": "head", 2024-09-12T18:35:47.384 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_context": "0=[]", 2024-09-12T18:35:47.384 INFO:teuthology.orchestra.run.smithi073.stdout: "mtime": "2024-09-12T18:35:47.356926+0000", 2024-09-12T18:35:47.384 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_ops": [ 2024-09-12T18:35:47.385 INFO:teuthology.orchestra.run.smithi073.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T18:35:47.385 INFO:teuthology.orchestra.run.smithi073.stdout: "write 0~65536 in=65536b" 2024-09-12T18:35:47.385 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:35:47.385 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:35:47.385 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:35:47.385 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 5595, 2024-09-12T18:35:47.385 INFO:teuthology.orchestra.run.smithi073.stdout: "pg": "5.cad77349", 2024-09-12T18:35:47.385 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2024-09-12T18:35:47.385 INFO:teuthology.orchestra.run.smithi073.stdout: "object_id": "benchmark_data_smithi073_23739_object5594", 2024-09-12T18:35:47.385 INFO:teuthology.orchestra.run.smithi073.stdout: "object_locator": "@5", 2024-09-12T18:35:47.385 INFO:teuthology.orchestra.run.smithi073.stdout: "target_object_id": "benchmark_data_smithi073_23739_object5594", 2024-09-12T18:35:47.385 INFO:teuthology.orchestra.run.smithi073.stdout: "target_object_locator": "@5", 2024-09-12T18:35:47.385 INFO:teuthology.orchestra.run.smithi073.stdout: "paused": 0, 2024-09-12T18:35:47.386 INFO:teuthology.orchestra.run.smithi073.stdout: "used_replica": 0, 2024-09-12T18:35:47.386 INFO:teuthology.orchestra.run.smithi073.stdout: "precalc_pgid": 0, 2024-09-12T18:35:47.386 INFO:teuthology.orchestra.run.smithi073.stdout: "last_sent": "710.943884s", 2024-09-12T18:35:47.386 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 0, 2024-09-12T18:35:47.386 INFO:teuthology.orchestra.run.smithi073.stdout: "attempts": 1, 2024-09-12T18:35:47.386 INFO:teuthology.orchestra.run.smithi073.stdout: "snapid": "head", 2024-09-12T18:35:47.386 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_context": "0=[]", 2024-09-12T18:35:47.386 INFO:teuthology.orchestra.run.smithi073.stdout: "mtime": "2024-09-12T18:35:47.357349+0000", 2024-09-12T18:35:47.386 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_ops": [ 2024-09-12T18:35:47.386 INFO:teuthology.orchestra.run.smithi073.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T18:35:47.386 INFO:teuthology.orchestra.run.smithi073.stdout: "write 0~65536 in=65536b" 2024-09-12T18:35:47.386 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:35:47.386 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:35:47.386 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T18:35:47.387 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_ops": [], 2024-09-12T18:35:47.387 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_ops": [], 2024-09-12T18:35:47.387 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_stat_ops": [], 2024-09-12T18:35:47.387 INFO:teuthology.orchestra.run.smithi073.stdout: "statfs_ops": [], 2024-09-12T18:35:47.387 INFO:teuthology.orchestra.run.smithi073.stdout: "command_ops": [] 2024-09-12T18:35:47.387 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T18:35:47.388 DEBUG:tasks.admin_socket:admin socket command objecter_requests returned { "ops": [ { "tid": 5576, "pg": "5.8d53aa6c", "osd": 0, "object_id": "benchmark_data_smithi073_23739_object5575", "object_locator": "@5", "target_object_id": "benchmark_data_smithi073_23739_object5575", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "710.939884s", "age": 0.003999964, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T18:35:47.353782+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5579, "pg": "5.1de040f3", "osd": 0, "object_id": "benchmark_data_smithi073_23739_object5578", "object_locator": "@5", "target_object_id": "benchmark_data_smithi073_23739_object5578", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "710.943884s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T18:35:47.354176+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5580, "pg": "5.1aff951c", "osd": 0, "object_id": "benchmark_data_smithi073_23739_object5579", "object_locator": "@5", "target_object_id": "benchmark_data_smithi073_23739_object5579", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "710.943884s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T18:35:47.354210+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5582, "pg": "5.c673b846", "osd": 0, "object_id": "benchmark_data_smithi073_23739_object5581", "object_locator": "@5", "target_object_id": "benchmark_data_smithi073_23739_object5581", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "710.943884s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T18:35:47.354301+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5585, "pg": "5.6285908a", "osd": 0, "object_id": "benchmark_data_smithi073_23739_object5584", "object_locator": "@5", "target_object_id": "benchmark_data_smithi073_23739_object5584", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "710.943884s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T18:35:47.354523+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5587, "pg": "5.eb4918cc", "osd": 0, "object_id": "benchmark_data_smithi073_23739_object5586", "object_locator": "@5", "target_object_id": "benchmark_data_smithi073_23739_object5586", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "710.943884s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T18:35:47.356279+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5590, "pg": "5.ee01e486", "osd": 0, "object_id": "benchmark_data_smithi073_23739_object5589", "object_locator": "@5", "target_object_id": "benchmark_data_smithi073_23739_object5589", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "710.943884s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T18:35:47.356876+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5581, "pg": "5.4b59921e", "osd": 1, "object_id": "benchmark_data_smithi073_23739_object5580", "object_locator": "@5", "target_object_id": "benchmark_data_smithi073_23739_object5580", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "710.943884s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T18:35:47.354227+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5586, "pg": "5.701c3998", "osd": 1, "object_id": "benchmark_data_smithi073_23739_object5585", "object_locator": "@5", "target_object_id": "benchmark_data_smithi073_23739_object5585", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "710.943884s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T18:35:47.355254+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5589, "pg": "5.eb164d20", "osd": 1, "object_id": "benchmark_data_smithi073_23739_object5588", "object_locator": "@5", "target_object_id": "benchmark_data_smithi073_23739_object5588", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "710.943884s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T18:35:47.356848+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5591, "pg": "5.69939420", "osd": 1, "object_id": "benchmark_data_smithi073_23739_object5590", "object_locator": "@5", "target_object_id": "benchmark_data_smithi073_23739_object5590", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "710.943884s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T18:35:47.356894+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5592, "pg": "5.dea11550", "osd": 1, "object_id": "benchmark_data_smithi073_23739_object5591", "object_locator": "@5", "target_object_id": "benchmark_data_smithi073_23739_object5591", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "710.943884s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T18:35:47.356909+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5588, "pg": "5.359df10f", "osd": 2, "object_id": "benchmark_data_smithi073_23739_object5587", "object_locator": "@5", "target_object_id": "benchmark_data_smithi073_23739_object5587", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "710.943884s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T18:35:47.356330+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5593, "pg": "5.c803ae37", "osd": 2, "object_id": "benchmark_data_smithi073_23739_object5592", "object_locator": "@5", "target_object_id": "benchmark_data_smithi073_23739_object5592", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "710.943884s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T18:35:47.356926+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5595, "pg": "5.cad77349", "osd": 2, "object_id": "benchmark_data_smithi073_23739_object5594", "object_locator": "@5", "target_object_id": "benchmark_data_smithi073_23739_object5594", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "710.943884s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T18:35:47.357349+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] } ], "linger_ops": [], "pool_ops": [], "pool_stat_ops": [], "statfs_ops": [], "command_ops": [] } 2024-09-12T18:35:47.389 DEBUG:teuthology.orchestra.run.smithi073:> /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests 2024-09-12T18:35:47.389 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:47.382+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:47.424 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf -- /home/ubuntu/cephtest/admin_socket_client.0 2024-09-12T18:35:47.462 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:35:47.462 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-09-12T18:35:47.462 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-09-12T18:35:47.462 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:35:47.462 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.462 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:47.462 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:35:47.463 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 21.829511146000002, 2024-09-12T18:35:47.463 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025088781000000001, 2024-09-12T18:35:47.463 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:47.463 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:47.463 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:47.463 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:47.463 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.463 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:47.463 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:35:47.463 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.463 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.463 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.463 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:47.464 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:35:47.464 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.464 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.464 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.464 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:47.464 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632518+0000", 2024-09-12T18:35:47.464 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:35:47.464 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.464 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.464 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:47.465 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632533+0000", 2024-09-12T18:35:47.465 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5130000000000001e-05 2024-09-12T18:35:47.465 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.465 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.465 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:47.465 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632564+0000", 2024-09-12T18:35:47.465 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0788999999999999e-05 2024-09-12T18:35:47.465 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.465 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.465 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:47.465 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632590+0000", 2024-09-12T18:35:47.465 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6057000000000001e-05 2024-09-12T18:35:47.466 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.466 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.466 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:47.466 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.635931+0000", 2024-09-12T18:35:47.466 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033411320000000001 2024-09-12T18:35:47.466 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.466 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.466 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:47.466 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636186+0000", 2024-09-12T18:35:47.466 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025452500000000002 2024-09-12T18:35:47.466 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.466 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.467 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:47.467 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636445+0000", 2024-09-12T18:35:47.467 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000259268 2024-09-12T18:35:47.467 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.467 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.467 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:47.467 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639562+0000", 2024-09-12T18:35:47.467 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031167 2024-09-12T18:35:47.467 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.467 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.467 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:47.467 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657314+0000", 2024-09-12T18:35:47.467 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017752562 2024-09-12T18:35:47.468 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.468 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.468 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:47.468 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657445+0000", 2024-09-12T18:35:47.468 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013105899999999999 2024-09-12T18:35:47.468 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.468 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.468 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:47.468 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657598+0000", 2024-09-12T18:35:47.468 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015247899999999999 2024-09-12T18:35:47.468 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.468 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:47.469 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.469 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.469 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.469 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:47.469 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:35:47.469 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 21.829384943000001, 2024-09-12T18:35:47.469 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025643131999999999, 2024-09-12T18:35:47.469 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:47.469 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:47.469 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:47.469 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:47.470 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.470 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:47.470 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:35:47.470 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.470 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.470 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.470 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:47.470 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:35:47.470 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.471 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.471 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.471 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:47.471 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632637+0000", 2024-09-12T18:35:47.471 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5600000000000001e-06 2024-09-12T18:35:47.471 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.471 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.471 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:47.472 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632650+0000", 2024-09-12T18:35:47.472 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3186e-05 2024-09-12T18:35:47.472 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.472 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.472 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:47.472 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632672+0000", 2024-09-12T18:35:47.472 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2013000000000001e-05 2024-09-12T18:35:47.473 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.473 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.473 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:47.473 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632687+0000", 2024-09-12T18:35:47.473 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5109999999999999e-05 2024-09-12T18:35:47.473 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.473 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.473 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:47.473 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636994+0000", 2024-09-12T18:35:47.473 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0043065539999999998 2024-09-12T18:35:47.473 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.473 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.473 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:47.474 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637198+0000", 2024-09-12T18:35:47.474 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020387199999999999 2024-09-12T18:35:47.474 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.474 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.474 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:47.474 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637475+0000", 2024-09-12T18:35:47.474 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027731000000000001 2024-09-12T18:35:47.474 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.474 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.474 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:47.474 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639574+0000", 2024-09-12T18:35:47.474 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020988999999999999 2024-09-12T18:35:47.474 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.474 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.475 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:47.475 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658057+0000", 2024-09-12T18:35:47.475 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018482926 2024-09-12T18:35:47.475 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.475 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.475 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:47.475 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658184+0000", 2024-09-12T18:35:47.475 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012756200000000001 2024-09-12T18:35:47.475 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.475 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.475 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:47.475 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658278+0000", 2024-09-12T18:35:47.476 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4139000000000001e-05 2024-09-12T18:35:47.476 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.476 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:47.476 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.476 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.476 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.476 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:47.476 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:35:47.476 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 21.829309851000001, 2024-09-12T18:35:47.476 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025238883, 2024-09-12T18:35:47.477 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:47.477 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:47.477 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:47.477 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:47.477 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.477 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:47.477 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:35:47.477 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.477 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.477 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.477 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:47.477 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:35:47.478 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.478 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.478 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.478 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:47.478 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632712+0000", 2024-09-12T18:35:47.478 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6869999999999999e-06 2024-09-12T18:35:47.478 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.478 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.478 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:47.478 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632719+0000", 2024-09-12T18:35:47.478 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6059999999999999e-06 2024-09-12T18:35:47.478 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.478 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.478 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:47.479 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632737+0000", 2024-09-12T18:35:47.479 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7983999999999999e-05 2024-09-12T18:35:47.479 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.479 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.479 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:47.479 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632751+0000", 2024-09-12T18:35:47.479 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4473e-05 2024-09-12T18:35:47.479 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.479 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.479 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:47.479 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636961+0000", 2024-09-12T18:35:47.479 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042100840000000002 2024-09-12T18:35:47.480 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.480 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.480 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:47.480 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637211+0000", 2024-09-12T18:35:47.480 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000249738 2024-09-12T18:35:47.480 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.480 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.480 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:47.480 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637504+0000", 2024-09-12T18:35:47.480 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00029271499999999998 2024-09-12T18:35:47.480 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.480 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.481 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:47.481 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639582+0000", 2024-09-12T18:35:47.481 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020783389999999998 2024-09-12T18:35:47.481 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.481 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.481 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:47.481 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657709+0000", 2024-09-12T18:35:47.481 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018126758999999999 2024-09-12T18:35:47.481 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.481 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.481 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:47.481 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657830+0000", 2024-09-12T18:35:47.481 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000121329 2024-09-12T18:35:47.482 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.482 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.482 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:47.482 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657949+0000", 2024-09-12T18:35:47.482 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000119169 2024-09-12T18:35:47.482 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.482 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:47.482 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.482 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.482 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.482 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:47.483 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:35:47.483 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 21.829245804999999, 2024-09-12T18:35:47.483 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026711823999999999, 2024-09-12T18:35:47.483 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:47.483 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:47.483 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:47.483 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:47.483 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.483 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:47.483 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:35:47.483 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.483 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.483 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.484 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:47.484 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:35:47.484 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.484 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.484 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.484 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:47.484 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632775+0000", 2024-09-12T18:35:47.484 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9999999999999995e-07 2024-09-12T18:35:47.484 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.484 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.484 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:47.484 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632788+0000", 2024-09-12T18:35:47.485 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2629999999999999e-05 2024-09-12T18:35:47.485 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.485 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.485 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:47.485 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632806+0000", 2024-09-12T18:35:47.485 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:35:47.485 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.485 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.485 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:47.485 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632820+0000", 2024-09-12T18:35:47.485 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3777e-05 2024-09-12T18:35:47.485 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.485 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.485 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:47.486 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638310+0000", 2024-09-12T18:35:47.486 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054898280000000004 2024-09-12T18:35:47.486 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.486 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.486 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:47.486 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638480+0000", 2024-09-12T18:35:47.486 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016968199999999999 2024-09-12T18:35:47.486 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.486 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.486 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:47.486 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638799+0000", 2024-09-12T18:35:47.486 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031915999999999997 2024-09-12T18:35:47.486 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.487 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.487 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:47.487 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639866+0000", 2024-09-12T18:35:47.487 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001067405 2024-09-12T18:35:47.487 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.487 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.487 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:47.487 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658398+0000", 2024-09-12T18:35:47.487 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018531542000000002 2024-09-12T18:35:47.487 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.487 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.487 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:47.488 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658643+0000", 2024-09-12T18:35:47.488 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00024531500000000002 2024-09-12T18:35:47.488 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.488 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.488 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:47.488 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.659486+0000", 2024-09-12T18:35:47.488 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00084316899999999995 2024-09-12T18:35:47.488 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.488 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:47.488 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.488 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.488 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.489 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:47.489 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632845+0000", 2024-09-12T18:35:47.489 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 21.829174778999999, 2024-09-12T18:35:47.489 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015333398999999999, 2024-09-12T18:35:47.489 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:47.489 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:47.489 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:47.489 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:47.489 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.489 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:47.489 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632845+0000", 2024-09-12T18:35:47.489 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.490 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.490 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.490 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:47.490 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632845+0000", 2024-09-12T18:35:47.490 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.490 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.490 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.490 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:47.490 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632847+0000", 2024-09-12T18:35:47.490 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.407e-06 2024-09-12T18:35:47.490 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.491 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.491 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:47.491 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632854+0000", 2024-09-12T18:35:47.491 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1670000000000002e-06 2024-09-12T18:35:47.491 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.491 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.491 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:47.491 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632877+0000", 2024-09-12T18:35:47.491 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2929e-05 2024-09-12T18:35:47.491 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.491 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.491 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:47.491 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632891+0000", 2024-09-12T18:35:47.492 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3689999999999999e-05 2024-09-12T18:35:47.492 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.492 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.492 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:47.492 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.634571+0000", 2024-09-12T18:35:47.492 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016800929999999999 2024-09-12T18:35:47.492 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.492 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.492 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:47.492 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.635247+0000", 2024-09-12T18:35:47.492 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000676051 2024-09-12T18:35:47.492 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.493 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.493 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:47.493 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636176+0000", 2024-09-12T18:35:47.493 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00092889199999999996 2024-09-12T18:35:47.493 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.493 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.493 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:47.493 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637978+0000", 2024-09-12T18:35:47.493 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018024320000000001 2024-09-12T18:35:47.493 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.493 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.493 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:47.493 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.647862+0000", 2024-09-12T18:35:47.493 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0098842540000000003 2024-09-12T18:35:47.494 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.494 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.494 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:47.494 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.648055+0000", 2024-09-12T18:35:47.494 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00019265499999999999 2024-09-12T18:35:47.494 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.494 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.494 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:47.494 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.648179+0000", 2024-09-12T18:35:47.494 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000123829 2024-09-12T18:35:47.494 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.494 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:47.495 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.495 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.495 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.495 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:47.495 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:35:47.495 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 21.829018742999999, 2024-09-12T18:35:47.495 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.021357139000000001, 2024-09-12T18:35:47.495 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:47.495 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:47.495 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:47.495 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:47.495 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.495 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:47.496 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:35:47.496 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.496 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.496 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.496 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:47.496 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:35:47.496 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.496 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.496 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.496 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:47.496 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633003+0000", 2024-09-12T18:35:47.496 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.53e-06 2024-09-12T18:35:47.496 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.497 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.497 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:47.497 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633012+0000", 2024-09-12T18:35:47.497 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9290000000000004e-06 2024-09-12T18:35:47.497 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.497 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.497 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:47.497 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633034+0000", 2024-09-12T18:35:47.497 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2127e-05 2024-09-12T18:35:47.497 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.497 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.497 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:47.497 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633054+0000", 2024-09-12T18:35:47.498 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9476000000000001e-05 2024-09-12T18:35:47.498 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.498 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.498 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:47.498 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636657+0000", 2024-09-12T18:35:47.498 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036038839999999999 2024-09-12T18:35:47.499 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.499 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.499 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:47.499 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636885+0000", 2024-09-12T18:35:47.499 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022798800000000001 2024-09-12T18:35:47.499 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.499 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.499 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:47.499 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637189+0000", 2024-09-12T18:35:47.499 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030392100000000002 2024-09-12T18:35:47.499 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.500 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.500 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:47.500 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639271+0000", 2024-09-12T18:35:47.500 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020817460000000002 2024-09-12T18:35:47.500 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.500 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.500 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:47.500 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.652371+0000", 2024-09-12T18:35:47.500 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013099417 2024-09-12T18:35:47.500 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.500 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.500 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:47.500 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654255+0000", 2024-09-12T18:35:47.501 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018846049999999999 2024-09-12T18:35:47.501 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.501 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.501 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:47.501 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654359+0000", 2024-09-12T18:35:47.501 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000103516 2024-09-12T18:35:47.501 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.501 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:47.502 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.502 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.502 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.502 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:47.502 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:35:47.502 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 21.828937051, 2024-09-12T18:35:47.502 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026938645000000001, 2024-09-12T18:35:47.502 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:47.502 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:47.502 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:47.502 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:47.502 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.502 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:47.502 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:35:47.503 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.503 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.503 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.503 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:47.503 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:35:47.503 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.503 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.503 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.503 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:47.503 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633085+0000", 2024-09-12T18:35:47.504 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:35:47.504 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.504 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.504 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:47.504 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633093+0000", 2024-09-12T18:35:47.504 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3999999999999992e-06 2024-09-12T18:35:47.504 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.504 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.504 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:47.504 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633111+0000", 2024-09-12T18:35:47.504 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8070000000000001e-05 2024-09-12T18:35:47.504 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.505 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.505 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:47.505 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633126+0000", 2024-09-12T18:35:47.505 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4487e-05 2024-09-12T18:35:47.505 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.505 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.505 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:47.505 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638290+0000", 2024-09-12T18:35:47.505 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0051640269999999999 2024-09-12T18:35:47.505 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.505 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.506 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:47.506 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638547+0000", 2024-09-12T18:35:47.506 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025714100000000001 2024-09-12T18:35:47.506 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.506 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.506 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:47.506 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638850+0000", 2024-09-12T18:35:47.506 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030278400000000001 2024-09-12T18:35:47.506 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.506 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.506 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:47.506 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.640706+0000", 2024-09-12T18:35:47.506 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018564580000000001 2024-09-12T18:35:47.506 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.507 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.507 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:47.507 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658420+0000", 2024-09-12T18:35:47.507 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017714395000000001 2024-09-12T18:35:47.507 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.507 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.507 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:47.507 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658635+0000", 2024-09-12T18:35:47.507 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021413500000000001 2024-09-12T18:35:47.507 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.507 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.507 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:47.508 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.660022+0000", 2024-09-12T18:35:47.508 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001387318 2024-09-12T18:35:47.508 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.508 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:47.508 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.508 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.508 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.508 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:47.508 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633323+0000", 2024-09-12T18:35:47.508 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 21.828697695999999, 2024-09-12T18:35:47.509 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015717332000000001, 2024-09-12T18:35:47.509 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:47.509 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:47.509 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:35:47.509 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:47.509 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.509 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:47.509 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633323+0000", 2024-09-12T18:35:47.509 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.509 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.509 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.509 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:47.509 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633323+0000", 2024-09-12T18:35:47.509 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.510 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.510 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.510 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:47.510 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633324+0000", 2024-09-12T18:35:47.510 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7230000000000001e-06 2024-09-12T18:35:47.510 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.510 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.510 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:47.510 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633351+0000", 2024-09-12T18:35:47.510 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7067e-05 2024-09-12T18:35:47.510 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.510 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.511 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:47.511 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633372+0000", 2024-09-12T18:35:47.511 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0429e-05 2024-09-12T18:35:47.511 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.511 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.511 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:47.511 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633387+0000", 2024-09-12T18:35:47.511 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5659999999999999e-05 2024-09-12T18:35:47.511 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.511 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.511 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:47.511 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633527+0000", 2024-09-12T18:35:47.511 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013991599999999999 2024-09-12T18:35:47.511 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.512 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.512 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:47.512 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633806+0000", 2024-09-12T18:35:47.512 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027858400000000001 2024-09-12T18:35:47.512 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.512 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.512 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:47.512 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.649040+0000", 2024-09-12T18:35:47.512 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015233953 2024-09-12T18:35:47.512 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.512 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:47.512 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.512 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.513 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.513 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:47.513 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:35:47.513 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 21.828592539999999, 2024-09-12T18:35:47.513 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.020709867, 2024-09-12T18:35:47.513 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:47.513 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:47.513 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:35:47.513 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:47.513 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.513 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:47.513 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:35:47.513 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.514 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.514 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.514 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:47.514 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:35:47.514 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.514 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.514 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.514 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:47.514 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633429+0000", 2024-09-12T18:35:47.514 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.313e-06 2024-09-12T18:35:47.514 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.514 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.515 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:47.515 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633462+0000", 2024-09-12T18:35:47.515 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3197000000000001e-05 2024-09-12T18:35:47.515 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.515 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.515 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:47.515 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633485+0000", 2024-09-12T18:35:47.515 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3243000000000001e-05 2024-09-12T18:35:47.515 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.515 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.515 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:47.515 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633501+0000", 2024-09-12T18:35:47.515 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5383000000000002e-05 2024-09-12T18:35:47.515 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.516 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.516 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:47.516 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633642+0000", 2024-09-12T18:35:47.516 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000141168 2024-09-12T18:35:47.516 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.516 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.516 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:47.516 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633982+0000", 2024-09-12T18:35:47.516 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000340067 2024-09-12T18:35:47.516 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.516 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.516 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:47.516 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654138+0000", 2024-09-12T18:35:47.517 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.020155495999999998 2024-09-12T18:35:47.517 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.517 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:47.517 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.517 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.517 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.517 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:1 5.e 5:7e06fd68:::benchmark_data_smithi073_23739_object0:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:35:47.517 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:45.871264+0000", 2024-09-12T18:35:47.517 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.590756136, 2024-09-12T18:35:47.517 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012442986, 2024-09-12T18:35:47.517 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:47.517 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:47.518 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:47.518 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:47.518 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:47.518 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:47.518 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 1 2024-09-12T18:35:47.518 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.518 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:47.518 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.518 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:47.518 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.871264+0000", 2024-09-12T18:35:47.518 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.518 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.518 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.519 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:47.519 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.871264+0000", 2024-09-12T18:35:47.519 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.519 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.519 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.519 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:47.519 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.871267+0000", 2024-09-12T18:35:47.519 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3699999999999999e-06 2024-09-12T18:35:47.519 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.519 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.519 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:47.519 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.871685+0000", 2024-09-12T18:35:47.519 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00041753599999999998 2024-09-12T18:35:47.519 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.520 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.520 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:47.520 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.871714+0000", 2024-09-12T18:35:47.520 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8626999999999999e-05 2024-09-12T18:35:47.520 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.520 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.520 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:47.520 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.871731+0000", 2024-09-12T18:35:47.520 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7229999999999999e-05 2024-09-12T18:35:47.520 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.520 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.520 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:47.520 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.871934+0000", 2024-09-12T18:35:47.521 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020336099999999999 2024-09-12T18:35:47.521 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.521 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.521 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:47.521 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872200+0000", 2024-09-12T18:35:47.521 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026600199999999999 2024-09-12T18:35:47.521 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.521 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.521 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:47.521 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872518+0000", 2024-09-12T18:35:47.521 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031749700000000003 2024-09-12T18:35:47.521 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.521 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.521 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:47.522 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.875939+0000", 2024-09-12T18:35:47.522 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0034210109999999998 2024-09-12T18:35:47.522 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.522 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.522 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:47.522 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.883472+0000", 2024-09-12T18:35:47.522 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0075330909999999996 2024-09-12T18:35:47.522 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.522 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.522 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:47.522 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.883591+0000", 2024-09-12T18:35:47.522 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000119636 2024-09-12T18:35:47.522 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.523 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.523 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:47.523 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.883707+0000", 2024-09-12T18:35:47.523 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011562500000000001 2024-09-12T18:35:47.523 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.523 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:47.523 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.523 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.523 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.523 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:6 5.8 5:1f55594e:::benchmark_data_smithi073_23739_object5:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:35:47.523 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:45.871821+0000", 2024-09-12T18:35:47.523 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.590198741, 2024-09-12T18:35:47.523 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011937, 2024-09-12T18:35:47.524 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:47.524 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:47.524 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:47.524 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:47.524 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:47.524 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:47.524 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 6 2024-09-12T18:35:47.524 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.524 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:47.524 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.524 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:47.525 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.871821+0000", 2024-09-12T18:35:47.525 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.525 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.525 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.525 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:47.525 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.871821+0000", 2024-09-12T18:35:47.525 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.525 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.525 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.525 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:47.525 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.871823+0000", 2024-09-12T18:35:47.525 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3999999999999999e-06 2024-09-12T18:35:47.525 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.526 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.526 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:47.526 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872163+0000", 2024-09-12T18:35:47.526 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00033989399999999998 2024-09-12T18:35:47.526 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.526 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.526 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:47.526 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872179+0000", 2024-09-12T18:35:47.526 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5736999999999999e-05 2024-09-12T18:35:47.526 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.526 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.526 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:47.526 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872189+0000", 2024-09-12T18:35:47.527 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.059e-05 2024-09-12T18:35:47.527 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.527 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.527 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:47.527 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872322+0000", 2024-09-12T18:35:47.527 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000133065 2024-09-12T18:35:47.527 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.527 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.527 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:47.527 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872547+0000", 2024-09-12T18:35:47.527 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022501800000000001 2024-09-12T18:35:47.527 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.527 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.527 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:47.528 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872918+0000", 2024-09-12T18:35:47.528 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00037063100000000001 2024-09-12T18:35:47.528 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.528 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.528 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:47.528 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.875427+0000", 2024-09-12T18:35:47.528 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025094449999999999 2024-09-12T18:35:47.528 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.528 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.528 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:47.528 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.883538+0000", 2024-09-12T18:35:47.528 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081109359999999991 2024-09-12T18:35:47.529 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.529 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.529 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:47.529 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.883643+0000", 2024-09-12T18:35:47.529 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000105059 2024-09-12T18:35:47.529 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.529 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.529 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:47.529 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.883758+0000", 2024-09-12T18:35:47.529 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000115225 2024-09-12T18:35:47.529 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.529 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:47.529 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.530 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.530 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.530 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:10 5.b 5:d4a107aa:::benchmark_data_smithi073_23739_object9:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:35:47.530 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:45.872222+0000", 2024-09-12T18:35:47.533 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.589798474, 2024-09-12T18:35:47.533 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011615613, 2024-09-12T18:35:47.533 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:47.533 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:47.533 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:47.533 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:47.533 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:47.533 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:47.533 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 10 2024-09-12T18:35:47.533 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.533 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:47.533 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.534 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:47.534 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872222+0000", 2024-09-12T18:35:47.534 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.534 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.534 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.534 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:47.534 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872222+0000", 2024-09-12T18:35:47.534 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.534 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.534 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.534 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:47.534 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872223+0000", 2024-09-12T18:35:47.534 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.06e-06 2024-09-12T18:35:47.535 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.535 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.535 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:47.535 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872343+0000", 2024-09-12T18:35:47.535 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000120629 2024-09-12T18:35:47.535 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.535 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.535 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:47.535 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872357+0000", 2024-09-12T18:35:47.535 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3665999999999999e-05 2024-09-12T18:35:47.535 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.535 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.535 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:47.536 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872366+0000", 2024-09-12T18:35:47.536 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.1430000000000004e-06 2024-09-12T18:35:47.536 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.536 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.536 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:47.536 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872476+0000", 2024-09-12T18:35:47.536 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000109246 2024-09-12T18:35:47.536 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.536 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.536 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:47.536 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872823+0000", 2024-09-12T18:35:47.536 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00034779100000000002 2024-09-12T18:35:47.536 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.537 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.537 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:47.537 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.873167+0000", 2024-09-12T18:35:47.537 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00034359400000000002 2024-09-12T18:35:47.537 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.537 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.537 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:47.537 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.876112+0000", 2024-09-12T18:35:47.537 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0029449580000000001 2024-09-12T18:35:47.537 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.537 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.537 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:47.537 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.883609+0000", 2024-09-12T18:35:47.538 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0074967109999999997 2024-09-12T18:35:47.538 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.538 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.538 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:47.538 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.883776+0000", 2024-09-12T18:35:47.538 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016785500000000001 2024-09-12T18:35:47.538 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.538 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.538 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:47.538 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.883837+0000", 2024-09-12T18:35:47.538 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0959999999999999e-05 2024-09-12T18:35:47.538 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.538 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:47.538 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.539 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.539 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.539 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:11 5.0 5:0517fd44:::benchmark_data_smithi073_23739_object10:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:35:47.539 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:45.872388+0000", 2024-09-12T18:35:47.539 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.5896320390000001, 2024-09-12T18:35:47.539 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011337009, 2024-09-12T18:35:47.539 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:47.539 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:47.539 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:47.539 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:47.539 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:47.539 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:47.540 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 11 2024-09-12T18:35:47.540 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.540 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:47.540 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.540 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:47.540 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872388+0000", 2024-09-12T18:35:47.540 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.540 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.540 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.540 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:47.540 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872388+0000", 2024-09-12T18:35:47.540 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.540 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.540 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.541 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:47.541 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872389+0000", 2024-09-12T18:35:47.541 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8299999999999995e-07 2024-09-12T18:35:47.541 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.541 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.541 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:47.541 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872483+0000", 2024-09-12T18:35:47.541 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.3626000000000001e-05 2024-09-12T18:35:47.541 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.541 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.541 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:47.541 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872518+0000", 2024-09-12T18:35:47.541 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5649999999999999e-05 2024-09-12T18:35:47.542 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.542 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.542 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:47.542 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872529+0000", 2024-09-12T18:35:47.542 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0716999999999999e-05 2024-09-12T18:35:47.542 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.542 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.542 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:47.542 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872636+0000", 2024-09-12T18:35:47.542 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010731200000000001 2024-09-12T18:35:47.542 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.542 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.542 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:47.543 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872903+0000", 2024-09-12T18:35:47.543 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026685499999999998 2024-09-12T18:35:47.543 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.543 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.543 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:47.543 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.873394+0000", 2024-09-12T18:35:47.543 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00049095200000000001 2024-09-12T18:35:47.543 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.543 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.543 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:47.543 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.876065+0000", 2024-09-12T18:35:47.543 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0026711310000000002 2024-09-12T18:35:47.543 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.543 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.544 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:47.544 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.883465+0000", 2024-09-12T18:35:47.544 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073996289999999996 2024-09-12T18:35:47.544 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.544 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.544 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:47.544 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.883598+0000", 2024-09-12T18:35:47.544 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000133378 2024-09-12T18:35:47.544 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.544 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.544 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:47.544 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.883725+0000", 2024-09-12T18:35:47.545 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000126876 2024-09-12T18:35:47.545 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.545 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:47.545 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.545 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.545 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.545 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:15 5.8 5:1781ebe7:::benchmark_data_smithi073_23739_object14:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:35:47.545 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:45.872695+0000", 2024-09-12T18:35:47.545 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.589325018, 2024-09-12T18:35:47.545 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012029096, 2024-09-12T18:35:47.545 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:47.545 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:47.545 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:47.545 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:47.546 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:47.546 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:47.546 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 15 2024-09-12T18:35:47.546 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.546 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:47.546 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.546 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:47.546 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872695+0000", 2024-09-12T18:35:47.546 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.547 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.547 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.547 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:47.547 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872695+0000", 2024-09-12T18:35:47.547 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.547 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.547 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.547 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:47.547 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872697+0000", 2024-09-12T18:35:47.547 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.407e-06 2024-09-12T18:35:47.547 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.547 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.547 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:47.547 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872824+0000", 2024-09-12T18:35:47.548 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012739500000000001 2024-09-12T18:35:47.548 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.548 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.548 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:47.548 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872844+0000", 2024-09-12T18:35:47.548 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9973e-05 2024-09-12T18:35:47.548 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.548 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.548 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:47.548 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872861+0000", 2024-09-12T18:35:47.548 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7220000000000001e-05 2024-09-12T18:35:47.548 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.549 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.549 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:47.549 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.874095+0000", 2024-09-12T18:35:47.549 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00123331 2024-09-12T18:35:47.549 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.549 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.549 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:47.549 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.874443+0000", 2024-09-12T18:35:47.549 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00034860000000000002 2024-09-12T18:35:47.549 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.549 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.549 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:47.549 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.874690+0000", 2024-09-12T18:35:47.550 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00024676500000000003 2024-09-12T18:35:47.550 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.550 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.550 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:47.550 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.876472+0000", 2024-09-12T18:35:47.550 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001781728 2024-09-12T18:35:47.550 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.550 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.550 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:47.550 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.884538+0000", 2024-09-12T18:35:47.550 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080661399999999994 2024-09-12T18:35:47.550 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.551 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.551 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:47.551 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.884632+0000", 2024-09-12T18:35:47.551 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4235999999999997e-05 2024-09-12T18:35:47.551 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.551 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.551 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:47.551 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.884724+0000", 2024-09-12T18:35:47.551 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2322000000000001e-05 2024-09-12T18:35:47.551 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.551 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:47.551 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.551 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.552 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.552 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:58 5.e 5:72811c8e:::benchmark_data_smithi073_23739_object57:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:35:47.552 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:45.899899+0000", 2024-09-12T18:35:47.552 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.5621207580000001, 2024-09-12T18:35:47.552 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012438803, 2024-09-12T18:35:47.552 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:47.552 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:47.552 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:47.552 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:47.553 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:47.553 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:47.553 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 58 2024-09-12T18:35:47.553 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.553 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:47.553 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.554 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:47.554 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.899899+0000", 2024-09-12T18:35:47.554 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.554 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.554 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.554 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:47.554 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.899899+0000", 2024-09-12T18:35:47.554 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.554 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.554 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.554 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:47.554 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.899901+0000", 2024-09-12T18:35:47.554 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9530000000000002e-06 2024-09-12T18:35:47.555 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.555 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.555 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:47.555 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.899988+0000", 2024-09-12T18:35:47.555 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6502999999999995e-05 2024-09-12T18:35:47.555 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.555 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.555 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:47.555 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.900015+0000", 2024-09-12T18:35:47.555 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6919000000000001e-05 2024-09-12T18:35:47.555 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.555 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.556 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:47.556 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.900040+0000", 2024-09-12T18:35:47.556 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5497e-05 2024-09-12T18:35:47.556 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.556 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.556 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:47.556 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.900147+0000", 2024-09-12T18:35:47.556 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000106309 2024-09-12T18:35:47.556 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.556 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.556 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:47.556 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.900371+0000", 2024-09-12T18:35:47.556 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000224792 2024-09-12T18:35:47.557 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.557 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.557 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:47.557 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.900658+0000", 2024-09-12T18:35:47.557 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00028669299999999997 2024-09-12T18:35:47.557 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.557 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.557 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:47.557 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.902976+0000", 2024-09-12T18:35:47.557 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002317815 2024-09-12T18:35:47.557 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.557 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.557 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:47.557 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.912140+0000", 2024-09-12T18:35:47.558 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0091642770000000002 2024-09-12T18:35:47.558 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.558 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.558 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:47.558 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.912259+0000", 2024-09-12T18:35:47.558 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000118465 2024-09-12T18:35:47.558 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.558 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.558 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:47.558 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.912338+0000", 2024-09-12T18:35:47.558 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9579999999999994e-05 2024-09-12T18:35:47.558 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.558 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:47.558 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.559 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.559 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.559 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:59 5.4 5:2d4b4181:::benchmark_data_smithi073_23739_object58:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:35:47.559 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:45.900281+0000", 2024-09-12T18:35:47.559 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.561738968, 2024-09-12T18:35:47.559 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011520287000000001, 2024-09-12T18:35:47.559 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:47.559 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:47.559 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:47.559 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:47.559 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:47.559 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:47.559 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 59 2024-09-12T18:35:47.560 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.560 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:47.560 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.560 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:47.560 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.900281+0000", 2024-09-12T18:35:47.560 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.560 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.560 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.560 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:47.560 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.900281+0000", 2024-09-12T18:35:47.560 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.560 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.560 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.560 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:47.561 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.900300+0000", 2024-09-12T18:35:47.561 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8366e-05 2024-09-12T18:35:47.561 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.561 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.561 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:47.561 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.900406+0000", 2024-09-12T18:35:47.561 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000106599 2024-09-12T18:35:47.561 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.561 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.561 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:47.561 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.900433+0000", 2024-09-12T18:35:47.561 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6696999999999999e-05 2024-09-12T18:35:47.561 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.562 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.562 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:47.562 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.900451+0000", 2024-09-12T18:35:47.562 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8085999999999999e-05 2024-09-12T18:35:47.562 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.562 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.562 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:47.562 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.900577+0000", 2024-09-12T18:35:47.562 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012627600000000001 2024-09-12T18:35:47.562 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.562 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.562 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:47.562 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.900860+0000", 2024-09-12T18:35:47.563 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00028272399999999999 2024-09-12T18:35:47.563 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.563 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.563 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:47.563 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.901313+0000", 2024-09-12T18:35:47.563 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00045344 2024-09-12T18:35:47.563 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.563 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.563 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:47.563 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.903849+0000", 2024-09-12T18:35:47.563 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025359979999999998 2024-09-12T18:35:47.563 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.563 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.564 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:47.564 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.911663+0000", 2024-09-12T18:35:47.564 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0078137290000000002 2024-09-12T18:35:47.564 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.564 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.564 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:47.564 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.911744+0000", 2024-09-12T18:35:47.564 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0746000000000002e-05 2024-09-12T18:35:47.564 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.564 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.564 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:47.564 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.911802+0000", 2024-09-12T18:35:47.565 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7626e-05 2024-09-12T18:35:47.565 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.565 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:47.565 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.565 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.565 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.565 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:61 5.0 5:077a70fb:::benchmark_data_smithi073_23739_object60:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:35:47.565 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:45.900716+0000", 2024-09-12T18:35:47.565 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.561304018, 2024-09-12T18:35:47.565 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.01152891, 2024-09-12T18:35:47.565 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:47.565 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:47.566 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:47.566 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:47.566 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:47.566 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:47.566 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 61 2024-09-12T18:35:47.566 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.566 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:47.566 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.566 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:47.566 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.900716+0000", 2024-09-12T18:35:47.566 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.566 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.566 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.567 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:47.567 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.900716+0000", 2024-09-12T18:35:47.567 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.567 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.567 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.567 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:47.567 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.900719+0000", 2024-09-12T18:35:47.567 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5229999999999998e-06 2024-09-12T18:35:47.567 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.567 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.567 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:47.568 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.900807+0000", 2024-09-12T18:35:47.568 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8388999999999997e-05 2024-09-12T18:35:47.568 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.568 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.568 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:47.568 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.900837+0000", 2024-09-12T18:35:47.568 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9750000000000001e-05 2024-09-12T18:35:47.568 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.568 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.568 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:47.568 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.900855+0000", 2024-09-12T18:35:47.568 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8566000000000001e-05 2024-09-12T18:35:47.568 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.569 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.569 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:47.569 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.901209+0000", 2024-09-12T18:35:47.569 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00035383399999999997 2024-09-12T18:35:47.569 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.569 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.569 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:47.569 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.901526+0000", 2024-09-12T18:35:47.569 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031638400000000001 2024-09-12T18:35:47.569 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.569 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.569 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:47.569 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.901827+0000", 2024-09-12T18:35:47.570 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030095700000000003 2024-09-12T18:35:47.570 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.570 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.570 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:47.570 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.904450+0000", 2024-09-12T18:35:47.570 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0026233350000000001 2024-09-12T18:35:47.570 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.570 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.570 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:47.570 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.912046+0000", 2024-09-12T18:35:47.570 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0075961930000000002 2024-09-12T18:35:47.570 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.570 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.571 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:47.571 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.912159+0000", 2024-09-12T18:35:47.571 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112753 2024-09-12T18:35:47.571 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.571 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.571 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:47.571 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.912245+0000", 2024-09-12T18:35:47.571 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6225999999999997e-05 2024-09-12T18:35:47.571 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.571 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:47.571 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.571 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.571 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.571 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:210 5.4 5:28535192:::benchmark_data_smithi073_23739_object209:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:35:47.572 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:45.967167+0000", 2024-09-12T18:35:47.572 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.4948529930000001, 2024-09-12T18:35:47.572 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012739489999999999, 2024-09-12T18:35:47.572 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:47.572 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:47.572 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:47.572 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:47.572 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:47.572 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:47.572 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 210 2024-09-12T18:35:47.572 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.572 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:47.573 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.573 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:47.573 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.967167+0000", 2024-09-12T18:35:47.573 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.573 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.573 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.573 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:47.573 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.967167+0000", 2024-09-12T18:35:47.573 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.573 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.573 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.573 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:47.573 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.967168+0000", 2024-09-12T18:35:47.574 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2419999999999999e-06 2024-09-12T18:35:47.574 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.574 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.574 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:47.574 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.967218+0000", 2024-09-12T18:35:47.574 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9493000000000002e-05 2024-09-12T18:35:47.574 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.574 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.574 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:47.574 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.967234+0000", 2024-09-12T18:35:47.574 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5576000000000001e-05 2024-09-12T18:35:47.574 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.575 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.575 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:47.575 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.967262+0000", 2024-09-12T18:35:47.575 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8708999999999999e-05 2024-09-12T18:35:47.575 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.575 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.575 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:47.575 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.969263+0000", 2024-09-12T18:35:47.575 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020011479999999999 2024-09-12T18:35:47.575 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.575 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.575 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:47.575 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.969456+0000", 2024-09-12T18:35:47.576 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000192807 2024-09-12T18:35:47.576 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.576 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.576 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:47.576 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.969748+0000", 2024-09-12T18:35:47.576 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00029194600000000001 2024-09-12T18:35:47.576 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.576 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.576 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:47.576 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.972800+0000", 2024-09-12T18:35:47.576 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0030521749999999999 2024-09-12T18:35:47.576 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.576 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.577 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:47.577 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.979658+0000", 2024-09-12T18:35:47.577 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0068579399999999999 2024-09-12T18:35:47.577 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.577 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.577 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:47.577 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.979805+0000", 2024-09-12T18:35:47.577 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000146565 2024-09-12T18:35:47.577 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.577 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.577 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:47.577 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.979907+0000", 2024-09-12T18:35:47.577 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000101889 2024-09-12T18:35:47.578 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.578 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:47.578 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.578 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.578 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.578 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:212 5.8 5:1652b127:::benchmark_data_smithi073_23739_object211:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:35:47.578 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:45.967455+0000", 2024-09-12T18:35:47.578 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.4945648220000001, 2024-09-12T18:35:47.578 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.01239791, 2024-09-12T18:35:47.578 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:47.578 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:47.578 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:47.579 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:47.579 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:47.579 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:47.579 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 212 2024-09-12T18:35:47.579 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.579 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:47.579 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.579 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:47.579 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.967455+0000", 2024-09-12T18:35:47.579 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.579 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.579 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.579 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:47.579 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.967455+0000", 2024-09-12T18:35:47.580 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.580 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.580 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.580 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:47.580 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.967457+0000", 2024-09-12T18:35:47.580 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.618e-06 2024-09-12T18:35:47.580 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.580 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.580 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:47.580 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.967530+0000", 2024-09-12T18:35:47.580 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3003999999999994e-05 2024-09-12T18:35:47.580 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.580 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.581 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:47.581 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.967550+0000", 2024-09-12T18:35:47.581 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9536999999999999e-05 2024-09-12T18:35:47.581 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.581 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.581 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:47.581 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.967561+0000", 2024-09-12T18:35:47.581 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1725e-05 2024-09-12T18:35:47.581 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.581 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.581 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:47.581 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.968822+0000", 2024-09-12T18:35:47.581 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001260749 2024-09-12T18:35:47.582 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.582 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.582 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:47.582 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.969078+0000", 2024-09-12T18:35:47.582 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025636300000000001 2024-09-12T18:35:47.582 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.582 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.582 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:47.582 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.969383+0000", 2024-09-12T18:35:47.582 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030495000000000001 2024-09-12T18:35:47.582 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.582 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.582 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:47.583 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.972624+0000", 2024-09-12T18:35:47.583 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0032410630000000002 2024-09-12T18:35:47.583 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.583 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.583 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:47.583 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.979640+0000", 2024-09-12T18:35:47.583 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0070157919999999999 2024-09-12T18:35:47.583 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.583 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.584 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:47.584 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.979763+0000", 2024-09-12T18:35:47.584 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000123139 2024-09-12T18:35:47.584 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.584 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.584 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:47.584 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.979853+0000", 2024-09-12T18:35:47.584 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9969999999999994e-05 2024-09-12T18:35:47.584 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.584 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:47.585 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.585 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.585 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.585 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:216 5.4 5:2af5a937:::benchmark_data_smithi073_23739_object215:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:35:47.585 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:45.968483+0000", 2024-09-12T18:35:47.585 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.4935375129999999, 2024-09-12T18:35:47.585 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011756588, 2024-09-12T18:35:47.585 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:47.585 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:47.585 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:47.586 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:47.586 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:47.586 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:47.586 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 216 2024-09-12T18:35:47.586 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.586 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:47.586 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.586 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:47.586 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.968483+0000", 2024-09-12T18:35:47.586 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.587 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.587 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.587 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:47.587 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.968483+0000", 2024-09-12T18:35:47.587 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:47.587 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.587 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.587 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:47.587 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.968484+0000", 2024-09-12T18:35:47.587 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2139999999999999e-06 2024-09-12T18:35:47.587 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.587 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.588 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:47.588 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.968603+0000", 2024-09-12T18:35:47.588 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000118861 2024-09-12T18:35:47.588 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.588 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.588 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:47.588 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.968621+0000", 2024-09-12T18:35:47.588 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8600000000000001e-05 2024-09-12T18:35:47.588 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.588 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.588 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:47.588 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.968635+0000", 2024-09-12T18:35:47.589 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3905e-05 2024-09-12T18:35:47.589 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.589 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.589 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:47.589 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.970847+0000", 2024-09-12T18:35:47.589 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022112260000000002 2024-09-12T18:35:47.589 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.589 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.589 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:47.589 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.971172+0000", 2024-09-12T18:35:47.590 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000325707 2024-09-12T18:35:47.590 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.590 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.590 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:47.590 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.971560+0000", 2024-09-12T18:35:47.590 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00038744400000000003 2024-09-12T18:35:47.590 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.590 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.590 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:47.590 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.974120+0000", 2024-09-12T18:35:47.590 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025601980000000001 2024-09-12T18:35:47.591 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.591 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.591 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:47.591 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.980034+0000", 2024-09-12T18:35:47.591 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.005914168 2024-09-12T18:35:47.591 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.591 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.591 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:47.591 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.980154+0000", 2024-09-12T18:35:47.591 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012042199999999999 2024-09-12T18:35:47.591 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:47.591 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:47.592 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:47.592 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.980239+0000", 2024-09-12T18:35:47.592 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4843000000000001e-05 2024-09-12T18:35:47.592 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.592 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:47.592 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.592 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:47.592 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:47.593 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:35:47.596 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:35:47.597 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:47.595+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:47.601 DEBUG:teuthology.parallel:result is None 2024-09-12T18:35:47.601 DEBUG:teuthology.run_tasks:Unwinding manager radosbench 2024-09-12T18:35:47.612 INFO:tasks.radosbench:joining radosbench (timing out after 2100s) 2024-09-12T18:35:47.612 INFO:teuthology.orchestra.run:waiting for 2100 2024-09-12T18:35:47.669 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:35:47.694 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:47.690+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:47.758 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:35:47.758 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:35:47.758 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.758 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:7113 5.f 5:f9f911c1:::benchmark_data_smithi073_23739_object7112:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T18:35:47.758 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:47.755983+0000", 2024-09-12T18:35:47.758 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.002592202, 2024-09-12T18:35:47.759 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0026106699999999998, 2024-09-12T18:35:47.759 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:47.759 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:47.759 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:47.759 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:35:47.759 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:35:47.759 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:47.759 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 7113 2024-09-12T18:35:47.759 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.759 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:47.759 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.759 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:47.759 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.755983+0000", 2024-09-12T18:35:47.759 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:47.760 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.760 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.760 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:47.760 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.755983+0000", 2024-09-12T18:35:47.760 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:47.760 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.760 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.760 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:47.760 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.755984+0000", 2024-09-12T18:35:47.760 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.071e-06 2024-09-12T18:35:47.760 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.760 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.760 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:47.761 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.756031+0000", 2024-09-12T18:35:47.761 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.7058999999999998e-05 2024-09-12T18:35:47.761 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.761 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.761 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:47.761 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.756042+0000", 2024-09-12T18:35:47.761 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1044e-05 2024-09-12T18:35:47.761 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.761 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.761 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:47.761 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.756050+0000", 2024-09-12T18:35:47.761 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3549999999999999e-06 2024-09-12T18:35:47.761 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.762 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.762 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:47.762 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.756107+0000", 2024-09-12T18:35:47.762 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.7348e-05 2024-09-12T18:35:47.762 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.762 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.762 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:47.762 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.756255+0000", 2024-09-12T18:35:47.762 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014773299999999999 2024-09-12T18:35:47.762 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.762 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.762 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:47.762 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.756394+0000", 2024-09-12T18:35:47.762 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013934900000000001 2024-09-12T18:35:47.763 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.763 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.763 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:47.763 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.758450+0000", 2024-09-12T18:35:47.763 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0020561109999999998 2024-09-12T18:35:47.763 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:47.763 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:47.763 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:47.763 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.763 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.763 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:7109 5.6 e24/21 5:63231c41:::benchmark_data_smithi073_23739_object7108:head v 24'460, mlcod=24'458)", 2024-09-12T18:35:47.763 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:47.756387+0000", 2024-09-12T18:35:47.763 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.002188602, 2024-09-12T18:35:47.763 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0022504109999999999, 2024-09-12T18:35:47.764 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:47.764 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:47.764 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:35:47.764 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:47.764 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.764 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:47.764 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.756387+0000", 2024-09-12T18:35:47.764 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:47.764 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.764 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.764 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:47.764 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.756387+0000", 2024-09-12T18:35:47.764 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:47.764 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.765 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.765 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:47.765 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.756387+0000", 2024-09-12T18:35:47.765 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.2100000000000002e-07 2024-09-12T18:35:47.765 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.765 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.765 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:47.765 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.756424+0000", 2024-09-12T18:35:47.765 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.693e-05 2024-09-12T18:35:47.765 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.765 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.765 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:47.765 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.756432+0000", 2024-09-12T18:35:47.766 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4999999999999999e-06 2024-09-12T18:35:47.766 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.766 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.766 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:47.766 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.756438+0000", 2024-09-12T18:35:47.766 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.8510000000000004e-06 2024-09-12T18:35:47.766 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.766 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.766 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:47.766 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.756486+0000", 2024-09-12T18:35:47.766 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.7243000000000002e-05 2024-09-12T18:35:47.766 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.766 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.766 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:47.767 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.756502+0000", 2024-09-12T18:35:47.767 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6291e-05 2024-09-12T18:35:47.767 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:47.767 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:47.767 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:47.767 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.767 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.767 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:7114 5.7 5:e15adeb1:::benchmark_data_smithi073_23739_object7113:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T18:35:47.767 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:47.756829+0000", 2024-09-12T18:35:47.767 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0017462319999999999, 2024-09-12T18:35:47.767 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001840454, 2024-09-12T18:35:47.767 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:47.767 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:47.768 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:47.768 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:35:47.768 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:35:47.768 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:47.768 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 7114 2024-09-12T18:35:47.768 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.768 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:47.768 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.768 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:47.768 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.756829+0000", 2024-09-12T18:35:47.768 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:47.768 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.768 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.768 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:47.769 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.756829+0000", 2024-09-12T18:35:47.769 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:47.769 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.769 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.769 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:47.769 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.756830+0000", 2024-09-12T18:35:47.769 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.009e-06 2024-09-12T18:35:47.769 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.769 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.769 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:47.769 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.756895+0000", 2024-09-12T18:35:47.769 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4721000000000006e-05 2024-09-12T18:35:47.769 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.769 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.770 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:47.770 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.756908+0000", 2024-09-12T18:35:47.770 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.328e-05 2024-09-12T18:35:47.770 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.770 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.770 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:47.770 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.756916+0000", 2024-09-12T18:35:47.770 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.2709999999999992e-06 2024-09-12T18:35:47.770 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.770 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.770 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:47.770 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.756990+0000", 2024-09-12T18:35:47.770 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3783999999999997e-05 2024-09-12T18:35:47.770 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.771 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.771 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:47.771 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.757108+0000", 2024-09-12T18:35:47.771 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000117991 2024-09-12T18:35:47.771 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.771 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.771 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:47.771 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.757184+0000", 2024-09-12T18:35:47.771 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.6236999999999995e-05 2024-09-12T18:35:47.771 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:47.772 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:47.772 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:47.772 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.772 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.772 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:7110 5.6 e24/21 5:67c73ced:::benchmark_data_smithi073_23739_object7109:head v 24'461, mlcod=24'458)", 2024-09-12T18:35:47.772 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:47.757116+0000", 2024-09-12T18:35:47.772 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.001458783, 2024-09-12T18:35:47.772 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0016030389999999999, 2024-09-12T18:35:47.772 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:47.772 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:47.772 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:35:47.772 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:47.772 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.773 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:47.773 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.757116+0000", 2024-09-12T18:35:47.773 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:47.773 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.773 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.773 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:47.773 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.757116+0000", 2024-09-12T18:35:47.773 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:47.774 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.774 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.774 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:47.774 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.757117+0000", 2024-09-12T18:35:47.774 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.1200000000000002e-07 2024-09-12T18:35:47.774 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.774 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.774 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:47.774 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.757182+0000", 2024-09-12T18:35:47.774 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4932999999999996e-05 2024-09-12T18:35:47.775 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.775 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.775 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:47.775 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.757192+0000", 2024-09-12T18:35:47.775 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.4259999999999992e-06 2024-09-12T18:35:47.775 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.775 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.775 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:47.775 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.757199+0000", 2024-09-12T18:35:47.776 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0849999999999999e-06 2024-09-12T18:35:47.776 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.776 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.776 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:47.776 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.757251+0000", 2024-09-12T18:35:47.776 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.202e-05 2024-09-12T18:35:47.776 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.776 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.776 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:47.776 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.757269+0000", 2024-09-12T18:35:47.776 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.8428e-05 2024-09-12T18:35:47.776 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:47.776 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:47.777 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:47.777 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.777 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.777 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:7116 5.2 5:4453e18b:::benchmark_data_smithi073_23739_object7115:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T18:35:47.777 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:47.757218+0000", 2024-09-12T18:35:47.777 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.00135706, 2024-09-12T18:35:47.777 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001551296, 2024-09-12T18:35:47.777 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:47.777 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:47.777 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:47.777 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:35:47.777 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:35:47.777 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:47.777 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 7116 2024-09-12T18:35:47.778 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.778 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:47.778 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.778 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:47.778 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.757218+0000", 2024-09-12T18:35:47.778 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:47.778 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.778 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.778 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:47.778 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.757218+0000", 2024-09-12T18:35:47.778 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:47.778 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.778 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.778 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:47.779 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.757219+0000", 2024-09-12T18:35:47.779 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.02e-06 2024-09-12T18:35:47.779 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.779 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.779 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:47.779 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.757295+0000", 2024-09-12T18:35:47.779 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.5996999999999998e-05 2024-09-12T18:35:47.780 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.780 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.780 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:47.780 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.757305+0000", 2024-09-12T18:35:47.780 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.4809999999999995e-06 2024-09-12T18:35:47.780 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.780 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.781 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:47.781 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.757310+0000", 2024-09-12T18:35:47.781 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.0509999999999996e-06 2024-09-12T18:35:47.781 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.781 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.781 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:47.781 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.757359+0000", 2024-09-12T18:35:47.781 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.9539000000000001e-05 2024-09-12T18:35:47.781 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.781 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.781 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:47.781 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.757556+0000", 2024-09-12T18:35:47.781 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019658300000000001 2024-09-12T18:35:47.782 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.782 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.782 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:47.782 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.757687+0000", 2024-09-12T18:35:47.782 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013082 2024-09-12T18:35:47.782 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:47.782 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:47.782 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:47.782 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.782 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.782 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:7118 5.6 e24/21 5:6f15c85d:::benchmark_data_smithi073_23739_object7117:head v 24'462, mlcod=24'458)", 2024-09-12T18:35:47.782 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:47.758049+0000", 2024-09-12T18:35:47.782 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.00052660399999999996, 2024-09-12T18:35:47.782 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00078808299999999997, 2024-09-12T18:35:47.783 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:47.783 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:47.783 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:35:47.783 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:47.783 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.783 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:47.783 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.758049+0000", 2024-09-12T18:35:47.783 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:47.783 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.783 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.783 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:47.783 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.758049+0000", 2024-09-12T18:35:47.783 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:47.784 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.784 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.784 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:47.784 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.758049+0000", 2024-09-12T18:35:47.784 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.5099999999999999e-07 2024-09-12T18:35:47.784 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.784 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.784 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:47.784 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.758157+0000", 2024-09-12T18:35:47.784 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000107419 2024-09-12T18:35:47.784 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.784 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.785 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:47.785 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.758164+0000", 2024-09-12T18:35:47.785 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2969999999999998e-06 2024-09-12T18:35:47.785 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.785 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.785 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:47.785 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.758179+0000", 2024-09-12T18:35:47.785 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4941e-05 2024-09-12T18:35:47.785 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.785 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.785 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:47.785 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.758232+0000", 2024-09-12T18:35:47.785 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3287e-05 2024-09-12T18:35:47.785 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.786 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.786 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:47.786 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.758251+0000", 2024-09-12T18:35:47.786 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.8765000000000001e-05 2024-09-12T18:35:47.786 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:47.786 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:47.786 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:47.786 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.786 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.786 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:7120 5.3 e24/21 5:cb77f95d:::benchmark_data_smithi073_23739_object7119:head v 24'438, mlcod=24'435)", 2024-09-12T18:35:47.786 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:47.758744+0000", 2024-09-12T18:35:47.786 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 4294967295.9998312, 2024-09-12T18:35:47.786 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013307600000000001, 2024-09-12T18:35:47.787 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:47.787 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:47.787 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:35:47.787 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:47.787 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.787 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:47.787 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.758744+0000", 2024-09-12T18:35:47.787 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:47.787 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.787 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.787 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:47.787 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.758744+0000", 2024-09-12T18:35:47.787 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:47.788 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.788 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.788 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:47.788 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.758745+0000", 2024-09-12T18:35:47.788 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.8700000000000005e-07 2024-09-12T18:35:47.788 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.788 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.788 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:47.788 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.758804+0000", 2024-09-12T18:35:47.788 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9728000000000001e-05 2024-09-12T18:35:47.788 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.788 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.788 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:47.789 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.758816+0000", 2024-09-12T18:35:47.789 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1123e-05 2024-09-12T18:35:47.789 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.789 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.789 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:47.789 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.758822+0000", 2024-09-12T18:35:47.789 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.8519999999999998e-06 2024-09-12T18:35:47.789 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.789 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.789 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:47.789 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.758855+0000", 2024-09-12T18:35:47.789 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.2481999999999998e-05 2024-09-12T18:35:47.789 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.790 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.790 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:47.790 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.758866+0000", 2024-09-12T18:35:47.790 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0934000000000001e-05 2024-09-12T18:35:47.790 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:47.790 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:47.790 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:47.790 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.790 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.790 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:7112 5.9 5:94fb03bd:::benchmark_data_smithi073_23739_object7111:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T18:35:47.790 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:47.755797+0000", 2024-09-12T18:35:47.790 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0027778159999999998, 2024-09-12T18:35:47.790 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0031200400000000001, 2024-09-12T18:35:47.791 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:47.791 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:47.791 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:47.791 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:35:47.791 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:35:47.791 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:47.791 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 7112 2024-09-12T18:35:47.791 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.791 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:47.791 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.791 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:47.791 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.755797+0000", 2024-09-12T18:35:47.791 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:47.792 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.792 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.792 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:47.792 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.755797+0000", 2024-09-12T18:35:47.792 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:47.792 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.792 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.792 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:47.792 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.755798+0000", 2024-09-12T18:35:47.792 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.017e-06 2024-09-12T18:35:47.792 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.792 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.792 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:47.793 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.755848+0000", 2024-09-12T18:35:47.793 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.9716000000000003e-05 2024-09-12T18:35:47.793 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.793 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.793 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:47.793 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.755857+0000", 2024-09-12T18:35:47.793 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.9730000000000003e-06 2024-09-12T18:35:47.793 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.793 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.793 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:47.793 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.755864+0000", 2024-09-12T18:35:47.793 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.6880000000000002e-06 2024-09-12T18:35:47.793 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.794 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.794 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:47.794 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.756275+0000", 2024-09-12T18:35:47.794 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00041110400000000003 2024-09-12T18:35:47.794 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.794 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.794 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:47.794 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.756396+0000", 2024-09-12T18:35:47.794 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000121013 2024-09-12T18:35:47.794 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.794 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.794 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:47.794 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.756519+0000", 2024-09-12T18:35:47.794 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012334600000000001 2024-09-12T18:35:47.795 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:47.795 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:47.795 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:47.795 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:47.758468+0000", 2024-09-12T18:35:47.795 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001948558 2024-09-12T18:35:47.795 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:47.795 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:47.795 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:47.795 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:47.795 INFO:teuthology.orchestra.run.smithi162.stdout: ], 2024-09-12T18:35:47.795 INFO:teuthology.orchestra.run.smithi162.stdout: "num_ops": 8 2024-09-12T18:35:47.795 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:35:47.797 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:35:47.797 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:47.795+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:47.831 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:35:47.831 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:35:47.851 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:35:47.851 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:35:47.867 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 2 16 7520 7504 234.477 251.75 0.0041047 0.00425292 2024-09-12T18:35:47.870 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:35:47.870 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:35:47.897 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:47.894+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:47.994 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:47.995 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:48.001 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:47.999+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:48.015 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:35:48.101 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:48.094+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:48.177 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:48.177 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:48.198 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:35:48.200 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:48.199+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:48.301 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:48.294+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:48.359 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:48.360 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:48.382 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:35:48.402 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:48.399+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:48.404 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:35:48.404 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:35:48.405 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-09-12T18:35:48.405 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-12T18:35:48.405 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-12T18:35:48.405 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-09-12T18:35:48.503 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:48.503+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:48.568 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:35:48.569 INFO:teuthology.orchestra.run.smithi143.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-12T18:35:48.569 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:35:48.592 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:48.592 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:48.614 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:35:48.630 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:48.631+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:48.705 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:48.707+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:48.769 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:48.770 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:48.790 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:35:48.806 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:48.803+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:48.867 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 3 16 10677 10661 222.082 197.312 0.00252609 0.00449635 2024-09-12T18:35:48.872 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T18:35:48.907 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:48.903+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:48.953 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:48.953 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:48.972 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:35:49.022 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:49.023+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:49.108 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:49.107+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:49.116 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:49.116 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:49.135 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:35:49.223 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:49.223+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:49.310 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:49.311+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:49.348 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:49.348 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:49.368 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:35:49.416 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:49.414+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:49.513 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:49.510+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:49.529 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:49.529 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:49.548 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:35:49.614 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:49.615+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:49.715 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:49.710+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:49.748 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:49.748 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:49.768 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:35:49.796 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is unset 2024-09-12T18:35:49.816 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:49.815+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:49.867 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 4 16 13706 13690 213.882 189.312 0.00456861 0.00466834 2024-09-12T18:35:49.888 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:35:49.917 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:49.910+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:49.921 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:49.921 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:49.941 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:35:50.018 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:50.019+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:50.051 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:35:50.052 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:35:50.071 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:35:50.071 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:35:50.089 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:35:50.089 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:35:50.102 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:35:50.102 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:35:50.102 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.102 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:14393 5.c 5:3f9ddef9:::benchmark_data_smithi073_23739_object14392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:35:50.102 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:50.099976+0000", 2024-09-12T18:35:50.102 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0014148850000000001, 2024-09-12T18:35:50.102 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0014354050000000001, 2024-09-12T18:35:50.102 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:50.102 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:50.102 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:50.103 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:35:50.103 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:35:50.103 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:50.103 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 14393 2024-09-12T18:35:50.103 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.103 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:50.103 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.103 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:50.103 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.099976+0000", 2024-09-12T18:35:50.103 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.103 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.103 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.103 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:50.103 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.099976+0000", 2024-09-12T18:35:50.104 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.104 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.104 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.104 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:50.104 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.099977+0000", 2024-09-12T18:35:50.104 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1710000000000001e-06 2024-09-12T18:35:50.104 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.104 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.104 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:50.104 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.100128+0000", 2024-09-12T18:35:50.104 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015180700000000001 2024-09-12T18:35:50.104 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.104 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.105 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:50.105 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.100140+0000", 2024-09-12T18:35:50.105 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1219e-05 2024-09-12T18:35:50.105 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.105 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.105 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:50.106 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.100162+0000", 2024-09-12T18:35:50.106 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2099e-05 2024-09-12T18:35:50.106 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.106 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.106 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:50.106 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.100221+0000", 2024-09-12T18:35:50.106 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8807000000000001e-05 2024-09-12T18:35:50.106 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.106 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.106 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:50.106 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.100375+0000", 2024-09-12T18:35:50.106 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015427299999999999 2024-09-12T18:35:50.106 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.107 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.107 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:50.107 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.100451+0000", 2024-09-12T18:35:50.107 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5797999999999995e-05 2024-09-12T18:35:50.107 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.107 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:50.107 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.107 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.107 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.107 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:14390 5.8 e25/21 5:179ed9e4:::benchmark_data_smithi073_23739_object14389:head v 25'872, mlcod=25'869)", 2024-09-12T18:35:50.107 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:50.100247+0000", 2024-09-12T18:35:50.107 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.001143067, 2024-09-12T18:35:50.107 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0012150030000000001, 2024-09-12T18:35:50.107 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:50.108 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:50.108 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:35:50.108 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:50.108 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.108 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:50.108 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.100247+0000", 2024-09-12T18:35:50.108 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.108 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.108 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.108 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:50.108 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.100247+0000", 2024-09-12T18:35:50.108 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.109 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.109 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.109 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:50.109 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.100248+0000", 2024-09-12T18:35:50.109 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6599999999999996e-07 2024-09-12T18:35:50.109 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.109 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.109 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:50.109 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.100298+0000", 2024-09-12T18:35:50.109 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9991000000000003e-05 2024-09-12T18:35:50.109 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.109 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.109 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:50.109 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.100321+0000", 2024-09-12T18:35:50.110 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.3309e-05 2024-09-12T18:35:50.110 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.110 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.110 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:50.110 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.100330+0000", 2024-09-12T18:35:50.110 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7979999999999995e-06 2024-09-12T18:35:50.110 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.110 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.110 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:50.110 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.100540+0000", 2024-09-12T18:35:50.110 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00020987499999999999 2024-09-12T18:35:50.110 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.110 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.111 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:50.111 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.100559+0000", 2024-09-12T18:35:50.111 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9230999999999999e-05 2024-09-12T18:35:50.111 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.111 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:50.111 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.111 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.111 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.111 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:14395 5.b e25/21 5:dc214f5a:::benchmark_data_smithi073_23739_object14394:head v 25'954, mlcod=25'951)", 2024-09-12T18:35:50.111 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:50.100663+0000", 2024-09-12T18:35:50.111 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00072731499999999997, 2024-09-12T18:35:50.111 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00082792300000000005, 2024-09-12T18:35:50.112 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:50.112 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:50.112 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:35:50.112 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:50.112 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.112 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:50.112 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.100663+0000", 2024-09-12T18:35:50.112 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.112 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.112 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.112 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:50.112 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.100663+0000", 2024-09-12T18:35:50.112 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.113 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.113 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.113 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:50.113 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.100664+0000", 2024-09-12T18:35:50.113 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:35:50.113 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.113 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.113 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:50.113 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.100702+0000", 2024-09-12T18:35:50.113 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8209e-05 2024-09-12T18:35:50.113 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.113 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.113 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:50.113 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.100713+0000", 2024-09-12T18:35:50.114 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1099e-05 2024-09-12T18:35:50.114 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.114 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.114 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:50.114 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.100721+0000", 2024-09-12T18:35:50.114 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4839999999999998e-06 2024-09-12T18:35:50.114 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.114 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.114 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:50.114 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.100769+0000", 2024-09-12T18:35:50.114 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8819000000000001e-05 2024-09-12T18:35:50.114 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.114 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.114 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:50.114 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.100791+0000", 2024-09-12T18:35:50.115 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1396999999999999e-05 2024-09-12T18:35:50.115 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.115 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:50.115 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.115 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.115 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.115 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:14399 5.8 e25/21 5:1ea70ff9:::benchmark_data_smithi073_23739_object14398:head v 25'873, mlcod=25'869)", 2024-09-12T18:35:50.115 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:50.101324+0000", 2024-09-12T18:35:50.115 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 6.6309000000000005e-05, 2024-09-12T18:35:50.115 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000200523, 2024-09-12T18:35:50.115 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:50.115 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:50.115 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:35:50.115 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:50.116 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.116 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:50.116 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.101324+0000", 2024-09-12T18:35:50.116 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.116 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.116 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.116 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:50.116 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.101324+0000", 2024-09-12T18:35:50.116 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.116 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.116 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.116 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:50.116 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.101325+0000", 2024-09-12T18:35:50.117 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5799999999999998e-07 2024-09-12T18:35:50.117 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.117 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.117 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:50.117 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.101380+0000", 2024-09-12T18:35:50.117 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4873999999999997e-05 2024-09-12T18:35:50.117 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.117 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.117 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:50.117 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.101389+0000", 2024-09-12T18:35:50.117 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.0189999999999995e-06 2024-09-12T18:35:50.117 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.117 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.118 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:50.118 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.101393+0000", 2024-09-12T18:35:50.118 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.6090000000000003e-06 2024-09-12T18:35:50.118 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.118 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.118 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:50.118 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.101429+0000", 2024-09-12T18:35:50.118 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.5788999999999999e-05 2024-09-12T18:35:50.118 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.118 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.118 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:50.118 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.101441+0000", 2024-09-12T18:35:50.119 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2097e-05 2024-09-12T18:35:50.119 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.119 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:50.119 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.119 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.119 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.119 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:14386 5.e e25/21 5:716f9352:::benchmark_data_smithi073_23739_object14385:head v 25'910, mlcod=25'906)", 2024-09-12T18:35:50.119 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:50.099085+0000", 2024-09-12T18:35:50.119 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0023052889999999999, 2024-09-12T18:35:50.119 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0024681210000000002, 2024-09-12T18:35:50.119 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:50.119 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:50.119 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:35:50.120 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:50.120 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.120 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:50.120 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.099085+0000", 2024-09-12T18:35:50.120 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.120 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.120 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.120 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:50.120 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.099085+0000", 2024-09-12T18:35:50.120 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.120 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.120 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.121 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:50.121 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.099086+0000", 2024-09-12T18:35:50.121 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4600000000000004e-07 2024-09-12T18:35:50.121 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.121 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.121 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:50.121 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.099159+0000", 2024-09-12T18:35:50.121 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3427e-05 2024-09-12T18:35:50.121 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.121 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.121 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:50.121 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.099171+0000", 2024-09-12T18:35:50.122 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1841999999999999e-05 2024-09-12T18:35:50.122 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.122 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.122 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:50.122 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.099178+0000", 2024-09-12T18:35:50.122 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.9709999999999998e-06 2024-09-12T18:35:50.122 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.122 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.122 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:50.122 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.099803+0000", 2024-09-12T18:35:50.122 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00062467499999999999 2024-09-12T18:35:50.122 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.123 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.123 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:50.123 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.099820+0000", 2024-09-12T18:35:50.123 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7586000000000001e-05 2024-09-12T18:35:50.123 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.123 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:50.123 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.123 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.123 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.123 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:14391 5.5 5:a2af116a:::benchmark_data_smithi073_23739_object14390:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:35:50.123 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:50.099173+0000", 2024-09-12T18:35:50.123 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0022178229999999998, 2024-09-12T18:35:50.123 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0024097950000000002, 2024-09-12T18:35:50.123 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:50.124 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:50.124 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:50.124 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:35:50.124 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:35:50.124 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:50.124 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 14391 2024-09-12T18:35:50.124 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.124 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:50.124 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.124 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:50.124 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.099173+0000", 2024-09-12T18:35:50.124 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.124 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.125 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.125 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:50.125 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.099173+0000", 2024-09-12T18:35:50.125 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.125 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.125 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.125 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:50.125 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.099174+0000", 2024-09-12T18:35:50.125 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.5999999999999991e-07 2024-09-12T18:35:50.125 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.125 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.125 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:50.125 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.099218+0000", 2024-09-12T18:35:50.125 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4192e-05 2024-09-12T18:35:50.126 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.126 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.126 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:50.126 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.099241+0000", 2024-09-12T18:35:50.126 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.3323999999999999e-05 2024-09-12T18:35:50.126 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.126 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.126 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:50.126 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.099288+0000", 2024-09-12T18:35:50.126 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.7225999999999998e-05 2024-09-12T18:35:50.126 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.126 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.126 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:50.127 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.099348+0000", 2024-09-12T18:35:50.127 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9277000000000002e-05 2024-09-12T18:35:50.127 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.127 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.127 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:50.127 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.099440+0000", 2024-09-12T18:35:50.127 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2918999999999996e-05 2024-09-12T18:35:50.127 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.127 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.127 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:50.127 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.099516+0000", 2024-09-12T18:35:50.127 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5605999999999994e-05 2024-09-12T18:35:50.127 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.127 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.128 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:35:50.128 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:50.100911+0000", 2024-09-12T18:35:50.128 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00139459 2024-09-12T18:35:50.128 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.128 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:50.128 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.128 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.128 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-12T18:35:50.128 INFO:teuthology.orchestra.run.smithi114.stdout: "num_ops": 6 2024-09-12T18:35:50.128 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:35:50.130 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:35:50.131 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:50.126+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:50.230 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:50.226+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:50.287 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:35:50.288 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2024-09-12T18:35:50.288 INFO:teuthology.orchestra.run.smithi114.stdout: "complaint_time": 30, 2024-09-12T18:35:50.288 INFO:teuthology.orchestra.run.smithi114.stdout: "num_blocked_ops": 0 2024-09-12T18:35:50.288 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:35:50.310 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:35:50.330 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:50.331+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:50.431 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:50.429+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:50.478 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:35:50.478 INFO:teuthology.orchestra.run.smithi114.stdout: "size": 20, 2024-09-12T18:35:50.478 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 600, 2024-09-12T18:35:50.478 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:35:50.478 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.479 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:50.479 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:35:50.479 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 24.847521105999999, 2024-09-12T18:35:50.479 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.042475618999999999, 2024-09-12T18:35:50.479 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:50.479 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:50.479 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:50.479 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:50.479 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.479 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:50.479 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:35:50.479 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.479 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.479 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.480 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:50.480 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:35:50.480 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.480 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.480 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.480 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:50.480 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628450+0000", 2024-09-12T18:35:50.480 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4212999999999999e-05 2024-09-12T18:35:50.480 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.480 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.480 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:50.480 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628463+0000", 2024-09-12T18:35:50.480 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2497000000000001e-05 2024-09-12T18:35:50.481 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.481 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.481 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:50.481 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628480+0000", 2024-09-12T18:35:50.481 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7232999999999999e-05 2024-09-12T18:35:50.481 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.481 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.481 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:50.481 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628496+0000", 2024-09-12T18:35:50.481 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6217000000000001e-05 2024-09-12T18:35:50.481 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.481 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.481 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:50.482 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628641+0000", 2024-09-12T18:35:50.482 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000144709 2024-09-12T18:35:50.482 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.482 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.482 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:35:50.482 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628657+0000", 2024-09-12T18:35:50.482 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6266e-05 2024-09-12T18:35:50.482 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.482 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.482 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:50.482 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663103+0000", 2024-09-12T18:35:50.482 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.034445523999999998 2024-09-12T18:35:50.482 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.482 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.483 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:50.483 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663373+0000", 2024-09-12T18:35:50.483 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00027085500000000002 2024-09-12T18:35:50.483 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.483 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.483 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:50.483 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663634+0000", 2024-09-12T18:35:50.483 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000260855 2024-09-12T18:35:50.483 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.483 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.483 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:35:50.483 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670294+0000", 2024-09-12T18:35:50.483 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0066597599999999998 2024-09-12T18:35:50.483 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.484 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.484 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:50.484 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670705+0000", 2024-09-12T18:35:50.484 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00041057099999999998 2024-09-12T18:35:50.484 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.484 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.484 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:50.484 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670820+0000", 2024-09-12T18:35:50.484 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000115111 2024-09-12T18:35:50.484 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.484 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.484 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:50.484 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670912+0000", 2024-09-12T18:35:50.485 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1807999999999999e-05 2024-09-12T18:35:50.485 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.485 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:50.485 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.485 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.485 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.485 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:50.485 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:35:50.485 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 24.847430360000001, 2024-09-12T18:35:50.485 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.044599273000000002, 2024-09-12T18:35:50.485 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:50.485 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:50.485 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:50.486 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:50.486 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.486 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:50.486 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:35:50.486 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.486 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.486 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.486 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:50.486 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:35:50.486 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.486 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.486 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.487 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:50.487 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628528+0000", 2024-09-12T18:35:50.487 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:35:50.487 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.487 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.487 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:50.487 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628537+0000", 2024-09-12T18:35:50.487 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6969999999999999e-06 2024-09-12T18:35:50.488 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.488 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.488 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:50.488 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628560+0000", 2024-09-12T18:35:50.488 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2889000000000001e-05 2024-09-12T18:35:50.488 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.488 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.488 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:50.488 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628576+0000", 2024-09-12T18:35:50.488 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.649e-05 2024-09-12T18:35:50.488 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.488 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.489 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:50.489 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628846+0000", 2024-09-12T18:35:50.489 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00026952500000000001 2024-09-12T18:35:50.489 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.489 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.489 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:35:50.489 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628853+0000", 2024-09-12T18:35:50.489 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6559999999999992e-06 2024-09-12T18:35:50.489 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.489 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.489 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:50.489 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665284+0000", 2024-09-12T18:35:50.489 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.036431140000000001 2024-09-12T18:35:50.490 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.490 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.490 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:50.490 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665494+0000", 2024-09-12T18:35:50.490 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000209762 2024-09-12T18:35:50.490 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.490 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.490 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:50.490 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665816+0000", 2024-09-12T18:35:50.490 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00032162299999999999 2024-09-12T18:35:50.490 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.490 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.490 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:35:50.490 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670382+0000", 2024-09-12T18:35:50.491 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0045656739999999996 2024-09-12T18:35:50.491 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.491 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.491 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:50.491 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.672978+0000", 2024-09-12T18:35:50.491 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.002596068 2024-09-12T18:35:50.491 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.491 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.491 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:50.491 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673058+0000", 2024-09-12T18:35:50.491 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0198999999999996e-05 2024-09-12T18:35:50.491 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.491 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.491 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:50.492 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673126+0000", 2024-09-12T18:35:50.492 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8120000000000005e-05 2024-09-12T18:35:50.492 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.492 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:50.492 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.492 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.492 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.492 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:23 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:50.492 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:35:50.492 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 24.847332554000001, 2024-09-12T18:35:50.492 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045539784, 2024-09-12T18:35:50.492 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:50.492 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:50.493 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:50.493 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:50.493 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.493 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:50.493 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:35:50.493 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.493 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.493 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.493 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:50.493 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:35:50.493 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.493 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.493 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.494 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:50.494 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628626+0000", 2024-09-12T18:35:50.494 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.573e-06 2024-09-12T18:35:50.494 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.494 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.494 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:50.494 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628640+0000", 2024-09-12T18:35:50.494 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3817e-05 2024-09-12T18:35:50.494 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.494 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.494 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:50.494 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628659+0000", 2024-09-12T18:35:50.494 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9539999999999999e-05 2024-09-12T18:35:50.494 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.495 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.495 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:50.495 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628675+0000", 2024-09-12T18:35:50.495 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5739e-05 2024-09-12T18:35:50.495 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.495 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.495 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:50.495 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628815+0000", 2024-09-12T18:35:50.495 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014003299999999999 2024-09-12T18:35:50.495 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.495 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.495 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:35:50.495 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628828+0000", 2024-09-12T18:35:50.495 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2849e-05 2024-09-12T18:35:50.495 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.496 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.496 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:50.496 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651162+0000", 2024-09-12T18:35:50.496 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.022334228000000001 2024-09-12T18:35:50.496 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.496 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.496 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:50.496 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651446+0000", 2024-09-12T18:35:50.496 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00028392800000000002 2024-09-12T18:35:50.496 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.496 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.496 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:50.496 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651746+0000", 2024-09-12T18:35:50.496 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000300091 2024-09-12T18:35:50.497 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.497 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.497 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:35:50.497 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665113+0000", 2024-09-12T18:35:50.497 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013366678 2024-09-12T18:35:50.497 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.497 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.497 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:50.497 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674010+0000", 2024-09-12T18:35:50.497 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0088970520000000008 2024-09-12T18:35:50.497 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.497 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.497 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:50.497 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674104+0000", 2024-09-12T18:35:50.498 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4124999999999998e-05 2024-09-12T18:35:50.498 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.498 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.498 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:50.498 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674164+0000", 2024-09-12T18:35:50.498 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.0130999999999997e-05 2024-09-12T18:35:50.498 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.498 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:50.498 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.498 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.498 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.498 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:26 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:50.498 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:35:50.499 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 24.847259348000001, 2024-09-12T18:35:50.499 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045702136999999997, 2024-09-12T18:35:50.499 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:50.499 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:50.499 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:50.499 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:50.499 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.499 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:50.499 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:35:50.499 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.499 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.499 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.499 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:50.499 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:35:50.500 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.500 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.500 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.500 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:50.500 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628699+0000", 2024-09-12T18:35:50.500 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3859999999999999e-06 2024-09-12T18:35:50.500 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.500 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.500 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:50.500 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628706+0000", 2024-09-12T18:35:50.500 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0169999999999999e-06 2024-09-12T18:35:50.500 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.500 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.501 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:50.501 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628725+0000", 2024-09-12T18:35:50.501 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8683000000000001e-05 2024-09-12T18:35:50.501 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.501 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.501 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:50.501 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628740+0000", 2024-09-12T18:35:50.501 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5413999999999998e-05 2024-09-12T18:35:50.501 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.501 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.501 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:50.501 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628907+0000", 2024-09-12T18:35:50.501 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00016670199999999999 2024-09-12T18:35:50.501 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.502 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.502 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:35:50.502 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628917+0000", 2024-09-12T18:35:50.502 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.046e-05 2024-09-12T18:35:50.502 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.502 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.502 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:50.502 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.660390+0000", 2024-09-12T18:35:50.502 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.031472364000000003 2024-09-12T18:35:50.502 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.502 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.502 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:50.502 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.661767+0000", 2024-09-12T18:35:50.503 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0013769190000000001 2024-09-12T18:35:50.503 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.503 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.503 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:50.503 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.662408+0000", 2024-09-12T18:35:50.503 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00064091099999999998 2024-09-12T18:35:50.503 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.503 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.503 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:35:50.503 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669577+0000", 2024-09-12T18:35:50.503 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.007169412 2024-09-12T18:35:50.503 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.504 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.504 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:50.504 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674244+0000", 2024-09-12T18:35:50.504 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0046671839999999996 2024-09-12T18:35:50.504 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.504 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.504 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:50.504 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674329+0000", 2024-09-12T18:35:50.504 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5276000000000001e-05 2024-09-12T18:35:50.504 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.504 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.504 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:50.504 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674400+0000", 2024-09-12T18:35:50.505 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0408999999999996e-05 2024-09-12T18:35:50.505 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.505 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:50.505 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.505 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.505 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.505 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:50.505 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:35:50.505 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 24.847151679, 2024-09-12T18:35:50.505 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.044572443000000003, 2024-09-12T18:35:50.505 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:50.505 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:50.505 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:50.505 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:50.506 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.506 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:50.506 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:35:50.506 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.506 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.506 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.506 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:50.506 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:35:50.506 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.506 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.506 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.506 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:50.506 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628807+0000", 2024-09-12T18:35:50.507 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3629999999999999e-06 2024-09-12T18:35:50.507 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.507 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.507 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:50.507 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628814+0000", 2024-09-12T18:35:50.507 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.2099999999999996e-06 2024-09-12T18:35:50.507 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.507 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.507 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:50.507 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628832+0000", 2024-09-12T18:35:50.507 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7972999999999999e-05 2024-09-12T18:35:50.507 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.508 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.508 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:50.508 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628854+0000", 2024-09-12T18:35:50.508 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1857000000000001e-05 2024-09-12T18:35:50.508 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.508 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.508 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:50.508 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628984+0000", 2024-09-12T18:35:50.508 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013013599999999999 2024-09-12T18:35:50.508 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.508 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.508 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:35:50.508 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628993+0000", 2024-09-12T18:35:50.509 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:35:50.509 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.509 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.509 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:50.509 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668176+0000", 2024-09-12T18:35:50.509 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.039182211000000002 2024-09-12T18:35:50.509 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.509 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.509 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:50.509 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668481+0000", 2024-09-12T18:35:50.509 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00030499200000000002 2024-09-12T18:35:50.509 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.509 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.510 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:50.510 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668771+0000", 2024-09-12T18:35:50.510 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00029018700000000002 2024-09-12T18:35:50.510 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.510 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.510 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:35:50.510 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.672674+0000", 2024-09-12T18:35:50.510 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0039031890000000001 2024-09-12T18:35:50.510 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.510 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.510 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:50.510 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673214+0000", 2024-09-12T18:35:50.511 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00053981600000000004 2024-09-12T18:35:50.511 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.511 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.511 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:50.511 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673310+0000", 2024-09-12T18:35:50.511 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.6682999999999996e-05 2024-09-12T18:35:50.511 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.511 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.511 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:50.511 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673378+0000", 2024-09-12T18:35:50.511 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7385999999999995e-05 2024-09-12T18:35:50.511 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.511 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:50.511 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.512 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.512 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.512 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:50.512 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:35:50.512 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 24.847015653, 2024-09-12T18:35:50.512 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.041480853999999998, 2024-09-12T18:35:50.512 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:50.512 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:50.512 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:50.512 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:50.512 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.512 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:50.512 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:35:50.513 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.513 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.513 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.513 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:50.513 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:35:50.513 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.513 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.513 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.513 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:50.513 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628943+0000", 2024-09-12T18:35:50.513 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.403e-06 2024-09-12T18:35:50.513 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.513 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.514 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:50.514 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628953+0000", 2024-09-12T18:35:50.514 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0273e-05 2024-09-12T18:35:50.514 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.514 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.514 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:50.514 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628973+0000", 2024-09-12T18:35:50.514 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9959999999999999e-05 2024-09-12T18:35:50.514 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.514 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.514 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:50.514 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628989+0000", 2024-09-12T18:35:50.514 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6447e-05 2024-09-12T18:35:50.514 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.515 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.515 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:50.515 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629144+0000", 2024-09-12T18:35:50.515 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015468900000000001 2024-09-12T18:35:50.515 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.515 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.515 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:35:50.515 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629162+0000", 2024-09-12T18:35:50.515 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7603000000000001e-05 2024-09-12T18:35:50.515 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.515 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.515 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:50.515 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.646927+0000", 2024-09-12T18:35:50.516 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.017765626 2024-09-12T18:35:50.516 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.516 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.516 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:50.516 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.647245+0000", 2024-09-12T18:35:50.516 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00031797699999999999 2024-09-12T18:35:50.516 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.516 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.516 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:50.516 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.647551+0000", 2024-09-12T18:35:50.516 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00030583500000000002 2024-09-12T18:35:50.516 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.516 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.517 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:35:50.517 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651738+0000", 2024-09-12T18:35:50.517 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0041864980000000003 2024-09-12T18:35:50.517 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.517 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.517 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:50.517 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670207+0000", 2024-09-12T18:35:50.517 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018469299000000002 2024-09-12T18:35:50.517 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.517 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.517 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:50.517 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670330+0000", 2024-09-12T18:35:50.517 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012284500000000001 2024-09-12T18:35:50.517 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.518 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.518 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:50.518 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670422+0000", 2024-09-12T18:35:50.518 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2398999999999994e-05 2024-09-12T18:35:50.518 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.518 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:50.518 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.518 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.518 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.518 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:50.518 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:35:50.518 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 24.846938399999999, 2024-09-12T18:35:50.518 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.041623741999999998, 2024-09-12T18:35:50.518 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:50.519 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:50.519 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:35:50.519 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:50.519 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.519 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:50.519 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:35:50.519 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.519 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.519 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.519 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:50.519 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:35:50.519 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.519 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.519 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.519 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:50.520 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629020+0000", 2024-09-12T18:35:50.520 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.15e-06 2024-09-12T18:35:50.520 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.520 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.520 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:50.520 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629023+0000", 2024-09-12T18:35:50.520 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4659999999999999e-06 2024-09-12T18:35:50.520 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.520 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.520 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:50.520 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629037+0000", 2024-09-12T18:35:50.520 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3857e-05 2024-09-12T18:35:50.520 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.521 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.521 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:50.521 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629062+0000", 2024-09-12T18:35:50.521 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4519999999999999e-05 2024-09-12T18:35:50.521 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.521 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.521 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:50.521 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629253+0000", 2024-09-12T18:35:50.521 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000191335 2024-09-12T18:35:50.521 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.522 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.522 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:35:50.522 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629266+0000", 2024-09-12T18:35:50.522 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3322999999999999e-05 2024-09-12T18:35:50.522 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.522 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.522 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:50.522 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648331+0000", 2024-09-12T18:35:50.522 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.019065060000000002 2024-09-12T18:35:50.522 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.522 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.522 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:50.522 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.650044+0000", 2024-09-12T18:35:50.523 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017123959999999999 2024-09-12T18:35:50.523 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.523 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.523 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:50.523 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670642+0000", 2024-09-12T18:35:50.523 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.020598635000000001 2024-09-12T18:35:50.523 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.523 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:50.523 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.523 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.523 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.523 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:50.523 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:35:50.524 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 24.846835068000001, 2024-09-12T18:35:50.524 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.046431252999999999, 2024-09-12T18:35:50.524 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:50.524 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:50.524 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:35:50.524 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:50.524 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.524 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:50.524 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:35:50.524 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.524 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.524 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.524 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:50.525 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:35:50.525 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.525 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.525 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.525 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:50.525 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629123+0000", 2024-09-12T18:35:50.525 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0899999999999999e-06 2024-09-12T18:35:50.525 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.525 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.525 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:50.525 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629138+0000", 2024-09-12T18:35:50.525 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4977000000000001e-05 2024-09-12T18:35:50.525 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.525 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.526 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:50.526 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629149+0000", 2024-09-12T18:35:50.526 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1182999999999999e-05 2024-09-12T18:35:50.526 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.526 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.526 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:50.526 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629157+0000", 2024-09-12T18:35:50.526 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8129999999999996e-06 2024-09-12T18:35:50.526 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.526 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.526 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:50.526 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629223+0000", 2024-09-12T18:35:50.526 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6463000000000004e-05 2024-09-12T18:35:50.527 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.527 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.527 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:35:50.527 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629230+0000", 2024-09-12T18:35:50.527 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1360000000000002e-06 2024-09-12T18:35:50.527 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.527 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.527 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:50.527 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669605+0000", 2024-09-12T18:35:50.527 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.040375518999999999 2024-09-12T18:35:50.527 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.527 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.527 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:50.528 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669840+0000", 2024-09-12T18:35:50.528 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00023520099999999999 2024-09-12T18:35:50.528 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.528 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.528 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:50.528 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.675553+0000", 2024-09-12T18:35:50.528 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0057128709999999996 2024-09-12T18:35:50.528 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.528 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:50.528 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.528 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.528 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.528 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:50.529 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:35:50.529 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 24.846780401, 2024-09-12T18:35:50.529 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.037357044999999998, 2024-09-12T18:35:50.529 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:50.529 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:50.529 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:35:50.529 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:50.529 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.529 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:50.529 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:35:50.529 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.529 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.529 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.530 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:50.530 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:35:50.530 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.530 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.530 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.530 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:50.530 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629178+0000", 2024-09-12T18:35:50.530 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.08e-06 2024-09-12T18:35:50.530 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.530 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.530 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:50.530 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629194+0000", 2024-09-12T18:35:50.530 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5899000000000001e-05 2024-09-12T18:35:50.531 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.531 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.531 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:50.531 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629211+0000", 2024-09-12T18:35:50.531 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7363e-05 2024-09-12T18:35:50.531 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.531 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.531 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:50.531 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629226+0000", 2024-09-12T18:35:50.531 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4567e-05 2024-09-12T18:35:50.531 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.531 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.531 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:50.531 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629299+0000", 2024-09-12T18:35:50.532 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3910000000000002e-05 2024-09-12T18:35:50.532 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.532 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.532 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:35:50.532 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629307+0000", 2024-09-12T18:35:50.532 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5299999999999999e-06 2024-09-12T18:35:50.532 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.532 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.532 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:50.532 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648185+0000", 2024-09-12T18:35:50.532 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018878533999999999 2024-09-12T18:35:50.532 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.532 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.533 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:50.533 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.649724+0000", 2024-09-12T18:35:50.533 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001538841 2024-09-12T18:35:50.533 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.533 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.533 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:50.533 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.666534+0000", 2024-09-12T18:35:50.533 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.016809320999999999 2024-09-12T18:35:50.533 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.533 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:50.533 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.533 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.533 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.533 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T18:35:50.534 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.634726+0000", 2024-09-12T18:35:50.534 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 24.841231481000001, 2024-09-12T18:35:50.534 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012351554000000001, 2024-09-12T18:35:50.534 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:50.534 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:50.534 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "reached pg", 2024-09-12T18:35:50.534 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:50.534 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.534 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:50.534 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.634726+0000", 2024-09-12T18:35:50.534 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.534 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.534 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.534 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:50.534 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.634726+0000", 2024-09-12T18:35:50.535 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.535 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.535 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.535 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:50.535 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.634726+0000", 2024-09-12T18:35:50.535 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7999999999999995e-07 2024-09-12T18:35:50.535 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.535 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.535 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:50.535 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.634742+0000", 2024-09-12T18:35:50.535 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.537e-05 2024-09-12T18:35:50.535 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.535 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.535 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:50.536 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.634788+0000", 2024-09-12T18:35:50.536 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.6059000000000001e-05 2024-09-12T18:35:50.536 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.536 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.536 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:50.536 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.634826+0000", 2024-09-12T18:35:50.536 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.7953000000000001e-05 2024-09-12T18:35:50.536 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.536 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.536 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:50.536 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.641962+0000", 2024-09-12T18:35:50.536 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0071361990000000002 2024-09-12T18:35:50.536 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.537 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.537 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:50.537 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.647077+0000", 2024-09-12T18:35:50.537 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0051152929999999999 2024-09-12T18:35:50.537 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.537 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:50.537 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.537 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.537 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.537 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:35:50.537 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.648091+0000", 2024-09-12T18:35:50.537 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 24.827865810999999, 2024-09-12T18:35:50.537 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015212766000000001, 2024-09-12T18:35:50.537 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:50.538 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:50.538 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:50.538 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:50.538 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.538 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:50.538 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648091+0000", 2024-09-12T18:35:50.538 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.538 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.538 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.538 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:50.538 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648091+0000", 2024-09-12T18:35:50.538 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.538 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.539 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.539 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:50.539 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648092+0000", 2024-09-12T18:35:50.539 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.26e-06 2024-09-12T18:35:50.540 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.540 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.540 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:50.540 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648123+0000", 2024-09-12T18:35:50.540 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.0719000000000002e-05 2024-09-12T18:35:50.540 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.540 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.541 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:50.541 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648140+0000", 2024-09-12T18:35:50.541 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6650000000000002e-05 2024-09-12T18:35:50.541 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.541 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.541 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:50.541 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648153+0000", 2024-09-12T18:35:50.541 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.278e-05 2024-09-12T18:35:50.541 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.541 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.541 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:50.541 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.649756+0000", 2024-09-12T18:35:50.541 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0016036379999999999 2024-09-12T18:35:50.542 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.542 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.542 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:50.542 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.649800+0000", 2024-09-12T18:35:50.542 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3748999999999997e-05 2024-09-12T18:35:50.542 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.542 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.542 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:50.542 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663215+0000", 2024-09-12T18:35:50.542 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013414733999999999 2024-09-12T18:35:50.542 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.542 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.542 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:50.542 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663304+0000", 2024-09-12T18:35:50.543 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.9235999999999997e-05 2024-09-12T18:35:50.543 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.543 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:50.543 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.543 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.543 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.543 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T18:35:50.543 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.648176+0000", 2024-09-12T18:35:50.543 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 24.827781401999999, 2024-09-12T18:35:50.543 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015315812, 2024-09-12T18:35:50.543 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:50.543 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:50.543 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:50.543 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:50.544 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.544 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:50.544 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648176+0000", 2024-09-12T18:35:50.544 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.544 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.544 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.544 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:50.544 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648176+0000", 2024-09-12T18:35:50.544 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.544 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.544 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.544 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:50.544 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648176+0000", 2024-09-12T18:35:50.545 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.9400000000000005e-07 2024-09-12T18:35:50.545 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.545 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.545 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:50.545 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648184+0000", 2024-09-12T18:35:50.545 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4730000000000003e-06 2024-09-12T18:35:50.545 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.545 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.545 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:50.545 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648201+0000", 2024-09-12T18:35:50.545 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7119999999999999e-05 2024-09-12T18:35:50.545 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.545 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.545 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:50.546 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648214+0000", 2024-09-12T18:35:50.546 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3343000000000001e-05 2024-09-12T18:35:50.546 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.546 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.546 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:50.546 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651085+0000", 2024-09-12T18:35:50.546 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0028710850000000002 2024-09-12T18:35:50.546 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.546 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.546 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:50.546 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651114+0000", 2024-09-12T18:35:50.546 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.8296000000000001e-05 2024-09-12T18:35:50.546 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.547 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.547 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:50.547 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663360+0000", 2024-09-12T18:35:50.547 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012246801999999999 2024-09-12T18:35:50.547 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.547 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.547 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:50.547 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663491+0000", 2024-09-12T18:35:50.547 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000130999 2024-09-12T18:35:50.547 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.547 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:50.547 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.548 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.548 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.548 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T18:35:50.548 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.648235+0000", 2024-09-12T18:35:50.548 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 24.827721862000001, 2024-09-12T18:35:50.548 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015168310000000001, 2024-09-12T18:35:50.548 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:50.548 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:50.548 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:50.548 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:50.548 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.548 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:50.548 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648235+0000", 2024-09-12T18:35:50.549 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.549 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.549 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.549 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:50.549 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648235+0000", 2024-09-12T18:35:50.549 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.549 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.549 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.549 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:50.549 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648236+0000", 2024-09-12T18:35:50.549 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5300000000000003e-07 2024-09-12T18:35:50.549 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.549 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.549 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:50.550 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648244+0000", 2024-09-12T18:35:50.550 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.7170000000000008e-06 2024-09-12T18:35:50.550 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.550 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.550 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:50.550 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648259+0000", 2024-09-12T18:35:50.550 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5126000000000001e-05 2024-09-12T18:35:50.550 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.550 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.550 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:50.550 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648270+0000", 2024-09-12T18:35:50.550 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0933e-05 2024-09-12T18:35:50.550 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.550 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.551 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:50.551 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.650395+0000", 2024-09-12T18:35:50.551 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0021251040000000001 2024-09-12T18:35:50.551 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.551 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.551 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:50.551 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.650444+0000", 2024-09-12T18:35:50.551 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9456000000000002e-05 2024-09-12T18:35:50.551 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.551 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.551 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:50.551 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663311+0000", 2024-09-12T18:35:50.551 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012866658 2024-09-12T18:35:50.551 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.552 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.552 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:50.552 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663403+0000", 2024-09-12T18:35:50.552 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2563000000000001e-05 2024-09-12T18:35:50.552 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.552 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:50.552 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.552 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.552 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.552 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T18:35:50.553 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:27.625852+0000", 2024-09-12T18:35:50.553 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 22.850105452000001, 2024-09-12T18:35:50.553 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011004888000000001, 2024-09-12T18:35:50.553 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:50.553 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:50.553 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:50.553 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:50.553 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.553 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:50.553 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:27.625852+0000", 2024-09-12T18:35:50.553 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.553 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.553 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.553 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:50.554 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:27.625852+0000", 2024-09-12T18:35:50.554 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.554 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.554 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.554 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:50.554 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:27.625854+0000", 2024-09-12T18:35:50.554 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.5000000000000002e-06 2024-09-12T18:35:50.554 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.554 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.554 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:50.554 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:27.625868+0000", 2024-09-12T18:35:50.554 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3689999999999999e-05 2024-09-12T18:35:50.554 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.555 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.555 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:50.555 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:27.625899+0000", 2024-09-12T18:35:50.555 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.0796000000000001e-05 2024-09-12T18:35:50.555 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.555 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.555 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:50.555 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:27.625913+0000", 2024-09-12T18:35:50.555 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4637000000000001e-05 2024-09-12T18:35:50.555 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.555 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.555 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:50.555 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:27.626065+0000", 2024-09-12T18:35:50.555 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015139799999999999 2024-09-12T18:35:50.556 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.556 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.556 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:35:50.556 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:27.626074+0000", 2024-09-12T18:35:50.556 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.6399999999999992e-06 2024-09-12T18:35:50.556 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.556 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.556 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:50.556 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:27.633983+0000", 2024-09-12T18:35:50.556 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0079088519999999992 2024-09-12T18:35:50.556 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.557 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.557 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:50.557 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:27.634198+0000", 2024-09-12T18:35:50.557 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00021542499999999999 2024-09-12T18:35:50.557 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.557 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.557 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:50.557 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:27.634372+0000", 2024-09-12T18:35:50.557 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000173022 2024-09-12T18:35:50.557 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.557 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.557 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:35:50.557 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:27.635551+0000", 2024-09-12T18:35:50.557 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001179561 2024-09-12T18:35:50.558 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.558 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.558 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:50.558 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:27.636721+0000", 2024-09-12T18:35:50.558 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001169738 2024-09-12T18:35:50.558 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.558 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.558 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:50.558 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:27.636794+0000", 2024-09-12T18:35:50.558 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3576000000000002e-05 2024-09-12T18:35:50.558 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.558 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.558 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:50.558 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:27.636856+0000", 2024-09-12T18:35:50.559 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2052999999999997e-05 2024-09-12T18:35:50.559 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.559 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:50.559 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.559 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.559 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.559 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:12 5.5 5:a9782381:::benchmark_data_smithi073_23739_object11:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:35:50.559 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:45.868934+0000", 2024-09-12T18:35:50.559 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4.6070231100000001, 2024-09-12T18:35:50.559 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011258424, 2024-09-12T18:35:50.559 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:50.559 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:50.560 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:50.560 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:35:50.560 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:35:50.560 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:50.560 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 12 2024-09-12T18:35:50.560 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.560 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:50.560 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.560 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:50.560 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.868934+0000", 2024-09-12T18:35:50.560 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.561 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.561 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.561 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:50.561 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.868934+0000", 2024-09-12T18:35:50.562 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.563 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.563 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.563 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:50.563 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.868935+0000", 2024-09-12T18:35:50.563 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.64e-07 2024-09-12T18:35:50.563 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.563 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.563 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:50.563 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.869119+0000", 2024-09-12T18:35:50.563 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00018435500000000001 2024-09-12T18:35:50.563 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.563 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.564 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:50.564 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.869138+0000", 2024-09-12T18:35:50.564 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8295999999999999e-05 2024-09-12T18:35:50.564 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.564 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.564 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:50.564 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.869148+0000", 2024-09-12T18:35:50.564 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0074e-05 2024-09-12T18:35:50.564 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.564 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.564 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:50.564 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.870937+0000", 2024-09-12T18:35:50.564 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017889500000000001 2024-09-12T18:35:50.564 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.565 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.565 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:50.565 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.871253+0000", 2024-09-12T18:35:50.565 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000316294 2024-09-12T18:35:50.565 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.565 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.565 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:50.565 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.871703+0000", 2024-09-12T18:35:50.565 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00045021599999999997 2024-09-12T18:35:50.565 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.565 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.565 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:50.565 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.879053+0000", 2024-09-12T18:35:50.565 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0073496969999999997 2024-09-12T18:35:50.566 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.566 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.566 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:35:50.566 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.879940+0000", 2024-09-12T18:35:50.566 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00088750999999999999 2024-09-12T18:35:50.566 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.566 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.566 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:50.566 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.880089+0000", 2024-09-12T18:35:50.566 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000148842 2024-09-12T18:35:50.566 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.566 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.566 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:50.566 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.880192+0000", 2024-09-12T18:35:50.567 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000103226 2024-09-12T18:35:50.567 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.567 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:50.567 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.567 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.567 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.567 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:50 5.6 5:66213960:::benchmark_data_smithi073_23739_object49:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:35:50.567 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:45.893135+0000", 2024-09-12T18:35:50.567 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4.5828222629999997, 2024-09-12T18:35:50.567 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011908922000000001, 2024-09-12T18:35:50.567 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:50.567 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:50.567 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:50.567 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:35:50.568 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:35:50.568 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:50.568 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 50 2024-09-12T18:35:50.568 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.568 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:50.568 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.568 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:50.568 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.893135+0000", 2024-09-12T18:35:50.568 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.568 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.568 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.568 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:50.568 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.893135+0000", 2024-09-12T18:35:50.569 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.569 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.569 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.569 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:50.569 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.893137+0000", 2024-09-12T18:35:50.569 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.3499999999999999e-06 2024-09-12T18:35:50.569 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.569 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.569 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:50.569 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.893304+0000", 2024-09-12T18:35:50.569 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000166859 2024-09-12T18:35:50.569 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.569 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.569 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:50.570 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.893329+0000", 2024-09-12T18:35:50.570 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.5386000000000001e-05 2024-09-12T18:35:50.570 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.570 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.570 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:50.570 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.893349+0000", 2024-09-12T18:35:50.570 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9547000000000001e-05 2024-09-12T18:35:50.570 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.570 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.570 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:50.570 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.894135+0000", 2024-09-12T18:35:50.570 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00078617699999999999 2024-09-12T18:35:50.570 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.570 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.571 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:50.571 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.894339+0000", 2024-09-12T18:35:50.571 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000203978 2024-09-12T18:35:50.571 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.571 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.571 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:50.571 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.894635+0000", 2024-09-12T18:35:50.571 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00029639500000000002 2024-09-12T18:35:50.571 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.571 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.571 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:50.571 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.897773+0000", 2024-09-12T18:35:50.571 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0031377990000000001 2024-09-12T18:35:50.571 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.572 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.572 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:35:50.572 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.904811+0000", 2024-09-12T18:35:50.572 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0070375860000000002 2024-09-12T18:35:50.572 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.572 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.572 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:50.572 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.904938+0000", 2024-09-12T18:35:50.572 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012709599999999999 2024-09-12T18:35:50.572 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.572 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.572 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:50.572 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.905044+0000", 2024-09-12T18:35:50.572 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00010574899999999999 2024-09-12T18:35:50.573 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.573 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:50.573 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.573 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.573 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.573 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:55 5.6 5:64da22f0:::benchmark_data_smithi073_23739_object54:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:35:50.573 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:45.896733+0000", 2024-09-12T18:35:50.573 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4.5792241469999997, 2024-09-12T18:35:50.573 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012070236999999999, 2024-09-12T18:35:50.573 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:50.573 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:50.573 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:50.573 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:35:50.574 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:35:50.574 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:50.574 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 55 2024-09-12T18:35:50.574 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.574 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:50.574 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.574 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:50.574 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.896733+0000", 2024-09-12T18:35:50.574 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.574 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.574 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.574 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:50.574 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.896733+0000", 2024-09-12T18:35:50.574 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.575 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.575 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.575 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:50.575 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.896735+0000", 2024-09-12T18:35:50.575 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.6359999999999998e-06 2024-09-12T18:35:50.575 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.575 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.575 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:50.575 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.896832+0000", 2024-09-12T18:35:50.575 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.6885999999999994e-05 2024-09-12T18:35:50.575 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.575 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.575 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:50.575 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.896861+0000", 2024-09-12T18:35:50.576 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.8456999999999999e-05 2024-09-12T18:35:50.576 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.576 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.576 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:50.576 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.896912+0000", 2024-09-12T18:35:50.576 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1566000000000001e-05 2024-09-12T18:35:50.576 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.576 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.576 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:50.576 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.898239+0000", 2024-09-12T18:35:50.576 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001326886 2024-09-12T18:35:50.576 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.576 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.577 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:50.577 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.898578+0000", 2024-09-12T18:35:50.577 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00033859800000000001 2024-09-12T18:35:50.577 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.577 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.577 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:50.577 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.898959+0000", 2024-09-12T18:35:50.577 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00038096700000000001 2024-09-12T18:35:50.577 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.577 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.577 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:50.577 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.905356+0000", 2024-09-12T18:35:50.577 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0063968269999999999 2024-09-12T18:35:50.577 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.578 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.578 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:35:50.578 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.908620+0000", 2024-09-12T18:35:50.578 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.003263948 2024-09-12T18:35:50.578 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.578 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.578 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:50.578 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.908726+0000", 2024-09-12T18:35:50.578 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000106519 2024-09-12T18:35:50.578 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.578 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.578 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:50.578 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.908803+0000", 2024-09-12T18:35:50.578 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6946999999999994e-05 2024-09-12T18:35:50.579 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.579 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:50.579 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.579 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.579 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.579 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:62 5.6 5:67709b9f:::benchmark_data_smithi073_23739_object61:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:35:50.579 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:45.898027+0000", 2024-09-12T18:35:50.579 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4.5779300909999998, 2024-09-12T18:35:50.579 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.014007786, 2024-09-12T18:35:50.579 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:50.579 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:50.579 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:50.579 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:35:50.579 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:35:50.580 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:50.580 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 62 2024-09-12T18:35:50.580 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.580 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:50.580 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.580 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:50.580 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.898027+0000", 2024-09-12T18:35:50.580 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.580 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.580 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.580 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:50.580 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.898027+0000", 2024-09-12T18:35:50.580 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.581 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.581 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.581 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:50.581 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.898029+0000", 2024-09-12T18:35:50.581 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.554e-06 2024-09-12T18:35:50.581 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.581 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.581 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:50.581 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.898164+0000", 2024-09-12T18:35:50.581 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000134719 2024-09-12T18:35:50.581 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.581 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.581 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:50.581 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.898186+0000", 2024-09-12T18:35:50.582 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1449000000000001e-05 2024-09-12T18:35:50.582 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.582 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.582 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:50.582 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.898199+0000", 2024-09-12T18:35:50.582 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3403e-05 2024-09-12T18:35:50.582 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.582 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.582 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:50.582 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.900978+0000", 2024-09-12T18:35:50.582 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0027789260000000001 2024-09-12T18:35:50.582 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.582 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.582 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:50.583 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.901163+0000", 2024-09-12T18:35:50.583 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00018457200000000001 2024-09-12T18:35:50.583 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.583 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.583 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:50.583 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.901378+0000", 2024-09-12T18:35:50.583 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00021581500000000001 2024-09-12T18:35:50.583 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.583 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.583 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:50.583 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.905487+0000", 2024-09-12T18:35:50.583 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0041085679999999999 2024-09-12T18:35:50.583 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.583 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.584 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:35:50.584 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.911778+0000", 2024-09-12T18:35:50.584 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0062909690000000004 2024-09-12T18:35:50.584 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.584 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.584 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:50.584 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.911923+0000", 2024-09-12T18:35:50.584 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014524199999999999 2024-09-12T18:35:50.584 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.584 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.584 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:50.584 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.912035+0000", 2024-09-12T18:35:50.584 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000111569 2024-09-12T18:35:50.585 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.585 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:50.585 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.585 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.585 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.585 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:67 5.2 e23/21 5:4e4fb020:::benchmark_data_smithi073_23739_object66:head v 23'5, mlcod=23'3)", 2024-09-12T18:35:50.585 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:45.902451+0000", 2024-09-12T18:35:50.585 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4.5735063939999998, 2024-09-12T18:35:50.585 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011085078, 2024-09-12T18:35:50.585 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:50.585 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:50.585 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:50.585 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:50.585 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.586 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:50.586 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.902451+0000", 2024-09-12T18:35:50.586 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.586 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.586 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.586 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:50.586 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.902451+0000", 2024-09-12T18:35:50.586 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.586 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.586 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.586 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:50.586 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.902452+0000", 2024-09-12T18:35:50.586 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.666e-06 2024-09-12T18:35:50.586 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.587 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.587 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:50.587 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.902533+0000", 2024-09-12T18:35:50.587 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0285999999999997e-05 2024-09-12T18:35:50.587 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.587 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.587 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:50.587 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.902550+0000", 2024-09-12T18:35:50.587 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7937000000000001e-05 2024-09-12T18:35:50.588 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.588 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.588 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:50.588 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.902564+0000", 2024-09-12T18:35:50.588 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3076e-05 2024-09-12T18:35:50.588 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.588 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.588 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:50.588 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.902673+0000", 2024-09-12T18:35:50.588 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000109206 2024-09-12T18:35:50.588 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.588 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.588 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:50.588 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.902708+0000", 2024-09-12T18:35:50.589 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.5689999999999999e-05 2024-09-12T18:35:50.589 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.589 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.589 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:50.589 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.913432+0000", 2024-09-12T18:35:50.589 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.010723926999999999 2024-09-12T18:35:50.589 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.589 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.589 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:50.589 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.913536+0000", 2024-09-12T18:35:50.589 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00010329 2024-09-12T18:35:50.589 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.589 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:50.589 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.590 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.590 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.590 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:214 5.3 5:c5bef8c1:::benchmark_data_smithi073_23739_object213:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:35:50.590 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:45.964844+0000", 2024-09-12T18:35:50.590 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4.5111128660000004, 2024-09-12T18:35:50.590 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011440293000000001, 2024-09-12T18:35:50.590 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:50.590 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:50.590 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:50.590 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:35:50.590 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:35:50.590 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:50.590 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 214 2024-09-12T18:35:50.591 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.591 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:50.591 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.591 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:50.591 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.964844+0000", 2024-09-12T18:35:50.591 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.591 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.591 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.591 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:50.591 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.964844+0000", 2024-09-12T18:35:50.591 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:50.591 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.591 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.591 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:50.591 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.964845+0000", 2024-09-12T18:35:50.592 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2640000000000001e-06 2024-09-12T18:35:50.592 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.592 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.592 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:50.592 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.964896+0000", 2024-09-12T18:35:50.592 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.083e-05 2024-09-12T18:35:50.592 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.592 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.592 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:50.592 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.964916+0000", 2024-09-12T18:35:50.592 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.0148000000000001e-05 2024-09-12T18:35:50.592 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.592 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.593 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:50.593 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.964930+0000", 2024-09-12T18:35:50.593 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3515e-05 2024-09-12T18:35:50.593 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.593 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.593 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:50.593 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.966600+0000", 2024-09-12T18:35:50.593 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001669996 2024-09-12T18:35:50.593 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.593 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.593 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:50.593 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.966899+0000", 2024-09-12T18:35:50.593 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00029921400000000001 2024-09-12T18:35:50.593 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.594 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.594 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:50.594 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.967259+0000", 2024-09-12T18:35:50.594 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00035954100000000001 2024-09-12T18:35:50.594 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.594 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.594 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:50.594 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.971259+0000", 2024-09-12T18:35:50.594 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0040004410000000004 2024-09-12T18:35:50.594 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.594 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.594 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:35:50.594 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.976069+0000", 2024-09-12T18:35:50.594 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0048094949999999996 2024-09-12T18:35:50.595 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.595 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.595 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:50.595 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.976195+0000", 2024-09-12T18:35:50.595 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000126802 2024-09-12T18:35:50.595 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:50.595 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:50.595 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:50.595 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.976284+0000", 2024-09-12T18:35:50.595 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.9047000000000003e-05 2024-09-12T18:35:50.595 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.595 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:50.595 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.595 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:50.596 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:50.596 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:35:50.597 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:35:50.598 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:50.593+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:50.698 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:50.693+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:50.748 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:35:50.748 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:35:50.748 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.748 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:16312 5.f e25/21 5:f8b5f1ad:::benchmark_data_smithi073_23739_object16311:head v 25'1026, mlcod=25'1024)", 2024-09-12T18:35:50.748 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:50.744950+0000", 2024-09-12T18:35:50.748 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0048348499999999999, 2024-09-12T18:35:50.749 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0048501639999999997, 2024-09-12T18:35:50.749 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:50.749 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:50.749 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:35:50.749 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:50.749 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.749 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:50.749 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.744950+0000", 2024-09-12T18:35:50.749 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:50.749 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.749 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.749 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:50.749 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.744950+0000", 2024-09-12T18:35:50.750 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:50.750 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.750 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.750 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:50.750 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.744951+0000", 2024-09-12T18:35:50.750 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3600000000000003e-07 2024-09-12T18:35:50.750 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.750 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.750 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:50.750 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.745014+0000", 2024-09-12T18:35:50.750 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.3814999999999998e-05 2024-09-12T18:35:50.750 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.750 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.750 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:50.751 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.745027+0000", 2024-09-12T18:35:50.751 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2638e-05 2024-09-12T18:35:50.751 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.751 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.751 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:50.751 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.745035+0000", 2024-09-12T18:35:50.751 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2300000000000008e-06 2024-09-12T18:35:50.751 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.751 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.751 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:50.751 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.745075+0000", 2024-09-12T18:35:50.751 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9277999999999999e-05 2024-09-12T18:35:50.751 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.752 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.752 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:50.752 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.745090+0000", 2024-09-12T18:35:50.752 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5293000000000001e-05 2024-09-12T18:35:50.752 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:50.752 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:50.752 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:50.752 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.752 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.752 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:16319 5.9 e25/21 5:9e725888:::benchmark_data_smithi073_23739_object16318:head v 25'1019, mlcod=25'1016)", 2024-09-12T18:35:50.752 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:50.745687+0000", 2024-09-12T18:35:50.752 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0040975669999999999, 2024-09-12T18:35:50.752 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041451530000000004, 2024-09-12T18:35:50.753 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:50.753 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:50.753 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:35:50.753 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:50.753 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.753 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:50.753 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.745687+0000", 2024-09-12T18:35:50.753 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:50.753 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.753 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.753 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:50.753 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.745687+0000", 2024-09-12T18:35:50.753 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:50.753 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.754 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.754 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:50.754 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.745688+0000", 2024-09-12T18:35:50.754 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4199999999999995e-07 2024-09-12T18:35:50.754 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.754 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.754 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:50.754 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.745746+0000", 2024-09-12T18:35:50.754 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8254000000000002e-05 2024-09-12T18:35:50.754 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.754 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.754 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:50.754 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.745760+0000", 2024-09-12T18:35:50.755 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3723999999999999e-05 2024-09-12T18:35:50.755 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.755 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.755 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:50.755 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.745768+0000", 2024-09-12T18:35:50.755 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4419999999999998e-06 2024-09-12T18:35:50.755 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.755 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.755 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:50.755 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.745822+0000", 2024-09-12T18:35:50.755 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3637000000000002e-05 2024-09-12T18:35:50.755 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.755 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.755 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:50.756 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.745835+0000", 2024-09-12T18:35:50.756 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2785e-05 2024-09-12T18:35:50.756 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:50.756 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:50.756 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:50.756 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.756 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.756 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:16316 5.f e25/21 5:f7e73d84:::benchmark_data_smithi073_23739_object16315:head v 25'1027, mlcod=25'1024)", 2024-09-12T18:35:50.756 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:50.745883+0000", 2024-09-12T18:35:50.756 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0039018870000000002, 2024-09-12T18:35:50.756 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0039802040000000002, 2024-09-12T18:35:50.756 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:50.756 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:50.757 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:35:50.757 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:50.757 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.757 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:50.757 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.745883+0000", 2024-09-12T18:35:50.757 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:50.757 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.757 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.757 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:50.757 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.745883+0000", 2024-09-12T18:35:50.757 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:50.757 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.757 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.758 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:50.758 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.745883+0000", 2024-09-12T18:35:50.758 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7000000000000005e-07 2024-09-12T18:35:50.758 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.758 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.758 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:50.758 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.745961+0000", 2024-09-12T18:35:50.758 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7682999999999995e-05 2024-09-12T18:35:50.758 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.758 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.758 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:50.758 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.745972+0000", 2024-09-12T18:35:50.758 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0796e-05 2024-09-12T18:35:50.759 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.759 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.759 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:50.759 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.745978+0000", 2024-09-12T18:35:50.759 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4679999999999997e-06 2024-09-12T18:35:50.759 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.759 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.759 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:50.759 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.746026+0000", 2024-09-12T18:35:50.759 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7479999999999999e-05 2024-09-12T18:35:50.759 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.759 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.759 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:50.759 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.746047+0000", 2024-09-12T18:35:50.760 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1276000000000001e-05 2024-09-12T18:35:50.760 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:50.760 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:50.760 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:50.760 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.760 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.760 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:16320 5.0 5:09c89096:::benchmark_data_smithi073_23739_object16319:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:35:50.760 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:50.746840+0000", 2024-09-12T18:35:50.760 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0029450750000000001, 2024-09-12T18:35:50.761 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0030662689999999999, 2024-09-12T18:35:50.761 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:50.761 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:50.761 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:50.761 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:50.761 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:50.761 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:50.761 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 16320 2024-09-12T18:35:50.761 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.761 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:50.761 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.761 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:50.761 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.746840+0000", 2024-09-12T18:35:50.762 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:50.762 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.762 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.762 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:50.762 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.746840+0000", 2024-09-12T18:35:50.762 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:50.762 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.762 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.762 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:50.762 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.746841+0000", 2024-09-12T18:35:50.763 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3680000000000001e-06 2024-09-12T18:35:50.763 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.763 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.763 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:50.763 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.746912+0000", 2024-09-12T18:35:50.763 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1433000000000005e-05 2024-09-12T18:35:50.763 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.763 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.763 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:50.763 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.746928+0000", 2024-09-12T18:35:50.763 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5152e-05 2024-09-12T18:35:50.763 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.763 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.764 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:50.764 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.746938+0000", 2024-09-12T18:35:50.764 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9960000000000005e-06 2024-09-12T18:35:50.764 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.764 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.764 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:50.764 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.746980+0000", 2024-09-12T18:35:50.764 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1992e-05 2024-09-12T18:35:50.764 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.764 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.764 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:50.764 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.747067+0000", 2024-09-12T18:35:50.764 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7732999999999995e-05 2024-09-12T18:35:50.764 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.765 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.765 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:50.765 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.747148+0000", 2024-09-12T18:35:50.765 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0710000000000005e-05 2024-09-12T18:35:50.765 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.765 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.765 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:50.765 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.749569+0000", 2024-09-12T18:35:50.765 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0024205910000000001 2024-09-12T18:35:50.765 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:50.765 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:50.765 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:50.765 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.766 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.766 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:16321 5.f e25/21 5:f8ef4f44:::benchmark_data_smithi073_23739_object16320:head v 25'1028, mlcod=25'1024)", 2024-09-12T18:35:50.766 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:50.747694+0000", 2024-09-12T18:35:50.766 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0020910299999999998, 2024-09-12T18:35:50.766 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022576499999999999, 2024-09-12T18:35:50.766 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:50.766 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:50.766 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:35:50.766 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:50.766 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.766 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:50.766 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.747694+0000", 2024-09-12T18:35:50.766 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:50.767 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.767 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.767 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:50.767 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.747694+0000", 2024-09-12T18:35:50.767 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:50.767 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.767 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.767 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:50.767 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.747694+0000", 2024-09-12T18:35:50.767 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.9500000000000002e-07 2024-09-12T18:35:50.767 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.767 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.767 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:50.767 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.747742+0000", 2024-09-12T18:35:50.768 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7786e-05 2024-09-12T18:35:50.768 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.768 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.768 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:50.768 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.747755+0000", 2024-09-12T18:35:50.768 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.294e-05 2024-09-12T18:35:50.768 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.768 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.768 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:50.768 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.747763+0000", 2024-09-12T18:35:50.768 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9859999999999994e-06 2024-09-12T18:35:50.768 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.768 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.769 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:50.769 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.747840+0000", 2024-09-12T18:35:50.769 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7084999999999998e-05 2024-09-12T18:35:50.769 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.769 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.769 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:50.769 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.747862+0000", 2024-09-12T18:35:50.769 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1654e-05 2024-09-12T18:35:50.769 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:50.769 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:50.769 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:50.769 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.769 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.769 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:16325 5.b 5.f2bc3bfb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:35:50.770 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:50.749856+0000", 2024-09-12T18:35:50.770 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4294967295.999929, 2024-09-12T18:35:50.770 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012424699999999999, 2024-09-12T18:35:50.770 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:50.770 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:50.770 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-09-12T18:35:50.770 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:50.770 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:50.770 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:50.770 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 16325 2024-09-12T18:35:50.770 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.770 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:50.770 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.771 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:50.771 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.749856+0000", 2024-09-12T18:35:50.771 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:50.771 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.771 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.771 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:50.771 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.749856+0000", 2024-09-12T18:35:50.771 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:50.771 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.771 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.771 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:50.771 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.749857+0000", 2024-09-12T18:35:50.771 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5799999999999998e-07 2024-09-12T18:35:50.771 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.772 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.772 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:50.772 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.749941+0000", 2024-09-12T18:35:50.772 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3848000000000001e-05 2024-09-12T18:35:50.772 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.772 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.772 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:50.772 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.749952+0000", 2024-09-12T18:35:50.772 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1199000000000001e-05 2024-09-12T18:35:50.772 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:50.772 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:50.772 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:50.772 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.749958+0000", 2024-09-12T18:35:50.773 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8590000000000001e-06 2024-09-12T18:35:50.773 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:50.773 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:50.773 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:50.773 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:50.773 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-09-12T18:35:50.773 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 6 2024-09-12T18:35:50.773 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:35:50.774 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:35:50.818 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:50.818+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:50.868 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 5 16 16711 16695 208.665 187.812 0.00431245 0.00478542 2024-09-12T18:35:50.900 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:50.897+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:50.932 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:35:50.933 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-09-12T18:35:50.933 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-09-12T18:35:50.933 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-09-12T18:35:50.933 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:35:50.953 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:35:51.000 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:50.997+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:51.101 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:51.098+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:51.152 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:35:51.153 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-09-12T18:35:51.153 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-09-12T18:35:51.153 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:35:51.153 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.153 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:51.153 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:35:51.153 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 25.520035618000001, 2024-09-12T18:35:51.153 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025088781000000001, 2024-09-12T18:35:51.153 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:51.153 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:51.153 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:51.153 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:51.154 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.154 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:51.154 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:35:51.154 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:51.154 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.154 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.154 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:51.154 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:35:51.154 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:51.154 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.154 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.154 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:51.154 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632518+0000", 2024-09-12T18:35:51.155 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:35:51.155 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.155 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.155 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:51.155 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632533+0000", 2024-09-12T18:35:51.155 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5130000000000001e-05 2024-09-12T18:35:51.155 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.155 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.155 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:51.155 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632564+0000", 2024-09-12T18:35:51.155 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0788999999999999e-05 2024-09-12T18:35:51.155 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.155 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.155 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.156 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632590+0000", 2024-09-12T18:35:51.156 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6057000000000001e-05 2024-09-12T18:35:51.156 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.156 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.156 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:51.156 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.635931+0000", 2024-09-12T18:35:51.156 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033411320000000001 2024-09-12T18:35:51.156 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.156 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.156 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:51.156 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636186+0000", 2024-09-12T18:35:51.156 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025452500000000002 2024-09-12T18:35:51.157 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.157 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.157 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:51.157 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636445+0000", 2024-09-12T18:35:51.157 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000259268 2024-09-12T18:35:51.157 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.157 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.157 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:51.157 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639562+0000", 2024-09-12T18:35:51.157 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031167 2024-09-12T18:35:51.157 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.157 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.158 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:51.158 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657314+0000", 2024-09-12T18:35:51.158 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017752562 2024-09-12T18:35:51.158 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.158 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.158 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:51.158 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657445+0000", 2024-09-12T18:35:51.158 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013105899999999999 2024-09-12T18:35:51.158 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.158 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.159 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:51.159 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657598+0000", 2024-09-12T18:35:51.159 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015247899999999999 2024-09-12T18:35:51.159 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:51.159 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:51.159 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:51.159 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.159 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.159 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:51.159 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:35:51.159 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 25.519909415000001, 2024-09-12T18:35:51.159 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025643131999999999, 2024-09-12T18:35:51.159 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:51.159 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:51.160 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:51.160 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:51.160 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.160 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:51.160 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:35:51.160 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:51.160 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.160 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.160 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:51.160 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:35:51.160 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:51.160 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.160 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.160 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:51.161 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632637+0000", 2024-09-12T18:35:51.161 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5600000000000001e-06 2024-09-12T18:35:51.161 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.161 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.161 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:51.161 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632650+0000", 2024-09-12T18:35:51.161 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3186e-05 2024-09-12T18:35:51.161 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.161 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.161 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:51.161 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632672+0000", 2024-09-12T18:35:51.161 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2013000000000001e-05 2024-09-12T18:35:51.161 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.161 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.162 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.162 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632687+0000", 2024-09-12T18:35:51.162 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5109999999999999e-05 2024-09-12T18:35:51.162 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.162 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.162 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:51.162 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636994+0000", 2024-09-12T18:35:51.162 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0043065539999999998 2024-09-12T18:35:51.162 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.162 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.162 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:51.162 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637198+0000", 2024-09-12T18:35:51.163 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020387199999999999 2024-09-12T18:35:51.163 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.163 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.163 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:51.163 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637475+0000", 2024-09-12T18:35:51.163 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027731000000000001 2024-09-12T18:35:51.163 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.163 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.163 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:51.163 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639574+0000", 2024-09-12T18:35:51.163 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020988999999999999 2024-09-12T18:35:51.163 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.164 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.164 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:51.164 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658057+0000", 2024-09-12T18:35:51.164 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018482926 2024-09-12T18:35:51.164 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.164 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.164 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:51.164 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658184+0000", 2024-09-12T18:35:51.164 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012756200000000001 2024-09-12T18:35:51.164 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.164 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.164 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:51.164 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658278+0000", 2024-09-12T18:35:51.165 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4139000000000001e-05 2024-09-12T18:35:51.165 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:51.165 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:51.165 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:51.165 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.165 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.165 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:51.165 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:35:51.165 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 25.519834323000001, 2024-09-12T18:35:51.165 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025238883, 2024-09-12T18:35:51.165 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:51.165 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:51.165 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:51.165 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:51.165 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.166 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:51.166 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:35:51.166 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:51.166 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.166 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.166 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:51.166 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:35:51.166 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:51.166 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.166 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.166 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:51.166 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632712+0000", 2024-09-12T18:35:51.166 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6869999999999999e-06 2024-09-12T18:35:51.167 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.167 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.167 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:51.167 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632719+0000", 2024-09-12T18:35:51.167 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6059999999999999e-06 2024-09-12T18:35:51.167 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.167 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.167 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:51.167 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632737+0000", 2024-09-12T18:35:51.167 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7983999999999999e-05 2024-09-12T18:35:51.167 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.167 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.167 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.168 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632751+0000", 2024-09-12T18:35:51.168 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4473e-05 2024-09-12T18:35:51.168 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.168 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.168 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:51.168 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636961+0000", 2024-09-12T18:35:51.168 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042100840000000002 2024-09-12T18:35:51.168 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.168 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.168 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:51.168 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637211+0000", 2024-09-12T18:35:51.168 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000249738 2024-09-12T18:35:51.169 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.169 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.169 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:51.169 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637504+0000", 2024-09-12T18:35:51.169 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00029271499999999998 2024-09-12T18:35:51.169 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.169 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.169 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:51.169 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639582+0000", 2024-09-12T18:35:51.169 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020783389999999998 2024-09-12T18:35:51.169 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.169 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.170 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:51.170 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657709+0000", 2024-09-12T18:35:51.170 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018126758999999999 2024-09-12T18:35:51.170 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.170 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.170 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:51.170 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657830+0000", 2024-09-12T18:35:51.170 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000121329 2024-09-12T18:35:51.170 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.170 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.170 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:51.170 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657949+0000", 2024-09-12T18:35:51.170 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000119169 2024-09-12T18:35:51.171 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:51.171 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:51.171 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:51.171 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.171 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.171 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:51.171 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:35:51.171 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 25.519770276999999, 2024-09-12T18:35:51.171 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026711823999999999, 2024-09-12T18:35:51.171 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:51.171 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:51.171 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:51.171 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:51.172 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.172 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:51.172 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:35:51.172 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:51.172 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.172 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.172 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:51.172 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:35:51.172 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:51.172 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.172 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.172 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:51.172 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632775+0000", 2024-09-12T18:35:51.172 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9999999999999995e-07 2024-09-12T18:35:51.173 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.173 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.173 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:51.173 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632788+0000", 2024-09-12T18:35:51.173 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2629999999999999e-05 2024-09-12T18:35:51.173 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.173 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.173 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:51.173 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632806+0000", 2024-09-12T18:35:51.173 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:35:51.173 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.173 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.173 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.174 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632820+0000", 2024-09-12T18:35:51.174 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3777e-05 2024-09-12T18:35:51.174 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.174 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.174 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:51.174 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638310+0000", 2024-09-12T18:35:51.174 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054898280000000004 2024-09-12T18:35:51.174 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.174 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.174 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:51.175 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638480+0000", 2024-09-12T18:35:51.175 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016968199999999999 2024-09-12T18:35:51.175 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.175 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.175 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:51.175 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638799+0000", 2024-09-12T18:35:51.175 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031915999999999997 2024-09-12T18:35:51.175 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.175 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.175 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:51.175 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639866+0000", 2024-09-12T18:35:51.175 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001067405 2024-09-12T18:35:51.176 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.176 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.176 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:51.176 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658398+0000", 2024-09-12T18:35:51.176 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018531542000000002 2024-09-12T18:35:51.176 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.176 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.176 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:51.176 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658643+0000", 2024-09-12T18:35:51.176 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00024531500000000002 2024-09-12T18:35:51.176 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.177 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.177 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:51.177 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.659486+0000", 2024-09-12T18:35:51.177 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00084316899999999995 2024-09-12T18:35:51.177 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:51.177 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:51.177 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:51.177 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.177 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.177 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:51.177 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632845+0000", 2024-09-12T18:35:51.177 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 25.519699250999999, 2024-09-12T18:35:51.177 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015333398999999999, 2024-09-12T18:35:51.178 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:51.178 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:51.178 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:51.178 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:51.178 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.178 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:51.178 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632845+0000", 2024-09-12T18:35:51.178 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:51.178 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.178 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.178 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:51.178 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632845+0000", 2024-09-12T18:35:51.178 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:51.178 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.179 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.179 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:51.179 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632847+0000", 2024-09-12T18:35:51.179 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.407e-06 2024-09-12T18:35:51.179 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.179 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.179 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:51.179 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632854+0000", 2024-09-12T18:35:51.179 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1670000000000002e-06 2024-09-12T18:35:51.179 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.179 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.179 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:51.179 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632877+0000", 2024-09-12T18:35:51.179 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2929e-05 2024-09-12T18:35:51.179 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.180 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.180 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.180 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632891+0000", 2024-09-12T18:35:51.180 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3689999999999999e-05 2024-09-12T18:35:51.180 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.180 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.180 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:51.180 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.634571+0000", 2024-09-12T18:35:51.180 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016800929999999999 2024-09-12T18:35:51.180 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.180 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.180 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:51.181 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.635247+0000", 2024-09-12T18:35:51.181 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000676051 2024-09-12T18:35:51.181 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.181 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.181 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:51.181 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636176+0000", 2024-09-12T18:35:51.181 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00092889199999999996 2024-09-12T18:35:51.181 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.181 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.181 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:51.181 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637978+0000", 2024-09-12T18:35:51.181 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018024320000000001 2024-09-12T18:35:51.181 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.181 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.181 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:51.182 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.647862+0000", 2024-09-12T18:35:51.182 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0098842540000000003 2024-09-12T18:35:51.182 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.182 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.182 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:51.182 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.648055+0000", 2024-09-12T18:35:51.182 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00019265499999999999 2024-09-12T18:35:51.182 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.182 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.182 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:51.182 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.648179+0000", 2024-09-12T18:35:51.182 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000123829 2024-09-12T18:35:51.182 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:51.182 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:51.182 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:51.183 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.183 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.183 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:51.183 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:35:51.183 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 25.519543214999999, 2024-09-12T18:35:51.183 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.021357139000000001, 2024-09-12T18:35:51.183 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:51.183 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:51.183 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:51.183 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:51.183 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.183 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:51.183 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:35:51.183 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:51.184 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.184 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.184 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:51.184 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:35:51.184 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:51.184 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.184 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.184 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:51.184 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633003+0000", 2024-09-12T18:35:51.184 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.53e-06 2024-09-12T18:35:51.184 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.184 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.184 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:51.185 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633012+0000", 2024-09-12T18:35:51.185 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9290000000000004e-06 2024-09-12T18:35:51.185 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.185 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.185 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:51.185 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633034+0000", 2024-09-12T18:35:51.185 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2127e-05 2024-09-12T18:35:51.185 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.185 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.185 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.185 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633054+0000", 2024-09-12T18:35:51.185 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9476000000000001e-05 2024-09-12T18:35:51.185 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.186 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.186 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:51.186 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636657+0000", 2024-09-12T18:35:51.186 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036038839999999999 2024-09-12T18:35:51.186 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.186 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.186 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:51.186 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636885+0000", 2024-09-12T18:35:51.186 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022798800000000001 2024-09-12T18:35:51.186 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.186 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.186 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:51.186 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637189+0000", 2024-09-12T18:35:51.186 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030392100000000002 2024-09-12T18:35:51.187 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.187 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.187 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:51.187 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639271+0000", 2024-09-12T18:35:51.187 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020817460000000002 2024-09-12T18:35:51.187 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.187 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.187 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:51.187 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.652371+0000", 2024-09-12T18:35:51.187 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013099417 2024-09-12T18:35:51.187 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.187 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.187 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:51.187 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654255+0000", 2024-09-12T18:35:51.187 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018846049999999999 2024-09-12T18:35:51.188 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.188 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.188 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:51.188 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654359+0000", 2024-09-12T18:35:51.188 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000103516 2024-09-12T18:35:51.188 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:51.188 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:51.188 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:51.188 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.188 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.188 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:51.188 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:35:51.188 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 25.519461523, 2024-09-12T18:35:51.189 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026938645000000001, 2024-09-12T18:35:51.189 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:51.189 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:51.189 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:51.189 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:51.189 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.189 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:51.189 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:35:51.189 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:51.189 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.189 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.189 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:51.189 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:35:51.190 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:51.190 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.190 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.190 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:51.190 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633085+0000", 2024-09-12T18:35:51.190 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:35:51.190 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.190 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.190 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:51.190 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633093+0000", 2024-09-12T18:35:51.190 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3999999999999992e-06 2024-09-12T18:35:51.190 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.190 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.191 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:51.191 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633111+0000", 2024-09-12T18:35:51.191 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8070000000000001e-05 2024-09-12T18:35:51.191 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.191 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.191 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.191 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633126+0000", 2024-09-12T18:35:51.191 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4487e-05 2024-09-12T18:35:51.191 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.191 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.191 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:51.191 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638290+0000", 2024-09-12T18:35:51.191 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0051640269999999999 2024-09-12T18:35:51.192 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.192 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.192 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:51.192 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638547+0000", 2024-09-12T18:35:51.192 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025714100000000001 2024-09-12T18:35:51.192 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.192 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.192 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:51.192 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638850+0000", 2024-09-12T18:35:51.192 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030278400000000001 2024-09-12T18:35:51.192 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.192 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.192 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:51.193 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.640706+0000", 2024-09-12T18:35:51.193 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018564580000000001 2024-09-12T18:35:51.193 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.193 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.193 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:51.193 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658420+0000", 2024-09-12T18:35:51.193 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017714395000000001 2024-09-12T18:35:51.193 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.193 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.193 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:51.193 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658635+0000", 2024-09-12T18:35:51.193 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021413500000000001 2024-09-12T18:35:51.194 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.194 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.194 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:51.194 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.660022+0000", 2024-09-12T18:35:51.194 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001387318 2024-09-12T18:35:51.194 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:51.194 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:51.194 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:51.194 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.194 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.194 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:51.194 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633323+0000", 2024-09-12T18:35:51.194 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 25.519222167999999, 2024-09-12T18:35:51.194 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015717332000000001, 2024-09-12T18:35:51.195 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:51.195 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:51.195 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:35:51.195 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:51.195 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.195 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:51.195 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633323+0000", 2024-09-12T18:35:51.195 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:51.195 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.195 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.195 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:51.195 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633323+0000", 2024-09-12T18:35:51.196 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:51.196 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.196 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.196 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:51.196 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633324+0000", 2024-09-12T18:35:51.196 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7230000000000001e-06 2024-09-12T18:35:51.196 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.196 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.196 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:51.196 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633351+0000", 2024-09-12T18:35:51.196 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7067e-05 2024-09-12T18:35:51.196 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.197 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.197 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:51.197 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633372+0000", 2024-09-12T18:35:51.197 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0429e-05 2024-09-12T18:35:51.197 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.197 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.197 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.197 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633387+0000", 2024-09-12T18:35:51.197 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5659999999999999e-05 2024-09-12T18:35:51.197 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.197 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.197 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:51.197 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633527+0000", 2024-09-12T18:35:51.198 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013991599999999999 2024-09-12T18:35:51.198 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.198 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.198 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:51.198 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633806+0000", 2024-09-12T18:35:51.198 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027858400000000001 2024-09-12T18:35:51.198 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.198 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.198 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:51.198 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.649040+0000", 2024-09-12T18:35:51.198 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015233953 2024-09-12T18:35:51.198 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:51.198 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:51.199 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:51.199 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.199 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.199 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:51.199 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:35:51.199 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 25.519117011999999, 2024-09-12T18:35:51.199 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.020709867, 2024-09-12T18:35:51.199 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:51.199 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:51.199 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:35:51.199 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:51.199 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.199 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:51.199 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:35:51.200 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:51.200 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.200 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.200 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:51.200 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:35:51.200 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:51.200 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.200 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.200 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:51.200 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633429+0000", 2024-09-12T18:35:51.200 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.313e-06 2024-09-12T18:35:51.200 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.200 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.201 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:51.201 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633462+0000", 2024-09-12T18:35:51.201 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3197000000000001e-05 2024-09-12T18:35:51.201 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.201 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.201 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:51.201 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633485+0000", 2024-09-12T18:35:51.201 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3243000000000001e-05 2024-09-12T18:35:51.201 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.201 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.201 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.201 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633501+0000", 2024-09-12T18:35:51.201 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5383000000000002e-05 2024-09-12T18:35:51.202 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.202 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.202 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:51.202 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633642+0000", 2024-09-12T18:35:51.202 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000141168 2024-09-12T18:35:51.202 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.202 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.202 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:51.202 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633982+0000", 2024-09-12T18:35:51.202 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000340067 2024-09-12T18:35:51.202 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.202 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.202 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:51.203 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654138+0000", 2024-09-12T18:35:51.203 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.020155495999999998 2024-09-12T18:35:51.203 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:51.203 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:51.203 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:51.203 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.203 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.203 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:1 5.e 5:7e06fd68:::benchmark_data_smithi073_23739_object0:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:35:51.203 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:45.871264+0000", 2024-09-12T18:35:51.203 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.2812806080000003, 2024-09-12T18:35:51.203 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012442986, 2024-09-12T18:35:51.203 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:51.203 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:51.203 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:51.204 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:51.204 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:51.204 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:51.204 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 1 2024-09-12T18:35:51.204 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.204 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:51.204 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.204 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:51.204 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.871264+0000", 2024-09-12T18:35:51.204 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:51.204 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.204 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.204 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:51.205 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.871264+0000", 2024-09-12T18:35:51.205 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:51.205 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.205 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.205 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:51.205 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.871267+0000", 2024-09-12T18:35:51.205 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3699999999999999e-06 2024-09-12T18:35:51.205 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.205 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.205 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:51.205 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.871685+0000", 2024-09-12T18:35:51.205 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00041753599999999998 2024-09-12T18:35:51.205 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.206 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.206 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:51.206 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.871714+0000", 2024-09-12T18:35:51.206 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8626999999999999e-05 2024-09-12T18:35:51.206 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.206 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.206 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.206 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.871731+0000", 2024-09-12T18:35:51.206 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7229999999999999e-05 2024-09-12T18:35:51.206 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.206 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.206 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:51.206 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.871934+0000", 2024-09-12T18:35:51.206 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020336099999999999 2024-09-12T18:35:51.206 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.207 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.207 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:51.207 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872200+0000", 2024-09-12T18:35:51.207 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026600199999999999 2024-09-12T18:35:51.207 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.207 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.207 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:51.207 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872518+0000", 2024-09-12T18:35:51.207 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031749700000000003 2024-09-12T18:35:51.207 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.207 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.207 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:51.207 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.875939+0000", 2024-09-12T18:35:51.208 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0034210109999999998 2024-09-12T18:35:51.208 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.208 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.208 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:51.208 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.883472+0000", 2024-09-12T18:35:51.208 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0075330909999999996 2024-09-12T18:35:51.208 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.208 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.208 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:51.208 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.883591+0000", 2024-09-12T18:35:51.208 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000119636 2024-09-12T18:35:51.208 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.208 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.208 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:51.209 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.883707+0000", 2024-09-12T18:35:51.209 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011562500000000001 2024-09-12T18:35:51.209 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:51.209 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:51.209 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:51.209 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.209 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.209 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:6 5.8 5:1f55594e:::benchmark_data_smithi073_23739_object5:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:35:51.209 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:45.871821+0000", 2024-09-12T18:35:51.209 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.2807232129999999, 2024-09-12T18:35:51.210 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011937, 2024-09-12T18:35:51.210 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:51.210 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:51.210 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:51.210 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:51.210 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:51.211 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:51.211 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 6 2024-09-12T18:35:51.212 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.212 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:51.212 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.212 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:51.212 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.871821+0000", 2024-09-12T18:35:51.212 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:51.212 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.212 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.212 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:51.212 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.871821+0000", 2024-09-12T18:35:51.212 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:51.212 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.212 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.212 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:51.213 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.871823+0000", 2024-09-12T18:35:51.213 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3999999999999999e-06 2024-09-12T18:35:51.213 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.213 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.213 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:51.213 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872163+0000", 2024-09-12T18:35:51.213 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00033989399999999998 2024-09-12T18:35:51.213 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.213 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.213 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:51.213 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872179+0000", 2024-09-12T18:35:51.213 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5736999999999999e-05 2024-09-12T18:35:51.213 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.214 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.214 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.214 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872189+0000", 2024-09-12T18:35:51.214 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.059e-05 2024-09-12T18:35:51.214 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.214 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.214 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:51.214 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872322+0000", 2024-09-12T18:35:51.214 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000133065 2024-09-12T18:35:51.214 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.214 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.214 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:51.214 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872547+0000", 2024-09-12T18:35:51.214 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022501800000000001 2024-09-12T18:35:51.215 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.215 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.215 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:51.215 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872918+0000", 2024-09-12T18:35:51.215 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00037063100000000001 2024-09-12T18:35:51.215 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.215 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.215 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:51.215 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.875427+0000", 2024-09-12T18:35:51.216 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025094449999999999 2024-09-12T18:35:51.216 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.216 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.216 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:51.216 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.883538+0000", 2024-09-12T18:35:51.216 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081109359999999991 2024-09-12T18:35:51.216 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.216 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.216 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:51.216 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.883643+0000", 2024-09-12T18:35:51.216 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000105059 2024-09-12T18:35:51.216 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.216 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.217 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:51.217 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.883758+0000", 2024-09-12T18:35:51.217 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000115225 2024-09-12T18:35:51.217 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:51.217 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:51.217 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:51.217 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.217 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.217 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:10 5.b 5:d4a107aa:::benchmark_data_smithi073_23739_object9:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:35:51.217 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:45.872222+0000", 2024-09-12T18:35:51.217 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.2803229460000001, 2024-09-12T18:35:51.217 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011615613, 2024-09-12T18:35:51.218 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:51.218 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:51.218 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:51.218 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:51.218 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:51.218 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:51.218 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 10 2024-09-12T18:35:51.218 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.218 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:51.218 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.218 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:51.218 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872222+0000", 2024-09-12T18:35:51.218 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:51.218 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.219 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.219 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:51.219 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872222+0000", 2024-09-12T18:35:51.219 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:51.219 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.219 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.219 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:51.219 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872223+0000", 2024-09-12T18:35:51.219 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.06e-06 2024-09-12T18:35:51.219 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.219 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.219 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:51.219 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872343+0000", 2024-09-12T18:35:51.219 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000120629 2024-09-12T18:35:51.220 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.220 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.220 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:51.220 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872357+0000", 2024-09-12T18:35:51.220 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3665999999999999e-05 2024-09-12T18:35:51.220 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.220 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.220 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.220 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872366+0000", 2024-09-12T18:35:51.220 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.1430000000000004e-06 2024-09-12T18:35:51.220 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.220 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.221 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:51.221 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872476+0000", 2024-09-12T18:35:51.221 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000109246 2024-09-12T18:35:51.221 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.221 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.221 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:51.221 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872823+0000", 2024-09-12T18:35:51.221 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00034779100000000002 2024-09-12T18:35:51.221 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.221 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.221 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:51.221 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.873167+0000", 2024-09-12T18:35:51.221 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00034359400000000002 2024-09-12T18:35:51.221 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.222 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.222 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:51.222 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.876112+0000", 2024-09-12T18:35:51.222 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0029449580000000001 2024-09-12T18:35:51.222 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.222 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.222 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:51.222 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.883609+0000", 2024-09-12T18:35:51.222 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0074967109999999997 2024-09-12T18:35:51.222 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.222 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.222 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:51.223 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.883776+0000", 2024-09-12T18:35:51.223 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016785500000000001 2024-09-12T18:35:51.223 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.223 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.223 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:51.223 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.883837+0000", 2024-09-12T18:35:51.223 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0959999999999999e-05 2024-09-12T18:35:51.223 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:51.223 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:51.224 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:51.224 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.224 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.224 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:15 5.8 5:1781ebe7:::benchmark_data_smithi073_23739_object14:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:35:51.224 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:45.872695+0000", 2024-09-12T18:35:51.224 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.2798494900000001, 2024-09-12T18:35:51.224 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012029096, 2024-09-12T18:35:51.224 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:51.224 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:51.224 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:51.224 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:51.224 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:51.225 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:51.225 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 15 2024-09-12T18:35:51.225 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.225 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:51.225 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.225 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:51.225 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872695+0000", 2024-09-12T18:35:51.225 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:51.225 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.225 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.225 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:51.225 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872695+0000", 2024-09-12T18:35:51.226 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:51.226 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.226 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.226 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:51.226 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872697+0000", 2024-09-12T18:35:51.226 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.407e-06 2024-09-12T18:35:51.226 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.226 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.226 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:51.226 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872824+0000", 2024-09-12T18:35:51.226 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012739500000000001 2024-09-12T18:35:51.226 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.226 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.227 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:51.227 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872844+0000", 2024-09-12T18:35:51.227 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9973e-05 2024-09-12T18:35:51.227 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.227 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.227 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.227 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872861+0000", 2024-09-12T18:35:51.227 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7220000000000001e-05 2024-09-12T18:35:51.227 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.227 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.227 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:51.227 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.874095+0000", 2024-09-12T18:35:51.227 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00123331 2024-09-12T18:35:51.227 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.228 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.228 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:51.228 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.874443+0000", 2024-09-12T18:35:51.228 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00034860000000000002 2024-09-12T18:35:51.228 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.228 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.228 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:51.228 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.874690+0000", 2024-09-12T18:35:51.228 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00024676500000000003 2024-09-12T18:35:51.228 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.228 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.228 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:51.229 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.876472+0000", 2024-09-12T18:35:51.229 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001781728 2024-09-12T18:35:51.229 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.229 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.229 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:51.229 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.884538+0000", 2024-09-12T18:35:51.229 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080661399999999994 2024-09-12T18:35:51.229 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.229 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.229 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:51.229 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.884632+0000", 2024-09-12T18:35:51.229 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4235999999999997e-05 2024-09-12T18:35:51.229 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.230 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.230 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:51.230 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.884724+0000", 2024-09-12T18:35:51.230 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2322000000000001e-05 2024-09-12T18:35:51.230 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:51.230 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:51.230 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:51.230 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.230 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.230 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:58 5.e 5:72811c8e:::benchmark_data_smithi073_23739_object57:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:35:51.230 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:45.899899+0000", 2024-09-12T18:35:51.230 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.2526452299999997, 2024-09-12T18:35:51.230 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012438803, 2024-09-12T18:35:51.231 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:51.231 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:51.231 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:51.231 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:51.231 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:51.231 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:51.231 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 58 2024-09-12T18:35:51.231 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.231 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:51.231 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.231 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:51.231 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.899899+0000", 2024-09-12T18:35:51.231 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:51.232 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.232 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.232 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:51.232 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.899899+0000", 2024-09-12T18:35:51.232 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:51.232 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.232 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.232 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:51.232 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.899901+0000", 2024-09-12T18:35:51.232 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9530000000000002e-06 2024-09-12T18:35:51.232 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.232 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.232 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:51.233 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.899988+0000", 2024-09-12T18:35:51.233 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6502999999999995e-05 2024-09-12T18:35:51.233 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.233 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.233 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:51.233 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.900015+0000", 2024-09-12T18:35:51.233 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6919000000000001e-05 2024-09-12T18:35:51.233 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.233 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.233 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.233 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.900040+0000", 2024-09-12T18:35:51.233 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5497e-05 2024-09-12T18:35:51.233 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.234 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.234 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:51.234 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.900147+0000", 2024-09-12T18:35:51.234 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000106309 2024-09-12T18:35:51.234 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.234 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.234 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:51.234 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.900371+0000", 2024-09-12T18:35:51.234 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000224792 2024-09-12T18:35:51.234 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.234 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.235 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:51.235 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.900658+0000", 2024-09-12T18:35:51.235 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00028669299999999997 2024-09-12T18:35:51.235 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.235 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.235 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:51.235 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.902976+0000", 2024-09-12T18:35:51.235 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002317815 2024-09-12T18:35:51.235 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.235 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.235 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:51.235 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.912140+0000", 2024-09-12T18:35:51.236 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0091642770000000002 2024-09-12T18:35:51.236 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.236 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.236 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:51.236 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.912259+0000", 2024-09-12T18:35:51.236 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000118465 2024-09-12T18:35:51.236 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.236 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.236 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:51.236 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.912338+0000", 2024-09-12T18:35:51.236 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9579999999999994e-05 2024-09-12T18:35:51.236 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:51.236 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:51.236 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:51.237 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.237 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.237 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:61 5.0 5:077a70fb:::benchmark_data_smithi073_23739_object60:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:35:51.237 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:45.900716+0000", 2024-09-12T18:35:51.237 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.2518284900000003, 2024-09-12T18:35:51.237 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.01152891, 2024-09-12T18:35:51.237 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:51.237 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:51.237 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:51.237 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:51.237 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:51.237 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:51.237 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 61 2024-09-12T18:35:51.238 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.238 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:51.238 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.238 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:51.238 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.900716+0000", 2024-09-12T18:35:51.238 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:51.238 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.238 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.238 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:51.238 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.900716+0000", 2024-09-12T18:35:51.238 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:51.238 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.238 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.238 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:51.239 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.900719+0000", 2024-09-12T18:35:51.239 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5229999999999998e-06 2024-09-12T18:35:51.239 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.239 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.239 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:51.239 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.900807+0000", 2024-09-12T18:35:51.239 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8388999999999997e-05 2024-09-12T18:35:51.239 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.239 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.239 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:51.239 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.900837+0000", 2024-09-12T18:35:51.239 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9750000000000001e-05 2024-09-12T18:35:51.239 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.239 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.240 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.240 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.900855+0000", 2024-09-12T18:35:51.240 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8566000000000001e-05 2024-09-12T18:35:51.240 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.240 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.240 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:51.240 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.901209+0000", 2024-09-12T18:35:51.240 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00035383399999999997 2024-09-12T18:35:51.240 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.240 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.240 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:51.240 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.901526+0000", 2024-09-12T18:35:51.240 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031638400000000001 2024-09-12T18:35:51.241 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.241 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.241 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:51.241 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.901827+0000", 2024-09-12T18:35:51.241 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030095700000000003 2024-09-12T18:35:51.241 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.241 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.241 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:51.241 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.904450+0000", 2024-09-12T18:35:51.241 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0026233350000000001 2024-09-12T18:35:51.241 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.241 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.241 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:51.241 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.912046+0000", 2024-09-12T18:35:51.242 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0075961930000000002 2024-09-12T18:35:51.242 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.242 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.242 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:51.242 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.912159+0000", 2024-09-12T18:35:51.242 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112753 2024-09-12T18:35:51.242 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.242 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.242 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:51.242 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.912245+0000", 2024-09-12T18:35:51.242 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6225999999999997e-05 2024-09-12T18:35:51.242 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:51.242 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:51.243 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:51.243 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.243 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.243 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:210 5.4 5:28535192:::benchmark_data_smithi073_23739_object209:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:35:51.243 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:45.967167+0000", 2024-09-12T18:35:51.243 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.1853774650000002, 2024-09-12T18:35:51.243 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012739489999999999, 2024-09-12T18:35:51.243 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:51.243 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:51.243 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:51.243 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:51.244 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:51.244 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:51.244 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 210 2024-09-12T18:35:51.244 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.244 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:51.244 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.244 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:51.244 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.967167+0000", 2024-09-12T18:35:51.244 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:51.244 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.244 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.244 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:51.244 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.967167+0000", 2024-09-12T18:35:51.245 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:51.245 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.245 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.245 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:51.245 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.967168+0000", 2024-09-12T18:35:51.245 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2419999999999999e-06 2024-09-12T18:35:51.245 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.245 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.245 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:51.245 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.967218+0000", 2024-09-12T18:35:51.245 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9493000000000002e-05 2024-09-12T18:35:51.245 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.246 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.246 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:51.246 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.967234+0000", 2024-09-12T18:35:51.246 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5576000000000001e-05 2024-09-12T18:35:51.246 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.246 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.246 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.246 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.967262+0000", 2024-09-12T18:35:51.246 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8708999999999999e-05 2024-09-12T18:35:51.246 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.246 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.246 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:51.247 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.969263+0000", 2024-09-12T18:35:51.247 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020011479999999999 2024-09-12T18:35:51.247 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.247 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.247 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:51.247 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.969456+0000", 2024-09-12T18:35:51.247 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000192807 2024-09-12T18:35:51.247 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.247 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.247 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:51.247 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.969748+0000", 2024-09-12T18:35:51.247 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00029194600000000001 2024-09-12T18:35:51.247 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.248 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.248 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:51.248 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.972800+0000", 2024-09-12T18:35:51.248 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0030521749999999999 2024-09-12T18:35:51.248 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.248 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.248 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:51.248 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.979658+0000", 2024-09-12T18:35:51.248 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0068579399999999999 2024-09-12T18:35:51.248 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.248 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.248 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:51.249 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.979805+0000", 2024-09-12T18:35:51.249 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000146565 2024-09-12T18:35:51.249 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.249 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.249 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:51.249 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.979907+0000", 2024-09-12T18:35:51.249 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000101889 2024-09-12T18:35:51.249 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:51.249 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:51.249 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:51.249 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.249 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.250 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:212 5.8 5:1652b127:::benchmark_data_smithi073_23739_object211:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:35:51.250 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:45.967455+0000", 2024-09-12T18:35:51.250 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.185089294, 2024-09-12T18:35:51.250 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.01239791, 2024-09-12T18:35:51.250 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:51.250 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:51.250 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:51.250 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:51.250 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:51.250 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:51.250 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 212 2024-09-12T18:35:51.250 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.251 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:51.251 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.251 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:51.251 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.967455+0000", 2024-09-12T18:35:51.251 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:51.251 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.251 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.251 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:51.251 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.967455+0000", 2024-09-12T18:35:51.251 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:51.251 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.251 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.252 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:51.252 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.967457+0000", 2024-09-12T18:35:51.252 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.618e-06 2024-09-12T18:35:51.252 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.252 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.252 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:51.252 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.967530+0000", 2024-09-12T18:35:51.252 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3003999999999994e-05 2024-09-12T18:35:51.252 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.252 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.252 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:51.253 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.967550+0000", 2024-09-12T18:35:51.253 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9536999999999999e-05 2024-09-12T18:35:51.253 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.253 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.253 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.253 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.967561+0000", 2024-09-12T18:35:51.253 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1725e-05 2024-09-12T18:35:51.253 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.253 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.253 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:51.253 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.968822+0000", 2024-09-12T18:35:51.253 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001260749 2024-09-12T18:35:51.253 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.253 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.254 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:51.254 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.969078+0000", 2024-09-12T18:35:51.254 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025636300000000001 2024-09-12T18:35:51.254 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.254 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.254 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:51.254 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.969383+0000", 2024-09-12T18:35:51.254 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030495000000000001 2024-09-12T18:35:51.254 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.254 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.254 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:51.254 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.972624+0000", 2024-09-12T18:35:51.254 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0032410630000000002 2024-09-12T18:35:51.254 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.255 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.255 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:51.255 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.979640+0000", 2024-09-12T18:35:51.255 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0070157919999999999 2024-09-12T18:35:51.255 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.255 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.255 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:51.255 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.979763+0000", 2024-09-12T18:35:51.255 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000123139 2024-09-12T18:35:51.255 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.255 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.255 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:51.255 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.979853+0000", 2024-09-12T18:35:51.255 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9969999999999994e-05 2024-09-12T18:35:51.256 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:51.256 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:51.256 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:51.256 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.256 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.256 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:216 5.4 5:2af5a937:::benchmark_data_smithi073_23739_object215:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:35:51.256 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:45.968483+0000", 2024-09-12T18:35:51.256 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.1840619849999996, 2024-09-12T18:35:51.256 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011756588, 2024-09-12T18:35:51.256 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:51.256 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:51.256 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:51.256 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:51.257 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:51.257 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:51.257 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 216 2024-09-12T18:35:51.257 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.257 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:51.257 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.257 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:51.257 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.968483+0000", 2024-09-12T18:35:51.257 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:51.257 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.257 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.257 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:51.257 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.968483+0000", 2024-09-12T18:35:51.258 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:51.258 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.258 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.258 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:51.258 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.968484+0000", 2024-09-12T18:35:51.258 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2139999999999999e-06 2024-09-12T18:35:51.258 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.258 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.258 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:51.258 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.968603+0000", 2024-09-12T18:35:51.258 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000118861 2024-09-12T18:35:51.258 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.258 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.258 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:51.259 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.968621+0000", 2024-09-12T18:35:51.259 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8600000000000001e-05 2024-09-12T18:35:51.259 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.259 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.259 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.259 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.968635+0000", 2024-09-12T18:35:51.259 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3905e-05 2024-09-12T18:35:51.259 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.259 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.259 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:51.259 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.970847+0000", 2024-09-12T18:35:51.259 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022112260000000002 2024-09-12T18:35:51.259 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.259 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.260 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:51.260 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.971172+0000", 2024-09-12T18:35:51.260 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000325707 2024-09-12T18:35:51.260 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.260 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.260 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:51.260 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.971560+0000", 2024-09-12T18:35:51.260 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00038744400000000003 2024-09-12T18:35:51.260 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.260 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.260 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:51.260 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.974120+0000", 2024-09-12T18:35:51.260 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025601980000000001 2024-09-12T18:35:51.261 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.261 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.261 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:51.261 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.980034+0000", 2024-09-12T18:35:51.261 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.005914168 2024-09-12T18:35:51.261 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.261 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.261 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:51.261 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.980154+0000", 2024-09-12T18:35:51.261 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012042199999999999 2024-09-12T18:35:51.261 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.261 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.261 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:51.262 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.980239+0000", 2024-09-12T18:35:51.262 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4843000000000001e-05 2024-09-12T18:35:51.262 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:51.262 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:51.262 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:51.262 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.262 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.262 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:14489 5.b 5:df8cc6dd:::benchmark_data_smithi073_23739_object14488:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:35:51.262 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:50.138204+0000", 2024-09-12T18:35:51.262 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.0143402130000001, 2024-09-12T18:35:51.262 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012524812, 2024-09-12T18:35:51.262 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:51.262 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:51.263 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:51.263 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:51.263 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:51.263 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:51.263 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 14489 2024-09-12T18:35:51.263 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.263 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:51.263 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.263 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:51.263 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.138204+0000", 2024-09-12T18:35:51.263 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:51.263 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.263 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.263 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:51.264 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.138204+0000", 2024-09-12T18:35:51.264 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:51.264 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.264 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.264 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:51.264 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.138205+0000", 2024-09-12T18:35:51.264 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2399999999999997e-07 2024-09-12T18:35:51.264 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.264 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.264 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:51.264 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.138331+0000", 2024-09-12T18:35:51.264 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000125368 2024-09-12T18:35:51.264 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.265 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.265 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:51.265 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.138338+0000", 2024-09-12T18:35:51.265 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.391e-06 2024-09-12T18:35:51.265 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.265 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.265 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.265 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.138343+0000", 2024-09-12T18:35:51.265 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6609999999999999e-06 2024-09-12T18:35:51.265 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.265 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.265 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:51.265 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.138716+0000", 2024-09-12T18:35:51.266 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00037288000000000002 2024-09-12T18:35:51.266 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.266 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.266 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:51.266 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.138895+0000", 2024-09-12T18:35:51.266 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00017898400000000001 2024-09-12T18:35:51.266 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.266 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.266 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:51.266 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.139094+0000", 2024-09-12T18:35:51.266 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00019899800000000001 2024-09-12T18:35:51.266 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.266 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.266 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:51.267 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.141419+0000", 2024-09-12T18:35:51.267 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002325386 2024-09-12T18:35:51.267 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.267 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.267 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:51.267 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.150525+0000", 2024-09-12T18:35:51.267 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.009106477 2024-09-12T18:35:51.267 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.267 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.267 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:51.267 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.150601+0000", 2024-09-12T18:35:51.267 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5148000000000006e-05 2024-09-12T18:35:51.267 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.267 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.268 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:51.268 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.150729+0000", 2024-09-12T18:35:51.268 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012879499999999999 2024-09-12T18:35:51.268 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:51.268 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:51.268 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:51.268 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.268 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.268 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:14490 5.b 5:d56fa7db:::benchmark_data_smithi073_23739_object14489:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:35:51.268 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:50.138355+0000", 2024-09-12T18:35:51.268 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.014189303, 2024-09-12T18:35:51.268 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.01258081, 2024-09-12T18:35:51.268 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:51.269 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:51.269 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:51.269 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:51.269 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:51.269 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:51.269 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 14490 2024-09-12T18:35:51.269 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.269 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:51.269 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.269 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:51.269 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.138355+0000", 2024-09-12T18:35:51.269 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:51.269 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.269 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.270 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:51.270 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.138355+0000", 2024-09-12T18:35:51.270 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:51.270 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.270 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.270 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:51.270 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.138356+0000", 2024-09-12T18:35:51.270 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.51e-07 2024-09-12T18:35:51.270 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.270 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.270 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:51.270 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.138411+0000", 2024-09-12T18:35:51.271 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5306999999999997e-05 2024-09-12T18:35:51.271 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.271 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.271 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:51.271 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.138419+0000", 2024-09-12T18:35:51.271 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3780000000000003e-06 2024-09-12T18:35:51.271 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.271 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.271 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.271 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.138422+0000", 2024-09-12T18:35:51.271 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8360000000000002e-06 2024-09-12T18:35:51.271 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.271 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.271 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:51.272 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.140053+0000", 2024-09-12T18:35:51.272 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001631108 2024-09-12T18:35:51.272 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.272 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.272 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:51.272 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.140192+0000", 2024-09-12T18:35:51.272 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000138892 2024-09-12T18:35:51.272 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.272 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.272 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:51.272 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.140333+0000", 2024-09-12T18:35:51.272 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014013299999999999 2024-09-12T18:35:51.272 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.273 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.273 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:51.273 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.142677+0000", 2024-09-12T18:35:51.273 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0023446249999999999 2024-09-12T18:35:51.273 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.273 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.273 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:51.273 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.150743+0000", 2024-09-12T18:35:51.273 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080661150000000004 2024-09-12T18:35:51.273 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.273 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.273 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:51.273 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.150883+0000", 2024-09-12T18:35:51.273 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013951 2024-09-12T18:35:51.274 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:51.274 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:51.274 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:51.274 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.150936+0000", 2024-09-12T18:35:51.274 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3455000000000002e-05 2024-09-12T18:35:51.274 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:51.274 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:51.274 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:51.274 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:51.274 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:51.274 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:35:51.276 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:35:51.276 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:51.274+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:51.376 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:51.373+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:51.438 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:35:51.438 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:35:51.438 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.438 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:18344 5.9 5:9d48a246:::benchmark_data_smithi073_23739_object18343:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:35:51.438 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:51.435012+0000", 2024-09-12T18:35:51.438 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0034176499999999999, 2024-09-12T18:35:51.438 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003444258, 2024-09-12T18:35:51.438 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:51.439 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:51.439 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:51.439 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:35:51.439 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:35:51.439 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:51.439 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 18344 2024-09-12T18:35:51.439 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.439 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:51.439 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.439 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:51.439 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.435012+0000", 2024-09-12T18:35:51.439 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.440 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.440 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.440 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:51.440 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.435012+0000", 2024-09-12T18:35:51.440 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.440 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.440 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.440 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:51.440 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.435013+0000", 2024-09-12T18:35:51.440 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2600000000000002e-07 2024-09-12T18:35:51.440 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.440 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.440 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:51.441 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.435128+0000", 2024-09-12T18:35:51.441 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011539700000000001 2024-09-12T18:35:51.441 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.441 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.441 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:51.441 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.435141+0000", 2024-09-12T18:35:51.441 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2465e-05 2024-09-12T18:35:51.441 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.441 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.441 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.442 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.435148+0000", 2024-09-12T18:35:51.442 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3599999999999998e-06 2024-09-12T18:35:51.442 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.442 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.442 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:51.442 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.435224+0000", 2024-09-12T18:35:51.442 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.5439999999999996e-05 2024-09-12T18:35:51.442 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.442 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.442 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:51.442 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.435356+0000", 2024-09-12T18:35:51.442 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013255400000000001 2024-09-12T18:35:51.442 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.442 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.443 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:51.443 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.435500+0000", 2024-09-12T18:35:51.443 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000143988 2024-09-12T18:35:51.443 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.443 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.443 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:51.443 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.437128+0000", 2024-09-12T18:35:51.443 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001627968 2024-09-12T18:35:51.443 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.443 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:51.443 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.443 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.443 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.444 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:18348 5.f 5:f0b987f1:::benchmark_data_smithi073_23739_object18347:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:35:51.444 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:51.436811+0000", 2024-09-12T18:35:51.444 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.001619337, 2024-09-12T18:35:51.444 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001726911, 2024-09-12T18:35:51.444 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:51.444 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:51.444 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:51.444 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:35:51.444 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:35:51.444 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:51.444 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 18348 2024-09-12T18:35:51.444 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.444 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:51.444 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.445 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:51.445 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.436811+0000", 2024-09-12T18:35:51.445 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.445 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.445 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.445 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:51.445 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.436811+0000", 2024-09-12T18:35:51.445 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.445 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.445 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.445 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:51.445 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.436811+0000", 2024-09-12T18:35:51.446 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2500000000000005e-07 2024-09-12T18:35:51.446 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.446 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.446 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:51.446 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.436893+0000", 2024-09-12T18:35:51.446 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1806999999999998e-05 2024-09-12T18:35:51.446 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.446 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.446 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:51.446 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.436903+0000", 2024-09-12T18:35:51.446 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.028e-05 2024-09-12T18:35:51.446 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.446 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.447 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.447 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.436909+0000", 2024-09-12T18:35:51.447 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4079999999999997e-06 2024-09-12T18:35:51.447 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.447 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.447 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:51.447 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.436945+0000", 2024-09-12T18:35:51.447 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.6368000000000001e-05 2024-09-12T18:35:51.447 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.447 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.447 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:51.447 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.437027+0000", 2024-09-12T18:35:51.448 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1686000000000004e-05 2024-09-12T18:35:51.448 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.448 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.448 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:51.448 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.437098+0000", 2024-09-12T18:35:51.448 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.1122000000000001e-05 2024-09-12T18:35:51.448 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.448 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:51.448 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.448 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.448 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.448 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:18351 5.7 5:e50987fe:::benchmark_data_smithi073_23739_object18350:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:35:51.448 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:51.436923+0000", 2024-09-12T18:35:51.449 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.001506819, 2024-09-12T18:35:51.449 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001667911, 2024-09-12T18:35:51.449 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:51.449 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:51.449 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:51.449 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:35:51.449 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:35:51.449 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:51.449 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 18351 2024-09-12T18:35:51.449 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.449 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:51.449 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.449 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:51.450 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.436923+0000", 2024-09-12T18:35:51.450 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.450 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.450 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.450 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:51.450 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.436923+0000", 2024-09-12T18:35:51.450 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.450 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.450 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.450 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:51.450 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.436924+0000", 2024-09-12T18:35:51.450 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.0299999999999999e-07 2024-09-12T18:35:51.450 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.450 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.451 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:51.451 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.437059+0000", 2024-09-12T18:35:51.451 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000135852 2024-09-12T18:35:51.451 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.451 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.451 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:51.451 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.437072+0000", 2024-09-12T18:35:51.451 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2077e-05 2024-09-12T18:35:51.451 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.451 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.451 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.451 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.437079+0000", 2024-09-12T18:35:51.451 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8639999999999996e-06 2024-09-12T18:35:51.451 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.452 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.452 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:51.452 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.437135+0000", 2024-09-12T18:35:51.452 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5247000000000001e-05 2024-09-12T18:35:51.452 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.452 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.452 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:51.452 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.437212+0000", 2024-09-12T18:35:51.452 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.7176999999999996e-05 2024-09-12T18:35:51.452 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.452 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.452 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:51.453 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.437291+0000", 2024-09-12T18:35:51.453 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.9521e-05 2024-09-12T18:35:51.453 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.453 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:51.453 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.453 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.453 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.453 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:18355 5.9 5:9d4cb5bd:::benchmark_data_smithi073_23739_object18354:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:35:51.453 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:51.437367+0000", 2024-09-12T18:35:51.453 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.00106258, 2024-09-12T18:35:51.453 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0012613749999999999, 2024-09-12T18:35:51.453 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:51.453 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:51.454 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:51.454 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:35:51.454 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:35:51.454 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:51.454 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 18355 2024-09-12T18:35:51.454 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.454 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:51.454 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.454 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:51.454 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.437367+0000", 2024-09-12T18:35:51.455 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.455 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.455 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.455 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:51.455 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.437367+0000", 2024-09-12T18:35:51.455 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.455 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.455 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.455 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:51.455 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.437368+0000", 2024-09-12T18:35:51.455 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0640000000000001e-06 2024-09-12T18:35:51.456 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.456 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.456 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:51.456 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.437438+0000", 2024-09-12T18:35:51.456 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0036999999999994e-05 2024-09-12T18:35:51.456 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.456 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.456 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:51.456 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.437452+0000", 2024-09-12T18:35:51.456 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3793e-05 2024-09-12T18:35:51.456 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.457 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.457 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.457 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.437460+0000", 2024-09-12T18:35:51.457 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.6809999999999998e-06 2024-09-12T18:35:51.457 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.457 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.457 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:51.457 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.437506+0000", 2024-09-12T18:35:51.457 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.5791000000000003e-05 2024-09-12T18:35:51.457 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.457 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.457 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:51.458 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.437603+0000", 2024-09-12T18:35:51.458 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7416000000000004e-05 2024-09-12T18:35:51.458 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.458 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.458 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:51.458 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.437751+0000", 2024-09-12T18:35:51.458 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014782900000000001 2024-09-12T18:35:51.458 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.458 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:51.458 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.458 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.458 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.458 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:18354 5.c e25/21 5:38f74fd1:::benchmark_data_smithi073_23739_object18353:head v 25'1170, mlcod=25'1168)", 2024-09-12T18:35:51.459 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:51.437606+0000", 2024-09-12T18:35:51.459 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.00082409300000000003, 2024-09-12T18:35:51.459 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0010552109999999999, 2024-09-12T18:35:51.459 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:51.459 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:51.459 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:35:51.459 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:51.459 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.459 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:51.459 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.437606+0000", 2024-09-12T18:35:51.459 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.459 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.460 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.460 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:51.460 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.437606+0000", 2024-09-12T18:35:51.460 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.460 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.460 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.460 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:51.460 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.437607+0000", 2024-09-12T18:35:51.460 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4300000000000003e-07 2024-09-12T18:35:51.460 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.460 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.460 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:51.461 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.437673+0000", 2024-09-12T18:35:51.461 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.6759000000000002e-05 2024-09-12T18:35:51.461 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.461 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.461 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:51.461 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.437682+0000", 2024-09-12T18:35:51.461 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0319999999999992e-06 2024-09-12T18:35:51.461 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.461 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.461 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.461 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.437696+0000", 2024-09-12T18:35:51.461 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3358e-05 2024-09-12T18:35:51.461 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.462 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.462 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:51.462 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.437746+0000", 2024-09-12T18:35:51.462 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.0682e-05 2024-09-12T18:35:51.462 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.462 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.462 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:51.462 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.437767+0000", 2024-09-12T18:35:51.462 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.0477999999999999e-05 2024-09-12T18:35:51.462 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.462 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:51.462 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.463 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.463 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.463 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:18353 5.d e25/21 5:bdacfd3d:::benchmark_data_smithi073_23739_object18352:head v 25'1170, mlcod=25'1167)", 2024-09-12T18:35:51.463 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:51.438440+0000", 2024-09-12T18:35:51.463 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 4294967295.99999, 2024-09-12T18:35:51.463 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00024835699999999999, 2024-09-12T18:35:51.463 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:51.463 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:51.463 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:35:51.463 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:51.463 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.463 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:51.464 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.438440+0000", 2024-09-12T18:35:51.464 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.464 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.464 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.464 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:51.464 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.438440+0000", 2024-09-12T18:35:51.464 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.464 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.464 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.464 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:51.464 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.438440+0000", 2024-09-12T18:35:51.464 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.1699999999999998e-07 2024-09-12T18:35:51.464 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.465 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.465 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:51.465 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.438502+0000", 2024-09-12T18:35:51.465 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.1797999999999993e-05 2024-09-12T18:35:51.465 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.465 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.465 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:51.465 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.438511+0000", 2024-09-12T18:35:51.465 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.6489999999999997e-06 2024-09-12T18:35:51.465 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.465 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.466 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.466 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.438516+0000", 2024-09-12T18:35:51.466 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.9350000000000002e-06 2024-09-12T18:35:51.466 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.466 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.466 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:51.466 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.438564+0000", 2024-09-12T18:35:51.466 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8411000000000001e-05 2024-09-12T18:35:51.466 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.466 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.466 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:51.466 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:51.438582+0000", 2024-09-12T18:35:51.466 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.8272999999999999e-05 2024-09-12T18:35:51.466 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.467 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:51.467 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.467 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.467 INFO:teuthology.orchestra.run.smithi162.stdout: ], 2024-09-12T18:35:51.467 INFO:teuthology.orchestra.run.smithi162.stdout: "num_ops": 6 2024-09-12T18:35:51.467 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:35:51.468 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:35:51.477 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:51.473+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:51.578 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:51.577+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:51.618 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:35:51.618 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [], 2024-09-12T18:35:51.618 INFO:teuthology.orchestra.run.smithi162.stdout: "complaint_time": 30, 2024-09-12T18:35:51.618 INFO:teuthology.orchestra.run.smithi162.stdout: "num_blocked_ops": 0 2024-09-12T18:35:51.618 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:35:51.639 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:35:51.679 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:51.677+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:51.779 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:51.777+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:51.792 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:35:51.792 INFO:teuthology.orchestra.run.smithi162.stdout: "size": 20, 2024-09-12T18:35:51.792 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 600, 2024-09-12T18:35:51.792 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:35:51.792 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.792 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4154.0:123 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:35:51.792 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:35:51.792 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 37.814593129000002, 2024-09-12T18:35:51.792 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.022398096999999999, 2024-09-12T18:35:51.793 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:51.793 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:51.793 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:51.793 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:35:51.793 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4154", 2024-09-12T18:35:51.793 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/745129001", 2024-09-12T18:35:51.793 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 123 2024-09-12T18:35:51.793 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.793 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:51.793 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.793 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:51.793 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:35:51.793 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.793 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.794 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.794 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:51.794 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:35:51.794 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.794 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.794 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.794 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:51.794 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:35:51.794 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.8299999999999996e-07 2024-09-12T18:35:51.794 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.794 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.794 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:51.795 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976528+0000", 2024-09-12T18:35:51.795 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011393299999999999 2024-09-12T18:35:51.795 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.795 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.795 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:51.795 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976539+0000", 2024-09-12T18:35:51.795 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0763e-05 2024-09-12T18:35:51.795 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.795 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.795 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.795 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976547+0000", 2024-09-12T18:35:51.795 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8199999999999997e-06 2024-09-12T18:35:51.795 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.795 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.796 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:51.796 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.995057+0000", 2024-09-12T18:35:51.796 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.018510047000000002 2024-09-12T18:35:51.796 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.796 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.796 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:51.796 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.995301+0000", 2024-09-12T18:35:51.796 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00024375899999999999 2024-09-12T18:35:51.796 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.796 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.796 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:51.796 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.995642+0000", 2024-09-12T18:35:51.796 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00034121100000000001 2024-09-12T18:35:51.797 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.797 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.797 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:51.797 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998179+0000", 2024-09-12T18:35:51.797 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00253761 2024-09-12T18:35:51.797 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.797 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.797 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:51.797 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998665+0000", 2024-09-12T18:35:51.797 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00048574600000000001 2024-09-12T18:35:51.797 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.797 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.797 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:51.798 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998739+0000", 2024-09-12T18:35:51.798 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.4286e-05 2024-09-12T18:35:51.798 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.798 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.798 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:51.798 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998812+0000", 2024-09-12T18:35:51.798 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2238999999999997e-05 2024-09-12T18:35:51.798 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.798 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:51.798 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.798 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.798 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.798 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4154.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:35:51.799 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:35:51.799 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 37.814445896999999, 2024-09-12T18:35:51.799 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025950709999999998, 2024-09-12T18:35:51.799 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:51.799 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:51.799 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:51.799 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:35:51.799 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4154", 2024-09-12T18:35:51.799 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/745129001", 2024-09-12T18:35:51.799 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 124 2024-09-12T18:35:51.799 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.799 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:51.799 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.799 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:51.800 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:35:51.800 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.800 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.800 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.800 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:51.800 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:35:51.800 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.800 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.800 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.800 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:51.800 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976562+0000", 2024-09-12T18:35:51.800 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.2999999999999999e-07 2024-09-12T18:35:51.801 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.801 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.801 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:51.801 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976567+0000", 2024-09-12T18:35:51.801 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3430000000000003e-06 2024-09-12T18:35:51.801 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.801 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.801 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:51.801 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976576+0000", 2024-09-12T18:35:51.801 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8070000000000006e-06 2024-09-12T18:35:51.801 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.801 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.801 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.802 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976583+0000", 2024-09-12T18:35:51.802 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9959999999999996e-06 2024-09-12T18:35:51.802 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.802 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.802 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:51.802 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997107+0000", 2024-09-12T18:35:51.802 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.020524106 2024-09-12T18:35:51.802 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.802 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.802 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:51.802 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997225+0000", 2024-09-12T18:35:51.802 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000117909 2024-09-12T18:35:51.802 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.803 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.803 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:51.803 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997407+0000", 2024-09-12T18:35:51.803 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00018175900000000001 2024-09-12T18:35:51.803 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.803 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.803 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:51.803 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998839+0000", 2024-09-12T18:35:51.803 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001432539 2024-09-12T18:35:51.803 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.803 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.803 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:51.803 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002319+0000", 2024-09-12T18:35:51.803 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0034803529999999998 2024-09-12T18:35:51.804 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.804 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.804 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:51.804 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002405+0000", 2024-09-12T18:35:51.804 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5434999999999998e-05 2024-09-12T18:35:51.804 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.804 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.804 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:51.804 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002512+0000", 2024-09-12T18:35:51.804 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010663299999999999 2024-09-12T18:35:51.804 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.804 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:51.804 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.805 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.805 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.805 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:51.805 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:35:51.805 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 26.149648389999999, 2024-09-12T18:35:51.805 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025127867000000002, 2024-09-12T18:35:51.805 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:51.805 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:51.805 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:51.805 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:51.805 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.805 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:51.805 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:35:51.806 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.806 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.806 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.806 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:51.806 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:35:51.806 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.806 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.806 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.806 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:51.806 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641362+0000", 2024-09-12T18:35:51.806 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.2569999999999999e-06 2024-09-12T18:35:51.806 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.807 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.807 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:51.807 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641374+0000", 2024-09-12T18:35:51.807 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2696e-05 2024-09-12T18:35:51.807 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.807 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.807 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:51.807 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641403+0000", 2024-09-12T18:35:51.807 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.8756999999999999e-05 2024-09-12T18:35:51.807 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.807 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.807 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.808 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641430+0000", 2024-09-12T18:35:51.808 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.6452999999999999e-05 2024-09-12T18:35:51.808 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.808 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.808 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:51.808 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641585+0000", 2024-09-12T18:35:51.808 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000155799 2024-09-12T18:35:51.808 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.808 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.808 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:51.808 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641753+0000", 2024-09-12T18:35:51.808 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000167868 2024-09-12T18:35:51.808 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.809 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.809 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:51.809 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641916+0000", 2024-09-12T18:35:51.809 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000162903 2024-09-12T18:35:51.809 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.809 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.809 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:51.809 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653655+0000", 2024-09-12T18:35:51.809 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011738879000000001 2024-09-12T18:35:51.809 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.809 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.809 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:51.809 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665515+0000", 2024-09-12T18:35:51.810 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011859915 2024-09-12T18:35:51.810 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.810 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.810 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:51.810 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665646+0000", 2024-09-12T18:35:51.810 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013122599999999999 2024-09-12T18:35:51.810 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.810 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.810 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:51.810 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666486+0000", 2024-09-12T18:35:51.810 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00084011399999999999 2024-09-12T18:35:51.810 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.810 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:51.810 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.811 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.811 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.811 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:51.811 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:35:51.811 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 26.149533927, 2024-09-12T18:35:51.811 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025384584000000002, 2024-09-12T18:35:51.811 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:51.811 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:51.811 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:51.811 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:51.811 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.811 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:51.811 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:35:51.812 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.812 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.812 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.812 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:51.812 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:35:51.812 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.812 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.812 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.812 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:51.812 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641474+0000", 2024-09-12T18:35:51.813 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.39e-06 2024-09-12T18:35:51.813 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.813 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.813 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:51.813 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641482+0000", 2024-09-12T18:35:51.813 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3499999999999999e-06 2024-09-12T18:35:51.813 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.813 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.813 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:51.813 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641534+0000", 2024-09-12T18:35:51.813 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2533e-05 2024-09-12T18:35:51.813 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.813 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.814 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.814 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641551+0000", 2024-09-12T18:35:51.814 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6515999999999999e-05 2024-09-12T18:35:51.814 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.814 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.814 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:51.814 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642630+0000", 2024-09-12T18:35:51.814 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001079705 2024-09-12T18:35:51.814 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.814 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.814 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:51.814 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642909+0000", 2024-09-12T18:35:51.814 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027859800000000002 2024-09-12T18:35:51.815 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.815 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.815 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:51.815 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643137+0000", 2024-09-12T18:35:51.815 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022803799999999999 2024-09-12T18:35:51.815 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.815 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.815 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:51.815 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653669+0000", 2024-09-12T18:35:51.815 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010532032 2024-09-12T18:35:51.815 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.815 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.815 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:51.816 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666624+0000", 2024-09-12T18:35:51.816 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012954940999999999 2024-09-12T18:35:51.816 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.816 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.816 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:51.816 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666762+0000", 2024-09-12T18:35:51.816 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000137668 2024-09-12T18:35:51.816 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.816 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.816 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:51.816 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666857+0000", 2024-09-12T18:35:51.816 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.5812999999999999e-05 2024-09-12T18:35:51.816 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.817 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:51.817 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.817 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.817 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.817 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:51.817 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:35:51.817 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 26.149406131999999, 2024-09-12T18:35:51.817 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025661562999999998, 2024-09-12T18:35:51.817 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:51.817 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:51.817 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:51.817 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:51.817 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.817 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:51.818 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:35:51.818 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.818 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.818 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.818 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:51.818 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:35:51.818 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.818 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.818 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.818 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:51.818 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641602+0000", 2024-09-12T18:35:51.818 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3540000000000001e-06 2024-09-12T18:35:51.818 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.819 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.819 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:51.819 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641637+0000", 2024-09-12T18:35:51.819 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5145999999999999e-05 2024-09-12T18:35:51.819 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.819 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.819 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:51.819 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641659+0000", 2024-09-12T18:35:51.819 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2249999999999999e-05 2024-09-12T18:35:51.819 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.819 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.819 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.819 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641675+0000", 2024-09-12T18:35:51.819 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6059999999999999e-05 2024-09-12T18:35:51.820 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.820 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.820 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:51.820 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644570+0000", 2024-09-12T18:35:51.820 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028947069999999998 2024-09-12T18:35:51.820 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.820 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.820 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:51.820 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644900+0000", 2024-09-12T18:35:51.820 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000329401 2024-09-12T18:35:51.820 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.820 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.820 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:51.821 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645235+0000", 2024-09-12T18:35:51.821 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000335874 2024-09-12T18:35:51.821 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.821 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.821 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:51.821 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655459+0000", 2024-09-12T18:35:51.821 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010223441999999999 2024-09-12T18:35:51.821 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.821 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.821 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:51.821 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667028+0000", 2024-09-12T18:35:51.821 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011568673999999999 2024-09-12T18:35:51.822 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.822 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.822 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:51.822 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667163+0000", 2024-09-12T18:35:51.822 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013525500000000001 2024-09-12T18:35:51.822 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.822 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.822 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:51.822 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667262+0000", 2024-09-12T18:35:51.822 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9400000000000004e-05 2024-09-12T18:35:51.822 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.822 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:51.823 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.823 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.823 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.823 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:51.823 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:35:51.823 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 26.149304312000002, 2024-09-12T18:35:51.823 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025971339, 2024-09-12T18:35:51.823 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:51.823 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:51.823 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:51.823 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:51.823 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.823 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:51.823 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:35:51.824 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.824 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.824 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.824 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:51.824 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:35:51.824 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.824 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.824 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.824 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:51.824 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641704+0000", 2024-09-12T18:35:51.824 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.297e-06 2024-09-12T18:35:51.824 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.824 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.825 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:51.825 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641712+0000", 2024-09-12T18:35:51.825 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.9060000000000002e-06 2024-09-12T18:35:51.825 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.825 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.825 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:51.825 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641731+0000", 2024-09-12T18:35:51.825 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9083e-05 2024-09-12T18:35:51.825 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.825 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.825 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.825 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641745+0000", 2024-09-12T18:35:51.825 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4066999999999999e-05 2024-09-12T18:35:51.826 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.826 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.826 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:51.826 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646529+0000", 2024-09-12T18:35:51.826 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.004784033 2024-09-12T18:35:51.826 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.826 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.826 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:51.826 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646727+0000", 2024-09-12T18:35:51.826 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019841800000000001 2024-09-12T18:35:51.826 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.826 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.826 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:51.826 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647057+0000", 2024-09-12T18:35:51.827 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032926800000000002 2024-09-12T18:35:51.827 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.827 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.827 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:51.827 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655475+0000", 2024-09-12T18:35:51.827 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0084186250000000008 2024-09-12T18:35:51.827 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.827 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.827 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:51.827 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667424+0000", 2024-09-12T18:35:51.827 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011949257 2024-09-12T18:35:51.827 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.827 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.827 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:51.828 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667573+0000", 2024-09-12T18:35:51.828 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014851900000000001 2024-09-12T18:35:51.828 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.828 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.828 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:51.828 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667674+0000", 2024-09-12T18:35:51.828 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010086600000000001 2024-09-12T18:35:51.828 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.828 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:51.828 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.828 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.828 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.828 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:51.829 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:35:51.829 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 26.149241923000002, 2024-09-12T18:35:51.829 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026215008000000001, 2024-09-12T18:35:51.829 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:51.829 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:51.829 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:51.829 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:51.829 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.830 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:51.830 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:35:51.830 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.830 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.830 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.830 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:51.830 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:35:51.830 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.830 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.830 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.830 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:51.830 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641766+0000", 2024-09-12T18:35:51.830 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1200000000000001e-06 2024-09-12T18:35:51.831 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.831 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.831 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:51.831 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641775+0000", 2024-09-12T18:35:51.831 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.2499999999999995e-06 2024-09-12T18:35:51.831 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.831 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.831 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:51.831 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641793+0000", 2024-09-12T18:35:51.831 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7773000000000001e-05 2024-09-12T18:35:51.831 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.831 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.831 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.832 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641807+0000", 2024-09-12T18:35:51.832 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3814e-05 2024-09-12T18:35:51.832 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.832 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.832 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:51.832 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647626+0000", 2024-09-12T18:35:51.832 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0058193050000000003 2024-09-12T18:35:51.832 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.832 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.832 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:51.832 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647937+0000", 2024-09-12T18:35:51.832 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031112400000000003 2024-09-12T18:35:51.832 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.833 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.833 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:51.833 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648239+0000", 2024-09-12T18:35:51.833 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00030227500000000002 2024-09-12T18:35:51.833 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.833 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.833 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:51.833 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655487+0000", 2024-09-12T18:35:51.833 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072479129999999999 2024-09-12T18:35:51.834 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.834 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.834 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:51.834 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667823+0000", 2024-09-12T18:35:51.834 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012335505 2024-09-12T18:35:51.834 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.834 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.834 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:51.834 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667908+0000", 2024-09-12T18:35:51.834 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4843000000000001e-05 2024-09-12T18:35:51.834 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.834 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.835 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:51.835 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667980+0000", 2024-09-12T18:35:51.835 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2086000000000001e-05 2024-09-12T18:35:51.835 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.835 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:51.835 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.835 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.835 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.835 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:51.835 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:35:51.835 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 26.149181769999998, 2024-09-12T18:35:51.835 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026483236, 2024-09-12T18:35:51.836 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:51.836 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:51.836 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:51.836 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:51.836 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.836 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:51.836 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:35:51.836 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.836 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.836 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.836 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:51.836 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:35:51.837 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.837 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.837 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.837 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:51.837 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641826+0000", 2024-09-12T18:35:51.837 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:35:51.837 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.837 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.837 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:51.837 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641832+0000", 2024-09-12T18:35:51.837 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4199999999999998e-06 2024-09-12T18:35:51.837 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.837 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.838 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:51.838 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641848+0000", 2024-09-12T18:35:51.838 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6492999999999999e-05 2024-09-12T18:35:51.838 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.838 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.838 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.838 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641863+0000", 2024-09-12T18:35:51.838 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5427e-05 2024-09-12T18:35:51.838 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.838 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.838 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:51.838 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648887+0000", 2024-09-12T18:35:51.838 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0070230860000000004 2024-09-12T18:35:51.839 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.839 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.839 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:51.839 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649111+0000", 2024-09-12T18:35:51.839 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022425799999999999 2024-09-12T18:35:51.839 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.839 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.839 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:51.839 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649494+0000", 2024-09-12T18:35:51.839 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00038349400000000001 2024-09-12T18:35:51.839 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.839 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.839 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:51.839 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655499+0000", 2024-09-12T18:35:51.840 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0060047260000000002 2024-09-12T18:35:51.840 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.840 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.840 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:51.840 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668110+0000", 2024-09-12T18:35:51.840 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012610543 2024-09-12T18:35:51.840 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.840 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.840 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:51.840 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668252+0000", 2024-09-12T18:35:51.840 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014265600000000001 2024-09-12T18:35:51.840 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.840 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.841 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:51.841 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668308+0000", 2024-09-12T18:35:51.841 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5992999999999997e-05 2024-09-12T18:35:51.841 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.841 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:51.841 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.841 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.841 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.841 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:51.841 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:35:51.841 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 26.149126553999999, 2024-09-12T18:35:51.841 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026605302000000001, 2024-09-12T18:35:51.841 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:51.842 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:51.842 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:51.842 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:51.842 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.842 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:51.842 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:35:51.842 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.842 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.842 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.842 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:51.842 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:35:51.842 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.843 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.843 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.843 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:51.843 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641881+0000", 2024-09-12T18:35:51.843 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.057e-06 2024-09-12T18:35:51.843 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.843 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.843 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:51.843 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641887+0000", 2024-09-12T18:35:51.843 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.6629999999999998e-06 2024-09-12T18:35:51.843 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.843 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.843 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:51.843 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641903+0000", 2024-09-12T18:35:51.844 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6317e-05 2024-09-12T18:35:51.844 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.844 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.844 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.844 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641917+0000", 2024-09-12T18:35:51.844 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3339999999999999e-05 2024-09-12T18:35:51.844 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.844 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.844 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:51.844 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650708+0000", 2024-09-12T18:35:51.844 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.008791419 2024-09-12T18:35:51.844 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.844 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.845 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:51.845 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651021+0000", 2024-09-12T18:35:51.845 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031296699999999999 2024-09-12T18:35:51.845 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.845 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.845 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:51.845 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651349+0000", 2024-09-12T18:35:51.845 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032796499999999999 2024-09-12T18:35:51.845 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.845 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.845 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:51.845 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655742+0000", 2024-09-12T18:35:51.845 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0043934680000000002 2024-09-12T18:35:51.846 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.846 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.846 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:51.846 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668377+0000", 2024-09-12T18:35:51.846 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012634312999999999 2024-09-12T18:35:51.846 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.846 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.846 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:51.846 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668441+0000", 2024-09-12T18:35:51.846 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4369999999999995e-05 2024-09-12T18:35:51.846 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.846 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.846 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:51.846 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668485+0000", 2024-09-12T18:35:51.847 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4422999999999998e-05 2024-09-12T18:35:51.847 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.847 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:51.847 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.847 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.847 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.847 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:51.847 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:35:51.847 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 26.149069150999999, 2024-09-12T18:35:51.847 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026919499, 2024-09-12T18:35:51.847 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:51.847 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:51.847 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:51.848 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:51.848 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.848 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:51.848 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:35:51.848 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.848 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.848 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.848 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:51.848 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:35:51.848 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.848 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.848 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.848 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:51.848 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641939+0000", 2024-09-12T18:35:51.849 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9399999999999993e-07 2024-09-12T18:35:51.849 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.849 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.849 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:51.849 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641945+0000", 2024-09-12T18:35:51.849 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9200000000000001e-06 2024-09-12T18:35:51.849 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.849 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.849 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:51.849 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641961+0000", 2024-09-12T18:35:51.849 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6520000000000001e-05 2024-09-12T18:35:51.849 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.849 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.850 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.850 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641974+0000", 2024-09-12T18:35:51.850 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3413e-05 2024-09-12T18:35:51.850 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.850 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.850 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:51.850 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654560+0000", 2024-09-12T18:35:51.850 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012585308999999999 2024-09-12T18:35:51.850 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.850 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.850 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:51.850 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654822+0000", 2024-09-12T18:35:51.850 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026210099999999999 2024-09-12T18:35:51.850 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.851 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.851 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:51.851 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655059+0000", 2024-09-12T18:35:51.851 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00023747899999999999 2024-09-12T18:35:51.851 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.851 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.851 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:51.851 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.656315+0000", 2024-09-12T18:35:51.851 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0012555000000000001 2024-09-12T18:35:51.851 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.851 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.851 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:51.852 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668590+0000", 2024-09-12T18:35:51.852 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012274851999999999 2024-09-12T18:35:51.852 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.852 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.852 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:51.852 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668725+0000", 2024-09-12T18:35:51.852 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013524199999999999 2024-09-12T18:35:51.852 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.852 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.852 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:51.852 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668857+0000", 2024-09-12T18:35:51.852 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013216899999999999 2024-09-12T18:35:51.852 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.853 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:51.853 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.853 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.853 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.853 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:51.853 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:35:51.853 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 26.149015631000001, 2024-09-12T18:35:51.853 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023616723999999999, 2024-09-12T18:35:51.853 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:51.853 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:51.853 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:51.853 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:51.853 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.854 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:51.854 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:35:51.854 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.854 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.854 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.854 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:51.854 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:35:51.854 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.854 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.854 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.854 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:51.854 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641992+0000", 2024-09-12T18:35:51.854 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.08e-06 2024-09-12T18:35:51.855 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.855 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.855 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:51.855 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641998+0000", 2024-09-12T18:35:51.855 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4299999999999997e-06 2024-09-12T18:35:51.855 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.855 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.855 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:51.855 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642014+0000", 2024-09-12T18:35:51.855 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6266e-05 2024-09-12T18:35:51.855 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.855 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.856 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.856 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642026+0000", 2024-09-12T18:35:51.856 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2567e-05 2024-09-12T18:35:51.856 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.856 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.856 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:51.856 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642213+0000", 2024-09-12T18:35:51.856 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00018701899999999999 2024-09-12T18:35:51.856 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.856 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.856 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:51.856 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642507+0000", 2024-09-12T18:35:51.856 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00029394700000000002 2024-09-12T18:35:51.857 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.857 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.857 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:51.857 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642686+0000", 2024-09-12T18:35:51.857 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000178152 2024-09-12T18:35:51.857 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.857 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.857 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:51.857 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650952+0000", 2024-09-12T18:35:51.857 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0082663570000000002 2024-09-12T18:35:51.857 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.857 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.858 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:51.858 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665382+0000", 2024-09-12T18:35:51.858 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.014430111000000001 2024-09-12T18:35:51.858 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.858 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.858 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:51.858 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665508+0000", 2024-09-12T18:35:51.858 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000125986 2024-09-12T18:35:51.858 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.858 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.858 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:51.858 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665608+0000", 2024-09-12T18:35:51.858 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9809000000000006e-05 2024-09-12T18:35:51.858 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.859 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:51.859 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.859 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.859 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.859 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:51.859 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:35:51.859 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 26.148887766000001, 2024-09-12T18:35:51.859 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024670563, 2024-09-12T18:35:51.859 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:51.859 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:51.859 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:51.859 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:51.860 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.860 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:51.860 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:35:51.860 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.860 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.860 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.860 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:51.860 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:35:51.860 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.860 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.860 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.860 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:51.861 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642120+0000", 2024-09-12T18:35:51.861 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1769999999999999e-06 2024-09-12T18:35:51.861 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.861 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.861 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:51.861 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642128+0000", 2024-09-12T18:35:51.861 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3429999999999998e-06 2024-09-12T18:35:51.861 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.861 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.861 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:51.861 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642192+0000", 2024-09-12T18:35:51.861 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4406999999999995e-05 2024-09-12T18:35:51.861 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.862 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.862 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.862 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642223+0000", 2024-09-12T18:35:51.862 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.1266000000000002e-05 2024-09-12T18:35:51.862 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.862 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.862 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:51.862 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643201+0000", 2024-09-12T18:35:51.862 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0009778390000000001 2024-09-12T18:35:51.862 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.862 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.862 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:51.862 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643410+0000", 2024-09-12T18:35:51.863 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020874199999999999 2024-09-12T18:35:51.863 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.863 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.863 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:51.863 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643685+0000", 2024-09-12T18:35:51.863 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027520700000000002 2024-09-12T18:35:51.863 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.863 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.863 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:51.863 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650966+0000", 2024-09-12T18:35:51.863 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072810710000000001 2024-09-12T18:35:51.863 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.863 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.864 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:51.864 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666560+0000", 2024-09-12T18:35:51.864 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015594143 2024-09-12T18:35:51.864 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.864 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.864 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:51.864 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666691+0000", 2024-09-12T18:35:51.864 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000130359 2024-09-12T18:35:51.864 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.864 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.864 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:51.864 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666790+0000", 2024-09-12T18:35:51.865 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9009e-05 2024-09-12T18:35:51.865 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.865 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:51.865 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.865 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.865 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.865 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:51.865 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:35:51.865 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 26.148109477999999, 2024-09-12T18:35:51.866 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024891744, 2024-09-12T18:35:51.866 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:51.866 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:51.866 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:51.866 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:51.866 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.866 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:51.866 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:35:51.866 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.866 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.866 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.866 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:51.866 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:35:51.866 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.867 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.867 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.867 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:51.867 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642899+0000", 2024-09-12T18:35:51.867 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4729999999999999e-06 2024-09-12T18:35:51.867 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.867 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.867 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:51.867 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642912+0000", 2024-09-12T18:35:51.867 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3495999999999999e-05 2024-09-12T18:35:51.867 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.867 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.868 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:51.868 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642934+0000", 2024-09-12T18:35:51.868 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2033999999999999e-05 2024-09-12T18:35:51.868 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.868 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.868 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.868 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642949+0000", 2024-09-12T18:35:51.868 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4970000000000001e-05 2024-09-12T18:35:51.868 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.868 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.868 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:51.869 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644400+0000", 2024-09-12T18:35:51.869 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001450305 2024-09-12T18:35:51.869 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.869 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.869 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:51.869 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644617+0000", 2024-09-12T18:35:51.869 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000217302 2024-09-12T18:35:51.869 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.869 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.869 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:51.869 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645052+0000", 2024-09-12T18:35:51.869 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000434797 2024-09-12T18:35:51.869 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.870 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.870 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:51.870 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653860+0000", 2024-09-12T18:35:51.870 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0088082249999999994 2024-09-12T18:35:51.870 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.870 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.870 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:51.870 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667598+0000", 2024-09-12T18:35:51.870 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.013738451 2024-09-12T18:35:51.870 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.870 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.870 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:51.870 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667698+0000", 2024-09-12T18:35:51.871 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9854999999999999e-05 2024-09-12T18:35:51.871 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.871 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.871 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:51.871 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667789+0000", 2024-09-12T18:35:51.871 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0835999999999996e-05 2024-09-12T18:35:51.871 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.871 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:51.871 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.871 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.871 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.871 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:30 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:51.871 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:35:51.872 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 26.148034662000001, 2024-09-12T18:35:51.872 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023936852000000002, 2024-09-12T18:35:51.872 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:51.872 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:51.872 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:51.872 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:51.872 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.872 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:51.872 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:35:51.872 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.872 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.872 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.872 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:51.873 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:35:51.873 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.873 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.873 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.873 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:51.873 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642973+0000", 2024-09-12T18:35:51.873 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.11e-06 2024-09-12T18:35:51.873 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.873 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.873 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:51.873 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642994+0000", 2024-09-12T18:35:51.873 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.0699999999999998e-05 2024-09-12T18:35:51.874 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.874 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.874 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:51.874 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643011+0000", 2024-09-12T18:35:51.874 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7229999999999999e-05 2024-09-12T18:35:51.874 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.874 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.874 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.874 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643025+0000", 2024-09-12T18:35:51.874 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3803e-05 2024-09-12T18:35:51.874 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.874 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.874 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:51.875 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643143+0000", 2024-09-12T18:35:51.875 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000118225 2024-09-12T18:35:51.875 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.875 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.875 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:51.875 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643426+0000", 2024-09-12T18:35:51.875 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00028250500000000001 2024-09-12T18:35:51.875 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.875 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.875 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:51.875 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643864+0000", 2024-09-12T18:35:51.875 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00043856 2024-09-12T18:35:51.875 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.876 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.876 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:51.876 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651148+0000", 2024-09-12T18:35:51.876 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072836769999999997 2024-09-12T18:35:51.876 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.876 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.876 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:51.876 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666674+0000", 2024-09-12T18:35:51.876 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015525786999999999 2024-09-12T18:35:51.876 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.876 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.876 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:51.876 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666796+0000", 2024-09-12T18:35:51.877 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000122416 2024-09-12T18:35:51.877 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.877 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.877 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:51.877 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666909+0000", 2024-09-12T18:35:51.877 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011283899999999999 2024-09-12T18:35:51.877 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.877 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:51.877 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.877 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.877 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.877 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:51.877 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:35:51.878 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 26.147951956, 2024-09-12T18:35:51.878 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024100234000000002, 2024-09-12T18:35:51.878 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:51.878 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:51.878 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:51.878 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:51.878 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.878 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:51.878 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:35:51.878 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.878 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.878 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.879 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:51.879 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:35:51.879 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.879 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.879 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.879 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:51.879 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643056+0000", 2024-09-12T18:35:51.879 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.046e-06 2024-09-12T18:35:51.879 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.879 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.879 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:51.879 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643068+0000", 2024-09-12T18:35:51.879 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2106999999999999e-05 2024-09-12T18:35:51.879 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.880 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.880 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:51.880 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643085+0000", 2024-09-12T18:35:51.880 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7479999999999999e-05 2024-09-12T18:35:51.880 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.880 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.880 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.880 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643099+0000", 2024-09-12T18:35:51.880 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3730000000000001e-05 2024-09-12T18:35:51.880 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.880 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.880 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:51.881 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644623+0000", 2024-09-12T18:35:51.881 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0015236080000000001 2024-09-12T18:35:51.881 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.881 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.881 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:51.881 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644893+0000", 2024-09-12T18:35:51.881 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026990500000000003 2024-09-12T18:35:51.881 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.881 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.881 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:51.881 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645227+0000", 2024-09-12T18:35:51.881 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00033391300000000003 2024-09-12T18:35:51.881 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.882 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.882 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:51.882 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653926+0000", 2024-09-12T18:35:51.882 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0086993339999999995 2024-09-12T18:35:51.882 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.882 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.882 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:51.882 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666925+0000", 2024-09-12T18:35:51.882 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012998686000000001 2024-09-12T18:35:51.882 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.882 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.882 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:51.882 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667057+0000", 2024-09-12T18:35:51.883 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013255600000000001 2024-09-12T18:35:51.883 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.883 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.883 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:51.883 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667155+0000", 2024-09-12T18:35:51.883 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7868999999999994e-05 2024-09-12T18:35:51.883 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.883 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:51.883 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.883 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.883 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.883 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:51.883 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643139+0000", 2024-09-12T18:35:51.883 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 26.14786737, 2024-09-12T18:35:51.884 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.022417057000000001, 2024-09-12T18:35:51.884 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:51.884 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:51.884 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:51.884 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:51.884 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.884 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:51.884 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643139+0000", 2024-09-12T18:35:51.884 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.884 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.884 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.884 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:51.884 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643139+0000", 2024-09-12T18:35:51.885 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.885 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.885 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.885 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:51.885 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643140+0000", 2024-09-12T18:35:51.885 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0729999999999999e-06 2024-09-12T18:35:51.885 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.885 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.885 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:51.885 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643151+0000", 2024-09-12T18:35:51.885 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.039e-05 2024-09-12T18:35:51.885 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.885 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.886 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:51.886 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643168+0000", 2024-09-12T18:35:51.886 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7575999999999999e-05 2024-09-12T18:35:51.886 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.886 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.886 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.886 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643182+0000", 2024-09-12T18:35:51.886 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3224000000000001e-05 2024-09-12T18:35:51.886 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.886 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.886 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:51.886 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643358+0000", 2024-09-12T18:35:51.886 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00017676500000000001 2024-09-12T18:35:51.886 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.887 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.887 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:51.887 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643647+0000", 2024-09-12T18:35:51.887 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00028850499999999999 2024-09-12T18:35:51.887 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.887 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.887 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:51.887 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643924+0000", 2024-09-12T18:35:51.887 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000277547 2024-09-12T18:35:51.887 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.887 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.887 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:51.887 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650289+0000", 2024-09-12T18:35:51.888 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0063645350000000002 2024-09-12T18:35:51.888 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.888 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.888 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:51.888 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665333+0000", 2024-09-12T18:35:51.888 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015043531000000001 2024-09-12T18:35:51.888 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.888 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.888 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:51.888 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665454+0000", 2024-09-12T18:35:51.888 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000121302 2024-09-12T18:35:51.888 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.888 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.889 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:51.889 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665556+0000", 2024-09-12T18:35:51.889 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010260900000000001 2024-09-12T18:35:51.889 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.889 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:51.889 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.889 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.889 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.889 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:51.889 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:35:51.889 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 26.147756167000001, 2024-09-12T18:35:51.889 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024255982999999998, 2024-09-12T18:35:51.889 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:51.890 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:51.890 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:51.890 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:51.890 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.890 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:51.890 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:35:51.890 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.890 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.890 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.890 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:51.890 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:35:51.890 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.890 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.890 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.891 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:51.891 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643252+0000", 2024-09-12T18:35:51.891 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:35:51.891 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.891 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.891 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:51.891 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643287+0000", 2024-09-12T18:35:51.891 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5225999999999998e-05 2024-09-12T18:35:51.891 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.891 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.891 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:51.891 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643323+0000", 2024-09-12T18:35:51.891 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5488999999999999e-05 2024-09-12T18:35:51.892 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.892 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.892 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.892 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643357+0000", 2024-09-12T18:35:51.892 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.3853999999999998e-05 2024-09-12T18:35:51.892 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.892 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.892 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:51.892 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646716+0000", 2024-09-12T18:35:51.892 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003359 2024-09-12T18:35:51.892 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.892 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.892 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:51.893 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647037+0000", 2024-09-12T18:35:51.893 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032131800000000002 2024-09-12T18:35:51.893 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.893 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.893 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:51.893 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647337+0000", 2024-09-12T18:35:51.893 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000300208 2024-09-12T18:35:51.893 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.893 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.893 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:51.893 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654291+0000", 2024-09-12T18:35:51.893 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0069543089999999997 2024-09-12T18:35:51.893 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.894 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.894 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:51.894 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667297+0000", 2024-09-12T18:35:51.894 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.013005526 2024-09-12T18:35:51.894 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.894 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.894 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:51.894 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667416+0000", 2024-09-12T18:35:51.894 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000119416 2024-09-12T18:35:51.894 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.894 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.894 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:51.894 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667507+0000", 2024-09-12T18:35:51.894 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0206999999999999e-05 2024-09-12T18:35:51.895 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.895 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:51.895 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.895 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.895 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.895 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:51.895 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:35:51.895 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 26.147629072000001, 2024-09-12T18:35:51.895 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023888482999999999, 2024-09-12T18:35:51.895 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:51.895 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:51.895 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:51.895 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:51.896 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.896 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:51.896 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:35:51.896 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.896 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.896 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.896 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:51.896 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:35:51.896 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.896 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.896 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.896 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:51.896 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643379+0000", 2024-09-12T18:35:51.897 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.207e-06 2024-09-12T18:35:51.897 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.897 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.897 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:51.897 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643390+0000", 2024-09-12T18:35:51.897 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0696000000000001e-05 2024-09-12T18:35:51.897 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.897 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.897 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:51.897 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643407+0000", 2024-09-12T18:35:51.897 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7563000000000001e-05 2024-09-12T18:35:51.897 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.898 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.898 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.898 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643420+0000", 2024-09-12T18:35:51.898 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3277e-05 2024-09-12T18:35:51.898 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.898 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.898 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:51.898 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644906+0000", 2024-09-12T18:35:51.898 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001485945 2024-09-12T18:35:51.898 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.898 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.898 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:51.898 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645404+0000", 2024-09-12T18:35:51.899 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00049807599999999997 2024-09-12T18:35:51.899 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.899 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.899 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:51.899 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645846+0000", 2024-09-12T18:35:51.899 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00044190400000000002 2024-09-12T18:35:51.899 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.899 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.899 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:51.899 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654223+0000", 2024-09-12T18:35:51.899 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0083767419999999995 2024-09-12T18:35:51.899 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.899 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.900 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:51.900 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667026+0000", 2024-09-12T18:35:51.900 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012802531000000001 2024-09-12T18:35:51.900 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.900 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.900 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:51.900 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667162+0000", 2024-09-12T18:35:51.900 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000136112 2024-09-12T18:35:51.900 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.900 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.900 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:51.900 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667266+0000", 2024-09-12T18:35:51.901 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010443 2024-09-12T18:35:51.901 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.901 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:51.901 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.901 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.901 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.901 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:51.901 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643447+0000", 2024-09-12T18:35:51.901 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 26.147559546, 2024-09-12T18:35:51.901 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.022081562999999998, 2024-09-12T18:35:51.901 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:51.901 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:51.901 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:51.902 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:51.902 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.902 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:51.902 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643447+0000", 2024-09-12T18:35:51.902 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.902 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.902 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.902 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:51.902 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643447+0000", 2024-09-12T18:35:51.902 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.902 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.902 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.903 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:51.903 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643448+0000", 2024-09-12T18:35:51.903 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1629999999999999e-06 2024-09-12T18:35:51.903 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.903 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.903 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:51.903 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643458+0000", 2024-09-12T18:35:51.903 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.8400000000000007e-06 2024-09-12T18:35:51.903 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.903 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.903 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:51.903 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643475+0000", 2024-09-12T18:35:51.903 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6874000000000001e-05 2024-09-12T18:35:51.904 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.904 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.904 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.904 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643488+0000", 2024-09-12T18:35:51.904 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3026e-05 2024-09-12T18:35:51.904 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.904 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.904 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:51.904 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643931+0000", 2024-09-12T18:35:51.904 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00044307 2024-09-12T18:35:51.904 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.904 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.905 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:51.905 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644210+0000", 2024-09-12T18:35:51.905 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027908400000000003 2024-09-12T18:35:51.905 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.905 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.905 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:51.905 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644606+0000", 2024-09-12T18:35:51.905 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00039615400000000002 2024-09-12T18:35:51.905 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.905 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.905 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:51.905 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650552+0000", 2024-09-12T18:35:51.905 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0059455619999999997 2024-09-12T18:35:51.905 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.906 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.906 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:51.906 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665302+0000", 2024-09-12T18:35:51.906 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.014749962 2024-09-12T18:35:51.906 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.906 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.906 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:51.906 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665424+0000", 2024-09-12T18:35:51.906 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012214300000000001 2024-09-12T18:35:51.906 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.906 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.906 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:51.906 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665529+0000", 2024-09-12T18:35:51.907 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000104685 2024-09-12T18:35:51.907 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.907 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:51.907 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.907 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.907 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.907 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:51.907 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:35:51.907 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 26.147478353, 2024-09-12T18:35:51.907 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024222582999999999, 2024-09-12T18:35:51.907 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:51.907 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:51.907 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:35:51.907 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:51.908 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.908 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:51.908 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:35:51.908 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.908 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.908 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.908 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:51.908 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:35:51.908 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:51.908 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.908 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.908 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:51.908 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643530+0000", 2024-09-12T18:35:51.909 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.393e-06 2024-09-12T18:35:51.909 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.909 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.909 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:51.909 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643536+0000", 2024-09-12T18:35:51.909 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4130000000000003e-06 2024-09-12T18:35:51.909 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.909 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.909 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:51.909 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643554+0000", 2024-09-12T18:35:51.909 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7572999999999999e-05 2024-09-12T18:35:51.909 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.909 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.909 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:51.909 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643567+0000", 2024-09-12T18:35:51.910 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3393999999999999e-05 2024-09-12T18:35:51.910 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.910 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.910 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:51.910 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648198+0000", 2024-09-12T18:35:51.910 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0046304479999999997 2024-09-12T18:35:51.910 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.910 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.910 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:51.910 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648413+0000", 2024-09-12T18:35:51.910 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00021507500000000001 2024-09-12T18:35:51.910 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:51.910 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:51.911 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:51.911 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667751+0000", 2024-09-12T18:35:51.911 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.019338286999999999 2024-09-12T18:35:51.911 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.911 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:51.911 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.911 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:51.911 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:51.911 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:35:51.911 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T18:35:51.913 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 6 16 19517 19501 203.113 175.375 0.00416515 0.00491703 2024-09-12T18:35:51.914 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:51.910+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:51.914 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:35:52.014 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:52.010+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:52.077 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:35:52.077 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:35:52.077 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.077 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:20085 5.2 e25/21 5:4d60c862:::benchmark_data_smithi073_23739_object20084:head v 25'1242, mlcod=25'1240)", 2024-09-12T18:35:52.077 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:52.071325+0000", 2024-09-12T18:35:52.077 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0042888700000000002, 2024-09-12T18:35:52.077 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0043064100000000001, 2024-09-12T18:35:52.078 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:52.078 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:52.078 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:35:52.078 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:52.078 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.078 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:52.078 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.071325+0000", 2024-09-12T18:35:52.078 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:52.078 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.078 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.078 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:52.078 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.071325+0000", 2024-09-12T18:35:52.078 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:52.079 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.079 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.079 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:52.079 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.071326+0000", 2024-09-12T18:35:52.079 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.7800000000000002e-07 2024-09-12T18:35:52.079 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.079 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.079 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:52.079 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.071458+0000", 2024-09-12T18:35:52.079 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013201 2024-09-12T18:35:52.079 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.079 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.079 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:52.080 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.071464+0000", 2024-09-12T18:35:52.080 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4760000000000003e-06 2024-09-12T18:35:52.080 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.080 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.080 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:52.080 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.071469+0000", 2024-09-12T18:35:52.080 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.1640000000000003e-06 2024-09-12T18:35:52.080 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.080 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.080 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:52.080 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.071515+0000", 2024-09-12T18:35:52.080 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.6102e-05 2024-09-12T18:35:52.080 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.081 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.081 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:52.081 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.071534+0000", 2024-09-12T18:35:52.081 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9304999999999999e-05 2024-09-12T18:35:52.081 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:52.081 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:52.081 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:52.081 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.081 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.081 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:20080 5.0 e25/21 5:02c81ea9:::benchmark_data_smithi073_23739_object20079:head v 25'1243, mlcod=25'1240)", 2024-09-12T18:35:52.081 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:52.071409+0000", 2024-09-12T18:35:52.081 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0042050359999999997, 2024-09-12T18:35:52.081 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0042557360000000004, 2024-09-12T18:35:52.082 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:52.082 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:52.082 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:35:52.082 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:52.082 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.082 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:52.082 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.071409+0000", 2024-09-12T18:35:52.082 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:52.082 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.082 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.082 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:52.082 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.071409+0000", 2024-09-12T18:35:52.082 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:52.083 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.083 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.083 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:52.083 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.071410+0000", 2024-09-12T18:35:52.083 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.33e-07 2024-09-12T18:35:52.083 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.083 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.083 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:52.083 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.071483+0000", 2024-09-12T18:35:52.083 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.2614000000000006e-05 2024-09-12T18:35:52.083 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.083 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.084 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:52.084 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.071495+0000", 2024-09-12T18:35:52.084 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2176e-05 2024-09-12T18:35:52.084 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.084 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.084 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:52.084 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.071502+0000", 2024-09-12T18:35:52.084 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4259999999999997e-06 2024-09-12T18:35:52.084 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.084 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.084 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:52.084 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.071553+0000", 2024-09-12T18:35:52.084 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0408000000000003e-05 2024-09-12T18:35:52.085 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.085 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.085 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:52.085 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.071568+0000", 2024-09-12T18:35:52.085 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5461999999999999e-05 2024-09-12T18:35:52.085 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:52.085 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:52.085 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:52.085 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.085 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.085 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:20086 5.e e25/21 5:756fad10:::benchmark_data_smithi073_23739_object20085:head v 25'1232, mlcod=25'1230)", 2024-09-12T18:35:52.085 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:52.071530+0000", 2024-09-12T18:35:52.086 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0040847569999999996, 2024-09-12T18:35:52.086 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0041635040000000002, 2024-09-12T18:35:52.086 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:52.086 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:52.086 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:35:52.086 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:52.086 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.086 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:52.086 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.071530+0000", 2024-09-12T18:35:52.086 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:52.086 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.086 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.087 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:52.087 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.071530+0000", 2024-09-12T18:35:52.087 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:52.087 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.087 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.087 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:52.087 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.071530+0000", 2024-09-12T18:35:52.087 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0399999999999996e-07 2024-09-12T18:35:52.087 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.087 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.087 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:52.087 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.071573+0000", 2024-09-12T18:35:52.088 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3291000000000003e-05 2024-09-12T18:35:52.088 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.088 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.088 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:52.088 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.071583+0000", 2024-09-12T18:35:52.088 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1640000000000007e-06 2024-09-12T18:35:52.088 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.088 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.088 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:52.088 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.071589+0000", 2024-09-12T18:35:52.088 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6379999999999998e-06 2024-09-12T18:35:52.088 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.088 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.089 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:52.089 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.071643+0000", 2024-09-12T18:35:52.089 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.3390000000000002e-05 2024-09-12T18:35:52.089 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.089 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.089 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:52.089 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.071659+0000", 2024-09-12T18:35:52.089 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6912999999999999e-05 2024-09-12T18:35:52.089 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:52.089 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:52.089 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:52.089 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.089 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.089 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:20087 5.b e25/21 5:df868922:::benchmark_data_smithi073_23739_object20086:head v 25'1314, mlcod=25'1312)", 2024-09-12T18:35:52.090 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:52.071604+0000", 2024-09-12T18:35:52.090 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0040102899999999997, 2024-09-12T18:35:52.090 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0041156309999999998, 2024-09-12T18:35:52.090 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:52.090 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:52.090 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:35:52.090 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:52.090 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.090 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:52.090 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.071604+0000", 2024-09-12T18:35:52.090 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:52.090 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.090 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.091 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:52.091 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.071604+0000", 2024-09-12T18:35:52.091 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:52.091 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.091 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.091 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:52.091 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.071604+0000", 2024-09-12T18:35:52.091 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.01e-07 2024-09-12T18:35:52.091 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.091 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.091 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:52.091 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.071642+0000", 2024-09-12T18:35:52.091 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.7243999999999998e-05 2024-09-12T18:35:52.092 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.092 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.092 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:52.092 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.071649+0000", 2024-09-12T18:35:52.092 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.695e-06 2024-09-12T18:35:52.092 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.092 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.092 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:52.092 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.071657+0000", 2024-09-12T18:35:52.092 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.2849999999999997e-06 2024-09-12T18:35:52.092 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.092 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.093 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:52.093 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.071716+0000", 2024-09-12T18:35:52.093 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9741999999999998e-05 2024-09-12T18:35:52.093 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.093 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.093 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:52.093 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.071736+0000", 2024-09-12T18:35:52.093 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9715999999999999e-05 2024-09-12T18:35:52.093 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:52.093 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:52.093 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:52.093 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.093 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.093 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:20090 5.3 5:ceb1c11e:::benchmark_data_smithi073_23739_object20089:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:35:52.094 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:52.072745+0000", 2024-09-12T18:35:52.094 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.002869473, 2024-09-12T18:35:52.094 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0030075200000000001, 2024-09-12T18:35:52.094 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:52.094 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:52.094 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:52.094 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:35:52.094 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:35:52.094 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:52.094 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 20090 2024-09-12T18:35:52.094 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.094 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:52.094 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.095 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:52.095 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.072745+0000", 2024-09-12T18:35:52.095 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:52.095 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.095 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.095 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:52.095 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.072745+0000", 2024-09-12T18:35:52.095 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:52.095 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.095 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.095 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:52.095 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.072746+0000", 2024-09-12T18:35:52.095 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.288e-06 2024-09-12T18:35:52.095 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.095 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.096 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:52.096 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.072809+0000", 2024-09-12T18:35:52.096 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2878000000000003e-05 2024-09-12T18:35:52.096 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.096 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.096 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:52.096 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.072821+0000", 2024-09-12T18:35:52.096 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2153e-05 2024-09-12T18:35:52.096 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.096 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.096 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:52.096 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.072828+0000", 2024-09-12T18:35:52.097 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8850000000000001e-06 2024-09-12T18:35:52.097 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.097 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.097 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:52.097 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.072868+0000", 2024-09-12T18:35:52.097 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.9845000000000002e-05 2024-09-12T18:35:52.097 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.097 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.097 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:52.097 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.072958+0000", 2024-09-12T18:35:52.097 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.0354999999999998e-05 2024-09-12T18:35:52.097 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.097 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.098 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:52.098 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.073040+0000", 2024-09-12T18:35:52.098 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1970000000000003e-05 2024-09-12T18:35:52.098 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:52.098 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:52.098 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:52.098 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.098 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.098 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:20089 5.7 e25/21 5:e5273a8f:::benchmark_data_smithi073_23739_object20088:head v 25'1256, mlcod=25'1254)", 2024-09-12T18:35:52.098 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:52.073127+0000", 2024-09-12T18:35:52.098 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0024875549999999998, 2024-09-12T18:35:52.098 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0026601540000000001, 2024-09-12T18:35:52.098 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:52.098 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:52.099 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:35:52.099 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:52.099 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.099 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:52.099 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.073127+0000", 2024-09-12T18:35:52.099 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:52.099 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.099 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.099 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:52.099 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.073127+0000", 2024-09-12T18:35:52.100 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:52.100 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.100 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.100 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:52.100 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.073127+0000", 2024-09-12T18:35:52.100 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5099999999999999e-07 2024-09-12T18:35:52.100 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.100 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.100 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:52.100 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.073168+0000", 2024-09-12T18:35:52.100 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.1063999999999999e-05 2024-09-12T18:35:52.100 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.101 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.101 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:52.101 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.073179+0000", 2024-09-12T18:35:52.101 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0532e-05 2024-09-12T18:35:52.101 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.101 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.101 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:52.101 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.073186+0000", 2024-09-12T18:35:52.101 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4209999999999998e-06 2024-09-12T18:35:52.101 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.101 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.101 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:52.102 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.073241+0000", 2024-09-12T18:35:52.102 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4271000000000003e-05 2024-09-12T18:35:52.102 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.102 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.102 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:52.102 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.073255+0000", 2024-09-12T18:35:52.102 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4379000000000001e-05 2024-09-12T18:35:52.102 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:52.102 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:52.102 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:52.102 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.102 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.103 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:20092 5.6 5:6511c684:::benchmark_data_smithi073_23739_object20091:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:35:52.103 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:52.073339+0000", 2024-09-12T18:35:52.103 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0022749599999999999, 2024-09-12T18:35:52.103 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.002476252, 2024-09-12T18:35:52.103 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:52.103 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:52.103 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:52.103 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:35:52.103 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:35:52.103 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:52.103 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 20092 2024-09-12T18:35:52.103 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.103 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:52.104 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.104 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:52.104 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.073339+0000", 2024-09-12T18:35:52.104 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:52.104 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.104 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.104 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:52.104 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.073339+0000", 2024-09-12T18:35:52.104 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:52.104 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.104 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.104 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:52.104 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.073340+0000", 2024-09-12T18:35:52.104 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.8700000000000004e-07 2024-09-12T18:35:52.105 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.105 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.105 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:52.105 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.073394+0000", 2024-09-12T18:35:52.105 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.3832999999999998e-05 2024-09-12T18:35:52.105 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.105 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.105 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:52.105 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.073445+0000", 2024-09-12T18:35:52.105 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0804999999999999e-05 2024-09-12T18:35:52.105 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.105 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.105 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:52.105 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.073463+0000", 2024-09-12T18:35:52.106 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8227999999999999e-05 2024-09-12T18:35:52.106 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.106 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.106 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:52.106 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.073525+0000", 2024-09-12T18:35:52.106 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2106000000000005e-05 2024-09-12T18:35:52.106 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.106 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.106 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:52.106 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.073672+0000", 2024-09-12T18:35:52.106 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014698399999999999 2024-09-12T18:35:52.106 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.106 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.106 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:52.107 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.073842+0000", 2024-09-12T18:35:52.107 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00016958699999999999 2024-09-12T18:35:52.107 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:52.107 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:52.107 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:52.107 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.107 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.107 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:20091 5.1 e25/21 5:86d73e3e:::benchmark_data_smithi073_23739_object20090:head v 25'1220, mlcod=25'1218)", 2024-09-12T18:35:52.107 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:52.073422+0000", 2024-09-12T18:35:52.107 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0021919679999999999, 2024-09-12T18:35:52.107 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0024274650000000002, 2024-09-12T18:35:52.107 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:52.107 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:52.107 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:35:52.108 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:52.108 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.108 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:52.108 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.073422+0000", 2024-09-12T18:35:52.108 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:52.108 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.108 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.108 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:52.108 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.073422+0000", 2024-09-12T18:35:52.108 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:52.108 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.108 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.108 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:52.109 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.073423+0000", 2024-09-12T18:35:52.109 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:35:52.109 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.109 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.109 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:52.109 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.073477+0000", 2024-09-12T18:35:52.109 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4428000000000001e-05 2024-09-12T18:35:52.109 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.109 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.109 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:52.109 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.073489+0000", 2024-09-12T18:35:52.109 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1177e-05 2024-09-12T18:35:52.110 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.110 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.110 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:52.110 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.073494+0000", 2024-09-12T18:35:52.110 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7980000000000002e-06 2024-09-12T18:35:52.110 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.110 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.110 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:52.110 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.073551+0000", 2024-09-12T18:35:52.110 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6614999999999999e-05 2024-09-12T18:35:52.110 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.110 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.111 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:52.111 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.073568+0000", 2024-09-12T18:35:52.111 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6538e-05 2024-09-12T18:35:52.111 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:52.111 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:52.111 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:52.111 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.111 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.111 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:20088 5.e e25/21 5:7897ba13:::benchmark_data_smithi073_23739_object20087:head v 25'1233, mlcod=25'1230)", 2024-09-12T18:35:52.111 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:52.073693+0000", 2024-09-12T18:35:52.111 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0019209679999999999, 2024-09-12T18:35:52.111 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0021822679999999998, 2024-09-12T18:35:52.111 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:52.112 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:52.112 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:35:52.112 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:52.112 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.112 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:52.112 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.073693+0000", 2024-09-12T18:35:52.112 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:52.112 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.112 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.112 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:52.112 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.073693+0000", 2024-09-12T18:35:52.112 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:52.112 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.113 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.113 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:52.113 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.073694+0000", 2024-09-12T18:35:52.113 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8599999999999998e-07 2024-09-12T18:35:52.113 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.113 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.113 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:52.113 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.073795+0000", 2024-09-12T18:35:52.113 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000100735 2024-09-12T18:35:52.113 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.113 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.113 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:52.113 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.073803+0000", 2024-09-12T18:35:52.114 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6489999999999997e-06 2024-09-12T18:35:52.114 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.114 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.114 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:52.114 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.073810+0000", 2024-09-12T18:35:52.114 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7279999999999998e-06 2024-09-12T18:35:52.114 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.114 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.114 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:52.114 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.073857+0000", 2024-09-12T18:35:52.114 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.6588000000000002e-05 2024-09-12T18:35:52.114 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.114 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.115 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:52.115 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.073876+0000", 2024-09-12T18:35:52.115 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9103e-05 2024-09-12T18:35:52.115 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:52.115 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:52.115 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:52.115 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.115 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.115 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:20082 5.0 e25/21 5:0ae17a6a:::benchmark_data_smithi073_23739_object20081:head v 25'1244, mlcod=25'1240)", 2024-09-12T18:35:52.115 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:52.073869+0000", 2024-09-12T18:35:52.115 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0017450930000000001, 2024-09-12T18:35:52.115 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0020346409999999998, 2024-09-12T18:35:52.115 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:52.116 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:52.116 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:35:52.116 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:52.116 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.116 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:52.116 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.073869+0000", 2024-09-12T18:35:52.116 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:52.116 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.116 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.116 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:52.116 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.073869+0000", 2024-09-12T18:35:52.116 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:52.116 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.117 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.117 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:52.117 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.073870+0000", 2024-09-12T18:35:52.117 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4799999999999999e-07 2024-09-12T18:35:52.117 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.117 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.117 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:52.117 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.073933+0000", 2024-09-12T18:35:52.117 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3616999999999998e-05 2024-09-12T18:35:52.117 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.117 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.117 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:52.117 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.073940+0000", 2024-09-12T18:35:52.118 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5490000000000003e-06 2024-09-12T18:35:52.118 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.118 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.118 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:52.118 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.073945+0000", 2024-09-12T18:35:52.118 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8289999999999998e-06 2024-09-12T18:35:52.118 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.118 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.118 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:52.118 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.073982+0000", 2024-09-12T18:35:52.118 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.7154999999999999e-05 2024-09-12T18:35:52.118 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.118 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.118 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:52.119 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.074010+0000", 2024-09-12T18:35:52.119 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7838999999999999e-05 2024-09-12T18:35:52.119 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:52.119 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:52.119 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:52.119 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.119 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.119 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:20093 5.c 5:342d884f:::benchmark_data_smithi073_23739_object20092:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:35:52.119 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:52.074247+0000", 2024-09-12T18:35:52.119 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00136685, 2024-09-12T18:35:52.119 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0016856219999999999, 2024-09-12T18:35:52.120 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:52.120 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:52.120 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:52.120 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:35:52.120 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:35:52.120 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:52.120 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 20093 2024-09-12T18:35:52.120 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.120 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:52.120 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.120 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:52.120 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.074247+0000", 2024-09-12T18:35:52.120 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:52.120 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.121 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.121 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:52.121 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.074247+0000", 2024-09-12T18:35:52.121 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:52.121 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.121 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.121 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:52.121 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.074248+0000", 2024-09-12T18:35:52.121 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.47e-07 2024-09-12T18:35:52.121 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.121 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.121 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:52.121 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.074302+0000", 2024-09-12T18:35:52.122 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4020000000000001e-05 2024-09-12T18:35:52.122 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.122 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.122 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:52.122 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.074313+0000", 2024-09-12T18:35:52.122 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0129000000000001e-05 2024-09-12T18:35:52.122 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.122 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.122 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:52.122 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.074319+0000", 2024-09-12T18:35:52.122 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7510000000000002e-06 2024-09-12T18:35:52.122 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.122 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.123 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:52.123 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.074366+0000", 2024-09-12T18:35:52.123 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.6520000000000002e-05 2024-09-12T18:35:52.123 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.123 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.123 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:52.123 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.074474+0000", 2024-09-12T18:35:52.123 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000107718 2024-09-12T18:35:52.123 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.123 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.124 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:52.124 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.074584+0000", 2024-09-12T18:35:52.124 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00011031600000000001 2024-09-12T18:35:52.124 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:52.124 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:52.124 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:52.124 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.124 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.124 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:20094 5.6 5.28dcd716 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:35:52.124 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:52.074338+0000", 2024-09-12T18:35:52.124 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0012758890000000001, 2024-09-12T18:35:52.124 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001626221, 2024-09-12T18:35:52.125 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:52.125 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:52.125 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:35:52.125 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:35:52.125 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:35:52.125 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:52.125 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 20094 2024-09-12T18:35:52.125 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.125 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:52.125 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.125 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:52.125 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.074338+0000", 2024-09-12T18:35:52.126 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:52.126 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.126 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.126 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:52.126 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.074338+0000", 2024-09-12T18:35:52.126 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:52.126 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.126 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.126 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:52.126 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.074339+0000", 2024-09-12T18:35:52.126 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3399999999999999e-07 2024-09-12T18:35:52.126 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.126 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.127 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:52.127 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.074375+0000", 2024-09-12T18:35:52.127 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.5785999999999999e-05 2024-09-12T18:35:52.127 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.127 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.127 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:52.127 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.074383+0000", 2024-09-12T18:35:52.127 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0399999999999993e-06 2024-09-12T18:35:52.127 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.127 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.127 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:52.127 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.074389+0000", 2024-09-12T18:35:52.128 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5409999999999997e-06 2024-09-12T18:35:52.128 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:52.128 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:52.128 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:52.128 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.128 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.128 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:20095 5.3 5:c9f75912:::benchmark_data_smithi073_23739_object20094:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:35:52.128 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:52.074780+0000", 2024-09-12T18:35:52.128 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00083383000000000003, 2024-09-12T18:35:52.128 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001214253, 2024-09-12T18:35:52.128 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:52.128 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:52.129 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:52.129 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:35:52.129 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:35:52.129 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:52.129 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 20095 2024-09-12T18:35:52.129 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.129 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:52.129 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.129 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:52.129 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.074780+0000", 2024-09-12T18:35:52.129 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:52.129 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.129 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.130 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:52.130 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.074780+0000", 2024-09-12T18:35:52.130 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:52.130 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.130 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.130 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:52.130 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.074781+0000", 2024-09-12T18:35:52.130 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3799999999999996e-07 2024-09-12T18:35:52.130 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.130 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.130 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:52.130 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.074843+0000", 2024-09-12T18:35:52.130 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2279999999999993e-05 2024-09-12T18:35:52.131 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.131 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.131 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:52.131 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.074854+0000", 2024-09-12T18:35:52.131 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0978000000000001e-05 2024-09-12T18:35:52.131 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.131 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.131 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:52.131 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.074860+0000", 2024-09-12T18:35:52.131 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.3630000000000002e-06 2024-09-12T18:35:52.131 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.131 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.132 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:52.132 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.074913+0000", 2024-09-12T18:35:52.132 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.3219e-05 2024-09-12T18:35:52.132 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.132 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.132 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:52.132 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.075028+0000", 2024-09-12T18:35:52.132 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000114561 2024-09-12T18:35:52.132 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.132 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.132 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:52.132 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.075110+0000", 2024-09-12T18:35:52.132 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2125000000000004e-05 2024-09-12T18:35:52.133 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:52.133 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:52.133 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:52.133 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.133 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.133 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:20090 5.3 e25/21)", 2024-09-12T18:35:52.133 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:52.075187+0000", 2024-09-12T18:35:52.133 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.000426857, 2024-09-12T18:35:52.133 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00083876700000000003, 2024-09-12T18:35:52.133 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:52.133 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:52.133 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:35:52.133 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:52.133 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.134 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:52.134 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.075187+0000", 2024-09-12T18:35:52.134 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:52.134 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.134 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.134 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:52.134 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.075187+0000", 2024-09-12T18:35:52.134 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:52.134 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.134 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.134 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:52.134 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.075188+0000", 2024-09-12T18:35:52.134 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5499999999999998e-07 2024-09-12T18:35:52.135 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.135 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.135 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:52.135 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.075192+0000", 2024-09-12T18:35:52.135 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.7780000000000001e-06 2024-09-12T18:35:52.135 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.135 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.135 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:52.135 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.075202+0000", 2024-09-12T18:35:52.135 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0117e-05 2024-09-12T18:35:52.135 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.135 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.135 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:52.136 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.075211+0000", 2024-09-12T18:35:52.136 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.9230000000000008e-06 2024-09-12T18:35:52.136 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:52.136 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:52.136 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:52.136 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.136 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.136 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:20092 5.6 e25/21)", 2024-09-12T18:35:52.136 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:52.075982+0000", 2024-09-12T18:35:52.136 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4294967295.9996324, 2024-09-12T18:35:52.136 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6816000000000005e-05, 2024-09-12T18:35:52.136 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:52.136 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:52.136 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:35:52.137 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:52.137 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.137 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:52.137 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.075982+0000", 2024-09-12T18:35:52.137 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:52.137 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.137 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.137 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:52.137 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.075982+0000", 2024-09-12T18:35:52.137 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:52.137 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.137 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.138 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:52.138 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.075982+0000", 2024-09-12T18:35:52.138 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.84e-07 2024-09-12T18:35:52.138 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.138 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.138 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:52.138 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.075984+0000", 2024-09-12T18:35:52.138 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.703e-06 2024-09-12T18:35:52.138 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.138 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.138 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:52.138 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.075991+0000", 2024-09-12T18:35:52.138 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1539999999999996e-06 2024-09-12T18:35:52.139 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.139 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.139 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:52.139 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.075997+0000", 2024-09-12T18:35:52.139 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9120000000000003e-06 2024-09-12T18:35:52.139 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:52.139 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:52.139 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:52.139 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.139 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.139 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:20074 5.a 5:5effabc4:::benchmark_data_smithi073_23739_object20073:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:35:52.139 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:52.068492+0000", 2024-09-12T18:35:52.139 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0071225259999999997, 2024-09-12T18:35:52.139 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0075859229999999996, 2024-09-12T18:35:52.140 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:52.140 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:52.140 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:52.140 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:35:52.140 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:35:52.140 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:52.140 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 20074 2024-09-12T18:35:52.140 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.140 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:52.140 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.140 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:52.140 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.068492+0000", 2024-09-12T18:35:52.140 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:52.141 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.141 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.141 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:52.141 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.068492+0000", 2024-09-12T18:35:52.141 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:52.141 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.141 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.141 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:52.141 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.068493+0000", 2024-09-12T18:35:52.141 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3099999999999997e-07 2024-09-12T18:35:52.141 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.141 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.141 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:52.142 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.068560+0000", 2024-09-12T18:35:52.142 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7977000000000003e-05 2024-09-12T18:35:52.142 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.142 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.142 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:52.142 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.068571+0000", 2024-09-12T18:35:52.142 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0485999999999999e-05 2024-09-12T18:35:52.142 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.142 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.142 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:52.142 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.068580+0000", 2024-09-12T18:35:52.142 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.9139999999999997e-06 2024-09-12T18:35:52.142 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.142 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.143 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:52.143 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.069102+0000", 2024-09-12T18:35:52.143 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00052200300000000005 2024-09-12T18:35:52.143 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.143 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.143 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:52.143 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.069175+0000", 2024-09-12T18:35:52.143 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.2651999999999995e-05 2024-09-12T18:35:52.143 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.143 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.143 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:52.143 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.069262+0000", 2024-09-12T18:35:52.143 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7225999999999995e-05 2024-09-12T18:35:52.143 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:52.144 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:52.144 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:35:52.144 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:52.071261+0000", 2024-09-12T18:35:52.144 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001999425 2024-09-12T18:35:52.144 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:52.144 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:52.144 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:52.144 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:52.144 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-12T18:35:52.144 INFO:teuthology.orchestra.run.smithi114.stdout: "num_ops": 16 2024-09-12T18:35:52.144 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:35:52.145 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:35:52.146 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:52.142+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:52.147 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:35:52.246 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:52.242+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:52.294 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:35:52.294 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:35:52.305 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:52.305 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:52.313 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is unset 2024-09-12T18:35:52.313 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:35:52.314 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:35:52.327 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:35:52.344 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:35:52.345 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:35:52.374 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:52.373+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:52.448 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:52.445+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:52.485 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:52.485 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:52.509 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:35:52.554 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:52.554+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:52.650 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:52.650+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:52.666 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:52.666 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:52.685 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:35:52.752 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:52.750+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:52.853 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:52.850+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:52.868 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 7 16 22342 22326 199.318 176.562 0.00467758 0.00501163 2024-09-12T18:35:52.889 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:52.889 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:52.910 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:35:52.954 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:52.950+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:53.056 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:53.054+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:53.167 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:53.162+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:53.167 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:53.167 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:53.168 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:35:53.267 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:53.266+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:53.320 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:53.321 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:53.341 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:35:53.368 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:53.366+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:53.469 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:53.466+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:53.499 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:53.499 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:53.521 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:35:53.589 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:35:53.589 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:35:53.589 INFO:tasks.thrashosds.thrasher:Setting full ratio to .001 2024-09-12T18:35:53.590 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set-full-ratio .001 2024-09-12T18:35:53.608 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:53.606+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:53.670 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:53.670+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:53.722 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:53.722 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:53.744 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:35:53.789 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:53.786+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:53.868 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 8 16 25201 25185 196.736 178.688 0.00455353 0.00507749 2024-09-12T18:35:53.872 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:53.869+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:53.910 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:53.910 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:53.931 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:35:53.974 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:53.973+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:54.074 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:54.073+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:54.129 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:54.129 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:54.151 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:35:54.175 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:54.170+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:54.276 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:54.274+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:54.330 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-12T18:35:54.329+0000 7f095e1b3640 -1 log_channel(cluster) log [ERR] : Health check failed: full ratio(s) out of order (OSD_OUT_OF_ORDER_FULL) 2024-09-12T18:35:54.343 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T18:35:54.354 INFO:teuthology.orchestra.run.smithi073.stderr:osd set-full-ratio 0.001 2024-09-12T18:35:54.355 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:54.355 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:54.362 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:35:54.375 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:35:54.377 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:54.374+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:54.477 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:54.474+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:54.516 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:35:54.517 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:35:54.527 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:54.528 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:54.535 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:35:54.535 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:35:54.549 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:35:54.554 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:35:54.554 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:35:54.578 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:54.577+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:54.679 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:54.674+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:54.743 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:35:54.743 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-09-12T18:35:54.743 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-09-12T18:35:54.743 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-09-12T18:35:54.743 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:35:54.761 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:35:54.806 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:54.806+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:54.868 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 9 16 27820 27804 193.062 163.688 0.00442329 0.00517396 2024-09-12T18:35:54.881 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:54.878+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:54.917 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:35:54.918 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-09-12T18:35:54.918 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-09-12T18:35:54.918 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:35:54.918 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.918 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:54.918 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:35:54.918 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 29.284354938, 2024-09-12T18:35:54.918 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025088781000000001, 2024-09-12T18:35:54.918 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:54.919 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:54.919 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:54.919 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:54.919 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.919 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:54.919 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:35:54.919 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:54.919 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.919 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.919 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:54.919 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:35:54.920 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:54.920 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.920 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.920 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:54.920 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632518+0000", 2024-09-12T18:35:54.920 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:35:54.920 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.920 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.920 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:54.921 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632533+0000", 2024-09-12T18:35:54.921 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5130000000000001e-05 2024-09-12T18:35:54.921 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.921 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.921 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:54.921 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632564+0000", 2024-09-12T18:35:54.921 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0788999999999999e-05 2024-09-12T18:35:54.921 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.921 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.921 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:54.922 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632590+0000", 2024-09-12T18:35:54.922 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6057000000000001e-05 2024-09-12T18:35:54.922 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.922 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.922 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:54.922 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.635931+0000", 2024-09-12T18:35:54.922 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033411320000000001 2024-09-12T18:35:54.922 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.922 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.922 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:54.922 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636186+0000", 2024-09-12T18:35:54.923 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025452500000000002 2024-09-12T18:35:54.923 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.923 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.923 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:54.923 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636445+0000", 2024-09-12T18:35:54.923 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000259268 2024-09-12T18:35:54.923 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.923 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.923 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:54.923 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639562+0000", 2024-09-12T18:35:54.924 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031167 2024-09-12T18:35:54.924 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.924 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.924 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:54.924 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657314+0000", 2024-09-12T18:35:54.924 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017752562 2024-09-12T18:35:54.924 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.924 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.924 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:54.924 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657445+0000", 2024-09-12T18:35:54.924 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013105899999999999 2024-09-12T18:35:54.925 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.925 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.925 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:54.925 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657598+0000", 2024-09-12T18:35:54.925 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015247899999999999 2024-09-12T18:35:54.925 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:54.925 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:54.925 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:54.925 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.925 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.926 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:54.926 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:35:54.926 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 29.284228734999999, 2024-09-12T18:35:54.926 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025643131999999999, 2024-09-12T18:35:54.926 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:54.926 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:54.926 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:54.926 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:54.926 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.926 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:54.927 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:35:54.927 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:54.927 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.927 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.927 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:54.927 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:35:54.927 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:54.927 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.927 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.928 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:54.928 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632637+0000", 2024-09-12T18:35:54.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5600000000000001e-06 2024-09-12T18:35:54.928 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.928 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:54.928 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632650+0000", 2024-09-12T18:35:54.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3186e-05 2024-09-12T18:35:54.928 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.929 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:54.929 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632672+0000", 2024-09-12T18:35:54.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2013000000000001e-05 2024-09-12T18:35:54.929 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.929 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.929 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:54.929 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632687+0000", 2024-09-12T18:35:54.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5109999999999999e-05 2024-09-12T18:35:54.929 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.929 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.929 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:54.930 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636994+0000", 2024-09-12T18:35:54.930 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0043065539999999998 2024-09-12T18:35:54.930 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.930 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:54.930 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637198+0000", 2024-09-12T18:35:54.930 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020387199999999999 2024-09-12T18:35:54.930 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.930 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:54.931 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637475+0000", 2024-09-12T18:35:54.931 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027731000000000001 2024-09-12T18:35:54.931 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.931 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.931 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:54.931 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639574+0000", 2024-09-12T18:35:54.931 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020988999999999999 2024-09-12T18:35:54.931 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.931 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.931 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:54.931 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658057+0000", 2024-09-12T18:35:54.932 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018482926 2024-09-12T18:35:54.932 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.932 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.932 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:54.932 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658184+0000", 2024-09-12T18:35:54.932 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012756200000000001 2024-09-12T18:35:54.932 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.932 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.932 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:54.932 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658278+0000", 2024-09-12T18:35:54.932 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4139000000000001e-05 2024-09-12T18:35:54.933 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:54.933 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:54.933 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:54.933 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.933 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.933 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:54.933 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:35:54.933 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 29.284153643, 2024-09-12T18:35:54.933 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025238883, 2024-09-12T18:35:54.933 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:54.933 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:54.934 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:54.934 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:54.934 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.934 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:54.934 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:35:54.934 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:54.934 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.934 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.934 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:54.934 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:35:54.934 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:54.935 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.935 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:54.935 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632712+0000", 2024-09-12T18:35:54.935 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6869999999999999e-06 2024-09-12T18:35:54.935 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.935 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:54.935 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632719+0000", 2024-09-12T18:35:54.935 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6059999999999999e-06 2024-09-12T18:35:54.935 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.936 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:54.936 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632737+0000", 2024-09-12T18:35:54.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7983999999999999e-05 2024-09-12T18:35:54.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.936 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.936 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:54.936 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632751+0000", 2024-09-12T18:35:54.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4473e-05 2024-09-12T18:35:54.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.937 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.937 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:54.937 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636961+0000", 2024-09-12T18:35:54.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042100840000000002 2024-09-12T18:35:54.937 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.937 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.937 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:54.937 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637211+0000", 2024-09-12T18:35:54.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000249738 2024-09-12T18:35:54.937 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.937 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.938 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:54.938 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637504+0000", 2024-09-12T18:35:54.938 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00029271499999999998 2024-09-12T18:35:54.938 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.938 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.938 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:54.938 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639582+0000", 2024-09-12T18:35:54.938 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020783389999999998 2024-09-12T18:35:54.938 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.938 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.938 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:54.939 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657709+0000", 2024-09-12T18:35:54.939 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018126758999999999 2024-09-12T18:35:54.939 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.939 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.939 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:54.939 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657830+0000", 2024-09-12T18:35:54.939 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000121329 2024-09-12T18:35:54.939 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.939 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.939 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:54.940 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657949+0000", 2024-09-12T18:35:54.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000119169 2024-09-12T18:35:54.940 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:54.941 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:54.941 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:54.941 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.941 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.941 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:54.941 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:35:54.941 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 29.284089597000001, 2024-09-12T18:35:54.941 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026711823999999999, 2024-09-12T18:35:54.941 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:54.941 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:54.941 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:54.942 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:54.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.942 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:54.942 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:35:54.942 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:54.942 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.942 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:54.942 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:35:54.942 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:54.942 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:54.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632775+0000", 2024-09-12T18:35:54.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9999999999999995e-07 2024-09-12T18:35:54.943 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:54.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632788+0000", 2024-09-12T18:35:54.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2629999999999999e-05 2024-09-12T18:35:54.943 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:54.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632806+0000", 2024-09-12T18:35:54.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:35:54.944 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.944 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.944 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:54.944 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632820+0000", 2024-09-12T18:35:54.944 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3777e-05 2024-09-12T18:35:54.944 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.944 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.944 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:54.944 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638310+0000", 2024-09-12T18:35:54.944 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054898280000000004 2024-09-12T18:35:54.944 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.945 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.945 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:54.945 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638480+0000", 2024-09-12T18:35:54.945 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016968199999999999 2024-09-12T18:35:54.945 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.945 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.945 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:54.945 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638799+0000", 2024-09-12T18:35:54.945 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031915999999999997 2024-09-12T18:35:54.945 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.945 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.945 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:54.945 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639866+0000", 2024-09-12T18:35:54.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001067405 2024-09-12T18:35:54.946 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.946 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:54.946 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658398+0000", 2024-09-12T18:35:54.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018531542000000002 2024-09-12T18:35:54.946 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.946 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:54.946 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658643+0000", 2024-09-12T18:35:54.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00024531500000000002 2024-09-12T18:35:54.946 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.947 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:54.947 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.659486+0000", 2024-09-12T18:35:54.947 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00084316899999999995 2024-09-12T18:35:54.947 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:54.947 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:54.947 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:54.947 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.947 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.947 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:54.947 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632845+0000", 2024-09-12T18:35:54.947 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 29.284018571000001, 2024-09-12T18:35:54.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015333398999999999, 2024-09-12T18:35:54.948 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:54.948 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:54.948 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:54.948 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:54.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:54.948 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632845+0000", 2024-09-12T18:35:54.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:54.948 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:54.948 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632845+0000", 2024-09-12T18:35:54.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:54.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:54.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632847+0000", 2024-09-12T18:35:54.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.407e-06 2024-09-12T18:35:54.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:54.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632854+0000", 2024-09-12T18:35:54.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1670000000000002e-06 2024-09-12T18:35:54.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.950 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:54.950 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632877+0000", 2024-09-12T18:35:54.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2929e-05 2024-09-12T18:35:54.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.950 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:54.950 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632891+0000", 2024-09-12T18:35:54.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3689999999999999e-05 2024-09-12T18:35:54.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.950 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:54.950 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.634571+0000", 2024-09-12T18:35:54.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016800929999999999 2024-09-12T18:35:54.951 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.951 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:54.951 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.635247+0000", 2024-09-12T18:35:54.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000676051 2024-09-12T18:35:54.951 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.951 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:54.951 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636176+0000", 2024-09-12T18:35:54.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00092889199999999996 2024-09-12T18:35:54.951 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.951 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:54.952 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637978+0000", 2024-09-12T18:35:54.952 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018024320000000001 2024-09-12T18:35:54.952 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.952 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.952 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:54.952 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.647862+0000", 2024-09-12T18:35:54.952 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0098842540000000003 2024-09-12T18:35:54.952 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.952 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.952 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:54.952 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.648055+0000", 2024-09-12T18:35:54.952 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00019265499999999999 2024-09-12T18:35:54.953 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.953 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.953 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:54.953 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.648179+0000", 2024-09-12T18:35:54.953 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000123829 2024-09-12T18:35:54.953 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:54.953 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:54.953 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:54.953 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.953 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.953 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:54.953 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:35:54.954 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 29.283862535000001, 2024-09-12T18:35:54.954 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.021357139000000001, 2024-09-12T18:35:54.954 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:54.954 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:54.954 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:54.954 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:54.954 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.954 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:54.954 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:35:54.954 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:54.954 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.954 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:54.955 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:35:54.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:54.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:54.955 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633003+0000", 2024-09-12T18:35:54.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.53e-06 2024-09-12T18:35:54.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:54.955 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633012+0000", 2024-09-12T18:35:54.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9290000000000004e-06 2024-09-12T18:35:54.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.956 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.956 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:54.956 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633034+0000", 2024-09-12T18:35:54.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2127e-05 2024-09-12T18:35:54.956 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.956 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.956 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:54.956 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633054+0000", 2024-09-12T18:35:54.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9476000000000001e-05 2024-09-12T18:35:54.956 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.956 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.957 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:54.957 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636657+0000", 2024-09-12T18:35:54.957 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036038839999999999 2024-09-12T18:35:54.957 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.957 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.957 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:54.957 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636885+0000", 2024-09-12T18:35:54.957 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022798800000000001 2024-09-12T18:35:54.957 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.957 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.957 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:54.958 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637189+0000", 2024-09-12T18:35:54.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030392100000000002 2024-09-12T18:35:54.958 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.958 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.958 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:54.958 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639271+0000", 2024-09-12T18:35:54.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020817460000000002 2024-09-12T18:35:54.958 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.958 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.958 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:54.958 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.652371+0000", 2024-09-12T18:35:54.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013099417 2024-09-12T18:35:54.959 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.959 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:54.959 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654255+0000", 2024-09-12T18:35:54.959 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018846049999999999 2024-09-12T18:35:54.959 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.959 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:54.959 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654359+0000", 2024-09-12T18:35:54.959 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000103516 2024-09-12T18:35:54.959 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:54.959 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:54.959 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:54.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.960 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:54.960 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:35:54.960 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 29.283780842999999, 2024-09-12T18:35:54.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026938645000000001, 2024-09-12T18:35:54.960 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:54.960 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:54.960 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:54.960 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:54.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.960 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:54.960 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:35:54.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:54.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:54.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:35:54.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:54.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:54.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633085+0000", 2024-09-12T18:35:54.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:35:54.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:54.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633093+0000", 2024-09-12T18:35:54.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3999999999999992e-06 2024-09-12T18:35:54.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:54.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633111+0000", 2024-09-12T18:35:54.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8070000000000001e-05 2024-09-12T18:35:54.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:54.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633126+0000", 2024-09-12T18:35:54.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4487e-05 2024-09-12T18:35:54.963 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.963 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.963 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:54.963 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638290+0000", 2024-09-12T18:35:54.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0051640269999999999 2024-09-12T18:35:54.963 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.963 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.963 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:54.963 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638547+0000", 2024-09-12T18:35:54.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025714100000000001 2024-09-12T18:35:54.963 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.964 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.964 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:54.964 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638850+0000", 2024-09-12T18:35:54.964 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030278400000000001 2024-09-12T18:35:54.964 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.964 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.964 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:54.964 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.640706+0000", 2024-09-12T18:35:54.964 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018564580000000001 2024-09-12T18:35:54.964 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.964 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.964 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:54.964 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658420+0000", 2024-09-12T18:35:54.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017714395000000001 2024-09-12T18:35:54.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:54.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658635+0000", 2024-09-12T18:35:54.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021413500000000001 2024-09-12T18:35:54.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:54.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.660022+0000", 2024-09-12T18:35:54.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001387318 2024-09-12T18:35:54.965 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:54.965 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:54.966 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:54.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.966 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:54.966 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633323+0000", 2024-09-12T18:35:54.966 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 29.283541488000001, 2024-09-12T18:35:54.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015717332000000001, 2024-09-12T18:35:54.966 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:54.966 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:54.966 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:35:54.966 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:54.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:54.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633323+0000", 2024-09-12T18:35:54.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:54.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:54.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633323+0000", 2024-09-12T18:35:54.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:54.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:54.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633324+0000", 2024-09-12T18:35:54.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7230000000000001e-06 2024-09-12T18:35:54.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:54.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633351+0000", 2024-09-12T18:35:54.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7067e-05 2024-09-12T18:35:54.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.968 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:54.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633372+0000", 2024-09-12T18:35:54.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0429e-05 2024-09-12T18:35:54.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.968 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:54.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633387+0000", 2024-09-12T18:35:54.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5659999999999999e-05 2024-09-12T18:35:54.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:54.969 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633527+0000", 2024-09-12T18:35:54.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013991599999999999 2024-09-12T18:35:54.969 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:54.969 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633806+0000", 2024-09-12T18:35:54.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027858400000000001 2024-09-12T18:35:54.969 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:54.969 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.649040+0000", 2024-09-12T18:35:54.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015233953 2024-09-12T18:35:54.970 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:54.970 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:54.970 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:54.970 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.970 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.970 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:54.970 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:35:54.970 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 29.283436332000001, 2024-09-12T18:35:54.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.020709867, 2024-09-12T18:35:54.970 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:54.970 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:54.971 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:35:54.971 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:54.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:54.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:35:54.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:54.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:54.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:35:54.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:54.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:54.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633429+0000", 2024-09-12T18:35:54.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.313e-06 2024-09-12T18:35:54.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:54.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633462+0000", 2024-09-12T18:35:54.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3197000000000001e-05 2024-09-12T18:35:54.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:54.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633485+0000", 2024-09-12T18:35:54.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3243000000000001e-05 2024-09-12T18:35:54.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:54.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633501+0000", 2024-09-12T18:35:54.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5383000000000002e-05 2024-09-12T18:35:54.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:54.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633642+0000", 2024-09-12T18:35:54.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000141168 2024-09-12T18:35:54.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.974 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:54.974 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633982+0000", 2024-09-12T18:35:54.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000340067 2024-09-12T18:35:54.974 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.974 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:54.974 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654138+0000", 2024-09-12T18:35:54.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.020155495999999998 2024-09-12T18:35:54.974 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:54.974 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:54.974 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:54.974 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.975 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:1 5.e 5:7e06fd68:::benchmark_data_smithi073_23739_object0:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:35:54.975 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:45.871264+0000", 2024-09-12T18:35:54.975 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 9.0455999279999997, 2024-09-12T18:35:54.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012442986, 2024-09-12T18:35:54.975 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:54.975 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:54.975 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:54.975 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:54.975 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:54.975 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:54.975 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 1 2024-09-12T18:35:54.975 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.976 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:54.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.976 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:54.976 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.871264+0000", 2024-09-12T18:35:54.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:54.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.976 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:54.976 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.871264+0000", 2024-09-12T18:35:54.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:54.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:54.977 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.871267+0000", 2024-09-12T18:35:54.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3699999999999999e-06 2024-09-12T18:35:54.977 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:54.977 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.871685+0000", 2024-09-12T18:35:54.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00041753599999999998 2024-09-12T18:35:54.977 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:54.977 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.871714+0000", 2024-09-12T18:35:54.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8626999999999999e-05 2024-09-12T18:35:54.978 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.978 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:54.978 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.871731+0000", 2024-09-12T18:35:54.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7229999999999999e-05 2024-09-12T18:35:54.978 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.978 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:54.978 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.871934+0000", 2024-09-12T18:35:54.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020336099999999999 2024-09-12T18:35:54.978 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.979 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:54.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872200+0000", 2024-09-12T18:35:54.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026600199999999999 2024-09-12T18:35:54.979 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.979 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:54.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872518+0000", 2024-09-12T18:35:54.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031749700000000003 2024-09-12T18:35:54.979 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.979 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:54.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.875939+0000", 2024-09-12T18:35:54.980 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0034210109999999998 2024-09-12T18:35:54.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.980 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:54.980 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.883472+0000", 2024-09-12T18:35:54.980 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0075330909999999996 2024-09-12T18:35:54.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.980 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:54.980 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.883591+0000", 2024-09-12T18:35:54.980 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000119636 2024-09-12T18:35:54.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.981 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.981 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:54.981 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.883707+0000", 2024-09-12T18:35:54.981 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011562500000000001 2024-09-12T18:35:54.981 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:54.981 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:54.981 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:54.981 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.981 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.981 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:6 5.8 5:1f55594e:::benchmark_data_smithi073_23739_object5:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:35:54.981 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:45.871821+0000", 2024-09-12T18:35:54.981 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 9.0450425330000002, 2024-09-12T18:35:54.981 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011937, 2024-09-12T18:35:54.982 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:54.982 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:54.982 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:54.982 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:54.982 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:54.982 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:54.982 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 6 2024-09-12T18:35:54.982 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.982 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:54.982 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.982 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:54.982 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.871821+0000", 2024-09-12T18:35:54.983 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:54.983 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.983 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.983 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:54.983 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.871821+0000", 2024-09-12T18:35:54.983 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:54.983 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.983 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.983 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:54.983 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.871823+0000", 2024-09-12T18:35:54.983 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3999999999999999e-06 2024-09-12T18:35:54.983 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.984 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:54.984 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872163+0000", 2024-09-12T18:35:54.984 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00033989399999999998 2024-09-12T18:35:54.984 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.984 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:54.984 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872179+0000", 2024-09-12T18:35:54.984 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5736999999999999e-05 2024-09-12T18:35:54.984 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.984 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:54.985 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872189+0000", 2024-09-12T18:35:54.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.059e-05 2024-09-12T18:35:54.985 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.985 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.985 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:54.985 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872322+0000", 2024-09-12T18:35:54.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000133065 2024-09-12T18:35:54.985 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.985 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.985 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:54.985 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872547+0000", 2024-09-12T18:35:54.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022501800000000001 2024-09-12T18:35:54.986 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.986 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.986 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:54.986 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872918+0000", 2024-09-12T18:35:54.986 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00037063100000000001 2024-09-12T18:35:54.986 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.986 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.986 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:54.986 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.875427+0000", 2024-09-12T18:35:54.986 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025094449999999999 2024-09-12T18:35:54.986 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.986 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.986 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:54.987 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.883538+0000", 2024-09-12T18:35:54.987 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0081109359999999991 2024-09-12T18:35:54.987 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.987 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.987 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:54.987 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.883643+0000", 2024-09-12T18:35:54.987 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000105059 2024-09-12T18:35:54.987 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.987 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.987 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:54.987 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.883758+0000", 2024-09-12T18:35:54.987 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000115225 2024-09-12T18:35:54.987 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:54.988 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:54.988 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:54.988 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.988 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.988 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:15 5.8 5:1781ebe7:::benchmark_data_smithi073_23739_object14:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:35:54.988 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:45.872695+0000", 2024-09-12T18:35:54.988 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 9.0441688100000004, 2024-09-12T18:35:54.988 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012029096, 2024-09-12T18:35:54.988 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:54.988 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:54.988 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:54.988 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:54.988 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:54.988 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:54.988 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 15 2024-09-12T18:35:54.989 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.989 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:54.989 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.989 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:54.989 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872695+0000", 2024-09-12T18:35:54.989 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:54.989 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.989 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.989 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:54.989 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872695+0000", 2024-09-12T18:35:54.990 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:54.990 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.990 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.990 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:54.990 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872697+0000", 2024-09-12T18:35:54.990 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.407e-06 2024-09-12T18:35:54.990 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.990 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.990 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:54.990 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872824+0000", 2024-09-12T18:35:54.990 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012739500000000001 2024-09-12T18:35:54.990 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.990 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.991 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:54.991 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872844+0000", 2024-09-12T18:35:54.991 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9973e-05 2024-09-12T18:35:54.991 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.991 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.991 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:54.991 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.872861+0000", 2024-09-12T18:35:54.991 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7220000000000001e-05 2024-09-12T18:35:54.991 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.991 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.991 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:54.991 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.874095+0000", 2024-09-12T18:35:54.991 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00123331 2024-09-12T18:35:54.991 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.992 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.992 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:54.992 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.874443+0000", 2024-09-12T18:35:54.992 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00034860000000000002 2024-09-12T18:35:54.992 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.992 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.992 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:54.992 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.874690+0000", 2024-09-12T18:35:54.992 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00024676500000000003 2024-09-12T18:35:54.992 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.992 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.992 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:54.992 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.876472+0000", 2024-09-12T18:35:54.992 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001781728 2024-09-12T18:35:54.993 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.993 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.993 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:54.993 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.884538+0000", 2024-09-12T18:35:54.993 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080661399999999994 2024-09-12T18:35:54.993 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.993 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.993 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:54.993 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.884632+0000", 2024-09-12T18:35:54.993 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4235999999999997e-05 2024-09-12T18:35:54.993 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.993 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.993 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:54.994 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.884724+0000", 2024-09-12T18:35:54.994 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2322000000000001e-05 2024-09-12T18:35:54.994 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:54.994 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:54.994 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:54.994 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.994 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.994 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:58 5.e 5:72811c8e:::benchmark_data_smithi073_23739_object57:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:35:54.994 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:45.899899+0000", 2024-09-12T18:35:54.994 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 9.0169645500000009, 2024-09-12T18:35:54.994 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012438803, 2024-09-12T18:35:54.994 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:54.994 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:54.994 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:54.995 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:54.995 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:54.995 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:54.995 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 58 2024-09-12T18:35:54.995 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.995 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:54.995 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.995 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:54.995 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.899899+0000", 2024-09-12T18:35:54.995 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:54.995 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.995 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.996 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:54.996 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.899899+0000", 2024-09-12T18:35:54.996 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:54.996 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.996 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.996 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:54.996 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.899901+0000", 2024-09-12T18:35:54.996 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9530000000000002e-06 2024-09-12T18:35:54.996 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.996 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.996 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:54.996 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.899988+0000", 2024-09-12T18:35:54.996 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6502999999999995e-05 2024-09-12T18:35:54.996 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.997 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.997 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:54.997 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.900015+0000", 2024-09-12T18:35:54.997 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6919000000000001e-05 2024-09-12T18:35:54.997 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.997 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.997 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:54.997 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.900040+0000", 2024-09-12T18:35:54.997 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5497e-05 2024-09-12T18:35:54.997 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.997 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.997 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:54.997 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.900147+0000", 2024-09-12T18:35:54.997 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000106309 2024-09-12T18:35:54.997 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.998 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.998 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:54.998 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.900371+0000", 2024-09-12T18:35:54.998 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000224792 2024-09-12T18:35:54.998 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.998 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.998 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:54.998 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.900658+0000", 2024-09-12T18:35:54.998 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00028669299999999997 2024-09-12T18:35:54.998 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.998 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.998 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:54.998 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.902976+0000", 2024-09-12T18:35:54.998 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002317815 2024-09-12T18:35:54.998 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.999 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.999 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:54.999 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.912140+0000", 2024-09-12T18:35:54.999 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0091642770000000002 2024-09-12T18:35:54.999 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.999 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.999 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:54.999 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.912259+0000", 2024-09-12T18:35:54.999 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000118465 2024-09-12T18:35:54.999 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:54.999 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:54.999 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:54.999 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.912338+0000", 2024-09-12T18:35:54.999 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9579999999999994e-05 2024-09-12T18:35:54.999 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:54.999 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:55.000 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:55.000 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.000 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.000 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:210 5.4 5:28535192:::benchmark_data_smithi073_23739_object209:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:35:55.000 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:45.967167+0000", 2024-09-12T18:35:55.000 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 8.9496967850000004, 2024-09-12T18:35:55.000 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012739489999999999, 2024-09-12T18:35:55.000 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:55.000 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:55.000 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:55.000 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:55.000 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:55.000 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:55.001 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 210 2024-09-12T18:35:55.001 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.001 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:55.001 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.001 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:55.001 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.967167+0000", 2024-09-12T18:35:55.001 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:55.001 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.001 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.001 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:55.001 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.967167+0000", 2024-09-12T18:35:55.001 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:55.001 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.001 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.001 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:55.002 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.967168+0000", 2024-09-12T18:35:55.002 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2419999999999999e-06 2024-09-12T18:35:55.002 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.002 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.002 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:55.002 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.967218+0000", 2024-09-12T18:35:55.002 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9493000000000002e-05 2024-09-12T18:35:55.002 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.002 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.002 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:55.002 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.967234+0000", 2024-09-12T18:35:55.002 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5576000000000001e-05 2024-09-12T18:35:55.002 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.002 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.002 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:55.003 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.967262+0000", 2024-09-12T18:35:55.003 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8708999999999999e-05 2024-09-12T18:35:55.003 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.003 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.003 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:55.003 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.969263+0000", 2024-09-12T18:35:55.003 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020011479999999999 2024-09-12T18:35:55.003 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.003 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.003 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:55.003 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.969456+0000", 2024-09-12T18:35:55.003 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000192807 2024-09-12T18:35:55.003 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.004 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.004 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:55.004 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.969748+0000", 2024-09-12T18:35:55.004 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00029194600000000001 2024-09-12T18:35:55.004 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.004 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.004 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:55.004 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.972800+0000", 2024-09-12T18:35:55.004 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0030521749999999999 2024-09-12T18:35:55.004 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.004 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.004 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:55.005 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.979658+0000", 2024-09-12T18:35:55.005 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0068579399999999999 2024-09-12T18:35:55.005 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.005 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.005 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:55.005 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.979805+0000", 2024-09-12T18:35:55.005 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000146565 2024-09-12T18:35:55.005 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.005 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.005 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:55.005 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.979907+0000", 2024-09-12T18:35:55.006 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000101889 2024-09-12T18:35:55.006 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:55.006 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:55.006 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:55.006 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.006 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.006 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:212 5.8 5:1652b127:::benchmark_data_smithi073_23739_object211:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:35:55.006 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:45.967455+0000", 2024-09-12T18:35:55.006 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 8.9494086139999993, 2024-09-12T18:35:55.006 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.01239791, 2024-09-12T18:35:55.006 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:55.006 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:55.007 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:55.007 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:55.007 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:55.007 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:55.007 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 212 2024-09-12T18:35:55.007 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.007 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:55.007 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.007 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:55.007 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.967455+0000", 2024-09-12T18:35:55.007 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:55.007 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.007 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.007 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:55.008 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.967455+0000", 2024-09-12T18:35:55.008 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:55.008 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.008 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.008 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:55.008 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.967457+0000", 2024-09-12T18:35:55.008 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.618e-06 2024-09-12T18:35:55.008 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.008 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.008 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:55.008 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.967530+0000", 2024-09-12T18:35:55.008 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3003999999999994e-05 2024-09-12T18:35:55.008 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.009 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.009 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:55.009 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.967550+0000", 2024-09-12T18:35:55.009 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9536999999999999e-05 2024-09-12T18:35:55.009 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.009 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.009 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:55.009 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.967561+0000", 2024-09-12T18:35:55.009 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1725e-05 2024-09-12T18:35:55.009 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.009 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.009 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:55.009 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.968822+0000", 2024-09-12T18:35:55.009 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001260749 2024-09-12T18:35:55.010 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.010 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.010 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:55.010 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.969078+0000", 2024-09-12T18:35:55.010 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025636300000000001 2024-09-12T18:35:55.010 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.010 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.010 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:55.010 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.969383+0000", 2024-09-12T18:35:55.010 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030495000000000001 2024-09-12T18:35:55.010 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.010 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.010 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:55.011 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.972624+0000", 2024-09-12T18:35:55.011 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0032410630000000002 2024-09-12T18:35:55.011 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.011 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.011 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:55.011 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.979640+0000", 2024-09-12T18:35:55.011 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0070157919999999999 2024-09-12T18:35:55.011 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.011 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.011 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:55.011 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.979763+0000", 2024-09-12T18:35:55.011 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000123139 2024-09-12T18:35:55.011 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.011 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.012 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:55.012 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:45.979853+0000", 2024-09-12T18:35:55.012 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9969999999999994e-05 2024-09-12T18:35:55.012 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:55.012 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:55.012 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:55.012 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.012 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.012 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:14489 5.b 5:df8cc6dd:::benchmark_data_smithi073_23739_object14488:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:35:55.012 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:50.138204+0000", 2024-09-12T18:35:55.012 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.7786595329999999, 2024-09-12T18:35:55.012 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012524812, 2024-09-12T18:35:55.012 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:55.013 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:55.013 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:55.013 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:55.013 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:55.013 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:55.013 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 14489 2024-09-12T18:35:55.013 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.013 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:55.013 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.013 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:55.013 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.138204+0000", 2024-09-12T18:35:55.013 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:55.013 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.014 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.014 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:55.014 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.138204+0000", 2024-09-12T18:35:55.014 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:55.014 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.014 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.014 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:55.014 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.138205+0000", 2024-09-12T18:35:55.014 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2399999999999997e-07 2024-09-12T18:35:55.014 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.014 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.014 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:55.015 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.138331+0000", 2024-09-12T18:35:55.015 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000125368 2024-09-12T18:35:55.015 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.015 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.015 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:55.015 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.138338+0000", 2024-09-12T18:35:55.015 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.391e-06 2024-09-12T18:35:55.015 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.015 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.015 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:55.015 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.138343+0000", 2024-09-12T18:35:55.015 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6609999999999999e-06 2024-09-12T18:35:55.015 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.016 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.016 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:55.016 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.138716+0000", 2024-09-12T18:35:55.016 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00037288000000000002 2024-09-12T18:35:55.016 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.016 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.016 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:55.016 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.138895+0000", 2024-09-12T18:35:55.016 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00017898400000000001 2024-09-12T18:35:55.016 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.016 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.016 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:55.017 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.139094+0000", 2024-09-12T18:35:55.017 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00019899800000000001 2024-09-12T18:35:55.017 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.017 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.017 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:55.017 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.141419+0000", 2024-09-12T18:35:55.017 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002325386 2024-09-12T18:35:55.017 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.017 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.017 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:55.017 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.150525+0000", 2024-09-12T18:35:55.017 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.009106477 2024-09-12T18:35:55.017 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.017 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.018 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:55.018 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.150601+0000", 2024-09-12T18:35:55.018 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5148000000000006e-05 2024-09-12T18:35:55.018 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.018 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.018 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:55.018 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.150729+0000", 2024-09-12T18:35:55.018 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012879499999999999 2024-09-12T18:35:55.018 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:55.018 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:55.018 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:55.018 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.018 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.018 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:14490 5.b 5:d56fa7db:::benchmark_data_smithi073_23739_object14489:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:35:55.019 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:50.138355+0000", 2024-09-12T18:35:55.019 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.7785086230000005, 2024-09-12T18:35:55.019 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.01258081, 2024-09-12T18:35:55.019 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:55.019 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:55.019 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:55.019 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:55.019 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:55.019 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:55.019 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 14490 2024-09-12T18:35:55.019 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.019 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:55.019 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.019 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:55.020 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.138355+0000", 2024-09-12T18:35:55.020 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:55.020 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.020 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.020 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:55.020 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.138355+0000", 2024-09-12T18:35:55.020 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:55.020 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.020 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.020 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:55.020 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.138356+0000", 2024-09-12T18:35:55.020 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.51e-07 2024-09-12T18:35:55.020 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.020 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.021 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:55.021 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.138411+0000", 2024-09-12T18:35:55.021 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5306999999999997e-05 2024-09-12T18:35:55.021 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.021 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.021 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:55.021 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.138419+0000", 2024-09-12T18:35:55.021 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3780000000000003e-06 2024-09-12T18:35:55.021 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.021 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.021 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:55.021 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.138422+0000", 2024-09-12T18:35:55.021 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8360000000000002e-06 2024-09-12T18:35:55.021 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.022 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.022 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:55.022 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.140053+0000", 2024-09-12T18:35:55.022 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001631108 2024-09-12T18:35:55.022 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.022 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.022 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:55.022 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.140192+0000", 2024-09-12T18:35:55.022 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000138892 2024-09-12T18:35:55.022 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.022 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.022 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:55.022 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.140333+0000", 2024-09-12T18:35:55.022 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014013299999999999 2024-09-12T18:35:55.023 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.023 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.023 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:55.023 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.142677+0000", 2024-09-12T18:35:55.023 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0023446249999999999 2024-09-12T18:35:55.023 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.023 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.023 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:55.023 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.150743+0000", 2024-09-12T18:35:55.023 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080661150000000004 2024-09-12T18:35:55.023 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.023 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.024 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:55.024 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.150883+0000", 2024-09-12T18:35:55.024 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013951 2024-09-12T18:35:55.024 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.024 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.024 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:55.024 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:50.150936+0000", 2024-09-12T18:35:55.024 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3455000000000002e-05 2024-09-12T18:35:55.024 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:55.024 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:55.024 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:55.024 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.024 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.025 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:18859 5.d 5:b4315e7b:::benchmark_data_smithi073_23739_object18858:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:35:55.025 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:51.620713+0000", 2024-09-12T18:35:55.025 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 3.2961512929999999, 2024-09-12T18:35:55.025 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012314649, 2024-09-12T18:35:55.025 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:55.025 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:55.025 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:55.025 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:55.025 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:55.025 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:55.025 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 18859 2024-09-12T18:35:55.025 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.025 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:55.026 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.026 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:55.026 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:51.620713+0000", 2024-09-12T18:35:55.026 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:55.026 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.026 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.026 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:55.026 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:51.620713+0000", 2024-09-12T18:35:55.026 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:55.026 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.026 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.026 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:55.026 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:51.620714+0000", 2024-09-12T18:35:55.027 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0589999999999999e-06 2024-09-12T18:35:55.027 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.027 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.027 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:55.027 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:51.620745+0000", 2024-09-12T18:35:55.027 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1579999999999999e-05 2024-09-12T18:35:55.027 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.027 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.027 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:55.027 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:51.620759+0000", 2024-09-12T18:35:55.027 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3283e-05 2024-09-12T18:35:55.027 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.027 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.028 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:55.028 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:51.620765+0000", 2024-09-12T18:35:55.028 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.9920000000000004e-06 2024-09-12T18:35:55.028 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.028 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.028 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:55.028 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:51.620822+0000", 2024-09-12T18:35:55.028 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7701999999999997e-05 2024-09-12T18:35:55.028 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.028 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.028 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:55.028 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:51.620964+0000", 2024-09-12T18:35:55.028 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000141569 2024-09-12T18:35:55.029 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.029 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.029 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:55.029 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:51.621122+0000", 2024-09-12T18:35:55.029 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015855900000000001 2024-09-12T18:35:55.029 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.029 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.029 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:55.029 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:51.622852+0000", 2024-09-12T18:35:55.029 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0017292200000000001 2024-09-12T18:35:55.029 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.029 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.030 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:55.030 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:51.632837+0000", 2024-09-12T18:35:55.030 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0099854869999999995 2024-09-12T18:35:55.030 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.030 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.030 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:55.030 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:51.632914+0000", 2024-09-12T18:35:55.030 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6402000000000005e-05 2024-09-12T18:35:55.030 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.030 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.030 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:55.030 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:51.633027+0000", 2024-09-12T18:35:55.030 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011379600000000001 2024-09-12T18:35:55.031 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:55.031 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:55.031 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:55.031 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.031 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.031 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:19085 5.0 5:02060b40:::benchmark_data_smithi073_23739_object19084:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:35:55.031 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:51.711487+0000", 2024-09-12T18:35:55.031 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 3.2053772990000002, 2024-09-12T18:35:55.031 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011816419, 2024-09-12T18:35:55.031 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:55.031 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:55.031 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:55.031 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:55.031 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:55.032 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:55.032 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 19085 2024-09-12T18:35:55.032 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.032 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:55.032 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.032 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:55.032 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:51.711487+0000", 2024-09-12T18:35:55.032 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:55.032 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.032 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.032 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:55.032 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:51.711487+0000", 2024-09-12T18:35:55.033 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:55.033 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.033 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.033 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:55.033 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:51.711487+0000", 2024-09-12T18:35:55.033 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0999999999999998e-07 2024-09-12T18:35:55.033 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.033 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.033 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:55.033 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:51.711613+0000", 2024-09-12T18:35:55.033 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012518100000000001 2024-09-12T18:35:55.033 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.033 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.034 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:55.034 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:51.711621+0000", 2024-09-12T18:35:55.034 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2800000000000003e-06 2024-09-12T18:35:55.034 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.034 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.034 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:55.034 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:51.711625+0000", 2024-09-12T18:35:55.034 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2309999999999998e-06 2024-09-12T18:35:55.034 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.034 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.034 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:55.034 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:51.718202+0000", 2024-09-12T18:35:55.034 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.006576864 2024-09-12T18:35:55.035 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.035 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.035 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:55.035 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:51.718389+0000", 2024-09-12T18:35:55.035 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00018759399999999999 2024-09-12T18:35:55.035 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.035 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.035 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:55.035 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:51.718555+0000", 2024-09-12T18:35:55.035 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000165563 2024-09-12T18:35:55.035 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.035 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.035 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:55.035 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:51.721882+0000", 2024-09-12T18:35:55.036 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033272520000000002 2024-09-12T18:35:55.036 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.036 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.036 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:55.036 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:51.723188+0000", 2024-09-12T18:35:55.036 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013055359999999999 2024-09-12T18:35:55.036 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.036 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.036 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:55.036 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:51.723240+0000", 2024-09-12T18:35:55.036 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1963999999999999e-05 2024-09-12T18:35:55.036 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.036 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.037 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:55.037 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:51.723303+0000", 2024-09-12T18:35:55.037 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.3343999999999995e-05 2024-09-12T18:35:55.037 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:55.037 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:55.037 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:55.037 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.037 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.037 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:19088 5.8 5:1f2fcbe9:::benchmark_data_smithi073_23739_object19087:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:35:55.037 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:51.713144+0000", 2024-09-12T18:35:55.037 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 3.2037201340000001, 2024-09-12T18:35:55.037 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011972160000000001, 2024-09-12T18:35:55.037 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:55.037 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:55.037 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:55.038 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:55.038 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:55.038 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:55.038 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 19088 2024-09-12T18:35:55.038 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.038 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:55.038 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.038 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:55.038 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:51.713144+0000", 2024-09-12T18:35:55.038 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:55.038 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.038 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.038 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:55.039 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:51.713144+0000", 2024-09-12T18:35:55.039 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:55.039 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.039 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.039 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:55.039 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:51.713145+0000", 2024-09-12T18:35:55.039 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2720000000000001e-06 2024-09-12T18:35:55.039 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.039 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.039 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:55.039 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:51.713247+0000", 2024-09-12T18:35:55.039 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000101482 2024-09-12T18:35:55.039 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.039 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.039 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:55.040 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:51.713263+0000", 2024-09-12T18:35:55.040 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6359e-05 2024-09-12T18:35:55.040 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.040 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.040 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:55.040 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:51.713274+0000", 2024-09-12T18:35:55.040 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0542e-05 2024-09-12T18:35:55.040 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.040 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.040 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:55.040 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:51.718312+0000", 2024-09-12T18:35:55.040 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0050383010000000002 2024-09-12T18:35:55.040 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.041 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.041 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:55.041 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:51.718507+0000", 2024-09-12T18:35:55.041 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000194835 2024-09-12T18:35:55.041 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.041 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.041 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:55.041 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:51.718739+0000", 2024-09-12T18:35:55.041 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00023246900000000001 2024-09-12T18:35:55.041 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.041 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.041 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:55.041 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:51.722104+0000", 2024-09-12T18:35:55.042 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033643739999999998 2024-09-12T18:35:55.042 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.042 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.042 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:55.042 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:51.725010+0000", 2024-09-12T18:35:55.042 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002906395 2024-09-12T18:35:55.042 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.042 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.042 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:35:55.042 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:51.725070+0000", 2024-09-12T18:35:55.042 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.9655999999999999e-05 2024-09-12T18:35:55.042 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:55.042 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:55.042 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:35:55.043 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:51.725116+0000", 2024-09-12T18:35:55.043 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6474999999999998e-05 2024-09-12T18:35:55.043 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:55.043 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:55.043 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:55.043 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:55.043 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:55.043 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:35:55.045 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:35:55.045 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:55.042+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:55.145 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:55.141+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:55.202 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:35:55.202 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:35:55.202 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.203 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:28700 5.6 e27/21 5:6fde6336:::benchmark_data_smithi073_23739_object28699:head v 27'1783, mlcod=27'1779)", 2024-09-12T18:35:55.203 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:55.201653+0000", 2024-09-12T18:35:55.203 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.001060229, 2024-09-12T18:35:55.203 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0010826, 2024-09-12T18:35:55.203 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:55.203 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:55.203 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:35:55.203 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:55.203 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.203 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:55.203 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.201653+0000", 2024-09-12T18:35:55.203 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.203 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.204 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.204 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:55.204 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.201653+0000", 2024-09-12T18:35:55.204 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.204 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.204 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.204 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:55.204 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.201653+0000", 2024-09-12T18:35:55.204 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5700000000000001e-07 2024-09-12T18:35:55.204 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.204 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.204 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:55.204 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.201755+0000", 2024-09-12T18:35:55.205 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010183099999999999 2024-09-12T18:35:55.205 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.205 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.205 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:55.205 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.201764+0000", 2024-09-12T18:35:55.205 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.1970000000000002e-06 2024-09-12T18:35:55.205 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.205 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.205 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:55.205 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.201770+0000", 2024-09-12T18:35:55.205 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1599999999999997e-06 2024-09-12T18:35:55.205 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.205 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.206 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:55.206 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.201808+0000", 2024-09-12T18:35:55.206 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.7962e-05 2024-09-12T18:35:55.206 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.206 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.206 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:55.206 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.201826+0000", 2024-09-12T18:35:55.206 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.8536999999999999e-05 2024-09-12T18:35:55.206 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.206 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:55.206 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.206 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.206 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.207 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:28705 5.9 5:921c1da7:::benchmark_data_smithi073_23739_object28704:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T18:35:55.207 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:55.201890+0000", 2024-09-12T18:35:55.207 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.00082297700000000002, 2024-09-12T18:35:55.207 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00091493599999999998, 2024-09-12T18:35:55.207 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:55.207 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:55.207 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:55.207 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:35:55.207 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:35:55.207 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:55.207 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 28705 2024-09-12T18:35:55.207 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.207 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:55.207 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.208 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:55.208 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.201890+0000", 2024-09-12T18:35:55.208 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.208 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.208 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.208 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:55.208 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.201890+0000", 2024-09-12T18:35:55.208 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.208 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.208 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.208 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:55.208 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.201891+0000", 2024-09-12T18:35:55.208 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.7300000000000005e-07 2024-09-12T18:35:55.209 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.209 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.209 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:55.209 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.201938+0000", 2024-09-12T18:35:55.209 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.7030999999999997e-05 2024-09-12T18:35:55.209 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.209 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.209 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:55.209 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.201947+0000", 2024-09-12T18:35:55.209 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.8369999999999992e-06 2024-09-12T18:35:55.209 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.209 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.209 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:55.210 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.201952+0000", 2024-09-12T18:35:55.210 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.0669999999999999e-06 2024-09-12T18:35:55.210 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.210 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.210 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:55.210 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.202001+0000", 2024-09-12T18:35:55.210 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8965999999999998e-05 2024-09-12T18:35:55.210 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.210 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.210 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:55.210 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.202124+0000", 2024-09-12T18:35:55.210 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012271499999999999 2024-09-12T18:35:55.210 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.211 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.211 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:55.211 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.202248+0000", 2024-09-12T18:35:55.211 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012357000000000001 2024-09-12T18:35:55.211 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.211 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:55.211 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.211 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.211 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.211 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:28706 5.2 5:4ffb227e:::benchmark_data_smithi073_23739_object28705:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T18:35:55.211 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:55.202024+0000", 2024-09-12T18:35:55.211 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.00068878099999999996, 2024-09-12T18:35:55.211 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00085440500000000003, 2024-09-12T18:35:55.211 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:55.212 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:55.212 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:55.212 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:35:55.212 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:35:55.212 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:55.212 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 28706 2024-09-12T18:35:55.212 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.212 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:55.212 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.212 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:55.212 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.202024+0000", 2024-09-12T18:35:55.212 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.212 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.213 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.213 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:55.213 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.202024+0000", 2024-09-12T18:35:55.213 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.213 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.213 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.213 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:55.213 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.202025+0000", 2024-09-12T18:35:55.213 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4700000000000001e-07 2024-09-12T18:35:55.213 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.213 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.213 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:55.213 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.202101+0000", 2024-09-12T18:35:55.213 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.6266000000000005e-05 2024-09-12T18:35:55.214 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.214 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.214 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:55.214 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.202110+0000", 2024-09-12T18:35:55.214 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.5810000000000003e-06 2024-09-12T18:35:55.214 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.214 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.214 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:55.214 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.202117+0000", 2024-09-12T18:35:55.214 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9179999999999997e-06 2024-09-12T18:35:55.214 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.214 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.214 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:55.215 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.202163+0000", 2024-09-12T18:35:55.215 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.5592e-05 2024-09-12T18:35:55.215 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.215 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.215 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:55.215 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.202287+0000", 2024-09-12T18:35:55.215 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000124487 2024-09-12T18:35:55.215 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.215 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.215 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:55.215 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.202404+0000", 2024-09-12T18:35:55.215 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000116766 2024-09-12T18:35:55.216 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.216 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:55.216 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.216 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.216 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.216 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:28708 5.7 5:e1a59a9a:::benchmark_data_smithi073_23739_object28707:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T18:35:55.216 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:55.202132+0000", 2024-09-12T18:35:55.216 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.000580337, 2024-09-12T18:35:55.216 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00079993499999999999, 2024-09-12T18:35:55.216 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:55.216 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:55.216 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:55.216 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:35:55.217 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:35:55.217 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:55.217 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 28708 2024-09-12T18:35:55.217 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.217 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:55.217 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.217 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:55.217 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.202132+0000", 2024-09-12T18:35:55.217 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.217 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.217 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.217 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:55.218 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.202132+0000", 2024-09-12T18:35:55.218 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.218 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.218 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.218 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:55.218 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.202133+0000", 2024-09-12T18:35:55.218 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.8899999999999999e-07 2024-09-12T18:35:55.218 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.218 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.218 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:55.218 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.202168+0000", 2024-09-12T18:35:55.218 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.4507e-05 2024-09-12T18:35:55.218 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.218 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.219 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:55.219 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.202176+0000", 2024-09-12T18:35:55.219 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8459999999999997e-06 2024-09-12T18:35:55.219 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.219 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.219 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:55.219 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.202183+0000", 2024-09-12T18:35:55.219 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.1739999999999997e-06 2024-09-12T18:35:55.219 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.219 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.219 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:55.219 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.202237+0000", 2024-09-12T18:35:55.219 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4237999999999998e-05 2024-09-12T18:35:55.220 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.220 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.220 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:55.220 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.202370+0000", 2024-09-12T18:35:55.220 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013338299999999999 2024-09-12T18:35:55.220 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.220 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.220 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:55.220 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.202522+0000", 2024-09-12T18:35:55.220 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015190700000000001 2024-09-12T18:35:55.220 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.220 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:55.220 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.221 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.221 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.221 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:28709 5.1 5:8f4f2875:::benchmark_data_smithi073_23739_object28708:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T18:35:55.221 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:55.202205+0000", 2024-09-12T18:35:55.221 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.00050756300000000005, 2024-09-12T18:35:55.221 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00076360999999999996, 2024-09-12T18:35:55.221 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:55.221 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:55.221 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:55.221 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:35:55.221 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:35:55.221 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:55.221 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 28709 2024-09-12T18:35:55.221 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.222 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:55.222 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.222 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:55.222 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.202205+0000", 2024-09-12T18:35:55.222 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.222 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.222 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.222 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:55.222 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.202205+0000", 2024-09-12T18:35:55.222 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.222 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.222 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.222 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:55.223 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.202206+0000", 2024-09-12T18:35:55.223 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.5000000000000002e-07 2024-09-12T18:35:55.223 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.223 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.223 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:55.223 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.202294+0000", 2024-09-12T18:35:55.223 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8141999999999997e-05 2024-09-12T18:35:55.223 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.223 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.223 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:55.223 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.202302+0000", 2024-09-12T18:35:55.223 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1559999999999995e-06 2024-09-12T18:35:55.223 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.223 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.224 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:55.224 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.202309+0000", 2024-09-12T18:35:55.224 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.7469999999999999e-06 2024-09-12T18:35:55.224 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.224 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.224 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:55.224 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.202519+0000", 2024-09-12T18:35:55.224 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020975799999999999 2024-09-12T18:35:55.224 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.224 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.224 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:55.224 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.202639+0000", 2024-09-12T18:35:55.224 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012018099999999999 2024-09-12T18:35:55.225 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.225 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.225 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:55.225 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:55.202720+0000", 2024-09-12T18:35:55.225 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1575000000000004e-05 2024-09-12T18:35:55.225 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.225 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:55.225 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.225 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.225 INFO:teuthology.orchestra.run.smithi162.stdout: ], 2024-09-12T18:35:55.225 INFO:teuthology.orchestra.run.smithi162.stdout: "num_ops": 5 2024-09-12T18:35:55.225 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:35:55.226 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:35:55.246 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:55.242+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:55.347 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:55.345+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:55.360 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is set 2024-09-12T18:35:55.375 INFO:tasks.thrashosds.thrasher:Setting full ratio back to .95 2024-09-12T18:35:55.376 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set-full-ratio .95 2024-09-12T18:35:55.378 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:35:55.378 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [], 2024-09-12T18:35:55.378 INFO:teuthology.orchestra.run.smithi162.stdout: "complaint_time": 30, 2024-09-12T18:35:55.378 INFO:teuthology.orchestra.run.smithi162.stdout: "num_blocked_ops": 0 2024-09-12T18:35:55.378 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:35:55.399 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:35:55.447 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:55.446+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:55.549 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:55.546+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:55.550 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:35:55.550 INFO:teuthology.orchestra.run.smithi162.stdout: "size": 20, 2024-09-12T18:35:55.550 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 600, 2024-09-12T18:35:55.550 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:35:55.551 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.551 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4154.0:123 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:35:55.551 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:35:55.551 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 41.573342742999998, 2024-09-12T18:35:55.551 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.022398096999999999, 2024-09-12T18:35:55.551 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:55.551 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:55.551 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:55.551 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:35:55.551 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4154", 2024-09-12T18:35:55.551 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/745129001", 2024-09-12T18:35:55.551 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 123 2024-09-12T18:35:55.552 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.552 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:55.552 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.552 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:55.552 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:35:55.552 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.552 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.552 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.552 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:55.552 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:35:55.552 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.552 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.553 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.553 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:55.553 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:35:55.553 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.8299999999999996e-07 2024-09-12T18:35:55.553 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.553 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.553 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:55.553 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976528+0000", 2024-09-12T18:35:55.553 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011393299999999999 2024-09-12T18:35:55.553 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.553 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.553 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:55.553 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976539+0000", 2024-09-12T18:35:55.554 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0763e-05 2024-09-12T18:35:55.554 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.554 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.554 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:55.554 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976547+0000", 2024-09-12T18:35:55.554 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8199999999999997e-06 2024-09-12T18:35:55.554 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.554 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.554 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:55.554 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.995057+0000", 2024-09-12T18:35:55.554 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.018510047000000002 2024-09-12T18:35:55.554 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.555 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.555 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:55.555 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.995301+0000", 2024-09-12T18:35:55.555 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00024375899999999999 2024-09-12T18:35:55.555 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.555 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.555 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:55.555 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.995642+0000", 2024-09-12T18:35:55.555 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00034121100000000001 2024-09-12T18:35:55.555 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.555 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.555 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:55.555 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998179+0000", 2024-09-12T18:35:55.556 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00253761 2024-09-12T18:35:55.556 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.556 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.556 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:55.556 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998665+0000", 2024-09-12T18:35:55.556 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00048574600000000001 2024-09-12T18:35:55.557 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.557 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.557 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:55.557 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998739+0000", 2024-09-12T18:35:55.557 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.4286e-05 2024-09-12T18:35:55.557 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.557 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.557 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:55.557 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998812+0000", 2024-09-12T18:35:55.557 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2238999999999997e-05 2024-09-12T18:35:55.557 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.558 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:55.558 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.558 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.558 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.558 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4154.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:35:55.558 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:35:55.558 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 41.573195511000002, 2024-09-12T18:35:55.558 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025950709999999998, 2024-09-12T18:35:55.558 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:55.558 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:55.558 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:55.558 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:35:55.558 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4154", 2024-09-12T18:35:55.559 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/745129001", 2024-09-12T18:35:55.559 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 124 2024-09-12T18:35:55.559 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.559 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:55.559 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.559 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:55.559 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:35:55.559 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.559 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.559 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.559 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:55.559 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:35:55.560 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.560 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.560 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.560 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:55.560 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976562+0000", 2024-09-12T18:35:55.560 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.2999999999999999e-07 2024-09-12T18:35:55.560 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.560 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.560 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:55.560 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976567+0000", 2024-09-12T18:35:55.561 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3430000000000003e-06 2024-09-12T18:35:55.561 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.561 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.561 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:55.561 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976576+0000", 2024-09-12T18:35:55.561 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8070000000000006e-06 2024-09-12T18:35:55.561 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.561 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.561 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:55.561 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976583+0000", 2024-09-12T18:35:55.561 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9959999999999996e-06 2024-09-12T18:35:55.561 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.561 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.562 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:55.562 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997107+0000", 2024-09-12T18:35:55.562 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.020524106 2024-09-12T18:35:55.562 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.562 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.562 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:55.562 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997225+0000", 2024-09-12T18:35:55.562 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000117909 2024-09-12T18:35:55.562 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.562 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.562 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:55.562 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997407+0000", 2024-09-12T18:35:55.563 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00018175900000000001 2024-09-12T18:35:55.563 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.563 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.563 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:55.563 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998839+0000", 2024-09-12T18:35:55.563 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001432539 2024-09-12T18:35:55.563 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.563 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.563 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:55.563 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002319+0000", 2024-09-12T18:35:55.563 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0034803529999999998 2024-09-12T18:35:55.564 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.564 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.564 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:55.564 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002405+0000", 2024-09-12T18:35:55.564 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5434999999999998e-05 2024-09-12T18:35:55.564 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.564 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.564 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:55.564 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002512+0000", 2024-09-12T18:35:55.564 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010663299999999999 2024-09-12T18:35:55.565 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.565 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:55.565 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.565 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.565 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.565 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:55.565 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:35:55.565 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 29.908398003999999, 2024-09-12T18:35:55.565 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025127867000000002, 2024-09-12T18:35:55.565 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:55.565 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:55.565 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:55.566 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:55.566 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.566 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:55.566 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:35:55.566 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.566 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.566 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.566 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:55.566 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:35:55.566 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.566 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.566 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.566 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:55.567 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641362+0000", 2024-09-12T18:35:55.567 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.2569999999999999e-06 2024-09-12T18:35:55.567 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.567 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.567 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:55.567 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641374+0000", 2024-09-12T18:35:55.567 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2696e-05 2024-09-12T18:35:55.567 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.568 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.568 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:55.568 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641403+0000", 2024-09-12T18:35:55.568 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.8756999999999999e-05 2024-09-12T18:35:55.568 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.568 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.568 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:55.568 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641430+0000", 2024-09-12T18:35:55.568 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.6452999999999999e-05 2024-09-12T18:35:55.568 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.568 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.568 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:55.568 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641585+0000", 2024-09-12T18:35:55.569 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000155799 2024-09-12T18:35:55.569 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.569 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.569 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:55.569 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641753+0000", 2024-09-12T18:35:55.569 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000167868 2024-09-12T18:35:55.569 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.569 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.569 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:55.569 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641916+0000", 2024-09-12T18:35:55.569 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000162903 2024-09-12T18:35:55.569 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.570 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.570 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:55.570 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653655+0000", 2024-09-12T18:35:55.570 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011738879000000001 2024-09-12T18:35:55.570 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.570 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.570 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:55.570 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665515+0000", 2024-09-12T18:35:55.570 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011859915 2024-09-12T18:35:55.570 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.570 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.570 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:55.570 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665646+0000", 2024-09-12T18:35:55.570 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013122599999999999 2024-09-12T18:35:55.571 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.571 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.571 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:55.571 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666486+0000", 2024-09-12T18:35:55.571 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00084011399999999999 2024-09-12T18:35:55.571 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.571 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:55.571 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.571 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.571 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.571 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:55.571 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:35:55.571 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 29.908283540999999, 2024-09-12T18:35:55.572 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025384584000000002, 2024-09-12T18:35:55.572 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:55.572 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:55.572 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:55.572 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:55.572 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.572 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:55.572 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:35:55.572 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.572 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.572 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.573 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:55.573 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:35:55.573 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.573 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.573 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.573 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:55.573 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641474+0000", 2024-09-12T18:35:55.573 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.39e-06 2024-09-12T18:35:55.573 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.573 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.573 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:55.574 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641482+0000", 2024-09-12T18:35:55.574 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3499999999999999e-06 2024-09-12T18:35:55.574 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.574 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.574 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:55.574 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641534+0000", 2024-09-12T18:35:55.574 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2533e-05 2024-09-12T18:35:55.574 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.574 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.574 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:55.574 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641551+0000", 2024-09-12T18:35:55.574 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6515999999999999e-05 2024-09-12T18:35:55.574 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.575 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.575 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:55.575 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642630+0000", 2024-09-12T18:35:55.575 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001079705 2024-09-12T18:35:55.575 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.575 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.575 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:55.575 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642909+0000", 2024-09-12T18:35:55.575 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027859800000000002 2024-09-12T18:35:55.575 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.575 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.576 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:55.576 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643137+0000", 2024-09-12T18:35:55.576 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022803799999999999 2024-09-12T18:35:55.576 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.576 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.576 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:55.576 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653669+0000", 2024-09-12T18:35:55.576 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010532032 2024-09-12T18:35:55.576 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.576 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.576 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:55.576 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666624+0000", 2024-09-12T18:35:55.577 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012954940999999999 2024-09-12T18:35:55.577 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.577 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.577 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:55.577 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666762+0000", 2024-09-12T18:35:55.577 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000137668 2024-09-12T18:35:55.577 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.578 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.578 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:55.578 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666857+0000", 2024-09-12T18:35:55.578 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.5812999999999999e-05 2024-09-12T18:35:55.578 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.578 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:55.578 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.578 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.578 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.578 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:55.578 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:35:55.578 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 29.908155745999998, 2024-09-12T18:35:55.579 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025661562999999998, 2024-09-12T18:35:55.579 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:55.579 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:55.579 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:55.579 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:55.579 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.579 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:55.579 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:35:55.579 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.579 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.579 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.579 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:55.579 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:35:55.580 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.580 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.580 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.580 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:55.580 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641602+0000", 2024-09-12T18:35:55.580 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3540000000000001e-06 2024-09-12T18:35:55.580 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.580 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.580 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:55.580 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641637+0000", 2024-09-12T18:35:55.580 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5145999999999999e-05 2024-09-12T18:35:55.580 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.581 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.581 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:55.581 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641659+0000", 2024-09-12T18:35:55.581 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2249999999999999e-05 2024-09-12T18:35:55.581 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.581 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.581 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:55.581 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641675+0000", 2024-09-12T18:35:55.581 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6059999999999999e-05 2024-09-12T18:35:55.581 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.581 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.581 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:55.582 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644570+0000", 2024-09-12T18:35:55.582 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028947069999999998 2024-09-12T18:35:55.582 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.582 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.582 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:55.582 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644900+0000", 2024-09-12T18:35:55.582 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000329401 2024-09-12T18:35:55.582 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.582 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.582 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:55.582 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645235+0000", 2024-09-12T18:35:55.582 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000335874 2024-09-12T18:35:55.582 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.583 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.583 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:55.583 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655459+0000", 2024-09-12T18:35:55.583 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010223441999999999 2024-09-12T18:35:55.583 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.583 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.583 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:55.583 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667028+0000", 2024-09-12T18:35:55.583 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011568673999999999 2024-09-12T18:35:55.583 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.583 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.583 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:55.584 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667163+0000", 2024-09-12T18:35:55.584 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013525500000000001 2024-09-12T18:35:55.584 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.584 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.584 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:55.584 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667262+0000", 2024-09-12T18:35:55.584 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9400000000000004e-05 2024-09-12T18:35:55.584 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.584 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:55.584 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.584 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.584 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.584 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:55.585 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:35:55.585 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 29.908053926000001, 2024-09-12T18:35:55.585 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025971339, 2024-09-12T18:35:55.585 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:55.585 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:55.585 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:55.585 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:55.585 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.585 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:55.585 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:35:55.585 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.585 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.586 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.586 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:55.586 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:35:55.586 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.586 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.586 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.586 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:55.586 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641704+0000", 2024-09-12T18:35:55.586 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.297e-06 2024-09-12T18:35:55.586 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.586 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.586 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:55.586 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641712+0000", 2024-09-12T18:35:55.587 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.9060000000000002e-06 2024-09-12T18:35:55.587 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.587 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.587 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:55.587 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641731+0000", 2024-09-12T18:35:55.587 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9083e-05 2024-09-12T18:35:55.587 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.587 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.587 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:55.587 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641745+0000", 2024-09-12T18:35:55.587 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4066999999999999e-05 2024-09-12T18:35:55.587 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.588 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.588 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:55.588 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646529+0000", 2024-09-12T18:35:55.588 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.004784033 2024-09-12T18:35:55.588 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.588 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.588 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:55.588 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646727+0000", 2024-09-12T18:35:55.588 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019841800000000001 2024-09-12T18:35:55.588 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.588 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.588 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:55.588 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647057+0000", 2024-09-12T18:35:55.589 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032926800000000002 2024-09-12T18:35:55.589 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.589 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.589 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:55.589 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655475+0000", 2024-09-12T18:35:55.589 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0084186250000000008 2024-09-12T18:35:55.589 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.589 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.589 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:55.589 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667424+0000", 2024-09-12T18:35:55.589 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011949257 2024-09-12T18:35:55.589 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.589 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.590 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:55.590 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667573+0000", 2024-09-12T18:35:55.590 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014851900000000001 2024-09-12T18:35:55.590 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.590 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.590 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:55.590 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667674+0000", 2024-09-12T18:35:55.590 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010086600000000001 2024-09-12T18:35:55.590 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.590 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:55.590 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.590 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.591 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.591 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:55.591 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:35:55.591 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 29.907991537000001, 2024-09-12T18:35:55.591 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026215008000000001, 2024-09-12T18:35:55.591 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:55.591 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:55.591 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:55.591 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:55.591 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.591 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:55.591 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:35:55.592 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.592 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.592 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.592 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:55.592 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:35:55.592 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.592 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.592 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.592 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:55.592 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641766+0000", 2024-09-12T18:35:55.592 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1200000000000001e-06 2024-09-12T18:35:55.592 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.593 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.593 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:55.593 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641775+0000", 2024-09-12T18:35:55.593 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.2499999999999995e-06 2024-09-12T18:35:55.593 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.593 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.593 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:55.593 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641793+0000", 2024-09-12T18:35:55.593 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7773000000000001e-05 2024-09-12T18:35:55.593 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.593 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.593 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:55.593 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641807+0000", 2024-09-12T18:35:55.593 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3814e-05 2024-09-12T18:35:55.594 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.594 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.594 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:55.594 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647626+0000", 2024-09-12T18:35:55.594 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0058193050000000003 2024-09-12T18:35:55.594 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.594 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.594 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:55.594 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647937+0000", 2024-09-12T18:35:55.594 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031112400000000003 2024-09-12T18:35:55.594 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.594 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.594 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:55.594 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648239+0000", 2024-09-12T18:35:55.595 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00030227500000000002 2024-09-12T18:35:55.595 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.595 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.595 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:55.595 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655487+0000", 2024-09-12T18:35:55.595 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072479129999999999 2024-09-12T18:35:55.595 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.595 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.595 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:55.595 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667823+0000", 2024-09-12T18:35:55.595 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012335505 2024-09-12T18:35:55.595 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.595 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.595 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:55.596 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667908+0000", 2024-09-12T18:35:55.596 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4843000000000001e-05 2024-09-12T18:35:55.596 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.596 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.596 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:55.596 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667980+0000", 2024-09-12T18:35:55.596 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2086000000000001e-05 2024-09-12T18:35:55.596 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.596 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:55.596 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.596 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.596 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.596 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:55.597 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:35:55.597 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 29.907931384000001, 2024-09-12T18:35:55.597 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026483236, 2024-09-12T18:35:55.597 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:55.597 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:55.597 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:55.597 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:55.597 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.597 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:55.597 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:35:55.597 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.597 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.597 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.597 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:55.598 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:35:55.598 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.598 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.598 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.598 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:55.598 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641826+0000", 2024-09-12T18:35:55.598 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:35:55.598 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.598 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.598 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:55.598 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641832+0000", 2024-09-12T18:35:55.598 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4199999999999998e-06 2024-09-12T18:35:55.598 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.599 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.599 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:55.599 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641848+0000", 2024-09-12T18:35:55.599 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6492999999999999e-05 2024-09-12T18:35:55.599 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.599 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.599 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:55.599 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641863+0000", 2024-09-12T18:35:55.599 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5427e-05 2024-09-12T18:35:55.599 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.599 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.599 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:55.600 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648887+0000", 2024-09-12T18:35:55.600 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0070230860000000004 2024-09-12T18:35:55.600 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.600 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.600 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:55.600 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649111+0000", 2024-09-12T18:35:55.600 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022425799999999999 2024-09-12T18:35:55.600 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.600 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.600 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:55.600 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649494+0000", 2024-09-12T18:35:55.600 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00038349400000000001 2024-09-12T18:35:55.600 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.601 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.601 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:55.601 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655499+0000", 2024-09-12T18:35:55.601 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0060047260000000002 2024-09-12T18:35:55.601 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.601 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.601 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:55.601 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668110+0000", 2024-09-12T18:35:55.601 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012610543 2024-09-12T18:35:55.601 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.601 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.601 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:55.601 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668252+0000", 2024-09-12T18:35:55.601 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014265600000000001 2024-09-12T18:35:55.602 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.602 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.602 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:55.602 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668308+0000", 2024-09-12T18:35:55.602 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5992999999999997e-05 2024-09-12T18:35:55.602 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.602 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:55.602 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.602 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.602 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.602 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:55.602 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:35:55.602 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 29.907876168000001, 2024-09-12T18:35:55.602 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026605302000000001, 2024-09-12T18:35:55.602 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:55.603 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:55.603 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:55.603 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:55.603 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.603 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:55.603 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:35:55.603 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.603 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.603 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.603 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:55.603 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:35:55.603 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.603 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.603 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.603 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:55.604 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641881+0000", 2024-09-12T18:35:55.604 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.057e-06 2024-09-12T18:35:55.604 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.604 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.604 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:55.604 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641887+0000", 2024-09-12T18:35:55.604 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.6629999999999998e-06 2024-09-12T18:35:55.604 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.604 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.604 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:55.604 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641903+0000", 2024-09-12T18:35:55.604 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6317e-05 2024-09-12T18:35:55.604 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.604 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.605 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:55.605 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641917+0000", 2024-09-12T18:35:55.605 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3339999999999999e-05 2024-09-12T18:35:55.605 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.605 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.605 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:55.605 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650708+0000", 2024-09-12T18:35:55.605 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.008791419 2024-09-12T18:35:55.605 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.605 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.605 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:55.605 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651021+0000", 2024-09-12T18:35:55.605 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031296699999999999 2024-09-12T18:35:55.606 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.606 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.606 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:55.606 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651349+0000", 2024-09-12T18:35:55.606 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032796499999999999 2024-09-12T18:35:55.606 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.606 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.606 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:55.606 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655742+0000", 2024-09-12T18:35:55.606 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0043934680000000002 2024-09-12T18:35:55.606 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.606 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.606 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:55.607 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668377+0000", 2024-09-12T18:35:55.607 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012634312999999999 2024-09-12T18:35:55.607 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.607 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.607 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:55.607 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668441+0000", 2024-09-12T18:35:55.607 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4369999999999995e-05 2024-09-12T18:35:55.607 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.607 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.607 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:55.607 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668485+0000", 2024-09-12T18:35:55.607 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4422999999999998e-05 2024-09-12T18:35:55.607 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.608 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:55.608 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.608 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.608 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.608 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:55.608 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:35:55.608 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 29.907818765000002, 2024-09-12T18:35:55.608 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026919499, 2024-09-12T18:35:55.608 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:55.608 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:55.609 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:55.609 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:55.609 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.609 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:55.609 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:35:55.609 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.609 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.609 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.609 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:55.609 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:35:55.609 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.609 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.610 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.610 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:55.610 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641939+0000", 2024-09-12T18:35:55.610 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9399999999999993e-07 2024-09-12T18:35:55.610 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.610 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.610 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:55.610 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641945+0000", 2024-09-12T18:35:55.610 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9200000000000001e-06 2024-09-12T18:35:55.610 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.610 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.610 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:55.610 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641961+0000", 2024-09-12T18:35:55.611 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6520000000000001e-05 2024-09-12T18:35:55.611 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.611 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.611 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:55.611 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641974+0000", 2024-09-12T18:35:55.611 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3413e-05 2024-09-12T18:35:55.611 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.611 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.611 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:55.611 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654560+0000", 2024-09-12T18:35:55.611 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012585308999999999 2024-09-12T18:35:55.611 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.611 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.612 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:55.612 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654822+0000", 2024-09-12T18:35:55.612 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026210099999999999 2024-09-12T18:35:55.612 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.612 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.612 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:55.612 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655059+0000", 2024-09-12T18:35:55.612 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00023747899999999999 2024-09-12T18:35:55.612 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.612 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.614 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:55.614 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.656315+0000", 2024-09-12T18:35:55.614 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0012555000000000001 2024-09-12T18:35:55.614 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.614 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.614 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:55.614 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668590+0000", 2024-09-12T18:35:55.614 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012274851999999999 2024-09-12T18:35:55.614 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.615 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.615 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:55.615 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668725+0000", 2024-09-12T18:35:55.615 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013524199999999999 2024-09-12T18:35:55.615 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.615 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.615 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:55.615 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668857+0000", 2024-09-12T18:35:55.615 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013216899999999999 2024-09-12T18:35:55.615 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.615 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:55.615 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.615 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.616 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.616 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:55.616 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:35:55.616 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 29.907765245, 2024-09-12T18:35:55.616 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023616723999999999, 2024-09-12T18:35:55.616 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:55.616 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:55.616 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:55.616 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:55.616 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.616 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:55.616 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:35:55.617 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.617 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.617 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.617 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:55.617 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:35:55.617 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.617 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.617 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.617 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:55.617 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641992+0000", 2024-09-12T18:35:55.618 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.08e-06 2024-09-12T18:35:55.618 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.618 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.618 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:55.618 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641998+0000", 2024-09-12T18:35:55.618 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4299999999999997e-06 2024-09-12T18:35:55.618 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.618 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.618 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:55.618 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642014+0000", 2024-09-12T18:35:55.618 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6266e-05 2024-09-12T18:35:55.618 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.618 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.618 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:55.619 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642026+0000", 2024-09-12T18:35:55.619 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2567e-05 2024-09-12T18:35:55.619 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.619 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.619 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:55.619 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642213+0000", 2024-09-12T18:35:55.619 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00018701899999999999 2024-09-12T18:35:55.619 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.619 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.619 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:55.619 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642507+0000", 2024-09-12T18:35:55.619 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00029394700000000002 2024-09-12T18:35:55.619 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.619 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.620 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:55.620 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642686+0000", 2024-09-12T18:35:55.620 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000178152 2024-09-12T18:35:55.620 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.620 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.620 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:55.620 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650952+0000", 2024-09-12T18:35:55.620 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0082663570000000002 2024-09-12T18:35:55.620 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.620 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.620 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:55.620 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665382+0000", 2024-09-12T18:35:55.620 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.014430111000000001 2024-09-12T18:35:55.620 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.621 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.621 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:55.621 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665508+0000", 2024-09-12T18:35:55.621 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000125986 2024-09-12T18:35:55.621 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.621 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.621 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:55.621 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665608+0000", 2024-09-12T18:35:55.621 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9809000000000006e-05 2024-09-12T18:35:55.621 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.621 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:55.621 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.622 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.622 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.622 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:55.622 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:35:55.622 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 29.907637380000001, 2024-09-12T18:35:55.622 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024670563, 2024-09-12T18:35:55.622 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:55.622 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:55.622 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:55.622 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:55.622 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.622 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:55.622 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:35:55.622 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.623 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.623 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.623 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:55.623 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:35:55.623 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.623 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.623 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.623 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:55.623 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642120+0000", 2024-09-12T18:35:55.623 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1769999999999999e-06 2024-09-12T18:35:55.623 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.623 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.624 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:55.624 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642128+0000", 2024-09-12T18:35:55.624 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3429999999999998e-06 2024-09-12T18:35:55.624 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.624 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.624 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:55.624 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642192+0000", 2024-09-12T18:35:55.624 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4406999999999995e-05 2024-09-12T18:35:55.624 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.624 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.624 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:55.624 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642223+0000", 2024-09-12T18:35:55.625 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.1266000000000002e-05 2024-09-12T18:35:55.625 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.625 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.625 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:55.625 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643201+0000", 2024-09-12T18:35:55.625 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0009778390000000001 2024-09-12T18:35:55.625 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.625 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.625 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:55.625 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643410+0000", 2024-09-12T18:35:55.625 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020874199999999999 2024-09-12T18:35:55.625 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.626 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.626 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:55.626 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643685+0000", 2024-09-12T18:35:55.626 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027520700000000002 2024-09-12T18:35:55.626 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.626 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.626 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:55.626 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650966+0000", 2024-09-12T18:35:55.626 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072810710000000001 2024-09-12T18:35:55.626 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.626 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.626 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:55.626 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666560+0000", 2024-09-12T18:35:55.626 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015594143 2024-09-12T18:35:55.627 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.627 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.627 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:55.627 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666691+0000", 2024-09-12T18:35:55.627 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000130359 2024-09-12T18:35:55.627 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.627 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.627 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:55.627 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666790+0000", 2024-09-12T18:35:55.627 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9009e-05 2024-09-12T18:35:55.627 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.627 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:55.627 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.627 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.627 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.628 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:55.628 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:35:55.628 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 29.906859092000001, 2024-09-12T18:35:55.628 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024891744, 2024-09-12T18:35:55.628 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:55.628 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:55.628 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:55.628 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:55.628 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.628 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:55.628 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:35:55.628 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.628 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.628 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.629 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:55.629 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:35:55.629 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.629 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.629 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.629 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:55.629 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642899+0000", 2024-09-12T18:35:55.629 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4729999999999999e-06 2024-09-12T18:35:55.629 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.629 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.629 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:55.629 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642912+0000", 2024-09-12T18:35:55.629 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3495999999999999e-05 2024-09-12T18:35:55.629 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.629 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.630 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:55.630 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642934+0000", 2024-09-12T18:35:55.630 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2033999999999999e-05 2024-09-12T18:35:55.630 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.630 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.630 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:55.630 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642949+0000", 2024-09-12T18:35:55.630 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4970000000000001e-05 2024-09-12T18:35:55.630 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.630 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.630 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:55.630 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644400+0000", 2024-09-12T18:35:55.631 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001450305 2024-09-12T18:35:55.631 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.631 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.631 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:55.631 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644617+0000", 2024-09-12T18:35:55.631 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000217302 2024-09-12T18:35:55.631 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.631 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.631 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:55.631 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645052+0000", 2024-09-12T18:35:55.631 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000434797 2024-09-12T18:35:55.631 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.631 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.632 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:55.632 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653860+0000", 2024-09-12T18:35:55.632 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0088082249999999994 2024-09-12T18:35:55.632 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.632 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.632 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:55.632 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667598+0000", 2024-09-12T18:35:55.632 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.013738451 2024-09-12T18:35:55.632 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.632 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.632 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:55.632 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667698+0000", 2024-09-12T18:35:55.633 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9854999999999999e-05 2024-09-12T18:35:55.633 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.633 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.633 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:55.633 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667789+0000", 2024-09-12T18:35:55.633 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0835999999999996e-05 2024-09-12T18:35:55.633 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.633 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:55.633 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.633 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.633 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.634 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:30 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:55.634 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:35:55.634 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 29.906784276, 2024-09-12T18:35:55.634 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023936852000000002, 2024-09-12T18:35:55.634 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:55.634 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:55.634 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:55.634 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:55.634 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.634 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:55.634 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:35:55.634 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.634 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.635 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.635 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:55.635 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:35:55.635 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.635 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.635 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.635 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:55.635 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642973+0000", 2024-09-12T18:35:55.635 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.11e-06 2024-09-12T18:35:55.635 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.635 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.635 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:55.635 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642994+0000", 2024-09-12T18:35:55.636 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.0699999999999998e-05 2024-09-12T18:35:55.636 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.636 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.636 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:55.636 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643011+0000", 2024-09-12T18:35:55.636 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7229999999999999e-05 2024-09-12T18:35:55.636 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.636 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.636 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:55.636 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643025+0000", 2024-09-12T18:35:55.636 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3803e-05 2024-09-12T18:35:55.636 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.636 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.637 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:55.637 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643143+0000", 2024-09-12T18:35:55.637 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000118225 2024-09-12T18:35:55.637 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.637 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.637 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:55.637 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643426+0000", 2024-09-12T18:35:55.637 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00028250500000000001 2024-09-12T18:35:55.637 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.637 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.637 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:55.637 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643864+0000", 2024-09-12T18:35:55.637 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00043856 2024-09-12T18:35:55.638 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.638 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.638 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:55.638 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651148+0000", 2024-09-12T18:35:55.638 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072836769999999997 2024-09-12T18:35:55.638 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.638 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.638 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:55.638 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666674+0000", 2024-09-12T18:35:55.638 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015525786999999999 2024-09-12T18:35:55.638 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.638 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.638 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:55.638 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666796+0000", 2024-09-12T18:35:55.639 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000122416 2024-09-12T18:35:55.639 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.639 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.639 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:55.639 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666909+0000", 2024-09-12T18:35:55.639 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011283899999999999 2024-09-12T18:35:55.639 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.639 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:55.639 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.639 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.639 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.639 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:55.639 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:35:55.639 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 29.906701569999999, 2024-09-12T18:35:55.640 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024100234000000002, 2024-09-12T18:35:55.640 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:55.640 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:55.640 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:55.640 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:55.640 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.640 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:55.640 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:35:55.640 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.640 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.640 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.640 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:55.640 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:35:55.641 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.641 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.641 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.641 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:55.641 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643056+0000", 2024-09-12T18:35:55.641 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.046e-06 2024-09-12T18:35:55.641 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.641 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.641 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:55.641 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643068+0000", 2024-09-12T18:35:55.641 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2106999999999999e-05 2024-09-12T18:35:55.641 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.641 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.641 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:55.642 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643085+0000", 2024-09-12T18:35:55.642 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7479999999999999e-05 2024-09-12T18:35:55.642 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.642 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.642 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:55.642 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643099+0000", 2024-09-12T18:35:55.642 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3730000000000001e-05 2024-09-12T18:35:55.642 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.642 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.642 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:55.642 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644623+0000", 2024-09-12T18:35:55.642 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0015236080000000001 2024-09-12T18:35:55.642 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.643 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.643 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:55.643 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644893+0000", 2024-09-12T18:35:55.643 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026990500000000003 2024-09-12T18:35:55.643 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.643 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.643 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:55.643 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645227+0000", 2024-09-12T18:35:55.643 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00033391300000000003 2024-09-12T18:35:55.643 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.643 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.643 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:55.643 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653926+0000", 2024-09-12T18:35:55.644 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0086993339999999995 2024-09-12T18:35:55.644 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.644 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.644 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:55.644 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666925+0000", 2024-09-12T18:35:55.644 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012998686000000001 2024-09-12T18:35:55.644 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.644 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.644 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:55.644 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667057+0000", 2024-09-12T18:35:55.644 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013255600000000001 2024-09-12T18:35:55.644 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.644 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.645 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:55.645 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667155+0000", 2024-09-12T18:35:55.645 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7868999999999994e-05 2024-09-12T18:35:55.645 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.645 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:55.645 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.645 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.645 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.645 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:55.645 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643139+0000", 2024-09-12T18:35:55.645 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 29.906616983999999, 2024-09-12T18:35:55.645 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.022417057000000001, 2024-09-12T18:35:55.645 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:55.645 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:55.646 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:55.646 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:55.646 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.646 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:55.646 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643139+0000", 2024-09-12T18:35:55.646 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.646 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.646 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.646 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:55.646 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643139+0000", 2024-09-12T18:35:55.646 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.646 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.646 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.647 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:55.647 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643140+0000", 2024-09-12T18:35:55.647 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0729999999999999e-06 2024-09-12T18:35:55.647 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.647 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.647 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:55.647 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643151+0000", 2024-09-12T18:35:55.647 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.039e-05 2024-09-12T18:35:55.647 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.647 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.647 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:55.647 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643168+0000", 2024-09-12T18:35:55.647 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7575999999999999e-05 2024-09-12T18:35:55.648 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.648 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.648 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:55.648 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643182+0000", 2024-09-12T18:35:55.648 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3224000000000001e-05 2024-09-12T18:35:55.648 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.648 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.648 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:55.648 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643358+0000", 2024-09-12T18:35:55.648 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00017676500000000001 2024-09-12T18:35:55.648 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.648 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.648 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:55.649 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643647+0000", 2024-09-12T18:35:55.649 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00028850499999999999 2024-09-12T18:35:55.649 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.649 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.649 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:55.649 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643924+0000", 2024-09-12T18:35:55.649 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000277547 2024-09-12T18:35:55.649 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.649 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.649 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:55.649 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650289+0000", 2024-09-12T18:35:55.649 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0063645350000000002 2024-09-12T18:35:55.649 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.649 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.650 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:55.650 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665333+0000", 2024-09-12T18:35:55.650 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015043531000000001 2024-09-12T18:35:55.650 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.650 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.650 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:55.650 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665454+0000", 2024-09-12T18:35:55.650 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000121302 2024-09-12T18:35:55.650 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.650 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.650 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:55.650 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665556+0000", 2024-09-12T18:35:55.650 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010260900000000001 2024-09-12T18:35:55.650 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.651 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:55.651 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.651 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.651 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.651 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:55.651 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:35:55.651 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 29.906505781, 2024-09-12T18:35:55.651 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024255982999999998, 2024-09-12T18:35:55.651 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:55.651 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:55.651 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:55.651 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:55.651 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.652 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:55.652 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:35:55.652 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.652 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.652 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.652 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:55.652 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:35:55.652 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.652 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.652 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.652 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:55.652 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643252+0000", 2024-09-12T18:35:55.652 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:35:55.653 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.653 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.653 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:55.653 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643287+0000", 2024-09-12T18:35:55.653 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5225999999999998e-05 2024-09-12T18:35:55.653 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.653 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.653 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:55.653 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643323+0000", 2024-09-12T18:35:55.653 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5488999999999999e-05 2024-09-12T18:35:55.653 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.653 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.653 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:55.653 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643357+0000", 2024-09-12T18:35:55.654 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.3853999999999998e-05 2024-09-12T18:35:55.654 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.654 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.654 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:55.654 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646716+0000", 2024-09-12T18:35:55.654 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003359 2024-09-12T18:35:55.654 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.654 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.654 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:55.654 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647037+0000", 2024-09-12T18:35:55.654 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032131800000000002 2024-09-12T18:35:55.654 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.654 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.655 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:55.655 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647337+0000", 2024-09-12T18:35:55.655 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000300208 2024-09-12T18:35:55.655 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.655 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.655 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:55.655 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654291+0000", 2024-09-12T18:35:55.655 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0069543089999999997 2024-09-12T18:35:55.655 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.655 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.655 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:55.655 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667297+0000", 2024-09-12T18:35:55.655 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.013005526 2024-09-12T18:35:55.656 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.656 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.656 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:55.656 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667416+0000", 2024-09-12T18:35:55.656 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000119416 2024-09-12T18:35:55.656 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.656 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.656 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:55.656 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667507+0000", 2024-09-12T18:35:55.656 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0206999999999999e-05 2024-09-12T18:35:55.656 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.656 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:55.656 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.657 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.657 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.657 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:55.657 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:35:55.657 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 29.906378686, 2024-09-12T18:35:55.657 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023888482999999999, 2024-09-12T18:35:55.657 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:55.657 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:55.657 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:55.657 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:55.657 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.657 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:55.658 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:35:55.658 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.658 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.658 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.658 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:55.658 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:35:55.658 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.658 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.658 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.658 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:55.658 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643379+0000", 2024-09-12T18:35:55.658 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.207e-06 2024-09-12T18:35:55.658 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.659 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.659 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:55.659 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643390+0000", 2024-09-12T18:35:55.659 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0696000000000001e-05 2024-09-12T18:35:55.659 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.659 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.659 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:55.659 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643407+0000", 2024-09-12T18:35:55.659 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7563000000000001e-05 2024-09-12T18:35:55.659 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.659 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.659 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:55.659 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643420+0000", 2024-09-12T18:35:55.659 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3277e-05 2024-09-12T18:35:55.660 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.660 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.660 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:55.660 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644906+0000", 2024-09-12T18:35:55.660 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001485945 2024-09-12T18:35:55.660 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.660 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.660 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:55.660 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645404+0000", 2024-09-12T18:35:55.660 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00049807599999999997 2024-09-12T18:35:55.660 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.660 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.661 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:55.661 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645846+0000", 2024-09-12T18:35:55.661 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00044190400000000002 2024-09-12T18:35:55.661 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.661 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.661 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:55.661 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654223+0000", 2024-09-12T18:35:55.661 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0083767419999999995 2024-09-12T18:35:55.661 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.661 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.661 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:55.661 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667026+0000", 2024-09-12T18:35:55.661 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012802531000000001 2024-09-12T18:35:55.662 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.662 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.662 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:55.662 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667162+0000", 2024-09-12T18:35:55.662 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000136112 2024-09-12T18:35:55.662 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.662 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.662 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:55.662 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667266+0000", 2024-09-12T18:35:55.662 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010443 2024-09-12T18:35:55.662 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.662 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:55.662 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.663 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.663 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.663 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:55.663 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643447+0000", 2024-09-12T18:35:55.663 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 29.906309159999999, 2024-09-12T18:35:55.663 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.022081562999999998, 2024-09-12T18:35:55.663 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:55.663 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:55.663 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:55.663 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:55.663 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.663 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:55.664 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643447+0000", 2024-09-12T18:35:55.664 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.664 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.664 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.664 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:55.664 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643447+0000", 2024-09-12T18:35:55.664 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.664 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.664 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.664 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:55.664 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643448+0000", 2024-09-12T18:35:55.664 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1629999999999999e-06 2024-09-12T18:35:55.665 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.665 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.665 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:55.665 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643458+0000", 2024-09-12T18:35:55.665 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.8400000000000007e-06 2024-09-12T18:35:55.665 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.665 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.665 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:55.665 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643475+0000", 2024-09-12T18:35:55.665 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6874000000000001e-05 2024-09-12T18:35:55.665 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.665 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.665 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:55.665 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643488+0000", 2024-09-12T18:35:55.666 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3026e-05 2024-09-12T18:35:55.666 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.666 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.666 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:55.666 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643931+0000", 2024-09-12T18:35:55.666 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00044307 2024-09-12T18:35:55.666 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.666 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.666 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:55.666 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644210+0000", 2024-09-12T18:35:55.666 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027908400000000003 2024-09-12T18:35:55.666 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.667 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.667 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:55.667 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644606+0000", 2024-09-12T18:35:55.667 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00039615400000000002 2024-09-12T18:35:55.667 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.667 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.667 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:55.667 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650552+0000", 2024-09-12T18:35:55.667 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0059455619999999997 2024-09-12T18:35:55.667 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.667 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.667 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:55.668 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665302+0000", 2024-09-12T18:35:55.668 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.014749962 2024-09-12T18:35:55.668 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.668 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.668 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:55.668 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665424+0000", 2024-09-12T18:35:55.668 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012214300000000001 2024-09-12T18:35:55.668 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.668 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.668 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:55.668 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665529+0000", 2024-09-12T18:35:55.668 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000104685 2024-09-12T18:35:55.668 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.669 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:55.669 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.669 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.669 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.669 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:55.669 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:35:55.669 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 29.906227967, 2024-09-12T18:35:55.669 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024222582999999999, 2024-09-12T18:35:55.669 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:55.669 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:55.669 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:35:55.669 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:55.669 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.670 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:55.670 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:35:55.670 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.670 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.670 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.670 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:55.670 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:35:55.670 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:55.670 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.670 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.670 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:55.670 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643530+0000", 2024-09-12T18:35:55.670 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.393e-06 2024-09-12T18:35:55.670 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.671 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.671 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:55.671 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643536+0000", 2024-09-12T18:35:55.671 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4130000000000003e-06 2024-09-12T18:35:55.671 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.671 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.671 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:55.671 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643554+0000", 2024-09-12T18:35:55.671 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7572999999999999e-05 2024-09-12T18:35:55.671 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.671 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.671 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:55.672 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643567+0000", 2024-09-12T18:35:55.672 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3393999999999999e-05 2024-09-12T18:35:55.672 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.672 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.672 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:55.672 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648198+0000", 2024-09-12T18:35:55.672 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0046304479999999997 2024-09-12T18:35:55.672 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.672 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.672 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:55.672 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648413+0000", 2024-09-12T18:35:55.672 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00021507500000000001 2024-09-12T18:35:55.672 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:55.672 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:55.673 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:55.673 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667751+0000", 2024-09-12T18:35:55.673 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.019338286999999999 2024-09-12T18:35:55.673 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.673 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:55.673 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.673 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:55.673 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:55.673 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:35:55.674 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:35:55.675 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:55.674+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:55.775 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:55.773+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:55.835 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:35:55.835 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:35:55.835 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.835 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:30308 5.a 5:58fb6be7:::benchmark_data_smithi073_23739_object30307:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T18:35:55.835 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:55.826772+0000", 2024-09-12T18:35:55.835 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0067054000000000002, 2024-09-12T18:35:55.835 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0067254690000000004, 2024-09-12T18:35:55.835 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:55.835 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:55.835 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:55.836 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:35:55.836 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:35:55.836 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:55.836 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 30308 2024-09-12T18:35:55.836 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.836 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:55.836 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.836 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:55.836 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.826772+0000", 2024-09-12T18:35:55.836 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:55.836 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.836 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.836 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:55.836 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.826772+0000", 2024-09-12T18:35:55.837 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:55.837 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.837 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.837 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:55.837 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.826773+0000", 2024-09-12T18:35:55.837 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5199999999999995e-07 2024-09-12T18:35:55.837 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.837 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.837 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:55.837 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.826928+0000", 2024-09-12T18:35:55.837 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015480299999999999 2024-09-12T18:35:55.837 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.837 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.838 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:55.838 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.826938+0000", 2024-09-12T18:35:55.838 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0414000000000001e-05 2024-09-12T18:35:55.838 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.838 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.838 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:55.838 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.826946+0000", 2024-09-12T18:35:55.838 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0430000000000002e-06 2024-09-12T18:35:55.838 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.838 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.838 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:55.838 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.826988+0000", 2024-09-12T18:35:55.838 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2753999999999998e-05 2024-09-12T18:35:55.838 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.839 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.839 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:55.839 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.827078+0000", 2024-09-12T18:35:55.839 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.0237999999999999e-05 2024-09-12T18:35:55.839 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.839 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.839 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:55.839 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.827197+0000", 2024-09-12T18:35:55.839 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000118324 2024-09-12T18:35:55.839 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.839 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.839 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:35:55.839 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.832059+0000", 2024-09-12T18:35:55.839 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00486214 2024-09-12T18:35:55.840 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:55.840 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:55.840 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:55.840 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.840 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.840 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:30311 5.5 5:abb7fcda:::benchmark_data_smithi073_23739_object30310:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T18:35:55.840 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:55.827107+0000", 2024-09-12T18:35:55.840 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0063706630000000004, 2024-09-12T18:35:55.840 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0064364879999999998, 2024-09-12T18:35:55.840 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:55.840 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:55.841 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:55.841 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:35:55.841 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:35:55.841 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:55.841 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 30311 2024-09-12T18:35:55.841 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.841 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:55.841 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.841 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:55.841 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.827107+0000", 2024-09-12T18:35:55.841 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:55.842 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.842 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.842 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:55.842 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.827107+0000", 2024-09-12T18:35:55.842 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:55.842 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.842 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.842 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:55.842 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.827108+0000", 2024-09-12T18:35:55.842 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.0999999999999998e-07 2024-09-12T18:35:55.842 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.842 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.842 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:55.843 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.827152+0000", 2024-09-12T18:35:55.843 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4073999999999998e-05 2024-09-12T18:35:55.843 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.843 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.843 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:55.843 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.827160+0000", 2024-09-12T18:35:55.843 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2279999999999998e-06 2024-09-12T18:35:55.843 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.843 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.843 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:55.843 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.827166+0000", 2024-09-12T18:35:55.843 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.207e-06 2024-09-12T18:35:55.843 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.844 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.844 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:55.844 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.827221+0000", 2024-09-12T18:35:55.844 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4354000000000002e-05 2024-09-12T18:35:55.844 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.844 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.844 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:55.844 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.827389+0000", 2024-09-12T18:35:55.844 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00016824400000000001 2024-09-12T18:35:55.844 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.844 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.844 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:55.844 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.827556+0000", 2024-09-12T18:35:55.845 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000166825 2024-09-12T18:35:55.845 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.845 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.845 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:35:55.845 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.832746+0000", 2024-09-12T18:35:55.845 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0051900929999999998 2024-09-12T18:35:55.845 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:55.845 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:55.845 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:55.845 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.845 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.845 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:30315 5.a 5:598149e1:::benchmark_data_smithi073_23739_object30314:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T18:35:55.846 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:55.829385+0000", 2024-09-12T18:35:55.846 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.004092516, 2024-09-12T18:35:55.846 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0042191319999999996, 2024-09-12T18:35:55.846 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:55.846 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:55.846 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:55.846 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:35:55.846 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:35:55.846 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:55.846 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 30315 2024-09-12T18:35:55.846 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.846 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:55.847 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.847 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:55.847 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.829385+0000", 2024-09-12T18:35:55.847 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:55.847 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.847 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.847 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:55.847 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.829385+0000", 2024-09-12T18:35:55.847 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:55.847 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.847 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.847 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:55.847 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.829387+0000", 2024-09-12T18:35:55.848 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3200000000000001e-06 2024-09-12T18:35:55.848 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.848 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.848 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:55.848 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.829472+0000", 2024-09-12T18:35:55.848 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5078000000000001e-05 2024-09-12T18:35:55.848 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.848 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.848 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:55.848 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.829484+0000", 2024-09-12T18:35:55.848 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2306999999999999e-05 2024-09-12T18:35:55.848 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.848 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.848 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:55.849 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.829491+0000", 2024-09-12T18:35:55.849 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3300000000000001e-06 2024-09-12T18:35:55.849 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.849 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.849 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:55.849 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.829543+0000", 2024-09-12T18:35:55.849 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1252999999999999e-05 2024-09-12T18:35:55.849 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.849 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.849 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:55.849 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.829680+0000", 2024-09-12T18:35:55.849 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000137028 2024-09-12T18:35:55.849 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.850 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.850 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:55.850 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.829810+0000", 2024-09-12T18:35:55.850 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000130708 2024-09-12T18:35:55.850 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.850 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.850 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:35:55.850 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.832705+0000", 2024-09-12T18:35:55.850 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0028945609999999999 2024-09-12T18:35:55.850 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:55.850 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:55.850 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:55.850 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.850 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.851 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:30319 5.5 5:ac092c58:::benchmark_data_smithi073_23739_object30318:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T18:35:55.851 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:55.831469+0000", 2024-09-12T18:35:55.851 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0020089930000000002, 2024-09-12T18:35:55.851 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0021756649999999998, 2024-09-12T18:35:55.851 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:55.851 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:55.851 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:55.851 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:35:55.851 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:35:55.851 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:55.851 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 30319 2024-09-12T18:35:55.851 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.851 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:55.852 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.852 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:55.852 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.831469+0000", 2024-09-12T18:35:55.852 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:55.852 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.852 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.852 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:55.852 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.831469+0000", 2024-09-12T18:35:55.852 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:55.852 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.852 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.852 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:55.852 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.831470+0000", 2024-09-12T18:35:55.852 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0589999999999999e-06 2024-09-12T18:35:55.853 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.853 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.853 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:55.853 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.831559+0000", 2024-09-12T18:35:55.853 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.8695000000000004e-05 2024-09-12T18:35:55.853 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.853 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.853 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:55.853 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.831569+0000", 2024-09-12T18:35:55.853 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0796e-05 2024-09-12T18:35:55.853 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.853 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.853 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:55.854 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.831575+0000", 2024-09-12T18:35:55.854 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4829999999999999e-06 2024-09-12T18:35:55.854 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.854 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.854 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:55.854 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.831618+0000", 2024-09-12T18:35:55.854 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3377000000000002e-05 2024-09-12T18:35:55.854 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.854 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.854 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:55.854 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.831721+0000", 2024-09-12T18:35:55.854 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000103164 2024-09-12T18:35:55.854 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.854 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.855 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:55.855 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.831814+0000", 2024-09-12T18:35:55.855 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2156000000000003e-05 2024-09-12T18:35:55.855 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.855 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.855 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:35:55.855 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.833570+0000", 2024-09-12T18:35:55.855 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017564480000000001 2024-09-12T18:35:55.855 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:55.855 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:55.855 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:55.855 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.855 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.855 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:30320 5.c 5:3a0ac052:::benchmark_data_smithi073_23739_object30319:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T18:35:55.856 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:55.831836+0000", 2024-09-12T18:35:55.856 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.001641761, 2024-09-12T18:35:55.856 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001848716, 2024-09-12T18:35:55.856 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:55.856 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:55.856 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:55.856 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:35:55.856 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:35:55.856 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:55.856 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 30320 2024-09-12T18:35:55.856 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.856 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:55.857 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.857 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:55.857 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.831836+0000", 2024-09-12T18:35:55.857 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:55.857 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.857 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.857 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:55.857 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.831836+0000", 2024-09-12T18:35:55.857 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:55.857 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.857 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.857 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:55.857 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.831837+0000", 2024-09-12T18:35:55.857 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1299999999999998e-07 2024-09-12T18:35:55.858 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.858 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.858 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:55.858 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.831892+0000", 2024-09-12T18:35:55.858 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4905999999999999e-05 2024-09-12T18:35:55.858 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.858 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.858 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:55.858 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.831901+0000", 2024-09-12T18:35:55.858 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6819999999999992e-06 2024-09-12T18:35:55.858 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.858 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.858 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:55.858 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.831905+0000", 2024-09-12T18:35:55.859 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.216e-06 2024-09-12T18:35:55.859 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.859 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.859 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:55.859 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.831980+0000", 2024-09-12T18:35:55.859 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5421999999999997e-05 2024-09-12T18:35:55.859 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.859 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.859 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:55.859 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.832146+0000", 2024-09-12T18:35:55.859 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00016608500000000001 2024-09-12T18:35:55.859 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.859 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.860 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:55.860 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.832279+0000", 2024-09-12T18:35:55.860 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000132719 2024-09-12T18:35:55.860 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:55.860 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:55.860 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:55.860 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.860 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.860 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:30321 5.5 5:a05f7aaa:::benchmark_data_smithi073_23739_object30320:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T18:35:55.860 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:55.832532+0000", 2024-09-12T18:35:55.860 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00094596399999999998, 2024-09-12T18:35:55.860 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0011947990000000001, 2024-09-12T18:35:55.860 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:55.861 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:55.861 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:55.861 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:35:55.861 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:35:55.861 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:55.861 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 30321 2024-09-12T18:35:55.861 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.861 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:55.861 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.861 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:55.861 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.832532+0000", 2024-09-12T18:35:55.861 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:55.861 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.861 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.861 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:55.862 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.832532+0000", 2024-09-12T18:35:55.862 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:55.862 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.862 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.862 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:55.862 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.832532+0000", 2024-09-12T18:35:55.862 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6499999999999999e-07 2024-09-12T18:35:55.862 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.862 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.862 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:55.862 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.832591+0000", 2024-09-12T18:35:55.862 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8078000000000002e-05 2024-09-12T18:35:55.862 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.862 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.863 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:55.863 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.832599+0000", 2024-09-12T18:35:55.863 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.4519999999999997e-06 2024-09-12T18:35:55.863 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.863 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.863 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:55.863 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.832605+0000", 2024-09-12T18:35:55.863 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.443e-06 2024-09-12T18:35:55.863 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.863 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.863 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:55.863 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.832775+0000", 2024-09-12T18:35:55.863 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00016955799999999999 2024-09-12T18:35:55.864 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.864 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.864 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:55.864 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.832893+0000", 2024-09-12T18:35:55.864 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00011786 2024-09-12T18:35:55.864 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:55.864 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:55.864 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:55.864 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.832969+0000", 2024-09-12T18:35:55.864 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6252000000000001e-05 2024-09-12T18:35:55.864 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:55.864 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:55.864 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:55.864 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:55.865 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-12T18:35:55.865 INFO:teuthology.orchestra.run.smithi114.stdout: "num_ops": 6 2024-09-12T18:35:55.865 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:35:55.866 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:35:55.868 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 10 16 30407 30391 189.923 161.688 0.00467456 0.00526002 2024-09-12T18:35:55.877 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:55.874+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:55.977 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:55.973+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:56.077 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:35:56.077 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2024-09-12T18:35:56.077 INFO:teuthology.orchestra.run.smithi114.stdout: "complaint_time": 30, 2024-09-12T18:35:56.077 INFO:teuthology.orchestra.run.smithi114.stdout: "num_blocked_ops": 0 2024-09-12T18:35:56.077 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:35:56.078 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:56.077+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:56.096 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:35:56.183 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:56.181+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:56.280 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:56.277+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:56.308 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:35:56.308 INFO:teuthology.orchestra.run.smithi114.stdout: "size": 20, 2024-09-12T18:35:56.308 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 600, 2024-09-12T18:35:56.308 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:35:56.308 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.308 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:56.308 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:35:56.308 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 30.676112620000001, 2024-09-12T18:35:56.309 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.042475618999999999, 2024-09-12T18:35:56.309 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:56.309 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:56.309 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:56.309 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:56.309 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.309 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:56.309 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:35:56.309 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:56.309 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.309 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.309 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:56.310 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:35:56.310 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:56.310 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.310 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.310 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:56.310 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628450+0000", 2024-09-12T18:35:56.310 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4212999999999999e-05 2024-09-12T18:35:56.310 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.310 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.310 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:56.310 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628463+0000", 2024-09-12T18:35:56.310 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2497000000000001e-05 2024-09-12T18:35:56.311 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.311 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.311 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:56.311 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628480+0000", 2024-09-12T18:35:56.311 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7232999999999999e-05 2024-09-12T18:35:56.311 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.311 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.311 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:56.311 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628496+0000", 2024-09-12T18:35:56.311 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6217000000000001e-05 2024-09-12T18:35:56.311 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.311 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.312 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:56.312 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628641+0000", 2024-09-12T18:35:56.312 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000144709 2024-09-12T18:35:56.312 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.313 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.313 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:35:56.313 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628657+0000", 2024-09-12T18:35:56.313 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6266e-05 2024-09-12T18:35:56.313 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.313 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.313 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:56.313 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663103+0000", 2024-09-12T18:35:56.313 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.034445523999999998 2024-09-12T18:35:56.313 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.313 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.314 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:56.314 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663373+0000", 2024-09-12T18:35:56.314 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00027085500000000002 2024-09-12T18:35:56.314 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.314 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.315 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:56.315 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663634+0000", 2024-09-12T18:35:56.315 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000260855 2024-09-12T18:35:56.315 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.316 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.316 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:35:56.316 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670294+0000", 2024-09-12T18:35:56.316 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0066597599999999998 2024-09-12T18:35:56.316 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.316 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.316 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:56.316 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670705+0000", 2024-09-12T18:35:56.316 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00041057099999999998 2024-09-12T18:35:56.316 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.316 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.316 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:56.317 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670820+0000", 2024-09-12T18:35:56.317 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000115111 2024-09-12T18:35:56.317 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.317 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.317 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:56.317 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670912+0000", 2024-09-12T18:35:56.317 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1807999999999999e-05 2024-09-12T18:35:56.317 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:56.317 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:56.317 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:56.317 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.317 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.317 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:56.318 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:35:56.318 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 30.676021874, 2024-09-12T18:35:56.318 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.044599273000000002, 2024-09-12T18:35:56.318 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:56.318 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:56.318 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:56.318 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:56.318 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.318 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:56.318 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:35:56.318 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:56.318 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.318 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.318 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:56.319 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:35:56.319 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:56.319 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.319 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.319 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:56.319 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628528+0000", 2024-09-12T18:35:56.319 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:35:56.319 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.319 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.319 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:56.319 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628537+0000", 2024-09-12T18:35:56.319 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6969999999999999e-06 2024-09-12T18:35:56.319 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.319 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.320 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:56.320 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628560+0000", 2024-09-12T18:35:56.320 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2889000000000001e-05 2024-09-12T18:35:56.320 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.320 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.320 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:56.320 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628576+0000", 2024-09-12T18:35:56.320 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.649e-05 2024-09-12T18:35:56.320 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.320 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.320 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:56.320 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628846+0000", 2024-09-12T18:35:56.320 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00026952500000000001 2024-09-12T18:35:56.321 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.321 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.321 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:35:56.321 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628853+0000", 2024-09-12T18:35:56.321 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6559999999999992e-06 2024-09-12T18:35:56.322 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.322 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.322 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:56.322 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665284+0000", 2024-09-12T18:35:56.322 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.036431140000000001 2024-09-12T18:35:56.322 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.322 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.322 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:56.322 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665494+0000", 2024-09-12T18:35:56.322 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000209762 2024-09-12T18:35:56.323 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.323 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.323 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:56.323 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665816+0000", 2024-09-12T18:35:56.323 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00032162299999999999 2024-09-12T18:35:56.323 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.323 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.323 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:35:56.323 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670382+0000", 2024-09-12T18:35:56.323 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0045656739999999996 2024-09-12T18:35:56.323 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.323 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.323 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:56.323 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.672978+0000", 2024-09-12T18:35:56.324 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.002596068 2024-09-12T18:35:56.324 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.324 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.324 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:56.324 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673058+0000", 2024-09-12T18:35:56.324 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0198999999999996e-05 2024-09-12T18:35:56.324 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.324 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.324 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:56.324 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673126+0000", 2024-09-12T18:35:56.325 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8120000000000005e-05 2024-09-12T18:35:56.325 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:56.325 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:56.325 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:56.325 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.325 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.325 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:23 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:56.325 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:35:56.325 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 30.675924068, 2024-09-12T18:35:56.325 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045539784, 2024-09-12T18:35:56.325 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:56.325 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:56.325 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:56.325 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:56.326 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.326 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:56.326 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:35:56.326 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:56.326 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.326 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.326 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:56.326 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:35:56.326 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:56.326 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.326 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.326 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:56.326 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628626+0000", 2024-09-12T18:35:56.326 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.573e-06 2024-09-12T18:35:56.327 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.327 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.327 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:56.327 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628640+0000", 2024-09-12T18:35:56.327 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3817e-05 2024-09-12T18:35:56.327 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.327 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.327 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:56.327 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628659+0000", 2024-09-12T18:35:56.327 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9539999999999999e-05 2024-09-12T18:35:56.327 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.327 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.327 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:56.327 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628675+0000", 2024-09-12T18:35:56.328 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5739e-05 2024-09-12T18:35:56.328 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.328 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.328 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:56.328 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628815+0000", 2024-09-12T18:35:56.328 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014003299999999999 2024-09-12T18:35:56.328 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.328 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.328 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:35:56.328 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628828+0000", 2024-09-12T18:35:56.328 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2849e-05 2024-09-12T18:35:56.328 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.328 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.329 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:56.329 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651162+0000", 2024-09-12T18:35:56.329 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.022334228000000001 2024-09-12T18:35:56.329 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.329 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.329 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:56.329 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651446+0000", 2024-09-12T18:35:56.329 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00028392800000000002 2024-09-12T18:35:56.329 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.329 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.329 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:56.329 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651746+0000", 2024-09-12T18:35:56.329 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000300091 2024-09-12T18:35:56.329 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.330 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.330 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:35:56.330 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665113+0000", 2024-09-12T18:35:56.330 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013366678 2024-09-12T18:35:56.330 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.330 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.330 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:56.330 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674010+0000", 2024-09-12T18:35:56.330 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0088970520000000008 2024-09-12T18:35:56.330 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.330 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.330 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:56.330 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674104+0000", 2024-09-12T18:35:56.330 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4124999999999998e-05 2024-09-12T18:35:56.331 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.331 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.331 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:56.331 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674164+0000", 2024-09-12T18:35:56.331 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.0130999999999997e-05 2024-09-12T18:35:56.331 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:56.331 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:56.331 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:56.331 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.331 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.331 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:26 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:56.331 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:35:56.331 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 30.675850862000001, 2024-09-12T18:35:56.331 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045702136999999997, 2024-09-12T18:35:56.332 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:56.332 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:56.332 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:56.332 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:56.332 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.332 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:56.332 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:35:56.332 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:56.332 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.332 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.333 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:56.333 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:35:56.333 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:56.333 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.333 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.333 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:56.333 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628699+0000", 2024-09-12T18:35:56.333 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3859999999999999e-06 2024-09-12T18:35:56.333 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.333 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.333 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:56.333 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628706+0000", 2024-09-12T18:35:56.333 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0169999999999999e-06 2024-09-12T18:35:56.333 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.334 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.334 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:56.334 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628725+0000", 2024-09-12T18:35:56.334 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8683000000000001e-05 2024-09-12T18:35:56.334 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.334 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.334 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:56.334 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628740+0000", 2024-09-12T18:35:56.336 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5413999999999998e-05 2024-09-12T18:35:56.336 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.336 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.336 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:56.336 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628907+0000", 2024-09-12T18:35:56.336 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00016670199999999999 2024-09-12T18:35:56.336 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.336 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.336 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:35:56.336 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628917+0000", 2024-09-12T18:35:56.336 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.046e-05 2024-09-12T18:35:56.336 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.336 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.337 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:56.337 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.660390+0000", 2024-09-12T18:35:56.337 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.031472364000000003 2024-09-12T18:35:56.337 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.337 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.337 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:56.337 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.661767+0000", 2024-09-12T18:35:56.337 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0013769190000000001 2024-09-12T18:35:56.337 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.337 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.337 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:56.337 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.662408+0000", 2024-09-12T18:35:56.337 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00064091099999999998 2024-09-12T18:35:56.337 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.338 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.338 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:35:56.338 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669577+0000", 2024-09-12T18:35:56.338 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.007169412 2024-09-12T18:35:56.338 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.338 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.338 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:56.338 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674244+0000", 2024-09-12T18:35:56.338 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0046671839999999996 2024-09-12T18:35:56.338 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.338 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.338 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:56.338 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674329+0000", 2024-09-12T18:35:56.338 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5276000000000001e-05 2024-09-12T18:35:56.338 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.339 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.339 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:56.339 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674400+0000", 2024-09-12T18:35:56.339 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0408999999999996e-05 2024-09-12T18:35:56.339 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:56.339 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:56.339 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:56.339 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.339 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.339 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:56.339 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:35:56.339 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 30.675743192999999, 2024-09-12T18:35:56.339 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.044572443000000003, 2024-09-12T18:35:56.339 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:56.340 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:56.340 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:56.340 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:56.340 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.340 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:56.340 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:35:56.340 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:56.340 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.340 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.340 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:56.340 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:35:56.340 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:56.340 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.340 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.341 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:56.341 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628807+0000", 2024-09-12T18:35:56.341 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3629999999999999e-06 2024-09-12T18:35:56.341 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.341 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.341 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:56.341 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628814+0000", 2024-09-12T18:35:56.341 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.2099999999999996e-06 2024-09-12T18:35:56.341 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.341 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.341 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:56.341 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628832+0000", 2024-09-12T18:35:56.341 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7972999999999999e-05 2024-09-12T18:35:56.342 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.342 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.342 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:56.342 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628854+0000", 2024-09-12T18:35:56.342 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1857000000000001e-05 2024-09-12T18:35:56.342 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.342 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.342 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:56.342 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628984+0000", 2024-09-12T18:35:56.342 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013013599999999999 2024-09-12T18:35:56.342 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.342 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.342 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:35:56.342 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628993+0000", 2024-09-12T18:35:56.343 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:35:56.343 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.343 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.343 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:56.343 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668176+0000", 2024-09-12T18:35:56.343 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.039182211000000002 2024-09-12T18:35:56.343 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.343 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.343 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:56.343 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668481+0000", 2024-09-12T18:35:56.343 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00030499200000000002 2024-09-12T18:35:56.343 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.343 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.343 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:56.344 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668771+0000", 2024-09-12T18:35:56.344 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00029018700000000002 2024-09-12T18:35:56.344 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.344 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.344 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:35:56.344 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.672674+0000", 2024-09-12T18:35:56.344 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0039031890000000001 2024-09-12T18:35:56.344 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.344 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.344 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:56.344 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673214+0000", 2024-09-12T18:35:56.344 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00053981600000000004 2024-09-12T18:35:56.344 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.344 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.345 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:56.345 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673310+0000", 2024-09-12T18:35:56.345 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.6682999999999996e-05 2024-09-12T18:35:56.345 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.345 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.345 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:56.345 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673378+0000", 2024-09-12T18:35:56.345 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7385999999999995e-05 2024-09-12T18:35:56.345 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:56.345 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:56.345 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:56.345 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.345 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.345 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:56.346 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:35:56.346 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 30.675607166999999, 2024-09-12T18:35:56.346 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.041480853999999998, 2024-09-12T18:35:56.346 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:56.346 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:56.346 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:56.346 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:56.346 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.346 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:56.346 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:35:56.346 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:56.346 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.346 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.346 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:56.347 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:35:56.347 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:56.347 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.347 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.347 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:56.347 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628943+0000", 2024-09-12T18:35:56.347 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.403e-06 2024-09-12T18:35:56.347 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.347 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.347 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:56.347 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628953+0000", 2024-09-12T18:35:56.347 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0273e-05 2024-09-12T18:35:56.347 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.347 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.348 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:56.348 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628973+0000", 2024-09-12T18:35:56.348 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9959999999999999e-05 2024-09-12T18:35:56.348 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.348 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.348 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:56.348 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628989+0000", 2024-09-12T18:35:56.348 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6447e-05 2024-09-12T18:35:56.348 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.348 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.348 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:56.348 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629144+0000", 2024-09-12T18:35:56.348 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015468900000000001 2024-09-12T18:35:56.349 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.349 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.349 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:35:56.349 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629162+0000", 2024-09-12T18:35:56.349 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7603000000000001e-05 2024-09-12T18:35:56.349 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.349 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.349 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:56.349 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.646927+0000", 2024-09-12T18:35:56.349 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.017765626 2024-09-12T18:35:56.349 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.349 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.349 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:56.349 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.647245+0000", 2024-09-12T18:35:56.350 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00031797699999999999 2024-09-12T18:35:56.350 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.350 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.350 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:56.350 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.647551+0000", 2024-09-12T18:35:56.350 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00030583500000000002 2024-09-12T18:35:56.350 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.350 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.350 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:35:56.350 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651738+0000", 2024-09-12T18:35:56.350 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0041864980000000003 2024-09-12T18:35:56.350 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.350 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.350 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:56.350 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670207+0000", 2024-09-12T18:35:56.351 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018469299000000002 2024-09-12T18:35:56.351 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.351 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.351 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:56.351 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670330+0000", 2024-09-12T18:35:56.351 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012284500000000001 2024-09-12T18:35:56.351 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.351 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.351 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:56.351 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670422+0000", 2024-09-12T18:35:56.351 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2398999999999994e-05 2024-09-12T18:35:56.351 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:56.351 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:56.352 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:56.352 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.352 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.352 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:56.352 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:35:56.352 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 30.675529913999998, 2024-09-12T18:35:56.352 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.041623741999999998, 2024-09-12T18:35:56.352 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:56.352 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:56.352 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:35:56.352 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:56.352 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.352 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:56.352 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:35:56.353 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:56.353 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.353 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.353 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:56.353 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:35:56.353 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:56.353 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.353 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.353 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:56.353 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629020+0000", 2024-09-12T18:35:56.353 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.15e-06 2024-09-12T18:35:56.353 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.353 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.353 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:56.354 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629023+0000", 2024-09-12T18:35:56.354 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4659999999999999e-06 2024-09-12T18:35:56.354 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.354 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.354 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:56.354 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629037+0000", 2024-09-12T18:35:56.354 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3857e-05 2024-09-12T18:35:56.354 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.354 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.354 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:56.354 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629062+0000", 2024-09-12T18:35:56.354 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4519999999999999e-05 2024-09-12T18:35:56.354 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.354 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.354 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:56.355 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629253+0000", 2024-09-12T18:35:56.355 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000191335 2024-09-12T18:35:56.355 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.355 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.355 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:35:56.355 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629266+0000", 2024-09-12T18:35:56.355 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3322999999999999e-05 2024-09-12T18:35:56.355 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.355 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.355 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:56.355 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648331+0000", 2024-09-12T18:35:56.355 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.019065060000000002 2024-09-12T18:35:56.355 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.356 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.356 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:56.356 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.650044+0000", 2024-09-12T18:35:56.356 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017123959999999999 2024-09-12T18:35:56.356 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.356 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.356 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:56.356 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670642+0000", 2024-09-12T18:35:56.356 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.020598635000000001 2024-09-12T18:35:56.356 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:56.356 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:56.356 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:56.356 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.356 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.357 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:56.357 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:35:56.357 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 30.675426582, 2024-09-12T18:35:56.357 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.046431252999999999, 2024-09-12T18:35:56.357 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:56.357 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:56.357 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:35:56.357 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:56.358 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.358 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:56.358 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:35:56.359 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:56.359 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.359 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.359 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:56.359 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:35:56.359 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:56.359 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.359 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.359 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:56.359 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629123+0000", 2024-09-12T18:35:56.359 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0899999999999999e-06 2024-09-12T18:35:56.359 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.359 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.359 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:56.360 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629138+0000", 2024-09-12T18:35:56.360 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4977000000000001e-05 2024-09-12T18:35:56.360 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.360 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.360 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:56.360 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629149+0000", 2024-09-12T18:35:56.360 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1182999999999999e-05 2024-09-12T18:35:56.360 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.360 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.360 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:56.360 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629157+0000", 2024-09-12T18:35:56.360 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8129999999999996e-06 2024-09-12T18:35:56.360 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.361 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.361 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:56.361 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629223+0000", 2024-09-12T18:35:56.361 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6463000000000004e-05 2024-09-12T18:35:56.361 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.361 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.361 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:35:56.361 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629230+0000", 2024-09-12T18:35:56.361 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1360000000000002e-06 2024-09-12T18:35:56.361 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.361 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.361 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:56.361 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669605+0000", 2024-09-12T18:35:56.361 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.040375518999999999 2024-09-12T18:35:56.362 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.362 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.362 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:56.362 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669840+0000", 2024-09-12T18:35:56.362 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00023520099999999999 2024-09-12T18:35:56.362 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.362 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.362 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:56.362 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.675553+0000", 2024-09-12T18:35:56.362 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0057128709999999996 2024-09-12T18:35:56.362 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:56.362 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:56.362 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:56.362 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.363 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.363 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:56.363 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:35:56.363 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 30.675371914999999, 2024-09-12T18:35:56.363 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.037357044999999998, 2024-09-12T18:35:56.363 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:56.363 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:56.363 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:35:56.363 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:56.363 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.363 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:56.363 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:35:56.363 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:56.363 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.364 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.364 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:56.364 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:35:56.364 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:56.364 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.364 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.364 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:56.364 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629178+0000", 2024-09-12T18:35:56.364 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.08e-06 2024-09-12T18:35:56.364 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.364 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.364 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:56.364 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629194+0000", 2024-09-12T18:35:56.365 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5899000000000001e-05 2024-09-12T18:35:56.365 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.365 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.365 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:56.365 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629211+0000", 2024-09-12T18:35:56.365 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7363e-05 2024-09-12T18:35:56.365 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.365 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.365 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:56.365 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629226+0000", 2024-09-12T18:35:56.365 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4567e-05 2024-09-12T18:35:56.365 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.365 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.365 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:56.366 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629299+0000", 2024-09-12T18:35:56.366 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3910000000000002e-05 2024-09-12T18:35:56.366 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.366 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.366 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:35:56.366 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629307+0000", 2024-09-12T18:35:56.366 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5299999999999999e-06 2024-09-12T18:35:56.366 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.366 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.366 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:56.366 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648185+0000", 2024-09-12T18:35:56.366 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018878533999999999 2024-09-12T18:35:56.366 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.366 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.366 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:56.367 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.649724+0000", 2024-09-12T18:35:56.367 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001538841 2024-09-12T18:35:56.367 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.367 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.367 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:56.367 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.666534+0000", 2024-09-12T18:35:56.367 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.016809320999999999 2024-09-12T18:35:56.367 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:56.367 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:56.367 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:56.367 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.367 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.367 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T18:35:56.367 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.634726+0000", 2024-09-12T18:35:56.368 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 30.669822995000001, 2024-09-12T18:35:56.368 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012351554000000001, 2024-09-12T18:35:56.368 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:56.368 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:56.368 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "reached pg", 2024-09-12T18:35:56.368 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:56.368 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.368 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:56.368 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.634726+0000", 2024-09-12T18:35:56.368 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:56.368 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.368 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.368 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:56.369 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.634726+0000", 2024-09-12T18:35:56.369 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:56.369 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.369 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.369 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:56.369 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.634726+0000", 2024-09-12T18:35:56.369 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7999999999999995e-07 2024-09-12T18:35:56.369 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.369 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.369 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:56.369 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.634742+0000", 2024-09-12T18:35:56.369 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.537e-05 2024-09-12T18:35:56.369 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.369 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.369 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:56.370 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.634788+0000", 2024-09-12T18:35:56.370 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.6059000000000001e-05 2024-09-12T18:35:56.370 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.370 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.370 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:56.370 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.634826+0000", 2024-09-12T18:35:56.370 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.7953000000000001e-05 2024-09-12T18:35:56.370 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.370 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.370 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:56.370 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.641962+0000", 2024-09-12T18:35:56.370 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0071361990000000002 2024-09-12T18:35:56.370 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.371 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.371 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:56.371 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.647077+0000", 2024-09-12T18:35:56.371 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0051152929999999999 2024-09-12T18:35:56.371 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:56.371 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:56.371 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:56.371 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.371 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.371 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:35:56.371 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.648091+0000", 2024-09-12T18:35:56.371 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 30.656457325000002, 2024-09-12T18:35:56.371 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015212766000000001, 2024-09-12T18:35:56.371 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:56.372 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:56.372 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:56.372 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:56.372 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.372 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:56.372 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648091+0000", 2024-09-12T18:35:56.372 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:56.372 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.372 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.372 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:56.372 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648091+0000", 2024-09-12T18:35:56.372 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:56.372 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.372 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.373 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:56.373 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648092+0000", 2024-09-12T18:35:56.373 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.26e-06 2024-09-12T18:35:56.373 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.373 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.373 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:56.373 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648123+0000", 2024-09-12T18:35:56.373 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.0719000000000002e-05 2024-09-12T18:35:56.373 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.373 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.373 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:56.373 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648140+0000", 2024-09-12T18:35:56.373 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6650000000000002e-05 2024-09-12T18:35:56.373 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.374 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.374 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:56.374 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648153+0000", 2024-09-12T18:35:56.374 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.278e-05 2024-09-12T18:35:56.374 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.374 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.374 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:56.374 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.649756+0000", 2024-09-12T18:35:56.374 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0016036379999999999 2024-09-12T18:35:56.374 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.374 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.374 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:56.374 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.649800+0000", 2024-09-12T18:35:56.374 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3748999999999997e-05 2024-09-12T18:35:56.375 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.375 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.375 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:56.375 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663215+0000", 2024-09-12T18:35:56.375 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013414733999999999 2024-09-12T18:35:56.375 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.375 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.375 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:56.375 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663304+0000", 2024-09-12T18:35:56.375 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.9235999999999997e-05 2024-09-12T18:35:56.375 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:56.375 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:56.375 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:56.376 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.376 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.376 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T18:35:56.376 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.648176+0000", 2024-09-12T18:35:56.376 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 30.656372915999999, 2024-09-12T18:35:56.376 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015315812, 2024-09-12T18:35:56.376 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:56.376 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:56.376 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:56.376 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:56.376 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.376 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:56.376 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648176+0000", 2024-09-12T18:35:56.376 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:56.377 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.377 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.377 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:56.377 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648176+0000", 2024-09-12T18:35:56.377 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:56.377 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.377 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.377 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:56.377 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648176+0000", 2024-09-12T18:35:56.377 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.9400000000000005e-07 2024-09-12T18:35:56.377 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.377 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.377 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:56.377 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648184+0000", 2024-09-12T18:35:56.378 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4730000000000003e-06 2024-09-12T18:35:56.378 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.378 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.378 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:56.378 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648201+0000", 2024-09-12T18:35:56.378 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7119999999999999e-05 2024-09-12T18:35:56.378 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.378 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.378 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:56.378 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648214+0000", 2024-09-12T18:35:56.378 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3343000000000001e-05 2024-09-12T18:35:56.378 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.378 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.379 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:56.379 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651085+0000", 2024-09-12T18:35:56.379 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0028710850000000002 2024-09-12T18:35:56.379 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.379 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.379 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:56.379 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651114+0000", 2024-09-12T18:35:56.379 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.8296000000000001e-05 2024-09-12T18:35:56.379 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.379 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.379 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:56.379 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663360+0000", 2024-09-12T18:35:56.379 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012246801999999999 2024-09-12T18:35:56.379 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.380 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.380 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:56.380 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663491+0000", 2024-09-12T18:35:56.380 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000130999 2024-09-12T18:35:56.380 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:56.380 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:56.380 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:56.380 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.380 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.380 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T18:35:56.380 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.648235+0000", 2024-09-12T18:35:56.380 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 30.656313376, 2024-09-12T18:35:56.380 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015168310000000001, 2024-09-12T18:35:56.381 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:56.381 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:56.381 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:56.381 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:56.381 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.381 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:56.381 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648235+0000", 2024-09-12T18:35:56.381 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:56.381 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.381 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.382 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:56.382 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648235+0000", 2024-09-12T18:35:56.382 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:56.382 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.382 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.382 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:56.382 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648236+0000", 2024-09-12T18:35:56.382 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5300000000000003e-07 2024-09-12T18:35:56.382 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.382 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.382 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:56.382 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648244+0000", 2024-09-12T18:35:56.382 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.7170000000000008e-06 2024-09-12T18:35:56.383 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.383 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.383 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:56.383 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648259+0000", 2024-09-12T18:35:56.383 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5126000000000001e-05 2024-09-12T18:35:56.383 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.383 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.383 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:56.383 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648270+0000", 2024-09-12T18:35:56.383 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0933e-05 2024-09-12T18:35:56.383 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.383 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.383 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:56.383 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.650395+0000", 2024-09-12T18:35:56.384 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0021251040000000001 2024-09-12T18:35:56.384 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.384 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.384 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:56.384 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.650444+0000", 2024-09-12T18:35:56.384 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9456000000000002e-05 2024-09-12T18:35:56.384 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.384 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.384 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:56.384 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663311+0000", 2024-09-12T18:35:56.384 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012866658 2024-09-12T18:35:56.384 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.384 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.385 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:56.385 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663403+0000", 2024-09-12T18:35:56.385 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2563000000000001e-05 2024-09-12T18:35:56.385 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:56.385 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:56.385 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:56.385 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.385 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.385 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:62 5.6 5:67709b9f:::benchmark_data_smithi073_23739_object61:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:35:56.385 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:45.898027+0000", 2024-09-12T18:35:56.385 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 10.406521605, 2024-09-12T18:35:56.385 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.014007786, 2024-09-12T18:35:56.385 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:56.386 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:56.386 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:56.386 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:35:56.386 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:35:56.386 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:56.386 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 62 2024-09-12T18:35:56.386 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.386 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:56.386 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.387 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:56.387 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.898027+0000", 2024-09-12T18:35:56.387 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:56.387 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.387 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.387 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:56.387 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.898027+0000", 2024-09-12T18:35:56.387 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:56.387 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.387 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.387 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:56.387 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.898029+0000", 2024-09-12T18:35:56.387 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.554e-06 2024-09-12T18:35:56.388 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.388 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.388 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:56.388 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.898164+0000", 2024-09-12T18:35:56.388 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000134719 2024-09-12T18:35:56.388 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.388 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.388 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:56.388 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.898186+0000", 2024-09-12T18:35:56.388 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1449000000000001e-05 2024-09-12T18:35:56.388 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.388 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.388 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:56.388 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.898199+0000", 2024-09-12T18:35:56.389 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3403e-05 2024-09-12T18:35:56.389 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.389 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.389 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:56.389 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.900978+0000", 2024-09-12T18:35:56.389 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0027789260000000001 2024-09-12T18:35:56.389 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.389 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.389 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:56.389 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.901163+0000", 2024-09-12T18:35:56.389 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00018457200000000001 2024-09-12T18:35:56.389 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.389 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.389 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:56.390 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.901378+0000", 2024-09-12T18:35:56.390 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00021581500000000001 2024-09-12T18:35:56.390 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.390 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.390 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:56.390 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.905487+0000", 2024-09-12T18:35:56.390 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0041085679999999999 2024-09-12T18:35:56.390 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.390 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.390 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:35:56.390 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.911778+0000", 2024-09-12T18:35:56.390 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0062909690000000004 2024-09-12T18:35:56.390 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.391 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.391 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:56.391 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.911923+0000", 2024-09-12T18:35:56.391 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014524199999999999 2024-09-12T18:35:56.391 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.391 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.391 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:56.391 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.912035+0000", 2024-09-12T18:35:56.391 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000111569 2024-09-12T18:35:56.391 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:56.391 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:56.391 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:56.391 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.392 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.392 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:19801 5.3 5:c7dab663:::benchmark_data_smithi073_23739_object19800:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:35:56.392 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:51.968444+0000", 2024-09-12T18:35:56.392 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4.3361045699999998, 2024-09-12T18:35:56.392 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012266192, 2024-09-12T18:35:56.392 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:56.392 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:56.392 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:56.392 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:35:56.392 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:35:56.392 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:56.392 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 19801 2024-09-12T18:35:56.392 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.392 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:56.393 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.393 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:56.393 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.968444+0000", 2024-09-12T18:35:56.393 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:56.393 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.393 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.393 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:56.393 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.968444+0000", 2024-09-12T18:35:56.393 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:56.393 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.393 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.393 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:56.393 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.968444+0000", 2024-09-12T18:35:56.394 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4700000000000001e-07 2024-09-12T18:35:56.394 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.394 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.394 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:56.394 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.968546+0000", 2024-09-12T18:35:56.394 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0001013 2024-09-12T18:35:56.394 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.394 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.394 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:56.394 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.968557+0000", 2024-09-12T18:35:56.394 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1107999999999999e-05 2024-09-12T18:35:56.394 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.394 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.395 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:56.395 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.968565+0000", 2024-09-12T18:35:56.395 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.3089999999999996e-06 2024-09-12T18:35:56.395 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.395 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.395 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:56.395 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.968620+0000", 2024-09-12T18:35:56.395 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4834999999999999e-05 2024-09-12T18:35:56.395 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.395 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.395 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:56.395 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.968738+0000", 2024-09-12T18:35:56.395 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000118385 2024-09-12T18:35:56.396 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.396 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.396 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:56.396 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.968852+0000", 2024-09-12T18:35:56.396 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000113668 2024-09-12T18:35:56.396 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.396 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.396 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:35:56.396 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.970810+0000", 2024-09-12T18:35:56.396 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0019579649999999999 2024-09-12T18:35:56.396 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.396 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.396 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:56.396 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.980635+0000", 2024-09-12T18:35:56.397 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0098251069999999996 2024-09-12T18:35:56.397 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.397 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.397 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:56.397 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.980681+0000", 2024-09-12T18:35:56.397 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5451999999999998e-05 2024-09-12T18:35:56.397 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.397 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.397 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:56.397 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.980710+0000", 2024-09-12T18:35:56.397 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.9516e-05 2024-09-12T18:35:56.397 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:56.397 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:56.398 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:56.398 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.398 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.398 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:19805 5.3 5:cc1cbe0a:::benchmark_data_smithi073_23739_object19804:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:35:56.398 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:51.968716+0000", 2024-09-12T18:35:56.398 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4.3358325530000004, 2024-09-12T18:35:56.398 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012125431000000001, 2024-09-12T18:35:56.398 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:56.398 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:56.398 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:56.398 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:35:56.398 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:35:56.398 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:56.399 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 19805 2024-09-12T18:35:56.399 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.399 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:56.399 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.399 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:56.399 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.968716+0000", 2024-09-12T18:35:56.399 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:56.399 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.399 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.399 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:56.399 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.968716+0000", 2024-09-12T18:35:56.399 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:56.399 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.399 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.400 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:56.400 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.968717+0000", 2024-09-12T18:35:56.400 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.046e-06 2024-09-12T18:35:56.400 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.400 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.400 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:56.400 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.968756+0000", 2024-09-12T18:35:56.400 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.9360999999999998e-05 2024-09-12T18:35:56.400 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.400 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.400 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:56.400 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.968767+0000", 2024-09-12T18:35:56.400 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0261000000000001e-05 2024-09-12T18:35:56.401 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.401 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.401 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:56.401 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.968774+0000", 2024-09-12T18:35:56.401 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0999999999999998e-06 2024-09-12T18:35:56.401 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.401 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.401 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:56.401 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.969768+0000", 2024-09-12T18:35:56.401 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0009942830000000001 2024-09-12T18:35:56.401 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.401 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.401 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:56.402 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.969886+0000", 2024-09-12T18:35:56.402 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000117705 2024-09-12T18:35:56.402 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.402 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.402 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:56.402 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.970036+0000", 2024-09-12T18:35:56.402 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000149899 2024-09-12T18:35:56.402 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.402 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.402 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:35:56.402 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.972291+0000", 2024-09-12T18:35:56.402 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.002255309 2024-09-12T18:35:56.402 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.402 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.403 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:56.403 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.980751+0000", 2024-09-12T18:35:56.403 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0084598239999999995 2024-09-12T18:35:56.403 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.403 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.403 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:56.403 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.980805+0000", 2024-09-12T18:35:56.403 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4561999999999997e-05 2024-09-12T18:35:56.403 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.403 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.403 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:56.403 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.980841+0000", 2024-09-12T18:35:56.403 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.6081000000000002e-05 2024-09-12T18:35:56.404 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:56.404 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:56.404 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:56.404 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.404 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.404 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:19809 5.c 5:3c729fea:::benchmark_data_smithi073_23739_object19808:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:35:56.404 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:51.970320+0000", 2024-09-12T18:35:56.404 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4.334228328, 2024-09-12T18:35:56.404 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.014749093, 2024-09-12T18:35:56.404 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:56.404 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:56.404 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:56.404 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:35:56.405 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:35:56.405 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:56.405 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 19809 2024-09-12T18:35:56.405 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.405 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:56.405 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.405 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:56.405 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.970320+0000", 2024-09-12T18:35:56.405 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:56.405 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.405 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.405 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:56.405 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.970320+0000", 2024-09-12T18:35:56.405 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:56.406 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.406 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.406 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:56.406 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.970321+0000", 2024-09-12T18:35:56.406 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1999999999999998e-07 2024-09-12T18:35:56.406 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.406 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.406 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:56.406 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.971120+0000", 2024-09-12T18:35:56.406 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00079864400000000005 2024-09-12T18:35:56.406 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.406 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.406 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:56.407 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.971132+0000", 2024-09-12T18:35:56.407 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2021000000000001e-05 2024-09-12T18:35:56.407 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.407 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.407 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:56.407 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.971139+0000", 2024-09-12T18:35:56.407 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5070000000000003e-06 2024-09-12T18:35:56.407 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.407 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.407 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:56.407 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.971181+0000", 2024-09-12T18:35:56.407 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.1430999999999997e-05 2024-09-12T18:35:56.407 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.407 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.408 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:56.408 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.971271+0000", 2024-09-12T18:35:56.408 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.0098000000000004e-05 2024-09-12T18:35:56.408 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.408 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.408 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:56.408 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.971351+0000", 2024-09-12T18:35:56.408 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0370999999999993e-05 2024-09-12T18:35:56.408 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.408 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.408 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:35:56.408 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.972563+0000", 2024-09-12T18:35:56.408 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0012113549999999999 2024-09-12T18:35:56.409 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.409 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.409 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:56.409 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.984988+0000", 2024-09-12T18:35:56.409 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012425808999999999 2024-09-12T18:35:56.409 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.409 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.409 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:56.409 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.985036+0000", 2024-09-12T18:35:56.409 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.7703000000000001e-05 2024-09-12T18:35:56.409 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.409 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.409 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:56.409 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.985069+0000", 2024-09-12T18:35:56.410 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3234000000000001e-05 2024-09-12T18:35:56.410 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:56.410 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:56.410 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:56.410 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.410 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.410 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:19814 5.6 5:61829c21:::benchmark_data_smithi073_23739_object19813:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:35:56.410 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:51.972022+0000", 2024-09-12T18:35:56.410 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4.3325269009999996, 2024-09-12T18:35:56.410 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013080481999999999, 2024-09-12T18:35:56.410 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:56.410 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:56.410 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:56.410 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:35:56.411 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:35:56.411 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:56.411 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 19814 2024-09-12T18:35:56.411 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.411 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:56.411 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.411 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:56.411 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.972022+0000", 2024-09-12T18:35:56.411 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:56.411 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.411 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.411 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:56.411 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.972022+0000", 2024-09-12T18:35:56.412 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:56.412 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.412 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.412 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:56.412 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.972022+0000", 2024-09-12T18:35:56.412 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.9899999999999999e-07 2024-09-12T18:35:56.412 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.412 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.412 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:56.412 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.972088+0000", 2024-09-12T18:35:56.412 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5766999999999996e-05 2024-09-12T18:35:56.412 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.412 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.412 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:56.413 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.972099+0000", 2024-09-12T18:35:56.413 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0729e-05 2024-09-12T18:35:56.413 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.413 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.413 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:56.413 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.972104+0000", 2024-09-12T18:35:56.413 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0930000000000002e-06 2024-09-12T18:35:56.413 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.413 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.413 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:56.413 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.972153+0000", 2024-09-12T18:35:56.413 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9024999999999999e-05 2024-09-12T18:35:56.413 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.413 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.414 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:56.414 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.972277+0000", 2024-09-12T18:35:56.414 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000123872 2024-09-12T18:35:56.414 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.414 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.414 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:56.414 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.972364+0000", 2024-09-12T18:35:56.414 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6876e-05 2024-09-12T18:35:56.414 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.414 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.414 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:35:56.414 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.973626+0000", 2024-09-12T18:35:56.414 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0012623420000000001 2024-09-12T18:35:56.414 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.415 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.415 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:56.415 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.985033+0000", 2024-09-12T18:35:56.415 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011406692 2024-09-12T18:35:56.415 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.415 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.415 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:56.415 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.985078+0000", 2024-09-12T18:35:56.415 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5404000000000001e-05 2024-09-12T18:35:56.415 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.415 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.415 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:56.415 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.985102+0000", 2024-09-12T18:35:56.416 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.3883000000000002e-05 2024-09-12T18:35:56.416 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:56.416 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:56.416 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:56.416 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.416 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.416 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:29330 5.8 e28/21 5:1b9a4683:::benchmark_data_smithi073_23739_object29329:head v 28'1769, mlcod=28'1766)", 2024-09-12T18:35:56.416 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:55.445828+0000", 2024-09-12T18:35:56.416 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.85872046400000002, 2024-09-12T18:35:56.416 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012602281, 2024-09-12T18:35:56.416 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:56.416 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:56.416 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:56.416 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:56.417 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.417 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:56.417 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.445828+0000", 2024-09-12T18:35:56.417 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:56.417 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.417 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.417 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:56.417 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.445828+0000", 2024-09-12T18:35:56.417 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:56.417 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.417 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.417 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:56.417 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.445829+0000", 2024-09-12T18:35:56.418 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1200000000000002e-07 2024-09-12T18:35:56.418 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.418 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.418 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:56.418 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.445860+0000", 2024-09-12T18:35:56.418 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.1488000000000001e-05 2024-09-12T18:35:56.418 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.418 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.418 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:56.418 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.445868+0000", 2024-09-12T18:35:56.418 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.7840000000000004e-06 2024-09-12T18:35:56.418 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.418 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.418 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:56.419 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.445875+0000", 2024-09-12T18:35:56.419 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.562e-06 2024-09-12T18:35:56.419 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.419 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.419 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:56.419 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.446193+0000", 2024-09-12T18:35:56.419 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000318783 2024-09-12T18:35:56.419 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.419 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.419 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:56.419 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.446236+0000", 2024-09-12T18:35:56.419 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2626000000000002e-05 2024-09-12T18:35:56.419 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.419 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.420 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:56.420 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.458382+0000", 2024-09-12T18:35:56.420 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012146396 2024-09-12T18:35:56.420 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.420 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.420 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:56.420 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.458430+0000", 2024-09-12T18:35:56.420 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.7929999999999997e-05 2024-09-12T18:35:56.420 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:56.420 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:56.420 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:56.420 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.420 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.420 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:29589 5.5 5:a59c4af7:::benchmark_data_smithi073_23739_object29588:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T18:35:56.421 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:55.544392+0000", 2024-09-12T18:35:56.421 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.76015664699999996, 2024-09-12T18:35:56.421 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012198231, 2024-09-12T18:35:56.421 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:56.421 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:56.421 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:56.421 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:35:56.421 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:35:56.421 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:56.421 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 29589 2024-09-12T18:35:56.421 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.421 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:56.421 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.422 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:56.422 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.544392+0000", 2024-09-12T18:35:56.422 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:56.422 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.422 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.422 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:56.422 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.544392+0000", 2024-09-12T18:35:56.422 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:56.422 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.422 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.422 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:56.422 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.544393+0000", 2024-09-12T18:35:56.422 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1600000000000001e-07 2024-09-12T18:35:56.422 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.423 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.423 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:56.423 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.544540+0000", 2024-09-12T18:35:56.423 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014758699999999999 2024-09-12T18:35:56.423 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.423 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.423 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:56.423 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.544550+0000", 2024-09-12T18:35:56.423 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.482e-06 2024-09-12T18:35:56.423 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.423 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.423 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:56.423 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.544554+0000", 2024-09-12T18:35:56.423 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2549999999999999e-06 2024-09-12T18:35:56.424 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.424 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.424 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:56.424 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.544606+0000", 2024-09-12T18:35:56.424 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2210999999999999e-05 2024-09-12T18:35:56.424 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.424 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.424 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:56.424 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.544727+0000", 2024-09-12T18:35:56.424 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012083600000000001 2024-09-12T18:35:56.424 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.424 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.424 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:56.424 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.544853+0000", 2024-09-12T18:35:56.425 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000126403 2024-09-12T18:35:56.425 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.425 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.425 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:35:56.425 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.549760+0000", 2024-09-12T18:35:56.425 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0049066250000000004 2024-09-12T18:35:56.425 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.425 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.425 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:56.425 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.556483+0000", 2024-09-12T18:35:56.425 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0067231010000000004 2024-09-12T18:35:56.425 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.425 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.425 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:35:56.426 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.556538+0000", 2024-09-12T18:35:56.426 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4737000000000001e-05 2024-09-12T18:35:56.426 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:56.426 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:56.426 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:35:56.426 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:55.556590+0000", 2024-09-12T18:35:56.426 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2278000000000003e-05 2024-09-12T18:35:56.426 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:56.426 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:56.426 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:56.426 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:56.426 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:56.426 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:35:56.428 INFO:teuthology.orchestra.run.smithi073.stderr:osd set-full-ratio 0.95 2024-09-12T18:35:56.429 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:35:56.429 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:56.422+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:56.528 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:56.526+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:56.573 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:35:56.585 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:35:56.585 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:35:56.585 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.585 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:32256 5.d 5:b39b3cca:::benchmark_data_smithi073_23739_object32255:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T18:35:56.586 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:56.584184+0000", 2024-09-12T18:35:56.587 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0016660080000000001, 2024-09-12T18:35:56.587 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016912769999999999, 2024-09-12T18:35:56.587 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:56.587 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:56.587 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:56.587 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:56.587 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:56.587 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:56.587 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 32256 2024-09-12T18:35:56.587 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.588 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:56.588 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.588 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:56.588 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584184+0000", 2024-09-12T18:35:56.588 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:56.588 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.588 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.588 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:56.588 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584184+0000", 2024-09-12T18:35:56.588 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:56.588 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.588 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.589 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:56.589 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584185+0000", 2024-09-12T18:35:56.589 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7199999999999998e-07 2024-09-12T18:35:56.589 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.589 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.589 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:56.589 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584272+0000", 2024-09-12T18:35:56.589 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7260000000000001e-05 2024-09-12T18:35:56.589 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.589 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.589 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:56.589 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584281+0000", 2024-09-12T18:35:56.589 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5140000000000001e-06 2024-09-12T18:35:56.589 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.590 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.590 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:56.590 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584292+0000", 2024-09-12T18:35:56.590 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1676e-05 2024-09-12T18:35:56.590 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.590 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.590 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:56.590 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584343+0000", 2024-09-12T18:35:56.590 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0145000000000002e-05 2024-09-12T18:35:56.590 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.590 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.590 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:56.590 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584456+0000", 2024-09-12T18:35:56.591 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011328999999999999 2024-09-12T18:35:56.591 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.591 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.591 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:56.591 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584556+0000", 2024-09-12T18:35:56.591 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9899e-05 2024-09-12T18:35:56.591 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:56.591 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:56.591 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:56.591 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.591 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.591 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:32258 5.d 5:bfcbc9e9:::benchmark_data_smithi073_23739_object32257:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T18:35:56.591 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:56.584305+0000", 2024-09-12T18:35:56.591 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.001545067, 2024-09-12T18:35:56.592 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016403380000000001, 2024-09-12T18:35:56.592 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:56.592 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:56.592 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:56.592 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:56.592 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:56.592 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:56.592 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 32258 2024-09-12T18:35:56.592 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.592 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:56.592 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.592 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:56.592 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584305+0000", 2024-09-12T18:35:56.593 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:56.593 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.593 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.593 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:56.593 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584305+0000", 2024-09-12T18:35:56.593 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:56.593 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.593 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.593 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:56.593 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584306+0000", 2024-09-12T18:35:56.593 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5299999999999999e-07 2024-09-12T18:35:56.593 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.593 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.593 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:56.594 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584377+0000", 2024-09-12T18:35:56.594 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1044999999999995e-05 2024-09-12T18:35:56.594 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.594 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.594 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:56.594 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584382+0000", 2024-09-12T18:35:56.594 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7139999999999998e-06 2024-09-12T18:35:56.594 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.594 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.594 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:56.594 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584386+0000", 2024-09-12T18:35:56.594 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6119999999999999e-06 2024-09-12T18:35:56.594 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.595 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.595 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:56.595 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.585713+0000", 2024-09-12T18:35:56.595 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013264660000000001 2024-09-12T18:35:56.595 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.595 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.595 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:56.595 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.585829+0000", 2024-09-12T18:35:56.595 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000116372 2024-09-12T18:35:56.595 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.595 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.595 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:56.595 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.585945+0000", 2024-09-12T18:35:56.595 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011565099999999999 2024-09-12T18:35:56.595 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:56.596 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:56.596 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:56.596 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.596 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.596 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:32259 5.4 5:2a601be0:::benchmark_data_smithi073_23739_object32258:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T18:35:56.596 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:56.584398+0000", 2024-09-12T18:35:56.596 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0014525059999999999, 2024-09-12T18:35:56.596 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016106849999999999, 2024-09-12T18:35:56.596 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:56.596 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:56.596 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:56.596 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:56.596 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:56.597 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:56.597 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 32259 2024-09-12T18:35:56.597 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.597 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:56.597 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.597 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:56.597 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584398+0000", 2024-09-12T18:35:56.597 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:56.597 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.597 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.597 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:56.597 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584398+0000", 2024-09-12T18:35:56.597 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:56.597 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.598 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.598 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:56.598 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584398+0000", 2024-09-12T18:35:56.598 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.44e-07 2024-09-12T18:35:56.598 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.598 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.598 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:56.598 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584439+0000", 2024-09-12T18:35:56.598 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0853999999999999e-05 2024-09-12T18:35:56.598 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.598 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.598 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:56.598 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584445+0000", 2024-09-12T18:35:56.598 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.9540000000000001e-06 2024-09-12T18:35:56.599 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.599 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.599 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:56.599 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584449+0000", 2024-09-12T18:35:56.599 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6619999999999998e-06 2024-09-12T18:35:56.599 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.599 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.599 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:56.599 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584500+0000", 2024-09-12T18:35:56.599 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0769999999999997e-05 2024-09-12T18:35:56.599 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.599 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.599 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:56.600 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584630+0000", 2024-09-12T18:35:56.600 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013048500000000001 2024-09-12T18:35:56.600 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.600 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.600 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:56.600 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584722+0000", 2024-09-12T18:35:56.600 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2140999999999998e-05 2024-09-12T18:35:56.600 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:56.600 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:56.600 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:56.600 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.600 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.600 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:32260 5.8 5:1f8d39a1:::benchmark_data_smithi073_23739_object32259:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T18:35:56.601 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:56.584460+0000", 2024-09-12T18:35:56.601 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00139017, 2024-09-12T18:35:56.601 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00161049, 2024-09-12T18:35:56.601 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:56.601 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:56.601 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:56.601 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:56.601 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:56.601 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:56.601 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 32260 2024-09-12T18:35:56.601 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.601 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:56.601 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.601 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:56.602 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584460+0000", 2024-09-12T18:35:56.602 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:56.602 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.602 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.602 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:56.602 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584460+0000", 2024-09-12T18:35:56.602 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:56.602 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.602 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.602 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:56.602 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584461+0000", 2024-09-12T18:35:56.602 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3900000000000005e-07 2024-09-12T18:35:56.602 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.603 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.603 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:56.603 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584497+0000", 2024-09-12T18:35:56.603 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5864000000000001e-05 2024-09-12T18:35:56.603 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.603 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.603 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:56.603 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584503+0000", 2024-09-12T18:35:56.603 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8170000000000001e-06 2024-09-12T18:35:56.603 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.603 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.603 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:56.603 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584509+0000", 2024-09-12T18:35:56.603 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8000000000000004e-06 2024-09-12T18:35:56.604 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.604 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.604 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:56.604 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584998+0000", 2024-09-12T18:35:56.604 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048838600000000005 2024-09-12T18:35:56.604 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.604 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.604 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:56.604 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.585138+0000", 2024-09-12T18:35:56.604 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014010300000000001 2024-09-12T18:35:56.604 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.604 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.604 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:56.604 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.585297+0000", 2024-09-12T18:35:56.605 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015913200000000001 2024-09-12T18:35:56.605 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:56.605 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:56.605 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:56.605 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.605 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.605 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:32264 5.8 5.4f442038 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T18:35:56.605 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:56.584813+0000", 2024-09-12T18:35:56.605 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0010368689999999999, 2024-09-12T18:35:56.605 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001313573, 2024-09-12T18:35:56.605 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:56.605 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:56.605 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-09-12T18:35:56.606 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:56.606 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:56.606 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:56.606 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 32264 2024-09-12T18:35:56.606 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.606 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:56.606 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.606 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:56.606 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584813+0000", 2024-09-12T18:35:56.606 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:56.606 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.606 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.606 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:56.606 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584813+0000", 2024-09-12T18:35:56.607 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:56.607 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.607 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.607 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:56.607 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584814+0000", 2024-09-12T18:35:56.607 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4799999999999997e-07 2024-09-12T18:35:56.607 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.607 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.607 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:56.607 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584878+0000", 2024-09-12T18:35:56.607 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.3824000000000004e-05 2024-09-12T18:35:56.607 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.607 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.608 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:56.608 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584888+0000", 2024-09-12T18:35:56.608 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5079999999999994e-06 2024-09-12T18:35:56.608 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.608 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.608 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:56.608 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584894+0000", 2024-09-12T18:35:56.608 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5590000000000002e-06 2024-09-12T18:35:56.608 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:56.608 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:56.608 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:56.608 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.608 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.609 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:32265 5.0 5.78c42570 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T18:35:56.609 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:56.584906+0000", 2024-09-12T18:35:56.609 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00094465100000000002, 2024-09-12T18:35:56.609 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0012640500000000001, 2024-09-12T18:35:56.609 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:56.609 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:56.609 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-09-12T18:35:56.609 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:56.609 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:56.609 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:56.609 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 32265 2024-09-12T18:35:56.609 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.609 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:56.609 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.610 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:56.610 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584906+0000", 2024-09-12T18:35:56.610 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:56.610 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.610 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.610 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:56.610 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584906+0000", 2024-09-12T18:35:56.610 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:56.610 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.610 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.610 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:56.610 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584906+0000", 2024-09-12T18:35:56.610 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0800000000000004e-07 2024-09-12T18:35:56.610 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.611 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.611 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:56.611 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584986+0000", 2024-09-12T18:35:56.611 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0247999999999995e-05 2024-09-12T18:35:56.611 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.611 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.611 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:56.611 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584994+0000", 2024-09-12T18:35:56.611 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5009999999999998e-06 2024-09-12T18:35:56.611 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.611 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.611 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:56.611 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584999+0000", 2024-09-12T18:35:56.612 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.485e-06 2024-09-12T18:35:56.612 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:56.612 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:56.612 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:56.612 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.612 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.612 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:32261 5.a e29/21 5:57ab4849:::benchmark_data_smithi073_23739_object32260:head v 29'2021, mlcod=29'2019)", 2024-09-12T18:35:56.612 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:56.585013+0000", 2024-09-12T18:35:56.612 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00083706399999999999, 2024-09-12T18:35:56.612 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0012005060000000001, 2024-09-12T18:35:56.612 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:56.612 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:56.612 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:35:56.612 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:56.613 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.613 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:56.613 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.585013+0000", 2024-09-12T18:35:56.613 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:56.613 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.613 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.613 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:56.613 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.585013+0000", 2024-09-12T18:35:56.613 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:56.613 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.613 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.613 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:56.613 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.585017+0000", 2024-09-12T18:35:56.613 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3680000000000002e-06 2024-09-12T18:35:56.614 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.614 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.614 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:56.614 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.585117+0000", 2024-09-12T18:35:56.614 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9974000000000002e-05 2024-09-12T18:35:56.614 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.614 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.614 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:56.614 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.585133+0000", 2024-09-12T18:35:56.614 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6563999999999999e-05 2024-09-12T18:35:56.614 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.614 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.614 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:56.614 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.585152+0000", 2024-09-12T18:35:56.615 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8640000000000001e-05 2024-09-12T18:35:56.615 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.615 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.615 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:56.615 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.585214+0000", 2024-09-12T18:35:56.615 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2453999999999995e-05 2024-09-12T18:35:56.615 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.615 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.615 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:56.615 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.585228+0000", 2024-09-12T18:35:56.615 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3570999999999999e-05 2024-09-12T18:35:56.615 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:56.615 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:56.616 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:56.616 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.616 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.616 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:32267 5.e 5:74aac0e2:::benchmark_data_smithi073_23739_object32266:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T18:35:56.616 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:56.585081+0000", 2024-09-12T18:35:56.616 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00076976300000000002, 2024-09-12T18:35:56.616 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011857390000000001, 2024-09-12T18:35:56.616 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:56.616 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:56.616 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:56.616 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:56.616 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:56.616 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:56.617 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 32267 2024-09-12T18:35:56.617 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.617 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:56.617 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.617 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:56.617 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.585081+0000", 2024-09-12T18:35:56.617 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:56.617 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.617 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.617 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:56.617 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.585081+0000", 2024-09-12T18:35:56.617 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:56.617 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.617 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.618 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:56.618 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.585081+0000", 2024-09-12T18:35:56.618 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1200000000000002e-07 2024-09-12T18:35:56.618 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.618 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.618 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:56.618 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.585162+0000", 2024-09-12T18:35:56.618 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1260999999999993e-05 2024-09-12T18:35:56.618 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.618 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.618 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:56.618 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.585170+0000", 2024-09-12T18:35:56.618 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5050000000000001e-06 2024-09-12T18:35:56.618 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.619 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.619 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:56.619 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.585176+0000", 2024-09-12T18:35:56.619 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.3330000000000002e-06 2024-09-12T18:35:56.619 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.619 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.619 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:56.619 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.585235+0000", 2024-09-12T18:35:56.619 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8983000000000001e-05 2024-09-12T18:35:56.619 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.619 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.619 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:56.619 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.585347+0000", 2024-09-12T18:35:56.619 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000111962 2024-09-12T18:35:56.620 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.620 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.620 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:56.620 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.585471+0000", 2024-09-12T18:35:56.620 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012347000000000001 2024-09-12T18:35:56.620 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:56.620 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:56.620 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:56.620 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.620 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.620 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:32251 5.0 5:0dbe3059:::benchmark_data_smithi073_23739_object32250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T18:35:56.620 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:56.578071+0000", 2024-09-12T18:35:56.620 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.007778821, 2024-09-12T18:35:56.621 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0082566210000000004, 2024-09-12T18:35:56.621 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:35:56.621 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:35:56.621 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:56.621 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:35:56.621 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:35:56.621 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:56.621 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 32251 2024-09-12T18:35:56.621 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.621 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:35:56.621 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.621 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:35:56.621 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.578071+0000", 2024-09-12T18:35:56.621 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:56.622 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.622 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.622 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:35:56.622 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.578071+0000", 2024-09-12T18:35:56.622 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:35:56.622 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.622 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.622 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:35:56.622 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.578072+0000", 2024-09-12T18:35:56.622 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5999999999999991e-07 2024-09-12T18:35:56.622 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.622 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.622 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:35:56.622 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.578158+0000", 2024-09-12T18:35:56.623 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5461000000000001e-05 2024-09-12T18:35:56.623 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.623 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.623 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:35:56.623 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.578169+0000", 2024-09-12T18:35:56.623 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0834e-05 2024-09-12T18:35:56.623 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.623 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.623 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:35:56.623 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.578176+0000", 2024-09-12T18:35:56.623 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5009999999999998e-06 2024-09-12T18:35:56.623 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.623 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.623 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:35:56.624 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.578642+0000", 2024-09-12T18:35:56.624 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00046565000000000002 2024-09-12T18:35:56.624 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.624 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.624 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:35:56.624 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.578791+0000", 2024-09-12T18:35:56.624 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014959700000000001 2024-09-12T18:35:56.624 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.624 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.624 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:56.624 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.578895+0000", 2024-09-12T18:35:56.624 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000103693 2024-09-12T18:35:56.624 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:35:56.625 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:35:56.625 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:35:56.625 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:56.584258+0000", 2024-09-12T18:35:56.625 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0053629810000000002 2024-09-12T18:35:56.625 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:56.625 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:35:56.625 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:56.625 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:35:56.625 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-09-12T18:35:56.625 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 9 2024-09-12T18:35:56.625 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:35:56.626 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:35:56.629 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:56.625+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:56.730 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:56.725+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:56.740 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:35:56.741 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:35:56.758 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:35:56.758 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:35:56.778 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:56.778 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:56.779 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:35:56.779 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:35:56.800 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:35:56.830 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:56.829+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:56.869 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 11 16 32995 32979 187.36 161.75 0.00710811 0.00533228 2024-09-12T18:35:56.931 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:56.930+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:56.953 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:56.954 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:56.974 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:35:57.032 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:57.030+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:57.128 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:57.129 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:57.133 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:57.130+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:57.149 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:35:57.234 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:57.229+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:57.299 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:57.299 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:57.319 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:35:57.364 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:57.362+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:57.387 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T18:35:57.436 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:57.434+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:57.475 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:57.475 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:57.497 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:35:57.544 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:57.541+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:57.638 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:57.637+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:57.648 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:57.648 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:57.662 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:35:57.750 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:57.749+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:57.839 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:57.834+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:57.865 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:57.865 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:57.869 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 12 16 35314 35298 183.824 144.938 0.0092801 0.00543472 2024-09-12T18:35:57.886 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:35:57.940 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:57.937+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:58.041 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:58.037+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:58.093 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:58.093 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:58.119 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:35:58.163 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:58.161+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:58.243 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:58.241+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:58.272 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:58.273 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:58.293 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:35:58.344 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:58.338+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:58.377 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is set 2024-09-12T18:35:58.445 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:58.442+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:58.489 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:58.490 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:58.508 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:35:58.546 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:58.542+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:58.647 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:58.642+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:58.664 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:58.664 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:58.687 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:35:58.748 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:58.742+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:58.799 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:35:58.844 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:35:58.844 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:35:58.848 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:58.846+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:58.867 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:35:58.869 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 13 16 37856 37840 181.903 158.875 0.00478427 0.00549245 2024-09-12T18:35:58.950 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:58.945+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:58.957 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:35:58.957 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:35:58.975 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:35:58.975 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:35:58.994 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:35:58.995 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:35:59.050 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:59.046+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:59.066 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:35:59.067 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [], 2024-09-12T18:35:59.067 INFO:teuthology.orchestra.run.smithi162.stdout: "complaint_time": 30, 2024-09-12T18:35:59.067 INFO:teuthology.orchestra.run.smithi162.stdout: "num_blocked_ops": 0 2024-09-12T18:35:59.067 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:35:59.087 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:35:59.152 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:35:59.149+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:35:59.253 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:59.250+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:59.280 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:35:59.280 INFO:teuthology.orchestra.run.smithi162.stdout: "size": 20, 2024-09-12T18:35:59.280 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 600, 2024-09-12T18:35:59.281 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:35:59.281 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.281 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4154.0:123 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:35:59.281 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:35:59.281 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 45.302472794000003, 2024-09-12T18:35:59.281 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.022398096999999999, 2024-09-12T18:35:59.281 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:59.281 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:59.281 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:59.281 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:35:59.281 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4154", 2024-09-12T18:35:59.281 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/745129001", 2024-09-12T18:35:59.282 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 123 2024-09-12T18:35:59.282 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.282 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:59.282 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.282 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:59.282 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:35:59.282 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:59.282 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.282 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.282 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:59.282 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:35:59.282 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:59.282 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.283 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.283 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:59.283 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:35:59.283 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.8299999999999996e-07 2024-09-12T18:35:59.283 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.283 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.283 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:59.283 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976528+0000", 2024-09-12T18:35:59.283 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011393299999999999 2024-09-12T18:35:59.283 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.283 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.283 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:59.283 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976539+0000", 2024-09-12T18:35:59.283 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0763e-05 2024-09-12T18:35:59.284 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.284 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.284 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:59.284 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976547+0000", 2024-09-12T18:35:59.284 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8199999999999997e-06 2024-09-12T18:35:59.284 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.284 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.285 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:59.285 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.995057+0000", 2024-09-12T18:35:59.285 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.018510047000000002 2024-09-12T18:35:59.285 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.285 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.285 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:59.285 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.995301+0000", 2024-09-12T18:35:59.285 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00024375899999999999 2024-09-12T18:35:59.285 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.285 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.285 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:59.286 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.995642+0000", 2024-09-12T18:35:59.286 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00034121100000000001 2024-09-12T18:35:59.286 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.286 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.286 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:59.286 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998179+0000", 2024-09-12T18:35:59.286 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00253761 2024-09-12T18:35:59.286 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.286 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.286 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:59.286 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998665+0000", 2024-09-12T18:35:59.286 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00048574600000000001 2024-09-12T18:35:59.286 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.287 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.287 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:59.287 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998739+0000", 2024-09-12T18:35:59.287 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.4286e-05 2024-09-12T18:35:59.287 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.287 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.287 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:59.287 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998812+0000", 2024-09-12T18:35:59.287 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2238999999999997e-05 2024-09-12T18:35:59.287 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:59.287 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:59.287 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:59.287 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.288 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.288 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4154.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:35:59.288 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:35:59.288 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 45.302325562, 2024-09-12T18:35:59.288 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025950709999999998, 2024-09-12T18:35:59.288 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:59.288 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:59.288 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:59.288 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:35:59.288 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4154", 2024-09-12T18:35:59.288 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/745129001", 2024-09-12T18:35:59.288 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 124 2024-09-12T18:35:59.288 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.289 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:59.289 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.289 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:59.289 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:35:59.289 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:59.289 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.289 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.289 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:59.289 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:35:59.289 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:59.289 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.289 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.289 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:59.289 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976562+0000", 2024-09-12T18:35:59.290 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.2999999999999999e-07 2024-09-12T18:35:59.290 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.290 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.290 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:59.290 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976567+0000", 2024-09-12T18:35:59.290 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3430000000000003e-06 2024-09-12T18:35:59.290 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.290 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.290 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:59.290 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976576+0000", 2024-09-12T18:35:59.290 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8070000000000006e-06 2024-09-12T18:35:59.290 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.290 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.291 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:59.291 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976583+0000", 2024-09-12T18:35:59.291 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9959999999999996e-06 2024-09-12T18:35:59.291 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.291 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.291 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:59.291 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997107+0000", 2024-09-12T18:35:59.291 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.020524106 2024-09-12T18:35:59.291 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.292 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.292 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:59.292 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997225+0000", 2024-09-12T18:35:59.292 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000117909 2024-09-12T18:35:59.292 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.292 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.292 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:59.292 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997407+0000", 2024-09-12T18:35:59.292 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00018175900000000001 2024-09-12T18:35:59.293 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.293 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.293 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:59.293 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998839+0000", 2024-09-12T18:35:59.293 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001432539 2024-09-12T18:35:59.293 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.293 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.293 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:59.293 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002319+0000", 2024-09-12T18:35:59.293 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0034803529999999998 2024-09-12T18:35:59.293 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.293 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.293 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:59.293 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002405+0000", 2024-09-12T18:35:59.294 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5434999999999998e-05 2024-09-12T18:35:59.294 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.294 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.294 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:59.294 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002512+0000", 2024-09-12T18:35:59.294 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010663299999999999 2024-09-12T18:35:59.294 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:59.294 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:59.294 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:59.294 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.294 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.294 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:59.294 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:35:59.295 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 33.637528054999997, 2024-09-12T18:35:59.295 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025127867000000002, 2024-09-12T18:35:59.295 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:59.295 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:59.295 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:59.295 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:59.295 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.295 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:59.295 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:35:59.295 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:59.295 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.295 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.295 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:59.295 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:35:59.296 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:59.296 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.296 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.296 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:59.296 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641362+0000", 2024-09-12T18:35:59.296 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.2569999999999999e-06 2024-09-12T18:35:59.296 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.296 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.297 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:59.297 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641374+0000", 2024-09-12T18:35:59.297 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2696e-05 2024-09-12T18:35:59.297 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.297 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.297 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:59.297 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641403+0000", 2024-09-12T18:35:59.297 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.8756999999999999e-05 2024-09-12T18:35:59.297 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.297 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.298 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:59.298 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641430+0000", 2024-09-12T18:35:59.298 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.6452999999999999e-05 2024-09-12T18:35:59.298 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.298 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.298 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:59.298 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641585+0000", 2024-09-12T18:35:59.298 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000155799 2024-09-12T18:35:59.298 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.298 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.298 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:59.298 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641753+0000", 2024-09-12T18:35:59.298 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000167868 2024-09-12T18:35:59.300 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.300 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.300 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:59.300 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641916+0000", 2024-09-12T18:35:59.300 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000162903 2024-09-12T18:35:59.300 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.300 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.300 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:59.300 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653655+0000", 2024-09-12T18:35:59.300 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011738879000000001 2024-09-12T18:35:59.300 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.301 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.301 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:59.301 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665515+0000", 2024-09-12T18:35:59.301 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011859915 2024-09-12T18:35:59.301 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.301 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.301 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:59.301 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665646+0000", 2024-09-12T18:35:59.301 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013122599999999999 2024-09-12T18:35:59.301 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.301 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.301 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:59.301 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666486+0000", 2024-09-12T18:35:59.302 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00084011399999999999 2024-09-12T18:35:59.302 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:59.302 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:59.302 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:59.302 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.302 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.302 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:59.302 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:35:59.302 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 33.637413592000001, 2024-09-12T18:35:59.302 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025384584000000002, 2024-09-12T18:35:59.302 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:59.302 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:59.302 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:59.303 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:59.303 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.303 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:59.303 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:35:59.303 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:59.303 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.303 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.303 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:59.303 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:35:59.303 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:59.303 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.303 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.303 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:59.304 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641474+0000", 2024-09-12T18:35:59.304 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.39e-06 2024-09-12T18:35:59.304 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.304 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.304 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:59.304 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641482+0000", 2024-09-12T18:35:59.304 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3499999999999999e-06 2024-09-12T18:35:59.304 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.304 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.304 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:59.304 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641534+0000", 2024-09-12T18:35:59.304 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2533e-05 2024-09-12T18:35:59.304 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.305 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.305 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:59.305 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641551+0000", 2024-09-12T18:35:59.305 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6515999999999999e-05 2024-09-12T18:35:59.305 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.305 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.305 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:59.305 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642630+0000", 2024-09-12T18:35:59.305 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001079705 2024-09-12T18:35:59.305 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.305 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.305 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:59.305 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642909+0000", 2024-09-12T18:35:59.306 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027859800000000002 2024-09-12T18:35:59.306 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.306 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.306 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:59.306 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643137+0000", 2024-09-12T18:35:59.306 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022803799999999999 2024-09-12T18:35:59.306 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.306 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.306 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:59.306 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653669+0000", 2024-09-12T18:35:59.306 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010532032 2024-09-12T18:35:59.306 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.306 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.307 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:59.307 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666624+0000", 2024-09-12T18:35:59.307 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012954940999999999 2024-09-12T18:35:59.307 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.307 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.307 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:59.307 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666762+0000", 2024-09-12T18:35:59.307 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000137668 2024-09-12T18:35:59.307 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.307 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.307 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:59.307 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666857+0000", 2024-09-12T18:35:59.307 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.5812999999999999e-05 2024-09-12T18:35:59.308 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:59.308 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:59.308 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:59.308 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.308 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.308 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:59.308 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:35:59.308 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 33.637285796999997, 2024-09-12T18:35:59.308 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025661562999999998, 2024-09-12T18:35:59.308 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:59.308 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:59.308 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:59.308 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:59.309 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.309 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:59.309 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:35:59.309 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:59.309 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.309 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.309 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:59.309 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:35:59.309 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:59.309 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.309 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.309 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:59.309 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641602+0000", 2024-09-12T18:35:59.309 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3540000000000001e-06 2024-09-12T18:35:59.310 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.310 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.310 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:59.310 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641637+0000", 2024-09-12T18:35:59.310 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5145999999999999e-05 2024-09-12T18:35:59.310 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.310 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.310 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:59.310 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641659+0000", 2024-09-12T18:35:59.310 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2249999999999999e-05 2024-09-12T18:35:59.310 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.310 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.310 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:59.310 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641675+0000", 2024-09-12T18:35:59.311 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6059999999999999e-05 2024-09-12T18:35:59.311 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.311 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.311 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:59.311 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644570+0000", 2024-09-12T18:35:59.311 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028947069999999998 2024-09-12T18:35:59.311 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.311 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.311 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:59.311 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644900+0000", 2024-09-12T18:35:59.311 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000329401 2024-09-12T18:35:59.311 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.311 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.312 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:59.312 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645235+0000", 2024-09-12T18:35:59.312 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000335874 2024-09-12T18:35:59.312 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.312 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.312 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:59.312 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655459+0000", 2024-09-12T18:35:59.312 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010223441999999999 2024-09-12T18:35:59.312 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.312 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.312 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:59.312 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667028+0000", 2024-09-12T18:35:59.312 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011568673999999999 2024-09-12T18:35:59.313 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.313 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.313 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:59.313 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667163+0000", 2024-09-12T18:35:59.313 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013525500000000001 2024-09-12T18:35:59.313 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.313 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.313 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:59.313 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667262+0000", 2024-09-12T18:35:59.313 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9400000000000004e-05 2024-09-12T18:35:59.313 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:59.313 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:59.313 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:59.313 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.314 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.314 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:59.314 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:35:59.314 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 33.637183976999999, 2024-09-12T18:35:59.314 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025971339, 2024-09-12T18:35:59.314 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:59.314 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:59.314 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:59.314 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:59.314 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.314 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:59.314 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:35:59.314 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:59.315 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.315 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.315 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:59.315 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:35:59.315 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:59.315 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.315 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.315 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:59.315 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641704+0000", 2024-09-12T18:35:59.315 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.297e-06 2024-09-12T18:35:59.315 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.315 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.315 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:59.315 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641712+0000", 2024-09-12T18:35:59.316 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.9060000000000002e-06 2024-09-12T18:35:59.316 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.316 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.316 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:59.316 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641731+0000", 2024-09-12T18:35:59.316 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9083e-05 2024-09-12T18:35:59.316 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.316 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.316 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:59.316 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641745+0000", 2024-09-12T18:35:59.316 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4066999999999999e-05 2024-09-12T18:35:59.316 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.316 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.316 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:59.317 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646529+0000", 2024-09-12T18:35:59.317 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.004784033 2024-09-12T18:35:59.317 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.317 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.317 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:59.317 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646727+0000", 2024-09-12T18:35:59.317 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019841800000000001 2024-09-12T18:35:59.317 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.317 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.317 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:59.317 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647057+0000", 2024-09-12T18:35:59.317 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032926800000000002 2024-09-12T18:35:59.317 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.318 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.318 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:59.318 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655475+0000", 2024-09-12T18:35:59.318 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0084186250000000008 2024-09-12T18:35:59.318 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.318 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.318 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:59.318 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667424+0000", 2024-09-12T18:35:59.318 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011949257 2024-09-12T18:35:59.318 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.318 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.318 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:59.318 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667573+0000", 2024-09-12T18:35:59.319 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014851900000000001 2024-09-12T18:35:59.319 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.319 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.319 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:59.319 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667674+0000", 2024-09-12T18:35:59.319 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010086600000000001 2024-09-12T18:35:59.319 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:59.319 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:59.319 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:59.319 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.319 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.319 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:59.319 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:35:59.320 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 33.637121587999999, 2024-09-12T18:35:59.320 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026215008000000001, 2024-09-12T18:35:59.320 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:59.320 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:59.320 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:59.320 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:59.320 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.320 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:59.320 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:35:59.320 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:59.320 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.320 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.320 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:59.321 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:35:59.321 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:59.321 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.321 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.321 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:59.321 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641766+0000", 2024-09-12T18:35:59.321 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1200000000000001e-06 2024-09-12T18:35:59.321 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.321 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.321 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:59.321 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641775+0000", 2024-09-12T18:35:59.321 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.2499999999999995e-06 2024-09-12T18:35:59.321 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.321 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.322 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:59.322 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641793+0000", 2024-09-12T18:35:59.322 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7773000000000001e-05 2024-09-12T18:35:59.322 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.322 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.322 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:59.322 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641807+0000", 2024-09-12T18:35:59.322 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3814e-05 2024-09-12T18:35:59.322 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.322 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.322 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:59.322 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647626+0000", 2024-09-12T18:35:59.322 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0058193050000000003 2024-09-12T18:35:59.323 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.323 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.323 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:59.323 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647937+0000", 2024-09-12T18:35:59.323 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031112400000000003 2024-09-12T18:35:59.323 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.323 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.323 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:59.323 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648239+0000", 2024-09-12T18:35:59.323 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00030227500000000002 2024-09-12T18:35:59.323 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.323 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.323 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:59.323 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655487+0000", 2024-09-12T18:35:59.324 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072479129999999999 2024-09-12T18:35:59.324 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.324 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.324 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:59.324 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667823+0000", 2024-09-12T18:35:59.324 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012335505 2024-09-12T18:35:59.324 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.324 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.324 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:59.324 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667908+0000", 2024-09-12T18:35:59.324 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4843000000000001e-05 2024-09-12T18:35:59.324 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.325 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.325 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:59.325 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667980+0000", 2024-09-12T18:35:59.325 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2086000000000001e-05 2024-09-12T18:35:59.325 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:59.325 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:59.325 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:59.325 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.325 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.325 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:59.325 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:35:59.325 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 33.637061435, 2024-09-12T18:35:59.325 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026483236, 2024-09-12T18:35:59.325 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:59.326 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:59.326 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:59.326 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:59.326 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.326 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:59.326 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:35:59.326 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:59.326 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.326 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.326 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:59.326 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:35:59.326 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:59.326 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.327 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.327 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:59.327 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641826+0000", 2024-09-12T18:35:59.327 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:35:59.327 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.327 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.327 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:59.327 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641832+0000", 2024-09-12T18:35:59.327 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4199999999999998e-06 2024-09-12T18:35:59.327 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.327 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.327 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:59.327 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641848+0000", 2024-09-12T18:35:59.328 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6492999999999999e-05 2024-09-12T18:35:59.328 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.328 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.328 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:59.328 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641863+0000", 2024-09-12T18:35:59.328 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5427e-05 2024-09-12T18:35:59.328 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.328 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.328 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:59.328 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648887+0000", 2024-09-12T18:35:59.328 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0070230860000000004 2024-09-12T18:35:59.328 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.328 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.328 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:59.329 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649111+0000", 2024-09-12T18:35:59.329 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022425799999999999 2024-09-12T18:35:59.329 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.329 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.329 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:59.329 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649494+0000", 2024-09-12T18:35:59.329 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00038349400000000001 2024-09-12T18:35:59.329 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.329 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.329 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:59.329 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655499+0000", 2024-09-12T18:35:59.329 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0060047260000000002 2024-09-12T18:35:59.329 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.330 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.330 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:59.330 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668110+0000", 2024-09-12T18:35:59.330 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012610543 2024-09-12T18:35:59.330 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.330 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.330 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:59.330 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668252+0000", 2024-09-12T18:35:59.330 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014265600000000001 2024-09-12T18:35:59.330 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.330 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.330 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:59.330 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668308+0000", 2024-09-12T18:35:59.330 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5992999999999997e-05 2024-09-12T18:35:59.331 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:59.331 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:59.331 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:59.331 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.331 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.331 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:59.331 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:35:59.331 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 33.637006219, 2024-09-12T18:35:59.331 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026605302000000001, 2024-09-12T18:35:59.331 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:59.331 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:59.331 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:59.331 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:59.332 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.332 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:59.332 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:35:59.332 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:59.332 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.332 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.332 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:59.332 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:35:59.332 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:59.332 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.332 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.332 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:59.332 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641881+0000", 2024-09-12T18:35:59.333 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.057e-06 2024-09-12T18:35:59.333 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.333 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.333 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:59.333 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641887+0000", 2024-09-12T18:35:59.333 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.6629999999999998e-06 2024-09-12T18:35:59.333 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.333 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.333 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:59.333 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641903+0000", 2024-09-12T18:35:59.333 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6317e-05 2024-09-12T18:35:59.333 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.333 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.334 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:59.334 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641917+0000", 2024-09-12T18:35:59.334 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3339999999999999e-05 2024-09-12T18:35:59.334 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.334 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.334 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:59.334 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650708+0000", 2024-09-12T18:35:59.334 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.008791419 2024-09-12T18:35:59.334 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.334 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.334 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:59.334 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651021+0000", 2024-09-12T18:35:59.334 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031296699999999999 2024-09-12T18:35:59.335 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.335 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.335 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:59.335 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651349+0000", 2024-09-12T18:35:59.335 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032796499999999999 2024-09-12T18:35:59.335 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.335 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.335 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:59.335 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655742+0000", 2024-09-12T18:35:59.335 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0043934680000000002 2024-09-12T18:35:59.335 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.335 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.335 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:59.335 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668377+0000", 2024-09-12T18:35:59.336 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012634312999999999 2024-09-12T18:35:59.336 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.336 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.336 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:59.336 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668441+0000", 2024-09-12T18:35:59.336 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4369999999999995e-05 2024-09-12T18:35:59.336 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.336 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.336 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:59.336 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668485+0000", 2024-09-12T18:35:59.336 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4422999999999998e-05 2024-09-12T18:35:59.336 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:59.336 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:59.337 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:59.337 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.337 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.337 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:59.337 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:35:59.337 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 33.636948816, 2024-09-12T18:35:59.337 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026919499, 2024-09-12T18:35:59.337 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:59.337 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:59.337 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:59.337 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:59.337 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.337 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:59.338 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:35:59.338 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:59.338 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.338 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.338 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:59.338 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:35:59.338 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:59.338 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.338 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.338 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:59.338 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641939+0000", 2024-09-12T18:35:59.338 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9399999999999993e-07 2024-09-12T18:35:59.338 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.339 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.339 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:59.339 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641945+0000", 2024-09-12T18:35:59.339 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9200000000000001e-06 2024-09-12T18:35:59.339 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.339 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.339 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:59.339 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641961+0000", 2024-09-12T18:35:59.339 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6520000000000001e-05 2024-09-12T18:35:59.339 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.339 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.339 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:59.339 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641974+0000", 2024-09-12T18:35:59.340 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3413e-05 2024-09-12T18:35:59.340 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.340 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.340 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:59.340 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654560+0000", 2024-09-12T18:35:59.340 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012585308999999999 2024-09-12T18:35:59.340 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.340 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.340 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:59.340 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654822+0000", 2024-09-12T18:35:59.340 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026210099999999999 2024-09-12T18:35:59.340 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.340 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.341 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:59.341 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655059+0000", 2024-09-12T18:35:59.341 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00023747899999999999 2024-09-12T18:35:59.341 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.341 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.341 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:59.341 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.656315+0000", 2024-09-12T18:35:59.341 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0012555000000000001 2024-09-12T18:35:59.341 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.341 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.341 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:59.341 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668590+0000", 2024-09-12T18:35:59.342 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012274851999999999 2024-09-12T18:35:59.342 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.342 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.342 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:59.342 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668725+0000", 2024-09-12T18:35:59.342 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013524199999999999 2024-09-12T18:35:59.342 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.342 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.342 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:59.342 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668857+0000", 2024-09-12T18:35:59.342 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013216899999999999 2024-09-12T18:35:59.342 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:59.342 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:59.343 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:59.343 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.343 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.343 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:59.343 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:35:59.343 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 33.636895295999999, 2024-09-12T18:35:59.343 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023616723999999999, 2024-09-12T18:35:59.343 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:59.343 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:59.343 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:59.343 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:59.343 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.344 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:59.344 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:35:59.344 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:59.344 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.344 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.344 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:59.344 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:35:59.344 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:59.344 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.344 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.344 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:59.344 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641992+0000", 2024-09-12T18:35:59.345 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.08e-06 2024-09-12T18:35:59.345 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.345 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.345 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:59.345 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641998+0000", 2024-09-12T18:35:59.345 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4299999999999997e-06 2024-09-12T18:35:59.345 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.345 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.345 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:59.345 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642014+0000", 2024-09-12T18:35:59.345 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6266e-05 2024-09-12T18:35:59.345 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.345 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.346 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:59.346 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642026+0000", 2024-09-12T18:35:59.346 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2567e-05 2024-09-12T18:35:59.346 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.346 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.346 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:59.346 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642213+0000", 2024-09-12T18:35:59.346 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00018701899999999999 2024-09-12T18:35:59.346 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.346 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.346 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:59.346 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642507+0000", 2024-09-12T18:35:59.346 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00029394700000000002 2024-09-12T18:35:59.347 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.347 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.347 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:59.347 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642686+0000", 2024-09-12T18:35:59.347 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000178152 2024-09-12T18:35:59.347 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.347 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.347 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:59.347 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650952+0000", 2024-09-12T18:35:59.347 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0082663570000000002 2024-09-12T18:35:59.347 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.347 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.347 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:59.348 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665382+0000", 2024-09-12T18:35:59.348 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.014430111000000001 2024-09-12T18:35:59.348 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.348 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.348 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:59.348 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665508+0000", 2024-09-12T18:35:59.348 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000125986 2024-09-12T18:35:59.348 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.348 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.348 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:59.348 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665608+0000", 2024-09-12T18:35:59.348 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9809000000000006e-05 2024-09-12T18:35:59.348 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:59.349 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:59.349 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:59.349 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.349 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.349 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:59.349 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:35:59.349 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 33.636767431000003, 2024-09-12T18:35:59.349 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024670563, 2024-09-12T18:35:59.349 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:59.349 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:59.349 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:59.349 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:59.349 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.350 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:59.350 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:35:59.350 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:59.350 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.350 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.350 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:59.350 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:35:59.350 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:59.350 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.350 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.350 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:59.350 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642120+0000", 2024-09-12T18:35:59.350 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1769999999999999e-06 2024-09-12T18:35:59.351 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.351 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.351 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:59.351 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642128+0000", 2024-09-12T18:35:59.351 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3429999999999998e-06 2024-09-12T18:35:59.351 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.351 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.351 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:59.351 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642192+0000", 2024-09-12T18:35:59.351 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4406999999999995e-05 2024-09-12T18:35:59.351 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.351 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.351 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:59.352 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642223+0000", 2024-09-12T18:35:59.352 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.1266000000000002e-05 2024-09-12T18:35:59.352 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.352 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.352 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:59.352 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643201+0000", 2024-09-12T18:35:59.352 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0009778390000000001 2024-09-12T18:35:59.352 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.352 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.352 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:59.352 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643410+0000", 2024-09-12T18:35:59.352 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020874199999999999 2024-09-12T18:35:59.352 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.353 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.353 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:59.353 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643685+0000", 2024-09-12T18:35:59.353 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027520700000000002 2024-09-12T18:35:59.353 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.353 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.353 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:59.353 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650966+0000", 2024-09-12T18:35:59.353 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072810710000000001 2024-09-12T18:35:59.353 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.354 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.354 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:59.354 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666560+0000", 2024-09-12T18:35:59.354 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015594143 2024-09-12T18:35:59.354 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.354 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.354 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:59.354 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666691+0000", 2024-09-12T18:35:59.354 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000130359 2024-09-12T18:35:59.354 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.354 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.354 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:59.354 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666790+0000", 2024-09-12T18:35:59.355 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9009e-05 2024-09-12T18:35:59.355 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:59.355 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:59.355 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:59.355 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.355 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.355 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:59.355 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:35:59.355 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 33.635989143000003, 2024-09-12T18:35:59.355 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024891744, 2024-09-12T18:35:59.355 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:59.355 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:59.355 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:59.355 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:59.356 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.356 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:59.356 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:35:59.356 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:59.356 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.356 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.356 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:59.356 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:35:59.356 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:59.356 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.356 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.356 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:59.357 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642899+0000", 2024-09-12T18:35:59.357 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4729999999999999e-06 2024-09-12T18:35:59.357 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.357 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.357 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:59.357 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642912+0000", 2024-09-12T18:35:59.357 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3495999999999999e-05 2024-09-12T18:35:59.357 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.357 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.357 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:59.357 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642934+0000", 2024-09-12T18:35:59.357 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2033999999999999e-05 2024-09-12T18:35:59.357 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.358 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.358 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:59.358 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642949+0000", 2024-09-12T18:35:59.358 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4970000000000001e-05 2024-09-12T18:35:59.358 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.358 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.358 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:59.358 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644400+0000", 2024-09-12T18:35:59.358 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001450305 2024-09-12T18:35:59.358 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.358 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.358 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:59.358 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644617+0000", 2024-09-12T18:35:59.359 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000217302 2024-09-12T18:35:59.359 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.359 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.359 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:59.359 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645052+0000", 2024-09-12T18:35:59.359 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000434797 2024-09-12T18:35:59.359 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.359 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.359 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:59.359 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653860+0000", 2024-09-12T18:35:59.360 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0088082249999999994 2024-09-12T18:35:59.360 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.360 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.360 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:59.360 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667598+0000", 2024-09-12T18:35:59.360 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.013738451 2024-09-12T18:35:59.360 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.360 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.360 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:59.360 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667698+0000", 2024-09-12T18:35:59.360 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9854999999999999e-05 2024-09-12T18:35:59.360 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.360 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.361 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:59.361 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667789+0000", 2024-09-12T18:35:59.361 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0835999999999996e-05 2024-09-12T18:35:59.361 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:59.361 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:59.361 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:59.361 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.361 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.361 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:30 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:59.361 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:35:59.361 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 33.635914327000002, 2024-09-12T18:35:59.361 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023936852000000002, 2024-09-12T18:35:59.361 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:59.361 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:59.362 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:59.362 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:59.362 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.362 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:59.362 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:35:59.362 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:59.362 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.362 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.362 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:59.362 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:35:59.362 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:59.362 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.362 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.363 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:59.363 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642973+0000", 2024-09-12T18:35:59.363 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.11e-06 2024-09-12T18:35:59.363 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.363 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.363 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:59.363 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642994+0000", 2024-09-12T18:35:59.363 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.0699999999999998e-05 2024-09-12T18:35:59.363 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.363 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.363 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:59.363 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643011+0000", 2024-09-12T18:35:59.363 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7229999999999999e-05 2024-09-12T18:35:59.363 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.364 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.364 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:59.364 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643025+0000", 2024-09-12T18:35:59.364 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3803e-05 2024-09-12T18:35:59.364 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.364 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.364 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:59.364 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643143+0000", 2024-09-12T18:35:59.364 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000118225 2024-09-12T18:35:59.364 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.364 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.364 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:59.364 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643426+0000", 2024-09-12T18:35:59.365 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00028250500000000001 2024-09-12T18:35:59.365 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.365 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.365 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:59.365 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643864+0000", 2024-09-12T18:35:59.365 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00043856 2024-09-12T18:35:59.365 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.365 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.365 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:59.365 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651148+0000", 2024-09-12T18:35:59.365 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072836769999999997 2024-09-12T18:35:59.365 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.365 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.366 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:59.366 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666674+0000", 2024-09-12T18:35:59.366 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015525786999999999 2024-09-12T18:35:59.366 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.366 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.366 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:59.366 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666796+0000", 2024-09-12T18:35:59.366 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000122416 2024-09-12T18:35:59.366 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.366 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.366 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:59.366 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666909+0000", 2024-09-12T18:35:59.366 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011283899999999999 2024-09-12T18:35:59.367 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:59.367 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:59.367 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:59.367 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.367 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.367 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:59.367 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:35:59.367 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 33.635831621000001, 2024-09-12T18:35:59.367 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024100234000000002, 2024-09-12T18:35:59.367 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:59.367 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:59.367 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:59.367 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:59.367 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.368 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:59.368 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:35:59.368 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:59.368 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.368 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.368 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:59.368 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:35:59.368 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:59.368 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.368 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.368 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:59.368 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643056+0000", 2024-09-12T18:35:59.368 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.046e-06 2024-09-12T18:35:59.369 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.369 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.369 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:59.369 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643068+0000", 2024-09-12T18:35:59.369 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2106999999999999e-05 2024-09-12T18:35:59.369 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.369 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.369 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:59.369 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643085+0000", 2024-09-12T18:35:59.369 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7479999999999999e-05 2024-09-12T18:35:59.369 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.369 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.369 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:59.370 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643099+0000", 2024-09-12T18:35:59.370 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3730000000000001e-05 2024-09-12T18:35:59.370 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.370 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.370 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:59.370 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644623+0000", 2024-09-12T18:35:59.370 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0015236080000000001 2024-09-12T18:35:59.370 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.370 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.370 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:59.370 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644893+0000", 2024-09-12T18:35:59.370 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026990500000000003 2024-09-12T18:35:59.370 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.371 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.371 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:59.371 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645227+0000", 2024-09-12T18:35:59.371 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00033391300000000003 2024-09-12T18:35:59.371 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.371 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.371 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:59.371 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653926+0000", 2024-09-12T18:35:59.371 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0086993339999999995 2024-09-12T18:35:59.371 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.371 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.371 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:59.371 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666925+0000", 2024-09-12T18:35:59.371 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012998686000000001 2024-09-12T18:35:59.372 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.372 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.372 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:59.372 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667057+0000", 2024-09-12T18:35:59.372 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013255600000000001 2024-09-12T18:35:59.372 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.372 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.372 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:59.372 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667155+0000", 2024-09-12T18:35:59.372 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7868999999999994e-05 2024-09-12T18:35:59.372 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:59.372 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:59.372 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:59.373 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.373 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.373 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:59.373 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643139+0000", 2024-09-12T18:35:59.373 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 33.635747035000001, 2024-09-12T18:35:59.373 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.022417057000000001, 2024-09-12T18:35:59.373 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:59.373 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:59.373 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:59.373 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:59.373 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.373 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:59.373 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643139+0000", 2024-09-12T18:35:59.374 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:59.374 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.374 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.374 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:59.374 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643139+0000", 2024-09-12T18:35:59.374 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:59.374 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.374 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.374 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:59.374 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643140+0000", 2024-09-12T18:35:59.374 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0729999999999999e-06 2024-09-12T18:35:59.374 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.374 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.375 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:59.375 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643151+0000", 2024-09-12T18:35:59.375 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.039e-05 2024-09-12T18:35:59.375 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.375 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.375 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:59.375 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643168+0000", 2024-09-12T18:35:59.375 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7575999999999999e-05 2024-09-12T18:35:59.375 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.375 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.375 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:59.375 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643182+0000", 2024-09-12T18:35:59.375 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3224000000000001e-05 2024-09-12T18:35:59.375 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.376 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.376 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:59.376 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643358+0000", 2024-09-12T18:35:59.376 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00017676500000000001 2024-09-12T18:35:59.376 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.376 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.376 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:59.376 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643647+0000", 2024-09-12T18:35:59.376 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00028850499999999999 2024-09-12T18:35:59.376 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.376 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.376 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:59.376 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643924+0000", 2024-09-12T18:35:59.377 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000277547 2024-09-12T18:35:59.377 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.377 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.377 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:59.377 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650289+0000", 2024-09-12T18:35:59.377 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0063645350000000002 2024-09-12T18:35:59.377 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.377 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.377 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:59.377 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665333+0000", 2024-09-12T18:35:59.377 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015043531000000001 2024-09-12T18:35:59.377 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.377 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.378 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:59.378 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665454+0000", 2024-09-12T18:35:59.378 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000121302 2024-09-12T18:35:59.378 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.378 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.378 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:59.378 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665556+0000", 2024-09-12T18:35:59.378 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010260900000000001 2024-09-12T18:35:59.378 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:59.378 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:59.378 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:59.378 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.378 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.378 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:59.379 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:35:59.379 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 33.635635831999998, 2024-09-12T18:35:59.379 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024255982999999998, 2024-09-12T18:35:59.379 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:59.379 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:59.379 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:59.379 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:59.379 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.379 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:59.379 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:35:59.379 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:59.379 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.379 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.380 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:59.380 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:35:59.380 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:59.380 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.380 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.380 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:59.380 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643252+0000", 2024-09-12T18:35:59.380 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:35:59.380 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.380 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.380 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:59.380 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643287+0000", 2024-09-12T18:35:59.380 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5225999999999998e-05 2024-09-12T18:35:59.381 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.381 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.381 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:59.381 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643323+0000", 2024-09-12T18:35:59.381 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5488999999999999e-05 2024-09-12T18:35:59.381 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.381 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.381 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:59.381 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643357+0000", 2024-09-12T18:35:59.381 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.3853999999999998e-05 2024-09-12T18:35:59.381 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.381 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.382 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:59.382 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646716+0000", 2024-09-12T18:35:59.382 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003359 2024-09-12T18:35:59.382 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.382 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.382 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:59.382 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647037+0000", 2024-09-12T18:35:59.382 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032131800000000002 2024-09-12T18:35:59.382 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.382 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.382 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:59.382 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647337+0000", 2024-09-12T18:35:59.382 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000300208 2024-09-12T18:35:59.382 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.383 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.383 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:59.383 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654291+0000", 2024-09-12T18:35:59.383 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0069543089999999997 2024-09-12T18:35:59.383 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.383 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.383 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:59.383 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667297+0000", 2024-09-12T18:35:59.383 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.013005526 2024-09-12T18:35:59.383 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.383 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.383 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:59.383 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667416+0000", 2024-09-12T18:35:59.383 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000119416 2024-09-12T18:35:59.384 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.384 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.384 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:59.384 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667507+0000", 2024-09-12T18:35:59.384 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0206999999999999e-05 2024-09-12T18:35:59.384 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:59.384 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:59.384 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:59.384 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.384 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.384 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:59.384 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:35:59.384 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 33.635508737000002, 2024-09-12T18:35:59.385 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023888482999999999, 2024-09-12T18:35:59.385 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:59.385 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:59.385 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:59.385 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:59.385 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.385 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:59.385 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:35:59.385 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:59.385 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.385 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.385 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:59.385 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:35:59.386 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:59.386 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.386 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.386 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:59.386 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643379+0000", 2024-09-12T18:35:59.386 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.207e-06 2024-09-12T18:35:59.386 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.386 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.386 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:59.386 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643390+0000", 2024-09-12T18:35:59.386 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0696000000000001e-05 2024-09-12T18:35:59.386 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.386 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.387 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:59.387 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643407+0000", 2024-09-12T18:35:59.387 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7563000000000001e-05 2024-09-12T18:35:59.387 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.387 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.387 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:59.387 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643420+0000", 2024-09-12T18:35:59.387 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3277e-05 2024-09-12T18:35:59.387 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.387 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.387 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:59.387 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644906+0000", 2024-09-12T18:35:59.387 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001485945 2024-09-12T18:35:59.387 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.388 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.388 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:59.388 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645404+0000", 2024-09-12T18:35:59.388 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00049807599999999997 2024-09-12T18:35:59.388 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.388 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.388 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:35:59.388 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645846+0000", 2024-09-12T18:35:59.388 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00044190400000000002 2024-09-12T18:35:59.388 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.388 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.388 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:59.388 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654223+0000", 2024-09-12T18:35:59.389 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0083767419999999995 2024-09-12T18:35:59.389 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.389 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.389 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:59.389 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667026+0000", 2024-09-12T18:35:59.389 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012802531000000001 2024-09-12T18:35:59.389 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.389 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.389 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:59.389 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667162+0000", 2024-09-12T18:35:59.389 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000136112 2024-09-12T18:35:59.389 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.389 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.390 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:59.390 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667266+0000", 2024-09-12T18:35:59.390 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010443 2024-09-12T18:35:59.390 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:59.390 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:59.390 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:59.390 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.390 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.390 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:59.390 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643447+0000", 2024-09-12T18:35:59.390 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 33.635439210999998, 2024-09-12T18:35:59.390 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.022081562999999998, 2024-09-12T18:35:59.390 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:59.391 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:59.391 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:35:59.391 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:59.391 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.391 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:59.391 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643447+0000", 2024-09-12T18:35:59.391 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:59.391 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.391 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.392 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:59.392 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643447+0000", 2024-09-12T18:35:59.392 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:59.392 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.392 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.392 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:59.392 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643448+0000", 2024-09-12T18:35:59.392 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1629999999999999e-06 2024-09-12T18:35:59.392 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.392 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.392 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:59.392 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643458+0000", 2024-09-12T18:35:59.392 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.8400000000000007e-06 2024-09-12T18:35:59.393 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.393 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.393 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:59.393 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643475+0000", 2024-09-12T18:35:59.393 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6874000000000001e-05 2024-09-12T18:35:59.393 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.393 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.393 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:59.393 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643488+0000", 2024-09-12T18:35:59.393 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3026e-05 2024-09-12T18:35:59.393 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.393 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.393 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:59.394 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643931+0000", 2024-09-12T18:35:59.394 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00044307 2024-09-12T18:35:59.394 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.394 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.394 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:59.394 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644210+0000", 2024-09-12T18:35:59.394 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027908400000000003 2024-09-12T18:35:59.394 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.394 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.394 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:35:59.394 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644606+0000", 2024-09-12T18:35:59.394 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00039615400000000002 2024-09-12T18:35:59.394 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.395 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.395 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:35:59.395 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650552+0000", 2024-09-12T18:35:59.395 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0059455619999999997 2024-09-12T18:35:59.395 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.395 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.395 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:35:59.395 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665302+0000", 2024-09-12T18:35:59.395 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.014749962 2024-09-12T18:35:59.395 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.395 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.395 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:35:59.395 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665424+0000", 2024-09-12T18:35:59.395 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012214300000000001 2024-09-12T18:35:59.396 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.396 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.396 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:59.396 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665529+0000", 2024-09-12T18:35:59.396 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000104685 2024-09-12T18:35:59.396 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:59.396 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:59.396 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:59.396 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.396 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.396 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:35:59.396 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:35:59.396 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 33.635358017999998, 2024-09-12T18:35:59.397 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024222582999999999, 2024-09-12T18:35:59.397 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:35:59.397 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:35:59.397 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:35:59.397 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:35:59.397 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.397 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:35:59.397 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:35:59.397 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:59.397 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.397 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.397 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:35:59.397 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:35:59.398 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:35:59.398 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.398 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.398 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:35:59.398 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643530+0000", 2024-09-12T18:35:59.398 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.393e-06 2024-09-12T18:35:59.398 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.398 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.398 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:35:59.398 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643536+0000", 2024-09-12T18:35:59.398 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4130000000000003e-06 2024-09-12T18:35:59.398 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.398 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.399 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:35:59.399 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643554+0000", 2024-09-12T18:35:59.399 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7572999999999999e-05 2024-09-12T18:35:59.399 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.399 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.399 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:35:59.399 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643567+0000", 2024-09-12T18:35:59.399 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3393999999999999e-05 2024-09-12T18:35:59.399 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.399 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.399 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:35:59.399 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648198+0000", 2024-09-12T18:35:59.399 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0046304479999999997 2024-09-12T18:35:59.399 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.400 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.400 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:35:59.400 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648413+0000", 2024-09-12T18:35:59.400 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00021507500000000001 2024-09-12T18:35:59.400 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:35:59.400 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:35:59.400 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:35:59.400 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667751+0000", 2024-09-12T18:35:59.400 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.019338286999999999 2024-09-12T18:35:59.400 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:59.400 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:59.400 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:59.400 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:35:59.401 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:35:59.401 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:35:59.402 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:35:59.403 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:59.397+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:59.502 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:59.498+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:35:59.565 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:35:59.565 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:35:59.565 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.565 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:39592 5.c 5:3391e5d2:::benchmark_data_smithi073_23739_object39591:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:35:59.565 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:59.558465+0000", 2024-09-12T18:35:59.565 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0043866440000000003, 2024-09-12T18:35:59.565 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0044159660000000003, 2024-09-12T18:35:59.565 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:59.565 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:59.565 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:59.565 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:35:59.566 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:35:59.566 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:59.566 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 39592 2024-09-12T18:35:59.566 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.566 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:59.566 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.566 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:59.566 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.558465+0000", 2024-09-12T18:35:59.566 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:59.566 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.566 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.566 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:59.566 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.558465+0000", 2024-09-12T18:35:59.567 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:59.567 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.567 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.567 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:59.567 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.558466+0000", 2024-09-12T18:35:59.567 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4810000000000001e-06 2024-09-12T18:35:59.567 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.567 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.567 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:59.567 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.558498+0000", 2024-09-12T18:35:59.567 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.1219e-05 2024-09-12T18:35:59.567 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.567 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.568 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:59.568 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.558507+0000", 2024-09-12T18:35:59.568 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.3070000000000008e-06 2024-09-12T18:35:59.568 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.568 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.568 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:59.568 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.558512+0000", 2024-09-12T18:35:59.568 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0660000000000003e-06 2024-09-12T18:35:59.568 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.568 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.568 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:59.568 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.558559+0000", 2024-09-12T18:35:59.569 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.7438000000000002e-05 2024-09-12T18:35:59.569 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.569 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.569 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:59.569 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.558690+0000", 2024-09-12T18:35:59.569 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000130471 2024-09-12T18:35:59.569 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.569 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.569 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:59.569 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.558768+0000", 2024-09-12T18:35:59.569 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8701000000000004e-05 2024-09-12T18:35:59.569 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:59.569 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:59.570 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:59.570 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.570 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.570 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:39594 5.c 5:3b44bc4e:::benchmark_data_smithi073_23739_object39593:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:35:59.570 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:59.559311+0000", 2024-09-12T18:35:59.570 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0035404220000000001, 2024-09-12T18:35:59.570 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.003628633, 2024-09-12T18:35:59.570 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:59.570 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:59.570 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:59.570 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:35:59.570 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:35:59.570 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:59.571 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 39594 2024-09-12T18:35:59.571 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.571 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:59.571 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.571 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:59.571 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.559311+0000", 2024-09-12T18:35:59.571 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:59.571 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.571 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.571 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:59.571 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.559311+0000", 2024-09-12T18:35:59.571 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:59.571 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.571 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.572 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:59.572 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.559312+0000", 2024-09-12T18:35:59.572 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0020000000000001e-06 2024-09-12T18:35:59.572 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.572 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.572 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:59.572 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.559353+0000", 2024-09-12T18:35:59.572 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.1179e-05 2024-09-12T18:35:59.572 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.572 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.572 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:59.572 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.559365+0000", 2024-09-12T18:35:59.573 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1537e-05 2024-09-12T18:35:59.573 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.573 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.573 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:59.573 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.559372+0000", 2024-09-12T18:35:59.573 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5109999999999997e-06 2024-09-12T18:35:59.573 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.573 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.573 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:59.573 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.560195+0000", 2024-09-12T18:35:59.573 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00082312699999999999 2024-09-12T18:35:59.573 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.573 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.574 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:59.574 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.560334+0000", 2024-09-12T18:35:59.574 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013875199999999999 2024-09-12T18:35:59.574 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.574 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.574 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:59.574 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.560468+0000", 2024-09-12T18:35:59.574 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013431000000000001 2024-09-12T18:35:59.574 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:59.574 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:59.574 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:59.574 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.574 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.575 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:39596 5.6 5:67b1914d:::benchmark_data_smithi073_23739_object39595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:35:59.575 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:59.559546+0000", 2024-09-12T18:35:59.575 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0033054629999999998, 2024-09-12T18:35:59.575 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00343057, 2024-09-12T18:35:59.575 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:59.575 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:59.575 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:59.575 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:35:59.575 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:35:59.575 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:59.575 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 39596 2024-09-12T18:35:59.575 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.575 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:59.576 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.576 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:59.576 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.559546+0000", 2024-09-12T18:35:59.576 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:59.576 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.576 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.576 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:59.576 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.559546+0000", 2024-09-12T18:35:59.576 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:59.576 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.576 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.576 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:59.576 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.559547+0000", 2024-09-12T18:35:59.577 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.78e-07 2024-09-12T18:35:59.577 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.577 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.577 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:59.577 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.559583+0000", 2024-09-12T18:35:59.577 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.6022999999999997e-05 2024-09-12T18:35:59.577 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.577 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.577 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:59.577 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.559594+0000", 2024-09-12T18:35:59.577 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0823e-05 2024-09-12T18:35:59.577 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.577 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.578 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:59.578 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.559601+0000", 2024-09-12T18:35:59.578 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.9410000000000001e-06 2024-09-12T18:35:59.578 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.578 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.578 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:59.578 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.560717+0000", 2024-09-12T18:35:59.578 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001116728 2024-09-12T18:35:59.578 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.578 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.578 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:59.578 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.560867+0000", 2024-09-12T18:35:59.578 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014951999999999999 2024-09-12T18:35:59.578 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.579 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.579 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:59.579 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.561027+0000", 2024-09-12T18:35:59.579 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015976299999999999 2024-09-12T18:35:59.579 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:59.579 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:59.579 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:59.579 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.579 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.579 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:39595 5.4 e30/21 5:265b80b9:::benchmark_data_smithi073_23739_object39594:head v 30'2461, mlcod=30'2459)", 2024-09-12T18:35:59.579 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:59.559882+0000", 2024-09-12T18:35:59.579 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0029697310000000002, 2024-09-12T18:35:59.579 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0031588499999999999, 2024-09-12T18:35:59.580 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:59.580 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:59.580 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:35:59.580 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:59.580 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.580 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:59.580 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.559882+0000", 2024-09-12T18:35:59.580 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:59.580 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.580 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.580 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:59.580 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.559882+0000", 2024-09-12T18:35:59.580 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:59.581 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.581 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.581 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:59.581 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.559882+0000", 2024-09-12T18:35:59.581 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.68e-07 2024-09-12T18:35:59.581 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.581 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.581 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:59.581 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.559945+0000", 2024-09-12T18:35:59.581 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2898999999999995e-05 2024-09-12T18:35:59.581 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.581 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.581 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:59.581 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.559959+0000", 2024-09-12T18:35:59.582 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3825999999999999e-05 2024-09-12T18:35:59.582 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.582 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.582 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:59.582 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.559971+0000", 2024-09-12T18:35:59.582 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2335e-05 2024-09-12T18:35:59.582 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.582 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.582 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:59.582 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.560188+0000", 2024-09-12T18:35:59.582 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00021646400000000001 2024-09-12T18:35:59.582 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.582 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.583 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:59.583 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.560205+0000", 2024-09-12T18:35:59.583 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6898999999999999e-05 2024-09-12T18:35:59.583 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:59.583 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:59.583 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:59.583 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.583 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.583 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:39598 5.3 5:c2ffa34e:::benchmark_data_smithi073_23739_object39597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:35:59.583 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:59.560042+0000", 2024-09-12T18:35:59.583 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0028099459999999998, 2024-09-12T18:35:59.583 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0030571270000000002, 2024-09-12T18:35:59.583 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:59.584 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:59.584 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:35:59.584 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:35:59.584 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:35:59.584 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:59.584 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 39598 2024-09-12T18:35:59.584 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.584 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:59.584 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.584 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:59.584 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.560042+0000", 2024-09-12T18:35:59.584 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:59.584 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.585 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.585 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:59.585 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.560042+0000", 2024-09-12T18:35:59.585 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:59.585 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.585 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.585 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:59.585 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.560042+0000", 2024-09-12T18:35:59.585 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.71e-07 2024-09-12T18:35:59.585 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.585 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.585 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:59.585 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.560075+0000", 2024-09-12T18:35:59.586 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.2583000000000003e-05 2024-09-12T18:35:59.586 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.586 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.586 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:59.586 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.560085+0000", 2024-09-12T18:35:59.586 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.6520000000000001e-06 2024-09-12T18:35:59.586 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.586 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.586 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:59.586 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.560090+0000", 2024-09-12T18:35:59.586 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0300000000000001e-06 2024-09-12T18:35:59.586 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.586 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.586 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:59.587 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.560155+0000", 2024-09-12T18:35:59.587 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5574999999999995e-05 2024-09-12T18:35:59.587 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.587 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.587 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:59.587 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.560291+0000", 2024-09-12T18:35:59.587 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000135993 2024-09-12T18:35:59.587 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.587 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.587 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:35:59.587 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.560419+0000", 2024-09-12T18:35:59.587 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000127837 2024-09-12T18:35:59.587 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.588 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.588 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:35:59.588 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.562907+0000", 2024-09-12T18:35:59.588 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0024876049999999999 2024-09-12T18:35:59.588 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:59.588 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:59.588 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:59.588 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.588 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.588 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:39600 5.c 5.311be0fc (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:35:59.588 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:59.560442+0000", 2024-09-12T18:35:59.588 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0024092060000000001, 2024-09-12T18:35:59.588 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0027199730000000001, 2024-09-12T18:35:59.588 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:59.589 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:59.589 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:35:59.589 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:35:59.589 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:35:59.589 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:59.589 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 39600 2024-09-12T18:35:59.589 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.589 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:59.589 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.589 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:59.589 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.560442+0000", 2024-09-12T18:35:59.589 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:59.589 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.590 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.590 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:59.590 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.560442+0000", 2024-09-12T18:35:59.590 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:59.590 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.590 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.590 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:59.590 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.560443+0000", 2024-09-12T18:35:59.590 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2410000000000001e-06 2024-09-12T18:35:59.590 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.590 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.590 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:59.590 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.560484+0000", 2024-09-12T18:35:59.591 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0009999999999998e-05 2024-09-12T18:35:59.591 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.591 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.591 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:59.591 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.560496+0000", 2024-09-12T18:35:59.591 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2269999999999999e-05 2024-09-12T18:35:59.591 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.591 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.591 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:59.591 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.560503+0000", 2024-09-12T18:35:59.591 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6079999999999998e-06 2024-09-12T18:35:59.591 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:59.591 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:59.591 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:59.592 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.592 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.592 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:39597 5.8 e30/21 5:122711cd:::benchmark_data_smithi073_23739_object39596:head v 30'2407, mlcod=30'2404)", 2024-09-12T18:35:59.592 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:59.561679+0000", 2024-09-12T18:35:59.592 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0011723689999999999, 2024-09-12T18:35:59.592 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001532058, 2024-09-12T18:35:59.592 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:59.592 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:59.592 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:35:59.592 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:59.593 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.593 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:59.593 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.561679+0000", 2024-09-12T18:35:59.593 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:59.593 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.594 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.594 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:59.594 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.561679+0000", 2024-09-12T18:35:59.594 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:59.594 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.595 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.595 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:59.595 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.561680+0000", 2024-09-12T18:35:59.595 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5199999999999996e-07 2024-09-12T18:35:59.595 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.595 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.595 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:59.596 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.561720+0000", 2024-09-12T18:35:59.596 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0404999999999997e-05 2024-09-12T18:35:59.596 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.596 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.596 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:59.596 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.561730+0000", 2024-09-12T18:35:59.596 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4020000000000008e-06 2024-09-12T18:35:59.596 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.596 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.596 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:59.596 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.561737+0000", 2024-09-12T18:35:59.597 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4529999999999996e-06 2024-09-12T18:35:59.597 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.597 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.597 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:59.597 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.561799+0000", 2024-09-12T18:35:59.597 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2133999999999998e-05 2024-09-12T18:35:59.597 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.597 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.597 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:59.597 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.561859+0000", 2024-09-12T18:35:59.597 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9562000000000003e-05 2024-09-12T18:35:59.598 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:59.598 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:59.598 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:59.598 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.598 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.598 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:39592 5.c e30/21)", 2024-09-12T18:35:59.598 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:59.561743+0000", 2024-09-12T18:35:59.598 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0011086609999999999, 2024-09-12T18:35:59.598 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0015203199999999999, 2024-09-12T18:35:59.598 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:59.598 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:59.598 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:35:59.598 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:59.598 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.599 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:59.599 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.561743+0000", 2024-09-12T18:35:59.599 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:59.599 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.599 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.599 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:59.599 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.561743+0000", 2024-09-12T18:35:59.599 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:59.599 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.599 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.599 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:59.599 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.561743+0000", 2024-09-12T18:35:59.599 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5400000000000001e-07 2024-09-12T18:35:59.600 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.600 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.600 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:59.600 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.561748+0000", 2024-09-12T18:35:59.600 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3290000000000004e-06 2024-09-12T18:35:59.600 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.600 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.600 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:59.600 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.561758+0000", 2024-09-12T18:35:59.600 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.8609999999999993e-06 2024-09-12T18:35:59.600 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.600 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.600 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:59.601 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.561767+0000", 2024-09-12T18:35:59.601 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.5899999999999997e-06 2024-09-12T18:35:59.601 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:59.601 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:59.601 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:59.601 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.601 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.601 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:39602 5.0 e30/21 5:0ae701bd:::benchmark_data_smithi073_23739_object39601:head v 30'2459, mlcod=30'2456)", 2024-09-12T18:35:59.601 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:59.563001+0000", 2024-09-12T18:35:59.601 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4294967295.9998503, 2024-09-12T18:35:59.601 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00030685, 2024-09-12T18:35:59.601 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:59.601 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:59.601 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:35:59.602 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:59.602 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.602 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:59.602 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.563001+0000", 2024-09-12T18:35:59.602 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:59.602 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.602 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.602 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:59.602 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.563001+0000", 2024-09-12T18:35:59.602 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:59.602 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.602 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.603 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:59.603 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.563002+0000", 2024-09-12T18:35:59.603 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8899999999999998e-07 2024-09-12T18:35:59.603 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.603 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.603 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:59.603 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.563064+0000", 2024-09-12T18:35:59.603 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1755999999999996e-05 2024-09-12T18:35:59.603 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.603 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.603 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:59.603 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.563073+0000", 2024-09-12T18:35:59.603 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4469999999999995e-06 2024-09-12T18:35:59.603 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.604 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.604 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:59.604 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.563080+0000", 2024-09-12T18:35:59.604 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7209999999999997e-06 2024-09-12T18:35:59.604 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.604 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.604 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:59.604 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.563130+0000", 2024-09-12T18:35:59.604 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9848000000000001e-05 2024-09-12T18:35:59.604 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.604 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.604 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:59.605 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.563149+0000", 2024-09-12T18:35:59.605 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8632000000000001e-05 2024-09-12T18:35:59.605 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:59.605 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:59.605 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:59.605 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.605 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.605 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:39599 5.4 e30/21)", 2024-09-12T18:35:59.605 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:59.563095+0000", 2024-09-12T18:35:59.605 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4294967295.9997559, 2024-09-12T18:35:59.605 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000263014, 2024-09-12T18:35:59.605 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:59.606 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:59.606 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:35:59.606 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:59.606 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.606 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:59.606 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.563095+0000", 2024-09-12T18:35:59.606 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:59.606 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.606 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.606 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:59.606 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.563095+0000", 2024-09-12T18:35:59.606 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:59.606 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.606 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.607 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:59.607 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.563096+0000", 2024-09-12T18:35:59.607 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.6199999999999999e-07 2024-09-12T18:35:59.607 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.607 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.607 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:59.607 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.563181+0000", 2024-09-12T18:35:59.607 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5455000000000001e-05 2024-09-12T18:35:59.607 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.607 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.607 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:59.607 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.563189+0000", 2024-09-12T18:35:59.607 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.9379999999999992e-06 2024-09-12T18:35:59.608 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.608 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.608 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:59.608 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.563195+0000", 2024-09-12T18:35:59.608 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6269999999999997e-06 2024-09-12T18:35:59.608 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:59.608 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:59.608 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:59.608 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.608 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.608 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:39606 5.6 5:6cb4df49:::benchmark_data_smithi073_23739_object39605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:35:59.608 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:59.563054+0000", 2024-09-12T18:35:59.608 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4294967295.9997973, 2024-09-12T18:35:59.609 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000354438, 2024-09-12T18:35:59.609 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:59.609 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:59.609 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:35:59.609 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:35:59.609 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:35:59.609 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:35:59.609 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 39606 2024-09-12T18:35:59.609 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.609 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:59.609 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.609 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:59.609 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.563054+0000", 2024-09-12T18:35:59.610 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:59.610 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.610 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.610 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:59.610 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.563054+0000", 2024-09-12T18:35:59.610 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:59.610 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.610 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.610 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:59.612 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.563055+0000", 2024-09-12T18:35:59.612 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2440000000000001e-06 2024-09-12T18:35:59.612 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.612 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.612 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:59.612 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.563192+0000", 2024-09-12T18:35:59.612 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013631299999999999 2024-09-12T18:35:59.612 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.612 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.612 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:59.612 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.563202+0000", 2024-09-12T18:35:59.612 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0725e-05 2024-09-12T18:35:59.613 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.613 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.613 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:59.613 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.563210+0000", 2024-09-12T18:35:59.613 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.7279999999999995e-06 2024-09-12T18:35:59.613 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.613 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.613 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:59.613 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.563265+0000", 2024-09-12T18:35:59.613 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4676000000000003e-05 2024-09-12T18:35:59.613 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.613 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.613 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:59.614 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.563397+0000", 2024-09-12T18:35:59.614 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013229499999999999 2024-09-12T18:35:59.614 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:59.614 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:59.614 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:59.614 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.614 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.614 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:39603 5.8 e30/21 5:1ffe4ecd:::benchmark_data_smithi073_23739_object39602:head v 30'2408, mlcod=30'2405)", 2024-09-12T18:35:59.614 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:59.563227+0000", 2024-09-12T18:35:59.614 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4294967295.9996247, 2024-09-12T18:35:59.614 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00024707199999999998, 2024-09-12T18:35:59.614 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:59.614 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:59.615 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:35:59.615 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:59.615 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.615 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:59.615 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.563227+0000", 2024-09-12T18:35:59.615 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:59.615 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.615 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.615 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:59.615 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.563227+0000", 2024-09-12T18:35:59.615 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:59.615 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.615 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.616 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:59.616 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.563227+0000", 2024-09-12T18:35:59.616 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3599999999999999e-07 2024-09-12T18:35:59.616 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.616 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.616 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:59.616 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.563266+0000", 2024-09-12T18:35:59.616 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.9072999999999997e-05 2024-09-12T18:35:59.616 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.616 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.616 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:59.616 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.563273+0000", 2024-09-12T18:35:59.616 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.255e-06 2024-09-12T18:35:59.616 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.617 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.617 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:59.617 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.563280+0000", 2024-09-12T18:35:59.617 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3679999999999998e-06 2024-09-12T18:35:59.617 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.617 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.617 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:59.617 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.563363+0000", 2024-09-12T18:35:59.617 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2993999999999999e-05 2024-09-12T18:35:59.617 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.617 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.617 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:59.617 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.563382+0000", 2024-09-12T18:35:59.618 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9732e-05 2024-09-12T18:35:59.618 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:59.618 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:59.618 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:59.618 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.618 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.618 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:39604 5.1 e30/21 5:845b70bd:::benchmark_data_smithi073_23739_object39603:head v 30'2478, mlcod=30'2476)", 2024-09-12T18:35:59.618 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:59.563229+0000", 2024-09-12T18:35:59.618 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4294967295.9996223, 2024-09-12T18:35:59.618 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00029605199999999999, 2024-09-12T18:35:59.618 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:35:59.618 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:35:59.618 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:35:59.618 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:35:59.619 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.619 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:35:59.619 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.563229+0000", 2024-09-12T18:35:59.619 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:59.619 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.619 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.619 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:35:59.619 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.563229+0000", 2024-09-12T18:35:59.619 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:35:59.619 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.619 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.619 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:35:59.619 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.563230+0000", 2024-09-12T18:35:59.620 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8400000000000003e-07 2024-09-12T18:35:59.620 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.620 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.620 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:35:59.620 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.563279+0000", 2024-09-12T18:35:59.620 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9599999999999999e-05 2024-09-12T18:35:59.620 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.620 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.620 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:35:59.620 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.563288+0000", 2024-09-12T18:35:59.620 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1169999999999993e-06 2024-09-12T18:35:59.620 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.620 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.621 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:35:59.621 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.563295+0000", 2024-09-12T18:35:59.621 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.0939999999999996e-06 2024-09-12T18:35:59.621 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.621 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.621 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:35:59.621 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.563367+0000", 2024-09-12T18:35:59.621 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.2953000000000004e-05 2024-09-12T18:35:59.621 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:35:59.621 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:35:59.621 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:35:59.621 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.563388+0000", 2024-09-12T18:35:59.621 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.0474000000000001e-05 2024-09-12T18:35:59.621 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:59.622 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:35:59.622 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:59.622 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:35:59.622 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-12T18:35:59.622 INFO:teuthology.orchestra.run.smithi114.stdout: "num_ops": 13 2024-09-12T18:35:59.622 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:35:59.624 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:35:59.624 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:59.621+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:59.724 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:59.721+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:59.825 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:35:59.821+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:35:59.829 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:35:59.829 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2024-09-12T18:35:59.829 INFO:teuthology.orchestra.run.smithi114.stdout: "complaint_time": 30, 2024-09-12T18:35:59.829 INFO:teuthology.orchestra.run.smithi114.stdout: "num_blocked_ops": 0 2024-09-12T18:35:59.829 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:35:59.853 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:35:59.869 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 14 16 40317 40301 179.895 153.812 0.00546722 0.00555365 2024-09-12T18:35:59.925 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:35:59.922+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:00.026 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:00.022+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:00.063 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:00.063 INFO:teuthology.orchestra.run.smithi114.stdout: "size": 20, 2024-09-12T18:36:00.063 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 600, 2024-09-12T18:36:00.063 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:36:00.063 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.064 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:00.064 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:00.064 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 34.432307457, 2024-09-12T18:36:00.064 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.042475618999999999, 2024-09-12T18:36:00.064 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:00.064 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:00.064 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:00.064 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:00.064 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.064 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:00.064 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:00.064 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:00.064 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.065 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.065 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:00.065 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:00.065 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:00.065 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.065 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.065 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:00.065 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628450+0000", 2024-09-12T18:36:00.065 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4212999999999999e-05 2024-09-12T18:36:00.065 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.065 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.065 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:00.065 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628463+0000", 2024-09-12T18:36:00.065 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2497000000000001e-05 2024-09-12T18:36:00.066 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.066 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.066 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:00.066 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628480+0000", 2024-09-12T18:36:00.066 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7232999999999999e-05 2024-09-12T18:36:00.066 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.066 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.066 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.066 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628496+0000", 2024-09-12T18:36:00.066 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6217000000000001e-05 2024-09-12T18:36:00.066 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.066 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.066 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:00.066 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628641+0000", 2024-09-12T18:36:00.067 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000144709 2024-09-12T18:36:00.067 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.067 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.067 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:00.067 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628657+0000", 2024-09-12T18:36:00.067 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6266e-05 2024-09-12T18:36:00.067 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.067 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.067 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:00.067 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663103+0000", 2024-09-12T18:36:00.067 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.034445523999999998 2024-09-12T18:36:00.067 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.067 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.067 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:00.068 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663373+0000", 2024-09-12T18:36:00.068 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00027085500000000002 2024-09-12T18:36:00.068 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.068 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.068 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:00.068 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663634+0000", 2024-09-12T18:36:00.068 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000260855 2024-09-12T18:36:00.068 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.068 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.068 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:00.068 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670294+0000", 2024-09-12T18:36:00.068 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0066597599999999998 2024-09-12T18:36:00.068 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.068 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.069 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:00.069 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670705+0000", 2024-09-12T18:36:00.069 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00041057099999999998 2024-09-12T18:36:00.069 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.069 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.069 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:00.069 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670820+0000", 2024-09-12T18:36:00.069 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000115111 2024-09-12T18:36:00.069 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.069 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.069 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:00.069 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670912+0000", 2024-09-12T18:36:00.069 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1807999999999999e-05 2024-09-12T18:36:00.070 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:00.070 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:00.070 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:00.070 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.070 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.070 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:00.070 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:00.070 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 34.432216711000002, 2024-09-12T18:36:00.070 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.044599273000000002, 2024-09-12T18:36:00.070 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:00.070 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:00.070 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:00.070 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:00.071 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.071 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:00.071 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:00.071 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:00.071 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.071 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.071 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:00.071 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:00.071 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:00.071 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.071 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.071 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:00.071 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628528+0000", 2024-09-12T18:36:00.072 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:00.072 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.072 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.072 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:00.072 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628537+0000", 2024-09-12T18:36:00.072 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6969999999999999e-06 2024-09-12T18:36:00.072 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.072 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.072 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:00.072 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628560+0000", 2024-09-12T18:36:00.072 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2889000000000001e-05 2024-09-12T18:36:00.072 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.072 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.072 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.073 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628576+0000", 2024-09-12T18:36:00.073 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.649e-05 2024-09-12T18:36:00.073 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.073 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.073 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:00.073 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628846+0000", 2024-09-12T18:36:00.073 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00026952500000000001 2024-09-12T18:36:00.073 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.073 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.073 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:00.073 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628853+0000", 2024-09-12T18:36:00.073 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6559999999999992e-06 2024-09-12T18:36:00.073 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.074 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.074 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:00.074 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665284+0000", 2024-09-12T18:36:00.074 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.036431140000000001 2024-09-12T18:36:00.074 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.074 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.074 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:00.074 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665494+0000", 2024-09-12T18:36:00.074 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000209762 2024-09-12T18:36:00.074 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.074 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.074 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:00.074 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665816+0000", 2024-09-12T18:36:00.075 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00032162299999999999 2024-09-12T18:36:00.075 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.075 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.075 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:00.075 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670382+0000", 2024-09-12T18:36:00.075 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0045656739999999996 2024-09-12T18:36:00.075 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.075 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.075 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:00.075 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.672978+0000", 2024-09-12T18:36:00.075 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.002596068 2024-09-12T18:36:00.075 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.075 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.075 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:00.076 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673058+0000", 2024-09-12T18:36:00.076 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0198999999999996e-05 2024-09-12T18:36:00.076 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.076 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.076 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:00.076 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673126+0000", 2024-09-12T18:36:00.076 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8120000000000005e-05 2024-09-12T18:36:00.076 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:00.076 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:00.076 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:00.076 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.076 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.076 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:23 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:00.077 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:00.077 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 34.432118905000003, 2024-09-12T18:36:00.077 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045539784, 2024-09-12T18:36:00.077 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:00.077 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:00.077 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:00.077 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:00.077 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.077 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:00.077 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:00.077 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:00.077 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.077 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.077 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:00.078 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:00.078 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:00.078 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.078 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.078 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:00.078 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628626+0000", 2024-09-12T18:36:00.078 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.573e-06 2024-09-12T18:36:00.078 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.078 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.078 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:00.078 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628640+0000", 2024-09-12T18:36:00.078 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3817e-05 2024-09-12T18:36:00.078 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.078 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.079 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:00.079 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628659+0000", 2024-09-12T18:36:00.079 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9539999999999999e-05 2024-09-12T18:36:00.079 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.079 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.079 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.079 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628675+0000", 2024-09-12T18:36:00.079 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5739e-05 2024-09-12T18:36:00.079 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.079 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.079 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:00.079 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628815+0000", 2024-09-12T18:36:00.079 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014003299999999999 2024-09-12T18:36:00.079 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.080 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.080 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:00.080 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628828+0000", 2024-09-12T18:36:00.080 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2849e-05 2024-09-12T18:36:00.080 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.080 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.080 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:00.080 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651162+0000", 2024-09-12T18:36:00.080 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.022334228000000001 2024-09-12T18:36:00.080 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.080 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.080 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:00.080 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651446+0000", 2024-09-12T18:36:00.081 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00028392800000000002 2024-09-12T18:36:00.081 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.081 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.081 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:00.081 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651746+0000", 2024-09-12T18:36:00.081 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000300091 2024-09-12T18:36:00.081 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.081 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.081 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:00.081 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665113+0000", 2024-09-12T18:36:00.081 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013366678 2024-09-12T18:36:00.081 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.081 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.081 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:00.082 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674010+0000", 2024-09-12T18:36:00.082 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0088970520000000008 2024-09-12T18:36:00.082 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.082 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.082 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:00.082 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674104+0000", 2024-09-12T18:36:00.082 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4124999999999998e-05 2024-09-12T18:36:00.082 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.082 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.082 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:00.082 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674164+0000", 2024-09-12T18:36:00.082 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.0130999999999997e-05 2024-09-12T18:36:00.082 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:00.083 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:00.083 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:00.083 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.083 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.083 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:26 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:00.083 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:00.083 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 34.432045699, 2024-09-12T18:36:00.083 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045702136999999997, 2024-09-12T18:36:00.083 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:00.083 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:00.083 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:00.083 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:00.083 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.083 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:00.084 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:00.084 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:00.084 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.084 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.084 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:00.084 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:00.084 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:00.084 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.084 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.084 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:00.084 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628699+0000", 2024-09-12T18:36:00.084 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3859999999999999e-06 2024-09-12T18:36:00.084 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.085 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.085 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:00.085 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628706+0000", 2024-09-12T18:36:00.085 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0169999999999999e-06 2024-09-12T18:36:00.085 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.085 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.085 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:00.085 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628725+0000", 2024-09-12T18:36:00.085 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8683000000000001e-05 2024-09-12T18:36:00.085 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.085 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.085 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.085 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628740+0000", 2024-09-12T18:36:00.085 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5413999999999998e-05 2024-09-12T18:36:00.086 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.086 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.086 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:00.086 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628907+0000", 2024-09-12T18:36:00.086 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00016670199999999999 2024-09-12T18:36:00.086 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.086 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.086 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:00.086 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628917+0000", 2024-09-12T18:36:00.086 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.046e-05 2024-09-12T18:36:00.086 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.086 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.086 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:00.086 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.660390+0000", 2024-09-12T18:36:00.087 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.031472364000000003 2024-09-12T18:36:00.087 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.087 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.087 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:00.087 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.661767+0000", 2024-09-12T18:36:00.087 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0013769190000000001 2024-09-12T18:36:00.087 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.087 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.087 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:00.087 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.662408+0000", 2024-09-12T18:36:00.087 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00064091099999999998 2024-09-12T18:36:00.087 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.087 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.087 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:00.088 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669577+0000", 2024-09-12T18:36:00.088 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.007169412 2024-09-12T18:36:00.088 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.088 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.088 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:00.088 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674244+0000", 2024-09-12T18:36:00.088 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0046671839999999996 2024-09-12T18:36:00.088 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.088 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.088 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:00.088 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674329+0000", 2024-09-12T18:36:00.088 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5276000000000001e-05 2024-09-12T18:36:00.088 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.089 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.089 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:00.089 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674400+0000", 2024-09-12T18:36:00.089 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0408999999999996e-05 2024-09-12T18:36:00.089 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:00.089 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:00.089 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:00.089 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.089 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.089 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:00.089 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:00.089 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 34.431938029999998, 2024-09-12T18:36:00.089 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.044572443000000003, 2024-09-12T18:36:00.089 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:00.090 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:00.090 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:00.090 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:00.090 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.090 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:00.090 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:00.090 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:00.090 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.090 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.090 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:00.090 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:00.090 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:00.090 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.090 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.091 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:00.091 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628807+0000", 2024-09-12T18:36:00.091 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3629999999999999e-06 2024-09-12T18:36:00.091 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.091 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.091 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:00.091 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628814+0000", 2024-09-12T18:36:00.091 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.2099999999999996e-06 2024-09-12T18:36:00.091 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.091 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.091 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:00.091 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628832+0000", 2024-09-12T18:36:00.091 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7972999999999999e-05 2024-09-12T18:36:00.092 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.092 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.092 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.092 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628854+0000", 2024-09-12T18:36:00.092 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1857000000000001e-05 2024-09-12T18:36:00.092 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.092 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.092 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:00.092 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628984+0000", 2024-09-12T18:36:00.092 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013013599999999999 2024-09-12T18:36:00.092 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.092 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.093 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:00.093 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628993+0000", 2024-09-12T18:36:00.093 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:36:00.093 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.093 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.093 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:00.093 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668176+0000", 2024-09-12T18:36:00.093 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.039182211000000002 2024-09-12T18:36:00.093 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.093 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.093 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:00.093 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668481+0000", 2024-09-12T18:36:00.093 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00030499200000000002 2024-09-12T18:36:00.094 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.094 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.094 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:00.094 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668771+0000", 2024-09-12T18:36:00.094 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00029018700000000002 2024-09-12T18:36:00.094 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.094 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.094 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:00.095 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.672674+0000", 2024-09-12T18:36:00.095 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0039031890000000001 2024-09-12T18:36:00.095 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.095 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.095 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:00.095 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673214+0000", 2024-09-12T18:36:00.095 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00053981600000000004 2024-09-12T18:36:00.095 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.095 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.095 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:00.095 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673310+0000", 2024-09-12T18:36:00.095 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.6682999999999996e-05 2024-09-12T18:36:00.095 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.096 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.096 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:00.096 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673378+0000", 2024-09-12T18:36:00.096 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7385999999999995e-05 2024-09-12T18:36:00.096 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:00.096 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:00.096 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:00.096 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.096 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.096 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:00.096 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:00.096 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 34.431802003999998, 2024-09-12T18:36:00.096 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.041480853999999998, 2024-09-12T18:36:00.096 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:00.097 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:00.097 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:00.097 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:00.097 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.097 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:00.097 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:00.097 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:00.097 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.097 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.097 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:00.097 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:00.097 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:00.097 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.098 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.098 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:00.098 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628943+0000", 2024-09-12T18:36:00.098 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.403e-06 2024-09-12T18:36:00.098 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.098 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.098 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:00.098 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628953+0000", 2024-09-12T18:36:00.098 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0273e-05 2024-09-12T18:36:00.098 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.098 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.098 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:00.098 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628973+0000", 2024-09-12T18:36:00.099 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9959999999999999e-05 2024-09-12T18:36:00.099 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.099 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.099 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.099 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628989+0000", 2024-09-12T18:36:00.099 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6447e-05 2024-09-12T18:36:00.099 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.099 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.099 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:00.099 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629144+0000", 2024-09-12T18:36:00.100 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015468900000000001 2024-09-12T18:36:00.100 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.100 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.100 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:00.100 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629162+0000", 2024-09-12T18:36:00.100 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7603000000000001e-05 2024-09-12T18:36:00.100 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.100 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.100 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:00.100 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.646927+0000", 2024-09-12T18:36:00.100 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.017765626 2024-09-12T18:36:00.100 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.100 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.101 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:00.101 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.647245+0000", 2024-09-12T18:36:00.101 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00031797699999999999 2024-09-12T18:36:00.101 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.101 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.101 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:00.101 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.647551+0000", 2024-09-12T18:36:00.101 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00030583500000000002 2024-09-12T18:36:00.101 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.101 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.101 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:00.101 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651738+0000", 2024-09-12T18:36:00.101 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0041864980000000003 2024-09-12T18:36:00.102 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.102 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.102 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:00.102 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670207+0000", 2024-09-12T18:36:00.102 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018469299000000002 2024-09-12T18:36:00.102 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.102 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.102 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:00.102 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670330+0000", 2024-09-12T18:36:00.102 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012284500000000001 2024-09-12T18:36:00.102 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.102 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.102 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:00.103 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670422+0000", 2024-09-12T18:36:00.103 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2398999999999994e-05 2024-09-12T18:36:00.103 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:00.103 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:00.103 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:00.103 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.103 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.103 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:00.103 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:00.103 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 34.431724750999997, 2024-09-12T18:36:00.103 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.041623741999999998, 2024-09-12T18:36:00.103 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:00.103 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:00.104 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:00.104 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:00.104 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.104 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:00.104 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:00.104 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:00.104 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.104 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.104 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:00.104 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:00.104 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:00.104 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.104 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.104 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:00.105 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629020+0000", 2024-09-12T18:36:00.105 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.15e-06 2024-09-12T18:36:00.105 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.105 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.105 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:00.105 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629023+0000", 2024-09-12T18:36:00.105 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4659999999999999e-06 2024-09-12T18:36:00.105 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.105 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.105 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:00.105 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629037+0000", 2024-09-12T18:36:00.105 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3857e-05 2024-09-12T18:36:00.105 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.106 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.106 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.106 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629062+0000", 2024-09-12T18:36:00.106 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4519999999999999e-05 2024-09-12T18:36:00.106 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.106 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.106 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:00.106 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629253+0000", 2024-09-12T18:36:00.106 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000191335 2024-09-12T18:36:00.106 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.106 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.106 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:00.106 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629266+0000", 2024-09-12T18:36:00.106 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3322999999999999e-05 2024-09-12T18:36:00.107 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.107 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.107 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:00.107 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648331+0000", 2024-09-12T18:36:00.107 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.019065060000000002 2024-09-12T18:36:00.107 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.107 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.107 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:00.107 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.650044+0000", 2024-09-12T18:36:00.107 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017123959999999999 2024-09-12T18:36:00.107 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.107 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.107 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:00.107 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670642+0000", 2024-09-12T18:36:00.108 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.020598635000000001 2024-09-12T18:36:00.108 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:00.108 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:00.108 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:00.108 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.108 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.108 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:00.108 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:00.108 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 34.431621419000003, 2024-09-12T18:36:00.108 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.046431252999999999, 2024-09-12T18:36:00.108 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:00.108 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:00.108 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:00.109 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:00.109 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.109 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:00.109 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:00.109 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:00.109 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.109 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.109 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:00.109 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:00.109 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:00.109 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.109 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.109 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:00.109 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629123+0000", 2024-09-12T18:36:00.110 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0899999999999999e-06 2024-09-12T18:36:00.110 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.110 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.110 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:00.110 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629138+0000", 2024-09-12T18:36:00.110 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4977000000000001e-05 2024-09-12T18:36:00.110 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.110 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.110 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:00.110 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629149+0000", 2024-09-12T18:36:00.110 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1182999999999999e-05 2024-09-12T18:36:00.110 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.110 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.110 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.111 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629157+0000", 2024-09-12T18:36:00.111 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8129999999999996e-06 2024-09-12T18:36:00.111 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.111 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.111 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:00.111 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629223+0000", 2024-09-12T18:36:00.111 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6463000000000004e-05 2024-09-12T18:36:00.111 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.111 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.111 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:00.111 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629230+0000", 2024-09-12T18:36:00.111 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1360000000000002e-06 2024-09-12T18:36:00.111 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.111 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.112 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:00.112 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669605+0000", 2024-09-12T18:36:00.112 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.040375518999999999 2024-09-12T18:36:00.112 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.112 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.112 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:00.112 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669840+0000", 2024-09-12T18:36:00.112 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00023520099999999999 2024-09-12T18:36:00.112 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.112 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.112 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:00.112 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.675553+0000", 2024-09-12T18:36:00.112 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0057128709999999996 2024-09-12T18:36:00.112 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:00.113 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:00.113 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:00.113 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.113 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.113 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:00.113 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:00.113 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 34.431566752000002, 2024-09-12T18:36:00.113 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.037357044999999998, 2024-09-12T18:36:00.113 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:00.113 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:00.113 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:00.113 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:00.113 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.114 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:00.114 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:00.114 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:00.114 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.114 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.114 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:00.114 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:00.114 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:00.114 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.114 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.114 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:00.114 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629178+0000", 2024-09-12T18:36:00.114 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.08e-06 2024-09-12T18:36:00.115 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.115 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.115 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:00.115 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629194+0000", 2024-09-12T18:36:00.115 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5899000000000001e-05 2024-09-12T18:36:00.115 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.115 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.115 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:00.115 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629211+0000", 2024-09-12T18:36:00.115 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7363e-05 2024-09-12T18:36:00.115 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.115 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.115 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.115 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629226+0000", 2024-09-12T18:36:00.116 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4567e-05 2024-09-12T18:36:00.116 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.116 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.116 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:00.116 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629299+0000", 2024-09-12T18:36:00.116 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3910000000000002e-05 2024-09-12T18:36:00.116 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.116 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.116 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:00.116 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629307+0000", 2024-09-12T18:36:00.116 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5299999999999999e-06 2024-09-12T18:36:00.116 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.116 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.117 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:00.117 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648185+0000", 2024-09-12T18:36:00.117 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018878533999999999 2024-09-12T18:36:00.117 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.117 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.117 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:00.117 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.649724+0000", 2024-09-12T18:36:00.117 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001538841 2024-09-12T18:36:00.117 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.117 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.117 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:00.117 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.666534+0000", 2024-09-12T18:36:00.117 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.016809320999999999 2024-09-12T18:36:00.117 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:00.118 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:00.118 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:00.118 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.118 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.118 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:36:00.118 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.648091+0000", 2024-09-12T18:36:00.118 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 34.412652162000001, 2024-09-12T18:36:00.118 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015212766000000001, 2024-09-12T18:36:00.118 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:00.118 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:00.118 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:00.118 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:00.118 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.119 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:00.119 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648091+0000", 2024-09-12T18:36:00.119 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:00.119 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.119 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.119 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:00.119 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648091+0000", 2024-09-12T18:36:00.119 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:00.119 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.119 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.119 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:00.119 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648092+0000", 2024-09-12T18:36:00.119 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.26e-06 2024-09-12T18:36:00.119 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.119 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.120 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:00.120 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648123+0000", 2024-09-12T18:36:00.120 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.0719000000000002e-05 2024-09-12T18:36:00.120 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.120 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.120 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:00.120 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648140+0000", 2024-09-12T18:36:00.120 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6650000000000002e-05 2024-09-12T18:36:00.120 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.120 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.120 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.120 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648153+0000", 2024-09-12T18:36:00.120 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.278e-05 2024-09-12T18:36:00.121 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.121 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.121 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:00.121 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.649756+0000", 2024-09-12T18:36:00.121 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0016036379999999999 2024-09-12T18:36:00.121 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.121 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.121 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:00.121 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.649800+0000", 2024-09-12T18:36:00.121 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3748999999999997e-05 2024-09-12T18:36:00.121 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.121 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.121 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:00.122 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663215+0000", 2024-09-12T18:36:00.122 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013414733999999999 2024-09-12T18:36:00.122 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.122 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.122 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:00.122 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663304+0000", 2024-09-12T18:36:00.122 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.9235999999999997e-05 2024-09-12T18:36:00.122 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:00.122 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:00.122 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:00.122 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.122 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.122 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T18:36:00.123 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.648176+0000", 2024-09-12T18:36:00.123 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 34.412567752999998, 2024-09-12T18:36:00.123 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015315812, 2024-09-12T18:36:00.123 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:00.123 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:00.123 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:00.123 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:00.123 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.123 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:00.123 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648176+0000", 2024-09-12T18:36:00.123 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:00.123 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.123 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.123 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:00.124 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648176+0000", 2024-09-12T18:36:00.124 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:00.124 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.124 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.124 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:00.124 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648176+0000", 2024-09-12T18:36:00.124 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.9400000000000005e-07 2024-09-12T18:36:00.124 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.124 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.124 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:00.124 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648184+0000", 2024-09-12T18:36:00.124 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4730000000000003e-06 2024-09-12T18:36:00.124 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.125 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.125 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:00.125 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648201+0000", 2024-09-12T18:36:00.125 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7119999999999999e-05 2024-09-12T18:36:00.125 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.125 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.125 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.125 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648214+0000", 2024-09-12T18:36:00.125 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3343000000000001e-05 2024-09-12T18:36:00.125 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.125 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.125 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:00.125 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651085+0000", 2024-09-12T18:36:00.125 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0028710850000000002 2024-09-12T18:36:00.126 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.126 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.126 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:00.126 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651114+0000", 2024-09-12T18:36:00.126 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.8296000000000001e-05 2024-09-12T18:36:00.126 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.126 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.126 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:00.126 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663360+0000", 2024-09-12T18:36:00.126 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012246801999999999 2024-09-12T18:36:00.126 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.126 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.126 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:00.127 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663491+0000", 2024-09-12T18:36:00.127 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000130999 2024-09-12T18:36:00.127 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:00.127 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:00.127 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:00.127 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.127 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.127 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T18:36:00.127 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.648235+0000", 2024-09-12T18:36:00.127 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 34.412508213000002, 2024-09-12T18:36:00.127 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015168310000000001, 2024-09-12T18:36:00.127 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:00.127 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:00.127 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:00.128 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:00.128 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.128 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:00.128 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648235+0000", 2024-09-12T18:36:00.128 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:00.128 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.128 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.128 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:00.128 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648235+0000", 2024-09-12T18:36:00.128 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:00.128 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.128 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.128 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:00.128 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648236+0000", 2024-09-12T18:36:00.129 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5300000000000003e-07 2024-09-12T18:36:00.129 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.129 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.129 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:00.129 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648244+0000", 2024-09-12T18:36:00.129 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.7170000000000008e-06 2024-09-12T18:36:00.129 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.129 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.129 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:00.129 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648259+0000", 2024-09-12T18:36:00.129 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5126000000000001e-05 2024-09-12T18:36:00.129 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.129 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.130 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.130 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648270+0000", 2024-09-12T18:36:00.130 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0933e-05 2024-09-12T18:36:00.130 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.130 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.130 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:00.130 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.650395+0000", 2024-09-12T18:36:00.130 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0021251040000000001 2024-09-12T18:36:00.130 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.130 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.130 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:00.130 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.650444+0000", 2024-09-12T18:36:00.130 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9456000000000002e-05 2024-09-12T18:36:00.130 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.131 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.131 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:00.131 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663311+0000", 2024-09-12T18:36:00.131 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012866658 2024-09-12T18:36:00.131 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.131 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.131 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:00.131 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663403+0000", 2024-09-12T18:36:00.131 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2563000000000001e-05 2024-09-12T18:36:00.131 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:00.131 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:00.131 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:00.131 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.131 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.131 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:62 5.6 5:67709b9f:::benchmark_data_smithi073_23739_object61:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:36:00.132 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:45.898027+0000", 2024-09-12T18:36:00.132 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 14.162716442000001, 2024-09-12T18:36:00.132 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.014007786, 2024-09-12T18:36:00.132 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:00.132 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:00.132 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:00.132 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:00.132 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:00.132 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:00.132 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 62 2024-09-12T18:36:00.132 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.132 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:00.132 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.133 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:00.133 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.898027+0000", 2024-09-12T18:36:00.133 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:00.133 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.133 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.133 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:00.133 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.898027+0000", 2024-09-12T18:36:00.133 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:00.133 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.133 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.133 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:00.133 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.898029+0000", 2024-09-12T18:36:00.133 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.554e-06 2024-09-12T18:36:00.133 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.134 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.134 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:00.134 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.898164+0000", 2024-09-12T18:36:00.134 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000134719 2024-09-12T18:36:00.134 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.134 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.134 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:00.134 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.898186+0000", 2024-09-12T18:36:00.134 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1449000000000001e-05 2024-09-12T18:36:00.134 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.134 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.134 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.134 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.898199+0000", 2024-09-12T18:36:00.134 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3403e-05 2024-09-12T18:36:00.134 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.135 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.135 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:00.135 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.900978+0000", 2024-09-12T18:36:00.135 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0027789260000000001 2024-09-12T18:36:00.135 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.135 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.135 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:00.135 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.901163+0000", 2024-09-12T18:36:00.135 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00018457200000000001 2024-09-12T18:36:00.135 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.135 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.135 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:00.135 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.901378+0000", 2024-09-12T18:36:00.136 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00021581500000000001 2024-09-12T18:36:00.136 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.136 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.136 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:00.136 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.905487+0000", 2024-09-12T18:36:00.136 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0041085679999999999 2024-09-12T18:36:00.136 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.136 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.136 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:00.136 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.911778+0000", 2024-09-12T18:36:00.136 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0062909690000000004 2024-09-12T18:36:00.136 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.136 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.137 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:00.137 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.911923+0000", 2024-09-12T18:36:00.137 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014524199999999999 2024-09-12T18:36:00.137 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.137 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.137 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:00.137 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.912035+0000", 2024-09-12T18:36:00.137 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000111569 2024-09-12T18:36:00.137 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:00.137 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:00.137 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:00.137 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.137 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.138 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:19809 5.c 5:3c729fea:::benchmark_data_smithi073_23739_object19808:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:36:00.138 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:51.970320+0000", 2024-09-12T18:36:00.138 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 8.0904231650000007, 2024-09-12T18:36:00.138 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.014749093, 2024-09-12T18:36:00.138 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:00.138 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:00.138 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:00.138 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:00.138 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:00.138 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:00.138 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 19809 2024-09-12T18:36:00.138 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.138 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:00.138 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.139 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:00.139 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.970320+0000", 2024-09-12T18:36:00.139 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:00.139 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.139 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.139 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:00.139 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.970320+0000", 2024-09-12T18:36:00.139 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:00.139 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.139 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.139 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:00.139 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.970321+0000", 2024-09-12T18:36:00.139 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1999999999999998e-07 2024-09-12T18:36:00.139 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.140 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.140 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:00.140 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.971120+0000", 2024-09-12T18:36:00.140 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00079864400000000005 2024-09-12T18:36:00.140 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.140 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.140 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:00.140 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.971132+0000", 2024-09-12T18:36:00.140 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2021000000000001e-05 2024-09-12T18:36:00.140 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.140 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.140 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.140 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.971139+0000", 2024-09-12T18:36:00.141 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5070000000000003e-06 2024-09-12T18:36:00.141 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.141 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.141 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:00.141 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.971181+0000", 2024-09-12T18:36:00.141 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.1430999999999997e-05 2024-09-12T18:36:00.141 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.141 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.141 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:00.141 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.971271+0000", 2024-09-12T18:36:00.141 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.0098000000000004e-05 2024-09-12T18:36:00.141 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.141 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.141 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:00.142 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.971351+0000", 2024-09-12T18:36:00.142 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0370999999999993e-05 2024-09-12T18:36:00.142 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.142 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.142 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:00.142 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.972563+0000", 2024-09-12T18:36:00.142 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0012113549999999999 2024-09-12T18:36:00.142 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.142 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.142 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:00.142 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.984988+0000", 2024-09-12T18:36:00.142 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012425808999999999 2024-09-12T18:36:00.142 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.142 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.143 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:00.143 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.985036+0000", 2024-09-12T18:36:00.143 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.7703000000000001e-05 2024-09-12T18:36:00.143 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.143 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.143 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:00.143 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.985069+0000", 2024-09-12T18:36:00.143 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3234000000000001e-05 2024-09-12T18:36:00.143 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:00.143 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:00.143 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:00.143 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.143 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.144 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:31882 5.5 5:ad03140d:::benchmark_data_smithi073_23739_object31881:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T18:36:00.144 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:56.433012+0000", 2024-09-12T18:36:00.144 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 3.6277309899999999, 2024-09-12T18:36:00.144 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.014156314, 2024-09-12T18:36:00.144 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:00.144 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:00.144 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:00.144 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:00.144 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:00.144 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:00.144 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 31882 2024-09-12T18:36:00.144 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.144 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:00.144 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.145 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:00.145 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.433012+0000", 2024-09-12T18:36:00.145 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:00.145 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.145 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.145 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:00.145 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.433012+0000", 2024-09-12T18:36:00.145 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:00.145 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.145 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.145 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:00.145 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.433014+0000", 2024-09-12T18:36:00.145 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.274e-06 2024-09-12T18:36:00.146 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.146 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.146 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:00.146 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.433091+0000", 2024-09-12T18:36:00.146 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.7343999999999997e-05 2024-09-12T18:36:00.146 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.146 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.146 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:00.146 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.433103+0000", 2024-09-12T18:36:00.146 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1987999999999999e-05 2024-09-12T18:36:00.146 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.146 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.146 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.146 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.433112+0000", 2024-09-12T18:36:00.147 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.0750000000000004e-06 2024-09-12T18:36:00.147 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.147 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.147 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:00.147 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.433177+0000", 2024-09-12T18:36:00.147 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4682000000000002e-05 2024-09-12T18:36:00.147 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.147 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.147 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:00.147 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.433336+0000", 2024-09-12T18:36:00.147 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015913400000000001 2024-09-12T18:36:00.147 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.147 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.147 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:00.148 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.433530+0000", 2024-09-12T18:36:00.148 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00019447799999999999 2024-09-12T18:36:00.148 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.148 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.148 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:00.148 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.439096+0000", 2024-09-12T18:36:00.148 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0055656789999999996 2024-09-12T18:36:00.148 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.148 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.148 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:00.148 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.447106+0000", 2024-09-12T18:36:00.148 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0080096230000000004 2024-09-12T18:36:00.148 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.149 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.149 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:00.149 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.447141+0000", 2024-09-12T18:36:00.149 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.5771e-05 2024-09-12T18:36:00.149 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.149 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.149 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:00.149 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.447169+0000", 2024-09-12T18:36:00.149 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7265999999999999e-05 2024-09-12T18:36:00.149 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:00.149 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:00.149 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:00.149 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.150 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.150 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:31884 5.5 5:a6755fd3:::benchmark_data_smithi073_23739_object31883:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T18:36:00.150 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:56.433445+0000", 2024-09-12T18:36:00.150 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 3.627298175, 2024-09-12T18:36:00.150 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.014045701000000001, 2024-09-12T18:36:00.150 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:00.150 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:00.150 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:00.150 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:00.150 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:00.150 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:00.150 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 31884 2024-09-12T18:36:00.150 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.151 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:00.151 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.151 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:00.151 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.433445+0000", 2024-09-12T18:36:00.151 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:00.151 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.151 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.151 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:00.151 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.433445+0000", 2024-09-12T18:36:00.151 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:00.151 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.151 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.151 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:00.151 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.433446+0000", 2024-09-12T18:36:00.152 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6799999999999999e-07 2024-09-12T18:36:00.152 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.152 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.152 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:00.152 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.433506+0000", 2024-09-12T18:36:00.152 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.0395e-05 2024-09-12T18:36:00.152 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.152 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.152 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:00.152 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.433516+0000", 2024-09-12T18:36:00.152 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.7440000000000002e-06 2024-09-12T18:36:00.152 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.152 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.152 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.153 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.433523+0000", 2024-09-12T18:36:00.153 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8299999999999998e-06 2024-09-12T18:36:00.153 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.153 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.153 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:00.153 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.434830+0000", 2024-09-12T18:36:00.153 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0013073990000000001 2024-09-12T18:36:00.153 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.153 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.153 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:00.154 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.434969+0000", 2024-09-12T18:36:00.154 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013848899999999999 2024-09-12T18:36:00.154 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.154 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.154 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:00.154 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.435078+0000", 2024-09-12T18:36:00.154 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00010863599999999999 2024-09-12T18:36:00.154 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.154 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.154 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:00.154 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.439195+0000", 2024-09-12T18:36:00.154 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0041172530000000004 2024-09-12T18:36:00.154 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.154 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.155 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:00.155 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.447439+0000", 2024-09-12T18:36:00.155 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0082444249999999997 2024-09-12T18:36:00.155 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.155 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.155 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:00.155 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.447470+0000", 2024-09-12T18:36:00.155 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.0324999999999998e-05 2024-09-12T18:36:00.155 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.155 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.155 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:00.155 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.447491+0000", 2024-09-12T18:36:00.155 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1336999999999999e-05 2024-09-12T18:36:00.156 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:00.156 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:00.156 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:00.156 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.156 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.156 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:38546 5.a 5:57563cdc:::benchmark_data_smithi073_23739_object38545:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:00.156 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:59.131733+0000", 2024-09-12T18:36:00.156 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.92901014900000001, 2024-09-12T18:36:00.156 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.01374713, 2024-09-12T18:36:00.156 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:00.156 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:00.156 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:00.156 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:00.157 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:00.157 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:00.157 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 38546 2024-09-12T18:36:00.157 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.157 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:00.157 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.157 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:00.157 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.131733+0000", 2024-09-12T18:36:00.157 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:00.157 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.157 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.157 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:00.157 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.131733+0000", 2024-09-12T18:36:00.158 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:00.158 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.158 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.158 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:00.158 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.131734+0000", 2024-09-12T18:36:00.158 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5799999999999998e-07 2024-09-12T18:36:00.158 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.158 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.158 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:00.158 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.131822+0000", 2024-09-12T18:36:00.158 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.8424999999999994e-05 2024-09-12T18:36:00.158 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.158 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.159 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:00.159 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.131831+0000", 2024-09-12T18:36:00.159 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.4840000000000004e-06 2024-09-12T18:36:00.159 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.159 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.159 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.159 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.131836+0000", 2024-09-12T18:36:00.159 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9660000000000004e-06 2024-09-12T18:36:00.159 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.159 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.159 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:00.159 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.133322+0000", 2024-09-12T18:36:00.159 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001485566 2024-09-12T18:36:00.160 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.160 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.160 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:00.160 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.133429+0000", 2024-09-12T18:36:00.160 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00010706599999999999 2024-09-12T18:36:00.160 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.160 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.160 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:00.160 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.133540+0000", 2024-09-12T18:36:00.160 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000111489 2024-09-12T18:36:00.160 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.160 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.160 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:00.161 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.138339+0000", 2024-09-12T18:36:00.161 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0047985420000000003 2024-09-12T18:36:00.161 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.161 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.161 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:00.161 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.145432+0000", 2024-09-12T18:36:00.161 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0070932959999999998 2024-09-12T18:36:00.161 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.161 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.161 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:00.161 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.145460+0000", 2024-09-12T18:36:00.161 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7823000000000001e-05 2024-09-12T18:36:00.161 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.162 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.162 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:00.162 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.145480+0000", 2024-09-12T18:36:00.162 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.0615000000000002e-05 2024-09-12T18:36:00.162 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:00.162 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:00.162 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:00.162 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.162 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.162 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:39360 5.6 5:6598b6f3:::benchmark_data_smithi073_23739_object39359:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:00.162 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:59.459787+0000", 2024-09-12T18:36:00.162 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.60095683799999999, 2024-09-12T18:36:00.162 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.014801007, 2024-09-12T18:36:00.162 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:00.163 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:00.163 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:00.163 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:00.163 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:00.163 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:00.163 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 39360 2024-09-12T18:36:00.163 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.163 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:00.163 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.163 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:00.163 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.459787+0000", 2024-09-12T18:36:00.163 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:00.163 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.164 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.164 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:00.164 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.459787+0000", 2024-09-12T18:36:00.164 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:00.164 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.164 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.164 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:00.164 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.459787+0000", 2024-09-12T18:36:00.164 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3e-07 2024-09-12T18:36:00.164 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.164 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.164 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:00.164 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.459845+0000", 2024-09-12T18:36:00.165 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7516000000000003e-05 2024-09-12T18:36:00.165 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.165 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.165 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:00.165 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.459857+0000", 2024-09-12T18:36:00.165 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1854e-05 2024-09-12T18:36:00.165 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.165 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.165 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.165 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.459862+0000", 2024-09-12T18:36:00.165 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7640000000000002e-06 2024-09-12T18:36:00.165 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.165 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.165 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:00.166 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.459918+0000", 2024-09-12T18:36:00.166 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5958000000000002e-05 2024-09-12T18:36:00.166 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.166 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.166 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:00.166 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.460099+0000", 2024-09-12T18:36:00.166 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000180485 2024-09-12T18:36:00.166 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.166 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.166 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:00.166 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.460214+0000", 2024-09-12T18:36:00.166 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000115649 2024-09-12T18:36:00.166 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.167 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.167 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:00.167 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.462160+0000", 2024-09-12T18:36:00.167 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0019455029999999999 2024-09-12T18:36:00.167 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.167 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.167 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:00.167 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.474494+0000", 2024-09-12T18:36:00.167 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012334443 2024-09-12T18:36:00.167 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.167 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.167 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:00.167 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.474547+0000", 2024-09-12T18:36:00.168 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2392000000000003e-05 2024-09-12T18:36:00.168 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.168 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.168 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:00.168 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.474588+0000", 2024-09-12T18:36:00.168 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0713000000000001e-05 2024-09-12T18:36:00.168 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:00.168 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:00.168 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:00.168 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.168 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.168 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:39659 5.3 5:cd2bc06c:::benchmark_data_smithi073_23739_object39658:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:00.168 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:59.582797+0000", 2024-09-12T18:36:00.168 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.477946806, 2024-09-12T18:36:00.169 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015424513000000001, 2024-09-12T18:36:00.169 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:00.169 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:00.169 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:00.169 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:00.169 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:00.169 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:00.169 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 39659 2024-09-12T18:36:00.169 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.169 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:00.169 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.169 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:00.170 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.582797+0000", 2024-09-12T18:36:00.170 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:00.170 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.170 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.170 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:00.170 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.582797+0000", 2024-09-12T18:36:00.170 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:00.170 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.170 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.170 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:00.170 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.582798+0000", 2024-09-12T18:36:00.170 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3769999999999999e-06 2024-09-12T18:36:00.170 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.170 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.171 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:00.171 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.582885+0000", 2024-09-12T18:36:00.171 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6601999999999995e-05 2024-09-12T18:36:00.171 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.171 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.171 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:00.171 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.582895+0000", 2024-09-12T18:36:00.171 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0232e-05 2024-09-12T18:36:00.171 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.171 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.171 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.171 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.582902+0000", 2024-09-12T18:36:00.171 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0330000000000003e-06 2024-09-12T18:36:00.172 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.172 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.172 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:00.172 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.582966+0000", 2024-09-12T18:36:00.172 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4493999999999996e-05 2024-09-12T18:36:00.172 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.172 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.172 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:00.172 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.583107+0000", 2024-09-12T18:36:00.172 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000140815 2024-09-12T18:36:00.172 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.172 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.173 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:00.173 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.583306+0000", 2024-09-12T18:36:00.173 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000199194 2024-09-12T18:36:00.173 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.173 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.173 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:00.173 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.585942+0000", 2024-09-12T18:36:00.173 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0026352960000000001 2024-09-12T18:36:00.173 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.173 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.173 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:00.173 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.598120+0000", 2024-09-12T18:36:00.173 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012178501 2024-09-12T18:36:00.173 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.174 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.174 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:00.174 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.598182+0000", 2024-09-12T18:36:00.174 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1550999999999994e-05 2024-09-12T18:36:00.174 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.174 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.174 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:00.174 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.598221+0000", 2024-09-12T18:36:00.174 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.9418000000000001e-05 2024-09-12T18:36:00.174 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:00.174 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:00.174 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:00.174 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.175 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.175 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:40507 5.e e30/21 5:729d4bc6:::benchmark_data_smithi073_23739_object40506:head v 30'2528, mlcod=30'2524)", 2024-09-12T18:36:00.175 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:59.950176+0000", 2024-09-12T18:36:00.175 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.11056785099999999, 2024-09-12T18:36:00.175 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015643424, 2024-09-12T18:36:00.175 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:00.175 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:00.175 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:00.175 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:00.175 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.175 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:00.175 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.950176+0000", 2024-09-12T18:36:00.175 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:00.175 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.176 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.176 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:00.176 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.950176+0000", 2024-09-12T18:36:00.176 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:00.176 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.176 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.176 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:00.176 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.950176+0000", 2024-09-12T18:36:00.176 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2600000000000001e-07 2024-09-12T18:36:00.176 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.176 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.176 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:00.176 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.950234+0000", 2024-09-12T18:36:00.176 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8137000000000003e-05 2024-09-12T18:36:00.177 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.177 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.177 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:00.177 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.950248+0000", 2024-09-12T18:36:00.177 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3981999999999999e-05 2024-09-12T18:36:00.177 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.177 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.177 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.177 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.950256+0000", 2024-09-12T18:36:00.177 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5970000000000003e-06 2024-09-12T18:36:00.177 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.177 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.177 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:00.178 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.950304+0000", 2024-09-12T18:36:00.178 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8111000000000001e-05 2024-09-12T18:36:00.178 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.178 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.178 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:00.178 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.950323+0000", 2024-09-12T18:36:00.178 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9303000000000001e-05 2024-09-12T18:36:00.178 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.178 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.178 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:00.178 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.965795+0000", 2024-09-12T18:36:00.178 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015471238999999999 2024-09-12T18:36:00.178 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:00.178 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:00.179 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:00.179 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.965819+0000", 2024-09-12T18:36:00.179 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4229000000000001e-05 2024-09-12T18:36:00.179 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:00.179 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:00.179 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:00.179 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:00.179 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:00.179 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:00.181 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:36:00.181 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:00.177+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:00.281 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:00.277+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:00.338 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:00.338 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:36:00.338 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.339 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:41415 5.9 e30/21 5:99c6a901:::benchmark_data_smithi073_23739_object41414:head v 30'2573, mlcod=30'2569)", 2024-09-12T18:36:00.339 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:00.333490+0000", 2024-09-12T18:36:00.339 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0052324069999999997, 2024-09-12T18:36:00.339 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052488880000000002, 2024-09-12T18:36:00.339 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:00.339 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:00.339 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:00.339 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:00.339 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.339 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:00.339 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.333490+0000", 2024-09-12T18:36:00.339 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.339 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.339 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.340 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:00.340 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.333490+0000", 2024-09-12T18:36:00.340 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.340 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.340 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.340 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:00.340 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.333491+0000", 2024-09-12T18:36:00.340 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9400000000000004e-07 2024-09-12T18:36:00.340 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.340 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.340 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:00.340 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.333541+0000", 2024-09-12T18:36:00.340 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.041e-05 2024-09-12T18:36:00.340 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.341 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.341 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:00.341 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.333549+0000", 2024-09-12T18:36:00.341 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9670000000000001e-06 2024-09-12T18:36:00.341 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.341 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.341 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.341 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.333554+0000", 2024-09-12T18:36:00.341 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7160000000000002e-06 2024-09-12T18:36:00.341 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.341 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.341 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:00.341 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.333603+0000", 2024-09-12T18:36:00.341 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9626000000000002e-05 2024-09-12T18:36:00.342 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.342 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.342 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:00.342 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.333623+0000", 2024-09-12T18:36:00.342 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0125000000000001e-05 2024-09-12T18:36:00.342 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.342 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:00.342 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.342 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.342 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.342 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:41417 5.d 5:b2724cac:::benchmark_data_smithi073_23739_object41416:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:00.342 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:00.334075+0000", 2024-09-12T18:36:00.342 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0046471990000000003, 2024-09-12T18:36:00.343 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0047004550000000001, 2024-09-12T18:36:00.343 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:00.343 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:00.343 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:00.343 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:00.343 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:00.343 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:00.343 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 41417 2024-09-12T18:36:00.343 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.343 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:00.343 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.343 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:00.343 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.334075+0000", 2024-09-12T18:36:00.343 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.344 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.344 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.344 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:00.344 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.334075+0000", 2024-09-12T18:36:00.344 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.344 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.344 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.344 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:00.344 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.334076+0000", 2024-09-12T18:36:00.344 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.291e-06 2024-09-12T18:36:00.344 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.344 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.344 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:00.344 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.334110+0000", 2024-09-12T18:36:00.345 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3725e-05 2024-09-12T18:36:00.345 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.345 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.345 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:00.345 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.334122+0000", 2024-09-12T18:36:00.345 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2072999999999999e-05 2024-09-12T18:36:00.345 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.345 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.345 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.345 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.334128+0000", 2024-09-12T18:36:00.345 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6629999999999998e-06 2024-09-12T18:36:00.345 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.345 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.345 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:00.346 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.334172+0000", 2024-09-12T18:36:00.346 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4651999999999999e-05 2024-09-12T18:36:00.346 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.346 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.346 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:00.346 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.334263+0000", 2024-09-12T18:36:00.346 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.1143999999999993e-05 2024-09-12T18:36:00.346 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.346 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.346 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:00.346 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.334347+0000", 2024-09-12T18:36:00.346 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3733000000000006e-05 2024-09-12T18:36:00.346 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.346 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.347 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:00.347 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.337238+0000", 2024-09-12T18:36:00.347 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002891275 2024-09-12T18:36:00.347 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.347 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:00.347 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.347 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.347 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.347 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:41421 5.e 5:750795bb:::benchmark_data_smithi073_23739_object41420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:00.347 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:00.335341+0000", 2024-09-12T18:36:00.347 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0033815239999999999, 2024-09-12T18:36:00.347 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0034754489999999998, 2024-09-12T18:36:00.347 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:00.347 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:00.348 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:00.348 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:00.348 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:00.348 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:00.348 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 41421 2024-09-12T18:36:00.348 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.348 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:00.348 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.348 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:00.348 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.335341+0000", 2024-09-12T18:36:00.348 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.348 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.348 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.349 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:00.349 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.335341+0000", 2024-09-12T18:36:00.349 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.349 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.349 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.349 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:00.349 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.335342+0000", 2024-09-12T18:36:00.349 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.08e-06 2024-09-12T18:36:00.349 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.349 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.349 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:00.349 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.335449+0000", 2024-09-12T18:36:00.349 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010729400000000001 2024-09-12T18:36:00.349 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.350 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.350 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:00.350 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.335462+0000", 2024-09-12T18:36:00.350 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3448000000000001e-05 2024-09-12T18:36:00.350 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.350 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.350 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.350 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.335470+0000", 2024-09-12T18:36:00.350 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.8720000000000002e-06 2024-09-12T18:36:00.350 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.350 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.350 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:00.350 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.335633+0000", 2024-09-12T18:36:00.350 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016220500000000001 2024-09-12T18:36:00.350 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.351 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.351 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:00.351 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.335739+0000", 2024-09-12T18:36:00.351 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000106959 2024-09-12T18:36:00.351 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.351 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.351 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:00.351 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.335825+0000", 2024-09-12T18:36:00.351 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5906e-05 2024-09-12T18:36:00.351 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.351 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.351 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:00.351 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.338501+0000", 2024-09-12T18:36:00.351 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0026759869999999999 2024-09-12T18:36:00.352 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.352 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:00.352 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.352 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.352 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.352 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:41419 5.9 e30/21 5:9b324ef1:::benchmark_data_smithi073_23739_object41418:head v 30'2574, mlcod=30'2570)", 2024-09-12T18:36:00.352 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:00.335835+0000", 2024-09-12T18:36:00.352 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0028874690000000001, 2024-09-12T18:36:00.352 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003018181, 2024-09-12T18:36:00.352 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:00.352 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:00.352 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:00.352 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:00.352 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.353 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:00.353 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.335835+0000", 2024-09-12T18:36:00.353 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.353 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.353 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.353 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:00.353 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.335835+0000", 2024-09-12T18:36:00.353 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.353 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.353 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.353 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:00.353 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.335835+0000", 2024-09-12T18:36:00.353 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4700000000000001e-07 2024-09-12T18:36:00.353 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.354 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.354 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:00.354 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.335930+0000", 2024-09-12T18:36:00.354 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4462000000000005e-05 2024-09-12T18:36:00.354 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.354 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.354 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:00.354 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.335942+0000", 2024-09-12T18:36:00.354 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.184e-05 2024-09-12T18:36:00.354 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.354 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.354 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.354 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.335948+0000", 2024-09-12T18:36:00.354 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4370000000000004e-06 2024-09-12T18:36:00.355 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.355 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.355 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:00.355 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.336046+0000", 2024-09-12T18:36:00.355 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.7787000000000004e-05 2024-09-12T18:36:00.355 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.355 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.355 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:00.355 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.336089+0000", 2024-09-12T18:36:00.355 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2794999999999999e-05 2024-09-12T18:36:00.355 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.355 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:00.355 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.355 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.355 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.356 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:41422 5.a e30/21 5:5b55599c:::benchmark_data_smithi073_23739_object41421:head v 30'2621, mlcod=30'2618)", 2024-09-12T18:36:00.356 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:00.335868+0000", 2024-09-12T18:36:00.356 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0028545100000000002, 2024-09-12T18:36:00.356 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0030113000000000002, 2024-09-12T18:36:00.356 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:00.356 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:00.356 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:00.356 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:00.356 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.356 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:00.356 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.335868+0000", 2024-09-12T18:36:00.356 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.356 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.357 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.357 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:00.357 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.335868+0000", 2024-09-12T18:36:00.357 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.357 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.357 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.357 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:00.357 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.335869+0000", 2024-09-12T18:36:00.357 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.3699999999999999e-07 2024-09-12T18:36:00.357 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.357 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.357 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:00.357 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.335964+0000", 2024-09-12T18:36:00.357 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5849999999999999e-05 2024-09-12T18:36:00.358 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.358 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.358 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:00.358 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.335977+0000", 2024-09-12T18:36:00.358 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2965e-05 2024-09-12T18:36:00.358 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.358 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.358 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.358 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.335985+0000", 2024-09-12T18:36:00.358 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2509999999999997e-06 2024-09-12T18:36:00.358 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.358 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.358 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:00.358 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.336053+0000", 2024-09-12T18:36:00.359 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8634999999999996e-05 2024-09-12T18:36:00.359 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.359 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.359 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:00.359 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.336070+0000", 2024-09-12T18:36:00.359 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6891000000000001e-05 2024-09-12T18:36:00.359 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.359 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:00.359 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.359 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.359 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.359 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:41425 5.8 5:1e81aac1:::benchmark_data_smithi073_23739_object41424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:00.359 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:00.335998+0000", 2024-09-12T18:36:00.359 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00272368, 2024-09-12T18:36:00.360 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0029099490000000002, 2024-09-12T18:36:00.360 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:00.360 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:00.360 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:00.360 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:00.360 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:00.360 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:00.360 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 41425 2024-09-12T18:36:00.360 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.360 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:00.360 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.360 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:00.360 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.335998+0000", 2024-09-12T18:36:00.360 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.361 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.361 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.361 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:00.361 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.335998+0000", 2024-09-12T18:36:00.361 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.361 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.361 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.361 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:00.361 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.335999+0000", 2024-09-12T18:36:00.361 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5499999999999997e-07 2024-09-12T18:36:00.361 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.361 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.361 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:00.361 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.336084+0000", 2024-09-12T18:36:00.362 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4416e-05 2024-09-12T18:36:00.362 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.362 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.362 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:00.362 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.336093+0000", 2024-09-12T18:36:00.362 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9039999999999998e-06 2024-09-12T18:36:00.362 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.362 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.362 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.362 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.336099+0000", 2024-09-12T18:36:00.362 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8329999999999996e-06 2024-09-12T18:36:00.362 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.362 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.363 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:00.363 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.336162+0000", 2024-09-12T18:36:00.363 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2399999999999999e-05 2024-09-12T18:36:00.363 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.363 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.363 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:00.363 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.336305+0000", 2024-09-12T18:36:00.363 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000143082 2024-09-12T18:36:00.364 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.364 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.364 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:00.364 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.336445+0000", 2024-09-12T18:36:00.364 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014012900000000001 2024-09-12T18:36:00.364 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.364 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:00.364 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.364 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.364 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.364 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:41423 5.f e30/21 5:faaeec8f:::benchmark_data_smithi073_23739_object41422:head v 30'2642, mlcod=30'2639)", 2024-09-12T18:36:00.364 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:00.336027+0000", 2024-09-12T18:36:00.364 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0026955210000000002, 2024-09-12T18:36:00.364 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002914186, 2024-09-12T18:36:00.365 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:00.365 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:00.365 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:00.365 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:00.365 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.365 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:00.365 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.336027+0000", 2024-09-12T18:36:00.365 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.365 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.365 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.365 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:00.365 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.336027+0000", 2024-09-12T18:36:00.365 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.365 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.366 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.366 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:00.366 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.336027+0000", 2024-09-12T18:36:00.366 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2199999999999999e-07 2024-09-12T18:36:00.366 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.366 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.366 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:00.366 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.336147+0000", 2024-09-12T18:36:00.366 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000119954 2024-09-12T18:36:00.366 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.366 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.366 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:00.366 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.336154+0000", 2024-09-12T18:36:00.367 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2439999999999996e-06 2024-09-12T18:36:00.367 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.367 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.367 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.367 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.336159+0000", 2024-09-12T18:36:00.367 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9910000000000002e-06 2024-09-12T18:36:00.367 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.367 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.367 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:00.367 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.336206+0000", 2024-09-12T18:36:00.367 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6411e-05 2024-09-12T18:36:00.367 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.367 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.367 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:00.367 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.336228+0000", 2024-09-12T18:36:00.368 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1999999999999999e-05 2024-09-12T18:36:00.368 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.368 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:00.368 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.368 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.368 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.368 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:41426 5.8 5:16ba5b9c:::benchmark_data_smithi073_23739_object41425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:00.368 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:00.337235+0000", 2024-09-12T18:36:00.368 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0014867439999999999, 2024-09-12T18:36:00.368 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001736263, 2024-09-12T18:36:00.368 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:00.368 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:00.368 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:00.369 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:00.369 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:00.369 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:00.369 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 41426 2024-09-12T18:36:00.369 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.369 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:00.369 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.369 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:00.369 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.337235+0000", 2024-09-12T18:36:00.369 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.369 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.369 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.369 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:00.369 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.337235+0000", 2024-09-12T18:36:00.370 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.370 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.370 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.370 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:00.370 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.337237+0000", 2024-09-12T18:36:00.370 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.407e-06 2024-09-12T18:36:00.370 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.370 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.370 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:00.370 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.337315+0000", 2024-09-12T18:36:00.370 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7730000000000003e-05 2024-09-12T18:36:00.370 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.370 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.370 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:00.371 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.337324+0000", 2024-09-12T18:36:00.371 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8120000000000002e-06 2024-09-12T18:36:00.371 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.371 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.371 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.371 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.337332+0000", 2024-09-12T18:36:00.371 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7829999999999999e-06 2024-09-12T18:36:00.371 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.371 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.371 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:00.371 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.338101+0000", 2024-09-12T18:36:00.371 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00076850400000000004 2024-09-12T18:36:00.371 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.371 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.372 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:00.372 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.338195+0000", 2024-09-12T18:36:00.372 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4006999999999996e-05 2024-09-12T18:36:00.372 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.372 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.372 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:00.372 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.338274+0000", 2024-09-12T18:36:00.372 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9079000000000006e-05 2024-09-12T18:36:00.372 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.372 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:00.372 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.372 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.372 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.372 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:41429 5.b 5:debba789:::benchmark_data_smithi073_23739_object41428:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:00.373 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:00.338002+0000", 2024-09-12T18:36:00.373 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00072044700000000004, 2024-09-12T18:36:00.373 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0010038639999999999, 2024-09-12T18:36:00.373 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:00.373 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:00.373 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:00.373 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:00.373 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:00.373 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:00.373 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 41429 2024-09-12T18:36:00.373 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.373 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:00.373 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.373 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:00.374 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.338002+0000", 2024-09-12T18:36:00.374 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.374 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.374 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.374 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:00.374 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.338002+0000", 2024-09-12T18:36:00.374 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.374 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.374 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.374 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:00.374 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.338003+0000", 2024-09-12T18:36:00.374 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6500000000000008e-07 2024-09-12T18:36:00.374 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.374 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.375 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:00.375 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.338064+0000", 2024-09-12T18:36:00.375 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1241999999999994e-05 2024-09-12T18:36:00.375 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.375 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.375 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:00.375 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.338074+0000", 2024-09-12T18:36:00.375 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0464e-05 2024-09-12T18:36:00.375 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.375 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.375 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.375 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.338082+0000", 2024-09-12T18:36:00.375 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.8599999999999993e-06 2024-09-12T18:36:00.375 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.376 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.376 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:00.376 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.338132+0000", 2024-09-12T18:36:00.376 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0067e-05 2024-09-12T18:36:00.376 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.376 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.376 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:00.376 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.338224+0000", 2024-09-12T18:36:00.376 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.1428000000000006e-05 2024-09-12T18:36:00.376 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.376 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.376 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:00.376 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.338299+0000", 2024-09-12T18:36:00.377 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5023000000000003e-05 2024-09-12T18:36:00.377 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.377 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:00.377 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.377 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.377 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.377 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:41431 5.8 5.da555718 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:00.377 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:00.338272+0000", 2024-09-12T18:36:00.377 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.000450121, 2024-09-12T18:36:00.377 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00076456500000000004, 2024-09-12T18:36:00.377 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:00.377 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:00.377 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:00.378 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:00.378 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:00.378 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:00.378 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 41431 2024-09-12T18:36:00.378 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.378 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:00.378 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.378 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:00.378 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.338272+0000", 2024-09-12T18:36:00.378 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.378 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.378 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.378 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:00.378 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.338272+0000", 2024-09-12T18:36:00.379 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.379 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.379 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.379 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:00.379 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.338273+0000", 2024-09-12T18:36:00.379 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.1800000000000004e-07 2024-09-12T18:36:00.379 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.379 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.379 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:00.379 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.338417+0000", 2024-09-12T18:36:00.379 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000143948 2024-09-12T18:36:00.379 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.379 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.379 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:00.380 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.338427+0000", 2024-09-12T18:36:00.380 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8689999999999999e-06 2024-09-12T18:36:00.380 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.380 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.380 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.380 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.338433+0000", 2024-09-12T18:36:00.380 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.737e-06 2024-09-12T18:36:00.380 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.380 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:00.380 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.380 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.380 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-09-12T18:36:00.380 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 10 2024-09-12T18:36:00.381 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:00.382 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:36:00.383 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:00.378+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:00.403 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T18:36:00.482 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:00.478+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:00.577 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:00.577 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-09-12T18:36:00.577 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-09-12T18:36:00.577 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-09-12T18:36:00.577 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:00.583 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:00.581+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:00.598 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:36:00.684 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:00.678+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:00.754 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:00.755 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-09-12T18:36:00.755 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-09-12T18:36:00.755 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:36:00.755 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.755 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:00.755 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:00.755 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 35.121119221000001, 2024-09-12T18:36:00.755 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025088781000000001, 2024-09-12T18:36:00.755 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:00.755 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:00.756 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:00.756 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:00.756 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.756 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:00.756 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:00.756 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.756 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.756 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.756 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:00.756 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:00.756 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.756 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.757 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.757 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:00.757 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632518+0000", 2024-09-12T18:36:00.757 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:36:00.757 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.757 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.757 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:00.757 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632533+0000", 2024-09-12T18:36:00.757 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5130000000000001e-05 2024-09-12T18:36:00.757 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.757 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.757 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:00.757 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632564+0000", 2024-09-12T18:36:00.758 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0788999999999999e-05 2024-09-12T18:36:00.758 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.758 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.758 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.758 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632590+0000", 2024-09-12T18:36:00.758 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6057000000000001e-05 2024-09-12T18:36:00.758 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.758 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.758 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:00.759 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.635931+0000", 2024-09-12T18:36:00.759 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033411320000000001 2024-09-12T18:36:00.759 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.759 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.759 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:00.759 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636186+0000", 2024-09-12T18:36:00.759 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025452500000000002 2024-09-12T18:36:00.759 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.759 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.759 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:00.759 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636445+0000", 2024-09-12T18:36:00.759 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000259268 2024-09-12T18:36:00.759 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.760 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.760 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:00.760 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639562+0000", 2024-09-12T18:36:00.760 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031167 2024-09-12T18:36:00.760 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.760 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.760 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:00.760 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657314+0000", 2024-09-12T18:36:00.760 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017752562 2024-09-12T18:36:00.760 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.760 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.760 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:00.760 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657445+0000", 2024-09-12T18:36:00.761 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013105899999999999 2024-09-12T18:36:00.761 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.761 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.761 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:00.761 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657598+0000", 2024-09-12T18:36:00.761 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015247899999999999 2024-09-12T18:36:00.761 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.761 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:00.761 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.761 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.761 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.761 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:00.762 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:00.762 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 35.120993018, 2024-09-12T18:36:00.762 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025643131999999999, 2024-09-12T18:36:00.762 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:00.762 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:00.762 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:00.762 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:00.762 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.762 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:00.762 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:00.762 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.762 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.762 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.763 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:00.763 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:00.763 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.763 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.763 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.763 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:00.763 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632637+0000", 2024-09-12T18:36:00.763 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5600000000000001e-06 2024-09-12T18:36:00.763 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.763 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.763 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:00.763 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632650+0000", 2024-09-12T18:36:00.763 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3186e-05 2024-09-12T18:36:00.763 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.764 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.764 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:00.764 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632672+0000", 2024-09-12T18:36:00.764 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2013000000000001e-05 2024-09-12T18:36:00.764 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.764 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.764 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.764 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632687+0000", 2024-09-12T18:36:00.764 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5109999999999999e-05 2024-09-12T18:36:00.764 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.764 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.764 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:00.764 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636994+0000", 2024-09-12T18:36:00.765 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0043065539999999998 2024-09-12T18:36:00.765 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.765 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.765 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:00.765 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637198+0000", 2024-09-12T18:36:00.765 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020387199999999999 2024-09-12T18:36:00.765 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.765 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.765 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:00.765 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637475+0000", 2024-09-12T18:36:00.765 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027731000000000001 2024-09-12T18:36:00.766 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.766 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.766 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:00.766 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639574+0000", 2024-09-12T18:36:00.766 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020988999999999999 2024-09-12T18:36:00.766 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.766 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.766 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:00.766 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658057+0000", 2024-09-12T18:36:00.766 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018482926 2024-09-12T18:36:00.766 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.766 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.766 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:00.766 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658184+0000", 2024-09-12T18:36:00.767 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012756200000000001 2024-09-12T18:36:00.767 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.767 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.767 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:00.767 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658278+0000", 2024-09-12T18:36:00.767 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4139000000000001e-05 2024-09-12T18:36:00.767 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.767 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:00.768 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.768 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.768 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.768 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:00.768 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:00.768 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 35.120917925999997, 2024-09-12T18:36:00.768 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025238883, 2024-09-12T18:36:00.768 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:00.768 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:00.768 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:00.768 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:00.768 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.768 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:00.769 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:00.769 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.769 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.769 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.769 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:00.769 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:00.769 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.769 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.769 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.769 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:00.770 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632712+0000", 2024-09-12T18:36:00.770 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6869999999999999e-06 2024-09-12T18:36:00.770 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.770 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.770 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:00.770 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632719+0000", 2024-09-12T18:36:00.770 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6059999999999999e-06 2024-09-12T18:36:00.770 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.770 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.770 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:00.770 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632737+0000", 2024-09-12T18:36:00.770 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7983999999999999e-05 2024-09-12T18:36:00.771 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.771 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.771 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.771 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632751+0000", 2024-09-12T18:36:00.771 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4473e-05 2024-09-12T18:36:00.771 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.771 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.771 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:00.771 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636961+0000", 2024-09-12T18:36:00.771 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042100840000000002 2024-09-12T18:36:00.771 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.772 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.772 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:00.772 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637211+0000", 2024-09-12T18:36:00.772 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000249738 2024-09-12T18:36:00.772 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.772 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.772 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:00.772 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637504+0000", 2024-09-12T18:36:00.772 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00029271499999999998 2024-09-12T18:36:00.772 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.772 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.772 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:00.772 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639582+0000", 2024-09-12T18:36:00.773 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020783389999999998 2024-09-12T18:36:00.773 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.773 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.773 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:00.773 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657709+0000", 2024-09-12T18:36:00.773 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018126758999999999 2024-09-12T18:36:00.773 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.773 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.773 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:00.773 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657830+0000", 2024-09-12T18:36:00.773 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000121329 2024-09-12T18:36:00.773 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.773 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.774 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:00.774 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657949+0000", 2024-09-12T18:36:00.774 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000119169 2024-09-12T18:36:00.774 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.774 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:00.774 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.774 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.774 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.774 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:00.774 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:00.774 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 35.120853879999999, 2024-09-12T18:36:00.774 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026711823999999999, 2024-09-12T18:36:00.774 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:00.775 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:00.775 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:00.775 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:00.775 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.775 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:00.775 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:00.775 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.775 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.775 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.775 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:00.775 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:00.775 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.775 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.775 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.776 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:00.776 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632775+0000", 2024-09-12T18:36:00.776 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9999999999999995e-07 2024-09-12T18:36:00.776 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.776 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.776 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:00.776 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632788+0000", 2024-09-12T18:36:00.776 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2629999999999999e-05 2024-09-12T18:36:00.776 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.776 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.776 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:00.776 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632806+0000", 2024-09-12T18:36:00.776 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:36:00.777 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.777 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.777 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.777 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632820+0000", 2024-09-12T18:36:00.777 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3777e-05 2024-09-12T18:36:00.777 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.777 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.777 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:00.777 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638310+0000", 2024-09-12T18:36:00.777 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054898280000000004 2024-09-12T18:36:00.777 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.777 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.777 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:00.778 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638480+0000", 2024-09-12T18:36:00.778 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016968199999999999 2024-09-12T18:36:00.778 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.778 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.778 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:00.778 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638799+0000", 2024-09-12T18:36:00.778 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031915999999999997 2024-09-12T18:36:00.778 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.778 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.778 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:00.778 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639866+0000", 2024-09-12T18:36:00.779 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001067405 2024-09-12T18:36:00.779 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.779 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.779 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:00.779 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658398+0000", 2024-09-12T18:36:00.779 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018531542000000002 2024-09-12T18:36:00.779 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.779 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.779 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:00.779 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658643+0000", 2024-09-12T18:36:00.779 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00024531500000000002 2024-09-12T18:36:00.779 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.779 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.779 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:00.780 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.659486+0000", 2024-09-12T18:36:00.780 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00084316899999999995 2024-09-12T18:36:00.780 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.780 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:00.780 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.780 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.780 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.780 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:00.780 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632845+0000", 2024-09-12T18:36:00.780 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 35.120782853999998, 2024-09-12T18:36:00.780 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015333398999999999, 2024-09-12T18:36:00.780 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:00.780 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:00.780 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:00.781 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:00.781 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.781 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:00.781 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632845+0000", 2024-09-12T18:36:00.781 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.781 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.781 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.781 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:00.781 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632845+0000", 2024-09-12T18:36:00.781 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.781 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.781 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.781 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:00.782 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632847+0000", 2024-09-12T18:36:00.782 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.407e-06 2024-09-12T18:36:00.782 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.782 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.782 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:00.782 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632854+0000", 2024-09-12T18:36:00.782 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1670000000000002e-06 2024-09-12T18:36:00.782 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.782 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.782 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:00.782 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632877+0000", 2024-09-12T18:36:00.782 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2929e-05 2024-09-12T18:36:00.782 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.783 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.783 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.783 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632891+0000", 2024-09-12T18:36:00.783 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3689999999999999e-05 2024-09-12T18:36:00.783 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.783 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.783 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:00.783 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.634571+0000", 2024-09-12T18:36:00.783 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016800929999999999 2024-09-12T18:36:00.783 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.783 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.783 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:00.783 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.635247+0000", 2024-09-12T18:36:00.783 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000676051 2024-09-12T18:36:00.784 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.784 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.784 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:00.784 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636176+0000", 2024-09-12T18:36:00.784 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00092889199999999996 2024-09-12T18:36:00.784 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.784 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.784 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:00.784 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637978+0000", 2024-09-12T18:36:00.784 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018024320000000001 2024-09-12T18:36:00.784 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.784 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.784 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:00.785 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.647862+0000", 2024-09-12T18:36:00.785 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0098842540000000003 2024-09-12T18:36:00.785 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.785 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.785 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:00.785 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.648055+0000", 2024-09-12T18:36:00.785 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00019265499999999999 2024-09-12T18:36:00.785 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.785 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.785 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:00.785 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.648179+0000", 2024-09-12T18:36:00.785 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000123829 2024-09-12T18:36:00.785 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.786 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:00.786 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.786 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.786 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.786 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:00.786 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:36:00.786 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 35.120626817999998, 2024-09-12T18:36:00.786 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.021357139000000001, 2024-09-12T18:36:00.786 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:00.786 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:00.786 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:00.786 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:00.786 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.787 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:00.787 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:36:00.787 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.787 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.787 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.787 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:00.787 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:36:00.787 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.787 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.787 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.787 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:00.787 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633003+0000", 2024-09-12T18:36:00.787 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.53e-06 2024-09-12T18:36:00.787 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.788 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.788 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:00.788 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633012+0000", 2024-09-12T18:36:00.788 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9290000000000004e-06 2024-09-12T18:36:00.788 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.788 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.788 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:00.788 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633034+0000", 2024-09-12T18:36:00.788 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2127e-05 2024-09-12T18:36:00.788 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.788 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.788 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.788 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633054+0000", 2024-09-12T18:36:00.788 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9476000000000001e-05 2024-09-12T18:36:00.789 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.789 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.789 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:00.789 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636657+0000", 2024-09-12T18:36:00.789 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036038839999999999 2024-09-12T18:36:00.789 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.789 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.789 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:00.789 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636885+0000", 2024-09-12T18:36:00.789 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022798800000000001 2024-09-12T18:36:00.789 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.789 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.789 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:00.790 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637189+0000", 2024-09-12T18:36:00.790 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030392100000000002 2024-09-12T18:36:00.790 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.790 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.790 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:00.790 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639271+0000", 2024-09-12T18:36:00.790 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020817460000000002 2024-09-12T18:36:00.790 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.790 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.790 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:00.790 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.652371+0000", 2024-09-12T18:36:00.790 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013099417 2024-09-12T18:36:00.790 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.791 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.791 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:00.791 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654255+0000", 2024-09-12T18:36:00.791 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018846049999999999 2024-09-12T18:36:00.791 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.791 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.791 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:00.791 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654359+0000", 2024-09-12T18:36:00.791 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000103516 2024-09-12T18:36:00.791 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.791 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:00.791 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.791 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.791 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.792 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:00.792 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:00.792 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 35.120545126000003, 2024-09-12T18:36:00.792 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026938645000000001, 2024-09-12T18:36:00.792 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:00.792 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:00.792 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:00.792 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:00.792 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.792 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:00.792 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:00.792 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.793 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.793 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.793 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:00.793 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:00.793 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.793 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.793 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.793 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:00.793 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633085+0000", 2024-09-12T18:36:00.793 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:00.793 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.793 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.793 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:00.794 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633093+0000", 2024-09-12T18:36:00.794 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3999999999999992e-06 2024-09-12T18:36:00.794 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.794 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.794 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:00.794 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633111+0000", 2024-09-12T18:36:00.794 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8070000000000001e-05 2024-09-12T18:36:00.794 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.794 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.794 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.794 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633126+0000", 2024-09-12T18:36:00.794 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4487e-05 2024-09-12T18:36:00.794 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.795 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.795 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:00.795 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638290+0000", 2024-09-12T18:36:00.795 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0051640269999999999 2024-09-12T18:36:00.795 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.795 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.795 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:00.795 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638547+0000", 2024-09-12T18:36:00.795 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025714100000000001 2024-09-12T18:36:00.795 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.795 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.795 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:00.795 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638850+0000", 2024-09-12T18:36:00.795 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030278400000000001 2024-09-12T18:36:00.796 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.796 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.796 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:00.796 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.640706+0000", 2024-09-12T18:36:00.796 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018564580000000001 2024-09-12T18:36:00.796 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.796 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.796 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:00.796 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658420+0000", 2024-09-12T18:36:00.796 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017714395000000001 2024-09-12T18:36:00.796 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.796 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.797 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:00.797 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658635+0000", 2024-09-12T18:36:00.797 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021413500000000001 2024-09-12T18:36:00.797 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.797 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.797 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:00.797 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.660022+0000", 2024-09-12T18:36:00.797 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001387318 2024-09-12T18:36:00.797 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.797 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:00.797 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.797 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.797 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.797 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:00.798 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633323+0000", 2024-09-12T18:36:00.798 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 35.120305770999998, 2024-09-12T18:36:00.798 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015717332000000001, 2024-09-12T18:36:00.798 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:00.798 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:00.798 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:00.798 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:00.798 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.798 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:00.798 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633323+0000", 2024-09-12T18:36:00.798 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.798 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.798 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.798 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:00.799 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633323+0000", 2024-09-12T18:36:00.799 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.799 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.799 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.799 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:00.799 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633324+0000", 2024-09-12T18:36:00.799 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7230000000000001e-06 2024-09-12T18:36:00.799 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.799 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.799 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:00.799 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633351+0000", 2024-09-12T18:36:00.799 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7067e-05 2024-09-12T18:36:00.799 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.800 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.800 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:00.800 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633372+0000", 2024-09-12T18:36:00.800 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0429e-05 2024-09-12T18:36:00.800 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.800 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.800 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.800 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633387+0000", 2024-09-12T18:36:00.800 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5659999999999999e-05 2024-09-12T18:36:00.800 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.800 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.801 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:00.801 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633527+0000", 2024-09-12T18:36:00.801 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013991599999999999 2024-09-12T18:36:00.801 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.801 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.801 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:00.801 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633806+0000", 2024-09-12T18:36:00.801 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027858400000000001 2024-09-12T18:36:00.801 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.801 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.801 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:00.801 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.649040+0000", 2024-09-12T18:36:00.801 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015233953 2024-09-12T18:36:00.802 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.802 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:00.802 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.802 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.802 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.802 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:00.802 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:36:00.802 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 35.120200615000002, 2024-09-12T18:36:00.802 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.020709867, 2024-09-12T18:36:00.802 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:00.802 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:00.802 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:00.802 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:00.803 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.803 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:00.803 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:36:00.803 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.803 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.803 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.803 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:00.803 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:36:00.803 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.803 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.803 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.803 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:00.803 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633429+0000", 2024-09-12T18:36:00.803 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.313e-06 2024-09-12T18:36:00.804 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.804 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.804 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:00.804 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633462+0000", 2024-09-12T18:36:00.804 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3197000000000001e-05 2024-09-12T18:36:00.804 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.804 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.804 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:00.804 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633485+0000", 2024-09-12T18:36:00.804 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3243000000000001e-05 2024-09-12T18:36:00.804 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.804 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.804 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.805 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633501+0000", 2024-09-12T18:36:00.805 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5383000000000002e-05 2024-09-12T18:36:00.805 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.805 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.805 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:00.805 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633642+0000", 2024-09-12T18:36:00.805 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000141168 2024-09-12T18:36:00.805 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.805 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.805 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:00.805 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633982+0000", 2024-09-12T18:36:00.805 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000340067 2024-09-12T18:36:00.805 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.806 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.806 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:00.806 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654138+0000", 2024-09-12T18:36:00.806 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.020155495999999998 2024-09-12T18:36:00.806 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.806 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:00.806 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.806 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.806 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.806 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:29330 5.8 5:1b9a4683:::benchmark_data_smithi073_23739_object29329:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T18:36:00.806 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:55.446525+0000", 2024-09-12T18:36:00.806 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.3071032840000001, 2024-09-12T18:36:00.806 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.014327295, 2024-09-12T18:36:00.806 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:00.807 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:00.807 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:00.807 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:00.807 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:00.807 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:00.807 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 29330 2024-09-12T18:36:00.807 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.807 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:00.807 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.807 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:00.807 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:55.446525+0000", 2024-09-12T18:36:00.807 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.808 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.808 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.808 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:00.808 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:55.446525+0000", 2024-09-12T18:36:00.808 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.808 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.808 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.808 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:00.808 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:55.446526+0000", 2024-09-12T18:36:00.808 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4050000000000001e-06 2024-09-12T18:36:00.808 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.808 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.808 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:00.809 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:55.446593+0000", 2024-09-12T18:36:00.809 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6123000000000004e-05 2024-09-12T18:36:00.809 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.809 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.809 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:00.809 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:55.446611+0000", 2024-09-12T18:36:00.809 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8771999999999999e-05 2024-09-12T18:36:00.809 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.809 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.809 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.809 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:55.446625+0000", 2024-09-12T18:36:00.809 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3344e-05 2024-09-12T18:36:00.809 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.810 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.810 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:00.810 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:55.447520+0000", 2024-09-12T18:36:00.810 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00089562500000000005 2024-09-12T18:36:00.810 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.810 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.810 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:00.810 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:55.447604+0000", 2024-09-12T18:36:00.810 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4073000000000006e-05 2024-09-12T18:36:00.810 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.810 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.810 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:00.810 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:55.447698+0000", 2024-09-12T18:36:00.811 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.3731000000000001e-05 2024-09-12T18:36:00.811 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.811 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.811 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:00.811 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:55.452981+0000", 2024-09-12T18:36:00.811 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052828329999999998 2024-09-12T18:36:00.811 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.811 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.811 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:00.811 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:55.460671+0000", 2024-09-12T18:36:00.811 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076904390000000003 2024-09-12T18:36:00.811 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.811 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.811 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:00.811 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:55.460742+0000", 2024-09-12T18:36:00.812 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0925000000000003e-05 2024-09-12T18:36:00.812 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.812 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.812 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:00.812 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:55.460852+0000", 2024-09-12T18:36:00.812 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000110025 2024-09-12T18:36:00.812 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.812 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:00.812 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.812 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.812 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.812 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:39657 5.b 5:d5bef399:::benchmark_data_smithi073_23739_object39656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:00.812 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:59.583437+0000", 2024-09-12T18:36:00.813 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.1701912590000001, 2024-09-12T18:36:00.813 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.014985627, 2024-09-12T18:36:00.813 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:00.813 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:00.813 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:00.813 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:00.813 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:00.813 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:00.813 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 39657 2024-09-12T18:36:00.813 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.813 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:00.813 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.813 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:00.814 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.583437+0000", 2024-09-12T18:36:00.814 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.814 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.814 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.814 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:00.814 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.583437+0000", 2024-09-12T18:36:00.814 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.814 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.814 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.814 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:00.814 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.583438+0000", 2024-09-12T18:36:00.814 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.1200000000000001e-07 2024-09-12T18:36:00.815 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.815 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.815 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:00.815 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.583508+0000", 2024-09-12T18:36:00.815 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0088999999999999e-05 2024-09-12T18:36:00.815 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.815 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.815 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:00.815 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.583518+0000", 2024-09-12T18:36:00.815 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.028e-05 2024-09-12T18:36:00.815 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.815 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.815 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.815 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.583525+0000", 2024-09-12T18:36:00.816 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.165e-06 2024-09-12T18:36:00.816 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.816 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.816 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:00.816 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.584442+0000", 2024-09-12T18:36:00.816 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00091684000000000004 2024-09-12T18:36:00.816 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.816 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.816 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:00.816 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.584615+0000", 2024-09-12T18:36:00.816 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000173089 2024-09-12T18:36:00.816 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.816 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.817 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:00.817 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.584877+0000", 2024-09-12T18:36:00.817 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000261644 2024-09-12T18:36:00.817 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.817 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.817 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:00.817 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.587726+0000", 2024-09-12T18:36:00.817 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0028489169999999999 2024-09-12T18:36:00.817 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.817 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.817 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:00.817 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.598304+0000", 2024-09-12T18:36:00.817 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.010578438000000001 2024-09-12T18:36:00.817 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.818 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.818 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:00.818 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.598366+0000", 2024-09-12T18:36:00.818 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2014999999999995e-05 2024-09-12T18:36:00.818 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.818 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.818 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:00.818 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.598423+0000", 2024-09-12T18:36:00.818 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6237999999999999e-05 2024-09-12T18:36:00.818 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.818 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:00.818 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.818 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.819 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.819 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:40427 5.b 5:d12d7e68:::benchmark_data_smithi073_23739_object40426:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:00.819 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:59.916941+0000", 2024-09-12T18:36:00.819 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.83668757800000004, 2024-09-12T18:36:00.819 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.014403212, 2024-09-12T18:36:00.819 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:00.819 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:00.819 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:00.819 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:00.819 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:00.819 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:00.819 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 40427 2024-09-12T18:36:00.819 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.820 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:00.820 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.820 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:00.820 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.916941+0000", 2024-09-12T18:36:00.820 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.820 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.820 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.820 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:00.820 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.916941+0000", 2024-09-12T18:36:00.820 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.820 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.820 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.820 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:00.821 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.916942+0000", 2024-09-12T18:36:00.821 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.3900000000000003e-07 2024-09-12T18:36:00.821 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.821 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.821 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:00.821 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.916966+0000", 2024-09-12T18:36:00.821 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4774e-05 2024-09-12T18:36:00.821 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.821 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.821 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:00.821 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.916974+0000", 2024-09-12T18:36:00.821 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2099999999999996e-06 2024-09-12T18:36:00.821 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.822 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.822 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.822 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.916978+0000", 2024-09-12T18:36:00.822 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4610000000000001e-06 2024-09-12T18:36:00.822 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.822 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.822 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:00.822 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.918115+0000", 2024-09-12T18:36:00.822 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011368319999999999 2024-09-12T18:36:00.822 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.822 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.822 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:00.822 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.918331+0000", 2024-09-12T18:36:00.823 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000215577 2024-09-12T18:36:00.823 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.823 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.823 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:00.823 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.918552+0000", 2024-09-12T18:36:00.823 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022193899999999999 2024-09-12T18:36:00.823 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.823 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.823 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:00.823 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.925156+0000", 2024-09-12T18:36:00.823 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0066035900000000003 2024-09-12T18:36:00.823 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.823 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.824 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:00.824 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.931234+0000", 2024-09-12T18:36:00.824 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0060781070000000001 2024-09-12T18:36:00.824 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.824 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.824 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:00.824 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.931281+0000", 2024-09-12T18:36:00.824 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7228000000000003e-05 2024-09-12T18:36:00.824 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.824 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.824 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:00.824 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.931344+0000", 2024-09-12T18:36:00.824 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2555e-05 2024-09-12T18:36:00.824 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.825 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:00.825 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.825 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.825 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.825 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:40429 5.b 5:d980c40d:::benchmark_data_smithi073_23739_object40428:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:00.825 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:59.917184+0000", 2024-09-12T18:36:00.825 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.83644467300000003, 2024-09-12T18:36:00.825 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.014260759, 2024-09-12T18:36:00.825 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:00.825 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:00.825 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:00.825 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:00.825 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:00.826 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:00.826 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 40429 2024-09-12T18:36:00.826 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.826 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:00.826 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.826 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:00.826 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.917184+0000", 2024-09-12T18:36:00.826 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.826 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.826 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.826 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:00.826 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.917184+0000", 2024-09-12T18:36:00.826 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.826 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.827 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.827 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:00.827 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.917184+0000", 2024-09-12T18:36:00.827 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4e-07 2024-09-12T18:36:00.827 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.827 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.827 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:00.827 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.917285+0000", 2024-09-12T18:36:00.827 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010014900000000001 2024-09-12T18:36:00.827 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.827 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.827 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:00.827 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.917292+0000", 2024-09-12T18:36:00.827 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9489999999999999e-06 2024-09-12T18:36:00.828 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.828 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.828 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.828 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.917297+0000", 2024-09-12T18:36:00.828 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2320000000000001e-06 2024-09-12T18:36:00.828 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.828 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.828 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:00.828 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.922136+0000", 2024-09-12T18:36:00.828 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0048395679999999998 2024-09-12T18:36:00.828 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.828 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.828 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:00.829 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.922366+0000", 2024-09-12T18:36:00.829 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022964900000000001 2024-09-12T18:36:00.829 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.829 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.829 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:00.829 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.922622+0000", 2024-09-12T18:36:00.829 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000255839 2024-09-12T18:36:00.829 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.829 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.829 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:00.829 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.931218+0000", 2024-09-12T18:36:00.829 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0085958279999999998 2024-09-12T18:36:00.829 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.830 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.830 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:00.830 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.931354+0000", 2024-09-12T18:36:00.830 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013594400000000001 2024-09-12T18:36:00.830 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.830 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.830 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:00.830 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.931394+0000", 2024-09-12T18:36:00.830 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0513000000000003e-05 2024-09-12T18:36:00.830 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.830 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.830 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:00.831 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.931444+0000", 2024-09-12T18:36:00.831 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0247999999999997e-05 2024-09-12T18:36:00.831 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.831 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:00.831 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.831 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.831 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.831 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:40432 5.b 5:d974a3ca:::benchmark_data_smithi073_23739_object40431:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:00.831 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:59.917611+0000", 2024-09-12T18:36:00.831 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.836017389, 2024-09-12T18:36:00.831 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016184628999999999, 2024-09-12T18:36:00.831 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:00.831 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:00.832 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:00.832 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:00.832 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:00.832 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:00.832 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 40432 2024-09-12T18:36:00.832 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.832 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:00.832 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.832 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:00.832 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.917611+0000", 2024-09-12T18:36:00.832 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.832 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.832 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.832 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:00.833 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.917611+0000", 2024-09-12T18:36:00.833 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.833 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.833 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.833 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:00.833 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.917612+0000", 2024-09-12T18:36:00.833 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.009e-06 2024-09-12T18:36:00.833 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.833 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.833 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:00.833 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.917751+0000", 2024-09-12T18:36:00.833 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013949399999999999 2024-09-12T18:36:00.833 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.834 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.834 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:00.834 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.917773+0000", 2024-09-12T18:36:00.834 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1265000000000001e-05 2024-09-12T18:36:00.834 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.834 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.834 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.834 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.917782+0000", 2024-09-12T18:36:00.834 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.1009999999999998e-06 2024-09-12T18:36:00.834 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.834 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.834 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:00.834 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.925352+0000", 2024-09-12T18:36:00.834 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0075700689999999996 2024-09-12T18:36:00.835 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.835 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.835 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:00.835 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.925576+0000", 2024-09-12T18:36:00.835 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000224565 2024-09-12T18:36:00.835 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.835 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.835 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:00.835 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.925832+0000", 2024-09-12T18:36:00.835 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000255436 2024-09-12T18:36:00.835 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.835 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.835 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:00.835 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.931553+0000", 2024-09-12T18:36:00.836 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0057211190000000002 2024-09-12T18:36:00.836 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.836 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.836 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:00.836 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.933745+0000", 2024-09-12T18:36:00.836 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0021916290000000001 2024-09-12T18:36:00.836 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.836 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.836 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:00.836 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.933773+0000", 2024-09-12T18:36:00.836 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8249e-05 2024-09-12T18:36:00.836 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.836 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.837 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:00.837 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.933796+0000", 2024-09-12T18:36:00.837 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2693000000000001e-05 2024-09-12T18:36:00.837 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.837 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:00.837 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.837 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.837 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.837 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:40438 5.b 5:da8c8e18:::benchmark_data_smithi073_23739_object40437:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:00.837 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:59.920932+0000", 2024-09-12T18:36:00.837 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.832695988, 2024-09-12T18:36:00.837 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.014831063, 2024-09-12T18:36:00.837 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:00.838 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:00.838 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:00.838 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:00.838 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:00.838 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:00.838 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 40438 2024-09-12T18:36:00.838 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.838 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:00.838 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.838 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:00.838 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.920932+0000", 2024-09-12T18:36:00.838 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.838 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.839 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.839 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:00.839 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.920932+0000", 2024-09-12T18:36:00.839 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.839 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.839 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.839 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:00.839 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.920933+0000", 2024-09-12T18:36:00.839 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4600000000000004e-07 2024-09-12T18:36:00.839 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.839 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.839 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:00.839 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.920978+0000", 2024-09-12T18:36:00.839 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5024999999999997e-05 2024-09-12T18:36:00.840 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.840 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.840 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:00.840 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.920989+0000", 2024-09-12T18:36:00.840 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1314e-05 2024-09-12T18:36:00.840 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.840 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.840 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.840 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.920995+0000", 2024-09-12T18:36:00.840 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6779999999999997e-06 2024-09-12T18:36:00.840 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.840 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.840 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:00.841 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.931674+0000", 2024-09-12T18:36:00.841 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.010678856 2024-09-12T18:36:00.841 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.841 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.841 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:00.841 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.931776+0000", 2024-09-12T18:36:00.841 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000101786 2024-09-12T18:36:00.841 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.841 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.841 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:00.841 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.931853+0000", 2024-09-12T18:36:00.841 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6959000000000006e-05 2024-09-12T18:36:00.841 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.842 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.842 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:00.842 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.935673+0000", 2024-09-12T18:36:00.842 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003819977 2024-09-12T18:36:00.842 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.842 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.842 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:00.842 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.935685+0000", 2024-09-12T18:36:00.842 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2191999999999999e-05 2024-09-12T18:36:00.842 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.842 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.842 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:00.842 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.935733+0000", 2024-09-12T18:36:00.843 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8072999999999999e-05 2024-09-12T18:36:00.843 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.843 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.843 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:00.843 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.935763+0000", 2024-09-12T18:36:00.843 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0556999999999999e-05 2024-09-12T18:36:00.843 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.843 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:00.843 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.843 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.843 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.843 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:40507 5.e 5:729d4bc6:::benchmark_data_smithi073_23739_object40506:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:00.843 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:59.951281+0000", 2024-09-12T18:36:00.844 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.80234752899999995, 2024-09-12T18:36:00.844 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016604759, 2024-09-12T18:36:00.844 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:00.844 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:00.844 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:00.844 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:00.844 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:00.844 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:00.844 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 40507 2024-09-12T18:36:00.844 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.844 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:00.844 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.844 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:00.844 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951281+0000", 2024-09-12T18:36:00.845 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.845 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.845 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.845 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:00.845 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951281+0000", 2024-09-12T18:36:00.845 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.845 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.845 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.845 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:00.845 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951282+0000", 2024-09-12T18:36:00.845 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7599999999999996e-07 2024-09-12T18:36:00.845 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.845 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.846 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:00.846 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951390+0000", 2024-09-12T18:36:00.846 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000108075 2024-09-12T18:36:00.846 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.846 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.846 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:00.846 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951425+0000", 2024-09-12T18:36:00.846 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5765000000000001e-05 2024-09-12T18:36:00.846 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.846 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.846 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.846 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951435+0000", 2024-09-12T18:36:00.846 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:36:00.846 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.847 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.847 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:00.847 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951505+0000", 2024-09-12T18:36:00.847 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0655999999999996e-05 2024-09-12T18:36:00.847 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.847 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.847 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:00.847 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951663+0000", 2024-09-12T18:36:00.847 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015736799999999999 2024-09-12T18:36:00.847 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.847 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.847 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:00.847 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951812+0000", 2024-09-12T18:36:00.848 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014943000000000001 2024-09-12T18:36:00.848 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.848 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.848 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:00.848 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.953812+0000", 2024-09-12T18:36:00.848 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001999781 2024-09-12T18:36:00.848 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.848 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.848 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:00.848 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.967782+0000", 2024-09-12T18:36:00.848 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013969472 2024-09-12T18:36:00.848 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.848 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.849 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:00.849 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.967839+0000", 2024-09-12T18:36:00.849 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7278999999999998e-05 2024-09-12T18:36:00.849 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.849 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.849 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:00.849 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.967886+0000", 2024-09-12T18:36:00.849 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6717e-05 2024-09-12T18:36:00.849 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.849 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:00.849 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.849 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.850 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.850 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:40638 5.8 5:1bcfd6bd:::benchmark_data_smithi073_23739_object40637:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:00.850 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:00.010531+0000", 2024-09-12T18:36:00.850 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.74309750100000005, 2024-09-12T18:36:00.850 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.01580927, 2024-09-12T18:36:00.850 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:00.850 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:00.850 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:00.850 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:00.850 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:00.850 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:00.850 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 40638 2024-09-12T18:36:00.850 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.851 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:00.851 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.851 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:00.851 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010531+0000", 2024-09-12T18:36:00.851 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.851 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.851 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.851 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:00.851 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010531+0000", 2024-09-12T18:36:00.851 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.851 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.851 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.851 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:00.851 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010531+0000", 2024-09-12T18:36:00.852 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6400000000000002e-07 2024-09-12T18:36:00.852 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.852 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.852 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:00.852 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010643+0000", 2024-09-12T18:36:00.852 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000111562 2024-09-12T18:36:00.852 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.852 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.852 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:00.852 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010657+0000", 2024-09-12T18:36:00.852 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3804e-05 2024-09-12T18:36:00.852 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.852 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.852 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.853 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010664+0000", 2024-09-12T18:36:00.853 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2919999999999998e-06 2024-09-12T18:36:00.853 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.853 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.853 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:00.853 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.016385+0000", 2024-09-12T18:36:00.853 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0057206490000000004 2024-09-12T18:36:00.853 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.853 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.853 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:00.853 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.016509+0000", 2024-09-12T18:36:00.853 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000124058 2024-09-12T18:36:00.854 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.854 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.854 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:00.854 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.016711+0000", 2024-09-12T18:36:00.854 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000202389 2024-09-12T18:36:00.854 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.854 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.854 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:00.854 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.021363+0000", 2024-09-12T18:36:00.854 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0046515970000000004 2024-09-12T18:36:00.854 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.854 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.854 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:00.855 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.026248+0000", 2024-09-12T18:36:00.855 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.004885655 2024-09-12T18:36:00.855 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.855 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.855 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:00.855 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.026287+0000", 2024-09-12T18:36:00.855 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8909000000000003e-05 2024-09-12T18:36:00.855 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.855 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.855 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:00.855 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.026340+0000", 2024-09-12T18:36:00.855 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2691000000000001e-05 2024-09-12T18:36:00.855 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.856 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:00.856 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.856 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.856 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.856 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:40639 5.8 5:16bd0f48:::benchmark_data_smithi073_23739_object40638:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:00.856 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:00.010888+0000", 2024-09-12T18:36:00.856 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.74274020500000004, 2024-09-12T18:36:00.856 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017069808999999998, 2024-09-12T18:36:00.856 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:00.856 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:00.856 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:00.856 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:00.857 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:00.857 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:00.857 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 40639 2024-09-12T18:36:00.857 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.857 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:00.857 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.857 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:00.857 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010888+0000", 2024-09-12T18:36:00.857 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.857 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.857 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.857 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:00.857 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010888+0000", 2024-09-12T18:36:00.858 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.858 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.858 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.858 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:00.858 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010889+0000", 2024-09-12T18:36:00.858 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.004e-06 2024-09-12T18:36:00.858 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.858 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.858 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:00.858 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010921+0000", 2024-09-12T18:36:00.858 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1745000000000002e-05 2024-09-12T18:36:00.858 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.858 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.858 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:00.859 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010933+0000", 2024-09-12T18:36:00.859 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2476999999999999e-05 2024-09-12T18:36:00.859 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.859 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.859 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.859 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010941+0000", 2024-09-12T18:36:00.859 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1810000000000004e-06 2024-09-12T18:36:00.859 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.859 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.860 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:00.860 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.019947+0000", 2024-09-12T18:36:00.860 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0090069190000000004 2024-09-12T18:36:00.860 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.860 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.860 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:00.860 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.020062+0000", 2024-09-12T18:36:00.860 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000114851 2024-09-12T18:36:00.860 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.860 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.860 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:00.860 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.020148+0000", 2024-09-12T18:36:00.860 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5579000000000002e-05 2024-09-12T18:36:00.861 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.861 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.861 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:00.861 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.026347+0000", 2024-09-12T18:36:00.861 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0061988820000000002 2024-09-12T18:36:00.861 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.861 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.861 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:00.861 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.027866+0000", 2024-09-12T18:36:00.861 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015197190000000001 2024-09-12T18:36:00.861 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.861 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.861 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:00.862 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.027914+0000", 2024-09-12T18:36:00.862 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8009000000000001e-05 2024-09-12T18:36:00.862 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.862 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.862 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:00.862 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.027958+0000", 2024-09-12T18:36:00.862 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3442999999999997e-05 2024-09-12T18:36:00.862 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.862 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:00.862 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.862 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.862 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.862 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:40642 5.0 5:015ece55:::benchmark_data_smithi073_23739_object40641:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:00.863 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:00.011626+0000", 2024-09-12T18:36:00.863 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.74200237599999996, 2024-09-12T18:36:00.863 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016593251, 2024-09-12T18:36:00.863 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:00.863 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:00.863 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:00.863 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:00.863 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:00.863 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:00.863 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 40642 2024-09-12T18:36:00.863 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.863 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:00.863 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.864 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:00.864 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.011626+0000", 2024-09-12T18:36:00.864 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.864 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.864 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.864 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:00.864 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.011626+0000", 2024-09-12T18:36:00.864 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.864 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.864 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.864 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:00.864 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.011627+0000", 2024-09-12T18:36:00.864 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.7399999999999991e-07 2024-09-12T18:36:00.864 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.865 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.865 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:00.865 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.011693+0000", 2024-09-12T18:36:00.865 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6586000000000002e-05 2024-09-12T18:36:00.865 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.865 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.865 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:00.865 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.011703+0000", 2024-09-12T18:36:00.865 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.3619999999999995e-06 2024-09-12T18:36:00.865 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.865 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.865 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.865 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.011710+0000", 2024-09-12T18:36:00.866 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1010000000000003e-06 2024-09-12T18:36:00.866 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.866 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.866 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:00.866 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.021346+0000", 2024-09-12T18:36:00.866 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0096362170000000007 2024-09-12T18:36:00.866 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.866 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.866 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:00.866 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.021456+0000", 2024-09-12T18:36:00.866 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010942000000000001 2024-09-12T18:36:00.866 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.866 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.867 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:00.867 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.021540+0000", 2024-09-12T18:36:00.867 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4220000000000003e-05 2024-09-12T18:36:00.867 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.867 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.867 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:00.867 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.027831+0000", 2024-09-12T18:36:00.867 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062915760000000001 2024-09-12T18:36:00.867 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.867 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.867 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:00.867 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.028132+0000", 2024-09-12T18:36:00.867 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030037 2024-09-12T18:36:00.867 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.868 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.868 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:00.868 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.028188+0000", 2024-09-12T18:36:00.868 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6023999999999998e-05 2024-09-12T18:36:00.868 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.868 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.868 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:00.868 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.028219+0000", 2024-09-12T18:36:00.868 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1401e-05 2024-09-12T18:36:00.868 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.868 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:00.868 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.868 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.869 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.869 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:41622 5.d 5:b67b3593:::benchmark_data_smithi073_23739_object41621:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:00.869 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:00.420588+0000", 2024-09-12T18:36:00.869 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.33304050800000001, 2024-09-12T18:36:00.869 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.014651192, 2024-09-12T18:36:00.869 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:00.869 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:00.869 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:00.869 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:00.869 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:00.869 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:00.869 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 41622 2024-09-12T18:36:00.869 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.870 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:00.870 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.870 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:00.870 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.420588+0000", 2024-09-12T18:36:00.870 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.870 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.870 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.870 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:00.870 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.420588+0000", 2024-09-12T18:36:00.870 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:00.870 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.870 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.870 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:00.870 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.420589+0000", 2024-09-12T18:36:00.871 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1030000000000001e-06 2024-09-12T18:36:00.871 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.871 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.871 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:00.871 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.420670+0000", 2024-09-12T18:36:00.871 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0768999999999999e-05 2024-09-12T18:36:00.871 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.871 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.871 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:00.871 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.420684+0000", 2024-09-12T18:36:00.871 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3828999999999999e-05 2024-09-12T18:36:00.871 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.871 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.871 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:00.872 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.420691+0000", 2024-09-12T18:36:00.872 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.357e-06 2024-09-12T18:36:00.872 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.872 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.872 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:00.872 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.422637+0000", 2024-09-12T18:36:00.872 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001946157 2024-09-12T18:36:00.872 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.872 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.872 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:00.872 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.422724+0000", 2024-09-12T18:36:00.872 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7205000000000003e-05 2024-09-12T18:36:00.872 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.873 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.873 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:00.873 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.422867+0000", 2024-09-12T18:36:00.873 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014323100000000001 2024-09-12T18:36:00.873 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.873 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.873 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:00.873 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.427325+0000", 2024-09-12T18:36:00.873 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0044572140000000001 2024-09-12T18:36:00.873 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.873 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.873 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:00.873 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.435147+0000", 2024-09-12T18:36:00.873 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0078225150000000004 2024-09-12T18:36:00.874 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.874 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.874 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:00.874 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.435183+0000", 2024-09-12T18:36:00.874 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6248000000000003e-05 2024-09-12T18:36:00.874 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:00.874 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:00.874 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:00.874 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.435239+0000", 2024-09-12T18:36:00.874 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5563999999999999e-05 2024-09-12T18:36:00.874 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.874 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:00.874 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.874 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:00.874 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:00.875 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:00.876 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 15 16 42749 42733 178.034 152 0.00591964 0.00561197 2024-09-12T18:36:00.876 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:00.873+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:00.877 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:36:00.977 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:00.974+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:01.013 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:36:01.038 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:36:01.038 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:36:01.038 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:01.038 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:43152 5.f 5:f3f389d2:::benchmark_data_smithi073_23739_object43151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:01.038 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:01.034875+0000", 2024-09-12T18:36:01.038 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0032484710000000002, 2024-09-12T18:36:01.038 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003275123, 2024-09-12T18:36:01.039 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:01.039 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:01.039 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:01.039 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:01.039 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:01.039 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:01.039 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 43152 2024-09-12T18:36:01.039 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:01.039 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:01.039 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:01.039 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:01.039 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:01.034875+0000", 2024-09-12T18:36:01.039 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:01.040 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:01.040 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:01.040 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:01.040 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:01.034875+0000", 2024-09-12T18:36:01.040 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:01.040 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:01.040 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:01.040 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:01.040 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:01.034877+0000", 2024-09-12T18:36:01.040 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.265e-06 2024-09-12T18:36:01.040 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:01.040 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:01.040 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:01.041 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:01.034952+0000", 2024-09-12T18:36:01.041 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.5234000000000005e-05 2024-09-12T18:36:01.041 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:01.041 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:01.041 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:01.041 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:01.034961+0000", 2024-09-12T18:36:01.041 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.5559999999999996e-06 2024-09-12T18:36:01.041 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:01.041 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:01.041 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:01.041 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:01.034970+0000", 2024-09-12T18:36:01.041 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.2460000000000003e-06 2024-09-12T18:36:01.041 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:01.042 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:01.042 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:01.042 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:01.035022+0000", 2024-09-12T18:36:01.042 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2262000000000002e-05 2024-09-12T18:36:01.042 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:01.042 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:01.042 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:01.042 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:01.035157+0000", 2024-09-12T18:36:01.042 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000134688 2024-09-12T18:36:01.042 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:01.042 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:01.042 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:01.042 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:01.035290+0000", 2024-09-12T18:36:01.042 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013396600000000001 2024-09-12T18:36:01.043 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:01.043 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:01.043 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:01.043 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:01.043 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:01.043 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:43154 5.f 5:fcdd8784:::benchmark_data_smithi073_23739_object43153:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:01.043 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:01.035714+0000", 2024-09-12T18:36:01.043 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0024100250000000001, 2024-09-12T18:36:01.043 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0024945000000000002, 2024-09-12T18:36:01.043 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:01.044 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:01.044 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:01.044 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:01.044 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:01.044 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:01.044 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 43154 2024-09-12T18:36:01.044 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:01.044 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:01.044 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:01.044 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:01.044 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:01.035714+0000", 2024-09-12T18:36:01.044 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:01.045 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:01.045 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:01.045 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:01.045 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:01.035714+0000", 2024-09-12T18:36:01.045 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:01.045 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:01.045 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:01.045 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:01.045 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:01.035715+0000", 2024-09-12T18:36:01.045 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5199999999999995e-07 2024-09-12T18:36:01.045 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:01.045 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:01.045 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:01.045 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:01.035803+0000", 2024-09-12T18:36:01.046 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8498999999999994e-05 2024-09-12T18:36:01.046 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:01.046 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:01.046 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:01.046 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:01.035815+0000", 2024-09-12T18:36:01.046 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2128e-05 2024-09-12T18:36:01.046 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:01.046 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:01.046 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:01.046 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:01.035822+0000", 2024-09-12T18:36:01.046 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.7020000000000004e-06 2024-09-12T18:36:01.046 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:01.047 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:01.047 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:01.047 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:01.036797+0000", 2024-09-12T18:36:01.047 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000974707 2024-09-12T18:36:01.047 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:01.047 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:01.047 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:01.047 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:01.036924+0000", 2024-09-12T18:36:01.047 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012752099999999999 2024-09-12T18:36:01.047 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:01.047 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:01.047 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:01.047 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:01.037070+0000", 2024-09-12T18:36:01.047 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014565199999999999 2024-09-12T18:36:01.048 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:01.048 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:01.048 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:01.048 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:01.048 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:01.048 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:43155 5.7 5:ed631e1b:::benchmark_data_smithi073_23739_object43154:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:01.048 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:01.036117+0000", 2024-09-12T18:36:01.048 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.002006552, 2024-09-12T18:36:01.048 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.002128469, 2024-09-12T18:36:01.048 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:01.048 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:01.048 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:01.048 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:01.049 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:01.049 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:01.049 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 43155 2024-09-12T18:36:01.049 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:01.049 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:01.049 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:01.049 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:01.049 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:01.036117+0000", 2024-09-12T18:36:01.049 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:01.049 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:01.049 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:01.049 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:01.049 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:01.036117+0000", 2024-09-12T18:36:01.050 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:01.050 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:01.050 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:01.050 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:01.050 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:01.036118+0000", 2024-09-12T18:36:01.050 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.6099999999999999e-07 2024-09-12T18:36:01.050 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:01.050 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:01.050 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:01.050 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:01.036212+0000", 2024-09-12T18:36:01.050 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.3571000000000002e-05 2024-09-12T18:36:01.050 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:01.050 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:01.051 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:01.051 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:01.036224+0000", 2024-09-12T18:36:01.051 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2069000000000001e-05 2024-09-12T18:36:01.051 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:01.051 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:01.051 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:01.051 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:01.036231+0000", 2024-09-12T18:36:01.051 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.968e-06 2024-09-12T18:36:01.051 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:01.051 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:01.051 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:01.051 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:01.036777+0000", 2024-09-12T18:36:01.051 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00054613100000000005 2024-09-12T18:36:01.052 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:01.052 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:01.052 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:01.052 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:01.036875+0000", 2024-09-12T18:36:01.052 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.8175000000000001e-05 2024-09-12T18:36:01.052 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:01.052 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:01.052 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:01.052 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:01.036989+0000", 2024-09-12T18:36:01.052 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011405599999999999 2024-09-12T18:36:01.052 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:01.052 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:01.052 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:01.053 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:01.053 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:01.053 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:43153 5.d e30/21 5:b0148547:::benchmark_data_smithi073_23739_object43152:head v 30'2735, mlcod=30'2731)", 2024-09-12T18:36:01.053 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:01.036458+0000", 2024-09-12T18:36:01.053 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.001665906, 2024-09-12T18:36:01.053 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0018224109999999999, 2024-09-12T18:36:01.053 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:01.053 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:01.053 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:01.053 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:01.053 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:01.053 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:01.053 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:01.036458+0000", 2024-09-12T18:36:01.054 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:01.054 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:01.054 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:01.054 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:01.054 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:01.036458+0000", 2024-09-12T18:36:01.054 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:01.054 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:01.054 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:01.054 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:01.054 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:01.036465+0000", 2024-09-12T18:36:01.054 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.754e-06 2024-09-12T18:36:01.054 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:01.055 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:01.055 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:01.055 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:01.036506+0000", 2024-09-12T18:36:01.055 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.1084000000000002e-05 2024-09-12T18:36:01.055 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:01.055 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:01.055 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:01.055 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:01.036522+0000", 2024-09-12T18:36:01.055 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6606e-05 2024-09-12T18:36:01.055 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:01.055 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:01.055 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:01.055 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:01.036529+0000", 2024-09-12T18:36:01.056 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.7819999999999996e-06 2024-09-12T18:36:01.056 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:01.056 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:01.056 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:01.056 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:01.036934+0000", 2024-09-12T18:36:01.056 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000405005 2024-09-12T18:36:01.056 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:01.056 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:01.056 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:01.056 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:01.036951+0000", 2024-09-12T18:36:01.056 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7027000000000001e-05 2024-09-12T18:36:01.056 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:01.056 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:01.056 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:01.057 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:01.057 INFO:teuthology.orchestra.run.smithi162.stdout: ], 2024-09-12T18:36:01.057 INFO:teuthology.orchestra.run.smithi162.stdout: "num_ops": 4 2024-09-12T18:36:01.057 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:36:01.061 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:36:01.105 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:01.102+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:01.173 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:36:01.174 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:36:01.179 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:01.177+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:01.192 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:36:01.192 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:36:01.211 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:36:01.211 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:36:01.261 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:01.261 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:01.280 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:01.277+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:01.282 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:36:01.381 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:01.377+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:01.430 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:36:01.430 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-12T18:36:01.441 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:01.441 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:01.452 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is unset 2024-09-12T18:36:01.463 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:36:01.483 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:01.477+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:01.584 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:01.581+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:01.621 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:01.621 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:01.639 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:36:01.684 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:01.681+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:01.785 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:01.781+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:01.791 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:01.791 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:01.810 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:36:01.870 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 16 16 45172 45156 176.371 151.438 0.00524967 0.00566481 2024-09-12T18:36:01.886 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:01.881+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:01.962 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:01.962 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:01.983 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:36:01.987 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:01.981+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:02.088 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:02.085+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:02.144 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:02.144 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:02.165 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:36:02.189 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:02.185+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:02.291 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:02.285+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:02.321 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:02.321 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:02.340 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:36:02.391 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:02.389+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:02.462 INFO:teuthology.orchestra.run.smithi073.stderr:reweighted osd.0 to 1 (10000) 2024-09-12T18:36:02.486 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-12T18:36:02.492 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:02.485+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:02.494 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:02.494 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:02.514 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:36:02.593 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:02.589+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:02.670 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:02.670 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:02.690 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:36:02.737 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:02.733+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:02.794 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:02.789+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:02.870 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 17 16 47586 47570 174.87 150.875 0.00600875 0.00571291 2024-09-12T18:36:02.886 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:02.886 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:02.895 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:02.889+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:02.908 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:36:02.996 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:02.993+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:03.097 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:03.093+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:03.109 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:03.109 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:03.131 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:36:03.198 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:03.193+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:03.229 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:36:03.282 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:03.283 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:03.299 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:03.297+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:03.301 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:36:03.387 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:36:03.388 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:36:03.400 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:03.397+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:03.406 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:36:03.407 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:36:03.424 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:36:03.425 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:36:03.468 INFO:teuthology.orchestra.run.smithi073.stderr:reweighted osd.1 to 1 (10000) 2024-09-12T18:36:03.476 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T18:36:03.489 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-12T18:36:03.501 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:03.501 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2024-09-12T18:36:03.501 INFO:teuthology.orchestra.run.smithi114.stdout: "complaint_time": 30, 2024-09-12T18:36:03.501 INFO:teuthology.orchestra.run.smithi114.stdout: "num_blocked_ops": 0 2024-09-12T18:36:03.501 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:03.502 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:03.497+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:03.524 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:36:03.602 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:03.597+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:03.681 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:03.681 INFO:teuthology.orchestra.run.smithi114.stdout: "size": 20, 2024-09-12T18:36:03.681 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 600, 2024-09-12T18:36:03.681 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:36:03.681 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.681 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:03.681 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:03.682 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 38.049115022000002, 2024-09-12T18:36:03.682 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.042475618999999999, 2024-09-12T18:36:03.682 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:03.682 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:03.682 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:03.682 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:03.682 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.682 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:03.682 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:03.682 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:03.682 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.682 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.682 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:03.683 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:03.683 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:03.683 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.683 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.683 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:03.683 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628450+0000", 2024-09-12T18:36:03.683 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4212999999999999e-05 2024-09-12T18:36:03.683 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.683 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.683 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:03.683 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628463+0000", 2024-09-12T18:36:03.683 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2497000000000001e-05 2024-09-12T18:36:03.683 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.683 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.684 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:03.684 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628480+0000", 2024-09-12T18:36:03.684 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7232999999999999e-05 2024-09-12T18:36:03.684 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.684 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.684 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:03.684 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628496+0000", 2024-09-12T18:36:03.684 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6217000000000001e-05 2024-09-12T18:36:03.684 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.684 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.684 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:03.684 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628641+0000", 2024-09-12T18:36:03.684 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000144709 2024-09-12T18:36:03.685 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.685 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.685 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:03.685 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628657+0000", 2024-09-12T18:36:03.685 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6266e-05 2024-09-12T18:36:03.685 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.685 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.685 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:03.685 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663103+0000", 2024-09-12T18:36:03.685 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.034445523999999998 2024-09-12T18:36:03.685 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.685 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.685 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:03.686 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663373+0000", 2024-09-12T18:36:03.686 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00027085500000000002 2024-09-12T18:36:03.686 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.686 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.686 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:03.686 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663634+0000", 2024-09-12T18:36:03.686 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000260855 2024-09-12T18:36:03.686 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.686 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.686 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:03.687 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670294+0000", 2024-09-12T18:36:03.687 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0066597599999999998 2024-09-12T18:36:03.687 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.687 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.687 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:03.687 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670705+0000", 2024-09-12T18:36:03.687 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00041057099999999998 2024-09-12T18:36:03.687 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.687 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.687 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:03.687 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670820+0000", 2024-09-12T18:36:03.687 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000115111 2024-09-12T18:36:03.687 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.688 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.688 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:03.688 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670912+0000", 2024-09-12T18:36:03.688 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1807999999999999e-05 2024-09-12T18:36:03.688 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:03.688 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:03.689 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:03.689 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.689 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.689 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:03.689 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:03.689 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 38.049024275999997, 2024-09-12T18:36:03.689 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.044599273000000002, 2024-09-12T18:36:03.689 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:03.689 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:03.689 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:03.689 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:03.689 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.689 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:03.690 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:03.690 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:03.690 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.690 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.690 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:03.690 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:03.690 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:03.690 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.690 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.690 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:03.690 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628528+0000", 2024-09-12T18:36:03.690 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:03.690 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.691 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.691 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:03.691 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628537+0000", 2024-09-12T18:36:03.691 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6969999999999999e-06 2024-09-12T18:36:03.691 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.691 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.691 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:03.691 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628560+0000", 2024-09-12T18:36:03.691 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2889000000000001e-05 2024-09-12T18:36:03.691 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.691 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.691 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:03.691 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628576+0000", 2024-09-12T18:36:03.691 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.649e-05 2024-09-12T18:36:03.692 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.692 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.692 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:03.692 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628846+0000", 2024-09-12T18:36:03.692 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00026952500000000001 2024-09-12T18:36:03.692 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.692 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.692 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:03.692 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628853+0000", 2024-09-12T18:36:03.692 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6559999999999992e-06 2024-09-12T18:36:03.692 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.692 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.692 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:03.693 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665284+0000", 2024-09-12T18:36:03.693 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.036431140000000001 2024-09-12T18:36:03.693 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.693 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.693 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:03.693 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665494+0000", 2024-09-12T18:36:03.693 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000209762 2024-09-12T18:36:03.693 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.693 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.693 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:03.693 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665816+0000", 2024-09-12T18:36:03.693 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00032162299999999999 2024-09-12T18:36:03.693 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.694 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.694 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:03.694 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670382+0000", 2024-09-12T18:36:03.694 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0045656739999999996 2024-09-12T18:36:03.694 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.694 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.694 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:03.694 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.672978+0000", 2024-09-12T18:36:03.694 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.002596068 2024-09-12T18:36:03.694 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.694 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.694 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:03.694 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673058+0000", 2024-09-12T18:36:03.694 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0198999999999996e-05 2024-09-12T18:36:03.695 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.695 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.695 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:03.695 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673126+0000", 2024-09-12T18:36:03.695 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8120000000000005e-05 2024-09-12T18:36:03.695 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:03.695 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:03.695 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:03.695 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.695 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.695 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:23 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:03.695 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:03.695 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 38.048926469999998, 2024-09-12T18:36:03.695 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045539784, 2024-09-12T18:36:03.696 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:03.696 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:03.696 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:03.696 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:03.696 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.696 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:03.696 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:03.696 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:03.696 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.697 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.697 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:03.697 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:03.697 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:03.697 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.697 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.697 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:03.697 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628626+0000", 2024-09-12T18:36:03.697 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.573e-06 2024-09-12T18:36:03.697 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.697 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.697 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:03.697 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628640+0000", 2024-09-12T18:36:03.698 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3817e-05 2024-09-12T18:36:03.698 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.698 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.698 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:03.698 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628659+0000", 2024-09-12T18:36:03.698 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9539999999999999e-05 2024-09-12T18:36:03.698 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.698 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.698 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:03.698 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628675+0000", 2024-09-12T18:36:03.698 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5739e-05 2024-09-12T18:36:03.698 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.699 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.699 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:03.699 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628815+0000", 2024-09-12T18:36:03.699 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014003299999999999 2024-09-12T18:36:03.699 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.699 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.699 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:03.699 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628828+0000", 2024-09-12T18:36:03.699 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2849e-05 2024-09-12T18:36:03.699 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.700 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.700 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:03.700 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651162+0000", 2024-09-12T18:36:03.700 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.022334228000000001 2024-09-12T18:36:03.700 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.700 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.700 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:03.700 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651446+0000", 2024-09-12T18:36:03.700 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00028392800000000002 2024-09-12T18:36:03.700 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.700 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.701 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:03.701 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651746+0000", 2024-09-12T18:36:03.701 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000300091 2024-09-12T18:36:03.701 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.701 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.701 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:03.701 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665113+0000", 2024-09-12T18:36:03.701 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013366678 2024-09-12T18:36:03.701 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.701 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.701 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:03.701 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674010+0000", 2024-09-12T18:36:03.701 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0088970520000000008 2024-09-12T18:36:03.702 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.702 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.702 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:03.702 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674104+0000", 2024-09-12T18:36:03.702 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4124999999999998e-05 2024-09-12T18:36:03.702 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.702 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.702 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:03.704 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674164+0000", 2024-09-12T18:36:03.704 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.0130999999999997e-05 2024-09-12T18:36:03.704 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:03.704 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:03.704 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:03.704 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.704 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.704 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:26 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:03.704 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:03.704 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 38.048853264000002, 2024-09-12T18:36:03.705 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045702136999999997, 2024-09-12T18:36:03.705 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:03.705 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:03.705 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:03.705 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:03.705 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.705 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:03.705 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:03.705 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:03.705 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.705 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.705 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:03.705 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:03.706 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:03.706 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.706 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.706 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:03.706 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628699+0000", 2024-09-12T18:36:03.706 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3859999999999999e-06 2024-09-12T18:36:03.706 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.706 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.706 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:03.706 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628706+0000", 2024-09-12T18:36:03.706 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0169999999999999e-06 2024-09-12T18:36:03.706 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.706 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.707 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:03.707 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628725+0000", 2024-09-12T18:36:03.707 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8683000000000001e-05 2024-09-12T18:36:03.707 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.707 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.707 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:03.707 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628740+0000", 2024-09-12T18:36:03.707 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5413999999999998e-05 2024-09-12T18:36:03.707 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.707 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.707 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:03.707 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628907+0000", 2024-09-12T18:36:03.707 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00016670199999999999 2024-09-12T18:36:03.707 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.708 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.708 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:03.708 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628917+0000", 2024-09-12T18:36:03.708 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.046e-05 2024-09-12T18:36:03.708 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.708 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.708 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:03.708 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.660390+0000", 2024-09-12T18:36:03.708 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.031472364000000003 2024-09-12T18:36:03.708 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.708 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.708 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:03.708 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.661767+0000", 2024-09-12T18:36:03.708 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0013769190000000001 2024-09-12T18:36:03.709 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.709 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.709 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:03.709 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.662408+0000", 2024-09-12T18:36:03.709 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00064091099999999998 2024-09-12T18:36:03.709 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.709 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.709 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:03.709 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669577+0000", 2024-09-12T18:36:03.709 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.007169412 2024-09-12T18:36:03.709 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.709 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.710 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:03.710 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674244+0000", 2024-09-12T18:36:03.710 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0046671839999999996 2024-09-12T18:36:03.710 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.710 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.710 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:03.710 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674329+0000", 2024-09-12T18:36:03.710 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5276000000000001e-05 2024-09-12T18:36:03.710 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.710 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.710 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:03.710 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674400+0000", 2024-09-12T18:36:03.710 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0408999999999996e-05 2024-09-12T18:36:03.710 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:03.711 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:03.711 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:03.711 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.711 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.711 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:03.711 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:03.711 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 38.048745595, 2024-09-12T18:36:03.711 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.044572443000000003, 2024-09-12T18:36:03.711 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:03.711 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:03.711 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:03.711 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:03.711 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.711 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:03.712 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:03.712 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:03.712 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.712 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.712 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:03.712 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:03.712 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:03.712 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.712 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.712 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:03.712 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628807+0000", 2024-09-12T18:36:03.712 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3629999999999999e-06 2024-09-12T18:36:03.712 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.712 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.713 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:03.713 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628814+0000", 2024-09-12T18:36:03.713 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.2099999999999996e-06 2024-09-12T18:36:03.713 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.713 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.713 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:03.713 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628832+0000", 2024-09-12T18:36:03.713 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7972999999999999e-05 2024-09-12T18:36:03.713 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.713 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.713 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:03.713 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628854+0000", 2024-09-12T18:36:03.713 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1857000000000001e-05 2024-09-12T18:36:03.714 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.714 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.714 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:03.714 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628984+0000", 2024-09-12T18:36:03.714 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013013599999999999 2024-09-12T18:36:03.714 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.714 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.714 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:03.714 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628993+0000", 2024-09-12T18:36:03.714 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:36:03.714 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.714 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.714 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:03.715 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668176+0000", 2024-09-12T18:36:03.715 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.039182211000000002 2024-09-12T18:36:03.715 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.715 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.715 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:03.715 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668481+0000", 2024-09-12T18:36:03.715 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00030499200000000002 2024-09-12T18:36:03.715 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.715 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.715 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:03.715 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668771+0000", 2024-09-12T18:36:03.715 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00029018700000000002 2024-09-12T18:36:03.715 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.715 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.716 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:03.716 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.672674+0000", 2024-09-12T18:36:03.716 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0039031890000000001 2024-09-12T18:36:03.716 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.716 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.716 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:03.716 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673214+0000", 2024-09-12T18:36:03.716 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00053981600000000004 2024-09-12T18:36:03.716 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.716 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.716 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:03.716 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673310+0000", 2024-09-12T18:36:03.716 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.6682999999999996e-05 2024-09-12T18:36:03.717 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.717 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.717 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:03.717 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673378+0000", 2024-09-12T18:36:03.717 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7385999999999995e-05 2024-09-12T18:36:03.717 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:03.717 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:03.717 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:03.717 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.717 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.717 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:03.717 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:03.717 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 38.048609569, 2024-09-12T18:36:03.717 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.041480853999999998, 2024-09-12T18:36:03.718 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:03.718 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:03.718 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:03.718 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:03.718 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.718 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:03.718 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:03.718 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:03.718 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.718 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.718 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:03.718 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:03.719 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:03.719 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.719 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.719 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:03.719 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628943+0000", 2024-09-12T18:36:03.719 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.403e-06 2024-09-12T18:36:03.719 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.719 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.719 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:03.719 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628953+0000", 2024-09-12T18:36:03.719 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0273e-05 2024-09-12T18:36:03.719 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.719 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.719 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:03.720 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628973+0000", 2024-09-12T18:36:03.720 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9959999999999999e-05 2024-09-12T18:36:03.720 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.720 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.720 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:03.720 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628989+0000", 2024-09-12T18:36:03.720 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6447e-05 2024-09-12T18:36:03.720 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.720 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.720 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:03.720 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629144+0000", 2024-09-12T18:36:03.720 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015468900000000001 2024-09-12T18:36:03.720 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.721 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.721 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:03.721 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629162+0000", 2024-09-12T18:36:03.721 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7603000000000001e-05 2024-09-12T18:36:03.721 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.721 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.721 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:03.721 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.646927+0000", 2024-09-12T18:36:03.721 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.017765626 2024-09-12T18:36:03.721 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.721 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.721 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:03.721 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.647245+0000", 2024-09-12T18:36:03.721 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00031797699999999999 2024-09-12T18:36:03.722 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.722 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.722 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:03.722 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.647551+0000", 2024-09-12T18:36:03.722 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00030583500000000002 2024-09-12T18:36:03.722 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.722 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.722 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:03.722 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651738+0000", 2024-09-12T18:36:03.722 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0041864980000000003 2024-09-12T18:36:03.722 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.722 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.722 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:03.723 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670207+0000", 2024-09-12T18:36:03.723 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018469299000000002 2024-09-12T18:36:03.723 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.723 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.723 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:03.723 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670330+0000", 2024-09-12T18:36:03.723 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012284500000000001 2024-09-12T18:36:03.723 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.723 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.723 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:03.723 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670422+0000", 2024-09-12T18:36:03.723 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2398999999999994e-05 2024-09-12T18:36:03.723 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:03.723 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:03.724 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:03.724 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.724 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.724 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:03.724 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:03.724 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 38.048532315999999, 2024-09-12T18:36:03.724 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.041623741999999998, 2024-09-12T18:36:03.724 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:03.724 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:03.724 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:03.724 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:03.724 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.724 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:03.724 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:03.725 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:03.725 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.725 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.725 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:03.725 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:03.725 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:03.725 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.725 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.725 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:03.725 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629020+0000", 2024-09-12T18:36:03.725 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.15e-06 2024-09-12T18:36:03.725 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.725 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.726 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:03.726 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629023+0000", 2024-09-12T18:36:03.726 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4659999999999999e-06 2024-09-12T18:36:03.726 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.726 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.726 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:03.726 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629037+0000", 2024-09-12T18:36:03.726 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3857e-05 2024-09-12T18:36:03.726 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.726 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.726 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:03.726 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629062+0000", 2024-09-12T18:36:03.726 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4519999999999999e-05 2024-09-12T18:36:03.726 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.727 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.727 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:03.727 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629253+0000", 2024-09-12T18:36:03.727 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000191335 2024-09-12T18:36:03.727 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.727 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.727 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:03.727 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629266+0000", 2024-09-12T18:36:03.727 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3322999999999999e-05 2024-09-12T18:36:03.727 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.727 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.727 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:03.727 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648331+0000", 2024-09-12T18:36:03.728 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.019065060000000002 2024-09-12T18:36:03.728 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.728 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.728 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:03.728 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.650044+0000", 2024-09-12T18:36:03.728 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017123959999999999 2024-09-12T18:36:03.728 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.728 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.728 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:03.728 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670642+0000", 2024-09-12T18:36:03.728 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.020598635000000001 2024-09-12T18:36:03.728 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:03.728 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:03.729 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:03.729 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.729 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.729 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:03.729 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:03.729 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 38.048428983999997, 2024-09-12T18:36:03.729 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.046431252999999999, 2024-09-12T18:36:03.729 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:03.729 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:03.729 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:03.729 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:03.729 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.729 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:03.729 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:03.730 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:03.730 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.730 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.730 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:03.730 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:03.730 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:03.730 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.730 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.730 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:03.730 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629123+0000", 2024-09-12T18:36:03.730 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0899999999999999e-06 2024-09-12T18:36:03.730 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.730 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.730 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:03.731 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629138+0000", 2024-09-12T18:36:03.731 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4977000000000001e-05 2024-09-12T18:36:03.731 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.731 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.731 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:03.731 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629149+0000", 2024-09-12T18:36:03.731 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1182999999999999e-05 2024-09-12T18:36:03.731 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.731 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.731 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:03.731 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629157+0000", 2024-09-12T18:36:03.731 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8129999999999996e-06 2024-09-12T18:36:03.731 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.732 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.732 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:03.732 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629223+0000", 2024-09-12T18:36:03.732 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6463000000000004e-05 2024-09-12T18:36:03.732 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.732 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.732 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:03.732 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629230+0000", 2024-09-12T18:36:03.732 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1360000000000002e-06 2024-09-12T18:36:03.732 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.732 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.732 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:03.733 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669605+0000", 2024-09-12T18:36:03.733 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.040375518999999999 2024-09-12T18:36:03.733 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.733 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.733 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:03.733 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669840+0000", 2024-09-12T18:36:03.733 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00023520099999999999 2024-09-12T18:36:03.733 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.733 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.733 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:03.733 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.675553+0000", 2024-09-12T18:36:03.733 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0057128709999999996 2024-09-12T18:36:03.733 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:03.733 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:03.734 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:03.734 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.734 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.734 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:03.734 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:03.734 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 38.048374316999997, 2024-09-12T18:36:03.734 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.037357044999999998, 2024-09-12T18:36:03.734 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:03.734 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:03.734 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:03.734 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:03.734 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.734 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:03.734 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:03.735 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:03.735 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.735 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.735 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:03.735 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:03.735 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:03.735 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.735 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.735 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:03.735 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629178+0000", 2024-09-12T18:36:03.735 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.08e-06 2024-09-12T18:36:03.735 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.736 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.736 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:03.736 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629194+0000", 2024-09-12T18:36:03.736 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5899000000000001e-05 2024-09-12T18:36:03.736 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.736 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.736 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:03.736 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629211+0000", 2024-09-12T18:36:03.736 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7363e-05 2024-09-12T18:36:03.736 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.736 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.737 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:03.737 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629226+0000", 2024-09-12T18:36:03.737 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4567e-05 2024-09-12T18:36:03.737 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.737 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.737 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:03.737 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629299+0000", 2024-09-12T18:36:03.737 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3910000000000002e-05 2024-09-12T18:36:03.737 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.737 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.737 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:03.737 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629307+0000", 2024-09-12T18:36:03.737 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5299999999999999e-06 2024-09-12T18:36:03.738 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.738 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.738 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:03.738 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648185+0000", 2024-09-12T18:36:03.738 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018878533999999999 2024-09-12T18:36:03.738 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.738 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.738 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:03.738 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.649724+0000", 2024-09-12T18:36:03.738 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001538841 2024-09-12T18:36:03.738 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.738 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.738 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:03.738 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.666534+0000", 2024-09-12T18:36:03.739 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.016809320999999999 2024-09-12T18:36:03.739 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:03.739 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:03.739 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:03.739 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.739 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.739 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:36:03.739 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.648091+0000", 2024-09-12T18:36:03.739 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 38.029459727000003, 2024-09-12T18:36:03.739 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015212766000000001, 2024-09-12T18:36:03.739 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:03.739 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:03.739 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:03.739 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:03.740 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.740 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:03.740 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648091+0000", 2024-09-12T18:36:03.740 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:03.740 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.740 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.740 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:03.740 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648091+0000", 2024-09-12T18:36:03.740 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:03.740 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.740 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.740 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:03.741 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648092+0000", 2024-09-12T18:36:03.741 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.26e-06 2024-09-12T18:36:03.741 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.741 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.741 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:03.741 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648123+0000", 2024-09-12T18:36:03.741 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.0719000000000002e-05 2024-09-12T18:36:03.741 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.741 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.741 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:03.741 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648140+0000", 2024-09-12T18:36:03.741 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6650000000000002e-05 2024-09-12T18:36:03.741 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.741 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.742 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:03.742 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648153+0000", 2024-09-12T18:36:03.742 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.278e-05 2024-09-12T18:36:03.742 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.742 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.742 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:03.742 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.649756+0000", 2024-09-12T18:36:03.742 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0016036379999999999 2024-09-12T18:36:03.742 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.742 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.742 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:03.742 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.649800+0000", 2024-09-12T18:36:03.742 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3748999999999997e-05 2024-09-12T18:36:03.742 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.743 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.743 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:03.743 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663215+0000", 2024-09-12T18:36:03.743 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013414733999999999 2024-09-12T18:36:03.743 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.743 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.743 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:03.743 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663304+0000", 2024-09-12T18:36:03.743 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.9235999999999997e-05 2024-09-12T18:36:03.743 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:03.743 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:03.743 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:03.743 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.743 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.744 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T18:36:03.744 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.648176+0000", 2024-09-12T18:36:03.744 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 38.029375318, 2024-09-12T18:36:03.744 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015315812, 2024-09-12T18:36:03.744 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:03.744 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:03.744 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:03.744 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:03.744 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.744 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:03.744 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648176+0000", 2024-09-12T18:36:03.744 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:03.744 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.745 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.745 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:03.745 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648176+0000", 2024-09-12T18:36:03.745 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:03.745 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.745 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.745 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:03.745 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648176+0000", 2024-09-12T18:36:03.745 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.9400000000000005e-07 2024-09-12T18:36:03.745 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.745 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.745 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:03.745 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648184+0000", 2024-09-12T18:36:03.745 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4730000000000003e-06 2024-09-12T18:36:03.746 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.746 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.746 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:03.746 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648201+0000", 2024-09-12T18:36:03.746 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7119999999999999e-05 2024-09-12T18:36:03.746 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.746 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.746 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:03.746 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648214+0000", 2024-09-12T18:36:03.746 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3343000000000001e-05 2024-09-12T18:36:03.746 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.746 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.746 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:03.746 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651085+0000", 2024-09-12T18:36:03.747 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0028710850000000002 2024-09-12T18:36:03.747 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.747 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.747 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:03.747 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651114+0000", 2024-09-12T18:36:03.747 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.8296000000000001e-05 2024-09-12T18:36:03.747 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.747 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.747 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:03.747 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663360+0000", 2024-09-12T18:36:03.747 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012246801999999999 2024-09-12T18:36:03.747 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.747 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.747 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:03.748 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663491+0000", 2024-09-12T18:36:03.748 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000130999 2024-09-12T18:36:03.748 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:03.748 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:03.748 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:03.748 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.748 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.748 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T18:36:03.748 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.648235+0000", 2024-09-12T18:36:03.748 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 38.029315777999997, 2024-09-12T18:36:03.748 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015168310000000001, 2024-09-12T18:36:03.748 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:03.748 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:03.749 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:03.749 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:03.749 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.749 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:03.749 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648235+0000", 2024-09-12T18:36:03.749 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:03.749 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.749 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.749 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:03.749 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648235+0000", 2024-09-12T18:36:03.749 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:03.749 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.749 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.750 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:03.750 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648236+0000", 2024-09-12T18:36:03.750 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5300000000000003e-07 2024-09-12T18:36:03.750 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.750 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.750 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:03.750 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648244+0000", 2024-09-12T18:36:03.750 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.7170000000000008e-06 2024-09-12T18:36:03.750 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.750 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.750 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:03.750 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648259+0000", 2024-09-12T18:36:03.750 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5126000000000001e-05 2024-09-12T18:36:03.751 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.751 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.751 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:03.751 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648270+0000", 2024-09-12T18:36:03.751 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0933e-05 2024-09-12T18:36:03.751 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.751 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.751 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:03.751 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.650395+0000", 2024-09-12T18:36:03.751 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0021251040000000001 2024-09-12T18:36:03.751 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.751 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.751 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:03.751 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.650444+0000", 2024-09-12T18:36:03.752 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9456000000000002e-05 2024-09-12T18:36:03.752 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.752 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.752 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:03.752 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663311+0000", 2024-09-12T18:36:03.752 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012866658 2024-09-12T18:36:03.752 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.752 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.752 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:03.752 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663403+0000", 2024-09-12T18:36:03.752 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2563000000000001e-05 2024-09-12T18:36:03.752 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:03.753 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:03.753 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:03.753 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.753 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.753 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:62 5.6 5:67709b9f:::benchmark_data_smithi073_23739_object61:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:36:03.753 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:45.898027+0000", 2024-09-12T18:36:03.753 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 17.779524006999999, 2024-09-12T18:36:03.753 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.014007786, 2024-09-12T18:36:03.753 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:03.753 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:03.753 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:03.753 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:03.753 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:03.753 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:03.754 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 62 2024-09-12T18:36:03.754 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.754 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:03.754 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.754 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:03.754 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.898027+0000", 2024-09-12T18:36:03.754 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:03.754 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.754 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.754 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:03.754 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.898027+0000", 2024-09-12T18:36:03.754 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:03.754 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.755 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.755 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:03.755 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.898029+0000", 2024-09-12T18:36:03.755 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.554e-06 2024-09-12T18:36:03.755 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.755 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.755 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:03.755 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.898164+0000", 2024-09-12T18:36:03.755 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000134719 2024-09-12T18:36:03.756 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.756 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.756 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:03.756 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.898186+0000", 2024-09-12T18:36:03.756 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1449000000000001e-05 2024-09-12T18:36:03.756 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.756 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.756 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:03.756 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.898199+0000", 2024-09-12T18:36:03.756 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3403e-05 2024-09-12T18:36:03.756 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.757 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.757 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:03.757 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.900978+0000", 2024-09-12T18:36:03.757 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0027789260000000001 2024-09-12T18:36:03.757 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.757 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.757 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:03.757 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.901163+0000", 2024-09-12T18:36:03.757 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00018457200000000001 2024-09-12T18:36:03.757 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.758 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.758 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:03.758 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.901378+0000", 2024-09-12T18:36:03.758 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00021581500000000001 2024-09-12T18:36:03.758 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.758 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.758 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:03.758 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.905487+0000", 2024-09-12T18:36:03.758 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0041085679999999999 2024-09-12T18:36:03.758 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.758 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.758 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:03.759 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.911778+0000", 2024-09-12T18:36:03.759 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0062909690000000004 2024-09-12T18:36:03.759 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.759 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.759 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:03.759 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.911923+0000", 2024-09-12T18:36:03.759 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014524199999999999 2024-09-12T18:36:03.759 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.759 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.759 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:03.759 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:45.912035+0000", 2024-09-12T18:36:03.759 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000111569 2024-09-12T18:36:03.759 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:03.759 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:03.760 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:03.760 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.760 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.760 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:19809 5.c 5:3c729fea:::benchmark_data_smithi073_23739_object19808:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:36:03.760 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:51.970320+0000", 2024-09-12T18:36:03.760 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 11.707230729999999, 2024-09-12T18:36:03.760 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.014749093, 2024-09-12T18:36:03.760 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:03.760 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:03.760 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:03.760 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:03.760 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:03.760 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:03.761 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 19809 2024-09-12T18:36:03.761 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.761 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:03.761 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.761 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:03.761 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.970320+0000", 2024-09-12T18:36:03.761 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:03.761 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.761 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.761 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:03.761 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.970320+0000", 2024-09-12T18:36:03.761 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:03.761 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.762 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.762 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:03.762 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.970321+0000", 2024-09-12T18:36:03.762 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1999999999999998e-07 2024-09-12T18:36:03.762 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.762 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.762 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:03.762 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.971120+0000", 2024-09-12T18:36:03.762 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00079864400000000005 2024-09-12T18:36:03.762 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.762 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.762 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:03.762 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.971132+0000", 2024-09-12T18:36:03.763 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2021000000000001e-05 2024-09-12T18:36:03.763 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.763 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.763 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:03.763 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.971139+0000", 2024-09-12T18:36:03.763 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5070000000000003e-06 2024-09-12T18:36:03.763 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.763 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.763 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:03.763 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.971181+0000", 2024-09-12T18:36:03.763 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.1430999999999997e-05 2024-09-12T18:36:03.763 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.763 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.764 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:03.764 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.971271+0000", 2024-09-12T18:36:03.764 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.0098000000000004e-05 2024-09-12T18:36:03.764 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.764 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.764 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:03.764 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.971351+0000", 2024-09-12T18:36:03.764 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0370999999999993e-05 2024-09-12T18:36:03.764 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.764 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.764 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:03.764 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.972563+0000", 2024-09-12T18:36:03.764 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0012113549999999999 2024-09-12T18:36:03.765 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.765 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.765 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:03.765 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.984988+0000", 2024-09-12T18:36:03.765 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012425808999999999 2024-09-12T18:36:03.765 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.765 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.765 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:03.765 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.985036+0000", 2024-09-12T18:36:03.765 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.7703000000000001e-05 2024-09-12T18:36:03.765 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.765 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.765 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:03.766 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:51.985069+0000", 2024-09-12T18:36:03.766 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3234000000000001e-05 2024-09-12T18:36:03.766 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:03.766 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:03.766 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:03.766 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.766 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.766 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:31882 5.5 5:ad03140d:::benchmark_data_smithi073_23739_object31881:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T18:36:03.766 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:56.433012+0000", 2024-09-12T18:36:03.766 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 7.2445385550000001, 2024-09-12T18:36:03.766 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.014156314, 2024-09-12T18:36:03.766 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:03.766 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:03.766 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:03.767 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:03.767 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:03.767 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:03.767 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 31882 2024-09-12T18:36:03.767 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.767 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:03.767 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.767 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:03.767 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.433012+0000", 2024-09-12T18:36:03.767 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:03.767 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.767 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.767 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:03.767 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.433012+0000", 2024-09-12T18:36:03.768 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:03.768 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.768 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.768 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:03.768 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.433014+0000", 2024-09-12T18:36:03.768 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.274e-06 2024-09-12T18:36:03.768 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.768 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.768 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:03.768 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.433091+0000", 2024-09-12T18:36:03.768 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.7343999999999997e-05 2024-09-12T18:36:03.768 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.768 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.768 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:03.769 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.433103+0000", 2024-09-12T18:36:03.769 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1987999999999999e-05 2024-09-12T18:36:03.769 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.769 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.769 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:03.769 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.433112+0000", 2024-09-12T18:36:03.769 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.0750000000000004e-06 2024-09-12T18:36:03.769 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.769 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.769 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:03.769 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.433177+0000", 2024-09-12T18:36:03.769 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4682000000000002e-05 2024-09-12T18:36:03.769 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.769 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.770 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:03.770 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.433336+0000", 2024-09-12T18:36:03.770 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015913400000000001 2024-09-12T18:36:03.770 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.770 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.770 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:03.770 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.433530+0000", 2024-09-12T18:36:03.770 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00019447799999999999 2024-09-12T18:36:03.770 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.770 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.770 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:03.770 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.439096+0000", 2024-09-12T18:36:03.770 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0055656789999999996 2024-09-12T18:36:03.770 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.771 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.771 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:03.771 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.447106+0000", 2024-09-12T18:36:03.771 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0080096230000000004 2024-09-12T18:36:03.771 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.771 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.771 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:03.771 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.447141+0000", 2024-09-12T18:36:03.772 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.5771e-05 2024-09-12T18:36:03.772 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.772 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.772 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:03.772 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.447169+0000", 2024-09-12T18:36:03.772 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7265999999999999e-05 2024-09-12T18:36:03.772 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:03.772 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:03.772 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:03.772 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.772 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.772 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:31884 5.5 5:a6755fd3:::benchmark_data_smithi073_23739_object31883:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T18:36:03.772 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:56.433445+0000", 2024-09-12T18:36:03.773 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 7.2441057400000002, 2024-09-12T18:36:03.773 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.014045701000000001, 2024-09-12T18:36:03.773 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:03.773 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:03.773 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:03.773 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:03.773 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:03.773 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:03.773 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 31884 2024-09-12T18:36:03.773 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.773 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:03.773 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.773 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:03.773 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.433445+0000", 2024-09-12T18:36:03.774 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:03.774 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.774 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.774 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:03.774 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.433445+0000", 2024-09-12T18:36:03.774 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:03.774 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.774 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.774 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:03.774 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.433446+0000", 2024-09-12T18:36:03.774 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6799999999999999e-07 2024-09-12T18:36:03.774 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.774 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.774 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:03.775 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.433506+0000", 2024-09-12T18:36:03.775 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.0395e-05 2024-09-12T18:36:03.775 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.775 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.775 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:03.775 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.433516+0000", 2024-09-12T18:36:03.775 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.7440000000000002e-06 2024-09-12T18:36:03.775 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.775 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.775 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:03.775 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.433523+0000", 2024-09-12T18:36:03.775 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8299999999999998e-06 2024-09-12T18:36:03.775 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.775 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.776 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:03.776 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.434830+0000", 2024-09-12T18:36:03.776 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0013073990000000001 2024-09-12T18:36:03.776 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.776 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.776 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:03.776 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.434969+0000", 2024-09-12T18:36:03.776 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013848899999999999 2024-09-12T18:36:03.776 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.776 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.776 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:03.776 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.435078+0000", 2024-09-12T18:36:03.776 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00010863599999999999 2024-09-12T18:36:03.777 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.777 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.777 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:03.777 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.439195+0000", 2024-09-12T18:36:03.777 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0041172530000000004 2024-09-12T18:36:03.777 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.777 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.777 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:03.777 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.447439+0000", 2024-09-12T18:36:03.777 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0082444249999999997 2024-09-12T18:36:03.777 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.777 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.777 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:03.778 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.447470+0000", 2024-09-12T18:36:03.778 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.0324999999999998e-05 2024-09-12T18:36:03.778 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.778 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.778 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:03.778 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:56.447491+0000", 2024-09-12T18:36:03.778 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1336999999999999e-05 2024-09-12T18:36:03.778 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:03.778 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:03.778 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:03.778 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.778 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.778 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:38546 5.a 5:57563cdc:::benchmark_data_smithi073_23739_object38545:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:03.778 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:59.131733+0000", 2024-09-12T18:36:03.779 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4.545817714, 2024-09-12T18:36:03.779 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.01374713, 2024-09-12T18:36:03.779 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:03.779 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:03.779 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:03.779 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:03.779 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:03.779 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:03.779 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 38546 2024-09-12T18:36:03.779 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.779 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:03.779 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.779 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:03.779 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.131733+0000", 2024-09-12T18:36:03.780 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:03.780 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.780 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.780 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:03.780 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.131733+0000", 2024-09-12T18:36:03.780 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:03.780 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.780 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.780 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:03.780 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.131734+0000", 2024-09-12T18:36:03.780 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5799999999999998e-07 2024-09-12T18:36:03.780 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.780 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.781 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:03.781 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.131822+0000", 2024-09-12T18:36:03.781 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.8424999999999994e-05 2024-09-12T18:36:03.781 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.781 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.781 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:03.781 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.131831+0000", 2024-09-12T18:36:03.781 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.4840000000000004e-06 2024-09-12T18:36:03.781 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.781 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.781 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:03.781 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.131836+0000", 2024-09-12T18:36:03.781 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9660000000000004e-06 2024-09-12T18:36:03.781 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.782 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.782 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:03.782 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.133322+0000", 2024-09-12T18:36:03.782 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001485566 2024-09-12T18:36:03.782 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.782 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.782 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:03.782 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.133429+0000", 2024-09-12T18:36:03.782 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00010706599999999999 2024-09-12T18:36:03.782 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.782 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.782 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:03.782 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.133540+0000", 2024-09-12T18:36:03.782 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000111489 2024-09-12T18:36:03.783 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.783 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.783 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:03.783 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.138339+0000", 2024-09-12T18:36:03.783 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0047985420000000003 2024-09-12T18:36:03.783 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.783 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.783 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:03.783 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.145432+0000", 2024-09-12T18:36:03.783 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0070932959999999998 2024-09-12T18:36:03.783 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.783 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.783 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:03.783 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.145460+0000", 2024-09-12T18:36:03.783 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7823000000000001e-05 2024-09-12T18:36:03.784 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.784 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.784 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:03.784 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.145480+0000", 2024-09-12T18:36:03.784 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.0615000000000002e-05 2024-09-12T18:36:03.784 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:03.784 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:03.784 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:03.784 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.784 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.784 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:39360 5.6 5:6598b6f3:::benchmark_data_smithi073_23739_object39359:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:03.784 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:59.459787+0000", 2024-09-12T18:36:03.784 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4.2177644030000003, 2024-09-12T18:36:03.785 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.014801007, 2024-09-12T18:36:03.785 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:03.785 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:03.785 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:03.785 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:03.785 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:03.785 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:03.785 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 39360 2024-09-12T18:36:03.785 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.785 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:03.785 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.785 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:03.785 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.459787+0000", 2024-09-12T18:36:03.785 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:03.786 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.786 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.786 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:03.786 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.459787+0000", 2024-09-12T18:36:03.786 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:03.786 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.786 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.786 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:03.786 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.459787+0000", 2024-09-12T18:36:03.786 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3e-07 2024-09-12T18:36:03.786 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.786 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.786 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:03.787 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.459845+0000", 2024-09-12T18:36:03.787 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7516000000000003e-05 2024-09-12T18:36:03.787 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.787 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.787 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:03.787 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.459857+0000", 2024-09-12T18:36:03.787 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1854e-05 2024-09-12T18:36:03.787 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.787 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.787 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:03.787 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.459862+0000", 2024-09-12T18:36:03.787 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7640000000000002e-06 2024-09-12T18:36:03.787 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.787 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.788 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:03.788 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.459918+0000", 2024-09-12T18:36:03.788 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5958000000000002e-05 2024-09-12T18:36:03.788 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.788 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.788 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:03.788 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.460099+0000", 2024-09-12T18:36:03.788 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000180485 2024-09-12T18:36:03.788 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.788 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.788 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:03.788 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.460214+0000", 2024-09-12T18:36:03.788 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000115649 2024-09-12T18:36:03.788 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.789 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.789 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:03.789 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.462160+0000", 2024-09-12T18:36:03.789 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0019455029999999999 2024-09-12T18:36:03.789 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.789 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.789 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:03.789 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.474494+0000", 2024-09-12T18:36:03.789 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012334443 2024-09-12T18:36:03.789 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.789 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.789 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:03.789 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.474547+0000", 2024-09-12T18:36:03.789 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2392000000000003e-05 2024-09-12T18:36:03.790 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.790 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.790 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:03.790 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.474588+0000", 2024-09-12T18:36:03.790 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0713000000000001e-05 2024-09-12T18:36:03.790 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:03.790 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:03.790 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:03.790 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.790 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.790 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:39659 5.3 5:cd2bc06c:::benchmark_data_smithi073_23739_object39658:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:03.790 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:59.582797+0000", 2024-09-12T18:36:03.790 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4.0947543709999996, 2024-09-12T18:36:03.791 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015424513000000001, 2024-09-12T18:36:03.791 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:03.791 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:03.791 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:03.791 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:03.791 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:03.791 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:03.791 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 39659 2024-09-12T18:36:03.791 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.791 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:03.791 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.791 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:03.791 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.582797+0000", 2024-09-12T18:36:03.791 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:03.792 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.792 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.792 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:03.792 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.582797+0000", 2024-09-12T18:36:03.792 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:03.792 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.792 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.792 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:03.792 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.582798+0000", 2024-09-12T18:36:03.792 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3769999999999999e-06 2024-09-12T18:36:03.792 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.792 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.792 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:03.792 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.582885+0000", 2024-09-12T18:36:03.793 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6601999999999995e-05 2024-09-12T18:36:03.793 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.793 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.793 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:03.793 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.582895+0000", 2024-09-12T18:36:03.793 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0232e-05 2024-09-12T18:36:03.793 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.793 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.793 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:03.793 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.582902+0000", 2024-09-12T18:36:03.793 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0330000000000003e-06 2024-09-12T18:36:03.793 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.793 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.794 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:03.794 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.582966+0000", 2024-09-12T18:36:03.794 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4493999999999996e-05 2024-09-12T18:36:03.794 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.794 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.794 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:03.794 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.583107+0000", 2024-09-12T18:36:03.794 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000140815 2024-09-12T18:36:03.794 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.794 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.794 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:03.794 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.583306+0000", 2024-09-12T18:36:03.794 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000199194 2024-09-12T18:36:03.794 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.795 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.795 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:03.795 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.585942+0000", 2024-09-12T18:36:03.795 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0026352960000000001 2024-09-12T18:36:03.795 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.795 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.795 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:03.795 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.598120+0000", 2024-09-12T18:36:03.795 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012178501 2024-09-12T18:36:03.795 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.795 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.795 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:03.795 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.598182+0000", 2024-09-12T18:36:03.796 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1550999999999994e-05 2024-09-12T18:36:03.796 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.796 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.796 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:03.796 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.598221+0000", 2024-09-12T18:36:03.796 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.9418000000000001e-05 2024-09-12T18:36:03.796 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:03.796 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:03.796 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:03.796 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.796 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.796 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:40507 5.e e30/21 5:729d4bc6:::benchmark_data_smithi073_23739_object40506:head v 30'2528, mlcod=30'2524)", 2024-09-12T18:36:03.796 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:59.950176+0000", 2024-09-12T18:36:03.797 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 3.7273754160000001, 2024-09-12T18:36:03.797 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015643424, 2024-09-12T18:36:03.797 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:03.797 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:03.797 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:03.797 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:03.797 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.797 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:03.797 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.950176+0000", 2024-09-12T18:36:03.797 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:03.797 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.797 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.797 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:03.798 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.950176+0000", 2024-09-12T18:36:03.798 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:03.798 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.798 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.798 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:03.798 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.950176+0000", 2024-09-12T18:36:03.798 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2600000000000001e-07 2024-09-12T18:36:03.798 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.798 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.798 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:03.798 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.950234+0000", 2024-09-12T18:36:03.798 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8137000000000003e-05 2024-09-12T18:36:03.798 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.798 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.799 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:03.799 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.950248+0000", 2024-09-12T18:36:03.799 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3981999999999999e-05 2024-09-12T18:36:03.799 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.799 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.799 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:03.799 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.950256+0000", 2024-09-12T18:36:03.799 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5970000000000003e-06 2024-09-12T18:36:03.799 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.799 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.799 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:03.799 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.950304+0000", 2024-09-12T18:36:03.799 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8111000000000001e-05 2024-09-12T18:36:03.799 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.800 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.800 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:03.800 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.950323+0000", 2024-09-12T18:36:03.800 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9303000000000001e-05 2024-09-12T18:36:03.800 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.800 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.800 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:03.800 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.965795+0000", 2024-09-12T18:36:03.800 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015471238999999999 2024-09-12T18:36:03.800 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:03.800 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:03.800 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:03.800 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.965819+0000", 2024-09-12T18:36:03.801 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4229000000000001e-05 2024-09-12T18:36:03.801 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:03.801 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:03.801 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:03.801 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:03.801 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:03.801 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:03.803 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:36:03.803 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:03.797+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:03.870 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 18 16 49922 49906 173.266 146 0.00518573 0.00576643 2024-09-12T18:36:03.904 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:03.901+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:03.958 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:03.958 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:36:03.958 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.958 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:50133 5.b 5:dce53017:::benchmark_data_smithi073_23739_object50132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T18:36:03.958 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:03.954590+0000", 2024-09-12T18:36:03.958 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00331943, 2024-09-12T18:36:03.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00333863, 2024-09-12T18:36:03.958 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:03.958 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:03.959 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:03.959 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:03.959 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:03.959 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:03.959 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 50133 2024-09-12T18:36:03.959 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.959 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:03.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.959 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:03.959 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.954590+0000", 2024-09-12T18:36:03.959 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:03.959 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.960 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:03.960 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.954590+0000", 2024-09-12T18:36:03.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:03.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.960 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:03.960 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.954590+0000", 2024-09-12T18:36:03.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3300000000000001e-07 2024-09-12T18:36:03.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:03.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.954644+0000", 2024-09-12T18:36:03.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3109999999999998e-05 2024-09-12T18:36:03.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:03.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.954654+0000", 2024-09-12T18:36:03.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0745e-05 2024-09-12T18:36:03.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:03.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.954661+0000", 2024-09-12T18:36:03.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0280000000000003e-06 2024-09-12T18:36:03.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:03.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.954721+0000", 2024-09-12T18:36:03.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.9747999999999998e-05 2024-09-12T18:36:03.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:03.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.954848+0000", 2024-09-12T18:36:03.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000127405 2024-09-12T18:36:03.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:03.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.955021+0000", 2024-09-12T18:36:03.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000172132 2024-09-12T18:36:03.963 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.963 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.963 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:03.963 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.957635+0000", 2024-09-12T18:36:03.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0026139290000000001 2024-09-12T18:36:03.963 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:03.963 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:03.963 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:03.963 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.963 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.963 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:50135 5.e 5:7e030f77:::benchmark_data_smithi073_23739_object50134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T18:36:03.963 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:03.954679+0000", 2024-09-12T18:36:03.964 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.003230002, 2024-09-12T18:36:03.964 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0032961209999999999, 2024-09-12T18:36:03.964 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:03.964 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:03.964 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:03.964 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:03.964 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:03.964 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:03.964 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 50135 2024-09-12T18:36:03.964 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.964 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:03.964 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:03.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.954679+0000", 2024-09-12T18:36:03.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:03.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:03.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.954679+0000", 2024-09-12T18:36:03.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:03.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:03.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.954680+0000", 2024-09-12T18:36:03.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0699999999999997e-07 2024-09-12T18:36:03.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:03.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.954739+0000", 2024-09-12T18:36:03.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.9231999999999998e-05 2024-09-12T18:36:03.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:03.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.954747+0000", 2024-09-12T18:36:03.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3100000000000001e-06 2024-09-12T18:36:03.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:03.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.954753+0000", 2024-09-12T18:36:03.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1530000000000002e-06 2024-09-12T18:36:03.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:03.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.954795+0000", 2024-09-12T18:36:03.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2036000000000002e-05 2024-09-12T18:36:03.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.968 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:03.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.954899+0000", 2024-09-12T18:36:03.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010378 2024-09-12T18:36:03.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.968 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:03.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.955000+0000", 2024-09-12T18:36:03.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000101217 2024-09-12T18:36:03.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.968 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:03.969 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.957559+0000", 2024-09-12T18:36:03.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002558364 2024-09-12T18:36:03.969 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:03.969 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:03.969 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:03.969 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.969 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:50138 5.4 5:29750458:::benchmark_data_smithi073_23739_object50137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T18:36:03.969 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:03.956321+0000", 2024-09-12T18:36:03.969 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0015882590000000001, 2024-09-12T18:36:03.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0017016209999999999, 2024-09-12T18:36:03.969 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:03.969 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:03.970 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:03.970 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:03.970 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:03.970 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:03.970 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 50138 2024-09-12T18:36:03.970 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.970 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:03.970 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.970 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:03.970 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.956321+0000", 2024-09-12T18:36:03.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:03.970 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.970 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.970 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:03.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.956321+0000", 2024-09-12T18:36:03.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:03.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:03.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.956322+0000", 2024-09-12T18:36:03.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2669999999999999e-06 2024-09-12T18:36:03.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:03.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.956380+0000", 2024-09-12T18:36:03.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7997000000000001e-05 2024-09-12T18:36:03.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:03.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.956391+0000", 2024-09-12T18:36:03.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1345000000000001e-05 2024-09-12T18:36:03.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:03.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.956406+0000", 2024-09-12T18:36:03.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4287000000000001e-05 2024-09-12T18:36:03.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:03.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.956499+0000", 2024-09-12T18:36:03.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.3498999999999994e-05 2024-09-12T18:36:03.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:03.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.956678+0000", 2024-09-12T18:36:03.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00017914499999999999 2024-09-12T18:36:03.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:03.974 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.956801+0000", 2024-09-12T18:36:03.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000122979 2024-09-12T18:36:03.974 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:03.974 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:03.974 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:03.974 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.974 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:50137 5.a e33/21 5:5fe95205:::benchmark_data_smithi073_23739_object50136:head v 33'3163, mlcod=33'3161)", 2024-09-12T18:36:03.974 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:03.956375+0000", 2024-09-12T18:36:03.974 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.001534103, 2024-09-12T18:36:03.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001692467, 2024-09-12T18:36:03.974 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:03.974 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:03.975 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:03.975 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:03.975 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.975 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:03.975 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.956375+0000", 2024-09-12T18:36:03.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:03.975 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.975 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.975 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:03.975 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.956375+0000", 2024-09-12T18:36:03.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:03.975 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.975 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.975 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:03.976 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.956376+0000", 2024-09-12T18:36:03.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7199999999999997e-07 2024-09-12T18:36:03.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.976 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:03.976 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.956439+0000", 2024-09-12T18:36:03.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.3450999999999999e-05 2024-09-12T18:36:03.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.976 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:03.976 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.956445+0000", 2024-09-12T18:36:03.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8390000000000003e-06 2024-09-12T18:36:03.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:03.977 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.956450+0000", 2024-09-12T18:36:03.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.074e-06 2024-09-12T18:36:03.977 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:03.977 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.956505+0000", 2024-09-12T18:36:03.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5152000000000003e-05 2024-09-12T18:36:03.977 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:03.977 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.956518+0000", 2024-09-12T18:36:03.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2941e-05 2024-09-12T18:36:03.978 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:03.978 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:03.978 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:03.978 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.978 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:50136 5.f e33/21 5:f5e1a012:::benchmark_data_smithi073_23739_object50135:head v 33'3187, mlcod=33'3185)", 2024-09-12T18:36:03.978 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:03.956556+0000", 2024-09-12T18:36:03.978 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0013534790000000001, 2024-09-12T18:36:03.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015405779999999999, 2024-09-12T18:36:03.978 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:03.978 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:03.978 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:03.978 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:03.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.979 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:03.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.956556+0000", 2024-09-12T18:36:03.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:03.979 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.979 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:03.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.956556+0000", 2024-09-12T18:36:03.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:03.979 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.979 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:03.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.956556+0000", 2024-09-12T18:36:03.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8800000000000002e-07 2024-09-12T18:36:03.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.980 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:03.980 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.956588+0000", 2024-09-12T18:36:03.980 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2327999999999999e-05 2024-09-12T18:36:03.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.980 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:03.980 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.956596+0000", 2024-09-12T18:36:03.980 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7849999999999992e-06 2024-09-12T18:36:03.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.980 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:03.981 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.956602+0000", 2024-09-12T18:36:03.981 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.9789999999999998e-06 2024-09-12T18:36:03.981 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.981 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.981 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:03.981 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.956647+0000", 2024-09-12T18:36:03.981 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4419000000000003e-05 2024-09-12T18:36:03.981 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.981 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.981 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:03.981 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.956665+0000", 2024-09-12T18:36:03.981 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8e-05 2024-09-12T18:36:03.981 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:03.982 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:03.982 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:03.982 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.982 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.982 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:50144 5.4 5.865c9434 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T18:36:03.982 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:03.957678+0000", 2024-09-12T18:36:03.982 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00023107999999999999, 2024-09-12T18:36:03.982 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00044420400000000002, 2024-09-12T18:36:03.982 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:03.982 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:03.982 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:03.982 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:03.982 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:03.983 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:03.983 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 50144 2024-09-12T18:36:03.983 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.983 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:03.983 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.983 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:03.983 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.957678+0000", 2024-09-12T18:36:03.983 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:03.983 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.983 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.983 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:03.983 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.957678+0000", 2024-09-12T18:36:03.983 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:03.984 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.984 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:03.984 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.957679+0000", 2024-09-12T18:36:03.984 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.074e-06 2024-09-12T18:36:03.984 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.984 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:03.984 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.957735+0000", 2024-09-12T18:36:03.984 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6193999999999998e-05 2024-09-12T18:36:03.984 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.984 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:03.985 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.957746+0000", 2024-09-12T18:36:03.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1116e-05 2024-09-12T18:36:03.985 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.985 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.985 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:03.985 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.957753+0000", 2024-09-12T18:36:03.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4300000000000003e-06 2024-09-12T18:36:03.985 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:03.985 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:03.985 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:03.985 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.985 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.986 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:50143 5.9 e33/21 5:9729bd1d:::benchmark_data_smithi073_23739_object50142:head v 33'3118, mlcod=33'3116)", 2024-09-12T18:36:03.986 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:03.957896+0000", 2024-09-12T18:36:03.986 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.2884000000000001e-05, 2024-09-12T18:36:03.986 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025685699999999998, 2024-09-12T18:36:03.986 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:03.986 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:03.986 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:03.986 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:03.986 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.986 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:03.986 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.957896+0000", 2024-09-12T18:36:03.986 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:03.986 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.987 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.987 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:03.987 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.957896+0000", 2024-09-12T18:36:03.987 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:03.987 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.987 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.987 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:03.987 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.957897+0000", 2024-09-12T18:36:03.987 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1500000000000005e-07 2024-09-12T18:36:03.987 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.987 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.987 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:03.987 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.957962+0000", 2024-09-12T18:36:03.987 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4888000000000006e-05 2024-09-12T18:36:03.988 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.988 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.988 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:03.988 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.957970+0000", 2024-09-12T18:36:03.988 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3569999999999998e-06 2024-09-12T18:36:03.988 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.988 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.988 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:03.988 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.957976+0000", 2024-09-12T18:36:03.988 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.178e-06 2024-09-12T18:36:03.988 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.988 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.988 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:03.989 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.958050+0000", 2024-09-12T18:36:03.989 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4306000000000003e-05 2024-09-12T18:36:03.989 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:03.989 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:03.989 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:03.989 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.958075+0000", 2024-09-12T18:36:03.989 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4467000000000001e-05 2024-09-12T18:36:03.989 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:03.989 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:03.989 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:03.989 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:03.989 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-09-12T18:36:03.989 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 7 2024-09-12T18:36:03.990 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:03.991 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:36:04.039 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:04.037+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:04.105 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:04.101+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:04.145 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:04.145 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-09-12T18:36:04.146 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-09-12T18:36:04.146 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-09-12T18:36:04.146 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:04.168 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:36:04.206 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:04.201+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:04.307 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:04.301+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:04.367 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:04.368 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-09-12T18:36:04.368 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-09-12T18:36:04.368 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:36:04.368 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.368 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:04.369 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:04.369 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 38.733375471999999, 2024-09-12T18:36:04.369 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025088781000000001, 2024-09-12T18:36:04.369 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:04.369 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:04.369 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:04.369 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:04.369 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.369 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:04.369 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:04.369 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:04.369 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.370 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.370 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:04.370 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:04.370 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:04.370 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.370 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.370 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:04.370 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632518+0000", 2024-09-12T18:36:04.370 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:36:04.370 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.370 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.371 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:04.371 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632533+0000", 2024-09-12T18:36:04.371 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5130000000000001e-05 2024-09-12T18:36:04.371 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.371 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.371 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:04.371 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632564+0000", 2024-09-12T18:36:04.371 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0788999999999999e-05 2024-09-12T18:36:04.371 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.371 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.371 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:04.371 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632590+0000", 2024-09-12T18:36:04.372 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6057000000000001e-05 2024-09-12T18:36:04.372 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.372 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.372 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:04.372 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.635931+0000", 2024-09-12T18:36:04.372 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033411320000000001 2024-09-12T18:36:04.372 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.372 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.372 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:04.372 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636186+0000", 2024-09-12T18:36:04.372 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025452500000000002 2024-09-12T18:36:04.372 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.373 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.373 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:04.373 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636445+0000", 2024-09-12T18:36:04.373 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000259268 2024-09-12T18:36:04.373 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.373 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.373 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:04.373 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639562+0000", 2024-09-12T18:36:04.373 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031167 2024-09-12T18:36:04.373 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.373 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.373 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:04.373 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657314+0000", 2024-09-12T18:36:04.374 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017752562 2024-09-12T18:36:04.374 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.374 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.374 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:04.374 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657445+0000", 2024-09-12T18:36:04.374 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013105899999999999 2024-09-12T18:36:04.374 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.374 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.374 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:04.374 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657598+0000", 2024-09-12T18:36:04.374 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015247899999999999 2024-09-12T18:36:04.374 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:04.374 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:04.374 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:04.375 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.375 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.375 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:04.375 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:04.375 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 38.733249268999998, 2024-09-12T18:36:04.375 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025643131999999999, 2024-09-12T18:36:04.375 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:04.375 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:04.375 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:04.375 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:04.375 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.375 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:04.375 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:04.375 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:04.376 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.376 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.376 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:04.376 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:04.376 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:04.376 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.376 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.376 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:04.376 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632637+0000", 2024-09-12T18:36:04.376 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5600000000000001e-06 2024-09-12T18:36:04.376 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.376 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.377 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:04.377 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632650+0000", 2024-09-12T18:36:04.377 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3186e-05 2024-09-12T18:36:04.377 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.377 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.377 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:04.377 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632672+0000", 2024-09-12T18:36:04.377 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2013000000000001e-05 2024-09-12T18:36:04.377 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.378 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.378 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:04.378 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632687+0000", 2024-09-12T18:36:04.378 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5109999999999999e-05 2024-09-12T18:36:04.378 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.378 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.378 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:04.378 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636994+0000", 2024-09-12T18:36:04.378 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0043065539999999998 2024-09-12T18:36:04.378 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.378 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.378 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:04.378 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637198+0000", 2024-09-12T18:36:04.379 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020387199999999999 2024-09-12T18:36:04.379 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.379 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.379 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:04.379 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637475+0000", 2024-09-12T18:36:04.379 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027731000000000001 2024-09-12T18:36:04.379 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.379 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.379 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:04.379 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639574+0000", 2024-09-12T18:36:04.379 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020988999999999999 2024-09-12T18:36:04.379 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.379 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.380 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:04.380 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658057+0000", 2024-09-12T18:36:04.380 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018482926 2024-09-12T18:36:04.380 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.380 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.380 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:04.380 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658184+0000", 2024-09-12T18:36:04.380 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012756200000000001 2024-09-12T18:36:04.380 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.380 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.380 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:04.380 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658278+0000", 2024-09-12T18:36:04.380 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4139000000000001e-05 2024-09-12T18:36:04.381 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:04.381 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:04.381 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:04.381 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.381 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.381 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:04.381 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:04.381 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 38.733174177000002, 2024-09-12T18:36:04.382 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025238883, 2024-09-12T18:36:04.382 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:04.382 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:04.382 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:04.382 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:04.382 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.382 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:04.382 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:04.382 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:04.382 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.382 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.383 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:04.383 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:04.383 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:04.383 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.383 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.383 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:04.383 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632712+0000", 2024-09-12T18:36:04.383 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6869999999999999e-06 2024-09-12T18:36:04.383 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.383 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.383 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:04.383 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632719+0000", 2024-09-12T18:36:04.383 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6059999999999999e-06 2024-09-12T18:36:04.383 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.384 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.384 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:04.384 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632737+0000", 2024-09-12T18:36:04.384 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7983999999999999e-05 2024-09-12T18:36:04.384 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.384 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.384 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:04.384 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632751+0000", 2024-09-12T18:36:04.384 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4473e-05 2024-09-12T18:36:04.384 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.384 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.384 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:04.385 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636961+0000", 2024-09-12T18:36:04.385 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042100840000000002 2024-09-12T18:36:04.385 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.385 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.385 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:04.385 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637211+0000", 2024-09-12T18:36:04.385 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000249738 2024-09-12T18:36:04.385 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.385 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.385 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:04.385 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637504+0000", 2024-09-12T18:36:04.385 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00029271499999999998 2024-09-12T18:36:04.385 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.385 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.386 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:04.386 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639582+0000", 2024-09-12T18:36:04.386 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020783389999999998 2024-09-12T18:36:04.386 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.386 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.386 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:04.386 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657709+0000", 2024-09-12T18:36:04.386 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018126758999999999 2024-09-12T18:36:04.386 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.386 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.386 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:04.386 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657830+0000", 2024-09-12T18:36:04.386 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000121329 2024-09-12T18:36:04.387 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.387 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.387 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:04.387 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657949+0000", 2024-09-12T18:36:04.387 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000119169 2024-09-12T18:36:04.387 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:04.387 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:04.387 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:04.387 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.387 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.387 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:04.387 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:04.388 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 38.733110130999997, 2024-09-12T18:36:04.388 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026711823999999999, 2024-09-12T18:36:04.388 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:04.388 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:04.388 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:04.388 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:04.388 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.388 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:04.388 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:04.388 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:04.388 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.388 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.389 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:04.389 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:04.389 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:04.389 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.389 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.389 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:04.389 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632775+0000", 2024-09-12T18:36:04.389 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9999999999999995e-07 2024-09-12T18:36:04.389 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.389 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.389 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:04.389 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632788+0000", 2024-09-12T18:36:04.389 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2629999999999999e-05 2024-09-12T18:36:04.390 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.390 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.390 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:04.390 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632806+0000", 2024-09-12T18:36:04.390 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:36:04.390 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.390 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.390 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:04.390 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632820+0000", 2024-09-12T18:36:04.390 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3777e-05 2024-09-12T18:36:04.390 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.390 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.391 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:04.391 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638310+0000", 2024-09-12T18:36:04.391 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054898280000000004 2024-09-12T18:36:04.391 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.391 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.391 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:04.391 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638480+0000", 2024-09-12T18:36:04.391 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016968199999999999 2024-09-12T18:36:04.391 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.391 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.391 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:04.391 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638799+0000", 2024-09-12T18:36:04.391 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031915999999999997 2024-09-12T18:36:04.392 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.392 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.392 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:04.392 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639866+0000", 2024-09-12T18:36:04.392 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001067405 2024-09-12T18:36:04.392 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.392 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.392 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:04.392 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658398+0000", 2024-09-12T18:36:04.392 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018531542000000002 2024-09-12T18:36:04.392 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.392 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.392 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:04.393 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658643+0000", 2024-09-12T18:36:04.393 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00024531500000000002 2024-09-12T18:36:04.393 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.393 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.393 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:04.393 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.659486+0000", 2024-09-12T18:36:04.393 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00084316899999999995 2024-09-12T18:36:04.393 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:04.393 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:04.393 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:04.393 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.393 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.394 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:04.394 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632845+0000", 2024-09-12T18:36:04.394 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 38.733039105000003, 2024-09-12T18:36:04.394 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015333398999999999, 2024-09-12T18:36:04.394 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:04.394 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:04.394 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:04.394 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:04.394 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.395 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:04.395 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632845+0000", 2024-09-12T18:36:04.395 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:04.395 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.395 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.395 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:04.395 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632845+0000", 2024-09-12T18:36:04.395 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:04.395 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.395 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.395 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:04.395 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632847+0000", 2024-09-12T18:36:04.395 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.407e-06 2024-09-12T18:36:04.396 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.396 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.396 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:04.396 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632854+0000", 2024-09-12T18:36:04.396 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1670000000000002e-06 2024-09-12T18:36:04.396 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.396 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.396 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:04.396 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632877+0000", 2024-09-12T18:36:04.396 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2929e-05 2024-09-12T18:36:04.396 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.396 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.397 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:04.397 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632891+0000", 2024-09-12T18:36:04.397 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3689999999999999e-05 2024-09-12T18:36:04.397 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.397 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.397 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:04.397 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.634571+0000", 2024-09-12T18:36:04.397 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016800929999999999 2024-09-12T18:36:04.397 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.397 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.397 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:04.397 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.635247+0000", 2024-09-12T18:36:04.398 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000676051 2024-09-12T18:36:04.398 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.398 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.398 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:04.398 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636176+0000", 2024-09-12T18:36:04.398 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00092889199999999996 2024-09-12T18:36:04.398 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.398 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.398 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:04.398 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637978+0000", 2024-09-12T18:36:04.398 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018024320000000001 2024-09-12T18:36:04.398 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.398 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.398 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:04.399 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.647862+0000", 2024-09-12T18:36:04.399 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0098842540000000003 2024-09-12T18:36:04.399 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.399 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.399 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:04.399 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.648055+0000", 2024-09-12T18:36:04.399 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00019265499999999999 2024-09-12T18:36:04.399 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.399 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.399 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:04.399 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.648179+0000", 2024-09-12T18:36:04.400 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000123829 2024-09-12T18:36:04.400 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:04.400 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:04.400 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:04.400 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.400 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.400 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:04.400 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:36:04.400 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 38.732883069000003, 2024-09-12T18:36:04.400 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.021357139000000001, 2024-09-12T18:36:04.400 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:04.400 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:04.400 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:04.400 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:04.401 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.401 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:04.401 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:36:04.401 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:04.401 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.401 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.401 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:04.401 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:36:04.401 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:04.401 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.401 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.401 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:04.401 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633003+0000", 2024-09-12T18:36:04.401 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.53e-06 2024-09-12T18:36:04.402 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.402 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.402 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:04.402 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633012+0000", 2024-09-12T18:36:04.402 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9290000000000004e-06 2024-09-12T18:36:04.402 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.402 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.402 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:04.402 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633034+0000", 2024-09-12T18:36:04.402 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2127e-05 2024-09-12T18:36:04.402 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.402 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.402 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:04.402 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633054+0000", 2024-09-12T18:36:04.403 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9476000000000001e-05 2024-09-12T18:36:04.403 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.403 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.403 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:04.403 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636657+0000", 2024-09-12T18:36:04.403 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036038839999999999 2024-09-12T18:36:04.403 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.403 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.403 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:04.403 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636885+0000", 2024-09-12T18:36:04.403 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022798800000000001 2024-09-12T18:36:04.403 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.403 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.403 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:04.404 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637189+0000", 2024-09-12T18:36:04.404 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030392100000000002 2024-09-12T18:36:04.404 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.404 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.404 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:04.404 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639271+0000", 2024-09-12T18:36:04.404 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020817460000000002 2024-09-12T18:36:04.404 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.404 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.404 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:04.404 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.652371+0000", 2024-09-12T18:36:04.404 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013099417 2024-09-12T18:36:04.405 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.405 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.405 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:04.405 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654255+0000", 2024-09-12T18:36:04.405 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018846049999999999 2024-09-12T18:36:04.405 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.405 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.405 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:04.405 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654359+0000", 2024-09-12T18:36:04.405 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000103516 2024-09-12T18:36:04.405 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:04.405 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:04.405 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:04.405 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.405 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.406 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:04.406 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:04.406 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 38.732801377000001, 2024-09-12T18:36:04.406 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026938645000000001, 2024-09-12T18:36:04.406 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:04.406 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:04.406 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:04.406 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:04.406 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.406 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:04.406 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:04.406 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:04.406 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.407 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.407 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:04.407 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:04.407 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:04.407 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.407 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.407 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:04.407 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633085+0000", 2024-09-12T18:36:04.407 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:04.407 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.407 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.407 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:04.407 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633093+0000", 2024-09-12T18:36:04.407 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3999999999999992e-06 2024-09-12T18:36:04.408 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.408 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.408 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:04.408 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633111+0000", 2024-09-12T18:36:04.408 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8070000000000001e-05 2024-09-12T18:36:04.408 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.408 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.408 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:04.408 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633126+0000", 2024-09-12T18:36:04.408 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4487e-05 2024-09-12T18:36:04.408 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.408 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.408 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:04.409 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638290+0000", 2024-09-12T18:36:04.409 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0051640269999999999 2024-09-12T18:36:04.409 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.409 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.409 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:04.409 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638547+0000", 2024-09-12T18:36:04.409 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025714100000000001 2024-09-12T18:36:04.409 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.409 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.409 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:04.409 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638850+0000", 2024-09-12T18:36:04.409 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030278400000000001 2024-09-12T18:36:04.409 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.409 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.410 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:04.410 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.640706+0000", 2024-09-12T18:36:04.410 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018564580000000001 2024-09-12T18:36:04.410 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.410 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.410 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:04.410 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658420+0000", 2024-09-12T18:36:04.410 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017714395000000001 2024-09-12T18:36:04.410 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.410 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.410 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:04.410 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658635+0000", 2024-09-12T18:36:04.410 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021413500000000001 2024-09-12T18:36:04.411 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.411 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.411 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:04.411 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.660022+0000", 2024-09-12T18:36:04.411 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001387318 2024-09-12T18:36:04.411 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:04.411 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:04.411 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:04.411 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.411 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.411 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:04.411 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633323+0000", 2024-09-12T18:36:04.411 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 38.732562022000003, 2024-09-12T18:36:04.412 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015717332000000001, 2024-09-12T18:36:04.412 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:04.412 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:04.412 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:04.412 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:04.412 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.412 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:04.412 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633323+0000", 2024-09-12T18:36:04.412 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:04.412 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.412 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.412 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:04.412 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633323+0000", 2024-09-12T18:36:04.413 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:04.413 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.413 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.413 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:04.413 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633324+0000", 2024-09-12T18:36:04.413 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7230000000000001e-06 2024-09-12T18:36:04.413 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.413 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.413 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:04.413 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633351+0000", 2024-09-12T18:36:04.413 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7067e-05 2024-09-12T18:36:04.413 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.413 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.414 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:04.414 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633372+0000", 2024-09-12T18:36:04.414 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0429e-05 2024-09-12T18:36:04.414 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.414 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.414 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:04.414 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633387+0000", 2024-09-12T18:36:04.414 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5659999999999999e-05 2024-09-12T18:36:04.414 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.414 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.414 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:04.414 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633527+0000", 2024-09-12T18:36:04.414 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013991599999999999 2024-09-12T18:36:04.415 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.415 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.415 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:04.415 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633806+0000", 2024-09-12T18:36:04.415 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027858400000000001 2024-09-12T18:36:04.415 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.415 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.415 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:04.415 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.649040+0000", 2024-09-12T18:36:04.416 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015233953 2024-09-12T18:36:04.416 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:04.416 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:04.416 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:04.416 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.416 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.416 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:04.416 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:36:04.416 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 38.732456866, 2024-09-12T18:36:04.416 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.020709867, 2024-09-12T18:36:04.416 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:04.417 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:04.417 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:04.417 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:04.417 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.417 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:04.417 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:36:04.417 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:04.417 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.417 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.418 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:04.418 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:36:04.418 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:04.418 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.418 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.418 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:04.418 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633429+0000", 2024-09-12T18:36:04.418 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.313e-06 2024-09-12T18:36:04.418 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.418 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.419 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:04.419 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633462+0000", 2024-09-12T18:36:04.419 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3197000000000001e-05 2024-09-12T18:36:04.419 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.419 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.419 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:04.419 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633485+0000", 2024-09-12T18:36:04.419 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3243000000000001e-05 2024-09-12T18:36:04.419 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.420 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.420 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:04.420 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633501+0000", 2024-09-12T18:36:04.420 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5383000000000002e-05 2024-09-12T18:36:04.420 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.420 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.420 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:04.420 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633642+0000", 2024-09-12T18:36:04.420 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000141168 2024-09-12T18:36:04.420 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.420 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.420 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:04.421 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633982+0000", 2024-09-12T18:36:04.421 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000340067 2024-09-12T18:36:04.421 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.421 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.421 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:04.421 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654138+0000", 2024-09-12T18:36:04.422 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.020155495999999998 2024-09-12T18:36:04.422 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:04.422 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:04.422 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:04.422 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.422 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.422 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:29330 5.8 5:1b9a4683:::benchmark_data_smithi073_23739_object29329:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T18:36:04.422 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:55.446525+0000", 2024-09-12T18:36:04.422 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 8.9193595349999999, 2024-09-12T18:36:04.422 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.014327295, 2024-09-12T18:36:04.422 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:04.423 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:04.423 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:04.423 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:04.423 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:04.423 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:04.423 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 29330 2024-09-12T18:36:04.423 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.423 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:04.423 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.423 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:04.423 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:55.446525+0000", 2024-09-12T18:36:04.423 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:04.423 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.423 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.424 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:04.424 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:55.446525+0000", 2024-09-12T18:36:04.424 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:04.424 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.424 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.424 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:04.424 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:55.446526+0000", 2024-09-12T18:36:04.424 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4050000000000001e-06 2024-09-12T18:36:04.424 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.424 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.424 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:04.424 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:55.446593+0000", 2024-09-12T18:36:04.424 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6123000000000004e-05 2024-09-12T18:36:04.425 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.425 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.425 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:04.425 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:55.446611+0000", 2024-09-12T18:36:04.425 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8771999999999999e-05 2024-09-12T18:36:04.425 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.425 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.425 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:04.425 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:55.446625+0000", 2024-09-12T18:36:04.425 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3344e-05 2024-09-12T18:36:04.425 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.425 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.426 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:04.426 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:55.447520+0000", 2024-09-12T18:36:04.426 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00089562500000000005 2024-09-12T18:36:04.426 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.426 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.426 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:04.426 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:55.447604+0000", 2024-09-12T18:36:04.426 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4073000000000006e-05 2024-09-12T18:36:04.426 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.426 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.426 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:04.426 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:55.447698+0000", 2024-09-12T18:36:04.426 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.3731000000000001e-05 2024-09-12T18:36:04.426 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.427 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.427 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:04.427 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:55.452981+0000", 2024-09-12T18:36:04.427 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052828329999999998 2024-09-12T18:36:04.427 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.427 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.427 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:04.427 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:55.460671+0000", 2024-09-12T18:36:04.427 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076904390000000003 2024-09-12T18:36:04.427 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.427 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.427 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:04.427 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:55.460742+0000", 2024-09-12T18:36:04.428 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0925000000000003e-05 2024-09-12T18:36:04.428 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.428 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.428 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:04.428 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:55.460852+0000", 2024-09-12T18:36:04.428 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000110025 2024-09-12T18:36:04.428 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:04.428 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:04.428 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:04.428 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.428 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.428 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:39657 5.b 5:d5bef399:::benchmark_data_smithi073_23739_object39656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:04.428 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:59.583437+0000", 2024-09-12T18:36:04.429 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.7824475099999999, 2024-09-12T18:36:04.429 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.014985627, 2024-09-12T18:36:04.429 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:04.429 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:04.429 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:04.429 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:04.429 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:04.429 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:04.429 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 39657 2024-09-12T18:36:04.429 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.429 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:04.429 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.429 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:04.429 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.583437+0000", 2024-09-12T18:36:04.430 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:04.430 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.430 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.430 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:04.430 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.583437+0000", 2024-09-12T18:36:04.430 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:04.430 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.430 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.430 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:04.430 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.583438+0000", 2024-09-12T18:36:04.431 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.1200000000000001e-07 2024-09-12T18:36:04.431 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.431 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.431 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:04.431 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.583508+0000", 2024-09-12T18:36:04.431 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0088999999999999e-05 2024-09-12T18:36:04.431 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.431 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.431 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:04.431 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.583518+0000", 2024-09-12T18:36:04.431 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.028e-05 2024-09-12T18:36:04.432 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.432 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.432 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:04.432 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.583525+0000", 2024-09-12T18:36:04.432 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.165e-06 2024-09-12T18:36:04.432 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.432 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.432 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:04.432 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.584442+0000", 2024-09-12T18:36:04.432 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00091684000000000004 2024-09-12T18:36:04.432 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.432 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.432 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:04.433 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.584615+0000", 2024-09-12T18:36:04.433 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000173089 2024-09-12T18:36:04.433 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.433 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.433 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:04.433 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.584877+0000", 2024-09-12T18:36:04.433 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000261644 2024-09-12T18:36:04.433 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.433 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.433 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:04.433 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.587726+0000", 2024-09-12T18:36:04.433 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0028489169999999999 2024-09-12T18:36:04.433 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.433 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.434 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:04.434 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.598304+0000", 2024-09-12T18:36:04.434 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.010578438000000001 2024-09-12T18:36:04.434 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.434 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.434 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:04.434 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.598366+0000", 2024-09-12T18:36:04.434 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2014999999999995e-05 2024-09-12T18:36:04.434 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.434 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.434 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:04.434 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.598423+0000", 2024-09-12T18:36:04.434 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6237999999999999e-05 2024-09-12T18:36:04.434 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:04.435 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:04.435 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:04.435 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.435 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.435 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:40427 5.b 5:d12d7e68:::benchmark_data_smithi073_23739_object40426:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:04.435 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:59.916941+0000", 2024-09-12T18:36:04.435 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.4489438290000001, 2024-09-12T18:36:04.435 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.014403212, 2024-09-12T18:36:04.435 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:04.435 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:04.435 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:04.435 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:04.436 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:04.436 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:04.436 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 40427 2024-09-12T18:36:04.436 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.436 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:04.436 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.436 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:04.436 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.916941+0000", 2024-09-12T18:36:04.436 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:04.436 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.436 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.436 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:04.436 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.916941+0000", 2024-09-12T18:36:04.437 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:04.437 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.437 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.437 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:04.437 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.916942+0000", 2024-09-12T18:36:04.437 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.3900000000000003e-07 2024-09-12T18:36:04.437 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.437 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.437 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:04.437 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.916966+0000", 2024-09-12T18:36:04.437 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4774e-05 2024-09-12T18:36:04.437 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.437 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.438 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:04.438 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.916974+0000", 2024-09-12T18:36:04.438 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2099999999999996e-06 2024-09-12T18:36:04.438 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.438 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.438 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:04.438 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.916978+0000", 2024-09-12T18:36:04.438 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4610000000000001e-06 2024-09-12T18:36:04.438 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.438 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.438 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:04.438 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.918115+0000", 2024-09-12T18:36:04.439 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011368319999999999 2024-09-12T18:36:04.439 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.439 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.439 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:04.439 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.918331+0000", 2024-09-12T18:36:04.439 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000215577 2024-09-12T18:36:04.439 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.439 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.439 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:04.439 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.918552+0000", 2024-09-12T18:36:04.439 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022193899999999999 2024-09-12T18:36:04.439 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.439 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.440 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:04.440 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.925156+0000", 2024-09-12T18:36:04.440 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0066035900000000003 2024-09-12T18:36:04.440 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.440 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.440 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:04.440 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.931234+0000", 2024-09-12T18:36:04.440 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0060781070000000001 2024-09-12T18:36:04.440 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.440 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.440 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:04.440 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.931281+0000", 2024-09-12T18:36:04.440 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7228000000000003e-05 2024-09-12T18:36:04.441 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.441 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.441 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:04.441 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.931344+0000", 2024-09-12T18:36:04.441 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2555e-05 2024-09-12T18:36:04.441 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:04.441 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:04.441 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:04.441 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.441 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.441 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:40432 5.b 5:d974a3ca:::benchmark_data_smithi073_23739_object40431:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:04.441 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:59.917611+0000", 2024-09-12T18:36:04.441 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.44827364, 2024-09-12T18:36:04.442 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016184628999999999, 2024-09-12T18:36:04.442 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:04.442 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:04.442 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:04.442 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:04.442 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:04.442 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:04.442 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 40432 2024-09-12T18:36:04.442 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.442 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:04.442 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.442 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:04.442 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.917611+0000", 2024-09-12T18:36:04.443 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:04.443 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.443 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.443 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:04.443 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.917611+0000", 2024-09-12T18:36:04.443 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:04.443 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.443 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.443 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:04.443 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.917612+0000", 2024-09-12T18:36:04.443 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.009e-06 2024-09-12T18:36:04.443 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.443 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.443 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:04.444 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.917751+0000", 2024-09-12T18:36:04.444 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013949399999999999 2024-09-12T18:36:04.444 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.444 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.444 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:04.444 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.917773+0000", 2024-09-12T18:36:04.444 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1265000000000001e-05 2024-09-12T18:36:04.444 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.444 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.444 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:04.444 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.917782+0000", 2024-09-12T18:36:04.444 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.1009999999999998e-06 2024-09-12T18:36:04.444 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.444 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.445 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:04.445 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.925352+0000", 2024-09-12T18:36:04.445 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0075700689999999996 2024-09-12T18:36:04.445 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.445 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.445 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:04.445 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.925576+0000", 2024-09-12T18:36:04.445 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000224565 2024-09-12T18:36:04.445 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.445 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.445 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:04.445 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.925832+0000", 2024-09-12T18:36:04.445 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000255436 2024-09-12T18:36:04.446 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.446 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.446 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:04.446 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.931553+0000", 2024-09-12T18:36:04.446 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0057211190000000002 2024-09-12T18:36:04.446 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.446 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.446 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:04.446 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.933745+0000", 2024-09-12T18:36:04.446 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0021916290000000001 2024-09-12T18:36:04.446 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.446 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.447 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:04.447 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.933773+0000", 2024-09-12T18:36:04.447 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8249e-05 2024-09-12T18:36:04.447 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.447 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.447 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:04.447 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.933796+0000", 2024-09-12T18:36:04.447 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2693000000000001e-05 2024-09-12T18:36:04.447 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:04.447 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:04.447 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:04.447 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.447 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.447 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:40438 5.b 5:da8c8e18:::benchmark_data_smithi073_23739_object40437:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:04.448 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:59.920932+0000", 2024-09-12T18:36:04.448 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.444952239, 2024-09-12T18:36:04.448 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.014831063, 2024-09-12T18:36:04.448 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:04.448 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:04.448 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:04.448 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:04.448 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:04.448 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:04.448 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 40438 2024-09-12T18:36:04.448 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.448 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:04.448 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.448 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:04.449 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.920932+0000", 2024-09-12T18:36:04.449 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:04.449 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.449 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.449 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:04.449 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.920932+0000", 2024-09-12T18:36:04.449 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:04.449 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.449 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.449 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:04.449 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.920933+0000", 2024-09-12T18:36:04.449 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4600000000000004e-07 2024-09-12T18:36:04.449 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.449 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.450 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:04.450 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.920978+0000", 2024-09-12T18:36:04.450 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5024999999999997e-05 2024-09-12T18:36:04.450 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.450 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.450 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:04.450 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.920989+0000", 2024-09-12T18:36:04.450 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1314e-05 2024-09-12T18:36:04.450 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.450 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.450 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:04.450 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.920995+0000", 2024-09-12T18:36:04.450 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6779999999999997e-06 2024-09-12T18:36:04.450 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.451 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.451 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:04.451 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.931674+0000", 2024-09-12T18:36:04.451 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.010678856 2024-09-12T18:36:04.451 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.451 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.451 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:04.451 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.931776+0000", 2024-09-12T18:36:04.451 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000101786 2024-09-12T18:36:04.451 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.451 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.451 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:04.451 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.931853+0000", 2024-09-12T18:36:04.451 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6959000000000006e-05 2024-09-12T18:36:04.452 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.452 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.452 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:04.452 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.935673+0000", 2024-09-12T18:36:04.452 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003819977 2024-09-12T18:36:04.452 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.452 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.452 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:04.452 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.935685+0000", 2024-09-12T18:36:04.452 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2191999999999999e-05 2024-09-12T18:36:04.452 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.452 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.452 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:04.452 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.935733+0000", 2024-09-12T18:36:04.453 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8072999999999999e-05 2024-09-12T18:36:04.453 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.453 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.453 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:04.453 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.935763+0000", 2024-09-12T18:36:04.453 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0556999999999999e-05 2024-09-12T18:36:04.453 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:04.453 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:04.453 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:04.453 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.453 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.453 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:40507 5.e 5:729d4bc6:::benchmark_data_smithi073_23739_object40506:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:04.453 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:59.951281+0000", 2024-09-12T18:36:04.454 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.4146037800000002, 2024-09-12T18:36:04.454 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016604759, 2024-09-12T18:36:04.454 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:04.454 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:04.454 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:04.454 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:04.454 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:04.454 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:04.454 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 40507 2024-09-12T18:36:04.454 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.454 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:04.455 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.455 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:04.455 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951281+0000", 2024-09-12T18:36:04.455 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:04.455 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.455 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.455 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:04.455 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951281+0000", 2024-09-12T18:36:04.455 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:04.455 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.455 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.455 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:04.455 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951282+0000", 2024-09-12T18:36:04.455 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7599999999999996e-07 2024-09-12T18:36:04.456 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.456 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.456 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:04.456 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951390+0000", 2024-09-12T18:36:04.456 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000108075 2024-09-12T18:36:04.456 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.456 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.456 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:04.456 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951425+0000", 2024-09-12T18:36:04.456 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5765000000000001e-05 2024-09-12T18:36:04.456 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.456 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.456 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:04.456 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951435+0000", 2024-09-12T18:36:04.457 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:36:04.457 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.457 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.457 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:04.457 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951505+0000", 2024-09-12T18:36:04.457 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0655999999999996e-05 2024-09-12T18:36:04.457 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.457 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.457 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:04.457 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951663+0000", 2024-09-12T18:36:04.457 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015736799999999999 2024-09-12T18:36:04.457 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.457 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.457 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:04.458 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951812+0000", 2024-09-12T18:36:04.458 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014943000000000001 2024-09-12T18:36:04.458 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.458 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.458 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:04.458 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.953812+0000", 2024-09-12T18:36:04.458 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001999781 2024-09-12T18:36:04.458 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.458 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.458 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:04.458 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.967782+0000", 2024-09-12T18:36:04.458 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013969472 2024-09-12T18:36:04.458 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.459 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.459 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:04.459 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.967839+0000", 2024-09-12T18:36:04.459 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7278999999999998e-05 2024-09-12T18:36:04.459 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.459 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.459 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:04.459 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.967886+0000", 2024-09-12T18:36:04.459 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6717e-05 2024-09-12T18:36:04.459 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:04.459 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:04.459 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:04.459 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.459 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.460 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:40638 5.8 5:1bcfd6bd:::benchmark_data_smithi073_23739_object40637:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:04.460 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:00.010531+0000", 2024-09-12T18:36:04.460 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.3553537520000001, 2024-09-12T18:36:04.460 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.01580927, 2024-09-12T18:36:04.460 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:04.460 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:04.460 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:04.460 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:04.460 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:04.460 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:04.461 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 40638 2024-09-12T18:36:04.461 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.461 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:04.461 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.461 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:04.461 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010531+0000", 2024-09-12T18:36:04.461 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:04.461 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.461 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.461 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:04.461 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010531+0000", 2024-09-12T18:36:04.461 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:04.461 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.462 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.462 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:04.462 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010531+0000", 2024-09-12T18:36:04.462 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6400000000000002e-07 2024-09-12T18:36:04.462 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.462 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.462 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:04.462 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010643+0000", 2024-09-12T18:36:04.462 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000111562 2024-09-12T18:36:04.462 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.462 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.462 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:04.462 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010657+0000", 2024-09-12T18:36:04.462 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3804e-05 2024-09-12T18:36:04.463 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.463 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.463 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:04.463 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010664+0000", 2024-09-12T18:36:04.463 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2919999999999998e-06 2024-09-12T18:36:04.463 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.463 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.463 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:04.463 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.016385+0000", 2024-09-12T18:36:04.463 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0057206490000000004 2024-09-12T18:36:04.463 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.463 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.463 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:04.464 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.016509+0000", 2024-09-12T18:36:04.464 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000124058 2024-09-12T18:36:04.464 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.464 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.464 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:04.464 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.016711+0000", 2024-09-12T18:36:04.464 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000202389 2024-09-12T18:36:04.464 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.464 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.464 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:04.464 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.021363+0000", 2024-09-12T18:36:04.464 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0046515970000000004 2024-09-12T18:36:04.464 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.464 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.465 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:04.465 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.026248+0000", 2024-09-12T18:36:04.465 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.004885655 2024-09-12T18:36:04.465 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.465 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.465 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:04.465 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.026287+0000", 2024-09-12T18:36:04.465 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8909000000000003e-05 2024-09-12T18:36:04.465 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.465 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.465 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:04.465 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.026340+0000", 2024-09-12T18:36:04.465 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2691000000000001e-05 2024-09-12T18:36:04.466 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:04.466 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:04.466 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:04.466 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.466 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.466 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:40639 5.8 5:16bd0f48:::benchmark_data_smithi073_23739_object40638:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:04.466 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:00.010888+0000", 2024-09-12T18:36:04.466 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.3549964560000003, 2024-09-12T18:36:04.466 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017069808999999998, 2024-09-12T18:36:04.466 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:04.466 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:04.466 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:04.467 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:04.467 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:04.467 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:04.467 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 40639 2024-09-12T18:36:04.467 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.467 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:04.467 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.467 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:04.467 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010888+0000", 2024-09-12T18:36:04.467 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:04.468 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.468 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.468 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:04.468 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010888+0000", 2024-09-12T18:36:04.468 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:04.468 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.468 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.468 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:04.468 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010889+0000", 2024-09-12T18:36:04.468 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.004e-06 2024-09-12T18:36:04.468 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.468 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.469 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:04.469 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010921+0000", 2024-09-12T18:36:04.469 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1745000000000002e-05 2024-09-12T18:36:04.469 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.469 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.469 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:04.469 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010933+0000", 2024-09-12T18:36:04.469 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2476999999999999e-05 2024-09-12T18:36:04.469 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.469 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.469 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:04.469 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010941+0000", 2024-09-12T18:36:04.469 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1810000000000004e-06 2024-09-12T18:36:04.470 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.470 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.470 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:04.470 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.019947+0000", 2024-09-12T18:36:04.470 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0090069190000000004 2024-09-12T18:36:04.470 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.470 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.470 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:04.470 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.020062+0000", 2024-09-12T18:36:04.470 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000114851 2024-09-12T18:36:04.470 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.470 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.470 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:04.471 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.020148+0000", 2024-09-12T18:36:04.471 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5579000000000002e-05 2024-09-12T18:36:04.471 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.471 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.471 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:04.471 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.026347+0000", 2024-09-12T18:36:04.471 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0061988820000000002 2024-09-12T18:36:04.471 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.471 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.471 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:04.471 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.027866+0000", 2024-09-12T18:36:04.471 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015197190000000001 2024-09-12T18:36:04.471 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.472 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.472 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:04.472 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.027914+0000", 2024-09-12T18:36:04.472 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8009000000000001e-05 2024-09-12T18:36:04.472 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.472 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.472 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:04.472 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.027958+0000", 2024-09-12T18:36:04.472 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3442999999999997e-05 2024-09-12T18:36:04.472 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:04.472 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:04.472 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:04.472 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.473 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.473 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:40642 5.0 5:015ece55:::benchmark_data_smithi073_23739_object40641:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:04.473 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:00.011626+0000", 2024-09-12T18:36:04.473 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.3542586270000001, 2024-09-12T18:36:04.473 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016593251, 2024-09-12T18:36:04.473 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:04.473 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:04.473 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:04.473 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:04.473 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:04.473 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:04.473 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 40642 2024-09-12T18:36:04.473 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.473 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:04.474 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.474 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:04.474 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.011626+0000", 2024-09-12T18:36:04.474 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:04.474 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.474 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.474 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:04.474 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.011626+0000", 2024-09-12T18:36:04.474 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:04.474 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.474 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.474 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:04.475 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.011627+0000", 2024-09-12T18:36:04.475 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.7399999999999991e-07 2024-09-12T18:36:04.475 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.475 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.475 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:04.475 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.011693+0000", 2024-09-12T18:36:04.475 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6586000000000002e-05 2024-09-12T18:36:04.475 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.475 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.475 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:04.475 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.011703+0000", 2024-09-12T18:36:04.475 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.3619999999999995e-06 2024-09-12T18:36:04.475 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.476 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.476 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:04.476 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.011710+0000", 2024-09-12T18:36:04.476 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1010000000000003e-06 2024-09-12T18:36:04.476 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.476 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.476 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:04.476 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.021346+0000", 2024-09-12T18:36:04.476 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0096362170000000007 2024-09-12T18:36:04.476 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.476 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.476 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:04.476 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.021456+0000", 2024-09-12T18:36:04.477 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010942000000000001 2024-09-12T18:36:04.477 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.477 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.477 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:04.477 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.021540+0000", 2024-09-12T18:36:04.477 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4220000000000003e-05 2024-09-12T18:36:04.477 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.477 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.477 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:04.477 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.027831+0000", 2024-09-12T18:36:04.477 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062915760000000001 2024-09-12T18:36:04.477 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.477 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.478 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:04.478 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.028132+0000", 2024-09-12T18:36:04.478 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030037 2024-09-12T18:36:04.478 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.478 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.478 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:04.478 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.028188+0000", 2024-09-12T18:36:04.478 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6023999999999998e-05 2024-09-12T18:36:04.478 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.478 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.478 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:04.478 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.028219+0000", 2024-09-12T18:36:04.478 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1401e-05 2024-09-12T18:36:04.479 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:04.479 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:04.479 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:04.479 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.479 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.479 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:41622 5.d 5:b67b3593:::benchmark_data_smithi073_23739_object41621:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:04.479 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:00.420588+0000", 2024-09-12T18:36:04.479 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 3.9452967590000001, 2024-09-12T18:36:04.479 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.014651192, 2024-09-12T18:36:04.479 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:04.479 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:04.479 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:04.479 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:04.479 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:04.480 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:04.480 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 41622 2024-09-12T18:36:04.480 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.480 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:04.480 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.480 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:04.480 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.420588+0000", 2024-09-12T18:36:04.480 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:04.480 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.480 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.480 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:04.480 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.420588+0000", 2024-09-12T18:36:04.481 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:04.481 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.481 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.481 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:04.481 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.420589+0000", 2024-09-12T18:36:04.481 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1030000000000001e-06 2024-09-12T18:36:04.481 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.481 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.481 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:04.481 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.420670+0000", 2024-09-12T18:36:04.481 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0768999999999999e-05 2024-09-12T18:36:04.481 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.481 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.482 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:04.482 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.420684+0000", 2024-09-12T18:36:04.482 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3828999999999999e-05 2024-09-12T18:36:04.482 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.482 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.482 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:04.482 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.420691+0000", 2024-09-12T18:36:04.482 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.357e-06 2024-09-12T18:36:04.482 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.482 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.482 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:04.483 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.422637+0000", 2024-09-12T18:36:04.483 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001946157 2024-09-12T18:36:04.483 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.483 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.483 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:04.483 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.422724+0000", 2024-09-12T18:36:04.483 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7205000000000003e-05 2024-09-12T18:36:04.483 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.483 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.483 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:04.484 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.422867+0000", 2024-09-12T18:36:04.484 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014323100000000001 2024-09-12T18:36:04.484 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.484 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.484 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:04.484 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.427325+0000", 2024-09-12T18:36:04.484 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0044572140000000001 2024-09-12T18:36:04.484 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.484 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.484 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:04.484 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.435147+0000", 2024-09-12T18:36:04.484 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0078225150000000004 2024-09-12T18:36:04.484 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.485 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.485 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:04.485 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.435183+0000", 2024-09-12T18:36:04.485 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6248000000000003e-05 2024-09-12T18:36:04.485 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.485 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.485 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:04.485 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.435239+0000", 2024-09-12T18:36:04.485 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5563999999999999e-05 2024-09-12T18:36:04.485 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:04.485 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:04.485 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:04.486 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.486 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.486 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:49141 5.d 5:bce526e5:::benchmark_data_smithi073_23739_object49140:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T18:36:04.486 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:03.538808+0000", 2024-09-12T18:36:04.486 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.82707682000000005, 2024-09-12T18:36:04.486 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.019659019, 2024-09-12T18:36:04.486 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:04.486 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:04.486 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:04.486 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:04.486 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:04.487 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:04.487 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 49141 2024-09-12T18:36:04.487 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.487 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:04.487 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.487 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:04.487 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538808+0000", 2024-09-12T18:36:04.487 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:04.487 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.487 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.487 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:04.487 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538808+0000", 2024-09-12T18:36:04.487 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:04.488 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.488 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.488 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:04.488 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538809+0000", 2024-09-12T18:36:04.488 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.065e-06 2024-09-12T18:36:04.488 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.488 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.488 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:04.488 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538914+0000", 2024-09-12T18:36:04.488 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010528599999999999 2024-09-12T18:36:04.488 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.489 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.489 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:04.489 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538924+0000", 2024-09-12T18:36:04.489 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4420000000000004e-06 2024-09-12T18:36:04.489 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.489 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.489 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:04.489 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538944+0000", 2024-09-12T18:36:04.489 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0460000000000001e-05 2024-09-12T18:36:04.489 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.489 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.489 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:04.490 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.539034+0000", 2024-09-12T18:36:04.490 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9512000000000006e-05 2024-09-12T18:36:04.490 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.490 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.490 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:04.490 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.539161+0000", 2024-09-12T18:36:04.490 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012782399999999999 2024-09-12T18:36:04.490 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.490 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.490 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:04.490 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.539246+0000", 2024-09-12T18:36:04.490 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4927999999999997e-05 2024-09-12T18:36:04.490 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.490 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.491 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:04.491 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.541390+0000", 2024-09-12T18:36:04.491 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0021439509999999998 2024-09-12T18:36:04.491 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.491 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.491 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:04.491 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.558236+0000", 2024-09-12T18:36:04.491 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016845619999999999 2024-09-12T18:36:04.491 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.491 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.491 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:04.491 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.558368+0000", 2024-09-12T18:36:04.491 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013241300000000001 2024-09-12T18:36:04.491 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:04.492 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:04.492 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:04.492 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.558467+0000", 2024-09-12T18:36:04.492 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8517999999999994e-05 2024-09-12T18:36:04.492 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:04.492 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:04.492 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:04.492 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:04.492 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:04.492 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:04.493 INFO:teuthology.orchestra.run.smithi073.stderr:reweighted osd.2 to 1 (10000) 2024-09-12T18:36:04.494 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:04.489+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:04.494 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is unset 2024-09-12T18:36:04.495 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:36:04.509 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-12T18:36:04.510 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:36:04.595 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:04.593+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:04.649 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:36:04.649 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:36:04.649 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.649 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:51735 5.9 5:9637e530:::benchmark_data_smithi073_23739_object51734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:36:04.649 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:04.646818+0000", 2024-09-12T18:36:04.649 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0016586190000000001, 2024-09-12T18:36:04.649 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0016844659999999999, 2024-09-12T18:36:04.649 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:04.649 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:04.649 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "reached pg", 2024-09-12T18:36:04.650 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:04.650 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:04.650 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:04.650 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 51735 2024-09-12T18:36:04.650 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.650 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:04.650 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.650 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:04.650 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.646818+0000", 2024-09-12T18:36:04.650 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:04.650 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.650 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.650 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:04.651 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.646818+0000", 2024-09-12T18:36:04.651 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:04.651 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.651 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.651 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:04.651 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.646819+0000", 2024-09-12T18:36:04.651 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.08e-06 2024-09-12T18:36:04.651 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.651 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.651 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:04.651 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.646866+0000", 2024-09-12T18:36:04.651 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.7253999999999999e-05 2024-09-12T18:36:04.652 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.652 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.652 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:04.652 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.646877+0000", 2024-09-12T18:36:04.652 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0856000000000001e-05 2024-09-12T18:36:04.652 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.652 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.652 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:04.652 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.646884+0000", 2024-09-12T18:36:04.652 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.1080000000000004e-06 2024-09-12T18:36:04.652 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.652 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.653 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:04.653 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.648445+0000", 2024-09-12T18:36:04.653 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001560624 2024-09-12T18:36:04.653 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:04.653 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:04.653 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:04.653 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.653 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.653 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:51736 5.9 5.8c782909 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:36:04.653 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:04.646971+0000", 2024-09-12T18:36:04.654 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.001505674, 2024-09-12T18:36:04.654 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001568028, 2024-09-12T18:36:04.654 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:04.654 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:04.654 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:04.654 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:04.654 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:04.654 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:04.654 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 51736 2024-09-12T18:36:04.654 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.654 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:04.654 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.654 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:04.654 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.646971+0000", 2024-09-12T18:36:04.655 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:04.655 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.655 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.655 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:04.655 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.646971+0000", 2024-09-12T18:36:04.655 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:04.655 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.655 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.655 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:04.655 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.646972+0000", 2024-09-12T18:36:04.655 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0759999999999999e-06 2024-09-12T18:36:04.655 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.655 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.656 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:04.656 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.647014+0000", 2024-09-12T18:36:04.656 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.1399000000000001e-05 2024-09-12T18:36:04.656 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.656 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.656 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:04.656 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.647024+0000", 2024-09-12T18:36:04.656 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9299999999999998e-06 2024-09-12T18:36:04.656 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.656 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.656 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:04.656 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.647030+0000", 2024-09-12T18:36:04.656 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.7970000000000003e-06 2024-09-12T18:36:04.657 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:04.657 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:04.657 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:04.657 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.657 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.657 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:51737 5.1 5.45044541 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:36:04.657 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:04.647222+0000", 2024-09-12T18:36:04.657 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.001254731, 2024-09-12T18:36:04.657 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0013433399999999999, 2024-09-12T18:36:04.657 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:04.657 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:04.657 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:04.658 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:04.658 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:04.658 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:04.658 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 51737 2024-09-12T18:36:04.658 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.658 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:04.658 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.658 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:04.659 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.647222+0000", 2024-09-12T18:36:04.659 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:04.659 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.659 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.659 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:04.659 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.647222+0000", 2024-09-12T18:36:04.659 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:04.659 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.659 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.659 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:04.659 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.647223+0000", 2024-09-12T18:36:04.659 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.6799999999999999e-07 2024-09-12T18:36:04.659 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.660 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.660 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:04.660 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.647259+0000", 2024-09-12T18:36:04.660 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.6464999999999997e-05 2024-09-12T18:36:04.660 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.660 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.660 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:04.660 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.647269+0000", 2024-09-12T18:36:04.660 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.5100000000000004e-06 2024-09-12T18:36:04.660 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.660 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.660 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:04.660 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.647275+0000", 2024-09-12T18:36:04.661 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4309999999999999e-06 2024-09-12T18:36:04.661 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:04.661 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:04.661 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:04.661 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.661 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.661 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:51719 5.1 5:8415f80f:::benchmark_data_smithi073_23739_object51718:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:36:04.661 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:04.641232+0000", 2024-09-12T18:36:04.661 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0072450379999999997, 2024-09-12T18:36:04.661 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.007362441, 2024-09-12T18:36:04.661 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:04.661 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:04.661 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:04.662 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:04.662 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:04.662 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:04.662 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 51719 2024-09-12T18:36:04.662 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.662 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:04.662 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.662 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:04.663 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.641232+0000", 2024-09-12T18:36:04.663 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:04.663 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.663 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.663 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:04.663 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.641232+0000", 2024-09-12T18:36:04.663 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:04.663 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.663 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.663 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:04.664 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.641232+0000", 2024-09-12T18:36:04.664 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.37e-07 2024-09-12T18:36:04.664 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.664 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.664 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:04.664 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.641274+0000", 2024-09-12T18:36:04.664 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.1186000000000002e-05 2024-09-12T18:36:04.664 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.664 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.664 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:04.664 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.641283+0000", 2024-09-12T18:36:04.664 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.3319999999999998e-06 2024-09-12T18:36:04.665 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.665 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.665 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:04.665 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.641290+0000", 2024-09-12T18:36:04.665 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2219999999999996e-06 2024-09-12T18:36:04.665 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.665 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.665 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:04.665 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.644473+0000", 2024-09-12T18:36:04.665 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0031829720000000001 2024-09-12T18:36:04.665 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.665 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.665 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:04.666 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.644699+0000", 2024-09-12T18:36:04.666 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022621699999999999 2024-09-12T18:36:04.666 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.666 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.666 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:04.666 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.644825+0000", 2024-09-12T18:36:04.666 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012607499999999999 2024-09-12T18:36:04.666 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.666 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.666 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:04.666 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.646897+0000", 2024-09-12T18:36:04.666 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0020717209999999999 2024-09-12T18:36:04.667 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:04.667 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:04.667 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:04.667 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.667 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.667 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:51725 5.9 5:952c7e76:::benchmark_data_smithi073_23739_object51724:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:36:04.667 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:04.642786+0000", 2024-09-12T18:36:04.667 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0056910930000000004, 2024-09-12T18:36:04.667 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0058571020000000003, 2024-09-12T18:36:04.667 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:04.667 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:04.667 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:04.667 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:04.667 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:04.668 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:04.668 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 51725 2024-09-12T18:36:04.668 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.668 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:04.668 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.668 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:04.668 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.642786+0000", 2024-09-12T18:36:04.668 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:04.668 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.668 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.668 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:04.668 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.642786+0000", 2024-09-12T18:36:04.668 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:04.669 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.669 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.669 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:04.669 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.642787+0000", 2024-09-12T18:36:04.669 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.09e-07 2024-09-12T18:36:04.669 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.669 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.669 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:04.669 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.642872+0000", 2024-09-12T18:36:04.669 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5399e-05 2024-09-12T18:36:04.669 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.669 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.669 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:04.670 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.642881+0000", 2024-09-12T18:36:04.670 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.1759999999999999e-06 2024-09-12T18:36:04.670 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.670 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.670 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:04.670 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.642889+0000", 2024-09-12T18:36:04.670 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.5000000000000002e-06 2024-09-12T18:36:04.670 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.670 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.670 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:04.670 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.644469+0000", 2024-09-12T18:36:04.670 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0015800530000000001 2024-09-12T18:36:04.670 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.671 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.671 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:04.671 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.644584+0000", 2024-09-12T18:36:04.671 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000115302 2024-09-12T18:36:04.671 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.671 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.671 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:04.671 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.644735+0000", 2024-09-12T18:36:04.671 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000150481 2024-09-12T18:36:04.671 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:04.671 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:04.671 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:04.671 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.672 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.672 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:51728 5.9 5:9b7ad306:::benchmark_data_smithi073_23739_object51727:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:36:04.672 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:04.643888+0000", 2024-09-12T18:36:04.672 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0045891370000000001, 2024-09-12T18:36:04.672 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0047922010000000003, 2024-09-12T18:36:04.672 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:04.672 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:04.672 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:04.672 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:04.672 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:04.672 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:04.672 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 51728 2024-09-12T18:36:04.672 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.673 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:04.673 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.673 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:04.673 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.643888+0000", 2024-09-12T18:36:04.673 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:04.673 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.673 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.673 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:04.673 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.643888+0000", 2024-09-12T18:36:04.673 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:04.673 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.674 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.674 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:04.674 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.643889+0000", 2024-09-12T18:36:04.674 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.4300000000000001e-07 2024-09-12T18:36:04.674 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.674 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.674 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:04.674 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.643933+0000", 2024-09-12T18:36:04.674 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4740999999999997e-05 2024-09-12T18:36:04.674 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.674 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.674 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:04.674 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.643945+0000", 2024-09-12T18:36:04.675 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1595e-05 2024-09-12T18:36:04.675 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.675 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.675 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:04.675 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.643952+0000", 2024-09-12T18:36:04.675 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9110000000000004e-06 2024-09-12T18:36:04.675 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.675 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.675 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:04.675 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.646849+0000", 2024-09-12T18:36:04.675 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.002896961 2024-09-12T18:36:04.675 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.675 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.676 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:04.676 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.646932+0000", 2024-09-12T18:36:04.676 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.2952000000000001e-05 2024-09-12T18:36:04.676 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.676 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.676 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:04.676 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.647040+0000", 2024-09-12T18:36:04.676 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000108606 2024-09-12T18:36:04.677 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:04.677 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:04.677 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:04.677 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.677 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.677 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:51732 5.2 5:4a78d9b3:::benchmark_data_smithi073_23739_object51731:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:36:04.677 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:04.644567+0000", 2024-09-12T18:36:04.677 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.003909577, 2024-09-12T18:36:04.677 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0041481599999999997, 2024-09-12T18:36:04.677 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:04.677 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:04.677 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:04.677 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:04.678 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:04.678 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:04.678 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 51732 2024-09-12T18:36:04.678 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.678 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:04.678 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.678 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:04.678 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.644567+0000", 2024-09-12T18:36:04.678 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:04.678 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.678 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.678 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:04.678 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.644567+0000", 2024-09-12T18:36:04.679 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:04.679 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.679 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.679 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:04.679 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.644568+0000", 2024-09-12T18:36:04.679 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.142e-06 2024-09-12T18:36:04.679 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.679 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.679 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:04.679 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.644618+0000", 2024-09-12T18:36:04.679 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.9876999999999997e-05 2024-09-12T18:36:04.679 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.679 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.680 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:04.680 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.644642+0000", 2024-09-12T18:36:04.680 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.3649999999999999e-05 2024-09-12T18:36:04.680 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.680 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.680 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:04.680 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.644649+0000", 2024-09-12T18:36:04.680 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.5340000000000002e-06 2024-09-12T18:36:04.680 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.680 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.680 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:04.680 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.644713+0000", 2024-09-12T18:36:04.681 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.3878000000000001e-05 2024-09-12T18:36:04.681 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.681 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.681 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:04.681 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.644824+0000", 2024-09-12T18:36:04.681 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011112699999999999 2024-09-12T18:36:04.681 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.681 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.681 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:04.681 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.644955+0000", 2024-09-12T18:36:04.681 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013107900000000001 2024-09-12T18:36:04.681 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.681 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.682 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:04.682 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.648036+0000", 2024-09-12T18:36:04.682 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003080761 2024-09-12T18:36:04.682 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:04.682 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:04.682 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:04.682 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.682 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.682 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:51733 5.1 5:82e2450e:::benchmark_data_smithi073_23739_object51732:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:36:04.682 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:04.644670+0000", 2024-09-12T18:36:04.682 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.00380649, 2024-09-12T18:36:04.682 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.004083082, 2024-09-12T18:36:04.682 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:04.683 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:04.683 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:04.683 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:04.683 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:04.683 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:04.683 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 51733 2024-09-12T18:36:04.683 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.683 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:04.683 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.683 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:04.683 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.644670+0000", 2024-09-12T18:36:04.683 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:04.683 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.684 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.684 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:04.684 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.644670+0000", 2024-09-12T18:36:04.684 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:04.684 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.684 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.684 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:04.684 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.644671+0000", 2024-09-12T18:36:04.684 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.7700000000000004e-07 2024-09-12T18:36:04.684 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.684 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.684 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:04.685 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.644712+0000", 2024-09-12T18:36:04.685 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.1433000000000001e-05 2024-09-12T18:36:04.685 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.685 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.685 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:04.685 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.644721+0000", 2024-09-12T18:36:04.685 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5890000000000003e-06 2024-09-12T18:36:04.685 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.685 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.685 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:04.685 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.644727+0000", 2024-09-12T18:36:04.686 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4330000000000001e-06 2024-09-12T18:36:04.686 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.686 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.686 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:04.686 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.647029+0000", 2024-09-12T18:36:04.686 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0023020789999999998 2024-09-12T18:36:04.686 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.686 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.686 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:04.686 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.647149+0000", 2024-09-12T18:36:04.686 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000119403 2024-09-12T18:36:04.686 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:04.686 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:04.687 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:04.687 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:04.647334+0000", 2024-09-12T18:36:04.687 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000185608 2024-09-12T18:36:04.687 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:04.687 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:04.687 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:04.687 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:04.687 INFO:teuthology.orchestra.run.smithi162.stdout: ], 2024-09-12T18:36:04.687 INFO:teuthology.orchestra.run.smithi162.stdout: "num_ops": 8 2024-09-12T18:36:04.687 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:36:04.689 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:36:04.696 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:04.693+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:04.796 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:04.793+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:04.841 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:36:04.843 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T18:36:04.844 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:36:04.844 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [], 2024-09-12T18:36:04.844 INFO:teuthology.orchestra.run.smithi162.stdout: "complaint_time": 30, 2024-09-12T18:36:04.844 INFO:teuthology.orchestra.run.smithi162.stdout: "num_blocked_ops": 0 2024-09-12T18:36:04.844 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:36:04.861 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-09-12T18:36:04.476503+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3016035229,"num_objects":46038,"num_object_clones":0,"num_object_copies":92076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46038,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":46204,"num_write_kb":2947456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46166,"ondisk_log_size":46166,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":542656,"kb_used_data":360264,"kb_used_omap":4,"kb_used_meta":182331,"kb_avail":282572864,"statfs":{"total":289910292480,"available":289354612736,"internally_reserved":0,"allocated":368910336,"data_stored":5886265552,"data_compressed":279506145,"data_compressed_allocated":367886336,"data_compressed_original":5885886464,"omap_allocated":4783,"internal_metadata":186707281},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,2,2,6,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":802291712,"num_objects":12242,"num_object_clones":0,"num_object_copies":24484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12242,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12242,"num_write_kb":783488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.090413"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468430+0000","last_change":"2024-09-12T18:35:25.657389+0000","last_active":"2024-09-12T18:36:03.468430+0000","last_peered":"2024-09-12T18:36:03.468430+0000","last_clean":"2024-09-12T18:36:03.468430+0000","last_became_active":"2024-09-12T18:35:25.651857+0000","last_became_peered":"2024-09-12T18:35:25.651857+0000","last_unstale":"2024-09-12T18:36:03.468430+0000","last_undegraded":"2024-09-12T18:36:03.468430+0000","last_fullsized":"2024-09-12T18:36:03.468430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:50.264536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468079+0000","last_change":"2024-09-12T18:35:25.659760+0000","last_active":"2024-09-12T18:36:03.468079+0000","last_peered":"2024-09-12T18:36:03.468079+0000","last_clean":"2024-09-12T18:36:03.468079+0000","last_became_active":"2024-09-12T18:35:25.654920+0000","last_became_peered":"2024-09-12T18:35:25.654920+0000","last_unstale":"2024-09-12T18:36:03.468079+0000","last_undegraded":"2024-09-12T18:36:03.468079+0000","last_fullsized":"2024-09-12T18:36:03.468079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:21.519881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457502+0000","last_change":"2024-09-12T18:35:25.659460+0000","last_active":"2024-09-12T18:36:01.457502+0000","last_peered":"2024-09-12T18:36:01.457502+0000","last_clean":"2024-09-12T18:36:01.457502+0000","last_became_active":"2024-09-12T18:35:25.657782+0000","last_became_peered":"2024-09-12T18:35:25.657782+0000","last_unstale":"2024-09-12T18:36:01.457502+0000","last_undegraded":"2024-09-12T18:36:01.457502+0000","last_fullsized":"2024-09-12T18:36:01.457502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:38.544284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457143+0000","last_change":"2024-09-12T18:35:25.663617+0000","last_active":"2024-09-12T18:36:01.457143+0000","last_peered":"2024-09-12T18:36:01.457143+0000","last_clean":"2024-09-12T18:36:01.457143+0000","last_became_active":"2024-09-12T18:35:25.661977+0000","last_became_peered":"2024-09-12T18:35:25.661977+0000","last_unstale":"2024-09-12T18:36:01.457143+0000","last_undegraded":"2024-09-12T18:36:01.457143+0000","last_fullsized":"2024-09-12T18:36:01.457143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:14.748234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.467891+0000","last_change":"2024-09-12T18:35:25.656566+0000","last_active":"2024-09-12T18:36:03.467891+0000","last_peered":"2024-09-12T18:36:03.467891+0000","last_clean":"2024-09-12T18:36:03.467891+0000","last_became_active":"2024-09-12T18:35:25.654898+0000","last_became_peered":"2024-09-12T18:35:25.654898+0000","last_unstale":"2024-09-12T18:36:03.467891+0000","last_undegraded":"2024-09-12T18:36:03.467891+0000","last_fullsized":"2024-09-12T18:36:03.467891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:36.113250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.456773+0000","last_change":"2024-09-12T18:35:25.652754+0000","last_active":"2024-09-12T18:36:01.456773+0000","last_peered":"2024-09-12T18:36:01.456773+0000","last_clean":"2024-09-12T18:36:01.456773+0000","last_became_active":"2024-09-12T18:35:25.651217+0000","last_became_peered":"2024-09-12T18:35:25.651217+0000","last_unstale":"2024-09-12T18:36:01.456773+0000","last_undegraded":"2024-09-12T18:36:01.456773+0000","last_fullsized":"2024-09-12T18:36:01.456773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:24.585774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457973+0000","last_change":"2024-09-12T18:35:25.659811+0000","last_active":"2024-09-12T18:36:01.457973+0000","last_peered":"2024-09-12T18:36:01.457973+0000","last_clean":"2024-09-12T18:36:01.457973+0000","last_became_active":"2024-09-12T18:35:25.658998+0000","last_became_peered":"2024-09-12T18:35:25.658998+0000","last_unstale":"2024-09-12T18:36:01.457973+0000","last_undegraded":"2024-09-12T18:36:01.457973+0000","last_fullsized":"2024-09-12T18:36:01.457973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.456620+0000","last_change":"2024-09-12T18:35:25.653999+0000","last_active":"2024-09-12T18:36:01.456620+0000","last_peered":"2024-09-12T18:36:01.456620+0000","last_clean":"2024-09-12T18:36:01.456620+0000","last_became_active":"2024-09-12T18:35:25.653319+0000","last_became_peered":"2024-09-12T18:35:25.653319+0000","last_unstale":"2024-09-12T18:36:01.456620+0000","last_undegraded":"2024-09-12T18:36:01.456620+0000","last_fullsized":"2024-09-12T18:36:01.456620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:04.718000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457931+0000","last_change":"2024-09-12T18:35:25.668339+0000","last_active":"2024-09-12T18:36:01.457931+0000","last_peered":"2024-09-12T18:36:01.457931+0000","last_clean":"2024-09-12T18:36:01.457931+0000","last_became_active":"2024-09-12T18:35:25.667608+0000","last_became_peered":"2024-09-12T18:35:25.667608+0000","last_unstale":"2024-09-12T18:36:01.457931+0000","last_undegraded":"2024-09-12T18:36:01.457931+0000","last_fullsized":"2024-09-12T18:36:01.457931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:15.699745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468417+0000","last_change":"2024-09-12T18:35:25.660174+0000","last_active":"2024-09-12T18:36:03.468417+0000","last_peered":"2024-09-12T18:36:03.468417+0000","last_clean":"2024-09-12T18:36:03.468417+0000","last_became_active":"2024-09-12T18:35:25.656560+0000","last_became_peered":"2024-09-12T18:35:25.656560+0000","last_unstale":"2024-09-12T18:36:03.468417+0000","last_undegraded":"2024-09-12T18:36:03.468417+0000","last_fullsized":"2024-09-12T18:36:03.468417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:47.268505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457557+0000","last_change":"2024-09-12T18:35:25.649858+0000","last_active":"2024-09-12T18:36:01.457557+0000","last_peered":"2024-09-12T18:36:01.457557+0000","last_clean":"2024-09-12T18:36:01.457557+0000","last_became_active":"2024-09-12T18:35:25.649090+0000","last_became_peered":"2024-09-12T18:35:25.649090+0000","last_unstale":"2024-09-12T18:36:01.457557+0000","last_undegraded":"2024-09-12T18:36:01.457557+0000","last_fullsized":"2024-09-12T18:36:01.457557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:33.158421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.467938+0000","last_change":"2024-09-12T18:35:25.649885+0000","last_active":"2024-09-12T18:36:03.467938+0000","last_peered":"2024-09-12T18:36:03.467938+0000","last_clean":"2024-09-12T18:36:03.467938+0000","last_became_active":"2024-09-12T18:35:25.649111+0000","last_became_peered":"2024-09-12T18:35:25.649111+0000","last_unstale":"2024-09-12T18:36:03.467938+0000","last_undegraded":"2024-09-12T18:36:03.467938+0000","last_fullsized":"2024-09-12T18:36:03.467938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:17.162410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468110+0000","last_change":"2024-09-12T18:35:25.651541+0000","last_active":"2024-09-12T18:36:03.468110+0000","last_peered":"2024-09-12T18:36:03.468110+0000","last_clean":"2024-09-12T18:36:03.468110+0000","last_became_active":"2024-09-12T18:35:25.650661+0000","last_became_peered":"2024-09-12T18:35:25.650661+0000","last_unstale":"2024-09-12T18:36:03.468110+0000","last_undegraded":"2024-09-12T18:36:03.468110+0000","last_fullsized":"2024-09-12T18:36:03.468110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:52.082734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.456857+0000","last_change":"2024-09-12T18:35:25.657913+0000","last_active":"2024-09-12T18:36:01.456857+0000","last_peered":"2024-09-12T18:36:01.456857+0000","last_clean":"2024-09-12T18:36:01.456857+0000","last_became_active":"2024-09-12T18:35:25.657082+0000","last_became_peered":"2024-09-12T18:35:25.657082+0000","last_unstale":"2024-09-12T18:36:01.456857+0000","last_undegraded":"2024-09-12T18:36:01.456857+0000","last_fullsized":"2024-09-12T18:36:01.456857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:21.538633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458068+0000","last_change":"2024-09-12T18:35:25.658763+0000","last_active":"2024-09-12T18:36:01.458068+0000","last_peered":"2024-09-12T18:36:01.458068+0000","last_clean":"2024-09-12T18:36:01.458068+0000","last_became_active":"2024-09-12T18:35:25.657508+0000","last_became_peered":"2024-09-12T18:35:25.657508+0000","last_unstale":"2024-09-12T18:36:01.458068+0000","last_undegraded":"2024-09-12T18:36:01.458068+0000","last_fullsized":"2024-09-12T18:36:01.458068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:13.170519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.456742+0000","last_change":"2024-09-12T18:35:25.653730+0000","last_active":"2024-09-12T18:36:01.456742+0000","last_peered":"2024-09-12T18:36:01.456742+0000","last_clean":"2024-09-12T18:36:01.456742+0000","last_became_active":"2024-09-12T18:35:25.651535+0000","last_became_peered":"2024-09-12T18:35:25.651535+0000","last_unstale":"2024-09-12T18:36:01.456742+0000","last_undegraded":"2024-09-12T18:36:01.456742+0000","last_fullsized":"2024-09-12T18:36:01.456742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458531+0000","last_change":"2024-09-12T18:35:25.656513+0000","last_active":"2024-09-12T18:36:01.458531+0000","last_peered":"2024-09-12T18:36:01.458531+0000","last_clean":"2024-09-12T18:36:01.458531+0000","last_became_active":"2024-09-12T18:35:25.653440+0000","last_became_peered":"2024-09-12T18:35:25.653440+0000","last_unstale":"2024-09-12T18:36:01.458531+0000","last_undegraded":"2024-09-12T18:36:01.458531+0000","last_fullsized":"2024-09-12T18:36:01.458531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:18.693161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468423+0000","last_change":"2024-09-12T18:35:25.657991+0000","last_active":"2024-09-12T18:36:03.468423+0000","last_peered":"2024-09-12T18:36:03.468423+0000","last_clean":"2024-09-12T18:36:03.468423+0000","last_became_active":"2024-09-12T18:35:25.653934+0000","last_became_peered":"2024-09-12T18:35:25.653934+0000","last_unstale":"2024-09-12T18:36:03.468423+0000","last_undegraded":"2024-09-12T18:36:03.468423+0000","last_fullsized":"2024-09-12T18:36:03.468423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:05.418901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457946+0000","last_change":"2024-09-12T18:35:25.658819+0000","last_active":"2024-09-12T18:36:01.457946+0000","last_peered":"2024-09-12T18:36:01.457946+0000","last_clean":"2024-09-12T18:36:01.457946+0000","last_became_active":"2024-09-12T18:35:25.656843+0000","last_became_peered":"2024-09-12T18:35:25.656843+0000","last_unstale":"2024-09-12T18:36:01.457946+0000","last_undegraded":"2024-09-12T18:36:01.457946+0000","last_fullsized":"2024-09-12T18:36:01.457946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:55.291963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457321+0000","last_change":"2024-09-12T18:35:25.661176+0000","last_active":"2024-09-12T18:36:01.457321+0000","last_peered":"2024-09-12T18:36:01.457321+0000","last_clean":"2024-09-12T18:36:01.457321+0000","last_became_active":"2024-09-12T18:35:25.659534+0000","last_became_peered":"2024-09-12T18:35:25.659534+0000","last_unstale":"2024-09-12T18:36:01.457321+0000","last_undegraded":"2024-09-12T18:36:01.457321+0000","last_fullsized":"2024-09-12T18:36:01.457321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:40.145442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.456864+0000","last_change":"2024-09-12T18:35:25.650632+0000","last_active":"2024-09-12T18:36:01.456864+0000","last_peered":"2024-09-12T18:36:01.456864+0000","last_clean":"2024-09-12T18:36:01.456864+0000","last_became_active":"2024-09-12T18:35:25.649333+0000","last_became_peered":"2024-09-12T18:35:25.649333+0000","last_unstale":"2024-09-12T18:36:01.456864+0000","last_undegraded":"2024-09-12T18:36:01.456864+0000","last_fullsized":"2024-09-12T18:36:01.456864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:30.537572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.467675+0000","last_change":"2024-09-12T18:35:25.648245+0000","last_active":"2024-09-12T18:36:03.467675+0000","last_peered":"2024-09-12T18:36:03.467675+0000","last_clean":"2024-09-12T18:36:03.467675+0000","last_became_active":"2024-09-12T18:35:25.646357+0000","last_became_peered":"2024-09-12T18:35:25.646357+0000","last_unstale":"2024-09-12T18:36:03.467675+0000","last_undegraded":"2024-09-12T18:36:03.467675+0000","last_fullsized":"2024-09-12T18:36:03.467675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:05.662140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457171+0000","last_change":"2024-09-12T18:35:25.661613+0000","last_active":"2024-09-12T18:36:01.457171+0000","last_peered":"2024-09-12T18:36:01.457171+0000","last_clean":"2024-09-12T18:36:01.457171+0000","last_became_active":"2024-09-12T18:35:25.658833+0000","last_became_peered":"2024-09-12T18:35:25.658833+0000","last_unstale":"2024-09-12T18:36:01.457171+0000","last_undegraded":"2024-09-12T18:36:01.457171+0000","last_fullsized":"2024-09-12T18:36:01.457171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:51.064080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468960+0000","last_change":"2024-09-12T18:35:25.657782+0000","last_active":"2024-09-12T18:36:03.468960+0000","last_peered":"2024-09-12T18:36:03.468960+0000","last_clean":"2024-09-12T18:36:03.468960+0000","last_became_active":"2024-09-12T18:35:25.655295+0000","last_became_peered":"2024-09-12T18:35:25.655295+0000","last_unstale":"2024-09-12T18:36:03.468960+0000","last_undegraded":"2024-09-12T18:36:03.468960+0000","last_fullsized":"2024-09-12T18:36:03.468960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:37.744175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468549+0000","last_change":"2024-09-12T18:35:25.654863+0000","last_active":"2024-09-12T18:36:03.468549+0000","last_peered":"2024-09-12T18:36:03.468549+0000","last_clean":"2024-09-12T18:36:03.468549+0000","last_became_active":"2024-09-12T18:35:25.650407+0000","last_became_peered":"2024-09-12T18:35:25.650407+0000","last_unstale":"2024-09-12T18:36:03.468549+0000","last_undegraded":"2024-09-12T18:36:03.468549+0000","last_fullsized":"2024-09-12T18:36:03.468549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:38.395666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458577+0000","last_change":"2024-09-12T18:35:25.662414+0000","last_active":"2024-09-12T18:36:01.458577+0000","last_peered":"2024-09-12T18:36:01.458577+0000","last_clean":"2024-09-12T18:36:01.458577+0000","last_became_active":"2024-09-12T18:35:25.660126+0000","last_became_peered":"2024-09-12T18:35:25.660126+0000","last_unstale":"2024-09-12T18:36:01.458577+0000","last_undegraded":"2024-09-12T18:36:01.458577+0000","last_fullsized":"2024-09-12T18:36:01.458577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:48.437139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457592+0000","last_change":"2024-09-12T18:35:25.661523+0000","last_active":"2024-09-12T18:36:01.457592+0000","last_peered":"2024-09-12T18:36:01.457592+0000","last_clean":"2024-09-12T18:36:01.457592+0000","last_became_active":"2024-09-12T18:35:25.659338+0000","last_became_peered":"2024-09-12T18:35:25.659338+0000","last_unstale":"2024-09-12T18:36:01.457592+0000","last_undegraded":"2024-09-12T18:36:01.457592+0000","last_fullsized":"2024-09-12T18:36:01.457592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:37.083820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468463+0000","last_change":"2024-09-12T18:35:25.662445+0000","last_active":"2024-09-12T18:36:03.468463+0000","last_peered":"2024-09-12T18:36:03.468463+0000","last_clean":"2024-09-12T18:36:03.468463+0000","last_became_active":"2024-09-12T18:35:25.659496+0000","last_became_peered":"2024-09-12T18:35:25.659496+0000","last_unstale":"2024-09-12T18:36:03.468463+0000","last_undegraded":"2024-09-12T18:36:03.468463+0000","last_fullsized":"2024-09-12T18:36:03.468463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:03.270420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457867+0000","last_change":"2024-09-12T18:35:25.662519+0000","last_active":"2024-09-12T18:36:01.457867+0000","last_peered":"2024-09-12T18:36:01.457867+0000","last_clean":"2024-09-12T18:36:01.457867+0000","last_became_active":"2024-09-12T18:35:25.652964+0000","last_became_peered":"2024-09-12T18:35:25.652964+0000","last_unstale":"2024-09-12T18:36:01.457867+0000","last_undegraded":"2024-09-12T18:36:01.457867+0000","last_fullsized":"2024-09-12T18:36:01.457867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:37.923468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.467821+0000","last_change":"2024-09-12T18:35:25.650507+0000","last_active":"2024-09-12T18:36:03.467821+0000","last_peered":"2024-09-12T18:36:03.467821+0000","last_clean":"2024-09-12T18:36:03.467821+0000","last_became_active":"2024-09-12T18:35:25.649415+0000","last_became_peered":"2024-09-12T18:35:25.649415+0000","last_unstale":"2024-09-12T18:36:03.467821+0000","last_undegraded":"2024-09-12T18:36:03.467821+0000","last_fullsized":"2024-09-12T18:36:03.467821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:23.081416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457196+0000","last_change":"2024-09-12T18:35:25.653949+0000","last_active":"2024-09-12T18:36:01.457196+0000","last_peered":"2024-09-12T18:36:01.457196+0000","last_clean":"2024-09-12T18:36:01.457196+0000","last_became_active":"2024-09-12T18:35:25.652992+0000","last_became_peered":"2024-09-12T18:35:25.652992+0000","last_unstale":"2024-09-12T18:36:01.457196+0000","last_undegraded":"2024-09-12T18:36:01.457196+0000","last_fullsized":"2024-09-12T18:36:01.457196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:47.687372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.456891+0000","last_change":"2024-09-12T18:35:25.653159+0000","last_active":"2024-09-12T18:36:01.456891+0000","last_peered":"2024-09-12T18:36:01.456891+0000","last_clean":"2024-09-12T18:36:01.456891+0000","last_became_active":"2024-09-12T18:35:25.650551+0000","last_became_peered":"2024-09-12T18:35:25.650551+0000","last_unstale":"2024-09-12T18:36:01.456891+0000","last_undegraded":"2024-09-12T18:36:01.456891+0000","last_fullsized":"2024-09-12T18:36:01.456891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:16.245302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468359+0000","last_change":"2024-09-12T18:35:25.651877+0000","last_active":"2024-09-12T18:36:03.468359+0000","last_peered":"2024-09-12T18:36:03.468359+0000","last_clean":"2024-09-12T18:36:03.468359+0000","last_became_active":"2024-09-12T18:35:25.651055+0000","last_became_peered":"2024-09-12T18:35:25.651055+0000","last_unstale":"2024-09-12T18:36:03.468359+0000","last_undegraded":"2024-09-12T18:36:03.468359+0000","last_fullsized":"2024-09-12T18:36:03.468359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:14.200080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457269+0000","last_change":"2024-09-12T18:35:24.657739+0000","last_active":"2024-09-12T18:36:01.457269+0000","last_peered":"2024-09-12T18:36:01.457269+0000","last_clean":"2024-09-12T18:36:01.457269+0000","last_became_active":"2024-09-12T18:35:24.656208+0000","last_became_peered":"2024-09-12T18:35:24.656208+0000","last_unstale":"2024-09-12T18:36:01.457269+0000","last_undegraded":"2024-09-12T18:36:01.457269+0000","last_fullsized":"2024-09-12T18:36:01.457269+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:50.073716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468191+0000","last_change":"2024-09-12T18:35:25.651651+0000","last_active":"2024-09-12T18:36:03.468191+0000","last_peered":"2024-09-12T18:36:03.468191+0000","last_clean":"2024-09-12T18:36:03.468191+0000","last_became_active":"2024-09-12T18:35:25.650849+0000","last_became_peered":"2024-09-12T18:35:25.650849+0000","last_unstale":"2024-09-12T18:36:03.468191+0000","last_undegraded":"2024-09-12T18:36:03.468191+0000","last_fullsized":"2024-09-12T18:36:03.468191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:18.555827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457663+0000","last_change":"2024-09-12T18:35:24.656119+0000","last_active":"2024-09-12T18:36:01.457663+0000","last_peered":"2024-09-12T18:36:01.457663+0000","last_clean":"2024-09-12T18:36:01.457663+0000","last_became_active":"2024-09-12T18:35:24.653175+0000","last_became_peered":"2024-09-12T18:35:24.653175+0000","last_unstale":"2024-09-12T18:36:01.457663+0000","last_undegraded":"2024-09-12T18:36:01.457663+0000","last_fullsized":"2024-09-12T18:36:01.457663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:00.551165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458765+0000","last_change":"2024-09-12T18:35:25.655723+0000","last_active":"2024-09-12T18:36:01.458765+0000","last_peered":"2024-09-12T18:36:01.458765+0000","last_clean":"2024-09-12T18:36:01.458765+0000","last_became_active":"2024-09-12T18:35:25.653630+0000","last_became_peered":"2024-09-12T18:35:25.653630+0000","last_unstale":"2024-09-12T18:36:01.458765+0000","last_undegraded":"2024-09-12T18:36:01.458765+0000","last_fullsized":"2024-09-12T18:36:01.458765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:07.655792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.467642+0000","last_change":"2024-09-12T18:35:24.640096+0000","last_active":"2024-09-12T18:36:03.467642+0000","last_peered":"2024-09-12T18:36:03.467642+0000","last_clean":"2024-09-12T18:36:03.467642+0000","last_became_active":"2024-09-12T18:35:24.638230+0000","last_became_peered":"2024-09-12T18:35:24.638230+0000","last_unstale":"2024-09-12T18:36:03.467642+0000","last_undegraded":"2024-09-12T18:36:03.467642+0000","last_fullsized":"2024-09-12T18:36:03.467642+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:38.435296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457928+0000","last_change":"2024-09-12T18:35:25.662692+0000","last_active":"2024-09-12T18:36:01.457928+0000","last_peered":"2024-09-12T18:36:01.457928+0000","last_clean":"2024-09-12T18:36:01.457928+0000","last_became_active":"2024-09-12T18:35:25.661885+0000","last_became_peered":"2024-09-12T18:35:25.661885+0000","last_unstale":"2024-09-12T18:36:01.457928+0000","last_undegraded":"2024-09-12T18:36:01.457928+0000","last_fullsized":"2024-09-12T18:36:01.457928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:41.264425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457083+0000","last_change":"2024-09-12T18:35:24.653610+0000","last_active":"2024-09-12T18:36:01.457083+0000","last_peered":"2024-09-12T18:36:01.457083+0000","last_clean":"2024-09-12T18:36:01.457083+0000","last_became_active":"2024-09-12T18:35:24.652880+0000","last_became_peered":"2024-09-12T18:35:24.652880+0000","last_unstale":"2024-09-12T18:36:01.457083+0000","last_undegraded":"2024-09-12T18:36:01.457083+0000","last_fullsized":"2024-09-12T18:36:01.457083+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:57.636251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"31'2753","reported_seq":2782,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.462239+0000","last_change":"2024-09-12T18:35:44.771794+0000","last_active":"2024-09-12T18:36:01.462239+0000","last_peered":"2024-09-12T18:36:01.462239+0000","last_clean":"2024-09-12T18:36:01.462239+0000","last_became_active":"2024-09-12T18:35:44.771286+0000","last_became_peered":"2024-09-12T18:35:44.771286+0000","last_unstale":"2024-09-12T18:36:01.462239+0000","last_undegraded":"2024-09-12T18:36:01.462239+0000","last_fullsized":"2024-09-12T18:36:01.462239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":2753,"log_dups_size":0,"ondisk_log_size":2753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:10.094729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180420608,"num_objects":2753,"num_object_clones":0,"num_object_copies":5506,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2753,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2753,"num_write_kb":176192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.460130+0000","last_change":"2024-09-12T18:35:24.653465+0000","last_active":"2024-09-12T18:36:01.460130+0000","last_peered":"2024-09-12T18:36:01.460130+0000","last_clean":"2024-09-12T18:36:01.460130+0000","last_became_active":"2024-09-12T18:35:24.652792+0000","last_became_peered":"2024-09-12T18:35:24.652792+0000","last_unstale":"2024-09-12T18:36:01.460130+0000","last_undegraded":"2024-09-12T18:36:01.460130+0000","last_fullsized":"2024-09-12T18:36:01.460130+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:14.588993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.469061+0000","last_change":"2024-09-12T18:35:25.655426+0000","last_active":"2024-09-12T18:36:03.469061+0000","last_peered":"2024-09-12T18:36:03.469061+0000","last_clean":"2024-09-12T18:36:03.469061+0000","last_became_active":"2024-09-12T18:35:25.648186+0000","last_became_peered":"2024-09-12T18:35:25.648186+0000","last_unstale":"2024-09-12T18:36:03.469061+0000","last_undegraded":"2024-09-12T18:36:03.469061+0000","last_fullsized":"2024-09-12T18:36:03.469061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:48.802815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"32'2968","reported_seq":3001,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468788+0000","last_change":"2024-09-12T18:35:44.767860+0000","last_active":"2024-09-12T18:36:03.468788+0000","last_peered":"2024-09-12T18:36:03.468788+0000","last_clean":"2024-09-12T18:36:03.468788+0000","last_became_active":"2024-09-12T18:35:44.766986+0000","last_became_peered":"2024-09-12T18:35:44.766986+0000","last_unstale":"2024-09-12T18:36:03.468788+0000","last_undegraded":"2024-09-12T18:36:03.468788+0000","last_fullsized":"2024-09-12T18:36:03.468788+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":2968,"log_dups_size":0,"ondisk_log_size":2968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:49.109157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194510848,"num_objects":2968,"num_object_clones":0,"num_object_copies":5936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2968,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2968,"num_write_kb":189952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468578+0000","last_change":"2024-09-12T18:35:24.648439+0000","last_active":"2024-09-12T18:36:03.468578+0000","last_peered":"2024-09-12T18:36:03.468578+0000","last_clean":"2024-09-12T18:36:03.468578+0000","last_became_active":"2024-09-12T18:35:24.647629+0000","last_became_peered":"2024-09-12T18:35:24.647629+0000","last_unstale":"2024-09-12T18:36:03.468578+0000","last_undegraded":"2024-09-12T18:36:03.468578+0000","last_fullsized":"2024-09-12T18:36:03.468578+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:45.428223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.467525+0000","last_change":"2024-09-12T18:35:25.652496+0000","last_active":"2024-09-12T18:36:03.467525+0000","last_peered":"2024-09-12T18:36:03.467525+0000","last_clean":"2024-09-12T18:36:03.467525+0000","last_became_active":"2024-09-12T18:35:25.651628+0000","last_became_peered":"2024-09-12T18:35:25.651628+0000","last_unstale":"2024-09-12T18:36:03.467525+0000","last_undegraded":"2024-09-12T18:36:03.467525+0000","last_fullsized":"2024-09-12T18:36:03.467525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:44.920448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"32'3118","reported_seq":3151,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.467646+0000","last_change":"2024-09-12T18:35:44.767175+0000","last_active":"2024-09-12T18:36:03.467646+0000","last_peered":"2024-09-12T18:36:03.467646+0000","last_clean":"2024-09-12T18:36:03.467646+0000","last_became_active":"2024-09-12T18:35:44.766592+0000","last_became_peered":"2024-09-12T18:35:44.766592+0000","last_unstale":"2024-09-12T18:36:03.467646+0000","last_undegraded":"2024-09-12T18:36:03.467646+0000","last_fullsized":"2024-09-12T18:36:03.467646+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3118,"log_dups_size":0,"ondisk_log_size":3118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:44.678279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204341248,"num_objects":3118,"num_object_clones":0,"num_object_copies":6236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3118,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3118,"num_write_kb":199552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458211+0000","last_change":"2024-09-12T18:35:24.654976+0000","last_active":"2024-09-12T18:36:01.458211+0000","last_peered":"2024-09-12T18:36:01.458211+0000","last_clean":"2024-09-12T18:36:01.458211+0000","last_became_active":"2024-09-12T18:35:24.654264+0000","last_became_peered":"2024-09-12T18:35:24.654264+0000","last_unstale":"2024-09-12T18:36:01.458211+0000","last_undegraded":"2024-09-12T18:36:01.458211+0000","last_fullsized":"2024-09-12T18:36:01.458211+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:00.115408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.456949+0000","last_change":"2024-09-12T18:35:25.650577+0000","last_active":"2024-09-12T18:36:01.456949+0000","last_peered":"2024-09-12T18:36:01.456949+0000","last_clean":"2024-09-12T18:36:01.456949+0000","last_became_active":"2024-09-12T18:35:25.649172+0000","last_became_peered":"2024-09-12T18:35:25.649172+0000","last_unstale":"2024-09-12T18:36:01.456949+0000","last_undegraded":"2024-09-12T18:36:01.456949+0000","last_fullsized":"2024-09-12T18:36:01.456949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:55.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"31'2790","reported_seq":2819,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457224+0000","last_change":"2024-09-12T18:35:44.763067+0000","last_active":"2024-09-12T18:36:01.457224+0000","last_peered":"2024-09-12T18:36:01.457224+0000","last_clean":"2024-09-12T18:36:01.457224+0000","last_became_active":"2024-09-12T18:35:44.762584+0000","last_became_peered":"2024-09-12T18:35:44.762584+0000","last_unstale":"2024-09-12T18:36:01.457224+0000","last_undegraded":"2024-09-12T18:36:01.457224+0000","last_fullsized":"2024-09-12T18:36:01.457224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":2790,"log_dups_size":0,"ondisk_log_size":2790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:47.847399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182845440,"num_objects":2790,"num_object_clones":0,"num_object_copies":5580,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2790,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2790,"num_write_kb":178560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457710+0000","last_change":"2024-09-12T18:35:24.657665+0000","last_active":"2024-09-12T18:36:01.457710+0000","last_peered":"2024-09-12T18:36:01.457710+0000","last_clean":"2024-09-12T18:36:01.457710+0000","last_became_active":"2024-09-12T18:35:24.657015+0000","last_became_peered":"2024-09-12T18:35:24.657015+0000","last_unstale":"2024-09-12T18:36:01.457710+0000","last_undegraded":"2024-09-12T18:36:01.457710+0000","last_fullsized":"2024-09-12T18:36:01.457710+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:03.171326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457769+0000","last_change":"2024-09-12T18:35:25.665275+0000","last_active":"2024-09-12T18:36:01.457769+0000","last_peered":"2024-09-12T18:36:01.457769+0000","last_clean":"2024-09-12T18:36:01.457769+0000","last_became_active":"2024-09-12T18:35:25.659511+0000","last_became_peered":"2024-09-12T18:35:25.659511+0000","last_unstale":"2024-09-12T18:36:01.457769+0000","last_undegraded":"2024-09-12T18:36:01.457769+0000","last_fullsized":"2024-09-12T18:36:01.457769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"33'3104","reported_seq":3137,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.475835+0000","last_change":"2024-09-12T18:35:44.773526+0000","last_active":"2024-09-12T18:36:03.475835+0000","last_peered":"2024-09-12T18:36:03.475835+0000","last_clean":"2024-09-12T18:36:03.475835+0000","last_became_active":"2024-09-12T18:35:44.772974+0000","last_became_peered":"2024-09-12T18:35:44.772974+0000","last_unstale":"2024-09-12T18:36:03.475835+0000","last_undegraded":"2024-09-12T18:36:03.475835+0000","last_fullsized":"2024-09-12T18:36:03.475835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3104,"log_dups_size":0,"ondisk_log_size":3104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:23.676840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203423744,"num_objects":3104,"num_object_clones":0,"num_object_copies":6208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3104,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3104,"num_write_kb":198656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458040+0000","last_change":"2024-09-12T18:35:24.651913+0000","last_active":"2024-09-12T18:36:01.458040+0000","last_peered":"2024-09-12T18:36:01.458040+0000","last_clean":"2024-09-12T18:36:01.458040+0000","last_became_active":"2024-09-12T18:35:24.650421+0000","last_became_peered":"2024-09-12T18:35:24.650421+0000","last_unstale":"2024-09-12T18:36:01.458040+0000","last_undegraded":"2024-09-12T18:36:01.458040+0000","last_fullsized":"2024-09-12T18:36:01.458040+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:57.685312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457604+0000","last_change":"2024-09-12T18:35:25.651138+0000","last_active":"2024-09-12T18:36:01.457604+0000","last_peered":"2024-09-12T18:36:01.457604+0000","last_clean":"2024-09-12T18:36:01.457604+0000","last_became_active":"2024-09-12T18:35:25.650617+0000","last_became_peered":"2024-09-12T18:35:25.650617+0000","last_unstale":"2024-09-12T18:36:01.457604+0000","last_undegraded":"2024-09-12T18:36:01.457604+0000","last_fullsized":"2024-09-12T18:36:01.457604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:58.535066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"31'2753","reported_seq":2781,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.461611+0000","last_change":"2024-09-12T18:35:44.767970+0000","last_active":"2024-09-12T18:36:01.461611+0000","last_peered":"2024-09-12T18:36:01.461611+0000","last_clean":"2024-09-12T18:36:01.461611+0000","last_became_active":"2024-09-12T18:35:44.767348+0000","last_became_peered":"2024-09-12T18:35:44.767348+0000","last_unstale":"2024-09-12T18:36:01.461611+0000","last_undegraded":"2024-09-12T18:36:01.461611+0000","last_fullsized":"2024-09-12T18:36:01.461611+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":2753,"log_dups_size":0,"ondisk_log_size":2753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:48.745907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180420608,"num_objects":2753,"num_object_clones":0,"num_object_copies":5506,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2753,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2753,"num_write_kb":176192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457846+0000","last_change":"2024-09-12T18:35:24.659019+0000","last_active":"2024-09-12T18:36:01.457846+0000","last_peered":"2024-09-12T18:36:01.457846+0000","last_clean":"2024-09-12T18:36:01.457846+0000","last_became_active":"2024-09-12T18:35:24.658423+0000","last_became_peered":"2024-09-12T18:35:24.658423+0000","last_unstale":"2024-09-12T18:36:01.457846+0000","last_undegraded":"2024-09-12T18:36:01.457846+0000","last_fullsized":"2024-09-12T18:36:01.457846+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:37.668417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457927+0000","last_change":"2024-09-12T18:35:25.662287+0000","last_active":"2024-09-12T18:36:01.457927+0000","last_peered":"2024-09-12T18:36:01.457927+0000","last_clean":"2024-09-12T18:36:01.457927+0000","last_became_active":"2024-09-12T18:35:25.660372+0000","last_became_peered":"2024-09-12T18:35:25.660372+0000","last_unstale":"2024-09-12T18:36:01.457927+0000","last_undegraded":"2024-09-12T18:36:01.457927+0000","last_fullsized":"2024-09-12T18:36:01.457927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:08.729541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.f","version":"30'2806","reported_seq":2835,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.459895+0000","last_change":"2024-09-12T18:35:44.774817+0000","last_active":"2024-09-12T18:36:01.459895+0000","last_peered":"2024-09-12T18:36:01.459895+0000","last_clean":"2024-09-12T18:36:01.459895+0000","last_became_active":"2024-09-12T18:35:44.774429+0000","last_became_peered":"2024-09-12T18:35:44.774429+0000","last_unstale":"2024-09-12T18:36:01.459895+0000","last_undegraded":"2024-09-12T18:36:01.459895+0000","last_fullsized":"2024-09-12T18:36:01.459895+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":2806,"log_dups_size":0,"ondisk_log_size":2806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:21.579103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183894016,"num_objects":2806,"num_object_clones":0,"num_object_copies":5612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2806,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2806,"num_write_kb":179584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.467739+0000","last_change":"2024-09-12T18:35:24.648330+0000","last_active":"2024-09-12T18:36:03.467739+0000","last_peered":"2024-09-12T18:36:03.467739+0000","last_clean":"2024-09-12T18:36:03.467739+0000","last_became_active":"2024-09-12T18:35:24.647520+0000","last_became_peered":"2024-09-12T18:35:24.647520+0000","last_unstale":"2024-09-12T18:36:03.467739+0000","last_undegraded":"2024-09-12T18:36:03.467739+0000","last_fullsized":"2024-09-12T18:36:03.467739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:25.552055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457719+0000","last_change":"2024-09-12T18:35:25.658674+0000","last_active":"2024-09-12T18:36:01.457719+0000","last_peered":"2024-09-12T18:36:01.457719+0000","last_clean":"2024-09-12T18:36:01.457719+0000","last_became_active":"2024-09-12T18:35:25.657386+0000","last_became_peered":"2024-09-12T18:35:25.657386+0000","last_unstale":"2024-09-12T18:36:01.457719+0000","last_undegraded":"2024-09-12T18:36:01.457719+0000","last_fullsized":"2024-09-12T18:36:01.457719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:48.037086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"32'3083","reported_seq":3116,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468201+0000","last_change":"2024-09-12T18:35:44.771738+0000","last_active":"2024-09-12T18:36:03.468201+0000","last_peered":"2024-09-12T18:36:03.468201+0000","last_clean":"2024-09-12T18:36:03.468201+0000","last_became_active":"2024-09-12T18:35:44.771227+0000","last_became_peered":"2024-09-12T18:35:44.771227+0000","last_unstale":"2024-09-12T18:36:03.468201+0000","last_undegraded":"2024-09-12T18:36:03.468201+0000","last_fullsized":"2024-09-12T18:36:03.468201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3083,"log_dups_size":0,"ondisk_log_size":3083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:27.329732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202047488,"num_objects":3083,"num_object_clones":0,"num_object_copies":6166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3083,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3083,"num_write_kb":197312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.469059+0000","last_change":"2024-09-12T18:35:24.646810+0000","last_active":"2024-09-12T18:36:03.469059+0000","last_peered":"2024-09-12T18:36:03.469059+0000","last_clean":"2024-09-12T18:36:03.469059+0000","last_became_active":"2024-09-12T18:35:24.646008+0000","last_became_peered":"2024-09-12T18:35:24.646008+0000","last_unstale":"2024-09-12T18:36:03.469059+0000","last_undegraded":"2024-09-12T18:36:03.469059+0000","last_fullsized":"2024-09-12T18:36:03.469059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:43.888776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458076+0000","last_change":"2024-09-12T18:35:25.667710+0000","last_active":"2024-09-12T18:36:01.458076+0000","last_peered":"2024-09-12T18:36:01.458076+0000","last_clean":"2024-09-12T18:36:01.458076+0000","last_became_active":"2024-09-12T18:35:25.666940+0000","last_became_peered":"2024-09-12T18:35:25.666940+0000","last_unstale":"2024-09-12T18:36:01.458076+0000","last_undegraded":"2024-09-12T18:36:01.458076+0000","last_fullsized":"2024-09-12T18:36:01.458076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:09.823085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"32'3023","reported_seq":3056,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.467735+0000","last_change":"2024-09-12T18:35:44.769127+0000","last_active":"2024-09-12T18:36:03.467735+0000","last_peered":"2024-09-12T18:36:03.467735+0000","last_clean":"2024-09-12T18:36:03.467735+0000","last_became_active":"2024-09-12T18:35:44.768382+0000","last_became_peered":"2024-09-12T18:35:44.768382+0000","last_unstale":"2024-09-12T18:36:03.467735+0000","last_undegraded":"2024-09-12T18:36:03.467735+0000","last_fullsized":"2024-09-12T18:36:03.467735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3023,"log_dups_size":0,"ondisk_log_size":3023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:33.385476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198115328,"num_objects":3023,"num_object_clones":0,"num_object_copies":6046,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3023,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3023,"num_write_kb":193472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":189,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457395+0000","last_change":"2024-09-12T18:35:13.489018+0000","last_active":"2024-09-12T18:36:01.457395+0000","last_peered":"2024-09-12T18:36:01.457395+0000","last_clean":"2024-09-12T18:36:01.457395+0000","last_became_active":"2024-09-12T18:35:13.488346+0000","last_became_peered":"2024-09-12T18:35:13.488346+0000","last_unstale":"2024-09-12T18:36:01.457395+0000","last_undegraded":"2024-09-12T18:36:01.457395+0000","last_fullsized":"2024-09-12T18:36:01.457395+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_clean_scrub_stamp":"2024-09-12T18:35:12.464628+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:54.864640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457506+0000","last_change":"2024-09-12T18:35:22.459694+0000","last_active":"2024-09-12T18:36:01.457506+0000","last_peered":"2024-09-12T18:36:01.457506+0000","last_clean":"2024-09-12T18:36:01.457506+0000","last_became_active":"2024-09-12T18:35:20.446796+0000","last_became_peered":"2024-09-12T18:35:20.446796+0000","last_unstale":"2024-09-12T18:36:01.457506+0000","last_undegraded":"2024-09-12T18:36:01.457506+0000","last_fullsized":"2024-09-12T18:36:01.457506+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:21.506024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016291610000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458518+0000","last_change":"2024-09-12T18:35:24.651749+0000","last_active":"2024-09-12T18:36:01.458518+0000","last_peered":"2024-09-12T18:36:01.458518+0000","last_clean":"2024-09-12T18:36:01.458518+0000","last_became_active":"2024-09-12T18:35:24.649860+0000","last_became_peered":"2024-09-12T18:35:24.649860+0000","last_unstale":"2024-09-12T18:36:01.458518+0000","last_undegraded":"2024-09-12T18:36:01.458518+0000","last_fullsized":"2024-09-12T18:36:01.458518+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:35.430065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458068+0000","last_change":"2024-09-12T18:35:25.662424+0000","last_active":"2024-09-12T18:36:01.458068+0000","last_peered":"2024-09-12T18:36:01.458068+0000","last_clean":"2024-09-12T18:36:01.458068+0000","last_became_active":"2024-09-12T18:35:25.661043+0000","last_became_peered":"2024-09-12T18:35:25.661043+0000","last_unstale":"2024-09-12T18:36:01.458068+0000","last_undegraded":"2024-09-12T18:36:01.458068+0000","last_fullsized":"2024-09-12T18:36:01.458068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:52.551802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.7","version":"31'2739","reported_seq":2768,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.460057+0000","last_change":"2024-09-12T18:35:44.774505+0000","last_active":"2024-09-12T18:36:01.460057+0000","last_peered":"2024-09-12T18:36:01.460057+0000","last_clean":"2024-09-12T18:36:01.460057+0000","last_became_active":"2024-09-12T18:35:44.774259+0000","last_became_peered":"2024-09-12T18:35:44.774259+0000","last_unstale":"2024-09-12T18:36:01.460057+0000","last_undegraded":"2024-09-12T18:36:01.460057+0000","last_fullsized":"2024-09-12T18:36:01.460057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":2739,"log_dups_size":0,"ondisk_log_size":2739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:21.731670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":179503104,"num_objects":2739,"num_object_clones":0,"num_object_copies":5478,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2739,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2739,"num_write_kb":175296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457296+0000","last_change":"2024-09-12T18:35:22.459090+0000","last_active":"2024-09-12T18:36:01.457296+0000","last_peered":"2024-09-12T18:36:01.457296+0000","last_clean":"2024-09-12T18:36:01.457296+0000","last_became_active":"2024-09-12T18:35:20.448553+0000","last_became_peered":"2024-09-12T18:35:20.448553+0000","last_unstale":"2024-09-12T18:36:01.457296+0000","last_undegraded":"2024-09-12T18:36:01.457296+0000","last_fullsized":"2024-09-12T18:36:01.457296+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:56.834808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001030836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457418+0000","last_change":"2024-09-12T18:35:24.651597+0000","last_active":"2024-09-12T18:36:01.457418+0000","last_peered":"2024-09-12T18:36:01.457418+0000","last_clean":"2024-09-12T18:36:01.457418+0000","last_became_active":"2024-09-12T18:35:24.649940+0000","last_became_peered":"2024-09-12T18:35:24.649940+0000","last_unstale":"2024-09-12T18:36:01.457418+0000","last_undegraded":"2024-09-12T18:36:01.457418+0000","last_fullsized":"2024-09-12T18:36:01.457418+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:36.822432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468531+0000","last_change":"2024-09-12T18:35:25.660529+0000","last_active":"2024-09-12T18:36:03.468531+0000","last_peered":"2024-09-12T18:36:03.468531+0000","last_clean":"2024-09-12T18:36:03.468531+0000","last_became_active":"2024-09-12T18:35:25.659537+0000","last_became_peered":"2024-09-12T18:35:25.659537+0000","last_unstale":"2024-09-12T18:36:03.468531+0000","last_undegraded":"2024-09-12T18:36:03.468531+0000","last_fullsized":"2024-09-12T18:36:03.468531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:51.790349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'2763","reported_seq":2792,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458710+0000","last_change":"2024-09-12T18:35:44.770379+0000","last_active":"2024-09-12T18:36:01.458710+0000","last_peered":"2024-09-12T18:36:01.458710+0000","last_clean":"2024-09-12T18:36:01.458710+0000","last_became_active":"2024-09-12T18:35:44.769739+0000","last_became_peered":"2024-09-12T18:35:44.769739+0000","last_unstale":"2024-09-12T18:36:01.458710+0000","last_undegraded":"2024-09-12T18:36:01.458710+0000","last_fullsized":"2024-09-12T18:36:01.458710+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":2763,"log_dups_size":0,"ondisk_log_size":2763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:02:23.077263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181075968,"num_objects":2763,"num_object_clones":0,"num_object_copies":5526,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2763,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2763,"num_write_kb":176832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457508+0000","last_change":"2024-09-12T18:35:22.464179+0000","last_active":"2024-09-12T18:36:01.457508+0000","last_peered":"2024-09-12T18:36:01.457508+0000","last_clean":"2024-09-12T18:36:01.457508+0000","last_became_active":"2024-09-12T18:35:20.442613+0000","last_became_peered":"2024-09-12T18:35:20.442613+0000","last_unstale":"2024-09-12T18:36:01.457508+0000","last_undegraded":"2024-09-12T18:36:01.457508+0000","last_fullsized":"2024-09-12T18:36:01.457508+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:17.636537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014134620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.469114+0000","last_change":"2024-09-12T18:35:24.641297+0000","last_active":"2024-09-12T18:36:03.469114+0000","last_peered":"2024-09-12T18:36:03.469114+0000","last_clean":"2024-09-12T18:36:03.469114+0000","last_became_active":"2024-09-12T18:35:24.637334+0000","last_became_peered":"2024-09-12T18:35:24.637334+0000","last_unstale":"2024-09-12T18:36:03.469114+0000","last_undegraded":"2024-09-12T18:36:03.469114+0000","last_fullsized":"2024-09-12T18:36:03.469114+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:50.772074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458083+0000","last_change":"2024-09-12T18:35:25.659209+0000","last_active":"2024-09-12T18:36:01.458083+0000","last_peered":"2024-09-12T18:36:01.458083+0000","last_clean":"2024-09-12T18:36:01.458083+0000","last_became_active":"2024-09-12T18:35:25.656170+0000","last_became_peered":"2024-09-12T18:35:25.656170+0000","last_unstale":"2024-09-12T18:36:01.458083+0000","last_undegraded":"2024-09-12T18:36:01.458083+0000","last_fullsized":"2024-09-12T18:36:01.458083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:40.925757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"31'2821","reported_seq":2849,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457861+0000","last_change":"2024-09-12T18:35:44.770358+0000","last_active":"2024-09-12T18:36:01.457861+0000","last_peered":"2024-09-12T18:36:01.457861+0000","last_clean":"2024-09-12T18:36:01.457861+0000","last_became_active":"2024-09-12T18:35:44.769786+0000","last_became_peered":"2024-09-12T18:35:44.769786+0000","last_unstale":"2024-09-12T18:36:01.457861+0000","last_undegraded":"2024-09-12T18:36:01.457861+0000","last_fullsized":"2024-09-12T18:36:01.457861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":2821,"log_dups_size":0,"ondisk_log_size":2821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:27.215502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184877056,"num_objects":2821,"num_object_clones":0,"num_object_copies":5642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2821,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2821,"num_write_kb":180544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457951+0000","last_change":"2024-09-12T18:35:22.459049+0000","last_active":"2024-09-12T18:36:01.457951+0000","last_peered":"2024-09-12T18:36:01.457951+0000","last_clean":"2024-09-12T18:36:01.457951+0000","last_became_active":"2024-09-12T18:35:20.446814+0000","last_became_peered":"2024-09-12T18:35:20.446814+0000","last_unstale":"2024-09-12T18:36:01.457951+0000","last_undegraded":"2024-09-12T18:36:01.457951+0000","last_fullsized":"2024-09-12T18:36:01.457951+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:18.033595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010716149999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457397+0000","last_change":"2024-09-12T18:35:24.658273+0000","last_active":"2024-09-12T18:36:01.457397+0000","last_peered":"2024-09-12T18:36:01.457397+0000","last_clean":"2024-09-12T18:36:01.457397+0000","last_became_active":"2024-09-12T18:35:24.657433+0000","last_became_peered":"2024-09-12T18:35:24.657433+0000","last_unstale":"2024-09-12T18:36:01.457397+0000","last_undegraded":"2024-09-12T18:36:01.457397+0000","last_fullsized":"2024-09-12T18:36:01.457397+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:48.497218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.459190+0000","last_change":"2024-09-12T18:35:25.655830+0000","last_active":"2024-09-12T18:36:01.459190+0000","last_peered":"2024-09-12T18:36:01.459190+0000","last_clean":"2024-09-12T18:36:01.459190+0000","last_became_active":"2024-09-12T18:35:25.652126+0000","last_became_peered":"2024-09-12T18:35:25.652126+0000","last_unstale":"2024-09-12T18:36:01.459190+0000","last_undegraded":"2024-09-12T18:36:01.459190+0000","last_fullsized":"2024-09-12T18:36:01.459190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:04.080721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"31'2761","reported_seq":2790,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.464762+0000","last_change":"2024-09-12T18:35:44.770799+0000","last_active":"2024-09-12T18:36:01.464762+0000","last_peered":"2024-09-12T18:36:01.464762+0000","last_clean":"2024-09-12T18:36:01.464762+0000","last_became_active":"2024-09-12T18:35:44.770030+0000","last_became_peered":"2024-09-12T18:35:44.770030+0000","last_unstale":"2024-09-12T18:36:01.464762+0000","last_undegraded":"2024-09-12T18:36:01.464762+0000","last_fullsized":"2024-09-12T18:36:01.464762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":2761,"log_dups_size":0,"ondisk_log_size":2761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:24.786452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180944896,"num_objects":2761,"num_object_clones":0,"num_object_copies":5522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2761,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2761,"num_write_kb":176704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458304+0000","last_change":"2024-09-12T18:35:24.657618+0000","last_active":"2024-09-12T18:36:01.458304+0000","last_peered":"2024-09-12T18:36:01.458304+0000","last_clean":"2024-09-12T18:36:01.458304+0000","last_became_active":"2024-09-12T18:35:24.656741+0000","last_became_peered":"2024-09-12T18:35:24.656741+0000","last_unstale":"2024-09-12T18:36:01.458304+0000","last_undegraded":"2024-09-12T18:36:01.458304+0000","last_fullsized":"2024-09-12T18:36:01.458304+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:43.113104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.459271+0000","last_change":"2024-09-12T18:35:22.464180+0000","last_active":"2024-09-12T18:36:01.459271+0000","last_peered":"2024-09-12T18:36:01.459271+0000","last_clean":"2024-09-12T18:36:01.459271+0000","last_became_active":"2024-09-12T18:35:20.442566+0000","last_became_peered":"2024-09-12T18:35:20.442566+0000","last_unstale":"2024-09-12T18:36:01.459271+0000","last_undegraded":"2024-09-12T18:36:01.459271+0000","last_fullsized":"2024-09-12T18:36:01.459271+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:29.021710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001325786,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.467780+0000","last_change":"2024-09-12T18:35:25.650458+0000","last_active":"2024-09-12T18:36:03.467780+0000","last_peered":"2024-09-12T18:36:03.467780+0000","last_clean":"2024-09-12T18:36:03.467780+0000","last_became_active":"2024-09-12T18:35:25.648761+0000","last_became_peered":"2024-09-12T18:35:25.648761+0000","last_unstale":"2024-09-12T18:36:03.467780+0000","last_undegraded":"2024-09-12T18:36:03.467780+0000","last_fullsized":"2024-09-12T18:36:03.467780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:53.026950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"30'2737","reported_seq":2766,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.456618+0000","last_change":"2024-09-12T18:35:44.773801+0000","last_active":"2024-09-12T18:36:01.456618+0000","last_peered":"2024-09-12T18:36:01.456618+0000","last_clean":"2024-09-12T18:36:01.456618+0000","last_became_active":"2024-09-12T18:35:44.772787+0000","last_became_peered":"2024-09-12T18:35:44.772787+0000","last_unstale":"2024-09-12T18:36:01.456618+0000","last_undegraded":"2024-09-12T18:36:01.456618+0000","last_fullsized":"2024-09-12T18:36:01.456618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":2737,"log_dups_size":0,"ondisk_log_size":2737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:13.758208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":179372032,"num_objects":2737,"num_object_clones":0,"num_object_copies":5474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2737,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2737,"num_write_kb":175168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.459235+0000","last_change":"2024-09-12T18:35:24.649669+0000","last_active":"2024-09-12T18:36:01.459235+0000","last_peered":"2024-09-12T18:36:01.459235+0000","last_clean":"2024-09-12T18:36:01.459235+0000","last_became_active":"2024-09-12T18:35:24.648881+0000","last_became_peered":"2024-09-12T18:35:24.648881+0000","last_unstale":"2024-09-12T18:36:01.459235+0000","last_undegraded":"2024-09-12T18:36:01.459235+0000","last_fullsized":"2024-09-12T18:36:01.459235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:23.614734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468782+0000","last_change":"2024-09-12T18:35:22.458666+0000","last_active":"2024-09-12T18:36:03.468782+0000","last_peered":"2024-09-12T18:36:03.468782+0000","last_clean":"2024-09-12T18:36:03.468782+0000","last_became_active":"2024-09-12T18:35:20.442394+0000","last_became_peered":"2024-09-12T18:35:20.442394+0000","last_unstale":"2024-09-12T18:36:03.468782+0000","last_undegraded":"2024-09-12T18:36:03.468782+0000","last_fullsized":"2024-09-12T18:36:03.468782+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:51.840246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080163599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.467781+0000","last_change":"2024-09-12T18:35:25.650717+0000","last_active":"2024-09-12T18:36:03.467781+0000","last_peered":"2024-09-12T18:36:03.467781+0000","last_clean":"2024-09-12T18:36:03.467781+0000","last_became_active":"2024-09-12T18:35:25.649147+0000","last_became_peered":"2024-09-12T18:35:25.649147+0000","last_unstale":"2024-09-12T18:36:03.467781+0000","last_undegraded":"2024-09-12T18:36:03.467781+0000","last_fullsized":"2024-09-12T18:36:03.467781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:07.365888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"31'2761","reported_seq":2790,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.460166+0000","last_change":"2024-09-12T18:35:44.774031+0000","last_active":"2024-09-12T18:36:01.460166+0000","last_peered":"2024-09-12T18:36:01.460166+0000","last_clean":"2024-09-12T18:36:01.460166+0000","last_became_active":"2024-09-12T18:35:44.772874+0000","last_became_peered":"2024-09-12T18:35:44.772874+0000","last_unstale":"2024-09-12T18:36:01.460166+0000","last_undegraded":"2024-09-12T18:36:01.460166+0000","last_fullsized":"2024-09-12T18:36:01.460166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":2761,"log_dups_size":0,"ondisk_log_size":2761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:27.897491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180944896,"num_objects":2761,"num_object_clones":0,"num_object_copies":5522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2761,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2761,"num_write_kb":176704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458608+0000","last_change":"2024-09-12T18:35:24.657234+0000","last_active":"2024-09-12T18:36:01.458608+0000","last_peered":"2024-09-12T18:36:01.458608+0000","last_clean":"2024-09-12T18:36:01.458608+0000","last_became_active":"2024-09-12T18:35:24.655950+0000","last_became_peered":"2024-09-12T18:35:24.655950+0000","last_unstale":"2024-09-12T18:36:01.458608+0000","last_undegraded":"2024-09-12T18:36:01.458608+0000","last_fullsized":"2024-09-12T18:36:01.458608+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:17.466623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458860+0000","last_change":"2024-09-12T18:35:22.464656+0000","last_active":"2024-09-12T18:36:01.458860+0000","last_peered":"2024-09-12T18:36:01.458860+0000","last_clean":"2024-09-12T18:36:01.458860+0000","last_became_active":"2024-09-12T18:35:20.445470+0000","last_became_peered":"2024-09-12T18:35:20.445470+0000","last_unstale":"2024-09-12T18:36:01.458860+0000","last_undegraded":"2024-09-12T18:36:01.458860+0000","last_fullsized":"2024-09-12T18:36:01.458860+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:58.947359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001742681,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457772+0000","last_change":"2024-09-12T18:35:25.658887+0000","last_active":"2024-09-12T18:36:01.457772+0000","last_peered":"2024-09-12T18:36:01.457772+0000","last_clean":"2024-09-12T18:36:01.457772+0000","last_became_active":"2024-09-12T18:35:25.656829+0000","last_became_peered":"2024-09-12T18:35:25.656829+0000","last_unstale":"2024-09-12T18:36:01.457772+0000","last_undegraded":"2024-09-12T18:36:01.457772+0000","last_fullsized":"2024-09-12T18:36:01.457772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:50.109858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"32'3032","reported_seq":3065,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468970+0000","last_change":"2024-09-12T18:35:44.767276+0000","last_active":"2024-09-12T18:36:03.468970+0000","last_peered":"2024-09-12T18:36:03.468970+0000","last_clean":"2024-09-12T18:36:03.468970+0000","last_became_active":"2024-09-12T18:35:44.766145+0000","last_became_peered":"2024-09-12T18:35:44.766145+0000","last_unstale":"2024-09-12T18:36:03.468970+0000","last_undegraded":"2024-09-12T18:36:03.468970+0000","last_fullsized":"2024-09-12T18:36:03.468970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3032,"log_dups_size":0,"ondisk_log_size":3032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:47.423493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198705152,"num_objects":3032,"num_object_clones":0,"num_object_copies":6064,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3032,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3032,"num_write_kb":194048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458860+0000","last_change":"2024-09-12T18:35:24.654518+0000","last_active":"2024-09-12T18:36:01.458860+0000","last_peered":"2024-09-12T18:36:01.458860+0000","last_clean":"2024-09-12T18:36:01.458860+0000","last_became_active":"2024-09-12T18:35:24.650309+0000","last_became_peered":"2024-09-12T18:35:24.650309+0000","last_unstale":"2024-09-12T18:36:01.458860+0000","last_undegraded":"2024-09-12T18:36:01.458860+0000","last_fullsized":"2024-09-12T18:36:01.458860+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:16.669035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.460165+0000","last_change":"2024-09-12T18:35:22.459767+0000","last_active":"2024-09-12T18:36:01.460165+0000","last_peered":"2024-09-12T18:36:01.460165+0000","last_clean":"2024-09-12T18:36:01.460165+0000","last_became_active":"2024-09-12T18:35:20.448521+0000","last_became_peered":"2024-09-12T18:35:20.448521+0000","last_unstale":"2024-09-12T18:36:01.460165+0000","last_undegraded":"2024-09-12T18:36:01.460165+0000","last_fullsized":"2024-09-12T18:36:01.460165+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:33.463792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017009670000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.467597+0000","last_change":"2024-09-12T18:35:25.648150+0000","last_active":"2024-09-12T18:36:03.467597+0000","last_peered":"2024-09-12T18:36:03.467597+0000","last_clean":"2024-09-12T18:36:03.467597+0000","last_became_active":"2024-09-12T18:35:25.647347+0000","last_became_peered":"2024-09-12T18:35:25.647347+0000","last_unstale":"2024-09-12T18:36:03.467597+0000","last_undegraded":"2024-09-12T18:36:03.467597+0000","last_fullsized":"2024-09-12T18:36:03.467597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:48.968336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.456973+0000","last_change":"2024-09-12T18:35:25.660696+0000","last_active":"2024-09-12T18:36:01.456973+0000","last_peered":"2024-09-12T18:36:01.456973+0000","last_clean":"2024-09-12T18:36:01.456973+0000","last_became_active":"2024-09-12T18:35:25.659827+0000","last_became_peered":"2024-09-12T18:35:25.659827+0000","last_unstale":"2024-09-12T18:36:01.456973+0000","last_undegraded":"2024-09-12T18:36:01.456973+0000","last_fullsized":"2024-09-12T18:36:01.456973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:15.678289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457552+0000","last_change":"2024-09-12T18:35:24.655051+0000","last_active":"2024-09-12T18:36:01.457552+0000","last_peered":"2024-09-12T18:36:01.457552+0000","last_clean":"2024-09-12T18:36:01.457552+0000","last_became_active":"2024-09-12T18:35:24.654282+0000","last_became_peered":"2024-09-12T18:35:24.654282+0000","last_unstale":"2024-09-12T18:36:01.457552+0000","last_undegraded":"2024-09-12T18:36:01.457552+0000","last_fullsized":"2024-09-12T18:36:01.457552+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:08.159799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457575+0000","last_change":"2024-09-12T18:35:25.659237+0000","last_active":"2024-09-12T18:36:01.457575+0000","last_peered":"2024-09-12T18:36:01.457575+0000","last_clean":"2024-09-12T18:36:01.457575+0000","last_became_active":"2024-09-12T18:35:25.658423+0000","last_became_peered":"2024-09-12T18:35:25.658423+0000","last_unstale":"2024-09-12T18:36:01.457575+0000","last_undegraded":"2024-09-12T18:36:01.457575+0000","last_fullsized":"2024-09-12T18:36:01.457575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:42.956934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468426+0000","last_change":"2024-09-12T18:35:24.648658+0000","last_active":"2024-09-12T18:36:03.468426+0000","last_peered":"2024-09-12T18:36:03.468426+0000","last_clean":"2024-09-12T18:36:03.468426+0000","last_became_active":"2024-09-12T18:35:24.647826+0000","last_became_peered":"2024-09-12T18:35:24.647826+0000","last_unstale":"2024-09-12T18:36:03.468426+0000","last_undegraded":"2024-09-12T18:36:03.468426+0000","last_fullsized":"2024-09-12T18:36:03.468426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:24.167549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.459646+0000","last_change":"2024-09-12T18:35:24.656855+0000","last_active":"2024-09-12T18:36:01.459646+0000","last_peered":"2024-09-12T18:36:01.459646+0000","last_clean":"2024-09-12T18:36:01.459646+0000","last_became_active":"2024-09-12T18:35:24.655935+0000","last_became_peered":"2024-09-12T18:35:24.655935+0000","last_unstale":"2024-09-12T18:36:01.459646+0000","last_undegraded":"2024-09-12T18:36:01.459646+0000","last_fullsized":"2024-09-12T18:36:01.459646+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:35.430065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457328+0000","last_change":"2024-09-12T18:35:25.661801+0000","last_active":"2024-09-12T18:36:01.457328+0000","last_peered":"2024-09-12T18:36:01.457328+0000","last_clean":"2024-09-12T18:36:01.457328+0000","last_became_active":"2024-09-12T18:35:25.658476+0000","last_became_peered":"2024-09-12T18:35:25.658476+0000","last_unstale":"2024-09-12T18:36:01.457328+0000","last_undegraded":"2024-09-12T18:36:01.457328+0000","last_fullsized":"2024-09-12T18:36:01.457328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:58.246449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458519+0000","last_change":"2024-09-12T18:35:24.652399+0000","last_active":"2024-09-12T18:36:01.458519+0000","last_peered":"2024-09-12T18:36:01.458519+0000","last_clean":"2024-09-12T18:36:01.458519+0000","last_became_active":"2024-09-12T18:35:24.651416+0000","last_became_peered":"2024-09-12T18:35:24.651416+0000","last_unstale":"2024-09-12T18:36:01.458519+0000","last_undegraded":"2024-09-12T18:36:01.458519+0000","last_fullsized":"2024-09-12T18:36:01.458519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:32.594978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458362+0000","last_change":"2024-09-12T18:35:25.658570+0000","last_active":"2024-09-12T18:36:01.458362+0000","last_peered":"2024-09-12T18:36:01.458362+0000","last_clean":"2024-09-12T18:36:01.458362+0000","last_became_active":"2024-09-12T18:35:25.656561+0000","last_became_peered":"2024-09-12T18:35:25.656561+0000","last_unstale":"2024-09-12T18:36:01.458362+0000","last_undegraded":"2024-09-12T18:36:01.458362+0000","last_fullsized":"2024-09-12T18:36:01.458362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:22.225756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468860+0000","last_change":"2024-09-12T18:35:25.651217+0000","last_active":"2024-09-12T18:36:03.468860+0000","last_peered":"2024-09-12T18:36:03.468860+0000","last_clean":"2024-09-12T18:36:03.468860+0000","last_became_active":"2024-09-12T18:35:25.649544+0000","last_became_peered":"2024-09-12T18:35:25.649544+0000","last_unstale":"2024-09-12T18:36:03.468860+0000","last_undegraded":"2024-09-12T18:36:03.468860+0000","last_fullsized":"2024-09-12T18:36:03.468860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:41.601376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457929+0000","last_change":"2024-09-12T18:35:24.657489+0000","last_active":"2024-09-12T18:36:01.457929+0000","last_peered":"2024-09-12T18:36:01.457929+0000","last_clean":"2024-09-12T18:36:01.457929+0000","last_became_active":"2024-09-12T18:35:24.656030+0000","last_became_peered":"2024-09-12T18:35:24.656030+0000","last_unstale":"2024-09-12T18:36:01.457929+0000","last_undegraded":"2024-09-12T18:36:01.457929+0000","last_fullsized":"2024-09-12T18:36:01.457929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:11.362759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458363+0000","last_change":"2024-09-12T18:35:25.661544+0000","last_active":"2024-09-12T18:36:01.458363+0000","last_peered":"2024-09-12T18:36:01.458363+0000","last_clean":"2024-09-12T18:36:01.458363+0000","last_became_active":"2024-09-12T18:35:25.656985+0000","last_became_peered":"2024-09-12T18:35:25.656985+0000","last_unstale":"2024-09-12T18:36:01.458363+0000","last_undegraded":"2024-09-12T18:36:01.458363+0000","last_fullsized":"2024-09-12T18:36:01.458363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457354+0000","last_change":"2024-09-12T18:35:24.646342+0000","last_active":"2024-09-12T18:36:01.457354+0000","last_peered":"2024-09-12T18:36:01.457354+0000","last_clean":"2024-09-12T18:36:01.457354+0000","last_became_active":"2024-09-12T18:35:24.644773+0000","last_became_peered":"2024-09-12T18:35:24.644773+0000","last_unstale":"2024-09-12T18:36:01.457354+0000","last_undegraded":"2024-09-12T18:36:01.457354+0000","last_fullsized":"2024-09-12T18:36:01.457354+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:17.011231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.467975+0000","last_change":"2024-09-12T18:35:25.656712+0000","last_active":"2024-09-12T18:36:03.467975+0000","last_peered":"2024-09-12T18:36:03.467975+0000","last_clean":"2024-09-12T18:36:03.467975+0000","last_became_active":"2024-09-12T18:35:25.654473+0000","last_became_peered":"2024-09-12T18:35:25.654473+0000","last_unstale":"2024-09-12T18:36:03.467975+0000","last_undegraded":"2024-09-12T18:36:03.467975+0000","last_fullsized":"2024-09-12T18:36:03.467975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:01.464680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468116+0000","last_change":"2024-09-12T18:35:24.659935+0000","last_active":"2024-09-12T18:36:03.468116+0000","last_peered":"2024-09-12T18:36:03.468116+0000","last_clean":"2024-09-12T18:36:03.468116+0000","last_became_active":"2024-09-12T18:35:24.659111+0000","last_became_peered":"2024-09-12T18:35:24.659111+0000","last_unstale":"2024-09-12T18:36:03.468116+0000","last_undegraded":"2024-09-12T18:36:03.468116+0000","last_fullsized":"2024-09-12T18:36:03.468116+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:11.480154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468260+0000","last_change":"2024-09-12T18:35:25.660557+0000","last_active":"2024-09-12T18:36:03.468260+0000","last_peered":"2024-09-12T18:36:03.468260+0000","last_clean":"2024-09-12T18:36:03.468260+0000","last_became_active":"2024-09-12T18:35:25.652300+0000","last_became_peered":"2024-09-12T18:35:25.652300+0000","last_unstale":"2024-09-12T18:36:03.468260+0000","last_undegraded":"2024-09-12T18:36:03.468260+0000","last_fullsized":"2024-09-12T18:36:03.468260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:10:59.995841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468140+0000","last_change":"2024-09-12T18:35:24.638538+0000","last_active":"2024-09-12T18:36:03.468140+0000","last_peered":"2024-09-12T18:36:03.468140+0000","last_clean":"2024-09-12T18:36:03.468140+0000","last_became_active":"2024-09-12T18:35:24.637242+0000","last_became_peered":"2024-09-12T18:35:24.637242+0000","last_unstale":"2024-09-12T18:36:03.468140+0000","last_undegraded":"2024-09-12T18:36:03.468140+0000","last_fullsized":"2024-09-12T18:36:03.468140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:26.877441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.456837+0000","last_change":"2024-09-12T18:35:25.662537+0000","last_active":"2024-09-12T18:36:01.456837+0000","last_peered":"2024-09-12T18:36:01.456837+0000","last_clean":"2024-09-12T18:36:01.456837+0000","last_became_active":"2024-09-12T18:35:25.661441+0000","last_became_peered":"2024-09-12T18:35:25.661441+0000","last_unstale":"2024-09-12T18:36:01.456837+0000","last_undegraded":"2024-09-12T18:36:01.456837+0000","last_fullsized":"2024-09-12T18:36:01.456837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:14.397867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457447+0000","last_change":"2024-09-12T18:35:24.657635+0000","last_active":"2024-09-12T18:36:01.457447+0000","last_peered":"2024-09-12T18:36:01.457447+0000","last_clean":"2024-09-12T18:36:01.457447+0000","last_became_active":"2024-09-12T18:35:24.655992+0000","last_became_peered":"2024-09-12T18:35:24.655992+0000","last_unstale":"2024-09-12T18:36:01.457447+0000","last_undegraded":"2024-09-12T18:36:01.457447+0000","last_fullsized":"2024-09-12T18:36:01.457447+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:33.536755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457644+0000","last_change":"2024-09-12T18:35:25.651406+0000","last_active":"2024-09-12T18:36:01.457644+0000","last_peered":"2024-09-12T18:36:01.457644+0000","last_clean":"2024-09-12T18:36:01.457644+0000","last_became_active":"2024-09-12T18:35:25.649728+0000","last_became_peered":"2024-09-12T18:35:25.649728+0000","last_unstale":"2024-09-12T18:36:01.457644+0000","last_undegraded":"2024-09-12T18:36:01.457644+0000","last_fullsized":"2024-09-12T18:36:01.457644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:41.773283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468282+0000","last_change":"2024-09-12T18:35:24.649153+0000","last_active":"2024-09-12T18:36:03.468282+0000","last_peered":"2024-09-12T18:36:03.468282+0000","last_clean":"2024-09-12T18:36:03.468282+0000","last_became_active":"2024-09-12T18:35:24.648512+0000","last_became_peered":"2024-09-12T18:35:24.648512+0000","last_unstale":"2024-09-12T18:36:03.468282+0000","last_undegraded":"2024-09-12T18:36:03.468282+0000","last_fullsized":"2024-09-12T18:36:03.468282+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:07.810456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.467850+0000","last_change":"2024-09-12T18:35:25.656799+0000","last_active":"2024-09-12T18:36:03.467850+0000","last_peered":"2024-09-12T18:36:03.467850+0000","last_clean":"2024-09-12T18:36:03.467850+0000","last_became_active":"2024-09-12T18:35:25.654980+0000","last_became_peered":"2024-09-12T18:35:25.654980+0000","last_unstale":"2024-09-12T18:36:03.467850+0000","last_undegraded":"2024-09-12T18:36:03.467850+0000","last_fullsized":"2024-09-12T18:36:03.467850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:10.735439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458749+0000","last_change":"2024-09-12T18:35:24.656268+0000","last_active":"2024-09-12T18:36:01.458749+0000","last_peered":"2024-09-12T18:36:01.458749+0000","last_clean":"2024-09-12T18:36:01.458749+0000","last_became_active":"2024-09-12T18:35:24.655420+0000","last_became_peered":"2024-09-12T18:35:24.655420+0000","last_unstale":"2024-09-12T18:36:01.458749+0000","last_undegraded":"2024-09-12T18:36:01.458749+0000","last_fullsized":"2024-09-12T18:36:01.458749+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:04.654666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457205+0000","last_change":"2024-09-12T18:35:25.661042+0000","last_active":"2024-09-12T18:36:01.457205+0000","last_peered":"2024-09-12T18:36:01.457205+0000","last_clean":"2024-09-12T18:36:01.457205+0000","last_became_active":"2024-09-12T18:35:25.660163+0000","last_became_peered":"2024-09-12T18:35:25.660163+0000","last_unstale":"2024-09-12T18:36:01.457205+0000","last_undegraded":"2024-09-12T18:36:01.457205+0000","last_fullsized":"2024-09-12T18:36:01.457205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:37.682184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458405+0000","last_change":"2024-09-12T18:35:24.652304+0000","last_active":"2024-09-12T18:36:01.458405+0000","last_peered":"2024-09-12T18:36:01.458405+0000","last_clean":"2024-09-12T18:36:01.458405+0000","last_became_active":"2024-09-12T18:35:24.651460+0000","last_became_peered":"2024-09-12T18:35:24.651460+0000","last_unstale":"2024-09-12T18:36:01.458405+0000","last_undegraded":"2024-09-12T18:36:01.458405+0000","last_fullsized":"2024-09-12T18:36:01.458405+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:42.050557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":3015442432,"num_objects":46012,"num_object_clones":0,"num_object_copies":92024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46012,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46012,"num_write_kb":2944768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":373264384,"data_stored":5972230144,"data_compressed":283591221,"data_compressed_allocated":373264384,"data_compressed_original":5972230144,"omap_allocated":0,"internal_metadata":0},"log_size":46012,"ondisk_log_size":46012,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705677,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":165392,"kb_used_data":107832,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94206448,"statfs":{"total":96636764160,"available":96467402752,"internally_reserved":0,"allocated":110419968,"data_stored":1760877616,"data_compressed":83616205,"data_compressed_allocated":110055424,"data_compressed_original":1760739328,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,1,3,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738381,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":163976,"kb_used_data":110584,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94207864,"statfs":{"total":96636764160,"available":96468852736,"internally_reserved":0,"allocated":113238016,"data_stored":1806154465,"data_compressed":85766509,"data_compressed_allocated":112885760,"data_compressed_original":1806024704,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738381,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":213288,"kb_used_data":141848,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94158552,"statfs":{"total":96636764160,"available":96418357248,"internally_reserved":0,"allocated":145252352,"data_stored":2319233471,"data_compressed":110123431,"data_compressed_allocated":144945152,"data_compressed_original":2319122432,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,2,1,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":146882560,"data_stored":2350120960,"data_compressed":111595407,"data_compressed_allocated":146882560,"data_compressed_original":2350120960,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":112922624,"data_stored":1806761984,"data_compressed":85794115,"data_compressed_allocated":112922624,"data_compressed_original":1806761984,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":113459200,"data_stored":1815347200,"data_compressed":86201699,"data_compressed_allocated":113459200,"data_compressed_original":1815347200,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:36:04.866 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:36:04.867 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:36:04.870 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 19 16 52229 52213 171.735 144.188 0.00539367 0.00581711 2024-09-12T18:36:04.897 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:04.893+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:04.998 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:04.993+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:05.020 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:36:05.020 INFO:teuthology.orchestra.run.smithi162.stdout: "size": 20, 2024-09-12T18:36:05.020 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 600, 2024-09-12T18:36:05.020 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:36:05.020 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.020 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4154.0:123 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:36:05.020 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:36:05.020 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 51.041315998999998, 2024-09-12T18:36:05.020 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.022398096999999999, 2024-09-12T18:36:05.020 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:05.021 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:05.021 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:05.021 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:05.021 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4154", 2024-09-12T18:36:05.022 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/745129001", 2024-09-12T18:36:05.022 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 123 2024-09-12T18:36:05.022 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.022 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:05.022 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.022 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:05.022 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:36:05.022 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:05.023 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.023 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.023 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:05.023 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:36:05.023 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:05.023 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.023 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.024 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:05.024 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:36:05.024 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.8299999999999996e-07 2024-09-12T18:36:05.024 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.024 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.024 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:05.024 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976528+0000", 2024-09-12T18:36:05.024 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011393299999999999 2024-09-12T18:36:05.025 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.025 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.025 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:05.025 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976539+0000", 2024-09-12T18:36:05.025 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0763e-05 2024-09-12T18:36:05.025 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.025 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.025 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:05.025 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976547+0000", 2024-09-12T18:36:05.025 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8199999999999997e-06 2024-09-12T18:36:05.025 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.025 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.025 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:05.026 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.995057+0000", 2024-09-12T18:36:05.026 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.018510047000000002 2024-09-12T18:36:05.026 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.026 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.026 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:05.026 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.995301+0000", 2024-09-12T18:36:05.026 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00024375899999999999 2024-09-12T18:36:05.026 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.026 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.026 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:05.026 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.995642+0000", 2024-09-12T18:36:05.026 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00034121100000000001 2024-09-12T18:36:05.026 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.027 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.027 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:05.027 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998179+0000", 2024-09-12T18:36:05.027 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00253761 2024-09-12T18:36:05.027 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.027 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.027 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:05.027 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998665+0000", 2024-09-12T18:36:05.027 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00048574600000000001 2024-09-12T18:36:05.027 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.027 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.027 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:05.027 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998739+0000", 2024-09-12T18:36:05.028 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.4286e-05 2024-09-12T18:36:05.028 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.028 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.028 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:05.028 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998812+0000", 2024-09-12T18:36:05.028 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2238999999999997e-05 2024-09-12T18:36:05.028 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:05.028 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:05.028 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:05.028 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.029 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.029 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4154.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:36:05.029 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:36:05.029 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 51.041168767000002, 2024-09-12T18:36:05.029 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025950709999999998, 2024-09-12T18:36:05.029 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:05.029 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:05.029 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:05.029 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:05.029 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4154", 2024-09-12T18:36:05.029 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/745129001", 2024-09-12T18:36:05.029 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 124 2024-09-12T18:36:05.029 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.030 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:05.030 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.030 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:05.030 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:36:05.030 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:05.030 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.030 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.030 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:05.030 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:36:05.030 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:05.030 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.030 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.030 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:05.030 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976562+0000", 2024-09-12T18:36:05.031 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.2999999999999999e-07 2024-09-12T18:36:05.031 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.031 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.031 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:05.031 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976567+0000", 2024-09-12T18:36:05.031 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3430000000000003e-06 2024-09-12T18:36:05.031 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.031 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.031 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:05.031 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976576+0000", 2024-09-12T18:36:05.031 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8070000000000006e-06 2024-09-12T18:36:05.031 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.031 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.032 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:05.032 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976583+0000", 2024-09-12T18:36:05.032 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9959999999999996e-06 2024-09-12T18:36:05.032 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.032 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.032 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:05.032 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997107+0000", 2024-09-12T18:36:05.032 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.020524106 2024-09-12T18:36:05.032 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.032 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.032 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:05.032 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997225+0000", 2024-09-12T18:36:05.032 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000117909 2024-09-12T18:36:05.033 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.033 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.033 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:05.033 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997407+0000", 2024-09-12T18:36:05.033 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00018175900000000001 2024-09-12T18:36:05.033 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.033 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.033 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:05.033 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998839+0000", 2024-09-12T18:36:05.033 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001432539 2024-09-12T18:36:05.033 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.033 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.033 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:05.034 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002319+0000", 2024-09-12T18:36:05.034 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0034803529999999998 2024-09-12T18:36:05.034 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.034 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.034 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:05.034 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002405+0000", 2024-09-12T18:36:05.034 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5434999999999998e-05 2024-09-12T18:36:05.034 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.034 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.034 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:05.034 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002512+0000", 2024-09-12T18:36:05.034 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010663299999999999 2024-09-12T18:36:05.034 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:05.034 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:05.035 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:05.035 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.035 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.035 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:05.035 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:36:05.035 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 39.376371259999999, 2024-09-12T18:36:05.035 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025127867000000002, 2024-09-12T18:36:05.035 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:05.035 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:05.035 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:05.035 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:05.035 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.035 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:05.035 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:36:05.036 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:05.036 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.036 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.036 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:05.036 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:36:05.036 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:05.036 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.036 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.036 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:05.036 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641362+0000", 2024-09-12T18:36:05.036 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.2569999999999999e-06 2024-09-12T18:36:05.036 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.037 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.037 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:05.037 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641374+0000", 2024-09-12T18:36:05.037 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2696e-05 2024-09-12T18:36:05.037 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.037 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.037 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:05.037 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641403+0000", 2024-09-12T18:36:05.037 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.8756999999999999e-05 2024-09-12T18:36:05.037 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.037 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.037 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:05.037 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641430+0000", 2024-09-12T18:36:05.038 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.6452999999999999e-05 2024-09-12T18:36:05.038 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.038 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.038 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:05.038 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641585+0000", 2024-09-12T18:36:05.038 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000155799 2024-09-12T18:36:05.038 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.038 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.038 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:05.038 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641753+0000", 2024-09-12T18:36:05.038 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000167868 2024-09-12T18:36:05.038 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.038 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.038 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:05.039 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641916+0000", 2024-09-12T18:36:05.039 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000162903 2024-09-12T18:36:05.039 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.039 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.039 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:05.039 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653655+0000", 2024-09-12T18:36:05.039 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011738879000000001 2024-09-12T18:36:05.039 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.039 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.039 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:05.039 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665515+0000", 2024-09-12T18:36:05.039 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011859915 2024-09-12T18:36:05.039 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.040 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.040 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:05.040 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665646+0000", 2024-09-12T18:36:05.040 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013122599999999999 2024-09-12T18:36:05.040 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.040 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.040 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:05.040 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666486+0000", 2024-09-12T18:36:05.040 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00084011399999999999 2024-09-12T18:36:05.040 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:05.040 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:05.040 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:05.040 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.041 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.041 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:05.041 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:36:05.041 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 39.376256797000003, 2024-09-12T18:36:05.041 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025384584000000002, 2024-09-12T18:36:05.041 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:05.041 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:05.041 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:05.041 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:05.041 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.041 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:05.041 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:36:05.041 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:05.041 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.042 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.042 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:05.042 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:36:05.042 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:05.042 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.042 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.042 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:05.042 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641474+0000", 2024-09-12T18:36:05.042 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.39e-06 2024-09-12T18:36:05.042 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.042 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.042 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:05.042 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641482+0000", 2024-09-12T18:36:05.043 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3499999999999999e-06 2024-09-12T18:36:05.043 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.043 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.043 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:05.043 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641534+0000", 2024-09-12T18:36:05.043 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2533e-05 2024-09-12T18:36:05.043 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.043 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.043 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:05.043 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641551+0000", 2024-09-12T18:36:05.043 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6515999999999999e-05 2024-09-12T18:36:05.043 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.044 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.044 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:05.044 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642630+0000", 2024-09-12T18:36:05.044 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001079705 2024-09-12T18:36:05.044 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.044 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.044 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:05.044 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642909+0000", 2024-09-12T18:36:05.044 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027859800000000002 2024-09-12T18:36:05.044 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.044 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.044 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:05.044 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643137+0000", 2024-09-12T18:36:05.045 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022803799999999999 2024-09-12T18:36:05.045 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.045 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.045 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:05.045 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653669+0000", 2024-09-12T18:36:05.045 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010532032 2024-09-12T18:36:05.045 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.045 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.045 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:05.045 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666624+0000", 2024-09-12T18:36:05.045 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012954940999999999 2024-09-12T18:36:05.045 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.045 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.045 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:05.046 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666762+0000", 2024-09-12T18:36:05.046 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000137668 2024-09-12T18:36:05.046 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.046 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.046 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:05.046 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666857+0000", 2024-09-12T18:36:05.046 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.5812999999999999e-05 2024-09-12T18:36:05.046 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:05.046 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:05.046 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:05.046 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.046 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.046 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:05.047 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:36:05.047 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 39.376129001999999, 2024-09-12T18:36:05.047 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025661562999999998, 2024-09-12T18:36:05.047 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:05.047 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:05.047 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:05.047 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:05.047 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.047 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:05.047 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:36:05.047 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:05.047 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.048 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.048 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:05.048 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:36:05.048 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:05.048 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.048 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.048 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:05.048 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641602+0000", 2024-09-12T18:36:05.048 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3540000000000001e-06 2024-09-12T18:36:05.048 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.048 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.048 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:05.048 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641637+0000", 2024-09-12T18:36:05.048 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5145999999999999e-05 2024-09-12T18:36:05.049 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.049 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.049 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:05.049 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641659+0000", 2024-09-12T18:36:05.049 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2249999999999999e-05 2024-09-12T18:36:05.049 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.049 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.049 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:05.049 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641675+0000", 2024-09-12T18:36:05.049 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6059999999999999e-05 2024-09-12T18:36:05.049 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.049 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.049 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:05.050 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644570+0000", 2024-09-12T18:36:05.050 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028947069999999998 2024-09-12T18:36:05.050 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.050 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.050 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:05.050 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644900+0000", 2024-09-12T18:36:05.050 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000329401 2024-09-12T18:36:05.050 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.050 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.050 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:05.050 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645235+0000", 2024-09-12T18:36:05.050 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000335874 2024-09-12T18:36:05.050 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.050 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.051 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:05.051 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655459+0000", 2024-09-12T18:36:05.051 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010223441999999999 2024-09-12T18:36:05.051 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.051 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.051 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:05.051 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667028+0000", 2024-09-12T18:36:05.051 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011568673999999999 2024-09-12T18:36:05.051 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.051 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.051 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:05.051 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667163+0000", 2024-09-12T18:36:05.051 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013525500000000001 2024-09-12T18:36:05.051 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.052 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.052 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:05.052 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667262+0000", 2024-09-12T18:36:05.052 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9400000000000004e-05 2024-09-12T18:36:05.052 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:05.052 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:05.052 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:05.052 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.052 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.052 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:05.052 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:36:05.052 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 39.376027182000001, 2024-09-12T18:36:05.052 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025971339, 2024-09-12T18:36:05.053 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:05.053 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:05.053 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:05.053 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:05.053 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.053 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:05.053 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:36:05.053 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:05.053 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.053 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.053 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:05.053 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:36:05.053 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:05.054 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.054 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.054 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:05.054 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641704+0000", 2024-09-12T18:36:05.054 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.297e-06 2024-09-12T18:36:05.054 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.054 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.054 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:05.054 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641712+0000", 2024-09-12T18:36:05.054 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.9060000000000002e-06 2024-09-12T18:36:05.054 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.054 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.054 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:05.054 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641731+0000", 2024-09-12T18:36:05.055 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9083e-05 2024-09-12T18:36:05.055 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.055 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.055 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:05.055 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641745+0000", 2024-09-12T18:36:05.055 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4066999999999999e-05 2024-09-12T18:36:05.055 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.055 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.055 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:05.055 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646529+0000", 2024-09-12T18:36:05.055 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.004784033 2024-09-12T18:36:05.055 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.055 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.055 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:05.056 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646727+0000", 2024-09-12T18:36:05.056 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019841800000000001 2024-09-12T18:36:05.056 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.056 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.056 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:05.056 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647057+0000", 2024-09-12T18:36:05.056 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032926800000000002 2024-09-12T18:36:05.056 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.056 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.056 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:05.056 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655475+0000", 2024-09-12T18:36:05.056 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0084186250000000008 2024-09-12T18:36:05.056 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.057 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.057 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:05.057 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667424+0000", 2024-09-12T18:36:05.057 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011949257 2024-09-12T18:36:05.057 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.057 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.057 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:05.057 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667573+0000", 2024-09-12T18:36:05.057 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014851900000000001 2024-09-12T18:36:05.057 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.057 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.057 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:05.057 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667674+0000", 2024-09-12T18:36:05.057 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010086600000000001 2024-09-12T18:36:05.058 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:05.058 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:05.058 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:05.058 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.058 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.058 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:05.058 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:36:05.058 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 39.375964793000001, 2024-09-12T18:36:05.058 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026215008000000001, 2024-09-12T18:36:05.058 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:05.058 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:05.058 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:05.058 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:05.059 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.059 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:05.059 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:36:05.059 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:05.059 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.059 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.059 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:05.059 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:36:05.059 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:05.059 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.059 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.059 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:05.059 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641766+0000", 2024-09-12T18:36:05.059 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1200000000000001e-06 2024-09-12T18:36:05.060 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.060 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.060 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:05.060 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641775+0000", 2024-09-12T18:36:05.060 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.2499999999999995e-06 2024-09-12T18:36:05.060 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.060 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.060 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:05.060 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641793+0000", 2024-09-12T18:36:05.060 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7773000000000001e-05 2024-09-12T18:36:05.060 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.060 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.061 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:05.061 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641807+0000", 2024-09-12T18:36:05.061 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3814e-05 2024-09-12T18:36:05.061 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.061 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.061 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:05.061 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647626+0000", 2024-09-12T18:36:05.061 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0058193050000000003 2024-09-12T18:36:05.061 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.061 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.061 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:05.061 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647937+0000", 2024-09-12T18:36:05.061 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031112400000000003 2024-09-12T18:36:05.061 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.062 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.062 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:05.062 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648239+0000", 2024-09-12T18:36:05.062 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00030227500000000002 2024-09-12T18:36:05.062 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.062 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.062 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:05.062 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655487+0000", 2024-09-12T18:36:05.062 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072479129999999999 2024-09-12T18:36:05.062 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.062 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.062 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:05.062 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667823+0000", 2024-09-12T18:36:05.062 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012335505 2024-09-12T18:36:05.063 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.063 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.063 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:05.063 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667908+0000", 2024-09-12T18:36:05.063 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4843000000000001e-05 2024-09-12T18:36:05.063 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.063 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.063 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:05.063 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667980+0000", 2024-09-12T18:36:05.063 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2086000000000001e-05 2024-09-12T18:36:05.063 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:05.063 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:05.063 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:05.063 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.064 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.064 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:05.064 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:36:05.064 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 39.375904640000002, 2024-09-12T18:36:05.064 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026483236, 2024-09-12T18:36:05.064 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:05.064 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:05.064 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:05.064 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:05.064 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.064 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:05.064 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:36:05.064 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:05.065 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.065 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.065 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:05.065 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:36:05.065 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:05.065 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.065 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.065 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:05.065 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641826+0000", 2024-09-12T18:36:05.065 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:36:05.065 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.065 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.065 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:05.066 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641832+0000", 2024-09-12T18:36:05.066 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4199999999999998e-06 2024-09-12T18:36:05.066 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.066 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.066 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:05.066 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641848+0000", 2024-09-12T18:36:05.066 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6492999999999999e-05 2024-09-12T18:36:05.066 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.066 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.066 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:05.066 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641863+0000", 2024-09-12T18:36:05.066 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5427e-05 2024-09-12T18:36:05.066 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.067 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.067 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:05.067 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648887+0000", 2024-09-12T18:36:05.067 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0070230860000000004 2024-09-12T18:36:05.067 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.067 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.067 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:05.067 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649111+0000", 2024-09-12T18:36:05.067 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022425799999999999 2024-09-12T18:36:05.067 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.067 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.067 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:05.067 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649494+0000", 2024-09-12T18:36:05.067 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00038349400000000001 2024-09-12T18:36:05.068 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.068 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.068 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:05.068 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655499+0000", 2024-09-12T18:36:05.068 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0060047260000000002 2024-09-12T18:36:05.068 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.068 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.068 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:05.068 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668110+0000", 2024-09-12T18:36:05.068 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012610543 2024-09-12T18:36:05.068 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.068 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.068 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:05.069 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668252+0000", 2024-09-12T18:36:05.069 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014265600000000001 2024-09-12T18:36:05.069 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.069 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.069 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:05.069 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668308+0000", 2024-09-12T18:36:05.069 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5992999999999997e-05 2024-09-12T18:36:05.069 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:05.069 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:05.069 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:05.069 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.069 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.069 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:05.069 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:36:05.070 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 39.375849424000002, 2024-09-12T18:36:05.070 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026605302000000001, 2024-09-12T18:36:05.070 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:05.070 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:05.070 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:05.070 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:05.070 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.070 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:05.070 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:36:05.070 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:05.070 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.070 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.070 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:05.071 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:36:05.071 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:05.071 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.071 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.071 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:05.071 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641881+0000", 2024-09-12T18:36:05.071 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.057e-06 2024-09-12T18:36:05.071 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.071 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.071 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:05.071 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641887+0000", 2024-09-12T18:36:05.071 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.6629999999999998e-06 2024-09-12T18:36:05.071 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.072 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.072 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:05.072 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641903+0000", 2024-09-12T18:36:05.072 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6317e-05 2024-09-12T18:36:05.072 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.072 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.072 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:05.072 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641917+0000", 2024-09-12T18:36:05.072 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3339999999999999e-05 2024-09-12T18:36:05.072 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.072 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.072 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:05.072 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650708+0000", 2024-09-12T18:36:05.073 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.008791419 2024-09-12T18:36:05.073 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.073 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.073 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:05.073 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651021+0000", 2024-09-12T18:36:05.073 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031296699999999999 2024-09-12T18:36:05.073 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.073 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.073 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:05.073 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651349+0000", 2024-09-12T18:36:05.073 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032796499999999999 2024-09-12T18:36:05.073 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.073 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.074 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:05.074 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655742+0000", 2024-09-12T18:36:05.074 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0043934680000000002 2024-09-12T18:36:05.074 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.074 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.074 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:05.074 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668377+0000", 2024-09-12T18:36:05.074 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012634312999999999 2024-09-12T18:36:05.074 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.074 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.074 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:05.074 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668441+0000", 2024-09-12T18:36:05.074 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4369999999999995e-05 2024-09-12T18:36:05.074 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.075 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.075 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:05.075 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668485+0000", 2024-09-12T18:36:05.075 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4422999999999998e-05 2024-09-12T18:36:05.075 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:05.075 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:05.075 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:05.075 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.075 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.076 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:05.076 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:36:05.076 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 39.375792021000002, 2024-09-12T18:36:05.076 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026919499, 2024-09-12T18:36:05.076 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:05.076 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:05.076 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:05.076 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:05.076 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.076 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:05.076 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:36:05.076 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:05.077 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.077 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.077 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:05.077 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:36:05.077 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:05.077 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.077 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.077 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:05.077 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641939+0000", 2024-09-12T18:36:05.077 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9399999999999993e-07 2024-09-12T18:36:05.077 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.077 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.077 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:05.078 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641945+0000", 2024-09-12T18:36:05.078 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9200000000000001e-06 2024-09-12T18:36:05.078 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.078 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.078 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:05.078 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641961+0000", 2024-09-12T18:36:05.078 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6520000000000001e-05 2024-09-12T18:36:05.078 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.078 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.078 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:05.078 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641974+0000", 2024-09-12T18:36:05.078 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3413e-05 2024-09-12T18:36:05.078 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.079 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.079 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:05.079 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654560+0000", 2024-09-12T18:36:05.079 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012585308999999999 2024-09-12T18:36:05.079 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.079 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.079 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:05.079 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654822+0000", 2024-09-12T18:36:05.079 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026210099999999999 2024-09-12T18:36:05.079 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.079 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.079 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:05.079 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655059+0000", 2024-09-12T18:36:05.079 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00023747899999999999 2024-09-12T18:36:05.080 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.080 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.080 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:05.080 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.656315+0000", 2024-09-12T18:36:05.080 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0012555000000000001 2024-09-12T18:36:05.080 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.080 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.080 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:05.080 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668590+0000", 2024-09-12T18:36:05.080 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012274851999999999 2024-09-12T18:36:05.080 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.080 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.081 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:05.081 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668725+0000", 2024-09-12T18:36:05.081 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013524199999999999 2024-09-12T18:36:05.081 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.081 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.081 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:05.081 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668857+0000", 2024-09-12T18:36:05.081 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013216899999999999 2024-09-12T18:36:05.081 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:05.081 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:05.081 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:05.081 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.081 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.082 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:05.082 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:36:05.082 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 39.375738501000001, 2024-09-12T18:36:05.082 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023616723999999999, 2024-09-12T18:36:05.082 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:05.082 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:05.082 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:05.082 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:05.082 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.082 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:05.082 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:36:05.082 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:05.082 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.083 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.083 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:05.083 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:36:05.083 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:05.083 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.083 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.083 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:05.083 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641992+0000", 2024-09-12T18:36:05.083 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.08e-06 2024-09-12T18:36:05.083 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.083 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.083 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:05.083 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641998+0000", 2024-09-12T18:36:05.084 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4299999999999997e-06 2024-09-12T18:36:05.084 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.084 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.084 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:05.084 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642014+0000", 2024-09-12T18:36:05.084 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6266e-05 2024-09-12T18:36:05.084 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.084 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.084 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:05.084 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642026+0000", 2024-09-12T18:36:05.084 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2567e-05 2024-09-12T18:36:05.084 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.084 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.085 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:05.085 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642213+0000", 2024-09-12T18:36:05.085 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00018701899999999999 2024-09-12T18:36:05.085 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.085 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.085 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:05.085 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642507+0000", 2024-09-12T18:36:05.085 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00029394700000000002 2024-09-12T18:36:05.085 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.085 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.085 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:05.085 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642686+0000", 2024-09-12T18:36:05.085 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000178152 2024-09-12T18:36:05.086 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.086 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.086 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:05.086 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650952+0000", 2024-09-12T18:36:05.086 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0082663570000000002 2024-09-12T18:36:05.086 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.086 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.086 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:05.086 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665382+0000", 2024-09-12T18:36:05.086 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.014430111000000001 2024-09-12T18:36:05.086 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.086 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.086 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:05.087 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665508+0000", 2024-09-12T18:36:05.087 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000125986 2024-09-12T18:36:05.087 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.087 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.087 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:05.087 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665608+0000", 2024-09-12T18:36:05.087 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9809000000000006e-05 2024-09-12T18:36:05.087 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:05.087 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:05.087 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:05.087 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.087 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.087 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:05.088 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:36:05.088 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 39.375610635999998, 2024-09-12T18:36:05.088 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024670563, 2024-09-12T18:36:05.088 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:05.088 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:05.088 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:05.088 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:05.088 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.088 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:05.088 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:36:05.088 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:05.088 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.088 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.089 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:05.089 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:36:05.089 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:05.089 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.089 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.089 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:05.089 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642120+0000", 2024-09-12T18:36:05.089 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1769999999999999e-06 2024-09-12T18:36:05.089 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.089 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.089 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:05.089 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642128+0000", 2024-09-12T18:36:05.089 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3429999999999998e-06 2024-09-12T18:36:05.090 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.090 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.090 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:05.090 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642192+0000", 2024-09-12T18:36:05.090 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4406999999999995e-05 2024-09-12T18:36:05.090 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.090 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.090 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:05.090 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642223+0000", 2024-09-12T18:36:05.090 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.1266000000000002e-05 2024-09-12T18:36:05.090 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.090 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.090 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:05.091 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643201+0000", 2024-09-12T18:36:05.091 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0009778390000000001 2024-09-12T18:36:05.091 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.091 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.091 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:05.091 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643410+0000", 2024-09-12T18:36:05.091 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020874199999999999 2024-09-12T18:36:05.091 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.091 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.091 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:05.091 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643685+0000", 2024-09-12T18:36:05.091 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027520700000000002 2024-09-12T18:36:05.091 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.091 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.092 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:05.092 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650966+0000", 2024-09-12T18:36:05.092 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072810710000000001 2024-09-12T18:36:05.092 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.092 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.092 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:05.092 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666560+0000", 2024-09-12T18:36:05.092 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015594143 2024-09-12T18:36:05.092 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.092 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.092 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:05.092 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666691+0000", 2024-09-12T18:36:05.092 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000130359 2024-09-12T18:36:05.093 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.093 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.093 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:05.093 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666790+0000", 2024-09-12T18:36:05.093 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9009e-05 2024-09-12T18:36:05.093 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:05.093 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:05.093 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:05.093 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.093 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.093 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:05.093 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:36:05.093 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 39.374832347999998, 2024-09-12T18:36:05.093 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024891744, 2024-09-12T18:36:05.094 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:05.094 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:05.094 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:05.094 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:05.094 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.094 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:05.094 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:36:05.094 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:05.094 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.094 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.094 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:05.094 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:36:05.094 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:05.095 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.095 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.095 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:05.095 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642899+0000", 2024-09-12T18:36:05.095 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4729999999999999e-06 2024-09-12T18:36:05.095 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.095 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.095 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:05.095 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642912+0000", 2024-09-12T18:36:05.095 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3495999999999999e-05 2024-09-12T18:36:05.095 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.095 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.095 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:05.096 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642934+0000", 2024-09-12T18:36:05.096 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2033999999999999e-05 2024-09-12T18:36:05.096 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.096 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.096 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:05.096 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642949+0000", 2024-09-12T18:36:05.096 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4970000000000001e-05 2024-09-12T18:36:05.096 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.096 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.096 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:05.096 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644400+0000", 2024-09-12T18:36:05.096 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001450305 2024-09-12T18:36:05.096 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.097 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.097 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:05.097 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644617+0000", 2024-09-12T18:36:05.097 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000217302 2024-09-12T18:36:05.097 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.097 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.097 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:05.097 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645052+0000", 2024-09-12T18:36:05.097 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000434797 2024-09-12T18:36:05.097 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.097 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.097 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:05.097 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653860+0000", 2024-09-12T18:36:05.097 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0088082249999999994 2024-09-12T18:36:05.098 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.098 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.098 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:05.098 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667598+0000", 2024-09-12T18:36:05.098 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.013738451 2024-09-12T18:36:05.098 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.098 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.098 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:05.098 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667698+0000", 2024-09-12T18:36:05.098 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9854999999999999e-05 2024-09-12T18:36:05.098 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.098 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.098 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:05.099 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667789+0000", 2024-09-12T18:36:05.099 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0835999999999996e-05 2024-09-12T18:36:05.099 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:05.099 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:05.099 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:05.099 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.099 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.099 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:30 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:05.099 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:36:05.099 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 39.374757531999997, 2024-09-12T18:36:05.099 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023936852000000002, 2024-09-12T18:36:05.099 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:05.099 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:05.099 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:05.100 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:05.100 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.100 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:05.100 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:36:05.100 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:05.100 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.100 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.100 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:05.100 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:36:05.100 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:05.100 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.100 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.100 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:05.101 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642973+0000", 2024-09-12T18:36:05.101 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.11e-06 2024-09-12T18:36:05.101 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.101 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.101 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:05.101 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642994+0000", 2024-09-12T18:36:05.101 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.0699999999999998e-05 2024-09-12T18:36:05.101 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.101 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.101 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:05.101 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643011+0000", 2024-09-12T18:36:05.101 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7229999999999999e-05 2024-09-12T18:36:05.101 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.101 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.102 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:05.102 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643025+0000", 2024-09-12T18:36:05.102 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3803e-05 2024-09-12T18:36:05.102 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.102 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.102 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:05.102 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643143+0000", 2024-09-12T18:36:05.102 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000118225 2024-09-12T18:36:05.102 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.102 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.102 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:05.102 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643426+0000", 2024-09-12T18:36:05.102 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00028250500000000001 2024-09-12T18:36:05.103 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.103 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.103 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:05.103 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643864+0000", 2024-09-12T18:36:05.103 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00043856 2024-09-12T18:36:05.103 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.103 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.103 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:05.103 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651148+0000", 2024-09-12T18:36:05.103 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072836769999999997 2024-09-12T18:36:05.103 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.103 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.103 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:05.103 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666674+0000", 2024-09-12T18:36:05.104 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015525786999999999 2024-09-12T18:36:05.104 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.104 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.104 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:05.104 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666796+0000", 2024-09-12T18:36:05.104 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000122416 2024-09-12T18:36:05.104 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.104 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.104 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:05.104 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666909+0000", 2024-09-12T18:36:05.104 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011283899999999999 2024-09-12T18:36:05.104 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:05.104 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:05.105 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:05.105 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.105 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.105 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:05.105 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:36:05.105 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 39.374674826000003, 2024-09-12T18:36:05.105 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024100234000000002, 2024-09-12T18:36:05.105 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:05.105 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:05.105 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:05.105 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:05.105 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.105 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:05.106 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:36:05.106 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:05.106 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.106 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.106 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:05.106 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:36:05.106 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:05.106 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.106 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.106 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:05.106 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643056+0000", 2024-09-12T18:36:05.106 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.046e-06 2024-09-12T18:36:05.106 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.106 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.107 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:05.107 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643068+0000", 2024-09-12T18:36:05.107 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2106999999999999e-05 2024-09-12T18:36:05.107 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.107 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.107 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:05.107 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643085+0000", 2024-09-12T18:36:05.107 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7479999999999999e-05 2024-09-12T18:36:05.107 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.107 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.107 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:05.107 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643099+0000", 2024-09-12T18:36:05.107 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3730000000000001e-05 2024-09-12T18:36:05.107 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.108 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.108 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:05.108 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644623+0000", 2024-09-12T18:36:05.108 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0015236080000000001 2024-09-12T18:36:05.108 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.108 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.108 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:05.108 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644893+0000", 2024-09-12T18:36:05.108 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026990500000000003 2024-09-12T18:36:05.108 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.108 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.108 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:05.108 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645227+0000", 2024-09-12T18:36:05.109 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00033391300000000003 2024-09-12T18:36:05.109 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.109 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.109 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:05.109 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653926+0000", 2024-09-12T18:36:05.109 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0086993339999999995 2024-09-12T18:36:05.109 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.109 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.109 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:05.109 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666925+0000", 2024-09-12T18:36:05.109 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012998686000000001 2024-09-12T18:36:05.109 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.109 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.109 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:05.110 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667057+0000", 2024-09-12T18:36:05.110 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013255600000000001 2024-09-12T18:36:05.110 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.110 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.110 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:05.110 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667155+0000", 2024-09-12T18:36:05.110 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7868999999999994e-05 2024-09-12T18:36:05.110 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:05.110 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:05.110 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:05.110 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.110 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.110 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:05.110 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643139+0000", 2024-09-12T18:36:05.111 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 39.374590240000003, 2024-09-12T18:36:05.111 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.022417057000000001, 2024-09-12T18:36:05.111 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:05.111 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:05.111 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:05.111 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:05.111 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.111 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:05.111 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643139+0000", 2024-09-12T18:36:05.111 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:05.111 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.111 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.111 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:05.111 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643139+0000", 2024-09-12T18:36:05.112 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:05.112 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.112 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.112 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:05.112 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643140+0000", 2024-09-12T18:36:05.112 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0729999999999999e-06 2024-09-12T18:36:05.112 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.112 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.112 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:05.112 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643151+0000", 2024-09-12T18:36:05.112 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.039e-05 2024-09-12T18:36:05.112 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.112 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.113 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:05.113 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643168+0000", 2024-09-12T18:36:05.113 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7575999999999999e-05 2024-09-12T18:36:05.113 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.113 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.113 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:05.113 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643182+0000", 2024-09-12T18:36:05.113 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3224000000000001e-05 2024-09-12T18:36:05.113 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.113 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.113 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:05.113 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643358+0000", 2024-09-12T18:36:05.113 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00017676500000000001 2024-09-12T18:36:05.114 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.114 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.114 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:05.114 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643647+0000", 2024-09-12T18:36:05.114 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00028850499999999999 2024-09-12T18:36:05.114 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.114 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.114 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:05.114 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643924+0000", 2024-09-12T18:36:05.114 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000277547 2024-09-12T18:36:05.114 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.114 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.114 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:05.114 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650289+0000", 2024-09-12T18:36:05.115 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0063645350000000002 2024-09-12T18:36:05.115 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.115 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.115 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:05.115 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665333+0000", 2024-09-12T18:36:05.115 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015043531000000001 2024-09-12T18:36:05.115 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.115 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.115 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:05.115 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665454+0000", 2024-09-12T18:36:05.115 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000121302 2024-09-12T18:36:05.115 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.115 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.115 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:05.115 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665556+0000", 2024-09-12T18:36:05.116 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010260900000000001 2024-09-12T18:36:05.116 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:05.116 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:05.116 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:05.116 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.116 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.116 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:05.116 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:36:05.116 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 39.374479037, 2024-09-12T18:36:05.116 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024255982999999998, 2024-09-12T18:36:05.116 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:05.116 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:05.116 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:05.117 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:05.117 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.117 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:05.117 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:36:05.117 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:05.117 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.117 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.117 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:05.117 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:36:05.117 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:05.117 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.117 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.117 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:05.118 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643252+0000", 2024-09-12T18:36:05.118 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:05.118 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.118 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.118 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:05.118 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643287+0000", 2024-09-12T18:36:05.118 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5225999999999998e-05 2024-09-12T18:36:05.118 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.118 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.118 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:05.118 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643323+0000", 2024-09-12T18:36:05.118 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5488999999999999e-05 2024-09-12T18:36:05.118 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.119 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.119 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:05.119 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643357+0000", 2024-09-12T18:36:05.119 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.3853999999999998e-05 2024-09-12T18:36:05.119 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.119 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.119 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:05.119 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646716+0000", 2024-09-12T18:36:05.119 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003359 2024-09-12T18:36:05.119 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.119 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.119 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:05.119 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647037+0000", 2024-09-12T18:36:05.120 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032131800000000002 2024-09-12T18:36:05.120 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.120 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.120 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:05.120 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647337+0000", 2024-09-12T18:36:05.120 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000300208 2024-09-12T18:36:05.120 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.120 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.120 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:05.120 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654291+0000", 2024-09-12T18:36:05.120 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0069543089999999997 2024-09-12T18:36:05.120 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.120 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.121 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:05.121 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667297+0000", 2024-09-12T18:36:05.121 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.013005526 2024-09-12T18:36:05.121 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.121 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.121 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:05.121 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667416+0000", 2024-09-12T18:36:05.121 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000119416 2024-09-12T18:36:05.121 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.121 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.121 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:05.121 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667507+0000", 2024-09-12T18:36:05.121 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0206999999999999e-05 2024-09-12T18:36:05.122 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:05.122 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:05.122 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:05.122 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.122 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.122 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:05.122 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:36:05.122 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 39.374351941999997, 2024-09-12T18:36:05.122 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023888482999999999, 2024-09-12T18:36:05.122 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:05.122 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:05.122 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:05.122 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:05.122 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.123 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:05.123 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:36:05.123 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:05.123 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.123 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.123 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:05.123 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:36:05.123 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:05.123 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.123 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.123 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:05.123 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643379+0000", 2024-09-12T18:36:05.124 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.207e-06 2024-09-12T18:36:05.124 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.124 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.124 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:05.124 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643390+0000", 2024-09-12T18:36:05.124 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0696000000000001e-05 2024-09-12T18:36:05.124 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.124 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.124 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:05.124 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643407+0000", 2024-09-12T18:36:05.124 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7563000000000001e-05 2024-09-12T18:36:05.124 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.124 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.124 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:05.125 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643420+0000", 2024-09-12T18:36:05.125 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3277e-05 2024-09-12T18:36:05.125 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.125 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.125 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:05.125 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644906+0000", 2024-09-12T18:36:05.125 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001485945 2024-09-12T18:36:05.125 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.125 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.125 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:05.125 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645404+0000", 2024-09-12T18:36:05.125 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00049807599999999997 2024-09-12T18:36:05.125 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.126 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.126 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:05.126 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645846+0000", 2024-09-12T18:36:05.126 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00044190400000000002 2024-09-12T18:36:05.126 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.126 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.126 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:05.126 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654223+0000", 2024-09-12T18:36:05.126 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0083767419999999995 2024-09-12T18:36:05.126 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.126 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.126 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:05.126 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667026+0000", 2024-09-12T18:36:05.126 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012802531000000001 2024-09-12T18:36:05.127 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.127 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.127 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:05.127 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667162+0000", 2024-09-12T18:36:05.127 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000136112 2024-09-12T18:36:05.127 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.127 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.127 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:05.127 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667266+0000", 2024-09-12T18:36:05.127 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010443 2024-09-12T18:36:05.127 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:05.127 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:05.127 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:05.128 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.128 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.128 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:05.128 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643447+0000", 2024-09-12T18:36:05.128 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 39.374282416, 2024-09-12T18:36:05.128 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.022081562999999998, 2024-09-12T18:36:05.128 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:05.128 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:05.128 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:05.128 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:05.128 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.128 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:05.128 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643447+0000", 2024-09-12T18:36:05.128 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:05.129 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.129 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.129 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:05.129 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643447+0000", 2024-09-12T18:36:05.129 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:05.129 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.129 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.129 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:05.129 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643448+0000", 2024-09-12T18:36:05.129 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1629999999999999e-06 2024-09-12T18:36:05.129 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.129 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.129 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:05.130 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643458+0000", 2024-09-12T18:36:05.130 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.8400000000000007e-06 2024-09-12T18:36:05.130 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.130 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.130 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:05.130 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643475+0000", 2024-09-12T18:36:05.130 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6874000000000001e-05 2024-09-12T18:36:05.130 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.130 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.130 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:05.130 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643488+0000", 2024-09-12T18:36:05.130 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3026e-05 2024-09-12T18:36:05.130 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.131 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.131 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:05.131 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643931+0000", 2024-09-12T18:36:05.131 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00044307 2024-09-12T18:36:05.131 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.131 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.131 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:05.131 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644210+0000", 2024-09-12T18:36:05.131 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027908400000000003 2024-09-12T18:36:05.131 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.131 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.131 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:05.132 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644606+0000", 2024-09-12T18:36:05.132 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00039615400000000002 2024-09-12T18:36:05.132 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.132 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.132 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:05.132 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650552+0000", 2024-09-12T18:36:05.132 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0059455619999999997 2024-09-12T18:36:05.132 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.132 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.132 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:05.132 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665302+0000", 2024-09-12T18:36:05.132 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.014749962 2024-09-12T18:36:05.132 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.133 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.133 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:05.133 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665424+0000", 2024-09-12T18:36:05.133 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012214300000000001 2024-09-12T18:36:05.133 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.133 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.133 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:05.133 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665529+0000", 2024-09-12T18:36:05.133 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000104685 2024-09-12T18:36:05.133 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:05.133 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:05.133 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:05.133 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.133 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.134 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:05.134 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:36:05.134 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 39.374201223, 2024-09-12T18:36:05.134 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024222582999999999, 2024-09-12T18:36:05.134 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:05.134 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:05.134 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:05.134 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:05.134 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.134 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:05.134 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:36:05.134 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:05.134 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.134 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.135 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:05.135 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:36:05.135 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:05.135 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.135 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.135 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:05.135 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643530+0000", 2024-09-12T18:36:05.135 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.393e-06 2024-09-12T18:36:05.135 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.135 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.135 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:05.135 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643536+0000", 2024-09-12T18:36:05.135 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4130000000000003e-06 2024-09-12T18:36:05.136 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.136 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.136 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:05.136 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643554+0000", 2024-09-12T18:36:05.136 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7572999999999999e-05 2024-09-12T18:36:05.136 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.136 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.136 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:05.136 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643567+0000", 2024-09-12T18:36:05.136 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3393999999999999e-05 2024-09-12T18:36:05.136 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.136 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.136 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:05.136 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648198+0000", 2024-09-12T18:36:05.137 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0046304479999999997 2024-09-12T18:36:05.137 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.137 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.137 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:05.137 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648413+0000", 2024-09-12T18:36:05.137 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00021507500000000001 2024-09-12T18:36:05.137 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:05.137 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:05.137 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:05.137 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667751+0000", 2024-09-12T18:36:05.137 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.019338286999999999 2024-09-12T18:36:05.137 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:05.137 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:05.139 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:05.140 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:05.140 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:05.140 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:36:05.141 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:05.136+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:05.142 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:36:05.182 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:36:05.184 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T18:36:05.199 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-09-12T18:36:04.476503+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3016035229,"num_objects":46038,"num_object_clones":0,"num_object_copies":92076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46038,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":46204,"num_write_kb":2947456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46166,"ondisk_log_size":46166,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":542656,"kb_used_data":360264,"kb_used_omap":4,"kb_used_meta":182331,"kb_avail":282572864,"statfs":{"total":289910292480,"available":289354612736,"internally_reserved":0,"allocated":368910336,"data_stored":5886265552,"data_compressed":279506145,"data_compressed_allocated":367886336,"data_compressed_original":5885886464,"omap_allocated":4783,"internal_metadata":186707281},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,2,2,6,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":802291712,"num_objects":12242,"num_object_clones":0,"num_object_copies":24484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12242,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12242,"num_write_kb":783488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.090413"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468430+0000","last_change":"2024-09-12T18:35:25.657389+0000","last_active":"2024-09-12T18:36:03.468430+0000","last_peered":"2024-09-12T18:36:03.468430+0000","last_clean":"2024-09-12T18:36:03.468430+0000","last_became_active":"2024-09-12T18:35:25.651857+0000","last_became_peered":"2024-09-12T18:35:25.651857+0000","last_unstale":"2024-09-12T18:36:03.468430+0000","last_undegraded":"2024-09-12T18:36:03.468430+0000","last_fullsized":"2024-09-12T18:36:03.468430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:50.264536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468079+0000","last_change":"2024-09-12T18:35:25.659760+0000","last_active":"2024-09-12T18:36:03.468079+0000","last_peered":"2024-09-12T18:36:03.468079+0000","last_clean":"2024-09-12T18:36:03.468079+0000","last_became_active":"2024-09-12T18:35:25.654920+0000","last_became_peered":"2024-09-12T18:35:25.654920+0000","last_unstale":"2024-09-12T18:36:03.468079+0000","last_undegraded":"2024-09-12T18:36:03.468079+0000","last_fullsized":"2024-09-12T18:36:03.468079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:21.519881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457502+0000","last_change":"2024-09-12T18:35:25.659460+0000","last_active":"2024-09-12T18:36:01.457502+0000","last_peered":"2024-09-12T18:36:01.457502+0000","last_clean":"2024-09-12T18:36:01.457502+0000","last_became_active":"2024-09-12T18:35:25.657782+0000","last_became_peered":"2024-09-12T18:35:25.657782+0000","last_unstale":"2024-09-12T18:36:01.457502+0000","last_undegraded":"2024-09-12T18:36:01.457502+0000","last_fullsized":"2024-09-12T18:36:01.457502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:38.544284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457143+0000","last_change":"2024-09-12T18:35:25.663617+0000","last_active":"2024-09-12T18:36:01.457143+0000","last_peered":"2024-09-12T18:36:01.457143+0000","last_clean":"2024-09-12T18:36:01.457143+0000","last_became_active":"2024-09-12T18:35:25.661977+0000","last_became_peered":"2024-09-12T18:35:25.661977+0000","last_unstale":"2024-09-12T18:36:01.457143+0000","last_undegraded":"2024-09-12T18:36:01.457143+0000","last_fullsized":"2024-09-12T18:36:01.457143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:14.748234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.467891+0000","last_change":"2024-09-12T18:35:25.656566+0000","last_active":"2024-09-12T18:36:03.467891+0000","last_peered":"2024-09-12T18:36:03.467891+0000","last_clean":"2024-09-12T18:36:03.467891+0000","last_became_active":"2024-09-12T18:35:25.654898+0000","last_became_peered":"2024-09-12T18:35:25.654898+0000","last_unstale":"2024-09-12T18:36:03.467891+0000","last_undegraded":"2024-09-12T18:36:03.467891+0000","last_fullsized":"2024-09-12T18:36:03.467891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:36.113250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.456773+0000","last_change":"2024-09-12T18:35:25.652754+0000","last_active":"2024-09-12T18:36:01.456773+0000","last_peered":"2024-09-12T18:36:01.456773+0000","last_clean":"2024-09-12T18:36:01.456773+0000","last_became_active":"2024-09-12T18:35:25.651217+0000","last_became_peered":"2024-09-12T18:35:25.651217+0000","last_unstale":"2024-09-12T18:36:01.456773+0000","last_undegraded":"2024-09-12T18:36:01.456773+0000","last_fullsized":"2024-09-12T18:36:01.456773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:24.585774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457973+0000","last_change":"2024-09-12T18:35:25.659811+0000","last_active":"2024-09-12T18:36:01.457973+0000","last_peered":"2024-09-12T18:36:01.457973+0000","last_clean":"2024-09-12T18:36:01.457973+0000","last_became_active":"2024-09-12T18:35:25.658998+0000","last_became_peered":"2024-09-12T18:35:25.658998+0000","last_unstale":"2024-09-12T18:36:01.457973+0000","last_undegraded":"2024-09-12T18:36:01.457973+0000","last_fullsized":"2024-09-12T18:36:01.457973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.456620+0000","last_change":"2024-09-12T18:35:25.653999+0000","last_active":"2024-09-12T18:36:01.456620+0000","last_peered":"2024-09-12T18:36:01.456620+0000","last_clean":"2024-09-12T18:36:01.456620+0000","last_became_active":"2024-09-12T18:35:25.653319+0000","last_became_peered":"2024-09-12T18:35:25.653319+0000","last_unstale":"2024-09-12T18:36:01.456620+0000","last_undegraded":"2024-09-12T18:36:01.456620+0000","last_fullsized":"2024-09-12T18:36:01.456620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:04.718000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457931+0000","last_change":"2024-09-12T18:35:25.668339+0000","last_active":"2024-09-12T18:36:01.457931+0000","last_peered":"2024-09-12T18:36:01.457931+0000","last_clean":"2024-09-12T18:36:01.457931+0000","last_became_active":"2024-09-12T18:35:25.667608+0000","last_became_peered":"2024-09-12T18:35:25.667608+0000","last_unstale":"2024-09-12T18:36:01.457931+0000","last_undegraded":"2024-09-12T18:36:01.457931+0000","last_fullsized":"2024-09-12T18:36:01.457931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:15.699745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468417+0000","last_change":"2024-09-12T18:35:25.660174+0000","last_active":"2024-09-12T18:36:03.468417+0000","last_peered":"2024-09-12T18:36:03.468417+0000","last_clean":"2024-09-12T18:36:03.468417+0000","last_became_active":"2024-09-12T18:35:25.656560+0000","last_became_peered":"2024-09-12T18:35:25.656560+0000","last_unstale":"2024-09-12T18:36:03.468417+0000","last_undegraded":"2024-09-12T18:36:03.468417+0000","last_fullsized":"2024-09-12T18:36:03.468417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:47.268505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457557+0000","last_change":"2024-09-12T18:35:25.649858+0000","last_active":"2024-09-12T18:36:01.457557+0000","last_peered":"2024-09-12T18:36:01.457557+0000","last_clean":"2024-09-12T18:36:01.457557+0000","last_became_active":"2024-09-12T18:35:25.649090+0000","last_became_peered":"2024-09-12T18:35:25.649090+0000","last_unstale":"2024-09-12T18:36:01.457557+0000","last_undegraded":"2024-09-12T18:36:01.457557+0000","last_fullsized":"2024-09-12T18:36:01.457557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:33.158421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.467938+0000","last_change":"2024-09-12T18:35:25.649885+0000","last_active":"2024-09-12T18:36:03.467938+0000","last_peered":"2024-09-12T18:36:03.467938+0000","last_clean":"2024-09-12T18:36:03.467938+0000","last_became_active":"2024-09-12T18:35:25.649111+0000","last_became_peered":"2024-09-12T18:35:25.649111+0000","last_unstale":"2024-09-12T18:36:03.467938+0000","last_undegraded":"2024-09-12T18:36:03.467938+0000","last_fullsized":"2024-09-12T18:36:03.467938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:17.162410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468110+0000","last_change":"2024-09-12T18:35:25.651541+0000","last_active":"2024-09-12T18:36:03.468110+0000","last_peered":"2024-09-12T18:36:03.468110+0000","last_clean":"2024-09-12T18:36:03.468110+0000","last_became_active":"2024-09-12T18:35:25.650661+0000","last_became_peered":"2024-09-12T18:35:25.650661+0000","last_unstale":"2024-09-12T18:36:03.468110+0000","last_undegraded":"2024-09-12T18:36:03.468110+0000","last_fullsized":"2024-09-12T18:36:03.468110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:52.082734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.456857+0000","last_change":"2024-09-12T18:35:25.657913+0000","last_active":"2024-09-12T18:36:01.456857+0000","last_peered":"2024-09-12T18:36:01.456857+0000","last_clean":"2024-09-12T18:36:01.456857+0000","last_became_active":"2024-09-12T18:35:25.657082+0000","last_became_peered":"2024-09-12T18:35:25.657082+0000","last_unstale":"2024-09-12T18:36:01.456857+0000","last_undegraded":"2024-09-12T18:36:01.456857+0000","last_fullsized":"2024-09-12T18:36:01.456857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:21.538633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458068+0000","last_change":"2024-09-12T18:35:25.658763+0000","last_active":"2024-09-12T18:36:01.458068+0000","last_peered":"2024-09-12T18:36:01.458068+0000","last_clean":"2024-09-12T18:36:01.458068+0000","last_became_active":"2024-09-12T18:35:25.657508+0000","last_became_peered":"2024-09-12T18:35:25.657508+0000","last_unstale":"2024-09-12T18:36:01.458068+0000","last_undegraded":"2024-09-12T18:36:01.458068+0000","last_fullsized":"2024-09-12T18:36:01.458068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:13.170519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.456742+0000","last_change":"2024-09-12T18:35:25.653730+0000","last_active":"2024-09-12T18:36:01.456742+0000","last_peered":"2024-09-12T18:36:01.456742+0000","last_clean":"2024-09-12T18:36:01.456742+0000","last_became_active":"2024-09-12T18:35:25.651535+0000","last_became_peered":"2024-09-12T18:35:25.651535+0000","last_unstale":"2024-09-12T18:36:01.456742+0000","last_undegraded":"2024-09-12T18:36:01.456742+0000","last_fullsized":"2024-09-12T18:36:01.456742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458531+0000","last_change":"2024-09-12T18:35:25.656513+0000","last_active":"2024-09-12T18:36:01.458531+0000","last_peered":"2024-09-12T18:36:01.458531+0000","last_clean":"2024-09-12T18:36:01.458531+0000","last_became_active":"2024-09-12T18:35:25.653440+0000","last_became_peered":"2024-09-12T18:35:25.653440+0000","last_unstale":"2024-09-12T18:36:01.458531+0000","last_undegraded":"2024-09-12T18:36:01.458531+0000","last_fullsized":"2024-09-12T18:36:01.458531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:18.693161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468423+0000","last_change":"2024-09-12T18:35:25.657991+0000","last_active":"2024-09-12T18:36:03.468423+0000","last_peered":"2024-09-12T18:36:03.468423+0000","last_clean":"2024-09-12T18:36:03.468423+0000","last_became_active":"2024-09-12T18:35:25.653934+0000","last_became_peered":"2024-09-12T18:35:25.653934+0000","last_unstale":"2024-09-12T18:36:03.468423+0000","last_undegraded":"2024-09-12T18:36:03.468423+0000","last_fullsized":"2024-09-12T18:36:03.468423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:05.418901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457946+0000","last_change":"2024-09-12T18:35:25.658819+0000","last_active":"2024-09-12T18:36:01.457946+0000","last_peered":"2024-09-12T18:36:01.457946+0000","last_clean":"2024-09-12T18:36:01.457946+0000","last_became_active":"2024-09-12T18:35:25.656843+0000","last_became_peered":"2024-09-12T18:35:25.656843+0000","last_unstale":"2024-09-12T18:36:01.457946+0000","last_undegraded":"2024-09-12T18:36:01.457946+0000","last_fullsized":"2024-09-12T18:36:01.457946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:55.291963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457321+0000","last_change":"2024-09-12T18:35:25.661176+0000","last_active":"2024-09-12T18:36:01.457321+0000","last_peered":"2024-09-12T18:36:01.457321+0000","last_clean":"2024-09-12T18:36:01.457321+0000","last_became_active":"2024-09-12T18:35:25.659534+0000","last_became_peered":"2024-09-12T18:35:25.659534+0000","last_unstale":"2024-09-12T18:36:01.457321+0000","last_undegraded":"2024-09-12T18:36:01.457321+0000","last_fullsized":"2024-09-12T18:36:01.457321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:40.145442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.456864+0000","last_change":"2024-09-12T18:35:25.650632+0000","last_active":"2024-09-12T18:36:01.456864+0000","last_peered":"2024-09-12T18:36:01.456864+0000","last_clean":"2024-09-12T18:36:01.456864+0000","last_became_active":"2024-09-12T18:35:25.649333+0000","last_became_peered":"2024-09-12T18:35:25.649333+0000","last_unstale":"2024-09-12T18:36:01.456864+0000","last_undegraded":"2024-09-12T18:36:01.456864+0000","last_fullsized":"2024-09-12T18:36:01.456864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:30.537572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.467675+0000","last_change":"2024-09-12T18:35:25.648245+0000","last_active":"2024-09-12T18:36:03.467675+0000","last_peered":"2024-09-12T18:36:03.467675+0000","last_clean":"2024-09-12T18:36:03.467675+0000","last_became_active":"2024-09-12T18:35:25.646357+0000","last_became_peered":"2024-09-12T18:35:25.646357+0000","last_unstale":"2024-09-12T18:36:03.467675+0000","last_undegraded":"2024-09-12T18:36:03.467675+0000","last_fullsized":"2024-09-12T18:36:03.467675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:05.662140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457171+0000","last_change":"2024-09-12T18:35:25.661613+0000","last_active":"2024-09-12T18:36:01.457171+0000","last_peered":"2024-09-12T18:36:01.457171+0000","last_clean":"2024-09-12T18:36:01.457171+0000","last_became_active":"2024-09-12T18:35:25.658833+0000","last_became_peered":"2024-09-12T18:35:25.658833+0000","last_unstale":"2024-09-12T18:36:01.457171+0000","last_undegraded":"2024-09-12T18:36:01.457171+0000","last_fullsized":"2024-09-12T18:36:01.457171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:51.064080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468960+0000","last_change":"2024-09-12T18:35:25.657782+0000","last_active":"2024-09-12T18:36:03.468960+0000","last_peered":"2024-09-12T18:36:03.468960+0000","last_clean":"2024-09-12T18:36:03.468960+0000","last_became_active":"2024-09-12T18:35:25.655295+0000","last_became_peered":"2024-09-12T18:35:25.655295+0000","last_unstale":"2024-09-12T18:36:03.468960+0000","last_undegraded":"2024-09-12T18:36:03.468960+0000","last_fullsized":"2024-09-12T18:36:03.468960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:37.744175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468549+0000","last_change":"2024-09-12T18:35:25.654863+0000","last_active":"2024-09-12T18:36:03.468549+0000","last_peered":"2024-09-12T18:36:03.468549+0000","last_clean":"2024-09-12T18:36:03.468549+0000","last_became_active":"2024-09-12T18:35:25.650407+0000","last_became_peered":"2024-09-12T18:35:25.650407+0000","last_unstale":"2024-09-12T18:36:03.468549+0000","last_undegraded":"2024-09-12T18:36:03.468549+0000","last_fullsized":"2024-09-12T18:36:03.468549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:38.395666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458577+0000","last_change":"2024-09-12T18:35:25.662414+0000","last_active":"2024-09-12T18:36:01.458577+0000","last_peered":"2024-09-12T18:36:01.458577+0000","last_clean":"2024-09-12T18:36:01.458577+0000","last_became_active":"2024-09-12T18:35:25.660126+0000","last_became_peered":"2024-09-12T18:35:25.660126+0000","last_unstale":"2024-09-12T18:36:01.458577+0000","last_undegraded":"2024-09-12T18:36:01.458577+0000","last_fullsized":"2024-09-12T18:36:01.458577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:48.437139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457592+0000","last_change":"2024-09-12T18:35:25.661523+0000","last_active":"2024-09-12T18:36:01.457592+0000","last_peered":"2024-09-12T18:36:01.457592+0000","last_clean":"2024-09-12T18:36:01.457592+0000","last_became_active":"2024-09-12T18:35:25.659338+0000","last_became_peered":"2024-09-12T18:35:25.659338+0000","last_unstale":"2024-09-12T18:36:01.457592+0000","last_undegraded":"2024-09-12T18:36:01.457592+0000","last_fullsized":"2024-09-12T18:36:01.457592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:37.083820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468463+0000","last_change":"2024-09-12T18:35:25.662445+0000","last_active":"2024-09-12T18:36:03.468463+0000","last_peered":"2024-09-12T18:36:03.468463+0000","last_clean":"2024-09-12T18:36:03.468463+0000","last_became_active":"2024-09-12T18:35:25.659496+0000","last_became_peered":"2024-09-12T18:35:25.659496+0000","last_unstale":"2024-09-12T18:36:03.468463+0000","last_undegraded":"2024-09-12T18:36:03.468463+0000","last_fullsized":"2024-09-12T18:36:03.468463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:03.270420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457867+0000","last_change":"2024-09-12T18:35:25.662519+0000","last_active":"2024-09-12T18:36:01.457867+0000","last_peered":"2024-09-12T18:36:01.457867+0000","last_clean":"2024-09-12T18:36:01.457867+0000","last_became_active":"2024-09-12T18:35:25.652964+0000","last_became_peered":"2024-09-12T18:35:25.652964+0000","last_unstale":"2024-09-12T18:36:01.457867+0000","last_undegraded":"2024-09-12T18:36:01.457867+0000","last_fullsized":"2024-09-12T18:36:01.457867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:37.923468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.467821+0000","last_change":"2024-09-12T18:35:25.650507+0000","last_active":"2024-09-12T18:36:03.467821+0000","last_peered":"2024-09-12T18:36:03.467821+0000","last_clean":"2024-09-12T18:36:03.467821+0000","last_became_active":"2024-09-12T18:35:25.649415+0000","last_became_peered":"2024-09-12T18:35:25.649415+0000","last_unstale":"2024-09-12T18:36:03.467821+0000","last_undegraded":"2024-09-12T18:36:03.467821+0000","last_fullsized":"2024-09-12T18:36:03.467821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:23.081416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457196+0000","last_change":"2024-09-12T18:35:25.653949+0000","last_active":"2024-09-12T18:36:01.457196+0000","last_peered":"2024-09-12T18:36:01.457196+0000","last_clean":"2024-09-12T18:36:01.457196+0000","last_became_active":"2024-09-12T18:35:25.652992+0000","last_became_peered":"2024-09-12T18:35:25.652992+0000","last_unstale":"2024-09-12T18:36:01.457196+0000","last_undegraded":"2024-09-12T18:36:01.457196+0000","last_fullsized":"2024-09-12T18:36:01.457196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:47.687372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.456891+0000","last_change":"2024-09-12T18:35:25.653159+0000","last_active":"2024-09-12T18:36:01.456891+0000","last_peered":"2024-09-12T18:36:01.456891+0000","last_clean":"2024-09-12T18:36:01.456891+0000","last_became_active":"2024-09-12T18:35:25.650551+0000","last_became_peered":"2024-09-12T18:35:25.650551+0000","last_unstale":"2024-09-12T18:36:01.456891+0000","last_undegraded":"2024-09-12T18:36:01.456891+0000","last_fullsized":"2024-09-12T18:36:01.456891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:16.245302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468359+0000","last_change":"2024-09-12T18:35:25.651877+0000","last_active":"2024-09-12T18:36:03.468359+0000","last_peered":"2024-09-12T18:36:03.468359+0000","last_clean":"2024-09-12T18:36:03.468359+0000","last_became_active":"2024-09-12T18:35:25.651055+0000","last_became_peered":"2024-09-12T18:35:25.651055+0000","last_unstale":"2024-09-12T18:36:03.468359+0000","last_undegraded":"2024-09-12T18:36:03.468359+0000","last_fullsized":"2024-09-12T18:36:03.468359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:14.200080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457269+0000","last_change":"2024-09-12T18:35:24.657739+0000","last_active":"2024-09-12T18:36:01.457269+0000","last_peered":"2024-09-12T18:36:01.457269+0000","last_clean":"2024-09-12T18:36:01.457269+0000","last_became_active":"2024-09-12T18:35:24.656208+0000","last_became_peered":"2024-09-12T18:35:24.656208+0000","last_unstale":"2024-09-12T18:36:01.457269+0000","last_undegraded":"2024-09-12T18:36:01.457269+0000","last_fullsized":"2024-09-12T18:36:01.457269+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:50.073716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468191+0000","last_change":"2024-09-12T18:35:25.651651+0000","last_active":"2024-09-12T18:36:03.468191+0000","last_peered":"2024-09-12T18:36:03.468191+0000","last_clean":"2024-09-12T18:36:03.468191+0000","last_became_active":"2024-09-12T18:35:25.650849+0000","last_became_peered":"2024-09-12T18:35:25.650849+0000","last_unstale":"2024-09-12T18:36:03.468191+0000","last_undegraded":"2024-09-12T18:36:03.468191+0000","last_fullsized":"2024-09-12T18:36:03.468191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:18.555827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457663+0000","last_change":"2024-09-12T18:35:24.656119+0000","last_active":"2024-09-12T18:36:01.457663+0000","last_peered":"2024-09-12T18:36:01.457663+0000","last_clean":"2024-09-12T18:36:01.457663+0000","last_became_active":"2024-09-12T18:35:24.653175+0000","last_became_peered":"2024-09-12T18:35:24.653175+0000","last_unstale":"2024-09-12T18:36:01.457663+0000","last_undegraded":"2024-09-12T18:36:01.457663+0000","last_fullsized":"2024-09-12T18:36:01.457663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:00.551165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458765+0000","last_change":"2024-09-12T18:35:25.655723+0000","last_active":"2024-09-12T18:36:01.458765+0000","last_peered":"2024-09-12T18:36:01.458765+0000","last_clean":"2024-09-12T18:36:01.458765+0000","last_became_active":"2024-09-12T18:35:25.653630+0000","last_became_peered":"2024-09-12T18:35:25.653630+0000","last_unstale":"2024-09-12T18:36:01.458765+0000","last_undegraded":"2024-09-12T18:36:01.458765+0000","last_fullsized":"2024-09-12T18:36:01.458765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:07.655792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.467642+0000","last_change":"2024-09-12T18:35:24.640096+0000","last_active":"2024-09-12T18:36:03.467642+0000","last_peered":"2024-09-12T18:36:03.467642+0000","last_clean":"2024-09-12T18:36:03.467642+0000","last_became_active":"2024-09-12T18:35:24.638230+0000","last_became_peered":"2024-09-12T18:35:24.638230+0000","last_unstale":"2024-09-12T18:36:03.467642+0000","last_undegraded":"2024-09-12T18:36:03.467642+0000","last_fullsized":"2024-09-12T18:36:03.467642+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:38.435296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457928+0000","last_change":"2024-09-12T18:35:25.662692+0000","last_active":"2024-09-12T18:36:01.457928+0000","last_peered":"2024-09-12T18:36:01.457928+0000","last_clean":"2024-09-12T18:36:01.457928+0000","last_became_active":"2024-09-12T18:35:25.661885+0000","last_became_peered":"2024-09-12T18:35:25.661885+0000","last_unstale":"2024-09-12T18:36:01.457928+0000","last_undegraded":"2024-09-12T18:36:01.457928+0000","last_fullsized":"2024-09-12T18:36:01.457928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:41.264425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457083+0000","last_change":"2024-09-12T18:35:24.653610+0000","last_active":"2024-09-12T18:36:01.457083+0000","last_peered":"2024-09-12T18:36:01.457083+0000","last_clean":"2024-09-12T18:36:01.457083+0000","last_became_active":"2024-09-12T18:35:24.652880+0000","last_became_peered":"2024-09-12T18:35:24.652880+0000","last_unstale":"2024-09-12T18:36:01.457083+0000","last_undegraded":"2024-09-12T18:36:01.457083+0000","last_fullsized":"2024-09-12T18:36:01.457083+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:57.636251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"31'2753","reported_seq":2782,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.462239+0000","last_change":"2024-09-12T18:35:44.771794+0000","last_active":"2024-09-12T18:36:01.462239+0000","last_peered":"2024-09-12T18:36:01.462239+0000","last_clean":"2024-09-12T18:36:01.462239+0000","last_became_active":"2024-09-12T18:35:44.771286+0000","last_became_peered":"2024-09-12T18:35:44.771286+0000","last_unstale":"2024-09-12T18:36:01.462239+0000","last_undegraded":"2024-09-12T18:36:01.462239+0000","last_fullsized":"2024-09-12T18:36:01.462239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":2753,"log_dups_size":0,"ondisk_log_size":2753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:10.094729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180420608,"num_objects":2753,"num_object_clones":0,"num_object_copies":5506,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2753,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2753,"num_write_kb":176192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.460130+0000","last_change":"2024-09-12T18:35:24.653465+0000","last_active":"2024-09-12T18:36:01.460130+0000","last_peered":"2024-09-12T18:36:01.460130+0000","last_clean":"2024-09-12T18:36:01.460130+0000","last_became_active":"2024-09-12T18:35:24.652792+0000","last_became_peered":"2024-09-12T18:35:24.652792+0000","last_unstale":"2024-09-12T18:36:01.460130+0000","last_undegraded":"2024-09-12T18:36:01.460130+0000","last_fullsized":"2024-09-12T18:36:01.460130+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:14.588993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.469061+0000","last_change":"2024-09-12T18:35:25.655426+0000","last_active":"2024-09-12T18:36:03.469061+0000","last_peered":"2024-09-12T18:36:03.469061+0000","last_clean":"2024-09-12T18:36:03.469061+0000","last_became_active":"2024-09-12T18:35:25.648186+0000","last_became_peered":"2024-09-12T18:35:25.648186+0000","last_unstale":"2024-09-12T18:36:03.469061+0000","last_undegraded":"2024-09-12T18:36:03.469061+0000","last_fullsized":"2024-09-12T18:36:03.469061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:48.802815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"32'2968","reported_seq":3001,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468788+0000","last_change":"2024-09-12T18:35:44.767860+0000","last_active":"2024-09-12T18:36:03.468788+0000","last_peered":"2024-09-12T18:36:03.468788+0000","last_clean":"2024-09-12T18:36:03.468788+0000","last_became_active":"2024-09-12T18:35:44.766986+0000","last_became_peered":"2024-09-12T18:35:44.766986+0000","last_unstale":"2024-09-12T18:36:03.468788+0000","last_undegraded":"2024-09-12T18:36:03.468788+0000","last_fullsized":"2024-09-12T18:36:03.468788+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":2968,"log_dups_size":0,"ondisk_log_size":2968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:49.109157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194510848,"num_objects":2968,"num_object_clones":0,"num_object_copies":5936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2968,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2968,"num_write_kb":189952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468578+0000","last_change":"2024-09-12T18:35:24.648439+0000","last_active":"2024-09-12T18:36:03.468578+0000","last_peered":"2024-09-12T18:36:03.468578+0000","last_clean":"2024-09-12T18:36:03.468578+0000","last_became_active":"2024-09-12T18:35:24.647629+0000","last_became_peered":"2024-09-12T18:35:24.647629+0000","last_unstale":"2024-09-12T18:36:03.468578+0000","last_undegraded":"2024-09-12T18:36:03.468578+0000","last_fullsized":"2024-09-12T18:36:03.468578+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:45.428223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.467525+0000","last_change":"2024-09-12T18:35:25.652496+0000","last_active":"2024-09-12T18:36:03.467525+0000","last_peered":"2024-09-12T18:36:03.467525+0000","last_clean":"2024-09-12T18:36:03.467525+0000","last_became_active":"2024-09-12T18:35:25.651628+0000","last_became_peered":"2024-09-12T18:35:25.651628+0000","last_unstale":"2024-09-12T18:36:03.467525+0000","last_undegraded":"2024-09-12T18:36:03.467525+0000","last_fullsized":"2024-09-12T18:36:03.467525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:44.920448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"32'3118","reported_seq":3151,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.467646+0000","last_change":"2024-09-12T18:35:44.767175+0000","last_active":"2024-09-12T18:36:03.467646+0000","last_peered":"2024-09-12T18:36:03.467646+0000","last_clean":"2024-09-12T18:36:03.467646+0000","last_became_active":"2024-09-12T18:35:44.766592+0000","last_became_peered":"2024-09-12T18:35:44.766592+0000","last_unstale":"2024-09-12T18:36:03.467646+0000","last_undegraded":"2024-09-12T18:36:03.467646+0000","last_fullsized":"2024-09-12T18:36:03.467646+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3118,"log_dups_size":0,"ondisk_log_size":3118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:44.678279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204341248,"num_objects":3118,"num_object_clones":0,"num_object_copies":6236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3118,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3118,"num_write_kb":199552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458211+0000","last_change":"2024-09-12T18:35:24.654976+0000","last_active":"2024-09-12T18:36:01.458211+0000","last_peered":"2024-09-12T18:36:01.458211+0000","last_clean":"2024-09-12T18:36:01.458211+0000","last_became_active":"2024-09-12T18:35:24.654264+0000","last_became_peered":"2024-09-12T18:35:24.654264+0000","last_unstale":"2024-09-12T18:36:01.458211+0000","last_undegraded":"2024-09-12T18:36:01.458211+0000","last_fullsized":"2024-09-12T18:36:01.458211+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:00.115408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.456949+0000","last_change":"2024-09-12T18:35:25.650577+0000","last_active":"2024-09-12T18:36:01.456949+0000","last_peered":"2024-09-12T18:36:01.456949+0000","last_clean":"2024-09-12T18:36:01.456949+0000","last_became_active":"2024-09-12T18:35:25.649172+0000","last_became_peered":"2024-09-12T18:35:25.649172+0000","last_unstale":"2024-09-12T18:36:01.456949+0000","last_undegraded":"2024-09-12T18:36:01.456949+0000","last_fullsized":"2024-09-12T18:36:01.456949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:55.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"31'2790","reported_seq":2819,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457224+0000","last_change":"2024-09-12T18:35:44.763067+0000","last_active":"2024-09-12T18:36:01.457224+0000","last_peered":"2024-09-12T18:36:01.457224+0000","last_clean":"2024-09-12T18:36:01.457224+0000","last_became_active":"2024-09-12T18:35:44.762584+0000","last_became_peered":"2024-09-12T18:35:44.762584+0000","last_unstale":"2024-09-12T18:36:01.457224+0000","last_undegraded":"2024-09-12T18:36:01.457224+0000","last_fullsized":"2024-09-12T18:36:01.457224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":2790,"log_dups_size":0,"ondisk_log_size":2790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:47.847399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182845440,"num_objects":2790,"num_object_clones":0,"num_object_copies":5580,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2790,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2790,"num_write_kb":178560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457710+0000","last_change":"2024-09-12T18:35:24.657665+0000","last_active":"2024-09-12T18:36:01.457710+0000","last_peered":"2024-09-12T18:36:01.457710+0000","last_clean":"2024-09-12T18:36:01.457710+0000","last_became_active":"2024-09-12T18:35:24.657015+0000","last_became_peered":"2024-09-12T18:35:24.657015+0000","last_unstale":"2024-09-12T18:36:01.457710+0000","last_undegraded":"2024-09-12T18:36:01.457710+0000","last_fullsized":"2024-09-12T18:36:01.457710+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:03.171326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457769+0000","last_change":"2024-09-12T18:35:25.665275+0000","last_active":"2024-09-12T18:36:01.457769+0000","last_peered":"2024-09-12T18:36:01.457769+0000","last_clean":"2024-09-12T18:36:01.457769+0000","last_became_active":"2024-09-12T18:35:25.659511+0000","last_became_peered":"2024-09-12T18:35:25.659511+0000","last_unstale":"2024-09-12T18:36:01.457769+0000","last_undegraded":"2024-09-12T18:36:01.457769+0000","last_fullsized":"2024-09-12T18:36:01.457769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"33'3104","reported_seq":3137,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.475835+0000","last_change":"2024-09-12T18:35:44.773526+0000","last_active":"2024-09-12T18:36:03.475835+0000","last_peered":"2024-09-12T18:36:03.475835+0000","last_clean":"2024-09-12T18:36:03.475835+0000","last_became_active":"2024-09-12T18:35:44.772974+0000","last_became_peered":"2024-09-12T18:35:44.772974+0000","last_unstale":"2024-09-12T18:36:03.475835+0000","last_undegraded":"2024-09-12T18:36:03.475835+0000","last_fullsized":"2024-09-12T18:36:03.475835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3104,"log_dups_size":0,"ondisk_log_size":3104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:23.676840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203423744,"num_objects":3104,"num_object_clones":0,"num_object_copies":6208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3104,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3104,"num_write_kb":198656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458040+0000","last_change":"2024-09-12T18:35:24.651913+0000","last_active":"2024-09-12T18:36:01.458040+0000","last_peered":"2024-09-12T18:36:01.458040+0000","last_clean":"2024-09-12T18:36:01.458040+0000","last_became_active":"2024-09-12T18:35:24.650421+0000","last_became_peered":"2024-09-12T18:35:24.650421+0000","last_unstale":"2024-09-12T18:36:01.458040+0000","last_undegraded":"2024-09-12T18:36:01.458040+0000","last_fullsized":"2024-09-12T18:36:01.458040+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:57.685312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457604+0000","last_change":"2024-09-12T18:35:25.651138+0000","last_active":"2024-09-12T18:36:01.457604+0000","last_peered":"2024-09-12T18:36:01.457604+0000","last_clean":"2024-09-12T18:36:01.457604+0000","last_became_active":"2024-09-12T18:35:25.650617+0000","last_became_peered":"2024-09-12T18:35:25.650617+0000","last_unstale":"2024-09-12T18:36:01.457604+0000","last_undegraded":"2024-09-12T18:36:01.457604+0000","last_fullsized":"2024-09-12T18:36:01.457604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:58.535066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"31'2753","reported_seq":2781,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.461611+0000","last_change":"2024-09-12T18:35:44.767970+0000","last_active":"2024-09-12T18:36:01.461611+0000","last_peered":"2024-09-12T18:36:01.461611+0000","last_clean":"2024-09-12T18:36:01.461611+0000","last_became_active":"2024-09-12T18:35:44.767348+0000","last_became_peered":"2024-09-12T18:35:44.767348+0000","last_unstale":"2024-09-12T18:36:01.461611+0000","last_undegraded":"2024-09-12T18:36:01.461611+0000","last_fullsized":"2024-09-12T18:36:01.461611+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":2753,"log_dups_size":0,"ondisk_log_size":2753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:48.745907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180420608,"num_objects":2753,"num_object_clones":0,"num_object_copies":5506,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2753,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2753,"num_write_kb":176192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457846+0000","last_change":"2024-09-12T18:35:24.659019+0000","last_active":"2024-09-12T18:36:01.457846+0000","last_peered":"2024-09-12T18:36:01.457846+0000","last_clean":"2024-09-12T18:36:01.457846+0000","last_became_active":"2024-09-12T18:35:24.658423+0000","last_became_peered":"2024-09-12T18:35:24.658423+0000","last_unstale":"2024-09-12T18:36:01.457846+0000","last_undegraded":"2024-09-12T18:36:01.457846+0000","last_fullsized":"2024-09-12T18:36:01.457846+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:37.668417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457927+0000","last_change":"2024-09-12T18:35:25.662287+0000","last_active":"2024-09-12T18:36:01.457927+0000","last_peered":"2024-09-12T18:36:01.457927+0000","last_clean":"2024-09-12T18:36:01.457927+0000","last_became_active":"2024-09-12T18:35:25.660372+0000","last_became_peered":"2024-09-12T18:35:25.660372+0000","last_unstale":"2024-09-12T18:36:01.457927+0000","last_undegraded":"2024-09-12T18:36:01.457927+0000","last_fullsized":"2024-09-12T18:36:01.457927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:08.729541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.f","version":"30'2806","reported_seq":2835,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.459895+0000","last_change":"2024-09-12T18:35:44.774817+0000","last_active":"2024-09-12T18:36:01.459895+0000","last_peered":"2024-09-12T18:36:01.459895+0000","last_clean":"2024-09-12T18:36:01.459895+0000","last_became_active":"2024-09-12T18:35:44.774429+0000","last_became_peered":"2024-09-12T18:35:44.774429+0000","last_unstale":"2024-09-12T18:36:01.459895+0000","last_undegraded":"2024-09-12T18:36:01.459895+0000","last_fullsized":"2024-09-12T18:36:01.459895+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":2806,"log_dups_size":0,"ondisk_log_size":2806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:21.579103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183894016,"num_objects":2806,"num_object_clones":0,"num_object_copies":5612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2806,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2806,"num_write_kb":179584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.467739+0000","last_change":"2024-09-12T18:35:24.648330+0000","last_active":"2024-09-12T18:36:03.467739+0000","last_peered":"2024-09-12T18:36:03.467739+0000","last_clean":"2024-09-12T18:36:03.467739+0000","last_became_active":"2024-09-12T18:35:24.647520+0000","last_became_peered":"2024-09-12T18:35:24.647520+0000","last_unstale":"2024-09-12T18:36:03.467739+0000","last_undegraded":"2024-09-12T18:36:03.467739+0000","last_fullsized":"2024-09-12T18:36:03.467739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:25.552055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457719+0000","last_change":"2024-09-12T18:35:25.658674+0000","last_active":"2024-09-12T18:36:01.457719+0000","last_peered":"2024-09-12T18:36:01.457719+0000","last_clean":"2024-09-12T18:36:01.457719+0000","last_became_active":"2024-09-12T18:35:25.657386+0000","last_became_peered":"2024-09-12T18:35:25.657386+0000","last_unstale":"2024-09-12T18:36:01.457719+0000","last_undegraded":"2024-09-12T18:36:01.457719+0000","last_fullsized":"2024-09-12T18:36:01.457719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:48.037086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"32'3083","reported_seq":3116,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468201+0000","last_change":"2024-09-12T18:35:44.771738+0000","last_active":"2024-09-12T18:36:03.468201+0000","last_peered":"2024-09-12T18:36:03.468201+0000","last_clean":"2024-09-12T18:36:03.468201+0000","last_became_active":"2024-09-12T18:35:44.771227+0000","last_became_peered":"2024-09-12T18:35:44.771227+0000","last_unstale":"2024-09-12T18:36:03.468201+0000","last_undegraded":"2024-09-12T18:36:03.468201+0000","last_fullsized":"2024-09-12T18:36:03.468201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3083,"log_dups_size":0,"ondisk_log_size":3083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:27.329732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202047488,"num_objects":3083,"num_object_clones":0,"num_object_copies":6166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3083,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3083,"num_write_kb":197312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.469059+0000","last_change":"2024-09-12T18:35:24.646810+0000","last_active":"2024-09-12T18:36:03.469059+0000","last_peered":"2024-09-12T18:36:03.469059+0000","last_clean":"2024-09-12T18:36:03.469059+0000","last_became_active":"2024-09-12T18:35:24.646008+0000","last_became_peered":"2024-09-12T18:35:24.646008+0000","last_unstale":"2024-09-12T18:36:03.469059+0000","last_undegraded":"2024-09-12T18:36:03.469059+0000","last_fullsized":"2024-09-12T18:36:03.469059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:43.888776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458076+0000","last_change":"2024-09-12T18:35:25.667710+0000","last_active":"2024-09-12T18:36:01.458076+0000","last_peered":"2024-09-12T18:36:01.458076+0000","last_clean":"2024-09-12T18:36:01.458076+0000","last_became_active":"2024-09-12T18:35:25.666940+0000","last_became_peered":"2024-09-12T18:35:25.666940+0000","last_unstale":"2024-09-12T18:36:01.458076+0000","last_undegraded":"2024-09-12T18:36:01.458076+0000","last_fullsized":"2024-09-12T18:36:01.458076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:09.823085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"32'3023","reported_seq":3056,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.467735+0000","last_change":"2024-09-12T18:35:44.769127+0000","last_active":"2024-09-12T18:36:03.467735+0000","last_peered":"2024-09-12T18:36:03.467735+0000","last_clean":"2024-09-12T18:36:03.467735+0000","last_became_active":"2024-09-12T18:35:44.768382+0000","last_became_peered":"2024-09-12T18:35:44.768382+0000","last_unstale":"2024-09-12T18:36:03.467735+0000","last_undegraded":"2024-09-12T18:36:03.467735+0000","last_fullsized":"2024-09-12T18:36:03.467735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3023,"log_dups_size":0,"ondisk_log_size":3023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:33.385476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198115328,"num_objects":3023,"num_object_clones":0,"num_object_copies":6046,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3023,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3023,"num_write_kb":193472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":189,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457395+0000","last_change":"2024-09-12T18:35:13.489018+0000","last_active":"2024-09-12T18:36:01.457395+0000","last_peered":"2024-09-12T18:36:01.457395+0000","last_clean":"2024-09-12T18:36:01.457395+0000","last_became_active":"2024-09-12T18:35:13.488346+0000","last_became_peered":"2024-09-12T18:35:13.488346+0000","last_unstale":"2024-09-12T18:36:01.457395+0000","last_undegraded":"2024-09-12T18:36:01.457395+0000","last_fullsized":"2024-09-12T18:36:01.457395+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_clean_scrub_stamp":"2024-09-12T18:35:12.464628+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:54.864640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457506+0000","last_change":"2024-09-12T18:35:22.459694+0000","last_active":"2024-09-12T18:36:01.457506+0000","last_peered":"2024-09-12T18:36:01.457506+0000","last_clean":"2024-09-12T18:36:01.457506+0000","last_became_active":"2024-09-12T18:35:20.446796+0000","last_became_peered":"2024-09-12T18:35:20.446796+0000","last_unstale":"2024-09-12T18:36:01.457506+0000","last_undegraded":"2024-09-12T18:36:01.457506+0000","last_fullsized":"2024-09-12T18:36:01.457506+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:21.506024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016291610000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458518+0000","last_change":"2024-09-12T18:35:24.651749+0000","last_active":"2024-09-12T18:36:01.458518+0000","last_peered":"2024-09-12T18:36:01.458518+0000","last_clean":"2024-09-12T18:36:01.458518+0000","last_became_active":"2024-09-12T18:35:24.649860+0000","last_became_peered":"2024-09-12T18:35:24.649860+0000","last_unstale":"2024-09-12T18:36:01.458518+0000","last_undegraded":"2024-09-12T18:36:01.458518+0000","last_fullsized":"2024-09-12T18:36:01.458518+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:35.430065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458068+0000","last_change":"2024-09-12T18:35:25.662424+0000","last_active":"2024-09-12T18:36:01.458068+0000","last_peered":"2024-09-12T18:36:01.458068+0000","last_clean":"2024-09-12T18:36:01.458068+0000","last_became_active":"2024-09-12T18:35:25.661043+0000","last_became_peered":"2024-09-12T18:35:25.661043+0000","last_unstale":"2024-09-12T18:36:01.458068+0000","last_undegraded":"2024-09-12T18:36:01.458068+0000","last_fullsized":"2024-09-12T18:36:01.458068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:52.551802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.7","version":"31'2739","reported_seq":2768,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.460057+0000","last_change":"2024-09-12T18:35:44.774505+0000","last_active":"2024-09-12T18:36:01.460057+0000","last_peered":"2024-09-12T18:36:01.460057+0000","last_clean":"2024-09-12T18:36:01.460057+0000","last_became_active":"2024-09-12T18:35:44.774259+0000","last_became_peered":"2024-09-12T18:35:44.774259+0000","last_unstale":"2024-09-12T18:36:01.460057+0000","last_undegraded":"2024-09-12T18:36:01.460057+0000","last_fullsized":"2024-09-12T18:36:01.460057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":2739,"log_dups_size":0,"ondisk_log_size":2739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:21.731670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":179503104,"num_objects":2739,"num_object_clones":0,"num_object_copies":5478,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2739,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2739,"num_write_kb":175296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457296+0000","last_change":"2024-09-12T18:35:22.459090+0000","last_active":"2024-09-12T18:36:01.457296+0000","last_peered":"2024-09-12T18:36:01.457296+0000","last_clean":"2024-09-12T18:36:01.457296+0000","last_became_active":"2024-09-12T18:35:20.448553+0000","last_became_peered":"2024-09-12T18:35:20.448553+0000","last_unstale":"2024-09-12T18:36:01.457296+0000","last_undegraded":"2024-09-12T18:36:01.457296+0000","last_fullsized":"2024-09-12T18:36:01.457296+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:56.834808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001030836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457418+0000","last_change":"2024-09-12T18:35:24.651597+0000","last_active":"2024-09-12T18:36:01.457418+0000","last_peered":"2024-09-12T18:36:01.457418+0000","last_clean":"2024-09-12T18:36:01.457418+0000","last_became_active":"2024-09-12T18:35:24.649940+0000","last_became_peered":"2024-09-12T18:35:24.649940+0000","last_unstale":"2024-09-12T18:36:01.457418+0000","last_undegraded":"2024-09-12T18:36:01.457418+0000","last_fullsized":"2024-09-12T18:36:01.457418+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:36.822432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468531+0000","last_change":"2024-09-12T18:35:25.660529+0000","last_active":"2024-09-12T18:36:03.468531+0000","last_peered":"2024-09-12T18:36:03.468531+0000","last_clean":"2024-09-12T18:36:03.468531+0000","last_became_active":"2024-09-12T18:35:25.659537+0000","last_became_peered":"2024-09-12T18:35:25.659537+0000","last_unstale":"2024-09-12T18:36:03.468531+0000","last_undegraded":"2024-09-12T18:36:03.468531+0000","last_fullsized":"2024-09-12T18:36:03.468531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:51.790349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'2763","reported_seq":2792,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458710+0000","last_change":"2024-09-12T18:35:44.770379+0000","last_active":"2024-09-12T18:36:01.458710+0000","last_peered":"2024-09-12T18:36:01.458710+0000","last_clean":"2024-09-12T18:36:01.458710+0000","last_became_active":"2024-09-12T18:35:44.769739+0000","last_became_peered":"2024-09-12T18:35:44.769739+0000","last_unstale":"2024-09-12T18:36:01.458710+0000","last_undegraded":"2024-09-12T18:36:01.458710+0000","last_fullsized":"2024-09-12T18:36:01.458710+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":2763,"log_dups_size":0,"ondisk_log_size":2763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:02:23.077263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181075968,"num_objects":2763,"num_object_clones":0,"num_object_copies":5526,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2763,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2763,"num_write_kb":176832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457508+0000","last_change":"2024-09-12T18:35:22.464179+0000","last_active":"2024-09-12T18:36:01.457508+0000","last_peered":"2024-09-12T18:36:01.457508+0000","last_clean":"2024-09-12T18:36:01.457508+0000","last_became_active":"2024-09-12T18:35:20.442613+0000","last_became_peered":"2024-09-12T18:35:20.442613+0000","last_unstale":"2024-09-12T18:36:01.457508+0000","last_undegraded":"2024-09-12T18:36:01.457508+0000","last_fullsized":"2024-09-12T18:36:01.457508+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:17.636537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014134620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.469114+0000","last_change":"2024-09-12T18:35:24.641297+0000","last_active":"2024-09-12T18:36:03.469114+0000","last_peered":"2024-09-12T18:36:03.469114+0000","last_clean":"2024-09-12T18:36:03.469114+0000","last_became_active":"2024-09-12T18:35:24.637334+0000","last_became_peered":"2024-09-12T18:35:24.637334+0000","last_unstale":"2024-09-12T18:36:03.469114+0000","last_undegraded":"2024-09-12T18:36:03.469114+0000","last_fullsized":"2024-09-12T18:36:03.469114+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:50.772074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458083+0000","last_change":"2024-09-12T18:35:25.659209+0000","last_active":"2024-09-12T18:36:01.458083+0000","last_peered":"2024-09-12T18:36:01.458083+0000","last_clean":"2024-09-12T18:36:01.458083+0000","last_became_active":"2024-09-12T18:35:25.656170+0000","last_became_peered":"2024-09-12T18:35:25.656170+0000","last_unstale":"2024-09-12T18:36:01.458083+0000","last_undegraded":"2024-09-12T18:36:01.458083+0000","last_fullsized":"2024-09-12T18:36:01.458083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:40.925757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"31'2821","reported_seq":2849,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457861+0000","last_change":"2024-09-12T18:35:44.770358+0000","last_active":"2024-09-12T18:36:01.457861+0000","last_peered":"2024-09-12T18:36:01.457861+0000","last_clean":"2024-09-12T18:36:01.457861+0000","last_became_active":"2024-09-12T18:35:44.769786+0000","last_became_peered":"2024-09-12T18:35:44.769786+0000","last_unstale":"2024-09-12T18:36:01.457861+0000","last_undegraded":"2024-09-12T18:36:01.457861+0000","last_fullsized":"2024-09-12T18:36:01.457861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":2821,"log_dups_size":0,"ondisk_log_size":2821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:27.215502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184877056,"num_objects":2821,"num_object_clones":0,"num_object_copies":5642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2821,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2821,"num_write_kb":180544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457951+0000","last_change":"2024-09-12T18:35:22.459049+0000","last_active":"2024-09-12T18:36:01.457951+0000","last_peered":"2024-09-12T18:36:01.457951+0000","last_clean":"2024-09-12T18:36:01.457951+0000","last_became_active":"2024-09-12T18:35:20.446814+0000","last_became_peered":"2024-09-12T18:35:20.446814+0000","last_unstale":"2024-09-12T18:36:01.457951+0000","last_undegraded":"2024-09-12T18:36:01.457951+0000","last_fullsized":"2024-09-12T18:36:01.457951+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:18.033595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010716149999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457397+0000","last_change":"2024-09-12T18:35:24.658273+0000","last_active":"2024-09-12T18:36:01.457397+0000","last_peered":"2024-09-12T18:36:01.457397+0000","last_clean":"2024-09-12T18:36:01.457397+0000","last_became_active":"2024-09-12T18:35:24.657433+0000","last_became_peered":"2024-09-12T18:35:24.657433+0000","last_unstale":"2024-09-12T18:36:01.457397+0000","last_undegraded":"2024-09-12T18:36:01.457397+0000","last_fullsized":"2024-09-12T18:36:01.457397+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:48.497218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.459190+0000","last_change":"2024-09-12T18:35:25.655830+0000","last_active":"2024-09-12T18:36:01.459190+0000","last_peered":"2024-09-12T18:36:01.459190+0000","last_clean":"2024-09-12T18:36:01.459190+0000","last_became_active":"2024-09-12T18:35:25.652126+0000","last_became_peered":"2024-09-12T18:35:25.652126+0000","last_unstale":"2024-09-12T18:36:01.459190+0000","last_undegraded":"2024-09-12T18:36:01.459190+0000","last_fullsized":"2024-09-12T18:36:01.459190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:04.080721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"31'2761","reported_seq":2790,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.464762+0000","last_change":"2024-09-12T18:35:44.770799+0000","last_active":"2024-09-12T18:36:01.464762+0000","last_peered":"2024-09-12T18:36:01.464762+0000","last_clean":"2024-09-12T18:36:01.464762+0000","last_became_active":"2024-09-12T18:35:44.770030+0000","last_became_peered":"2024-09-12T18:35:44.770030+0000","last_unstale":"2024-09-12T18:36:01.464762+0000","last_undegraded":"2024-09-12T18:36:01.464762+0000","last_fullsized":"2024-09-12T18:36:01.464762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":2761,"log_dups_size":0,"ondisk_log_size":2761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:24.786452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180944896,"num_objects":2761,"num_object_clones":0,"num_object_copies":5522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2761,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2761,"num_write_kb":176704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458304+0000","last_change":"2024-09-12T18:35:24.657618+0000","last_active":"2024-09-12T18:36:01.458304+0000","last_peered":"2024-09-12T18:36:01.458304+0000","last_clean":"2024-09-12T18:36:01.458304+0000","last_became_active":"2024-09-12T18:35:24.656741+0000","last_became_peered":"2024-09-12T18:35:24.656741+0000","last_unstale":"2024-09-12T18:36:01.458304+0000","last_undegraded":"2024-09-12T18:36:01.458304+0000","last_fullsized":"2024-09-12T18:36:01.458304+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:43.113104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.459271+0000","last_change":"2024-09-12T18:35:22.464180+0000","last_active":"2024-09-12T18:36:01.459271+0000","last_peered":"2024-09-12T18:36:01.459271+0000","last_clean":"2024-09-12T18:36:01.459271+0000","last_became_active":"2024-09-12T18:35:20.442566+0000","last_became_peered":"2024-09-12T18:35:20.442566+0000","last_unstale":"2024-09-12T18:36:01.459271+0000","last_undegraded":"2024-09-12T18:36:01.459271+0000","last_fullsized":"2024-09-12T18:36:01.459271+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:29.021710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001325786,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.467780+0000","last_change":"2024-09-12T18:35:25.650458+0000","last_active":"2024-09-12T18:36:03.467780+0000","last_peered":"2024-09-12T18:36:03.467780+0000","last_clean":"2024-09-12T18:36:03.467780+0000","last_became_active":"2024-09-12T18:35:25.648761+0000","last_became_peered":"2024-09-12T18:35:25.648761+0000","last_unstale":"2024-09-12T18:36:03.467780+0000","last_undegraded":"2024-09-12T18:36:03.467780+0000","last_fullsized":"2024-09-12T18:36:03.467780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:53.026950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"30'2737","reported_seq":2766,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.456618+0000","last_change":"2024-09-12T18:35:44.773801+0000","last_active":"2024-09-12T18:36:01.456618+0000","last_peered":"2024-09-12T18:36:01.456618+0000","last_clean":"2024-09-12T18:36:01.456618+0000","last_became_active":"2024-09-12T18:35:44.772787+0000","last_became_peered":"2024-09-12T18:35:44.772787+0000","last_unstale":"2024-09-12T18:36:01.456618+0000","last_undegraded":"2024-09-12T18:36:01.456618+0000","last_fullsized":"2024-09-12T18:36:01.456618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":2737,"log_dups_size":0,"ondisk_log_size":2737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:13.758208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":179372032,"num_objects":2737,"num_object_clones":0,"num_object_copies":5474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2737,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2737,"num_write_kb":175168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.459235+0000","last_change":"2024-09-12T18:35:24.649669+0000","last_active":"2024-09-12T18:36:01.459235+0000","last_peered":"2024-09-12T18:36:01.459235+0000","last_clean":"2024-09-12T18:36:01.459235+0000","last_became_active":"2024-09-12T18:35:24.648881+0000","last_became_peered":"2024-09-12T18:35:24.648881+0000","last_unstale":"2024-09-12T18:36:01.459235+0000","last_undegraded":"2024-09-12T18:36:01.459235+0000","last_fullsized":"2024-09-12T18:36:01.459235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:23.614734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468782+0000","last_change":"2024-09-12T18:35:22.458666+0000","last_active":"2024-09-12T18:36:03.468782+0000","last_peered":"2024-09-12T18:36:03.468782+0000","last_clean":"2024-09-12T18:36:03.468782+0000","last_became_active":"2024-09-12T18:35:20.442394+0000","last_became_peered":"2024-09-12T18:35:20.442394+0000","last_unstale":"2024-09-12T18:36:03.468782+0000","last_undegraded":"2024-09-12T18:36:03.468782+0000","last_fullsized":"2024-09-12T18:36:03.468782+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:51.840246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080163599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.467781+0000","last_change":"2024-09-12T18:35:25.650717+0000","last_active":"2024-09-12T18:36:03.467781+0000","last_peered":"2024-09-12T18:36:03.467781+0000","last_clean":"2024-09-12T18:36:03.467781+0000","last_became_active":"2024-09-12T18:35:25.649147+0000","last_became_peered":"2024-09-12T18:35:25.649147+0000","last_unstale":"2024-09-12T18:36:03.467781+0000","last_undegraded":"2024-09-12T18:36:03.467781+0000","last_fullsized":"2024-09-12T18:36:03.467781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:07.365888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"31'2761","reported_seq":2790,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.460166+0000","last_change":"2024-09-12T18:35:44.774031+0000","last_active":"2024-09-12T18:36:01.460166+0000","last_peered":"2024-09-12T18:36:01.460166+0000","last_clean":"2024-09-12T18:36:01.460166+0000","last_became_active":"2024-09-12T18:35:44.772874+0000","last_became_peered":"2024-09-12T18:35:44.772874+0000","last_unstale":"2024-09-12T18:36:01.460166+0000","last_undegraded":"2024-09-12T18:36:01.460166+0000","last_fullsized":"2024-09-12T18:36:01.460166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":2761,"log_dups_size":0,"ondisk_log_size":2761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:27.897491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180944896,"num_objects":2761,"num_object_clones":0,"num_object_copies":5522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2761,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2761,"num_write_kb":176704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458608+0000","last_change":"2024-09-12T18:35:24.657234+0000","last_active":"2024-09-12T18:36:01.458608+0000","last_peered":"2024-09-12T18:36:01.458608+0000","last_clean":"2024-09-12T18:36:01.458608+0000","last_became_active":"2024-09-12T18:35:24.655950+0000","last_became_peered":"2024-09-12T18:35:24.655950+0000","last_unstale":"2024-09-12T18:36:01.458608+0000","last_undegraded":"2024-09-12T18:36:01.458608+0000","last_fullsized":"2024-09-12T18:36:01.458608+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:17.466623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458860+0000","last_change":"2024-09-12T18:35:22.464656+0000","last_active":"2024-09-12T18:36:01.458860+0000","last_peered":"2024-09-12T18:36:01.458860+0000","last_clean":"2024-09-12T18:36:01.458860+0000","last_became_active":"2024-09-12T18:35:20.445470+0000","last_became_peered":"2024-09-12T18:35:20.445470+0000","last_unstale":"2024-09-12T18:36:01.458860+0000","last_undegraded":"2024-09-12T18:36:01.458860+0000","last_fullsized":"2024-09-12T18:36:01.458860+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:58.947359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001742681,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457772+0000","last_change":"2024-09-12T18:35:25.658887+0000","last_active":"2024-09-12T18:36:01.457772+0000","last_peered":"2024-09-12T18:36:01.457772+0000","last_clean":"2024-09-12T18:36:01.457772+0000","last_became_active":"2024-09-12T18:35:25.656829+0000","last_became_peered":"2024-09-12T18:35:25.656829+0000","last_unstale":"2024-09-12T18:36:01.457772+0000","last_undegraded":"2024-09-12T18:36:01.457772+0000","last_fullsized":"2024-09-12T18:36:01.457772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:50.109858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"32'3032","reported_seq":3065,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468970+0000","last_change":"2024-09-12T18:35:44.767276+0000","last_active":"2024-09-12T18:36:03.468970+0000","last_peered":"2024-09-12T18:36:03.468970+0000","last_clean":"2024-09-12T18:36:03.468970+0000","last_became_active":"2024-09-12T18:35:44.766145+0000","last_became_peered":"2024-09-12T18:35:44.766145+0000","last_unstale":"2024-09-12T18:36:03.468970+0000","last_undegraded":"2024-09-12T18:36:03.468970+0000","last_fullsized":"2024-09-12T18:36:03.468970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3032,"log_dups_size":0,"ondisk_log_size":3032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:47.423493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198705152,"num_objects":3032,"num_object_clones":0,"num_object_copies":6064,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3032,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3032,"num_write_kb":194048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458860+0000","last_change":"2024-09-12T18:35:24.654518+0000","last_active":"2024-09-12T18:36:01.458860+0000","last_peered":"2024-09-12T18:36:01.458860+0000","last_clean":"2024-09-12T18:36:01.458860+0000","last_became_active":"2024-09-12T18:35:24.650309+0000","last_became_peered":"2024-09-12T18:35:24.650309+0000","last_unstale":"2024-09-12T18:36:01.458860+0000","last_undegraded":"2024-09-12T18:36:01.458860+0000","last_fullsized":"2024-09-12T18:36:01.458860+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:16.669035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.460165+0000","last_change":"2024-09-12T18:35:22.459767+0000","last_active":"2024-09-12T18:36:01.460165+0000","last_peered":"2024-09-12T18:36:01.460165+0000","last_clean":"2024-09-12T18:36:01.460165+0000","last_became_active":"2024-09-12T18:35:20.448521+0000","last_became_peered":"2024-09-12T18:35:20.448521+0000","last_unstale":"2024-09-12T18:36:01.460165+0000","last_undegraded":"2024-09-12T18:36:01.460165+0000","last_fullsized":"2024-09-12T18:36:01.460165+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:33.463792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017009670000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.467597+0000","last_change":"2024-09-12T18:35:25.648150+0000","last_active":"2024-09-12T18:36:03.467597+0000","last_peered":"2024-09-12T18:36:03.467597+0000","last_clean":"2024-09-12T18:36:03.467597+0000","last_became_active":"2024-09-12T18:35:25.647347+0000","last_became_peered":"2024-09-12T18:35:25.647347+0000","last_unstale":"2024-09-12T18:36:03.467597+0000","last_undegraded":"2024-09-12T18:36:03.467597+0000","last_fullsized":"2024-09-12T18:36:03.467597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:48.968336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.456973+0000","last_change":"2024-09-12T18:35:25.660696+0000","last_active":"2024-09-12T18:36:01.456973+0000","last_peered":"2024-09-12T18:36:01.456973+0000","last_clean":"2024-09-12T18:36:01.456973+0000","last_became_active":"2024-09-12T18:35:25.659827+0000","last_became_peered":"2024-09-12T18:35:25.659827+0000","last_unstale":"2024-09-12T18:36:01.456973+0000","last_undegraded":"2024-09-12T18:36:01.456973+0000","last_fullsized":"2024-09-12T18:36:01.456973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:15.678289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457552+0000","last_change":"2024-09-12T18:35:24.655051+0000","last_active":"2024-09-12T18:36:01.457552+0000","last_peered":"2024-09-12T18:36:01.457552+0000","last_clean":"2024-09-12T18:36:01.457552+0000","last_became_active":"2024-09-12T18:35:24.654282+0000","last_became_peered":"2024-09-12T18:35:24.654282+0000","last_unstale":"2024-09-12T18:36:01.457552+0000","last_undegraded":"2024-09-12T18:36:01.457552+0000","last_fullsized":"2024-09-12T18:36:01.457552+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:08.159799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457575+0000","last_change":"2024-09-12T18:35:25.659237+0000","last_active":"2024-09-12T18:36:01.457575+0000","last_peered":"2024-09-12T18:36:01.457575+0000","last_clean":"2024-09-12T18:36:01.457575+0000","last_became_active":"2024-09-12T18:35:25.658423+0000","last_became_peered":"2024-09-12T18:35:25.658423+0000","last_unstale":"2024-09-12T18:36:01.457575+0000","last_undegraded":"2024-09-12T18:36:01.457575+0000","last_fullsized":"2024-09-12T18:36:01.457575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:42.956934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468426+0000","last_change":"2024-09-12T18:35:24.648658+0000","last_active":"2024-09-12T18:36:03.468426+0000","last_peered":"2024-09-12T18:36:03.468426+0000","last_clean":"2024-09-12T18:36:03.468426+0000","last_became_active":"2024-09-12T18:35:24.647826+0000","last_became_peered":"2024-09-12T18:35:24.647826+0000","last_unstale":"2024-09-12T18:36:03.468426+0000","last_undegraded":"2024-09-12T18:36:03.468426+0000","last_fullsized":"2024-09-12T18:36:03.468426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:24.167549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.459646+0000","last_change":"2024-09-12T18:35:24.656855+0000","last_active":"2024-09-12T18:36:01.459646+0000","last_peered":"2024-09-12T18:36:01.459646+0000","last_clean":"2024-09-12T18:36:01.459646+0000","last_became_active":"2024-09-12T18:35:24.655935+0000","last_became_peered":"2024-09-12T18:35:24.655935+0000","last_unstale":"2024-09-12T18:36:01.459646+0000","last_undegraded":"2024-09-12T18:36:01.459646+0000","last_fullsized":"2024-09-12T18:36:01.459646+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:35.430065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457328+0000","last_change":"2024-09-12T18:35:25.661801+0000","last_active":"2024-09-12T18:36:01.457328+0000","last_peered":"2024-09-12T18:36:01.457328+0000","last_clean":"2024-09-12T18:36:01.457328+0000","last_became_active":"2024-09-12T18:35:25.658476+0000","last_became_peered":"2024-09-12T18:35:25.658476+0000","last_unstale":"2024-09-12T18:36:01.457328+0000","last_undegraded":"2024-09-12T18:36:01.457328+0000","last_fullsized":"2024-09-12T18:36:01.457328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:58.246449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458519+0000","last_change":"2024-09-12T18:35:24.652399+0000","last_active":"2024-09-12T18:36:01.458519+0000","last_peered":"2024-09-12T18:36:01.458519+0000","last_clean":"2024-09-12T18:36:01.458519+0000","last_became_active":"2024-09-12T18:35:24.651416+0000","last_became_peered":"2024-09-12T18:35:24.651416+0000","last_unstale":"2024-09-12T18:36:01.458519+0000","last_undegraded":"2024-09-12T18:36:01.458519+0000","last_fullsized":"2024-09-12T18:36:01.458519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:32.594978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458362+0000","last_change":"2024-09-12T18:35:25.658570+0000","last_active":"2024-09-12T18:36:01.458362+0000","last_peered":"2024-09-12T18:36:01.458362+0000","last_clean":"2024-09-12T18:36:01.458362+0000","last_became_active":"2024-09-12T18:35:25.656561+0000","last_became_peered":"2024-09-12T18:35:25.656561+0000","last_unstale":"2024-09-12T18:36:01.458362+0000","last_undegraded":"2024-09-12T18:36:01.458362+0000","last_fullsized":"2024-09-12T18:36:01.458362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:22.225756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468860+0000","last_change":"2024-09-12T18:35:25.651217+0000","last_active":"2024-09-12T18:36:03.468860+0000","last_peered":"2024-09-12T18:36:03.468860+0000","last_clean":"2024-09-12T18:36:03.468860+0000","last_became_active":"2024-09-12T18:35:25.649544+0000","last_became_peered":"2024-09-12T18:35:25.649544+0000","last_unstale":"2024-09-12T18:36:03.468860+0000","last_undegraded":"2024-09-12T18:36:03.468860+0000","last_fullsized":"2024-09-12T18:36:03.468860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:41.601376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457929+0000","last_change":"2024-09-12T18:35:24.657489+0000","last_active":"2024-09-12T18:36:01.457929+0000","last_peered":"2024-09-12T18:36:01.457929+0000","last_clean":"2024-09-12T18:36:01.457929+0000","last_became_active":"2024-09-12T18:35:24.656030+0000","last_became_peered":"2024-09-12T18:35:24.656030+0000","last_unstale":"2024-09-12T18:36:01.457929+0000","last_undegraded":"2024-09-12T18:36:01.457929+0000","last_fullsized":"2024-09-12T18:36:01.457929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:11.362759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458363+0000","last_change":"2024-09-12T18:35:25.661544+0000","last_active":"2024-09-12T18:36:01.458363+0000","last_peered":"2024-09-12T18:36:01.458363+0000","last_clean":"2024-09-12T18:36:01.458363+0000","last_became_active":"2024-09-12T18:35:25.656985+0000","last_became_peered":"2024-09-12T18:35:25.656985+0000","last_unstale":"2024-09-12T18:36:01.458363+0000","last_undegraded":"2024-09-12T18:36:01.458363+0000","last_fullsized":"2024-09-12T18:36:01.458363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457354+0000","last_change":"2024-09-12T18:35:24.646342+0000","last_active":"2024-09-12T18:36:01.457354+0000","last_peered":"2024-09-12T18:36:01.457354+0000","last_clean":"2024-09-12T18:36:01.457354+0000","last_became_active":"2024-09-12T18:35:24.644773+0000","last_became_peered":"2024-09-12T18:35:24.644773+0000","last_unstale":"2024-09-12T18:36:01.457354+0000","last_undegraded":"2024-09-12T18:36:01.457354+0000","last_fullsized":"2024-09-12T18:36:01.457354+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:17.011231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.467975+0000","last_change":"2024-09-12T18:35:25.656712+0000","last_active":"2024-09-12T18:36:03.467975+0000","last_peered":"2024-09-12T18:36:03.467975+0000","last_clean":"2024-09-12T18:36:03.467975+0000","last_became_active":"2024-09-12T18:35:25.654473+0000","last_became_peered":"2024-09-12T18:35:25.654473+0000","last_unstale":"2024-09-12T18:36:03.467975+0000","last_undegraded":"2024-09-12T18:36:03.467975+0000","last_fullsized":"2024-09-12T18:36:03.467975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:01.464680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468116+0000","last_change":"2024-09-12T18:35:24.659935+0000","last_active":"2024-09-12T18:36:03.468116+0000","last_peered":"2024-09-12T18:36:03.468116+0000","last_clean":"2024-09-12T18:36:03.468116+0000","last_became_active":"2024-09-12T18:35:24.659111+0000","last_became_peered":"2024-09-12T18:35:24.659111+0000","last_unstale":"2024-09-12T18:36:03.468116+0000","last_undegraded":"2024-09-12T18:36:03.468116+0000","last_fullsized":"2024-09-12T18:36:03.468116+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:11.480154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468260+0000","last_change":"2024-09-12T18:35:25.660557+0000","last_active":"2024-09-12T18:36:03.468260+0000","last_peered":"2024-09-12T18:36:03.468260+0000","last_clean":"2024-09-12T18:36:03.468260+0000","last_became_active":"2024-09-12T18:35:25.652300+0000","last_became_peered":"2024-09-12T18:35:25.652300+0000","last_unstale":"2024-09-12T18:36:03.468260+0000","last_undegraded":"2024-09-12T18:36:03.468260+0000","last_fullsized":"2024-09-12T18:36:03.468260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:10:59.995841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468140+0000","last_change":"2024-09-12T18:35:24.638538+0000","last_active":"2024-09-12T18:36:03.468140+0000","last_peered":"2024-09-12T18:36:03.468140+0000","last_clean":"2024-09-12T18:36:03.468140+0000","last_became_active":"2024-09-12T18:35:24.637242+0000","last_became_peered":"2024-09-12T18:35:24.637242+0000","last_unstale":"2024-09-12T18:36:03.468140+0000","last_undegraded":"2024-09-12T18:36:03.468140+0000","last_fullsized":"2024-09-12T18:36:03.468140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:26.877441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.456837+0000","last_change":"2024-09-12T18:35:25.662537+0000","last_active":"2024-09-12T18:36:01.456837+0000","last_peered":"2024-09-12T18:36:01.456837+0000","last_clean":"2024-09-12T18:36:01.456837+0000","last_became_active":"2024-09-12T18:35:25.661441+0000","last_became_peered":"2024-09-12T18:35:25.661441+0000","last_unstale":"2024-09-12T18:36:01.456837+0000","last_undegraded":"2024-09-12T18:36:01.456837+0000","last_fullsized":"2024-09-12T18:36:01.456837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:14.397867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457447+0000","last_change":"2024-09-12T18:35:24.657635+0000","last_active":"2024-09-12T18:36:01.457447+0000","last_peered":"2024-09-12T18:36:01.457447+0000","last_clean":"2024-09-12T18:36:01.457447+0000","last_became_active":"2024-09-12T18:35:24.655992+0000","last_became_peered":"2024-09-12T18:35:24.655992+0000","last_unstale":"2024-09-12T18:36:01.457447+0000","last_undegraded":"2024-09-12T18:36:01.457447+0000","last_fullsized":"2024-09-12T18:36:01.457447+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:33.536755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457644+0000","last_change":"2024-09-12T18:35:25.651406+0000","last_active":"2024-09-12T18:36:01.457644+0000","last_peered":"2024-09-12T18:36:01.457644+0000","last_clean":"2024-09-12T18:36:01.457644+0000","last_became_active":"2024-09-12T18:35:25.649728+0000","last_became_peered":"2024-09-12T18:35:25.649728+0000","last_unstale":"2024-09-12T18:36:01.457644+0000","last_undegraded":"2024-09-12T18:36:01.457644+0000","last_fullsized":"2024-09-12T18:36:01.457644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:41.773283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468282+0000","last_change":"2024-09-12T18:35:24.649153+0000","last_active":"2024-09-12T18:36:03.468282+0000","last_peered":"2024-09-12T18:36:03.468282+0000","last_clean":"2024-09-12T18:36:03.468282+0000","last_became_active":"2024-09-12T18:35:24.648512+0000","last_became_peered":"2024-09-12T18:35:24.648512+0000","last_unstale":"2024-09-12T18:36:03.468282+0000","last_undegraded":"2024-09-12T18:36:03.468282+0000","last_fullsized":"2024-09-12T18:36:03.468282+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:07.810456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.467850+0000","last_change":"2024-09-12T18:35:25.656799+0000","last_active":"2024-09-12T18:36:03.467850+0000","last_peered":"2024-09-12T18:36:03.467850+0000","last_clean":"2024-09-12T18:36:03.467850+0000","last_became_active":"2024-09-12T18:35:25.654980+0000","last_became_peered":"2024-09-12T18:35:25.654980+0000","last_unstale":"2024-09-12T18:36:03.467850+0000","last_undegraded":"2024-09-12T18:36:03.467850+0000","last_fullsized":"2024-09-12T18:36:03.467850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:10.735439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458749+0000","last_change":"2024-09-12T18:35:24.656268+0000","last_active":"2024-09-12T18:36:01.458749+0000","last_peered":"2024-09-12T18:36:01.458749+0000","last_clean":"2024-09-12T18:36:01.458749+0000","last_became_active":"2024-09-12T18:35:24.655420+0000","last_became_peered":"2024-09-12T18:35:24.655420+0000","last_unstale":"2024-09-12T18:36:01.458749+0000","last_undegraded":"2024-09-12T18:36:01.458749+0000","last_fullsized":"2024-09-12T18:36:01.458749+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:04.654666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457205+0000","last_change":"2024-09-12T18:35:25.661042+0000","last_active":"2024-09-12T18:36:01.457205+0000","last_peered":"2024-09-12T18:36:01.457205+0000","last_clean":"2024-09-12T18:36:01.457205+0000","last_became_active":"2024-09-12T18:35:25.660163+0000","last_became_peered":"2024-09-12T18:35:25.660163+0000","last_unstale":"2024-09-12T18:36:01.457205+0000","last_undegraded":"2024-09-12T18:36:01.457205+0000","last_fullsized":"2024-09-12T18:36:01.457205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:37.682184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458405+0000","last_change":"2024-09-12T18:35:24.652304+0000","last_active":"2024-09-12T18:36:01.458405+0000","last_peered":"2024-09-12T18:36:01.458405+0000","last_clean":"2024-09-12T18:36:01.458405+0000","last_became_active":"2024-09-12T18:35:24.651460+0000","last_became_peered":"2024-09-12T18:35:24.651460+0000","last_unstale":"2024-09-12T18:36:01.458405+0000","last_undegraded":"2024-09-12T18:36:01.458405+0000","last_fullsized":"2024-09-12T18:36:01.458405+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:42.050557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":3015442432,"num_objects":46012,"num_object_clones":0,"num_object_copies":92024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46012,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46012,"num_write_kb":2944768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":373264384,"data_stored":5972230144,"data_compressed":283591221,"data_compressed_allocated":373264384,"data_compressed_original":5972230144,"omap_allocated":0,"internal_metadata":0},"log_size":46012,"ondisk_log_size":46012,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705677,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":165392,"kb_used_data":107832,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94206448,"statfs":{"total":96636764160,"available":96467402752,"internally_reserved":0,"allocated":110419968,"data_stored":1760877616,"data_compressed":83616205,"data_compressed_allocated":110055424,"data_compressed_original":1760739328,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,1,3,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738381,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":163976,"kb_used_data":110584,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94207864,"statfs":{"total":96636764160,"available":96468852736,"internally_reserved":0,"allocated":113238016,"data_stored":1806154465,"data_compressed":85766509,"data_compressed_allocated":112885760,"data_compressed_original":1806024704,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738381,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":213288,"kb_used_data":141848,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94158552,"statfs":{"total":96636764160,"available":96418357248,"internally_reserved":0,"allocated":145252352,"data_stored":2319233471,"data_compressed":110123431,"data_compressed_allocated":144945152,"data_compressed_original":2319122432,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,2,1,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":146882560,"data_stored":2350120960,"data_compressed":111595407,"data_compressed_allocated":146882560,"data_compressed_original":2350120960,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":112922624,"data_stored":1806761984,"data_compressed":85794115,"data_compressed_allocated":112922624,"data_compressed_original":1806761984,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":113459200,"data_stored":1815347200,"data_compressed":86201699,"data_compressed_allocated":113459200,"data_compressed_original":1815347200,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:36:05.204 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-12T18:36:05.205 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:36:05.205 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-12T18:36:05.205 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T18:36:05.243 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:05.236+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:05.294 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:05.294 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:36:05.295 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.295 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:53168 5.0 e34/21 5:04a388e8:::benchmark_data_smithi073_23739_object53167:head v 34'3305, mlcod=34'3302)", 2024-09-12T18:36:05.295 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:05.286526+0000", 2024-09-12T18:36:05.295 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.006096728, 2024-09-12T18:36:05.295 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0061106190000000003, 2024-09-12T18:36:05.295 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:05.295 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:05.295 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:05.295 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:05.295 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.295 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:05.296 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.286526+0000", 2024-09-12T18:36:05.296 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:05.296 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.296 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.296 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:05.296 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.286526+0000", 2024-09-12T18:36:05.296 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:05.296 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.296 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.296 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:05.296 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.286526+0000", 2024-09-12T18:36:05.296 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8299999999999998e-07 2024-09-12T18:36:05.296 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.296 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.297 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:05.297 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.286605+0000", 2024-09-12T18:36:05.297 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8929000000000003e-05 2024-09-12T18:36:05.297 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.297 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.297 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:05.297 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.286614+0000", 2024-09-12T18:36:05.297 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.3839999999999997e-06 2024-09-12T18:36:05.297 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.297 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.297 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:05.297 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.286620+0000", 2024-09-12T18:36:05.297 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8900000000000004e-06 2024-09-12T18:36:05.298 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.298 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.298 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:05.298 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.286671+0000", 2024-09-12T18:36:05.298 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1017999999999998e-05 2024-09-12T18:36:05.298 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.298 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.298 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:05.298 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.286690+0000", 2024-09-12T18:36:05.298 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9188e-05 2024-09-12T18:36:05.298 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:05.298 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:05.298 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:05.298 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.299 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.299 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:53169 5.c 5:388f69c6:::benchmark_data_smithi073_23739_object53168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:36:05.299 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:05.286721+0000", 2024-09-12T18:36:05.299 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0059019780000000004, 2024-09-12T18:36:05.299 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0059754580000000003, 2024-09-12T18:36:05.299 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:05.299 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:05.299 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:05.299 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:05.299 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:05.299 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:05.299 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 53169 2024-09-12T18:36:05.299 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.299 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:05.300 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.300 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:05.300 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.286721+0000", 2024-09-12T18:36:05.300 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:05.300 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.300 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.300 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:05.300 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.286721+0000", 2024-09-12T18:36:05.300 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:05.300 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.300 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.300 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:05.300 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.286722+0000", 2024-09-12T18:36:05.300 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2130000000000001e-06 2024-09-12T18:36:05.301 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.301 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.301 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:05.301 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.286773+0000", 2024-09-12T18:36:05.301 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1261000000000003e-05 2024-09-12T18:36:05.301 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.301 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.301 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:05.301 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.286789+0000", 2024-09-12T18:36:05.301 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5905000000000001e-05 2024-09-12T18:36:05.301 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.301 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.301 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:05.302 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.286796+0000", 2024-09-12T18:36:05.302 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3189999999999997e-06 2024-09-12T18:36:05.302 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.302 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.302 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:05.302 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.286837+0000", 2024-09-12T18:36:05.302 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0586000000000001e-05 2024-09-12T18:36:05.302 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.302 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.302 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:05.302 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.286950+0000", 2024-09-12T18:36:05.302 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000112775 2024-09-12T18:36:05.302 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.302 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.303 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:05.303 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.287069+0000", 2024-09-12T18:36:05.303 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00011873 2024-09-12T18:36:05.303 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.303 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.303 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:05.303 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.291434+0000", 2024-09-12T18:36:05.303 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0043657219999999998 2024-09-12T18:36:05.303 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:05.303 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:05.303 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:05.303 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.303 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.303 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:53170 5.5 5:a44aacca:::benchmark_data_smithi073_23739_object53169:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:36:05.303 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:05.287624+0000", 2024-09-12T18:36:05.304 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0049986229999999998, 2024-09-12T18:36:05.304 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0051483079999999999, 2024-09-12T18:36:05.304 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:05.304 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:05.304 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:05.304 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:05.304 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:05.304 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:05.304 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 53170 2024-09-12T18:36:05.304 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.304 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:05.304 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.304 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:05.304 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.287624+0000", 2024-09-12T18:36:05.305 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:05.305 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.305 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.305 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:05.305 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.287624+0000", 2024-09-12T18:36:05.305 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:05.305 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.305 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.305 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:05.305 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.287625+0000", 2024-09-12T18:36:05.305 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.3500000000000005e-07 2024-09-12T18:36:05.305 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.305 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.306 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:05.306 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.287687+0000", 2024-09-12T18:36:05.306 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2021999999999997e-05 2024-09-12T18:36:05.306 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.306 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.306 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:05.306 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.287696+0000", 2024-09-12T18:36:05.306 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.9160000000000007e-06 2024-09-12T18:36:05.306 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.306 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.306 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:05.307 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.287703+0000", 2024-09-12T18:36:05.307 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3769999999999998e-06 2024-09-12T18:36:05.307 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.307 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.307 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:05.307 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.287754+0000", 2024-09-12T18:36:05.307 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0983999999999998e-05 2024-09-12T18:36:05.307 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.307 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.307 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:05.307 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.287870+0000", 2024-09-12T18:36:05.307 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000115982 2024-09-12T18:36:05.307 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.308 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.308 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:05.308 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.287991+0000", 2024-09-12T18:36:05.308 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000120765 2024-09-12T18:36:05.308 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.308 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.308 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:05.308 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.291591+0000", 2024-09-12T18:36:05.308 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.003600341 2024-09-12T18:36:05.308 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:05.308 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:05.308 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:05.308 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.308 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.309 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:53174 5.1 e34/21 5:8d9a7723:::benchmark_data_smithi073_23739_object53173:head v 34'3315, mlcod=34'3313)", 2024-09-12T18:36:05.309 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:05.289337+0000", 2024-09-12T18:36:05.309 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0032853539999999999, 2024-09-12T18:36:05.309 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0034977620000000002, 2024-09-12T18:36:05.309 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:05.309 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:05.309 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:05.309 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:05.310 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.310 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:05.310 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.289337+0000", 2024-09-12T18:36:05.310 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:05.310 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.310 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.310 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:05.310 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.289337+0000", 2024-09-12T18:36:05.310 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:05.310 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.310 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.310 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:05.310 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.289338+0000", 2024-09-12T18:36:05.311 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7400000000000003e-07 2024-09-12T18:36:05.311 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.311 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.311 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:05.311 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.289386+0000", 2024-09-12T18:36:05.311 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8368999999999997e-05 2024-09-12T18:36:05.311 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.311 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.311 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:05.311 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.289396+0000", 2024-09-12T18:36:05.311 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0189e-05 2024-09-12T18:36:05.311 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.312 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.312 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:05.312 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.289401+0000", 2024-09-12T18:36:05.312 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9420000000000003e-06 2024-09-12T18:36:05.312 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.312 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.312 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:05.312 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.289466+0000", 2024-09-12T18:36:05.312 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4704999999999998e-05 2024-09-12T18:36:05.312 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.312 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.312 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:05.312 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.289484+0000", 2024-09-12T18:36:05.313 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7813e-05 2024-09-12T18:36:05.313 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:05.313 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:05.313 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:05.313 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.313 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.313 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:53175 5.b e34/21 5:dba4b944:::benchmark_data_smithi073_23739_object53174:head v 34'3384, mlcod=34'3380)", 2024-09-12T18:36:05.313 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:05.289445+0000", 2024-09-12T18:36:05.313 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0031774910000000002, 2024-09-12T18:36:05.313 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.003436167, 2024-09-12T18:36:05.313 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:05.313 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:05.314 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:05.314 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:05.314 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.314 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:05.314 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.289445+0000", 2024-09-12T18:36:05.314 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:05.314 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.314 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.314 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:05.314 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.289445+0000", 2024-09-12T18:36:05.314 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:05.314 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.314 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.315 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:05.315 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.289446+0000", 2024-09-12T18:36:05.315 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5600000000000005e-07 2024-09-12T18:36:05.315 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.315 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.315 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:05.315 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.289496+0000", 2024-09-12T18:36:05.315 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0179000000000002e-05 2024-09-12T18:36:05.315 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.315 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.315 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:05.315 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.289506+0000", 2024-09-12T18:36:05.315 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.5419999999999994e-06 2024-09-12T18:36:05.316 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.316 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.316 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:05.316 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.289512+0000", 2024-09-12T18:36:05.316 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.156e-06 2024-09-12T18:36:05.316 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.316 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.316 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:05.316 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.291309+0000", 2024-09-12T18:36:05.316 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00179718 2024-09-12T18:36:05.316 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.316 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.317 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:05.317 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.291327+0000", 2024-09-12T18:36:05.317 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7968000000000001e-05 2024-09-12T18:36:05.317 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:05.317 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:05.317 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:05.317 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.317 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.317 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:53176 5.0 e34/21 5:072944ad:::benchmark_data_smithi073_23739_object53175:head v 34'3306, mlcod=34'3302)", 2024-09-12T18:36:05.317 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:05.290224+0000", 2024-09-12T18:36:05.317 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0023987190000000001, 2024-09-12T18:36:05.317 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0027077310000000001, 2024-09-12T18:36:05.317 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:05.318 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:05.318 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:05.318 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:05.318 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.318 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:05.318 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.290224+0000", 2024-09-12T18:36:05.318 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:05.318 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.318 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.318 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:05.318 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.290224+0000", 2024-09-12T18:36:05.318 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:05.318 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.319 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.319 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:05.319 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.290225+0000", 2024-09-12T18:36:05.319 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8899999999999999e-07 2024-09-12T18:36:05.319 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.319 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.319 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:05.319 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.290278+0000", 2024-09-12T18:36:05.319 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.3032999999999999e-05 2024-09-12T18:36:05.319 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.319 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.319 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:05.320 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.290286+0000", 2024-09-12T18:36:05.320 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0220000000000004e-06 2024-09-12T18:36:05.320 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.320 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.320 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:05.320 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.290290+0000", 2024-09-12T18:36:05.320 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3000000000000003e-06 2024-09-12T18:36:05.320 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.320 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.320 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:05.320 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.291436+0000", 2024-09-12T18:36:05.320 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0011460509999999999 2024-09-12T18:36:05.321 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.321 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.321 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:05.321 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.291452+0000", 2024-09-12T18:36:05.321 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5769000000000001e-05 2024-09-12T18:36:05.321 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:05.321 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:05.321 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:05.321 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.321 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.321 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:53173 5.7 e34/21 5:e2c12be5:::benchmark_data_smithi073_23739_object53172:head v 34'3292, mlcod=34'3289)", 2024-09-12T18:36:05.321 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:05.290893+0000", 2024-09-12T18:36:05.321 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.001729995, 2024-09-12T18:36:05.321 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0020837009999999999, 2024-09-12T18:36:05.322 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:05.322 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:05.322 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:05.322 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:05.322 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.322 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:05.322 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.290893+0000", 2024-09-12T18:36:05.322 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:05.322 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.322 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.322 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:05.322 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.290893+0000", 2024-09-12T18:36:05.322 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:05.322 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.323 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.323 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:05.323 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.290893+0000", 2024-09-12T18:36:05.323 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8800000000000003e-07 2024-09-12T18:36:05.323 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.323 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.323 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:05.323 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.290946+0000", 2024-09-12T18:36:05.323 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.3087999999999997e-05 2024-09-12T18:36:05.323 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.323 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.323 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:05.323 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.290954+0000", 2024-09-12T18:36:05.323 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.537e-06 2024-09-12T18:36:05.324 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.324 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.324 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:05.324 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.290957+0000", 2024-09-12T18:36:05.324 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.6119999999999999e-06 2024-09-12T18:36:05.324 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.324 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.324 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:05.324 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.291321+0000", 2024-09-12T18:36:05.324 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00036350800000000002 2024-09-12T18:36:05.324 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.324 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.325 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:05.325 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.291346+0000", 2024-09-12T18:36:05.325 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.5018999999999999e-05 2024-09-12T18:36:05.325 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:05.325 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:05.325 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:05.325 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.325 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.325 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:53177 5.b e34/21 5:dffe2029:::benchmark_data_smithi073_23739_object53176:head v 34'3385, mlcod=34'3381)", 2024-09-12T18:36:05.325 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:05.292125+0000", 2024-09-12T18:36:05.325 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00049735299999999997, 2024-09-12T18:36:05.325 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000897571, 2024-09-12T18:36:05.325 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:05.325 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:05.326 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:05.326 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:05.326 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.326 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:05.326 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.292125+0000", 2024-09-12T18:36:05.326 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:05.326 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.326 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.326 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:05.326 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.292125+0000", 2024-09-12T18:36:05.326 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:05.326 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.327 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.327 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:05.327 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.292126+0000", 2024-09-12T18:36:05.327 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8299999999999996e-07 2024-09-12T18:36:05.327 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.327 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.327 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:05.327 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.292172+0000", 2024-09-12T18:36:05.327 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5362999999999999e-05 2024-09-12T18:36:05.327 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.327 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.327 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:05.327 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.292195+0000", 2024-09-12T18:36:05.327 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.3640999999999999e-05 2024-09-12T18:36:05.328 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.328 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.328 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:05.328 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.292201+0000", 2024-09-12T18:36:05.328 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2910000000000004e-06 2024-09-12T18:36:05.328 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.328 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.328 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:05.328 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.292881+0000", 2024-09-12T18:36:05.328 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00067976099999999997 2024-09-12T18:36:05.328 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.328 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.329 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:05.329 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.292898+0000", 2024-09-12T18:36:05.329 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7244e-05 2024-09-12T18:36:05.329 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:05.329 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:05.329 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:05.329 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.329 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.329 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:53180 5.0 e34/21 5:0c262550:::benchmark_data_smithi073_23739_object53179:head v 34'3307, mlcod=34'3303)", 2024-09-12T18:36:05.329 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:05.292404+0000", 2024-09-12T18:36:05.329 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00021892799999999999, 2024-09-12T18:36:05.329 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00066309599999999995, 2024-09-12T18:36:05.329 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:05.329 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:05.330 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:05.330 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:05.330 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.330 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:05.330 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.292404+0000", 2024-09-12T18:36:05.330 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:05.330 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.330 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.330 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:05.330 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.292404+0000", 2024-09-12T18:36:05.330 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:05.330 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.330 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.331 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:05.331 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.292404+0000", 2024-09-12T18:36:05.331 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.3300000000000002e-07 2024-09-12T18:36:05.331 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.331 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.331 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:05.331 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.292488+0000", 2024-09-12T18:36:05.331 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.3252999999999997e-05 2024-09-12T18:36:05.331 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.331 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.331 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:05.331 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.292497+0000", 2024-09-12T18:36:05.331 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.329e-06 2024-09-12T18:36:05.331 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.332 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.332 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:05.332 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.292504+0000", 2024-09-12T18:36:05.332 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.114e-06 2024-09-12T18:36:05.332 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.332 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.332 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:05.332 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.292844+0000", 2024-09-12T18:36:05.332 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00034012799999999998 2024-09-12T18:36:05.332 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.332 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.332 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:05.333 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.292862+0000", 2024-09-12T18:36:05.333 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7799e-05 2024-09-12T18:36:05.333 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:05.333 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:05.333 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:05.333 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.333 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.333 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:53179 5.e e34/21 5:741d8478:::benchmark_data_smithi073_23739_object53178:head v 34'3343, mlcod=34'3341)", 2024-09-12T18:36:05.333 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:05.292578+0000", 2024-09-12T18:36:05.333 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4.4325e-05, 2024-09-12T18:36:05.333 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00053246299999999995, 2024-09-12T18:36:05.333 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:05.333 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:05.334 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:05.334 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:05.334 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.334 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:05.334 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.292578+0000", 2024-09-12T18:36:05.334 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:05.334 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.334 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.334 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:05.334 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.292578+0000", 2024-09-12T18:36:05.334 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:05.334 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.334 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.334 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:05.335 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.292579+0000", 2024-09-12T18:36:05.335 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2200000000000004e-07 2024-09-12T18:36:05.335 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.335 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.335 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:05.335 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.292615+0000", 2024-09-12T18:36:05.335 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.5994000000000001e-05 2024-09-12T18:36:05.335 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.335 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.335 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:05.335 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.292623+0000", 2024-09-12T18:36:05.335 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6469999999999998e-06 2024-09-12T18:36:05.335 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.335 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.336 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:05.336 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.292628+0000", 2024-09-12T18:36:05.336 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7490000000000004e-06 2024-09-12T18:36:05.336 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.336 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.336 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:05.336 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.292679+0000", 2024-09-12T18:36:05.336 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0343999999999998e-05 2024-09-12T18:36:05.336 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.336 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.336 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:05.336 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.292697+0000", 2024-09-12T18:36:05.336 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8529000000000002e-05 2024-09-12T18:36:05.336 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:05.337 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:05.337 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:05.337 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.337 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.337 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:53182 5.1 e34/21 5:8b82d4db:::benchmark_data_smithi073_23739_object53181:head v 34'3316, mlcod=34'3313)", 2024-09-12T18:36:05.337 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:05.292777+0000", 2024-09-12T18:36:05.337 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4294967295.9998455, 2024-09-12T18:36:05.337 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000378549, 2024-09-12T18:36:05.337 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:05.337 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:05.337 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:05.337 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:05.337 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.338 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:05.338 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.292777+0000", 2024-09-12T18:36:05.338 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:05.338 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.338 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.338 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:05.338 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.292777+0000", 2024-09-12T18:36:05.338 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:05.338 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.338 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.338 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:05.338 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.292778+0000", 2024-09-12T18:36:05.338 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7700000000000004e-07 2024-09-12T18:36:05.339 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.339 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.339 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:05.339 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.292812+0000", 2024-09-12T18:36:05.339 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3793e-05 2024-09-12T18:36:05.339 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.339 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.339 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:05.339 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.292820+0000", 2024-09-12T18:36:05.339 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0979999999999994e-06 2024-09-12T18:36:05.339 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.339 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.340 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:05.340 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.292825+0000", 2024-09-12T18:36:05.340 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6500000000000001e-06 2024-09-12T18:36:05.340 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.340 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.340 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:05.340 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.292897+0000", 2024-09-12T18:36:05.340 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1964000000000004e-05 2024-09-12T18:36:05.340 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.340 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.340 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:05.340 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.292917+0000", 2024-09-12T18:36:05.340 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9522999999999999e-05 2024-09-12T18:36:05.341 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:05.341 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:05.341 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:05.341 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.341 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.341 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:53166 5.b e34/21 5:d49224f7:::benchmark_data_smithi073_23739_object53165:head v 34'3383, mlcod=34'3380)", 2024-09-12T18:36:05.341 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:05.286407+0000", 2024-09-12T18:36:05.341 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.006216119, 2024-09-12T18:36:05.341 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0067939790000000003, 2024-09-12T18:36:05.341 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:05.341 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:05.341 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:05.342 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:05.342 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.342 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:05.342 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.286407+0000", 2024-09-12T18:36:05.342 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:05.342 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.342 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.342 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:05.342 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.286407+0000", 2024-09-12T18:36:05.342 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:05.342 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.342 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.342 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:05.343 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.286407+0000", 2024-09-12T18:36:05.343 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0600000000000001e-07 2024-09-12T18:36:05.343 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.343 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.343 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:05.343 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.286474+0000", 2024-09-12T18:36:05.343 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7176999999999997e-05 2024-09-12T18:36:05.343 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.343 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.343 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:05.343 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.286484+0000", 2024-09-12T18:36:05.343 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.6730000000000004e-06 2024-09-12T18:36:05.344 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.344 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.344 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:05.344 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.286489+0000", 2024-09-12T18:36:05.344 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5079999999999996e-06 2024-09-12T18:36:05.344 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.344 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.344 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:05.344 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.288032+0000", 2024-09-12T18:36:05.344 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0015430839999999999 2024-09-12T18:36:05.344 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:05.344 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:05.344 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:05.345 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.288051+0000", 2024-09-12T18:36:05.345 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8529000000000002e-05 2024-09-12T18:36:05.345 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:05.345 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:05.345 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:05.345 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:05.345 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-12T18:36:05.345 INFO:teuthology.orchestra.run.smithi114.stdout: "num_ops": 12 2024-09-12T18:36:05.345 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:05.348 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:36:05.349 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:05.341+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:05.442 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:36:05.447 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:05.445+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:05.542 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:05.542 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2024-09-12T18:36:05.542 INFO:teuthology.orchestra.run.smithi114.stdout: "complaint_time": 30, 2024-09-12T18:36:05.542 INFO:teuthology.orchestra.run.smithi114.stdout: "num_blocked_ops": 0 2024-09-12T18:36:05.542 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:05.548 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:05.545+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:05.552 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:36:05.552 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T18:36:05.552 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 34, 2024-09-12T18:36:05.552 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "c08d5a84-711b-44bf-bdf1-e06ecc2c7c00", 2024-09-12T18:36:05.552 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-12T18:35:02.695853+0000", 2024-09-12T18:36:05.552 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-12T18:36:04.464662+0000", 2024-09-12T18:36:05.552 INFO:teuthology.orchestra.run.smithi073.stdout: "last_up_change": "2024-09-12T18:35:12.464628+0000", 2024-09-12T18:36:05.552 INFO:teuthology.orchestra.run.smithi073.stdout: "last_in_change": "2024-09-12T18:35:04.352525+0000", 2024-09-12T18:36:05.553 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T18:36:05.553 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_num": 5799936, 2024-09-12T18:36:05.553 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_set": [ 2024-09-12T18:36:05.553 INFO:teuthology.orchestra.run.smithi073.stdout: "pglog_hardlimit", 2024-09-12T18:36:05.553 INFO:teuthology.orchestra.run.smithi073.stdout: "purged_snapdirs", 2024-09-12T18:36:05.553 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_deletes", 2024-09-12T18:36:05.553 INFO:teuthology.orchestra.run.smithi073.stdout: "sortbitwise" 2024-09-12T18:36:05.553 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T18:36:05.554 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_version": 5, 2024-09-12T18:36:05.554 INFO:teuthology.orchestra.run.smithi073.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T18:36:05.554 INFO:teuthology.orchestra.run.smithi073.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T18:36:05.554 INFO:teuthology.orchestra.run.smithi073.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T18:36:05.554 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_snapshot": "", 2024-09-12T18:36:05.554 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_max": 5, 2024-09-12T18:36:05.554 INFO:teuthology.orchestra.run.smithi073.stdout: "max_osd": 3, 2024-09-12T18:36:05.554 INFO:teuthology.orchestra.run.smithi073.stdout: "require_min_compat_client": "luminous", 2024-09-12T18:36:05.554 INFO:teuthology.orchestra.run.smithi073.stdout: "min_compat_client": "jewel", 2024-09-12T18:36:05.555 INFO:teuthology.orchestra.run.smithi073.stdout: "require_osd_release": "squid", 2024-09-12T18:36:05.555 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_crimson": false, 2024-09-12T18:36:05.555 INFO:teuthology.orchestra.run.smithi073.stdout: "pools": [ 2024-09-12T18:36:05.555 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:05.555 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 1, 2024-09-12T18:36:05.555 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": ".mgr", 2024-09-12T18:36:05.555 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:12.418430+0000", 2024-09-12T18:36:05.555 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-12T18:36:05.555 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-09-12T18:36:05.555 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:36:05.555 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:36:05.555 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:36:05.555 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:36:05.556 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:36:05.556 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:36:05.556 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:36:05.556 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:36:05.556 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:36:05.556 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:36:05.556 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:36:05.556 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 1, 2024-09-12T18:36:05.556 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 1, 2024-09-12T18:36:05.556 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 1, 2024-09-12T18:36:05.556 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 1, 2024-09-12T18:36:05.556 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 1, 2024-09-12T18:36:05.557 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:36:05.557 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:36:05.557 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:36:05.557 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:36:05.557 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:36:05.557 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:36:05.557 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:36:05.557 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.557 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "11", 2024-09-12T18:36:05.557 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:36:05.557 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:36:05.557 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:36:05.557 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:36:05.558 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:36:05.558 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-09-12T18:36:05.558 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-09-12T18:36:05.558 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:36:05.558 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:36:05.558 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:36:05.558 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:36:05.558 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:36:05.558 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:36:05.558 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:36:05.558 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:36:05.558 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:36:05.558 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:36:05.558 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:36:05.559 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:36:05.559 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:36:05.559 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:36:05.559 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:36:05.559 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:36:05.559 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:36:05.559 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:36:05.559 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:36:05.559 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.559 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:36:05.559 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:36:05.559 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:36:05.559 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:36:05.560 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:36:05.560 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:36:05.560 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:36:05.560 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:36:05.560 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:36:05.560 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:36:05.560 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:36:05.560 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-09-12T18:36:05.560 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_max": 32, 2024-09-12T18:36:05.560 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 1 2024-09-12T18:36:05.560 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.560 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:36:05.560 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": {} 2024-09-12T18:36:05.561 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.561 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:36:05.561 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:36:05.561 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 2.9900000095367432, 2024-09-12T18:36:05.561 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 2.9900000095367432, 2024-09-12T18:36:05.561 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 0.67000001668930054, 2024-09-12T18:36:05.561 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 2, 2024-09-12T18:36:05.561 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 2, 2024-09-12T18:36:05.561 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:36:05.561 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:36:05.561 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:36:05.561 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:05.561 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.562 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:05.562 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 2, 2024-09-12T18:36:05.562 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "rbd", 2024-09-12T18:36:05.562 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:18.665309+0000", 2024-09-12T18:36:05.562 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 8193, 2024-09-12T18:36:05.562 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T18:36:05.562 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:36:05.562 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:36:05.562 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:36:05.562 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:36:05.562 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:36:05.562 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:36:05.562 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:36:05.563 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:36:05.563 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:36:05.563 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:36:05.563 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:36:05.563 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 8, 2024-09-12T18:36:05.563 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 8, 2024-09-12T18:36:05.563 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 8, 2024-09-12T18:36:05.563 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 8, 2024-09-12T18:36:05.563 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 8, 2024-09-12T18:36:05.564 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:36:05.564 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:36:05.564 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:36:05.564 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:36:05.564 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:36:05.564 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:36:05.564 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:36:05.564 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.564 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "15", 2024-09-12T18:36:05.565 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:36:05.565 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:36:05.565 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:36:05.565 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:36:05.565 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:36:05.565 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 2, 2024-09-12T18:36:05.565 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 15, 2024-09-12T18:36:05.565 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:36:05.565 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:36:05.565 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:36:05.566 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:36:05.566 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:36:05.566 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:36:05.566 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:36:05.566 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:36:05.566 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:36:05.566 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:36:05.566 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:36:05.566 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:36:05.566 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:36:05.566 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:36:05.566 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:36:05.566 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:36:05.566 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:36:05.567 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:36:05.567 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:36:05.567 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.567 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:36:05.567 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:36:05.567 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:36:05.567 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:36:05.567 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:36:05.567 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:36:05.567 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:36:05.567 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:36:05.567 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:36:05.568 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:36:05.568 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:36:05.568 INFO:teuthology.orchestra.run.smithi073.stdout: "options": {}, 2024-09-12T18:36:05.568 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:36:05.568 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd": {} 2024-09-12T18:36:05.568 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.568 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:36:05.568 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:36:05.568 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.5, 2024-09-12T18:36:05.568 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.5, 2024-09-12T18:36:05.568 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-09-12T18:36:05.568 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.5, 2024-09-12T18:36:05.569 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.5, 2024-09-12T18:36:05.569 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:36:05.569 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:36:05.569 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:36:05.569 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:05.569 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.569 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:05.569 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 3, 2024-09-12T18:36:05.569 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "cephfs_metadata", 2024-09-12T18:36:05.569 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:23.447845+0000", 2024-09-12T18:36:05.569 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-12T18:36:05.569 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-09-12T18:36:05.569 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:36:05.569 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:36:05.570 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:36:05.570 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:36:05.570 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:36:05.570 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:36:05.570 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:36:05.570 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:36:05.570 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:36:05.570 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:36:05.570 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:36:05.570 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 32, 2024-09-12T18:36:05.570 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 32, 2024-09-12T18:36:05.570 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 32, 2024-09-12T18:36:05.570 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 32, 2024-09-12T18:36:05.570 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 32, 2024-09-12T18:36:05.571 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:36:05.571 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:36:05.571 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:36:05.571 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:36:05.571 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:36:05.571 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:36:05.571 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:36:05.571 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.571 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "18", 2024-09-12T18:36:05.571 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:36:05.571 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:36:05.571 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:36:05.571 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:36:05.572 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:36:05.572 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-09-12T18:36:05.572 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-09-12T18:36:05.572 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:36:05.572 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:36:05.572 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:36:05.572 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:36:05.572 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:36:05.572 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:36:05.572 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:36:05.572 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:36:05.572 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:36:05.572 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:36:05.573 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:36:05.573 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:36:05.573 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:36:05.573 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:36:05.573 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:36:05.573 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:36:05.573 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:36:05.573 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:36:05.573 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:36:05.573 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.573 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:36:05.573 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:36:05.573 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:36:05.574 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:36:05.574 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:36:05.574 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:36:05.574 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:36:05.574 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:36:05.574 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:36:05.574 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:36:05.574 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:36:05.574 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-09-12T18:36:05.574 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_bias": 4, 2024-09-12T18:36:05.574 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 16, 2024-09-12T18:36:05.574 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_priority": 5 2024-09-12T18:36:05.574 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.575 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:36:05.575 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs": { 2024-09-12T18:36:05.575 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": "cephfs" 2024-09-12T18:36:05.575 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:05.575 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.575 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:36:05.575 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:36:05.575 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.1299999952316284, 2024-09-12T18:36:05.575 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.1299999952316284, 2024-09-12T18:36:05.575 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-09-12T18:36:05.575 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T18:36:05.575 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T18:36:05.575 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:36:05.576 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:36:05.576 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:36:05.576 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:05.576 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.576 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:05.576 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 4, 2024-09-12T18:36:05.576 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "cephfs_data", 2024-09-12T18:36:05.576 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:23.959973+0000", 2024-09-12T18:36:05.576 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-12T18:36:05.576 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-09-12T18:36:05.576 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:36:05.576 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:36:05.577 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:36:05.577 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:36:05.577 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:36:05.577 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:36:05.577 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:36:05.577 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:36:05.577 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:36:05.577 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:36:05.577 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:36:05.577 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 64, 2024-09-12T18:36:05.577 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 64, 2024-09-12T18:36:05.577 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 64, 2024-09-12T18:36:05.578 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 64, 2024-09-12T18:36:05.578 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 64, 2024-09-12T18:36:05.578 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:36:05.578 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:36:05.578 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:36:05.578 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:36:05.578 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:36:05.578 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:36:05.578 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:36:05.578 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.578 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "19", 2024-09-12T18:36:05.578 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:36:05.578 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:36:05.579 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:36:05.579 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:36:05.579 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:36:05.579 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-09-12T18:36:05.579 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-09-12T18:36:05.579 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:36:05.579 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:36:05.579 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:36:05.579 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:36:05.579 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:36:05.579 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:36:05.579 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:36:05.579 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:36:05.579 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:36:05.580 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:36:05.580 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:36:05.580 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:36:05.580 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:36:05.580 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:36:05.580 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:36:05.580 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:36:05.580 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:36:05.580 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:36:05.580 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:36:05.580 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.580 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:36:05.580 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:36:05.581 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:36:05.581 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:36:05.581 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:36:05.581 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:36:05.581 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:36:05.581 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:36:05.581 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:36:05.581 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:36:05.581 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:36:05.581 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-09-12T18:36:05.581 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 64, 2024-09-12T18:36:05.581 INFO:teuthology.orchestra.run.smithi073.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T18:36:05.582 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.582 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:36:05.582 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs": { 2024-09-12T18:36:05.582 INFO:teuthology.orchestra.run.smithi073.stdout: "data": "cephfs" 2024-09-12T18:36:05.582 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:05.582 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.582 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:36:05.582 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:36:05.582 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.1299999952316284, 2024-09-12T18:36:05.582 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.1299999952316284, 2024-09-12T18:36:05.582 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-09-12T18:36:05.582 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T18:36:05.582 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T18:36:05.582 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:36:05.583 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:36:05.583 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:36:05.583 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:05.583 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.583 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:05.583 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 5, 2024-09-12T18:36:05.583 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "unique_pool_0", 2024-09-12T18:36:05.583 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:43.562347+0000", 2024-09-12T18:36:05.583 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-12T18:36:05.583 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-09-12T18:36:05.583 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:36:05.583 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:36:05.583 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:36:05.584 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:36:05.584 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:36:05.584 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:36:05.584 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:36:05.584 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:36:05.584 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:36:05.584 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:36:05.584 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:36:05.584 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 16, 2024-09-12T18:36:05.584 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 16, 2024-09-12T18:36:05.584 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 16, 2024-09-12T18:36:05.584 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 16, 2024-09-12T18:36:05.585 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 16, 2024-09-12T18:36:05.585 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:36:05.585 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:36:05.585 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:36:05.585 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:36:05.585 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:36:05.585 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:36:05.585 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:36:05.585 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.585 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "23", 2024-09-12T18:36:05.585 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:36:05.585 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:36:05.585 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:36:05.585 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:36:05.586 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:36:05.586 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-09-12T18:36:05.586 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-09-12T18:36:05.586 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:36:05.586 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:36:05.586 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:36:05.586 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:36:05.586 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:36:05.586 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:36:05.586 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:36:05.586 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:36:05.586 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:36:05.586 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:36:05.587 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:36:05.587 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:36:05.587 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:36:05.587 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:36:05.587 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:36:05.587 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:36:05.587 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:36:05.587 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:36:05.587 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:36:05.587 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.587 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:36:05.587 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:36:05.587 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:36:05.588 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:36:05.588 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:36:05.588 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:36:05.588 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:36:05.588 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:36:05.588 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:36:05.588 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:36:05.588 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:36:05.588 INFO:teuthology.orchestra.run.smithi073.stdout: "options": {}, 2024-09-12T18:36:05.588 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:36:05.588 INFO:teuthology.orchestra.run.smithi073.stdout: "rados": {} 2024-09-12T18:36:05.588 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.589 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:36:05.589 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:36:05.589 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.1299999952316284, 2024-09-12T18:36:05.589 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.1299999952316284, 2024-09-12T18:36:05.589 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-09-12T18:36:05.589 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T18:36:05.589 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T18:36:05.589 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:36:05.589 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:36:05.589 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:36:05.589 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:05.589 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:05.589 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T18:36:05.590 INFO:teuthology.orchestra.run.smithi073.stdout: "osds": [ 2024-09-12T18:36:05.590 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:05.590 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-09-12T18:36:05.590 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "f1cf24e8-6179-4666-a444-fa81ef0d7482", 2024-09-12T18:36:05.590 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-09-12T18:36:05.590 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-09-12T18:36:05.590 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-09-12T18:36:05.590 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-09-12T18:36:05.590 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-09-12T18:36:05.590 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-09-12T18:36:05.590 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-09-12T18:36:05.590 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 21, 2024-09-12T18:36:05.590 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-09-12T18:36:05.590 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-09-12T18:36:05.591 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-12T18:36:05.591 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:05.591 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:05.591 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:05.591 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6800", 2024-09-12T18:36:05.591 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:36:05.591 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.591 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:05.591 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:05.591 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6801", 2024-09-12T18:36:05.591 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:36:05.591 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:05.591 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:05.592 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.592 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-09-12T18:36:05.592 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:05.592 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:05.592 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:05.592 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6802", 2024-09-12T18:36:05.592 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:36:05.592 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.592 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:05.592 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:05.592 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6803", 2024-09-12T18:36:05.592 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:36:05.592 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:05.593 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:05.593 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.593 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-09-12T18:36:05.593 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:05.593 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:05.593 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:05.593 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6806", 2024-09-12T18:36:05.593 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:36:05.593 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.593 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:05.593 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:05.593 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6807", 2024-09-12T18:36:05.593 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:36:05.593 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:05.594 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:05.594 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.594 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-09-12T18:36:05.594 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:05.594 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:05.594 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:05.594 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6804", 2024-09-12T18:36:05.594 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:36:05.594 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.594 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:05.594 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:05.594 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6805", 2024-09-12T18:36:05.594 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:36:05.595 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:05.595 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:05.595 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.595 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.114:6801/2710632206", 2024-09-12T18:36:05.595 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.114:6803/2710632206", 2024-09-12T18:36:05.595 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.114:6807/2710632206", 2024-09-12T18:36:05.595 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.114:6805/2710632206", 2024-09-12T18:36:05.595 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-09-12T18:36:05.595 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-09-12T18:36:05.595 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-09-12T18:36:05.595 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:05.595 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.595 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:05.595 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-09-12T18:36:05.596 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "3fdb0044-2820-4411-978b-4b6e94fbf0b1", 2024-09-12T18:36:05.596 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-09-12T18:36:05.596 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-09-12T18:36:05.596 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-09-12T18:36:05.596 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-09-12T18:36:05.596 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-09-12T18:36:05.596 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-09-12T18:36:05.596 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 9, 2024-09-12T18:36:05.596 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 21, 2024-09-12T18:36:05.596 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-09-12T18:36:05.596 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-09-12T18:36:05.596 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-12T18:36:05.596 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:05.597 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:05.597 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:05.597 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6800", 2024-09-12T18:36:05.597 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:36:05.597 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.597 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:05.597 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:05.597 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6801", 2024-09-12T18:36:05.597 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:36:05.597 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:05.597 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:05.597 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.597 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-09-12T18:36:05.598 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:05.598 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:05.598 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:05.598 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6802", 2024-09-12T18:36:05.598 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:36:05.598 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.598 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:05.598 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:05.598 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6803", 2024-09-12T18:36:05.598 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:36:05.598 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:05.598 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:05.598 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.598 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-09-12T18:36:05.599 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:05.599 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:05.599 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:05.599 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6806", 2024-09-12T18:36:05.599 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:36:05.599 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.599 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:05.599 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:05.599 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6807", 2024-09-12T18:36:05.599 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:36:05.599 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:05.599 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:05.599 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.600 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-09-12T18:36:05.600 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:05.600 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:05.600 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:05.600 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6804", 2024-09-12T18:36:05.600 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:36:05.600 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.600 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:05.600 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:05.600 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6805", 2024-09-12T18:36:05.600 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:36:05.600 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:05.600 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:05.601 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.601 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.143:6801/862189968", 2024-09-12T18:36:05.601 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.143:6803/862189968", 2024-09-12T18:36:05.601 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.143:6807/862189968", 2024-09-12T18:36:05.601 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.143:6805/862189968", 2024-09-12T18:36:05.601 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-09-12T18:36:05.601 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-09-12T18:36:05.601 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-09-12T18:36:05.601 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:05.601 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.601 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:05.601 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2024-09-12T18:36:05.601 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "6fb554da-561f-4aa2-b855-0e3adb98b057", 2024-09-12T18:36:05.602 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-09-12T18:36:05.602 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-09-12T18:36:05.602 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-09-12T18:36:05.602 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-09-12T18:36:05.602 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-09-12T18:36:05.602 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-09-12T18:36:05.602 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-09-12T18:36:05.602 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 21, 2024-09-12T18:36:05.602 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-09-12T18:36:05.602 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-09-12T18:36:05.602 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-12T18:36:05.602 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:05.602 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:05.603 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:05.603 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6800", 2024-09-12T18:36:05.603 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:36:05.603 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.603 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:05.603 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:05.603 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6801", 2024-09-12T18:36:05.603 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:36:05.603 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:05.603 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:05.603 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.603 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-09-12T18:36:05.603 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:05.603 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:05.604 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:05.604 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6802", 2024-09-12T18:36:05.604 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:36:05.604 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.604 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:05.604 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:05.604 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6803", 2024-09-12T18:36:05.604 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:36:05.604 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:05.604 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:05.604 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.604 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-09-12T18:36:05.604 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:05.605 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:05.605 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:05.605 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6806", 2024-09-12T18:36:05.605 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:36:05.605 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.605 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:05.605 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:05.605 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6807", 2024-09-12T18:36:05.605 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:36:05.605 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:05.605 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:05.605 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.605 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-09-12T18:36:05.605 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:05.606 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:05.606 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:05.606 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6804", 2024-09-12T18:36:05.606 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:36:05.606 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.606 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:05.606 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:05.606 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6805", 2024-09-12T18:36:05.606 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:36:05.606 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:05.606 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:05.606 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.606 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.162:6801/1397104153", 2024-09-12T18:36:05.607 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.162:6803/1397104153", 2024-09-12T18:36:05.607 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.162:6807/1397104153", 2024-09-12T18:36:05.607 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.162:6805/1397104153", 2024-09-12T18:36:05.607 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-09-12T18:36:05.607 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-09-12T18:36:05.607 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-09-12T18:36:05.607 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:05.607 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:05.607 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T18:36:05.607 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_xinfo": [ 2024-09-12T18:36:05.607 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:05.607 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-09-12T18:36:05.607 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-09-12T18:36:05.608 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-09-12T18:36:05.608 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-09-12T18:36:05.608 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540719139924082687, 2024-09-12T18:36:05.608 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-09-12T18:36:05.608 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-09-12T18:35:10.239320+0000", 2024-09-12T18:36:05.608 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-09-12T18:36:05.608 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.608 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:05.608 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-09-12T18:36:05.608 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-09-12T18:36:05.608 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-09-12T18:36:05.608 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-09-12T18:36:05.608 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540719139924082687, 2024-09-12T18:36:05.609 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-09-12T18:36:05.609 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-09-12T18:35:10.861760+0000", 2024-09-12T18:36:05.609 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-09-12T18:36:05.609 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.609 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:05.609 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2024-09-12T18:36:05.609 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-09-12T18:36:05.609 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-09-12T18:36:05.609 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-09-12T18:36:05.609 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540719139924082687, 2024-09-12T18:36:05.609 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-09-12T18:36:05.609 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-09-12T18:35:10.355997+0000", 2024-09-12T18:36:05.609 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-09-12T18:36:05.610 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:05.610 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T18:36:05.610 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap": [], 2024-09-12T18:36:05.610 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap_items": [], 2024-09-12T18:36:05.610 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap_primaries": [], 2024-09-12T18:36:05.610 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_temp": [], 2024-09-12T18:36:05.610 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_temp": [], 2024-09-12T18:36:05.610 INFO:teuthology.orchestra.run.smithi073.stdout: "blocklist": {}, 2024-09-12T18:36:05.610 INFO:teuthology.orchestra.run.smithi073.stdout: "range_blocklist": {}, 2024-09-12T18:36:05.610 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profiles": { 2024-09-12T18:36:05.610 INFO:teuthology.orchestra.run.smithi073.stdout: "default": { 2024-09-12T18:36:05.610 INFO:teuthology.orchestra.run.smithi073.stdout: "crush-failure-domain": "osd", 2024-09-12T18:36:05.610 INFO:teuthology.orchestra.run.smithi073.stdout: "k": "2", 2024-09-12T18:36:05.610 INFO:teuthology.orchestra.run.smithi073.stdout: "m": "1", 2024-09-12T18:36:05.611 INFO:teuthology.orchestra.run.smithi073.stdout: "plugin": "jerasure", 2024-09-12T18:36:05.611 INFO:teuthology.orchestra.run.smithi073.stdout: "technique": "reed_sol_van" 2024-09-12T18:36:05.611 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:05.611 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:05.611 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps_queue": [], 2024-09-12T18:36:05.611 INFO:teuthology.orchestra.run.smithi073.stdout: "new_removed_snaps": [], 2024-09-12T18:36:05.611 INFO:teuthology.orchestra.run.smithi073.stdout: "new_purged_snaps": [], 2024-09-12T18:36:05.611 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_node_flags": {}, 2024-09-12T18:36:05.611 INFO:teuthology.orchestra.run.smithi073.stdout: "device_class_flags": {}, 2024-09-12T18:36:05.611 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": { 2024-09-12T18:36:05.611 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode_enabled": false, 2024-09-12T18:36:05.611 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_bucket_count": 0, 2024-09-12T18:36:05.611 INFO:teuthology.orchestra.run.smithi073.stdout: "degraded_stretch_mode": 0, 2024-09-12T18:36:05.612 INFO:teuthology.orchestra.run.smithi073.stdout: "recovering_stretch_mode": 0, 2024-09-12T18:36:05.612 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode_bucket": 0 2024-09-12T18:36:05.612 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:05.612 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T18:36:05.614 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:36:05.614 INFO:tasks.thrashosds.thrasher:j is {'epoch': 34, 'fsid': 'c08d5a84-711b-44bf-bdf1-e06ecc2c7c00', 'created': '2024-09-12T18:35:02.695853+0000', 'modified': '2024-09-12T18:36:04.464662+0000', 'last_up_change': '2024-09-12T18:35:12.464628+0000', 'last_in_change': '2024-09-12T18:35:04.352525+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T18:35:12.418430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-12T18:35:18.665309+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 15, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T18:35:23.447845+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T18:35:23.959973+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2024-09-12T18:35:43.562347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'f1cf24e8-6179-4666-a444-fa81ef0d7482', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6800', 'nonce': 2710632206}, {'type': 'v1', 'addr': '172.21.15.114:6801', 'nonce': 2710632206}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6802', 'nonce': 2710632206}, {'type': 'v1', 'addr': '172.21.15.114:6803', 'nonce': 2710632206}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6806', 'nonce': 2710632206}, {'type': 'v1', 'addr': '172.21.15.114:6807', 'nonce': 2710632206}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6804', 'nonce': 2710632206}, {'type': 'v1', 'addr': '172.21.15.114:6805', 'nonce': 2710632206}]}, 'public_addr': '172.21.15.114:6801/2710632206', 'cluster_addr': '172.21.15.114:6803/2710632206', 'heartbeat_back_addr': '172.21.15.114:6807/2710632206', 'heartbeat_front_addr': '172.21.15.114:6805/2710632206', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '3fdb0044-2820-4411-978b-4b6e94fbf0b1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 9, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6800', 'nonce': 862189968}, {'type': 'v1', 'addr': '172.21.15.143:6801', 'nonce': 862189968}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6802', 'nonce': 862189968}, {'type': 'v1', 'addr': '172.21.15.143:6803', 'nonce': 862189968}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6806', 'nonce': 862189968}, {'type': 'v1', 'addr': '172.21.15.143:6807', 'nonce': 862189968}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6804', 'nonce': 862189968}, {'type': 'v1', 'addr': '172.21.15.143:6805', 'nonce': 862189968}]}, 'public_addr': '172.21.15.143:6801/862189968', 'cluster_addr': '172.21.15.143:6803/862189968', 'heartbeat_back_addr': '172.21.15.143:6807/862189968', 'heartbeat_front_addr': '172.21.15.143:6805/862189968', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '6fb554da-561f-4aa2-b855-0e3adb98b057', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6800', 'nonce': 1397104153}, {'type': 'v1', 'addr': '172.21.15.162:6801', 'nonce': 1397104153}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6802', 'nonce': 1397104153}, {'type': 'v1', 'addr': '172.21.15.162:6803', 'nonce': 1397104153}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6806', 'nonce': 1397104153}, {'type': 'v1', 'addr': '172.21.15.162:6807', 'nonce': 1397104153}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6804', 'nonce': 1397104153}, {'type': 'v1', 'addr': '172.21.15.162:6805', 'nonce': 1397104153}]}, 'public_addr': '172.21.15.162:6801/1397104153', 'cluster_addr': '172.21.15.162:6803/1397104153', 'heartbeat_back_addr': '172.21.15.162:6807/1397104153', 'heartbeat_front_addr': '172.21.15.162:6805/1397104153', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:35:10.239320+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:35:10.861760+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:35:10.355997+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T18:36:05.615 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:36:05.615 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:36:05.615 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:36:05.616 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:36:05.616 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:36:05.621 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:36:05.621 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:36:05.662 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:05.660+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:05.750 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:05.745+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:05.763 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:05.763 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:05.782 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:36:05.850 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:05.848+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:05.870 INFO:tasks.radosbench.radosbench.0.smithi073.stdout:2024-09-12T18:36:05.869928+0000 min lat: 0.00145327 max lat: 0.0663759 avg lat: 0.00587575 2024-09-12T18:36:05.870 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-12T18:36:05.870 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 20 16 54438 54422 170.051 138.062 0.0122688 0.00587575 2024-09-12T18:36:05.921 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:36:05.923 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T18:36:05.928 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:05.928 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:05.938 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-09-12T18:36:04.476503+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3016035229,"num_objects":46038,"num_object_clones":0,"num_object_copies":92076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46038,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":46204,"num_write_kb":2947456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46166,"ondisk_log_size":46166,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":542656,"kb_used_data":360264,"kb_used_omap":4,"kb_used_meta":182331,"kb_avail":282572864,"statfs":{"total":289910292480,"available":289354612736,"internally_reserved":0,"allocated":368910336,"data_stored":5886265552,"data_compressed":279506145,"data_compressed_allocated":367886336,"data_compressed_original":5885886464,"omap_allocated":4783,"internal_metadata":186707281},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,2,2,6,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":802291712,"num_objects":12242,"num_object_clones":0,"num_object_copies":24484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12242,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12242,"num_write_kb":783488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.090413"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468430+0000","last_change":"2024-09-12T18:35:25.657389+0000","last_active":"2024-09-12T18:36:03.468430+0000","last_peered":"2024-09-12T18:36:03.468430+0000","last_clean":"2024-09-12T18:36:03.468430+0000","last_became_active":"2024-09-12T18:35:25.651857+0000","last_became_peered":"2024-09-12T18:35:25.651857+0000","last_unstale":"2024-09-12T18:36:03.468430+0000","last_undegraded":"2024-09-12T18:36:03.468430+0000","last_fullsized":"2024-09-12T18:36:03.468430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:50.264536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468079+0000","last_change":"2024-09-12T18:35:25.659760+0000","last_active":"2024-09-12T18:36:03.468079+0000","last_peered":"2024-09-12T18:36:03.468079+0000","last_clean":"2024-09-12T18:36:03.468079+0000","last_became_active":"2024-09-12T18:35:25.654920+0000","last_became_peered":"2024-09-12T18:35:25.654920+0000","last_unstale":"2024-09-12T18:36:03.468079+0000","last_undegraded":"2024-09-12T18:36:03.468079+0000","last_fullsized":"2024-09-12T18:36:03.468079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:21.519881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457502+0000","last_change":"2024-09-12T18:35:25.659460+0000","last_active":"2024-09-12T18:36:01.457502+0000","last_peered":"2024-09-12T18:36:01.457502+0000","last_clean":"2024-09-12T18:36:01.457502+0000","last_became_active":"2024-09-12T18:35:25.657782+0000","last_became_peered":"2024-09-12T18:35:25.657782+0000","last_unstale":"2024-09-12T18:36:01.457502+0000","last_undegraded":"2024-09-12T18:36:01.457502+0000","last_fullsized":"2024-09-12T18:36:01.457502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:38.544284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457143+0000","last_change":"2024-09-12T18:35:25.663617+0000","last_active":"2024-09-12T18:36:01.457143+0000","last_peered":"2024-09-12T18:36:01.457143+0000","last_clean":"2024-09-12T18:36:01.457143+0000","last_became_active":"2024-09-12T18:35:25.661977+0000","last_became_peered":"2024-09-12T18:35:25.661977+0000","last_unstale":"2024-09-12T18:36:01.457143+0000","last_undegraded":"2024-09-12T18:36:01.457143+0000","last_fullsized":"2024-09-12T18:36:01.457143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:14.748234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.467891+0000","last_change":"2024-09-12T18:35:25.656566+0000","last_active":"2024-09-12T18:36:03.467891+0000","last_peered":"2024-09-12T18:36:03.467891+0000","last_clean":"2024-09-12T18:36:03.467891+0000","last_became_active":"2024-09-12T18:35:25.654898+0000","last_became_peered":"2024-09-12T18:35:25.654898+0000","last_unstale":"2024-09-12T18:36:03.467891+0000","last_undegraded":"2024-09-12T18:36:03.467891+0000","last_fullsized":"2024-09-12T18:36:03.467891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:36.113250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.456773+0000","last_change":"2024-09-12T18:35:25.652754+0000","last_active":"2024-09-12T18:36:01.456773+0000","last_peered":"2024-09-12T18:36:01.456773+0000","last_clean":"2024-09-12T18:36:01.456773+0000","last_became_active":"2024-09-12T18:35:25.651217+0000","last_became_peered":"2024-09-12T18:35:25.651217+0000","last_unstale":"2024-09-12T18:36:01.456773+0000","last_undegraded":"2024-09-12T18:36:01.456773+0000","last_fullsized":"2024-09-12T18:36:01.456773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:24.585774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457973+0000","last_change":"2024-09-12T18:35:25.659811+0000","last_active":"2024-09-12T18:36:01.457973+0000","last_peered":"2024-09-12T18:36:01.457973+0000","last_clean":"2024-09-12T18:36:01.457973+0000","last_became_active":"2024-09-12T18:35:25.658998+0000","last_became_peered":"2024-09-12T18:35:25.658998+0000","last_unstale":"2024-09-12T18:36:01.457973+0000","last_undegraded":"2024-09-12T18:36:01.457973+0000","last_fullsized":"2024-09-12T18:36:01.457973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.456620+0000","last_change":"2024-09-12T18:35:25.653999+0000","last_active":"2024-09-12T18:36:01.456620+0000","last_peered":"2024-09-12T18:36:01.456620+0000","last_clean":"2024-09-12T18:36:01.456620+0000","last_became_active":"2024-09-12T18:35:25.653319+0000","last_became_peered":"2024-09-12T18:35:25.653319+0000","last_unstale":"2024-09-12T18:36:01.456620+0000","last_undegraded":"2024-09-12T18:36:01.456620+0000","last_fullsized":"2024-09-12T18:36:01.456620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:04.718000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457931+0000","last_change":"2024-09-12T18:35:25.668339+0000","last_active":"2024-09-12T18:36:01.457931+0000","last_peered":"2024-09-12T18:36:01.457931+0000","last_clean":"2024-09-12T18:36:01.457931+0000","last_became_active":"2024-09-12T18:35:25.667608+0000","last_became_peered":"2024-09-12T18:35:25.667608+0000","last_unstale":"2024-09-12T18:36:01.457931+0000","last_undegraded":"2024-09-12T18:36:01.457931+0000","last_fullsized":"2024-09-12T18:36:01.457931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:15.699745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468417+0000","last_change":"2024-09-12T18:35:25.660174+0000","last_active":"2024-09-12T18:36:03.468417+0000","last_peered":"2024-09-12T18:36:03.468417+0000","last_clean":"2024-09-12T18:36:03.468417+0000","last_became_active":"2024-09-12T18:35:25.656560+0000","last_became_peered":"2024-09-12T18:35:25.656560+0000","last_unstale":"2024-09-12T18:36:03.468417+0000","last_undegraded":"2024-09-12T18:36:03.468417+0000","last_fullsized":"2024-09-12T18:36:03.468417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:47.268505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457557+0000","last_change":"2024-09-12T18:35:25.649858+0000","last_active":"2024-09-12T18:36:01.457557+0000","last_peered":"2024-09-12T18:36:01.457557+0000","last_clean":"2024-09-12T18:36:01.457557+0000","last_became_active":"2024-09-12T18:35:25.649090+0000","last_became_peered":"2024-09-12T18:35:25.649090+0000","last_unstale":"2024-09-12T18:36:01.457557+0000","last_undegraded":"2024-09-12T18:36:01.457557+0000","last_fullsized":"2024-09-12T18:36:01.457557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:33.158421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.467938+0000","last_change":"2024-09-12T18:35:25.649885+0000","last_active":"2024-09-12T18:36:03.467938+0000","last_peered":"2024-09-12T18:36:03.467938+0000","last_clean":"2024-09-12T18:36:03.467938+0000","last_became_active":"2024-09-12T18:35:25.649111+0000","last_became_peered":"2024-09-12T18:35:25.649111+0000","last_unstale":"2024-09-12T18:36:03.467938+0000","last_undegraded":"2024-09-12T18:36:03.467938+0000","last_fullsized":"2024-09-12T18:36:03.467938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:17.162410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468110+0000","last_change":"2024-09-12T18:35:25.651541+0000","last_active":"2024-09-12T18:36:03.468110+0000","last_peered":"2024-09-12T18:36:03.468110+0000","last_clean":"2024-09-12T18:36:03.468110+0000","last_became_active":"2024-09-12T18:35:25.650661+0000","last_became_peered":"2024-09-12T18:35:25.650661+0000","last_unstale":"2024-09-12T18:36:03.468110+0000","last_undegraded":"2024-09-12T18:36:03.468110+0000","last_fullsized":"2024-09-12T18:36:03.468110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:52.082734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.456857+0000","last_change":"2024-09-12T18:35:25.657913+0000","last_active":"2024-09-12T18:36:01.456857+0000","last_peered":"2024-09-12T18:36:01.456857+0000","last_clean":"2024-09-12T18:36:01.456857+0000","last_became_active":"2024-09-12T18:35:25.657082+0000","last_became_peered":"2024-09-12T18:35:25.657082+0000","last_unstale":"2024-09-12T18:36:01.456857+0000","last_undegraded":"2024-09-12T18:36:01.456857+0000","last_fullsized":"2024-09-12T18:36:01.456857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:21.538633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458068+0000","last_change":"2024-09-12T18:35:25.658763+0000","last_active":"2024-09-12T18:36:01.458068+0000","last_peered":"2024-09-12T18:36:01.458068+0000","last_clean":"2024-09-12T18:36:01.458068+0000","last_became_active":"2024-09-12T18:35:25.657508+0000","last_became_peered":"2024-09-12T18:35:25.657508+0000","last_unstale":"2024-09-12T18:36:01.458068+0000","last_undegraded":"2024-09-12T18:36:01.458068+0000","last_fullsized":"2024-09-12T18:36:01.458068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:13.170519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.456742+0000","last_change":"2024-09-12T18:35:25.653730+0000","last_active":"2024-09-12T18:36:01.456742+0000","last_peered":"2024-09-12T18:36:01.456742+0000","last_clean":"2024-09-12T18:36:01.456742+0000","last_became_active":"2024-09-12T18:35:25.651535+0000","last_became_peered":"2024-09-12T18:35:25.651535+0000","last_unstale":"2024-09-12T18:36:01.456742+0000","last_undegraded":"2024-09-12T18:36:01.456742+0000","last_fullsized":"2024-09-12T18:36:01.456742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458531+0000","last_change":"2024-09-12T18:35:25.656513+0000","last_active":"2024-09-12T18:36:01.458531+0000","last_peered":"2024-09-12T18:36:01.458531+0000","last_clean":"2024-09-12T18:36:01.458531+0000","last_became_active":"2024-09-12T18:35:25.653440+0000","last_became_peered":"2024-09-12T18:35:25.653440+0000","last_unstale":"2024-09-12T18:36:01.458531+0000","last_undegraded":"2024-09-12T18:36:01.458531+0000","last_fullsized":"2024-09-12T18:36:01.458531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:18.693161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468423+0000","last_change":"2024-09-12T18:35:25.657991+0000","last_active":"2024-09-12T18:36:03.468423+0000","last_peered":"2024-09-12T18:36:03.468423+0000","last_clean":"2024-09-12T18:36:03.468423+0000","last_became_active":"2024-09-12T18:35:25.653934+0000","last_became_peered":"2024-09-12T18:35:25.653934+0000","last_unstale":"2024-09-12T18:36:03.468423+0000","last_undegraded":"2024-09-12T18:36:03.468423+0000","last_fullsized":"2024-09-12T18:36:03.468423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:05.418901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457946+0000","last_change":"2024-09-12T18:35:25.658819+0000","last_active":"2024-09-12T18:36:01.457946+0000","last_peered":"2024-09-12T18:36:01.457946+0000","last_clean":"2024-09-12T18:36:01.457946+0000","last_became_active":"2024-09-12T18:35:25.656843+0000","last_became_peered":"2024-09-12T18:35:25.656843+0000","last_unstale":"2024-09-12T18:36:01.457946+0000","last_undegraded":"2024-09-12T18:36:01.457946+0000","last_fullsized":"2024-09-12T18:36:01.457946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:55.291963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457321+0000","last_change":"2024-09-12T18:35:25.661176+0000","last_active":"2024-09-12T18:36:01.457321+0000","last_peered":"2024-09-12T18:36:01.457321+0000","last_clean":"2024-09-12T18:36:01.457321+0000","last_became_active":"2024-09-12T18:35:25.659534+0000","last_became_peered":"2024-09-12T18:35:25.659534+0000","last_unstale":"2024-09-12T18:36:01.457321+0000","last_undegraded":"2024-09-12T18:36:01.457321+0000","last_fullsized":"2024-09-12T18:36:01.457321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:40.145442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.456864+0000","last_change":"2024-09-12T18:35:25.650632+0000","last_active":"2024-09-12T18:36:01.456864+0000","last_peered":"2024-09-12T18:36:01.456864+0000","last_clean":"2024-09-12T18:36:01.456864+0000","last_became_active":"2024-09-12T18:35:25.649333+0000","last_became_peered":"2024-09-12T18:35:25.649333+0000","last_unstale":"2024-09-12T18:36:01.456864+0000","last_undegraded":"2024-09-12T18:36:01.456864+0000","last_fullsized":"2024-09-12T18:36:01.456864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:30.537572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.467675+0000","last_change":"2024-09-12T18:35:25.648245+0000","last_active":"2024-09-12T18:36:03.467675+0000","last_peered":"2024-09-12T18:36:03.467675+0000","last_clean":"2024-09-12T18:36:03.467675+0000","last_became_active":"2024-09-12T18:35:25.646357+0000","last_became_peered":"2024-09-12T18:35:25.646357+0000","last_unstale":"2024-09-12T18:36:03.467675+0000","last_undegraded":"2024-09-12T18:36:03.467675+0000","last_fullsized":"2024-09-12T18:36:03.467675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:05.662140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457171+0000","last_change":"2024-09-12T18:35:25.661613+0000","last_active":"2024-09-12T18:36:01.457171+0000","last_peered":"2024-09-12T18:36:01.457171+0000","last_clean":"2024-09-12T18:36:01.457171+0000","last_became_active":"2024-09-12T18:35:25.658833+0000","last_became_peered":"2024-09-12T18:35:25.658833+0000","last_unstale":"2024-09-12T18:36:01.457171+0000","last_undegraded":"2024-09-12T18:36:01.457171+0000","last_fullsized":"2024-09-12T18:36:01.457171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:51.064080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468960+0000","last_change":"2024-09-12T18:35:25.657782+0000","last_active":"2024-09-12T18:36:03.468960+0000","last_peered":"2024-09-12T18:36:03.468960+0000","last_clean":"2024-09-12T18:36:03.468960+0000","last_became_active":"2024-09-12T18:35:25.655295+0000","last_became_peered":"2024-09-12T18:35:25.655295+0000","last_unstale":"2024-09-12T18:36:03.468960+0000","last_undegraded":"2024-09-12T18:36:03.468960+0000","last_fullsized":"2024-09-12T18:36:03.468960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:37.744175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468549+0000","last_change":"2024-09-12T18:35:25.654863+0000","last_active":"2024-09-12T18:36:03.468549+0000","last_peered":"2024-09-12T18:36:03.468549+0000","last_clean":"2024-09-12T18:36:03.468549+0000","last_became_active":"2024-09-12T18:35:25.650407+0000","last_became_peered":"2024-09-12T18:35:25.650407+0000","last_unstale":"2024-09-12T18:36:03.468549+0000","last_undegraded":"2024-09-12T18:36:03.468549+0000","last_fullsized":"2024-09-12T18:36:03.468549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:38.395666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458577+0000","last_change":"2024-09-12T18:35:25.662414+0000","last_active":"2024-09-12T18:36:01.458577+0000","last_peered":"2024-09-12T18:36:01.458577+0000","last_clean":"2024-09-12T18:36:01.458577+0000","last_became_active":"2024-09-12T18:35:25.660126+0000","last_became_peered":"2024-09-12T18:35:25.660126+0000","last_unstale":"2024-09-12T18:36:01.458577+0000","last_undegraded":"2024-09-12T18:36:01.458577+0000","last_fullsized":"2024-09-12T18:36:01.458577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:48.437139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457592+0000","last_change":"2024-09-12T18:35:25.661523+0000","last_active":"2024-09-12T18:36:01.457592+0000","last_peered":"2024-09-12T18:36:01.457592+0000","last_clean":"2024-09-12T18:36:01.457592+0000","last_became_active":"2024-09-12T18:35:25.659338+0000","last_became_peered":"2024-09-12T18:35:25.659338+0000","last_unstale":"2024-09-12T18:36:01.457592+0000","last_undegraded":"2024-09-12T18:36:01.457592+0000","last_fullsized":"2024-09-12T18:36:01.457592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:37.083820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468463+0000","last_change":"2024-09-12T18:35:25.662445+0000","last_active":"2024-09-12T18:36:03.468463+0000","last_peered":"2024-09-12T18:36:03.468463+0000","last_clean":"2024-09-12T18:36:03.468463+0000","last_became_active":"2024-09-12T18:35:25.659496+0000","last_became_peered":"2024-09-12T18:35:25.659496+0000","last_unstale":"2024-09-12T18:36:03.468463+0000","last_undegraded":"2024-09-12T18:36:03.468463+0000","last_fullsized":"2024-09-12T18:36:03.468463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:03.270420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457867+0000","last_change":"2024-09-12T18:35:25.662519+0000","last_active":"2024-09-12T18:36:01.457867+0000","last_peered":"2024-09-12T18:36:01.457867+0000","last_clean":"2024-09-12T18:36:01.457867+0000","last_became_active":"2024-09-12T18:35:25.652964+0000","last_became_peered":"2024-09-12T18:35:25.652964+0000","last_unstale":"2024-09-12T18:36:01.457867+0000","last_undegraded":"2024-09-12T18:36:01.457867+0000","last_fullsized":"2024-09-12T18:36:01.457867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:37.923468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.467821+0000","last_change":"2024-09-12T18:35:25.650507+0000","last_active":"2024-09-12T18:36:03.467821+0000","last_peered":"2024-09-12T18:36:03.467821+0000","last_clean":"2024-09-12T18:36:03.467821+0000","last_became_active":"2024-09-12T18:35:25.649415+0000","last_became_peered":"2024-09-12T18:35:25.649415+0000","last_unstale":"2024-09-12T18:36:03.467821+0000","last_undegraded":"2024-09-12T18:36:03.467821+0000","last_fullsized":"2024-09-12T18:36:03.467821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:23.081416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457196+0000","last_change":"2024-09-12T18:35:25.653949+0000","last_active":"2024-09-12T18:36:01.457196+0000","last_peered":"2024-09-12T18:36:01.457196+0000","last_clean":"2024-09-12T18:36:01.457196+0000","last_became_active":"2024-09-12T18:35:25.652992+0000","last_became_peered":"2024-09-12T18:35:25.652992+0000","last_unstale":"2024-09-12T18:36:01.457196+0000","last_undegraded":"2024-09-12T18:36:01.457196+0000","last_fullsized":"2024-09-12T18:36:01.457196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:47.687372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.456891+0000","last_change":"2024-09-12T18:35:25.653159+0000","last_active":"2024-09-12T18:36:01.456891+0000","last_peered":"2024-09-12T18:36:01.456891+0000","last_clean":"2024-09-12T18:36:01.456891+0000","last_became_active":"2024-09-12T18:35:25.650551+0000","last_became_peered":"2024-09-12T18:35:25.650551+0000","last_unstale":"2024-09-12T18:36:01.456891+0000","last_undegraded":"2024-09-12T18:36:01.456891+0000","last_fullsized":"2024-09-12T18:36:01.456891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:16.245302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468359+0000","last_change":"2024-09-12T18:35:25.651877+0000","last_active":"2024-09-12T18:36:03.468359+0000","last_peered":"2024-09-12T18:36:03.468359+0000","last_clean":"2024-09-12T18:36:03.468359+0000","last_became_active":"2024-09-12T18:35:25.651055+0000","last_became_peered":"2024-09-12T18:35:25.651055+0000","last_unstale":"2024-09-12T18:36:03.468359+0000","last_undegraded":"2024-09-12T18:36:03.468359+0000","last_fullsized":"2024-09-12T18:36:03.468359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:14.200080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457269+0000","last_change":"2024-09-12T18:35:24.657739+0000","last_active":"2024-09-12T18:36:01.457269+0000","last_peered":"2024-09-12T18:36:01.457269+0000","last_clean":"2024-09-12T18:36:01.457269+0000","last_became_active":"2024-09-12T18:35:24.656208+0000","last_became_peered":"2024-09-12T18:35:24.656208+0000","last_unstale":"2024-09-12T18:36:01.457269+0000","last_undegraded":"2024-09-12T18:36:01.457269+0000","last_fullsized":"2024-09-12T18:36:01.457269+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:50.073716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468191+0000","last_change":"2024-09-12T18:35:25.651651+0000","last_active":"2024-09-12T18:36:03.468191+0000","last_peered":"2024-09-12T18:36:03.468191+0000","last_clean":"2024-09-12T18:36:03.468191+0000","last_became_active":"2024-09-12T18:35:25.650849+0000","last_became_peered":"2024-09-12T18:35:25.650849+0000","last_unstale":"2024-09-12T18:36:03.468191+0000","last_undegraded":"2024-09-12T18:36:03.468191+0000","last_fullsized":"2024-09-12T18:36:03.468191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:18.555827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457663+0000","last_change":"2024-09-12T18:35:24.656119+0000","last_active":"2024-09-12T18:36:01.457663+0000","last_peered":"2024-09-12T18:36:01.457663+0000","last_clean":"2024-09-12T18:36:01.457663+0000","last_became_active":"2024-09-12T18:35:24.653175+0000","last_became_peered":"2024-09-12T18:35:24.653175+0000","last_unstale":"2024-09-12T18:36:01.457663+0000","last_undegraded":"2024-09-12T18:36:01.457663+0000","last_fullsized":"2024-09-12T18:36:01.457663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:00.551165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458765+0000","last_change":"2024-09-12T18:35:25.655723+0000","last_active":"2024-09-12T18:36:01.458765+0000","last_peered":"2024-09-12T18:36:01.458765+0000","last_clean":"2024-09-12T18:36:01.458765+0000","last_became_active":"2024-09-12T18:35:25.653630+0000","last_became_peered":"2024-09-12T18:35:25.653630+0000","last_unstale":"2024-09-12T18:36:01.458765+0000","last_undegraded":"2024-09-12T18:36:01.458765+0000","last_fullsized":"2024-09-12T18:36:01.458765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:07.655792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.467642+0000","last_change":"2024-09-12T18:35:24.640096+0000","last_active":"2024-09-12T18:36:03.467642+0000","last_peered":"2024-09-12T18:36:03.467642+0000","last_clean":"2024-09-12T18:36:03.467642+0000","last_became_active":"2024-09-12T18:35:24.638230+0000","last_became_peered":"2024-09-12T18:35:24.638230+0000","last_unstale":"2024-09-12T18:36:03.467642+0000","last_undegraded":"2024-09-12T18:36:03.467642+0000","last_fullsized":"2024-09-12T18:36:03.467642+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:38.435296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457928+0000","last_change":"2024-09-12T18:35:25.662692+0000","last_active":"2024-09-12T18:36:01.457928+0000","last_peered":"2024-09-12T18:36:01.457928+0000","last_clean":"2024-09-12T18:36:01.457928+0000","last_became_active":"2024-09-12T18:35:25.661885+0000","last_became_peered":"2024-09-12T18:35:25.661885+0000","last_unstale":"2024-09-12T18:36:01.457928+0000","last_undegraded":"2024-09-12T18:36:01.457928+0000","last_fullsized":"2024-09-12T18:36:01.457928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:41.264425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457083+0000","last_change":"2024-09-12T18:35:24.653610+0000","last_active":"2024-09-12T18:36:01.457083+0000","last_peered":"2024-09-12T18:36:01.457083+0000","last_clean":"2024-09-12T18:36:01.457083+0000","last_became_active":"2024-09-12T18:35:24.652880+0000","last_became_peered":"2024-09-12T18:35:24.652880+0000","last_unstale":"2024-09-12T18:36:01.457083+0000","last_undegraded":"2024-09-12T18:36:01.457083+0000","last_fullsized":"2024-09-12T18:36:01.457083+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:57.636251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"31'2753","reported_seq":2782,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.462239+0000","last_change":"2024-09-12T18:35:44.771794+0000","last_active":"2024-09-12T18:36:01.462239+0000","last_peered":"2024-09-12T18:36:01.462239+0000","last_clean":"2024-09-12T18:36:01.462239+0000","last_became_active":"2024-09-12T18:35:44.771286+0000","last_became_peered":"2024-09-12T18:35:44.771286+0000","last_unstale":"2024-09-12T18:36:01.462239+0000","last_undegraded":"2024-09-12T18:36:01.462239+0000","last_fullsized":"2024-09-12T18:36:01.462239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":2753,"log_dups_size":0,"ondisk_log_size":2753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:10.094729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180420608,"num_objects":2753,"num_object_clones":0,"num_object_copies":5506,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2753,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2753,"num_write_kb":176192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.460130+0000","last_change":"2024-09-12T18:35:24.653465+0000","last_active":"2024-09-12T18:36:01.460130+0000","last_peered":"2024-09-12T18:36:01.460130+0000","last_clean":"2024-09-12T18:36:01.460130+0000","last_became_active":"2024-09-12T18:35:24.652792+0000","last_became_peered":"2024-09-12T18:35:24.652792+0000","last_unstale":"2024-09-12T18:36:01.460130+0000","last_undegraded":"2024-09-12T18:36:01.460130+0000","last_fullsized":"2024-09-12T18:36:01.460130+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:14.588993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.469061+0000","last_change":"2024-09-12T18:35:25.655426+0000","last_active":"2024-09-12T18:36:03.469061+0000","last_peered":"2024-09-12T18:36:03.469061+0000","last_clean":"2024-09-12T18:36:03.469061+0000","last_became_active":"2024-09-12T18:35:25.648186+0000","last_became_peered":"2024-09-12T18:35:25.648186+0000","last_unstale":"2024-09-12T18:36:03.469061+0000","last_undegraded":"2024-09-12T18:36:03.469061+0000","last_fullsized":"2024-09-12T18:36:03.469061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:48.802815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"32'2968","reported_seq":3001,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468788+0000","last_change":"2024-09-12T18:35:44.767860+0000","last_active":"2024-09-12T18:36:03.468788+0000","last_peered":"2024-09-12T18:36:03.468788+0000","last_clean":"2024-09-12T18:36:03.468788+0000","last_became_active":"2024-09-12T18:35:44.766986+0000","last_became_peered":"2024-09-12T18:35:44.766986+0000","last_unstale":"2024-09-12T18:36:03.468788+0000","last_undegraded":"2024-09-12T18:36:03.468788+0000","last_fullsized":"2024-09-12T18:36:03.468788+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":2968,"log_dups_size":0,"ondisk_log_size":2968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:49.109157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194510848,"num_objects":2968,"num_object_clones":0,"num_object_copies":5936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2968,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2968,"num_write_kb":189952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468578+0000","last_change":"2024-09-12T18:35:24.648439+0000","last_active":"2024-09-12T18:36:03.468578+0000","last_peered":"2024-09-12T18:36:03.468578+0000","last_clean":"2024-09-12T18:36:03.468578+0000","last_became_active":"2024-09-12T18:35:24.647629+0000","last_became_peered":"2024-09-12T18:35:24.647629+0000","last_unstale":"2024-09-12T18:36:03.468578+0000","last_undegraded":"2024-09-12T18:36:03.468578+0000","last_fullsized":"2024-09-12T18:36:03.468578+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:45.428223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.467525+0000","last_change":"2024-09-12T18:35:25.652496+0000","last_active":"2024-09-12T18:36:03.467525+0000","last_peered":"2024-09-12T18:36:03.467525+0000","last_clean":"2024-09-12T18:36:03.467525+0000","last_became_active":"2024-09-12T18:35:25.651628+0000","last_became_peered":"2024-09-12T18:35:25.651628+0000","last_unstale":"2024-09-12T18:36:03.467525+0000","last_undegraded":"2024-09-12T18:36:03.467525+0000","last_fullsized":"2024-09-12T18:36:03.467525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:44.920448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"32'3118","reported_seq":3151,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.467646+0000","last_change":"2024-09-12T18:35:44.767175+0000","last_active":"2024-09-12T18:36:03.467646+0000","last_peered":"2024-09-12T18:36:03.467646+0000","last_clean":"2024-09-12T18:36:03.467646+0000","last_became_active":"2024-09-12T18:35:44.766592+0000","last_became_peered":"2024-09-12T18:35:44.766592+0000","last_unstale":"2024-09-12T18:36:03.467646+0000","last_undegraded":"2024-09-12T18:36:03.467646+0000","last_fullsized":"2024-09-12T18:36:03.467646+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3118,"log_dups_size":0,"ondisk_log_size":3118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:44.678279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204341248,"num_objects":3118,"num_object_clones":0,"num_object_copies":6236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3118,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3118,"num_write_kb":199552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458211+0000","last_change":"2024-09-12T18:35:24.654976+0000","last_active":"2024-09-12T18:36:01.458211+0000","last_peered":"2024-09-12T18:36:01.458211+0000","last_clean":"2024-09-12T18:36:01.458211+0000","last_became_active":"2024-09-12T18:35:24.654264+0000","last_became_peered":"2024-09-12T18:35:24.654264+0000","last_unstale":"2024-09-12T18:36:01.458211+0000","last_undegraded":"2024-09-12T18:36:01.458211+0000","last_fullsized":"2024-09-12T18:36:01.458211+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:00.115408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.456949+0000","last_change":"2024-09-12T18:35:25.650577+0000","last_active":"2024-09-12T18:36:01.456949+0000","last_peered":"2024-09-12T18:36:01.456949+0000","last_clean":"2024-09-12T18:36:01.456949+0000","last_became_active":"2024-09-12T18:35:25.649172+0000","last_became_peered":"2024-09-12T18:35:25.649172+0000","last_unstale":"2024-09-12T18:36:01.456949+0000","last_undegraded":"2024-09-12T18:36:01.456949+0000","last_fullsized":"2024-09-12T18:36:01.456949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:55.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"31'2790","reported_seq":2819,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457224+0000","last_change":"2024-09-12T18:35:44.763067+0000","last_active":"2024-09-12T18:36:01.457224+0000","last_peered":"2024-09-12T18:36:01.457224+0000","last_clean":"2024-09-12T18:36:01.457224+0000","last_became_active":"2024-09-12T18:35:44.762584+0000","last_became_peered":"2024-09-12T18:35:44.762584+0000","last_unstale":"2024-09-12T18:36:01.457224+0000","last_undegraded":"2024-09-12T18:36:01.457224+0000","last_fullsized":"2024-09-12T18:36:01.457224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":2790,"log_dups_size":0,"ondisk_log_size":2790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:47.847399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182845440,"num_objects":2790,"num_object_clones":0,"num_object_copies":5580,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2790,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2790,"num_write_kb":178560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457710+0000","last_change":"2024-09-12T18:35:24.657665+0000","last_active":"2024-09-12T18:36:01.457710+0000","last_peered":"2024-09-12T18:36:01.457710+0000","last_clean":"2024-09-12T18:36:01.457710+0000","last_became_active":"2024-09-12T18:35:24.657015+0000","last_became_peered":"2024-09-12T18:35:24.657015+0000","last_unstale":"2024-09-12T18:36:01.457710+0000","last_undegraded":"2024-09-12T18:36:01.457710+0000","last_fullsized":"2024-09-12T18:36:01.457710+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:03.171326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457769+0000","last_change":"2024-09-12T18:35:25.665275+0000","last_active":"2024-09-12T18:36:01.457769+0000","last_peered":"2024-09-12T18:36:01.457769+0000","last_clean":"2024-09-12T18:36:01.457769+0000","last_became_active":"2024-09-12T18:35:25.659511+0000","last_became_peered":"2024-09-12T18:35:25.659511+0000","last_unstale":"2024-09-12T18:36:01.457769+0000","last_undegraded":"2024-09-12T18:36:01.457769+0000","last_fullsized":"2024-09-12T18:36:01.457769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"33'3104","reported_seq":3137,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.475835+0000","last_change":"2024-09-12T18:35:44.773526+0000","last_active":"2024-09-12T18:36:03.475835+0000","last_peered":"2024-09-12T18:36:03.475835+0000","last_clean":"2024-09-12T18:36:03.475835+0000","last_became_active":"2024-09-12T18:35:44.772974+0000","last_became_peered":"2024-09-12T18:35:44.772974+0000","last_unstale":"2024-09-12T18:36:03.475835+0000","last_undegraded":"2024-09-12T18:36:03.475835+0000","last_fullsized":"2024-09-12T18:36:03.475835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3104,"log_dups_size":0,"ondisk_log_size":3104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:23.676840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203423744,"num_objects":3104,"num_object_clones":0,"num_object_copies":6208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3104,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3104,"num_write_kb":198656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458040+0000","last_change":"2024-09-12T18:35:24.651913+0000","last_active":"2024-09-12T18:36:01.458040+0000","last_peered":"2024-09-12T18:36:01.458040+0000","last_clean":"2024-09-12T18:36:01.458040+0000","last_became_active":"2024-09-12T18:35:24.650421+0000","last_became_peered":"2024-09-12T18:35:24.650421+0000","last_unstale":"2024-09-12T18:36:01.458040+0000","last_undegraded":"2024-09-12T18:36:01.458040+0000","last_fullsized":"2024-09-12T18:36:01.458040+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:57.685312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457604+0000","last_change":"2024-09-12T18:35:25.651138+0000","last_active":"2024-09-12T18:36:01.457604+0000","last_peered":"2024-09-12T18:36:01.457604+0000","last_clean":"2024-09-12T18:36:01.457604+0000","last_became_active":"2024-09-12T18:35:25.650617+0000","last_became_peered":"2024-09-12T18:35:25.650617+0000","last_unstale":"2024-09-12T18:36:01.457604+0000","last_undegraded":"2024-09-12T18:36:01.457604+0000","last_fullsized":"2024-09-12T18:36:01.457604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:58.535066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"31'2753","reported_seq":2781,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.461611+0000","last_change":"2024-09-12T18:35:44.767970+0000","last_active":"2024-09-12T18:36:01.461611+0000","last_peered":"2024-09-12T18:36:01.461611+0000","last_clean":"2024-09-12T18:36:01.461611+0000","last_became_active":"2024-09-12T18:35:44.767348+0000","last_became_peered":"2024-09-12T18:35:44.767348+0000","last_unstale":"2024-09-12T18:36:01.461611+0000","last_undegraded":"2024-09-12T18:36:01.461611+0000","last_fullsized":"2024-09-12T18:36:01.461611+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":2753,"log_dups_size":0,"ondisk_log_size":2753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:48.745907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180420608,"num_objects":2753,"num_object_clones":0,"num_object_copies":5506,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2753,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2753,"num_write_kb":176192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457846+0000","last_change":"2024-09-12T18:35:24.659019+0000","last_active":"2024-09-12T18:36:01.457846+0000","last_peered":"2024-09-12T18:36:01.457846+0000","last_clean":"2024-09-12T18:36:01.457846+0000","last_became_active":"2024-09-12T18:35:24.658423+0000","last_became_peered":"2024-09-12T18:35:24.658423+0000","last_unstale":"2024-09-12T18:36:01.457846+0000","last_undegraded":"2024-09-12T18:36:01.457846+0000","last_fullsized":"2024-09-12T18:36:01.457846+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:37.668417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457927+0000","last_change":"2024-09-12T18:35:25.662287+0000","last_active":"2024-09-12T18:36:01.457927+0000","last_peered":"2024-09-12T18:36:01.457927+0000","last_clean":"2024-09-12T18:36:01.457927+0000","last_became_active":"2024-09-12T18:35:25.660372+0000","last_became_peered":"2024-09-12T18:35:25.660372+0000","last_unstale":"2024-09-12T18:36:01.457927+0000","last_undegraded":"2024-09-12T18:36:01.457927+0000","last_fullsized":"2024-09-12T18:36:01.457927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:08.729541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.f","version":"30'2806","reported_seq":2835,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.459895+0000","last_change":"2024-09-12T18:35:44.774817+0000","last_active":"2024-09-12T18:36:01.459895+0000","last_peered":"2024-09-12T18:36:01.459895+0000","last_clean":"2024-09-12T18:36:01.459895+0000","last_became_active":"2024-09-12T18:35:44.774429+0000","last_became_peered":"2024-09-12T18:35:44.774429+0000","last_unstale":"2024-09-12T18:36:01.459895+0000","last_undegraded":"2024-09-12T18:36:01.459895+0000","last_fullsized":"2024-09-12T18:36:01.459895+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":2806,"log_dups_size":0,"ondisk_log_size":2806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:21.579103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183894016,"num_objects":2806,"num_object_clones":0,"num_object_copies":5612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2806,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2806,"num_write_kb":179584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.467739+0000","last_change":"2024-09-12T18:35:24.648330+0000","last_active":"2024-09-12T18:36:03.467739+0000","last_peered":"2024-09-12T18:36:03.467739+0000","last_clean":"2024-09-12T18:36:03.467739+0000","last_became_active":"2024-09-12T18:35:24.647520+0000","last_became_peered":"2024-09-12T18:35:24.647520+0000","last_unstale":"2024-09-12T18:36:03.467739+0000","last_undegraded":"2024-09-12T18:36:03.467739+0000","last_fullsized":"2024-09-12T18:36:03.467739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:25.552055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457719+0000","last_change":"2024-09-12T18:35:25.658674+0000","last_active":"2024-09-12T18:36:01.457719+0000","last_peered":"2024-09-12T18:36:01.457719+0000","last_clean":"2024-09-12T18:36:01.457719+0000","last_became_active":"2024-09-12T18:35:25.657386+0000","last_became_peered":"2024-09-12T18:35:25.657386+0000","last_unstale":"2024-09-12T18:36:01.457719+0000","last_undegraded":"2024-09-12T18:36:01.457719+0000","last_fullsized":"2024-09-12T18:36:01.457719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:48.037086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"32'3083","reported_seq":3116,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468201+0000","last_change":"2024-09-12T18:35:44.771738+0000","last_active":"2024-09-12T18:36:03.468201+0000","last_peered":"2024-09-12T18:36:03.468201+0000","last_clean":"2024-09-12T18:36:03.468201+0000","last_became_active":"2024-09-12T18:35:44.771227+0000","last_became_peered":"2024-09-12T18:35:44.771227+0000","last_unstale":"2024-09-12T18:36:03.468201+0000","last_undegraded":"2024-09-12T18:36:03.468201+0000","last_fullsized":"2024-09-12T18:36:03.468201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3083,"log_dups_size":0,"ondisk_log_size":3083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:27.329732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202047488,"num_objects":3083,"num_object_clones":0,"num_object_copies":6166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3083,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3083,"num_write_kb":197312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.469059+0000","last_change":"2024-09-12T18:35:24.646810+0000","last_active":"2024-09-12T18:36:03.469059+0000","last_peered":"2024-09-12T18:36:03.469059+0000","last_clean":"2024-09-12T18:36:03.469059+0000","last_became_active":"2024-09-12T18:35:24.646008+0000","last_became_peered":"2024-09-12T18:35:24.646008+0000","last_unstale":"2024-09-12T18:36:03.469059+0000","last_undegraded":"2024-09-12T18:36:03.469059+0000","last_fullsized":"2024-09-12T18:36:03.469059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:43.888776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458076+0000","last_change":"2024-09-12T18:35:25.667710+0000","last_active":"2024-09-12T18:36:01.458076+0000","last_peered":"2024-09-12T18:36:01.458076+0000","last_clean":"2024-09-12T18:36:01.458076+0000","last_became_active":"2024-09-12T18:35:25.666940+0000","last_became_peered":"2024-09-12T18:35:25.666940+0000","last_unstale":"2024-09-12T18:36:01.458076+0000","last_undegraded":"2024-09-12T18:36:01.458076+0000","last_fullsized":"2024-09-12T18:36:01.458076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:09.823085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"32'3023","reported_seq":3056,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.467735+0000","last_change":"2024-09-12T18:35:44.769127+0000","last_active":"2024-09-12T18:36:03.467735+0000","last_peered":"2024-09-12T18:36:03.467735+0000","last_clean":"2024-09-12T18:36:03.467735+0000","last_became_active":"2024-09-12T18:35:44.768382+0000","last_became_peered":"2024-09-12T18:35:44.768382+0000","last_unstale":"2024-09-12T18:36:03.467735+0000","last_undegraded":"2024-09-12T18:36:03.467735+0000","last_fullsized":"2024-09-12T18:36:03.467735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3023,"log_dups_size":0,"ondisk_log_size":3023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:33.385476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198115328,"num_objects":3023,"num_object_clones":0,"num_object_copies":6046,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3023,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3023,"num_write_kb":193472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":189,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457395+0000","last_change":"2024-09-12T18:35:13.489018+0000","last_active":"2024-09-12T18:36:01.457395+0000","last_peered":"2024-09-12T18:36:01.457395+0000","last_clean":"2024-09-12T18:36:01.457395+0000","last_became_active":"2024-09-12T18:35:13.488346+0000","last_became_peered":"2024-09-12T18:35:13.488346+0000","last_unstale":"2024-09-12T18:36:01.457395+0000","last_undegraded":"2024-09-12T18:36:01.457395+0000","last_fullsized":"2024-09-12T18:36:01.457395+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_clean_scrub_stamp":"2024-09-12T18:35:12.464628+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:54.864640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457506+0000","last_change":"2024-09-12T18:35:22.459694+0000","last_active":"2024-09-12T18:36:01.457506+0000","last_peered":"2024-09-12T18:36:01.457506+0000","last_clean":"2024-09-12T18:36:01.457506+0000","last_became_active":"2024-09-12T18:35:20.446796+0000","last_became_peered":"2024-09-12T18:35:20.446796+0000","last_unstale":"2024-09-12T18:36:01.457506+0000","last_undegraded":"2024-09-12T18:36:01.457506+0000","last_fullsized":"2024-09-12T18:36:01.457506+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:21.506024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016291610000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458518+0000","last_change":"2024-09-12T18:35:24.651749+0000","last_active":"2024-09-12T18:36:01.458518+0000","last_peered":"2024-09-12T18:36:01.458518+0000","last_clean":"2024-09-12T18:36:01.458518+0000","last_became_active":"2024-09-12T18:35:24.649860+0000","last_became_peered":"2024-09-12T18:35:24.649860+0000","last_unstale":"2024-09-12T18:36:01.458518+0000","last_undegraded":"2024-09-12T18:36:01.458518+0000","last_fullsized":"2024-09-12T18:36:01.458518+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:35.430065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458068+0000","last_change":"2024-09-12T18:35:25.662424+0000","last_active":"2024-09-12T18:36:01.458068+0000","last_peered":"2024-09-12T18:36:01.458068+0000","last_clean":"2024-09-12T18:36:01.458068+0000","last_became_active":"2024-09-12T18:35:25.661043+0000","last_became_peered":"2024-09-12T18:35:25.661043+0000","last_unstale":"2024-09-12T18:36:01.458068+0000","last_undegraded":"2024-09-12T18:36:01.458068+0000","last_fullsized":"2024-09-12T18:36:01.458068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:52.551802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.7","version":"31'2739","reported_seq":2768,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.460057+0000","last_change":"2024-09-12T18:35:44.774505+0000","last_active":"2024-09-12T18:36:01.460057+0000","last_peered":"2024-09-12T18:36:01.460057+0000","last_clean":"2024-09-12T18:36:01.460057+0000","last_became_active":"2024-09-12T18:35:44.774259+0000","last_became_peered":"2024-09-12T18:35:44.774259+0000","last_unstale":"2024-09-12T18:36:01.460057+0000","last_undegraded":"2024-09-12T18:36:01.460057+0000","last_fullsized":"2024-09-12T18:36:01.460057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":2739,"log_dups_size":0,"ondisk_log_size":2739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:21.731670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":179503104,"num_objects":2739,"num_object_clones":0,"num_object_copies":5478,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2739,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2739,"num_write_kb":175296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457296+0000","last_change":"2024-09-12T18:35:22.459090+0000","last_active":"2024-09-12T18:36:01.457296+0000","last_peered":"2024-09-12T18:36:01.457296+0000","last_clean":"2024-09-12T18:36:01.457296+0000","last_became_active":"2024-09-12T18:35:20.448553+0000","last_became_peered":"2024-09-12T18:35:20.448553+0000","last_unstale":"2024-09-12T18:36:01.457296+0000","last_undegraded":"2024-09-12T18:36:01.457296+0000","last_fullsized":"2024-09-12T18:36:01.457296+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:56.834808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001030836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457418+0000","last_change":"2024-09-12T18:35:24.651597+0000","last_active":"2024-09-12T18:36:01.457418+0000","last_peered":"2024-09-12T18:36:01.457418+0000","last_clean":"2024-09-12T18:36:01.457418+0000","last_became_active":"2024-09-12T18:35:24.649940+0000","last_became_peered":"2024-09-12T18:35:24.649940+0000","last_unstale":"2024-09-12T18:36:01.457418+0000","last_undegraded":"2024-09-12T18:36:01.457418+0000","last_fullsized":"2024-09-12T18:36:01.457418+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:36.822432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468531+0000","last_change":"2024-09-12T18:35:25.660529+0000","last_active":"2024-09-12T18:36:03.468531+0000","last_peered":"2024-09-12T18:36:03.468531+0000","last_clean":"2024-09-12T18:36:03.468531+0000","last_became_active":"2024-09-12T18:35:25.659537+0000","last_became_peered":"2024-09-12T18:35:25.659537+0000","last_unstale":"2024-09-12T18:36:03.468531+0000","last_undegraded":"2024-09-12T18:36:03.468531+0000","last_fullsized":"2024-09-12T18:36:03.468531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:51.790349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'2763","reported_seq":2792,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458710+0000","last_change":"2024-09-12T18:35:44.770379+0000","last_active":"2024-09-12T18:36:01.458710+0000","last_peered":"2024-09-12T18:36:01.458710+0000","last_clean":"2024-09-12T18:36:01.458710+0000","last_became_active":"2024-09-12T18:35:44.769739+0000","last_became_peered":"2024-09-12T18:35:44.769739+0000","last_unstale":"2024-09-12T18:36:01.458710+0000","last_undegraded":"2024-09-12T18:36:01.458710+0000","last_fullsized":"2024-09-12T18:36:01.458710+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":2763,"log_dups_size":0,"ondisk_log_size":2763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:02:23.077263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181075968,"num_objects":2763,"num_object_clones":0,"num_object_copies":5526,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2763,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2763,"num_write_kb":176832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457508+0000","last_change":"2024-09-12T18:35:22.464179+0000","last_active":"2024-09-12T18:36:01.457508+0000","last_peered":"2024-09-12T18:36:01.457508+0000","last_clean":"2024-09-12T18:36:01.457508+0000","last_became_active":"2024-09-12T18:35:20.442613+0000","last_became_peered":"2024-09-12T18:35:20.442613+0000","last_unstale":"2024-09-12T18:36:01.457508+0000","last_undegraded":"2024-09-12T18:36:01.457508+0000","last_fullsized":"2024-09-12T18:36:01.457508+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:17.636537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014134620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.469114+0000","last_change":"2024-09-12T18:35:24.641297+0000","last_active":"2024-09-12T18:36:03.469114+0000","last_peered":"2024-09-12T18:36:03.469114+0000","last_clean":"2024-09-12T18:36:03.469114+0000","last_became_active":"2024-09-12T18:35:24.637334+0000","last_became_peered":"2024-09-12T18:35:24.637334+0000","last_unstale":"2024-09-12T18:36:03.469114+0000","last_undegraded":"2024-09-12T18:36:03.469114+0000","last_fullsized":"2024-09-12T18:36:03.469114+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:50.772074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458083+0000","last_change":"2024-09-12T18:35:25.659209+0000","last_active":"2024-09-12T18:36:01.458083+0000","last_peered":"2024-09-12T18:36:01.458083+0000","last_clean":"2024-09-12T18:36:01.458083+0000","last_became_active":"2024-09-12T18:35:25.656170+0000","last_became_peered":"2024-09-12T18:35:25.656170+0000","last_unstale":"2024-09-12T18:36:01.458083+0000","last_undegraded":"2024-09-12T18:36:01.458083+0000","last_fullsized":"2024-09-12T18:36:01.458083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:40.925757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"31'2821","reported_seq":2849,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457861+0000","last_change":"2024-09-12T18:35:44.770358+0000","last_active":"2024-09-12T18:36:01.457861+0000","last_peered":"2024-09-12T18:36:01.457861+0000","last_clean":"2024-09-12T18:36:01.457861+0000","last_became_active":"2024-09-12T18:35:44.769786+0000","last_became_peered":"2024-09-12T18:35:44.769786+0000","last_unstale":"2024-09-12T18:36:01.457861+0000","last_undegraded":"2024-09-12T18:36:01.457861+0000","last_fullsized":"2024-09-12T18:36:01.457861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":2821,"log_dups_size":0,"ondisk_log_size":2821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:27.215502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184877056,"num_objects":2821,"num_object_clones":0,"num_object_copies":5642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2821,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2821,"num_write_kb":180544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457951+0000","last_change":"2024-09-12T18:35:22.459049+0000","last_active":"2024-09-12T18:36:01.457951+0000","last_peered":"2024-09-12T18:36:01.457951+0000","last_clean":"2024-09-12T18:36:01.457951+0000","last_became_active":"2024-09-12T18:35:20.446814+0000","last_became_peered":"2024-09-12T18:35:20.446814+0000","last_unstale":"2024-09-12T18:36:01.457951+0000","last_undegraded":"2024-09-12T18:36:01.457951+0000","last_fullsized":"2024-09-12T18:36:01.457951+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:18.033595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010716149999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457397+0000","last_change":"2024-09-12T18:35:24.658273+0000","last_active":"2024-09-12T18:36:01.457397+0000","last_peered":"2024-09-12T18:36:01.457397+0000","last_clean":"2024-09-12T18:36:01.457397+0000","last_became_active":"2024-09-12T18:35:24.657433+0000","last_became_peered":"2024-09-12T18:35:24.657433+0000","last_unstale":"2024-09-12T18:36:01.457397+0000","last_undegraded":"2024-09-12T18:36:01.457397+0000","last_fullsized":"2024-09-12T18:36:01.457397+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:48.497218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.459190+0000","last_change":"2024-09-12T18:35:25.655830+0000","last_active":"2024-09-12T18:36:01.459190+0000","last_peered":"2024-09-12T18:36:01.459190+0000","last_clean":"2024-09-12T18:36:01.459190+0000","last_became_active":"2024-09-12T18:35:25.652126+0000","last_became_peered":"2024-09-12T18:35:25.652126+0000","last_unstale":"2024-09-12T18:36:01.459190+0000","last_undegraded":"2024-09-12T18:36:01.459190+0000","last_fullsized":"2024-09-12T18:36:01.459190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:04.080721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"31'2761","reported_seq":2790,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.464762+0000","last_change":"2024-09-12T18:35:44.770799+0000","last_active":"2024-09-12T18:36:01.464762+0000","last_peered":"2024-09-12T18:36:01.464762+0000","last_clean":"2024-09-12T18:36:01.464762+0000","last_became_active":"2024-09-12T18:35:44.770030+0000","last_became_peered":"2024-09-12T18:35:44.770030+0000","last_unstale":"2024-09-12T18:36:01.464762+0000","last_undegraded":"2024-09-12T18:36:01.464762+0000","last_fullsized":"2024-09-12T18:36:01.464762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":2761,"log_dups_size":0,"ondisk_log_size":2761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:24.786452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180944896,"num_objects":2761,"num_object_clones":0,"num_object_copies":5522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2761,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2761,"num_write_kb":176704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458304+0000","last_change":"2024-09-12T18:35:24.657618+0000","last_active":"2024-09-12T18:36:01.458304+0000","last_peered":"2024-09-12T18:36:01.458304+0000","last_clean":"2024-09-12T18:36:01.458304+0000","last_became_active":"2024-09-12T18:35:24.656741+0000","last_became_peered":"2024-09-12T18:35:24.656741+0000","last_unstale":"2024-09-12T18:36:01.458304+0000","last_undegraded":"2024-09-12T18:36:01.458304+0000","last_fullsized":"2024-09-12T18:36:01.458304+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:43.113104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.459271+0000","last_change":"2024-09-12T18:35:22.464180+0000","last_active":"2024-09-12T18:36:01.459271+0000","last_peered":"2024-09-12T18:36:01.459271+0000","last_clean":"2024-09-12T18:36:01.459271+0000","last_became_active":"2024-09-12T18:35:20.442566+0000","last_became_peered":"2024-09-12T18:35:20.442566+0000","last_unstale":"2024-09-12T18:36:01.459271+0000","last_undegraded":"2024-09-12T18:36:01.459271+0000","last_fullsized":"2024-09-12T18:36:01.459271+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:29.021710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001325786,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.467780+0000","last_change":"2024-09-12T18:35:25.650458+0000","last_active":"2024-09-12T18:36:03.467780+0000","last_peered":"2024-09-12T18:36:03.467780+0000","last_clean":"2024-09-12T18:36:03.467780+0000","last_became_active":"2024-09-12T18:35:25.648761+0000","last_became_peered":"2024-09-12T18:35:25.648761+0000","last_unstale":"2024-09-12T18:36:03.467780+0000","last_undegraded":"2024-09-12T18:36:03.467780+0000","last_fullsized":"2024-09-12T18:36:03.467780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:53.026950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"30'2737","reported_seq":2766,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.456618+0000","last_change":"2024-09-12T18:35:44.773801+0000","last_active":"2024-09-12T18:36:01.456618+0000","last_peered":"2024-09-12T18:36:01.456618+0000","last_clean":"2024-09-12T18:36:01.456618+0000","last_became_active":"2024-09-12T18:35:44.772787+0000","last_became_peered":"2024-09-12T18:35:44.772787+0000","last_unstale":"2024-09-12T18:36:01.456618+0000","last_undegraded":"2024-09-12T18:36:01.456618+0000","last_fullsized":"2024-09-12T18:36:01.456618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":2737,"log_dups_size":0,"ondisk_log_size":2737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:13.758208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":179372032,"num_objects":2737,"num_object_clones":0,"num_object_copies":5474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2737,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2737,"num_write_kb":175168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.459235+0000","last_change":"2024-09-12T18:35:24.649669+0000","last_active":"2024-09-12T18:36:01.459235+0000","last_peered":"2024-09-12T18:36:01.459235+0000","last_clean":"2024-09-12T18:36:01.459235+0000","last_became_active":"2024-09-12T18:35:24.648881+0000","last_became_peered":"2024-09-12T18:35:24.648881+0000","last_unstale":"2024-09-12T18:36:01.459235+0000","last_undegraded":"2024-09-12T18:36:01.459235+0000","last_fullsized":"2024-09-12T18:36:01.459235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:23.614734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468782+0000","last_change":"2024-09-12T18:35:22.458666+0000","last_active":"2024-09-12T18:36:03.468782+0000","last_peered":"2024-09-12T18:36:03.468782+0000","last_clean":"2024-09-12T18:36:03.468782+0000","last_became_active":"2024-09-12T18:35:20.442394+0000","last_became_peered":"2024-09-12T18:35:20.442394+0000","last_unstale":"2024-09-12T18:36:03.468782+0000","last_undegraded":"2024-09-12T18:36:03.468782+0000","last_fullsized":"2024-09-12T18:36:03.468782+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:51.840246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080163599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.467781+0000","last_change":"2024-09-12T18:35:25.650717+0000","last_active":"2024-09-12T18:36:03.467781+0000","last_peered":"2024-09-12T18:36:03.467781+0000","last_clean":"2024-09-12T18:36:03.467781+0000","last_became_active":"2024-09-12T18:35:25.649147+0000","last_became_peered":"2024-09-12T18:35:25.649147+0000","last_unstale":"2024-09-12T18:36:03.467781+0000","last_undegraded":"2024-09-12T18:36:03.467781+0000","last_fullsized":"2024-09-12T18:36:03.467781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:07.365888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"31'2761","reported_seq":2790,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.460166+0000","last_change":"2024-09-12T18:35:44.774031+0000","last_active":"2024-09-12T18:36:01.460166+0000","last_peered":"2024-09-12T18:36:01.460166+0000","last_clean":"2024-09-12T18:36:01.460166+0000","last_became_active":"2024-09-12T18:35:44.772874+0000","last_became_peered":"2024-09-12T18:35:44.772874+0000","last_unstale":"2024-09-12T18:36:01.460166+0000","last_undegraded":"2024-09-12T18:36:01.460166+0000","last_fullsized":"2024-09-12T18:36:01.460166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":2761,"log_dups_size":0,"ondisk_log_size":2761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:27.897491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180944896,"num_objects":2761,"num_object_clones":0,"num_object_copies":5522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2761,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2761,"num_write_kb":176704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458608+0000","last_change":"2024-09-12T18:35:24.657234+0000","last_active":"2024-09-12T18:36:01.458608+0000","last_peered":"2024-09-12T18:36:01.458608+0000","last_clean":"2024-09-12T18:36:01.458608+0000","last_became_active":"2024-09-12T18:35:24.655950+0000","last_became_peered":"2024-09-12T18:35:24.655950+0000","last_unstale":"2024-09-12T18:36:01.458608+0000","last_undegraded":"2024-09-12T18:36:01.458608+0000","last_fullsized":"2024-09-12T18:36:01.458608+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:17.466623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458860+0000","last_change":"2024-09-12T18:35:22.464656+0000","last_active":"2024-09-12T18:36:01.458860+0000","last_peered":"2024-09-12T18:36:01.458860+0000","last_clean":"2024-09-12T18:36:01.458860+0000","last_became_active":"2024-09-12T18:35:20.445470+0000","last_became_peered":"2024-09-12T18:35:20.445470+0000","last_unstale":"2024-09-12T18:36:01.458860+0000","last_undegraded":"2024-09-12T18:36:01.458860+0000","last_fullsized":"2024-09-12T18:36:01.458860+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:58.947359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001742681,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457772+0000","last_change":"2024-09-12T18:35:25.658887+0000","last_active":"2024-09-12T18:36:01.457772+0000","last_peered":"2024-09-12T18:36:01.457772+0000","last_clean":"2024-09-12T18:36:01.457772+0000","last_became_active":"2024-09-12T18:35:25.656829+0000","last_became_peered":"2024-09-12T18:35:25.656829+0000","last_unstale":"2024-09-12T18:36:01.457772+0000","last_undegraded":"2024-09-12T18:36:01.457772+0000","last_fullsized":"2024-09-12T18:36:01.457772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:50.109858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"32'3032","reported_seq":3065,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468970+0000","last_change":"2024-09-12T18:35:44.767276+0000","last_active":"2024-09-12T18:36:03.468970+0000","last_peered":"2024-09-12T18:36:03.468970+0000","last_clean":"2024-09-12T18:36:03.468970+0000","last_became_active":"2024-09-12T18:35:44.766145+0000","last_became_peered":"2024-09-12T18:35:44.766145+0000","last_unstale":"2024-09-12T18:36:03.468970+0000","last_undegraded":"2024-09-12T18:36:03.468970+0000","last_fullsized":"2024-09-12T18:36:03.468970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3032,"log_dups_size":0,"ondisk_log_size":3032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:47.423493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198705152,"num_objects":3032,"num_object_clones":0,"num_object_copies":6064,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3032,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3032,"num_write_kb":194048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458860+0000","last_change":"2024-09-12T18:35:24.654518+0000","last_active":"2024-09-12T18:36:01.458860+0000","last_peered":"2024-09-12T18:36:01.458860+0000","last_clean":"2024-09-12T18:36:01.458860+0000","last_became_active":"2024-09-12T18:35:24.650309+0000","last_became_peered":"2024-09-12T18:35:24.650309+0000","last_unstale":"2024-09-12T18:36:01.458860+0000","last_undegraded":"2024-09-12T18:36:01.458860+0000","last_fullsized":"2024-09-12T18:36:01.458860+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:16.669035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.460165+0000","last_change":"2024-09-12T18:35:22.459767+0000","last_active":"2024-09-12T18:36:01.460165+0000","last_peered":"2024-09-12T18:36:01.460165+0000","last_clean":"2024-09-12T18:36:01.460165+0000","last_became_active":"2024-09-12T18:35:20.448521+0000","last_became_peered":"2024-09-12T18:35:20.448521+0000","last_unstale":"2024-09-12T18:36:01.460165+0000","last_undegraded":"2024-09-12T18:36:01.460165+0000","last_fullsized":"2024-09-12T18:36:01.460165+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:33.463792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017009670000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.467597+0000","last_change":"2024-09-12T18:35:25.648150+0000","last_active":"2024-09-12T18:36:03.467597+0000","last_peered":"2024-09-12T18:36:03.467597+0000","last_clean":"2024-09-12T18:36:03.467597+0000","last_became_active":"2024-09-12T18:35:25.647347+0000","last_became_peered":"2024-09-12T18:35:25.647347+0000","last_unstale":"2024-09-12T18:36:03.467597+0000","last_undegraded":"2024-09-12T18:36:03.467597+0000","last_fullsized":"2024-09-12T18:36:03.467597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:48.968336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.456973+0000","last_change":"2024-09-12T18:35:25.660696+0000","last_active":"2024-09-12T18:36:01.456973+0000","last_peered":"2024-09-12T18:36:01.456973+0000","last_clean":"2024-09-12T18:36:01.456973+0000","last_became_active":"2024-09-12T18:35:25.659827+0000","last_became_peered":"2024-09-12T18:35:25.659827+0000","last_unstale":"2024-09-12T18:36:01.456973+0000","last_undegraded":"2024-09-12T18:36:01.456973+0000","last_fullsized":"2024-09-12T18:36:01.456973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:15.678289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457552+0000","last_change":"2024-09-12T18:35:24.655051+0000","last_active":"2024-09-12T18:36:01.457552+0000","last_peered":"2024-09-12T18:36:01.457552+0000","last_clean":"2024-09-12T18:36:01.457552+0000","last_became_active":"2024-09-12T18:35:24.654282+0000","last_became_peered":"2024-09-12T18:35:24.654282+0000","last_unstale":"2024-09-12T18:36:01.457552+0000","last_undegraded":"2024-09-12T18:36:01.457552+0000","last_fullsized":"2024-09-12T18:36:01.457552+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:08.159799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457575+0000","last_change":"2024-09-12T18:35:25.659237+0000","last_active":"2024-09-12T18:36:01.457575+0000","last_peered":"2024-09-12T18:36:01.457575+0000","last_clean":"2024-09-12T18:36:01.457575+0000","last_became_active":"2024-09-12T18:35:25.658423+0000","last_became_peered":"2024-09-12T18:35:25.658423+0000","last_unstale":"2024-09-12T18:36:01.457575+0000","last_undegraded":"2024-09-12T18:36:01.457575+0000","last_fullsized":"2024-09-12T18:36:01.457575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:42.956934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468426+0000","last_change":"2024-09-12T18:35:24.648658+0000","last_active":"2024-09-12T18:36:03.468426+0000","last_peered":"2024-09-12T18:36:03.468426+0000","last_clean":"2024-09-12T18:36:03.468426+0000","last_became_active":"2024-09-12T18:35:24.647826+0000","last_became_peered":"2024-09-12T18:35:24.647826+0000","last_unstale":"2024-09-12T18:36:03.468426+0000","last_undegraded":"2024-09-12T18:36:03.468426+0000","last_fullsized":"2024-09-12T18:36:03.468426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:24.167549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.459646+0000","last_change":"2024-09-12T18:35:24.656855+0000","last_active":"2024-09-12T18:36:01.459646+0000","last_peered":"2024-09-12T18:36:01.459646+0000","last_clean":"2024-09-12T18:36:01.459646+0000","last_became_active":"2024-09-12T18:35:24.655935+0000","last_became_peered":"2024-09-12T18:35:24.655935+0000","last_unstale":"2024-09-12T18:36:01.459646+0000","last_undegraded":"2024-09-12T18:36:01.459646+0000","last_fullsized":"2024-09-12T18:36:01.459646+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:35.430065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457328+0000","last_change":"2024-09-12T18:35:25.661801+0000","last_active":"2024-09-12T18:36:01.457328+0000","last_peered":"2024-09-12T18:36:01.457328+0000","last_clean":"2024-09-12T18:36:01.457328+0000","last_became_active":"2024-09-12T18:35:25.658476+0000","last_became_peered":"2024-09-12T18:35:25.658476+0000","last_unstale":"2024-09-12T18:36:01.457328+0000","last_undegraded":"2024-09-12T18:36:01.457328+0000","last_fullsized":"2024-09-12T18:36:01.457328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:58.246449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458519+0000","last_change":"2024-09-12T18:35:24.652399+0000","last_active":"2024-09-12T18:36:01.458519+0000","last_peered":"2024-09-12T18:36:01.458519+0000","last_clean":"2024-09-12T18:36:01.458519+0000","last_became_active":"2024-09-12T18:35:24.651416+0000","last_became_peered":"2024-09-12T18:35:24.651416+0000","last_unstale":"2024-09-12T18:36:01.458519+0000","last_undegraded":"2024-09-12T18:36:01.458519+0000","last_fullsized":"2024-09-12T18:36:01.458519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:32.594978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458362+0000","last_change":"2024-09-12T18:35:25.658570+0000","last_active":"2024-09-12T18:36:01.458362+0000","last_peered":"2024-09-12T18:36:01.458362+0000","last_clean":"2024-09-12T18:36:01.458362+0000","last_became_active":"2024-09-12T18:35:25.656561+0000","last_became_peered":"2024-09-12T18:35:25.656561+0000","last_unstale":"2024-09-12T18:36:01.458362+0000","last_undegraded":"2024-09-12T18:36:01.458362+0000","last_fullsized":"2024-09-12T18:36:01.458362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:22.225756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468860+0000","last_change":"2024-09-12T18:35:25.651217+0000","last_active":"2024-09-12T18:36:03.468860+0000","last_peered":"2024-09-12T18:36:03.468860+0000","last_clean":"2024-09-12T18:36:03.468860+0000","last_became_active":"2024-09-12T18:35:25.649544+0000","last_became_peered":"2024-09-12T18:35:25.649544+0000","last_unstale":"2024-09-12T18:36:03.468860+0000","last_undegraded":"2024-09-12T18:36:03.468860+0000","last_fullsized":"2024-09-12T18:36:03.468860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:41.601376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457929+0000","last_change":"2024-09-12T18:35:24.657489+0000","last_active":"2024-09-12T18:36:01.457929+0000","last_peered":"2024-09-12T18:36:01.457929+0000","last_clean":"2024-09-12T18:36:01.457929+0000","last_became_active":"2024-09-12T18:35:24.656030+0000","last_became_peered":"2024-09-12T18:35:24.656030+0000","last_unstale":"2024-09-12T18:36:01.457929+0000","last_undegraded":"2024-09-12T18:36:01.457929+0000","last_fullsized":"2024-09-12T18:36:01.457929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:11.362759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458363+0000","last_change":"2024-09-12T18:35:25.661544+0000","last_active":"2024-09-12T18:36:01.458363+0000","last_peered":"2024-09-12T18:36:01.458363+0000","last_clean":"2024-09-12T18:36:01.458363+0000","last_became_active":"2024-09-12T18:35:25.656985+0000","last_became_peered":"2024-09-12T18:35:25.656985+0000","last_unstale":"2024-09-12T18:36:01.458363+0000","last_undegraded":"2024-09-12T18:36:01.458363+0000","last_fullsized":"2024-09-12T18:36:01.458363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457354+0000","last_change":"2024-09-12T18:35:24.646342+0000","last_active":"2024-09-12T18:36:01.457354+0000","last_peered":"2024-09-12T18:36:01.457354+0000","last_clean":"2024-09-12T18:36:01.457354+0000","last_became_active":"2024-09-12T18:35:24.644773+0000","last_became_peered":"2024-09-12T18:35:24.644773+0000","last_unstale":"2024-09-12T18:36:01.457354+0000","last_undegraded":"2024-09-12T18:36:01.457354+0000","last_fullsized":"2024-09-12T18:36:01.457354+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:17.011231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.467975+0000","last_change":"2024-09-12T18:35:25.656712+0000","last_active":"2024-09-12T18:36:03.467975+0000","last_peered":"2024-09-12T18:36:03.467975+0000","last_clean":"2024-09-12T18:36:03.467975+0000","last_became_active":"2024-09-12T18:35:25.654473+0000","last_became_peered":"2024-09-12T18:35:25.654473+0000","last_unstale":"2024-09-12T18:36:03.467975+0000","last_undegraded":"2024-09-12T18:36:03.467975+0000","last_fullsized":"2024-09-12T18:36:03.467975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:01.464680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468116+0000","last_change":"2024-09-12T18:35:24.659935+0000","last_active":"2024-09-12T18:36:03.468116+0000","last_peered":"2024-09-12T18:36:03.468116+0000","last_clean":"2024-09-12T18:36:03.468116+0000","last_became_active":"2024-09-12T18:35:24.659111+0000","last_became_peered":"2024-09-12T18:35:24.659111+0000","last_unstale":"2024-09-12T18:36:03.468116+0000","last_undegraded":"2024-09-12T18:36:03.468116+0000","last_fullsized":"2024-09-12T18:36:03.468116+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:11.480154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468260+0000","last_change":"2024-09-12T18:35:25.660557+0000","last_active":"2024-09-12T18:36:03.468260+0000","last_peered":"2024-09-12T18:36:03.468260+0000","last_clean":"2024-09-12T18:36:03.468260+0000","last_became_active":"2024-09-12T18:35:25.652300+0000","last_became_peered":"2024-09-12T18:35:25.652300+0000","last_unstale":"2024-09-12T18:36:03.468260+0000","last_undegraded":"2024-09-12T18:36:03.468260+0000","last_fullsized":"2024-09-12T18:36:03.468260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:10:59.995841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468140+0000","last_change":"2024-09-12T18:35:24.638538+0000","last_active":"2024-09-12T18:36:03.468140+0000","last_peered":"2024-09-12T18:36:03.468140+0000","last_clean":"2024-09-12T18:36:03.468140+0000","last_became_active":"2024-09-12T18:35:24.637242+0000","last_became_peered":"2024-09-12T18:35:24.637242+0000","last_unstale":"2024-09-12T18:36:03.468140+0000","last_undegraded":"2024-09-12T18:36:03.468140+0000","last_fullsized":"2024-09-12T18:36:03.468140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:26.877441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.456837+0000","last_change":"2024-09-12T18:35:25.662537+0000","last_active":"2024-09-12T18:36:01.456837+0000","last_peered":"2024-09-12T18:36:01.456837+0000","last_clean":"2024-09-12T18:36:01.456837+0000","last_became_active":"2024-09-12T18:35:25.661441+0000","last_became_peered":"2024-09-12T18:35:25.661441+0000","last_unstale":"2024-09-12T18:36:01.456837+0000","last_undegraded":"2024-09-12T18:36:01.456837+0000","last_fullsized":"2024-09-12T18:36:01.456837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:14.397867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457447+0000","last_change":"2024-09-12T18:35:24.657635+0000","last_active":"2024-09-12T18:36:01.457447+0000","last_peered":"2024-09-12T18:36:01.457447+0000","last_clean":"2024-09-12T18:36:01.457447+0000","last_became_active":"2024-09-12T18:35:24.655992+0000","last_became_peered":"2024-09-12T18:35:24.655992+0000","last_unstale":"2024-09-12T18:36:01.457447+0000","last_undegraded":"2024-09-12T18:36:01.457447+0000","last_fullsized":"2024-09-12T18:36:01.457447+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:33.536755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457644+0000","last_change":"2024-09-12T18:35:25.651406+0000","last_active":"2024-09-12T18:36:01.457644+0000","last_peered":"2024-09-12T18:36:01.457644+0000","last_clean":"2024-09-12T18:36:01.457644+0000","last_became_active":"2024-09-12T18:35:25.649728+0000","last_became_peered":"2024-09-12T18:35:25.649728+0000","last_unstale":"2024-09-12T18:36:01.457644+0000","last_undegraded":"2024-09-12T18:36:01.457644+0000","last_fullsized":"2024-09-12T18:36:01.457644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:41.773283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.468282+0000","last_change":"2024-09-12T18:35:24.649153+0000","last_active":"2024-09-12T18:36:03.468282+0000","last_peered":"2024-09-12T18:36:03.468282+0000","last_clean":"2024-09-12T18:36:03.468282+0000","last_became_active":"2024-09-12T18:35:24.648512+0000","last_became_peered":"2024-09-12T18:35:24.648512+0000","last_unstale":"2024-09-12T18:36:03.468282+0000","last_undegraded":"2024-09-12T18:36:03.468282+0000","last_fullsized":"2024-09-12T18:36:03.468282+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:07.810456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T18:36:03.467850+0000","last_change":"2024-09-12T18:35:25.656799+0000","last_active":"2024-09-12T18:36:03.467850+0000","last_peered":"2024-09-12T18:36:03.467850+0000","last_clean":"2024-09-12T18:36:03.467850+0000","last_became_active":"2024-09-12T18:35:25.654980+0000","last_became_peered":"2024-09-12T18:35:25.654980+0000","last_unstale":"2024-09-12T18:36:03.467850+0000","last_undegraded":"2024-09-12T18:36:03.467850+0000","last_fullsized":"2024-09-12T18:36:03.467850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:10.735439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458749+0000","last_change":"2024-09-12T18:35:24.656268+0000","last_active":"2024-09-12T18:36:01.458749+0000","last_peered":"2024-09-12T18:36:01.458749+0000","last_clean":"2024-09-12T18:36:01.458749+0000","last_became_active":"2024-09-12T18:35:24.655420+0000","last_became_peered":"2024-09-12T18:35:24.655420+0000","last_unstale":"2024-09-12T18:36:01.458749+0000","last_undegraded":"2024-09-12T18:36:01.458749+0000","last_fullsized":"2024-09-12T18:36:01.458749+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:04.654666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.457205+0000","last_change":"2024-09-12T18:35:25.661042+0000","last_active":"2024-09-12T18:36:01.457205+0000","last_peered":"2024-09-12T18:36:01.457205+0000","last_clean":"2024-09-12T18:36:01.457205+0000","last_became_active":"2024-09-12T18:35:25.660163+0000","last_became_peered":"2024-09-12T18:35:25.660163+0000","last_unstale":"2024-09-12T18:36:01.457205+0000","last_undegraded":"2024-09-12T18:36:01.457205+0000","last_fullsized":"2024-09-12T18:36:01.457205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:37.682184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.458405+0000","last_change":"2024-09-12T18:35:24.652304+0000","last_active":"2024-09-12T18:36:01.458405+0000","last_peered":"2024-09-12T18:36:01.458405+0000","last_clean":"2024-09-12T18:36:01.458405+0000","last_became_active":"2024-09-12T18:35:24.651460+0000","last_became_peered":"2024-09-12T18:35:24.651460+0000","last_unstale":"2024-09-12T18:36:01.458405+0000","last_undegraded":"2024-09-12T18:36:01.458405+0000","last_fullsized":"2024-09-12T18:36:01.458405+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:42.050557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":3015442432,"num_objects":46012,"num_object_clones":0,"num_object_copies":92024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46012,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46012,"num_write_kb":2944768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":373264384,"data_stored":5972230144,"data_compressed":283591221,"data_compressed_allocated":373264384,"data_compressed_original":5972230144,"omap_allocated":0,"internal_metadata":0},"log_size":46012,"ondisk_log_size":46012,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705677,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":165392,"kb_used_data":107832,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94206448,"statfs":{"total":96636764160,"available":96467402752,"internally_reserved":0,"allocated":110419968,"data_stored":1760877616,"data_compressed":83616205,"data_compressed_allocated":110055424,"data_compressed_original":1760739328,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,1,3,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738381,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":163976,"kb_used_data":110584,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94207864,"statfs":{"total":96636764160,"available":96468852736,"internally_reserved":0,"allocated":113238016,"data_stored":1806154465,"data_compressed":85766509,"data_compressed_allocated":112885760,"data_compressed_original":1806024704,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738381,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":213288,"kb_used_data":141848,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94158552,"statfs":{"total":96636764160,"available":96418357248,"internally_reserved":0,"allocated":145252352,"data_stored":2319233471,"data_compressed":110123431,"data_compressed_allocated":144945152,"data_compressed_original":2319122432,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,2,1,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":146882560,"data_stored":2350120960,"data_compressed":111595407,"data_compressed_allocated":146882560,"data_compressed_original":2350120960,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":112922624,"data_stored":1806761984,"data_compressed":85794115,"data_compressed_allocated":112922624,"data_compressed_original":1806761984,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":113459200,"data_stored":1815347200,"data_compressed":86201699,"data_compressed_allocated":113459200,"data_compressed_original":1815347200,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:36:05.943 INFO:tasks.thrashosds.thrasher:Setting 3.2 to [1, 2, 0] 2024-09-12T18:36:05.943 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '3.2', '1', '2', '0'] 2024-09-12T18:36:05.943 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 3.2 1 2 0 2024-09-12T18:36:05.952 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:36:05.953 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:05.948+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:06.052 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:06.048+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:06.102 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:06.102 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:06.126 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:36:06.153 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:06.149+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:06.255 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:06.249+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:06.273 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:06.273 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:06.294 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:36:06.331 INFO:teuthology.orchestra.run.smithi073.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2024-09-12T18:36:06.336 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T18:36:06.337 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2024-09-12T18:36:06.355 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:06.349+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:06.445 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:06.445 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:06.457 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:06.453+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:06.467 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:36:06.509 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T18:36:06.557 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:06.552+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:06.658 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:06.653+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:06.664 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:06.664 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:06.682 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:36:06.769 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:06.765+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:06.860 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:06.857+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:06.870 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 21 16 56605 56589 168.402 135.438 0.00557032 0.00593299 2024-09-12T18:36:06.878 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:06.878 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:06.900 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:36:06.962 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:06.956+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:07.050 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:07.050 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:07.063 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:07.057+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:07.068 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:36:07.164 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:07.160+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:07.220 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:07.220 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:07.242 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:36:07.265 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:07.260+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:07.366 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:07.360+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:07.444 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:07.444 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:07.464 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:36:07.467 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:07.464+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:07.494 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is set 2024-09-12T18:36:07.567 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:07.561+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:07.613 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:07.613 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:07.634 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:36:07.639 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:36:07.669 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:07.665+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:07.769 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:07.764+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:07.784 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:07.785 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:07.795 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:36:07.795 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:36:07.809 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:36:07.813 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:36:07.813 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:36:07.831 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:36:07.831 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:36:07.870 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 22 16 58687 58671 166.661 130.125 0.00868892 0.00599509 2024-09-12T18:36:07.871 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:07.868+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:07.969 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:07.969 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-09-12T18:36:07.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-09-12T18:36:07.969 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:36:07.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.969 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:07.969 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:07.969 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 42.334395598999997, 2024-09-12T18:36:07.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025088781000000001, 2024-09-12T18:36:07.970 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:07.970 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:07.970 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:07.970 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:07.970 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.970 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:07.970 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:07.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:07.970 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.970 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.970 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:07.970 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:07.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:07.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:07.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632518+0000", 2024-09-12T18:36:07.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:36:07.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:07.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632533+0000", 2024-09-12T18:36:07.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5130000000000001e-05 2024-09-12T18:36:07.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:07.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632564+0000", 2024-09-12T18:36:07.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0788999999999999e-05 2024-09-12T18:36:07.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:07.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632590+0000", 2024-09-12T18:36:07.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6057000000000001e-05 2024-09-12T18:36:07.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:07.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.635931+0000", 2024-09-12T18:36:07.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033411320000000001 2024-09-12T18:36:07.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:07.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636186+0000", 2024-09-12T18:36:07.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025452500000000002 2024-09-12T18:36:07.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:07.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636445+0000", 2024-09-12T18:36:07.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000259268 2024-09-12T18:36:07.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:07.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639562+0000", 2024-09-12T18:36:07.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031167 2024-09-12T18:36:07.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.974 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:07.974 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657314+0000", 2024-09-12T18:36:07.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017752562 2024-09-12T18:36:07.974 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.974 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:07.974 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657445+0000", 2024-09-12T18:36:07.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013105899999999999 2024-09-12T18:36:07.974 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.974 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:07.974 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657598+0000", 2024-09-12T18:36:07.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015247899999999999 2024-09-12T18:36:07.974 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:07.975 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:07.975 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:07.975 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.975 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.975 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:07.975 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:07.975 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 42.334269396000003, 2024-09-12T18:36:07.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025643131999999999, 2024-09-12T18:36:07.975 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:07.975 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:07.975 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:07.975 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:07.975 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.975 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:07.976 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:07.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:07.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.976 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:07.976 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:07.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:07.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.976 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:07.976 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632637+0000", 2024-09-12T18:36:07.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5600000000000001e-06 2024-09-12T18:36:07.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:07.977 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632650+0000", 2024-09-12T18:36:07.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3186e-05 2024-09-12T18:36:07.977 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:07.977 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632672+0000", 2024-09-12T18:36:07.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2013000000000001e-05 2024-09-12T18:36:07.977 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:07.977 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632687+0000", 2024-09-12T18:36:07.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5109999999999999e-05 2024-09-12T18:36:07.978 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.978 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:07.978 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636994+0000", 2024-09-12T18:36:07.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0043065539999999998 2024-09-12T18:36:07.978 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.978 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:07.978 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637198+0000", 2024-09-12T18:36:07.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020387199999999999 2024-09-12T18:36:07.978 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.978 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:07.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637475+0000", 2024-09-12T18:36:07.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027731000000000001 2024-09-12T18:36:07.979 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.979 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:07.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639574+0000", 2024-09-12T18:36:07.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020988999999999999 2024-09-12T18:36:07.979 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.979 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:07.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658057+0000", 2024-09-12T18:36:07.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018482926 2024-09-12T18:36:07.979 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.980 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:07.980 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658184+0000", 2024-09-12T18:36:07.980 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012756200000000001 2024-09-12T18:36:07.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.980 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:07.980 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658278+0000", 2024-09-12T18:36:07.980 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4139000000000001e-05 2024-09-12T18:36:07.980 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:07.980 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:07.980 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:07.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.980 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:07.981 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:07.981 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 42.334194304, 2024-09-12T18:36:07.981 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025238883, 2024-09-12T18:36:07.981 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:07.981 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:07.981 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:07.981 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:07.981 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.981 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:07.981 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:07.981 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:07.981 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.981 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.981 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:07.982 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:07.982 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:07.982 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.982 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.982 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:07.982 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632712+0000", 2024-09-12T18:36:07.982 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6869999999999999e-06 2024-09-12T18:36:07.982 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.982 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.982 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:07.982 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632719+0000", 2024-09-12T18:36:07.982 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6059999999999999e-06 2024-09-12T18:36:07.982 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.982 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.983 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:07.983 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632737+0000", 2024-09-12T18:36:07.983 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7983999999999999e-05 2024-09-12T18:36:07.983 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.983 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.983 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:07.983 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632751+0000", 2024-09-12T18:36:07.983 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4473e-05 2024-09-12T18:36:07.983 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.983 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.983 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:07.983 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636961+0000", 2024-09-12T18:36:07.983 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042100840000000002 2024-09-12T18:36:07.984 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.984 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:07.984 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637211+0000", 2024-09-12T18:36:07.984 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000249738 2024-09-12T18:36:07.984 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.984 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:07.984 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637504+0000", 2024-09-12T18:36:07.984 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00029271499999999998 2024-09-12T18:36:07.984 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.984 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:07.985 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639582+0000", 2024-09-12T18:36:07.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020783389999999998 2024-09-12T18:36:07.985 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.985 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.985 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:07.985 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657709+0000", 2024-09-12T18:36:07.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018126758999999999 2024-09-12T18:36:07.985 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.985 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.985 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:07.985 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657830+0000", 2024-09-12T18:36:07.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000121329 2024-09-12T18:36:07.985 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.985 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.986 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:07.986 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657949+0000", 2024-09-12T18:36:07.986 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000119169 2024-09-12T18:36:07.986 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:07.986 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:07.986 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:07.986 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.986 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.987 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:07.987 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:07.987 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 42.334130258000002, 2024-09-12T18:36:07.987 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026711823999999999, 2024-09-12T18:36:07.987 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:07.987 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:07.987 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:07.987 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:07.987 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.987 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:07.987 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:07.987 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:07.987 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.987 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.988 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:07.988 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:07.988 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:07.988 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.988 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.988 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:07.988 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632775+0000", 2024-09-12T18:36:07.988 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9999999999999995e-07 2024-09-12T18:36:07.988 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.988 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.988 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:07.988 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632788+0000", 2024-09-12T18:36:07.988 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2629999999999999e-05 2024-09-12T18:36:07.989 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.989 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.989 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:07.989 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632806+0000", 2024-09-12T18:36:07.989 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:36:07.989 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.989 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.989 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:07.989 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632820+0000", 2024-09-12T18:36:07.989 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3777e-05 2024-09-12T18:36:07.989 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.989 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.989 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:07.989 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638310+0000", 2024-09-12T18:36:07.990 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054898280000000004 2024-09-12T18:36:07.990 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.990 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.990 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:07.990 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638480+0000", 2024-09-12T18:36:07.990 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016968199999999999 2024-09-12T18:36:07.990 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.990 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.990 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:07.990 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638799+0000", 2024-09-12T18:36:07.990 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031915999999999997 2024-09-12T18:36:07.990 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.990 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.991 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:07.991 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639866+0000", 2024-09-12T18:36:07.991 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001067405 2024-09-12T18:36:07.991 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.991 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.991 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:07.991 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658398+0000", 2024-09-12T18:36:07.991 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018531542000000002 2024-09-12T18:36:07.991 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.991 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.991 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:07.991 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658643+0000", 2024-09-12T18:36:07.991 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00024531500000000002 2024-09-12T18:36:07.991 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.992 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.992 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:07.992 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.659486+0000", 2024-09-12T18:36:07.992 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00084316899999999995 2024-09-12T18:36:07.992 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:07.992 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:07.992 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:07.992 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.992 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.992 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:07.992 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632845+0000", 2024-09-12T18:36:07.992 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 42.334059232000001, 2024-09-12T18:36:07.992 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015333398999999999, 2024-09-12T18:36:07.993 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:07.993 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:07.993 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:07.993 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:07.993 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.993 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:07.993 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632845+0000", 2024-09-12T18:36:07.993 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:07.993 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.993 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.993 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:07.993 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632845+0000", 2024-09-12T18:36:07.993 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:07.993 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.994 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.994 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:07.994 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632847+0000", 2024-09-12T18:36:07.994 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.407e-06 2024-09-12T18:36:07.994 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.994 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.994 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:07.994 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632854+0000", 2024-09-12T18:36:07.994 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1670000000000002e-06 2024-09-12T18:36:07.994 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.994 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.994 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:07.994 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632877+0000", 2024-09-12T18:36:07.994 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2929e-05 2024-09-12T18:36:07.995 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.995 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.995 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:07.995 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632891+0000", 2024-09-12T18:36:07.995 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3689999999999999e-05 2024-09-12T18:36:07.995 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.995 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.995 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:07.995 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.634571+0000", 2024-09-12T18:36:07.995 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016800929999999999 2024-09-12T18:36:07.995 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.995 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.995 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:07.995 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.635247+0000", 2024-09-12T18:36:07.996 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000676051 2024-09-12T18:36:07.996 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.996 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.996 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:07.996 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636176+0000", 2024-09-12T18:36:07.996 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00092889199999999996 2024-09-12T18:36:07.996 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.996 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.996 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:07.996 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637978+0000", 2024-09-12T18:36:07.996 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018024320000000001 2024-09-12T18:36:07.996 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.996 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.996 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:07.997 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.647862+0000", 2024-09-12T18:36:07.997 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0098842540000000003 2024-09-12T18:36:07.997 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.997 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.997 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:07.997 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.648055+0000", 2024-09-12T18:36:07.997 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00019265499999999999 2024-09-12T18:36:07.997 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.997 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.997 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:07.997 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.648179+0000", 2024-09-12T18:36:07.997 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000123829 2024-09-12T18:36:07.997 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:07.998 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:07.998 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:07.998 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.998 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.998 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:07.998 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:36:07.998 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 42.333903196000001, 2024-09-12T18:36:07.998 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.021357139000000001, 2024-09-12T18:36:07.998 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:07.998 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:07.998 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:07.998 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:07.998 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.999 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:07.999 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:36:07.999 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:07.999 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.999 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.999 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:07.999 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:36:07.999 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:07.999 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:07.999 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:07.999 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:07.999 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633003+0000", 2024-09-12T18:36:07.999 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.53e-06 2024-09-12T18:36:07.999 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.000 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.000 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:08.000 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633012+0000", 2024-09-12T18:36:08.000 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9290000000000004e-06 2024-09-12T18:36:08.000 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.000 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.000 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:08.000 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633034+0000", 2024-09-12T18:36:08.000 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2127e-05 2024-09-12T18:36:08.000 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.000 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.000 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.000 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633054+0000", 2024-09-12T18:36:08.001 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9476000000000001e-05 2024-09-12T18:36:08.001 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.001 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.001 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:08.001 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636657+0000", 2024-09-12T18:36:08.001 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036038839999999999 2024-09-12T18:36:08.001 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.001 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.001 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:08.001 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636885+0000", 2024-09-12T18:36:08.001 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022798800000000001 2024-09-12T18:36:08.001 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.001 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.002 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:08.002 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637189+0000", 2024-09-12T18:36:08.002 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030392100000000002 2024-09-12T18:36:08.002 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.002 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.002 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:08.002 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639271+0000", 2024-09-12T18:36:08.002 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020817460000000002 2024-09-12T18:36:08.002 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.002 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.002 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:08.002 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.652371+0000", 2024-09-12T18:36:08.002 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013099417 2024-09-12T18:36:08.002 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.003 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.003 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:08.003 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654255+0000", 2024-09-12T18:36:08.003 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018846049999999999 2024-09-12T18:36:08.003 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.003 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.003 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:08.003 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654359+0000", 2024-09-12T18:36:08.003 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000103516 2024-09-12T18:36:08.003 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:08.003 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:08.003 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:08.003 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.003 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.004 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:08.004 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:08.004 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 42.333821503999999, 2024-09-12T18:36:08.004 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026938645000000001, 2024-09-12T18:36:08.004 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:08.004 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:08.004 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:08.004 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:08.004 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.004 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:08.004 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:08.004 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:08.004 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.004 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.005 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:08.005 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:08.005 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:08.005 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.005 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.005 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:08.005 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633085+0000", 2024-09-12T18:36:08.005 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:08.005 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.005 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.005 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:08.005 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633093+0000", 2024-09-12T18:36:08.005 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3999999999999992e-06 2024-09-12T18:36:08.005 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.006 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.006 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:08.006 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633111+0000", 2024-09-12T18:36:08.006 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8070000000000001e-05 2024-09-12T18:36:08.006 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.006 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.006 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.006 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633126+0000", 2024-09-12T18:36:08.006 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4487e-05 2024-09-12T18:36:08.006 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.006 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.006 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:08.006 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638290+0000", 2024-09-12T18:36:08.006 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0051640269999999999 2024-09-12T18:36:08.007 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.007 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.007 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:08.007 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638547+0000", 2024-09-12T18:36:08.007 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025714100000000001 2024-09-12T18:36:08.007 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.007 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.007 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:08.007 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638850+0000", 2024-09-12T18:36:08.007 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030278400000000001 2024-09-12T18:36:08.007 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.007 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.007 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:08.008 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.640706+0000", 2024-09-12T18:36:08.008 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018564580000000001 2024-09-12T18:36:08.008 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.008 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.008 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:08.008 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658420+0000", 2024-09-12T18:36:08.008 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017714395000000001 2024-09-12T18:36:08.008 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.008 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.008 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:08.008 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658635+0000", 2024-09-12T18:36:08.008 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021413500000000001 2024-09-12T18:36:08.008 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.008 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.009 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:08.009 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.660022+0000", 2024-09-12T18:36:08.009 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001387318 2024-09-12T18:36:08.009 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:08.009 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:08.009 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:08.009 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.009 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.009 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:08.009 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633323+0000", 2024-09-12T18:36:08.010 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 42.333582149000001, 2024-09-12T18:36:08.010 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015717332000000001, 2024-09-12T18:36:08.010 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:08.010 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:08.010 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:08.010 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:08.010 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.010 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:08.010 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633323+0000", 2024-09-12T18:36:08.011 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:08.012 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.012 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.012 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:08.012 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633323+0000", 2024-09-12T18:36:08.012 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:08.012 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.012 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.012 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:08.012 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633324+0000", 2024-09-12T18:36:08.012 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7230000000000001e-06 2024-09-12T18:36:08.012 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.012 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.012 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:08.013 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633351+0000", 2024-09-12T18:36:08.013 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7067e-05 2024-09-12T18:36:08.013 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.013 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.013 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:08.013 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633372+0000", 2024-09-12T18:36:08.013 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0429e-05 2024-09-12T18:36:08.013 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.013 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.014 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.014 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633387+0000", 2024-09-12T18:36:08.014 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5659999999999999e-05 2024-09-12T18:36:08.014 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.014 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.014 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:08.014 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633527+0000", 2024-09-12T18:36:08.014 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013991599999999999 2024-09-12T18:36:08.014 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.014 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.014 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:08.014 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633806+0000", 2024-09-12T18:36:08.014 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027858400000000001 2024-09-12T18:36:08.014 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.015 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.015 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:08.015 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.649040+0000", 2024-09-12T18:36:08.015 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015233953 2024-09-12T18:36:08.015 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:08.015 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:08.015 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:08.015 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.015 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.015 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:08.015 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:36:08.015 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 42.333476992999998, 2024-09-12T18:36:08.015 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.020709867, 2024-09-12T18:36:08.016 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:08.016 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:08.016 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:08.016 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:08.016 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.016 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:08.016 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:36:08.016 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:08.016 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.016 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.016 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:08.016 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:36:08.016 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:08.016 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.017 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.017 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:08.017 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633429+0000", 2024-09-12T18:36:08.017 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.313e-06 2024-09-12T18:36:08.017 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.017 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.017 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:08.017 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633462+0000", 2024-09-12T18:36:08.017 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3197000000000001e-05 2024-09-12T18:36:08.017 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.017 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.017 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:08.017 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633485+0000", 2024-09-12T18:36:08.017 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3243000000000001e-05 2024-09-12T18:36:08.018 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.018 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.018 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.018 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633501+0000", 2024-09-12T18:36:08.018 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5383000000000002e-05 2024-09-12T18:36:08.018 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.018 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.018 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:08.018 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633642+0000", 2024-09-12T18:36:08.018 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000141168 2024-09-12T18:36:08.018 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.018 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.018 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:08.018 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633982+0000", 2024-09-12T18:36:08.019 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000340067 2024-09-12T18:36:08.019 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.019 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.019 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:08.019 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654138+0000", 2024-09-12T18:36:08.019 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.020155495999999998 2024-09-12T18:36:08.019 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:08.019 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:08.019 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:08.019 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.019 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.019 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:39657 5.b 5:d5bef399:::benchmark_data_smithi073_23739_object39656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:08.019 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:59.583437+0000", 2024-09-12T18:36:08.019 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 8.3834676370000007, 2024-09-12T18:36:08.020 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.014985627, 2024-09-12T18:36:08.020 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:08.020 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:08.020 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:08.020 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:08.020 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:08.020 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:08.020 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 39657 2024-09-12T18:36:08.020 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.020 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:08.020 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.020 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:08.020 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.583437+0000", 2024-09-12T18:36:08.021 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:08.021 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.021 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.021 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:08.021 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.583437+0000", 2024-09-12T18:36:08.021 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:08.021 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.021 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.021 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:08.021 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.583438+0000", 2024-09-12T18:36:08.021 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.1200000000000001e-07 2024-09-12T18:36:08.021 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.021 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.021 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:08.022 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.583508+0000", 2024-09-12T18:36:08.022 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0088999999999999e-05 2024-09-12T18:36:08.022 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.022 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.022 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:08.022 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.583518+0000", 2024-09-12T18:36:08.022 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.028e-05 2024-09-12T18:36:08.022 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.022 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.022 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.022 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.583525+0000", 2024-09-12T18:36:08.022 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.165e-06 2024-09-12T18:36:08.022 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.022 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.023 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:08.023 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.584442+0000", 2024-09-12T18:36:08.023 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00091684000000000004 2024-09-12T18:36:08.023 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.023 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.023 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:08.023 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.584615+0000", 2024-09-12T18:36:08.023 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000173089 2024-09-12T18:36:08.023 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.023 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.023 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:08.023 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.584877+0000", 2024-09-12T18:36:08.024 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000261644 2024-09-12T18:36:08.024 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.024 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.024 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:08.024 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.587726+0000", 2024-09-12T18:36:08.024 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0028489169999999999 2024-09-12T18:36:08.024 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.024 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.024 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:08.024 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.598304+0000", 2024-09-12T18:36:08.024 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.010578438000000001 2024-09-12T18:36:08.024 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.024 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.025 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:08.025 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.598366+0000", 2024-09-12T18:36:08.025 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2014999999999995e-05 2024-09-12T18:36:08.025 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.025 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.025 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:08.025 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.598423+0000", 2024-09-12T18:36:08.025 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6237999999999999e-05 2024-09-12T18:36:08.025 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:08.025 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:08.025 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:08.025 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.025 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.025 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:40432 5.b 5:d974a3ca:::benchmark_data_smithi073_23739_object40431:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:08.026 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:59.917611+0000", 2024-09-12T18:36:08.026 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 8.049293767, 2024-09-12T18:36:08.026 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016184628999999999, 2024-09-12T18:36:08.026 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:08.026 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:08.026 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:08.026 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:08.026 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:08.026 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:08.026 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 40432 2024-09-12T18:36:08.026 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.026 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:08.026 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.026 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:08.027 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.917611+0000", 2024-09-12T18:36:08.027 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:08.027 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.027 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.027 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:08.027 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.917611+0000", 2024-09-12T18:36:08.027 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:08.027 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.027 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.027 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:08.027 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.917612+0000", 2024-09-12T18:36:08.027 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.009e-06 2024-09-12T18:36:08.027 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.028 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.028 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:08.028 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.917751+0000", 2024-09-12T18:36:08.028 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013949399999999999 2024-09-12T18:36:08.028 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.028 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.028 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:08.028 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.917773+0000", 2024-09-12T18:36:08.028 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1265000000000001e-05 2024-09-12T18:36:08.028 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.028 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.028 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.028 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.917782+0000", 2024-09-12T18:36:08.028 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.1009999999999998e-06 2024-09-12T18:36:08.029 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.029 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.029 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:08.029 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.925352+0000", 2024-09-12T18:36:08.029 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0075700689999999996 2024-09-12T18:36:08.029 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.029 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.029 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:08.029 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.925576+0000", 2024-09-12T18:36:08.029 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000224565 2024-09-12T18:36:08.029 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.029 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.029 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:08.030 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.925832+0000", 2024-09-12T18:36:08.030 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000255436 2024-09-12T18:36:08.030 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.030 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.030 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:08.030 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.931553+0000", 2024-09-12T18:36:08.030 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0057211190000000002 2024-09-12T18:36:08.030 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.030 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.030 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:08.030 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.933745+0000", 2024-09-12T18:36:08.030 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0021916290000000001 2024-09-12T18:36:08.030 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.031 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.031 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:08.031 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.933773+0000", 2024-09-12T18:36:08.031 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8249e-05 2024-09-12T18:36:08.031 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.031 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.031 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:08.031 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.933796+0000", 2024-09-12T18:36:08.031 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2693000000000001e-05 2024-09-12T18:36:08.031 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:08.031 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:08.031 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:08.031 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.031 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.032 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:40507 5.e 5:729d4bc6:::benchmark_data_smithi073_23739_object40506:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:08.032 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:59.951281+0000", 2024-09-12T18:36:08.032 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 8.0156239070000002, 2024-09-12T18:36:08.032 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016604759, 2024-09-12T18:36:08.032 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:08.032 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:08.032 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:08.032 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:08.032 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:08.032 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:08.032 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 40507 2024-09-12T18:36:08.032 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.032 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:08.033 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.033 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:08.033 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951281+0000", 2024-09-12T18:36:08.033 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:08.033 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.033 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.033 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:08.033 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951281+0000", 2024-09-12T18:36:08.033 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:08.033 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.033 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.033 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:08.033 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951282+0000", 2024-09-12T18:36:08.033 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7599999999999996e-07 2024-09-12T18:36:08.034 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.034 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.034 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:08.034 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951390+0000", 2024-09-12T18:36:08.034 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000108075 2024-09-12T18:36:08.034 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.034 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.034 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:08.034 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951425+0000", 2024-09-12T18:36:08.034 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5765000000000001e-05 2024-09-12T18:36:08.034 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.034 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.034 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.035 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951435+0000", 2024-09-12T18:36:08.035 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:36:08.035 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.035 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.035 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:08.035 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951505+0000", 2024-09-12T18:36:08.035 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0655999999999996e-05 2024-09-12T18:36:08.035 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.035 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.035 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:08.035 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951663+0000", 2024-09-12T18:36:08.035 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015736799999999999 2024-09-12T18:36:08.035 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.035 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.036 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:08.036 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951812+0000", 2024-09-12T18:36:08.036 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014943000000000001 2024-09-12T18:36:08.036 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.036 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.036 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:08.036 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.953812+0000", 2024-09-12T18:36:08.036 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001999781 2024-09-12T18:36:08.036 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.036 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.036 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:08.036 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.967782+0000", 2024-09-12T18:36:08.036 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013969472 2024-09-12T18:36:08.036 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.037 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.037 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:08.037 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.967839+0000", 2024-09-12T18:36:08.037 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7278999999999998e-05 2024-09-12T18:36:08.037 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.037 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.037 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:08.037 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.967886+0000", 2024-09-12T18:36:08.037 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6717e-05 2024-09-12T18:36:08.037 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:08.037 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:08.037 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:08.037 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.038 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.038 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:40638 5.8 5:1bcfd6bd:::benchmark_data_smithi073_23739_object40637:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:08.038 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:00.010531+0000", 2024-09-12T18:36:08.038 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 7.956373879, 2024-09-12T18:36:08.038 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.01580927, 2024-09-12T18:36:08.038 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:08.038 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:08.038 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:08.038 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:08.038 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:08.038 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:08.038 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 40638 2024-09-12T18:36:08.038 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.039 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:08.039 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.039 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:08.039 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010531+0000", 2024-09-12T18:36:08.039 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:08.039 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.039 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.039 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:08.039 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010531+0000", 2024-09-12T18:36:08.039 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:08.039 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.039 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.039 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:08.039 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010531+0000", 2024-09-12T18:36:08.040 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6400000000000002e-07 2024-09-12T18:36:08.040 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.040 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.040 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:08.040 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010643+0000", 2024-09-12T18:36:08.040 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000111562 2024-09-12T18:36:08.040 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.040 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.040 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:08.040 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010657+0000", 2024-09-12T18:36:08.040 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3804e-05 2024-09-12T18:36:08.040 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.040 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.041 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.041 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010664+0000", 2024-09-12T18:36:08.041 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2919999999999998e-06 2024-09-12T18:36:08.041 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.041 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.041 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:08.041 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.016385+0000", 2024-09-12T18:36:08.041 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0057206490000000004 2024-09-12T18:36:08.041 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.041 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.041 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:08.041 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.016509+0000", 2024-09-12T18:36:08.041 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000124058 2024-09-12T18:36:08.041 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.042 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.042 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:08.042 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.016711+0000", 2024-09-12T18:36:08.042 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000202389 2024-09-12T18:36:08.042 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.042 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.042 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:08.042 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.021363+0000", 2024-09-12T18:36:08.042 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0046515970000000004 2024-09-12T18:36:08.042 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.042 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.042 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:08.042 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.026248+0000", 2024-09-12T18:36:08.043 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.004885655 2024-09-12T18:36:08.043 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.043 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.043 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:08.043 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.026287+0000", 2024-09-12T18:36:08.043 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8909000000000003e-05 2024-09-12T18:36:08.043 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.043 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.043 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:08.043 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.026340+0000", 2024-09-12T18:36:08.043 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2691000000000001e-05 2024-09-12T18:36:08.043 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:08.043 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:08.044 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:08.044 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.044 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.044 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:40639 5.8 5:16bd0f48:::benchmark_data_smithi073_23739_object40638:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:08.044 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:00.010888+0000", 2024-09-12T18:36:08.044 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 7.9560165830000003, 2024-09-12T18:36:08.044 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017069808999999998, 2024-09-12T18:36:08.044 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:08.044 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:08.044 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:08.044 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:08.044 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:08.044 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:08.045 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 40639 2024-09-12T18:36:08.045 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.045 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:08.045 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.045 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:08.045 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010888+0000", 2024-09-12T18:36:08.045 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:08.045 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.045 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.045 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:08.045 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010888+0000", 2024-09-12T18:36:08.045 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:08.045 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.046 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.046 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:08.046 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010889+0000", 2024-09-12T18:36:08.046 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.004e-06 2024-09-12T18:36:08.046 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.046 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.046 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:08.046 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010921+0000", 2024-09-12T18:36:08.046 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1745000000000002e-05 2024-09-12T18:36:08.046 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.046 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.046 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:08.046 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010933+0000", 2024-09-12T18:36:08.046 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2476999999999999e-05 2024-09-12T18:36:08.046 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.047 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.047 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.047 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010941+0000", 2024-09-12T18:36:08.047 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1810000000000004e-06 2024-09-12T18:36:08.047 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.047 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.047 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:08.047 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.019947+0000", 2024-09-12T18:36:08.047 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0090069190000000004 2024-09-12T18:36:08.047 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.047 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.047 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:08.047 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.020062+0000", 2024-09-12T18:36:08.047 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000114851 2024-09-12T18:36:08.048 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.048 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.048 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:08.048 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.020148+0000", 2024-09-12T18:36:08.048 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5579000000000002e-05 2024-09-12T18:36:08.048 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.048 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.048 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:08.048 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.026347+0000", 2024-09-12T18:36:08.048 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0061988820000000002 2024-09-12T18:36:08.048 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.048 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.048 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:08.048 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.027866+0000", 2024-09-12T18:36:08.049 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015197190000000001 2024-09-12T18:36:08.049 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.049 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.049 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:08.049 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.027914+0000", 2024-09-12T18:36:08.049 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8009000000000001e-05 2024-09-12T18:36:08.049 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.049 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.049 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:08.049 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.027958+0000", 2024-09-12T18:36:08.049 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3442999999999997e-05 2024-09-12T18:36:08.049 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:08.049 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:08.050 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:08.050 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.050 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.050 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:40642 5.0 5:015ece55:::benchmark_data_smithi073_23739_object40641:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:08.050 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:00.011626+0000", 2024-09-12T18:36:08.050 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 7.9552787540000001, 2024-09-12T18:36:08.050 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016593251, 2024-09-12T18:36:08.050 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:08.050 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:08.050 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:08.050 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:08.050 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:08.050 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:08.050 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 40642 2024-09-12T18:36:08.051 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.051 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:08.051 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.051 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:08.051 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.011626+0000", 2024-09-12T18:36:08.051 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:08.051 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.051 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.051 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:08.051 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.011626+0000", 2024-09-12T18:36:08.051 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:08.051 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.051 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.052 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:08.052 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.011627+0000", 2024-09-12T18:36:08.052 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.7399999999999991e-07 2024-09-12T18:36:08.052 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.052 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.052 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:08.052 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.011693+0000", 2024-09-12T18:36:08.052 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6586000000000002e-05 2024-09-12T18:36:08.052 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.052 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.052 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:08.052 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.011703+0000", 2024-09-12T18:36:08.052 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.3619999999999995e-06 2024-09-12T18:36:08.053 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.053 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.053 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.053 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.011710+0000", 2024-09-12T18:36:08.053 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1010000000000003e-06 2024-09-12T18:36:08.053 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.053 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.053 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:08.053 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.021346+0000", 2024-09-12T18:36:08.053 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0096362170000000007 2024-09-12T18:36:08.053 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.053 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.053 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:08.053 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.021456+0000", 2024-09-12T18:36:08.054 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010942000000000001 2024-09-12T18:36:08.054 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.054 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.054 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:08.054 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.021540+0000", 2024-09-12T18:36:08.054 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4220000000000003e-05 2024-09-12T18:36:08.054 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.054 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.054 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:08.054 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.027831+0000", 2024-09-12T18:36:08.054 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062915760000000001 2024-09-12T18:36:08.054 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.054 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.054 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:08.055 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.028132+0000", 2024-09-12T18:36:08.055 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030037 2024-09-12T18:36:08.055 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.055 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.055 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:08.055 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.028188+0000", 2024-09-12T18:36:08.055 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6023999999999998e-05 2024-09-12T18:36:08.055 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.055 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.055 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:08.055 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.028219+0000", 2024-09-12T18:36:08.055 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1401e-05 2024-09-12T18:36:08.055 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:08.055 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:08.056 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:08.056 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.056 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.056 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:49141 5.d 5:bce526e5:::benchmark_data_smithi073_23739_object49140:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T18:36:08.056 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:03.538808+0000", 2024-09-12T18:36:08.056 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.4280969470000002, 2024-09-12T18:36:08.056 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.019659019, 2024-09-12T18:36:08.056 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:08.056 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:08.056 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:08.056 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:08.056 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:08.056 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:08.056 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 49141 2024-09-12T18:36:08.057 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.057 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:08.057 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.057 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:08.057 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538808+0000", 2024-09-12T18:36:08.057 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:08.057 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.057 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.057 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:08.057 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538808+0000", 2024-09-12T18:36:08.057 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:08.057 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.057 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.058 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:08.058 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538809+0000", 2024-09-12T18:36:08.058 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.065e-06 2024-09-12T18:36:08.058 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.058 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.058 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:08.058 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538914+0000", 2024-09-12T18:36:08.058 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010528599999999999 2024-09-12T18:36:08.058 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.058 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.058 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:08.058 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538924+0000", 2024-09-12T18:36:08.058 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4420000000000004e-06 2024-09-12T18:36:08.058 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.059 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.059 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.059 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538944+0000", 2024-09-12T18:36:08.059 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0460000000000001e-05 2024-09-12T18:36:08.059 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.059 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.059 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:08.059 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.539034+0000", 2024-09-12T18:36:08.059 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9512000000000006e-05 2024-09-12T18:36:08.059 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.059 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.059 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:08.059 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.539161+0000", 2024-09-12T18:36:08.059 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012782399999999999 2024-09-12T18:36:08.060 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.060 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.060 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:08.060 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.539246+0000", 2024-09-12T18:36:08.060 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4927999999999997e-05 2024-09-12T18:36:08.060 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.060 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.060 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:08.060 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.541390+0000", 2024-09-12T18:36:08.060 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0021439509999999998 2024-09-12T18:36:08.060 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.060 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.060 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:08.061 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.558236+0000", 2024-09-12T18:36:08.061 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016845619999999999 2024-09-12T18:36:08.061 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.061 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.061 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:08.061 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.558368+0000", 2024-09-12T18:36:08.061 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013241300000000001 2024-09-12T18:36:08.061 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.061 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.061 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:08.061 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.558467+0000", 2024-09-12T18:36:08.061 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8517999999999994e-05 2024-09-12T18:36:08.061 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:08.062 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:08.062 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:08.062 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.062 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.062 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:52202 5.e 5:79316c1c:::benchmark_data_smithi073_23739_object52201:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:36:08.062 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:04.855752+0000", 2024-09-12T18:36:08.062 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 3.1111524180000001, 2024-09-12T18:36:08.062 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015567998, 2024-09-12T18:36:08.062 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:08.062 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:08.062 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:08.062 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:08.062 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:08.062 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:08.063 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 52202 2024-09-12T18:36:08.063 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.063 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:08.063 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.063 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:08.063 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:04.855752+0000", 2024-09-12T18:36:08.063 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:08.063 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.063 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.063 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:08.063 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:04.855752+0000", 2024-09-12T18:36:08.063 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:08.063 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.064 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.064 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:08.064 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:04.855753+0000", 2024-09-12T18:36:08.064 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9899999999999999e-07 2024-09-12T18:36:08.064 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.064 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.064 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:08.064 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:04.855871+0000", 2024-09-12T18:36:08.064 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000117916 2024-09-12T18:36:08.064 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.064 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.064 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:08.064 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:04.855882+0000", 2024-09-12T18:36:08.064 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1291000000000001e-05 2024-09-12T18:36:08.065 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.065 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.065 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.065 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:04.855890+0000", 2024-09-12T18:36:08.065 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7840000000000004e-06 2024-09-12T18:36:08.065 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.065 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.065 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:08.065 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:04.855986+0000", 2024-09-12T18:36:08.065 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6413e-05 2024-09-12T18:36:08.065 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.066 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.066 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:08.066 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:04.856075+0000", 2024-09-12T18:36:08.066 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8051000000000001e-05 2024-09-12T18:36:08.066 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.066 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.066 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:08.066 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:04.856155+0000", 2024-09-12T18:36:08.066 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0035000000000002e-05 2024-09-12T18:36:08.066 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.066 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.066 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:08.066 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:04.861933+0000", 2024-09-12T18:36:08.066 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0057787230000000004 2024-09-12T18:36:08.067 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.067 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.067 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:08.067 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:04.871256+0000", 2024-09-12T18:36:08.067 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0093228010000000004 2024-09-12T18:36:08.067 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.067 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.067 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:08.067 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:04.871290+0000", 2024-09-12T18:36:08.067 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4319999999999997e-05 2024-09-12T18:36:08.067 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.067 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.067 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:08.067 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:04.871320+0000", 2024-09-12T18:36:08.068 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9865e-05 2024-09-12T18:36:08.068 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:08.068 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:08.068 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:08.068 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.068 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.068 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:52665 5.4 5:2596ded4:::benchmark_data_smithi073_23739_object52664:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:36:08.068 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:05.063686+0000", 2024-09-12T18:36:08.068 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 2.9032187020000002, 2024-09-12T18:36:08.068 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016518109, 2024-09-12T18:36:08.068 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:08.068 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:08.068 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:08.068 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:08.069 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:08.069 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:08.069 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 52665 2024-09-12T18:36:08.069 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.069 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:08.069 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.069 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:08.069 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063686+0000", 2024-09-12T18:36:08.069 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:08.069 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.069 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.069 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:08.069 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063686+0000", 2024-09-12T18:36:08.069 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:08.070 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.070 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.070 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:08.070 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063687+0000", 2024-09-12T18:36:08.070 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8800000000000001e-07 2024-09-12T18:36:08.070 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.070 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.070 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:08.070 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063816+0000", 2024-09-12T18:36:08.070 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012879100000000001 2024-09-12T18:36:08.070 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.070 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.070 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:08.071 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063844+0000", 2024-09-12T18:36:08.071 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8683e-05 2024-09-12T18:36:08.071 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.071 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.071 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.071 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063851+0000", 2024-09-12T18:36:08.071 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4110000000000001e-06 2024-09-12T18:36:08.071 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.071 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.071 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:08.071 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.066498+0000", 2024-09-12T18:36:08.071 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00264774 2024-09-12T18:36:08.071 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.071 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.072 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:08.072 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.066620+0000", 2024-09-12T18:36:08.072 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000121919 2024-09-12T18:36:08.072 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.072 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.072 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:08.072 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.066756+0000", 2024-09-12T18:36:08.072 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013559800000000001 2024-09-12T18:36:08.072 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.072 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.072 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:08.072 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.072827+0000", 2024-09-12T18:36:08.072 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0060708439999999997 2024-09-12T18:36:08.072 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.073 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.073 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:08.073 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.080088+0000", 2024-09-12T18:36:08.073 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0072613900000000004 2024-09-12T18:36:08.073 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.073 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.073 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:08.073 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.080146+0000", 2024-09-12T18:36:08.073 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7533e-05 2024-09-12T18:36:08.073 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.073 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.073 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:08.073 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.080204+0000", 2024-09-12T18:36:08.073 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8312e-05 2024-09-12T18:36:08.074 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:08.074 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:08.074 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:08.074 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.074 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.074 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:52666 5.4 5:2086007b:::benchmark_data_smithi073_23739_object52665:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:36:08.074 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:05.063873+0000", 2024-09-12T18:36:08.074 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 2.9030318180000001, 2024-09-12T18:36:08.074 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016582294000000001, 2024-09-12T18:36:08.074 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:08.074 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:08.074 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:08.074 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:08.074 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:08.075 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:08.075 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 52666 2024-09-12T18:36:08.075 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.075 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:08.075 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.075 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:08.075 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063873+0000", 2024-09-12T18:36:08.075 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:08.075 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.075 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.075 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:08.075 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063873+0000", 2024-09-12T18:36:08.075 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:08.075 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.076 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.076 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:08.076 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063874+0000", 2024-09-12T18:36:08.076 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4099999999999998e-07 2024-09-12T18:36:08.076 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.076 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.076 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:08.076 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063925+0000", 2024-09-12T18:36:08.076 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1462999999999998e-05 2024-09-12T18:36:08.076 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.076 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.076 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:08.076 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063937+0000", 2024-09-12T18:36:08.076 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1649e-05 2024-09-12T18:36:08.077 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.077 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.077 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.077 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063951+0000", 2024-09-12T18:36:08.077 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4161999999999999e-05 2024-09-12T18:36:08.077 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.077 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.077 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:08.077 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.068208+0000", 2024-09-12T18:36:08.077 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042567630000000002 2024-09-12T18:36:08.077 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.077 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.077 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:08.078 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.068319+0000", 2024-09-12T18:36:08.078 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000110955 2024-09-12T18:36:08.078 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.078 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.078 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:08.078 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.068417+0000", 2024-09-12T18:36:08.078 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.7969999999999999e-05 2024-09-12T18:36:08.078 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.078 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.078 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:08.078 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.072834+0000", 2024-09-12T18:36:08.078 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0044172910000000003 2024-09-12T18:36:08.078 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.078 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.079 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:08.079 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.080278+0000", 2024-09-12T18:36:08.079 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0074438880000000001 2024-09-12T18:36:08.079 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.079 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.079 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:08.079 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.080389+0000", 2024-09-12T18:36:08.079 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000111475 2024-09-12T18:36:08.079 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.079 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.079 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:08.079 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.080455+0000", 2024-09-12T18:36:08.079 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5937000000000002e-05 2024-09-12T18:36:08.079 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:08.079 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:08.080 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:08.080 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.080 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.080 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:52993 5.0 5:00f9e688:::benchmark_data_smithi073_23739_object52992:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:36:08.080 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:05.209109+0000", 2024-09-12T18:36:08.080 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 2.7577958740000001, 2024-09-12T18:36:08.080 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017556391000000001, 2024-09-12T18:36:08.080 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:08.080 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:08.080 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:08.080 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:08.080 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:08.080 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:08.080 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 52993 2024-09-12T18:36:08.081 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.081 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:08.081 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.081 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:08.081 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.209109+0000", 2024-09-12T18:36:08.081 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:08.081 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.081 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.081 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:08.081 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.209109+0000", 2024-09-12T18:36:08.081 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:08.081 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.081 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.081 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:08.082 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.209110+0000", 2024-09-12T18:36:08.082 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8000000000000004e-07 2024-09-12T18:36:08.082 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.082 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.082 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:08.082 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.209246+0000", 2024-09-12T18:36:08.082 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013595 2024-09-12T18:36:08.082 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.082 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.082 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:08.082 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.209256+0000", 2024-09-12T18:36:08.082 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9580000000000002e-06 2024-09-12T18:36:08.082 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.083 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.083 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.083 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.209262+0000", 2024-09-12T18:36:08.083 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7950000000000002e-06 2024-09-12T18:36:08.083 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.083 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.083 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:08.083 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.212362+0000", 2024-09-12T18:36:08.083 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003099606 2024-09-12T18:36:08.083 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.083 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.083 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:08.083 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.212569+0000", 2024-09-12T18:36:08.083 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020737699999999999 2024-09-12T18:36:08.084 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.084 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.084 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:08.084 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.212907+0000", 2024-09-12T18:36:08.084 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00033730499999999998 2024-09-12T18:36:08.084 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.084 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.084 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:08.084 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.226511+0000", 2024-09-12T18:36:08.084 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.01360451 2024-09-12T18:36:08.084 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.084 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.084 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:08.084 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.226567+0000", 2024-09-12T18:36:08.085 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5371000000000002e-05 2024-09-12T18:36:08.085 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.085 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.085 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:08.085 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.226624+0000", 2024-09-12T18:36:08.085 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7355999999999998e-05 2024-09-12T18:36:08.085 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:08.085 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:08.085 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:08.085 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.226665+0000", 2024-09-12T18:36:08.085 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1282999999999998e-05 2024-09-12T18:36:08.085 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:08.085 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:08.085 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:08.086 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:08.086 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:08.086 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:08.087 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:08.084+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:08.087 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:36:08.188 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:08.184+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:08.245 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:36:08.245 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:36:08.246 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.246 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:59479 5.f 5:f7b163d2:::benchmark_data_smithi073_23739_object59478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:36:08.246 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:08.241881+0000", 2024-09-12T18:36:08.246 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0023093570000000002, 2024-09-12T18:36:08.246 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0023342620000000001, 2024-09-12T18:36:08.246 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:08.247 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:08.247 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:08.247 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:08.247 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:08.247 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:08.247 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 59479 2024-09-12T18:36:08.247 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.247 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:08.247 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.247 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:08.247 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.241881+0000", 2024-09-12T18:36:08.248 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.248 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.248 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.248 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:08.248 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.241881+0000", 2024-09-12T18:36:08.248 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.248 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.248 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.248 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:08.249 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.241893+0000", 2024-09-12T18:36:08.249 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2057e-05 2024-09-12T18:36:08.249 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.249 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.249 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:08.249 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.241955+0000", 2024-09-12T18:36:08.249 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.1462000000000002e-05 2024-09-12T18:36:08.249 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.249 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.249 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:08.250 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.241964+0000", 2024-09-12T18:36:08.250 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.7139999999999999e-06 2024-09-12T18:36:08.250 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.250 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.250 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.250 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.241984+0000", 2024-09-12T18:36:08.250 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9976e-05 2024-09-12T18:36:08.250 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.250 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.250 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:08.250 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242064+0000", 2024-09-12T18:36:08.250 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.0168999999999998e-05 2024-09-12T18:36:08.250 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.250 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.251 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:08.251 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242190+0000", 2024-09-12T18:36:08.251 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000125709 2024-09-12T18:36:08.251 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.251 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.251 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:08.251 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242276+0000", 2024-09-12T18:36:08.252 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.6520000000000005e-05 2024-09-12T18:36:08.252 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.252 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:08.252 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.252 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.252 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.253 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:59480 5.1 5:83135789:::benchmark_data_smithi073_23739_object59479:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:36:08.253 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:08.242037+0000", 2024-09-12T18:36:08.253 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0021539129999999999, 2024-09-12T18:36:08.253 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0022343929999999999, 2024-09-12T18:36:08.253 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:08.253 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:08.253 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:08.253 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:08.253 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:08.253 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:08.253 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 59480 2024-09-12T18:36:08.253 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.253 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:08.253 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.254 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:08.254 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242037+0000", 2024-09-12T18:36:08.254 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.254 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.254 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.254 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:08.254 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242037+0000", 2024-09-12T18:36:08.254 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.254 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.254 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.254 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:08.254 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242037+0000", 2024-09-12T18:36:08.254 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.8500000000000001e-07 2024-09-12T18:36:08.254 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.255 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.255 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:08.255 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242077+0000", 2024-09-12T18:36:08.255 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.9075000000000001e-05 2024-09-12T18:36:08.255 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.255 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.255 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:08.255 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242083+0000", 2024-09-12T18:36:08.255 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.1890000000000004e-06 2024-09-12T18:36:08.255 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.255 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.255 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.255 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242087+0000", 2024-09-12T18:36:08.256 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.143e-06 2024-09-12T18:36:08.256 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.256 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.256 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:08.256 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242127+0000", 2024-09-12T18:36:08.256 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.9922000000000002e-05 2024-09-12T18:36:08.256 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.256 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.256 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:08.256 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242207+0000", 2024-09-12T18:36:08.256 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.0196000000000003e-05 2024-09-12T18:36:08.256 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.256 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.256 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:08.257 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242288+0000", 2024-09-12T18:36:08.257 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.0867999999999999e-05 2024-09-12T18:36:08.257 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.257 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:08.257 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.257 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.258 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.258 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:59481 5.f 5.6dba03cf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:36:08.258 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:08.242099+0000", 2024-09-12T18:36:08.258 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0020915880000000001, 2024-09-12T18:36:08.258 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.002228772, 2024-09-12T18:36:08.258 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:08.258 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:08.258 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:08.258 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:08.258 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:08.258 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:08.258 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 59481 2024-09-12T18:36:08.259 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.259 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:08.259 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.259 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:08.259 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242099+0000", 2024-09-12T18:36:08.259 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.259 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.259 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.259 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:08.259 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242099+0000", 2024-09-12T18:36:08.260 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.260 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.260 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.260 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:08.260 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242100+0000", 2024-09-12T18:36:08.260 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.4399999999999999e-07 2024-09-12T18:36:08.260 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.260 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.260 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:08.260 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242137+0000", 2024-09-12T18:36:08.260 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.7397999999999997e-05 2024-09-12T18:36:08.260 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.260 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.261 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:08.261 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242143+0000", 2024-09-12T18:36:08.261 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.7950000000000004e-06 2024-09-12T18:36:08.261 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.261 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.261 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.261 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242161+0000", 2024-09-12T18:36:08.261 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7876e-05 2024-09-12T18:36:08.261 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.261 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:08.261 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.261 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.261 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.262 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:59483 5.f 5.1c7d0e8f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:36:08.262 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:08.242171+0000", 2024-09-12T18:36:08.262 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.002020109, 2024-09-12T18:36:08.262 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0022131099999999999, 2024-09-12T18:36:08.262 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:08.262 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:08.262 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:08.262 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:08.262 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:08.262 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:08.262 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 59483 2024-09-12T18:36:08.262 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.262 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:08.263 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.263 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:08.263 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242171+0000", 2024-09-12T18:36:08.263 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.263 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.263 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.263 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:08.263 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242171+0000", 2024-09-12T18:36:08.263 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.263 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.263 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.263 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:08.263 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242171+0000", 2024-09-12T18:36:08.264 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.7e-07 2024-09-12T18:36:08.264 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.264 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.264 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:08.264 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242209+0000", 2024-09-12T18:36:08.264 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.7455e-05 2024-09-12T18:36:08.264 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.264 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.264 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:08.264 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242214+0000", 2024-09-12T18:36:08.264 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.0170000000000004e-06 2024-09-12T18:36:08.264 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.264 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.265 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.265 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242217+0000", 2024-09-12T18:36:08.265 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.6030000000000001e-06 2024-09-12T18:36:08.265 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.265 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:08.265 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.265 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.265 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.265 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:59484 5.7 5.a9850997 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:36:08.265 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:08.242271+0000", 2024-09-12T18:36:08.265 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.001919745, 2024-09-12T18:36:08.265 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0021666839999999999, 2024-09-12T18:36:08.266 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:08.266 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:08.266 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:08.266 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:08.266 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:08.266 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:08.266 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 59484 2024-09-12T18:36:08.266 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.266 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:08.266 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.266 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:08.266 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242271+0000", 2024-09-12T18:36:08.266 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.266 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.267 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.267 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:08.267 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242271+0000", 2024-09-12T18:36:08.267 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.267 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.267 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.267 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:08.267 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242272+0000", 2024-09-12T18:36:08.267 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.68e-07 2024-09-12T18:36:08.267 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.267 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.267 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:08.267 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242327+0000", 2024-09-12T18:36:08.268 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5686000000000002e-05 2024-09-12T18:36:08.268 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.268 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.268 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:08.268 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242337+0000", 2024-09-12T18:36:08.268 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0156999999999999e-05 2024-09-12T18:36:08.268 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.268 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.268 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.268 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242344+0000", 2024-09-12T18:36:08.269 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.3949999999999998e-06 2024-09-12T18:36:08.269 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.269 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:08.269 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.269 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.269 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.269 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:59485 5.9 5:9274b29d:::benchmark_data_smithi073_23739_object59484:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:36:08.269 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:08.242385+0000", 2024-09-12T18:36:08.269 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0018060159999999999, 2024-09-12T18:36:08.269 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0021024429999999998, 2024-09-12T18:36:08.269 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:08.270 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:08.270 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:08.270 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:08.270 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:08.270 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:08.270 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 59485 2024-09-12T18:36:08.270 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.270 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:08.270 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.270 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:08.271 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242385+0000", 2024-09-12T18:36:08.271 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.271 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.271 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.271 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:08.271 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242385+0000", 2024-09-12T18:36:08.271 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.271 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.271 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.271 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:08.271 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242385+0000", 2024-09-12T18:36:08.271 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.0299999999999999e-07 2024-09-12T18:36:08.271 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.271 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.272 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:08.272 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242495+0000", 2024-09-12T18:36:08.272 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010990800000000001 2024-09-12T18:36:08.272 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.272 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.272 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:08.272 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242502+0000", 2024-09-12T18:36:08.272 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.1350000000000003e-06 2024-09-12T18:36:08.272 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.272 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.272 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.273 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242506+0000", 2024-09-12T18:36:08.273 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.619e-06 2024-09-12T18:36:08.273 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.273 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.273 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:08.273 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242549+0000", 2024-09-12T18:36:08.273 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.3155999999999998e-05 2024-09-12T18:36:08.273 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.273 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.273 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:08.273 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242663+0000", 2024-09-12T18:36:08.273 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011333200000000001 2024-09-12T18:36:08.273 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.273 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.274 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:08.274 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242780+0000", 2024-09-12T18:36:08.274 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000117051 2024-09-12T18:36:08.274 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.274 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:08.274 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.274 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.274 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.274 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:59490 5.1 5.a4a0761 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:36:08.274 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:08.242680+0000", 2024-09-12T18:36:08.274 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.001510986, 2024-09-12T18:36:08.274 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001876331, 2024-09-12T18:36:08.274 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:08.275 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:08.275 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:08.275 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:08.275 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:08.275 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:08.275 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 59490 2024-09-12T18:36:08.275 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.275 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:08.275 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.275 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:08.275 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242680+0000", 2024-09-12T18:36:08.275 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.275 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.275 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.276 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:08.276 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242680+0000", 2024-09-12T18:36:08.276 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.276 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.276 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.276 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:08.276 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242680+0000", 2024-09-12T18:36:08.276 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.5799999999999999e-07 2024-09-12T18:36:08.276 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.276 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.277 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:08.277 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242862+0000", 2024-09-12T18:36:08.277 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00018188500000000001 2024-09-12T18:36:08.277 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.277 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.277 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:08.277 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242873+0000", 2024-09-12T18:36:08.277 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0411000000000001e-05 2024-09-12T18:36:08.277 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.277 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.277 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.277 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242880+0000", 2024-09-12T18:36:08.277 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9809999999999997e-06 2024-09-12T18:36:08.278 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.278 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:08.278 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.278 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.278 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.278 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:59487 5.3 e35/21 5:c0d23f91:::benchmark_data_smithi073_23739_object59486:head v 35'3677, mlcod=35'3674)", 2024-09-12T18:36:08.278 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:08.242990+0000", 2024-09-12T18:36:08.278 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0012010160000000001, 2024-09-12T18:36:08.278 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0016181850000000001, 2024-09-12T18:36:08.278 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:08.278 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:08.278 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:08.278 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:08.278 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.279 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:08.279 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242990+0000", 2024-09-12T18:36:08.279 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.279 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.279 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.279 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:08.279 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242990+0000", 2024-09-12T18:36:08.279 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.279 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.279 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.279 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:08.280 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.242990+0000", 2024-09-12T18:36:08.280 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.3500000000000002e-07 2024-09-12T18:36:08.280 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.280 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.280 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:08.280 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.243070+0000", 2024-09-12T18:36:08.280 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.9935e-05 2024-09-12T18:36:08.280 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.281 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.281 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:08.281 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.243081+0000", 2024-09-12T18:36:08.281 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1269e-05 2024-09-12T18:36:08.281 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.281 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.281 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.281 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.243088+0000", 2024-09-12T18:36:08.281 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.1770000000000003e-06 2024-09-12T18:36:08.281 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.281 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.281 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:08.281 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.243169+0000", 2024-09-12T18:36:08.281 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1427000000000005e-05 2024-09-12T18:36:08.282 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.282 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.282 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:08.282 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.243193+0000", 2024-09-12T18:36:08.282 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.3883000000000002e-05 2024-09-12T18:36:08.282 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.282 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:08.282 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.282 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.282 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.282 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:59486 5.d e35/21 5:bc174ac7:::benchmark_data_smithi073_23739_object59485:head v 35'3782, mlcod=35'3780)", 2024-09-12T18:36:08.282 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:08.243016+0000", 2024-09-12T18:36:08.282 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0011745010000000001, 2024-09-12T18:36:08.283 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0016482389999999999, 2024-09-12T18:36:08.283 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:08.283 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:08.283 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:08.283 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:08.283 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.283 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:08.283 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.243016+0000", 2024-09-12T18:36:08.283 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.284 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.284 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.284 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:08.284 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.243016+0000", 2024-09-12T18:36:08.284 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.284 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.284 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.284 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:08.284 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.243017+0000", 2024-09-12T18:36:08.284 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.4200000000000002e-07 2024-09-12T18:36:08.284 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.284 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.285 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:08.285 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.243124+0000", 2024-09-12T18:36:08.285 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000107352 2024-09-12T18:36:08.285 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.285 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.285 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:08.285 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.243159+0000", 2024-09-12T18:36:08.285 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5287000000000003e-05 2024-09-12T18:36:08.285 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.285 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.285 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.286 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.243166+0000", 2024-09-12T18:36:08.286 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2439999999999996e-06 2024-09-12T18:36:08.286 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.286 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.286 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:08.286 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.243235+0000", 2024-09-12T18:36:08.286 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9006999999999998e-05 2024-09-12T18:36:08.286 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.286 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.286 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:08.286 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.243255+0000", 2024-09-12T18:36:08.286 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9905999999999999e-05 2024-09-12T18:36:08.287 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.287 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:08.287 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.287 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.287 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.287 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:59488 5.6 e35/21 5:66171bc7:::benchmark_data_smithi073_23739_object59487:head v 35'3788, mlcod=35'3786)", 2024-09-12T18:36:08.287 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:08.243115+0000", 2024-09-12T18:36:08.287 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0010762759999999999, 2024-09-12T18:36:08.287 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001604755, 2024-09-12T18:36:08.287 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:08.287 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:08.288 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:08.288 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:08.288 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.288 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:08.288 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.243115+0000", 2024-09-12T18:36:08.288 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.288 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.288 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.288 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:08.288 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.243115+0000", 2024-09-12T18:36:08.288 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.289 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.289 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.289 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:08.289 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.243115+0000", 2024-09-12T18:36:08.289 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.6899999999999998e-07 2024-09-12T18:36:08.289 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.289 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.289 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:08.289 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.243182+0000", 2024-09-12T18:36:08.289 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.7325999999999999e-05 2024-09-12T18:36:08.289 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.290 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.290 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:08.290 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.243197+0000", 2024-09-12T18:36:08.290 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4309e-05 2024-09-12T18:36:08.290 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.290 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.290 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.290 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.243202+0000", 2024-09-12T18:36:08.290 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.823e-06 2024-09-12T18:36:08.290 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.290 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.290 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:08.291 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.243260+0000", 2024-09-12T18:36:08.291 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.7698000000000002e-05 2024-09-12T18:36:08.291 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.291 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.291 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:08.291 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.243275+0000", 2024-09-12T18:36:08.291 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.535e-05 2024-09-12T18:36:08.291 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.291 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:08.291 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.291 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.292 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.292 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:59476 5.3 e35/21 5:cce1c2ab:::benchmark_data_smithi073_23739_object59475:head v 35'3676, mlcod=35'3672)", 2024-09-12T18:36:08.292 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:08.239159+0000", 2024-09-12T18:36:08.292 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.005031593, 2024-09-12T18:36:08.292 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0056143829999999997, 2024-09-12T18:36:08.292 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:08.292 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:08.292 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:08.292 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:08.292 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.292 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:08.292 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.239159+0000", 2024-09-12T18:36:08.292 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.293 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.293 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.293 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:08.293 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.239159+0000", 2024-09-12T18:36:08.293 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.293 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.293 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.293 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:08.293 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.239160+0000", 2024-09-12T18:36:08.293 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8899999999999998e-07 2024-09-12T18:36:08.293 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.293 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.294 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:08.294 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.239273+0000", 2024-09-12T18:36:08.294 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000112963 2024-09-12T18:36:08.294 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.294 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.294 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:08.294 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.239281+0000", 2024-09-12T18:36:08.294 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.5610000000000001e-06 2024-09-12T18:36:08.294 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.294 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.294 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.295 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.239285+0000", 2024-09-12T18:36:08.295 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8960000000000002e-06 2024-09-12T18:36:08.295 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.295 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.295 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:08.295 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.240456+0000", 2024-09-12T18:36:08.295 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0011707200000000001 2024-09-12T18:36:08.295 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.295 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.295 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:08.295 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:08.240473+0000", 2024-09-12T18:36:08.295 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6922000000000002e-05 2024-09-12T18:36:08.295 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.295 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:08.296 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.296 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.296 INFO:teuthology.orchestra.run.smithi162.stdout: ], 2024-09-12T18:36:08.296 INFO:teuthology.orchestra.run.smithi162.stdout: "num_ops": 11 2024-09-12T18:36:08.296 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:36:08.297 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:08.292+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:08.298 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:36:08.398 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:08.393+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:08.450 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:36:08.450 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [], 2024-09-12T18:36:08.451 INFO:teuthology.orchestra.run.smithi162.stdout: "complaint_time": 30, 2024-09-12T18:36:08.451 INFO:teuthology.orchestra.run.smithi162.stdout: "num_blocked_ops": 0 2024-09-12T18:36:08.451 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:36:08.474 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:36:08.499 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:08.492+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:08.599 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:08.596+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:08.673 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:36:08.673 INFO:teuthology.orchestra.run.smithi162.stdout: "size": 20, 2024-09-12T18:36:08.673 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 600, 2024-09-12T18:36:08.673 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:36:08.673 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.673 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4154.0:123 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:36:08.673 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:36:08.673 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 54.694236840000002, 2024-09-12T18:36:08.673 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.022398096999999999, 2024-09-12T18:36:08.673 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:08.674 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:08.674 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:08.674 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:08.674 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4154", 2024-09-12T18:36:08.674 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/745129001", 2024-09-12T18:36:08.674 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 123 2024-09-12T18:36:08.674 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.674 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:08.674 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.674 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:08.674 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:36:08.674 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.674 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.674 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.675 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:08.675 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:36:08.675 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.675 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.675 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.675 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:08.675 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:36:08.675 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.8299999999999996e-07 2024-09-12T18:36:08.675 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.675 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.675 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:08.675 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976528+0000", 2024-09-12T18:36:08.675 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011393299999999999 2024-09-12T18:36:08.676 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.676 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.676 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:08.676 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976539+0000", 2024-09-12T18:36:08.676 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0763e-05 2024-09-12T18:36:08.676 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.676 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.676 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.676 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976547+0000", 2024-09-12T18:36:08.676 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8199999999999997e-06 2024-09-12T18:36:08.676 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.676 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.676 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:08.677 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.995057+0000", 2024-09-12T18:36:08.677 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.018510047000000002 2024-09-12T18:36:08.677 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.677 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.677 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:08.677 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.995301+0000", 2024-09-12T18:36:08.677 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00024375899999999999 2024-09-12T18:36:08.677 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.677 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.677 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:08.677 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.995642+0000", 2024-09-12T18:36:08.677 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00034121100000000001 2024-09-12T18:36:08.677 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.677 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.678 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:08.678 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998179+0000", 2024-09-12T18:36:08.678 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00253761 2024-09-12T18:36:08.678 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.678 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.678 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:08.678 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998665+0000", 2024-09-12T18:36:08.678 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00048574600000000001 2024-09-12T18:36:08.678 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.678 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.678 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:08.678 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998739+0000", 2024-09-12T18:36:08.678 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.4286e-05 2024-09-12T18:36:08.679 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.679 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.679 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:08.679 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998812+0000", 2024-09-12T18:36:08.679 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2238999999999997e-05 2024-09-12T18:36:08.679 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.679 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:08.679 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.679 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.679 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.679 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4154.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:36:08.679 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:36:08.679 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 54.694089607999999, 2024-09-12T18:36:08.680 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025950709999999998, 2024-09-12T18:36:08.680 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:08.680 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:08.680 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:08.680 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:08.680 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4154", 2024-09-12T18:36:08.680 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/745129001", 2024-09-12T18:36:08.680 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 124 2024-09-12T18:36:08.680 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.680 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:08.680 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.680 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:08.680 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:36:08.680 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.681 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.681 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.681 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:08.681 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:36:08.681 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.681 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.681 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.681 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:08.681 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976562+0000", 2024-09-12T18:36:08.681 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.2999999999999999e-07 2024-09-12T18:36:08.681 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.681 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.681 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:08.682 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976567+0000", 2024-09-12T18:36:08.682 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3430000000000003e-06 2024-09-12T18:36:08.682 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.682 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.682 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:08.682 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976576+0000", 2024-09-12T18:36:08.682 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8070000000000006e-06 2024-09-12T18:36:08.682 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.682 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.682 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.682 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976583+0000", 2024-09-12T18:36:08.682 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9959999999999996e-06 2024-09-12T18:36:08.682 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.683 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.683 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:08.683 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997107+0000", 2024-09-12T18:36:08.683 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.020524106 2024-09-12T18:36:08.683 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.683 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.683 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:08.683 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997225+0000", 2024-09-12T18:36:08.683 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000117909 2024-09-12T18:36:08.683 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.683 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.683 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:08.683 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997407+0000", 2024-09-12T18:36:08.683 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00018175900000000001 2024-09-12T18:36:08.683 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.684 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.684 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:08.684 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998839+0000", 2024-09-12T18:36:08.684 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001432539 2024-09-12T18:36:08.684 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.684 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.684 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:08.684 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002319+0000", 2024-09-12T18:36:08.684 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0034803529999999998 2024-09-12T18:36:08.684 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.684 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.684 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:08.684 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002405+0000", 2024-09-12T18:36:08.684 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5434999999999998e-05 2024-09-12T18:36:08.685 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.685 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.685 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:08.685 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002512+0000", 2024-09-12T18:36:08.685 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010663299999999999 2024-09-12T18:36:08.685 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.685 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:08.685 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.685 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.685 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.685 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:08.685 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:36:08.685 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 43.029292101000003, 2024-09-12T18:36:08.685 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025127867000000002, 2024-09-12T18:36:08.686 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:08.686 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:08.686 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:08.686 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:08.686 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.686 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:08.686 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:36:08.686 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.686 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.686 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.686 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:08.686 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:36:08.686 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.687 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.687 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.687 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:08.687 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641362+0000", 2024-09-12T18:36:08.687 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.2569999999999999e-06 2024-09-12T18:36:08.687 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.687 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.687 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:08.687 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641374+0000", 2024-09-12T18:36:08.687 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2696e-05 2024-09-12T18:36:08.687 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.687 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.687 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:08.688 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641403+0000", 2024-09-12T18:36:08.688 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.8756999999999999e-05 2024-09-12T18:36:08.688 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.688 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.688 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.688 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641430+0000", 2024-09-12T18:36:08.688 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.6452999999999999e-05 2024-09-12T18:36:08.688 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.688 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.688 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:08.688 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641585+0000", 2024-09-12T18:36:08.688 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000155799 2024-09-12T18:36:08.688 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.689 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.689 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:08.689 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641753+0000", 2024-09-12T18:36:08.689 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000167868 2024-09-12T18:36:08.689 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.689 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.689 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:08.689 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641916+0000", 2024-09-12T18:36:08.689 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000162903 2024-09-12T18:36:08.689 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.689 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.689 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:08.689 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653655+0000", 2024-09-12T18:36:08.689 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011738879000000001 2024-09-12T18:36:08.690 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.690 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.690 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:08.690 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665515+0000", 2024-09-12T18:36:08.690 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011859915 2024-09-12T18:36:08.690 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.690 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.690 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:08.690 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665646+0000", 2024-09-12T18:36:08.690 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013122599999999999 2024-09-12T18:36:08.690 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.690 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.690 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:08.690 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666486+0000", 2024-09-12T18:36:08.691 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00084011399999999999 2024-09-12T18:36:08.691 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.691 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:08.691 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.691 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.691 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.691 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:08.691 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:36:08.691 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 43.029177638, 2024-09-12T18:36:08.691 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025384584000000002, 2024-09-12T18:36:08.691 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:08.691 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:08.691 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:08.691 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:08.692 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.692 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:08.692 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:36:08.692 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.692 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.692 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.692 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:08.692 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:36:08.692 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.692 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.692 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.692 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:08.692 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641474+0000", 2024-09-12T18:36:08.693 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.39e-06 2024-09-12T18:36:08.693 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.693 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.693 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:08.693 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641482+0000", 2024-09-12T18:36:08.693 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3499999999999999e-06 2024-09-12T18:36:08.693 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.693 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.693 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:08.693 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641534+0000", 2024-09-12T18:36:08.693 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2533e-05 2024-09-12T18:36:08.693 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.693 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.693 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.694 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641551+0000", 2024-09-12T18:36:08.694 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6515999999999999e-05 2024-09-12T18:36:08.694 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.694 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.694 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:08.694 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642630+0000", 2024-09-12T18:36:08.694 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001079705 2024-09-12T18:36:08.694 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.694 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.694 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:08.694 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642909+0000", 2024-09-12T18:36:08.694 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027859800000000002 2024-09-12T18:36:08.694 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.694 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.694 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:08.695 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643137+0000", 2024-09-12T18:36:08.695 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022803799999999999 2024-09-12T18:36:08.695 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.695 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.695 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:08.695 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653669+0000", 2024-09-12T18:36:08.695 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010532032 2024-09-12T18:36:08.695 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.695 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.695 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:08.695 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666624+0000", 2024-09-12T18:36:08.695 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012954940999999999 2024-09-12T18:36:08.695 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.695 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.695 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:08.696 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666762+0000", 2024-09-12T18:36:08.696 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000137668 2024-09-12T18:36:08.696 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.696 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.696 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:08.696 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666857+0000", 2024-09-12T18:36:08.696 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.5812999999999999e-05 2024-09-12T18:36:08.696 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.696 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:08.696 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.696 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.696 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.696 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:08.697 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:36:08.697 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 43.029049843000003, 2024-09-12T18:36:08.697 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025661562999999998, 2024-09-12T18:36:08.697 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:08.697 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:08.697 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:08.697 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:08.697 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.697 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:08.697 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:36:08.697 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.697 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.697 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.698 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:08.698 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:36:08.698 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.698 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.698 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.698 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:08.698 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641602+0000", 2024-09-12T18:36:08.698 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3540000000000001e-06 2024-09-12T18:36:08.698 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.698 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.698 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:08.698 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641637+0000", 2024-09-12T18:36:08.698 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5145999999999999e-05 2024-09-12T18:36:08.698 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.699 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.699 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:08.699 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641659+0000", 2024-09-12T18:36:08.699 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2249999999999999e-05 2024-09-12T18:36:08.699 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.699 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.699 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.699 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641675+0000", 2024-09-12T18:36:08.699 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6059999999999999e-05 2024-09-12T18:36:08.699 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.699 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.699 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:08.699 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644570+0000", 2024-09-12T18:36:08.699 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028947069999999998 2024-09-12T18:36:08.700 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.700 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.700 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:08.700 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644900+0000", 2024-09-12T18:36:08.700 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000329401 2024-09-12T18:36:08.700 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.700 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.700 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:08.700 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645235+0000", 2024-09-12T18:36:08.700 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000335874 2024-09-12T18:36:08.700 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.700 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.701 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:08.701 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655459+0000", 2024-09-12T18:36:08.701 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010223441999999999 2024-09-12T18:36:08.701 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.701 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.701 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:08.701 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667028+0000", 2024-09-12T18:36:08.701 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011568673999999999 2024-09-12T18:36:08.701 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.701 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.701 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:08.701 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667163+0000", 2024-09-12T18:36:08.701 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013525500000000001 2024-09-12T18:36:08.702 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.702 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.702 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:08.702 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667262+0000", 2024-09-12T18:36:08.702 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9400000000000004e-05 2024-09-12T18:36:08.702 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.702 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:08.702 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.702 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.702 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.702 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:08.702 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:36:08.703 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 43.028948022999998, 2024-09-12T18:36:08.703 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025971339, 2024-09-12T18:36:08.703 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:08.703 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:08.703 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:08.703 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:08.703 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.703 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:08.703 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:36:08.703 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.703 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.703 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.703 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:08.703 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:36:08.704 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.704 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.704 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.704 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:08.704 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641704+0000", 2024-09-12T18:36:08.704 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.297e-06 2024-09-12T18:36:08.704 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.704 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.704 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:08.704 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641712+0000", 2024-09-12T18:36:08.704 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.9060000000000002e-06 2024-09-12T18:36:08.704 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.704 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.704 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:08.704 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641731+0000", 2024-09-12T18:36:08.705 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9083e-05 2024-09-12T18:36:08.705 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.705 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.705 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.705 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641745+0000", 2024-09-12T18:36:08.705 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4066999999999999e-05 2024-09-12T18:36:08.705 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.705 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.705 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:08.705 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646529+0000", 2024-09-12T18:36:08.705 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.004784033 2024-09-12T18:36:08.705 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.705 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.706 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:08.706 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646727+0000", 2024-09-12T18:36:08.706 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019841800000000001 2024-09-12T18:36:08.706 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.706 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.706 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:08.706 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647057+0000", 2024-09-12T18:36:08.706 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032926800000000002 2024-09-12T18:36:08.706 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.706 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.706 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:08.706 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655475+0000", 2024-09-12T18:36:08.706 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0084186250000000008 2024-09-12T18:36:08.706 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.707 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.707 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:08.707 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667424+0000", 2024-09-12T18:36:08.707 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011949257 2024-09-12T18:36:08.707 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.707 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.707 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:08.707 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667573+0000", 2024-09-12T18:36:08.707 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014851900000000001 2024-09-12T18:36:08.707 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.707 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.707 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:08.707 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667674+0000", 2024-09-12T18:36:08.707 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010086600000000001 2024-09-12T18:36:08.708 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.708 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:08.708 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.708 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.708 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.708 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:08.708 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:36:08.708 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 43.028885633999998, 2024-09-12T18:36:08.708 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026215008000000001, 2024-09-12T18:36:08.708 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:08.708 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:08.708 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:08.708 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:08.709 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.709 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:08.709 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:36:08.709 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.709 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.709 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.709 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:08.709 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:36:08.709 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.709 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.709 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.709 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:08.709 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641766+0000", 2024-09-12T18:36:08.710 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1200000000000001e-06 2024-09-12T18:36:08.710 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.710 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.710 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:08.710 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641775+0000", 2024-09-12T18:36:08.710 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.2499999999999995e-06 2024-09-12T18:36:08.710 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.710 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.710 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:08.710 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641793+0000", 2024-09-12T18:36:08.710 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7773000000000001e-05 2024-09-12T18:36:08.710 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.710 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.710 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.711 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641807+0000", 2024-09-12T18:36:08.711 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3814e-05 2024-09-12T18:36:08.711 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.711 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.711 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:08.711 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647626+0000", 2024-09-12T18:36:08.711 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0058193050000000003 2024-09-12T18:36:08.711 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.711 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.711 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:08.711 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647937+0000", 2024-09-12T18:36:08.711 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031112400000000003 2024-09-12T18:36:08.711 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.712 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.712 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:08.712 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648239+0000", 2024-09-12T18:36:08.712 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00030227500000000002 2024-09-12T18:36:08.712 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.712 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.712 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:08.712 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655487+0000", 2024-09-12T18:36:08.712 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072479129999999999 2024-09-12T18:36:08.712 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.712 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.712 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:08.712 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667823+0000", 2024-09-12T18:36:08.712 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012335505 2024-09-12T18:36:08.713 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.713 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.713 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:08.713 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667908+0000", 2024-09-12T18:36:08.713 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4843000000000001e-05 2024-09-12T18:36:08.713 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.713 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.713 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:08.713 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667980+0000", 2024-09-12T18:36:08.713 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2086000000000001e-05 2024-09-12T18:36:08.713 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.713 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:08.713 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.714 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.714 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.714 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:08.714 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:36:08.714 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 43.028825480999998, 2024-09-12T18:36:08.714 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026483236, 2024-09-12T18:36:08.714 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:08.714 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:08.714 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:08.714 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:08.714 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.714 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:08.714 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:36:08.714 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.715 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.715 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.715 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:08.715 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:36:08.715 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.715 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.715 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.715 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:08.715 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641826+0000", 2024-09-12T18:36:08.715 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:36:08.715 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.715 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.715 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:08.715 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641832+0000", 2024-09-12T18:36:08.715 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4199999999999998e-06 2024-09-12T18:36:08.716 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.716 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.716 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:08.716 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641848+0000", 2024-09-12T18:36:08.716 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6492999999999999e-05 2024-09-12T18:36:08.716 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.716 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.716 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.716 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641863+0000", 2024-09-12T18:36:08.716 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5427e-05 2024-09-12T18:36:08.716 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.716 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.716 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:08.716 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648887+0000", 2024-09-12T18:36:08.717 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0070230860000000004 2024-09-12T18:36:08.717 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.717 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.717 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:08.717 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649111+0000", 2024-09-12T18:36:08.717 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022425799999999999 2024-09-12T18:36:08.717 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.717 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.717 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:08.717 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649494+0000", 2024-09-12T18:36:08.717 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00038349400000000001 2024-09-12T18:36:08.717 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.717 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.718 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:08.718 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655499+0000", 2024-09-12T18:36:08.718 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0060047260000000002 2024-09-12T18:36:08.718 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.718 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.718 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:08.718 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668110+0000", 2024-09-12T18:36:08.718 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012610543 2024-09-12T18:36:08.718 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.718 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.718 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:08.718 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668252+0000", 2024-09-12T18:36:08.718 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014265600000000001 2024-09-12T18:36:08.719 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.719 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.719 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:08.719 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668308+0000", 2024-09-12T18:36:08.719 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5992999999999997e-05 2024-09-12T18:36:08.719 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.719 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:08.719 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.719 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.719 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.719 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:08.719 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:36:08.719 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 43.028770264999999, 2024-09-12T18:36:08.719 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026605302000000001, 2024-09-12T18:36:08.720 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:08.720 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:08.720 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:08.720 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:08.720 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.720 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:08.720 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:36:08.720 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.720 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.720 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.720 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:08.720 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:36:08.720 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.720 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.721 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.721 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:08.721 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641881+0000", 2024-09-12T18:36:08.721 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.057e-06 2024-09-12T18:36:08.721 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.721 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.721 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:08.721 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641887+0000", 2024-09-12T18:36:08.721 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.6629999999999998e-06 2024-09-12T18:36:08.721 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.721 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.721 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:08.721 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641903+0000", 2024-09-12T18:36:08.722 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6317e-05 2024-09-12T18:36:08.722 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.722 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.722 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.722 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641917+0000", 2024-09-12T18:36:08.722 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3339999999999999e-05 2024-09-12T18:36:08.722 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.722 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.722 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:08.722 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650708+0000", 2024-09-12T18:36:08.722 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.008791419 2024-09-12T18:36:08.722 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.722 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.722 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:08.723 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651021+0000", 2024-09-12T18:36:08.723 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031296699999999999 2024-09-12T18:36:08.723 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.723 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.723 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:08.723 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651349+0000", 2024-09-12T18:36:08.723 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032796499999999999 2024-09-12T18:36:08.723 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.723 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.723 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:08.723 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655742+0000", 2024-09-12T18:36:08.723 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0043934680000000002 2024-09-12T18:36:08.723 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.723 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.723 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:08.724 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668377+0000", 2024-09-12T18:36:08.724 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012634312999999999 2024-09-12T18:36:08.724 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.724 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.724 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:08.724 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668441+0000", 2024-09-12T18:36:08.724 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4369999999999995e-05 2024-09-12T18:36:08.724 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.724 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.724 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:08.724 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668485+0000", 2024-09-12T18:36:08.724 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4422999999999998e-05 2024-09-12T18:36:08.724 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.724 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:08.725 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.725 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.725 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.725 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:08.725 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:36:08.725 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 43.028712861999999, 2024-09-12T18:36:08.725 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026919499, 2024-09-12T18:36:08.725 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:08.725 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:08.725 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:08.725 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:08.725 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.725 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:08.725 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:36:08.726 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.726 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.726 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.726 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:08.726 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:36:08.726 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.726 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.726 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.726 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:08.726 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641939+0000", 2024-09-12T18:36:08.726 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9399999999999993e-07 2024-09-12T18:36:08.726 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.726 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.726 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:08.727 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641945+0000", 2024-09-12T18:36:08.727 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9200000000000001e-06 2024-09-12T18:36:08.727 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.727 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.727 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:08.727 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641961+0000", 2024-09-12T18:36:08.727 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6520000000000001e-05 2024-09-12T18:36:08.727 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.727 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.727 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.727 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641974+0000", 2024-09-12T18:36:08.727 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3413e-05 2024-09-12T18:36:08.727 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.727 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.728 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:08.728 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654560+0000", 2024-09-12T18:36:08.728 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012585308999999999 2024-09-12T18:36:08.728 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.728 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.728 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:08.728 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654822+0000", 2024-09-12T18:36:08.728 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026210099999999999 2024-09-12T18:36:08.728 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.728 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.728 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:08.728 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655059+0000", 2024-09-12T18:36:08.728 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00023747899999999999 2024-09-12T18:36:08.728 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.729 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.729 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:08.729 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.656315+0000", 2024-09-12T18:36:08.729 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0012555000000000001 2024-09-12T18:36:08.729 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.729 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.729 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:08.729 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668590+0000", 2024-09-12T18:36:08.729 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012274851999999999 2024-09-12T18:36:08.729 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.729 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.729 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:08.729 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668725+0000", 2024-09-12T18:36:08.730 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013524199999999999 2024-09-12T18:36:08.730 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.730 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.730 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:08.730 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668857+0000", 2024-09-12T18:36:08.730 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013216899999999999 2024-09-12T18:36:08.730 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.730 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:08.730 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.730 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.730 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.730 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:08.730 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:36:08.731 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 43.028659341999997, 2024-09-12T18:36:08.731 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023616723999999999, 2024-09-12T18:36:08.731 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:08.731 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:08.731 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:08.731 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:08.731 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.731 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:08.731 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:36:08.731 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.731 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.731 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.731 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:08.731 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:36:08.732 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.732 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.732 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.732 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:08.732 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641992+0000", 2024-09-12T18:36:08.732 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.08e-06 2024-09-12T18:36:08.732 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.732 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.732 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:08.732 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641998+0000", 2024-09-12T18:36:08.732 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4299999999999997e-06 2024-09-12T18:36:08.732 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.732 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.733 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:08.733 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642014+0000", 2024-09-12T18:36:08.733 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6266e-05 2024-09-12T18:36:08.733 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.733 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.733 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.733 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642026+0000", 2024-09-12T18:36:08.733 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2567e-05 2024-09-12T18:36:08.733 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.733 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.733 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:08.733 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642213+0000", 2024-09-12T18:36:08.733 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00018701899999999999 2024-09-12T18:36:08.733 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.734 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.734 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:08.734 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642507+0000", 2024-09-12T18:36:08.734 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00029394700000000002 2024-09-12T18:36:08.734 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.734 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.734 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:08.734 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642686+0000", 2024-09-12T18:36:08.734 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000178152 2024-09-12T18:36:08.734 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.734 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.734 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:08.734 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650952+0000", 2024-09-12T18:36:08.734 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0082663570000000002 2024-09-12T18:36:08.735 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.735 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.735 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:08.735 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665382+0000", 2024-09-12T18:36:08.735 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.014430111000000001 2024-09-12T18:36:08.735 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.735 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.735 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:08.735 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665508+0000", 2024-09-12T18:36:08.735 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000125986 2024-09-12T18:36:08.735 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.735 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.735 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:08.735 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665608+0000", 2024-09-12T18:36:08.736 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9809000000000006e-05 2024-09-12T18:36:08.736 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.736 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:08.736 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.736 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.736 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.736 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:08.736 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:36:08.736 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 43.028531477000001, 2024-09-12T18:36:08.736 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024670563, 2024-09-12T18:36:08.736 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:08.736 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:08.736 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:08.736 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:08.737 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.737 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:08.737 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:36:08.737 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.737 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.737 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.737 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:08.737 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:36:08.737 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.737 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.737 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.737 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:08.737 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642120+0000", 2024-09-12T18:36:08.738 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1769999999999999e-06 2024-09-12T18:36:08.738 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.738 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.738 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:08.738 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642128+0000", 2024-09-12T18:36:08.738 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3429999999999998e-06 2024-09-12T18:36:08.738 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.738 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.738 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:08.738 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642192+0000", 2024-09-12T18:36:08.738 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4406999999999995e-05 2024-09-12T18:36:08.738 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.738 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.738 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.739 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642223+0000", 2024-09-12T18:36:08.739 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.1266000000000002e-05 2024-09-12T18:36:08.739 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.739 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.739 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:08.739 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643201+0000", 2024-09-12T18:36:08.739 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0009778390000000001 2024-09-12T18:36:08.739 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.739 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.739 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:08.739 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643410+0000", 2024-09-12T18:36:08.739 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020874199999999999 2024-09-12T18:36:08.739 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.739 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.740 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:08.740 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643685+0000", 2024-09-12T18:36:08.740 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027520700000000002 2024-09-12T18:36:08.740 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.740 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.740 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:08.740 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650966+0000", 2024-09-12T18:36:08.740 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072810710000000001 2024-09-12T18:36:08.740 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.740 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.740 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:08.740 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666560+0000", 2024-09-12T18:36:08.740 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015594143 2024-09-12T18:36:08.740 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.741 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.741 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:08.741 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666691+0000", 2024-09-12T18:36:08.741 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000130359 2024-09-12T18:36:08.741 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.741 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.741 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:08.741 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666790+0000", 2024-09-12T18:36:08.741 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9009e-05 2024-09-12T18:36:08.741 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.741 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:08.741 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.741 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.741 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.742 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:08.742 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:36:08.742 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 43.027753189000002, 2024-09-12T18:36:08.742 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024891744, 2024-09-12T18:36:08.742 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:08.742 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:08.742 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:08.742 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:08.742 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.742 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:08.742 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:36:08.742 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.742 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.743 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.743 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:08.743 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:36:08.743 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.743 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.743 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.743 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:08.743 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642899+0000", 2024-09-12T18:36:08.743 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4729999999999999e-06 2024-09-12T18:36:08.743 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.743 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.743 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:08.743 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642912+0000", 2024-09-12T18:36:08.743 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3495999999999999e-05 2024-09-12T18:36:08.744 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.744 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.744 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:08.744 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642934+0000", 2024-09-12T18:36:08.744 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2033999999999999e-05 2024-09-12T18:36:08.744 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.744 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.744 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.744 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642949+0000", 2024-09-12T18:36:08.744 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4970000000000001e-05 2024-09-12T18:36:08.744 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.744 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.744 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:08.744 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644400+0000", 2024-09-12T18:36:08.745 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001450305 2024-09-12T18:36:08.745 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.745 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.745 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:08.745 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644617+0000", 2024-09-12T18:36:08.745 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000217302 2024-09-12T18:36:08.745 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.745 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.745 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:08.745 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645052+0000", 2024-09-12T18:36:08.745 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000434797 2024-09-12T18:36:08.745 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.745 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.746 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:08.746 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653860+0000", 2024-09-12T18:36:08.746 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0088082249999999994 2024-09-12T18:36:08.746 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.746 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.746 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:08.746 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667598+0000", 2024-09-12T18:36:08.746 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.013738451 2024-09-12T18:36:08.746 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.746 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.746 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:08.746 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667698+0000", 2024-09-12T18:36:08.746 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9854999999999999e-05 2024-09-12T18:36:08.746 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.747 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.747 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:08.747 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667789+0000", 2024-09-12T18:36:08.747 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0835999999999996e-05 2024-09-12T18:36:08.747 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.747 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:08.747 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.747 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.747 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.747 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:30 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:08.747 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:36:08.747 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 43.027678373000001, 2024-09-12T18:36:08.747 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023936852000000002, 2024-09-12T18:36:08.748 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:08.748 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:08.748 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:08.748 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:08.748 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.748 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:08.748 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:36:08.748 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.748 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.748 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.748 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:08.748 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:36:08.748 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.748 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.749 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.749 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:08.749 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642973+0000", 2024-09-12T18:36:08.749 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.11e-06 2024-09-12T18:36:08.749 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.749 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.749 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:08.749 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642994+0000", 2024-09-12T18:36:08.749 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.0699999999999998e-05 2024-09-12T18:36:08.749 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.749 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.749 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:08.749 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643011+0000", 2024-09-12T18:36:08.750 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7229999999999999e-05 2024-09-12T18:36:08.750 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.750 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.750 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.750 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643025+0000", 2024-09-12T18:36:08.750 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3803e-05 2024-09-12T18:36:08.750 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.750 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.750 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:08.750 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643143+0000", 2024-09-12T18:36:08.750 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000118225 2024-09-12T18:36:08.750 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.750 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.750 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:08.750 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643426+0000", 2024-09-12T18:36:08.751 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00028250500000000001 2024-09-12T18:36:08.751 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.751 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.751 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:08.751 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643864+0000", 2024-09-12T18:36:08.751 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00043856 2024-09-12T18:36:08.751 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.751 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.751 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:08.751 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651148+0000", 2024-09-12T18:36:08.751 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072836769999999997 2024-09-12T18:36:08.751 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.751 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.751 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:08.751 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666674+0000", 2024-09-12T18:36:08.752 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015525786999999999 2024-09-12T18:36:08.752 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.752 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.752 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:08.752 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666796+0000", 2024-09-12T18:36:08.752 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000122416 2024-09-12T18:36:08.752 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.752 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.752 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:08.752 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666909+0000", 2024-09-12T18:36:08.752 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011283899999999999 2024-09-12T18:36:08.752 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.752 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:08.752 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.752 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.753 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.753 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:08.753 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:36:08.753 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 43.027595667, 2024-09-12T18:36:08.753 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024100234000000002, 2024-09-12T18:36:08.753 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:08.753 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:08.753 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:08.753 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:08.753 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.753 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:08.753 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:36:08.753 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.754 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.754 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.754 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:08.754 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:36:08.754 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.754 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.754 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.754 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:08.754 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643056+0000", 2024-09-12T18:36:08.754 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.046e-06 2024-09-12T18:36:08.754 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.754 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.754 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:08.754 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643068+0000", 2024-09-12T18:36:08.754 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2106999999999999e-05 2024-09-12T18:36:08.755 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.755 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.755 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:08.755 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643085+0000", 2024-09-12T18:36:08.755 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7479999999999999e-05 2024-09-12T18:36:08.755 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.755 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.755 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.755 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643099+0000", 2024-09-12T18:36:08.755 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3730000000000001e-05 2024-09-12T18:36:08.755 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.755 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.755 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:08.756 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644623+0000", 2024-09-12T18:36:08.756 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0015236080000000001 2024-09-12T18:36:08.756 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.756 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.756 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:08.756 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644893+0000", 2024-09-12T18:36:08.756 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026990500000000003 2024-09-12T18:36:08.756 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.756 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.756 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:08.756 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645227+0000", 2024-09-12T18:36:08.756 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00033391300000000003 2024-09-12T18:36:08.756 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.756 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.757 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:08.757 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653926+0000", 2024-09-12T18:36:08.757 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0086993339999999995 2024-09-12T18:36:08.757 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.757 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.757 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:08.757 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666925+0000", 2024-09-12T18:36:08.757 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012998686000000001 2024-09-12T18:36:08.757 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.757 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.757 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:08.757 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667057+0000", 2024-09-12T18:36:08.757 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013255600000000001 2024-09-12T18:36:08.758 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.758 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.758 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:08.758 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667155+0000", 2024-09-12T18:36:08.758 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7868999999999994e-05 2024-09-12T18:36:08.758 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.758 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:08.758 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.758 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.758 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.758 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:08.758 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643139+0000", 2024-09-12T18:36:08.758 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 43.027511081, 2024-09-12T18:36:08.758 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.022417057000000001, 2024-09-12T18:36:08.759 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:08.759 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:08.759 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:08.759 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:08.759 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.759 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:08.759 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643139+0000", 2024-09-12T18:36:08.759 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.759 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.759 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.759 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:08.759 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643139+0000", 2024-09-12T18:36:08.759 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.759 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.760 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.760 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:08.760 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643140+0000", 2024-09-12T18:36:08.760 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0729999999999999e-06 2024-09-12T18:36:08.760 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.760 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.760 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:08.760 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643151+0000", 2024-09-12T18:36:08.760 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.039e-05 2024-09-12T18:36:08.760 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.760 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.760 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:08.760 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643168+0000", 2024-09-12T18:36:08.760 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7575999999999999e-05 2024-09-12T18:36:08.761 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.761 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.761 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.761 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643182+0000", 2024-09-12T18:36:08.761 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3224000000000001e-05 2024-09-12T18:36:08.761 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.761 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.761 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:08.761 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643358+0000", 2024-09-12T18:36:08.761 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00017676500000000001 2024-09-12T18:36:08.761 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.761 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.761 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:08.761 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643647+0000", 2024-09-12T18:36:08.762 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00028850499999999999 2024-09-12T18:36:08.762 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.762 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.762 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:08.762 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643924+0000", 2024-09-12T18:36:08.762 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000277547 2024-09-12T18:36:08.762 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.762 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.762 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:08.762 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650289+0000", 2024-09-12T18:36:08.762 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0063645350000000002 2024-09-12T18:36:08.762 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.762 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.762 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:08.763 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665333+0000", 2024-09-12T18:36:08.763 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015043531000000001 2024-09-12T18:36:08.763 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.763 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.763 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:08.763 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665454+0000", 2024-09-12T18:36:08.763 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000121302 2024-09-12T18:36:08.763 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.763 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.763 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:08.763 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665556+0000", 2024-09-12T18:36:08.763 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010260900000000001 2024-09-12T18:36:08.763 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.763 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:08.764 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.764 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.764 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.764 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:08.764 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:36:08.764 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 43.027399877999997, 2024-09-12T18:36:08.764 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024255982999999998, 2024-09-12T18:36:08.764 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:08.764 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:08.764 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:08.764 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:08.764 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.764 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:08.765 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:36:08.765 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.765 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.765 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.765 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:08.765 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:36:08.765 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.765 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.765 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.765 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:08.765 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643252+0000", 2024-09-12T18:36:08.765 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:08.766 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.766 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.766 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:08.766 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643287+0000", 2024-09-12T18:36:08.766 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5225999999999998e-05 2024-09-12T18:36:08.766 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.766 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.766 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:08.766 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643323+0000", 2024-09-12T18:36:08.766 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5488999999999999e-05 2024-09-12T18:36:08.766 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.766 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.766 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.766 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643357+0000", 2024-09-12T18:36:08.767 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.3853999999999998e-05 2024-09-12T18:36:08.767 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.767 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.767 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:08.767 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646716+0000", 2024-09-12T18:36:08.767 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003359 2024-09-12T18:36:08.767 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.767 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.767 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:08.767 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647037+0000", 2024-09-12T18:36:08.767 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032131800000000002 2024-09-12T18:36:08.767 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.768 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.768 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:08.768 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647337+0000", 2024-09-12T18:36:08.768 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000300208 2024-09-12T18:36:08.768 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.768 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.768 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:08.768 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654291+0000", 2024-09-12T18:36:08.768 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0069543089999999997 2024-09-12T18:36:08.768 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.768 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.768 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:08.768 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667297+0000", 2024-09-12T18:36:08.769 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.013005526 2024-09-12T18:36:08.769 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.769 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.769 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:08.769 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667416+0000", 2024-09-12T18:36:08.769 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000119416 2024-09-12T18:36:08.769 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.769 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.769 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:08.769 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667507+0000", 2024-09-12T18:36:08.769 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0206999999999999e-05 2024-09-12T18:36:08.769 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.769 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:08.770 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.770 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.770 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.770 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:08.770 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:36:08.770 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 43.027272783000001, 2024-09-12T18:36:08.770 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023888482999999999, 2024-09-12T18:36:08.770 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:08.770 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:08.770 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:08.770 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:08.770 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.770 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:08.770 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:36:08.771 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.771 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.771 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.771 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:08.771 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:36:08.771 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.771 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.771 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.771 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:08.771 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643379+0000", 2024-09-12T18:36:08.771 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.207e-06 2024-09-12T18:36:08.771 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.771 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.771 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:08.772 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643390+0000", 2024-09-12T18:36:08.772 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0696000000000001e-05 2024-09-12T18:36:08.772 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.772 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.772 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:08.772 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643407+0000", 2024-09-12T18:36:08.772 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7563000000000001e-05 2024-09-12T18:36:08.772 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.772 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.772 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.772 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643420+0000", 2024-09-12T18:36:08.772 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3277e-05 2024-09-12T18:36:08.772 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.772 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.773 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:08.773 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644906+0000", 2024-09-12T18:36:08.773 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001485945 2024-09-12T18:36:08.773 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.773 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.773 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:08.773 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645404+0000", 2024-09-12T18:36:08.773 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00049807599999999997 2024-09-12T18:36:08.773 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.773 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.773 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:08.773 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645846+0000", 2024-09-12T18:36:08.773 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00044190400000000002 2024-09-12T18:36:08.773 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.774 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.774 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:08.774 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654223+0000", 2024-09-12T18:36:08.774 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0083767419999999995 2024-09-12T18:36:08.774 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.774 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.774 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:08.774 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667026+0000", 2024-09-12T18:36:08.774 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012802531000000001 2024-09-12T18:36:08.774 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.774 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.774 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:08.774 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667162+0000", 2024-09-12T18:36:08.774 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000136112 2024-09-12T18:36:08.775 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.775 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.775 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:08.775 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667266+0000", 2024-09-12T18:36:08.775 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010443 2024-09-12T18:36:08.775 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.775 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:08.775 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.775 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.775 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.775 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:08.775 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643447+0000", 2024-09-12T18:36:08.775 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 43.027203256999996, 2024-09-12T18:36:08.775 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.022081562999999998, 2024-09-12T18:36:08.776 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:08.776 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:08.776 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:08.776 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:08.776 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.776 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:08.776 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643447+0000", 2024-09-12T18:36:08.776 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.776 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.776 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.776 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:08.776 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643447+0000", 2024-09-12T18:36:08.776 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.776 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.777 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.777 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:08.777 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643448+0000", 2024-09-12T18:36:08.777 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1629999999999999e-06 2024-09-12T18:36:08.777 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.777 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.777 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:08.777 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643458+0000", 2024-09-12T18:36:08.777 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.8400000000000007e-06 2024-09-12T18:36:08.777 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.777 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.777 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:08.777 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643475+0000", 2024-09-12T18:36:08.777 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6874000000000001e-05 2024-09-12T18:36:08.778 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.778 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.778 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.778 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643488+0000", 2024-09-12T18:36:08.778 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3026e-05 2024-09-12T18:36:08.778 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.778 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.778 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:08.778 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643931+0000", 2024-09-12T18:36:08.778 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00044307 2024-09-12T18:36:08.778 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.778 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.778 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:08.779 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644210+0000", 2024-09-12T18:36:08.779 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027908400000000003 2024-09-12T18:36:08.779 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.779 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.779 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:08.779 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644606+0000", 2024-09-12T18:36:08.779 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00039615400000000002 2024-09-12T18:36:08.779 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.779 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.779 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:08.779 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650552+0000", 2024-09-12T18:36:08.779 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0059455619999999997 2024-09-12T18:36:08.779 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.779 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.779 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:08.780 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665302+0000", 2024-09-12T18:36:08.780 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.014749962 2024-09-12T18:36:08.780 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.780 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.780 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:08.780 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665424+0000", 2024-09-12T18:36:08.780 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012214300000000001 2024-09-12T18:36:08.780 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.780 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.780 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:08.780 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665529+0000", 2024-09-12T18:36:08.780 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000104685 2024-09-12T18:36:08.780 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.781 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:08.781 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.781 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.781 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.781 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:08.781 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:36:08.781 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 43.027122063999997, 2024-09-12T18:36:08.781 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024222582999999999, 2024-09-12T18:36:08.781 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:08.781 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:08.781 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:08.781 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:08.781 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.781 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:08.782 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:36:08.782 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.782 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.782 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.782 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:08.782 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:36:08.782 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:08.782 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.782 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.782 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:08.782 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643530+0000", 2024-09-12T18:36:08.782 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.393e-06 2024-09-12T18:36:08.782 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.782 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.783 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:08.783 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643536+0000", 2024-09-12T18:36:08.783 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4130000000000003e-06 2024-09-12T18:36:08.783 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.783 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.783 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:08.783 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643554+0000", 2024-09-12T18:36:08.783 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7572999999999999e-05 2024-09-12T18:36:08.783 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.783 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.783 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.783 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643567+0000", 2024-09-12T18:36:08.783 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3393999999999999e-05 2024-09-12T18:36:08.783 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.784 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.784 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:08.784 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648198+0000", 2024-09-12T18:36:08.784 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0046304479999999997 2024-09-12T18:36:08.784 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.784 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.784 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:08.784 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648413+0000", 2024-09-12T18:36:08.784 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00021507500000000001 2024-09-12T18:36:08.784 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:08.784 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:08.784 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:08.784 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667751+0000", 2024-09-12T18:36:08.784 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.019338286999999999 2024-09-12T18:36:08.785 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.785 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:08.785 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.785 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:08.785 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:08.785 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:36:08.786 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:36:08.787 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:08.780+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:08.870 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 23 16 60826 60810 165.227 133.688 0.0129419 0.00604683 2024-09-12T18:36:08.887 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:08.884+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:08.940 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:08.940 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:36:08.940 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.940 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:60965 5.5 5:ae0120da:::benchmark_data_smithi073_23739_object60964:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:36:08.940 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:08.935313+0000", 2024-09-12T18:36:08.940 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0029526209999999999, 2024-09-12T18:36:08.940 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0029811460000000001, 2024-09-12T18:36:08.940 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:08.940 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:08.941 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:08.941 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:08.941 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:08.941 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:08.941 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 60965 2024-09-12T18:36:08.941 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.941 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:08.941 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.941 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:08.941 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.935313+0000", 2024-09-12T18:36:08.941 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:08.941 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.941 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.942 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:08.942 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.935313+0000", 2024-09-12T18:36:08.942 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:08.942 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.942 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.942 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:08.942 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.935314+0000", 2024-09-12T18:36:08.942 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.35e-06 2024-09-12T18:36:08.942 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.942 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.942 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:08.942 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.935370+0000", 2024-09-12T18:36:08.942 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6051999999999998e-05 2024-09-12T18:36:08.943 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.943 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.943 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:08.943 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.935382+0000", 2024-09-12T18:36:08.943 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1337e-05 2024-09-12T18:36:08.943 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.943 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.943 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.943 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.935388+0000", 2024-09-12T18:36:08.943 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1809999999999998e-06 2024-09-12T18:36:08.943 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.943 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.943 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:08.944 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.935446+0000", 2024-09-12T18:36:08.944 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8715999999999998e-05 2024-09-12T18:36:08.944 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.944 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.944 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:08.944 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.935573+0000", 2024-09-12T18:36:08.944 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012613199999999999 2024-09-12T18:36:08.944 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.944 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.944 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:08.944 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.935702+0000", 2024-09-12T18:36:08.944 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012954399999999999 2024-09-12T18:36:08.944 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.944 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.945 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:08.945 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.938136+0000", 2024-09-12T18:36:08.945 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0024335849999999998 2024-09-12T18:36:08.945 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:08.945 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:08.945 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:08.945 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.945 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.945 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:60971 5.5 5:a274584a:::benchmark_data_smithi073_23739_object60970:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:36:08.945 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:08.938012+0000", 2024-09-12T18:36:08.945 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00025365199999999999, 2024-09-12T18:36:08.945 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00036457200000000002, 2024-09-12T18:36:08.945 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:08.945 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:08.946 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:08.946 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:08.946 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:08.946 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:08.946 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 60971 2024-09-12T18:36:08.946 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.946 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:08.946 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.946 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:08.946 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.938012+0000", 2024-09-12T18:36:08.946 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:08.946 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.946 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.946 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:08.947 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.938012+0000", 2024-09-12T18:36:08.947 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:08.947 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.947 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.947 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:08.947 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.938013+0000", 2024-09-12T18:36:08.947 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2200000000000002e-07 2024-09-12T18:36:08.947 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.947 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.947 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:08.947 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.938151+0000", 2024-09-12T18:36:08.947 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013784499999999999 2024-09-12T18:36:08.947 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.947 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.948 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:08.948 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.938160+0000", 2024-09-12T18:36:08.948 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.3470000000000005e-06 2024-09-12T18:36:08.948 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.948 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.948 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.948 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.938170+0000", 2024-09-12T18:36:08.948 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0225e-05 2024-09-12T18:36:08.948 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.948 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.948 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:08.949 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.938209+0000", 2024-09-12T18:36:08.950 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8562000000000001e-05 2024-09-12T18:36:08.950 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.950 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.950 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:08.950 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.938320+0000", 2024-09-12T18:36:08.950 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000111816 2024-09-12T18:36:08.950 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:08.950 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:08.950 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:08.950 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.950 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.950 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:60968 5.b e35/21 5:d9fccd60:::benchmark_data_smithi073_23739_object60967:head v 35'3882, mlcod=35'3880)", 2024-09-12T18:36:08.950 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:08.938161+0000", 2024-09-12T18:36:08.951 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.000104493, 2024-09-12T18:36:08.951 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00029378999999999999, 2024-09-12T18:36:08.951 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:08.951 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:08.951 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:08.951 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:08.951 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.951 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:08.951 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.938161+0000", 2024-09-12T18:36:08.951 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:08.951 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.951 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.951 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:08.951 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.938161+0000", 2024-09-12T18:36:08.952 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:08.952 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.952 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.952 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:08.952 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.938161+0000", 2024-09-12T18:36:08.952 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.9000000000000002e-07 2024-09-12T18:36:08.952 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.952 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.952 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:08.952 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.938230+0000", 2024-09-12T18:36:08.952 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8244000000000006e-05 2024-09-12T18:36:08.952 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.952 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.953 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:08.953 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.938240+0000", 2024-09-12T18:36:08.953 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0752e-05 2024-09-12T18:36:08.953 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.953 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.953 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.953 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.938245+0000", 2024-09-12T18:36:08.953 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3730000000000003e-06 2024-09-12T18:36:08.953 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.953 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.953 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:08.953 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.938293+0000", 2024-09-12T18:36:08.953 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8479999999999997e-05 2024-09-12T18:36:08.953 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.954 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.954 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:08.954 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.938310+0000", 2024-09-12T18:36:08.954 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6852000000000001e-05 2024-09-12T18:36:08.954 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:08.954 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:08.954 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:08.954 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.954 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.954 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:60973 5.6 5:6e85bbcf:::benchmark_data_smithi073_23739_object60972:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:36:08.954 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:08.938198+0000", 2024-09-12T18:36:08.954 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 6.7178e-05, 2024-09-12T18:36:08.954 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00033556699999999999, 2024-09-12T18:36:08.954 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:08.955 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:08.955 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:08.955 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:08.955 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:08.955 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:08.955 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 60973 2024-09-12T18:36:08.955 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.955 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:08.955 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.955 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:08.955 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.938198+0000", 2024-09-12T18:36:08.955 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:08.955 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.955 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.956 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:08.956 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.938198+0000", 2024-09-12T18:36:08.956 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:08.956 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.956 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.956 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:08.956 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.938199+0000", 2024-09-12T18:36:08.956 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2799999999999995e-07 2024-09-12T18:36:08.956 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.956 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.956 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:08.956 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.938256+0000", 2024-09-12T18:36:08.956 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6666999999999998e-05 2024-09-12T18:36:08.957 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.957 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.957 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:08.957 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.938268+0000", 2024-09-12T18:36:08.957 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1813e-05 2024-09-12T18:36:08.957 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.957 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.957 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.957 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.938273+0000", 2024-09-12T18:36:08.957 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9880000000000004e-06 2024-09-12T18:36:08.957 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.957 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.957 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:08.957 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.938319+0000", 2024-09-12T18:36:08.958 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.6350999999999997e-05 2024-09-12T18:36:08.958 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.958 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.958 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:08.958 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.938418+0000", 2024-09-12T18:36:08.958 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.9098999999999994e-05 2024-09-12T18:36:08.958 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.958 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.958 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:08.958 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.938514+0000", 2024-09-12T18:36:08.958 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.5737999999999997e-05 2024-09-12T18:36:08.958 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:08.958 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:08.958 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:08.959 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.959 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.959 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:60966 5.7 e35/21 5:ea751607:::benchmark_data_smithi073_23739_object60965:head v 35'3770, mlcod=35'3768)", 2024-09-12T18:36:08.959 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:08.938078+0000", 2024-09-12T18:36:08.959 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00018787900000000001, 2024-09-12T18:36:08.959 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00052334799999999998, 2024-09-12T18:36:08.959 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:08.959 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:08.959 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:08.959 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:08.959 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.959 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:08.959 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.938078+0000", 2024-09-12T18:36:08.960 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:08.960 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.960 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.960 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:08.960 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.938078+0000", 2024-09-12T18:36:08.960 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:08.960 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.960 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.960 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:08.960 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.938078+0000", 2024-09-12T18:36:08.960 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6499999999999998e-07 2024-09-12T18:36:08.960 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.960 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.960 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:08.961 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.938302+0000", 2024-09-12T18:36:08.961 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000223484 2024-09-12T18:36:08.961 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.961 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.961 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:08.961 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.938309+0000", 2024-09-12T18:36:08.961 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.9650000000000002e-06 2024-09-12T18:36:08.961 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.961 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.961 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.961 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.938313+0000", 2024-09-12T18:36:08.961 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.6809999999999997e-06 2024-09-12T18:36:08.961 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.962 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.962 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:08.962 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.938364+0000", 2024-09-12T18:36:08.962 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0609999999999998e-05 2024-09-12T18:36:08.962 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.962 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.962 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:08.962 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.938375+0000", 2024-09-12T18:36:08.962 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1311000000000001e-05 2024-09-12T18:36:08.962 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:08.962 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:08.963 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:08.963 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.963 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.963 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:60975 5.c 5:3b7538da:::benchmark_data_smithi073_23739_object60974:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:36:08.963 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:08.938454+0000", 2024-09-12T18:36:08.963 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4294967295.9998112, 2024-09-12T18:36:08.963 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00020261199999999999, 2024-09-12T18:36:08.963 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:08.963 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:08.963 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "reached pg", 2024-09-12T18:36:08.963 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:08.963 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:08.963 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:08.964 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 60975 2024-09-12T18:36:08.964 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.964 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:08.964 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.964 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:08.964 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.938454+0000", 2024-09-12T18:36:08.964 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:08.964 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.964 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.964 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:08.964 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.938454+0000", 2024-09-12T18:36:08.964 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:08.964 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.965 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.965 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:08.965 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.938455+0000", 2024-09-12T18:36:08.965 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.5000000000000001e-07 2024-09-12T18:36:08.965 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.965 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.965 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:08.965 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.938509+0000", 2024-09-12T18:36:08.965 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.3835999999999998e-05 2024-09-12T18:36:08.965 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.965 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.965 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:08.965 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.938518+0000", 2024-09-12T18:36:08.965 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.6390000000000004e-06 2024-09-12T18:36:08.966 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.966 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.966 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:08.966 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.938525+0000", 2024-09-12T18:36:08.966 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3080000000000004e-06 2024-09-12T18:36:08.966 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:08.966 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:08.966 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:08.966 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.938572+0000", 2024-09-12T18:36:08.966 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.7417999999999999e-05 2024-09-12T18:36:08.966 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:08.966 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:08.966 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:08.966 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:08.967 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-12T18:36:08.967 INFO:teuthology.orchestra.run.smithi114.stdout: "num_ops": 6 2024-09-12T18:36:08.967 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:08.968 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:36:09.011 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:09.008+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:09.089 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:09.084+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:09.162 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:09.162 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2024-09-12T18:36:09.162 INFO:teuthology.orchestra.run.smithi114.stdout: "complaint_time": 30, 2024-09-12T18:36:09.162 INFO:teuthology.orchestra.run.smithi114.stdout: "num_blocked_ops": 0 2024-09-12T18:36:09.162 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:09.181 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:36:09.231 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:09.228+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:09.289 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:09.285+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:09.334 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:09.334 INFO:teuthology.orchestra.run.smithi114.stdout: "size": 20, 2024-09-12T18:36:09.334 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 600, 2024-09-12T18:36:09.334 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:36:09.335 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.335 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:09.335 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:09.335 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 43.702863266000001, 2024-09-12T18:36:09.335 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.042475618999999999, 2024-09-12T18:36:09.335 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:09.335 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:09.335 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:09.335 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:09.335 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.335 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:09.336 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:09.336 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:09.336 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.336 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.336 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:09.336 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:09.336 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:09.336 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.336 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.336 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:09.336 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628450+0000", 2024-09-12T18:36:09.337 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4212999999999999e-05 2024-09-12T18:36:09.337 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.337 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.337 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:09.337 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628463+0000", 2024-09-12T18:36:09.337 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2497000000000001e-05 2024-09-12T18:36:09.337 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.337 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.337 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:09.337 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628480+0000", 2024-09-12T18:36:09.337 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7232999999999999e-05 2024-09-12T18:36:09.338 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.338 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.338 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:09.338 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628496+0000", 2024-09-12T18:36:09.338 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6217000000000001e-05 2024-09-12T18:36:09.338 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.338 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.338 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:09.338 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628641+0000", 2024-09-12T18:36:09.338 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000144709 2024-09-12T18:36:09.338 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.339 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.339 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:09.339 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628657+0000", 2024-09-12T18:36:09.339 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6266e-05 2024-09-12T18:36:09.339 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.339 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.339 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:09.339 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663103+0000", 2024-09-12T18:36:09.339 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.034445523999999998 2024-09-12T18:36:09.339 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.339 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.339 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:09.340 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663373+0000", 2024-09-12T18:36:09.340 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00027085500000000002 2024-09-12T18:36:09.340 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.340 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.340 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:09.340 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663634+0000", 2024-09-12T18:36:09.340 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000260855 2024-09-12T18:36:09.340 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.340 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.340 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:09.340 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670294+0000", 2024-09-12T18:36:09.341 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0066597599999999998 2024-09-12T18:36:09.341 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.341 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.341 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:09.341 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670705+0000", 2024-09-12T18:36:09.341 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00041057099999999998 2024-09-12T18:36:09.341 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.341 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.341 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:09.341 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670820+0000", 2024-09-12T18:36:09.341 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000115111 2024-09-12T18:36:09.342 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.342 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.342 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:09.342 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670912+0000", 2024-09-12T18:36:09.342 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1807999999999999e-05 2024-09-12T18:36:09.342 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:09.342 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:09.342 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:09.342 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.342 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.342 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:09.342 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:09.343 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 43.702772520000003, 2024-09-12T18:36:09.343 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.044599273000000002, 2024-09-12T18:36:09.343 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:09.343 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:09.343 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:09.343 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:09.343 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.343 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:09.343 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:09.343 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:09.344 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.344 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.344 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:09.344 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:09.344 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:09.344 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.344 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.344 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:09.344 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628528+0000", 2024-09-12T18:36:09.344 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:09.344 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.345 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.345 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:09.345 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628537+0000", 2024-09-12T18:36:09.345 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6969999999999999e-06 2024-09-12T18:36:09.345 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.345 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.345 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:09.345 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628560+0000", 2024-09-12T18:36:09.345 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2889000000000001e-05 2024-09-12T18:36:09.345 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.345 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.345 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:09.346 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628576+0000", 2024-09-12T18:36:09.346 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.649e-05 2024-09-12T18:36:09.346 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.346 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.346 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:09.346 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628846+0000", 2024-09-12T18:36:09.346 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00026952500000000001 2024-09-12T18:36:09.346 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.346 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.346 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:09.346 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628853+0000", 2024-09-12T18:36:09.347 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6559999999999992e-06 2024-09-12T18:36:09.347 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.347 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.347 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:09.347 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665284+0000", 2024-09-12T18:36:09.347 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.036431140000000001 2024-09-12T18:36:09.347 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.347 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.347 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:09.347 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665494+0000", 2024-09-12T18:36:09.347 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000209762 2024-09-12T18:36:09.347 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.347 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.348 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:09.348 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665816+0000", 2024-09-12T18:36:09.348 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00032162299999999999 2024-09-12T18:36:09.348 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.348 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.348 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:09.348 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670382+0000", 2024-09-12T18:36:09.348 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0045656739999999996 2024-09-12T18:36:09.348 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.348 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.348 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:09.349 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.672978+0000", 2024-09-12T18:36:09.349 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.002596068 2024-09-12T18:36:09.349 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.349 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.349 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:09.349 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673058+0000", 2024-09-12T18:36:09.349 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0198999999999996e-05 2024-09-12T18:36:09.349 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.349 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.349 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:09.349 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673126+0000", 2024-09-12T18:36:09.349 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8120000000000005e-05 2024-09-12T18:36:09.350 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:09.350 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:09.350 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:09.350 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.350 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.350 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:23 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:09.350 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:09.350 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 43.702674713999997, 2024-09-12T18:36:09.350 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045539784, 2024-09-12T18:36:09.350 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:09.350 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:09.350 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:09.351 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:09.351 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.351 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:09.351 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:09.351 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:09.351 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.351 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.352 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:09.352 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:09.352 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:09.352 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.352 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.352 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:09.352 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628626+0000", 2024-09-12T18:36:09.352 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.573e-06 2024-09-12T18:36:09.352 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.352 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.353 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:09.353 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628640+0000", 2024-09-12T18:36:09.353 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3817e-05 2024-09-12T18:36:09.353 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.353 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.353 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:09.353 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628659+0000", 2024-09-12T18:36:09.353 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9539999999999999e-05 2024-09-12T18:36:09.353 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.353 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.353 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:09.353 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628675+0000", 2024-09-12T18:36:09.354 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5739e-05 2024-09-12T18:36:09.354 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.354 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.354 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:09.354 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628815+0000", 2024-09-12T18:36:09.354 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014003299999999999 2024-09-12T18:36:09.354 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.354 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.354 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:09.354 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628828+0000", 2024-09-12T18:36:09.355 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2849e-05 2024-09-12T18:36:09.355 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.355 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.355 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:09.355 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651162+0000", 2024-09-12T18:36:09.355 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.022334228000000001 2024-09-12T18:36:09.355 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.355 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.356 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:09.356 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651446+0000", 2024-09-12T18:36:09.356 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00028392800000000002 2024-09-12T18:36:09.356 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.356 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.356 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:09.356 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651746+0000", 2024-09-12T18:36:09.356 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000300091 2024-09-12T18:36:09.356 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.357 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.357 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:09.357 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665113+0000", 2024-09-12T18:36:09.357 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013366678 2024-09-12T18:36:09.357 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.357 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.357 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:09.357 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674010+0000", 2024-09-12T18:36:09.357 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0088970520000000008 2024-09-12T18:36:09.357 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.358 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.358 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:09.358 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674104+0000", 2024-09-12T18:36:09.358 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4124999999999998e-05 2024-09-12T18:36:09.358 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.358 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.358 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:09.358 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674164+0000", 2024-09-12T18:36:09.358 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.0130999999999997e-05 2024-09-12T18:36:09.358 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:09.358 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:09.359 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:09.359 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.359 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.359 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:26 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:09.359 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:09.359 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 43.702601508000001, 2024-09-12T18:36:09.359 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045702136999999997, 2024-09-12T18:36:09.359 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:09.359 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:09.359 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:09.359 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:09.360 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.360 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:09.361 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:09.361 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:09.361 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.361 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.361 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:09.361 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:09.362 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:09.362 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.362 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.362 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:09.362 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628699+0000", 2024-09-12T18:36:09.362 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3859999999999999e-06 2024-09-12T18:36:09.362 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.362 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.362 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:09.362 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628706+0000", 2024-09-12T18:36:09.362 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0169999999999999e-06 2024-09-12T18:36:09.363 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.363 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.363 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:09.363 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628725+0000", 2024-09-12T18:36:09.363 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8683000000000001e-05 2024-09-12T18:36:09.363 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.363 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.363 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:09.363 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628740+0000", 2024-09-12T18:36:09.363 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5413999999999998e-05 2024-09-12T18:36:09.364 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.364 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.364 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:09.364 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628907+0000", 2024-09-12T18:36:09.364 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00016670199999999999 2024-09-12T18:36:09.364 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.364 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.364 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:09.364 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628917+0000", 2024-09-12T18:36:09.364 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.046e-05 2024-09-12T18:36:09.364 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.364 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.365 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:09.365 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.660390+0000", 2024-09-12T18:36:09.365 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.031472364000000003 2024-09-12T18:36:09.365 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.365 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.365 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:09.365 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.661767+0000", 2024-09-12T18:36:09.365 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0013769190000000001 2024-09-12T18:36:09.365 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.365 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.365 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:09.366 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.662408+0000", 2024-09-12T18:36:09.366 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00064091099999999998 2024-09-12T18:36:09.366 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.366 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.366 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:09.366 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669577+0000", 2024-09-12T18:36:09.366 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.007169412 2024-09-12T18:36:09.366 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.366 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.366 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:09.366 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674244+0000", 2024-09-12T18:36:09.366 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0046671839999999996 2024-09-12T18:36:09.367 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.367 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.367 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:09.367 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674329+0000", 2024-09-12T18:36:09.367 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5276000000000001e-05 2024-09-12T18:36:09.367 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.367 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.367 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:09.367 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674400+0000", 2024-09-12T18:36:09.367 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0408999999999996e-05 2024-09-12T18:36:09.367 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:09.368 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:09.368 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:09.368 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.368 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.368 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:09.368 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:09.368 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 43.702493838999999, 2024-09-12T18:36:09.368 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.044572443000000003, 2024-09-12T18:36:09.368 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:09.368 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:09.368 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:09.368 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:09.369 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.369 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:09.369 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:09.369 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:09.369 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.369 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.369 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:09.369 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:09.369 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:09.369 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.369 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.370 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:09.370 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628807+0000", 2024-09-12T18:36:09.370 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3629999999999999e-06 2024-09-12T18:36:09.370 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.370 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.370 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:09.370 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628814+0000", 2024-09-12T18:36:09.370 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.2099999999999996e-06 2024-09-12T18:36:09.370 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.370 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.370 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:09.370 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628832+0000", 2024-09-12T18:36:09.371 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7972999999999999e-05 2024-09-12T18:36:09.371 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.371 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.371 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:09.371 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628854+0000", 2024-09-12T18:36:09.371 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1857000000000001e-05 2024-09-12T18:36:09.371 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.371 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.371 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:09.371 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628984+0000", 2024-09-12T18:36:09.371 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013013599999999999 2024-09-12T18:36:09.371 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.372 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.372 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:09.372 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628993+0000", 2024-09-12T18:36:09.372 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:36:09.372 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.372 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.372 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:09.372 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668176+0000", 2024-09-12T18:36:09.372 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.039182211000000002 2024-09-12T18:36:09.372 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.372 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.373 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:09.373 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668481+0000", 2024-09-12T18:36:09.373 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00030499200000000002 2024-09-12T18:36:09.373 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.373 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.373 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:09.373 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668771+0000", 2024-09-12T18:36:09.373 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00029018700000000002 2024-09-12T18:36:09.373 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.373 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.373 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:09.374 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.672674+0000", 2024-09-12T18:36:09.374 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0039031890000000001 2024-09-12T18:36:09.374 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.374 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.374 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:09.374 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673214+0000", 2024-09-12T18:36:09.374 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00053981600000000004 2024-09-12T18:36:09.374 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.374 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.374 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:09.375 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673310+0000", 2024-09-12T18:36:09.375 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.6682999999999996e-05 2024-09-12T18:36:09.375 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.375 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.375 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:09.375 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673378+0000", 2024-09-12T18:36:09.375 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7385999999999995e-05 2024-09-12T18:36:09.375 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:09.375 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:09.375 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:09.375 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.376 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.376 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:09.376 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:09.376 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 43.702357812999999, 2024-09-12T18:36:09.376 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.041480853999999998, 2024-09-12T18:36:09.376 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:09.376 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:09.376 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:09.376 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:09.376 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.376 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:09.376 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:09.377 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:09.377 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.377 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.377 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:09.377 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:09.377 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:09.377 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.377 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.377 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:09.377 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628943+0000", 2024-09-12T18:36:09.377 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.403e-06 2024-09-12T18:36:09.377 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.378 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.378 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:09.378 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628953+0000", 2024-09-12T18:36:09.378 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0273e-05 2024-09-12T18:36:09.378 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.378 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.378 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:09.378 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628973+0000", 2024-09-12T18:36:09.378 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9959999999999999e-05 2024-09-12T18:36:09.378 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.378 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.378 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:09.379 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628989+0000", 2024-09-12T18:36:09.379 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6447e-05 2024-09-12T18:36:09.379 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.379 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.379 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:09.379 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629144+0000", 2024-09-12T18:36:09.379 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015468900000000001 2024-09-12T18:36:09.379 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.379 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.379 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:09.379 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629162+0000", 2024-09-12T18:36:09.380 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7603000000000001e-05 2024-09-12T18:36:09.380 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.380 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.380 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:09.380 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.646927+0000", 2024-09-12T18:36:09.380 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.017765626 2024-09-12T18:36:09.380 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.380 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.380 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:09.380 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.647245+0000", 2024-09-12T18:36:09.380 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00031797699999999999 2024-09-12T18:36:09.381 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.381 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.381 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:09.381 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.647551+0000", 2024-09-12T18:36:09.381 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00030583500000000002 2024-09-12T18:36:09.381 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.381 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.381 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:09.381 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651738+0000", 2024-09-12T18:36:09.381 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0041864980000000003 2024-09-12T18:36:09.381 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.382 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.382 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:09.382 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670207+0000", 2024-09-12T18:36:09.382 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018469299000000002 2024-09-12T18:36:09.382 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.382 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.382 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:09.382 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670330+0000", 2024-09-12T18:36:09.382 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012284500000000001 2024-09-12T18:36:09.382 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.382 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.382 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:09.383 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670422+0000", 2024-09-12T18:36:09.383 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2398999999999994e-05 2024-09-12T18:36:09.383 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:09.383 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:09.383 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:09.383 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.383 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.383 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:09.383 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:09.383 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 43.702280559999998, 2024-09-12T18:36:09.383 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.041623741999999998, 2024-09-12T18:36:09.384 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:09.384 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:09.384 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:09.384 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:09.384 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.384 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:09.384 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:09.384 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:09.384 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.384 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.384 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:09.384 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:09.385 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:09.385 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.385 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.385 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:09.385 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629020+0000", 2024-09-12T18:36:09.385 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.15e-06 2024-09-12T18:36:09.385 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.385 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.385 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:09.385 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629023+0000", 2024-09-12T18:36:09.385 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4659999999999999e-06 2024-09-12T18:36:09.386 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.386 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.386 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:09.386 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629037+0000", 2024-09-12T18:36:09.386 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3857e-05 2024-09-12T18:36:09.386 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.386 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.386 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:09.386 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629062+0000", 2024-09-12T18:36:09.386 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4519999999999999e-05 2024-09-12T18:36:09.386 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.386 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.387 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:09.387 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629253+0000", 2024-09-12T18:36:09.387 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000191335 2024-09-12T18:36:09.387 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.387 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.387 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:09.387 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629266+0000", 2024-09-12T18:36:09.387 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3322999999999999e-05 2024-09-12T18:36:09.387 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.387 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.387 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:09.388 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648331+0000", 2024-09-12T18:36:09.388 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.019065060000000002 2024-09-12T18:36:09.388 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.388 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.388 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:09.388 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.650044+0000", 2024-09-12T18:36:09.388 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017123959999999999 2024-09-12T18:36:09.388 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.388 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.388 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:09.388 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670642+0000", 2024-09-12T18:36:09.389 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.020598635000000001 2024-09-12T18:36:09.389 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:09.389 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:09.389 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:09.389 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.389 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.389 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:09.389 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:09.389 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 43.702177227999996, 2024-09-12T18:36:09.389 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.046431252999999999, 2024-09-12T18:36:09.389 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:09.390 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:09.390 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:09.390 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:09.390 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.390 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:09.390 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:09.390 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:09.390 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.390 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.390 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:09.390 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:09.390 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:09.391 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.391 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.391 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:09.391 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629123+0000", 2024-09-12T18:36:09.391 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0899999999999999e-06 2024-09-12T18:36:09.391 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.391 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.391 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:09.391 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629138+0000", 2024-09-12T18:36:09.391 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4977000000000001e-05 2024-09-12T18:36:09.391 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.392 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.392 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:09.392 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629149+0000", 2024-09-12T18:36:09.392 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1182999999999999e-05 2024-09-12T18:36:09.392 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.392 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.392 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:09.392 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629157+0000", 2024-09-12T18:36:09.392 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8129999999999996e-06 2024-09-12T18:36:09.392 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.392 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.393 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:09.393 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629223+0000", 2024-09-12T18:36:09.393 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6463000000000004e-05 2024-09-12T18:36:09.393 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.393 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.393 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:09.393 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629230+0000", 2024-09-12T18:36:09.393 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1360000000000002e-06 2024-09-12T18:36:09.393 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.393 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.393 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:09.393 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669605+0000", 2024-09-12T18:36:09.394 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.040375518999999999 2024-09-12T18:36:09.394 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.394 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.394 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:09.394 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669840+0000", 2024-09-12T18:36:09.394 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00023520099999999999 2024-09-12T18:36:09.394 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.394 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.394 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:09.394 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.675553+0000", 2024-09-12T18:36:09.394 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0057128709999999996 2024-09-12T18:36:09.395 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:09.395 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:09.395 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:09.395 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.395 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.395 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:09.395 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:09.395 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 43.702122561000003, 2024-09-12T18:36:09.395 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.037357044999999998, 2024-09-12T18:36:09.395 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:09.395 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:09.396 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:09.396 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:09.396 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.396 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:09.396 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:09.396 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:09.396 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.396 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.396 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:09.396 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:09.396 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:09.397 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.397 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.397 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:09.397 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629178+0000", 2024-09-12T18:36:09.397 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.08e-06 2024-09-12T18:36:09.397 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.397 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.397 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:09.397 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629194+0000", 2024-09-12T18:36:09.397 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5899000000000001e-05 2024-09-12T18:36:09.397 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.397 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.398 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:09.398 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629211+0000", 2024-09-12T18:36:09.398 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7363e-05 2024-09-12T18:36:09.398 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.398 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.398 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:09.398 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629226+0000", 2024-09-12T18:36:09.398 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4567e-05 2024-09-12T18:36:09.398 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.399 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.399 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:09.399 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629299+0000", 2024-09-12T18:36:09.399 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3910000000000002e-05 2024-09-12T18:36:09.399 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.399 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.399 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:09.399 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629307+0000", 2024-09-12T18:36:09.399 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5299999999999999e-06 2024-09-12T18:36:09.399 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.399 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.399 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:09.400 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648185+0000", 2024-09-12T18:36:09.400 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018878533999999999 2024-09-12T18:36:09.400 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.400 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.400 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:09.400 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.649724+0000", 2024-09-12T18:36:09.400 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001538841 2024-09-12T18:36:09.400 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.400 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.400 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:09.400 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.666534+0000", 2024-09-12T18:36:09.401 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.016809320999999999 2024-09-12T18:36:09.401 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:09.401 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:09.401 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:09.401 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.401 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.401 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:36:09.401 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.648091+0000", 2024-09-12T18:36:09.401 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 43.683207971000002, 2024-09-12T18:36:09.401 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015212766000000001, 2024-09-12T18:36:09.401 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:09.402 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:09.402 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:09.402 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:09.402 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.402 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:09.402 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648091+0000", 2024-09-12T18:36:09.402 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:09.402 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.402 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.402 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:09.402 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648091+0000", 2024-09-12T18:36:09.403 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:09.403 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.403 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.403 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:09.403 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648092+0000", 2024-09-12T18:36:09.403 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.26e-06 2024-09-12T18:36:09.403 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.403 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.403 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:09.403 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648123+0000", 2024-09-12T18:36:09.403 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.0719000000000002e-05 2024-09-12T18:36:09.403 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.404 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.404 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:09.404 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648140+0000", 2024-09-12T18:36:09.404 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6650000000000002e-05 2024-09-12T18:36:09.404 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.404 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.404 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:09.404 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648153+0000", 2024-09-12T18:36:09.404 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.278e-05 2024-09-12T18:36:09.404 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.404 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.405 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:09.405 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.649756+0000", 2024-09-12T18:36:09.405 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0016036379999999999 2024-09-12T18:36:09.405 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.405 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.405 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:09.405 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.649800+0000", 2024-09-12T18:36:09.405 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3748999999999997e-05 2024-09-12T18:36:09.405 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.405 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.405 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:09.405 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663215+0000", 2024-09-12T18:36:09.406 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013414733999999999 2024-09-12T18:36:09.406 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.406 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.406 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:09.406 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663304+0000", 2024-09-12T18:36:09.406 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.9235999999999997e-05 2024-09-12T18:36:09.406 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:09.406 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:09.406 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:09.406 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.406 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.407 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T18:36:09.407 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.648176+0000", 2024-09-12T18:36:09.407 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 43.683123561999999, 2024-09-12T18:36:09.407 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015315812, 2024-09-12T18:36:09.407 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:09.407 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:09.407 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:09.407 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:09.407 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.407 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:09.407 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648176+0000", 2024-09-12T18:36:09.408 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:09.408 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.408 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.408 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:09.408 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648176+0000", 2024-09-12T18:36:09.408 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:09.408 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.408 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.408 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:09.408 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648176+0000", 2024-09-12T18:36:09.408 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.9400000000000005e-07 2024-09-12T18:36:09.409 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.409 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.409 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:09.409 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648184+0000", 2024-09-12T18:36:09.409 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4730000000000003e-06 2024-09-12T18:36:09.409 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.409 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.409 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:09.409 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648201+0000", 2024-09-12T18:36:09.409 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7119999999999999e-05 2024-09-12T18:36:09.409 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.410 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.410 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:09.410 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648214+0000", 2024-09-12T18:36:09.410 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3343000000000001e-05 2024-09-12T18:36:09.410 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.410 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.410 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:09.410 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651085+0000", 2024-09-12T18:36:09.410 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0028710850000000002 2024-09-12T18:36:09.410 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.410 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.410 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:09.411 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651114+0000", 2024-09-12T18:36:09.411 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.8296000000000001e-05 2024-09-12T18:36:09.411 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.411 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.411 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:09.411 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663360+0000", 2024-09-12T18:36:09.411 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012246801999999999 2024-09-12T18:36:09.411 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.411 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.411 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:09.411 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663491+0000", 2024-09-12T18:36:09.411 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000130999 2024-09-12T18:36:09.412 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:09.412 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:09.412 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:09.412 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.412 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.412 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T18:36:09.412 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.648235+0000", 2024-09-12T18:36:09.412 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 43.683064022000003, 2024-09-12T18:36:09.412 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015168310000000001, 2024-09-12T18:36:09.412 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:09.412 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:09.413 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:09.413 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:09.413 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.413 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:09.413 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648235+0000", 2024-09-12T18:36:09.413 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:09.413 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.413 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.413 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:09.413 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648235+0000", 2024-09-12T18:36:09.413 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:09.413 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.414 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.414 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:09.414 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648236+0000", 2024-09-12T18:36:09.414 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5300000000000003e-07 2024-09-12T18:36:09.414 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.414 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.414 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:09.414 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648244+0000", 2024-09-12T18:36:09.414 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.7170000000000008e-06 2024-09-12T18:36:09.414 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.414 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.415 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:09.415 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648259+0000", 2024-09-12T18:36:09.415 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5126000000000001e-05 2024-09-12T18:36:09.415 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.415 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.415 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:09.415 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648270+0000", 2024-09-12T18:36:09.415 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0933e-05 2024-09-12T18:36:09.415 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.415 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.415 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:09.415 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.650395+0000", 2024-09-12T18:36:09.416 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0021251040000000001 2024-09-12T18:36:09.416 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.416 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.416 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:09.416 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.650444+0000", 2024-09-12T18:36:09.416 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9456000000000002e-05 2024-09-12T18:36:09.416 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.416 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.416 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:09.416 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663311+0000", 2024-09-12T18:36:09.416 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012866658 2024-09-12T18:36:09.417 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.417 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.417 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:09.417 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663403+0000", 2024-09-12T18:36:09.417 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2563000000000001e-05 2024-09-12T18:36:09.417 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:09.417 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:09.417 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:09.417 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.417 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.417 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:39659 5.3 5:cd2bc06c:::benchmark_data_smithi073_23739_object39658:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:09.418 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:59.582797+0000", 2024-09-12T18:36:09.418 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 9.7485026149999996, 2024-09-12T18:36:09.418 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015424513000000001, 2024-09-12T18:36:09.418 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:09.418 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:09.418 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:09.418 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:09.418 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:09.418 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:09.418 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 39659 2024-09-12T18:36:09.418 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.418 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:09.419 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.419 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:09.419 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.582797+0000", 2024-09-12T18:36:09.419 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:09.419 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.419 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.419 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:09.419 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.582797+0000", 2024-09-12T18:36:09.419 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:09.419 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.419 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.419 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:09.420 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.582798+0000", 2024-09-12T18:36:09.420 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3769999999999999e-06 2024-09-12T18:36:09.420 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.420 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.420 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:09.420 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.582885+0000", 2024-09-12T18:36:09.420 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6601999999999995e-05 2024-09-12T18:36:09.420 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.420 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.420 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:09.420 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.582895+0000", 2024-09-12T18:36:09.421 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0232e-05 2024-09-12T18:36:09.421 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.421 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.421 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:09.421 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.582902+0000", 2024-09-12T18:36:09.421 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0330000000000003e-06 2024-09-12T18:36:09.421 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.421 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.421 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:09.421 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.582966+0000", 2024-09-12T18:36:09.421 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4493999999999996e-05 2024-09-12T18:36:09.422 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.422 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.422 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:09.422 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.583107+0000", 2024-09-12T18:36:09.422 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000140815 2024-09-12T18:36:09.422 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.422 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.422 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:09.422 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.583306+0000", 2024-09-12T18:36:09.422 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000199194 2024-09-12T18:36:09.422 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.423 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.423 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:09.423 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.585942+0000", 2024-09-12T18:36:09.423 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0026352960000000001 2024-09-12T18:36:09.423 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.423 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.423 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:09.423 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.598120+0000", 2024-09-12T18:36:09.423 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012178501 2024-09-12T18:36:09.423 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.423 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.424 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:09.424 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.598182+0000", 2024-09-12T18:36:09.424 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1550999999999994e-05 2024-09-12T18:36:09.424 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.424 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.424 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:09.424 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.598221+0000", 2024-09-12T18:36:09.424 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.9418000000000001e-05 2024-09-12T18:36:09.424 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:09.424 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:09.424 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:09.425 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.425 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.425 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:40507 5.e e30/21 5:729d4bc6:::benchmark_data_smithi073_23739_object40506:head v 30'2528, mlcod=30'2524)", 2024-09-12T18:36:09.425 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:59.950176+0000", 2024-09-12T18:36:09.425 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 9.3811236600000001, 2024-09-12T18:36:09.425 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015643424, 2024-09-12T18:36:09.425 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:09.425 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:09.425 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:09.425 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:09.425 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.426 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:09.426 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.950176+0000", 2024-09-12T18:36:09.426 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:09.426 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.426 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.426 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:09.426 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.950176+0000", 2024-09-12T18:36:09.426 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:09.426 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.426 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.426 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:09.427 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.950176+0000", 2024-09-12T18:36:09.427 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2600000000000001e-07 2024-09-12T18:36:09.427 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.427 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.427 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:09.427 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.950234+0000", 2024-09-12T18:36:09.427 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8137000000000003e-05 2024-09-12T18:36:09.427 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.427 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.427 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:09.428 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.950248+0000", 2024-09-12T18:36:09.428 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3981999999999999e-05 2024-09-12T18:36:09.428 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.428 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.428 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:09.428 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.950256+0000", 2024-09-12T18:36:09.428 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5970000000000003e-06 2024-09-12T18:36:09.428 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.428 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.428 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:09.428 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.950304+0000", 2024-09-12T18:36:09.428 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8111000000000001e-05 2024-09-12T18:36:09.429 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.429 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.429 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:09.429 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.950323+0000", 2024-09-12T18:36:09.429 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9303000000000001e-05 2024-09-12T18:36:09.429 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.429 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.429 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:09.429 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.965795+0000", 2024-09-12T18:36:09.429 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015471238999999999 2024-09-12T18:36:09.429 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.430 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.430 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:09.430 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.965819+0000", 2024-09-12T18:36:09.430 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4229000000000001e-05 2024-09-12T18:36:09.430 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:09.430 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:09.430 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:09.430 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.430 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.430 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:52931 5.a 5:5d738d7b:::benchmark_data_smithi073_23739_object52930:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:36:09.430 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:05.178736+0000", 2024-09-12T18:36:09.430 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4.1525634980000001, 2024-09-12T18:36:09.431 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.014845013000000001, 2024-09-12T18:36:09.431 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:09.431 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:09.431 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:09.431 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:09.431 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:09.431 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:09.431 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 52931 2024-09-12T18:36:09.431 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.431 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:09.431 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.432 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:09.432 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.178736+0000", 2024-09-12T18:36:09.432 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:09.432 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.432 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.432 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:09.432 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.178736+0000", 2024-09-12T18:36:09.432 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:09.432 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.432 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.432 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:09.432 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.178737+0000", 2024-09-12T18:36:09.433 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1880000000000001e-06 2024-09-12T18:36:09.433 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.433 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.433 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:09.433 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.178809+0000", 2024-09-12T18:36:09.433 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1829000000000006e-05 2024-09-12T18:36:09.433 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.433 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.433 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:09.433 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.178821+0000", 2024-09-12T18:36:09.434 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1847e-05 2024-09-12T18:36:09.434 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.434 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.434 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:09.434 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.178827+0000", 2024-09-12T18:36:09.434 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.798e-06 2024-09-12T18:36:09.434 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.434 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.434 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:09.434 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.180077+0000", 2024-09-12T18:36:09.434 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001249956 2024-09-12T18:36:09.435 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.435 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.435 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:09.435 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.180178+0000", 2024-09-12T18:36:09.435 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000100881 2024-09-12T18:36:09.435 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.435 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.435 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:09.435 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.180263+0000", 2024-09-12T18:36:09.435 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.4439999999999998e-05 2024-09-12T18:36:09.435 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.436 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.436 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:09.436 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.185494+0000", 2024-09-12T18:36:09.436 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.005231772 2024-09-12T18:36:09.436 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.436 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.436 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:09.436 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.193466+0000", 2024-09-12T18:36:09.436 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0079715900000000006 2024-09-12T18:36:09.436 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.436 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.437 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:09.437 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.193531+0000", 2024-09-12T18:36:09.437 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4809999999999998e-05 2024-09-12T18:36:09.437 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.437 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.437 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:09.437 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.193581+0000", 2024-09-12T18:36:09.437 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9901999999999998e-05 2024-09-12T18:36:09.437 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:09.437 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:09.437 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:09.438 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.438 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.438 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:53737 5.3 5:c865a65b:::benchmark_data_smithi073_23739_object53736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:36:09.438 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:05.543994+0000", 2024-09-12T18:36:09.438 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 3.7873051059999998, 2024-09-12T18:36:09.438 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015570031999999999, 2024-09-12T18:36:09.438 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:09.438 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:09.438 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:09.438 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:09.438 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:09.439 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:09.439 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 53737 2024-09-12T18:36:09.439 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.439 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:09.439 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.439 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:09.439 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.543994+0000", 2024-09-12T18:36:09.439 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:09.439 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.439 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.439 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:09.440 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.543994+0000", 2024-09-12T18:36:09.440 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:09.440 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.440 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.440 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:09.440 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.543995+0000", 2024-09-12T18:36:09.440 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2099999999999996e-07 2024-09-12T18:36:09.440 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.440 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.441 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:09.441 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.544087+0000", 2024-09-12T18:36:09.441 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2047999999999997e-05 2024-09-12T18:36:09.441 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.441 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.441 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:09.441 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.544096+0000", 2024-09-12T18:36:09.441 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.3640000000000005e-06 2024-09-12T18:36:09.441 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.441 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.441 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:09.442 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.544102+0000", 2024-09-12T18:36:09.442 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4349999999999996e-06 2024-09-12T18:36:09.442 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.442 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.442 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:09.442 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.550904+0000", 2024-09-12T18:36:09.442 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0068029090000000002 2024-09-12T18:36:09.442 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.442 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.442 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:09.442 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.551008+0000", 2024-09-12T18:36:09.443 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000103084 2024-09-12T18:36:09.443 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.443 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.443 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:09.443 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.551092+0000", 2024-09-12T18:36:09.443 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.4876000000000005e-05 2024-09-12T18:36:09.443 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.443 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.443 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:09.443 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.555976+0000", 2024-09-12T18:36:09.443 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0048837810000000002 2024-09-12T18:36:09.444 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.444 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.444 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:09.444 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.559456+0000", 2024-09-12T18:36:09.444 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0034797059999999999 2024-09-12T18:36:09.444 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.444 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.444 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:09.445 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.559511+0000", 2024-09-12T18:36:09.445 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4880999999999999e-05 2024-09-12T18:36:09.445 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.445 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.445 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:09.445 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.559564+0000", 2024-09-12T18:36:09.445 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.3327e-05 2024-09-12T18:36:09.445 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:09.445 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:09.445 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:09.445 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.445 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.446 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:60726 5.5 5:a40e180a:::benchmark_data_smithi073_23739_object60725:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:36:09.446 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:08.816711+0000", 2024-09-12T18:36:09.446 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.51458804599999997, 2024-09-12T18:36:09.446 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.014955308, 2024-09-12T18:36:09.446 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:09.446 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:09.446 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:09.446 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:09.446 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:09.446 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:09.447 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 60726 2024-09-12T18:36:09.447 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.447 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:09.447 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.447 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:09.447 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.816711+0000", 2024-09-12T18:36:09.447 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:09.447 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.447 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.447 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:09.447 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.816711+0000", 2024-09-12T18:36:09.448 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:09.448 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.448 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.448 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:09.448 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.816712+0000", 2024-09-12T18:36:09.448 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6700000000000003e-07 2024-09-12T18:36:09.448 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.448 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.448 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:09.448 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.816793+0000", 2024-09-12T18:36:09.449 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1637999999999993e-05 2024-09-12T18:36:09.449 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.449 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.449 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:09.449 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.816802+0000", 2024-09-12T18:36:09.449 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.8890000000000008e-06 2024-09-12T18:36:09.449 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.449 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.449 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:09.449 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.816811+0000", 2024-09-12T18:36:09.449 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6999999999999997e-06 2024-09-12T18:36:09.450 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.450 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.450 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:09.450 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.819305+0000", 2024-09-12T18:36:09.450 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0024942100000000002 2024-09-12T18:36:09.450 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.450 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.450 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:09.450 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.819429+0000", 2024-09-12T18:36:09.450 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012387300000000001 2024-09-12T18:36:09.450 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.451 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.451 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:09.451 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.819557+0000", 2024-09-12T18:36:09.451 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000128326 2024-09-12T18:36:09.451 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.451 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.451 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:09.451 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.828683+0000", 2024-09-12T18:36:09.451 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0091256819999999995 2024-09-12T18:36:09.451 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.451 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.452 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:09.452 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.831607+0000", 2024-09-12T18:36:09.452 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0029243020000000002 2024-09-12T18:36:09.452 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.452 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.452 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:09.452 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.831640+0000", 2024-09-12T18:36:09.452 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.2116000000000002e-05 2024-09-12T18:36:09.453 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.453 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.453 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:09.453 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:08.831666+0000", 2024-09-12T18:36:09.453 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.6905000000000001e-05 2024-09-12T18:36:09.453 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:09.453 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:09.453 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:09.453 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.453 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.453 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:61262 5.3 5:cce3e952:::benchmark_data_smithi073_23739_object61261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:36:09.454 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:09.078701+0000", 2024-09-12T18:36:09.454 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.252597717, 2024-09-12T18:36:09.454 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015538290999999999, 2024-09-12T18:36:09.454 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:09.454 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:09.454 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:09.454 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:09.454 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:09.454 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:09.454 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 61262 2024-09-12T18:36:09.454 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.454 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:09.455 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.455 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:09.455 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.078701+0000", 2024-09-12T18:36:09.455 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:09.455 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.455 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.455 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:09.455 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.078701+0000", 2024-09-12T18:36:09.455 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:09.455 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.455 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.456 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:09.456 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.078702+0000", 2024-09-12T18:36:09.456 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.9599999999999998e-07 2024-09-12T18:36:09.456 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.456 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.456 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:09.456 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.078806+0000", 2024-09-12T18:36:09.456 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000103322 2024-09-12T18:36:09.456 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.456 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.456 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:09.456 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.078815+0000", 2024-09-12T18:36:09.457 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4220000000000006e-06 2024-09-12T18:36:09.457 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.457 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.457 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:09.457 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.078823+0000", 2024-09-12T18:36:09.457 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5850000000000002e-06 2024-09-12T18:36:09.457 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.457 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.457 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:09.457 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.081130+0000", 2024-09-12T18:36:09.457 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.002307314 2024-09-12T18:36:09.458 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.458 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.458 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:09.458 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.081299+0000", 2024-09-12T18:36:09.458 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00016958899999999999 2024-09-12T18:36:09.458 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.458 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.458 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:09.458 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.081429+0000", 2024-09-12T18:36:09.458 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000129892 2024-09-12T18:36:09.458 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.458 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.459 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:09.459 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.086592+0000", 2024-09-12T18:36:09.459 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0051629400000000004 2024-09-12T18:36:09.459 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.459 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.459 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:09.459 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.094083+0000", 2024-09-12T18:36:09.459 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0074906349999999998 2024-09-12T18:36:09.459 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.459 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.459 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:09.459 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.094191+0000", 2024-09-12T18:36:09.460 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000108497 2024-09-12T18:36:09.460 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.460 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.460 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:09.460 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.094240+0000", 2024-09-12T18:36:09.460 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8299e-05 2024-09-12T18:36:09.460 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:09.460 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:09.460 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:09.460 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.460 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.460 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:61561 5.e e35/21 5:715fe5e4:::benchmark_data_smithi073_23739_object61560:head v 35'3863, mlcod=35'3861)", 2024-09-12T18:36:09.461 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:09.220994+0000", 2024-09-12T18:36:09.461 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.110305264, 2024-09-12T18:36:09.461 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.017185846000000001, 2024-09-12T18:36:09.461 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:09.461 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:09.461 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:09.461 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:09.461 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.461 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:09.461 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.220994+0000", 2024-09-12T18:36:09.461 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:09.462 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.462 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.462 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:09.462 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.220994+0000", 2024-09-12T18:36:09.462 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:09.462 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.462 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.462 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:09.462 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.220995+0000", 2024-09-12T18:36:09.462 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2799999999999996e-07 2024-09-12T18:36:09.462 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.462 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.463 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:09.463 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.221049+0000", 2024-09-12T18:36:09.463 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4506999999999998e-05 2024-09-12T18:36:09.463 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.463 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.463 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:09.463 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.221057+0000", 2024-09-12T18:36:09.463 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.4290000000000001e-06 2024-09-12T18:36:09.463 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.463 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.464 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:09.464 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.221063+0000", 2024-09-12T18:36:09.464 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7899999999999996e-06 2024-09-12T18:36:09.464 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.464 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.464 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:09.464 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.221135+0000", 2024-09-12T18:36:09.464 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1268999999999998e-05 2024-09-12T18:36:09.464 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.464 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.464 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:09.465 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.221153+0000", 2024-09-12T18:36:09.465 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8892000000000001e-05 2024-09-12T18:36:09.465 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.465 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.465 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:09.465 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.238141+0000", 2024-09-12T18:36:09.465 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.016988077000000001 2024-09-12T18:36:09.465 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.465 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.465 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:09.465 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.238180+0000", 2024-09-12T18:36:09.465 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8254000000000003e-05 2024-09-12T18:36:09.466 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:09.466 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:09.466 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:09.466 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.466 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.466 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:61578 5.6 5:638c8823:::benchmark_data_smithi073_23739_object61577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:36:09.466 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:09.232201+0000", 2024-09-12T18:36:09.466 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.099097774999999999, 2024-09-12T18:36:09.466 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.017140757, 2024-09-12T18:36:09.466 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:09.466 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:09.466 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:09.467 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:09.467 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:09.467 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:09.467 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 61578 2024-09-12T18:36:09.467 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.467 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:09.467 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.467 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:09.467 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.232201+0000", 2024-09-12T18:36:09.467 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:09.467 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.468 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.468 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:09.468 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.232201+0000", 2024-09-12T18:36:09.468 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:09.468 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.468 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.468 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:09.468 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.232202+0000", 2024-09-12T18:36:09.468 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1299999999999998e-07 2024-09-12T18:36:09.468 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.468 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.469 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:09.469 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.232276+0000", 2024-09-12T18:36:09.469 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3298000000000002e-05 2024-09-12T18:36:09.469 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.469 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.469 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:09.469 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.232287+0000", 2024-09-12T18:36:09.469 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1049e-05 2024-09-12T18:36:09.469 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.469 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.469 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:09.470 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.232293+0000", 2024-09-12T18:36:09.470 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6710000000000002e-06 2024-09-12T18:36:09.470 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.470 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.470 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:09.470 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.238749+0000", 2024-09-12T18:36:09.470 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.006455199 2024-09-12T18:36:09.470 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.470 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.470 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:09.470 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.238868+0000", 2024-09-12T18:36:09.470 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000119651 2024-09-12T18:36:09.471 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.471 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.471 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:09.471 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.239038+0000", 2024-09-12T18:36:09.471 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000169696 2024-09-12T18:36:09.471 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.471 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.471 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:09.471 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.245237+0000", 2024-09-12T18:36:09.471 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0061988169999999997 2024-09-12T18:36:09.471 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.471 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.472 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:09.472 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.249223+0000", 2024-09-12T18:36:09.472 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0039859079999999998 2024-09-12T18:36:09.472 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.472 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.472 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:09.472 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.249288+0000", 2024-09-12T18:36:09.472 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5122000000000004e-05 2024-09-12T18:36:09.472 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:09.472 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:09.473 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:09.473 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.249342+0000", 2024-09-12T18:36:09.473 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4432999999999999e-05 2024-09-12T18:36:09.473 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:09.473 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:09.473 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:09.473 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:09.473 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:09.473 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:09.475 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:36:09.476 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:09.472+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:09.517 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T18:36:09.576 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:09.572+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:09.635 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:09.635 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:36:09.635 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.635 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:62423 5.8 5:11fb7108:::benchmark_data_smithi073_23739_object62422:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:36:09.635 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:09.629457+0000", 2024-09-12T18:36:09.635 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0047559300000000002, 2024-09-12T18:36:09.635 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00478459, 2024-09-12T18:36:09.636 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:09.636 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:09.636 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:09.636 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:09.636 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:09.636 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:09.636 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 62423 2024-09-12T18:36:09.636 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.636 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:09.636 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.636 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:09.636 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.629457+0000", 2024-09-12T18:36:09.636 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:09.637 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.637 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.637 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:09.637 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.629457+0000", 2024-09-12T18:36:09.637 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:09.637 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.637 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.637 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:09.637 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.629458+0000", 2024-09-12T18:36:09.637 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9700000000000005e-07 2024-09-12T18:36:09.637 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.637 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.637 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:09.638 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.629499+0000", 2024-09-12T18:36:09.638 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1100999999999998e-05 2024-09-12T18:36:09.638 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.638 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.638 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:09.638 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.629512+0000", 2024-09-12T18:36:09.638 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3389e-05 2024-09-12T18:36:09.638 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.638 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.638 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:09.638 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.629520+0000", 2024-09-12T18:36:09.638 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0260000000000007e-06 2024-09-12T18:36:09.638 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.639 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.639 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:09.639 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.629564+0000", 2024-09-12T18:36:09.639 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3606999999999998e-05 2024-09-12T18:36:09.639 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.639 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.639 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:09.639 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.629666+0000", 2024-09-12T18:36:09.639 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000101992 2024-09-12T18:36:09.639 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.639 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.639 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:09.639 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.629746+0000", 2024-09-12T18:36:09.640 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0321000000000006e-05 2024-09-12T18:36:09.640 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.640 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.640 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:09.640 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.632601+0000", 2024-09-12T18:36:09.640 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0028550569999999998 2024-09-12T18:36:09.640 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:09.640 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:09.640 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:09.640 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.640 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.640 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:62424 5.d 5:b67b3252:::benchmark_data_smithi073_23739_object62423:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:36:09.641 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:09.629534+0000", 2024-09-12T18:36:09.641 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0046783609999999998, 2024-09-12T18:36:09.641 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0047816109999999998, 2024-09-12T18:36:09.641 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:09.641 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:09.641 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:09.641 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:09.641 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:09.641 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:09.641 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 62424 2024-09-12T18:36:09.641 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.641 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:09.641 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.642 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:09.642 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.629534+0000", 2024-09-12T18:36:09.642 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:09.642 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.642 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.642 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:09.642 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.629534+0000", 2024-09-12T18:36:09.642 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:09.643 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.643 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.643 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:09.643 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.629535+0000", 2024-09-12T18:36:09.643 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1200000000000003e-07 2024-09-12T18:36:09.643 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.643 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.643 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:09.643 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.629575+0000", 2024-09-12T18:36:09.643 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0110000000000001e-05 2024-09-12T18:36:09.643 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.643 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.643 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:09.644 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.629585+0000", 2024-09-12T18:36:09.644 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.7629999999999995e-06 2024-09-12T18:36:09.644 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.644 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.644 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:09.644 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.629591+0000", 2024-09-12T18:36:09.644 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6540000000000002e-06 2024-09-12T18:36:09.644 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.644 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.644 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:09.644 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.629647+0000", 2024-09-12T18:36:09.644 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5923e-05 2024-09-12T18:36:09.645 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.645 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.645 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:09.645 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.629765+0000", 2024-09-12T18:36:09.645 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000117389 2024-09-12T18:36:09.645 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.645 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.645 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:09.645 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.629884+0000", 2024-09-12T18:36:09.645 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011953800000000001 2024-09-12T18:36:09.645 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.645 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.646 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:09.646 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.633256+0000", 2024-09-12T18:36:09.646 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033713950000000001 2024-09-12T18:36:09.646 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:09.646 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:09.646 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:09.646 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.646 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.646 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:62426 5.f e35/21 5:fce426e0:::benchmark_data_smithi073_23739_object62425:head v 35'3919, mlcod=35'3917)", 2024-09-12T18:36:09.648 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:09.631454+0000", 2024-09-12T18:36:09.648 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0027583450000000002, 2024-09-12T18:36:09.648 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0029263280000000002, 2024-09-12T18:36:09.648 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:09.648 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:09.648 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:09.648 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:09.648 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.648 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:09.648 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.631454+0000", 2024-09-12T18:36:09.649 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:09.649 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.649 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.649 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:09.649 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.631454+0000", 2024-09-12T18:36:09.649 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:09.649 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.649 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.649 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:09.649 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.631455+0000", 2024-09-12T18:36:09.649 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.06e-07 2024-09-12T18:36:09.649 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.649 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.650 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:09.650 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.631522+0000", 2024-09-12T18:36:09.650 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7358000000000001e-05 2024-09-12T18:36:09.650 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.650 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.650 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:09.650 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.631533+0000", 2024-09-12T18:36:09.650 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0883000000000001e-05 2024-09-12T18:36:09.650 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.650 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.650 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:09.650 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.631540+0000", 2024-09-12T18:36:09.650 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2820000000000002e-06 2024-09-12T18:36:09.651 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.651 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.651 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:09.651 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.631590+0000", 2024-09-12T18:36:09.651 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0766999999999997e-05 2024-09-12T18:36:09.651 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.651 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.651 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:09.651 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.631632+0000", 2024-09-12T18:36:09.651 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1931000000000002e-05 2024-09-12T18:36:09.651 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:09.651 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:09.651 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:09.651 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.652 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.652 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:62422 5.9 e35/21 5:9ec7daed:::benchmark_data_smithi073_23739_object62421:head v 35'3870, mlcod=35'3866)", 2024-09-12T18:36:09.652 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:09.631584+0000", 2024-09-12T18:36:09.652 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0026284749999999999, 2024-09-12T18:36:09.652 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0028456850000000001, 2024-09-12T18:36:09.652 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:09.652 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:09.652 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:09.652 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:09.652 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.652 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:09.652 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.631584+0000", 2024-09-12T18:36:09.653 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:09.653 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.653 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.653 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:09.653 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.631584+0000", 2024-09-12T18:36:09.653 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:09.653 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.653 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.653 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:09.653 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.631585+0000", 2024-09-12T18:36:09.653 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9200000000000001e-07 2024-09-12T18:36:09.653 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.653 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.653 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:09.654 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.631640+0000", 2024-09-12T18:36:09.654 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5455999999999999e-05 2024-09-12T18:36:09.654 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.654 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.654 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:09.654 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.631656+0000", 2024-09-12T18:36:09.654 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5449999999999999e-05 2024-09-12T18:36:09.654 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.654 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.654 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:09.655 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.631661+0000", 2024-09-12T18:36:09.655 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4689999999999996e-06 2024-09-12T18:36:09.655 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.655 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.655 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:09.655 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.631722+0000", 2024-09-12T18:36:09.655 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1342999999999999e-05 2024-09-12T18:36:09.655 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.655 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.655 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:09.655 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.631755+0000", 2024-09-12T18:36:09.655 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2817000000000001e-05 2024-09-12T18:36:09.655 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:09.656 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:09.656 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:09.656 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.656 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.656 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:62429 5.a e35/21 5:591c4679:::benchmark_data_smithi073_23739_object62428:head v 35'3946, mlcod=35'3942)", 2024-09-12T18:36:09.656 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:09.631909+0000", 2024-09-12T18:36:09.656 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00230416, 2024-09-12T18:36:09.656 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025707849999999999, 2024-09-12T18:36:09.656 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:09.656 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:09.656 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:09.657 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:09.657 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.657 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:09.657 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.631909+0000", 2024-09-12T18:36:09.657 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:09.657 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.657 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.657 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:09.657 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.631909+0000", 2024-09-12T18:36:09.657 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:09.657 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.658 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.658 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:09.658 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.631909+0000", 2024-09-12T18:36:09.658 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6400000000000001e-07 2024-09-12T18:36:09.658 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.658 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.658 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:09.658 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.631946+0000", 2024-09-12T18:36:09.658 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6458999999999998e-05 2024-09-12T18:36:09.658 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.658 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.658 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:09.658 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.631957+0000", 2024-09-12T18:36:09.659 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0956e-05 2024-09-12T18:36:09.659 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.659 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.659 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:09.659 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.631963+0000", 2024-09-12T18:36:09.659 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2020000000000001e-06 2024-09-12T18:36:09.659 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.659 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.659 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:09.659 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.632026+0000", 2024-09-12T18:36:09.659 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2613000000000005e-05 2024-09-12T18:36:09.659 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.659 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.659 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:09.660 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.632045+0000", 2024-09-12T18:36:09.660 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9428000000000001e-05 2024-09-12T18:36:09.660 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:09.660 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:09.660 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:09.660 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.660 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.660 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:62431 5.4 5:2c7cc667:::benchmark_data_smithi073_23739_object62430:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:36:09.660 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:09.632659+0000", 2024-09-12T18:36:09.660 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0015540549999999999, 2024-09-12T18:36:09.660 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001884157, 2024-09-12T18:36:09.660 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:09.661 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:09.661 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:09.661 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:09.661 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:09.661 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:09.661 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 62431 2024-09-12T18:36:09.661 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.661 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:09.661 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.661 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:09.661 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.632659+0000", 2024-09-12T18:36:09.661 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:09.661 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.662 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.662 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:09.662 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.632659+0000", 2024-09-12T18:36:09.662 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:09.662 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.662 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.662 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:09.662 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.632660+0000", 2024-09-12T18:36:09.662 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3689999999999999e-06 2024-09-12T18:36:09.662 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.662 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.662 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:09.662 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.632689+0000", 2024-09-12T18:36:09.663 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8972999999999999e-05 2024-09-12T18:36:09.663 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.663 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.663 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:09.663 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.632703+0000", 2024-09-12T18:36:09.663 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4450999999999999e-05 2024-09-12T18:36:09.663 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.663 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.663 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:09.663 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.632711+0000", 2024-09-12T18:36:09.663 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.126e-06 2024-09-12T18:36:09.663 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.663 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.664 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:09.664 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.632757+0000", 2024-09-12T18:36:09.664 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6186999999999997e-05 2024-09-12T18:36:09.664 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.664 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.664 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:09.664 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.632856+0000", 2024-09-12T18:36:09.664 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9131999999999999e-05 2024-09-12T18:36:09.664 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.664 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.664 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:09.664 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.632941+0000", 2024-09-12T18:36:09.665 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4815999999999996e-05 2024-09-12T18:36:09.665 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:09.665 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:09.665 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:09.665 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.665 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.665 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:62430 5.f e35/21 5:f4ea45a8:::benchmark_data_smithi073_23739_object62429:head v 35'3920, mlcod=35'3917)", 2024-09-12T18:36:09.665 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:09.633656+0000", 2024-09-12T18:36:09.665 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00055656300000000004, 2024-09-12T18:36:09.665 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00095284299999999998, 2024-09-12T18:36:09.665 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:09.665 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:09.665 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:09.665 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:09.665 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.666 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:09.666 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.633656+0000", 2024-09-12T18:36:09.666 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:09.666 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.666 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.666 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:09.666 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.633656+0000", 2024-09-12T18:36:09.666 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:09.666 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.666 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.666 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:09.666 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.633657+0000", 2024-09-12T18:36:09.666 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1100000000000001e-07 2024-09-12T18:36:09.667 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.667 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.667 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:09.667 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.633752+0000", 2024-09-12T18:36:09.667 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5088999999999997e-05 2024-09-12T18:36:09.667 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.667 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.667 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:09.667 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.633762+0000", 2024-09-12T18:36:09.667 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0730999999999999e-05 2024-09-12T18:36:09.667 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.667 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.667 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:09.668 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.633787+0000", 2024-09-12T18:36:09.668 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4304e-05 2024-09-12T18:36:09.668 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.668 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.668 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:09.668 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.633837+0000", 2024-09-12T18:36:09.668 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9987000000000001e-05 2024-09-12T18:36:09.668 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.668 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.668 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:09.668 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.633864+0000", 2024-09-12T18:36:09.668 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6900999999999999e-05 2024-09-12T18:36:09.668 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:09.669 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:09.669 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:09.669 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.669 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.669 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:62432 5.4 5.bc094d84 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:36:09.669 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:09.633601+0000", 2024-09-12T18:36:09.669 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00061134199999999996, 2024-09-12T18:36:09.669 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001059969, 2024-09-12T18:36:09.669 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:09.669 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:09.669 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:09.669 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:09.669 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:09.669 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:09.670 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 62432 2024-09-12T18:36:09.670 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.670 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:09.670 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.670 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:09.670 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.633601+0000", 2024-09-12T18:36:09.670 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:09.670 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.670 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.670 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:09.670 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.633601+0000", 2024-09-12T18:36:09.671 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:09.671 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.671 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.671 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:09.671 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.633603+0000", 2024-09-12T18:36:09.671 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.172e-06 2024-09-12T18:36:09.671 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.671 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.671 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:09.671 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.633828+0000", 2024-09-12T18:36:09.671 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000225954 2024-09-12T18:36:09.671 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.671 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.671 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:09.672 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.633837+0000", 2024-09-12T18:36:09.672 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5839999999999995e-06 2024-09-12T18:36:09.672 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.672 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.672 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:09.672 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.633846+0000", 2024-09-12T18:36:09.672 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9239999999999996e-06 2024-09-12T18:36:09.672 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:09.672 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:09.672 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:09.672 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.672 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.673 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:62436 5.b 5:d06f0dc7:::benchmark_data_smithi073_23739_object62435:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:36:09.673 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:09.634250+0000", 2024-09-12T18:36:09.673 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4294967295.9999633, 2024-09-12T18:36:09.673 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00045491699999999999, 2024-09-12T18:36:09.673 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:09.673 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:09.673 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:09.673 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:09.673 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:09.673 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:09.673 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 62436 2024-09-12T18:36:09.673 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.673 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:09.674 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.674 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:09.674 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.634250+0000", 2024-09-12T18:36:09.674 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:09.674 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.674 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.674 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:09.674 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.634250+0000", 2024-09-12T18:36:09.674 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:09.674 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.674 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.674 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:09.674 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.634251+0000", 2024-09-12T18:36:09.674 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8400000000000002e-07 2024-09-12T18:36:09.675 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.675 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.675 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:09.675 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.634320+0000", 2024-09-12T18:36:09.675 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9692999999999998e-05 2024-09-12T18:36:09.675 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.675 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.675 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:09.675 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.634332+0000", 2024-09-12T18:36:09.675 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1999e-05 2024-09-12T18:36:09.675 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.675 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.675 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:09.676 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.634339+0000", 2024-09-12T18:36:09.676 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7390000000000002e-06 2024-09-12T18:36:09.676 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.676 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.676 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:09.676 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.634400+0000", 2024-09-12T18:36:09.676 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0813999999999997e-05 2024-09-12T18:36:09.676 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.676 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.676 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:09.676 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.634525+0000", 2024-09-12T18:36:09.676 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012526400000000001 2024-09-12T18:36:09.676 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.676 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.677 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:09.677 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.634638+0000", 2024-09-12T18:36:09.677 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112526 2024-09-12T18:36:09.677 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:09.677 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:09.677 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:09.677 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.677 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.677 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:62438 5.b 5.6ab93fbb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:36:09.677 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:09.634464+0000", 2024-09-12T18:36:09.677 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4294967295.9997487, 2024-09-12T18:36:09.677 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00028834200000000003, 2024-09-12T18:36:09.677 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:09.677 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:09.678 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:09.678 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:09.678 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:09.678 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:09.678 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 62438 2024-09-12T18:36:09.678 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.678 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:09.678 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.678 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:09.678 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.634464+0000", 2024-09-12T18:36:09.678 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:09.678 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.678 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.678 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:09.679 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.634464+0000", 2024-09-12T18:36:09.679 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:09.679 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.679 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.679 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:09.679 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.634465+0000", 2024-09-12T18:36:09.679 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5000000000000001e-07 2024-09-12T18:36:09.679 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.679 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.679 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:09.679 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.634542+0000", 2024-09-12T18:36:09.679 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7434000000000004e-05 2024-09-12T18:36:09.679 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.679 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.680 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:09.680 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.634554+0000", 2024-09-12T18:36:09.680 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1915e-05 2024-09-12T18:36:09.680 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:09.680 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:09.680 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:09.680 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.634562+0000", 2024-09-12T18:36:09.680 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6000000000000001e-06 2024-09-12T18:36:09.680 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:09.680 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:09.680 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:09.680 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:09.680 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-09-12T18:36:09.680 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 10 2024-09-12T18:36:09.681 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:09.682 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:36:09.683 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:09.676+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:09.783 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:09.780+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:09.833 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:09.833 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-09-12T18:36:09.834 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-09-12T18:36:09.834 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-09-12T18:36:09.834 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:09.849 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:36:09.854 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:36:09.870 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 24 16 62935 62919 163.834 131.812 0.00499341 0.00609869 2024-09-12T18:36:09.885 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:09.880+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:09.902 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is set 2024-09-12T18:36:09.986 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:09.980+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:09.996 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:36:09.997 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:36:10.009 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:10.009 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-09-12T18:36:10.009 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-09-12T18:36:10.009 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:36:10.009 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.009 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:10.009 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:10.009 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 44.374317945999998, 2024-09-12T18:36:10.010 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025088781000000001, 2024-09-12T18:36:10.010 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:10.010 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:10.010 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:10.010 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:10.010 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.010 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:10.010 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:10.010 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:10.010 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.010 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.010 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:10.010 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:10.011 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:10.011 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.011 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.011 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:10.011 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632518+0000", 2024-09-12T18:36:10.011 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:36:10.011 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.011 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.011 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:10.011 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632533+0000", 2024-09-12T18:36:10.011 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5130000000000001e-05 2024-09-12T18:36:10.012 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.012 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.012 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:10.012 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632564+0000", 2024-09-12T18:36:10.012 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0788999999999999e-05 2024-09-12T18:36:10.012 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.012 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.012 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:10.012 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632590+0000", 2024-09-12T18:36:10.012 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6057000000000001e-05 2024-09-12T18:36:10.012 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.012 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.012 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:10.013 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.635931+0000", 2024-09-12T18:36:10.013 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033411320000000001 2024-09-12T18:36:10.013 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.013 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.013 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:10.013 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636186+0000", 2024-09-12T18:36:10.013 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025452500000000002 2024-09-12T18:36:10.013 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.013 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.013 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:10.013 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636445+0000", 2024-09-12T18:36:10.013 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000259268 2024-09-12T18:36:10.013 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.013 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.014 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:10.014 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639562+0000", 2024-09-12T18:36:10.014 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031167 2024-09-12T18:36:10.014 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.014 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.014 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:10.014 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657314+0000", 2024-09-12T18:36:10.014 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017752562 2024-09-12T18:36:10.014 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.014 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.014 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:10.014 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657445+0000", 2024-09-12T18:36:10.014 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013105899999999999 2024-09-12T18:36:10.014 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.015 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.015 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:10.015 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657598+0000", 2024-09-12T18:36:10.015 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015247899999999999 2024-09-12T18:36:10.015 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:10.015 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:10.015 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:10.015 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.015 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.015 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:10.015 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:10.015 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 44.374191742999997, 2024-09-12T18:36:10.015 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025643131999999999, 2024-09-12T18:36:10.016 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:10.016 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:10.016 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:10.016 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:10.016 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.016 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:10.016 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:10.016 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:10.016 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.016 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.016 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:10.016 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:10.016 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:10.017 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.017 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.017 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:10.017 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632637+0000", 2024-09-12T18:36:10.017 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5600000000000001e-06 2024-09-12T18:36:10.017 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.017 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.017 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:10.017 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632650+0000", 2024-09-12T18:36:10.017 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3186e-05 2024-09-12T18:36:10.017 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.017 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.017 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:10.017 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632672+0000", 2024-09-12T18:36:10.018 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2013000000000001e-05 2024-09-12T18:36:10.018 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.018 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.018 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:10.018 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632687+0000", 2024-09-12T18:36:10.018 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5109999999999999e-05 2024-09-12T18:36:10.018 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.018 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.018 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:10.018 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636994+0000", 2024-09-12T18:36:10.018 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0043065539999999998 2024-09-12T18:36:10.018 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.018 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.019 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:10.019 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637198+0000", 2024-09-12T18:36:10.019 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020387199999999999 2024-09-12T18:36:10.019 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.019 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.019 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:10.019 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637475+0000", 2024-09-12T18:36:10.019 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027731000000000001 2024-09-12T18:36:10.019 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.019 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.019 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:10.019 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639574+0000", 2024-09-12T18:36:10.019 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020988999999999999 2024-09-12T18:36:10.019 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.020 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.020 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:10.020 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658057+0000", 2024-09-12T18:36:10.020 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018482926 2024-09-12T18:36:10.020 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.020 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.020 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:10.020 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658184+0000", 2024-09-12T18:36:10.020 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012756200000000001 2024-09-12T18:36:10.020 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.020 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.020 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:10.020 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658278+0000", 2024-09-12T18:36:10.020 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4139000000000001e-05 2024-09-12T18:36:10.021 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:10.021 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:10.021 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:10.021 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.021 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.021 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:10.021 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:10.021 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 44.374116651000001, 2024-09-12T18:36:10.021 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025238883, 2024-09-12T18:36:10.021 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:10.021 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:10.021 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:10.021 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:10.022 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.022 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:10.022 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:10.022 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:10.022 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.022 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.022 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:10.022 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:10.022 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:10.022 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.022 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.023 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:10.023 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632712+0000", 2024-09-12T18:36:10.023 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6869999999999999e-06 2024-09-12T18:36:10.023 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.023 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.023 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:10.023 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632719+0000", 2024-09-12T18:36:10.023 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6059999999999999e-06 2024-09-12T18:36:10.023 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.023 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.023 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:10.023 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632737+0000", 2024-09-12T18:36:10.023 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7983999999999999e-05 2024-09-12T18:36:10.024 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.024 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.024 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:10.024 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632751+0000", 2024-09-12T18:36:10.024 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4473e-05 2024-09-12T18:36:10.024 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.024 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.024 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:10.024 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636961+0000", 2024-09-12T18:36:10.024 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042100840000000002 2024-09-12T18:36:10.024 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.024 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.024 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:10.025 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637211+0000", 2024-09-12T18:36:10.025 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000249738 2024-09-12T18:36:10.025 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.025 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.025 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:10.025 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637504+0000", 2024-09-12T18:36:10.025 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00029271499999999998 2024-09-12T18:36:10.025 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.025 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.025 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:10.025 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639582+0000", 2024-09-12T18:36:10.025 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020783389999999998 2024-09-12T18:36:10.025 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.025 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.026 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:10.026 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657709+0000", 2024-09-12T18:36:10.026 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018126758999999999 2024-09-12T18:36:10.026 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.026 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.026 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:10.026 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657830+0000", 2024-09-12T18:36:10.026 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000121329 2024-09-12T18:36:10.026 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.026 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.026 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:10.026 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657949+0000", 2024-09-12T18:36:10.026 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000119169 2024-09-12T18:36:10.026 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:10.027 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:10.027 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:10.027 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.027 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.027 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:10.027 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:10.027 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 44.374052605000003, 2024-09-12T18:36:10.027 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026711823999999999, 2024-09-12T18:36:10.027 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:10.027 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:10.027 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:10.027 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:10.027 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.028 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:10.028 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:10.028 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:10.028 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.028 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.028 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:10.028 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:10.028 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:10.028 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.028 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.028 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:10.028 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632775+0000", 2024-09-12T18:36:10.028 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9999999999999995e-07 2024-09-12T18:36:10.029 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.029 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.029 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:10.029 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632788+0000", 2024-09-12T18:36:10.029 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2629999999999999e-05 2024-09-12T18:36:10.029 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.029 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.029 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:10.029 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632806+0000", 2024-09-12T18:36:10.029 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:36:10.029 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.029 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.029 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:10.030 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632820+0000", 2024-09-12T18:36:10.030 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3777e-05 2024-09-12T18:36:10.030 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.030 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.030 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:10.030 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638310+0000", 2024-09-12T18:36:10.030 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054898280000000004 2024-09-12T18:36:10.030 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.030 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.030 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:10.030 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638480+0000", 2024-09-12T18:36:10.030 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016968199999999999 2024-09-12T18:36:10.030 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.030 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.031 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:10.031 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638799+0000", 2024-09-12T18:36:10.031 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031915999999999997 2024-09-12T18:36:10.031 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.031 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.031 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:10.031 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639866+0000", 2024-09-12T18:36:10.031 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001067405 2024-09-12T18:36:10.031 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.031 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.031 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:10.031 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658398+0000", 2024-09-12T18:36:10.031 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018531542000000002 2024-09-12T18:36:10.032 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.032 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.032 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:10.032 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658643+0000", 2024-09-12T18:36:10.032 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00024531500000000002 2024-09-12T18:36:10.032 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.033 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.033 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:10.033 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.659486+0000", 2024-09-12T18:36:10.033 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00084316899999999995 2024-09-12T18:36:10.033 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:10.033 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:10.033 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:10.033 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.033 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.033 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:10.033 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:36:10.033 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 44.373825543000002, 2024-09-12T18:36:10.033 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.021357139000000001, 2024-09-12T18:36:10.034 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:10.034 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:10.034 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:10.034 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:10.034 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.034 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:10.034 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:36:10.034 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:10.034 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.034 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.034 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:10.034 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:36:10.034 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:10.035 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.035 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.035 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:10.035 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633003+0000", 2024-09-12T18:36:10.035 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.53e-06 2024-09-12T18:36:10.035 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.035 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.035 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:10.035 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633012+0000", 2024-09-12T18:36:10.035 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9290000000000004e-06 2024-09-12T18:36:10.035 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.035 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.035 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:10.036 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633034+0000", 2024-09-12T18:36:10.036 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2127e-05 2024-09-12T18:36:10.036 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.036 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.036 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:10.036 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633054+0000", 2024-09-12T18:36:10.036 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9476000000000001e-05 2024-09-12T18:36:10.036 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.036 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.036 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:10.036 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636657+0000", 2024-09-12T18:36:10.036 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036038839999999999 2024-09-12T18:36:10.036 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.037 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.037 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:10.037 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636885+0000", 2024-09-12T18:36:10.037 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022798800000000001 2024-09-12T18:36:10.037 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.037 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.037 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:10.037 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637189+0000", 2024-09-12T18:36:10.037 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030392100000000002 2024-09-12T18:36:10.037 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.037 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.037 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:10.037 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639271+0000", 2024-09-12T18:36:10.037 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020817460000000002 2024-09-12T18:36:10.038 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.038 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.038 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:10.038 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.652371+0000", 2024-09-12T18:36:10.038 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013099417 2024-09-12T18:36:10.038 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.038 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.038 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:10.038 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654255+0000", 2024-09-12T18:36:10.038 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018846049999999999 2024-09-12T18:36:10.038 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.038 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.038 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:10.038 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654359+0000", 2024-09-12T18:36:10.039 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000103516 2024-09-12T18:36:10.039 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:10.039 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:10.039 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:10.039 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.039 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.039 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:10.039 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:10.039 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 44.373743851, 2024-09-12T18:36:10.040 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026938645000000001, 2024-09-12T18:36:10.040 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:10.040 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:10.040 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:10.040 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:10.040 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.040 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:10.040 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:10.040 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:10.040 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.040 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.040 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:10.041 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:10.041 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:10.041 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.041 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.041 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:10.041 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633085+0000", 2024-09-12T18:36:10.041 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:10.041 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.041 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.041 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:10.041 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633093+0000", 2024-09-12T18:36:10.041 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3999999999999992e-06 2024-09-12T18:36:10.041 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.041 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.042 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:10.042 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633111+0000", 2024-09-12T18:36:10.042 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8070000000000001e-05 2024-09-12T18:36:10.042 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.042 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.042 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:10.042 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633126+0000", 2024-09-12T18:36:10.042 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4487e-05 2024-09-12T18:36:10.042 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.042 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.042 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:10.042 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638290+0000", 2024-09-12T18:36:10.042 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0051640269999999999 2024-09-12T18:36:10.043 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.043 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.043 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:10.043 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638547+0000", 2024-09-12T18:36:10.043 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025714100000000001 2024-09-12T18:36:10.043 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.043 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.043 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:10.043 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638850+0000", 2024-09-12T18:36:10.043 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030278400000000001 2024-09-12T18:36:10.043 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.043 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.043 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:10.043 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.640706+0000", 2024-09-12T18:36:10.044 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018564580000000001 2024-09-12T18:36:10.044 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.044 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.044 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:10.044 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658420+0000", 2024-09-12T18:36:10.044 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017714395000000001 2024-09-12T18:36:10.044 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.044 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.044 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:10.044 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658635+0000", 2024-09-12T18:36:10.044 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021413500000000001 2024-09-12T18:36:10.044 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.044 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.045 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:10.045 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.660022+0000", 2024-09-12T18:36:10.045 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001387318 2024-09-12T18:36:10.045 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:10.045 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:10.045 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:10.045 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.045 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.045 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:10.045 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633323+0000", 2024-09-12T18:36:10.045 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 44.373504496000002, 2024-09-12T18:36:10.045 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015717332000000001, 2024-09-12T18:36:10.045 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:10.046 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:10.046 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:10.046 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:10.046 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.046 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:10.046 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633323+0000", 2024-09-12T18:36:10.046 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:10.046 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.046 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.046 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:10.046 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633323+0000", 2024-09-12T18:36:10.046 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:10.046 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.046 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.047 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:10.047 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633324+0000", 2024-09-12T18:36:10.047 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7230000000000001e-06 2024-09-12T18:36:10.047 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.047 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.047 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:10.047 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633351+0000", 2024-09-12T18:36:10.047 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7067e-05 2024-09-12T18:36:10.047 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.047 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.047 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:10.047 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633372+0000", 2024-09-12T18:36:10.047 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0429e-05 2024-09-12T18:36:10.047 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.048 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.048 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:10.048 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633387+0000", 2024-09-12T18:36:10.048 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5659999999999999e-05 2024-09-12T18:36:10.048 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.048 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.048 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:10.048 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633527+0000", 2024-09-12T18:36:10.048 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013991599999999999 2024-09-12T18:36:10.048 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.048 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.048 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:10.048 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633806+0000", 2024-09-12T18:36:10.049 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027858400000000001 2024-09-12T18:36:10.049 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.049 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.049 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:10.049 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.649040+0000", 2024-09-12T18:36:10.049 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015233953 2024-09-12T18:36:10.049 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:10.049 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:10.049 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:10.049 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.049 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.049 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:10.049 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:36:10.049 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 44.373399339999999, 2024-09-12T18:36:10.050 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.020709867, 2024-09-12T18:36:10.050 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:10.050 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:10.050 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:10.050 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:10.050 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.050 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:10.050 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:36:10.050 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:10.050 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.050 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.050 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:10.050 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:36:10.050 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:10.051 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.051 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.051 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:10.051 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633429+0000", 2024-09-12T18:36:10.051 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.313e-06 2024-09-12T18:36:10.051 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.051 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.051 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:10.051 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633462+0000", 2024-09-12T18:36:10.051 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3197000000000001e-05 2024-09-12T18:36:10.051 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.051 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.051 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:10.051 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633485+0000", 2024-09-12T18:36:10.052 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3243000000000001e-05 2024-09-12T18:36:10.052 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.052 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.052 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:10.052 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633501+0000", 2024-09-12T18:36:10.052 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5383000000000002e-05 2024-09-12T18:36:10.052 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.052 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.052 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:10.052 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633642+0000", 2024-09-12T18:36:10.052 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000141168 2024-09-12T18:36:10.052 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.052 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.053 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:10.053 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633982+0000", 2024-09-12T18:36:10.053 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000340067 2024-09-12T18:36:10.053 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.053 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.053 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:10.053 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654138+0000", 2024-09-12T18:36:10.053 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.020155495999999998 2024-09-12T18:36:10.053 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:10.053 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:10.053 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:10.053 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.053 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.054 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:40432 5.b 5:d974a3ca:::benchmark_data_smithi073_23739_object40431:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:10.054 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:59.917611+0000", 2024-09-12T18:36:10.054 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 10.089216113999999, 2024-09-12T18:36:10.054 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016184628999999999, 2024-09-12T18:36:10.054 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:10.054 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:10.054 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:10.056 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:10.056 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:10.056 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:10.056 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 40432 2024-09-12T18:36:10.056 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.056 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:10.056 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.056 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:10.056 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.917611+0000", 2024-09-12T18:36:10.056 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:10.056 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.057 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.057 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:10.057 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.917611+0000", 2024-09-12T18:36:10.057 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:10.057 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.057 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.057 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:10.057 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.917612+0000", 2024-09-12T18:36:10.057 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.009e-06 2024-09-12T18:36:10.057 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.057 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.057 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:10.057 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.917751+0000", 2024-09-12T18:36:10.057 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013949399999999999 2024-09-12T18:36:10.058 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.058 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.058 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:10.058 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.917773+0000", 2024-09-12T18:36:10.058 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1265000000000001e-05 2024-09-12T18:36:10.058 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.058 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.058 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:10.058 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.917782+0000", 2024-09-12T18:36:10.058 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.1009999999999998e-06 2024-09-12T18:36:10.058 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.058 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.058 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:10.058 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.925352+0000", 2024-09-12T18:36:10.059 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0075700689999999996 2024-09-12T18:36:10.059 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.059 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.059 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:10.059 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.925576+0000", 2024-09-12T18:36:10.059 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000224565 2024-09-12T18:36:10.059 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.059 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.059 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:10.059 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.925832+0000", 2024-09-12T18:36:10.059 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000255436 2024-09-12T18:36:10.059 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.061 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.061 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:10.061 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.931553+0000", 2024-09-12T18:36:10.061 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0057211190000000002 2024-09-12T18:36:10.061 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.061 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.061 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:10.061 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.933745+0000", 2024-09-12T18:36:10.061 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0021916290000000001 2024-09-12T18:36:10.061 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.061 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.061 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:10.061 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.933773+0000", 2024-09-12T18:36:10.062 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8249e-05 2024-09-12T18:36:10.062 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.062 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.062 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:10.062 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.933796+0000", 2024-09-12T18:36:10.062 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2693000000000001e-05 2024-09-12T18:36:10.062 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:10.062 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:10.062 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:10.062 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.062 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.062 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:40507 5.e 5:729d4bc6:::benchmark_data_smithi073_23739_object40506:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:10.062 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:59.951281+0000", 2024-09-12T18:36:10.063 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 10.055546253999999, 2024-09-12T18:36:10.063 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016604759, 2024-09-12T18:36:10.063 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:10.063 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:10.063 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:10.063 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:10.063 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:10.063 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:10.063 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 40507 2024-09-12T18:36:10.063 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.063 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:10.063 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.063 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:10.063 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951281+0000", 2024-09-12T18:36:10.064 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:10.064 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.064 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.064 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:10.064 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951281+0000", 2024-09-12T18:36:10.064 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:10.064 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.064 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.064 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:10.064 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951282+0000", 2024-09-12T18:36:10.064 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7599999999999996e-07 2024-09-12T18:36:10.064 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.064 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.064 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:10.065 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951390+0000", 2024-09-12T18:36:10.065 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000108075 2024-09-12T18:36:10.065 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.065 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.065 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:10.065 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951425+0000", 2024-09-12T18:36:10.065 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5765000000000001e-05 2024-09-12T18:36:10.065 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.065 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.065 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:10.065 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951435+0000", 2024-09-12T18:36:10.065 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:36:10.066 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.066 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.066 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:10.066 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951505+0000", 2024-09-12T18:36:10.066 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0655999999999996e-05 2024-09-12T18:36:10.066 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.066 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.066 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:10.066 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951663+0000", 2024-09-12T18:36:10.066 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015736799999999999 2024-09-12T18:36:10.066 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.066 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.066 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:10.067 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951812+0000", 2024-09-12T18:36:10.067 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014943000000000001 2024-09-12T18:36:10.067 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.067 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.067 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:10.067 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.953812+0000", 2024-09-12T18:36:10.067 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001999781 2024-09-12T18:36:10.067 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.067 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.067 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:10.067 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.967782+0000", 2024-09-12T18:36:10.067 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013969472 2024-09-12T18:36:10.067 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.067 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.068 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:10.068 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.967839+0000", 2024-09-12T18:36:10.068 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7278999999999998e-05 2024-09-12T18:36:10.068 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.068 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.068 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:10.068 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.967886+0000", 2024-09-12T18:36:10.068 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6717e-05 2024-09-12T18:36:10.068 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:10.068 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:10.068 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:10.068 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.068 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.069 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:40638 5.8 5:1bcfd6bd:::benchmark_data_smithi073_23739_object40637:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:10.069 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:00.010531+0000", 2024-09-12T18:36:10.069 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 9.9962962260000001, 2024-09-12T18:36:10.069 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.01580927, 2024-09-12T18:36:10.069 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:10.069 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:10.069 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:10.069 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:10.069 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:10.069 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:10.069 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 40638 2024-09-12T18:36:10.069 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.069 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:10.069 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.070 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:10.070 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010531+0000", 2024-09-12T18:36:10.070 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:10.070 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.070 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.070 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:10.070 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010531+0000", 2024-09-12T18:36:10.070 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:10.070 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.070 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.070 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:10.070 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010531+0000", 2024-09-12T18:36:10.070 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6400000000000002e-07 2024-09-12T18:36:10.071 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.071 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.071 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:10.071 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010643+0000", 2024-09-12T18:36:10.071 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000111562 2024-09-12T18:36:10.071 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.071 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.071 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:10.071 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010657+0000", 2024-09-12T18:36:10.071 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3804e-05 2024-09-12T18:36:10.071 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.071 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.071 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:10.072 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010664+0000", 2024-09-12T18:36:10.072 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2919999999999998e-06 2024-09-12T18:36:10.072 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.072 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.072 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:10.072 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.016385+0000", 2024-09-12T18:36:10.072 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0057206490000000004 2024-09-12T18:36:10.072 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.072 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.072 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:10.072 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.016509+0000", 2024-09-12T18:36:10.072 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000124058 2024-09-12T18:36:10.072 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.072 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.073 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:10.073 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.016711+0000", 2024-09-12T18:36:10.073 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000202389 2024-09-12T18:36:10.073 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.073 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.073 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:10.073 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.021363+0000", 2024-09-12T18:36:10.073 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0046515970000000004 2024-09-12T18:36:10.073 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.073 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.073 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:10.073 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.026248+0000", 2024-09-12T18:36:10.073 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.004885655 2024-09-12T18:36:10.074 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.074 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.074 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:10.074 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.026287+0000", 2024-09-12T18:36:10.074 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8909000000000003e-05 2024-09-12T18:36:10.074 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.074 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.074 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:10.074 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.026340+0000", 2024-09-12T18:36:10.074 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2691000000000001e-05 2024-09-12T18:36:10.074 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:10.074 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:10.074 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:10.074 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.075 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.075 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:40639 5.8 5:16bd0f48:::benchmark_data_smithi073_23739_object40638:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:10.075 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:00.010888+0000", 2024-09-12T18:36:10.075 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 9.9959389299999994, 2024-09-12T18:36:10.075 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017069808999999998, 2024-09-12T18:36:10.075 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:10.075 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:10.075 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:10.075 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:10.075 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:10.075 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:10.075 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 40639 2024-09-12T18:36:10.075 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.075 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:10.076 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.076 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:10.076 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010888+0000", 2024-09-12T18:36:10.076 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:10.076 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.076 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.076 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:10.076 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010888+0000", 2024-09-12T18:36:10.076 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:10.076 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.076 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.076 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:10.076 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010889+0000", 2024-09-12T18:36:10.077 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.004e-06 2024-09-12T18:36:10.077 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.077 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.077 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:10.077 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010921+0000", 2024-09-12T18:36:10.077 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1745000000000002e-05 2024-09-12T18:36:10.077 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.077 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.078 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:10.078 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010933+0000", 2024-09-12T18:36:10.078 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2476999999999999e-05 2024-09-12T18:36:10.078 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.078 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.078 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:10.078 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010941+0000", 2024-09-12T18:36:10.078 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1810000000000004e-06 2024-09-12T18:36:10.078 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.078 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.078 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:10.078 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.019947+0000", 2024-09-12T18:36:10.078 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0090069190000000004 2024-09-12T18:36:10.078 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.079 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.079 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:10.079 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.020062+0000", 2024-09-12T18:36:10.079 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000114851 2024-09-12T18:36:10.079 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.079 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.079 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:10.079 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.020148+0000", 2024-09-12T18:36:10.079 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5579000000000002e-05 2024-09-12T18:36:10.079 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.079 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.079 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:10.079 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.026347+0000", 2024-09-12T18:36:10.080 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0061988820000000002 2024-09-12T18:36:10.080 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.080 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.080 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:10.080 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.027866+0000", 2024-09-12T18:36:10.080 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015197190000000001 2024-09-12T18:36:10.080 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.080 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.080 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:10.080 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.027914+0000", 2024-09-12T18:36:10.080 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8009000000000001e-05 2024-09-12T18:36:10.080 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.080 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.080 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:10.081 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.027958+0000", 2024-09-12T18:36:10.081 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3442999999999997e-05 2024-09-12T18:36:10.081 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:10.081 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:10.081 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:10.081 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.081 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.081 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:40642 5.0 5:015ece55:::benchmark_data_smithi073_23739_object40641:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:10.081 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:00.011626+0000", 2024-09-12T18:36:10.081 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 9.9952011009999993, 2024-09-12T18:36:10.081 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016593251, 2024-09-12T18:36:10.081 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:10.081 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:10.082 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:10.082 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:10.082 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:10.082 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:10.082 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 40642 2024-09-12T18:36:10.082 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.082 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:10.082 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.082 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:10.082 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.011626+0000", 2024-09-12T18:36:10.082 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:10.082 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.082 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.082 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:10.082 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.011626+0000", 2024-09-12T18:36:10.083 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:10.083 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.083 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.083 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:10.083 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.011627+0000", 2024-09-12T18:36:10.083 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.7399999999999991e-07 2024-09-12T18:36:10.083 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.083 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.083 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:10.083 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.011693+0000", 2024-09-12T18:36:10.083 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6586000000000002e-05 2024-09-12T18:36:10.083 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.083 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.083 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:10.084 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.011703+0000", 2024-09-12T18:36:10.084 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.3619999999999995e-06 2024-09-12T18:36:10.084 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.084 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.084 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:10.084 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.011710+0000", 2024-09-12T18:36:10.084 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1010000000000003e-06 2024-09-12T18:36:10.084 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.084 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.084 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:10.084 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.021346+0000", 2024-09-12T18:36:10.084 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0096362170000000007 2024-09-12T18:36:10.084 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.085 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.085 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:10.085 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.021456+0000", 2024-09-12T18:36:10.085 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010942000000000001 2024-09-12T18:36:10.085 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.085 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.085 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:10.085 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.021540+0000", 2024-09-12T18:36:10.085 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4220000000000003e-05 2024-09-12T18:36:10.085 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.085 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.085 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:10.085 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.027831+0000", 2024-09-12T18:36:10.086 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062915760000000001 2024-09-12T18:36:10.086 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.086 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.086 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:10.086 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.028132+0000", 2024-09-12T18:36:10.086 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030037 2024-09-12T18:36:10.086 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.086 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.086 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:10.086 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.028188+0000", 2024-09-12T18:36:10.086 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6023999999999998e-05 2024-09-12T18:36:10.086 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.086 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.087 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:10.087 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.028219+0000", 2024-09-12T18:36:10.087 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1401e-05 2024-09-12T18:36:10.087 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:10.087 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:10.087 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:10.087 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.087 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.087 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:49141 5.d 5:bce526e5:::benchmark_data_smithi073_23739_object49140:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T18:36:10.087 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:03.538808+0000", 2024-09-12T18:36:10.087 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 6.4680192940000003, 2024-09-12T18:36:10.087 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.019659019, 2024-09-12T18:36:10.087 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:10.087 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:10.087 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:10.088 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:10.088 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:10.088 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:10.088 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 49141 2024-09-12T18:36:10.088 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.088 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:10.088 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.088 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:10.088 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538808+0000", 2024-09-12T18:36:10.088 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:10.088 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.088 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.088 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:10.089 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538808+0000", 2024-09-12T18:36:10.089 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:10.089 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.089 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.089 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:10.089 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538809+0000", 2024-09-12T18:36:10.089 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.065e-06 2024-09-12T18:36:10.089 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.089 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.089 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:10.089 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538914+0000", 2024-09-12T18:36:10.089 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010528599999999999 2024-09-12T18:36:10.089 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.089 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.090 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:10.090 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538924+0000", 2024-09-12T18:36:10.090 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4420000000000004e-06 2024-09-12T18:36:10.090 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.090 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.090 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:10.090 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538944+0000", 2024-09-12T18:36:10.090 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0460000000000001e-05 2024-09-12T18:36:10.090 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.090 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.090 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:10.090 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.539034+0000", 2024-09-12T18:36:10.090 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9512000000000006e-05 2024-09-12T18:36:10.091 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.091 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.091 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:10.091 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.539161+0000", 2024-09-12T18:36:10.091 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012782399999999999 2024-09-12T18:36:10.091 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.091 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.091 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:10.091 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.539246+0000", 2024-09-12T18:36:10.091 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4927999999999997e-05 2024-09-12T18:36:10.091 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.091 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.091 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:10.091 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.541390+0000", 2024-09-12T18:36:10.092 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0021439509999999998 2024-09-12T18:36:10.092 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.092 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.092 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:10.092 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.558236+0000", 2024-09-12T18:36:10.092 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016845619999999999 2024-09-12T18:36:10.092 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.092 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.092 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:10.092 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.558368+0000", 2024-09-12T18:36:10.092 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013241300000000001 2024-09-12T18:36:10.092 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.092 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.092 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:10.093 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.558467+0000", 2024-09-12T18:36:10.093 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8517999999999994e-05 2024-09-12T18:36:10.093 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:10.093 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:10.093 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:10.093 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.093 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.093 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:52202 5.e 5:79316c1c:::benchmark_data_smithi073_23739_object52201:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:36:10.093 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:04.855752+0000", 2024-09-12T18:36:10.093 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.1510747649999997, 2024-09-12T18:36:10.093 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015567998, 2024-09-12T18:36:10.093 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:10.093 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:10.093 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:10.094 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:10.094 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:10.094 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:10.094 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 52202 2024-09-12T18:36:10.094 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.094 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:10.094 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.094 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:10.094 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:04.855752+0000", 2024-09-12T18:36:10.094 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:10.094 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.094 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.094 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:10.095 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:04.855752+0000", 2024-09-12T18:36:10.095 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:10.095 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.095 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.095 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:10.095 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:04.855753+0000", 2024-09-12T18:36:10.095 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9899999999999999e-07 2024-09-12T18:36:10.095 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.095 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.095 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:10.095 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:04.855871+0000", 2024-09-12T18:36:10.095 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000117916 2024-09-12T18:36:10.095 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.095 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.096 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:10.096 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:04.855882+0000", 2024-09-12T18:36:10.096 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1291000000000001e-05 2024-09-12T18:36:10.096 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.096 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.096 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:10.096 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:04.855890+0000", 2024-09-12T18:36:10.096 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7840000000000004e-06 2024-09-12T18:36:10.096 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.096 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.096 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:10.096 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:04.855986+0000", 2024-09-12T18:36:10.096 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6413e-05 2024-09-12T18:36:10.096 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.097 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.097 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:10.097 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:04.856075+0000", 2024-09-12T18:36:10.097 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8051000000000001e-05 2024-09-12T18:36:10.097 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.097 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.097 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:10.097 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:04.856155+0000", 2024-09-12T18:36:10.097 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0035000000000002e-05 2024-09-12T18:36:10.097 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.097 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.097 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:10.097 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:04.861933+0000", 2024-09-12T18:36:10.097 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0057787230000000004 2024-09-12T18:36:10.098 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.098 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.098 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:10.098 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:04.871256+0000", 2024-09-12T18:36:10.098 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0093228010000000004 2024-09-12T18:36:10.098 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.098 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.098 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:10.098 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:04.871290+0000", 2024-09-12T18:36:10.098 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4319999999999997e-05 2024-09-12T18:36:10.098 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.098 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.098 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:10.099 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:04.871320+0000", 2024-09-12T18:36:10.099 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9865e-05 2024-09-12T18:36:10.099 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:10.099 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:10.099 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:10.099 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.099 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.099 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:52665 5.4 5:2596ded4:::benchmark_data_smithi073_23739_object52664:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:36:10.099 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:05.063686+0000", 2024-09-12T18:36:10.099 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.9431410490000003, 2024-09-12T18:36:10.099 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016518109, 2024-09-12T18:36:10.099 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:10.099 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:10.099 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:10.100 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:10.100 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:10.100 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:10.100 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 52665 2024-09-12T18:36:10.100 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.100 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:10.100 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.100 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:10.100 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063686+0000", 2024-09-12T18:36:10.100 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:10.100 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.100 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.100 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:10.101 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063686+0000", 2024-09-12T18:36:10.101 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:10.101 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.101 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.101 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:10.101 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063687+0000", 2024-09-12T18:36:10.101 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8800000000000001e-07 2024-09-12T18:36:10.101 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.101 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.101 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:10.101 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063816+0000", 2024-09-12T18:36:10.101 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012879100000000001 2024-09-12T18:36:10.101 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.102 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.102 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:10.102 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063844+0000", 2024-09-12T18:36:10.102 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8683e-05 2024-09-12T18:36:10.102 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.102 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.102 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:10.102 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063851+0000", 2024-09-12T18:36:10.102 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4110000000000001e-06 2024-09-12T18:36:10.102 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.102 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.102 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:10.103 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.066498+0000", 2024-09-12T18:36:10.103 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00264774 2024-09-12T18:36:10.103 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.103 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.103 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:10.103 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.066620+0000", 2024-09-12T18:36:10.103 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000121919 2024-09-12T18:36:10.103 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.103 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.103 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:10.103 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.066756+0000", 2024-09-12T18:36:10.103 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013559800000000001 2024-09-12T18:36:10.103 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.104 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.104 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:10.104 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.072827+0000", 2024-09-12T18:36:10.104 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0060708439999999997 2024-09-12T18:36:10.104 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.104 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.104 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:10.104 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.080088+0000", 2024-09-12T18:36:10.104 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0072613900000000004 2024-09-12T18:36:10.104 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.104 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.104 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:10.104 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.080146+0000", 2024-09-12T18:36:10.104 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7533e-05 2024-09-12T18:36:10.105 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.105 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.105 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:10.105 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.080204+0000", 2024-09-12T18:36:10.105 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8312e-05 2024-09-12T18:36:10.105 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:10.105 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:10.105 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:10.105 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.105 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.105 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:52666 5.4 5:2086007b:::benchmark_data_smithi073_23739_object52665:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:36:10.105 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:05.063873+0000", 2024-09-12T18:36:10.105 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.9429541649999997, 2024-09-12T18:36:10.106 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016582294000000001, 2024-09-12T18:36:10.106 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:10.106 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:10.106 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:10.106 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:10.106 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:10.106 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:10.106 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 52666 2024-09-12T18:36:10.106 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.106 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:10.106 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.106 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:10.106 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063873+0000", 2024-09-12T18:36:10.106 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:10.107 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.107 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.107 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:10.107 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063873+0000", 2024-09-12T18:36:10.107 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:10.107 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.107 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.107 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:10.107 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063874+0000", 2024-09-12T18:36:10.107 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4099999999999998e-07 2024-09-12T18:36:10.107 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.107 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.107 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:10.107 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063925+0000", 2024-09-12T18:36:10.108 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1462999999999998e-05 2024-09-12T18:36:10.108 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.108 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.108 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:10.108 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063937+0000", 2024-09-12T18:36:10.108 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1649e-05 2024-09-12T18:36:10.108 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.108 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.108 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:10.108 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063951+0000", 2024-09-12T18:36:10.108 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4161999999999999e-05 2024-09-12T18:36:10.108 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.108 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.108 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:10.109 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.068208+0000", 2024-09-12T18:36:10.109 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042567630000000002 2024-09-12T18:36:10.109 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.109 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.109 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:10.109 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.068319+0000", 2024-09-12T18:36:10.109 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000110955 2024-09-12T18:36:10.109 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.109 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.109 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:10.109 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.068417+0000", 2024-09-12T18:36:10.109 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.7969999999999999e-05 2024-09-12T18:36:10.109 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.109 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.110 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:10.110 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.072834+0000", 2024-09-12T18:36:10.110 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0044172910000000003 2024-09-12T18:36:10.110 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.110 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.110 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:10.110 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.080278+0000", 2024-09-12T18:36:10.110 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0074438880000000001 2024-09-12T18:36:10.110 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.110 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.110 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:10.110 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.080389+0000", 2024-09-12T18:36:10.110 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000111475 2024-09-12T18:36:10.111 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.111 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.111 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:10.111 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.080455+0000", 2024-09-12T18:36:10.111 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5937000000000002e-05 2024-09-12T18:36:10.111 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:10.111 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:10.111 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:10.111 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.111 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.111 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:52993 5.0 5:00f9e688:::benchmark_data_smithi073_23739_object52992:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:36:10.111 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:05.209109+0000", 2024-09-12T18:36:10.111 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.7977182210000002, 2024-09-12T18:36:10.111 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017556391000000001, 2024-09-12T18:36:10.111 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:10.112 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:10.112 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:10.112 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:10.112 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:10.112 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:10.112 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 52993 2024-09-12T18:36:10.112 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.112 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:10.112 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.112 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:10.112 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.209109+0000", 2024-09-12T18:36:10.112 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:10.112 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.113 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.113 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:10.113 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.209109+0000", 2024-09-12T18:36:10.113 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:10.113 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.113 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.113 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:10.113 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.209110+0000", 2024-09-12T18:36:10.113 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8000000000000004e-07 2024-09-12T18:36:10.113 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.113 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.113 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:10.113 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.209246+0000", 2024-09-12T18:36:10.113 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013595 2024-09-12T18:36:10.114 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.114 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.114 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:10.114 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.209256+0000", 2024-09-12T18:36:10.114 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9580000000000002e-06 2024-09-12T18:36:10.114 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.114 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.114 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:10.114 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.209262+0000", 2024-09-12T18:36:10.114 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7950000000000002e-06 2024-09-12T18:36:10.114 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.114 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.114 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:10.114 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.212362+0000", 2024-09-12T18:36:10.115 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003099606 2024-09-12T18:36:10.115 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.115 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.115 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:10.115 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.212569+0000", 2024-09-12T18:36:10.115 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020737699999999999 2024-09-12T18:36:10.115 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.115 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.115 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:10.115 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.212907+0000", 2024-09-12T18:36:10.115 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00033730499999999998 2024-09-12T18:36:10.115 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.115 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.115 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:10.116 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.226511+0000", 2024-09-12T18:36:10.116 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.01360451 2024-09-12T18:36:10.116 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.116 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.116 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:10.116 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.226567+0000", 2024-09-12T18:36:10.116 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5371000000000002e-05 2024-09-12T18:36:10.116 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.116 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.116 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:10.116 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.226624+0000", 2024-09-12T18:36:10.116 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7355999999999998e-05 2024-09-12T18:36:10.116 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.116 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.117 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:10.117 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.226665+0000", 2024-09-12T18:36:10.117 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1282999999999998e-05 2024-09-12T18:36:10.117 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:10.117 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:10.117 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:10.117 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.117 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.117 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:61561 5.e 5:715fe5e4:::benchmark_data_smithi073_23739_object61560:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:36:10.117 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:09.221864+0000", 2024-09-12T18:36:10.117 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.78496287899999995, 2024-09-12T18:36:10.117 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017993663999999999, 2024-09-12T18:36:10.117 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:10.118 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:10.118 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:10.118 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:10.118 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:10.118 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:10.118 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 61561 2024-09-12T18:36:10.118 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.118 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:10.118 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.118 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:10.118 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.221864+0000", 2024-09-12T18:36:10.118 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:10.118 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.119 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.119 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:10.119 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.221864+0000", 2024-09-12T18:36:10.119 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:10.119 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.119 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.119 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:10.119 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.221865+0000", 2024-09-12T18:36:10.119 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1310000000000001e-06 2024-09-12T18:36:10.119 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.119 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.119 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:10.119 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222022+0000", 2024-09-12T18:36:10.119 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015628500000000001 2024-09-12T18:36:10.120 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.120 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.120 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:10.120 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222034+0000", 2024-09-12T18:36:10.120 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2481e-05 2024-09-12T18:36:10.120 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.120 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.120 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:10.120 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222041+0000", 2024-09-12T18:36:10.120 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7469999999999999e-06 2024-09-12T18:36:10.120 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.120 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.120 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:10.121 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222103+0000", 2024-09-12T18:36:10.121 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1903999999999995e-05 2024-09-12T18:36:10.121 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.121 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.121 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:10.121 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222199+0000", 2024-09-12T18:36:10.121 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6664999999999997e-05 2024-09-12T18:36:10.121 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.121 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.121 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:10.121 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222286+0000", 2024-09-12T18:36:10.121 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6582999999999994e-05 2024-09-12T18:36:10.121 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.122 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.122 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:10.122 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.228622+0000", 2024-09-12T18:36:10.122 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063357520000000001 2024-09-12T18:36:10.122 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.122 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.122 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:10.122 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.239753+0000", 2024-09-12T18:36:10.122 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011131709 2024-09-12T18:36:10.122 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.122 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.122 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:10.122 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.239813+0000", 2024-09-12T18:36:10.122 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0007999999999999e-05 2024-09-12T18:36:10.123 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.123 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.123 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:10.123 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.239858+0000", 2024-09-12T18:36:10.123 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4399e-05 2024-09-12T18:36:10.123 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:10.123 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:10.123 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:10.123 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.123 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.123 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:62045 5.4 5:28350251:::benchmark_data_smithi073_23739_object62044:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:36:10.123 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:09.454028+0000", 2024-09-12T18:36:10.123 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.55279910200000004, 2024-09-12T18:36:10.124 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016191579000000001, 2024-09-12T18:36:10.124 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:10.124 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:10.124 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:10.124 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:10.124 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:10.124 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:10.124 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 62045 2024-09-12T18:36:10.124 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.124 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:10.124 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.124 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:10.124 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.454028+0000", 2024-09-12T18:36:10.124 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:10.125 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.125 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.125 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:10.125 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.454028+0000", 2024-09-12T18:36:10.125 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:10.125 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.125 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.125 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:10.125 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.454031+0000", 2024-09-12T18:36:10.125 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6240000000000002e-06 2024-09-12T18:36:10.125 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.125 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.125 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:10.125 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.454082+0000", 2024-09-12T18:36:10.126 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1866000000000001e-05 2024-09-12T18:36:10.126 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.126 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.126 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:10.126 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.454091+0000", 2024-09-12T18:36:10.126 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4489999999999999e-06 2024-09-12T18:36:10.126 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.126 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.126 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:10.126 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.454096+0000", 2024-09-12T18:36:10.126 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4369999999999998e-06 2024-09-12T18:36:10.126 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.126 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.127 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:10.127 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.460375+0000", 2024-09-12T18:36:10.127 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.006278863 2024-09-12T18:36:10.127 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.127 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.127 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:10.127 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.460519+0000", 2024-09-12T18:36:10.127 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014404399999999999 2024-09-12T18:36:10.127 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.127 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.127 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:10.127 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.460713+0000", 2024-09-12T18:36:10.127 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000193442 2024-09-12T18:36:10.128 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.128 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.128 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:10.128 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.465478+0000", 2024-09-12T18:36:10.128 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0047649850000000002 2024-09-12T18:36:10.128 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.128 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.128 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:10.128 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.470072+0000", 2024-09-12T18:36:10.128 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00459473 2024-09-12T18:36:10.128 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.128 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.128 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:10.129 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.470131+0000", 2024-09-12T18:36:10.129 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8508000000000003e-05 2024-09-12T18:36:10.129 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:10.129 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:10.129 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:10.129 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.470220+0000", 2024-09-12T18:36:10.129 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8630999999999999e-05 2024-09-12T18:36:10.129 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:10.129 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:10.129 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:10.129 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:10.129 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:10.129 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:10.130 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:36:10.131 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:36:10.131 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:36:10.132 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:36:10.132 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:10.124+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:10.133 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:36:10.231 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:10.224+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:10.282 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:10.283 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:10.301 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:36:10.345 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:10.341+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:10.433 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:10.428+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:10.456 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:10.457 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:10.478 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:36:10.565 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:10.561+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:10.635 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:10.628+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:10.679 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:10.679 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:10.700 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:36:10.741 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:10.737+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:10.837 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:10.833+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:10.855 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:10.855 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:10.871 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 25 16 65061 65045 162.595 132.875 0.00403891 0.00614513 2024-09-12T18:36:10.873 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:36:10.938 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:10.936+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:11.023 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:11.023 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:11.039 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:11.033+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:11.044 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:36:11.140 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:11.133+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:11.237 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:11.238 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:11.241 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:11.236+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:11.257 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:36:11.338 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:36:11.338 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:36:11.338 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-09-12T18:36:11.339 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-12T18:36:11.339 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-12T18:36:11.339 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-09-12T18:36:11.342 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:11.337+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:11.417 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:11.417 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:11.442 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:36:11.443 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:11.436+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:11.500 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:11.500 INFO:teuthology.orchestra.run.smithi143.stdout: "success": "" 2024-09-12T18:36:11.500 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:11.544 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:11.540+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:11.599 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:11.599 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:11.620 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:36:11.664 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:11.660+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:11.745 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:11.740+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:11.813 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:11.814 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:11.833 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:36:11.871 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 26 16 67135 67119 161.327 129.625 0.00817369 0.00619386 2024-09-12T18:36:11.876 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:11.872+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:11.929 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T18:36:11.948 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:11.940+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:11.986 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:11.986 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:12.009 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:36:12.053 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:12.049+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:12.134 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:36:12.149 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:12.144+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:12.161 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:12.161 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:12.182 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:36:12.250 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:12.244+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:12.288 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:36:12.288 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:36:12.307 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:36:12.307 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:36:12.328 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is unset 2024-09-12T18:36:12.329 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:36:12.330 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:36:12.351 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:12.345+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:12.381 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:36:12.381 INFO:teuthology.orchestra.run.smithi162.stdout: "size": 20, 2024-09-12T18:36:12.381 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 600, 2024-09-12T18:36:12.381 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:36:12.381 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.381 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4154.0:123 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:36:12.382 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:36:12.382 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 58.402422371, 2024-09-12T18:36:12.382 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.022398096999999999, 2024-09-12T18:36:12.382 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:12.382 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:12.382 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:12.382 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:12.382 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4154", 2024-09-12T18:36:12.382 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/745129001", 2024-09-12T18:36:12.382 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 123 2024-09-12T18:36:12.382 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.382 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:12.382 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.382 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:12.383 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:36:12.383 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:12.383 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.383 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.383 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:12.383 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:36:12.383 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:12.383 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.384 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.384 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:12.384 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:36:12.384 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.8299999999999996e-07 2024-09-12T18:36:12.384 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.384 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.384 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:12.384 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976528+0000", 2024-09-12T18:36:12.384 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011393299999999999 2024-09-12T18:36:12.384 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.384 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.384 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:12.385 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976539+0000", 2024-09-12T18:36:12.385 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0763e-05 2024-09-12T18:36:12.385 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.385 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.385 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:12.385 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976547+0000", 2024-09-12T18:36:12.385 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8199999999999997e-06 2024-09-12T18:36:12.385 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.385 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.385 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:12.385 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.995057+0000", 2024-09-12T18:36:12.385 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.018510047000000002 2024-09-12T18:36:12.385 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.385 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.386 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:12.386 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.995301+0000", 2024-09-12T18:36:12.386 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00024375899999999999 2024-09-12T18:36:12.386 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.386 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.386 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:12.386 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.995642+0000", 2024-09-12T18:36:12.386 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00034121100000000001 2024-09-12T18:36:12.386 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.386 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.386 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:12.386 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998179+0000", 2024-09-12T18:36:12.387 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00253761 2024-09-12T18:36:12.387 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.387 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.387 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:12.387 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998665+0000", 2024-09-12T18:36:12.387 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00048574600000000001 2024-09-12T18:36:12.387 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.387 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.387 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:12.387 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998739+0000", 2024-09-12T18:36:12.387 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.4286e-05 2024-09-12T18:36:12.388 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.388 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.388 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:12.388 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998812+0000", 2024-09-12T18:36:12.388 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2238999999999997e-05 2024-09-12T18:36:12.388 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:12.388 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:12.388 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:12.388 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.388 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.388 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4154.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:36:12.388 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:36:12.388 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 58.402275138999997, 2024-09-12T18:36:12.389 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025950709999999998, 2024-09-12T18:36:12.389 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:12.389 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:12.389 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:12.389 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:12.389 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4154", 2024-09-12T18:36:12.389 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/745129001", 2024-09-12T18:36:12.389 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 124 2024-09-12T18:36:12.389 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.389 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:12.389 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.389 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:12.390 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:36:12.390 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:12.390 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.390 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.390 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:12.390 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:36:12.390 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:12.390 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.390 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.390 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:12.390 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976562+0000", 2024-09-12T18:36:12.390 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.2999999999999999e-07 2024-09-12T18:36:12.391 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.391 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.391 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:12.391 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976567+0000", 2024-09-12T18:36:12.391 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3430000000000003e-06 2024-09-12T18:36:12.391 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.391 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.391 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:12.391 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976576+0000", 2024-09-12T18:36:12.391 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8070000000000006e-06 2024-09-12T18:36:12.391 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.391 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.391 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:12.392 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976583+0000", 2024-09-12T18:36:12.392 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9959999999999996e-06 2024-09-12T18:36:12.392 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.392 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.392 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:12.392 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997107+0000", 2024-09-12T18:36:12.392 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.020524106 2024-09-12T18:36:12.392 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.392 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.392 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:12.392 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997225+0000", 2024-09-12T18:36:12.392 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000117909 2024-09-12T18:36:12.392 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.393 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.393 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:12.393 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997407+0000", 2024-09-12T18:36:12.393 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00018175900000000001 2024-09-12T18:36:12.393 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.393 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.393 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:12.393 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998839+0000", 2024-09-12T18:36:12.393 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001432539 2024-09-12T18:36:12.393 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.393 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.393 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:12.393 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002319+0000", 2024-09-12T18:36:12.394 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0034803529999999998 2024-09-12T18:36:12.394 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.394 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.394 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:12.394 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002405+0000", 2024-09-12T18:36:12.394 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5434999999999998e-05 2024-09-12T18:36:12.394 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.394 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.394 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:12.394 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002512+0000", 2024-09-12T18:36:12.394 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010663299999999999 2024-09-12T18:36:12.394 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:12.394 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:12.394 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:12.395 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.395 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.395 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:12.395 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:36:12.395 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 46.737477632000001, 2024-09-12T18:36:12.395 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025127867000000002, 2024-09-12T18:36:12.395 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:12.395 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:12.395 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:12.395 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:12.395 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.395 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:12.395 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:36:12.396 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:12.396 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.396 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.396 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:12.396 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:36:12.396 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:12.396 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.396 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.396 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:12.396 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641362+0000", 2024-09-12T18:36:12.396 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.2569999999999999e-06 2024-09-12T18:36:12.396 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.396 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.397 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:12.397 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641374+0000", 2024-09-12T18:36:12.397 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2696e-05 2024-09-12T18:36:12.397 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.397 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.397 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:12.397 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641403+0000", 2024-09-12T18:36:12.397 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.8756999999999999e-05 2024-09-12T18:36:12.397 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.397 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.397 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:12.397 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641430+0000", 2024-09-12T18:36:12.397 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.6452999999999999e-05 2024-09-12T18:36:12.398 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.398 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.398 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:12.398 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641585+0000", 2024-09-12T18:36:12.398 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000155799 2024-09-12T18:36:12.398 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.398 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.398 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:12.398 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641753+0000", 2024-09-12T18:36:12.398 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000167868 2024-09-12T18:36:12.398 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.398 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.398 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:12.399 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641916+0000", 2024-09-12T18:36:12.399 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000162903 2024-09-12T18:36:12.399 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.399 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.399 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:12.399 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653655+0000", 2024-09-12T18:36:12.399 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011738879000000001 2024-09-12T18:36:12.399 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.399 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.399 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:12.399 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665515+0000", 2024-09-12T18:36:12.399 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011859915 2024-09-12T18:36:12.399 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.400 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.400 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:12.400 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665646+0000", 2024-09-12T18:36:12.400 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013122599999999999 2024-09-12T18:36:12.400 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.400 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.400 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:12.400 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666486+0000", 2024-09-12T18:36:12.400 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00084011399999999999 2024-09-12T18:36:12.400 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:12.400 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:12.400 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:12.400 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.401 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.401 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:12.401 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:36:12.401 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 46.737363168999998, 2024-09-12T18:36:12.401 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025384584000000002, 2024-09-12T18:36:12.401 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:12.401 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:12.401 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:12.401 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:12.401 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.401 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:12.401 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:36:12.402 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:12.402 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.402 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.402 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:12.402 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:36:12.402 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:12.402 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.402 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.402 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:12.402 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641474+0000", 2024-09-12T18:36:12.402 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.39e-06 2024-09-12T18:36:12.402 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.402 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.403 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:12.403 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641482+0000", 2024-09-12T18:36:12.403 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3499999999999999e-06 2024-09-12T18:36:12.403 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.403 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.403 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:12.403 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641534+0000", 2024-09-12T18:36:12.403 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2533e-05 2024-09-12T18:36:12.403 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.403 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.403 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:12.403 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641551+0000", 2024-09-12T18:36:12.404 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6515999999999999e-05 2024-09-12T18:36:12.404 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.404 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.404 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:12.404 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642630+0000", 2024-09-12T18:36:12.404 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001079705 2024-09-12T18:36:12.404 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.404 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.404 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:12.404 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642909+0000", 2024-09-12T18:36:12.404 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027859800000000002 2024-09-12T18:36:12.404 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.404 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.405 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:12.405 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643137+0000", 2024-09-12T18:36:12.405 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022803799999999999 2024-09-12T18:36:12.405 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.405 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.405 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:12.405 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653669+0000", 2024-09-12T18:36:12.405 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010532032 2024-09-12T18:36:12.405 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.405 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.405 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:12.405 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666624+0000", 2024-09-12T18:36:12.405 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012954940999999999 2024-09-12T18:36:12.406 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.406 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.406 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:12.406 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666762+0000", 2024-09-12T18:36:12.406 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000137668 2024-09-12T18:36:12.406 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.406 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.406 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:12.406 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666857+0000", 2024-09-12T18:36:12.406 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.5812999999999999e-05 2024-09-12T18:36:12.406 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:12.406 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:12.406 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:12.406 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.407 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.407 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:12.407 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:36:12.407 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 46.737235374000001, 2024-09-12T18:36:12.407 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025661562999999998, 2024-09-12T18:36:12.407 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:12.407 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:12.407 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:12.407 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:12.407 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.407 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:12.408 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:36:12.408 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:12.408 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.408 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.408 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:12.408 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:36:12.408 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:12.408 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.408 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.408 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:12.408 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641602+0000", 2024-09-12T18:36:12.408 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3540000000000001e-06 2024-09-12T18:36:12.409 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.409 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.409 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:12.409 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641637+0000", 2024-09-12T18:36:12.409 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5145999999999999e-05 2024-09-12T18:36:12.409 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.409 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.409 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:12.409 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641659+0000", 2024-09-12T18:36:12.409 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2249999999999999e-05 2024-09-12T18:36:12.409 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.409 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.409 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:12.409 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641675+0000", 2024-09-12T18:36:12.410 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6059999999999999e-05 2024-09-12T18:36:12.410 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.410 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.410 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:12.410 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644570+0000", 2024-09-12T18:36:12.410 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028947069999999998 2024-09-12T18:36:12.410 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.410 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.410 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:12.410 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644900+0000", 2024-09-12T18:36:12.410 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000329401 2024-09-12T18:36:12.410 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.411 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.411 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:12.411 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645235+0000", 2024-09-12T18:36:12.411 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000335874 2024-09-12T18:36:12.411 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.411 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.411 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:12.411 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655459+0000", 2024-09-12T18:36:12.411 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010223441999999999 2024-09-12T18:36:12.411 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.411 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.411 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:12.411 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667028+0000", 2024-09-12T18:36:12.412 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011568673999999999 2024-09-12T18:36:12.412 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.412 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.412 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:12.412 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667163+0000", 2024-09-12T18:36:12.412 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013525500000000001 2024-09-12T18:36:12.412 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.412 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.412 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:12.412 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667262+0000", 2024-09-12T18:36:12.412 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9400000000000004e-05 2024-09-12T18:36:12.413 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:12.413 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:12.413 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:12.413 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.413 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.413 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:12.413 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:36:12.413 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 46.737133554000003, 2024-09-12T18:36:12.413 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025971339, 2024-09-12T18:36:12.413 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:12.413 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:12.413 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:12.414 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:12.414 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.414 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:12.414 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:36:12.414 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:12.414 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.414 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.414 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:12.414 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:36:12.414 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:12.414 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.414 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.414 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:12.415 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641704+0000", 2024-09-12T18:36:12.415 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.297e-06 2024-09-12T18:36:12.415 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.415 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.415 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:12.415 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641712+0000", 2024-09-12T18:36:12.415 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.9060000000000002e-06 2024-09-12T18:36:12.416 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.416 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.416 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:12.416 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641731+0000", 2024-09-12T18:36:12.416 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9083e-05 2024-09-12T18:36:12.416 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.416 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.416 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:12.417 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641745+0000", 2024-09-12T18:36:12.417 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4066999999999999e-05 2024-09-12T18:36:12.417 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.417 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.417 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:12.417 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646529+0000", 2024-09-12T18:36:12.417 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.004784033 2024-09-12T18:36:12.417 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.417 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.417 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:12.417 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646727+0000", 2024-09-12T18:36:12.417 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019841800000000001 2024-09-12T18:36:12.418 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.418 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.418 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:12.418 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647057+0000", 2024-09-12T18:36:12.418 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032926800000000002 2024-09-12T18:36:12.418 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.418 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.418 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:12.418 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655475+0000", 2024-09-12T18:36:12.418 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0084186250000000008 2024-09-12T18:36:12.418 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.418 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.419 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:12.419 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667424+0000", 2024-09-12T18:36:12.419 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011949257 2024-09-12T18:36:12.419 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.419 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.419 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:12.419 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667573+0000", 2024-09-12T18:36:12.419 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014851900000000001 2024-09-12T18:36:12.419 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.419 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.420 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:12.420 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667674+0000", 2024-09-12T18:36:12.420 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010086600000000001 2024-09-12T18:36:12.420 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:12.420 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:12.420 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:12.420 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.420 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.420 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:12.420 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:36:12.421 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 46.737071165000003, 2024-09-12T18:36:12.421 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026215008000000001, 2024-09-12T18:36:12.421 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:12.421 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:12.421 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:12.421 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:12.421 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.421 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:12.421 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:36:12.421 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:12.421 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.422 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.422 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:12.422 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:36:12.422 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:12.422 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.422 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.422 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:12.422 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641766+0000", 2024-09-12T18:36:12.422 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1200000000000001e-06 2024-09-12T18:36:12.422 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.422 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.422 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:12.423 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641775+0000", 2024-09-12T18:36:12.423 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.2499999999999995e-06 2024-09-12T18:36:12.423 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.423 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.423 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:12.423 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641793+0000", 2024-09-12T18:36:12.423 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7773000000000001e-05 2024-09-12T18:36:12.423 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.423 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.423 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:12.423 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641807+0000", 2024-09-12T18:36:12.423 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3814e-05 2024-09-12T18:36:12.423 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.424 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.424 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:12.424 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647626+0000", 2024-09-12T18:36:12.424 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0058193050000000003 2024-09-12T18:36:12.424 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.424 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.424 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:12.424 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647937+0000", 2024-09-12T18:36:12.424 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031112400000000003 2024-09-12T18:36:12.424 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.424 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.424 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:12.425 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648239+0000", 2024-09-12T18:36:12.425 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00030227500000000002 2024-09-12T18:36:12.425 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.425 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.425 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:12.425 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655487+0000", 2024-09-12T18:36:12.425 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072479129999999999 2024-09-12T18:36:12.425 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.425 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.425 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:12.426 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667823+0000", 2024-09-12T18:36:12.426 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012335505 2024-09-12T18:36:12.426 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.426 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.426 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:12.426 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667908+0000", 2024-09-12T18:36:12.426 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4843000000000001e-05 2024-09-12T18:36:12.426 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.426 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.426 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:12.426 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667980+0000", 2024-09-12T18:36:12.426 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2086000000000001e-05 2024-09-12T18:36:12.426 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:12.427 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:12.427 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:12.427 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.427 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.427 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:12.427 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:36:12.427 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 46.737011011999996, 2024-09-12T18:36:12.427 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026483236, 2024-09-12T18:36:12.427 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:12.427 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:12.427 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:12.427 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:12.427 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.428 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:12.428 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:36:12.428 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:12.428 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.428 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.428 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:12.428 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:36:12.428 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:12.428 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.428 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.428 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:12.428 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641826+0000", 2024-09-12T18:36:12.428 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:36:12.429 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.429 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.429 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:12.429 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641832+0000", 2024-09-12T18:36:12.429 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4199999999999998e-06 2024-09-12T18:36:12.429 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.429 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.429 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:12.429 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641848+0000", 2024-09-12T18:36:12.429 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6492999999999999e-05 2024-09-12T18:36:12.429 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.430 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.430 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:12.430 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641863+0000", 2024-09-12T18:36:12.430 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5427e-05 2024-09-12T18:36:12.430 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.430 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.430 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:12.430 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648887+0000", 2024-09-12T18:36:12.430 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0070230860000000004 2024-09-12T18:36:12.430 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.430 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.430 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:12.431 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649111+0000", 2024-09-12T18:36:12.431 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022425799999999999 2024-09-12T18:36:12.431 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.431 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.431 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:12.431 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649494+0000", 2024-09-12T18:36:12.431 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00038349400000000001 2024-09-12T18:36:12.431 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.431 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.431 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:12.431 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655499+0000", 2024-09-12T18:36:12.431 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0060047260000000002 2024-09-12T18:36:12.432 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.432 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.432 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:12.432 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668110+0000", 2024-09-12T18:36:12.432 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012610543 2024-09-12T18:36:12.432 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.432 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.432 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:12.432 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668252+0000", 2024-09-12T18:36:12.432 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014265600000000001 2024-09-12T18:36:12.432 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.433 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.433 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:12.433 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668308+0000", 2024-09-12T18:36:12.433 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5992999999999997e-05 2024-09-12T18:36:12.433 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:12.433 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:12.433 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:12.433 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.433 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.433 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:12.433 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:36:12.433 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 46.736955795999997, 2024-09-12T18:36:12.434 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026605302000000001, 2024-09-12T18:36:12.434 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:12.434 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:12.434 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:12.434 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:12.434 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.434 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:12.434 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:36:12.434 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:12.434 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.434 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.435 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:12.435 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:36:12.435 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:12.435 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.435 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.435 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:12.435 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641881+0000", 2024-09-12T18:36:12.435 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.057e-06 2024-09-12T18:36:12.435 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.435 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.435 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:12.435 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641887+0000", 2024-09-12T18:36:12.435 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.6629999999999998e-06 2024-09-12T18:36:12.436 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.436 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.436 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:12.436 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641903+0000", 2024-09-12T18:36:12.436 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6317e-05 2024-09-12T18:36:12.436 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.436 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.436 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:12.436 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641917+0000", 2024-09-12T18:36:12.436 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3339999999999999e-05 2024-09-12T18:36:12.436 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.436 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.436 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:12.437 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650708+0000", 2024-09-12T18:36:12.437 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.008791419 2024-09-12T18:36:12.437 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.437 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.437 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:12.437 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651021+0000", 2024-09-12T18:36:12.437 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031296699999999999 2024-09-12T18:36:12.437 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.437 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.437 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:12.437 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651349+0000", 2024-09-12T18:36:12.437 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032796499999999999 2024-09-12T18:36:12.437 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.438 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.438 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:12.438 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655742+0000", 2024-09-12T18:36:12.438 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0043934680000000002 2024-09-12T18:36:12.438 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.438 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.438 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:12.438 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668377+0000", 2024-09-12T18:36:12.438 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012634312999999999 2024-09-12T18:36:12.438 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.438 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.438 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:12.439 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668441+0000", 2024-09-12T18:36:12.439 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4369999999999995e-05 2024-09-12T18:36:12.439 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.439 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.439 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:12.439 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668485+0000", 2024-09-12T18:36:12.439 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4422999999999998e-05 2024-09-12T18:36:12.439 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:12.439 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:12.439 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:12.439 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.439 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.439 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:12.440 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:36:12.440 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 46.736898392999997, 2024-09-12T18:36:12.440 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026919499, 2024-09-12T18:36:12.440 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:12.440 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:12.440 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:12.440 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:12.440 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.440 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:12.440 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:36:12.440 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:12.440 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.440 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.441 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:12.441 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:36:12.441 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:12.441 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.441 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.441 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:12.441 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641939+0000", 2024-09-12T18:36:12.441 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9399999999999993e-07 2024-09-12T18:36:12.441 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.441 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.441 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:12.441 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641945+0000", 2024-09-12T18:36:12.441 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9200000000000001e-06 2024-09-12T18:36:12.442 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.442 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.442 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:12.442 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641961+0000", 2024-09-12T18:36:12.442 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6520000000000001e-05 2024-09-12T18:36:12.442 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.442 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.442 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:12.442 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641974+0000", 2024-09-12T18:36:12.442 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3413e-05 2024-09-12T18:36:12.442 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.442 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.442 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:12.442 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654560+0000", 2024-09-12T18:36:12.443 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012585308999999999 2024-09-12T18:36:12.443 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.443 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.443 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:12.443 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654822+0000", 2024-09-12T18:36:12.443 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026210099999999999 2024-09-12T18:36:12.443 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.443 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.443 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:12.443 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655059+0000", 2024-09-12T18:36:12.443 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00023747899999999999 2024-09-12T18:36:12.443 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.443 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.444 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:12.444 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.656315+0000", 2024-09-12T18:36:12.444 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0012555000000000001 2024-09-12T18:36:12.444 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.444 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.444 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:12.444 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668590+0000", 2024-09-12T18:36:12.444 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012274851999999999 2024-09-12T18:36:12.444 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.444 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.444 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:12.444 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668725+0000", 2024-09-12T18:36:12.444 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013524199999999999 2024-09-12T18:36:12.445 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.445 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.445 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:12.445 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668857+0000", 2024-09-12T18:36:12.445 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013216899999999999 2024-09-12T18:36:12.445 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:12.445 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:12.445 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:12.445 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.445 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.445 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:12.446 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:36:12.446 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 46.736844873000003, 2024-09-12T18:36:12.446 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023616723999999999, 2024-09-12T18:36:12.446 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:12.446 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:12.446 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:12.446 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:12.446 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.446 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:12.446 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:36:12.446 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:12.446 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.446 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.447 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:12.447 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:36:12.447 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:12.447 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.447 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.447 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:12.447 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641992+0000", 2024-09-12T18:36:12.447 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.08e-06 2024-09-12T18:36:12.447 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.447 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.447 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:12.447 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641998+0000", 2024-09-12T18:36:12.447 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4299999999999997e-06 2024-09-12T18:36:12.448 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.448 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.448 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:12.448 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642014+0000", 2024-09-12T18:36:12.448 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6266e-05 2024-09-12T18:36:12.448 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.448 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.448 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:12.448 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642026+0000", 2024-09-12T18:36:12.448 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2567e-05 2024-09-12T18:36:12.448 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.448 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.449 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:12.449 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642213+0000", 2024-09-12T18:36:12.449 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00018701899999999999 2024-09-12T18:36:12.449 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.449 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.449 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:12.449 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642507+0000", 2024-09-12T18:36:12.449 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00029394700000000002 2024-09-12T18:36:12.449 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.449 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.449 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:12.449 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642686+0000", 2024-09-12T18:36:12.450 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000178152 2024-09-12T18:36:12.450 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.450 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.450 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:12.450 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650952+0000", 2024-09-12T18:36:12.450 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0082663570000000002 2024-09-12T18:36:12.450 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.450 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.450 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:12.450 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665382+0000", 2024-09-12T18:36:12.450 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.014430111000000001 2024-09-12T18:36:12.450 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.450 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.451 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:12.451 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665508+0000", 2024-09-12T18:36:12.451 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000125986 2024-09-12T18:36:12.451 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.451 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.451 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:12.451 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665608+0000", 2024-09-12T18:36:12.451 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9809000000000006e-05 2024-09-12T18:36:12.451 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:12.451 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:12.451 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:12.451 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.451 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.451 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:12.452 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:36:12.452 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 46.736717007999999, 2024-09-12T18:36:12.452 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024670563, 2024-09-12T18:36:12.452 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:12.452 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:12.452 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:12.452 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:12.452 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.452 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:12.452 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:36:12.452 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:12.452 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.453 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.453 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:12.453 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:36:12.453 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:12.453 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.453 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.453 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:12.453 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642120+0000", 2024-09-12T18:36:12.453 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1769999999999999e-06 2024-09-12T18:36:12.453 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.453 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.453 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:12.453 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642128+0000", 2024-09-12T18:36:12.454 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3429999999999998e-06 2024-09-12T18:36:12.454 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.454 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.454 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:12.454 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642192+0000", 2024-09-12T18:36:12.454 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4406999999999995e-05 2024-09-12T18:36:12.454 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.454 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.454 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:12.454 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642223+0000", 2024-09-12T18:36:12.454 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.1266000000000002e-05 2024-09-12T18:36:12.454 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.455 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.455 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:12.455 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643201+0000", 2024-09-12T18:36:12.455 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0009778390000000001 2024-09-12T18:36:12.455 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.455 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.455 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:12.455 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643410+0000", 2024-09-12T18:36:12.455 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020874199999999999 2024-09-12T18:36:12.455 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.455 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.455 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:12.455 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643685+0000", 2024-09-12T18:36:12.455 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027520700000000002 2024-09-12T18:36:12.456 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.456 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.456 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:12.456 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650966+0000", 2024-09-12T18:36:12.456 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072810710000000001 2024-09-12T18:36:12.456 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.456 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.456 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:12.456 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666560+0000", 2024-09-12T18:36:12.456 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015594143 2024-09-12T18:36:12.456 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.456 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.457 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:12.457 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666691+0000", 2024-09-12T18:36:12.457 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000130359 2024-09-12T18:36:12.457 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.457 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.457 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:12.457 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666790+0000", 2024-09-12T18:36:12.457 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9009e-05 2024-09-12T18:36:12.457 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:12.457 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:12.457 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:12.457 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.457 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.457 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:12.458 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:36:12.458 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 46.73593872, 2024-09-12T18:36:12.458 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024891744, 2024-09-12T18:36:12.458 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:12.458 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:12.458 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:12.458 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:12.458 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.458 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:12.458 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:36:12.458 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:12.458 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.458 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.459 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:12.459 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:36:12.459 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:12.459 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.459 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.459 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:12.459 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642899+0000", 2024-09-12T18:36:12.459 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4729999999999999e-06 2024-09-12T18:36:12.459 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.459 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.459 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:12.459 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642912+0000", 2024-09-12T18:36:12.459 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3495999999999999e-05 2024-09-12T18:36:12.460 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.460 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.460 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:12.460 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642934+0000", 2024-09-12T18:36:12.460 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2033999999999999e-05 2024-09-12T18:36:12.460 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.460 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.460 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:12.460 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642949+0000", 2024-09-12T18:36:12.460 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4970000000000001e-05 2024-09-12T18:36:12.460 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.460 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.460 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:12.461 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644400+0000", 2024-09-12T18:36:12.461 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001450305 2024-09-12T18:36:12.461 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.461 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.461 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:12.461 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644617+0000", 2024-09-12T18:36:12.461 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000217302 2024-09-12T18:36:12.461 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.461 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.461 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:12.461 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645052+0000", 2024-09-12T18:36:12.461 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000434797 2024-09-12T18:36:12.461 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.461 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.462 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:12.462 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653860+0000", 2024-09-12T18:36:12.462 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0088082249999999994 2024-09-12T18:36:12.462 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.462 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.462 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:12.462 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667598+0000", 2024-09-12T18:36:12.462 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.013738451 2024-09-12T18:36:12.462 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.462 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.462 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:12.462 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667698+0000", 2024-09-12T18:36:12.462 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9854999999999999e-05 2024-09-12T18:36:12.463 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.463 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.463 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:12.463 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667789+0000", 2024-09-12T18:36:12.463 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0835999999999996e-05 2024-09-12T18:36:12.463 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:12.463 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:12.463 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:12.463 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.463 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.463 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:30 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:12.463 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:36:12.463 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 46.735863903999999, 2024-09-12T18:36:12.463 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023936852000000002, 2024-09-12T18:36:12.464 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:12.464 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:12.464 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:12.464 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:12.464 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.464 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:12.464 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:36:12.464 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:12.464 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.464 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.464 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:12.464 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:36:12.465 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:12.465 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.465 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.465 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:12.465 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642973+0000", 2024-09-12T18:36:12.465 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.11e-06 2024-09-12T18:36:12.465 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.465 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.465 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:12.465 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642994+0000", 2024-09-12T18:36:12.465 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.0699999999999998e-05 2024-09-12T18:36:12.465 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.465 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.466 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:12.466 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643011+0000", 2024-09-12T18:36:12.466 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7229999999999999e-05 2024-09-12T18:36:12.466 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.466 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.466 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:12.466 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643025+0000", 2024-09-12T18:36:12.466 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3803e-05 2024-09-12T18:36:12.466 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.466 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.467 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:12.467 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643143+0000", 2024-09-12T18:36:12.467 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000118225 2024-09-12T18:36:12.467 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.467 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.467 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:12.467 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643426+0000", 2024-09-12T18:36:12.467 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00028250500000000001 2024-09-12T18:36:12.467 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.468 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.468 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:12.468 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643864+0000", 2024-09-12T18:36:12.468 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00043856 2024-09-12T18:36:12.468 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.468 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.468 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:12.468 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651148+0000", 2024-09-12T18:36:12.468 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072836769999999997 2024-09-12T18:36:12.468 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.468 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.469 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:12.469 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666674+0000", 2024-09-12T18:36:12.469 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015525786999999999 2024-09-12T18:36:12.469 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.469 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.469 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:12.469 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666796+0000", 2024-09-12T18:36:12.469 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000122416 2024-09-12T18:36:12.469 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.469 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.469 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:12.469 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666909+0000", 2024-09-12T18:36:12.469 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011283899999999999 2024-09-12T18:36:12.470 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:12.470 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:12.470 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:12.470 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.470 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.470 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:12.470 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:36:12.470 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 46.735781197999998, 2024-09-12T18:36:12.470 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024100234000000002, 2024-09-12T18:36:12.470 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:12.470 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:12.470 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:12.470 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:12.470 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.471 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:12.471 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:36:12.471 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:12.471 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.471 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.471 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:12.471 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:36:12.471 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:12.471 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.471 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.471 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:12.471 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643056+0000", 2024-09-12T18:36:12.471 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.046e-06 2024-09-12T18:36:12.472 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.472 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.472 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:12.472 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643068+0000", 2024-09-12T18:36:12.472 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2106999999999999e-05 2024-09-12T18:36:12.472 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.472 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.472 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:12.472 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643085+0000", 2024-09-12T18:36:12.472 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7479999999999999e-05 2024-09-12T18:36:12.472 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.472 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.472 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:12.473 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643099+0000", 2024-09-12T18:36:12.473 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3730000000000001e-05 2024-09-12T18:36:12.473 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.473 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.473 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:12.473 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644623+0000", 2024-09-12T18:36:12.473 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0015236080000000001 2024-09-12T18:36:12.473 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.473 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.473 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:12.473 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644893+0000", 2024-09-12T18:36:12.473 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026990500000000003 2024-09-12T18:36:12.473 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.474 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.474 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:12.474 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645227+0000", 2024-09-12T18:36:12.474 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00033391300000000003 2024-09-12T18:36:12.474 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.474 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.474 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:12.474 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653926+0000", 2024-09-12T18:36:12.474 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0086993339999999995 2024-09-12T18:36:12.474 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.475 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.475 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:12.475 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666925+0000", 2024-09-12T18:36:12.475 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012998686000000001 2024-09-12T18:36:12.475 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.475 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.475 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:12.475 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667057+0000", 2024-09-12T18:36:12.475 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013255600000000001 2024-09-12T18:36:12.475 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.475 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.475 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:12.476 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667155+0000", 2024-09-12T18:36:12.476 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7868999999999994e-05 2024-09-12T18:36:12.476 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:12.476 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:12.476 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:12.476 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.476 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.476 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:12.476 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643139+0000", 2024-09-12T18:36:12.476 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 46.735696611999998, 2024-09-12T18:36:12.476 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.022417057000000001, 2024-09-12T18:36:12.476 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:12.477 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:12.477 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:12.477 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:12.477 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.477 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:12.477 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643139+0000", 2024-09-12T18:36:12.477 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:12.477 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.477 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.477 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:12.477 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643139+0000", 2024-09-12T18:36:12.477 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:12.477 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.478 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.478 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:12.478 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643140+0000", 2024-09-12T18:36:12.478 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0729999999999999e-06 2024-09-12T18:36:12.478 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.478 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.478 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:12.478 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643151+0000", 2024-09-12T18:36:12.478 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.039e-05 2024-09-12T18:36:12.478 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.478 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.478 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:12.479 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643168+0000", 2024-09-12T18:36:12.479 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7575999999999999e-05 2024-09-12T18:36:12.479 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.479 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.479 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:12.479 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643182+0000", 2024-09-12T18:36:12.479 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3224000000000001e-05 2024-09-12T18:36:12.479 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.479 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.479 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:12.479 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643358+0000", 2024-09-12T18:36:12.479 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00017676500000000001 2024-09-12T18:36:12.479 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.479 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.480 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:12.480 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643647+0000", 2024-09-12T18:36:12.480 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00028850499999999999 2024-09-12T18:36:12.480 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.480 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.480 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:12.480 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643924+0000", 2024-09-12T18:36:12.480 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000277547 2024-09-12T18:36:12.480 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.480 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.480 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:12.480 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650289+0000", 2024-09-12T18:36:12.480 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0063645350000000002 2024-09-12T18:36:12.480 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.481 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.481 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:12.481 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665333+0000", 2024-09-12T18:36:12.481 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015043531000000001 2024-09-12T18:36:12.481 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.481 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.481 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:12.481 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665454+0000", 2024-09-12T18:36:12.481 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000121302 2024-09-12T18:36:12.481 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.481 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.481 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:12.481 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665556+0000", 2024-09-12T18:36:12.482 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010260900000000001 2024-09-12T18:36:12.482 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:12.482 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:12.482 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:12.482 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.482 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.482 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:12.482 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:36:12.482 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 46.735585409000002, 2024-09-12T18:36:12.482 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024255982999999998, 2024-09-12T18:36:12.482 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:12.482 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:12.482 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:12.482 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:12.483 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.483 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:12.483 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:36:12.483 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:12.483 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.483 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.483 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:12.483 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:36:12.483 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:12.483 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.483 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.483 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:12.483 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643252+0000", 2024-09-12T18:36:12.484 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:12.484 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.484 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.484 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:12.484 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643287+0000", 2024-09-12T18:36:12.484 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5225999999999998e-05 2024-09-12T18:36:12.484 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.484 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.484 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:12.484 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643323+0000", 2024-09-12T18:36:12.484 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5488999999999999e-05 2024-09-12T18:36:12.484 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.484 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.485 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:12.485 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643357+0000", 2024-09-12T18:36:12.485 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.3853999999999998e-05 2024-09-12T18:36:12.485 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.485 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.485 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:12.485 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646716+0000", 2024-09-12T18:36:12.485 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003359 2024-09-12T18:36:12.485 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.485 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.485 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:12.485 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647037+0000", 2024-09-12T18:36:12.485 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032131800000000002 2024-09-12T18:36:12.485 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.486 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.486 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:12.486 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647337+0000", 2024-09-12T18:36:12.486 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000300208 2024-09-12T18:36:12.486 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.486 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.486 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:12.486 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654291+0000", 2024-09-12T18:36:12.486 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0069543089999999997 2024-09-12T18:36:12.486 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.486 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.486 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:12.486 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667297+0000", 2024-09-12T18:36:12.487 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.013005526 2024-09-12T18:36:12.487 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.487 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.487 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:12.487 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667416+0000", 2024-09-12T18:36:12.487 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000119416 2024-09-12T18:36:12.487 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.487 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.487 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:12.487 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667507+0000", 2024-09-12T18:36:12.487 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0206999999999999e-05 2024-09-12T18:36:12.487 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:12.487 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:12.487 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:12.488 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.488 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.488 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:12.488 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:36:12.488 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 46.735458313999999, 2024-09-12T18:36:12.488 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023888482999999999, 2024-09-12T18:36:12.488 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:12.488 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:12.488 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:12.488 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:12.488 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.488 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:12.488 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:36:12.489 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:12.489 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.489 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.489 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:12.489 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:36:12.489 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:12.489 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.489 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.489 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:12.489 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643379+0000", 2024-09-12T18:36:12.489 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.207e-06 2024-09-12T18:36:12.489 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.489 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.490 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:12.490 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643390+0000", 2024-09-12T18:36:12.490 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0696000000000001e-05 2024-09-12T18:36:12.490 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.490 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.490 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:12.490 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643407+0000", 2024-09-12T18:36:12.490 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7563000000000001e-05 2024-09-12T18:36:12.490 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.490 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.490 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:12.490 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643420+0000", 2024-09-12T18:36:12.490 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3277e-05 2024-09-12T18:36:12.490 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.491 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.491 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:12.491 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644906+0000", 2024-09-12T18:36:12.491 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001485945 2024-09-12T18:36:12.491 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.491 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.491 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:12.491 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645404+0000", 2024-09-12T18:36:12.491 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00049807599999999997 2024-09-12T18:36:12.491 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.491 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.491 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:12.491 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645846+0000", 2024-09-12T18:36:12.492 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00044190400000000002 2024-09-12T18:36:12.492 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.492 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.492 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:12.492 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654223+0000", 2024-09-12T18:36:12.492 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0083767419999999995 2024-09-12T18:36:12.492 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.492 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.492 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:12.492 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667026+0000", 2024-09-12T18:36:12.492 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012802531000000001 2024-09-12T18:36:12.492 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.492 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.493 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:12.493 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667162+0000", 2024-09-12T18:36:12.493 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000136112 2024-09-12T18:36:12.493 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.493 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.493 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:12.493 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667266+0000", 2024-09-12T18:36:12.493 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010443 2024-09-12T18:36:12.493 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:12.493 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:12.493 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:12.493 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.493 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.494 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:12.494 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643447+0000", 2024-09-12T18:36:12.494 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 46.735388788000002, 2024-09-12T18:36:12.494 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.022081562999999998, 2024-09-12T18:36:12.494 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:12.494 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:12.494 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:12.494 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:12.494 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.494 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:12.494 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643447+0000", 2024-09-12T18:36:12.494 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:12.494 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.495 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.495 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:12.495 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643447+0000", 2024-09-12T18:36:12.495 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:12.495 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.495 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.495 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:12.495 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643448+0000", 2024-09-12T18:36:12.495 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1629999999999999e-06 2024-09-12T18:36:12.495 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.495 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.495 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:12.495 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643458+0000", 2024-09-12T18:36:12.496 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.8400000000000007e-06 2024-09-12T18:36:12.496 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.496 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.496 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:12.496 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643475+0000", 2024-09-12T18:36:12.496 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6874000000000001e-05 2024-09-12T18:36:12.496 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.496 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.496 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:12.496 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643488+0000", 2024-09-12T18:36:12.496 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3026e-05 2024-09-12T18:36:12.496 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.496 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.497 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:12.497 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643931+0000", 2024-09-12T18:36:12.497 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00044307 2024-09-12T18:36:12.497 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.497 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.497 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:12.497 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644210+0000", 2024-09-12T18:36:12.497 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027908400000000003 2024-09-12T18:36:12.497 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.497 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.497 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:12.497 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644606+0000", 2024-09-12T18:36:12.497 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00039615400000000002 2024-09-12T18:36:12.498 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.498 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.498 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:12.498 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650552+0000", 2024-09-12T18:36:12.498 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0059455619999999997 2024-09-12T18:36:12.498 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.498 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.498 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:12.498 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665302+0000", 2024-09-12T18:36:12.498 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.014749962 2024-09-12T18:36:12.498 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.498 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.498 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:12.498 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665424+0000", 2024-09-12T18:36:12.499 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012214300000000001 2024-09-12T18:36:12.499 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.499 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.499 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:12.499 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665529+0000", 2024-09-12T18:36:12.499 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000104685 2024-09-12T18:36:12.499 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:12.499 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:12.499 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:12.499 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.499 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.499 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:12.499 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:36:12.500 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 46.735307595000002, 2024-09-12T18:36:12.500 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024222582999999999, 2024-09-12T18:36:12.500 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:12.500 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:12.500 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:12.500 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:12.500 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.500 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:12.500 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:36:12.500 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:12.500 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.500 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.500 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:12.500 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:36:12.501 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:12.501 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.501 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.501 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:12.501 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643530+0000", 2024-09-12T18:36:12.501 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.393e-06 2024-09-12T18:36:12.501 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.501 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.501 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:12.501 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643536+0000", 2024-09-12T18:36:12.501 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4130000000000003e-06 2024-09-12T18:36:12.501 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.501 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.502 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:12.502 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643554+0000", 2024-09-12T18:36:12.502 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7572999999999999e-05 2024-09-12T18:36:12.502 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.502 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.502 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:12.502 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643567+0000", 2024-09-12T18:36:12.502 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3393999999999999e-05 2024-09-12T18:36:12.502 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.502 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.502 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:12.502 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648198+0000", 2024-09-12T18:36:12.502 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0046304479999999997 2024-09-12T18:36:12.503 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.503 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.503 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:12.503 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648413+0000", 2024-09-12T18:36:12.503 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00021507500000000001 2024-09-12T18:36:12.503 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:12.503 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:12.503 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:12.503 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667751+0000", 2024-09-12T18:36:12.503 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.019338286999999999 2024-09-12T18:36:12.503 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:12.503 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:12.503 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:12.504 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:12.504 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:12.504 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:36:12.505 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:12.501+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:12.506 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:36:12.606 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:12.600+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:12.654 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:12.654 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:36:12.654 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.655 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:68791 5.6 5:6929f0f4:::benchmark_data_smithi073_23739_object68790:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:36:12.655 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:12.650913+0000", 2024-09-12T18:36:12.655 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0010934429999999999, 2024-09-12T18:36:12.655 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00111911, 2024-09-12T18:36:12.655 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:12.655 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:12.656 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:12.656 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:12.656 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:12.656 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:12.656 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 68791 2024-09-12T18:36:12.656 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.656 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:12.656 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.656 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:12.656 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.650913+0000", 2024-09-12T18:36:12.656 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:12.656 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.656 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.657 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:12.657 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.650913+0000", 2024-09-12T18:36:12.657 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:12.657 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.657 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.657 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:12.657 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.650914+0000", 2024-09-12T18:36:12.657 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0920000000000001e-06 2024-09-12T18:36:12.657 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.657 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.657 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:12.657 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.650989+0000", 2024-09-12T18:36:12.657 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4286e-05 2024-09-12T18:36:12.658 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.658 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.658 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:12.658 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.650996+0000", 2024-09-12T18:36:12.658 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8510000000000001e-06 2024-09-12T18:36:12.658 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.658 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.658 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:12.658 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651000+0000", 2024-09-12T18:36:12.658 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8520000000000003e-06 2024-09-12T18:36:12.658 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.658 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.658 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:12.658 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651034+0000", 2024-09-12T18:36:12.659 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3645000000000001e-05 2024-09-12T18:36:12.659 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.659 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.659 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:12.659 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651124+0000", 2024-09-12T18:36:12.659 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.9831000000000001e-05 2024-09-12T18:36:12.659 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.659 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.659 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:12.659 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651285+0000", 2024-09-12T18:36:12.659 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000160598 2024-09-12T18:36:12.659 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:12.659 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:12.659 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:12.660 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.660 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.660 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:68790 5.e e37/21 5:7a63527e:::benchmark_data_smithi073_23739_object68789:head v 37'4324, mlcod=37'4321)", 2024-09-12T18:36:12.660 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:12.651151+0000", 2024-09-12T18:36:12.660 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00085627399999999997, 2024-09-12T18:36:12.660 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00095062800000000002, 2024-09-12T18:36:12.660 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:12.660 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:12.660 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:12.660 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:12.660 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.660 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:12.660 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651151+0000", 2024-09-12T18:36:12.661 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:12.661 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.661 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.661 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:12.661 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651151+0000", 2024-09-12T18:36:12.661 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:12.661 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.661 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.661 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:12.661 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651151+0000", 2024-09-12T18:36:12.661 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.9099999999999999e-07 2024-09-12T18:36:12.661 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.661 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.662 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:12.662 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651241+0000", 2024-09-12T18:36:12.662 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.9668999999999998e-05 2024-09-12T18:36:12.662 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.662 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.662 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:12.662 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651248+0000", 2024-09-12T18:36:12.662 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3069999999999997e-06 2024-09-12T18:36:12.662 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.662 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.662 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:12.662 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651254+0000", 2024-09-12T18:36:12.662 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6520000000000003e-06 2024-09-12T18:36:12.663 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.663 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.663 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:12.663 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651291+0000", 2024-09-12T18:36:12.663 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.7546000000000003e-05 2024-09-12T18:36:12.663 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.663 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.663 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:12.663 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651308+0000", 2024-09-12T18:36:12.663 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6844999999999999e-05 2024-09-12T18:36:12.663 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:12.663 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:12.663 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:12.663 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.664 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.664 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:68793 5.6 5.db37c796 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:36:12.664 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:12.651121+0000", 2024-09-12T18:36:12.664 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00088548000000000001, 2024-09-12T18:36:12.664 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0010279760000000001, 2024-09-12T18:36:12.664 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:12.664 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:12.664 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:12.664 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:12.664 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:12.664 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:12.664 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 68793 2024-09-12T18:36:12.664 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.665 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:12.665 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.665 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:12.665 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651121+0000", 2024-09-12T18:36:12.665 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:12.665 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.665 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.665 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:12.665 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651121+0000", 2024-09-12T18:36:12.665 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:12.665 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.665 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.666 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:12.666 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651122+0000", 2024-09-12T18:36:12.666 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6899999999999997e-07 2024-09-12T18:36:12.666 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.666 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.666 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:12.666 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651244+0000", 2024-09-12T18:36:12.666 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000121679 2024-09-12T18:36:12.666 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.666 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.666 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:12.666 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651253+0000", 2024-09-12T18:36:12.666 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.0690000000000008e-06 2024-09-12T18:36:12.667 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.667 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.667 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:12.667 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651258+0000", 2024-09-12T18:36:12.667 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4639999999999997e-06 2024-09-12T18:36:12.667 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:12.667 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:12.667 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:12.667 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.667 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.667 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:68796 5.c 5:39b9b6b0:::benchmark_data_smithi073_23739_object68795:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:36:12.667 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:12.651285+0000", 2024-09-12T18:36:12.667 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00072172600000000001, 2024-09-12T18:36:12.668 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000922842, 2024-09-12T18:36:12.668 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:12.668 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:12.668 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:12.668 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:12.668 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:12.668 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:12.668 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 68796 2024-09-12T18:36:12.668 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.668 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:12.668 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.668 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:12.668 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651285+0000", 2024-09-12T18:36:12.668 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:12.669 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.669 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.669 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:12.669 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651285+0000", 2024-09-12T18:36:12.669 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:12.669 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.669 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.669 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:12.669 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651286+0000", 2024-09-12T18:36:12.669 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6300000000000005e-07 2024-09-12T18:36:12.669 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.669 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.670 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:12.670 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651326+0000", 2024-09-12T18:36:12.670 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0618000000000003e-05 2024-09-12T18:36:12.670 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.670 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.670 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:12.670 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651334+0000", 2024-09-12T18:36:12.670 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1040000000000007e-06 2024-09-12T18:36:12.670 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.670 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.670 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:12.670 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651341+0000", 2024-09-12T18:36:12.671 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2709999999999998e-06 2024-09-12T18:36:12.671 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.671 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.671 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:12.671 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651410+0000", 2024-09-12T18:36:12.671 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8794999999999994e-05 2024-09-12T18:36:12.671 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.671 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.671 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:12.671 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651523+0000", 2024-09-12T18:36:12.671 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00011357999999999999 2024-09-12T18:36:12.671 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.671 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.671 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:12.671 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651613+0000", 2024-09-12T18:36:12.672 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.9911e-05 2024-09-12T18:36:12.672 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:12.672 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:12.672 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:12.672 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.672 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.672 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:68797 5.6 5.aa6c0436 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:36:12.672 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:12.651355+0000", 2024-09-12T18:36:12.672 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00065203899999999998, 2024-09-12T18:36:12.672 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00090967700000000001, 2024-09-12T18:36:12.672 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:12.672 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:12.672 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:12.673 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:12.673 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:12.673 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:12.673 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 68797 2024-09-12T18:36:12.673 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.673 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:12.673 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.673 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:12.673 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651355+0000", 2024-09-12T18:36:12.673 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:12.673 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.673 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.673 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:12.674 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651355+0000", 2024-09-12T18:36:12.674 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:12.674 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.674 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.674 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:12.674 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651355+0000", 2024-09-12T18:36:12.674 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1099999999999995e-07 2024-09-12T18:36:12.674 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.674 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.674 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:12.674 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651419+0000", 2024-09-12T18:36:12.674 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3942999999999994e-05 2024-09-12T18:36:12.674 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.674 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.674 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:12.675 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651428+0000", 2024-09-12T18:36:12.675 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.755e-06 2024-09-12T18:36:12.675 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.675 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.675 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:12.675 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651434+0000", 2024-09-12T18:36:12.675 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7799999999999997e-06 2024-09-12T18:36:12.675 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:12.675 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:12.675 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:12.675 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.675 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.675 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:68798 5.3 5:ce7b93c6:::benchmark_data_smithi073_23739_object68797:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:36:12.675 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:12.651444+0000", 2024-09-12T18:36:12.676 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00056294299999999999, 2024-09-12T18:36:12.676 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00086771199999999998, 2024-09-12T18:36:12.676 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:12.676 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:12.676 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:12.676 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:12.676 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:12.676 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:12.676 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 68798 2024-09-12T18:36:12.676 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.676 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:12.676 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.677 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:12.677 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651444+0000", 2024-09-12T18:36:12.677 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:12.677 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.677 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.677 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:12.677 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651444+0000", 2024-09-12T18:36:12.677 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:12.677 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.677 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.677 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:12.678 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651444+0000", 2024-09-12T18:36:12.678 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8100000000000003e-07 2024-09-12T18:36:12.678 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.678 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.678 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:12.678 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651591+0000", 2024-09-12T18:36:12.678 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000146899 2024-09-12T18:36:12.678 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.678 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.678 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:12.678 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651601+0000", 2024-09-12T18:36:12.678 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.5990000000000008e-06 2024-09-12T18:36:12.678 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.679 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.679 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:12.679 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651607+0000", 2024-09-12T18:36:12.679 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8440000000000003e-06 2024-09-12T18:36:12.679 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.679 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.679 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:12.679 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651649+0000", 2024-09-12T18:36:12.679 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2481000000000002e-05 2024-09-12T18:36:12.679 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.679 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.679 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:12.679 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651768+0000", 2024-09-12T18:36:12.680 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000119029 2024-09-12T18:36:12.680 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.680 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.680 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:12.680 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651893+0000", 2024-09-12T18:36:12.680 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012476800000000001 2024-09-12T18:36:12.680 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:12.680 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:12.680 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:12.680 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.680 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.680 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:68795 5.1 e37/21 5:83a62808:::benchmark_data_smithi073_23739_object68794:head v 37'4294, mlcod=37'4292)", 2024-09-12T18:36:12.680 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:12.651912+0000", 2024-09-12T18:36:12.681 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 9.4636000000000007e-05, 2024-09-12T18:36:12.681 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000455103, 2024-09-12T18:36:12.681 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:12.681 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:12.681 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:12.681 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:12.681 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.681 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:12.681 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651912+0000", 2024-09-12T18:36:12.681 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:12.681 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.681 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.681 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:12.682 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651912+0000", 2024-09-12T18:36:12.682 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:12.682 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.682 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.682 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:12.682 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651913+0000", 2024-09-12T18:36:12.682 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.0100000000000005e-07 2024-09-12T18:36:12.682 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.682 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.682 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:12.682 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.651996+0000", 2024-09-12T18:36:12.682 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.3337999999999994e-05 2024-09-12T18:36:12.682 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.683 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.683 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:12.683 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.652007+0000", 2024-09-12T18:36:12.683 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0397000000000001e-05 2024-09-12T18:36:12.683 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.683 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.683 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:12.683 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.652014+0000", 2024-09-12T18:36:12.683 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4749999999999996e-06 2024-09-12T18:36:12.683 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.683 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.683 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:12.684 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.652073+0000", 2024-09-12T18:36:12.684 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8857000000000002e-05 2024-09-12T18:36:12.684 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.684 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.684 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:12.684 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.652091+0000", 2024-09-12T18:36:12.684 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7774e-05 2024-09-12T18:36:12.684 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:12.684 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:12.684 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:12.684 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.684 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.684 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:68799 5.8 e37/21)", 2024-09-12T18:36:12.685 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:12.652037+0000", 2024-09-12T18:36:12.685 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4294967295.99997, 2024-09-12T18:36:12.685 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000378274, 2024-09-12T18:36:12.685 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:12.685 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:12.685 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:12.685 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:12.685 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.685 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:12.685 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.652037+0000", 2024-09-12T18:36:12.685 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:12.685 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.686 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.686 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:12.686 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.652037+0000", 2024-09-12T18:36:12.686 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:12.686 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.686 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.686 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:12.686 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.652037+0000", 2024-09-12T18:36:12.686 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8899999999999999e-07 2024-09-12T18:36:12.686 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.686 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.686 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:12.686 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.652110+0000", 2024-09-12T18:36:12.687 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.2886999999999995e-05 2024-09-12T18:36:12.687 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.687 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.687 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:12.687 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.652121+0000", 2024-09-12T18:36:12.687 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0587e-05 2024-09-12T18:36:12.687 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.687 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.687 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:12.687 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.652149+0000", 2024-09-12T18:36:12.687 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.8107999999999999e-05 2024-09-12T18:36:12.687 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:12.688 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:12.688 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:12.688 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.688 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.688 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:68794 5.4 e37/21 5:2b24404a:::benchmark_data_smithi073_23739_object68793:head v 37'4248, mlcod=37'4246)", 2024-09-12T18:36:12.688 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:12.652216+0000", 2024-09-12T18:36:12.688 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4294967295.9997911, 2024-09-12T18:36:12.688 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00023805399999999999, 2024-09-12T18:36:12.688 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:12.688 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:12.688 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:12.688 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:12.689 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.689 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:12.689 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.652216+0000", 2024-09-12T18:36:12.689 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:12.689 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.689 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.689 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:12.689 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.652216+0000", 2024-09-12T18:36:12.689 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:12.689 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.689 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.689 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:12.689 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.652216+0000", 2024-09-12T18:36:12.690 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.6499999999999999e-07 2024-09-12T18:36:12.690 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.690 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.690 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:12.690 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.652272+0000", 2024-09-12T18:36:12.690 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6134999999999997e-05 2024-09-12T18:36:12.690 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.690 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.690 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:12.690 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.652280+0000", 2024-09-12T18:36:12.690 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3710000000000002e-06 2024-09-12T18:36:12.690 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.690 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.691 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:12.691 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.652285+0000", 2024-09-12T18:36:12.691 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5979999999999996e-06 2024-09-12T18:36:12.691 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.691 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.691 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:12.691 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.652333+0000", 2024-09-12T18:36:12.691 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8278000000000001e-05 2024-09-12T18:36:12.691 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.691 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.691 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:12.691 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.652345+0000", 2024-09-12T18:36:12.691 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1874e-05 2024-09-12T18:36:12.692 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:12.692 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:12.692 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:12.692 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.692 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.692 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:68788 5.e e37/21 5:7f5917d8:::benchmark_data_smithi073_23739_object68787:head v 37'4323, mlcod=37'4319)", 2024-09-12T18:36:12.692 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:12.648470+0000", 2024-09-12T18:36:12.692 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0035371460000000001, 2024-09-12T18:36:12.692 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0040311449999999999, 2024-09-12T18:36:12.692 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:12.692 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:12.692 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:12.692 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:12.693 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.693 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:12.693 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.648470+0000", 2024-09-12T18:36:12.693 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:12.693 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.693 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.693 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:12.693 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.648470+0000", 2024-09-12T18:36:12.693 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:12.693 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.693 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.693 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:12.693 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.648470+0000", 2024-09-12T18:36:12.693 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.7599999999999998e-07 2024-09-12T18:36:12.694 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.694 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.694 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:12.694 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.648495+0000", 2024-09-12T18:36:12.694 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.5187000000000001e-05 2024-09-12T18:36:12.694 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.694 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.694 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:12.694 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.648529+0000", 2024-09-12T18:36:12.694 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3429000000000001e-05 2024-09-12T18:36:12.694 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.694 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.694 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:12.694 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.648534+0000", 2024-09-12T18:36:12.695 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.3569999999999997e-06 2024-09-12T18:36:12.695 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.695 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.695 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:12.695 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.648994+0000", 2024-09-12T18:36:12.695 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00046016699999999999 2024-09-12T18:36:12.695 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:12.695 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:12.695 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:12.695 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.649012+0000", 2024-09-12T18:36:12.695 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7333000000000002e-05 2024-09-12T18:36:12.695 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:12.695 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:12.695 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:12.696 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:12.696 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-12T18:36:12.696 INFO:teuthology.orchestra.run.smithi114.stdout: "num_ops": 10 2024-09-12T18:36:12.696 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:12.697 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:36:12.707 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:12.701+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:12.807 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:12.804+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:12.848 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:12.848 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2024-09-12T18:36:12.849 INFO:teuthology.orchestra.run.smithi114.stdout: "complaint_time": 30, 2024-09-12T18:36:12.849 INFO:teuthology.orchestra.run.smithi114.stdout: "num_blocked_ops": 0 2024-09-12T18:36:12.849 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:12.868 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:36:12.871 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 27 16 69237 69221 160.217 131.375 0.00750717 0.00623664 2024-09-12T18:36:12.912 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:12.908+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:13.009 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:13.004+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:13.062 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:13.062 INFO:teuthology.orchestra.run.smithi114.stdout: "size": 20, 2024-09-12T18:36:13.062 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 600, 2024-09-12T18:36:13.062 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:36:13.062 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.063 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:13.063 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:13.063 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 47.430831507999997, 2024-09-12T18:36:13.063 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.042475618999999999, 2024-09-12T18:36:13.063 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:13.063 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:13.063 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:13.063 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:13.063 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.063 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:13.063 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:13.063 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:13.063 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.064 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.064 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:13.064 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:13.064 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:13.064 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.064 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.064 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:13.064 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628450+0000", 2024-09-12T18:36:13.064 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4212999999999999e-05 2024-09-12T18:36:13.064 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.064 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.065 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:13.065 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628463+0000", 2024-09-12T18:36:13.065 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2497000000000001e-05 2024-09-12T18:36:13.065 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.065 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.066 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:13.066 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628480+0000", 2024-09-12T18:36:13.066 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7232999999999999e-05 2024-09-12T18:36:13.066 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.066 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.066 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.066 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628496+0000", 2024-09-12T18:36:13.066 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6217000000000001e-05 2024-09-12T18:36:13.066 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.066 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.066 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:13.067 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628641+0000", 2024-09-12T18:36:13.067 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000144709 2024-09-12T18:36:13.067 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.067 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.067 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:13.067 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628657+0000", 2024-09-12T18:36:13.067 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6266e-05 2024-09-12T18:36:13.067 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.067 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.068 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:13.068 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663103+0000", 2024-09-12T18:36:13.068 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.034445523999999998 2024-09-12T18:36:13.068 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.068 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.068 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:13.068 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663373+0000", 2024-09-12T18:36:13.068 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00027085500000000002 2024-09-12T18:36:13.068 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.068 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.068 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:13.068 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663634+0000", 2024-09-12T18:36:13.069 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000260855 2024-09-12T18:36:13.069 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.069 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.069 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:13.069 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670294+0000", 2024-09-12T18:36:13.069 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0066597599999999998 2024-09-12T18:36:13.069 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.069 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.069 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:13.069 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670705+0000", 2024-09-12T18:36:13.069 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00041057099999999998 2024-09-12T18:36:13.069 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.069 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.070 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:13.070 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670820+0000", 2024-09-12T18:36:13.070 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000115111 2024-09-12T18:36:13.070 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.070 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.070 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:13.070 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670912+0000", 2024-09-12T18:36:13.070 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1807999999999999e-05 2024-09-12T18:36:13.070 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:13.070 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:13.070 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:13.070 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.070 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.070 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:13.071 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:13.071 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 47.430740761999999, 2024-09-12T18:36:13.071 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.044599273000000002, 2024-09-12T18:36:13.071 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:13.071 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:13.071 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:13.071 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:13.071 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.071 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:13.071 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:13.071 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:13.071 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.071 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.072 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:13.072 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:13.072 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:13.072 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.072 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.072 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:13.072 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628528+0000", 2024-09-12T18:36:13.072 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:13.072 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.072 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.072 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:13.072 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628537+0000", 2024-09-12T18:36:13.072 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6969999999999999e-06 2024-09-12T18:36:13.073 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.073 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.073 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:13.073 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628560+0000", 2024-09-12T18:36:13.073 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2889000000000001e-05 2024-09-12T18:36:13.073 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.073 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.073 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.073 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628576+0000", 2024-09-12T18:36:13.073 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.649e-05 2024-09-12T18:36:13.073 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.073 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.073 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:13.073 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628846+0000", 2024-09-12T18:36:13.074 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00026952500000000001 2024-09-12T18:36:13.074 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.074 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.074 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:13.074 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628853+0000", 2024-09-12T18:36:13.074 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6559999999999992e-06 2024-09-12T18:36:13.074 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.074 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.074 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:13.074 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665284+0000", 2024-09-12T18:36:13.074 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.036431140000000001 2024-09-12T18:36:13.074 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.074 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.074 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:13.075 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665494+0000", 2024-09-12T18:36:13.075 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000209762 2024-09-12T18:36:13.075 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.075 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.075 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:13.075 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665816+0000", 2024-09-12T18:36:13.075 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00032162299999999999 2024-09-12T18:36:13.075 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.075 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.075 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:13.075 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670382+0000", 2024-09-12T18:36:13.075 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0045656739999999996 2024-09-12T18:36:13.075 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.075 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.076 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:13.076 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.672978+0000", 2024-09-12T18:36:13.076 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.002596068 2024-09-12T18:36:13.076 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.076 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.076 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:13.076 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673058+0000", 2024-09-12T18:36:13.076 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0198999999999996e-05 2024-09-12T18:36:13.076 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.076 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.076 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:13.077 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673126+0000", 2024-09-12T18:36:13.077 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8120000000000005e-05 2024-09-12T18:36:13.077 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:13.077 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:13.077 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:13.077 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.077 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.077 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:23 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:13.077 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:13.077 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 47.430642956, 2024-09-12T18:36:13.077 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045539784, 2024-09-12T18:36:13.078 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:13.078 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:13.078 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:13.078 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:13.078 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.078 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:13.078 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:13.078 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:13.078 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.079 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.079 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:13.079 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:13.079 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:13.079 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.079 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.079 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:13.079 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628626+0000", 2024-09-12T18:36:13.079 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.573e-06 2024-09-12T18:36:13.079 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.079 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.079 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:13.080 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628640+0000", 2024-09-12T18:36:13.080 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3817e-05 2024-09-12T18:36:13.080 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.080 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.080 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:13.080 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628659+0000", 2024-09-12T18:36:13.080 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9539999999999999e-05 2024-09-12T18:36:13.080 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.080 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.081 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.081 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628675+0000", 2024-09-12T18:36:13.081 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5739e-05 2024-09-12T18:36:13.081 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.081 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.081 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:13.081 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628815+0000", 2024-09-12T18:36:13.081 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014003299999999999 2024-09-12T18:36:13.081 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.081 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.081 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:13.081 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628828+0000", 2024-09-12T18:36:13.081 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2849e-05 2024-09-12T18:36:13.081 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.082 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.082 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:13.082 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651162+0000", 2024-09-12T18:36:13.082 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.022334228000000001 2024-09-12T18:36:13.082 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.082 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.082 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:13.082 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651446+0000", 2024-09-12T18:36:13.082 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00028392800000000002 2024-09-12T18:36:13.082 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.082 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.082 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:13.082 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651746+0000", 2024-09-12T18:36:13.082 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000300091 2024-09-12T18:36:13.083 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.083 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.083 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:13.083 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665113+0000", 2024-09-12T18:36:13.083 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013366678 2024-09-12T18:36:13.083 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.083 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.083 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:13.083 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674010+0000", 2024-09-12T18:36:13.083 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0088970520000000008 2024-09-12T18:36:13.084 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.084 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.084 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:13.084 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674104+0000", 2024-09-12T18:36:13.084 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4124999999999998e-05 2024-09-12T18:36:13.084 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.084 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.084 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:13.084 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674164+0000", 2024-09-12T18:36:13.084 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.0130999999999997e-05 2024-09-12T18:36:13.084 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:13.084 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:13.084 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:13.084 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.085 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.085 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:26 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:13.085 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:13.085 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 47.430569749999997, 2024-09-12T18:36:13.085 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045702136999999997, 2024-09-12T18:36:13.085 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:13.085 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:13.085 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:13.085 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:13.085 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.085 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:13.086 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:13.086 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:13.086 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.086 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.086 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:13.086 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:13.086 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:13.086 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.086 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.086 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:13.086 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628699+0000", 2024-09-12T18:36:13.087 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3859999999999999e-06 2024-09-12T18:36:13.087 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.087 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.087 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:13.087 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628706+0000", 2024-09-12T18:36:13.087 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0169999999999999e-06 2024-09-12T18:36:13.087 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.087 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.087 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:13.087 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628725+0000", 2024-09-12T18:36:13.087 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8683000000000001e-05 2024-09-12T18:36:13.087 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.087 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.088 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.088 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628740+0000", 2024-09-12T18:36:13.088 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5413999999999998e-05 2024-09-12T18:36:13.088 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.088 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.088 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:13.088 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628907+0000", 2024-09-12T18:36:13.088 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00016670199999999999 2024-09-12T18:36:13.088 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.089 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.089 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:13.089 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628917+0000", 2024-09-12T18:36:13.089 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.046e-05 2024-09-12T18:36:13.089 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.089 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.089 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:13.090 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.660390+0000", 2024-09-12T18:36:13.090 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.031472364000000003 2024-09-12T18:36:13.090 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.090 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.090 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:13.090 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.661767+0000", 2024-09-12T18:36:13.090 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0013769190000000001 2024-09-12T18:36:13.090 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.090 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.090 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:13.090 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.662408+0000", 2024-09-12T18:36:13.090 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00064091099999999998 2024-09-12T18:36:13.090 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.091 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.091 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:13.091 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669577+0000", 2024-09-12T18:36:13.091 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.007169412 2024-09-12T18:36:13.091 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.091 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.091 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:13.091 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674244+0000", 2024-09-12T18:36:13.091 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0046671839999999996 2024-09-12T18:36:13.091 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.091 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.091 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:13.091 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674329+0000", 2024-09-12T18:36:13.091 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5276000000000001e-05 2024-09-12T18:36:13.092 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.092 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.092 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:13.092 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674400+0000", 2024-09-12T18:36:13.092 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0408999999999996e-05 2024-09-12T18:36:13.092 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:13.092 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:13.092 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:13.092 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.092 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.092 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:13.092 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:13.092 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 47.430462081000002, 2024-09-12T18:36:13.093 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.044572443000000003, 2024-09-12T18:36:13.093 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:13.093 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:13.093 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:13.093 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:13.093 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.093 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:13.093 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:13.093 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:13.094 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.094 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.094 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:13.094 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:13.094 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:13.094 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.094 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.094 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:13.094 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628807+0000", 2024-09-12T18:36:13.094 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3629999999999999e-06 2024-09-12T18:36:13.094 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.094 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.094 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:13.094 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628814+0000", 2024-09-12T18:36:13.095 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.2099999999999996e-06 2024-09-12T18:36:13.095 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.095 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.095 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:13.095 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628832+0000", 2024-09-12T18:36:13.095 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7972999999999999e-05 2024-09-12T18:36:13.095 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.095 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.095 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.095 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628854+0000", 2024-09-12T18:36:13.095 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1857000000000001e-05 2024-09-12T18:36:13.095 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.095 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.096 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:13.096 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628984+0000", 2024-09-12T18:36:13.096 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013013599999999999 2024-09-12T18:36:13.096 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.096 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.096 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:13.096 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628993+0000", 2024-09-12T18:36:13.096 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:36:13.096 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.096 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.096 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:13.096 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668176+0000", 2024-09-12T18:36:13.096 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.039182211000000002 2024-09-12T18:36:13.096 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.097 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.097 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:13.097 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668481+0000", 2024-09-12T18:36:13.097 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00030499200000000002 2024-09-12T18:36:13.097 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.097 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.097 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:13.097 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668771+0000", 2024-09-12T18:36:13.097 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00029018700000000002 2024-09-12T18:36:13.097 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.097 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.097 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:13.097 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.672674+0000", 2024-09-12T18:36:13.098 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0039031890000000001 2024-09-12T18:36:13.098 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.098 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.098 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:13.098 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673214+0000", 2024-09-12T18:36:13.098 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00053981600000000004 2024-09-12T18:36:13.098 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.098 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.098 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:13.098 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673310+0000", 2024-09-12T18:36:13.098 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.6682999999999996e-05 2024-09-12T18:36:13.098 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.098 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.098 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:13.099 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673378+0000", 2024-09-12T18:36:13.099 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7385999999999995e-05 2024-09-12T18:36:13.099 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:13.099 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:13.099 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:13.099 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.099 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.099 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:13.099 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:13.099 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 47.430326055000002, 2024-09-12T18:36:13.099 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.041480853999999998, 2024-09-12T18:36:13.099 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:13.099 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:13.099 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:13.100 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:13.100 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.100 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:13.100 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:13.100 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:13.100 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.100 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.100 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:13.100 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:13.100 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:13.100 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.100 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.100 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:13.101 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628943+0000", 2024-09-12T18:36:13.101 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.403e-06 2024-09-12T18:36:13.101 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.101 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.101 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:13.101 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628953+0000", 2024-09-12T18:36:13.101 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0273e-05 2024-09-12T18:36:13.101 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.101 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.101 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:13.101 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628973+0000", 2024-09-12T18:36:13.101 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9959999999999999e-05 2024-09-12T18:36:13.101 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.101 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.102 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.102 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628989+0000", 2024-09-12T18:36:13.102 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6447e-05 2024-09-12T18:36:13.102 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.102 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.102 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:13.102 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629144+0000", 2024-09-12T18:36:13.102 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015468900000000001 2024-09-12T18:36:13.102 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.102 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.102 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:13.102 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629162+0000", 2024-09-12T18:36:13.102 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7603000000000001e-05 2024-09-12T18:36:13.102 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.103 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.103 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:13.103 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.646927+0000", 2024-09-12T18:36:13.103 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.017765626 2024-09-12T18:36:13.103 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.103 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.103 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:13.103 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.647245+0000", 2024-09-12T18:36:13.103 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00031797699999999999 2024-09-12T18:36:13.103 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.103 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.103 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:13.103 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.647551+0000", 2024-09-12T18:36:13.104 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00030583500000000002 2024-09-12T18:36:13.104 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.104 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.104 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:13.104 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651738+0000", 2024-09-12T18:36:13.104 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0041864980000000003 2024-09-12T18:36:13.104 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.104 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.104 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:13.104 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670207+0000", 2024-09-12T18:36:13.104 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018469299000000002 2024-09-12T18:36:13.104 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.104 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.105 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:13.105 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670330+0000", 2024-09-12T18:36:13.105 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012284500000000001 2024-09-12T18:36:13.105 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.105 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.105 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:13.105 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670422+0000", 2024-09-12T18:36:13.105 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2398999999999994e-05 2024-09-12T18:36:13.105 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:13.105 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:13.105 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:13.105 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.105 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.105 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:13.106 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:13.106 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 47.430248802000001, 2024-09-12T18:36:13.106 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.041623741999999998, 2024-09-12T18:36:13.106 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:13.106 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:13.106 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:13.106 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:13.106 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.106 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:13.106 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:13.106 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:13.106 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.106 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.107 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:13.107 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:13.107 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:13.107 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.107 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.107 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:13.107 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629020+0000", 2024-09-12T18:36:13.107 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.15e-06 2024-09-12T18:36:13.107 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.107 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.107 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:13.107 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629023+0000", 2024-09-12T18:36:13.107 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4659999999999999e-06 2024-09-12T18:36:13.107 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.108 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.108 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:13.108 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629037+0000", 2024-09-12T18:36:13.108 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3857e-05 2024-09-12T18:36:13.108 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.108 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.108 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.108 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629062+0000", 2024-09-12T18:36:13.108 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4519999999999999e-05 2024-09-12T18:36:13.108 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.108 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.108 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:13.108 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629253+0000", 2024-09-12T18:36:13.108 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000191335 2024-09-12T18:36:13.109 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.109 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.109 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:13.109 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629266+0000", 2024-09-12T18:36:13.109 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3322999999999999e-05 2024-09-12T18:36:13.109 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.109 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.109 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:13.109 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648331+0000", 2024-09-12T18:36:13.109 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.019065060000000002 2024-09-12T18:36:13.109 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.109 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.109 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:13.110 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.650044+0000", 2024-09-12T18:36:13.110 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017123959999999999 2024-09-12T18:36:13.110 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.110 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.110 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:13.110 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670642+0000", 2024-09-12T18:36:13.110 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.020598635000000001 2024-09-12T18:36:13.110 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:13.110 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:13.110 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:13.110 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.110 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.110 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:13.111 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:13.111 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 47.430145469999999, 2024-09-12T18:36:13.111 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.046431252999999999, 2024-09-12T18:36:13.111 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:13.111 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:13.111 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:13.111 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:13.111 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.111 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:13.111 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:13.111 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:13.111 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.111 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.111 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:13.112 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:13.112 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:13.112 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.112 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.112 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:13.112 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629123+0000", 2024-09-12T18:36:13.112 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0899999999999999e-06 2024-09-12T18:36:13.112 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.112 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.112 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:13.112 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629138+0000", 2024-09-12T18:36:13.112 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4977000000000001e-05 2024-09-12T18:36:13.112 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.113 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.113 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:13.113 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629149+0000", 2024-09-12T18:36:13.113 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1182999999999999e-05 2024-09-12T18:36:13.113 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.113 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.113 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.113 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629157+0000", 2024-09-12T18:36:13.113 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8129999999999996e-06 2024-09-12T18:36:13.113 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.113 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.113 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:13.113 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629223+0000", 2024-09-12T18:36:13.114 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6463000000000004e-05 2024-09-12T18:36:13.114 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.114 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.114 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:13.114 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629230+0000", 2024-09-12T18:36:13.114 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1360000000000002e-06 2024-09-12T18:36:13.114 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.114 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.114 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:13.114 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669605+0000", 2024-09-12T18:36:13.114 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.040375518999999999 2024-09-12T18:36:13.114 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.114 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.114 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:13.115 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669840+0000", 2024-09-12T18:36:13.115 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00023520099999999999 2024-09-12T18:36:13.115 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.115 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.115 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:13.115 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.675553+0000", 2024-09-12T18:36:13.115 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0057128709999999996 2024-09-12T18:36:13.115 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:13.115 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:13.115 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:13.115 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.115 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.116 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:13.116 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:13.116 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 47.430090802999999, 2024-09-12T18:36:13.116 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.037357044999999998, 2024-09-12T18:36:13.116 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:13.116 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:13.116 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:13.116 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:13.116 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.116 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:13.116 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:13.116 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:13.116 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.117 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.117 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:13.117 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:13.117 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:13.117 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.117 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.117 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:13.117 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629178+0000", 2024-09-12T18:36:13.117 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.08e-06 2024-09-12T18:36:13.117 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.117 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.117 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:13.117 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629194+0000", 2024-09-12T18:36:13.117 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5899000000000001e-05 2024-09-12T18:36:13.118 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.118 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.118 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:13.118 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629211+0000", 2024-09-12T18:36:13.118 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7363e-05 2024-09-12T18:36:13.118 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.118 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.118 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.118 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629226+0000", 2024-09-12T18:36:13.118 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4567e-05 2024-09-12T18:36:13.118 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.118 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.118 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:13.119 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629299+0000", 2024-09-12T18:36:13.119 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3910000000000002e-05 2024-09-12T18:36:13.119 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.119 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.119 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:13.119 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629307+0000", 2024-09-12T18:36:13.119 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5299999999999999e-06 2024-09-12T18:36:13.119 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.119 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.119 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:13.119 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648185+0000", 2024-09-12T18:36:13.119 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018878533999999999 2024-09-12T18:36:13.119 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.119 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.120 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:13.120 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.649724+0000", 2024-09-12T18:36:13.120 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001538841 2024-09-12T18:36:13.120 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.120 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.120 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:13.120 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.666534+0000", 2024-09-12T18:36:13.120 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.016809320999999999 2024-09-12T18:36:13.120 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:13.120 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:13.120 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:13.120 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.120 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.121 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:39659 5.3 5:cd2bc06c:::benchmark_data_smithi073_23739_object39658:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:13.121 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:59.582797+0000", 2024-09-12T18:36:13.121 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 13.476470857000001, 2024-09-12T18:36:13.121 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015424513000000001, 2024-09-12T18:36:13.121 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:13.121 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:13.121 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:13.121 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:13.121 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:13.121 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:13.121 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 39659 2024-09-12T18:36:13.121 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.121 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:13.121 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.122 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:13.122 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.582797+0000", 2024-09-12T18:36:13.122 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:13.122 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.122 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.122 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:13.122 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.582797+0000", 2024-09-12T18:36:13.122 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:13.122 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.122 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.122 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:13.122 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.582798+0000", 2024-09-12T18:36:13.122 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3769999999999999e-06 2024-09-12T18:36:13.122 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.123 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.123 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:13.123 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.582885+0000", 2024-09-12T18:36:13.123 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6601999999999995e-05 2024-09-12T18:36:13.123 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.123 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.123 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:13.123 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.582895+0000", 2024-09-12T18:36:13.123 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0232e-05 2024-09-12T18:36:13.123 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.123 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.123 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.123 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.582902+0000", 2024-09-12T18:36:13.123 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0330000000000003e-06 2024-09-12T18:36:13.124 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.124 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.124 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:13.124 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.582966+0000", 2024-09-12T18:36:13.124 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4493999999999996e-05 2024-09-12T18:36:13.124 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.124 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.124 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:13.124 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.583107+0000", 2024-09-12T18:36:13.124 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000140815 2024-09-12T18:36:13.124 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.124 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.124 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:13.125 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.583306+0000", 2024-09-12T18:36:13.125 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000199194 2024-09-12T18:36:13.125 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.125 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.125 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:13.125 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.585942+0000", 2024-09-12T18:36:13.125 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0026352960000000001 2024-09-12T18:36:13.125 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.125 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.125 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:13.125 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.598120+0000", 2024-09-12T18:36:13.125 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012178501 2024-09-12T18:36:13.125 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.126 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.126 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:13.126 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.598182+0000", 2024-09-12T18:36:13.126 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1550999999999994e-05 2024-09-12T18:36:13.126 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.126 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.126 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:13.126 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.598221+0000", 2024-09-12T18:36:13.126 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.9418000000000001e-05 2024-09-12T18:36:13.126 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:13.126 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:13.126 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:13.126 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.126 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.127 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:40507 5.e e30/21 5:729d4bc6:::benchmark_data_smithi073_23739_object40506:head v 30'2528, mlcod=30'2524)", 2024-09-12T18:36:13.127 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:59.950176+0000", 2024-09-12T18:36:13.127 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 13.109091901999999, 2024-09-12T18:36:13.127 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015643424, 2024-09-12T18:36:13.127 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:13.127 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:13.127 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:13.127 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:13.127 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.127 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:13.127 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.950176+0000", 2024-09-12T18:36:13.127 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:13.127 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.128 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.128 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:13.128 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.950176+0000", 2024-09-12T18:36:13.128 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:13.128 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.128 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.128 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:13.128 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.950176+0000", 2024-09-12T18:36:13.128 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2600000000000001e-07 2024-09-12T18:36:13.128 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.128 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.128 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:13.128 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.950234+0000", 2024-09-12T18:36:13.129 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8137000000000003e-05 2024-09-12T18:36:13.129 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.129 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.129 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:13.129 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.950248+0000", 2024-09-12T18:36:13.129 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3981999999999999e-05 2024-09-12T18:36:13.129 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.129 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.129 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.129 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.950256+0000", 2024-09-12T18:36:13.129 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5970000000000003e-06 2024-09-12T18:36:13.129 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.129 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.129 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:13.130 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.950304+0000", 2024-09-12T18:36:13.130 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8111000000000001e-05 2024-09-12T18:36:13.130 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.130 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.130 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:13.130 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.950323+0000", 2024-09-12T18:36:13.130 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9303000000000001e-05 2024-09-12T18:36:13.130 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.130 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.130 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:13.130 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.965795+0000", 2024-09-12T18:36:13.130 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015471238999999999 2024-09-12T18:36:13.130 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.131 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.131 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:13.131 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:59.965819+0000", 2024-09-12T18:36:13.131 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4229000000000001e-05 2024-09-12T18:36:13.131 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:13.131 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:13.131 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:13.131 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.131 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.131 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:53737 5.3 5:c865a65b:::benchmark_data_smithi073_23739_object53736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:36:13.131 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:05.543994+0000", 2024-09-12T18:36:13.131 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 7.515273348, 2024-09-12T18:36:13.131 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015570031999999999, 2024-09-12T18:36:13.131 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:13.132 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:13.132 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:13.132 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:13.132 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:13.132 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:13.132 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 53737 2024-09-12T18:36:13.132 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.132 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:13.132 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.132 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:13.132 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.543994+0000", 2024-09-12T18:36:13.132 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:13.132 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.133 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.133 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:13.133 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.543994+0000", 2024-09-12T18:36:13.133 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:13.133 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.133 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.133 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:13.133 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.543995+0000", 2024-09-12T18:36:13.133 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2099999999999996e-07 2024-09-12T18:36:13.133 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.133 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.133 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:13.133 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.544087+0000", 2024-09-12T18:36:13.133 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2047999999999997e-05 2024-09-12T18:36:13.134 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.134 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.134 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:13.134 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.544096+0000", 2024-09-12T18:36:13.134 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.3640000000000005e-06 2024-09-12T18:36:13.134 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.134 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.134 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.134 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.544102+0000", 2024-09-12T18:36:13.134 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4349999999999996e-06 2024-09-12T18:36:13.134 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.134 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.134 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:13.134 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.550904+0000", 2024-09-12T18:36:13.135 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0068029090000000002 2024-09-12T18:36:13.135 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.135 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.135 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:13.135 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.551008+0000", 2024-09-12T18:36:13.135 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000103084 2024-09-12T18:36:13.135 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.135 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.135 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:13.135 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.551092+0000", 2024-09-12T18:36:13.135 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.4876000000000005e-05 2024-09-12T18:36:13.135 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.136 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.136 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:13.136 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.555976+0000", 2024-09-12T18:36:13.136 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0048837810000000002 2024-09-12T18:36:13.136 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.136 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.136 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:13.136 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.559456+0000", 2024-09-12T18:36:13.136 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0034797059999999999 2024-09-12T18:36:13.136 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.136 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.136 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:13.136 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.559511+0000", 2024-09-12T18:36:13.137 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4880999999999999e-05 2024-09-12T18:36:13.137 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.137 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.137 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:13.137 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:05.559564+0000", 2024-09-12T18:36:13.137 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.3327e-05 2024-09-12T18:36:13.137 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:13.137 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:13.137 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:13.137 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.137 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.137 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:61262 5.3 5:cce3e952:::benchmark_data_smithi073_23739_object61261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:36:13.137 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:09.078701+0000", 2024-09-12T18:36:13.138 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 3.9805659589999998, 2024-09-12T18:36:13.138 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015538290999999999, 2024-09-12T18:36:13.138 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:13.138 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:13.138 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:13.138 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:13.138 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:13.138 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:13.138 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 61262 2024-09-12T18:36:13.138 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.138 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:13.139 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.139 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:13.139 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.078701+0000", 2024-09-12T18:36:13.139 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:13.139 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.139 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.139 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:13.139 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.078701+0000", 2024-09-12T18:36:13.139 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:13.139 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.139 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.139 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:13.139 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.078702+0000", 2024-09-12T18:36:13.140 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.9599999999999998e-07 2024-09-12T18:36:13.140 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.140 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.140 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:13.140 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.078806+0000", 2024-09-12T18:36:13.140 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000103322 2024-09-12T18:36:13.140 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.140 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.140 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:13.140 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.078815+0000", 2024-09-12T18:36:13.140 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4220000000000006e-06 2024-09-12T18:36:13.140 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.140 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.140 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.141 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.078823+0000", 2024-09-12T18:36:13.141 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5850000000000002e-06 2024-09-12T18:36:13.141 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.141 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.141 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:13.141 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.081130+0000", 2024-09-12T18:36:13.141 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.002307314 2024-09-12T18:36:13.141 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.141 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.141 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:13.141 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.081299+0000", 2024-09-12T18:36:13.141 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00016958899999999999 2024-09-12T18:36:13.141 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.142 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.142 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:13.142 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.081429+0000", 2024-09-12T18:36:13.142 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000129892 2024-09-12T18:36:13.142 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.142 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.142 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:13.142 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.086592+0000", 2024-09-12T18:36:13.142 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0051629400000000004 2024-09-12T18:36:13.142 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.142 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.142 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:13.142 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.094083+0000", 2024-09-12T18:36:13.143 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0074906349999999998 2024-09-12T18:36:13.143 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.143 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.143 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:13.143 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.094191+0000", 2024-09-12T18:36:13.143 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000108497 2024-09-12T18:36:13.143 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.143 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.143 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:13.143 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.094240+0000", 2024-09-12T18:36:13.143 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8299e-05 2024-09-12T18:36:13.143 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:13.143 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:13.143 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:13.144 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.144 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.144 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:61561 5.e e35/21 5:715fe5e4:::benchmark_data_smithi073_23739_object61560:head v 35'3863, mlcod=35'3861)", 2024-09-12T18:36:13.144 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:09.220994+0000", 2024-09-12T18:36:13.144 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 3.8382735060000002, 2024-09-12T18:36:13.144 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.017185846000000001, 2024-09-12T18:36:13.144 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:13.144 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:13.144 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:13.144 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:13.144 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.144 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:13.144 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.220994+0000", 2024-09-12T18:36:13.144 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:13.145 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.145 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.145 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:13.145 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.220994+0000", 2024-09-12T18:36:13.145 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:13.145 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.145 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.145 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:13.145 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.220995+0000", 2024-09-12T18:36:13.145 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2799999999999996e-07 2024-09-12T18:36:13.145 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.145 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.145 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:13.145 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.221049+0000", 2024-09-12T18:36:13.146 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4506999999999998e-05 2024-09-12T18:36:13.146 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.146 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.146 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:13.146 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.221057+0000", 2024-09-12T18:36:13.146 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.4290000000000001e-06 2024-09-12T18:36:13.146 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.146 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.146 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.146 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.221063+0000", 2024-09-12T18:36:13.146 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7899999999999996e-06 2024-09-12T18:36:13.146 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.146 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.147 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:13.147 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.221135+0000", 2024-09-12T18:36:13.147 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1268999999999998e-05 2024-09-12T18:36:13.147 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.147 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.147 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:13.147 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.221153+0000", 2024-09-12T18:36:13.147 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8892000000000001e-05 2024-09-12T18:36:13.147 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.147 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.147 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:13.147 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.238141+0000", 2024-09-12T18:36:13.148 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.016988077000000001 2024-09-12T18:36:13.148 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.148 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.148 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:13.148 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.238180+0000", 2024-09-12T18:36:13.148 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8254000000000003e-05 2024-09-12T18:36:13.148 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:13.148 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:13.148 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:13.148 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.149 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.149 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:61578 5.6 5:638c8823:::benchmark_data_smithi073_23739_object61577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:36:13.149 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:09.232201+0000", 2024-09-12T18:36:13.149 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 3.8270660169999999, 2024-09-12T18:36:13.149 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.017140757, 2024-09-12T18:36:13.149 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:13.149 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:13.149 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:13.149 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:13.149 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:13.149 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:13.149 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 61578 2024-09-12T18:36:13.149 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.150 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:13.150 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.150 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:13.150 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.232201+0000", 2024-09-12T18:36:13.150 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:13.150 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.150 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.150 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:13.150 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.232201+0000", 2024-09-12T18:36:13.150 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:13.150 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.150 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.150 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:13.151 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.232202+0000", 2024-09-12T18:36:13.151 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1299999999999998e-07 2024-09-12T18:36:13.151 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.151 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.151 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:13.151 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.232276+0000", 2024-09-12T18:36:13.151 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3298000000000002e-05 2024-09-12T18:36:13.151 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.151 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.151 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:13.151 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.232287+0000", 2024-09-12T18:36:13.151 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1049e-05 2024-09-12T18:36:13.151 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.151 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.152 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.152 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.232293+0000", 2024-09-12T18:36:13.152 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6710000000000002e-06 2024-09-12T18:36:13.152 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.152 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.152 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:13.152 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.238749+0000", 2024-09-12T18:36:13.152 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.006455199 2024-09-12T18:36:13.152 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.152 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.152 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:13.152 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.238868+0000", 2024-09-12T18:36:13.152 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000119651 2024-09-12T18:36:13.153 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.153 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.153 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:13.153 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.239038+0000", 2024-09-12T18:36:13.153 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000169696 2024-09-12T18:36:13.153 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.153 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.153 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:13.153 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.245237+0000", 2024-09-12T18:36:13.153 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0061988169999999997 2024-09-12T18:36:13.153 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.153 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.153 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:13.153 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.249223+0000", 2024-09-12T18:36:13.154 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0039859079999999998 2024-09-12T18:36:13.154 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.154 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.154 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:13.154 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.249288+0000", 2024-09-12T18:36:13.154 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5122000000000004e-05 2024-09-12T18:36:13.154 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.154 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.154 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:13.154 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.249342+0000", 2024-09-12T18:36:13.154 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4432999999999999e-05 2024-09-12T18:36:13.154 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:13.154 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:13.155 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:13.155 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.155 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.155 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:68555 5.a 5:5f01bf96:::benchmark_data_smithi073_23739_object68554:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:36:13.155 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:12.535565+0000", 2024-09-12T18:36:13.155 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.52370195500000005, 2024-09-12T18:36:13.155 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015342761, 2024-09-12T18:36:13.155 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:13.155 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:13.155 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:13.155 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:13.155 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:13.156 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:13.156 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 68555 2024-09-12T18:36:13.156 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.156 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:13.156 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.156 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:13.156 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.535565+0000", 2024-09-12T18:36:13.156 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:13.156 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.156 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.156 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:13.156 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.535565+0000", 2024-09-12T18:36:13.156 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:13.157 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.157 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.157 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:13.157 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.535566+0000", 2024-09-12T18:36:13.157 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.95e-07 2024-09-12T18:36:13.157 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.157 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.157 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:13.157 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.535656+0000", 2024-09-12T18:36:13.157 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.0036000000000003e-05 2024-09-12T18:36:13.157 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.157 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.157 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:13.158 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.535666+0000", 2024-09-12T18:36:13.158 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2040000000000003e-06 2024-09-12T18:36:13.158 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.158 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.158 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.158 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.535671+0000", 2024-09-12T18:36:13.158 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9699999999999998e-06 2024-09-12T18:36:13.158 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.158 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.158 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:13.158 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.538908+0000", 2024-09-12T18:36:13.158 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0032372070000000002 2024-09-12T18:36:13.159 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.159 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.159 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:13.159 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.539015+0000", 2024-09-12T18:36:13.159 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000107019 2024-09-12T18:36:13.159 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.159 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.159 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:13.159 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.539139+0000", 2024-09-12T18:36:13.159 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000123805 2024-09-12T18:36:13.159 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.159 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.160 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:13.160 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.547781+0000", 2024-09-12T18:36:13.160 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.008642172 2024-09-12T18:36:13.160 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.160 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.160 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:13.160 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.550607+0000", 2024-09-12T18:36:13.160 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0028264789999999998 2024-09-12T18:36:13.160 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.160 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.160 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:13.160 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.550865+0000", 2024-09-12T18:36:13.161 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00025740799999999999 2024-09-12T18:36:13.161 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.161 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.161 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:13.161 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.550908+0000", 2024-09-12T18:36:13.161 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3466e-05 2024-09-12T18:36:13.161 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:13.161 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:13.161 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:13.161 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.161 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.161 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:68971 5.3 5:c953bb42:::benchmark_data_smithi073_23739_object68970:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:36:13.161 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:12.733487+0000", 2024-09-12T18:36:13.161 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.32578022400000001, 2024-09-12T18:36:13.162 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.016255100000000001, 2024-09-12T18:36:13.162 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:13.162 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:13.162 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:13.162 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:13.162 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:13.162 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:13.162 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 68971 2024-09-12T18:36:13.162 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.162 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:13.162 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.162 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:13.162 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.733487+0000", 2024-09-12T18:36:13.163 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:13.163 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.163 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.163 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:13.163 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.733487+0000", 2024-09-12T18:36:13.163 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:13.163 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.163 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.163 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:13.163 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.733488+0000", 2024-09-12T18:36:13.163 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6499999999999999e-07 2024-09-12T18:36:13.163 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.163 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.163 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:13.164 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.733605+0000", 2024-09-12T18:36:13.164 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000117496 2024-09-12T18:36:13.164 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.164 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.164 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:13.164 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.733616+0000", 2024-09-12T18:36:13.164 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0351e-05 2024-09-12T18:36:13.164 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.164 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.164 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.164 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.733622+0000", 2024-09-12T18:36:13.164 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7460000000000003e-06 2024-09-12T18:36:13.164 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.165 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.165 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:13.165 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.737237+0000", 2024-09-12T18:36:13.165 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0036150650000000002 2024-09-12T18:36:13.165 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.165 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.165 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:13.165 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.737356+0000", 2024-09-12T18:36:13.165 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000118717 2024-09-12T18:36:13.165 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.165 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.165 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:13.165 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.737501+0000", 2024-09-12T18:36:13.166 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000145153 2024-09-12T18:36:13.166 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.166 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.166 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:13.166 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.739794+0000", 2024-09-12T18:36:13.166 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0022930479999999998 2024-09-12T18:36:13.166 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.166 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.166 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:13.166 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.749633+0000", 2024-09-12T18:36:13.166 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0098388439999999994 2024-09-12T18:36:13.166 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.166 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.166 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:13.167 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.749691+0000", 2024-09-12T18:36:13.167 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7966e-05 2024-09-12T18:36:13.167 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.167 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.167 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:13.167 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.749742+0000", 2024-09-12T18:36:13.167 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1149000000000001e-05 2024-09-12T18:36:13.167 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:13.167 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:13.167 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:13.167 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.167 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.167 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:69221 5.5 5:a8067693:::benchmark_data_smithi073_23739_object69220:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:36:13.168 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:12.862272+0000", 2024-09-12T18:36:13.168 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.19699535800000001, 2024-09-12T18:36:13.168 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015692447000000002, 2024-09-12T18:36:13.168 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:13.168 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:13.168 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:13.168 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:13.168 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:13.168 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:13.168 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 69221 2024-09-12T18:36:13.168 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.168 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:13.168 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.169 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:13.169 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.862272+0000", 2024-09-12T18:36:13.169 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:13.169 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.169 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.169 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:13.169 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.862272+0000", 2024-09-12T18:36:13.169 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:13.169 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.169 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.169 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:13.169 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.862273+0000", 2024-09-12T18:36:13.169 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.243e-06 2024-09-12T18:36:13.170 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.170 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.170 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:13.170 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.862326+0000", 2024-09-12T18:36:13.170 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2942999999999998e-05 2024-09-12T18:36:13.170 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.170 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.170 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:13.170 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.862338+0000", 2024-09-12T18:36:13.170 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1874e-05 2024-09-12T18:36:13.170 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.170 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.170 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.171 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.862345+0000", 2024-09-12T18:36:13.171 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4579999999999998e-06 2024-09-12T18:36:13.171 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.171 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.171 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:13.171 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.862414+0000", 2024-09-12T18:36:13.171 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.9436000000000004e-05 2024-09-12T18:36:13.171 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.171 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.171 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:13.171 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.862653+0000", 2024-09-12T18:36:13.171 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00023874700000000001 2024-09-12T18:36:13.171 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.171 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.172 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:13.172 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.862844+0000", 2024-09-12T18:36:13.172 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00019086400000000001 2024-09-12T18:36:13.172 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.172 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.172 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:13.172 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.865608+0000", 2024-09-12T18:36:13.172 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0027645870000000002 2024-09-12T18:36:13.172 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.172 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.172 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:13.172 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.877883+0000", 2024-09-12T18:36:13.173 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012275035 2024-09-12T18:36:13.173 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.173 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.173 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:13.173 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.877936+0000", 2024-09-12T18:36:13.173 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.3245000000000003e-05 2024-09-12T18:36:13.173 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.173 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.173 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:13.173 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.877964+0000", 2024-09-12T18:36:13.174 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.8014999999999999e-05 2024-09-12T18:36:13.174 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:13.174 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:13.174 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:13.174 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.174 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.174 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:69416 5.0 e37/21 5:023ec417:::benchmark_data_smithi073_23739_object69415:head v 37'4344, mlcod=37'4340)", 2024-09-12T18:36:13.174 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:12.965158+0000", 2024-09-12T18:36:13.174 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.094108971999999999, 2024-09-12T18:36:13.174 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015678377, 2024-09-12T18:36:13.174 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:13.174 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:13.175 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:13.175 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:13.175 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.175 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:13.175 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.965158+0000", 2024-09-12T18:36:13.175 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:13.175 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.175 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.175 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:13.175 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.965158+0000", 2024-09-12T18:36:13.175 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:13.175 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.176 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.176 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:13.176 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.965159+0000", 2024-09-12T18:36:13.176 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.37e-07 2024-09-12T18:36:13.176 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.176 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.176 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:13.176 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.965222+0000", 2024-09-12T18:36:13.176 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3094000000000003e-05 2024-09-12T18:36:13.176 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.176 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.176 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:13.176 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.965230+0000", 2024-09-12T18:36:13.176 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2439999999999993e-06 2024-09-12T18:36:13.177 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.177 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.177 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.177 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.965237+0000", 2024-09-12T18:36:13.177 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1310000000000003e-06 2024-09-12T18:36:13.177 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.177 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.177 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:13.177 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.966036+0000", 2024-09-12T18:36:13.177 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00079909200000000005 2024-09-12T18:36:13.177 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.177 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.177 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:13.178 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.966047+0000", 2024-09-12T18:36:13.178 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1406000000000001e-05 2024-09-12T18:36:13.178 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.178 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.178 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:13.178 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.980807+0000", 2024-09-12T18:36:13.178 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.01476013 2024-09-12T18:36:13.178 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.178 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.178 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:13.178 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.980837+0000", 2024-09-12T18:36:13.178 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.9643000000000001e-05 2024-09-12T18:36:13.178 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:13.179 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:13.179 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:13.179 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.179 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.179 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:69430 5.6 5:672003d5:::benchmark_data_smithi073_23739_object69429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:36:13.179 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:12.970863+0000", 2024-09-12T18:36:13.179 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.088404320999999994, 2024-09-12T18:36:13.179 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015683751999999999, 2024-09-12T18:36:13.179 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:13.179 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:13.179 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:13.179 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:13.179 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:13.179 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:13.179 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 69430 2024-09-12T18:36:13.180 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.180 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:13.180 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.180 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:13.180 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.970863+0000", 2024-09-12T18:36:13.180 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:13.180 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.180 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.180 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:13.180 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.970863+0000", 2024-09-12T18:36:13.180 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:13.180 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.180 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.180 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:13.181 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.970864+0000", 2024-09-12T18:36:13.181 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.2799999999999995e-07 2024-09-12T18:36:13.181 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.181 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.181 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:13.181 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.970968+0000", 2024-09-12T18:36:13.181 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00010467 2024-09-12T18:36:13.181 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.181 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.181 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:13.181 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.970980+0000", 2024-09-12T18:36:13.181 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1209999999999999e-05 2024-09-12T18:36:13.181 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.181 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.182 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.182 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.970986+0000", 2024-09-12T18:36:13.182 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7159999999999997e-06 2024-09-12T18:36:13.182 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.182 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.182 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:13.182 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.974718+0000", 2024-09-12T18:36:13.182 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0037316720000000001 2024-09-12T18:36:13.182 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.182 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.182 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:13.182 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.974852+0000", 2024-09-12T18:36:13.182 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013369799999999999 2024-09-12T18:36:13.182 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.183 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.183 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:13.183 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.974985+0000", 2024-09-12T18:36:13.183 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000132772 2024-09-12T18:36:13.183 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.183 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.183 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:13.183 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.979495+0000", 2024-09-12T18:36:13.183 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0045104940000000003 2024-09-12T18:36:13.183 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.183 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.183 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:13.183 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.986409+0000", 2024-09-12T18:36:13.183 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0069137280000000001 2024-09-12T18:36:13.183 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.183 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.184 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:13.184 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.986493+0000", 2024-09-12T18:36:13.184 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.4421999999999999e-05 2024-09-12T18:36:13.184 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:13.184 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:13.184 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:13.184 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.986547+0000", 2024-09-12T18:36:13.184 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.3641999999999999e-05 2024-09-12T18:36:13.184 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:13.184 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:13.184 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:13.184 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:13.184 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:13.185 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:13.186 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:36:13.187 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:13.180+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:13.287 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:13.280+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:13.347 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:13.348 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:36:13.348 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.348 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:70205 5.0 5.dcb21ee0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:36:13.348 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:13.346171+0000", 2024-09-12T18:36:13.348 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00013143200000000001, 2024-09-12T18:36:13.348 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000151512, 2024-09-12T18:36:13.348 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:13.348 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:13.348 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:13.348 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:13.348 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:13.349 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:13.349 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 70205 2024-09-12T18:36:13.349 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.349 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:13.349 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.349 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:13.349 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.346171+0000", 2024-09-12T18:36:13.349 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.349 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.349 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.350 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:13.350 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.346171+0000", 2024-09-12T18:36:13.350 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.350 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.350 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.350 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:13.350 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.346172+0000", 2024-09-12T18:36:13.350 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8700000000000005e-07 2024-09-12T18:36:13.350 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.350 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.350 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:13.351 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.346269+0000", 2024-09-12T18:36:13.351 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.7579999999999997e-05 2024-09-12T18:36:13.351 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.351 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.351 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:13.351 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.346279+0000", 2024-09-12T18:36:13.351 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.38e-06 2024-09-12T18:36:13.351 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.351 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.351 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.351 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.346285+0000", 2024-09-12T18:36:13.351 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.3899999999999998e-06 2024-09-12T18:36:13.351 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.352 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:13.352 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.352 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.352 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.352 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:70176 5.e 5:71c1d8e1:::benchmark_data_smithi073_23739_object70175:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:36:13.352 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:13.332208+0000", 2024-09-12T18:36:13.352 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.014094354999999999, 2024-09-12T18:36:13.352 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.01416602, 2024-09-12T18:36:13.352 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:13.352 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:13.352 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:13.353 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:13.353 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:13.353 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:13.353 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 70176 2024-09-12T18:36:13.353 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.353 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:13.353 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.353 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:13.353 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.332208+0000", 2024-09-12T18:36:13.353 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.353 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.353 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.353 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:13.353 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.332208+0000", 2024-09-12T18:36:13.354 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.354 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.354 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.354 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:13.354 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.332209+0000", 2024-09-12T18:36:13.354 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9800000000000002e-07 2024-09-12T18:36:13.354 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.354 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.354 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:13.354 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.332304+0000", 2024-09-12T18:36:13.354 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4918000000000002e-05 2024-09-12T18:36:13.354 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.354 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.355 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:13.355 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.332316+0000", 2024-09-12T18:36:13.355 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1994000000000001e-05 2024-09-12T18:36:13.355 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.355 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.355 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.355 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.332323+0000", 2024-09-12T18:36:13.355 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9759999999999998e-06 2024-09-12T18:36:13.355 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.355 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.356 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:13.356 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.334600+0000", 2024-09-12T18:36:13.356 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022775400000000002 2024-09-12T18:36:13.356 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.356 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.356 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:13.356 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.334694+0000", 2024-09-12T18:36:13.356 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4017999999999993e-05 2024-09-12T18:36:13.356 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.356 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.356 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:13.356 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.334796+0000", 2024-09-12T18:36:13.356 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010135499999999999 2024-09-12T18:36:13.357 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.357 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.357 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:13.357 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.339585+0000", 2024-09-12T18:36:13.357 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0047896620000000001 2024-09-12T18:36:13.357 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.357 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:13.358 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.358 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.358 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.358 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(client.4480.0:70196 5.d e37/21)", 2024-09-12T18:36:13.358 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:13.346301+0000", 2024-09-12T18:36:13.358 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.0279999999999999e-06, 2024-09-12T18:36:13.358 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000108236, 2024-09-12T18:36:13.358 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:13.358 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:13.358 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:13.358 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:13.358 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.358 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:13.358 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.346301+0000", 2024-09-12T18:36:13.359 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.359 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.359 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.359 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:13.359 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.346301+0000", 2024-09-12T18:36:13.359 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.359 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.359 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.359 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:13.359 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.346302+0000", 2024-09-12T18:36:13.359 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5699999999999998e-07 2024-09-12T18:36:13.359 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.359 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.359 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:13.360 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.346304+0000", 2024-09-12T18:36:13.360 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4760000000000001e-06 2024-09-12T18:36:13.360 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.360 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.360 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:13.360 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.346312+0000", 2024-09-12T18:36:13.360 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2919999999999998e-06 2024-09-12T18:36:13.360 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.360 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.360 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.360 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.346316+0000", 2024-09-12T18:36:13.360 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6269999999999999e-06 2024-09-12T18:36:13.361 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.361 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:13.361 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.361 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.361 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.361 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:70187 5.4 5:2c56b5b5:::benchmark_data_smithi073_23739_object70186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:36:13.361 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:13.338229+0000", 2024-09-12T18:36:13.361 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0080735790000000009, 2024-09-12T18:36:13.361 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0082064219999999997, 2024-09-12T18:36:13.361 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:13.361 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:13.362 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:13.362 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:13.362 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:13.362 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:13.362 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 70187 2024-09-12T18:36:13.362 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.362 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:13.362 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.362 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:13.362 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.338229+0000", 2024-09-12T18:36:13.363 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.363 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.363 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.363 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:13.363 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.338229+0000", 2024-09-12T18:36:13.363 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.363 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.363 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.363 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:13.363 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.338230+0000", 2024-09-12T18:36:13.363 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6700000000000003e-07 2024-09-12T18:36:13.363 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.364 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.364 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:13.364 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.338327+0000", 2024-09-12T18:36:13.364 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.7397000000000003e-05 2024-09-12T18:36:13.364 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.364 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.364 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:13.364 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.338336+0000", 2024-09-12T18:36:13.365 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8380000000000008e-06 2024-09-12T18:36:13.365 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.365 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.365 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.365 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.338341+0000", 2024-09-12T18:36:13.365 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7849999999999999e-06 2024-09-12T18:36:13.365 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.365 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.365 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:13.365 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.338392+0000", 2024-09-12T18:36:13.366 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1554999999999997e-05 2024-09-12T18:36:13.366 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.366 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.366 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:13.366 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.338470+0000", 2024-09-12T18:36:13.366 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7917000000000006e-05 2024-09-12T18:36:13.366 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.366 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.366 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:13.366 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.338552+0000", 2024-09-12T18:36:13.366 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1669999999999996e-05 2024-09-12T18:36:13.366 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.366 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:13.367 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.367 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.367 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.367 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:70191 5.e 5:7898898e:::benchmark_data_smithi073_23739_object70190:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:36:13.367 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:13.339787+0000", 2024-09-12T18:36:13.367 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0065156620000000002, 2024-09-12T18:36:13.367 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0066846190000000002, 2024-09-12T18:36:13.367 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:13.367 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:13.367 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:13.367 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:13.367 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:13.367 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:13.368 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 70191 2024-09-12T18:36:13.368 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.368 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:13.368 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.368 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:13.368 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.339787+0000", 2024-09-12T18:36:13.368 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.368 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.368 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.368 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:13.368 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.339787+0000", 2024-09-12T18:36:13.368 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.368 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.369 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.369 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:13.369 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.339788+0000", 2024-09-12T18:36:13.369 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0330000000000001e-06 2024-09-12T18:36:13.369 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.369 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.369 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:13.369 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.339830+0000", 2024-09-12T18:36:13.369 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2728000000000002e-05 2024-09-12T18:36:13.369 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.369 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.369 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:13.369 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.339844+0000", 2024-09-12T18:36:13.369 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3097e-05 2024-09-12T18:36:13.370 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.370 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.370 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.370 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.339852+0000", 2024-09-12T18:36:13.370 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4509999999999992e-06 2024-09-12T18:36:13.370 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.370 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.370 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:13.370 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.339897+0000", 2024-09-12T18:36:13.370 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5342000000000001e-05 2024-09-12T18:36:13.370 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.370 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.370 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:13.370 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.339986+0000", 2024-09-12T18:36:13.371 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8352999999999999e-05 2024-09-12T18:36:13.371 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.371 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.371 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:13.371 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.340074+0000", 2024-09-12T18:36:13.371 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8684999999999995e-05 2024-09-12T18:36:13.371 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.371 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:13.371 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.371 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.371 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.371 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:70193 5.e 5:7e6e1121:::benchmark_data_smithi073_23739_object70192:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:36:13.371 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:13.343090+0000", 2024-09-12T18:36:13.372 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0032120180000000001, 2024-09-12T18:36:13.372 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0034153579999999998, 2024-09-12T18:36:13.372 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:13.372 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:13.372 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:13.372 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:13.372 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:13.372 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:13.372 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 70193 2024-09-12T18:36:13.372 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.373 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:13.373 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.373 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:13.373 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.343090+0000", 2024-09-12T18:36:13.373 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.373 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.373 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.373 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:13.373 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.343090+0000", 2024-09-12T18:36:13.373 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.373 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.373 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.374 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:13.374 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.343091+0000", 2024-09-12T18:36:13.374 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4099999999999997e-07 2024-09-12T18:36:13.374 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.374 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.374 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:13.374 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.343177+0000", 2024-09-12T18:36:13.374 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5968000000000001e-05 2024-09-12T18:36:13.374 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.374 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.374 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:13.374 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.343186+0000", 2024-09-12T18:36:13.374 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.1090000000000004e-06 2024-09-12T18:36:13.374 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.375 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.375 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.375 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.343192+0000", 2024-09-12T18:36:13.375 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2170000000000002e-06 2024-09-12T18:36:13.375 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.375 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.375 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:13.375 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.343237+0000", 2024-09-12T18:36:13.375 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5457000000000002e-05 2024-09-12T18:36:13.375 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.375 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.375 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:13.375 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.343314+0000", 2024-09-12T18:36:13.376 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7241000000000001e-05 2024-09-12T18:36:13.376 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.376 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.376 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:13.376 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.343420+0000", 2024-09-12T18:36:13.376 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000105728 2024-09-12T18:36:13.376 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.376 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:13.376 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.376 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.376 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.376 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:70194 5.4 5:2f2370fc:::benchmark_data_smithi073_23739_object70193:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:36:13.376 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:13.343205+0000", 2024-09-12T18:36:13.377 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0030970139999999999, 2024-09-12T18:36:13.377 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033343079999999998, 2024-09-12T18:36:13.377 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:13.377 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:13.377 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:13.377 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:13.377 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:13.377 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:13.377 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 70194 2024-09-12T18:36:13.377 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.377 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:13.377 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.377 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:13.378 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.343205+0000", 2024-09-12T18:36:13.378 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.378 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.378 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.378 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:13.378 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.343205+0000", 2024-09-12T18:36:13.378 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.378 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.378 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.378 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:13.378 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.343206+0000", 2024-09-12T18:36:13.378 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9799999999999999e-07 2024-09-12T18:36:13.378 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.379 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.379 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:13.379 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.343242+0000", 2024-09-12T18:36:13.379 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5781999999999997e-05 2024-09-12T18:36:13.379 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.379 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.379 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:13.379 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.343248+0000", 2024-09-12T18:36:13.379 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1460000000000001e-06 2024-09-12T18:36:13.379 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.379 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.379 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.379 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.343262+0000", 2024-09-12T18:36:13.380 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4365999999999999e-05 2024-09-12T18:36:13.380 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.380 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.380 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:13.380 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.343308+0000", 2024-09-12T18:36:13.380 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5945999999999997e-05 2024-09-12T18:36:13.380 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.380 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.380 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:13.380 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.343438+0000", 2024-09-12T18:36:13.380 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013036499999999999 2024-09-12T18:36:13.380 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.381 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.381 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:13.381 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.343572+0000", 2024-09-12T18:36:13.381 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013330199999999999 2024-09-12T18:36:13.381 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.381 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:13.381 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.381 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.381 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.381 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:70196 5.d 5:b78faf00:::benchmark_data_smithi073_23739_object70195:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:36:13.381 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:13.343275+0000", 2024-09-12T18:36:13.381 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0030269030000000001, 2024-09-12T18:36:13.381 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003300515, 2024-09-12T18:36:13.382 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:13.382 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:13.382 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:13.382 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:13.382 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:13.382 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:13.382 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 70196 2024-09-12T18:36:13.382 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.382 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:13.382 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.382 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:13.382 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.343275+0000", 2024-09-12T18:36:13.383 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.383 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.383 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.383 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:13.383 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.343275+0000", 2024-09-12T18:36:13.383 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.383 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.383 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.383 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:13.383 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.343276+0000", 2024-09-12T18:36:13.383 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0100000000000005e-07 2024-09-12T18:36:13.383 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.383 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.383 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:13.384 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.343346+0000", 2024-09-12T18:36:13.384 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0042000000000005e-05 2024-09-12T18:36:13.384 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.384 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.384 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:13.384 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.343354+0000", 2024-09-12T18:36:13.384 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7379999999999994e-06 2024-09-12T18:36:13.384 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.384 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.384 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.384 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.343360+0000", 2024-09-12T18:36:13.384 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5899999999999996e-06 2024-09-12T18:36:13.384 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.385 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.385 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:13.385 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.343422+0000", 2024-09-12T18:36:13.385 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1637000000000006e-05 2024-09-12T18:36:13.385 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.385 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.385 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:13.385 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.343551+0000", 2024-09-12T18:36:13.385 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000128603 2024-09-12T18:36:13.385 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.385 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.385 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:13.385 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.343696+0000", 2024-09-12T18:36:13.386 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014510799999999999 2024-09-12T18:36:13.386 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.386 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:13.386 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.386 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.386 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.386 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(client.4480.0:70187 5.4 e37/21)", 2024-09-12T18:36:13.386 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:13.343564+0000", 2024-09-12T18:36:13.386 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.002738154, 2024-09-12T18:36:13.386 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0030420680000000002, 2024-09-12T18:36:13.386 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:13.386 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:13.386 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:13.387 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:13.387 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.387 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:13.387 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.343564+0000", 2024-09-12T18:36:13.387 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.387 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.387 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.387 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:13.387 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.343564+0000", 2024-09-12T18:36:13.387 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.387 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.387 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.387 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:13.388 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.343565+0000", 2024-09-12T18:36:13.388 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2399999999999999e-07 2024-09-12T18:36:13.388 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.388 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.388 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:13.388 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.343567+0000", 2024-09-12T18:36:13.388 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5950000000000001e-06 2024-09-12T18:36:13.388 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.388 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.388 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:13.388 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.343574+0000", 2024-09-12T18:36:13.389 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9670000000000004e-06 2024-09-12T18:36:13.389 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.389 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.389 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.389 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.343579+0000", 2024-09-12T18:36:13.389 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9289999999999997e-06 2024-09-12T18:36:13.389 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.389 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:13.389 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.389 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.389 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.389 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:70197 5.0 5:08a352aa:::benchmark_data_smithi073_23739_object70196:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:36:13.390 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:13.343515+0000", 2024-09-12T18:36:13.390 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0027871079999999999, 2024-09-12T18:36:13.390 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031166470000000002, 2024-09-12T18:36:13.390 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:13.390 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:13.390 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:13.390 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:13.390 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:13.390 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:13.390 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 70197 2024-09-12T18:36:13.390 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.390 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:13.390 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.391 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:13.391 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.343515+0000", 2024-09-12T18:36:13.391 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.391 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.391 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.391 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:13.391 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.343515+0000", 2024-09-12T18:36:13.391 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.391 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.391 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.391 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:13.391 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.343516+0000", 2024-09-12T18:36:13.391 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.7000000000000003e-07 2024-09-12T18:36:13.392 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.392 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.392 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:13.392 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.343728+0000", 2024-09-12T18:36:13.392 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021190900000000001 2024-09-12T18:36:13.392 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.392 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.392 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:13.392 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.343737+0000", 2024-09-12T18:36:13.392 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.1589999999999999e-06 2024-09-12T18:36:13.392 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.392 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.393 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.393 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.343744+0000", 2024-09-12T18:36:13.393 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5910000000000001e-06 2024-09-12T18:36:13.393 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.393 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.393 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:13.393 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.343799+0000", 2024-09-12T18:36:13.393 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4700999999999997e-05 2024-09-12T18:36:13.393 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.393 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.393 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:13.393 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.343937+0000", 2024-09-12T18:36:13.393 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013846900000000001 2024-09-12T18:36:13.393 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.394 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.394 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:13.394 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.344087+0000", 2024-09-12T18:36:13.394 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000149837 2024-09-12T18:36:13.394 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.394 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:13.394 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.394 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.394 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.394 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:70198 5.e 5:7c36913e:::benchmark_data_smithi073_23739_object70197:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:36:13.394 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:13.344024+0000", 2024-09-12T18:36:13.394 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0022788309999999998, 2024-09-12T18:36:13.395 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0026419439999999998, 2024-09-12T18:36:13.395 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:13.395 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:13.395 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:13.395 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:13.395 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:13.395 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:13.395 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 70198 2024-09-12T18:36:13.395 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.395 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:13.395 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.395 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:13.395 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.344024+0000", 2024-09-12T18:36:13.395 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.396 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.396 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.396 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:13.396 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.344024+0000", 2024-09-12T18:36:13.396 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.396 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.396 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.396 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:13.396 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.344024+0000", 2024-09-12T18:36:13.396 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4300000000000002e-07 2024-09-12T18:36:13.396 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.396 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.396 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:13.397 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.344100+0000", 2024-09-12T18:36:13.397 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5440999999999998e-05 2024-09-12T18:36:13.397 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.397 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.397 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:13.397 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.344110+0000", 2024-09-12T18:36:13.397 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.7110000000000007e-06 2024-09-12T18:36:13.397 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.397 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.397 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.397 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.344116+0000", 2024-09-12T18:36:13.397 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4350000000000002e-06 2024-09-12T18:36:13.398 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.398 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.398 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:13.398 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.345134+0000", 2024-09-12T18:36:13.398 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0010179430000000001 2024-09-12T18:36:13.398 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.398 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.398 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:13.398 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.345210+0000", 2024-09-12T18:36:13.398 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6316999999999995e-05 2024-09-12T18:36:13.398 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.398 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.398 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:13.398 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.345322+0000", 2024-09-12T18:36:13.399 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000111612 2024-09-12T18:36:13.399 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.399 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:13.399 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.399 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.399 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.399 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(client.4480.0:70172 5.e e37/21)", 2024-09-12T18:36:13.399 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:13.344786+0000", 2024-09-12T18:36:13.399 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0015162000000000001, 2024-09-12T18:36:13.399 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019091589999999999, 2024-09-12T18:36:13.399 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:13.399 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:13.400 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:13.400 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:13.400 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.400 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:13.400 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.344786+0000", 2024-09-12T18:36:13.400 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.400 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.400 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.400 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:13.400 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.344786+0000", 2024-09-12T18:36:13.400 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.400 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.401 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.401 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:13.401 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.344787+0000", 2024-09-12T18:36:13.401 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6899999999999997e-07 2024-09-12T18:36:13.401 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.401 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.401 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:13.401 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.344793+0000", 2024-09-12T18:36:13.401 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8839999999999999e-06 2024-09-12T18:36:13.401 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.401 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.401 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:13.401 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.344808+0000", 2024-09-12T18:36:13.402 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4902000000000001e-05 2024-09-12T18:36:13.402 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.402 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.402 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.402 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.344814+0000", 2024-09-12T18:36:13.402 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.365e-06 2024-09-12T18:36:13.402 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.402 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:13.402 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.402 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.402 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.402 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(client.4480.0:70176 5.e e37/21)", 2024-09-12T18:36:13.402 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:13.344830+0000", 2024-09-12T18:36:13.403 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0014723659999999999, 2024-09-12T18:36:13.403 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001884899, 2024-09-12T18:36:13.403 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:13.403 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:13.403 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:13.403 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:13.403 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.403 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:13.403 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.344830+0000", 2024-09-12T18:36:13.403 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.403 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.403 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.403 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:13.404 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.344830+0000", 2024-09-12T18:36:13.404 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.404 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.404 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.404 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:13.404 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.344830+0000", 2024-09-12T18:36:13.404 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1100000000000002e-07 2024-09-12T18:36:13.404 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.404 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.404 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:13.404 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.344833+0000", 2024-09-12T18:36:13.404 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2390000000000001e-06 2024-09-12T18:36:13.404 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.405 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.405 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:13.405 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.344846+0000", 2024-09-12T18:36:13.405 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3215e-05 2024-09-12T18:36:13.405 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.405 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.405 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.405 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.344853+0000", 2024-09-12T18:36:13.405 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9639999999999997e-06 2024-09-12T18:36:13.405 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.405 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:13.405 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.405 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.406 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.406 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:70172 5.e 5:7d3deeb4:::benchmark_data_smithi073_23739_object70171:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:36:13.406 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:13.331166+0000", 2024-09-12T18:36:13.406 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.015136835, 2024-09-12T18:36:13.406 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015573521, 2024-09-12T18:36:13.406 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:13.406 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:13.406 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:13.406 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:13.406 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:13.406 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:13.406 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 70172 2024-09-12T18:36:13.406 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.407 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:13.407 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.407 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:13.407 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.331166+0000", 2024-09-12T18:36:13.407 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.407 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.407 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.407 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:13.407 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.331166+0000", 2024-09-12T18:36:13.407 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.407 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.407 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.407 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:13.407 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.331166+0000", 2024-09-12T18:36:13.408 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3900000000000004e-07 2024-09-12T18:36:13.408 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.408 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.408 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:13.408 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.331197+0000", 2024-09-12T18:36:13.408 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0320000000000001e-05 2024-09-12T18:36:13.408 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.408 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.408 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:13.408 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.331206+0000", 2024-09-12T18:36:13.408 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9649999999999997e-06 2024-09-12T18:36:13.408 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.408 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.408 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.409 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.331212+0000", 2024-09-12T18:36:13.409 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.3720000000000001e-06 2024-09-12T18:36:13.409 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.409 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.409 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:13.409 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.332742+0000", 2024-09-12T18:36:13.409 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015303039999999999 2024-09-12T18:36:13.409 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.409 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.409 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:13.409 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.332842+0000", 2024-09-12T18:36:13.409 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9313000000000003e-05 2024-09-12T18:36:13.410 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.410 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.410 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:13.410 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.332924+0000", 2024-09-12T18:36:13.410 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2322000000000002e-05 2024-09-12T18:36:13.410 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.410 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.410 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:13.410 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.336928+0000", 2024-09-12T18:36:13.410 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.004003716 2024-09-12T18:36:13.410 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.410 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:13.410 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.411 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.411 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.411 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:70201 5.0 5.556129a0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:36:13.411 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:13.345155+0000", 2024-09-12T18:36:13.411 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.001147361, 2024-09-12T18:36:13.411 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016213460000000001, 2024-09-12T18:36:13.411 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:13.411 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:13.411 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:13.411 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:13.411 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:13.411 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:13.411 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 70201 2024-09-12T18:36:13.411 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.412 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:13.412 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.412 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:13.412 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.345155+0000", 2024-09-12T18:36:13.412 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.412 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.412 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.412 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:13.412 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.345155+0000", 2024-09-12T18:36:13.412 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.412 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.412 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.412 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:13.413 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.345156+0000", 2024-09-12T18:36:13.413 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4900000000000004e-07 2024-09-12T18:36:13.413 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.413 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.413 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:13.413 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.345224+0000", 2024-09-12T18:36:13.413 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7663999999999995e-05 2024-09-12T18:36:13.413 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.413 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.413 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:13.413 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.345234+0000", 2024-09-12T18:36:13.413 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0448000000000001e-05 2024-09-12T18:36:13.413 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.414 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.414 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.414 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.345242+0000", 2024-09-12T18:36:13.414 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7870000000000002e-06 2024-09-12T18:36:13.414 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.414 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:13.414 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.414 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.414 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.414 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:70203 5.b 5:d499c5bd:::benchmark_data_smithi073_23739_object70202:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:36:13.414 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:13.345518+0000", 2024-09-12T18:36:13.414 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00078475799999999998, 2024-09-12T18:36:13.414 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0012850120000000001, 2024-09-12T18:36:13.415 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:13.415 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:13.415 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:13.415 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:13.415 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:13.415 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:13.415 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 70203 2024-09-12T18:36:13.415 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.415 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:13.415 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.415 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:13.415 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.345518+0000", 2024-09-12T18:36:13.415 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.415 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.416 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.416 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:13.416 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.345518+0000", 2024-09-12T18:36:13.416 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.416 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.416 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.416 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:13.416 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.345518+0000", 2024-09-12T18:36:13.416 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3300000000000001e-07 2024-09-12T18:36:13.416 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.416 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.416 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:13.417 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.345607+0000", 2024-09-12T18:36:13.417 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9081999999999999e-05 2024-09-12T18:36:13.417 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.417 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.417 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:13.417 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.345615+0000", 2024-09-12T18:36:13.417 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.8450000000000003e-06 2024-09-12T18:36:13.417 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.417 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.417 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.418 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.345620+0000", 2024-09-12T18:36:13.418 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9259999999999999e-06 2024-09-12T18:36:13.418 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.418 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.418 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:13.418 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.345672+0000", 2024-09-12T18:36:13.418 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1926999999999999e-05 2024-09-12T18:36:13.418 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.418 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.418 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:13.418 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.345794+0000", 2024-09-12T18:36:13.418 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0001215 2024-09-12T18:36:13.418 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.419 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.419 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:13.419 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.345916+0000", 2024-09-12T18:36:13.419 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012209800000000001 2024-09-12T18:36:13.419 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.419 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:13.419 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.419 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.419 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.419 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:70200 5.9 e37/21 5:932c4473:::benchmark_data_smithi073_23739_object70199:head v 37'4343, mlcod=37'4341)", 2024-09-12T18:36:13.419 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:13.345565+0000", 2024-09-12T18:36:13.419 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00073711200000000005, 2024-09-12T18:36:13.419 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0012692070000000001, 2024-09-12T18:36:13.419 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:13.420 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:13.420 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:13.420 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:13.420 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.420 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:13.420 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.345565+0000", 2024-09-12T18:36:13.420 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.420 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.420 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.420 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:13.420 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.345565+0000", 2024-09-12T18:36:13.420 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.421 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.421 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.421 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:13.421 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.345566+0000", 2024-09-12T18:36:13.421 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3599999999999999e-07 2024-09-12T18:36:13.421 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.421 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.421 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:13.421 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.345669+0000", 2024-09-12T18:36:13.421 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000103603 2024-09-12T18:36:13.421 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.421 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.421 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:13.421 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.345675+0000", 2024-09-12T18:36:13.422 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3410000000000002e-06 2024-09-12T18:36:13.422 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.422 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.422 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.422 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.345678+0000", 2024-09-12T18:36:13.422 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4520000000000002e-06 2024-09-12T18:36:13.422 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.422 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.422 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:13.422 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.345726+0000", 2024-09-12T18:36:13.422 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7920000000000002e-05 2024-09-12T18:36:13.422 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.423 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.423 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:13.423 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.345744+0000", 2024-09-12T18:36:13.423 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7807000000000001e-05 2024-09-12T18:36:13.423 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.423 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:13.423 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.423 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.423 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-09-12T18:36:13.423 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 17 2024-09-12T18:36:13.423 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:13.424 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:13.420+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:13.425 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:36:13.525 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:13.520+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:13.619 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:13.619 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-09-12T18:36:13.619 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-09-12T18:36:13.619 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-09-12T18:36:13.620 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:13.626 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:13.620+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:13.641 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:36:13.727 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:13.721+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:13.799 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:13.799 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-09-12T18:36:13.799 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-09-12T18:36:13.799 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:36:13.799 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.799 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:13.800 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:13.800 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 48.164244422000003, 2024-09-12T18:36:13.800 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025088781000000001, 2024-09-12T18:36:13.800 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:13.800 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:13.800 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:13.800 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:13.800 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.800 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:13.800 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:13.800 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.800 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.800 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.801 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:13.801 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:13.801 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.801 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.801 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.801 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:13.801 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632518+0000", 2024-09-12T18:36:13.801 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:36:13.801 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.801 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.801 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:13.801 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632533+0000", 2024-09-12T18:36:13.801 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5130000000000001e-05 2024-09-12T18:36:13.801 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.802 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.802 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:13.802 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632564+0000", 2024-09-12T18:36:13.802 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0788999999999999e-05 2024-09-12T18:36:13.802 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.802 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.802 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.802 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632590+0000", 2024-09-12T18:36:13.802 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6057000000000001e-05 2024-09-12T18:36:13.802 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.802 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.802 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:13.802 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.635931+0000", 2024-09-12T18:36:13.802 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033411320000000001 2024-09-12T18:36:13.803 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.803 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.803 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:13.803 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636186+0000", 2024-09-12T18:36:13.803 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025452500000000002 2024-09-12T18:36:13.803 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.803 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.803 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:13.803 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636445+0000", 2024-09-12T18:36:13.803 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000259268 2024-09-12T18:36:13.803 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.803 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.804 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:13.804 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639562+0000", 2024-09-12T18:36:13.804 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031167 2024-09-12T18:36:13.804 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.804 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.804 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:13.804 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657314+0000", 2024-09-12T18:36:13.804 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017752562 2024-09-12T18:36:13.804 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.804 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.804 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:13.804 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657445+0000", 2024-09-12T18:36:13.804 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013105899999999999 2024-09-12T18:36:13.805 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.805 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.805 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:13.805 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657598+0000", 2024-09-12T18:36:13.805 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015247899999999999 2024-09-12T18:36:13.805 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.805 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:13.805 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.805 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.805 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.805 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:13.805 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:13.805 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 48.164118219000002, 2024-09-12T18:36:13.805 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025643131999999999, 2024-09-12T18:36:13.806 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:13.806 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:13.806 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:13.806 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:13.806 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.806 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:13.806 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:13.806 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.806 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.806 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.806 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:13.806 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:13.806 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.806 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.807 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.807 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:13.807 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632637+0000", 2024-09-12T18:36:13.807 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5600000000000001e-06 2024-09-12T18:36:13.807 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.807 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.807 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:13.807 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632650+0000", 2024-09-12T18:36:13.807 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3186e-05 2024-09-12T18:36:13.807 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.807 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.807 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:13.807 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632672+0000", 2024-09-12T18:36:13.807 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2013000000000001e-05 2024-09-12T18:36:13.808 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.808 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.808 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.808 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632687+0000", 2024-09-12T18:36:13.808 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5109999999999999e-05 2024-09-12T18:36:13.808 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.808 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.808 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:13.808 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636994+0000", 2024-09-12T18:36:13.808 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0043065539999999998 2024-09-12T18:36:13.808 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.808 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.808 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:13.809 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637198+0000", 2024-09-12T18:36:13.809 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020387199999999999 2024-09-12T18:36:13.809 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.809 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.809 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:13.809 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637475+0000", 2024-09-12T18:36:13.809 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027731000000000001 2024-09-12T18:36:13.809 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.809 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.809 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:13.809 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639574+0000", 2024-09-12T18:36:13.809 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020988999999999999 2024-09-12T18:36:13.809 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.809 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.810 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:13.810 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658057+0000", 2024-09-12T18:36:13.810 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018482926 2024-09-12T18:36:13.810 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.810 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.810 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:13.810 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658184+0000", 2024-09-12T18:36:13.810 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012756200000000001 2024-09-12T18:36:13.810 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.810 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.810 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:13.810 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658278+0000", 2024-09-12T18:36:13.810 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4139000000000001e-05 2024-09-12T18:36:13.810 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.811 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:13.811 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.811 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.811 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.811 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:13.811 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:13.811 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 48.164043126999999, 2024-09-12T18:36:13.811 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025238883, 2024-09-12T18:36:13.811 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:13.811 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:13.811 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:13.811 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:13.811 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.811 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:13.811 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:13.812 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.812 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.812 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.812 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:13.812 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:13.812 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.812 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.812 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.812 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:13.812 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632712+0000", 2024-09-12T18:36:13.812 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6869999999999999e-06 2024-09-12T18:36:13.812 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.812 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.812 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:13.813 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632719+0000", 2024-09-12T18:36:13.813 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6059999999999999e-06 2024-09-12T18:36:13.813 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.813 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.813 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:13.813 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632737+0000", 2024-09-12T18:36:13.813 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7983999999999999e-05 2024-09-12T18:36:13.813 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.813 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.813 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.813 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632751+0000", 2024-09-12T18:36:13.813 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4473e-05 2024-09-12T18:36:13.813 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.814 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.814 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:13.814 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636961+0000", 2024-09-12T18:36:13.814 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042100840000000002 2024-09-12T18:36:13.814 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.814 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.814 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:13.814 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637211+0000", 2024-09-12T18:36:13.814 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000249738 2024-09-12T18:36:13.814 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.814 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.814 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:13.814 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637504+0000", 2024-09-12T18:36:13.814 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00029271499999999998 2024-09-12T18:36:13.815 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.815 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.815 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:13.815 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639582+0000", 2024-09-12T18:36:13.815 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020783389999999998 2024-09-12T18:36:13.815 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.815 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.815 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:13.815 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657709+0000", 2024-09-12T18:36:13.815 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018126758999999999 2024-09-12T18:36:13.815 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.815 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.815 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:13.815 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657830+0000", 2024-09-12T18:36:13.816 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000121329 2024-09-12T18:36:13.816 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.816 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.816 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:13.816 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657949+0000", 2024-09-12T18:36:13.816 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000119169 2024-09-12T18:36:13.816 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.816 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:13.816 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.816 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.816 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.816 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:13.816 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:13.816 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 48.163979081000001, 2024-09-12T18:36:13.817 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026711823999999999, 2024-09-12T18:36:13.817 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:13.817 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:13.817 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:13.817 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:13.817 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.817 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:13.817 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:13.817 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.817 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.817 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.817 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:13.817 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:13.818 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.818 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.818 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.818 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:13.818 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632775+0000", 2024-09-12T18:36:13.818 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9999999999999995e-07 2024-09-12T18:36:13.818 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.818 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.818 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:13.818 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632788+0000", 2024-09-12T18:36:13.818 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2629999999999999e-05 2024-09-12T18:36:13.818 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.818 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.818 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:13.819 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632806+0000", 2024-09-12T18:36:13.819 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:36:13.819 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.819 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.819 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.819 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632820+0000", 2024-09-12T18:36:13.819 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3777e-05 2024-09-12T18:36:13.819 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.819 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.819 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:13.819 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638310+0000", 2024-09-12T18:36:13.819 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054898280000000004 2024-09-12T18:36:13.819 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.819 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.820 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:13.820 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638480+0000", 2024-09-12T18:36:13.820 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016968199999999999 2024-09-12T18:36:13.820 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.820 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.820 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:13.820 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638799+0000", 2024-09-12T18:36:13.820 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031915999999999997 2024-09-12T18:36:13.820 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.820 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.820 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:13.820 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639866+0000", 2024-09-12T18:36:13.820 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001067405 2024-09-12T18:36:13.820 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.821 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.821 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:13.821 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658398+0000", 2024-09-12T18:36:13.821 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018531542000000002 2024-09-12T18:36:13.821 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.821 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.821 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:13.821 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658643+0000", 2024-09-12T18:36:13.821 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00024531500000000002 2024-09-12T18:36:13.821 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.821 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.821 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:13.821 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.659486+0000", 2024-09-12T18:36:13.822 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00084316899999999995 2024-09-12T18:36:13.822 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.822 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:13.822 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.822 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.822 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.822 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:13.822 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:36:13.822 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 48.163752019, 2024-09-12T18:36:13.822 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.021357139000000001, 2024-09-12T18:36:13.822 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:13.822 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:13.822 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:13.822 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:13.822 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.823 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:13.823 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:36:13.823 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.823 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.823 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.823 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:13.823 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:36:13.823 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.823 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.823 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.823 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:13.823 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633003+0000", 2024-09-12T18:36:13.823 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.53e-06 2024-09-12T18:36:13.824 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.824 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.824 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:13.824 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633012+0000", 2024-09-12T18:36:13.824 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9290000000000004e-06 2024-09-12T18:36:13.824 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.824 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.824 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:13.824 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633034+0000", 2024-09-12T18:36:13.824 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2127e-05 2024-09-12T18:36:13.824 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.824 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.824 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.825 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633054+0000", 2024-09-12T18:36:13.825 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9476000000000001e-05 2024-09-12T18:36:13.825 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.825 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.825 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:13.825 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636657+0000", 2024-09-12T18:36:13.825 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036038839999999999 2024-09-12T18:36:13.825 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.825 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.825 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:13.825 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636885+0000", 2024-09-12T18:36:13.825 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022798800000000001 2024-09-12T18:36:13.825 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.825 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.825 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:13.826 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637189+0000", 2024-09-12T18:36:13.826 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030392100000000002 2024-09-12T18:36:13.826 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.826 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.826 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:13.826 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639271+0000", 2024-09-12T18:36:13.826 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020817460000000002 2024-09-12T18:36:13.826 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.826 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.826 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:13.826 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.652371+0000", 2024-09-12T18:36:13.826 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013099417 2024-09-12T18:36:13.826 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.826 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.827 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:13.827 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654255+0000", 2024-09-12T18:36:13.827 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018846049999999999 2024-09-12T18:36:13.827 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.827 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.827 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:13.827 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654359+0000", 2024-09-12T18:36:13.827 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000103516 2024-09-12T18:36:13.827 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.827 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:13.827 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.827 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.827 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.828 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:13.828 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:13.828 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 48.163670326999998, 2024-09-12T18:36:13.828 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026938645000000001, 2024-09-12T18:36:13.828 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:13.828 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:13.828 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:13.828 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:13.828 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.828 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:13.828 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:13.828 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.828 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.829 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.829 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:13.829 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:13.829 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.829 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.829 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.829 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:13.829 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633085+0000", 2024-09-12T18:36:13.829 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:13.829 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.829 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.829 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:13.829 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633093+0000", 2024-09-12T18:36:13.830 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3999999999999992e-06 2024-09-12T18:36:13.830 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.830 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.830 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:13.830 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633111+0000", 2024-09-12T18:36:13.830 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8070000000000001e-05 2024-09-12T18:36:13.830 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.830 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.830 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.830 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633126+0000", 2024-09-12T18:36:13.830 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4487e-05 2024-09-12T18:36:13.830 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.830 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.830 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:13.831 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638290+0000", 2024-09-12T18:36:13.831 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0051640269999999999 2024-09-12T18:36:13.831 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.831 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.831 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:13.831 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638547+0000", 2024-09-12T18:36:13.831 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025714100000000001 2024-09-12T18:36:13.831 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.831 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.831 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:13.831 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638850+0000", 2024-09-12T18:36:13.831 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030278400000000001 2024-09-12T18:36:13.831 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.831 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.832 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:13.832 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.640706+0000", 2024-09-12T18:36:13.832 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018564580000000001 2024-09-12T18:36:13.832 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.832 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.832 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:13.832 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658420+0000", 2024-09-12T18:36:13.832 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017714395000000001 2024-09-12T18:36:13.832 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.832 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.832 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:13.832 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658635+0000", 2024-09-12T18:36:13.832 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021413500000000001 2024-09-12T18:36:13.833 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.833 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.833 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:13.833 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.660022+0000", 2024-09-12T18:36:13.833 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001387318 2024-09-12T18:36:13.833 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.833 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:13.833 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.833 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.833 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.833 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:13.833 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:36:13.833 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 48.163325815999997, 2024-09-12T18:36:13.833 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.020709867, 2024-09-12T18:36:13.834 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:13.834 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:13.834 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:13.834 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:13.834 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.834 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:13.834 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:36:13.834 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.834 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.834 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.834 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:13.834 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:36:13.834 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.834 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.835 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.835 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:13.835 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633429+0000", 2024-09-12T18:36:13.835 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.313e-06 2024-09-12T18:36:13.835 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.835 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.835 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:13.835 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633462+0000", 2024-09-12T18:36:13.835 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3197000000000001e-05 2024-09-12T18:36:13.835 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.835 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.835 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:13.836 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633485+0000", 2024-09-12T18:36:13.836 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3243000000000001e-05 2024-09-12T18:36:13.836 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.836 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.836 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.836 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633501+0000", 2024-09-12T18:36:13.836 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5383000000000002e-05 2024-09-12T18:36:13.836 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.836 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.836 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:13.836 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633642+0000", 2024-09-12T18:36:13.836 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000141168 2024-09-12T18:36:13.836 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.837 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.837 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:13.837 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633982+0000", 2024-09-12T18:36:13.837 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000340067 2024-09-12T18:36:13.837 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.837 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.837 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:13.837 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654138+0000", 2024-09-12T18:36:13.837 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.020155495999999998 2024-09-12T18:36:13.837 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.837 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:13.837 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.837 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.838 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.838 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:40507 5.e 5:729d4bc6:::benchmark_data_smithi073_23739_object40506:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:13.838 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:59.951281+0000", 2024-09-12T18:36:13.838 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 13.845472730000001, 2024-09-12T18:36:13.838 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016604759, 2024-09-12T18:36:13.838 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:13.838 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:13.838 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:13.838 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:13.838 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:13.838 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:13.838 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 40507 2024-09-12T18:36:13.838 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.839 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:13.839 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.839 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:13.839 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951281+0000", 2024-09-12T18:36:13.839 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.839 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.839 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.839 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:13.839 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951281+0000", 2024-09-12T18:36:13.839 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.839 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.839 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.839 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:13.839 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951282+0000", 2024-09-12T18:36:13.840 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7599999999999996e-07 2024-09-12T18:36:13.840 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.840 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.840 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:13.840 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951390+0000", 2024-09-12T18:36:13.840 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000108075 2024-09-12T18:36:13.840 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.840 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.840 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:13.840 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951425+0000", 2024-09-12T18:36:13.840 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5765000000000001e-05 2024-09-12T18:36:13.840 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.840 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.841 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.841 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951435+0000", 2024-09-12T18:36:13.841 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:36:13.841 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.841 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.841 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:13.841 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951505+0000", 2024-09-12T18:36:13.841 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0655999999999996e-05 2024-09-12T18:36:13.841 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.841 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.841 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:13.841 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951663+0000", 2024-09-12T18:36:13.841 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015736799999999999 2024-09-12T18:36:13.842 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.842 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.842 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:13.842 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951812+0000", 2024-09-12T18:36:13.842 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014943000000000001 2024-09-12T18:36:13.842 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.842 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.842 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:13.842 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.953812+0000", 2024-09-12T18:36:13.842 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001999781 2024-09-12T18:36:13.842 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.842 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.842 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:13.843 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.967782+0000", 2024-09-12T18:36:13.843 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013969472 2024-09-12T18:36:13.843 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.843 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.843 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:13.843 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.967839+0000", 2024-09-12T18:36:13.843 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7278999999999998e-05 2024-09-12T18:36:13.843 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.843 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.843 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:13.843 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.967886+0000", 2024-09-12T18:36:13.843 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6717e-05 2024-09-12T18:36:13.843 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.844 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:13.844 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.844 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.844 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.844 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:40639 5.8 5:16bd0f48:::benchmark_data_smithi073_23739_object40638:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:13.844 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:00.010888+0000", 2024-09-12T18:36:13.844 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 13.785865405999999, 2024-09-12T18:36:13.844 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017069808999999998, 2024-09-12T18:36:13.844 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:13.844 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:13.844 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:13.844 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:13.845 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:13.845 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:13.845 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 40639 2024-09-12T18:36:13.845 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.845 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:13.845 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.845 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:13.845 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010888+0000", 2024-09-12T18:36:13.845 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.845 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.845 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.845 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:13.846 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010888+0000", 2024-09-12T18:36:13.846 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.846 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.846 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.846 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:13.846 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010889+0000", 2024-09-12T18:36:13.846 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.004e-06 2024-09-12T18:36:13.846 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.846 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.847 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:13.847 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010921+0000", 2024-09-12T18:36:13.847 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1745000000000002e-05 2024-09-12T18:36:13.847 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.847 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.847 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:13.847 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010933+0000", 2024-09-12T18:36:13.847 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2476999999999999e-05 2024-09-12T18:36:13.847 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.847 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.847 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.847 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010941+0000", 2024-09-12T18:36:13.848 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1810000000000004e-06 2024-09-12T18:36:13.848 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.848 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.848 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:13.848 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.019947+0000", 2024-09-12T18:36:13.848 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0090069190000000004 2024-09-12T18:36:13.848 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.848 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.848 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:13.848 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.020062+0000", 2024-09-12T18:36:13.848 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000114851 2024-09-12T18:36:13.849 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.849 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.849 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:13.849 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.020148+0000", 2024-09-12T18:36:13.849 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5579000000000002e-05 2024-09-12T18:36:13.849 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.849 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.849 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:13.849 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.026347+0000", 2024-09-12T18:36:13.849 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0061988820000000002 2024-09-12T18:36:13.849 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.849 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.849 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:13.849 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.027866+0000", 2024-09-12T18:36:13.850 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015197190000000001 2024-09-12T18:36:13.850 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.850 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.850 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:13.850 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.027914+0000", 2024-09-12T18:36:13.850 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8009000000000001e-05 2024-09-12T18:36:13.850 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.850 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.850 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:13.850 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.027958+0000", 2024-09-12T18:36:13.850 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3442999999999997e-05 2024-09-12T18:36:13.850 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.850 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:13.851 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.851 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.851 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.851 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:40642 5.0 5:015ece55:::benchmark_data_smithi073_23739_object40641:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:13.851 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:00.011626+0000", 2024-09-12T18:36:13.851 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 13.785127577000001, 2024-09-12T18:36:13.851 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016593251, 2024-09-12T18:36:13.851 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:13.851 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:13.851 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:13.851 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:13.851 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:13.851 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:13.851 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 40642 2024-09-12T18:36:13.852 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.852 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:13.852 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.852 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:13.852 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.011626+0000", 2024-09-12T18:36:13.852 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.852 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.852 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.852 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:13.852 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.011626+0000", 2024-09-12T18:36:13.852 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.852 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.852 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.853 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:13.853 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.011627+0000", 2024-09-12T18:36:13.853 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.7399999999999991e-07 2024-09-12T18:36:13.853 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.853 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.853 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:13.853 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.011693+0000", 2024-09-12T18:36:13.853 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6586000000000002e-05 2024-09-12T18:36:13.853 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.853 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.853 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:13.853 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.011703+0000", 2024-09-12T18:36:13.853 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.3619999999999995e-06 2024-09-12T18:36:13.853 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.854 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.854 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.854 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.011710+0000", 2024-09-12T18:36:13.854 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1010000000000003e-06 2024-09-12T18:36:13.854 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.854 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.854 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:13.854 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.021346+0000", 2024-09-12T18:36:13.854 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0096362170000000007 2024-09-12T18:36:13.854 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.854 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.854 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:13.854 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.021456+0000", 2024-09-12T18:36:13.854 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010942000000000001 2024-09-12T18:36:13.855 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.855 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.855 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:13.855 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.021540+0000", 2024-09-12T18:36:13.855 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4220000000000003e-05 2024-09-12T18:36:13.855 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.855 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.855 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:13.855 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.027831+0000", 2024-09-12T18:36:13.855 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062915760000000001 2024-09-12T18:36:13.855 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.855 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.855 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:13.855 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.028132+0000", 2024-09-12T18:36:13.856 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030037 2024-09-12T18:36:13.856 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.856 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.856 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:13.856 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.028188+0000", 2024-09-12T18:36:13.856 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6023999999999998e-05 2024-09-12T18:36:13.856 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.856 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.856 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:13.857 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.028219+0000", 2024-09-12T18:36:13.857 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1401e-05 2024-09-12T18:36:13.857 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.857 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:13.857 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.857 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.857 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.857 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:49141 5.d 5:bce526e5:::benchmark_data_smithi073_23739_object49140:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T18:36:13.857 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:03.538808+0000", 2024-09-12T18:36:13.857 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 10.257945769999999, 2024-09-12T18:36:13.857 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.019659019, 2024-09-12T18:36:13.857 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:13.857 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:13.858 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:13.858 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:13.858 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:13.858 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:13.858 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 49141 2024-09-12T18:36:13.858 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.858 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:13.858 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.858 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:13.858 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538808+0000", 2024-09-12T18:36:13.858 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.858 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.858 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.859 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:13.859 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538808+0000", 2024-09-12T18:36:13.859 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.859 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.859 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.859 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:13.859 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538809+0000", 2024-09-12T18:36:13.860 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.065e-06 2024-09-12T18:36:13.860 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.860 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.860 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:13.860 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538914+0000", 2024-09-12T18:36:13.860 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010528599999999999 2024-09-12T18:36:13.860 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.860 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.860 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:13.860 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538924+0000", 2024-09-12T18:36:13.860 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4420000000000004e-06 2024-09-12T18:36:13.860 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.861 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.861 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.861 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538944+0000", 2024-09-12T18:36:13.861 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0460000000000001e-05 2024-09-12T18:36:13.861 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.861 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.861 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:13.861 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.539034+0000", 2024-09-12T18:36:13.861 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9512000000000006e-05 2024-09-12T18:36:13.861 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.861 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.861 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:13.861 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.539161+0000", 2024-09-12T18:36:13.861 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012782399999999999 2024-09-12T18:36:13.862 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.862 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.862 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:13.862 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.539246+0000", 2024-09-12T18:36:13.862 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4927999999999997e-05 2024-09-12T18:36:13.862 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.862 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.862 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:13.862 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.541390+0000", 2024-09-12T18:36:13.862 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0021439509999999998 2024-09-12T18:36:13.862 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.862 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.862 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:13.863 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.558236+0000", 2024-09-12T18:36:13.863 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016845619999999999 2024-09-12T18:36:13.863 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.863 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.863 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:13.863 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.558368+0000", 2024-09-12T18:36:13.863 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013241300000000001 2024-09-12T18:36:13.863 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.863 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.863 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:13.863 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.558467+0000", 2024-09-12T18:36:13.863 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8517999999999994e-05 2024-09-12T18:36:13.863 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.864 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:13.864 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.864 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.864 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.864 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:52665 5.4 5:2596ded4:::benchmark_data_smithi073_23739_object52664:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:36:13.864 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:05.063686+0000", 2024-09-12T18:36:13.864 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 8.7330675249999992, 2024-09-12T18:36:13.864 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016518109, 2024-09-12T18:36:13.864 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:13.864 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:13.864 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:13.864 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:13.865 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:13.865 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:13.865 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 52665 2024-09-12T18:36:13.865 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.865 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:13.865 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.865 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:13.865 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063686+0000", 2024-09-12T18:36:13.865 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.865 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.865 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.865 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:13.865 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063686+0000", 2024-09-12T18:36:13.866 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.866 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.866 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.866 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:13.866 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063687+0000", 2024-09-12T18:36:13.866 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8800000000000001e-07 2024-09-12T18:36:13.866 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.866 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.866 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:13.866 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063816+0000", 2024-09-12T18:36:13.866 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012879100000000001 2024-09-12T18:36:13.866 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.866 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.866 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:13.867 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063844+0000", 2024-09-12T18:36:13.867 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8683e-05 2024-09-12T18:36:13.867 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.867 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.867 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.867 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063851+0000", 2024-09-12T18:36:13.867 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4110000000000001e-06 2024-09-12T18:36:13.867 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.867 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.867 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:13.867 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.066498+0000", 2024-09-12T18:36:13.867 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00264774 2024-09-12T18:36:13.867 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.868 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.868 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:13.868 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.066620+0000", 2024-09-12T18:36:13.868 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000121919 2024-09-12T18:36:13.868 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.868 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.868 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:13.868 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.066756+0000", 2024-09-12T18:36:13.868 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013559800000000001 2024-09-12T18:36:13.868 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.868 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.868 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:13.868 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.072827+0000", 2024-09-12T18:36:13.869 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0060708439999999997 2024-09-12T18:36:13.869 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.869 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.869 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:13.869 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.080088+0000", 2024-09-12T18:36:13.869 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0072613900000000004 2024-09-12T18:36:13.869 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.869 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.869 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:13.869 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.080146+0000", 2024-09-12T18:36:13.869 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7533e-05 2024-09-12T18:36:13.869 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.869 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.869 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:13.870 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.080204+0000", 2024-09-12T18:36:13.870 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8312e-05 2024-09-12T18:36:13.870 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.870 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:13.870 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.870 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.870 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.870 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:52666 5.4 5:2086007b:::benchmark_data_smithi073_23739_object52665:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:36:13.870 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:05.063873+0000", 2024-09-12T18:36:13.870 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 8.7328806409999995, 2024-09-12T18:36:13.870 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016582294000000001, 2024-09-12T18:36:13.870 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:13.870 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:13.871 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:13.871 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:13.871 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:13.871 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:13.871 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 52666 2024-09-12T18:36:13.871 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.871 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:13.871 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.871 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:13.871 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063873+0000", 2024-09-12T18:36:13.872 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.872 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.872 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.872 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:13.872 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063873+0000", 2024-09-12T18:36:13.872 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.872 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.872 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.872 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:13.872 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063874+0000", 2024-09-12T18:36:13.872 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4099999999999998e-07 2024-09-12T18:36:13.872 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.872 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.873 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:13.873 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063925+0000", 2024-09-12T18:36:13.873 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1462999999999998e-05 2024-09-12T18:36:13.873 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.873 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.873 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:13.873 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063937+0000", 2024-09-12T18:36:13.873 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1649e-05 2024-09-12T18:36:13.873 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.873 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.873 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.873 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063951+0000", 2024-09-12T18:36:13.873 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4161999999999999e-05 2024-09-12T18:36:13.873 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.874 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.874 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:13.874 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.068208+0000", 2024-09-12T18:36:13.874 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042567630000000002 2024-09-12T18:36:13.874 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.874 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.874 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:13.874 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.068319+0000", 2024-09-12T18:36:13.874 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000110955 2024-09-12T18:36:13.874 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.874 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.874 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:13.874 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.068417+0000", 2024-09-12T18:36:13.875 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.7969999999999999e-05 2024-09-12T18:36:13.875 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.875 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.875 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:13.875 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.072834+0000", 2024-09-12T18:36:13.875 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0044172910000000003 2024-09-12T18:36:13.875 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.875 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.875 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:13.875 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.080278+0000", 2024-09-12T18:36:13.875 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0074438880000000001 2024-09-12T18:36:13.875 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.875 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.875 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:13.876 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.080389+0000", 2024-09-12T18:36:13.876 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000111475 2024-09-12T18:36:13.876 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.876 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.876 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:13.876 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.080455+0000", 2024-09-12T18:36:13.876 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5937000000000002e-05 2024-09-12T18:36:13.876 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.876 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:13.876 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.876 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.876 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.876 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:52993 5.0 5:00f9e688:::benchmark_data_smithi073_23739_object52992:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:36:13.877 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:05.209109+0000", 2024-09-12T18:36:13.877 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 8.587644697, 2024-09-12T18:36:13.877 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017556391000000001, 2024-09-12T18:36:13.877 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:13.877 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:13.877 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:13.877 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:13.877 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:13.877 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:13.877 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 52993 2024-09-12T18:36:13.877 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.877 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:13.877 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.877 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:13.878 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.209109+0000", 2024-09-12T18:36:13.878 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.878 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.878 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.878 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:13.878 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.209109+0000", 2024-09-12T18:36:13.878 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.878 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.878 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.878 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:13.878 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.209110+0000", 2024-09-12T18:36:13.878 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8000000000000004e-07 2024-09-12T18:36:13.878 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.878 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.879 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:13.879 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.209246+0000", 2024-09-12T18:36:13.879 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013595 2024-09-12T18:36:13.879 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.879 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.879 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:13.879 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.209256+0000", 2024-09-12T18:36:13.879 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9580000000000002e-06 2024-09-12T18:36:13.879 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.879 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.879 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.879 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.209262+0000", 2024-09-12T18:36:13.879 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7950000000000002e-06 2024-09-12T18:36:13.879 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.880 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.880 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:13.880 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.212362+0000", 2024-09-12T18:36:13.880 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003099606 2024-09-12T18:36:13.880 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.880 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.880 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:13.880 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.212569+0000", 2024-09-12T18:36:13.880 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020737699999999999 2024-09-12T18:36:13.880 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.880 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.880 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:13.880 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.212907+0000", 2024-09-12T18:36:13.881 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00033730499999999998 2024-09-12T18:36:13.881 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.881 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.881 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:13.881 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.226511+0000", 2024-09-12T18:36:13.881 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.01360451 2024-09-12T18:36:13.881 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.881 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.881 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:13.881 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.226567+0000", 2024-09-12T18:36:13.881 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5371000000000002e-05 2024-09-12T18:36:13.881 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.881 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.882 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:13.882 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.226624+0000", 2024-09-12T18:36:13.882 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7355999999999998e-05 2024-09-12T18:36:13.882 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.882 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.882 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:13.882 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.226665+0000", 2024-09-12T18:36:13.882 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1282999999999998e-05 2024-09-12T18:36:13.882 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.882 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:13.882 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.882 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.882 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.882 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:61561 5.e 5:715fe5e4:::benchmark_data_smithi073_23739_object61560:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:36:13.883 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:09.221864+0000", 2024-09-12T18:36:13.883 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.5748893549999998, 2024-09-12T18:36:13.883 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017993663999999999, 2024-09-12T18:36:13.883 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:13.883 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:13.883 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:13.883 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:13.883 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:13.883 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:13.883 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 61561 2024-09-12T18:36:13.883 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.883 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:13.883 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.884 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:13.884 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.221864+0000", 2024-09-12T18:36:13.884 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.884 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.884 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.884 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:13.884 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.221864+0000", 2024-09-12T18:36:13.884 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.884 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.884 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.884 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:13.884 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.221865+0000", 2024-09-12T18:36:13.884 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1310000000000001e-06 2024-09-12T18:36:13.884 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.885 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.885 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:13.885 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222022+0000", 2024-09-12T18:36:13.885 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015628500000000001 2024-09-12T18:36:13.885 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.885 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.885 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:13.885 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222034+0000", 2024-09-12T18:36:13.885 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2481e-05 2024-09-12T18:36:13.885 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.885 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.885 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.885 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222041+0000", 2024-09-12T18:36:13.886 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7469999999999999e-06 2024-09-12T18:36:13.886 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.886 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.886 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:13.886 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222103+0000", 2024-09-12T18:36:13.886 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1903999999999995e-05 2024-09-12T18:36:13.886 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.886 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.886 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:13.886 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222199+0000", 2024-09-12T18:36:13.886 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6664999999999997e-05 2024-09-12T18:36:13.886 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.887 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.887 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:13.887 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222286+0000", 2024-09-12T18:36:13.887 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6582999999999994e-05 2024-09-12T18:36:13.887 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.887 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.887 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:13.887 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.228622+0000", 2024-09-12T18:36:13.887 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063357520000000001 2024-09-12T18:36:13.887 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.887 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.887 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:13.888 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.239753+0000", 2024-09-12T18:36:13.888 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011131709 2024-09-12T18:36:13.888 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.888 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.888 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:13.888 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.239813+0000", 2024-09-12T18:36:13.888 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0007999999999999e-05 2024-09-12T18:36:13.888 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.888 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.888 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:13.888 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.239858+0000", 2024-09-12T18:36:13.888 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4399e-05 2024-09-12T18:36:13.889 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.889 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:13.889 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.889 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.889 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.889 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:62045 5.4 5:28350251:::benchmark_data_smithi073_23739_object62044:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:36:13.889 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:09.454028+0000", 2024-09-12T18:36:13.889 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.3427255779999996, 2024-09-12T18:36:13.889 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016191579000000001, 2024-09-12T18:36:13.889 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:13.889 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:13.889 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:13.889 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:13.890 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:13.890 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:13.890 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 62045 2024-09-12T18:36:13.890 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.890 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:13.890 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.890 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:13.890 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.454028+0000", 2024-09-12T18:36:13.890 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.890 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.890 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.890 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:13.891 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.454028+0000", 2024-09-12T18:36:13.891 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.891 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.891 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.891 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:13.891 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.454031+0000", 2024-09-12T18:36:13.891 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6240000000000002e-06 2024-09-12T18:36:13.891 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.891 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.891 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:13.891 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.454082+0000", 2024-09-12T18:36:13.891 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1866000000000001e-05 2024-09-12T18:36:13.891 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.892 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.892 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:13.892 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.454091+0000", 2024-09-12T18:36:13.892 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4489999999999999e-06 2024-09-12T18:36:13.892 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.892 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.892 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.892 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.454096+0000", 2024-09-12T18:36:13.892 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4369999999999998e-06 2024-09-12T18:36:13.892 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.892 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.892 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:13.892 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.460375+0000", 2024-09-12T18:36:13.892 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.006278863 2024-09-12T18:36:13.893 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.893 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.893 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:13.893 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.460519+0000", 2024-09-12T18:36:13.893 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014404399999999999 2024-09-12T18:36:13.893 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.893 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.893 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:13.893 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.460713+0000", 2024-09-12T18:36:13.893 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000193442 2024-09-12T18:36:13.893 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.893 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.893 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:13.893 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.465478+0000", 2024-09-12T18:36:13.894 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0047649850000000002 2024-09-12T18:36:13.894 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.894 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.894 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:13.894 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.470072+0000", 2024-09-12T18:36:13.894 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00459473 2024-09-12T18:36:13.894 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.894 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.894 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:13.894 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.470131+0000", 2024-09-12T18:36:13.894 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8508000000000003e-05 2024-09-12T18:36:13.894 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.894 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.895 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:13.895 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.470220+0000", 2024-09-12T18:36:13.895 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8630999999999999e-05 2024-09-12T18:36:13.895 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.895 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:13.895 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.895 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.895 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.895 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:68606 5.8 5:10a6f333:::benchmark_data_smithi073_23739_object68605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:36:13.895 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:12.561643+0000", 2024-09-12T18:36:13.895 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.2351109220000001, 2024-09-12T18:36:13.895 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016446977000000002, 2024-09-12T18:36:13.895 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:13.895 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:13.896 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:13.896 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:13.896 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:13.896 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:13.896 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 68606 2024-09-12T18:36:13.896 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.896 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:13.896 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.896 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:13.896 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.561643+0000", 2024-09-12T18:36:13.896 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.896 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.896 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.897 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:13.897 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.561643+0000", 2024-09-12T18:36:13.897 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.897 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.897 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.897 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:13.897 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.561643+0000", 2024-09-12T18:36:13.897 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3900000000000004e-07 2024-09-12T18:36:13.897 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.897 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.897 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:13.897 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.561787+0000", 2024-09-12T18:36:13.897 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014318999999999999 2024-09-12T18:36:13.897 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.898 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.898 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:13.898 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.561800+0000", 2024-09-12T18:36:13.898 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3736e-05 2024-09-12T18:36:13.898 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.898 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.898 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.898 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.561812+0000", 2024-09-12T18:36:13.898 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.137e-05 2024-09-12T18:36:13.898 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.898 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.898 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:13.898 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.565842+0000", 2024-09-12T18:36:13.898 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0040301319999999996 2024-09-12T18:36:13.899 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.899 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.899 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:13.899 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.566009+0000", 2024-09-12T18:36:13.899 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016746099999999999 2024-09-12T18:36:13.899 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.899 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.899 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:13.899 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.566209+0000", 2024-09-12T18:36:13.899 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020010199999999999 2024-09-12T18:36:13.899 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.899 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.899 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:13.899 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.573158+0000", 2024-09-12T18:36:13.900 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.006949032 2024-09-12T18:36:13.900 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.900 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.900 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:13.900 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.577999+0000", 2024-09-12T18:36:13.900 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.004840217 2024-09-12T18:36:13.900 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.900 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.900 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:13.900 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.578061+0000", 2024-09-12T18:36:13.900 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1947999999999997e-05 2024-09-12T18:36:13.900 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.900 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.901 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:13.901 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.578090+0000", 2024-09-12T18:36:13.901 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8949999999999999e-05 2024-09-12T18:36:13.901 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.901 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:13.901 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.901 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.901 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.901 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:69359 5.0 5:08dd0213:::benchmark_data_smithi073_23739_object69358:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:36:13.901 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:12.934887+0000", 2024-09-12T18:36:13.901 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.86186691199999999, 2024-09-12T18:36:13.901 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016366206000000001, 2024-09-12T18:36:13.901 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:13.902 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:13.902 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:13.902 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:13.902 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:13.902 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:13.902 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 69359 2024-09-12T18:36:13.902 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.902 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:13.902 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.902 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:13.902 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.934887+0000", 2024-09-12T18:36:13.902 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.902 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.902 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.903 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:13.903 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.934887+0000", 2024-09-12T18:36:13.903 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.903 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.903 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.903 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:13.903 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.934888+0000", 2024-09-12T18:36:13.903 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.7199999999999997e-07 2024-09-12T18:36:13.903 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.903 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.903 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:13.903 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.934931+0000", 2024-09-12T18:36:13.903 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3334000000000002e-05 2024-09-12T18:36:13.904 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.904 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.904 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:13.904 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.934939+0000", 2024-09-12T18:36:13.904 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3289999999999994e-06 2024-09-12T18:36:13.904 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.904 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.904 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.904 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.934944+0000", 2024-09-12T18:36:13.904 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.215e-06 2024-09-12T18:36:13.904 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.904 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.904 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:13.904 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.936847+0000", 2024-09-12T18:36:13.905 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001902234 2024-09-12T18:36:13.905 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.905 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.905 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:13.905 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.936928+0000", 2024-09-12T18:36:13.905 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1201999999999999e-05 2024-09-12T18:36:13.905 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.905 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.905 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:13.905 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.937005+0000", 2024-09-12T18:36:13.905 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7386999999999996e-05 2024-09-12T18:36:13.905 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.905 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.905 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:13.906 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.940637+0000", 2024-09-12T18:36:13.906 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003632021 2024-09-12T18:36:13.906 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.906 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.906 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:13.906 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.951159+0000", 2024-09-12T18:36:13.906 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.010521878 2024-09-12T18:36:13.906 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.906 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.906 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:13.906 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.951220+0000", 2024-09-12T18:36:13.906 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1136000000000006e-05 2024-09-12T18:36:13.906 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.907 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.907 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:13.907 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.951253+0000", 2024-09-12T18:36:13.907 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2498e-05 2024-09-12T18:36:13.907 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.907 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:13.907 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.907 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.907 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.907 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:69416 5.0 5:023ec417:::benchmark_data_smithi073_23739_object69415:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:36:13.907 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:12.965982+0000", 2024-09-12T18:36:13.907 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.83077124999999996, 2024-09-12T18:36:13.907 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016444225, 2024-09-12T18:36:13.907 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:13.908 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:13.908 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:13.908 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:13.908 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:13.908 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:13.908 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 69416 2024-09-12T18:36:13.908 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.908 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:13.908 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.908 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:13.908 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.965982+0000", 2024-09-12T18:36:13.908 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.908 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.909 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.909 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:13.909 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.965982+0000", 2024-09-12T18:36:13.909 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.909 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.909 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.909 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:13.909 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.965983+0000", 2024-09-12T18:36:13.909 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1179999999999999e-06 2024-09-12T18:36:13.909 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.909 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.909 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:13.909 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.966065+0000", 2024-09-12T18:36:13.909 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2027000000000006e-05 2024-09-12T18:36:13.910 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.910 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.910 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:13.910 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.966073+0000", 2024-09-12T18:36:13.910 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6210000000000004e-06 2024-09-12T18:36:13.910 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.910 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.910 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.910 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.966078+0000", 2024-09-12T18:36:13.910 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6530000000000002e-06 2024-09-12T18:36:13.910 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.910 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.910 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:13.910 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.966133+0000", 2024-09-12T18:36:13.911 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5031000000000002e-05 2024-09-12T18:36:13.911 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.911 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.911 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:13.911 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.966241+0000", 2024-09-12T18:36:13.911 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000108538 2024-09-12T18:36:13.911 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.911 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.911 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:13.911 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.966336+0000", 2024-09-12T18:36:13.911 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4262e-05 2024-09-12T18:36:13.911 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.911 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.911 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:13.912 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.971173+0000", 2024-09-12T18:36:13.912 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0048379030000000002 2024-09-12T18:36:13.912 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.912 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.912 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:13.912 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.982286+0000", 2024-09-12T18:36:13.912 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011112782 2024-09-12T18:36:13.912 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.912 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.912 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:13.912 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.982361+0000", 2024-09-12T18:36:13.912 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4709000000000006e-05 2024-09-12T18:36:13.912 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.913 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.913 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:13.913 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.982426+0000", 2024-09-12T18:36:13.913 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5580999999999994e-05 2024-09-12T18:36:13.913 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.913 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:13.913 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.913 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.913 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.913 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:70172 5.e 5:7d3deeb4:::benchmark_data_smithi073_23739_object70171:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:36:13.913 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:13.331166+0000", 2024-09-12T18:36:13.913 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.46558798600000001, 2024-09-12T18:36:13.913 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016367316999999999, 2024-09-12T18:36:13.913 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:13.913 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:13.914 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:13.914 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:13.914 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:13.914 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:13.914 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 70172 2024-09-12T18:36:13.914 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.914 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:13.914 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.914 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:13.914 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.331166+0000", 2024-09-12T18:36:13.914 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.914 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.915 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.915 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:13.915 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.331166+0000", 2024-09-12T18:36:13.915 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:13.915 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.915 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.915 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:13.915 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.331166+0000", 2024-09-12T18:36:13.915 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3900000000000004e-07 2024-09-12T18:36:13.915 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.915 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.915 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:13.915 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.331197+0000", 2024-09-12T18:36:13.916 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0320000000000001e-05 2024-09-12T18:36:13.916 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.916 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.916 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:13.916 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.331206+0000", 2024-09-12T18:36:13.916 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9649999999999997e-06 2024-09-12T18:36:13.916 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.916 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.916 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:13.916 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.331212+0000", 2024-09-12T18:36:13.916 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.3720000000000001e-06 2024-09-12T18:36:13.916 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.916 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.916 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:13.917 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.332742+0000", 2024-09-12T18:36:13.917 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015303039999999999 2024-09-12T18:36:13.917 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.917 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.917 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:13.917 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.332842+0000", 2024-09-12T18:36:13.917 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9313000000000003e-05 2024-09-12T18:36:13.917 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.917 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.917 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:13.917 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.332924+0000", 2024-09-12T18:36:13.917 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2322000000000002e-05 2024-09-12T18:36:13.917 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.918 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.918 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:13.918 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.336928+0000", 2024-09-12T18:36:13.918 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.004003716 2024-09-12T18:36:13.918 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.918 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.918 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:13.918 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.347463+0000", 2024-09-12T18:36:13.918 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.010535452000000001 2024-09-12T18:36:13.918 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.918 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.918 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:13.918 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.347498+0000", 2024-09-12T18:36:13.918 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4504e-05 2024-09-12T18:36:13.919 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:13.919 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:13.919 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:13.919 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:13.347533+0000", 2024-09-12T18:36:13.919 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5309999999999999e-05 2024-09-12T18:36:13.919 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.919 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:13.919 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.919 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:13.919 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:13.919 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:13.920 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 28 16 71349 71333 159.209 132 0.00537373 0.0062762 2024-09-12T18:36:13.921 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:36:13.922 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:13.916+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:14.021 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:14.017+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:14.073 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:36:14.074 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:36:14.074 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.074 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:71753 5.7 5:e65d1bdd:::benchmark_data_smithi073_23739_object71752:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:36:14.074 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:14.065477+0000", 2024-09-12T18:36:14.074 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0073395550000000002, 2024-09-12T18:36:14.074 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0073618319999999996, 2024-09-12T18:36:14.074 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:14.074 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:14.074 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:14.074 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:14.074 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:14.074 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:14.074 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 71753 2024-09-12T18:36:14.075 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.075 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:14.075 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.075 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:14.075 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.065477+0000", 2024-09-12T18:36:14.075 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.075 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.075 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.075 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:14.075 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.065477+0000", 2024-09-12T18:36:14.075 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.075 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.076 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.076 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:14.076 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.065477+0000", 2024-09-12T18:36:14.076 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2099999999999996e-07 2024-09-12T18:36:14.076 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.076 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.076 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:14.076 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.065511+0000", 2024-09-12T18:36:14.076 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.375e-05 2024-09-12T18:36:14.076 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.076 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.076 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:14.077 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.065520+0000", 2024-09-12T18:36:14.077 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5930000000000006e-06 2024-09-12T18:36:14.077 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.077 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.077 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:14.077 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.065526+0000", 2024-09-12T18:36:14.077 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.3879999999999997e-06 2024-09-12T18:36:14.077 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.077 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.077 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:14.078 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.067931+0000", 2024-09-12T18:36:14.078 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0024054900000000001 2024-09-12T18:36:14.078 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.078 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.078 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:14.078 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.068068+0000", 2024-09-12T18:36:14.078 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013621400000000001 2024-09-12T18:36:14.078 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.078 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.078 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:14.078 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.068172+0000", 2024-09-12T18:36:14.078 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000104652 2024-09-12T18:36:14.078 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.078 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:14.079 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.079 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.079 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.079 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:71757 5.1 5:859cb965:::benchmark_data_smithi073_23739_object71756:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:36:14.079 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:14.067657+0000", 2024-09-12T18:36:14.079 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0051587660000000004, 2024-09-12T18:36:14.079 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0052333129999999999, 2024-09-12T18:36:14.079 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:14.079 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:14.079 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:14.079 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:14.079 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:14.079 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:14.080 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 71757 2024-09-12T18:36:14.080 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.080 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:14.080 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.080 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:14.080 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.067657+0000", 2024-09-12T18:36:14.080 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.080 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.080 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.080 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:14.080 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.067657+0000", 2024-09-12T18:36:14.080 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.080 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.080 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.081 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:14.081 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.067659+0000", 2024-09-12T18:36:14.081 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.322e-06 2024-09-12T18:36:14.081 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.081 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.081 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:14.081 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.067762+0000", 2024-09-12T18:36:14.081 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010343700000000001 2024-09-12T18:36:14.081 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.081 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.081 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:14.081 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.067771+0000", 2024-09-12T18:36:14.081 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.6009999999999995e-06 2024-09-12T18:36:14.082 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.082 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.082 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:14.082 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.067776+0000", 2024-09-12T18:36:14.082 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2950000000000001e-06 2024-09-12T18:36:14.082 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.082 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.082 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:14.082 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.067818+0000", 2024-09-12T18:36:14.082 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.2262000000000003e-05 2024-09-12T18:36:14.082 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.082 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.082 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:14.083 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.067915+0000", 2024-09-12T18:36:14.083 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.6257999999999999e-05 2024-09-12T18:36:14.083 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.083 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.083 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:14.083 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.067997+0000", 2024-09-12T18:36:14.083 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.2614999999999994e-05 2024-09-12T18:36:14.083 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.083 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.083 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:14.083 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.072189+0000", 2024-09-12T18:36:14.083 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0041916119999999999 2024-09-12T18:36:14.083 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.084 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:14.084 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.084 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.084 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.084 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:71758 5.3 e37/21 5:cb8e3c20:::benchmark_data_smithi073_23739_object71757:head v 37'4401, mlcod=37'4399)", 2024-09-12T18:36:14.084 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:14.068197+0000", 2024-09-12T18:36:14.084 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0046192159999999998, 2024-09-12T18:36:14.084 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.004731641, 2024-09-12T18:36:14.084 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:14.084 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:14.084 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:14.084 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:14.084 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.085 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:14.085 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.068197+0000", 2024-09-12T18:36:14.085 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.085 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.085 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.085 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:14.085 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.068197+0000", 2024-09-12T18:36:14.085 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.085 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.085 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.085 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:14.085 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.068198+0000", 2024-09-12T18:36:14.085 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0200000000000001e-07 2024-09-12T18:36:14.086 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.086 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.086 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:14.086 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.068284+0000", 2024-09-12T18:36:14.086 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.6582999999999994e-05 2024-09-12T18:36:14.086 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.086 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.086 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:14.086 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.068293+0000", 2024-09-12T18:36:14.086 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.7709999999999995e-06 2024-09-12T18:36:14.086 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.086 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.086 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:14.086 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.068299+0000", 2024-09-12T18:36:14.087 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2149999999999998e-06 2024-09-12T18:36:14.087 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.087 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.087 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:14.087 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.068356+0000", 2024-09-12T18:36:14.087 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.6450000000000003e-05 2024-09-12T18:36:14.087 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.087 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.087 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:14.087 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.068378+0000", 2024-09-12T18:36:14.087 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2418000000000001e-05 2024-09-12T18:36:14.087 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.087 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:14.087 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.088 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.088 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.088 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:71763 5.1 5:8fb5c262:::benchmark_data_smithi073_23739_object71762:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:36:14.088 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:14.068347+0000", 2024-09-12T18:36:14.088 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0044692070000000002, 2024-09-12T18:36:14.088 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0046213749999999996, 2024-09-12T18:36:14.088 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:14.088 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:14.088 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:14.088 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:14.088 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:14.089 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:14.089 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 71763 2024-09-12T18:36:14.089 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.089 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:14.089 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.089 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:14.089 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.068347+0000", 2024-09-12T18:36:14.089 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.089 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.089 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.089 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:14.089 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.068347+0000", 2024-09-12T18:36:14.090 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.090 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.090 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.090 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:14.090 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.068348+0000", 2024-09-12T18:36:14.090 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.173e-06 2024-09-12T18:36:14.090 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.090 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.090 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:14.090 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.068393+0000", 2024-09-12T18:36:14.090 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.5185999999999997e-05 2024-09-12T18:36:14.090 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.090 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.090 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:14.091 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.068407+0000", 2024-09-12T18:36:14.091 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3237e-05 2024-09-12T18:36:14.091 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.091 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.091 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:14.091 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.068414+0000", 2024-09-12T18:36:14.091 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.114e-06 2024-09-12T18:36:14.091 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.091 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.091 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:14.091 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.069833+0000", 2024-09-12T18:36:14.091 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0014192670000000001 2024-09-12T18:36:14.091 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.092 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.092 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:14.092 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.069961+0000", 2024-09-12T18:36:14.092 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012815099999999999 2024-09-12T18:36:14.092 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.092 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.092 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:14.092 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.070113+0000", 2024-09-12T18:36:14.092 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015180599999999999 2024-09-12T18:36:14.092 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.093 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:14.093 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.093 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.093 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.093 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:71765 5.9 5:9eb67556:::benchmark_data_smithi073_23739_object71764:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:36:14.093 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:14.069599+0000", 2024-09-12T18:36:14.093 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.003217438, 2024-09-12T18:36:14.093 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0034221949999999998, 2024-09-12T18:36:14.093 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:14.093 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:14.093 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:14.093 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:14.093 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:14.094 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:14.094 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 71765 2024-09-12T18:36:14.094 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.094 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:14.094 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.094 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:14.094 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.069599+0000", 2024-09-12T18:36:14.094 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.094 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.094 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.094 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:14.094 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.069599+0000", 2024-09-12T18:36:14.095 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.095 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.095 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.095 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:14.095 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.069600+0000", 2024-09-12T18:36:14.095 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0330000000000001e-06 2024-09-12T18:36:14.095 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.095 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.095 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:14.095 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.069669+0000", 2024-09-12T18:36:14.095 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9622999999999994e-05 2024-09-12T18:36:14.096 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.096 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.096 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:14.096 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.069689+0000", 2024-09-12T18:36:14.096 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9585999999999998e-05 2024-09-12T18:36:14.096 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.096 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.096 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:14.096 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.069697+0000", 2024-09-12T18:36:14.096 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.6000000000000001e-06 2024-09-12T18:36:14.096 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.096 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.097 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:14.097 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.069827+0000", 2024-09-12T18:36:14.097 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013059000000000001 2024-09-12T18:36:14.097 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.097 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.097 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:14.097 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.069961+0000", 2024-09-12T18:36:14.097 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013431200000000001 2024-09-12T18:36:14.097 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.097 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.097 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:14.097 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.070113+0000", 2024-09-12T18:36:14.098 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015141699999999999 2024-09-12T18:36:14.098 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.098 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.098 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:14.098 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.072894+0000", 2024-09-12T18:36:14.098 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0027810909999999999 2024-09-12T18:36:14.098 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.098 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:14.098 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.098 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.098 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.099 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:71764 5.5 e37/21 5:a0be71c3:::benchmark_data_smithi073_23739_object71763:head v 37'4530, mlcod=37'4528)", 2024-09-12T18:36:14.099 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:14.070171+0000", 2024-09-12T18:36:14.099 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0026454529999999999, 2024-09-12T18:36:14.099 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0029048609999999999, 2024-09-12T18:36:14.099 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:14.099 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:14.099 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:14.099 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:14.099 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.099 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:14.099 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.070171+0000", 2024-09-12T18:36:14.099 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.099 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.100 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.100 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:14.100 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.070171+0000", 2024-09-12T18:36:14.100 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.100 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.100 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.100 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:14.100 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.070172+0000", 2024-09-12T18:36:14.100 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.54e-07 2024-09-12T18:36:14.100 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.100 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.101 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:14.101 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.070239+0000", 2024-09-12T18:36:14.101 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.7113999999999995e-05 2024-09-12T18:36:14.101 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.101 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.101 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:14.101 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.070246+0000", 2024-09-12T18:36:14.101 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9199999999999998e-06 2024-09-12T18:36:14.101 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.101 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.101 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:14.101 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.070250+0000", 2024-09-12T18:36:14.101 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6759999999999998e-06 2024-09-12T18:36:14.102 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.102 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.102 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:14.102 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.070293+0000", 2024-09-12T18:36:14.102 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.2429000000000003e-05 2024-09-12T18:36:14.102 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.102 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.102 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:14.102 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.070304+0000", 2024-09-12T18:36:14.102 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1681999999999999e-05 2024-09-12T18:36:14.102 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.102 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:14.102 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.103 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.103 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.103 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:71768 5.6 e37/21 5:6a2b99fd:::benchmark_data_smithi073_23739_object71767:head v 37'4515, mlcod=37'4513)", 2024-09-12T18:36:14.103 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:14.071011+0000", 2024-09-12T18:36:14.103 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0018053660000000001, 2024-09-12T18:36:14.103 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0020917800000000001, 2024-09-12T18:36:14.103 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:14.103 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:14.103 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:14.103 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:14.103 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.103 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:14.103 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.071011+0000", 2024-09-12T18:36:14.104 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.104 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.104 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.104 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:14.104 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.071011+0000", 2024-09-12T18:36:14.104 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.104 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.104 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.104 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:14.104 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.071012+0000", 2024-09-12T18:36:14.104 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.4199999999999995e-07 2024-09-12T18:36:14.104 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.105 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.105 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:14.105 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.071062+0000", 2024-09-12T18:36:14.105 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.0163000000000001e-05 2024-09-12T18:36:14.105 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.105 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.105 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:14.105 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.071072+0000", 2024-09-12T18:36:14.105 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0764000000000001e-05 2024-09-12T18:36:14.105 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.105 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.105 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:14.106 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.071078+0000", 2024-09-12T18:36:14.106 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.8549999999999998e-06 2024-09-12T18:36:14.106 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.106 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.106 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:14.106 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.071138+0000", 2024-09-12T18:36:14.106 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9595000000000001e-05 2024-09-12T18:36:14.106 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.106 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.106 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:14.106 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.071153+0000", 2024-09-12T18:36:14.106 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4983e-05 2024-09-12T18:36:14.106 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.106 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:14.107 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.107 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.107 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.107 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop_reply(client.4480.0:71757 5.1 e37/21 ondisk, result = 0)", 2024-09-12T18:36:14.107 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:14.072997+0000", 2024-09-12T18:36:14.107 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 4294967295.9998188, 2024-09-12T18:36:14.107 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014450199999999999, 2024-09-12T18:36:14.107 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:14.107 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:14.107 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:14.107 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:14.107 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.108 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:14.108 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.072997+0000", 2024-09-12T18:36:14.108 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.108 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.108 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.108 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:14.108 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.072997+0000", 2024-09-12T18:36:14.108 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.108 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.108 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.108 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:14.108 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.072998+0000", 2024-09-12T18:36:14.108 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5700000000000001e-07 2024-09-12T18:36:14.109 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.109 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.109 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:14.109 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.073018+0000", 2024-09-12T18:36:14.109 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9839000000000001e-05 2024-09-12T18:36:14.109 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.109 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.109 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:14.109 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.073027+0000", 2024-09-12T18:36:14.109 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.3039999999999994e-06 2024-09-12T18:36:14.109 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.109 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.109 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:14.109 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.073042+0000", 2024-09-12T18:36:14.110 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4306e-05 2024-09-12T18:36:14.110 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.110 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.110 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:14.110 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.073091+0000", 2024-09-12T18:36:14.110 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8940000000000002e-05 2024-09-12T18:36:14.110 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.110 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.110 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:14.110 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:14.073097+0000", 2024-09-12T18:36:14.110 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.7089999999999996e-06 2024-09-12T18:36:14.110 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.110 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:14.111 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.111 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.111 INFO:teuthology.orchestra.run.smithi162.stdout: ], 2024-09-12T18:36:14.111 INFO:teuthology.orchestra.run.smithi162.stdout: "num_ops": 8 2024-09-12T18:36:14.111 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:36:14.112 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:36:14.153 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:14.149+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:14.224 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:14.220+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:14.302 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:36:14.303 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [], 2024-09-12T18:36:14.303 INFO:teuthology.orchestra.run.smithi162.stdout: "complaint_time": 30, 2024-09-12T18:36:14.303 INFO:teuthology.orchestra.run.smithi162.stdout: "num_blocked_ops": 0 2024-09-12T18:36:14.303 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:36:14.324 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:36:14.325 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:14.321+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:14.357 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:36:14.359 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T18:36:14.426 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:14.420+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:14.484 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:36:14.484 INFO:teuthology.orchestra.run.smithi162.stdout: "size": 20, 2024-09-12T18:36:14.484 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 600, 2024-09-12T18:36:14.484 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:36:14.484 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.484 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4154.0:123 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:36:14.484 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:36:14.484 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 60.505545931, 2024-09-12T18:36:14.485 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.022398096999999999, 2024-09-12T18:36:14.485 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:14.485 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:14.485 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:14.485 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:14.485 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4154", 2024-09-12T18:36:14.485 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/745129001", 2024-09-12T18:36:14.485 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 123 2024-09-12T18:36:14.485 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.485 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:14.485 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.485 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:14.485 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:36:14.486 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.486 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.486 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.486 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:14.486 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:36:14.486 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.486 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.486 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.486 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:14.486 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:36:14.486 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.8299999999999996e-07 2024-09-12T18:36:14.486 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.486 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.487 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:14.487 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976528+0000", 2024-09-12T18:36:14.487 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011393299999999999 2024-09-12T18:36:14.487 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.487 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.487 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:14.487 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976539+0000", 2024-09-12T18:36:14.487 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0763e-05 2024-09-12T18:36:14.487 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.487 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.487 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:14.487 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976547+0000", 2024-09-12T18:36:14.487 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8199999999999997e-06 2024-09-12T18:36:14.488 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.488 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.488 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:14.488 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.995057+0000", 2024-09-12T18:36:14.488 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.018510047000000002 2024-09-12T18:36:14.488 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.488 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.488 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:14.488 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.995301+0000", 2024-09-12T18:36:14.488 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00024375899999999999 2024-09-12T18:36:14.488 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.488 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.488 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:14.489 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.995642+0000", 2024-09-12T18:36:14.489 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00034121100000000001 2024-09-12T18:36:14.489 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.489 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.489 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:14.489 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998179+0000", 2024-09-12T18:36:14.489 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00253761 2024-09-12T18:36:14.489 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.489 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.489 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:14.489 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998665+0000", 2024-09-12T18:36:14.489 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00048574600000000001 2024-09-12T18:36:14.489 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.489 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.490 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:14.490 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998739+0000", 2024-09-12T18:36:14.490 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.4286e-05 2024-09-12T18:36:14.490 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.490 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.490 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:14.490 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998812+0000", 2024-09-12T18:36:14.490 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2238999999999997e-05 2024-09-12T18:36:14.490 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.490 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:14.490 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.490 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.490 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.491 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4154.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:36:14.491 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:36:14.491 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 60.505398698999997, 2024-09-12T18:36:14.491 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025950709999999998, 2024-09-12T18:36:14.491 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:14.491 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:14.491 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:14.491 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:14.491 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4154", 2024-09-12T18:36:14.491 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/745129001", 2024-09-12T18:36:14.491 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 124 2024-09-12T18:36:14.491 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.491 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:14.491 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.492 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:14.492 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:36:14.492 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.492 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.492 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.492 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:14.492 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:36:14.492 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.492 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.492 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.492 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:14.493 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976562+0000", 2024-09-12T18:36:14.493 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.2999999999999999e-07 2024-09-12T18:36:14.493 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.493 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.493 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:14.493 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976567+0000", 2024-09-12T18:36:14.493 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3430000000000003e-06 2024-09-12T18:36:14.493 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.493 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.493 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:14.493 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976576+0000", 2024-09-12T18:36:14.493 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8070000000000006e-06 2024-09-12T18:36:14.493 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.494 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.494 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:14.494 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976583+0000", 2024-09-12T18:36:14.494 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9959999999999996e-06 2024-09-12T18:36:14.494 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.494 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.494 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:14.494 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997107+0000", 2024-09-12T18:36:14.494 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.020524106 2024-09-12T18:36:14.494 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.494 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.494 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:14.494 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997225+0000", 2024-09-12T18:36:14.495 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000117909 2024-09-12T18:36:14.495 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.495 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.495 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:14.495 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997407+0000", 2024-09-12T18:36:14.495 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00018175900000000001 2024-09-12T18:36:14.495 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.495 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.495 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:14.495 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998839+0000", 2024-09-12T18:36:14.495 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001432539 2024-09-12T18:36:14.495 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.495 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.496 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:14.496 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002319+0000", 2024-09-12T18:36:14.496 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0034803529999999998 2024-09-12T18:36:14.496 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.496 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.496 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:14.496 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002405+0000", 2024-09-12T18:36:14.496 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5434999999999998e-05 2024-09-12T18:36:14.496 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.496 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.496 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:14.496 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002512+0000", 2024-09-12T18:36:14.496 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010663299999999999 2024-09-12T18:36:14.497 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.497 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:14.497 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.497 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.497 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.497 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:14.497 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:36:14.497 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 48.840601192000001, 2024-09-12T18:36:14.497 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025127867000000002, 2024-09-12T18:36:14.497 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:14.497 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:14.497 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:14.497 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:14.498 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.498 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:14.498 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:36:14.498 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.498 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.498 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.498 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:14.499 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:36:14.499 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.499 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.499 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.499 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:14.499 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641362+0000", 2024-09-12T18:36:14.499 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.2569999999999999e-06 2024-09-12T18:36:14.499 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.499 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.499 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:14.499 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641374+0000", 2024-09-12T18:36:14.499 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2696e-05 2024-09-12T18:36:14.499 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.500 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.500 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:14.500 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641403+0000", 2024-09-12T18:36:14.500 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.8756999999999999e-05 2024-09-12T18:36:14.500 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.500 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.500 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:14.500 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641430+0000", 2024-09-12T18:36:14.500 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.6452999999999999e-05 2024-09-12T18:36:14.500 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.500 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.500 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:14.500 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641585+0000", 2024-09-12T18:36:14.500 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000155799 2024-09-12T18:36:14.501 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.501 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.501 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:14.501 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641753+0000", 2024-09-12T18:36:14.501 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000167868 2024-09-12T18:36:14.501 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.501 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.501 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:14.501 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641916+0000", 2024-09-12T18:36:14.501 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000162903 2024-09-12T18:36:14.501 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.501 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.501 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:14.502 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653655+0000", 2024-09-12T18:36:14.502 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011738879000000001 2024-09-12T18:36:14.502 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.502 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.502 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:14.502 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665515+0000", 2024-09-12T18:36:14.502 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011859915 2024-09-12T18:36:14.502 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.502 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.502 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:14.502 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665646+0000", 2024-09-12T18:36:14.502 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013122599999999999 2024-09-12T18:36:14.502 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.502 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.503 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:14.503 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666486+0000", 2024-09-12T18:36:14.503 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00084011399999999999 2024-09-12T18:36:14.503 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.503 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:14.503 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.503 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.503 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.503 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:14.503 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:36:14.503 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 48.840486728999998, 2024-09-12T18:36:14.503 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025384584000000002, 2024-09-12T18:36:14.503 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:14.504 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:14.504 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:14.504 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:14.504 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.504 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:14.504 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:36:14.504 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.504 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.504 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.504 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:14.504 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:36:14.504 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.504 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.505 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.505 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:14.505 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641474+0000", 2024-09-12T18:36:14.505 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.39e-06 2024-09-12T18:36:14.505 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.505 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.505 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:14.505 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641482+0000", 2024-09-12T18:36:14.505 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3499999999999999e-06 2024-09-12T18:36:14.505 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.505 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.505 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:14.505 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641534+0000", 2024-09-12T18:36:14.506 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2533e-05 2024-09-12T18:36:14.506 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.506 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.507 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:14.507 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641551+0000", 2024-09-12T18:36:14.507 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6515999999999999e-05 2024-09-12T18:36:14.507 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.507 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.507 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:14.507 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642630+0000", 2024-09-12T18:36:14.507 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001079705 2024-09-12T18:36:14.507 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.507 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.508 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:14.508 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642909+0000", 2024-09-12T18:36:14.508 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027859800000000002 2024-09-12T18:36:14.508 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.508 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.508 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:14.508 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643137+0000", 2024-09-12T18:36:14.508 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022803799999999999 2024-09-12T18:36:14.508 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.508 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.508 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:14.508 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653669+0000", 2024-09-12T18:36:14.508 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010532032 2024-09-12T18:36:14.509 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.509 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.509 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:14.509 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666624+0000", 2024-09-12T18:36:14.509 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012954940999999999 2024-09-12T18:36:14.509 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.509 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.509 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:14.509 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666762+0000", 2024-09-12T18:36:14.509 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000137668 2024-09-12T18:36:14.509 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.509 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.509 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:14.510 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666857+0000", 2024-09-12T18:36:14.510 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.5812999999999999e-05 2024-09-12T18:36:14.510 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.510 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:14.510 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.510 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.510 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.510 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:14.510 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:36:14.510 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 48.840358934000001, 2024-09-12T18:36:14.510 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025661562999999998, 2024-09-12T18:36:14.510 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:14.510 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:14.511 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:14.511 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:14.511 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.511 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:14.511 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:36:14.511 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.511 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.511 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.511 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:14.511 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:36:14.511 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.511 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.512 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.512 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:14.512 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641602+0000", 2024-09-12T18:36:14.512 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3540000000000001e-06 2024-09-12T18:36:14.512 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.512 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.512 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:14.512 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641637+0000", 2024-09-12T18:36:14.512 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5145999999999999e-05 2024-09-12T18:36:14.512 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.512 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.512 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:14.513 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641659+0000", 2024-09-12T18:36:14.513 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2249999999999999e-05 2024-09-12T18:36:14.513 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.513 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.513 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:14.513 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641675+0000", 2024-09-12T18:36:14.514 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6059999999999999e-05 2024-09-12T18:36:14.514 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.514 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.514 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:14.514 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644570+0000", 2024-09-12T18:36:14.514 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028947069999999998 2024-09-12T18:36:14.514 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.514 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.514 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:14.514 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644900+0000", 2024-09-12T18:36:14.514 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000329401 2024-09-12T18:36:14.514 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.514 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.515 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:14.515 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645235+0000", 2024-09-12T18:36:14.515 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000335874 2024-09-12T18:36:14.515 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.515 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.515 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:14.515 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655459+0000", 2024-09-12T18:36:14.515 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010223441999999999 2024-09-12T18:36:14.515 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.515 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.515 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:14.515 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667028+0000", 2024-09-12T18:36:14.515 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011568673999999999 2024-09-12T18:36:14.516 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.516 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.516 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:14.516 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667163+0000", 2024-09-12T18:36:14.516 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013525500000000001 2024-09-12T18:36:14.516 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.516 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.516 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:14.516 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667262+0000", 2024-09-12T18:36:14.516 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9400000000000004e-05 2024-09-12T18:36:14.516 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.516 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:14.516 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.517 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.517 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.517 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:14.517 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:36:14.517 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 48.840257114000003, 2024-09-12T18:36:14.517 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025971339, 2024-09-12T18:36:14.517 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:14.517 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:14.517 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:14.517 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:14.517 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.517 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:14.517 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:36:14.517 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.518 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.518 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.518 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:14.518 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:36:14.518 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.518 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.518 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.518 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:14.518 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641704+0000", 2024-09-12T18:36:14.518 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.297e-06 2024-09-12T18:36:14.518 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.518 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.518 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:14.519 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641712+0000", 2024-09-12T18:36:14.519 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.9060000000000002e-06 2024-09-12T18:36:14.519 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.519 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.519 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:14.519 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641731+0000", 2024-09-12T18:36:14.519 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9083e-05 2024-09-12T18:36:14.519 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.519 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.519 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:14.519 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641745+0000", 2024-09-12T18:36:14.519 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4066999999999999e-05 2024-09-12T18:36:14.519 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.519 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.520 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:14.520 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646529+0000", 2024-09-12T18:36:14.520 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.004784033 2024-09-12T18:36:14.520 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.520 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.520 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:14.520 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646727+0000", 2024-09-12T18:36:14.520 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019841800000000001 2024-09-12T18:36:14.520 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.520 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.520 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:14.520 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647057+0000", 2024-09-12T18:36:14.520 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032926800000000002 2024-09-12T18:36:14.521 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.521 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.521 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:14.521 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655475+0000", 2024-09-12T18:36:14.521 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0084186250000000008 2024-09-12T18:36:14.521 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.521 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.521 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:14.521 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667424+0000", 2024-09-12T18:36:14.521 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011949257 2024-09-12T18:36:14.521 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.521 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.521 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:14.522 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667573+0000", 2024-09-12T18:36:14.522 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014851900000000001 2024-09-12T18:36:14.522 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.522 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.522 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:14.522 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667674+0000", 2024-09-12T18:36:14.522 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010086600000000001 2024-09-12T18:36:14.522 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.522 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:14.522 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.522 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.522 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.522 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:14.523 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:36:14.523 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 48.840194725000003, 2024-09-12T18:36:14.523 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026215008000000001, 2024-09-12T18:36:14.523 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:14.523 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:14.523 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:14.523 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:14.523 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.523 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:14.523 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:36:14.523 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.523 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.523 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.524 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:14.524 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:36:14.524 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.524 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.524 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.524 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:14.524 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641766+0000", 2024-09-12T18:36:14.524 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1200000000000001e-06 2024-09-12T18:36:14.524 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.524 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.524 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:14.524 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641775+0000", 2024-09-12T18:36:14.524 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.2499999999999995e-06 2024-09-12T18:36:14.525 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.525 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.525 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:14.525 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641793+0000", 2024-09-12T18:36:14.525 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7773000000000001e-05 2024-09-12T18:36:14.525 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.525 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.525 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:14.525 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641807+0000", 2024-09-12T18:36:14.525 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3814e-05 2024-09-12T18:36:14.525 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.525 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.525 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:14.525 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647626+0000", 2024-09-12T18:36:14.526 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0058193050000000003 2024-09-12T18:36:14.526 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.526 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.526 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:14.526 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647937+0000", 2024-09-12T18:36:14.526 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031112400000000003 2024-09-12T18:36:14.526 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.526 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.526 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:14.526 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648239+0000", 2024-09-12T18:36:14.526 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00030227500000000002 2024-09-12T18:36:14.526 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.526 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.527 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:14.527 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655487+0000", 2024-09-12T18:36:14.527 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072479129999999999 2024-09-12T18:36:14.527 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.527 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.527 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:14.527 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667823+0000", 2024-09-12T18:36:14.527 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012335505 2024-09-12T18:36:14.527 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.527 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.527 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:14.527 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667908+0000", 2024-09-12T18:36:14.527 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4843000000000001e-05 2024-09-12T18:36:14.527 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.528 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.528 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:14.528 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667980+0000", 2024-09-12T18:36:14.528 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2086000000000001e-05 2024-09-12T18:36:14.528 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.528 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:14.528 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.528 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.528 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.528 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:14.528 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:36:14.528 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 48.840134571999997, 2024-09-12T18:36:14.528 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026483236, 2024-09-12T18:36:14.529 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:14.529 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:14.529 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:14.529 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:14.529 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.529 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:14.529 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:36:14.529 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.529 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.529 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.529 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:14.529 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:36:14.529 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.529 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.529 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.530 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:14.530 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641826+0000", 2024-09-12T18:36:14.530 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:36:14.530 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.530 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.530 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:14.530 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641832+0000", 2024-09-12T18:36:14.530 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4199999999999998e-06 2024-09-12T18:36:14.530 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.530 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.530 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:14.530 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641848+0000", 2024-09-12T18:36:14.530 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6492999999999999e-05 2024-09-12T18:36:14.531 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.531 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.531 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:14.531 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641863+0000", 2024-09-12T18:36:14.531 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5427e-05 2024-09-12T18:36:14.531 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.531 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.531 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:14.531 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648887+0000", 2024-09-12T18:36:14.531 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0070230860000000004 2024-09-12T18:36:14.531 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.531 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.531 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:14.531 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649111+0000", 2024-09-12T18:36:14.532 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022425799999999999 2024-09-12T18:36:14.532 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.532 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.532 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:14.532 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649494+0000", 2024-09-12T18:36:14.532 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00038349400000000001 2024-09-12T18:36:14.532 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.532 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.532 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:14.532 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655499+0000", 2024-09-12T18:36:14.532 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0060047260000000002 2024-09-12T18:36:14.532 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.532 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.532 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:14.533 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668110+0000", 2024-09-12T18:36:14.533 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012610543 2024-09-12T18:36:14.533 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.533 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.533 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:14.533 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668252+0000", 2024-09-12T18:36:14.533 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014265600000000001 2024-09-12T18:36:14.533 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.533 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.533 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:14.533 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668308+0000", 2024-09-12T18:36:14.533 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5992999999999997e-05 2024-09-12T18:36:14.533 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.534 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:14.534 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.534 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.534 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.534 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:14.534 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:36:14.534 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 48.840079355999997, 2024-09-12T18:36:14.534 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026605302000000001, 2024-09-12T18:36:14.534 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:14.534 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:14.534 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:14.534 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:14.534 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.534 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:14.535 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:36:14.535 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.535 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.535 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.535 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:14.535 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:36:14.535 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.535 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.535 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.535 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:14.535 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641881+0000", 2024-09-12T18:36:14.535 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.057e-06 2024-09-12T18:36:14.535 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.535 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.536 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:14.536 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641887+0000", 2024-09-12T18:36:14.536 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.6629999999999998e-06 2024-09-12T18:36:14.536 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.536 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.536 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:14.536 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641903+0000", 2024-09-12T18:36:14.536 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6317e-05 2024-09-12T18:36:14.536 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.536 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.536 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:14.536 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641917+0000", 2024-09-12T18:36:14.536 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3339999999999999e-05 2024-09-12T18:36:14.536 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.537 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.537 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:14.537 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650708+0000", 2024-09-12T18:36:14.537 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.008791419 2024-09-12T18:36:14.537 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.537 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.537 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:14.537 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651021+0000", 2024-09-12T18:36:14.537 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031296699999999999 2024-09-12T18:36:14.537 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.537 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.537 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:14.537 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651349+0000", 2024-09-12T18:36:14.537 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032796499999999999 2024-09-12T18:36:14.538 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.538 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.538 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:14.538 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655742+0000", 2024-09-12T18:36:14.538 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0043934680000000002 2024-09-12T18:36:14.538 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.538 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.538 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:14.538 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668377+0000", 2024-09-12T18:36:14.538 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012634312999999999 2024-09-12T18:36:14.538 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.538 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.538 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:14.538 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668441+0000", 2024-09-12T18:36:14.539 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4369999999999995e-05 2024-09-12T18:36:14.539 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.539 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.539 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:14.539 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668485+0000", 2024-09-12T18:36:14.539 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4422999999999998e-05 2024-09-12T18:36:14.539 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.539 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:14.539 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.539 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.539 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.539 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:14.539 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:36:14.540 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 48.840021952999997, 2024-09-12T18:36:14.540 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026919499, 2024-09-12T18:36:14.540 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:14.540 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:14.540 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:14.540 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:14.540 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.540 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:14.540 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:36:14.540 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.540 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.540 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.540 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:14.540 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:36:14.541 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.541 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.541 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.541 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:14.541 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641939+0000", 2024-09-12T18:36:14.541 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9399999999999993e-07 2024-09-12T18:36:14.541 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.541 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.541 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:14.541 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641945+0000", 2024-09-12T18:36:14.541 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9200000000000001e-06 2024-09-12T18:36:14.541 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.541 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.541 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:14.542 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641961+0000", 2024-09-12T18:36:14.542 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6520000000000001e-05 2024-09-12T18:36:14.542 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.542 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.542 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:14.542 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641974+0000", 2024-09-12T18:36:14.542 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3413e-05 2024-09-12T18:36:14.542 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.542 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.542 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:14.542 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654560+0000", 2024-09-12T18:36:14.542 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012585308999999999 2024-09-12T18:36:14.542 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.542 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.543 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:14.543 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654822+0000", 2024-09-12T18:36:14.543 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026210099999999999 2024-09-12T18:36:14.543 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.543 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.543 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:14.543 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655059+0000", 2024-09-12T18:36:14.543 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00023747899999999999 2024-09-12T18:36:14.543 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.543 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.543 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:14.543 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.656315+0000", 2024-09-12T18:36:14.543 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0012555000000000001 2024-09-12T18:36:14.543 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.544 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.544 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:14.544 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668590+0000", 2024-09-12T18:36:14.544 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012274851999999999 2024-09-12T18:36:14.544 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.544 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.544 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:14.544 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668725+0000", 2024-09-12T18:36:14.544 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013524199999999999 2024-09-12T18:36:14.544 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.544 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.544 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:14.544 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668857+0000", 2024-09-12T18:36:14.544 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013216899999999999 2024-09-12T18:36:14.545 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.545 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:14.545 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.545 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.545 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.545 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:14.545 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:36:14.545 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 48.839968433000003, 2024-09-12T18:36:14.545 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023616723999999999, 2024-09-12T18:36:14.545 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:14.545 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:14.545 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:14.545 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:14.545 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.546 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:14.546 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:36:14.546 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.546 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.546 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.546 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:14.546 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:36:14.546 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.546 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.546 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.546 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:14.546 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641992+0000", 2024-09-12T18:36:14.546 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.08e-06 2024-09-12T18:36:14.546 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.547 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.547 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:14.547 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641998+0000", 2024-09-12T18:36:14.547 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4299999999999997e-06 2024-09-12T18:36:14.547 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.547 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.547 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:14.547 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642014+0000", 2024-09-12T18:36:14.547 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6266e-05 2024-09-12T18:36:14.547 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.547 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.547 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:14.547 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642026+0000", 2024-09-12T18:36:14.547 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2567e-05 2024-09-12T18:36:14.548 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.548 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.548 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:14.548 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642213+0000", 2024-09-12T18:36:14.548 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00018701899999999999 2024-09-12T18:36:14.548 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.548 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.548 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:14.548 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642507+0000", 2024-09-12T18:36:14.548 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00029394700000000002 2024-09-12T18:36:14.548 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.548 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.548 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:14.549 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642686+0000", 2024-09-12T18:36:14.549 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000178152 2024-09-12T18:36:14.549 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.549 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.549 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:14.549 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650952+0000", 2024-09-12T18:36:14.549 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0082663570000000002 2024-09-12T18:36:14.549 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.549 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.549 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:14.549 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665382+0000", 2024-09-12T18:36:14.549 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.014430111000000001 2024-09-12T18:36:14.549 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.549 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.550 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:14.550 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665508+0000", 2024-09-12T18:36:14.550 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000125986 2024-09-12T18:36:14.550 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.550 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.550 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:14.550 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665608+0000", 2024-09-12T18:36:14.550 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9809000000000006e-05 2024-09-12T18:36:14.550 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.550 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:14.550 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.550 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.550 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.550 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:14.551 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:36:14.551 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 48.839840568, 2024-09-12T18:36:14.551 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024670563, 2024-09-12T18:36:14.551 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:14.551 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:14.551 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:14.551 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:14.551 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.551 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:14.551 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:36:14.551 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.551 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.551 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.551 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:14.552 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:36:14.552 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.552 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.552 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.552 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:14.552 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642120+0000", 2024-09-12T18:36:14.552 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1769999999999999e-06 2024-09-12T18:36:14.552 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.552 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.552 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:14.552 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642128+0000", 2024-09-12T18:36:14.552 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3429999999999998e-06 2024-09-12T18:36:14.552 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.553 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.553 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:14.553 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642192+0000", 2024-09-12T18:36:14.553 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4406999999999995e-05 2024-09-12T18:36:14.553 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.553 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.553 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:14.553 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642223+0000", 2024-09-12T18:36:14.553 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.1266000000000002e-05 2024-09-12T18:36:14.553 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.553 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.553 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:14.553 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643201+0000", 2024-09-12T18:36:14.554 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0009778390000000001 2024-09-12T18:36:14.554 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.554 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.554 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:14.554 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643410+0000", 2024-09-12T18:36:14.554 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020874199999999999 2024-09-12T18:36:14.554 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.554 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.554 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:14.554 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643685+0000", 2024-09-12T18:36:14.554 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027520700000000002 2024-09-12T18:36:14.554 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.554 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.554 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:14.555 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650966+0000", 2024-09-12T18:36:14.555 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072810710000000001 2024-09-12T18:36:14.555 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.555 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.555 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:14.555 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666560+0000", 2024-09-12T18:36:14.555 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015594143 2024-09-12T18:36:14.555 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.555 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.555 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:14.555 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666691+0000", 2024-09-12T18:36:14.555 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000130359 2024-09-12T18:36:14.555 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.555 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.556 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:14.556 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666790+0000", 2024-09-12T18:36:14.556 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9009e-05 2024-09-12T18:36:14.556 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.556 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:14.556 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.556 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.556 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.556 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:14.556 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:36:14.556 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 48.83906228, 2024-09-12T18:36:14.556 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024891744, 2024-09-12T18:36:14.556 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:14.557 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:14.557 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:14.557 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:14.557 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.557 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:14.557 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:36:14.557 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.557 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.557 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.557 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:14.557 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:36:14.557 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.557 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.558 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.558 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:14.558 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642899+0000", 2024-09-12T18:36:14.558 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4729999999999999e-06 2024-09-12T18:36:14.558 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.558 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.558 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:14.558 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642912+0000", 2024-09-12T18:36:14.558 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3495999999999999e-05 2024-09-12T18:36:14.558 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.558 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.558 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:14.558 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642934+0000", 2024-09-12T18:36:14.558 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2033999999999999e-05 2024-09-12T18:36:14.559 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.559 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.559 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:14.559 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642949+0000", 2024-09-12T18:36:14.559 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4970000000000001e-05 2024-09-12T18:36:14.559 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.559 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.559 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:14.559 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644400+0000", 2024-09-12T18:36:14.559 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001450305 2024-09-12T18:36:14.559 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.559 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.559 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:14.559 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644617+0000", 2024-09-12T18:36:14.560 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000217302 2024-09-12T18:36:14.560 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.560 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.560 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:14.560 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645052+0000", 2024-09-12T18:36:14.560 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000434797 2024-09-12T18:36:14.560 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.560 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.560 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:14.560 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653860+0000", 2024-09-12T18:36:14.560 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0088082249999999994 2024-09-12T18:36:14.560 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.560 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.561 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:14.561 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667598+0000", 2024-09-12T18:36:14.561 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.013738451 2024-09-12T18:36:14.561 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.561 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.561 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:14.561 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667698+0000", 2024-09-12T18:36:14.561 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9854999999999999e-05 2024-09-12T18:36:14.561 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.561 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.561 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:14.561 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667789+0000", 2024-09-12T18:36:14.562 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0835999999999996e-05 2024-09-12T18:36:14.562 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.562 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:14.562 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.562 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.562 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.562 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:30 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:14.562 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:36:14.562 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 48.838987463999999, 2024-09-12T18:36:14.562 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023936852000000002, 2024-09-12T18:36:14.562 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:14.562 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:14.562 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:14.563 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:14.563 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.563 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:14.563 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:36:14.563 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.563 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.563 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.563 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:14.563 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:36:14.563 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.563 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.563 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.563 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:14.564 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642973+0000", 2024-09-12T18:36:14.564 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.11e-06 2024-09-12T18:36:14.564 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.564 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.564 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:14.564 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642994+0000", 2024-09-12T18:36:14.564 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.0699999999999998e-05 2024-09-12T18:36:14.564 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.564 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.564 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:14.564 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643011+0000", 2024-09-12T18:36:14.564 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7229999999999999e-05 2024-09-12T18:36:14.564 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.565 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.565 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:14.565 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643025+0000", 2024-09-12T18:36:14.565 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3803e-05 2024-09-12T18:36:14.565 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.565 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.565 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:14.565 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643143+0000", 2024-09-12T18:36:14.565 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000118225 2024-09-12T18:36:14.565 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.565 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.565 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:14.566 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643426+0000", 2024-09-12T18:36:14.566 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00028250500000000001 2024-09-12T18:36:14.566 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.566 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.566 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:14.566 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643864+0000", 2024-09-12T18:36:14.566 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00043856 2024-09-12T18:36:14.566 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.566 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.566 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:14.566 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651148+0000", 2024-09-12T18:36:14.566 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072836769999999997 2024-09-12T18:36:14.566 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.566 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.567 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:14.567 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666674+0000", 2024-09-12T18:36:14.567 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015525786999999999 2024-09-12T18:36:14.567 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.567 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.567 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:14.567 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666796+0000", 2024-09-12T18:36:14.567 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000122416 2024-09-12T18:36:14.567 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.567 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.567 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:14.567 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666909+0000", 2024-09-12T18:36:14.568 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011283899999999999 2024-09-12T18:36:14.568 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.568 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:14.568 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.568 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.568 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.568 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:14.568 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:36:14.568 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 48.838904757999998, 2024-09-12T18:36:14.568 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024100234000000002, 2024-09-12T18:36:14.568 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:14.568 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:14.568 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:14.569 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:14.569 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.569 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:14.569 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:36:14.569 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.569 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.569 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.569 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:14.569 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:36:14.569 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.569 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.569 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.569 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:14.570 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643056+0000", 2024-09-12T18:36:14.570 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.046e-06 2024-09-12T18:36:14.570 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.570 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.570 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:14.570 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643068+0000", 2024-09-12T18:36:14.570 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2106999999999999e-05 2024-09-12T18:36:14.570 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.570 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.570 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:14.570 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643085+0000", 2024-09-12T18:36:14.570 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7479999999999999e-05 2024-09-12T18:36:14.570 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.571 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.571 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:14.571 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643099+0000", 2024-09-12T18:36:14.571 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3730000000000001e-05 2024-09-12T18:36:14.571 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.571 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.571 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:14.571 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644623+0000", 2024-09-12T18:36:14.571 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0015236080000000001 2024-09-12T18:36:14.571 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.571 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.571 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:14.571 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644893+0000", 2024-09-12T18:36:14.572 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026990500000000003 2024-09-12T18:36:14.572 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.572 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.572 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:14.572 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645227+0000", 2024-09-12T18:36:14.572 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00033391300000000003 2024-09-12T18:36:14.572 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.572 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.572 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:14.572 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653926+0000", 2024-09-12T18:36:14.572 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0086993339999999995 2024-09-12T18:36:14.572 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.572 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.573 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:14.573 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666925+0000", 2024-09-12T18:36:14.573 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012998686000000001 2024-09-12T18:36:14.573 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.573 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.573 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:14.573 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667057+0000", 2024-09-12T18:36:14.573 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013255600000000001 2024-09-12T18:36:14.573 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.573 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.573 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:14.573 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667155+0000", 2024-09-12T18:36:14.573 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7868999999999994e-05 2024-09-12T18:36:14.574 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.574 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:14.574 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.574 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.574 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.574 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:14.574 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643139+0000", 2024-09-12T18:36:14.574 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 48.838820171999998, 2024-09-12T18:36:14.574 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.022417057000000001, 2024-09-12T18:36:14.574 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:14.574 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:14.574 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:14.574 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:14.574 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.575 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:14.575 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643139+0000", 2024-09-12T18:36:14.575 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.575 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.575 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.575 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:14.575 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643139+0000", 2024-09-12T18:36:14.575 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.575 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.575 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.575 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:14.575 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643140+0000", 2024-09-12T18:36:14.575 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0729999999999999e-06 2024-09-12T18:36:14.576 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.576 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.576 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:14.576 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643151+0000", 2024-09-12T18:36:14.576 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.039e-05 2024-09-12T18:36:14.576 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.576 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.576 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:14.576 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643168+0000", 2024-09-12T18:36:14.576 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7575999999999999e-05 2024-09-12T18:36:14.576 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.576 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.576 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:14.577 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643182+0000", 2024-09-12T18:36:14.577 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3224000000000001e-05 2024-09-12T18:36:14.577 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.577 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.577 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:14.577 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643358+0000", 2024-09-12T18:36:14.577 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00017676500000000001 2024-09-12T18:36:14.577 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.577 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.577 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:14.577 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643647+0000", 2024-09-12T18:36:14.577 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00028850499999999999 2024-09-12T18:36:14.577 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.578 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.578 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:14.578 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643924+0000", 2024-09-12T18:36:14.578 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000277547 2024-09-12T18:36:14.578 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.578 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.578 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:14.578 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650289+0000", 2024-09-12T18:36:14.578 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0063645350000000002 2024-09-12T18:36:14.578 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.578 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.578 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:14.578 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665333+0000", 2024-09-12T18:36:14.578 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015043531000000001 2024-09-12T18:36:14.579 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.579 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.579 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:14.579 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665454+0000", 2024-09-12T18:36:14.579 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000121302 2024-09-12T18:36:14.579 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.579 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.579 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:14.579 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665556+0000", 2024-09-12T18:36:14.579 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010260900000000001 2024-09-12T18:36:14.579 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.579 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:14.579 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.580 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.580 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.580 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:14.580 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:36:14.580 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 48.838708969000002, 2024-09-12T18:36:14.580 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024255982999999998, 2024-09-12T18:36:14.580 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:14.580 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:14.580 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:14.580 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:14.580 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.580 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:14.580 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:36:14.581 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.581 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.581 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.581 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:14.581 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:36:14.581 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.581 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.581 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.581 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:14.581 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643252+0000", 2024-09-12T18:36:14.581 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:14.581 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.581 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.582 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:14.582 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643287+0000", 2024-09-12T18:36:14.582 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5225999999999998e-05 2024-09-12T18:36:14.582 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.582 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.582 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:14.582 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643323+0000", 2024-09-12T18:36:14.582 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5488999999999999e-05 2024-09-12T18:36:14.582 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.582 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.582 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:14.582 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643357+0000", 2024-09-12T18:36:14.582 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.3853999999999998e-05 2024-09-12T18:36:14.582 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.583 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.583 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:14.583 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646716+0000", 2024-09-12T18:36:14.583 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003359 2024-09-12T18:36:14.583 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.583 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.583 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:14.583 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647037+0000", 2024-09-12T18:36:14.583 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032131800000000002 2024-09-12T18:36:14.583 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.583 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.583 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:14.583 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647337+0000", 2024-09-12T18:36:14.583 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000300208 2024-09-12T18:36:14.584 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.584 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.584 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:14.584 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654291+0000", 2024-09-12T18:36:14.584 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0069543089999999997 2024-09-12T18:36:14.584 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.584 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.584 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:14.584 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667297+0000", 2024-09-12T18:36:14.584 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.013005526 2024-09-12T18:36:14.584 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.584 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.584 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:14.585 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667416+0000", 2024-09-12T18:36:14.585 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000119416 2024-09-12T18:36:14.585 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.585 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.585 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:14.585 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667507+0000", 2024-09-12T18:36:14.585 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0206999999999999e-05 2024-09-12T18:36:14.585 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.585 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:14.585 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.585 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.585 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.585 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:14.585 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:36:14.586 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 48.838581873999999, 2024-09-12T18:36:14.586 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023888482999999999, 2024-09-12T18:36:14.586 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:14.586 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:14.586 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:14.586 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:14.586 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.586 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:14.586 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:36:14.586 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.586 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.586 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.586 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:14.587 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:36:14.587 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.587 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.587 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.587 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:14.587 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643379+0000", 2024-09-12T18:36:14.587 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.207e-06 2024-09-12T18:36:14.587 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.587 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.587 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:14.587 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643390+0000", 2024-09-12T18:36:14.587 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0696000000000001e-05 2024-09-12T18:36:14.587 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.588 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.588 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:14.588 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643407+0000", 2024-09-12T18:36:14.588 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7563000000000001e-05 2024-09-12T18:36:14.588 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.588 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.588 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:14.588 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643420+0000", 2024-09-12T18:36:14.588 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3277e-05 2024-09-12T18:36:14.588 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.588 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.588 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:14.588 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644906+0000", 2024-09-12T18:36:14.589 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001485945 2024-09-12T18:36:14.589 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.589 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.589 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:14.589 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645404+0000", 2024-09-12T18:36:14.589 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00049807599999999997 2024-09-12T18:36:14.589 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.589 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.589 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:14.589 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645846+0000", 2024-09-12T18:36:14.589 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00044190400000000002 2024-09-12T18:36:14.589 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.589 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.589 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:14.590 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654223+0000", 2024-09-12T18:36:14.590 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0083767419999999995 2024-09-12T18:36:14.590 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.590 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.590 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:14.590 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667026+0000", 2024-09-12T18:36:14.590 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012802531000000001 2024-09-12T18:36:14.590 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.590 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.590 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:14.590 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667162+0000", 2024-09-12T18:36:14.590 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000136112 2024-09-12T18:36:14.590 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.590 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.590 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:14.590 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667266+0000", 2024-09-12T18:36:14.591 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010443 2024-09-12T18:36:14.591 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.591 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:14.591 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.591 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.591 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.591 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:14.591 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643447+0000", 2024-09-12T18:36:14.591 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 48.838512348000002, 2024-09-12T18:36:14.591 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.022081562999999998, 2024-09-12T18:36:14.591 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:14.591 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:14.591 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:14.592 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:14.592 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.592 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:14.592 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643447+0000", 2024-09-12T18:36:14.592 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.592 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.592 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.592 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:14.592 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643447+0000", 2024-09-12T18:36:14.592 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.592 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.592 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.592 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:14.593 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643448+0000", 2024-09-12T18:36:14.593 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1629999999999999e-06 2024-09-12T18:36:14.593 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.593 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.593 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:14.593 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643458+0000", 2024-09-12T18:36:14.593 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.8400000000000007e-06 2024-09-12T18:36:14.593 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.593 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.593 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:14.593 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643475+0000", 2024-09-12T18:36:14.593 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6874000000000001e-05 2024-09-12T18:36:14.593 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.594 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.594 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:14.594 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643488+0000", 2024-09-12T18:36:14.594 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3026e-05 2024-09-12T18:36:14.594 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.594 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.594 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:14.594 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643931+0000", 2024-09-12T18:36:14.594 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00044307 2024-09-12T18:36:14.594 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.594 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.594 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:14.594 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644210+0000", 2024-09-12T18:36:14.595 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027908400000000003 2024-09-12T18:36:14.595 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.595 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.595 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:14.595 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644606+0000", 2024-09-12T18:36:14.595 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00039615400000000002 2024-09-12T18:36:14.595 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.595 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.595 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:14.595 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650552+0000", 2024-09-12T18:36:14.595 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0059455619999999997 2024-09-12T18:36:14.595 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.595 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.596 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:14.596 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665302+0000", 2024-09-12T18:36:14.596 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.014749962 2024-09-12T18:36:14.596 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.596 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.596 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:14.596 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665424+0000", 2024-09-12T18:36:14.596 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012214300000000001 2024-09-12T18:36:14.596 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.596 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.596 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:14.596 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665529+0000", 2024-09-12T18:36:14.596 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000104685 2024-09-12T18:36:14.596 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.597 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:14.597 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.597 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.597 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.597 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:14.597 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:36:14.597 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 48.838431155000002, 2024-09-12T18:36:14.597 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024222582999999999, 2024-09-12T18:36:14.597 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:14.597 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:14.597 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:14.597 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:14.597 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.597 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:14.598 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:36:14.598 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.598 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.598 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.598 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:14.598 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:36:14.598 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:14.598 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.598 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.598 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:14.598 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643530+0000", 2024-09-12T18:36:14.598 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.393e-06 2024-09-12T18:36:14.599 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.599 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.599 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:14.599 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643536+0000", 2024-09-12T18:36:14.599 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4130000000000003e-06 2024-09-12T18:36:14.599 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.599 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.599 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:14.599 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643554+0000", 2024-09-12T18:36:14.599 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7572999999999999e-05 2024-09-12T18:36:14.599 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.599 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.599 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:14.599 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643567+0000", 2024-09-12T18:36:14.600 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3393999999999999e-05 2024-09-12T18:36:14.600 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.600 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.600 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:14.600 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648198+0000", 2024-09-12T18:36:14.600 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0046304479999999997 2024-09-12T18:36:14.600 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.600 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.600 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:14.600 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648413+0000", 2024-09-12T18:36:14.600 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00021507500000000001 2024-09-12T18:36:14.600 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:14.600 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:14.601 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:14.601 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667751+0000", 2024-09-12T18:36:14.601 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.019338286999999999 2024-09-12T18:36:14.601 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.601 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:14.601 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.601 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:14.601 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:14.601 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:36:14.602 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:36:14.603 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:14.596+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:14.603 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:36:14.604 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:36:14.604 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:36:14.604 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:36:14.605 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:36:14.606 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:36:14.703 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:14.700+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:14.755 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:14.756 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:14.776 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:36:14.804 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:14.797+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:14.871 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 29 16 73431 73415 158.205 130.125 0.00664231 0.00631606 2024-09-12T18:36:14.905 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:14.900+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:14.981 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:14.981 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:15.000 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:36:15.005 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:15.000+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:15.107 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:15.100+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:15.151 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:15.151 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:15.173 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:36:15.220 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:15.220+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:15.308 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:15.308+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:15.330 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:15.330 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:15.350 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:36:15.408 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:15.401+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:15.447 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is unset 2024-09-12T18:36:15.509 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:15.508+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:15.524 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:15.525 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:15.545 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:36:15.632 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:15.632+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:15.711 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:15.705+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:15.744 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:15.744 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:15.765 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:36:15.812 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:15.808+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:15.871 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 30 16 75321 75305 156.869 118.125 0.00778277 0.00637001 2024-09-12T18:36:15.913 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:15.909+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:15.928 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:15.928 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:15.950 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:36:16.013 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:16.008+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:16.114 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:16.109+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:16.147 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:16.147 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:16.170 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:36:16.215 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:16.212+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:16.316 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:16.316+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:16.380 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:16.380 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:16.402 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:36:16.417 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:16.416+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:16.518 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:16.512+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:16.524 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:36:16.524 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:36:16.524 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:36:16.556 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:16.556 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:16.576 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:36:16.607 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:36:16.618 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:16.616+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:16.720 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:16.713+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:16.761 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:36:16.762 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:36:16.769 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:16.769 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2024-09-12T18:36:16.769 INFO:teuthology.orchestra.run.smithi114.stdout: "complaint_time": 30, 2024-09-12T18:36:16.769 INFO:teuthology.orchestra.run.smithi114.stdout: "num_blocked_ops": 0 2024-09-12T18:36:16.769 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:16.780 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:36:16.780 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:36:16.792 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:36:16.798 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:36:16.798 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:36:16.820 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:16.813+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:16.859 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:36:16.862 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T18:36:16.871 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 31 16 77409 77393 156.018 130.5 0.00408137 0.00640491 2024-09-12T18:36:16.878 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-09-12T18:36:16.390918+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4450945949,"num_objects":67933,"num_object_clones":0,"num_object_copies":135866,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67933,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":68099,"num_write_kb":4348736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60761,"ondisk_log_size":60761,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":772052,"kb_used_data":535512,"kb_used_omap":4,"kb_used_meta":236475,"kb_avail":282343468,"statfs":{"total":289910292480,"available":289119711232,"internally_reserved":0,"allocated":548364288,"data_stored":8754264321,"data_compressed":415690373,"data_compressed_allocated":547131392,"data_compressed_original":8753807360,"omap_allocated":4783,"internal_metadata":242150737},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,3,4,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":694943744,"num_objects":10604,"num_object_clones":0,"num_object_copies":21208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10604,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10604,"num_write_kb":678656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.484725"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.333475+0000","last_change":"2024-09-12T18:35:25.657389+0000","last_active":"2024-09-12T18:36:12.333475+0000","last_peered":"2024-09-12T18:36:12.333475+0000","last_clean":"2024-09-12T18:36:12.333475+0000","last_became_active":"2024-09-12T18:35:25.651857+0000","last_became_peered":"2024-09-12T18:35:25.651857+0000","last_unstale":"2024-09-12T18:36:12.333475+0000","last_undegraded":"2024-09-12T18:36:12.333475+0000","last_fullsized":"2024-09-12T18:36:12.333475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:50.264536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.332793+0000","last_change":"2024-09-12T18:35:25.659760+0000","last_active":"2024-09-12T18:36:12.332793+0000","last_peered":"2024-09-12T18:36:12.332793+0000","last_clean":"2024-09-12T18:36:12.332793+0000","last_became_active":"2024-09-12T18:35:25.654920+0000","last_became_peered":"2024-09-12T18:35:25.654920+0000","last_unstale":"2024-09-12T18:36:12.332793+0000","last_undegraded":"2024-09-12T18:36:12.332793+0000","last_fullsized":"2024-09-12T18:36:12.332793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:21.519881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.912942+0000","last_change":"2024-09-12T18:35:25.659460+0000","last_active":"2024-09-12T18:36:09.912942+0000","last_peered":"2024-09-12T18:36:09.912942+0000","last_clean":"2024-09-12T18:36:09.912942+0000","last_became_active":"2024-09-12T18:35:25.657782+0000","last_became_peered":"2024-09-12T18:35:25.657782+0000","last_unstale":"2024-09-12T18:36:09.912942+0000","last_undegraded":"2024-09-12T18:36:09.912942+0000","last_fullsized":"2024-09-12T18:36:09.912942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:38.544284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.911403+0000","last_change":"2024-09-12T18:35:25.663617+0000","last_active":"2024-09-12T18:36:09.911403+0000","last_peered":"2024-09-12T18:36:09.911403+0000","last_clean":"2024-09-12T18:36:09.911403+0000","last_became_active":"2024-09-12T18:35:25.661977+0000","last_became_peered":"2024-09-12T18:35:25.661977+0000","last_unstale":"2024-09-12T18:36:09.911403+0000","last_undegraded":"2024-09-12T18:36:09.911403+0000","last_fullsized":"2024-09-12T18:36:09.911403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:14.748234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.332990+0000","last_change":"2024-09-12T18:35:25.656566+0000","last_active":"2024-09-12T18:36:12.332990+0000","last_peered":"2024-09-12T18:36:12.332990+0000","last_clean":"2024-09-12T18:36:12.332990+0000","last_became_active":"2024-09-12T18:35:25.654898+0000","last_became_peered":"2024-09-12T18:35:25.654898+0000","last_unstale":"2024-09-12T18:36:12.332990+0000","last_undegraded":"2024-09-12T18:36:12.332990+0000","last_fullsized":"2024-09-12T18:36:12.332990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:36.113250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.909970+0000","last_change":"2024-09-12T18:35:25.652754+0000","last_active":"2024-09-12T18:36:09.909970+0000","last_peered":"2024-09-12T18:36:09.909970+0000","last_clean":"2024-09-12T18:36:09.909970+0000","last_became_active":"2024-09-12T18:35:25.651217+0000","last_became_peered":"2024-09-12T18:35:25.651217+0000","last_unstale":"2024-09-12T18:36:09.909970+0000","last_undegraded":"2024-09-12T18:36:09.909970+0000","last_fullsized":"2024-09-12T18:36:09.909970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:24.585774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.911277+0000","last_change":"2024-09-12T18:35:25.659811+0000","last_active":"2024-09-12T18:36:09.911277+0000","last_peered":"2024-09-12T18:36:09.911277+0000","last_clean":"2024-09-12T18:36:09.911277+0000","last_became_active":"2024-09-12T18:35:25.658998+0000","last_became_peered":"2024-09-12T18:35:25.658998+0000","last_unstale":"2024-09-12T18:36:09.911277+0000","last_undegraded":"2024-09-12T18:36:09.911277+0000","last_fullsized":"2024-09-12T18:36:09.911277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.909618+0000","last_change":"2024-09-12T18:35:25.653999+0000","last_active":"2024-09-12T18:36:09.909618+0000","last_peered":"2024-09-12T18:36:09.909618+0000","last_clean":"2024-09-12T18:36:09.909618+0000","last_became_active":"2024-09-12T18:35:25.653319+0000","last_became_peered":"2024-09-12T18:35:25.653319+0000","last_unstale":"2024-09-12T18:36:09.909618+0000","last_undegraded":"2024-09-12T18:36:09.909618+0000","last_fullsized":"2024-09-12T18:36:09.909618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:04.718000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.912773+0000","last_change":"2024-09-12T18:35:25.668339+0000","last_active":"2024-09-12T18:36:09.912773+0000","last_peered":"2024-09-12T18:36:09.912773+0000","last_clean":"2024-09-12T18:36:09.912773+0000","last_became_active":"2024-09-12T18:35:25.667608+0000","last_became_peered":"2024-09-12T18:35:25.667608+0000","last_unstale":"2024-09-12T18:36:09.912773+0000","last_undegraded":"2024-09-12T18:36:09.912773+0000","last_fullsized":"2024-09-12T18:36:09.912773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:15.699745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.332956+0000","last_change":"2024-09-12T18:35:25.660174+0000","last_active":"2024-09-12T18:36:12.332956+0000","last_peered":"2024-09-12T18:36:12.332956+0000","last_clean":"2024-09-12T18:36:12.332956+0000","last_became_active":"2024-09-12T18:35:25.656560+0000","last_became_peered":"2024-09-12T18:35:25.656560+0000","last_unstale":"2024-09-12T18:36:12.332956+0000","last_undegraded":"2024-09-12T18:36:12.332956+0000","last_fullsized":"2024-09-12T18:36:12.332956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:47.268505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.913070+0000","last_change":"2024-09-12T18:35:25.649858+0000","last_active":"2024-09-12T18:36:09.913070+0000","last_peered":"2024-09-12T18:36:09.913070+0000","last_clean":"2024-09-12T18:36:09.913070+0000","last_became_active":"2024-09-12T18:35:25.649090+0000","last_became_peered":"2024-09-12T18:35:25.649090+0000","last_unstale":"2024-09-12T18:36:09.913070+0000","last_undegraded":"2024-09-12T18:36:09.913070+0000","last_fullsized":"2024-09-12T18:36:09.913070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:33.158421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.332454+0000","last_change":"2024-09-12T18:35:25.649885+0000","last_active":"2024-09-12T18:36:12.332454+0000","last_peered":"2024-09-12T18:36:12.332454+0000","last_clean":"2024-09-12T18:36:12.332454+0000","last_became_active":"2024-09-12T18:35:25.649111+0000","last_became_peered":"2024-09-12T18:35:25.649111+0000","last_unstale":"2024-09-12T18:36:12.332454+0000","last_undegraded":"2024-09-12T18:36:12.332454+0000","last_fullsized":"2024-09-12T18:36:12.332454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:17.162410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.332807+0000","last_change":"2024-09-12T18:35:25.651541+0000","last_active":"2024-09-12T18:36:12.332807+0000","last_peered":"2024-09-12T18:36:12.332807+0000","last_clean":"2024-09-12T18:36:12.332807+0000","last_became_active":"2024-09-12T18:35:25.650661+0000","last_became_peered":"2024-09-12T18:35:25.650661+0000","last_unstale":"2024-09-12T18:36:12.332807+0000","last_undegraded":"2024-09-12T18:36:12.332807+0000","last_fullsized":"2024-09-12T18:36:12.332807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:52.082734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.910072+0000","last_change":"2024-09-12T18:35:25.657913+0000","last_active":"2024-09-12T18:36:09.910072+0000","last_peered":"2024-09-12T18:36:09.910072+0000","last_clean":"2024-09-12T18:36:09.910072+0000","last_became_active":"2024-09-12T18:35:25.657082+0000","last_became_peered":"2024-09-12T18:35:25.657082+0000","last_unstale":"2024-09-12T18:36:09.910072+0000","last_undegraded":"2024-09-12T18:36:09.910072+0000","last_fullsized":"2024-09-12T18:36:09.910072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:21.538633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.911282+0000","last_change":"2024-09-12T18:35:25.658763+0000","last_active":"2024-09-12T18:36:09.911282+0000","last_peered":"2024-09-12T18:36:09.911282+0000","last_clean":"2024-09-12T18:36:09.911282+0000","last_became_active":"2024-09-12T18:35:25.657508+0000","last_became_peered":"2024-09-12T18:35:25.657508+0000","last_unstale":"2024-09-12T18:36:09.911282+0000","last_undegraded":"2024-09-12T18:36:09.911282+0000","last_fullsized":"2024-09-12T18:36:09.911282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:13.170519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.909682+0000","last_change":"2024-09-12T18:35:25.653730+0000","last_active":"2024-09-12T18:36:09.909682+0000","last_peered":"2024-09-12T18:36:09.909682+0000","last_clean":"2024-09-12T18:36:09.909682+0000","last_became_active":"2024-09-12T18:35:25.651535+0000","last_became_peered":"2024-09-12T18:35:25.651535+0000","last_unstale":"2024-09-12T18:36:09.909682+0000","last_undegraded":"2024-09-12T18:36:09.909682+0000","last_fullsized":"2024-09-12T18:36:09.909682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.913350+0000","last_change":"2024-09-12T18:35:25.656513+0000","last_active":"2024-09-12T18:36:09.913350+0000","last_peered":"2024-09-12T18:36:09.913350+0000","last_clean":"2024-09-12T18:36:09.913350+0000","last_became_active":"2024-09-12T18:35:25.653440+0000","last_became_peered":"2024-09-12T18:35:25.653440+0000","last_unstale":"2024-09-12T18:36:09.913350+0000","last_undegraded":"2024-09-12T18:36:09.913350+0000","last_fullsized":"2024-09-12T18:36:09.913350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:18.693161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.333091+0000","last_change":"2024-09-12T18:35:25.657991+0000","last_active":"2024-09-12T18:36:12.333091+0000","last_peered":"2024-09-12T18:36:12.333091+0000","last_clean":"2024-09-12T18:36:12.333091+0000","last_became_active":"2024-09-12T18:35:25.653934+0000","last_became_peered":"2024-09-12T18:35:25.653934+0000","last_unstale":"2024-09-12T18:36:12.333091+0000","last_undegraded":"2024-09-12T18:36:12.333091+0000","last_fullsized":"2024-09-12T18:36:12.333091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:05.418901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.913204+0000","last_change":"2024-09-12T18:35:25.658819+0000","last_active":"2024-09-12T18:36:09.913204+0000","last_peered":"2024-09-12T18:36:09.913204+0000","last_clean":"2024-09-12T18:36:09.913204+0000","last_became_active":"2024-09-12T18:35:25.656843+0000","last_became_peered":"2024-09-12T18:35:25.656843+0000","last_unstale":"2024-09-12T18:36:09.913204+0000","last_undegraded":"2024-09-12T18:36:09.913204+0000","last_fullsized":"2024-09-12T18:36:09.913204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:55.291963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.911550+0000","last_change":"2024-09-12T18:35:25.661176+0000","last_active":"2024-09-12T18:36:09.911550+0000","last_peered":"2024-09-12T18:36:09.911550+0000","last_clean":"2024-09-12T18:36:09.911550+0000","last_became_active":"2024-09-12T18:35:25.659534+0000","last_became_peered":"2024-09-12T18:35:25.659534+0000","last_unstale":"2024-09-12T18:36:09.911550+0000","last_undegraded":"2024-09-12T18:36:09.911550+0000","last_fullsized":"2024-09-12T18:36:09.911550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:40.145442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.911685+0000","last_change":"2024-09-12T18:35:25.650632+0000","last_active":"2024-09-12T18:36:09.911685+0000","last_peered":"2024-09-12T18:36:09.911685+0000","last_clean":"2024-09-12T18:36:09.911685+0000","last_became_active":"2024-09-12T18:35:25.649333+0000","last_became_peered":"2024-09-12T18:35:25.649333+0000","last_unstale":"2024-09-12T18:36:09.911685+0000","last_undegraded":"2024-09-12T18:36:09.911685+0000","last_fullsized":"2024-09-12T18:36:09.911685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:30.537572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.333467+0000","last_change":"2024-09-12T18:35:25.648245+0000","last_active":"2024-09-12T18:36:12.333467+0000","last_peered":"2024-09-12T18:36:12.333467+0000","last_clean":"2024-09-12T18:36:12.333467+0000","last_became_active":"2024-09-12T18:35:25.646357+0000","last_became_peered":"2024-09-12T18:35:25.646357+0000","last_unstale":"2024-09-12T18:36:12.333467+0000","last_undegraded":"2024-09-12T18:36:12.333467+0000","last_fullsized":"2024-09-12T18:36:12.333467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:05.662140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.912037+0000","last_change":"2024-09-12T18:35:25.661613+0000","last_active":"2024-09-12T18:36:09.912037+0000","last_peered":"2024-09-12T18:36:09.912037+0000","last_clean":"2024-09-12T18:36:09.912037+0000","last_became_active":"2024-09-12T18:35:25.658833+0000","last_became_peered":"2024-09-12T18:35:25.658833+0000","last_unstale":"2024-09-12T18:36:09.912037+0000","last_undegraded":"2024-09-12T18:36:09.912037+0000","last_fullsized":"2024-09-12T18:36:09.912037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:51.064080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.332176+0000","last_change":"2024-09-12T18:35:25.657782+0000","last_active":"2024-09-12T18:36:12.332176+0000","last_peered":"2024-09-12T18:36:12.332176+0000","last_clean":"2024-09-12T18:36:12.332176+0000","last_became_active":"2024-09-12T18:35:25.655295+0000","last_became_peered":"2024-09-12T18:35:25.655295+0000","last_unstale":"2024-09-12T18:36:12.332176+0000","last_undegraded":"2024-09-12T18:36:12.332176+0000","last_fullsized":"2024-09-12T18:36:12.332176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:37.744175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.333582+0000","last_change":"2024-09-12T18:35:25.654863+0000","last_active":"2024-09-12T18:36:12.333582+0000","last_peered":"2024-09-12T18:36:12.333582+0000","last_clean":"2024-09-12T18:36:12.333582+0000","last_became_active":"2024-09-12T18:35:25.650407+0000","last_became_peered":"2024-09-12T18:35:25.650407+0000","last_unstale":"2024-09-12T18:36:12.333582+0000","last_undegraded":"2024-09-12T18:36:12.333582+0000","last_fullsized":"2024-09-12T18:36:12.333582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:38.395666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.913143+0000","last_change":"2024-09-12T18:35:25.662414+0000","last_active":"2024-09-12T18:36:09.913143+0000","last_peered":"2024-09-12T18:36:09.913143+0000","last_clean":"2024-09-12T18:36:09.913143+0000","last_became_active":"2024-09-12T18:35:25.660126+0000","last_became_peered":"2024-09-12T18:35:25.660126+0000","last_unstale":"2024-09-12T18:36:09.913143+0000","last_undegraded":"2024-09-12T18:36:09.913143+0000","last_fullsized":"2024-09-12T18:36:09.913143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:48.437139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.913122+0000","last_change":"2024-09-12T18:35:25.661523+0000","last_active":"2024-09-12T18:36:09.913122+0000","last_peered":"2024-09-12T18:36:09.913122+0000","last_clean":"2024-09-12T18:36:09.913122+0000","last_became_active":"2024-09-12T18:35:25.659338+0000","last_became_peered":"2024-09-12T18:35:25.659338+0000","last_unstale":"2024-09-12T18:36:09.913122+0000","last_undegraded":"2024-09-12T18:36:09.913122+0000","last_fullsized":"2024-09-12T18:36:09.913122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:37.083820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.332780+0000","last_change":"2024-09-12T18:35:25.662445+0000","last_active":"2024-09-12T18:36:12.332780+0000","last_peered":"2024-09-12T18:36:12.332780+0000","last_clean":"2024-09-12T18:36:12.332780+0000","last_became_active":"2024-09-12T18:35:25.659496+0000","last_became_peered":"2024-09-12T18:35:25.659496+0000","last_unstale":"2024-09-12T18:36:12.332780+0000","last_undegraded":"2024-09-12T18:36:12.332780+0000","last_fullsized":"2024-09-12T18:36:12.332780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:03.270420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.913561+0000","last_change":"2024-09-12T18:35:25.662519+0000","last_active":"2024-09-12T18:36:09.913561+0000","last_peered":"2024-09-12T18:36:09.913561+0000","last_clean":"2024-09-12T18:36:09.913561+0000","last_became_active":"2024-09-12T18:35:25.652964+0000","last_became_peered":"2024-09-12T18:35:25.652964+0000","last_unstale":"2024-09-12T18:36:09.913561+0000","last_undegraded":"2024-09-12T18:36:09.913561+0000","last_fullsized":"2024-09-12T18:36:09.913561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:37.923468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.333674+0000","last_change":"2024-09-12T18:35:25.650507+0000","last_active":"2024-09-12T18:36:12.333674+0000","last_peered":"2024-09-12T18:36:12.333674+0000","last_clean":"2024-09-12T18:36:12.333674+0000","last_became_active":"2024-09-12T18:35:25.649415+0000","last_became_peered":"2024-09-12T18:35:25.649415+0000","last_unstale":"2024-09-12T18:36:12.333674+0000","last_undegraded":"2024-09-12T18:36:12.333674+0000","last_fullsized":"2024-09-12T18:36:12.333674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:23.081416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.912189+0000","last_change":"2024-09-12T18:35:25.653949+0000","last_active":"2024-09-12T18:36:09.912189+0000","last_peered":"2024-09-12T18:36:09.912189+0000","last_clean":"2024-09-12T18:36:09.912189+0000","last_became_active":"2024-09-12T18:35:25.652992+0000","last_became_peered":"2024-09-12T18:35:25.652992+0000","last_unstale":"2024-09-12T18:36:09.912189+0000","last_undegraded":"2024-09-12T18:36:09.912189+0000","last_fullsized":"2024-09-12T18:36:09.912189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:47.687372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.909712+0000","last_change":"2024-09-12T18:35:25.653159+0000","last_active":"2024-09-12T18:36:09.909712+0000","last_peered":"2024-09-12T18:36:09.909712+0000","last_clean":"2024-09-12T18:36:09.909712+0000","last_became_active":"2024-09-12T18:35:25.650551+0000","last_became_peered":"2024-09-12T18:35:25.650551+0000","last_unstale":"2024-09-12T18:36:09.909712+0000","last_undegraded":"2024-09-12T18:36:09.909712+0000","last_fullsized":"2024-09-12T18:36:09.909712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:16.245302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.332689+0000","last_change":"2024-09-12T18:35:25.651877+0000","last_active":"2024-09-12T18:36:12.332689+0000","last_peered":"2024-09-12T18:36:12.332689+0000","last_clean":"2024-09-12T18:36:12.332689+0000","last_became_active":"2024-09-12T18:35:25.651055+0000","last_became_peered":"2024-09-12T18:35:25.651055+0000","last_unstale":"2024-09-12T18:36:12.332689+0000","last_undegraded":"2024-09-12T18:36:12.332689+0000","last_fullsized":"2024-09-12T18:36:12.332689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:14.200080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.911909+0000","last_change":"2024-09-12T18:35:24.657739+0000","last_active":"2024-09-12T18:36:09.911909+0000","last_peered":"2024-09-12T18:36:09.911909+0000","last_clean":"2024-09-12T18:36:09.911909+0000","last_became_active":"2024-09-12T18:35:24.656208+0000","last_became_peered":"2024-09-12T18:35:24.656208+0000","last_unstale":"2024-09-12T18:36:09.911909+0000","last_undegraded":"2024-09-12T18:36:09.911909+0000","last_fullsized":"2024-09-12T18:36:09.911909+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:50.073716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.334111+0000","last_change":"2024-09-12T18:35:25.651651+0000","last_active":"2024-09-12T18:36:12.334111+0000","last_peered":"2024-09-12T18:36:12.334111+0000","last_clean":"2024-09-12T18:36:12.334111+0000","last_became_active":"2024-09-12T18:35:25.650849+0000","last_became_peered":"2024-09-12T18:35:25.650849+0000","last_unstale":"2024-09-12T18:36:12.334111+0000","last_undegraded":"2024-09-12T18:36:12.334111+0000","last_fullsized":"2024-09-12T18:36:12.334111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:18.555827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.912470+0000","last_change":"2024-09-12T18:35:24.656119+0000","last_active":"2024-09-12T18:36:09.912470+0000","last_peered":"2024-09-12T18:36:09.912470+0000","last_clean":"2024-09-12T18:36:09.912470+0000","last_became_active":"2024-09-12T18:35:24.653175+0000","last_became_peered":"2024-09-12T18:35:24.653175+0000","last_unstale":"2024-09-12T18:36:09.912470+0000","last_undegraded":"2024-09-12T18:36:09.912470+0000","last_fullsized":"2024-09-12T18:36:09.912470+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:00.551165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.913428+0000","last_change":"2024-09-12T18:35:25.655723+0000","last_active":"2024-09-12T18:36:09.913428+0000","last_peered":"2024-09-12T18:36:09.913428+0000","last_clean":"2024-09-12T18:36:09.913428+0000","last_became_active":"2024-09-12T18:35:25.653630+0000","last_became_peered":"2024-09-12T18:35:25.653630+0000","last_unstale":"2024-09-12T18:36:09.913428+0000","last_undegraded":"2024-09-12T18:36:09.913428+0000","last_fullsized":"2024-09-12T18:36:09.913428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:07.655792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.334109+0000","last_change":"2024-09-12T18:35:24.640096+0000","last_active":"2024-09-12T18:36:12.334109+0000","last_peered":"2024-09-12T18:36:12.334109+0000","last_clean":"2024-09-12T18:36:12.334109+0000","last_became_active":"2024-09-12T18:35:24.638230+0000","last_became_peered":"2024-09-12T18:35:24.638230+0000","last_unstale":"2024-09-12T18:36:12.334109+0000","last_undegraded":"2024-09-12T18:36:12.334109+0000","last_fullsized":"2024-09-12T18:36:12.334109+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:38.435296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.912828+0000","last_change":"2024-09-12T18:35:25.662692+0000","last_active":"2024-09-12T18:36:09.912828+0000","last_peered":"2024-09-12T18:36:09.912828+0000","last_clean":"2024-09-12T18:36:09.912828+0000","last_became_active":"2024-09-12T18:35:25.661885+0000","last_became_peered":"2024-09-12T18:35:25.661885+0000","last_unstale":"2024-09-12T18:36:09.912828+0000","last_undegraded":"2024-09-12T18:36:09.912828+0000","last_fullsized":"2024-09-12T18:36:09.912828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:41.264425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.909847+0000","last_change":"2024-09-12T18:35:24.653610+0000","last_active":"2024-09-12T18:36:09.909847+0000","last_peered":"2024-09-12T18:36:09.909847+0000","last_clean":"2024-09-12T18:36:09.909847+0000","last_became_active":"2024-09-12T18:35:24.652880+0000","last_became_peered":"2024-09-12T18:35:24.652880+0000","last_unstale":"2024-09-12T18:36:09.909847+0000","last_undegraded":"2024-09-12T18:36:09.909847+0000","last_fullsized":"2024-09-12T18:36:09.909847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:57.636251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"36'4112","reported_seq":4151,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:11.463562+0000","last_change":"2024-09-12T18:35:44.771794+0000","last_active":"2024-09-12T18:36:11.463562+0000","last_peered":"2024-09-12T18:36:11.463562+0000","last_clean":"2024-09-12T18:36:11.463562+0000","last_became_active":"2024-09-12T18:35:44.771286+0000","last_became_peered":"2024-09-12T18:35:44.771286+0000","last_unstale":"2024-09-12T18:36:11.463562+0000","last_undegraded":"2024-09-12T18:36:11.463562+0000","last_fullsized":"2024-09-12T18:36:11.463562+0000","mapping_epoch":21,"log_start":"24'400","ondisk_log_start":"24'400","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3712,"log_dups_size":0,"ondisk_log_size":3712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:10.094729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":269484032,"num_objects":4112,"num_object_clones":0,"num_object_copies":8224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4112,"num_write_kb":263168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.910868+0000","last_change":"2024-09-12T18:35:24.653465+0000","last_active":"2024-09-12T18:36:09.910868+0000","last_peered":"2024-09-12T18:36:09.910868+0000","last_clean":"2024-09-12T18:36:09.910868+0000","last_became_active":"2024-09-12T18:35:24.652792+0000","last_became_peered":"2024-09-12T18:35:24.652792+0000","last_unstale":"2024-09-12T18:36:09.910868+0000","last_undegraded":"2024-09-12T18:36:09.910868+0000","last_fullsized":"2024-09-12T18:36:09.910868+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:14.588993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.332211+0000","last_change":"2024-09-12T18:35:25.655426+0000","last_active":"2024-09-12T18:36:12.332211+0000","last_peered":"2024-09-12T18:36:12.332211+0000","last_clean":"2024-09-12T18:36:12.332211+0000","last_became_active":"2024-09-12T18:35:25.648186+0000","last_became_peered":"2024-09-12T18:35:25.648186+0000","last_unstale":"2024-09-12T18:36:12.332211+0000","last_undegraded":"2024-09-12T18:36:12.332211+0000","last_fullsized":"2024-09-12T18:36:12.332211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:48.802815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"37'4295","reported_seq":4336,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:36:13.459988+0000","last_change":"2024-09-12T18:35:44.767860+0000","last_active":"2024-09-12T18:36:13.459988+0000","last_peered":"2024-09-12T18:36:13.459988+0000","last_clean":"2024-09-12T18:36:13.459988+0000","last_became_active":"2024-09-12T18:35:44.766986+0000","last_became_peered":"2024-09-12T18:35:44.766986+0000","last_unstale":"2024-09-12T18:36:13.459988+0000","last_undegraded":"2024-09-12T18:36:13.459988+0000","last_fullsized":"2024-09-12T18:36:13.459988+0000","mapping_epoch":21,"log_start":"24'300","ondisk_log_start":"24'300","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3995,"log_dups_size":0,"ondisk_log_size":3995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:49.109157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281477120,"num_objects":4295,"num_object_clones":0,"num_object_copies":8590,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4295,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4295,"num_write_kb":274880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.333269+0000","last_change":"2024-09-12T18:35:24.648439+0000","last_active":"2024-09-12T18:36:12.333269+0000","last_peered":"2024-09-12T18:36:12.333269+0000","last_clean":"2024-09-12T18:36:12.333269+0000","last_became_active":"2024-09-12T18:35:24.647629+0000","last_became_peered":"2024-09-12T18:35:24.647629+0000","last_unstale":"2024-09-12T18:36:12.333269+0000","last_undegraded":"2024-09-12T18:36:12.333269+0000","last_fullsized":"2024-09-12T18:36:12.333269+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:45.428223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.333930+0000","last_change":"2024-09-12T18:35:25.652496+0000","last_active":"2024-09-12T18:36:12.333930+0000","last_peered":"2024-09-12T18:36:12.333930+0000","last_clean":"2024-09-12T18:36:12.333930+0000","last_became_active":"2024-09-12T18:35:25.651628+0000","last_became_peered":"2024-09-12T18:35:25.651628+0000","last_unstale":"2024-09-12T18:36:12.333930+0000","last_undegraded":"2024-09-12T18:36:12.333930+0000","last_fullsized":"2024-09-12T18:36:12.333930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:44.920448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"37'4499","reported_seq":4540,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:36:13.477557+0000","last_change":"2024-09-12T18:35:44.767175+0000","last_active":"2024-09-12T18:36:13.477557+0000","last_peered":"2024-09-12T18:36:13.477557+0000","last_clean":"2024-09-12T18:36:13.477557+0000","last_became_active":"2024-09-12T18:35:44.766592+0000","last_became_peered":"2024-09-12T18:35:44.766592+0000","last_unstale":"2024-09-12T18:36:13.477557+0000","last_undegraded":"2024-09-12T18:36:13.477557+0000","last_fullsized":"2024-09-12T18:36:13.477557+0000","mapping_epoch":21,"log_start":"24'500","ondisk_log_start":"24'500","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3999,"log_dups_size":0,"ondisk_log_size":3999,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:44.678279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":294846464,"num_objects":4499,"num_object_clones":0,"num_object_copies":8998,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4499,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4499,"num_write_kb":287936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.913470+0000","last_change":"2024-09-12T18:35:24.654976+0000","last_active":"2024-09-12T18:36:09.913470+0000","last_peered":"2024-09-12T18:36:09.913470+0000","last_clean":"2024-09-12T18:36:09.913470+0000","last_became_active":"2024-09-12T18:35:24.654264+0000","last_became_peered":"2024-09-12T18:35:24.654264+0000","last_unstale":"2024-09-12T18:36:09.913470+0000","last_undegraded":"2024-09-12T18:36:09.913470+0000","last_fullsized":"2024-09-12T18:36:09.913470+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:00.115408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.910176+0000","last_change":"2024-09-12T18:35:25.650577+0000","last_active":"2024-09-12T18:36:09.910176+0000","last_peered":"2024-09-12T18:36:09.910176+0000","last_clean":"2024-09-12T18:36:09.910176+0000","last_became_active":"2024-09-12T18:35:25.649172+0000","last_became_peered":"2024-09-12T18:35:25.649172+0000","last_unstale":"2024-09-12T18:36:09.910176+0000","last_undegraded":"2024-09-12T18:36:09.910176+0000","last_fullsized":"2024-09-12T18:36:09.910176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:55.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"36'4208","reported_seq":4247,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:11.469807+0000","last_change":"2024-09-12T18:35:44.763067+0000","last_active":"2024-09-12T18:36:11.469807+0000","last_peered":"2024-09-12T18:36:11.469807+0000","last_clean":"2024-09-12T18:36:11.469807+0000","last_became_active":"2024-09-12T18:35:44.762584+0000","last_became_peered":"2024-09-12T18:35:44.762584+0000","last_unstale":"2024-09-12T18:36:11.469807+0000","last_undegraded":"2024-09-12T18:36:11.469807+0000","last_fullsized":"2024-09-12T18:36:11.469807+0000","mapping_epoch":21,"log_start":"24'600","ondisk_log_start":"24'600","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3608,"log_dups_size":0,"ondisk_log_size":3608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:47.847399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":275775488,"num_objects":4208,"num_object_clones":0,"num_object_copies":8416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4208,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4208,"num_write_kb":269312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.912012+0000","last_change":"2024-09-12T18:35:24.657665+0000","last_active":"2024-09-12T18:36:09.912012+0000","last_peered":"2024-09-12T18:36:09.912012+0000","last_clean":"2024-09-12T18:36:09.912012+0000","last_became_active":"2024-09-12T18:35:24.657015+0000","last_became_peered":"2024-09-12T18:35:24.657015+0000","last_unstale":"2024-09-12T18:36:09.912012+0000","last_undegraded":"2024-09-12T18:36:09.912012+0000","last_fullsized":"2024-09-12T18:36:09.912012+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:03.171326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.912906+0000","last_change":"2024-09-12T18:35:25.665275+0000","last_active":"2024-09-12T18:36:09.912906+0000","last_peered":"2024-09-12T18:36:09.912906+0000","last_clean":"2024-09-12T18:36:09.912906+0000","last_became_active":"2024-09-12T18:35:25.659511+0000","last_became_peered":"2024-09-12T18:35:25.659511+0000","last_unstale":"2024-09-12T18:36:09.912906+0000","last_undegraded":"2024-09-12T18:36:09.912906+0000","last_fullsized":"2024-09-12T18:36:09.912906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"37'4454","reported_seq":4495,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:36:13.472958+0000","last_change":"2024-09-12T18:35:44.773526+0000","last_active":"2024-09-12T18:36:13.472958+0000","last_peered":"2024-09-12T18:36:13.472958+0000","last_clean":"2024-09-12T18:36:13.472958+0000","last_became_active":"2024-09-12T18:35:44.772974+0000","last_became_peered":"2024-09-12T18:35:44.772974+0000","last_unstale":"2024-09-12T18:36:13.472958+0000","last_undegraded":"2024-09-12T18:36:13.472958+0000","last_fullsized":"2024-09-12T18:36:13.472958+0000","mapping_epoch":21,"log_start":"24'500","ondisk_log_start":"24'500","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3954,"log_dups_size":0,"ondisk_log_size":3954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:23.676840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":291897344,"num_objects":4454,"num_object_clones":0,"num_object_copies":8908,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4454,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4454,"num_write_kb":285056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.913190+0000","last_change":"2024-09-12T18:35:24.651913+0000","last_active":"2024-09-12T18:36:09.913190+0000","last_peered":"2024-09-12T18:36:09.913190+0000","last_clean":"2024-09-12T18:36:09.913190+0000","last_became_active":"2024-09-12T18:35:24.650421+0000","last_became_peered":"2024-09-12T18:35:24.650421+0000","last_unstale":"2024-09-12T18:36:09.913190+0000","last_undegraded":"2024-09-12T18:36:09.913190+0000","last_fullsized":"2024-09-12T18:36:09.913190+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:57.685312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.911812+0000","last_change":"2024-09-12T18:35:25.651138+0000","last_active":"2024-09-12T18:36:09.911812+0000","last_peered":"2024-09-12T18:36:09.911812+0000","last_clean":"2024-09-12T18:36:09.911812+0000","last_became_active":"2024-09-12T18:35:25.650617+0000","last_became_peered":"2024-09-12T18:35:25.650617+0000","last_unstale":"2024-09-12T18:36:09.911812+0000","last_undegraded":"2024-09-12T18:36:09.911812+0000","last_fullsized":"2024-09-12T18:36:09.911812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:58.535066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"36'4102","reported_seq":4141,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:11.439066+0000","last_change":"2024-09-12T18:35:44.767970+0000","last_active":"2024-09-12T18:36:11.439066+0000","last_peered":"2024-09-12T18:36:11.439066+0000","last_clean":"2024-09-12T18:36:11.439066+0000","last_became_active":"2024-09-12T18:35:44.767348+0000","last_became_peered":"2024-09-12T18:35:44.767348+0000","last_unstale":"2024-09-12T18:36:11.439066+0000","last_undegraded":"2024-09-12T18:36:11.439066+0000","last_fullsized":"2024-09-12T18:36:11.439066+0000","mapping_epoch":21,"log_start":"24'500","ondisk_log_start":"24'500","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3602,"log_dups_size":0,"ondisk_log_size":3602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:48.745907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268828672,"num_objects":4102,"num_object_clones":0,"num_object_copies":8204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4102,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4102,"num_write_kb":262528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.910381+0000","last_change":"2024-09-12T18:35:24.659019+0000","last_active":"2024-09-12T18:36:09.910381+0000","last_peered":"2024-09-12T18:36:09.910381+0000","last_clean":"2024-09-12T18:36:09.910381+0000","last_became_active":"2024-09-12T18:35:24.658423+0000","last_became_peered":"2024-09-12T18:35:24.658423+0000","last_unstale":"2024-09-12T18:36:09.910381+0000","last_undegraded":"2024-09-12T18:36:09.910381+0000","last_fullsized":"2024-09-12T18:36:09.910381+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:37.668417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.913290+0000","last_change":"2024-09-12T18:35:25.662287+0000","last_active":"2024-09-12T18:36:09.913290+0000","last_peered":"2024-09-12T18:36:09.913290+0000","last_clean":"2024-09-12T18:36:09.913290+0000","last_became_active":"2024-09-12T18:35:25.660372+0000","last_became_peered":"2024-09-12T18:35:25.660372+0000","last_unstale":"2024-09-12T18:36:09.913290+0000","last_undegraded":"2024-09-12T18:36:09.913290+0000","last_fullsized":"2024-09-12T18:36:09.913290+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:08.729541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.f","version":"36'4154","reported_seq":4193,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:11.457376+0000","last_change":"2024-09-12T18:35:44.774817+0000","last_active":"2024-09-12T18:36:11.457376+0000","last_peered":"2024-09-12T18:36:11.457376+0000","last_clean":"2024-09-12T18:36:11.457376+0000","last_became_active":"2024-09-12T18:35:44.774429+0000","last_became_peered":"2024-09-12T18:35:44.774429+0000","last_unstale":"2024-09-12T18:36:11.457376+0000","last_undegraded":"2024-09-12T18:36:11.457376+0000","last_fullsized":"2024-09-12T18:36:11.457376+0000","mapping_epoch":21,"log_start":"24'400","ondisk_log_start":"24'400","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3754,"log_dups_size":0,"ondisk_log_size":3754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:21.579103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272236544,"num_objects":4154,"num_object_clones":0,"num_object_copies":8308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4154,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4154,"num_write_kb":265856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.334195+0000","last_change":"2024-09-12T18:35:24.648330+0000","last_active":"2024-09-12T18:36:12.334195+0000","last_peered":"2024-09-12T18:36:12.334195+0000","last_clean":"2024-09-12T18:36:12.334195+0000","last_became_active":"2024-09-12T18:35:24.647520+0000","last_became_peered":"2024-09-12T18:35:24.647520+0000","last_unstale":"2024-09-12T18:36:12.334195+0000","last_undegraded":"2024-09-12T18:36:12.334195+0000","last_fullsized":"2024-09-12T18:36:12.334195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:25.552055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.911262+0000","last_change":"2024-09-12T18:35:25.658674+0000","last_active":"2024-09-12T18:36:09.911262+0000","last_peered":"2024-09-12T18:36:09.911262+0000","last_clean":"2024-09-12T18:36:09.911262+0000","last_became_active":"2024-09-12T18:35:25.657386+0000","last_became_peered":"2024-09-12T18:35:25.657386+0000","last_unstale":"2024-09-12T18:36:09.911262+0000","last_undegraded":"2024-09-12T18:36:09.911262+0000","last_fullsized":"2024-09-12T18:36:09.911262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:48.037086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"37'4432","reported_seq":4473,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:36:13.469532+0000","last_change":"2024-09-12T18:35:44.771738+0000","last_active":"2024-09-12T18:36:13.469532+0000","last_peered":"2024-09-12T18:36:13.469532+0000","last_clean":"2024-09-12T18:36:13.469532+0000","last_became_active":"2024-09-12T18:35:44.771227+0000","last_became_peered":"2024-09-12T18:35:44.771227+0000","last_unstale":"2024-09-12T18:36:13.469532+0000","last_undegraded":"2024-09-12T18:36:13.469532+0000","last_fullsized":"2024-09-12T18:36:13.469532+0000","mapping_epoch":21,"log_start":"24'400","ondisk_log_start":"24'400","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":4032,"log_dups_size":0,"ondisk_log_size":4032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:27.329732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":290455552,"num_objects":4432,"num_object_clones":0,"num_object_copies":8864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4432,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4432,"num_write_kb":283648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.332266+0000","last_change":"2024-09-12T18:35:24.646810+0000","last_active":"2024-09-12T18:36:12.332266+0000","last_peered":"2024-09-12T18:36:12.332266+0000","last_clean":"2024-09-12T18:36:12.332266+0000","last_became_active":"2024-09-12T18:35:24.646008+0000","last_became_peered":"2024-09-12T18:35:24.646008+0000","last_unstale":"2024-09-12T18:36:12.332266+0000","last_undegraded":"2024-09-12T18:36:12.332266+0000","last_fullsized":"2024-09-12T18:36:12.332266+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:43.888776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.912879+0000","last_change":"2024-09-12T18:35:25.667710+0000","last_active":"2024-09-12T18:36:09.912879+0000","last_peered":"2024-09-12T18:36:09.912879+0000","last_clean":"2024-09-12T18:36:09.912879+0000","last_became_active":"2024-09-12T18:35:25.666940+0000","last_became_peered":"2024-09-12T18:35:25.666940+0000","last_unstale":"2024-09-12T18:36:09.912879+0000","last_undegraded":"2024-09-12T18:36:09.912879+0000","last_fullsized":"2024-09-12T18:36:09.912879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:09.823085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"37'4358","reported_seq":4399,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:36:13.472271+0000","last_change":"2024-09-12T18:35:44.769127+0000","last_active":"2024-09-12T18:36:13.472271+0000","last_peered":"2024-09-12T18:36:13.472271+0000","last_clean":"2024-09-12T18:36:13.472271+0000","last_became_active":"2024-09-12T18:35:44.768382+0000","last_became_peered":"2024-09-12T18:35:44.768382+0000","last_unstale":"2024-09-12T18:36:13.472271+0000","last_undegraded":"2024-09-12T18:36:13.472271+0000","last_fullsized":"2024-09-12T18:36:13.472271+0000","mapping_epoch":21,"log_start":"24'400","ondisk_log_start":"24'400","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3958,"log_dups_size":0,"ondisk_log_size":3958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:33.385476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285605888,"num_objects":4358,"num_object_clones":0,"num_object_copies":8716,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4358,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4358,"num_write_kb":278912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":199,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.910053+0000","last_change":"2024-09-12T18:35:13.489018+0000","last_active":"2024-09-12T18:36:09.910053+0000","last_peered":"2024-09-12T18:36:09.910053+0000","last_clean":"2024-09-12T18:36:09.910053+0000","last_became_active":"2024-09-12T18:35:13.488346+0000","last_became_peered":"2024-09-12T18:35:13.488346+0000","last_unstale":"2024-09-12T18:36:09.910053+0000","last_undegraded":"2024-09-12T18:36:09.910053+0000","last_fullsized":"2024-09-12T18:36:09.910053+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_clean_scrub_stamp":"2024-09-12T18:35:12.464628+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:54.864640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.912012+0000","last_change":"2024-09-12T18:35:22.459694+0000","last_active":"2024-09-12T18:36:09.912012+0000","last_peered":"2024-09-12T18:36:09.912012+0000","last_clean":"2024-09-12T18:36:09.912012+0000","last_became_active":"2024-09-12T18:35:20.446796+0000","last_became_peered":"2024-09-12T18:35:20.446796+0000","last_unstale":"2024-09-12T18:36:09.912012+0000","last_undegraded":"2024-09-12T18:36:09.912012+0000","last_fullsized":"2024-09-12T18:36:09.912012+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:21.506024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016291610000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.913119+0000","last_change":"2024-09-12T18:35:24.651749+0000","last_active":"2024-09-12T18:36:09.913119+0000","last_peered":"2024-09-12T18:36:09.913119+0000","last_clean":"2024-09-12T18:36:09.913119+0000","last_became_active":"2024-09-12T18:35:24.649860+0000","last_became_peered":"2024-09-12T18:35:24.649860+0000","last_unstale":"2024-09-12T18:36:09.913119+0000","last_undegraded":"2024-09-12T18:36:09.913119+0000","last_fullsized":"2024-09-12T18:36:09.913119+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:35.430065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.913418+0000","last_change":"2024-09-12T18:35:25.662424+0000","last_active":"2024-09-12T18:36:09.913418+0000","last_peered":"2024-09-12T18:36:09.913418+0000","last_clean":"2024-09-12T18:36:09.913418+0000","last_became_active":"2024-09-12T18:35:25.661043+0000","last_became_peered":"2024-09-12T18:35:25.661043+0000","last_unstale":"2024-09-12T18:36:09.913418+0000","last_undegraded":"2024-09-12T18:36:09.913418+0000","last_fullsized":"2024-09-12T18:36:09.913418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:52.551802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.7","version":"36'4131","reported_seq":4170,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:11.460211+0000","last_change":"2024-09-12T18:35:44.774505+0000","last_active":"2024-09-12T18:36:11.460211+0000","last_peered":"2024-09-12T18:36:11.460211+0000","last_clean":"2024-09-12T18:36:11.460211+0000","last_became_active":"2024-09-12T18:35:44.774259+0000","last_became_peered":"2024-09-12T18:35:44.774259+0000","last_unstale":"2024-09-12T18:36:11.460211+0000","last_undegraded":"2024-09-12T18:36:11.460211+0000","last_fullsized":"2024-09-12T18:36:11.460211+0000","mapping_epoch":21,"log_start":"24'400","ondisk_log_start":"24'400","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3731,"log_dups_size":0,"ondisk_log_size":3731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:21.731670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270729216,"num_objects":4131,"num_object_clones":0,"num_object_copies":8262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4131,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4131,"num_write_kb":264384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.909973+0000","last_change":"2024-09-12T18:35:22.459090+0000","last_active":"2024-09-12T18:36:09.909973+0000","last_peered":"2024-09-12T18:36:09.909973+0000","last_clean":"2024-09-12T18:36:09.909973+0000","last_became_active":"2024-09-12T18:35:20.448553+0000","last_became_peered":"2024-09-12T18:35:20.448553+0000","last_unstale":"2024-09-12T18:36:09.909973+0000","last_undegraded":"2024-09-12T18:36:09.909973+0000","last_fullsized":"2024-09-12T18:36:09.909973+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:56.834808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001030836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.912283+0000","last_change":"2024-09-12T18:35:24.651597+0000","last_active":"2024-09-12T18:36:09.912283+0000","last_peered":"2024-09-12T18:36:09.912283+0000","last_clean":"2024-09-12T18:36:09.912283+0000","last_became_active":"2024-09-12T18:35:24.649940+0000","last_became_peered":"2024-09-12T18:35:24.649940+0000","last_unstale":"2024-09-12T18:36:09.912283+0000","last_undegraded":"2024-09-12T18:36:09.912283+0000","last_fullsized":"2024-09-12T18:36:09.912283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:36.822432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.333179+0000","last_change":"2024-09-12T18:35:25.660529+0000","last_active":"2024-09-12T18:36:12.333179+0000","last_peered":"2024-09-12T18:36:12.333179+0000","last_clean":"2024-09-12T18:36:12.333179+0000","last_became_active":"2024-09-12T18:35:25.659537+0000","last_became_peered":"2024-09-12T18:35:25.659537+0000","last_unstale":"2024-09-12T18:36:12.333179+0000","last_undegraded":"2024-09-12T18:36:12.333179+0000","last_fullsized":"2024-09-12T18:36:12.333179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:51.790349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"36'4190","reported_seq":4229,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:11.463339+0000","last_change":"2024-09-12T18:35:44.770379+0000","last_active":"2024-09-12T18:36:11.463339+0000","last_peered":"2024-09-12T18:36:11.463339+0000","last_clean":"2024-09-12T18:36:11.463339+0000","last_became_active":"2024-09-12T18:35:44.769739+0000","last_became_peered":"2024-09-12T18:35:44.769739+0000","last_unstale":"2024-09-12T18:36:11.463339+0000","last_undegraded":"2024-09-12T18:36:11.463339+0000","last_fullsized":"2024-09-12T18:36:11.463339+0000","mapping_epoch":21,"log_start":"24'600","ondisk_log_start":"24'600","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3590,"log_dups_size":0,"ondisk_log_size":3590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:02:23.077263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":274595840,"num_objects":4190,"num_object_clones":0,"num_object_copies":8380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4190,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4190,"num_write_kb":268160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.912369+0000","last_change":"2024-09-12T18:35:22.464179+0000","last_active":"2024-09-12T18:36:09.912369+0000","last_peered":"2024-09-12T18:36:09.912369+0000","last_clean":"2024-09-12T18:36:09.912369+0000","last_became_active":"2024-09-12T18:35:20.442613+0000","last_became_peered":"2024-09-12T18:35:20.442613+0000","last_unstale":"2024-09-12T18:36:09.912369+0000","last_undegraded":"2024-09-12T18:36:09.912369+0000","last_fullsized":"2024-09-12T18:36:09.912369+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:17.636537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014134620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.332322+0000","last_change":"2024-09-12T18:35:24.641297+0000","last_active":"2024-09-12T18:36:12.332322+0000","last_peered":"2024-09-12T18:36:12.332322+0000","last_clean":"2024-09-12T18:36:12.332322+0000","last_became_active":"2024-09-12T18:35:24.637334+0000","last_became_peered":"2024-09-12T18:35:24.637334+0000","last_unstale":"2024-09-12T18:36:12.332322+0000","last_undegraded":"2024-09-12T18:36:12.332322+0000","last_fullsized":"2024-09-12T18:36:12.332322+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:50.772074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.912946+0000","last_change":"2024-09-12T18:35:25.659209+0000","last_active":"2024-09-12T18:36:09.912946+0000","last_peered":"2024-09-12T18:36:09.912946+0000","last_clean":"2024-09-12T18:36:09.912946+0000","last_became_active":"2024-09-12T18:35:25.656170+0000","last_became_peered":"2024-09-12T18:35:25.656170+0000","last_unstale":"2024-09-12T18:36:09.912946+0000","last_undegraded":"2024-09-12T18:36:09.912946+0000","last_fullsized":"2024-09-12T18:36:09.912946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:40.925757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"36'4210","reported_seq":4247,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:11.473893+0000","last_change":"2024-09-12T18:35:44.770358+0000","last_active":"2024-09-12T18:36:11.473893+0000","last_peered":"2024-09-12T18:36:11.473893+0000","last_clean":"2024-09-12T18:36:11.473893+0000","last_became_active":"2024-09-12T18:35:44.769786+0000","last_became_peered":"2024-09-12T18:35:44.769786+0000","last_unstale":"2024-09-12T18:36:11.473893+0000","last_undegraded":"2024-09-12T18:36:11.473893+0000","last_fullsized":"2024-09-12T18:36:11.473893+0000","mapping_epoch":21,"log_start":"24'600","ondisk_log_start":"24'600","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3610,"log_dups_size":0,"ondisk_log_size":3610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:27.215502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":275906560,"num_objects":4210,"num_object_clones":0,"num_object_copies":8420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4210,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4210,"num_write_kb":269440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.910457+0000","last_change":"2024-09-12T18:35:22.459049+0000","last_active":"2024-09-12T18:36:09.910457+0000","last_peered":"2024-09-12T18:36:09.910457+0000","last_clean":"2024-09-12T18:36:09.910457+0000","last_became_active":"2024-09-12T18:35:20.446814+0000","last_became_peered":"2024-09-12T18:35:20.446814+0000","last_unstale":"2024-09-12T18:36:09.910457+0000","last_undegraded":"2024-09-12T18:36:09.910457+0000","last_fullsized":"2024-09-12T18:36:09.910457+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:18.033595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010716149999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.911945+0000","last_change":"2024-09-12T18:35:24.658273+0000","last_active":"2024-09-12T18:36:09.911945+0000","last_peered":"2024-09-12T18:36:09.911945+0000","last_clean":"2024-09-12T18:36:09.911945+0000","last_became_active":"2024-09-12T18:35:24.657433+0000","last_became_peered":"2024-09-12T18:35:24.657433+0000","last_unstale":"2024-09-12T18:36:09.911945+0000","last_undegraded":"2024-09-12T18:36:09.911945+0000","last_fullsized":"2024-09-12T18:36:09.911945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:48.497218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.913704+0000","last_change":"2024-09-12T18:35:25.655830+0000","last_active":"2024-09-12T18:36:09.913704+0000","last_peered":"2024-09-12T18:36:09.913704+0000","last_clean":"2024-09-12T18:36:09.913704+0000","last_became_active":"2024-09-12T18:35:25.652126+0000","last_became_peered":"2024-09-12T18:35:25.652126+0000","last_unstale":"2024-09-12T18:36:09.913704+0000","last_undegraded":"2024-09-12T18:36:09.913704+0000","last_fullsized":"2024-09-12T18:36:09.913704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:04.080721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"36'4066","reported_seq":4105,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:11.450272+0000","last_change":"2024-09-12T18:35:44.770799+0000","last_active":"2024-09-12T18:36:11.450272+0000","last_peered":"2024-09-12T18:36:11.450272+0000","last_clean":"2024-09-12T18:36:11.450272+0000","last_became_active":"2024-09-12T18:35:44.770030+0000","last_became_peered":"2024-09-12T18:35:44.770030+0000","last_unstale":"2024-09-12T18:36:11.450272+0000","last_undegraded":"2024-09-12T18:36:11.450272+0000","last_fullsized":"2024-09-12T18:36:11.450272+0000","mapping_epoch":21,"log_start":"24'500","ondisk_log_start":"24'500","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3566,"log_dups_size":0,"ondisk_log_size":3566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:24.786452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":266469376,"num_objects":4066,"num_object_clones":0,"num_object_copies":8132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4066,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4066,"num_write_kb":260224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.913546+0000","last_change":"2024-09-12T18:35:24.657618+0000","last_active":"2024-09-12T18:36:09.913546+0000","last_peered":"2024-09-12T18:36:09.913546+0000","last_clean":"2024-09-12T18:36:09.913546+0000","last_became_active":"2024-09-12T18:35:24.656741+0000","last_became_peered":"2024-09-12T18:35:24.656741+0000","last_unstale":"2024-09-12T18:36:09.913546+0000","last_undegraded":"2024-09-12T18:36:09.913546+0000","last_fullsized":"2024-09-12T18:36:09.913546+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:43.113104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.913791+0000","last_change":"2024-09-12T18:35:22.464180+0000","last_active":"2024-09-12T18:36:09.913791+0000","last_peered":"2024-09-12T18:36:09.913791+0000","last_clean":"2024-09-12T18:36:09.913791+0000","last_became_active":"2024-09-12T18:35:20.442566+0000","last_became_peered":"2024-09-12T18:35:20.442566+0000","last_unstale":"2024-09-12T18:36:09.913791+0000","last_undegraded":"2024-09-12T18:36:09.913791+0000","last_fullsized":"2024-09-12T18:36:09.913791+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:29.021710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001325786,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.333576+0000","last_change":"2024-09-12T18:35:25.650458+0000","last_active":"2024-09-12T18:36:12.333576+0000","last_peered":"2024-09-12T18:36:12.333576+0000","last_clean":"2024-09-12T18:36:12.333576+0000","last_became_active":"2024-09-12T18:35:25.648761+0000","last_became_peered":"2024-09-12T18:35:25.648761+0000","last_unstale":"2024-09-12T18:36:12.333576+0000","last_undegraded":"2024-09-12T18:36:12.333576+0000","last_fullsized":"2024-09-12T18:36:12.333576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:53.026950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"36'4145","reported_seq":4184,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:11.471768+0000","last_change":"2024-09-12T18:35:44.773801+0000","last_active":"2024-09-12T18:36:11.471768+0000","last_peered":"2024-09-12T18:36:11.471768+0000","last_clean":"2024-09-12T18:36:11.471768+0000","last_became_active":"2024-09-12T18:35:44.772787+0000","last_became_peered":"2024-09-12T18:35:44.772787+0000","last_unstale":"2024-09-12T18:36:11.471768+0000","last_undegraded":"2024-09-12T18:36:11.471768+0000","last_fullsized":"2024-09-12T18:36:11.471768+0000","mapping_epoch":21,"log_start":"24'400","ondisk_log_start":"24'400","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3745,"log_dups_size":0,"ondisk_log_size":3745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:13.758208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271646720,"num_objects":4145,"num_object_clones":0,"num_object_copies":8290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4145,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4145,"num_write_kb":265280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.913753+0000","last_change":"2024-09-12T18:35:24.649669+0000","last_active":"2024-09-12T18:36:09.913753+0000","last_peered":"2024-09-12T18:36:09.913753+0000","last_clean":"2024-09-12T18:36:09.913753+0000","last_became_active":"2024-09-12T18:35:24.648881+0000","last_became_peered":"2024-09-12T18:35:24.648881+0000","last_unstale":"2024-09-12T18:36:09.913753+0000","last_undegraded":"2024-09-12T18:36:09.913753+0000","last_fullsized":"2024-09-12T18:36:09.913753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:23.614734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.334320+0000","last_change":"2024-09-12T18:35:22.458666+0000","last_active":"2024-09-12T18:36:12.334320+0000","last_peered":"2024-09-12T18:36:12.334320+0000","last_clean":"2024-09-12T18:36:12.334320+0000","last_became_active":"2024-09-12T18:35:20.442394+0000","last_became_peered":"2024-09-12T18:35:20.442394+0000","last_unstale":"2024-09-12T18:36:12.334320+0000","last_undegraded":"2024-09-12T18:36:12.334320+0000","last_fullsized":"2024-09-12T18:36:12.334320+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:51.840246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080163599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.332903+0000","last_change":"2024-09-12T18:35:25.650717+0000","last_active":"2024-09-12T18:36:12.332903+0000","last_peered":"2024-09-12T18:36:12.332903+0000","last_clean":"2024-09-12T18:36:12.332903+0000","last_became_active":"2024-09-12T18:35:25.649147+0000","last_became_peered":"2024-09-12T18:35:25.649147+0000","last_unstale":"2024-09-12T18:36:12.332903+0000","last_undegraded":"2024-09-12T18:36:12.332903+0000","last_fullsized":"2024-09-12T18:36:12.332903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:07.365888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"36'4130","reported_seq":4169,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:11.454615+0000","last_change":"2024-09-12T18:35:44.774031+0000","last_active":"2024-09-12T18:36:11.454615+0000","last_peered":"2024-09-12T18:36:11.454615+0000","last_clean":"2024-09-12T18:36:11.454615+0000","last_became_active":"2024-09-12T18:35:44.772874+0000","last_became_peered":"2024-09-12T18:35:44.772874+0000","last_unstale":"2024-09-12T18:36:11.454615+0000","last_undegraded":"2024-09-12T18:36:11.454615+0000","last_fullsized":"2024-09-12T18:36:11.454615+0000","mapping_epoch":21,"log_start":"24'400","ondisk_log_start":"24'400","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3730,"log_dups_size":0,"ondisk_log_size":3730,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:27.897491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270663680,"num_objects":4130,"num_object_clones":0,"num_object_copies":8260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4130,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4130,"num_write_kb":264320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.913392+0000","last_change":"2024-09-12T18:35:24.657234+0000","last_active":"2024-09-12T18:36:09.913392+0000","last_peered":"2024-09-12T18:36:09.913392+0000","last_clean":"2024-09-12T18:36:09.913392+0000","last_became_active":"2024-09-12T18:35:24.655950+0000","last_became_peered":"2024-09-12T18:35:24.655950+0000","last_unstale":"2024-09-12T18:36:09.913392+0000","last_undegraded":"2024-09-12T18:36:09.913392+0000","last_fullsized":"2024-09-12T18:36:09.913392+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:17.466623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.913508+0000","last_change":"2024-09-12T18:35:22.464656+0000","last_active":"2024-09-12T18:36:09.913508+0000","last_peered":"2024-09-12T18:36:09.913508+0000","last_clean":"2024-09-12T18:36:09.913508+0000","last_became_active":"2024-09-12T18:35:20.445470+0000","last_became_peered":"2024-09-12T18:35:20.445470+0000","last_unstale":"2024-09-12T18:36:09.913508+0000","last_undegraded":"2024-09-12T18:36:09.913508+0000","last_fullsized":"2024-09-12T18:36:09.913508+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:58.947359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001742681,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.913267+0000","last_change":"2024-09-12T18:35:25.658887+0000","last_active":"2024-09-12T18:36:09.913267+0000","last_peered":"2024-09-12T18:36:09.913267+0000","last_clean":"2024-09-12T18:36:09.913267+0000","last_became_active":"2024-09-12T18:35:25.656829+0000","last_became_peered":"2024-09-12T18:35:25.656829+0000","last_unstale":"2024-09-12T18:36:09.913267+0000","last_undegraded":"2024-09-12T18:36:09.913267+0000","last_fullsized":"2024-09-12T18:36:09.913267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:50.109858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"37'4421","reported_seq":4461,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:36:13.469458+0000","last_change":"2024-09-12T18:35:44.767276+0000","last_active":"2024-09-12T18:36:13.469458+0000","last_peered":"2024-09-12T18:36:13.469458+0000","last_clean":"2024-09-12T18:36:13.469458+0000","last_became_active":"2024-09-12T18:35:44.766145+0000","last_became_peered":"2024-09-12T18:35:44.766145+0000","last_unstale":"2024-09-12T18:36:13.469458+0000","last_undegraded":"2024-09-12T18:36:13.469458+0000","last_fullsized":"2024-09-12T18:36:13.469458+0000","mapping_epoch":21,"log_start":"24'400","ondisk_log_start":"24'400","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":4021,"log_dups_size":0,"ondisk_log_size":4021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:47.423493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289734656,"num_objects":4421,"num_object_clones":0,"num_object_copies":8842,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4421,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4421,"num_write_kb":282944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.913488+0000","last_change":"2024-09-12T18:35:24.654518+0000","last_active":"2024-09-12T18:36:09.913488+0000","last_peered":"2024-09-12T18:36:09.913488+0000","last_clean":"2024-09-12T18:36:09.913488+0000","last_became_active":"2024-09-12T18:35:24.650309+0000","last_became_peered":"2024-09-12T18:35:24.650309+0000","last_unstale":"2024-09-12T18:36:09.913488+0000","last_undegraded":"2024-09-12T18:36:09.913488+0000","last_fullsized":"2024-09-12T18:36:09.913488+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:16.669035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.910920+0000","last_change":"2024-09-12T18:35:22.459767+0000","last_active":"2024-09-12T18:36:09.910920+0000","last_peered":"2024-09-12T18:36:09.910920+0000","last_clean":"2024-09-12T18:36:09.910920+0000","last_became_active":"2024-09-12T18:35:20.448521+0000","last_became_peered":"2024-09-12T18:35:20.448521+0000","last_unstale":"2024-09-12T18:36:09.910920+0000","last_undegraded":"2024-09-12T18:36:09.910920+0000","last_fullsized":"2024-09-12T18:36:09.910920+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:33.463792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017009670000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.334022+0000","last_change":"2024-09-12T18:35:25.648150+0000","last_active":"2024-09-12T18:36:12.334022+0000","last_peered":"2024-09-12T18:36:12.334022+0000","last_clean":"2024-09-12T18:36:12.334022+0000","last_became_active":"2024-09-12T18:35:25.647347+0000","last_became_peered":"2024-09-12T18:35:25.647347+0000","last_unstale":"2024-09-12T18:36:12.334022+0000","last_undegraded":"2024-09-12T18:36:12.334022+0000","last_fullsized":"2024-09-12T18:36:12.334022+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:48.968336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.911796+0000","last_change":"2024-09-12T18:35:25.660696+0000","last_active":"2024-09-12T18:36:09.911796+0000","last_peered":"2024-09-12T18:36:09.911796+0000","last_clean":"2024-09-12T18:36:09.911796+0000","last_became_active":"2024-09-12T18:35:25.659827+0000","last_became_peered":"2024-09-12T18:35:25.659827+0000","last_unstale":"2024-09-12T18:36:09.911796+0000","last_undegraded":"2024-09-12T18:36:09.911796+0000","last_fullsized":"2024-09-12T18:36:09.911796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:15.678289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.911952+0000","last_change":"2024-09-12T18:35:24.655051+0000","last_active":"2024-09-12T18:36:09.911952+0000","last_peered":"2024-09-12T18:36:09.911952+0000","last_clean":"2024-09-12T18:36:09.911952+0000","last_became_active":"2024-09-12T18:35:24.654282+0000","last_became_peered":"2024-09-12T18:35:24.654282+0000","last_unstale":"2024-09-12T18:36:09.911952+0000","last_undegraded":"2024-09-12T18:36:09.911952+0000","last_fullsized":"2024-09-12T18:36:09.911952+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:08.159799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.912369+0000","last_change":"2024-09-12T18:35:25.659237+0000","last_active":"2024-09-12T18:36:09.912369+0000","last_peered":"2024-09-12T18:36:09.912369+0000","last_clean":"2024-09-12T18:36:09.912369+0000","last_became_active":"2024-09-12T18:35:25.658423+0000","last_became_peered":"2024-09-12T18:35:25.658423+0000","last_unstale":"2024-09-12T18:36:09.912369+0000","last_undegraded":"2024-09-12T18:36:09.912369+0000","last_fullsized":"2024-09-12T18:36:09.912369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:42.956934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.334214+0000","last_change":"2024-09-12T18:35:24.648658+0000","last_active":"2024-09-12T18:36:12.334214+0000","last_peered":"2024-09-12T18:36:12.334214+0000","last_clean":"2024-09-12T18:36:12.334214+0000","last_became_active":"2024-09-12T18:35:24.647826+0000","last_became_peered":"2024-09-12T18:35:24.647826+0000","last_unstale":"2024-09-12T18:36:12.334214+0000","last_undegraded":"2024-09-12T18:36:12.334214+0000","last_fullsized":"2024-09-12T18:36:12.334214+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:24.167549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.911546+0000","last_change":"2024-09-12T18:35:24.656855+0000","last_active":"2024-09-12T18:36:09.911546+0000","last_peered":"2024-09-12T18:36:09.911546+0000","last_clean":"2024-09-12T18:36:09.911546+0000","last_became_active":"2024-09-12T18:35:24.655935+0000","last_became_peered":"2024-09-12T18:35:24.655935+0000","last_unstale":"2024-09-12T18:36:09.911546+0000","last_undegraded":"2024-09-12T18:36:09.911546+0000","last_fullsized":"2024-09-12T18:36:09.911546+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:35.430065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.912128+0000","last_change":"2024-09-12T18:35:25.661801+0000","last_active":"2024-09-12T18:36:09.912128+0000","last_peered":"2024-09-12T18:36:09.912128+0000","last_clean":"2024-09-12T18:36:09.912128+0000","last_became_active":"2024-09-12T18:35:25.658476+0000","last_became_peered":"2024-09-12T18:35:25.658476+0000","last_unstale":"2024-09-12T18:36:09.912128+0000","last_undegraded":"2024-09-12T18:36:09.912128+0000","last_fullsized":"2024-09-12T18:36:09.912128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:58.246449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.913281+0000","last_change":"2024-09-12T18:35:24.652399+0000","last_active":"2024-09-12T18:36:09.913281+0000","last_peered":"2024-09-12T18:36:09.913281+0000","last_clean":"2024-09-12T18:36:09.913281+0000","last_became_active":"2024-09-12T18:35:24.651416+0000","last_became_peered":"2024-09-12T18:35:24.651416+0000","last_unstale":"2024-09-12T18:36:09.913281+0000","last_undegraded":"2024-09-12T18:36:09.913281+0000","last_fullsized":"2024-09-12T18:36:09.913281+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:32.594978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.913137+0000","last_change":"2024-09-12T18:35:25.658570+0000","last_active":"2024-09-12T18:36:09.913137+0000","last_peered":"2024-09-12T18:36:09.913137+0000","last_clean":"2024-09-12T18:36:09.913137+0000","last_became_active":"2024-09-12T18:35:25.656561+0000","last_became_peered":"2024-09-12T18:35:25.656561+0000","last_unstale":"2024-09-12T18:36:09.913137+0000","last_undegraded":"2024-09-12T18:36:09.913137+0000","last_fullsized":"2024-09-12T18:36:09.913137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:22.225756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.333725+0000","last_change":"2024-09-12T18:35:25.651217+0000","last_active":"2024-09-12T18:36:12.333725+0000","last_peered":"2024-09-12T18:36:12.333725+0000","last_clean":"2024-09-12T18:36:12.333725+0000","last_became_active":"2024-09-12T18:35:25.649544+0000","last_became_peered":"2024-09-12T18:35:25.649544+0000","last_unstale":"2024-09-12T18:36:12.333725+0000","last_undegraded":"2024-09-12T18:36:12.333725+0000","last_fullsized":"2024-09-12T18:36:12.333725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:41.601376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.913415+0000","last_change":"2024-09-12T18:35:24.657489+0000","last_active":"2024-09-12T18:36:09.913415+0000","last_peered":"2024-09-12T18:36:09.913415+0000","last_clean":"2024-09-12T18:36:09.913415+0000","last_became_active":"2024-09-12T18:35:24.656030+0000","last_became_peered":"2024-09-12T18:35:24.656030+0000","last_unstale":"2024-09-12T18:36:09.913415+0000","last_undegraded":"2024-09-12T18:36:09.913415+0000","last_fullsized":"2024-09-12T18:36:09.913415+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:11.362759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.912963+0000","last_change":"2024-09-12T18:35:25.661544+0000","last_active":"2024-09-12T18:36:09.912963+0000","last_peered":"2024-09-12T18:36:09.912963+0000","last_clean":"2024-09-12T18:36:09.912963+0000","last_became_active":"2024-09-12T18:35:25.656985+0000","last_became_peered":"2024-09-12T18:35:25.656985+0000","last_unstale":"2024-09-12T18:36:09.912963+0000","last_undegraded":"2024-09-12T18:36:09.912963+0000","last_fullsized":"2024-09-12T18:36:09.912963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.912258+0000","last_change":"2024-09-12T18:35:24.646342+0000","last_active":"2024-09-12T18:36:09.912258+0000","last_peered":"2024-09-12T18:36:09.912258+0000","last_clean":"2024-09-12T18:36:09.912258+0000","last_became_active":"2024-09-12T18:35:24.644773+0000","last_became_peered":"2024-09-12T18:35:24.644773+0000","last_unstale":"2024-09-12T18:36:09.912258+0000","last_undegraded":"2024-09-12T18:36:09.912258+0000","last_fullsized":"2024-09-12T18:36:09.912258+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:17.011231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.334021+0000","last_change":"2024-09-12T18:35:25.656712+0000","last_active":"2024-09-12T18:36:12.334021+0000","last_peered":"2024-09-12T18:36:12.334021+0000","last_clean":"2024-09-12T18:36:12.334021+0000","last_became_active":"2024-09-12T18:35:25.654473+0000","last_became_peered":"2024-09-12T18:35:25.654473+0000","last_unstale":"2024-09-12T18:36:12.334021+0000","last_undegraded":"2024-09-12T18:36:12.334021+0000","last_fullsized":"2024-09-12T18:36:12.334021+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:01.464680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.333753+0000","last_change":"2024-09-12T18:35:24.659935+0000","last_active":"2024-09-12T18:36:12.333753+0000","last_peered":"2024-09-12T18:36:12.333753+0000","last_clean":"2024-09-12T18:36:12.333753+0000","last_became_active":"2024-09-12T18:35:24.659111+0000","last_became_peered":"2024-09-12T18:35:24.659111+0000","last_unstale":"2024-09-12T18:36:12.333753+0000","last_undegraded":"2024-09-12T18:36:12.333753+0000","last_fullsized":"2024-09-12T18:36:12.333753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:11.480154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.332604+0000","last_change":"2024-09-12T18:35:25.660557+0000","last_active":"2024-09-12T18:36:12.332604+0000","last_peered":"2024-09-12T18:36:12.332604+0000","last_clean":"2024-09-12T18:36:12.332604+0000","last_became_active":"2024-09-12T18:35:25.652300+0000","last_became_peered":"2024-09-12T18:35:25.652300+0000","last_unstale":"2024-09-12T18:36:12.332604+0000","last_undegraded":"2024-09-12T18:36:12.332604+0000","last_fullsized":"2024-09-12T18:36:12.332604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:10:59.995841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.333081+0000","last_change":"2024-09-12T18:35:24.638538+0000","last_active":"2024-09-12T18:36:12.333081+0000","last_peered":"2024-09-12T18:36:12.333081+0000","last_clean":"2024-09-12T18:36:12.333081+0000","last_became_active":"2024-09-12T18:35:24.637242+0000","last_became_peered":"2024-09-12T18:35:24.637242+0000","last_unstale":"2024-09-12T18:36:12.333081+0000","last_undegraded":"2024-09-12T18:36:12.333081+0000","last_fullsized":"2024-09-12T18:36:12.333081+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:26.877441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.911790+0000","last_change":"2024-09-12T18:35:25.662537+0000","last_active":"2024-09-12T18:36:09.911790+0000","last_peered":"2024-09-12T18:36:09.911790+0000","last_clean":"2024-09-12T18:36:09.911790+0000","last_became_active":"2024-09-12T18:35:25.661441+0000","last_became_peered":"2024-09-12T18:35:25.661441+0000","last_unstale":"2024-09-12T18:36:09.911790+0000","last_undegraded":"2024-09-12T18:36:09.911790+0000","last_fullsized":"2024-09-12T18:36:09.911790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:14.397867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.911877+0000","last_change":"2024-09-12T18:35:24.657635+0000","last_active":"2024-09-12T18:36:09.911877+0000","last_peered":"2024-09-12T18:36:09.911877+0000","last_clean":"2024-09-12T18:36:09.911877+0000","last_became_active":"2024-09-12T18:35:24.655992+0000","last_became_peered":"2024-09-12T18:35:24.655992+0000","last_unstale":"2024-09-12T18:36:09.911877+0000","last_undegraded":"2024-09-12T18:36:09.911877+0000","last_fullsized":"2024-09-12T18:36:09.911877+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:33.536755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.910306+0000","last_change":"2024-09-12T18:35:25.651406+0000","last_active":"2024-09-12T18:36:09.910306+0000","last_peered":"2024-09-12T18:36:09.910306+0000","last_clean":"2024-09-12T18:36:09.910306+0000","last_became_active":"2024-09-12T18:35:25.649728+0000","last_became_peered":"2024-09-12T18:35:25.649728+0000","last_unstale":"2024-09-12T18:36:09.910306+0000","last_undegraded":"2024-09-12T18:36:09.910306+0000","last_fullsized":"2024-09-12T18:36:09.910306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:41.773283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.334123+0000","last_change":"2024-09-12T18:35:24.649153+0000","last_active":"2024-09-12T18:36:12.334123+0000","last_peered":"2024-09-12T18:36:12.334123+0000","last_clean":"2024-09-12T18:36:12.334123+0000","last_became_active":"2024-09-12T18:35:24.648512+0000","last_became_peered":"2024-09-12T18:35:24.648512+0000","last_unstale":"2024-09-12T18:36:12.334123+0000","last_undegraded":"2024-09-12T18:36:12.334123+0000","last_fullsized":"2024-09-12T18:36:12.334123+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:07.810456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.334288+0000","last_change":"2024-09-12T18:35:25.656799+0000","last_active":"2024-09-12T18:36:12.334288+0000","last_peered":"2024-09-12T18:36:12.334288+0000","last_clean":"2024-09-12T18:36:12.334288+0000","last_became_active":"2024-09-12T18:35:25.654980+0000","last_became_peered":"2024-09-12T18:35:25.654980+0000","last_unstale":"2024-09-12T18:36:12.334288+0000","last_undegraded":"2024-09-12T18:36:12.334288+0000","last_fullsized":"2024-09-12T18:36:12.334288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:10.735439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.913392+0000","last_change":"2024-09-12T18:35:24.656268+0000","last_active":"2024-09-12T18:36:09.913392+0000","last_peered":"2024-09-12T18:36:09.913392+0000","last_clean":"2024-09-12T18:36:09.913392+0000","last_became_active":"2024-09-12T18:35:24.655420+0000","last_became_peered":"2024-09-12T18:35:24.655420+0000","last_unstale":"2024-09-12T18:36:09.913392+0000","last_undegraded":"2024-09-12T18:36:09.913392+0000","last_fullsized":"2024-09-12T18:36:09.913392+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:04.654666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.909853+0000","last_change":"2024-09-12T18:35:25.661042+0000","last_active":"2024-09-12T18:36:09.909853+0000","last_peered":"2024-09-12T18:36:09.909853+0000","last_clean":"2024-09-12T18:36:09.909853+0000","last_became_active":"2024-09-12T18:35:25.660163+0000","last_became_peered":"2024-09-12T18:35:25.660163+0000","last_unstale":"2024-09-12T18:36:09.909853+0000","last_undegraded":"2024-09-12T18:36:09.909853+0000","last_fullsized":"2024-09-12T18:36:09.909853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:37.682184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.913123+0000","last_change":"2024-09-12T18:35:24.652304+0000","last_active":"2024-09-12T18:36:09.913123+0000","last_peered":"2024-09-12T18:36:09.913123+0000","last_clean":"2024-09-12T18:36:09.913123+0000","last_became_active":"2024-09-12T18:35:24.651460+0000","last_became_peered":"2024-09-12T18:35:24.651460+0000","last_unstale":"2024-09-12T18:36:09.913123+0000","last_undegraded":"2024-09-12T18:36:09.913123+0000","last_fullsized":"2024-09-12T18:36:09.913123+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:42.050557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":4450353152,"num_objects":67907,"num_object_clones":0,"num_object_copies":135814,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67907,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67907,"num_write_kb":4346048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":553062400,"data_stored":8848998400,"data_compressed":420195569,"data_compressed_allocated":553062400,"data_compressed_original":8848998400,"omap_allocated":0,"internal_metadata":0},"log_size":60607,"ondisk_log_size":60607,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705679,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":227716,"kb_used_data":156272,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94144124,"statfs":{"total":96636764160,"available":96403582976,"internally_reserved":0,"allocated":160022528,"data_stored":2553558437,"data_compressed":121255843,"data_compressed_allocated":159596544,"data_compressed_original":2553397248,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738383,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":237012,"kb_used_data":165568,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94134828,"statfs":{"total":96636764160,"available":96394063872,"internally_reserved":0,"allocated":169541632,"data_stored":2705860159,"data_compressed":128488045,"data_compressed_allocated":169115648,"data_compressed_original":2705702912,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,3,4,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738383,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307324,"kb_used_data":213672,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94064516,"statfs":{"total":96636764160,"available":96322064384,"internally_reserved":0,"allocated":218800128,"data_stored":3494845725,"data_compressed":165946485,"data_compressed_allocated":218419200,"data_compressed_original":3494707200,"omap_allocated":1594,"internal_metadata":95877574},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":220655616,"data_stored":3530489856,"data_compressed":167645637,"data_compressed_allocated":220655616,"data_compressed_original":3530489856,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":162725888,"data_stored":2603614208,"data_compressed":123632921,"data_compressed_allocated":162725888,"data_compressed_original":2603614208,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":169680896,"data_stored":2714894336,"data_compressed":128917011,"data_compressed_allocated":169680896,"data_compressed_original":2714894336,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:36:16.922 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:16.917+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:16.952 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:16.952 INFO:teuthology.orchestra.run.smithi114.stdout: "size": 20, 2024-09-12T18:36:16.952 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 600, 2024-09-12T18:36:16.952 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:36:16.953 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.953 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:16.953 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:16.953 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 51.318801614999998, 2024-09-12T18:36:16.954 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.042475618999999999, 2024-09-12T18:36:16.954 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:16.954 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:16.954 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:16.954 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:16.955 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.955 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:16.955 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:16.955 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:16.955 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.955 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.956 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:16.956 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:16.956 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:16.956 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.956 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.957 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:16.957 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628450+0000", 2024-09-12T18:36:16.957 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4212999999999999e-05 2024-09-12T18:36:16.957 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.957 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.957 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:16.958 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628463+0000", 2024-09-12T18:36:16.958 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2497000000000001e-05 2024-09-12T18:36:16.958 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.959 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.959 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:16.959 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628480+0000", 2024-09-12T18:36:16.959 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7232999999999999e-05 2024-09-12T18:36:16.959 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.960 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.960 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:16.960 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628496+0000", 2024-09-12T18:36:16.961 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6217000000000001e-05 2024-09-12T18:36:16.961 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.961 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.962 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:16.962 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628641+0000", 2024-09-12T18:36:16.962 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000144709 2024-09-12T18:36:16.962 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.963 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.963 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:16.963 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628657+0000", 2024-09-12T18:36:16.963 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6266e-05 2024-09-12T18:36:16.964 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.964 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.964 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:16.964 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663103+0000", 2024-09-12T18:36:16.964 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.034445523999999998 2024-09-12T18:36:16.964 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.965 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.965 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:16.965 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663373+0000", 2024-09-12T18:36:16.965 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00027085500000000002 2024-09-12T18:36:16.965 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.966 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.966 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:16.966 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663634+0000", 2024-09-12T18:36:16.967 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000260855 2024-09-12T18:36:16.967 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.967 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.967 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:16.967 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670294+0000", 2024-09-12T18:36:16.967 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0066597599999999998 2024-09-12T18:36:16.968 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.968 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.968 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:16.968 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670705+0000", 2024-09-12T18:36:16.968 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00041057099999999998 2024-09-12T18:36:16.969 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.969 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.969 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:16.970 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670820+0000", 2024-09-12T18:36:16.970 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000115111 2024-09-12T18:36:16.970 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.970 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.971 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:16.971 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670912+0000", 2024-09-12T18:36:16.971 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1807999999999999e-05 2024-09-12T18:36:16.971 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:16.971 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:16.971 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:16.971 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.972 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.972 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:16.972 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:16.972 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 51.318710869, 2024-09-12T18:36:16.972 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.044599273000000002, 2024-09-12T18:36:16.972 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:16.972 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:16.972 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:16.972 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:16.972 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.972 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:16.972 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:16.973 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:16.973 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.973 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.973 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:16.973 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:16.973 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:16.973 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.973 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.973 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:16.973 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628528+0000", 2024-09-12T18:36:16.973 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:16.973 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.974 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.974 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:16.974 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628537+0000", 2024-09-12T18:36:16.974 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6969999999999999e-06 2024-09-12T18:36:16.974 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.974 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.974 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:16.974 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628560+0000", 2024-09-12T18:36:16.974 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2889000000000001e-05 2024-09-12T18:36:16.974 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.974 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.974 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:16.975 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628576+0000", 2024-09-12T18:36:16.975 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.649e-05 2024-09-12T18:36:16.975 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.975 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.975 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:16.975 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628846+0000", 2024-09-12T18:36:16.975 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00026952500000000001 2024-09-12T18:36:16.975 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.975 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.975 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:16.975 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628853+0000", 2024-09-12T18:36:16.975 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6559999999999992e-06 2024-09-12T18:36:16.975 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.976 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.976 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:16.976 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665284+0000", 2024-09-12T18:36:16.976 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.036431140000000001 2024-09-12T18:36:16.976 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.976 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.976 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:16.976 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665494+0000", 2024-09-12T18:36:16.976 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000209762 2024-09-12T18:36:16.976 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.976 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.976 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:16.976 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665816+0000", 2024-09-12T18:36:16.977 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00032162299999999999 2024-09-12T18:36:16.977 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.977 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.977 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:16.977 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670382+0000", 2024-09-12T18:36:16.977 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0045656739999999996 2024-09-12T18:36:16.977 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.977 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.977 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:16.977 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.672978+0000", 2024-09-12T18:36:16.977 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.002596068 2024-09-12T18:36:16.977 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.977 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.977 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:16.978 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673058+0000", 2024-09-12T18:36:16.978 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0198999999999996e-05 2024-09-12T18:36:16.978 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.978 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.978 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:16.978 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673126+0000", 2024-09-12T18:36:16.978 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8120000000000005e-05 2024-09-12T18:36:16.978 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:16.978 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:16.978 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:16.979 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.979 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.979 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:23 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:16.979 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:16.979 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 51.318613063000001, 2024-09-12T18:36:16.979 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045539784, 2024-09-12T18:36:16.979 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:16.979 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:16.979 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:16.979 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:16.979 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.979 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:16.979 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:16.980 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:16.980 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.980 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.980 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:16.980 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:16.980 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:16.980 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.980 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.980 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:16.980 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628626+0000", 2024-09-12T18:36:16.980 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.573e-06 2024-09-12T18:36:16.980 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.981 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.981 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:16.981 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628640+0000", 2024-09-12T18:36:16.981 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3817e-05 2024-09-12T18:36:16.981 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.981 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.981 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:16.981 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628659+0000", 2024-09-12T18:36:16.981 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9539999999999999e-05 2024-09-12T18:36:16.981 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.981 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.981 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:16.981 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628675+0000", 2024-09-12T18:36:16.981 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5739e-05 2024-09-12T18:36:16.982 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.982 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.982 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:16.982 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628815+0000", 2024-09-12T18:36:16.982 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014003299999999999 2024-09-12T18:36:16.982 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.982 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.982 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:16.982 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628828+0000", 2024-09-12T18:36:16.982 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2849e-05 2024-09-12T18:36:16.982 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.982 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.982 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:16.983 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651162+0000", 2024-09-12T18:36:16.983 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.022334228000000001 2024-09-12T18:36:16.983 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.983 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.983 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:16.983 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651446+0000", 2024-09-12T18:36:16.983 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00028392800000000002 2024-09-12T18:36:16.983 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.983 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.983 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:16.983 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651746+0000", 2024-09-12T18:36:16.983 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000300091 2024-09-12T18:36:16.983 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.984 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.984 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:16.984 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665113+0000", 2024-09-12T18:36:16.984 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013366678 2024-09-12T18:36:16.984 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.984 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.984 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:16.984 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674010+0000", 2024-09-12T18:36:16.984 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0088970520000000008 2024-09-12T18:36:16.984 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.984 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.984 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:16.984 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674104+0000", 2024-09-12T18:36:16.984 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4124999999999998e-05 2024-09-12T18:36:16.985 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.985 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.985 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:16.985 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674164+0000", 2024-09-12T18:36:16.985 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.0130999999999997e-05 2024-09-12T18:36:16.985 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:16.985 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:16.985 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:16.985 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.985 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.985 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:26 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:16.985 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:16.985 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 51.318539856999998, 2024-09-12T18:36:16.986 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045702136999999997, 2024-09-12T18:36:16.986 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:16.986 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:16.986 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:16.986 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:16.986 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.986 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:16.986 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:16.986 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:16.986 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.986 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.986 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:16.986 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:16.987 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:16.987 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.987 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.987 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:16.987 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628699+0000", 2024-09-12T18:36:16.987 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3859999999999999e-06 2024-09-12T18:36:16.987 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.987 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.987 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:16.987 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628706+0000", 2024-09-12T18:36:16.987 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0169999999999999e-06 2024-09-12T18:36:16.987 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.987 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.988 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:16.988 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628725+0000", 2024-09-12T18:36:16.988 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8683000000000001e-05 2024-09-12T18:36:16.988 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.988 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.988 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:16.988 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628740+0000", 2024-09-12T18:36:16.988 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5413999999999998e-05 2024-09-12T18:36:16.988 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.988 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.988 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:16.988 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628907+0000", 2024-09-12T18:36:16.988 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00016670199999999999 2024-09-12T18:36:16.989 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.989 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.989 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:16.989 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628917+0000", 2024-09-12T18:36:16.989 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.046e-05 2024-09-12T18:36:16.989 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.989 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.989 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:16.989 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.660390+0000", 2024-09-12T18:36:16.989 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.031472364000000003 2024-09-12T18:36:16.989 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.989 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.989 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:16.990 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.661767+0000", 2024-09-12T18:36:16.990 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0013769190000000001 2024-09-12T18:36:16.990 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.990 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.990 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:16.990 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.662408+0000", 2024-09-12T18:36:16.990 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00064091099999999998 2024-09-12T18:36:16.990 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.990 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.990 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:16.990 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669577+0000", 2024-09-12T18:36:16.990 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.007169412 2024-09-12T18:36:16.990 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.990 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.991 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:16.991 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674244+0000", 2024-09-12T18:36:16.991 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0046671839999999996 2024-09-12T18:36:16.991 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.991 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.991 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:16.991 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674329+0000", 2024-09-12T18:36:16.991 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5276000000000001e-05 2024-09-12T18:36:16.991 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.991 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.991 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:16.991 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674400+0000", 2024-09-12T18:36:16.992 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0408999999999996e-05 2024-09-12T18:36:16.992 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:16.992 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:16.992 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:16.992 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.992 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.992 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:16.992 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:16.992 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 51.318432188000003, 2024-09-12T18:36:16.992 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.044572443000000003, 2024-09-12T18:36:16.992 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:16.992 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:16.992 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:16.992 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:16.993 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.993 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:16.993 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:16.993 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:16.993 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.993 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.993 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:16.993 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:16.993 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:16.993 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.993 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.993 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:16.993 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628807+0000", 2024-09-12T18:36:16.994 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3629999999999999e-06 2024-09-12T18:36:16.994 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.994 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.994 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:16.994 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628814+0000", 2024-09-12T18:36:16.994 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.2099999999999996e-06 2024-09-12T18:36:16.994 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.994 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.994 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:16.994 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628832+0000", 2024-09-12T18:36:16.994 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7972999999999999e-05 2024-09-12T18:36:16.994 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.995 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.995 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:16.995 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628854+0000", 2024-09-12T18:36:16.995 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1857000000000001e-05 2024-09-12T18:36:16.995 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.995 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.995 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:16.995 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628984+0000", 2024-09-12T18:36:16.995 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013013599999999999 2024-09-12T18:36:16.995 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.995 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.995 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:16.995 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628993+0000", 2024-09-12T18:36:16.995 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:36:16.996 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.996 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.996 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:16.996 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668176+0000", 2024-09-12T18:36:16.996 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.039182211000000002 2024-09-12T18:36:16.996 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.996 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.996 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:16.996 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668481+0000", 2024-09-12T18:36:16.996 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00030499200000000002 2024-09-12T18:36:16.996 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.996 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.996 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:16.997 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668771+0000", 2024-09-12T18:36:16.997 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00029018700000000002 2024-09-12T18:36:16.997 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.997 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.997 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:16.997 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.672674+0000", 2024-09-12T18:36:16.997 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0039031890000000001 2024-09-12T18:36:16.997 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.997 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.997 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:16.997 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673214+0000", 2024-09-12T18:36:16.997 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00053981600000000004 2024-09-12T18:36:16.997 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.998 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.998 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:16.998 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673310+0000", 2024-09-12T18:36:16.998 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.6682999999999996e-05 2024-09-12T18:36:16.998 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.998 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.998 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:16.998 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673378+0000", 2024-09-12T18:36:16.998 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7385999999999995e-05 2024-09-12T18:36:16.998 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:16.998 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:16.998 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:16.998 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:16.999 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.999 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:16.999 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:16.999 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 51.318296162000003, 2024-09-12T18:36:16.999 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.041480853999999998, 2024-09-12T18:36:16.999 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:16.999 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:16.999 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:16.999 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:16.999 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:16.999 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:16.999 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:17.000 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:17.000 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.000 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.000 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:17.000 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:17.000 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:17.000 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.000 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.000 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:17.000 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628943+0000", 2024-09-12T18:36:17.001 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.403e-06 2024-09-12T18:36:17.001 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.001 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.001 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:17.001 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628953+0000", 2024-09-12T18:36:17.001 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0273e-05 2024-09-12T18:36:17.002 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.002 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.002 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:17.002 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628973+0000", 2024-09-12T18:36:17.002 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9959999999999999e-05 2024-09-12T18:36:17.002 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.002 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.002 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.002 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628989+0000", 2024-09-12T18:36:17.002 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6447e-05 2024-09-12T18:36:17.002 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.002 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.003 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:17.003 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629144+0000", 2024-09-12T18:36:17.003 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015468900000000001 2024-09-12T18:36:17.003 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.003 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.003 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:17.003 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629162+0000", 2024-09-12T18:36:17.003 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7603000000000001e-05 2024-09-12T18:36:17.003 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.003 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.003 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:17.003 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.646927+0000", 2024-09-12T18:36:17.004 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.017765626 2024-09-12T18:36:17.004 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.004 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.004 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:17.004 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.647245+0000", 2024-09-12T18:36:17.004 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00031797699999999999 2024-09-12T18:36:17.004 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.004 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.004 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:17.005 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.647551+0000", 2024-09-12T18:36:17.005 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00030583500000000002 2024-09-12T18:36:17.005 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.005 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.005 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:17.005 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651738+0000", 2024-09-12T18:36:17.005 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0041864980000000003 2024-09-12T18:36:17.005 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.006 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.006 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:17.006 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670207+0000", 2024-09-12T18:36:17.006 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018469299000000002 2024-09-12T18:36:17.006 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.006 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.006 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:17.006 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670330+0000", 2024-09-12T18:36:17.006 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012284500000000001 2024-09-12T18:36:17.006 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.006 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.006 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:17.006 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670422+0000", 2024-09-12T18:36:17.007 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2398999999999994e-05 2024-09-12T18:36:17.007 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:17.007 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:17.007 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:17.007 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.007 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.007 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:17.007 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:17.007 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 51.318218909000002, 2024-09-12T18:36:17.007 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.041623741999999998, 2024-09-12T18:36:17.007 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:17.007 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:17.007 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:17.008 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:17.008 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.008 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:17.008 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:17.008 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:17.008 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.008 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.008 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:17.008 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:17.008 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:17.008 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.008 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.008 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:17.008 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629020+0000", 2024-09-12T18:36:17.009 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.15e-06 2024-09-12T18:36:17.009 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.009 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.009 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:17.009 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629023+0000", 2024-09-12T18:36:17.009 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4659999999999999e-06 2024-09-12T18:36:17.009 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.009 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.013 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:17.013 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629037+0000", 2024-09-12T18:36:17.013 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3857e-05 2024-09-12T18:36:17.013 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.013 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.013 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.013 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629062+0000", 2024-09-12T18:36:17.013 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4519999999999999e-05 2024-09-12T18:36:17.013 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.013 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.013 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:17.013 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629253+0000", 2024-09-12T18:36:17.013 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000191335 2024-09-12T18:36:17.014 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.014 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.014 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:17.014 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629266+0000", 2024-09-12T18:36:17.014 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3322999999999999e-05 2024-09-12T18:36:17.014 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.014 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.014 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:17.014 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648331+0000", 2024-09-12T18:36:17.014 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.019065060000000002 2024-09-12T18:36:17.014 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.014 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.014 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:17.015 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.650044+0000", 2024-09-12T18:36:17.015 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017123959999999999 2024-09-12T18:36:17.015 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.015 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.015 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:17.015 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670642+0000", 2024-09-12T18:36:17.015 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.020598635000000001 2024-09-12T18:36:17.015 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:17.015 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:17.015 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:17.015 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.015 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.015 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:17.015 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:17.016 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 51.318115577, 2024-09-12T18:36:17.016 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.046431252999999999, 2024-09-12T18:36:17.016 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:17.016 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:17.016 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:17.016 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:17.016 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.016 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:17.016 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:17.016 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:17.016 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.016 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.016 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:17.017 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:17.017 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:17.017 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.017 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.017 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:17.017 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629123+0000", 2024-09-12T18:36:17.017 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0899999999999999e-06 2024-09-12T18:36:17.017 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.017 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.017 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:17.017 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629138+0000", 2024-09-12T18:36:17.017 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4977000000000001e-05 2024-09-12T18:36:17.017 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.017 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.018 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:17.018 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629149+0000", 2024-09-12T18:36:17.018 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1182999999999999e-05 2024-09-12T18:36:17.018 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.018 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.018 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.018 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629157+0000", 2024-09-12T18:36:17.018 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8129999999999996e-06 2024-09-12T18:36:17.018 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.018 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.018 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:17.018 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629223+0000", 2024-09-12T18:36:17.018 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6463000000000004e-05 2024-09-12T18:36:17.018 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.019 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.019 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:17.019 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629230+0000", 2024-09-12T18:36:17.019 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1360000000000002e-06 2024-09-12T18:36:17.019 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.019 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.019 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:17.019 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669605+0000", 2024-09-12T18:36:17.019 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.040375518999999999 2024-09-12T18:36:17.019 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.019 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.019 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:17.019 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669840+0000", 2024-09-12T18:36:17.019 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00023520099999999999 2024-09-12T18:36:17.020 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.020 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.020 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:17.020 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.675553+0000", 2024-09-12T18:36:17.020 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0057128709999999996 2024-09-12T18:36:17.020 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:17.020 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:17.020 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:17.020 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.020 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.020 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:17.020 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:17.020 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 51.31806091, 2024-09-12T18:36:17.021 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.037357044999999998, 2024-09-12T18:36:17.021 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:17.021 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:17.021 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:17.021 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:17.021 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.021 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:17.021 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:17.021 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:17.021 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.021 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.021 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:17.021 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:17.022 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:17.022 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.022 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.022 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:17.022 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629178+0000", 2024-09-12T18:36:17.022 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.08e-06 2024-09-12T18:36:17.022 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.022 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.022 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:17.022 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629194+0000", 2024-09-12T18:36:17.022 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5899000000000001e-05 2024-09-12T18:36:17.022 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.022 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.022 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:17.023 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629211+0000", 2024-09-12T18:36:17.023 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7363e-05 2024-09-12T18:36:17.023 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.023 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.023 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.023 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629226+0000", 2024-09-12T18:36:17.023 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4567e-05 2024-09-12T18:36:17.023 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.023 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.023 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:17.023 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629299+0000", 2024-09-12T18:36:17.023 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3910000000000002e-05 2024-09-12T18:36:17.023 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.024 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.024 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:17.024 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629307+0000", 2024-09-12T18:36:17.024 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5299999999999999e-06 2024-09-12T18:36:17.024 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.024 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.024 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:17.024 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648185+0000", 2024-09-12T18:36:17.024 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018878533999999999 2024-09-12T18:36:17.024 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.024 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.024 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:17.024 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.649724+0000", 2024-09-12T18:36:17.024 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001538841 2024-09-12T18:36:17.025 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.025 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.025 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:17.025 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.666534+0000", 2024-09-12T18:36:17.025 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.016809320999999999 2024-09-12T18:36:17.025 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:17.025 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:17.025 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:17.025 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.025 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.025 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:61561 5.e e35/21 5:715fe5e4:::benchmark_data_smithi073_23739_object61560:head v 35'3863, mlcod=35'3861)", 2024-09-12T18:36:17.025 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:09.220994+0000", 2024-09-12T18:36:17.025 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 7.7262436130000003, 2024-09-12T18:36:17.026 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.017185846000000001, 2024-09-12T18:36:17.026 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:17.026 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:17.026 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:17.026 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:17.026 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.026 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:17.026 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.220994+0000", 2024-09-12T18:36:17.026 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:17.026 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.026 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.026 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:17.026 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.220994+0000", 2024-09-12T18:36:17.026 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:17.026 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.027 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.027 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:17.027 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.220995+0000", 2024-09-12T18:36:17.027 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2799999999999996e-07 2024-09-12T18:36:17.027 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.027 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.027 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:17.027 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.221049+0000", 2024-09-12T18:36:17.027 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4506999999999998e-05 2024-09-12T18:36:17.027 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.027 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.027 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:17.027 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.221057+0000", 2024-09-12T18:36:17.028 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.4290000000000001e-06 2024-09-12T18:36:17.028 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.028 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.028 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.028 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.221063+0000", 2024-09-12T18:36:17.028 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7899999999999996e-06 2024-09-12T18:36:17.028 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.028 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.028 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:17.028 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.221135+0000", 2024-09-12T18:36:17.028 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1268999999999998e-05 2024-09-12T18:36:17.028 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.028 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.029 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:17.029 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.221153+0000", 2024-09-12T18:36:17.029 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8892000000000001e-05 2024-09-12T18:36:17.029 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.029 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.029 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:17.029 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.238141+0000", 2024-09-12T18:36:17.029 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.016988077000000001 2024-09-12T18:36:17.029 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.029 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.029 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:17.029 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.238180+0000", 2024-09-12T18:36:17.029 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8254000000000003e-05 2024-09-12T18:36:17.029 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:17.030 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:17.030 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:17.030 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.030 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.030 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:61578 5.6 5:638c8823:::benchmark_data_smithi073_23739_object61577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:36:17.030 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:09.232201+0000", 2024-09-12T18:36:17.030 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 7.7150361240000001, 2024-09-12T18:36:17.030 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.017140757, 2024-09-12T18:36:17.030 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:17.030 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:17.030 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:17.030 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:17.030 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:17.031 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:17.031 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 61578 2024-09-12T18:36:17.031 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.031 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:17.031 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.031 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:17.031 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.232201+0000", 2024-09-12T18:36:17.031 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:17.031 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.031 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.031 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:17.031 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.232201+0000", 2024-09-12T18:36:17.031 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:17.031 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.032 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.032 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:17.032 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.232202+0000", 2024-09-12T18:36:17.032 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1299999999999998e-07 2024-09-12T18:36:17.032 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.032 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.032 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:17.032 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.232276+0000", 2024-09-12T18:36:17.032 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3298000000000002e-05 2024-09-12T18:36:17.032 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.032 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.032 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:17.032 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.232287+0000", 2024-09-12T18:36:17.033 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1049e-05 2024-09-12T18:36:17.033 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.033 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.033 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.033 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.232293+0000", 2024-09-12T18:36:17.033 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6710000000000002e-06 2024-09-12T18:36:17.033 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.033 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.033 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:17.033 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.238749+0000", 2024-09-12T18:36:17.033 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.006455199 2024-09-12T18:36:17.033 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.033 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.033 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:17.034 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.238868+0000", 2024-09-12T18:36:17.034 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000119651 2024-09-12T18:36:17.034 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.034 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.034 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:17.034 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.239038+0000", 2024-09-12T18:36:17.034 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000169696 2024-09-12T18:36:17.034 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.034 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.034 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:17.034 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.245237+0000", 2024-09-12T18:36:17.034 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0061988169999999997 2024-09-12T18:36:17.034 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.035 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.035 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:17.035 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.249223+0000", 2024-09-12T18:36:17.035 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0039859079999999998 2024-09-12T18:36:17.035 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.035 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.035 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:17.035 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.249288+0000", 2024-09-12T18:36:17.035 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5122000000000004e-05 2024-09-12T18:36:17.035 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.035 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.035 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:17.035 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.249342+0000", 2024-09-12T18:36:17.035 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4432999999999999e-05 2024-09-12T18:36:17.036 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:17.036 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:17.036 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:17.036 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.036 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.036 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:68971 5.3 5:c953bb42:::benchmark_data_smithi073_23739_object68970:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:36:17.036 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:12.733487+0000", 2024-09-12T18:36:17.036 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4.213750331, 2024-09-12T18:36:17.036 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.016255100000000001, 2024-09-12T18:36:17.036 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:17.036 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:17.036 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:17.036 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:17.037 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:17.037 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:17.037 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 68971 2024-09-12T18:36:17.037 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.037 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:17.037 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.037 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:17.037 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.733487+0000", 2024-09-12T18:36:17.037 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:17.037 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.037 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.037 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:17.037 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.733487+0000", 2024-09-12T18:36:17.037 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:17.038 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.038 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.038 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:17.038 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.733488+0000", 2024-09-12T18:36:17.038 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6499999999999999e-07 2024-09-12T18:36:17.038 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.038 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.038 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:17.038 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.733605+0000", 2024-09-12T18:36:17.038 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000117496 2024-09-12T18:36:17.038 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.038 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.038 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:17.038 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.733616+0000", 2024-09-12T18:36:17.039 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0351e-05 2024-09-12T18:36:17.039 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.039 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.039 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.039 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.733622+0000", 2024-09-12T18:36:17.039 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7460000000000003e-06 2024-09-12T18:36:17.039 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.039 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.039 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:17.039 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.737237+0000", 2024-09-12T18:36:17.040 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0036150650000000002 2024-09-12T18:36:17.040 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.040 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.040 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:17.040 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.737356+0000", 2024-09-12T18:36:17.040 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000118717 2024-09-12T18:36:17.040 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.040 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.040 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:17.040 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.737501+0000", 2024-09-12T18:36:17.040 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000145153 2024-09-12T18:36:17.040 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.040 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.041 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:17.041 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.739794+0000", 2024-09-12T18:36:17.041 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0022930479999999998 2024-09-12T18:36:17.041 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.041 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.041 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:17.041 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.749633+0000", 2024-09-12T18:36:17.041 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0098388439999999994 2024-09-12T18:36:17.041 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.041 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.041 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:17.041 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.749691+0000", 2024-09-12T18:36:17.041 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7966e-05 2024-09-12T18:36:17.041 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.042 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.042 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:17.042 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.749742+0000", 2024-09-12T18:36:17.042 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1149000000000001e-05 2024-09-12T18:36:17.042 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:17.042 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:17.042 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:17.042 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.042 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.042 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:69221 5.5 5:a8067693:::benchmark_data_smithi073_23739_object69220:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:36:17.042 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:12.862272+0000", 2024-09-12T18:36:17.042 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4.0849654649999998, 2024-09-12T18:36:17.042 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015692447000000002, 2024-09-12T18:36:17.043 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:17.043 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:17.043 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:17.043 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:17.043 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:17.043 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:17.043 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 69221 2024-09-12T18:36:17.043 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.043 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:17.043 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.043 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:17.043 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.862272+0000", 2024-09-12T18:36:17.043 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:17.044 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.044 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.044 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:17.044 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.862272+0000", 2024-09-12T18:36:17.044 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:17.044 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.044 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.044 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:17.044 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.862273+0000", 2024-09-12T18:36:17.044 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.243e-06 2024-09-12T18:36:17.045 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.045 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.045 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:17.045 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.862326+0000", 2024-09-12T18:36:17.045 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2942999999999998e-05 2024-09-12T18:36:17.045 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.045 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.045 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:17.045 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.862338+0000", 2024-09-12T18:36:17.045 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1874e-05 2024-09-12T18:36:17.045 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.045 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.045 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.046 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.862345+0000", 2024-09-12T18:36:17.046 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4579999999999998e-06 2024-09-12T18:36:17.046 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.046 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.046 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:17.046 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.862414+0000", 2024-09-12T18:36:17.046 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.9436000000000004e-05 2024-09-12T18:36:17.046 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.046 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.046 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:17.046 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.862653+0000", 2024-09-12T18:36:17.046 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00023874700000000001 2024-09-12T18:36:17.046 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.047 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.047 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:17.047 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.862844+0000", 2024-09-12T18:36:17.047 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00019086400000000001 2024-09-12T18:36:17.047 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.047 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.047 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:17.047 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.865608+0000", 2024-09-12T18:36:17.047 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0027645870000000002 2024-09-12T18:36:17.047 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.047 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.047 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:17.047 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.877883+0000", 2024-09-12T18:36:17.047 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012275035 2024-09-12T18:36:17.048 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.048 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.048 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:17.048 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.877936+0000", 2024-09-12T18:36:17.048 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.3245000000000003e-05 2024-09-12T18:36:17.048 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.048 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.048 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:17.048 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.877964+0000", 2024-09-12T18:36:17.048 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.8014999999999999e-05 2024-09-12T18:36:17.048 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:17.048 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:17.048 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:17.049 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.049 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.049 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:69416 5.0 e37/21 5:023ec417:::benchmark_data_smithi073_23739_object69415:head v 37'4344, mlcod=37'4340)", 2024-09-12T18:36:17.049 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:12.965158+0000", 2024-09-12T18:36:17.049 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 3.982079079, 2024-09-12T18:36:17.049 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015678377, 2024-09-12T18:36:17.049 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:17.049 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:17.049 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:17.049 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:17.049 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.049 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:17.049 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.965158+0000", 2024-09-12T18:36:17.049 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:17.050 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.050 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.050 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:17.050 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.965158+0000", 2024-09-12T18:36:17.050 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:17.050 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.050 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.050 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:17.050 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.965159+0000", 2024-09-12T18:36:17.050 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.37e-07 2024-09-12T18:36:17.050 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.050 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.050 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:17.051 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.965222+0000", 2024-09-12T18:36:17.051 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3094000000000003e-05 2024-09-12T18:36:17.051 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.051 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.051 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:17.051 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.965230+0000", 2024-09-12T18:36:17.051 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2439999999999993e-06 2024-09-12T18:36:17.051 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.051 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.051 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.051 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.965237+0000", 2024-09-12T18:36:17.051 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1310000000000003e-06 2024-09-12T18:36:17.051 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.051 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.052 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:17.052 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.966036+0000", 2024-09-12T18:36:17.052 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00079909200000000005 2024-09-12T18:36:17.052 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.052 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.052 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:17.052 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.966047+0000", 2024-09-12T18:36:17.052 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1406000000000001e-05 2024-09-12T18:36:17.052 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.052 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.052 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:17.052 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.980807+0000", 2024-09-12T18:36:17.052 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.01476013 2024-09-12T18:36:17.053 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.053 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.053 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:17.053 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.980837+0000", 2024-09-12T18:36:17.053 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.9643000000000001e-05 2024-09-12T18:36:17.053 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:17.053 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:17.053 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:17.053 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.053 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.053 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:69430 5.6 5:672003d5:::benchmark_data_smithi073_23739_object69429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:36:17.053 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:12.970863+0000", 2024-09-12T18:36:17.053 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 3.9763744279999997, 2024-09-12T18:36:17.054 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015683751999999999, 2024-09-12T18:36:17.054 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:17.054 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:17.054 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:17.054 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:17.054 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:17.054 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:17.054 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 69430 2024-09-12T18:36:17.054 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.054 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:17.054 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.054 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:17.054 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.970863+0000", 2024-09-12T18:36:17.054 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:17.055 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.055 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.055 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:17.055 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.970863+0000", 2024-09-12T18:36:17.055 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:17.055 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.055 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.055 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:17.055 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.970864+0000", 2024-09-12T18:36:17.055 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.2799999999999995e-07 2024-09-12T18:36:17.055 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.055 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.055 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:17.056 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.970968+0000", 2024-09-12T18:36:17.056 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00010467 2024-09-12T18:36:17.056 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.056 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.056 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:17.056 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.970980+0000", 2024-09-12T18:36:17.056 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1209999999999999e-05 2024-09-12T18:36:17.056 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.056 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.056 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.056 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.970986+0000", 2024-09-12T18:36:17.056 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7159999999999997e-06 2024-09-12T18:36:17.056 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.056 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.057 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:17.057 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.974718+0000", 2024-09-12T18:36:17.057 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0037316720000000001 2024-09-12T18:36:17.057 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.057 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.057 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:17.057 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.974852+0000", 2024-09-12T18:36:17.057 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013369799999999999 2024-09-12T18:36:17.057 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.057 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.057 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:17.057 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.974985+0000", 2024-09-12T18:36:17.058 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000132772 2024-09-12T18:36:17.058 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.058 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.058 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:17.058 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.979495+0000", 2024-09-12T18:36:17.058 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0045104940000000003 2024-09-12T18:36:17.058 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.058 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.058 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:17.058 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.986409+0000", 2024-09-12T18:36:17.058 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0069137280000000001 2024-09-12T18:36:17.058 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.058 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.058 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:17.059 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.986493+0000", 2024-09-12T18:36:17.059 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.4421999999999999e-05 2024-09-12T18:36:17.059 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.059 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.059 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:17.059 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:12.986547+0000", 2024-09-12T18:36:17.059 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.3641999999999999e-05 2024-09-12T18:36:17.059 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:17.059 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:17.059 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:17.060 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.060 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.060 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:69869 5.a 5:5cd7ff34:::benchmark_data_smithi073_23739_object69868:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:36:17.060 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:13.183607+0000", 2024-09-12T18:36:17.060 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 3.763630719, 2024-09-12T18:36:17.060 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015782029999999999, 2024-09-12T18:36:17.060 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:17.060 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:17.060 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:17.060 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:17.060 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:17.060 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:17.060 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 69869 2024-09-12T18:36:17.061 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.061 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:17.061 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.061 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:17.061 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:13.183607+0000", 2024-09-12T18:36:17.061 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:17.061 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.061 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.061 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:17.061 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:13.183607+0000", 2024-09-12T18:36:17.061 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:17.061 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.061 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.062 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:17.062 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:13.183607+0000", 2024-09-12T18:36:17.062 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4700000000000001e-07 2024-09-12T18:36:17.062 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.062 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.062 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:17.062 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:13.183751+0000", 2024-09-12T18:36:17.062 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014314199999999999 2024-09-12T18:36:17.062 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.062 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.062 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:17.062 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:13.183762+0000", 2024-09-12T18:36:17.062 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.098e-05 2024-09-12T18:36:17.062 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.063 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.063 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.063 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:13.183768+0000", 2024-09-12T18:36:17.063 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8000000000000001e-06 2024-09-12T18:36:17.063 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.063 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.063 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:17.063 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:13.188520+0000", 2024-09-12T18:36:17.063 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0047515470000000001 2024-09-12T18:36:17.064 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.064 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.064 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:17.064 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:13.188634+0000", 2024-09-12T18:36:17.064 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00011380800000000001 2024-09-12T18:36:17.064 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.064 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.064 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:17.064 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:13.188774+0000", 2024-09-12T18:36:17.064 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000140092 2024-09-12T18:36:17.065 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.065 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.065 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:17.065 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:13.193167+0000", 2024-09-12T18:36:17.065 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0043935110000000001 2024-09-12T18:36:17.065 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.065 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.065 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:17.065 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:13.199288+0000", 2024-09-12T18:36:17.065 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0061209710000000002 2024-09-12T18:36:17.065 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.065 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.065 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:17.065 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:13.199353+0000", 2024-09-12T18:36:17.066 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4319000000000005e-05 2024-09-12T18:36:17.066 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.066 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.066 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:17.066 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:13.199389+0000", 2024-09-12T18:36:17.066 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.6213e-05 2024-09-12T18:36:17.066 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:17.066 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:17.066 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:17.066 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.066 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.066 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:77246 5.3 5:ce8e943d:::benchmark_data_smithi073_23739_object77245:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:17.066 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:16.793012+0000", 2024-09-12T18:36:17.067 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.15422571199999999, 2024-09-12T18:36:17.067 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.016348155, 2024-09-12T18:36:17.067 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:17.067 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:17.067 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:17.067 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:17.067 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:17.067 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:17.067 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 77246 2024-09-12T18:36:17.067 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.067 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:17.067 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.067 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:17.068 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.793012+0000", 2024-09-12T18:36:17.068 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:17.068 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.068 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.068 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:17.068 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.793012+0000", 2024-09-12T18:36:17.068 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:17.068 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.068 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.068 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:17.068 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.793012+0000", 2024-09-12T18:36:17.068 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9500000000000002e-07 2024-09-12T18:36:17.068 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.069 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.069 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:17.069 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.793101+0000", 2024-09-12T18:36:17.069 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.8889999999999998e-05 2024-09-12T18:36:17.069 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.069 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.069 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:17.069 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.793110+0000", 2024-09-12T18:36:17.069 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7159999999999992e-06 2024-09-12T18:36:17.069 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.069 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.069 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.070 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.793116+0000", 2024-09-12T18:36:17.070 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.0769999999999996e-06 2024-09-12T18:36:17.070 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.070 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.070 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:17.070 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.795789+0000", 2024-09-12T18:36:17.070 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0026725849999999999 2024-09-12T18:36:17.070 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.070 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.070 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:17.070 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.795930+0000", 2024-09-12T18:36:17.070 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014143000000000001 2024-09-12T18:36:17.070 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.070 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.071 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:17.071 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.796085+0000", 2024-09-12T18:36:17.071 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015526799999999999 2024-09-12T18:36:17.071 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.071 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.071 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:17.071 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.800536+0000", 2024-09-12T18:36:17.071 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.004450931 2024-09-12T18:36:17.071 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.071 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.071 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:17.071 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.809269+0000", 2024-09-12T18:36:17.071 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0087325730000000004 2024-09-12T18:36:17.071 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.072 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.072 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:17.072 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.809319+0000", 2024-09-12T18:36:17.072 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9675000000000001e-05 2024-09-12T18:36:17.072 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.072 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.072 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:17.072 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.809360+0000", 2024-09-12T18:36:17.072 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.1415000000000002e-05 2024-09-12T18:36:17.072 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:17.072 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:17.072 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:17.072 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.073 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.073 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:77241 5.b e38/21 5:d9973dc8:::benchmark_data_smithi073_23739_object77240:head v 38'4928, mlcod=38'4925)", 2024-09-12T18:36:17.073 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:16.794009+0000", 2024-09-12T18:36:17.073 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.153228068, 2024-09-12T18:36:17.073 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.017144257999999999, 2024-09-12T18:36:17.073 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:17.073 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:17.073 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:17.073 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:17.073 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.073 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:17.073 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.794009+0000", 2024-09-12T18:36:17.073 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:17.073 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.074 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.074 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:17.074 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.794009+0000", 2024-09-12T18:36:17.074 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:17.074 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.074 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.074 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:17.074 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.794010+0000", 2024-09-12T18:36:17.074 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8799999999999998e-07 2024-09-12T18:36:17.074 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.074 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.074 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:17.074 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.794047+0000", 2024-09-12T18:36:17.074 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.7407000000000003e-05 2024-09-12T18:36:17.075 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.075 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.075 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:17.075 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.794055+0000", 2024-09-12T18:36:17.075 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5820000000000004e-06 2024-09-12T18:36:17.075 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.075 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.075 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.075 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.794059+0000", 2024-09-12T18:36:17.075 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5179999999999998e-06 2024-09-12T18:36:17.075 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.075 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.075 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:17.076 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.795771+0000", 2024-09-12T18:36:17.076 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017113600000000001 2024-09-12T18:36:17.076 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.076 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.076 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:17.076 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.795789+0000", 2024-09-12T18:36:17.076 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8422000000000001e-05 2024-09-12T18:36:17.076 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.076 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.076 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:17.076 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.811118+0000", 2024-09-12T18:36:17.076 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015329267000000001 2024-09-12T18:36:17.076 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.076 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.077 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:17.077 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.811154+0000", 2024-09-12T18:36:17.077 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.5314000000000001e-05 2024-09-12T18:36:17.077 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:17.077 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:17.077 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:17.077 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.077 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.077 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:77251 5.3 5:c0b45ab3:::benchmark_data_smithi073_23739_object77250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:17.077 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:16.796319+0000", 2024-09-12T18:36:17.077 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.15091812399999999, 2024-09-12T18:36:17.077 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018653991000000002, 2024-09-12T18:36:17.077 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:17.078 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:17.078 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:17.078 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:17.078 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:17.078 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:17.078 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 77251 2024-09-12T18:36:17.078 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.078 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:17.078 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.078 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:17.078 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.796319+0000", 2024-09-12T18:36:17.078 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:17.078 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.078 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.079 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:17.079 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.796319+0000", 2024-09-12T18:36:17.079 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:17.079 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.079 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.079 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:17.079 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.796320+0000", 2024-09-12T18:36:17.079 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1100000000000005e-07 2024-09-12T18:36:17.079 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.079 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.079 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:17.079 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.796353+0000", 2024-09-12T18:36:17.079 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3043000000000002e-05 2024-09-12T18:36:17.079 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.080 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.080 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:17.080 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.796361+0000", 2024-09-12T18:36:17.080 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3989999999999998e-06 2024-09-12T18:36:17.080 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.080 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.080 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.080 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.796367+0000", 2024-09-12T18:36:17.080 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9950000000000002e-06 2024-09-12T18:36:17.080 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.080 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.080 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:17.080 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.800568+0000", 2024-09-12T18:36:17.081 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0042010709999999998 2024-09-12T18:36:17.081 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.081 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.081 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:17.081 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.800679+0000", 2024-09-12T18:36:17.081 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000111119 2024-09-12T18:36:17.081 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.081 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.081 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:17.081 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.800802+0000", 2024-09-12T18:36:17.081 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000123418 2024-09-12T18:36:17.081 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.081 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.082 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:17.082 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.805536+0000", 2024-09-12T18:36:17.082 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0047341309999999999 2024-09-12T18:36:17.082 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.082 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.082 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:17.082 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.814921+0000", 2024-09-12T18:36:17.082 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0093849680000000005 2024-09-12T18:36:17.082 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.082 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.082 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:17.082 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.814951+0000", 2024-09-12T18:36:17.082 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.9189000000000001e-05 2024-09-12T18:36:17.082 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.083 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.083 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:17.083 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.814973+0000", 2024-09-12T18:36:17.083 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2847e-05 2024-09-12T18:36:17.083 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:17.083 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:17.083 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:17.083 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.083 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.083 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:77253 5.b e38/21 5:df1f7025:::benchmark_data_smithi073_23739_object77252:head v 38'4929, mlcod=38'4925)", 2024-09-12T18:36:17.083 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:16.797351+0000", 2024-09-12T18:36:17.083 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.14988699999999999, 2024-09-12T18:36:17.083 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.017650757999999999, 2024-09-12T18:36:17.084 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:17.084 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:17.084 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:17.084 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:17.084 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.084 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:17.084 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.797351+0000", 2024-09-12T18:36:17.084 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:17.084 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.084 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.084 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:17.084 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.797351+0000", 2024-09-12T18:36:17.084 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:17.085 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.085 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.085 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:17.085 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.797351+0000", 2024-09-12T18:36:17.085 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4900000000000005e-07 2024-09-12T18:36:17.085 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.085 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.085 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:17.085 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.797404+0000", 2024-09-12T18:36:17.085 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.3038000000000003e-05 2024-09-12T18:36:17.085 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.085 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.085 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:17.086 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.797413+0000", 2024-09-12T18:36:17.086 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.0899999999999994e-06 2024-09-12T18:36:17.086 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.086 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.086 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.086 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.797419+0000", 2024-09-12T18:36:17.086 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1749999999999996e-06 2024-09-12T18:36:17.086 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.086 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.086 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:17.086 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.802808+0000", 2024-09-12T18:36:17.086 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0053890919999999998 2024-09-12T18:36:17.086 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.087 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.087 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:17.087 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.802819+0000", 2024-09-12T18:36:17.087 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1252e-05 2024-09-12T18:36:17.087 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.087 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.087 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:17.087 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.814977+0000", 2024-09-12T18:36:17.087 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012157651 2024-09-12T18:36:17.087 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:17.087 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:17.087 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:17.087 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.815001+0000", 2024-09-12T18:36:17.088 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4711000000000001e-05 2024-09-12T18:36:17.088 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:17.088 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:17.088 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:17.088 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:17.088 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:17.088 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:17.089 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:36:17.090 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:17.088+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:17.190 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:17.188+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:17.254 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:17.254 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:36:17.254 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.254 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:78210 5.b 5:d28e52be:::benchmark_data_smithi073_23739_object78209:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:17.254 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:17.244627+0000", 2024-09-12T18:36:17.254 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0076351819999999999, 2024-09-12T18:36:17.254 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076523470000000003, 2024-09-12T18:36:17.254 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:17.254 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:17.254 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:17.254 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:17.255 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:17.255 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:17.255 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 78210 2024-09-12T18:36:17.255 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.255 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:17.255 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.255 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:17.255 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.244627+0000", 2024-09-12T18:36:17.255 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.255 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.255 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.255 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:17.255 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.244627+0000", 2024-09-12T18:36:17.255 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.256 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.256 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.256 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:17.256 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.244627+0000", 2024-09-12T18:36:17.256 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5300000000000003e-07 2024-09-12T18:36:17.256 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.256 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.256 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:17.256 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.244751+0000", 2024-09-12T18:36:17.256 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012380299999999999 2024-09-12T18:36:17.256 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.256 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.256 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:17.257 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.244762+0000", 2024-09-12T18:36:17.257 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0546e-05 2024-09-12T18:36:17.257 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.257 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.257 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.257 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.244769+0000", 2024-09-12T18:36:17.257 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3390000000000004e-06 2024-09-12T18:36:17.257 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.257 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.257 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:17.257 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.244833+0000", 2024-09-12T18:36:17.257 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.3985999999999994e-05 2024-09-12T18:36:17.257 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.257 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.258 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:17.258 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.244985+0000", 2024-09-12T18:36:17.258 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015213499999999999 2024-09-12T18:36:17.258 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.258 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.258 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:17.258 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.245134+0000", 2024-09-12T18:36:17.258 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014871400000000001 2024-09-12T18:36:17.258 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.258 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.259 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:17.259 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.252250+0000", 2024-09-12T18:36:17.259 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0071157729999999997 2024-09-12T18:36:17.259 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.259 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:17.259 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.259 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.259 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.259 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:78212 5.8 5:13fc35af:::benchmark_data_smithi073_23739_object78211:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:17.259 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:17.245113+0000", 2024-09-12T18:36:17.259 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0071485610000000003, 2024-09-12T18:36:17.259 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0072327349999999997, 2024-09-12T18:36:17.259 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:17.259 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:17.260 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:17.260 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:17.260 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:17.260 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:17.260 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 78212 2024-09-12T18:36:17.260 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.260 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:17.260 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.260 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:17.260 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.245113+0000", 2024-09-12T18:36:17.260 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.260 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.260 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.260 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:17.261 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.245113+0000", 2024-09-12T18:36:17.261 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.261 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.261 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.261 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:17.261 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.245114+0000", 2024-09-12T18:36:17.261 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8599999999999996e-07 2024-09-12T18:36:17.261 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.261 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.261 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:17.261 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.245194+0000", 2024-09-12T18:36:17.261 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9497000000000001e-05 2024-09-12T18:36:17.261 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.262 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.262 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:17.262 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.245203+0000", 2024-09-12T18:36:17.262 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9090000000000006e-06 2024-09-12T18:36:17.262 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.262 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.262 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.262 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.245211+0000", 2024-09-12T18:36:17.262 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9189999999999999e-06 2024-09-12T18:36:17.262 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.262 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.262 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:17.262 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.245275+0000", 2024-09-12T18:36:17.263 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4435000000000002e-05 2024-09-12T18:36:17.263 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.263 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.263 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:17.263 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.245383+0000", 2024-09-12T18:36:17.263 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000108211 2024-09-12T18:36:17.263 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.263 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.263 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:17.263 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.245515+0000", 2024-09-12T18:36:17.263 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013164000000000001 2024-09-12T18:36:17.263 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.263 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.263 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:17.263 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.250177+0000", 2024-09-12T18:36:17.264 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.004662607 2024-09-12T18:36:17.264 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.264 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:17.264 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.264 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.264 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.264 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:78215 5.d 5:b69be0dc:::benchmark_data_smithi073_23739_object78214:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:17.264 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:17.247346+0000", 2024-09-12T18:36:17.264 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0049158470000000001, 2024-09-12T18:36:17.264 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0050391050000000003, 2024-09-12T18:36:17.264 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:17.264 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:17.264 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:17.265 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:17.265 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:17.265 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:17.265 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 78215 2024-09-12T18:36:17.265 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.265 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:17.265 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.265 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:17.265 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.247346+0000", 2024-09-12T18:36:17.265 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.265 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.265 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.265 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:17.266 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.247346+0000", 2024-09-12T18:36:17.266 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.266 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.266 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.266 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:17.266 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.247348+0000", 2024-09-12T18:36:17.266 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.705e-06 2024-09-12T18:36:17.266 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.266 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.266 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:17.266 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.247434+0000", 2024-09-12T18:36:17.266 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5989000000000006e-05 2024-09-12T18:36:17.266 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.266 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.266 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:17.267 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.247445+0000", 2024-09-12T18:36:17.267 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1712999999999999e-05 2024-09-12T18:36:17.267 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.267 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.267 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.267 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.247454+0000", 2024-09-12T18:36:17.267 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4489999999999999e-06 2024-09-12T18:36:17.267 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.267 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.267 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:17.267 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.247581+0000", 2024-09-12T18:36:17.267 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000127329 2024-09-12T18:36:17.267 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.267 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.268 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:17.268 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.247744+0000", 2024-09-12T18:36:17.268 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016324199999999999 2024-09-12T18:36:17.268 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.268 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.268 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:17.268 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.247941+0000", 2024-09-12T18:36:17.268 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000197002 2024-09-12T18:36:17.268 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.268 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:17.268 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.268 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.268 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.269 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:78218 5.9 e38/21 5:9057928f:::benchmark_data_smithi073_23739_object78217:head v 38'4821, mlcod=38'4819)", 2024-09-12T18:36:17.269 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:17.248857+0000", 2024-09-12T18:36:17.269 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0034043530000000002, 2024-09-12T18:36:17.269 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035621950000000002, 2024-09-12T18:36:17.269 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:17.269 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:17.269 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:17.269 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:17.269 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.269 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:17.269 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.248857+0000", 2024-09-12T18:36:17.269 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.269 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.269 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.270 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:17.270 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.248857+0000", 2024-09-12T18:36:17.270 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.270 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.270 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.270 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:17.270 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.248858+0000", 2024-09-12T18:36:17.270 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6699999999999999e-07 2024-09-12T18:36:17.270 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.270 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.270 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:17.270 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.248894+0000", 2024-09-12T18:36:17.270 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6406999999999999e-05 2024-09-12T18:36:17.270 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.271 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.271 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:17.271 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.248902+0000", 2024-09-12T18:36:17.271 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9829999999999996e-06 2024-09-12T18:36:17.271 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.271 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.271 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.271 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.248906+0000", 2024-09-12T18:36:17.271 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5650000000000002e-06 2024-09-12T18:36:17.271 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.271 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.271 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:17.271 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.248946+0000", 2024-09-12T18:36:17.271 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0638e-05 2024-09-12T18:36:17.272 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.272 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.272 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:17.272 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.248964+0000", 2024-09-12T18:36:17.272 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7944999999999998e-05 2024-09-12T18:36:17.272 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.272 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:17.272 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.272 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.272 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.272 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:78220 5.d 5:bfc5ac7e:::benchmark_data_smithi073_23739_object78219:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:17.272 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:17.249393+0000", 2024-09-12T18:36:17.272 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0028691369999999999, 2024-09-12T18:36:17.272 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003055688, 2024-09-12T18:36:17.273 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:17.273 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:17.273 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:17.273 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:17.273 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:17.273 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:17.273 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 78220 2024-09-12T18:36:17.273 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.273 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:17.273 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.273 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:17.274 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.249393+0000", 2024-09-12T18:36:17.274 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.274 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.274 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.275 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:17.275 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.249393+0000", 2024-09-12T18:36:17.275 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.275 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.275 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.275 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:17.275 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.249393+0000", 2024-09-12T18:36:17.275 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1900000000000002e-07 2024-09-12T18:36:17.275 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.275 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.275 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:17.275 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.249452+0000", 2024-09-12T18:36:17.275 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8873999999999999e-05 2024-09-12T18:36:17.275 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.276 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.276 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:17.276 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.249461+0000", 2024-09-12T18:36:17.276 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2250000000000006e-06 2024-09-12T18:36:17.276 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.276 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.276 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.276 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.249466+0000", 2024-09-12T18:36:17.276 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9180000000000002e-06 2024-09-12T18:36:17.276 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.276 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.276 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:17.276 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.250920+0000", 2024-09-12T18:36:17.277 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014535819999999999 2024-09-12T18:36:17.277 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.277 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.277 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:17.277 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.251047+0000", 2024-09-12T18:36:17.277 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012656399999999999 2024-09-12T18:36:17.277 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.277 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.277 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:17.277 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.251162+0000", 2024-09-12T18:36:17.277 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000115652 2024-09-12T18:36:17.277 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.277 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:17.277 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.278 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.278 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.278 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:78221 5.d 5.92271f5d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:17.278 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:17.249482+0000", 2024-09-12T18:36:17.278 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0027798549999999999, 2024-09-12T18:36:17.278 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0029981579999999999, 2024-09-12T18:36:17.278 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:17.278 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:17.278 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:17.278 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:17.278 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:17.278 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:17.278 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 78221 2024-09-12T18:36:17.278 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.279 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:17.279 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.279 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:17.279 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.249482+0000", 2024-09-12T18:36:17.279 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.279 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.279 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.279 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:17.279 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.249482+0000", 2024-09-12T18:36:17.279 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.279 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.279 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.279 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:17.280 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.249482+0000", 2024-09-12T18:36:17.280 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3300000000000003e-07 2024-09-12T18:36:17.280 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.280 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.280 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:17.280 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.249540+0000", 2024-09-12T18:36:17.280 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8105e-05 2024-09-12T18:36:17.280 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.280 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.281 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:17.281 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.249548+0000", 2024-09-12T18:36:17.281 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6040000000000004e-06 2024-09-12T18:36:17.281 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.281 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.281 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.281 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.249553+0000", 2024-09-12T18:36:17.281 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5210000000000004e-06 2024-09-12T18:36:17.281 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.281 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:17.281 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.281 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.281 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.281 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:78222 5.b 5:d1541c0d:::benchmark_data_smithi073_23739_object78221:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:17.282 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:17.249582+0000", 2024-09-12T18:36:17.282 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0026794119999999999, 2024-09-12T18:36:17.282 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0029264019999999998, 2024-09-12T18:36:17.282 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:17.282 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:17.282 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:17.282 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:17.282 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:17.282 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:17.282 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 78222 2024-09-12T18:36:17.282 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.282 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:17.282 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.282 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:17.283 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.249582+0000", 2024-09-12T18:36:17.283 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.283 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.283 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.283 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:17.283 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.249582+0000", 2024-09-12T18:36:17.283 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.283 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.283 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.283 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:17.283 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.249583+0000", 2024-09-12T18:36:17.283 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2799999999999996e-07 2024-09-12T18:36:17.283 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.283 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.284 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:17.284 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.249635+0000", 2024-09-12T18:36:17.284 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2459e-05 2024-09-12T18:36:17.284 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.284 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.284 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:17.284 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.249642+0000", 2024-09-12T18:36:17.284 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6290000000000004e-06 2024-09-12T18:36:17.284 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.284 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.284 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.284 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.249646+0000", 2024-09-12T18:36:17.284 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1060000000000002e-06 2024-09-12T18:36:17.284 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.285 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.285 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:17.285 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.249699+0000", 2024-09-12T18:36:17.285 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2853999999999999e-05 2024-09-12T18:36:17.285 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.285 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.285 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:17.285 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.249807+0000", 2024-09-12T18:36:17.285 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010785099999999999 2024-09-12T18:36:17.285 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.285 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.285 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:17.285 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.249982+0000", 2024-09-12T18:36:17.286 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000175348 2024-09-12T18:36:17.286 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.286 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:17.286 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.286 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.286 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.286 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:78223 5.9 e38/21 5:97321a38:::benchmark_data_smithi073_23739_object78222:head v 38'4822, mlcod=38'4819)", 2024-09-12T18:36:17.286 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:17.250823+0000", 2024-09-12T18:36:17.286 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.001438588, 2024-09-12T18:36:17.286 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001736055, 2024-09-12T18:36:17.286 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:17.286 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:17.286 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:17.286 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:17.287 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.287 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:17.287 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.250823+0000", 2024-09-12T18:36:17.287 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.287 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.287 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.287 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:17.287 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.250823+0000", 2024-09-12T18:36:17.287 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.287 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.287 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.287 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:17.287 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.250824+0000", 2024-09-12T18:36:17.287 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1500000000000003e-07 2024-09-12T18:36:17.288 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.288 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.288 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:17.288 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.250902+0000", 2024-09-12T18:36:17.288 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.8276999999999996e-05 2024-09-12T18:36:17.288 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.288 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.288 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:17.288 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.250912+0000", 2024-09-12T18:36:17.288 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.577e-06 2024-09-12T18:36:17.288 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.288 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.288 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.288 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.250918+0000", 2024-09-12T18:36:17.289 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.942e-06 2024-09-12T18:36:17.289 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.289 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.289 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:17.289 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.251040+0000", 2024-09-12T18:36:17.289 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000121909 2024-09-12T18:36:17.289 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.289 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.289 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:17.289 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.251071+0000", 2024-09-12T18:36:17.289 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0879e-05 2024-09-12T18:36:17.289 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.289 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:17.289 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.290 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.290 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.290 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(client.4480.0:78215 5.d e38/21)", 2024-09-12T18:36:17.290 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:17.250960+0000", 2024-09-12T18:36:17.290 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0013019990000000001, 2024-09-12T18:36:17.290 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016361749999999999, 2024-09-12T18:36:17.290 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:17.290 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:17.290 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:17.290 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:17.290 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.291 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:17.291 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.250960+0000", 2024-09-12T18:36:17.291 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.291 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.291 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.291 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:17.291 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.250960+0000", 2024-09-12T18:36:17.291 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.291 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.291 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.291 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:17.291 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.250960+0000", 2024-09-12T18:36:17.291 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.61e-07 2024-09-12T18:36:17.291 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.292 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.292 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:17.292 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.250964+0000", 2024-09-12T18:36:17.292 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.112e-06 2024-09-12T18:36:17.292 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.292 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.292 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:17.292 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.250971+0000", 2024-09-12T18:36:17.292 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3239999999999997e-06 2024-09-12T18:36:17.292 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.292 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.292 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.292 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.251018+0000", 2024-09-12T18:36:17.292 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6638000000000003e-05 2024-09-12T18:36:17.293 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.293 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:17.293 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.293 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.293 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.293 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:78224 5.e 5:7fe2e222:::benchmark_data_smithi073_23739_object78223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:17.293 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:17.251259+0000", 2024-09-12T18:36:17.293 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.001003131, 2024-09-12T18:36:17.293 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013917529999999999, 2024-09-12T18:36:17.293 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:17.293 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:17.293 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:17.293 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:17.293 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:17.294 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:17.294 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 78224 2024-09-12T18:36:17.294 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.294 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:17.294 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.294 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:17.294 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.251259+0000", 2024-09-12T18:36:17.294 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.294 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.294 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.294 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:17.294 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.251259+0000", 2024-09-12T18:36:17.294 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.294 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.295 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.295 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:17.295 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.251260+0000", 2024-09-12T18:36:17.295 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.15e-06 2024-09-12T18:36:17.295 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.295 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.295 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:17.295 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.251307+0000", 2024-09-12T18:36:17.295 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7623000000000001e-05 2024-09-12T18:36:17.295 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.295 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.295 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:17.295 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.251320+0000", 2024-09-12T18:36:17.295 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.216e-05 2024-09-12T18:36:17.296 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.296 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.296 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.296 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.251333+0000", 2024-09-12T18:36:17.296 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3777999999999999e-05 2024-09-12T18:36:17.296 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.296 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.296 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:17.296 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.251405+0000", 2024-09-12T18:36:17.296 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1853999999999993e-05 2024-09-12T18:36:17.296 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.296 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.296 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:17.296 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.251520+0000", 2024-09-12T18:36:17.297 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011483499999999999 2024-09-12T18:36:17.297 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.297 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.297 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:17.297 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.251654+0000", 2024-09-12T18:36:17.297 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000133719 2024-09-12T18:36:17.297 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.297 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:17.297 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.297 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.297 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.297 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(client.4480.0:78208 5.0 e38/21 ondisk, result = 0)", 2024-09-12T18:36:17.297 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:17.252535+0000", 2024-09-12T18:36:17.298 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4294967295.9997272, 2024-09-12T18:36:17.298 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00017861999999999999, 2024-09-12T18:36:17.298 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:17.298 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:17.298 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:17.298 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:17.298 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.298 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:17.298 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.252535+0000", 2024-09-12T18:36:17.298 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.298 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.298 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.298 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:17.299 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.252535+0000", 2024-09-12T18:36:17.299 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.299 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.299 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.299 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:17.299 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.252535+0000", 2024-09-12T18:36:17.299 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1200000000000002e-07 2024-09-12T18:36:17.299 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.299 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.299 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:17.299 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.252542+0000", 2024-09-12T18:36:17.299 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1820000000000003e-06 2024-09-12T18:36:17.299 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.299 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.300 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:17.300 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.252551+0000", 2024-09-12T18:36:17.300 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4129999999999995e-06 2024-09-12T18:36:17.300 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.300 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.300 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.300 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.252558+0000", 2024-09-12T18:36:17.300 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9630000000000001e-06 2024-09-12T18:36:17.300 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.300 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.300 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:17.300 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.252609+0000", 2024-09-12T18:36:17.300 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0877000000000001e-05 2024-09-12T18:36:17.301 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.301 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.301 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:17.301 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.252619+0000", 2024-09-12T18:36:17.301 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8449999999999998e-06 2024-09-12T18:36:17.301 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.301 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:17.301 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.301 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.301 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.301 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(client.4480.0:78210 5.b e38/21 ondisk, result = 0)", 2024-09-12T18:36:17.301 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:17.252582+0000", 2024-09-12T18:36:17.301 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4294967295.99968, 2024-09-12T18:36:17.302 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000184611, 2024-09-12T18:36:17.302 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:17.302 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:17.302 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:17.302 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:17.302 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.302 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:17.302 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.252582+0000", 2024-09-12T18:36:17.302 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.302 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.302 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.302 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:17.302 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.252582+0000", 2024-09-12T18:36:17.302 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.303 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.303 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.303 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:17.303 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.252582+0000", 2024-09-12T18:36:17.303 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2500000000000001e-07 2024-09-12T18:36:17.303 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.303 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.303 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:17.303 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.252585+0000", 2024-09-12T18:36:17.303 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5409999999999999e-06 2024-09-12T18:36:17.303 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.303 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.303 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:17.304 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.252592+0000", 2024-09-12T18:36:17.304 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0280000000000003e-06 2024-09-12T18:36:17.304 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.304 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.304 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.304 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.252597+0000", 2024-09-12T18:36:17.304 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.113e-06 2024-09-12T18:36:17.304 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.304 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.304 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:17.304 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.252707+0000", 2024-09-12T18:36:17.304 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000110232 2024-09-12T18:36:17.304 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.305 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.305 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:17.305 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.252714+0000", 2024-09-12T18:36:17.305 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2649999999999999e-06 2024-09-12T18:36:17.305 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.305 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:17.305 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.305 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.305 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.305 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(client.4480.0:78212 5.8 e38/21)", 2024-09-12T18:36:17.305 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:17.252640+0000", 2024-09-12T18:36:17.305 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4294967295.9996214, 2024-09-12T18:36:17.305 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00017489599999999999, 2024-09-12T18:36:17.305 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:17.306 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:17.306 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:17.306 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:17.306 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.306 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:17.306 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.252640+0000", 2024-09-12T18:36:17.306 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.306 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.306 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.306 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:17.306 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.252640+0000", 2024-09-12T18:36:17.306 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.306 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.306 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.307 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:17.307 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.252641+0000", 2024-09-12T18:36:17.307 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6400000000000003e-07 2024-09-12T18:36:17.307 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.307 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.307 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:17.307 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.252643+0000", 2024-09-12T18:36:17.307 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5210000000000001e-06 2024-09-12T18:36:17.307 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.307 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.307 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:17.307 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.252650+0000", 2024-09-12T18:36:17.307 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0740000000000004e-06 2024-09-12T18:36:17.307 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.308 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.308 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.308 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.252656+0000", 2024-09-12T18:36:17.308 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.9479999999999996e-06 2024-09-12T18:36:17.308 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.308 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.308 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:17.308 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.252809+0000", 2024-09-12T18:36:17.308 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000152569 2024-09-12T18:36:17.308 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.308 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.308 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:17.308 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.252817+0000", 2024-09-12T18:36:17.309 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.8839999999999994e-06 2024-09-12T18:36:17.309 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.309 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:17.309 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.309 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.309 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.309 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(client.4480.0:78209 5.4 e38/21)", 2024-09-12T18:36:17.309 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:17.252666+0000", 2024-09-12T18:36:17.309 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4294967295.9995956, 2024-09-12T18:36:17.309 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020066999999999999, 2024-09-12T18:36:17.309 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:17.309 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:17.309 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:17.309 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:17.310 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.310 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:17.310 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.252666+0000", 2024-09-12T18:36:17.310 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.310 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.310 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.310 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:17.310 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.252666+0000", 2024-09-12T18:36:17.310 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.310 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.310 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.310 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:17.310 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.252666+0000", 2024-09-12T18:36:17.311 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8900000000000001e-07 2024-09-12T18:36:17.311 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.311 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.311 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:17.311 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.252669+0000", 2024-09-12T18:36:17.311 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1229999999999998e-06 2024-09-12T18:36:17.311 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.311 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.311 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:17.311 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.252843+0000", 2024-09-12T18:36:17.311 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00017430200000000001 2024-09-12T18:36:17.311 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.311 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.311 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.312 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.252849+0000", 2024-09-12T18:36:17.312 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8799999999999996e-06 2024-09-12T18:36:17.312 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.312 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:17.312 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.312 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.312 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.312 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:78209 5.4 5:28eb3ec6:::benchmark_data_smithi073_23739_object78208:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:17.312 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:17.244163+0000", 2024-09-12T18:36:17.312 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0080989119999999998, 2024-09-12T18:36:17.312 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0087719789999999992, 2024-09-12T18:36:17.312 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:17.312 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:17.313 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:17.313 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:17.313 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:17.313 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:17.313 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 78209 2024-09-12T18:36:17.313 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.313 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:17.313 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.313 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:17.313 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.244163+0000", 2024-09-12T18:36:17.313 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.313 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.313 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.313 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:17.314 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.244163+0000", 2024-09-12T18:36:17.314 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.314 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.314 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.314 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:17.314 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.244163+0000", 2024-09-12T18:36:17.314 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1200000000000003e-07 2024-09-12T18:36:17.314 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.314 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.314 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:17.314 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.244196+0000", 2024-09-12T18:36:17.314 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2237000000000003e-05 2024-09-12T18:36:17.314 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.314 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.315 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:17.315 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.244204+0000", 2024-09-12T18:36:17.315 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6160000000000002e-06 2024-09-12T18:36:17.315 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.315 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.315 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.315 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.244211+0000", 2024-09-12T18:36:17.315 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5810000000000002e-06 2024-09-12T18:36:17.315 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.315 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.315 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:17.315 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.245225+0000", 2024-09-12T18:36:17.315 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0010143019999999999 2024-09-12T18:36:17.315 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.315 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.316 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:17.316 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.245346+0000", 2024-09-12T18:36:17.316 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012057600000000001 2024-09-12T18:36:17.316 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.316 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.316 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:17.316 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.245499+0000", 2024-09-12T18:36:17.316 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000153719 2024-09-12T18:36:17.316 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.316 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.316 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:17.316 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.250157+0000", 2024-09-12T18:36:17.316 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0046578319999999998 2024-09-12T18:36:17.316 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.317 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.317 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:17.317 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.252932+0000", 2024-09-12T18:36:17.317 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0027750169999999998 2024-09-12T18:36:17.317 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.317 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:17.317 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.317 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.317 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-09-12T18:36:17.317 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 15 2024-09-12T18:36:17.317 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:17.319 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:36:17.319 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:17.316+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:17.419 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:17.413+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:17.474 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T18:36:17.515 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:17.516 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-09-12T18:36:17.516 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-09-12T18:36:17.516 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-09-12T18:36:17.516 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:17.520 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:17.513+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:17.535 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:36:17.621 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:17.620+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:17.691 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:17.691 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-09-12T18:36:17.691 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-09-12T18:36:17.691 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:36:17.691 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.691 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:17.691 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:17.691 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 52.055473083000003, 2024-09-12T18:36:17.691 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025088781000000001, 2024-09-12T18:36:17.691 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:17.692 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:17.692 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:17.692 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:17.692 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.692 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:17.692 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:17.692 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.692 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.692 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.692 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:17.692 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:17.692 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.692 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.692 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.693 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:17.693 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632518+0000", 2024-09-12T18:36:17.693 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:36:17.693 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.693 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.693 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:17.693 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632533+0000", 2024-09-12T18:36:17.693 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5130000000000001e-05 2024-09-12T18:36:17.693 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.693 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.693 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:17.693 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632564+0000", 2024-09-12T18:36:17.693 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0788999999999999e-05 2024-09-12T18:36:17.694 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.694 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.694 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.694 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632590+0000", 2024-09-12T18:36:17.694 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6057000000000001e-05 2024-09-12T18:36:17.694 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.694 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.694 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:17.694 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.635931+0000", 2024-09-12T18:36:17.694 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033411320000000001 2024-09-12T18:36:17.694 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.694 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.694 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:17.694 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636186+0000", 2024-09-12T18:36:17.695 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025452500000000002 2024-09-12T18:36:17.695 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.695 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.695 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:17.695 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636445+0000", 2024-09-12T18:36:17.695 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000259268 2024-09-12T18:36:17.695 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.695 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.695 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:17.695 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639562+0000", 2024-09-12T18:36:17.695 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031167 2024-09-12T18:36:17.695 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.695 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.695 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:17.696 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657314+0000", 2024-09-12T18:36:17.696 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017752562 2024-09-12T18:36:17.696 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.696 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.696 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:17.696 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657445+0000", 2024-09-12T18:36:17.696 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013105899999999999 2024-09-12T18:36:17.696 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.696 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.696 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:17.696 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657598+0000", 2024-09-12T18:36:17.696 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015247899999999999 2024-09-12T18:36:17.696 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.697 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:17.697 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.697 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.697 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.697 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:17.697 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:17.697 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 52.055346880000002, 2024-09-12T18:36:17.697 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025643131999999999, 2024-09-12T18:36:17.697 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:17.697 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:17.697 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:17.697 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:17.697 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.697 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:17.698 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:17.698 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.698 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.698 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.698 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:17.698 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:17.698 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.698 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.698 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.698 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:17.698 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632637+0000", 2024-09-12T18:36:17.698 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5600000000000001e-06 2024-09-12T18:36:17.698 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.699 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.699 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:17.699 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632650+0000", 2024-09-12T18:36:17.699 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3186e-05 2024-09-12T18:36:17.699 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.699 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.699 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:17.699 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632672+0000", 2024-09-12T18:36:17.699 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2013000000000001e-05 2024-09-12T18:36:17.699 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.699 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.700 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.700 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632687+0000", 2024-09-12T18:36:17.700 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5109999999999999e-05 2024-09-12T18:36:17.700 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.700 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.700 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:17.700 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636994+0000", 2024-09-12T18:36:17.700 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0043065539999999998 2024-09-12T18:36:17.700 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.700 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.700 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:17.701 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637198+0000", 2024-09-12T18:36:17.701 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020387199999999999 2024-09-12T18:36:17.701 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.701 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.701 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:17.701 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637475+0000", 2024-09-12T18:36:17.701 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027731000000000001 2024-09-12T18:36:17.701 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.701 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.701 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:17.701 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639574+0000", 2024-09-12T18:36:17.701 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020988999999999999 2024-09-12T18:36:17.701 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.702 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.702 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:17.702 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658057+0000", 2024-09-12T18:36:17.702 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018482926 2024-09-12T18:36:17.702 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.702 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.702 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:17.702 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658184+0000", 2024-09-12T18:36:17.702 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012756200000000001 2024-09-12T18:36:17.702 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.703 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.703 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:17.703 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658278+0000", 2024-09-12T18:36:17.703 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4139000000000001e-05 2024-09-12T18:36:17.703 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.703 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:17.703 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.703 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.703 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.703 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:17.703 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:17.703 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 52.055271787999999, 2024-09-12T18:36:17.703 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025238883, 2024-09-12T18:36:17.704 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:17.704 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:17.704 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:17.704 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:17.704 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.704 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:17.704 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:17.704 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.704 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.704 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.704 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:17.704 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:17.704 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.705 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.705 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.705 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:17.705 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632712+0000", 2024-09-12T18:36:17.705 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6869999999999999e-06 2024-09-12T18:36:17.705 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.705 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.705 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:17.705 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632719+0000", 2024-09-12T18:36:17.705 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6059999999999999e-06 2024-09-12T18:36:17.705 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.705 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.705 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:17.706 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632737+0000", 2024-09-12T18:36:17.706 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7983999999999999e-05 2024-09-12T18:36:17.706 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.706 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.706 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.706 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632751+0000", 2024-09-12T18:36:17.706 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4473e-05 2024-09-12T18:36:17.706 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.706 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.706 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:17.706 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636961+0000", 2024-09-12T18:36:17.706 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042100840000000002 2024-09-12T18:36:17.707 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.707 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.707 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:17.707 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637211+0000", 2024-09-12T18:36:17.707 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000249738 2024-09-12T18:36:17.707 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.707 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.707 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:17.707 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637504+0000", 2024-09-12T18:36:17.707 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00029271499999999998 2024-09-12T18:36:17.707 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.707 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.707 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:17.707 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639582+0000", 2024-09-12T18:36:17.708 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020783389999999998 2024-09-12T18:36:17.708 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.708 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.708 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:17.708 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657709+0000", 2024-09-12T18:36:17.708 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018126758999999999 2024-09-12T18:36:17.708 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.708 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.708 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:17.708 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657830+0000", 2024-09-12T18:36:17.708 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000121329 2024-09-12T18:36:17.708 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.708 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.709 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:17.709 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657949+0000", 2024-09-12T18:36:17.709 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000119169 2024-09-12T18:36:17.709 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.709 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:17.709 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.709 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.709 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.709 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:17.709 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:17.709 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 52.055207742, 2024-09-12T18:36:17.709 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026711823999999999, 2024-09-12T18:36:17.709 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:17.710 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:17.710 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:17.710 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:17.710 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.710 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:17.710 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:17.710 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.710 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.710 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.710 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:17.710 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:17.710 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.710 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.711 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.711 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:17.711 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632775+0000", 2024-09-12T18:36:17.711 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9999999999999995e-07 2024-09-12T18:36:17.711 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.711 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.711 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:17.711 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632788+0000", 2024-09-12T18:36:17.711 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2629999999999999e-05 2024-09-12T18:36:17.711 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.711 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.711 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:17.711 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632806+0000", 2024-09-12T18:36:17.712 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:36:17.712 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.712 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.712 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.712 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632820+0000", 2024-09-12T18:36:17.712 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3777e-05 2024-09-12T18:36:17.712 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.712 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.712 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:17.712 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638310+0000", 2024-09-12T18:36:17.712 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054898280000000004 2024-09-12T18:36:17.712 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.712 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.713 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:17.713 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638480+0000", 2024-09-12T18:36:17.713 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016968199999999999 2024-09-12T18:36:17.713 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.713 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.713 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:17.713 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638799+0000", 2024-09-12T18:36:17.713 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031915999999999997 2024-09-12T18:36:17.713 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.713 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.713 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:17.713 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639866+0000", 2024-09-12T18:36:17.713 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001067405 2024-09-12T18:36:17.713 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.714 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.714 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:17.714 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658398+0000", 2024-09-12T18:36:17.714 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018531542000000002 2024-09-12T18:36:17.714 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.714 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.714 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:17.714 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658643+0000", 2024-09-12T18:36:17.714 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00024531500000000002 2024-09-12T18:36:17.714 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.714 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.714 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:17.714 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.659486+0000", 2024-09-12T18:36:17.715 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00084316899999999995 2024-09-12T18:36:17.715 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.715 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:17.715 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.715 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.715 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.715 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:17.715 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:36:17.715 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 52.05498068, 2024-09-12T18:36:17.715 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.021357139000000001, 2024-09-12T18:36:17.715 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:17.715 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:17.715 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:17.716 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:17.716 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.716 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:17.716 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:36:17.716 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.716 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.716 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.716 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:17.716 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:36:17.716 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.716 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.716 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.716 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:17.716 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633003+0000", 2024-09-12T18:36:17.717 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.53e-06 2024-09-12T18:36:17.717 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.717 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.717 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:17.717 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633012+0000", 2024-09-12T18:36:17.717 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9290000000000004e-06 2024-09-12T18:36:17.717 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.717 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.717 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:17.717 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633034+0000", 2024-09-12T18:36:17.717 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2127e-05 2024-09-12T18:36:17.717 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.717 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.717 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.718 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633054+0000", 2024-09-12T18:36:17.718 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9476000000000001e-05 2024-09-12T18:36:17.718 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.718 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.718 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:17.718 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636657+0000", 2024-09-12T18:36:17.718 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036038839999999999 2024-09-12T18:36:17.718 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.718 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.718 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:17.718 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636885+0000", 2024-09-12T18:36:17.718 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022798800000000001 2024-09-12T18:36:17.718 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.718 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.719 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:17.719 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637189+0000", 2024-09-12T18:36:17.719 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030392100000000002 2024-09-12T18:36:17.719 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.719 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.719 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:17.719 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639271+0000", 2024-09-12T18:36:17.719 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020817460000000002 2024-09-12T18:36:17.719 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.719 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.719 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:17.719 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.652371+0000", 2024-09-12T18:36:17.719 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013099417 2024-09-12T18:36:17.719 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.720 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.720 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:17.720 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654255+0000", 2024-09-12T18:36:17.720 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018846049999999999 2024-09-12T18:36:17.720 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.720 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.720 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:17.720 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654359+0000", 2024-09-12T18:36:17.720 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000103516 2024-09-12T18:36:17.720 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.720 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:17.720 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.720 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.721 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.721 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:17.721 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:17.721 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 52.054898987999998, 2024-09-12T18:36:17.721 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026938645000000001, 2024-09-12T18:36:17.721 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:17.721 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:17.721 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:17.721 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:17.721 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.721 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:17.721 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:17.721 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.721 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.722 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.722 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:17.722 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:17.722 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.722 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.722 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.722 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:17.722 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633085+0000", 2024-09-12T18:36:17.722 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:17.722 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.722 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.722 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:17.722 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633093+0000", 2024-09-12T18:36:17.722 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3999999999999992e-06 2024-09-12T18:36:17.723 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.723 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.723 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:17.723 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633111+0000", 2024-09-12T18:36:17.723 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8070000000000001e-05 2024-09-12T18:36:17.723 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.723 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.723 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.723 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633126+0000", 2024-09-12T18:36:17.723 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4487e-05 2024-09-12T18:36:17.723 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.723 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.723 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:17.724 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638290+0000", 2024-09-12T18:36:17.724 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0051640269999999999 2024-09-12T18:36:17.724 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.724 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.724 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:17.724 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638547+0000", 2024-09-12T18:36:17.724 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025714100000000001 2024-09-12T18:36:17.724 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.724 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.724 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:17.724 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638850+0000", 2024-09-12T18:36:17.724 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030278400000000001 2024-09-12T18:36:17.724 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.725 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.725 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:17.725 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.640706+0000", 2024-09-12T18:36:17.725 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018564580000000001 2024-09-12T18:36:17.725 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.725 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.725 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:17.725 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658420+0000", 2024-09-12T18:36:17.725 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017714395000000001 2024-09-12T18:36:17.725 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.725 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.725 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:17.725 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658635+0000", 2024-09-12T18:36:17.725 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021413500000000001 2024-09-12T18:36:17.726 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.726 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.726 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:17.726 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.660022+0000", 2024-09-12T18:36:17.726 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001387318 2024-09-12T18:36:17.726 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.726 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:17.726 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.726 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.726 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.726 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:17.726 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:36:17.726 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 52.054554477000003, 2024-09-12T18:36:17.726 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.020709867, 2024-09-12T18:36:17.727 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:17.727 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:17.727 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:17.727 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:17.727 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.727 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:17.727 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:36:17.727 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.727 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.727 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.727 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:17.727 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:36:17.727 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.727 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.728 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.728 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:17.728 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633429+0000", 2024-09-12T18:36:17.728 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.313e-06 2024-09-12T18:36:17.728 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.728 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.728 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:17.728 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633462+0000", 2024-09-12T18:36:17.728 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3197000000000001e-05 2024-09-12T18:36:17.728 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.728 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.728 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:17.728 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633485+0000", 2024-09-12T18:36:17.729 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3243000000000001e-05 2024-09-12T18:36:17.729 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.729 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.729 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.729 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633501+0000", 2024-09-12T18:36:17.729 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5383000000000002e-05 2024-09-12T18:36:17.729 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.729 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.729 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:17.729 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633642+0000", 2024-09-12T18:36:17.729 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000141168 2024-09-12T18:36:17.729 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.729 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.730 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:17.730 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633982+0000", 2024-09-12T18:36:17.730 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000340067 2024-09-12T18:36:17.730 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.730 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.730 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:17.730 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654138+0000", 2024-09-12T18:36:17.730 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.020155495999999998 2024-09-12T18:36:17.730 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.730 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:17.730 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.730 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.730 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.730 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:40507 5.e 5:729d4bc6:::benchmark_data_smithi073_23739_object40506:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:17.731 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:59.951281+0000", 2024-09-12T18:36:17.731 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 17.736701391, 2024-09-12T18:36:17.731 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016604759, 2024-09-12T18:36:17.731 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:17.731 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:17.731 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:17.731 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:17.731 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:17.731 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:17.731 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 40507 2024-09-12T18:36:17.731 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.731 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:17.731 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.732 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:17.732 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951281+0000", 2024-09-12T18:36:17.732 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.732 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.732 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.732 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:17.732 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951281+0000", 2024-09-12T18:36:17.732 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.732 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.732 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.732 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:17.732 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951282+0000", 2024-09-12T18:36:17.732 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7599999999999996e-07 2024-09-12T18:36:17.733 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.733 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.733 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:17.733 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951390+0000", 2024-09-12T18:36:17.733 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000108075 2024-09-12T18:36:17.733 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.733 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.733 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:17.733 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951425+0000", 2024-09-12T18:36:17.733 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5765000000000001e-05 2024-09-12T18:36:17.733 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.733 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.733 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.733 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951435+0000", 2024-09-12T18:36:17.734 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:36:17.734 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.734 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.734 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:17.734 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951505+0000", 2024-09-12T18:36:17.734 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0655999999999996e-05 2024-09-12T18:36:17.734 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.734 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.734 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:17.734 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951663+0000", 2024-09-12T18:36:17.734 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015736799999999999 2024-09-12T18:36:17.734 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.734 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.734 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:17.735 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.951812+0000", 2024-09-12T18:36:17.735 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014943000000000001 2024-09-12T18:36:17.735 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.735 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.735 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:17.735 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.953812+0000", 2024-09-12T18:36:17.735 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001999781 2024-09-12T18:36:17.735 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.735 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.735 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:17.735 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.967782+0000", 2024-09-12T18:36:17.735 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013969472 2024-09-12T18:36:17.735 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.736 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.736 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:17.736 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.967839+0000", 2024-09-12T18:36:17.736 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7278999999999998e-05 2024-09-12T18:36:17.736 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.736 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.736 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:17.736 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:59.967886+0000", 2024-09-12T18:36:17.736 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6717e-05 2024-09-12T18:36:17.736 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.736 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:17.736 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.736 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.736 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.737 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:40639 5.8 5:16bd0f48:::benchmark_data_smithi073_23739_object40638:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:17.737 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:00.010888+0000", 2024-09-12T18:36:17.737 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 17.677094066999999, 2024-09-12T18:36:17.737 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017069808999999998, 2024-09-12T18:36:17.737 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:17.737 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:17.737 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:17.737 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:17.737 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:17.737 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:17.737 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 40639 2024-09-12T18:36:17.737 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.737 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:17.738 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.738 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:17.738 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010888+0000", 2024-09-12T18:36:17.738 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.738 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.738 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.738 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:17.738 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010888+0000", 2024-09-12T18:36:17.738 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.738 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.738 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.738 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:17.738 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010889+0000", 2024-09-12T18:36:17.738 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.004e-06 2024-09-12T18:36:17.739 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.739 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.739 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:17.739 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010921+0000", 2024-09-12T18:36:17.739 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1745000000000002e-05 2024-09-12T18:36:17.739 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.739 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.739 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:17.739 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010933+0000", 2024-09-12T18:36:17.739 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2476999999999999e-05 2024-09-12T18:36:17.739 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.739 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.739 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.740 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010941+0000", 2024-09-12T18:36:17.740 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1810000000000004e-06 2024-09-12T18:36:17.740 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.740 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.740 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:17.740 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.019947+0000", 2024-09-12T18:36:17.740 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0090069190000000004 2024-09-12T18:36:17.740 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.740 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.740 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:17.740 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.020062+0000", 2024-09-12T18:36:17.740 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000114851 2024-09-12T18:36:17.740 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.741 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.741 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:17.741 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.020148+0000", 2024-09-12T18:36:17.741 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5579000000000002e-05 2024-09-12T18:36:17.741 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.741 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.741 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:17.741 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.026347+0000", 2024-09-12T18:36:17.741 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0061988820000000002 2024-09-12T18:36:17.741 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.741 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.741 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:17.741 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.027866+0000", 2024-09-12T18:36:17.741 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015197190000000001 2024-09-12T18:36:17.742 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.742 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.742 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:17.742 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.027914+0000", 2024-09-12T18:36:17.742 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8009000000000001e-05 2024-09-12T18:36:17.742 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.742 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.742 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:17.742 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.027958+0000", 2024-09-12T18:36:17.742 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3442999999999997e-05 2024-09-12T18:36:17.742 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.742 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:17.742 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.743 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.743 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.743 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:40642 5.0 5:015ece55:::benchmark_data_smithi073_23739_object40641:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:17.743 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:00.011626+0000", 2024-09-12T18:36:17.743 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 17.676356238, 2024-09-12T18:36:17.743 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016593251, 2024-09-12T18:36:17.743 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:17.743 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:17.743 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:17.743 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:17.743 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:17.743 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:17.743 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 40642 2024-09-12T18:36:17.743 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.744 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:17.744 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.744 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:17.744 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.011626+0000", 2024-09-12T18:36:17.744 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.744 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.744 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.744 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:17.744 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.011626+0000", 2024-09-12T18:36:17.744 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.744 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.744 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.744 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:17.745 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.011627+0000", 2024-09-12T18:36:17.745 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.7399999999999991e-07 2024-09-12T18:36:17.745 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.745 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.745 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:17.745 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.011693+0000", 2024-09-12T18:36:17.745 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6586000000000002e-05 2024-09-12T18:36:17.745 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.745 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.745 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:17.745 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.011703+0000", 2024-09-12T18:36:17.745 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.3619999999999995e-06 2024-09-12T18:36:17.745 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.745 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.746 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.746 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.011710+0000", 2024-09-12T18:36:17.746 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1010000000000003e-06 2024-09-12T18:36:17.746 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.746 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.746 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:17.746 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.021346+0000", 2024-09-12T18:36:17.746 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0096362170000000007 2024-09-12T18:36:17.746 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.746 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.746 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:17.746 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.021456+0000", 2024-09-12T18:36:17.746 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010942000000000001 2024-09-12T18:36:17.747 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.747 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.747 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:17.747 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.021540+0000", 2024-09-12T18:36:17.747 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4220000000000003e-05 2024-09-12T18:36:17.747 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.747 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.747 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:17.747 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.027831+0000", 2024-09-12T18:36:17.747 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062915760000000001 2024-09-12T18:36:17.747 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.747 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.747 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:17.747 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.028132+0000", 2024-09-12T18:36:17.748 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030037 2024-09-12T18:36:17.748 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.748 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.748 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:17.748 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.028188+0000", 2024-09-12T18:36:17.748 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6023999999999998e-05 2024-09-12T18:36:17.748 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.748 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.748 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:17.748 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.028219+0000", 2024-09-12T18:36:17.748 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1401e-05 2024-09-12T18:36:17.748 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.748 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:17.749 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.749 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.749 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.749 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:49141 5.d 5:bce526e5:::benchmark_data_smithi073_23739_object49140:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T18:36:17.749 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:03.538808+0000", 2024-09-12T18:36:17.749 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 14.149174431, 2024-09-12T18:36:17.749 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.019659019, 2024-09-12T18:36:17.749 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:17.749 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:17.749 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:17.749 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:17.749 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:17.749 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:17.750 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 49141 2024-09-12T18:36:17.750 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.750 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:17.750 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.750 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:17.750 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538808+0000", 2024-09-12T18:36:17.750 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.750 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.750 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.750 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:17.750 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538808+0000", 2024-09-12T18:36:17.750 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.750 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.751 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.751 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:17.751 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538809+0000", 2024-09-12T18:36:17.751 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.065e-06 2024-09-12T18:36:17.751 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.751 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.751 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:17.751 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538914+0000", 2024-09-12T18:36:17.751 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010528599999999999 2024-09-12T18:36:17.751 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.751 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.751 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:17.751 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538924+0000", 2024-09-12T18:36:17.751 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4420000000000004e-06 2024-09-12T18:36:17.752 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.752 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.752 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.752 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538944+0000", 2024-09-12T18:36:17.752 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0460000000000001e-05 2024-09-12T18:36:17.752 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.752 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.752 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:17.752 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.539034+0000", 2024-09-12T18:36:17.752 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9512000000000006e-05 2024-09-12T18:36:17.752 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.752 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.752 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:17.753 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.539161+0000", 2024-09-12T18:36:17.753 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012782399999999999 2024-09-12T18:36:17.753 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.753 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.753 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:17.753 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.539246+0000", 2024-09-12T18:36:17.753 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4927999999999997e-05 2024-09-12T18:36:17.753 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.753 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.753 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:17.753 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.541390+0000", 2024-09-12T18:36:17.753 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0021439509999999998 2024-09-12T18:36:17.753 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.753 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.754 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:17.754 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.558236+0000", 2024-09-12T18:36:17.754 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016845619999999999 2024-09-12T18:36:17.754 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.754 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.754 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:17.754 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.558368+0000", 2024-09-12T18:36:17.754 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013241300000000001 2024-09-12T18:36:17.754 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.754 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.754 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:17.754 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.558467+0000", 2024-09-12T18:36:17.754 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8517999999999994e-05 2024-09-12T18:36:17.755 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.755 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:17.755 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.755 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.755 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.755 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:52665 5.4 5:2596ded4:::benchmark_data_smithi073_23739_object52664:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:36:17.755 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:05.063686+0000", 2024-09-12T18:36:17.755 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 12.624296186, 2024-09-12T18:36:17.755 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016518109, 2024-09-12T18:36:17.755 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:17.755 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:17.755 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:17.755 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:17.755 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:17.756 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:17.756 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 52665 2024-09-12T18:36:17.756 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.756 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:17.756 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.756 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:17.756 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063686+0000", 2024-09-12T18:36:17.756 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.756 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.756 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.756 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:17.756 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063686+0000", 2024-09-12T18:36:17.756 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.757 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.757 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.757 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:17.757 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063687+0000", 2024-09-12T18:36:17.757 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8800000000000001e-07 2024-09-12T18:36:17.757 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.757 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.757 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:17.757 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063816+0000", 2024-09-12T18:36:17.757 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012879100000000001 2024-09-12T18:36:17.757 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.757 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.757 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:17.757 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063844+0000", 2024-09-12T18:36:17.758 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8683e-05 2024-09-12T18:36:17.758 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.758 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.758 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.758 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063851+0000", 2024-09-12T18:36:17.758 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4110000000000001e-06 2024-09-12T18:36:17.758 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.758 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.758 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:17.758 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.066498+0000", 2024-09-12T18:36:17.758 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00264774 2024-09-12T18:36:17.758 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.758 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.758 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:17.758 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.066620+0000", 2024-09-12T18:36:17.759 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000121919 2024-09-12T18:36:17.759 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.759 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.759 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:17.759 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.066756+0000", 2024-09-12T18:36:17.759 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013559800000000001 2024-09-12T18:36:17.759 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.759 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.759 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:17.759 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.072827+0000", 2024-09-12T18:36:17.759 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0060708439999999997 2024-09-12T18:36:17.759 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.759 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.759 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:17.760 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.080088+0000", 2024-09-12T18:36:17.760 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0072613900000000004 2024-09-12T18:36:17.760 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.760 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.760 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:17.760 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.080146+0000", 2024-09-12T18:36:17.760 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7533e-05 2024-09-12T18:36:17.760 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.760 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.760 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:17.760 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.080204+0000", 2024-09-12T18:36:17.760 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8312e-05 2024-09-12T18:36:17.760 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.760 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:17.761 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.761 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.761 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.761 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:52666 5.4 5:2086007b:::benchmark_data_smithi073_23739_object52665:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:36:17.761 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:05.063873+0000", 2024-09-12T18:36:17.761 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 12.624109302000001, 2024-09-12T18:36:17.761 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016582294000000001, 2024-09-12T18:36:17.761 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:17.761 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:17.761 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:17.761 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:17.761 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:17.761 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:17.761 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 52666 2024-09-12T18:36:17.762 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.762 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:17.762 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.762 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:17.762 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063873+0000", 2024-09-12T18:36:17.762 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.762 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.762 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.762 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:17.762 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063873+0000", 2024-09-12T18:36:17.762 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.762 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.762 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.763 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:17.763 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063874+0000", 2024-09-12T18:36:17.763 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4099999999999998e-07 2024-09-12T18:36:17.763 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.763 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.763 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:17.763 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063925+0000", 2024-09-12T18:36:17.763 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1462999999999998e-05 2024-09-12T18:36:17.763 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.763 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.763 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:17.763 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063937+0000", 2024-09-12T18:36:17.763 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1649e-05 2024-09-12T18:36:17.763 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.763 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.764 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.764 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.063951+0000", 2024-09-12T18:36:17.764 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4161999999999999e-05 2024-09-12T18:36:17.764 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.764 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.764 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:17.764 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.068208+0000", 2024-09-12T18:36:17.764 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042567630000000002 2024-09-12T18:36:17.764 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.764 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.765 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:17.765 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.068319+0000", 2024-09-12T18:36:17.765 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000110955 2024-09-12T18:36:17.765 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.765 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.765 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:17.765 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.068417+0000", 2024-09-12T18:36:17.765 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.7969999999999999e-05 2024-09-12T18:36:17.765 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.765 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.765 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:17.765 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.072834+0000", 2024-09-12T18:36:17.765 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0044172910000000003 2024-09-12T18:36:17.766 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.766 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.766 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:17.766 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.080278+0000", 2024-09-12T18:36:17.766 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0074438880000000001 2024-09-12T18:36:17.766 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.766 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.766 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:17.766 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.080389+0000", 2024-09-12T18:36:17.766 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000111475 2024-09-12T18:36:17.766 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.766 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.766 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:17.766 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.080455+0000", 2024-09-12T18:36:17.767 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5937000000000002e-05 2024-09-12T18:36:17.767 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.767 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:17.767 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.767 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.767 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.767 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:52993 5.0 5:00f9e688:::benchmark_data_smithi073_23739_object52992:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:36:17.767 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:05.209109+0000", 2024-09-12T18:36:17.767 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 12.478873358, 2024-09-12T18:36:17.767 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017556391000000001, 2024-09-12T18:36:17.767 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:17.767 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:17.767 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:17.767 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:17.768 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:17.768 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:17.768 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 52993 2024-09-12T18:36:17.768 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.768 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:17.768 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.768 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:17.768 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.209109+0000", 2024-09-12T18:36:17.768 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.768 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.768 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.768 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:17.768 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.209109+0000", 2024-09-12T18:36:17.769 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.769 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.769 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.769 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:17.769 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.209110+0000", 2024-09-12T18:36:17.769 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8000000000000004e-07 2024-09-12T18:36:17.769 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.769 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.769 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:17.769 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.209246+0000", 2024-09-12T18:36:17.769 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013595 2024-09-12T18:36:17.769 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.769 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.769 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:17.770 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.209256+0000", 2024-09-12T18:36:17.770 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9580000000000002e-06 2024-09-12T18:36:17.770 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.770 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.770 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.770 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.209262+0000", 2024-09-12T18:36:17.770 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7950000000000002e-06 2024-09-12T18:36:17.770 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.770 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.770 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:17.770 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.212362+0000", 2024-09-12T18:36:17.770 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003099606 2024-09-12T18:36:17.770 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.770 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.771 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:17.771 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.212569+0000", 2024-09-12T18:36:17.771 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020737699999999999 2024-09-12T18:36:17.771 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.771 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.771 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:17.771 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.212907+0000", 2024-09-12T18:36:17.771 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00033730499999999998 2024-09-12T18:36:17.771 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.771 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.771 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:17.771 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.226511+0000", 2024-09-12T18:36:17.771 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.01360451 2024-09-12T18:36:17.771 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.772 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.772 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:17.772 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.226567+0000", 2024-09-12T18:36:17.772 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5371000000000002e-05 2024-09-12T18:36:17.772 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.772 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.772 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:17.772 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.226624+0000", 2024-09-12T18:36:17.772 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7355999999999998e-05 2024-09-12T18:36:17.772 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.773 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.773 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:17.773 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.226665+0000", 2024-09-12T18:36:17.773 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1282999999999998e-05 2024-09-12T18:36:17.773 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.773 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:17.773 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.773 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.773 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.773 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:61561 5.e 5:715fe5e4:::benchmark_data_smithi073_23739_object61560:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:36:17.773 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:09.221864+0000", 2024-09-12T18:36:17.773 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 8.4661180159999994, 2024-09-12T18:36:17.773 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017993663999999999, 2024-09-12T18:36:17.774 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:17.774 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:17.774 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:17.774 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:17.774 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:17.774 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:17.774 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 61561 2024-09-12T18:36:17.774 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.774 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:17.774 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.774 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:17.774 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.221864+0000", 2024-09-12T18:36:17.774 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.774 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.775 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.775 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:17.775 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.221864+0000", 2024-09-12T18:36:17.775 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.775 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.775 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.775 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:17.775 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.221865+0000", 2024-09-12T18:36:17.775 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1310000000000001e-06 2024-09-12T18:36:17.775 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.775 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.775 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:17.775 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222022+0000", 2024-09-12T18:36:17.775 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015628500000000001 2024-09-12T18:36:17.776 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.776 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.776 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:17.776 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222034+0000", 2024-09-12T18:36:17.776 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2481e-05 2024-09-12T18:36:17.776 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.776 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.776 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.776 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222041+0000", 2024-09-12T18:36:17.776 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7469999999999999e-06 2024-09-12T18:36:17.776 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.776 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.776 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:17.777 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222103+0000", 2024-09-12T18:36:17.777 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1903999999999995e-05 2024-09-12T18:36:17.777 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.777 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.777 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:17.777 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222199+0000", 2024-09-12T18:36:17.777 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6664999999999997e-05 2024-09-12T18:36:17.777 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.777 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.777 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:17.777 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222286+0000", 2024-09-12T18:36:17.777 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6582999999999994e-05 2024-09-12T18:36:17.777 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.777 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.778 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:17.778 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.228622+0000", 2024-09-12T18:36:17.778 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063357520000000001 2024-09-12T18:36:17.778 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.778 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.778 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:17.778 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.239753+0000", 2024-09-12T18:36:17.778 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011131709 2024-09-12T18:36:17.778 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.778 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.778 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:17.778 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.239813+0000", 2024-09-12T18:36:17.778 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0007999999999999e-05 2024-09-12T18:36:17.778 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.779 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.779 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:17.779 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.239858+0000", 2024-09-12T18:36:17.779 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4399e-05 2024-09-12T18:36:17.779 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.779 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:17.779 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.779 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.779 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.779 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:68606 5.8 5:10a6f333:::benchmark_data_smithi073_23739_object68605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:36:17.779 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:12.561643+0000", 2024-09-12T18:36:17.779 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.126339583, 2024-09-12T18:36:17.779 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016446977000000002, 2024-09-12T18:36:17.779 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:17.780 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:17.780 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:17.780 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:17.780 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:17.780 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:17.780 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 68606 2024-09-12T18:36:17.780 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.780 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:17.780 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.780 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:17.780 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.561643+0000", 2024-09-12T18:36:17.780 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.780 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.780 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.781 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:17.781 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.561643+0000", 2024-09-12T18:36:17.781 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.781 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.781 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.781 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:17.781 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.561643+0000", 2024-09-12T18:36:17.781 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3900000000000004e-07 2024-09-12T18:36:17.781 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.781 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.781 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:17.781 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.561787+0000", 2024-09-12T18:36:17.781 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014318999999999999 2024-09-12T18:36:17.781 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.782 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.782 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:17.782 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.561800+0000", 2024-09-12T18:36:17.782 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3736e-05 2024-09-12T18:36:17.782 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.782 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.782 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.782 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.561812+0000", 2024-09-12T18:36:17.782 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.137e-05 2024-09-12T18:36:17.782 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.782 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.782 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:17.782 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.565842+0000", 2024-09-12T18:36:17.783 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0040301319999999996 2024-09-12T18:36:17.783 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.783 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.783 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:17.783 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.566009+0000", 2024-09-12T18:36:17.783 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016746099999999999 2024-09-12T18:36:17.783 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.783 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.783 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:17.783 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.566209+0000", 2024-09-12T18:36:17.783 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020010199999999999 2024-09-12T18:36:17.783 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.783 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.783 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:17.784 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.573158+0000", 2024-09-12T18:36:17.784 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.006949032 2024-09-12T18:36:17.784 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.784 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.784 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:17.784 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.577999+0000", 2024-09-12T18:36:17.784 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.004840217 2024-09-12T18:36:17.784 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.784 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.784 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:17.784 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.578061+0000", 2024-09-12T18:36:17.784 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1947999999999997e-05 2024-09-12T18:36:17.784 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.785 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.785 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:17.785 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:12.578090+0000", 2024-09-12T18:36:17.785 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8949999999999999e-05 2024-09-12T18:36:17.785 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.785 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:17.785 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.785 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.785 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.785 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:77241 5.b 5:d9973dc8:::benchmark_data_smithi073_23739_object77240:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:17.785 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:16.792553+0000", 2024-09-12T18:36:17.785 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.89542880700000005, 2024-09-12T18:36:17.785 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.019966754999999999, 2024-09-12T18:36:17.785 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:17.786 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:17.786 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:17.786 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:17.786 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:17.786 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:17.786 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 77241 2024-09-12T18:36:17.786 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.786 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:17.786 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.786 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:17.786 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.792553+0000", 2024-09-12T18:36:17.786 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.786 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.787 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.787 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:17.787 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.792553+0000", 2024-09-12T18:36:17.787 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.787 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.787 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.787 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:17.787 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.792554+0000", 2024-09-12T18:36:17.787 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.16e-07 2024-09-12T18:36:17.787 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.787 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.787 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:17.787 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.792661+0000", 2024-09-12T18:36:17.787 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000106909 2024-09-12T18:36:17.788 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.788 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.788 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:17.788 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.792671+0000", 2024-09-12T18:36:17.788 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0268000000000001e-05 2024-09-12T18:36:17.788 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.788 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.788 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.788 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.792678+0000", 2024-09-12T18:36:17.788 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7510000000000002e-06 2024-09-12T18:36:17.788 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.788 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.788 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:17.789 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.794730+0000", 2024-09-12T18:36:17.789 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002051794 2024-09-12T18:36:17.789 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.789 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.789 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:17.789 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.794857+0000", 2024-09-12T18:36:17.789 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012728500000000001 2024-09-12T18:36:17.789 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.789 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.789 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:17.789 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.794987+0000", 2024-09-12T18:36:17.789 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012996899999999999 2024-09-12T18:36:17.789 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.789 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.790 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:17.790 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.797553+0000", 2024-09-12T18:36:17.790 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025652980000000001 2024-09-12T18:36:17.790 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.790 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.790 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:17.790 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.812460+0000", 2024-09-12T18:36:17.790 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.014907884 2024-09-12T18:36:17.790 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.790 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.790 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:17.790 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.812494+0000", 2024-09-12T18:36:17.790 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3525000000000002e-05 2024-09-12T18:36:17.791 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.791 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.791 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:17.791 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.812520+0000", 2024-09-12T18:36:17.791 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6156000000000002e-05 2024-09-12T18:36:17.792 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.792 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:17.792 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.792 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.792 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.792 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:77253 5.b 5:df1f7025:::benchmark_data_smithi073_23739_object77252:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:17.792 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:16.798099+0000", 2024-09-12T18:36:17.792 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.889883117, 2024-09-12T18:36:17.792 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0182598, 2024-09-12T18:36:17.792 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:17.792 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:17.792 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:17.792 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:17.793 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:17.793 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:17.793 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 77253 2024-09-12T18:36:17.793 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.793 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:17.793 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.793 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:17.793 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798099+0000", 2024-09-12T18:36:17.793 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.793 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.793 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.793 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:17.793 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798099+0000", 2024-09-12T18:36:17.794 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.794 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.794 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.794 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:17.794 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798100+0000", 2024-09-12T18:36:17.794 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2449999999999999e-06 2024-09-12T18:36:17.794 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.794 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.794 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:17.794 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798159+0000", 2024-09-12T18:36:17.794 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8925999999999998e-05 2024-09-12T18:36:17.794 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.794 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.794 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:17.795 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798171+0000", 2024-09-12T18:36:17.795 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.206e-05 2024-09-12T18:36:17.795 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.795 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.795 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.795 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798178+0000", 2024-09-12T18:36:17.795 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9009999999999997e-06 2024-09-12T18:36:17.795 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.795 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.795 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:17.795 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798227+0000", 2024-09-12T18:36:17.795 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8794000000000001e-05 2024-09-12T18:36:17.795 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.795 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.796 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:17.796 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798314+0000", 2024-09-12T18:36:17.796 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7322000000000002e-05 2024-09-12T18:36:17.796 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.796 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.796 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:17.796 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798417+0000", 2024-09-12T18:36:17.796 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000102777 2024-09-12T18:36:17.796 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.796 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.796 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:17.796 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.800633+0000", 2024-09-12T18:36:17.796 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022157740000000002 2024-09-12T18:36:17.797 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.797 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.797 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:17.797 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.816295+0000", 2024-09-12T18:36:17.797 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015662359000000001 2024-09-12T18:36:17.797 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.797 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.797 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:17.797 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.816330+0000", 2024-09-12T18:36:17.797 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4353999999999997e-05 2024-09-12T18:36:17.797 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.797 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.797 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:17.798 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.816359+0000", 2024-09-12T18:36:17.798 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9288000000000001e-05 2024-09-12T18:36:17.798 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.798 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:17.798 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.798 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.798 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.798 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:77600 5.8 5:19763263:::benchmark_data_smithi073_23739_object77599:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:17.798 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:16.966879+0000", 2024-09-12T18:36:17.798 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.72110303499999995, 2024-09-12T18:36:17.798 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016582889, 2024-09-12T18:36:17.798 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:17.798 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:17.799 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:17.799 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:17.799 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:17.799 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:17.799 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 77600 2024-09-12T18:36:17.799 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.799 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:17.799 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.799 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:17.799 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.966879+0000", 2024-09-12T18:36:17.799 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.799 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.799 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.799 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:17.800 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.966879+0000", 2024-09-12T18:36:17.800 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.800 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.800 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.800 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:17.800 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.966880+0000", 2024-09-12T18:36:17.800 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.034e-06 2024-09-12T18:36:17.800 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.800 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.800 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:17.800 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.966969+0000", 2024-09-12T18:36:17.800 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8405000000000005e-05 2024-09-12T18:36:17.800 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.801 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.801 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:17.801 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.966982+0000", 2024-09-12T18:36:17.801 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3195e-05 2024-09-12T18:36:17.801 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.801 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.801 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.801 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.966989+0000", 2024-09-12T18:36:17.801 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.576e-06 2024-09-12T18:36:17.801 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.801 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.801 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:17.801 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.972962+0000", 2024-09-12T18:36:17.801 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0059721649999999998 2024-09-12T18:36:17.802 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.802 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.802 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:17.802 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.973055+0000", 2024-09-12T18:36:17.802 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.3670000000000003e-05 2024-09-12T18:36:17.802 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.802 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.802 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:17.802 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.973142+0000", 2024-09-12T18:36:17.802 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7115999999999997e-05 2024-09-12T18:36:17.802 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.802 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.802 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:17.803 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.977990+0000", 2024-09-12T18:36:17.803 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0048472560000000003 2024-09-12T18:36:17.803 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.803 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.803 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:17.803 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.983358+0000", 2024-09-12T18:36:17.803 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0053688219999999997 2024-09-12T18:36:17.803 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.803 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.803 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:17.803 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.983428+0000", 2024-09-12T18:36:17.803 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9289999999999996e-05 2024-09-12T18:36:17.803 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.803 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.804 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:17.804 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.983462+0000", 2024-09-12T18:36:17.804 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4360000000000003e-05 2024-09-12T18:36:17.804 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.804 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:17.804 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.804 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.804 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.804 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:78133 5.b 5:dec6ab35:::benchmark_data_smithi073_23739_object78132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:17.804 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:17.210447+0000", 2024-09-12T18:36:17.804 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.47753542100000002, 2024-09-12T18:36:17.804 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016460529000000002, 2024-09-12T18:36:17.804 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:17.805 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:17.805 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:17.805 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:17.805 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:17.805 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:17.805 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 78133 2024-09-12T18:36:17.805 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.805 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:17.805 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.805 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:17.805 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.210447+0000", 2024-09-12T18:36:17.805 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.805 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.806 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.806 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:17.806 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.210447+0000", 2024-09-12T18:36:17.806 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:17.806 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.806 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.806 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:17.806 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.210447+0000", 2024-09-12T18:36:17.806 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.75e-07 2024-09-12T18:36:17.806 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.806 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.806 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:17.807 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.210485+0000", 2024-09-12T18:36:17.807 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7215999999999997e-05 2024-09-12T18:36:17.807 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.807 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.807 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:17.807 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.210492+0000", 2024-09-12T18:36:17.807 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4089999999999997e-06 2024-09-12T18:36:17.807 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.807 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.807 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.807 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.210499+0000", 2024-09-12T18:36:17.807 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1169999999999998e-06 2024-09-12T18:36:17.808 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.808 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.808 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:17.808 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.215088+0000", 2024-09-12T18:36:17.808 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.004589348 2024-09-12T18:36:17.808 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.808 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.808 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:17.808 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.215176+0000", 2024-09-12T18:36:17.808 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7305999999999994e-05 2024-09-12T18:36:17.808 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.808 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.808 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:17.808 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.215273+0000", 2024-09-12T18:36:17.809 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.7497000000000005e-05 2024-09-12T18:36:17.809 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.809 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.809 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:17.809 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.219061+0000", 2024-09-12T18:36:17.809 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037878109999999999 2024-09-12T18:36:17.809 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.809 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.809 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:17.809 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.224517+0000", 2024-09-12T18:36:17.809 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054564230000000002 2024-09-12T18:36:17.809 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.809 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.810 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:17.810 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.224635+0000", 2024-09-12T18:36:17.810 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000117235 2024-09-12T18:36:17.810 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:17.810 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:17.810 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:17.810 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:17.226907+0000", 2024-09-12T18:36:17.810 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022725919999999999 2024-09-12T18:36:17.810 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.810 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:17.810 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.810 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:17.810 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:17.810 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:17.812 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:36:17.813 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:17.808+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:17.872 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 32 16 79541 79525 155.306 133.25 0.00872659 0.00643345 2024-09-12T18:36:17.912 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:17.905+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:17.969 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:36:17.969 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:36:17.969 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.969 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:79738 5.7 5:e74ce471:::benchmark_data_smithi073_23739_object79737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:17.969 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:17.963558+0000", 2024-09-12T18:36:17.969 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0047195249999999996, 2024-09-12T18:36:17.969 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0047381940000000003, 2024-09-12T18:36:17.969 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:17.969 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:17.970 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:17.970 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:17.970 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:17.970 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:17.970 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 79738 2024-09-12T18:36:17.970 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.970 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:17.970 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.970 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:17.970 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.963558+0000", 2024-09-12T18:36:17.970 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:17.970 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.970 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.971 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:17.971 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.963558+0000", 2024-09-12T18:36:17.971 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:17.971 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.971 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.971 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:17.971 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.963559+0000", 2024-09-12T18:36:17.971 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3540000000000001e-06 2024-09-12T18:36:17.971 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.971 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.971 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:17.971 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.963605+0000", 2024-09-12T18:36:17.971 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.5349000000000002e-05 2024-09-12T18:36:17.972 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.972 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.972 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:17.972 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.963617+0000", 2024-09-12T18:36:17.972 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2765000000000001e-05 2024-09-12T18:36:17.972 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.972 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.972 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.972 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.963625+0000", 2024-09-12T18:36:17.972 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.6909999999999997e-06 2024-09-12T18:36:17.972 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.972 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.972 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:17.973 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.963693+0000", 2024-09-12T18:36:17.973 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.8108000000000006e-05 2024-09-12T18:36:17.973 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.973 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.973 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:17.973 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.963856+0000", 2024-09-12T18:36:17.973 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000162864 2024-09-12T18:36:17.973 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.973 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.973 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:17.973 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.964012+0000", 2024-09-12T18:36:17.973 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000156427 2024-09-12T18:36:17.973 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:17.973 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:17.974 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:17.974 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.974 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.974 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:79730 5.d e38/21 5:b9d659d1:::benchmark_data_smithi073_23739_object79729:head v 38'5010, mlcod=38'5006)", 2024-09-12T18:36:17.974 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:17.963820+0000", 2024-09-12T18:36:17.974 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0044571760000000002, 2024-09-12T18:36:17.974 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0045164849999999998, 2024-09-12T18:36:17.974 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:17.974 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:17.974 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:17.974 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:17.974 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.974 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:17.974 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.963820+0000", 2024-09-12T18:36:17.975 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:17.975 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.975 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.975 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:17.975 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.963820+0000", 2024-09-12T18:36:17.975 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:17.975 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.975 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.975 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:17.975 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.963821+0000", 2024-09-12T18:36:17.975 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.6700000000000003e-07 2024-09-12T18:36:17.975 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.975 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.975 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:17.976 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.963875+0000", 2024-09-12T18:36:17.976 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3533999999999999e-05 2024-09-12T18:36:17.976 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.976 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.976 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:17.976 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.963882+0000", 2024-09-12T18:36:17.976 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.4080000000000001e-06 2024-09-12T18:36:17.976 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.976 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.976 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.976 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.963887+0000", 2024-09-12T18:36:17.976 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.7890000000000002e-06 2024-09-12T18:36:17.976 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.977 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.977 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:17.977 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.963924+0000", 2024-09-12T18:36:17.977 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.6946999999999997e-05 2024-09-12T18:36:17.977 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.977 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.977 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:17.977 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.963935+0000", 2024-09-12T18:36:17.977 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1517e-05 2024-09-12T18:36:17.977 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:17.977 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:17.977 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:17.977 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.977 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.978 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:79739 5.9 5:986454ce:::benchmark_data_smithi073_23739_object79738:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:17.978 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:17.964184+0000", 2024-09-12T18:36:17.978 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0040933039999999999, 2024-09-12T18:36:17.978 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0041828810000000003, 2024-09-12T18:36:17.978 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:17.978 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:17.978 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:17.978 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:17.978 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:17.978 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:17.978 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 79739 2024-09-12T18:36:17.978 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.978 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:17.979 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.979 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:17.979 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.964184+0000", 2024-09-12T18:36:17.979 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:17.979 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.979 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.979 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:17.979 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.964184+0000", 2024-09-12T18:36:17.979 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:17.979 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.979 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.979 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:17.979 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.964185+0000", 2024-09-12T18:36:17.979 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.4300000000000001e-07 2024-09-12T18:36:17.980 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.980 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.980 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:17.980 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.964271+0000", 2024-09-12T18:36:17.980 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5570999999999998e-05 2024-09-12T18:36:17.980 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.980 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.980 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:17.980 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.964281+0000", 2024-09-12T18:36:17.980 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9420000000000007e-06 2024-09-12T18:36:17.980 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.980 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.980 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.981 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.964286+0000", 2024-09-12T18:36:17.981 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2870000000000004e-06 2024-09-12T18:36:17.981 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.981 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.981 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:17.981 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.964328+0000", 2024-09-12T18:36:17.981 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.2188999999999999e-05 2024-09-12T18:36:17.981 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.981 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.981 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:17.981 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.964414+0000", 2024-09-12T18:36:17.981 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.6144999999999996e-05 2024-09-12T18:36:17.981 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.981 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.982 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:17.982 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.964497+0000", 2024-09-12T18:36:17.982 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.2953000000000004e-05 2024-09-12T18:36:17.982 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:17.982 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:17.982 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:17.982 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.982 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.982 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:79740 5.f 5:f175bdfd:::benchmark_data_smithi073_23739_object79739:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:17.982 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:17.964910+0000", 2024-09-12T18:36:17.982 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.003367105, 2024-09-12T18:36:17.982 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0034915499999999999, 2024-09-12T18:36:17.982 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:17.982 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:17.983 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:17.983 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:17.983 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:17.983 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:17.983 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 79740 2024-09-12T18:36:17.983 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.983 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:17.983 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.983 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:17.983 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.964910+0000", 2024-09-12T18:36:17.983 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:17.983 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.983 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.984 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:17.984 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.964910+0000", 2024-09-12T18:36:17.984 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:17.984 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.984 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.984 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:17.984 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.964911+0000", 2024-09-12T18:36:17.984 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.105e-06 2024-09-12T18:36:17.984 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.984 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.984 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:17.984 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.964980+0000", 2024-09-12T18:36:17.984 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.8435000000000005e-05 2024-09-12T18:36:17.985 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.985 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.985 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:17.985 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.964993+0000", 2024-09-12T18:36:17.985 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3115000000000001e-05 2024-09-12T18:36:17.985 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.985 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.985 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.985 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.965000+0000", 2024-09-12T18:36:17.985 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0190000000000001e-06 2024-09-12T18:36:17.985 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.985 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.985 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:17.986 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.965053+0000", 2024-09-12T18:36:17.986 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3151e-05 2024-09-12T18:36:17.986 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.986 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.986 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:17.986 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.965186+0000", 2024-09-12T18:36:17.986 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013280400000000001 2024-09-12T18:36:17.986 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.986 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.986 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:17.986 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.965350+0000", 2024-09-12T18:36:17.986 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00016417100000000001 2024-09-12T18:36:17.986 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:17.986 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:17.987 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:17.987 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.987 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.987 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:79742 5.2 5:4474fa03:::benchmark_data_smithi073_23739_object79741:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:17.987 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:17.966303+0000", 2024-09-12T18:36:17.987 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0019746809999999998, 2024-09-12T18:36:17.987 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0021351349999999998, 2024-09-12T18:36:17.987 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:17.987 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:17.987 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:17.987 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:17.987 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:17.987 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:17.987 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 79742 2024-09-12T18:36:17.988 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.988 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:17.988 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.988 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:17.988 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.966303+0000", 2024-09-12T18:36:17.988 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:17.988 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.988 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.988 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:17.988 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.966303+0000", 2024-09-12T18:36:17.988 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:17.988 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.988 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.989 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:17.989 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.966304+0000", 2024-09-12T18:36:17.989 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0100000000000001e-06 2024-09-12T18:36:17.989 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.989 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.989 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:17.989 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.966384+0000", 2024-09-12T18:36:17.989 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.0659000000000001e-05 2024-09-12T18:36:17.989 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.989 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.989 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:17.989 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.966394+0000", 2024-09-12T18:36:17.989 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.4939999999999992e-06 2024-09-12T18:36:17.990 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.990 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.990 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.990 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.966399+0000", 2024-09-12T18:36:17.990 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2140000000000004e-06 2024-09-12T18:36:17.990 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.990 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.990 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:17.990 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.966454+0000", 2024-09-12T18:36:17.990 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4432999999999999e-05 2024-09-12T18:36:17.990 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.990 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.990 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:17.991 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.966583+0000", 2024-09-12T18:36:17.991 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000129319 2024-09-12T18:36:17.991 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.991 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.991 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:17.991 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.966722+0000", 2024-09-12T18:36:17.991 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013957100000000001 2024-09-12T18:36:17.991 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:17.991 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:17.991 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:17.991 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.991 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.991 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:79731 5.9 5:98b3e0df:::benchmark_data_smithi073_23739_object79730:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:17.991 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:17.960496+0000", 2024-09-12T18:36:17.992 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.007781128, 2024-09-12T18:36:17.992 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0079781149999999992, 2024-09-12T18:36:17.992 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:17.992 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:17.992 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:17.992 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:17.992 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:17.992 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:17.992 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 79731 2024-09-12T18:36:17.992 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.992 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:17.992 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.992 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:17.993 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.960496+0000", 2024-09-12T18:36:17.993 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:17.993 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.993 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.993 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:17.993 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.960496+0000", 2024-09-12T18:36:17.993 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:17.993 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.993 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.993 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:17.993 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.960497+0000", 2024-09-12T18:36:17.993 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1510000000000001e-06 2024-09-12T18:36:17.993 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.993 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.994 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:17.994 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.960559+0000", 2024-09-12T18:36:17.994 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.1672000000000002e-05 2024-09-12T18:36:17.994 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.994 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.994 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:17.994 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.960572+0000", 2024-09-12T18:36:17.994 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2437e-05 2024-09-12T18:36:17.994 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.994 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.994 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:17.994 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.960579+0000", 2024-09-12T18:36:17.994 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.6750000000000002e-06 2024-09-12T18:36:17.994 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.995 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.995 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:17.995 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.962286+0000", 2024-09-12T18:36:17.995 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0017071689999999999 2024-09-12T18:36:17.995 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.995 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.995 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:17.995 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.962370+0000", 2024-09-12T18:36:17.995 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.3267000000000001e-05 2024-09-12T18:36:17.995 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.995 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.995 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:17.995 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.962453+0000", 2024-09-12T18:36:17.995 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.3405000000000005e-05 2024-09-12T18:36:17.996 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:17.996 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:17.996 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:17.996 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:17.966262+0000", 2024-09-12T18:36:17.996 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0038087360000000001 2024-09-12T18:36:17.996 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:17.996 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:17.996 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:17.996 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:17.996 INFO:teuthology.orchestra.run.smithi162.stdout: ], 2024-09-12T18:36:17.996 INFO:teuthology.orchestra.run.smithi162.stdout: "num_ops": 6 2024-09-12T18:36:17.996 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:36:17.998 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:36:18.013 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:18.012+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:18.114 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:18.108+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:18.188 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:36:18.188 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [], 2024-09-12T18:36:18.188 INFO:teuthology.orchestra.run.smithi162.stdout: "complaint_time": 30, 2024-09-12T18:36:18.188 INFO:teuthology.orchestra.run.smithi162.stdout: "num_blocked_ops": 0 2024-09-12T18:36:18.188 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:36:18.211 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:36:18.215 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:18.212+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:18.316 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:18.312+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:18.362 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:36:18.362 INFO:teuthology.orchestra.run.smithi162.stdout: "size": 20, 2024-09-12T18:36:18.362 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 600, 2024-09-12T18:36:18.362 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:36:18.362 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.362 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4154.0:123 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:36:18.362 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:36:18.362 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 64.383458050000002, 2024-09-12T18:36:18.362 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.022398096999999999, 2024-09-12T18:36:18.363 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:18.363 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:18.363 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:18.363 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:18.363 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4154", 2024-09-12T18:36:18.363 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/745129001", 2024-09-12T18:36:18.363 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 123 2024-09-12T18:36:18.363 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.363 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:18.363 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.364 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:18.364 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:36:18.364 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:18.364 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.364 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.364 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:18.364 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:36:18.364 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:18.364 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.364 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.364 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:18.364 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:36:18.365 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.8299999999999996e-07 2024-09-12T18:36:18.365 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.365 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.365 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:18.365 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976528+0000", 2024-09-12T18:36:18.365 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011393299999999999 2024-09-12T18:36:18.365 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.365 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.365 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:18.365 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976539+0000", 2024-09-12T18:36:18.365 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0763e-05 2024-09-12T18:36:18.365 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.365 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.366 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:18.366 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976547+0000", 2024-09-12T18:36:18.366 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8199999999999997e-06 2024-09-12T18:36:18.366 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.366 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.366 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:18.366 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.995057+0000", 2024-09-12T18:36:18.366 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.018510047000000002 2024-09-12T18:36:18.366 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.366 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.366 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:18.366 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.995301+0000", 2024-09-12T18:36:18.366 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00024375899999999999 2024-09-12T18:36:18.366 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.367 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.367 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:18.367 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.995642+0000", 2024-09-12T18:36:18.367 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00034121100000000001 2024-09-12T18:36:18.367 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.367 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.367 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:18.367 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998179+0000", 2024-09-12T18:36:18.367 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00253761 2024-09-12T18:36:18.367 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.367 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.367 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:18.367 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998665+0000", 2024-09-12T18:36:18.368 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00048574600000000001 2024-09-12T18:36:18.368 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.368 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.368 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:18.368 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998739+0000", 2024-09-12T18:36:18.368 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.4286e-05 2024-09-12T18:36:18.368 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.368 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.368 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:18.368 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998812+0000", 2024-09-12T18:36:18.368 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2238999999999997e-05 2024-09-12T18:36:18.368 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:18.368 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:18.369 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:18.369 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.369 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.369 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4154.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:36:18.369 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:36:18.369 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 64.383310817999998, 2024-09-12T18:36:18.369 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025950709999999998, 2024-09-12T18:36:18.369 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:18.369 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:18.369 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:18.369 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:18.369 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4154", 2024-09-12T18:36:18.369 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/745129001", 2024-09-12T18:36:18.370 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 124 2024-09-12T18:36:18.370 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.370 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:18.370 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.370 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:18.370 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:36:18.370 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:18.370 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.370 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.370 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:18.370 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:36:18.370 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:18.371 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.371 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.371 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:18.371 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976562+0000", 2024-09-12T18:36:18.371 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.2999999999999999e-07 2024-09-12T18:36:18.371 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.371 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.371 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:18.371 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976567+0000", 2024-09-12T18:36:18.371 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3430000000000003e-06 2024-09-12T18:36:18.371 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.371 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.371 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:18.372 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976576+0000", 2024-09-12T18:36:18.372 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8070000000000006e-06 2024-09-12T18:36:18.372 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.372 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.372 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:18.372 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976583+0000", 2024-09-12T18:36:18.372 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9959999999999996e-06 2024-09-12T18:36:18.372 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.372 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.372 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:18.372 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997107+0000", 2024-09-12T18:36:18.372 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.020524106 2024-09-12T18:36:18.372 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.373 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.373 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:18.373 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997225+0000", 2024-09-12T18:36:18.373 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000117909 2024-09-12T18:36:18.373 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.373 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.373 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:18.373 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997407+0000", 2024-09-12T18:36:18.373 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00018175900000000001 2024-09-12T18:36:18.373 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.373 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.373 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:18.373 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998839+0000", 2024-09-12T18:36:18.373 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001432539 2024-09-12T18:36:18.374 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.374 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.374 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:18.374 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002319+0000", 2024-09-12T18:36:18.374 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0034803529999999998 2024-09-12T18:36:18.374 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.374 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.374 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:18.374 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002405+0000", 2024-09-12T18:36:18.374 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5434999999999998e-05 2024-09-12T18:36:18.374 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.375 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.375 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:18.375 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002512+0000", 2024-09-12T18:36:18.375 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010663299999999999 2024-09-12T18:36:18.375 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:18.375 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:18.375 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:18.375 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.375 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.375 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:18.375 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:36:18.376 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 52.718513311000002, 2024-09-12T18:36:18.376 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025127867000000002, 2024-09-12T18:36:18.376 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:18.376 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:18.376 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:18.376 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:18.376 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.376 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:18.376 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:36:18.376 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:18.376 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.376 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.377 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:18.377 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:36:18.377 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:18.377 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.377 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.377 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:18.377 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641362+0000", 2024-09-12T18:36:18.377 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.2569999999999999e-06 2024-09-12T18:36:18.377 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.377 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.377 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:18.377 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641374+0000", 2024-09-12T18:36:18.378 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2696e-05 2024-09-12T18:36:18.378 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.378 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.378 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:18.378 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641403+0000", 2024-09-12T18:36:18.378 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.8756999999999999e-05 2024-09-12T18:36:18.378 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.378 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.378 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:18.378 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641430+0000", 2024-09-12T18:36:18.378 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.6452999999999999e-05 2024-09-12T18:36:18.378 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.378 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.378 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:18.379 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641585+0000", 2024-09-12T18:36:18.379 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000155799 2024-09-12T18:36:18.379 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.379 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.379 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:18.379 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641753+0000", 2024-09-12T18:36:18.379 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000167868 2024-09-12T18:36:18.379 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.379 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.379 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:18.379 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641916+0000", 2024-09-12T18:36:18.379 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000162903 2024-09-12T18:36:18.379 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.379 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.379 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:18.380 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653655+0000", 2024-09-12T18:36:18.380 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011738879000000001 2024-09-12T18:36:18.380 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.380 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.380 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:18.380 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665515+0000", 2024-09-12T18:36:18.380 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011859915 2024-09-12T18:36:18.380 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.380 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.380 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:18.380 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665646+0000", 2024-09-12T18:36:18.380 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013122599999999999 2024-09-12T18:36:18.380 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.380 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.380 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:18.381 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666486+0000", 2024-09-12T18:36:18.381 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00084011399999999999 2024-09-12T18:36:18.381 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:18.381 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:18.381 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:18.381 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.381 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.381 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:18.381 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:36:18.381 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 52.718398848, 2024-09-12T18:36:18.381 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025384584000000002, 2024-09-12T18:36:18.381 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:18.382 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:18.382 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:18.382 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:18.382 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.382 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:18.382 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:36:18.382 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:18.382 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.382 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.382 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:18.382 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:36:18.382 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:18.382 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.383 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.383 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:18.383 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641474+0000", 2024-09-12T18:36:18.383 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.39e-06 2024-09-12T18:36:18.383 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.383 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.383 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:18.383 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641482+0000", 2024-09-12T18:36:18.383 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3499999999999999e-06 2024-09-12T18:36:18.383 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.384 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.384 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:18.384 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641534+0000", 2024-09-12T18:36:18.384 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2533e-05 2024-09-12T18:36:18.384 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.384 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.384 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:18.384 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641551+0000", 2024-09-12T18:36:18.384 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6515999999999999e-05 2024-09-12T18:36:18.384 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.384 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.385 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:18.385 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642630+0000", 2024-09-12T18:36:18.385 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001079705 2024-09-12T18:36:18.385 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.385 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.385 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:18.385 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642909+0000", 2024-09-12T18:36:18.385 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027859800000000002 2024-09-12T18:36:18.385 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.385 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.385 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:18.385 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643137+0000", 2024-09-12T18:36:18.386 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022803799999999999 2024-09-12T18:36:18.386 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.386 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.386 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:18.386 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653669+0000", 2024-09-12T18:36:18.386 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010532032 2024-09-12T18:36:18.386 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.386 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.386 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:18.386 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666624+0000", 2024-09-12T18:36:18.386 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012954940999999999 2024-09-12T18:36:18.386 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.386 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.387 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:18.387 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666762+0000", 2024-09-12T18:36:18.387 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000137668 2024-09-12T18:36:18.387 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.387 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.387 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:18.387 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666857+0000", 2024-09-12T18:36:18.387 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.5812999999999999e-05 2024-09-12T18:36:18.387 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:18.387 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:18.387 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:18.387 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.388 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.388 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:18.388 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:36:18.388 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 52.718271053000002, 2024-09-12T18:36:18.388 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025661562999999998, 2024-09-12T18:36:18.388 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:18.388 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:18.388 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:18.388 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:18.388 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.389 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:18.389 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:36:18.389 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:18.389 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.389 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.389 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:18.389 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:36:18.389 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:18.389 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.389 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.389 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:18.389 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641602+0000", 2024-09-12T18:36:18.389 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3540000000000001e-06 2024-09-12T18:36:18.390 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.390 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.390 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:18.390 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641637+0000", 2024-09-12T18:36:18.390 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5145999999999999e-05 2024-09-12T18:36:18.390 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.390 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.390 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:18.390 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641659+0000", 2024-09-12T18:36:18.390 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2249999999999999e-05 2024-09-12T18:36:18.390 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.390 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.391 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:18.391 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641675+0000", 2024-09-12T18:36:18.391 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6059999999999999e-05 2024-09-12T18:36:18.391 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.391 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.391 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:18.391 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644570+0000", 2024-09-12T18:36:18.391 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028947069999999998 2024-09-12T18:36:18.391 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.391 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.391 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:18.391 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644900+0000", 2024-09-12T18:36:18.391 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000329401 2024-09-12T18:36:18.392 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.392 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.392 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:18.392 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645235+0000", 2024-09-12T18:36:18.392 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000335874 2024-09-12T18:36:18.392 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.392 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.392 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:18.392 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655459+0000", 2024-09-12T18:36:18.392 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010223441999999999 2024-09-12T18:36:18.392 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.393 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.393 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:18.393 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667028+0000", 2024-09-12T18:36:18.393 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011568673999999999 2024-09-12T18:36:18.393 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.393 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.393 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:18.393 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667163+0000", 2024-09-12T18:36:18.393 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013525500000000001 2024-09-12T18:36:18.393 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.394 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.394 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:18.394 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667262+0000", 2024-09-12T18:36:18.394 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9400000000000004e-05 2024-09-12T18:36:18.394 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:18.394 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:18.394 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:18.395 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.395 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.395 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:18.395 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:36:18.395 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 52.718169232999998, 2024-09-12T18:36:18.395 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025971339, 2024-09-12T18:36:18.395 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:18.395 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:18.395 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:18.395 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:18.396 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.396 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:18.396 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:36:18.396 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:18.396 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.396 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.396 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:18.396 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:36:18.396 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:18.396 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.397 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.397 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:18.397 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641704+0000", 2024-09-12T18:36:18.397 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.297e-06 2024-09-12T18:36:18.397 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.397 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.397 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:18.397 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641712+0000", 2024-09-12T18:36:18.397 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.9060000000000002e-06 2024-09-12T18:36:18.397 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.397 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.397 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:18.397 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641731+0000", 2024-09-12T18:36:18.398 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9083e-05 2024-09-12T18:36:18.398 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.398 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.398 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:18.398 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641745+0000", 2024-09-12T18:36:18.398 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4066999999999999e-05 2024-09-12T18:36:18.398 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.398 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.398 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:18.398 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646529+0000", 2024-09-12T18:36:18.398 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.004784033 2024-09-12T18:36:18.398 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.399 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.399 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:18.399 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646727+0000", 2024-09-12T18:36:18.399 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019841800000000001 2024-09-12T18:36:18.399 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.399 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.399 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:18.399 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647057+0000", 2024-09-12T18:36:18.399 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032926800000000002 2024-09-12T18:36:18.399 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.399 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.399 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:18.400 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655475+0000", 2024-09-12T18:36:18.400 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0084186250000000008 2024-09-12T18:36:18.400 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.400 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.400 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:18.400 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667424+0000", 2024-09-12T18:36:18.400 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011949257 2024-09-12T18:36:18.400 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.400 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.400 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:18.400 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667573+0000", 2024-09-12T18:36:18.400 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014851900000000001 2024-09-12T18:36:18.401 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.401 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.401 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:18.401 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667674+0000", 2024-09-12T18:36:18.401 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010086600000000001 2024-09-12T18:36:18.401 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:18.401 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:18.401 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:18.401 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.401 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.401 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:18.401 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:36:18.402 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 52.718106843999998, 2024-09-12T18:36:18.402 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026215008000000001, 2024-09-12T18:36:18.402 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:18.402 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:18.402 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:18.402 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:18.402 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.402 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:18.402 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:36:18.402 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:18.402 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.402 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.403 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:18.403 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:36:18.403 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:18.403 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.403 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.403 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:18.403 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641766+0000", 2024-09-12T18:36:18.403 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1200000000000001e-06 2024-09-12T18:36:18.403 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.403 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.403 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:18.403 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641775+0000", 2024-09-12T18:36:18.403 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.2499999999999995e-06 2024-09-12T18:36:18.404 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.404 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.404 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:18.404 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641793+0000", 2024-09-12T18:36:18.404 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7773000000000001e-05 2024-09-12T18:36:18.404 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.404 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.404 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:18.404 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641807+0000", 2024-09-12T18:36:18.404 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3814e-05 2024-09-12T18:36:18.404 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.404 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.405 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:18.405 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647626+0000", 2024-09-12T18:36:18.405 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0058193050000000003 2024-09-12T18:36:18.405 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.405 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.405 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:18.405 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647937+0000", 2024-09-12T18:36:18.405 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031112400000000003 2024-09-12T18:36:18.405 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.405 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.405 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:18.405 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648239+0000", 2024-09-12T18:36:18.405 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00030227500000000002 2024-09-12T18:36:18.406 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.406 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.406 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:18.406 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655487+0000", 2024-09-12T18:36:18.406 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072479129999999999 2024-09-12T18:36:18.406 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.406 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.406 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:18.406 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667823+0000", 2024-09-12T18:36:18.406 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012335505 2024-09-12T18:36:18.406 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.406 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.407 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:18.407 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667908+0000", 2024-09-12T18:36:18.407 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4843000000000001e-05 2024-09-12T18:36:18.407 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.407 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.407 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:18.407 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667980+0000", 2024-09-12T18:36:18.407 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2086000000000001e-05 2024-09-12T18:36:18.407 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:18.407 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:18.407 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:18.408 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.408 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.408 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:18.408 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:36:18.408 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 52.718046690999998, 2024-09-12T18:36:18.408 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026483236, 2024-09-12T18:36:18.408 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:18.408 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:18.408 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:18.408 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:18.408 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.408 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:18.408 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:36:18.409 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:18.409 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.409 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.409 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:18.409 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:36:18.409 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:18.409 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.409 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.409 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:18.409 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641826+0000", 2024-09-12T18:36:18.409 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:36:18.409 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.410 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.410 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:18.410 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641832+0000", 2024-09-12T18:36:18.410 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4199999999999998e-06 2024-09-12T18:36:18.410 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.410 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.410 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:18.410 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641848+0000", 2024-09-12T18:36:18.410 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6492999999999999e-05 2024-09-12T18:36:18.410 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.410 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.410 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:18.410 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641863+0000", 2024-09-12T18:36:18.410 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5427e-05 2024-09-12T18:36:18.411 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.411 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.411 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:18.411 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648887+0000", 2024-09-12T18:36:18.411 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0070230860000000004 2024-09-12T18:36:18.411 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.411 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.411 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:18.411 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649111+0000", 2024-09-12T18:36:18.411 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022425799999999999 2024-09-12T18:36:18.411 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.411 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.411 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:18.412 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649494+0000", 2024-09-12T18:36:18.412 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00038349400000000001 2024-09-12T18:36:18.412 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.412 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.412 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:18.412 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655499+0000", 2024-09-12T18:36:18.412 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0060047260000000002 2024-09-12T18:36:18.412 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.412 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.412 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:18.412 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668110+0000", 2024-09-12T18:36:18.412 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012610543 2024-09-12T18:36:18.413 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.413 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.413 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:18.413 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668252+0000", 2024-09-12T18:36:18.413 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014265600000000001 2024-09-12T18:36:18.413 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.413 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.413 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:18.413 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668308+0000", 2024-09-12T18:36:18.413 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5992999999999997e-05 2024-09-12T18:36:18.413 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:18.413 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:18.414 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:18.414 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.414 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.414 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:18.414 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:36:18.414 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 52.717991474999998, 2024-09-12T18:36:18.414 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026605302000000001, 2024-09-12T18:36:18.414 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:18.414 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:18.414 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:18.414 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:18.414 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.415 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:18.415 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:36:18.415 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:18.415 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.415 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.415 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:18.415 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:36:18.415 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:18.415 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.415 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.415 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:18.415 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641881+0000", 2024-09-12T18:36:18.415 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.057e-06 2024-09-12T18:36:18.416 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.416 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.416 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:18.416 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641887+0000", 2024-09-12T18:36:18.416 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.6629999999999998e-06 2024-09-12T18:36:18.416 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.416 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.416 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:18.416 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641903+0000", 2024-09-12T18:36:18.416 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6317e-05 2024-09-12T18:36:18.416 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.416 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.417 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:18.417 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641917+0000", 2024-09-12T18:36:18.417 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3339999999999999e-05 2024-09-12T18:36:18.417 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.417 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.417 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:18.417 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650708+0000", 2024-09-12T18:36:18.417 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.008791419 2024-09-12T18:36:18.417 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.417 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.417 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:18.417 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651021+0000", 2024-09-12T18:36:18.417 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031296699999999999 2024-09-12T18:36:18.418 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.418 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.418 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:18.418 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651349+0000", 2024-09-12T18:36:18.418 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032796499999999999 2024-09-12T18:36:18.418 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.418 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.418 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:18.418 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655742+0000", 2024-09-12T18:36:18.418 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0043934680000000002 2024-09-12T18:36:18.418 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.419 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.419 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:18.419 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668377+0000", 2024-09-12T18:36:18.419 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012634312999999999 2024-09-12T18:36:18.419 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.419 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.419 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:18.419 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668441+0000", 2024-09-12T18:36:18.419 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4369999999999995e-05 2024-09-12T18:36:18.419 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.419 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.419 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:18.420 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668485+0000", 2024-09-12T18:36:18.420 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4422999999999998e-05 2024-09-12T18:36:18.420 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:18.420 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:18.420 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:18.420 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.420 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.420 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:18.420 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:36:18.420 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 52.717934071999998, 2024-09-12T18:36:18.420 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026919499, 2024-09-12T18:36:18.421 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:18.421 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:18.421 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:18.421 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:18.421 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.421 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:18.421 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:36:18.421 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:18.421 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.421 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.421 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:18.421 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:36:18.422 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:18.422 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.422 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.422 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:18.422 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641939+0000", 2024-09-12T18:36:18.422 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9399999999999993e-07 2024-09-12T18:36:18.422 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.422 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.422 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:18.422 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641945+0000", 2024-09-12T18:36:18.422 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9200000000000001e-06 2024-09-12T18:36:18.422 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.422 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.422 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:18.423 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641961+0000", 2024-09-12T18:36:18.423 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6520000000000001e-05 2024-09-12T18:36:18.423 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.423 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.423 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:18.423 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641974+0000", 2024-09-12T18:36:18.423 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3413e-05 2024-09-12T18:36:18.423 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.423 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.423 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:18.423 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654560+0000", 2024-09-12T18:36:18.424 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012585308999999999 2024-09-12T18:36:18.424 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.424 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.424 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:18.424 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654822+0000", 2024-09-12T18:36:18.424 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026210099999999999 2024-09-12T18:36:18.424 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.424 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.424 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:18.424 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655059+0000", 2024-09-12T18:36:18.424 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00023747899999999999 2024-09-12T18:36:18.424 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.424 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.425 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:18.425 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.656315+0000", 2024-09-12T18:36:18.425 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0012555000000000001 2024-09-12T18:36:18.425 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.425 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.425 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:18.425 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668590+0000", 2024-09-12T18:36:18.425 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012274851999999999 2024-09-12T18:36:18.425 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.425 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.425 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:18.425 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668725+0000", 2024-09-12T18:36:18.426 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013524199999999999 2024-09-12T18:36:18.426 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.426 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.426 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:18.426 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668857+0000", 2024-09-12T18:36:18.426 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013216899999999999 2024-09-12T18:36:18.426 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:18.426 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:18.426 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:18.426 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.426 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.426 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:18.426 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:36:18.427 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 52.717880551999997, 2024-09-12T18:36:18.427 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023616723999999999, 2024-09-12T18:36:18.427 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:18.427 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:18.427 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:18.427 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:18.427 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.427 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:18.427 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:36:18.427 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:18.427 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.427 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.427 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:18.428 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:36:18.428 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:18.428 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.428 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.428 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:18.428 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641992+0000", 2024-09-12T18:36:18.428 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.08e-06 2024-09-12T18:36:18.428 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.428 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.428 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:18.428 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641998+0000", 2024-09-12T18:36:18.428 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4299999999999997e-06 2024-09-12T18:36:18.429 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.429 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.429 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:18.429 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642014+0000", 2024-09-12T18:36:18.429 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6266e-05 2024-09-12T18:36:18.429 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.429 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.429 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:18.429 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642026+0000", 2024-09-12T18:36:18.429 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2567e-05 2024-09-12T18:36:18.429 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.429 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.429 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:18.430 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642213+0000", 2024-09-12T18:36:18.430 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00018701899999999999 2024-09-12T18:36:18.430 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.430 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.430 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:18.430 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642507+0000", 2024-09-12T18:36:18.430 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00029394700000000002 2024-09-12T18:36:18.430 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.430 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.430 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:18.430 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642686+0000", 2024-09-12T18:36:18.430 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000178152 2024-09-12T18:36:18.431 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.431 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.431 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:18.431 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650952+0000", 2024-09-12T18:36:18.431 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0082663570000000002 2024-09-12T18:36:18.431 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.431 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.431 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:18.431 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665382+0000", 2024-09-12T18:36:18.431 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.014430111000000001 2024-09-12T18:36:18.431 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.431 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.432 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:18.432 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665508+0000", 2024-09-12T18:36:18.432 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000125986 2024-09-12T18:36:18.432 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.432 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.432 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:18.432 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665608+0000", 2024-09-12T18:36:18.432 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9809000000000006e-05 2024-09-12T18:36:18.432 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:18.432 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:18.432 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:18.432 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.433 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.433 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:18.433 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:36:18.433 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 52.717752687000001, 2024-09-12T18:36:18.433 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024670563, 2024-09-12T18:36:18.433 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:18.433 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:18.433 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:18.433 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:18.433 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.433 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:18.433 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:36:18.433 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:18.434 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.434 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.434 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:18.434 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:36:18.434 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:18.434 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.434 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.434 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:18.434 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642120+0000", 2024-09-12T18:36:18.434 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1769999999999999e-06 2024-09-12T18:36:18.434 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.434 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.435 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:18.435 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642128+0000", 2024-09-12T18:36:18.435 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3429999999999998e-06 2024-09-12T18:36:18.435 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.435 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.435 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:18.435 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642192+0000", 2024-09-12T18:36:18.435 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4406999999999995e-05 2024-09-12T18:36:18.435 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.435 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.435 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:18.435 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642223+0000", 2024-09-12T18:36:18.435 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.1266000000000002e-05 2024-09-12T18:36:18.436 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.436 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.436 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:18.436 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643201+0000", 2024-09-12T18:36:18.436 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0009778390000000001 2024-09-12T18:36:18.436 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.436 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.436 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:18.436 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643410+0000", 2024-09-12T18:36:18.436 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020874199999999999 2024-09-12T18:36:18.436 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.436 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.436 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:18.437 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643685+0000", 2024-09-12T18:36:18.437 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027520700000000002 2024-09-12T18:36:18.437 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.437 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.437 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:18.437 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650966+0000", 2024-09-12T18:36:18.437 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072810710000000001 2024-09-12T18:36:18.437 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.437 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.437 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:18.437 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666560+0000", 2024-09-12T18:36:18.437 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015594143 2024-09-12T18:36:18.438 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.438 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.438 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:18.438 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666691+0000", 2024-09-12T18:36:18.438 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000130359 2024-09-12T18:36:18.438 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.438 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.438 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:18.438 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666790+0000", 2024-09-12T18:36:18.438 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9009e-05 2024-09-12T18:36:18.438 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:18.438 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:18.439 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:18.439 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.439 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.439 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:18.439 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:36:18.439 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 52.716974399000001, 2024-09-12T18:36:18.439 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024891744, 2024-09-12T18:36:18.439 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:18.439 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:18.439 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:18.439 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:18.439 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.440 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:18.440 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:36:18.440 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:18.440 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.440 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.440 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:18.440 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:36:18.440 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:18.440 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.440 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.440 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:18.441 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642899+0000", 2024-09-12T18:36:18.441 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4729999999999999e-06 2024-09-12T18:36:18.441 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.441 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.441 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:18.441 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642912+0000", 2024-09-12T18:36:18.441 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3495999999999999e-05 2024-09-12T18:36:18.441 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.441 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.441 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:18.441 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642934+0000", 2024-09-12T18:36:18.441 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2033999999999999e-05 2024-09-12T18:36:18.441 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.442 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.442 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:18.442 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642949+0000", 2024-09-12T18:36:18.442 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4970000000000001e-05 2024-09-12T18:36:18.442 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.442 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.442 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:18.444 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644400+0000", 2024-09-12T18:36:18.444 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001450305 2024-09-12T18:36:18.444 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.444 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.444 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:18.444 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644617+0000", 2024-09-12T18:36:18.444 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000217302 2024-09-12T18:36:18.444 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.444 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.444 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:18.445 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645052+0000", 2024-09-12T18:36:18.445 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000434797 2024-09-12T18:36:18.445 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.445 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.445 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:18.445 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653860+0000", 2024-09-12T18:36:18.445 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0088082249999999994 2024-09-12T18:36:18.445 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.445 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.445 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:18.445 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667598+0000", 2024-09-12T18:36:18.445 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.013738451 2024-09-12T18:36:18.445 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.446 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.446 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:18.446 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667698+0000", 2024-09-12T18:36:18.446 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9854999999999999e-05 2024-09-12T18:36:18.446 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.446 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.446 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:18.446 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667789+0000", 2024-09-12T18:36:18.446 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0835999999999996e-05 2024-09-12T18:36:18.446 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:18.446 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:18.446 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:18.446 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.447 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.447 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:30 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:18.447 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:36:18.447 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 52.716899583, 2024-09-12T18:36:18.447 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023936852000000002, 2024-09-12T18:36:18.447 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:18.447 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:18.447 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:18.447 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:18.447 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.447 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:18.447 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:36:18.448 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:18.448 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.448 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.448 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:18.448 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:36:18.448 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:18.448 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.448 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.448 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:18.448 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642973+0000", 2024-09-12T18:36:18.448 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.11e-06 2024-09-12T18:36:18.448 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.449 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.449 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:18.449 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642994+0000", 2024-09-12T18:36:18.449 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.0699999999999998e-05 2024-09-12T18:36:18.449 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.449 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.449 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:18.449 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643011+0000", 2024-09-12T18:36:18.449 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7229999999999999e-05 2024-09-12T18:36:18.450 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.450 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.450 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:18.450 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643025+0000", 2024-09-12T18:36:18.450 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3803e-05 2024-09-12T18:36:18.450 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.450 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.450 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:18.450 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643143+0000", 2024-09-12T18:36:18.450 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000118225 2024-09-12T18:36:18.450 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.450 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.450 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:18.450 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643426+0000", 2024-09-12T18:36:18.451 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00028250500000000001 2024-09-12T18:36:18.451 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.451 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.451 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:18.451 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643864+0000", 2024-09-12T18:36:18.451 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00043856 2024-09-12T18:36:18.451 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.451 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.451 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:18.451 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651148+0000", 2024-09-12T18:36:18.451 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072836769999999997 2024-09-12T18:36:18.451 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.452 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.452 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:18.452 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666674+0000", 2024-09-12T18:36:18.452 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015525786999999999 2024-09-12T18:36:18.452 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.452 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.452 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:18.452 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666796+0000", 2024-09-12T18:36:18.452 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000122416 2024-09-12T18:36:18.452 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.452 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.452 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:18.453 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666909+0000", 2024-09-12T18:36:18.453 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011283899999999999 2024-09-12T18:36:18.453 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:18.453 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:18.453 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:18.453 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.453 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.453 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:18.453 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:36:18.453 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 52.716816876999999, 2024-09-12T18:36:18.453 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024100234000000002, 2024-09-12T18:36:18.453 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:18.453 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:18.453 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:18.454 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:18.454 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.454 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:18.454 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:36:18.454 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:18.454 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.454 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.454 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:18.454 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:36:18.454 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:18.454 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.454 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.454 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:18.455 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643056+0000", 2024-09-12T18:36:18.455 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.046e-06 2024-09-12T18:36:18.455 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.455 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.455 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:18.455 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643068+0000", 2024-09-12T18:36:18.455 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2106999999999999e-05 2024-09-12T18:36:18.455 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.455 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.455 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:18.455 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643085+0000", 2024-09-12T18:36:18.455 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7479999999999999e-05 2024-09-12T18:36:18.455 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.455 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.456 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:18.456 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643099+0000", 2024-09-12T18:36:18.456 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3730000000000001e-05 2024-09-12T18:36:18.456 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.456 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.456 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:18.456 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644623+0000", 2024-09-12T18:36:18.456 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0015236080000000001 2024-09-12T18:36:18.456 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.456 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.456 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:18.456 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644893+0000", 2024-09-12T18:36:18.457 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026990500000000003 2024-09-12T18:36:18.457 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.457 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.457 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:18.457 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645227+0000", 2024-09-12T18:36:18.457 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00033391300000000003 2024-09-12T18:36:18.457 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.457 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.457 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:18.457 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653926+0000", 2024-09-12T18:36:18.457 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0086993339999999995 2024-09-12T18:36:18.457 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.457 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.458 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:18.458 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666925+0000", 2024-09-12T18:36:18.458 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012998686000000001 2024-09-12T18:36:18.458 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.458 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.458 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:18.458 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667057+0000", 2024-09-12T18:36:18.458 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013255600000000001 2024-09-12T18:36:18.458 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.458 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.458 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:18.458 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667155+0000", 2024-09-12T18:36:18.459 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7868999999999994e-05 2024-09-12T18:36:18.459 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:18.459 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:18.459 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:18.459 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.459 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.459 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:18.459 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643139+0000", 2024-09-12T18:36:18.459 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 52.716732291, 2024-09-12T18:36:18.459 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.022417057000000001, 2024-09-12T18:36:18.459 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:18.459 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:18.460 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:18.460 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:18.460 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.460 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:18.460 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643139+0000", 2024-09-12T18:36:18.460 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:18.460 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.460 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.460 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:18.460 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643139+0000", 2024-09-12T18:36:18.460 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:18.461 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.461 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.461 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:18.461 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643140+0000", 2024-09-12T18:36:18.461 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0729999999999999e-06 2024-09-12T18:36:18.461 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.461 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.461 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:18.461 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643151+0000", 2024-09-12T18:36:18.461 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.039e-05 2024-09-12T18:36:18.461 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.461 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.461 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:18.461 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643168+0000", 2024-09-12T18:36:18.462 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7575999999999999e-05 2024-09-12T18:36:18.462 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.462 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.462 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:18.462 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643182+0000", 2024-09-12T18:36:18.462 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3224000000000001e-05 2024-09-12T18:36:18.462 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.462 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.462 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:18.462 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643358+0000", 2024-09-12T18:36:18.462 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00017676500000000001 2024-09-12T18:36:18.462 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.463 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.463 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:18.463 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643647+0000", 2024-09-12T18:36:18.463 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00028850499999999999 2024-09-12T18:36:18.463 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.463 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.463 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:18.463 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643924+0000", 2024-09-12T18:36:18.463 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000277547 2024-09-12T18:36:18.463 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.463 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.463 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:18.463 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650289+0000", 2024-09-12T18:36:18.464 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0063645350000000002 2024-09-12T18:36:18.464 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.464 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.464 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:18.464 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665333+0000", 2024-09-12T18:36:18.464 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015043531000000001 2024-09-12T18:36:18.464 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.464 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.464 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:18.464 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665454+0000", 2024-09-12T18:36:18.464 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000121302 2024-09-12T18:36:18.464 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.465 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.465 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:18.465 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665556+0000", 2024-09-12T18:36:18.465 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010260900000000001 2024-09-12T18:36:18.465 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:18.465 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:18.465 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:18.465 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.465 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.465 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:18.465 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:36:18.465 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 52.716621087999997, 2024-09-12T18:36:18.466 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024255982999999998, 2024-09-12T18:36:18.466 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:18.466 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:18.466 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:18.466 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:18.466 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.466 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:18.466 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:36:18.466 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:18.466 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.466 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.466 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:18.466 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:36:18.466 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:18.467 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.467 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.467 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:18.467 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643252+0000", 2024-09-12T18:36:18.467 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:18.467 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.467 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.467 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:18.467 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643287+0000", 2024-09-12T18:36:18.467 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5225999999999998e-05 2024-09-12T18:36:18.467 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.467 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.467 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:18.467 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643323+0000", 2024-09-12T18:36:18.468 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5488999999999999e-05 2024-09-12T18:36:18.468 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.468 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.468 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:18.468 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643357+0000", 2024-09-12T18:36:18.468 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.3853999999999998e-05 2024-09-12T18:36:18.468 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.468 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.468 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:18.468 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646716+0000", 2024-09-12T18:36:18.468 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003359 2024-09-12T18:36:18.468 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.468 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.469 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:18.469 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647037+0000", 2024-09-12T18:36:18.469 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032131800000000002 2024-09-12T18:36:18.469 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.469 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.469 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:18.469 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647337+0000", 2024-09-12T18:36:18.469 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000300208 2024-09-12T18:36:18.469 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.469 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.469 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:18.469 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654291+0000", 2024-09-12T18:36:18.469 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0069543089999999997 2024-09-12T18:36:18.469 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.470 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.470 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:18.470 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667297+0000", 2024-09-12T18:36:18.470 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.013005526 2024-09-12T18:36:18.470 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.470 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.470 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:18.470 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667416+0000", 2024-09-12T18:36:18.470 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000119416 2024-09-12T18:36:18.470 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.470 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.470 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:18.470 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667507+0000", 2024-09-12T18:36:18.470 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0206999999999999e-05 2024-09-12T18:36:18.471 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:18.471 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:18.471 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:18.471 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.471 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.471 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:18.471 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:36:18.471 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 52.716493993, 2024-09-12T18:36:18.471 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023888482999999999, 2024-09-12T18:36:18.471 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:18.471 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:18.471 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:18.471 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:18.472 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.472 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:18.472 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:36:18.472 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:18.472 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.472 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.472 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:18.472 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:36:18.472 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:18.472 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.472 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.472 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:18.472 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643379+0000", 2024-09-12T18:36:18.473 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.207e-06 2024-09-12T18:36:18.473 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.473 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.473 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:18.473 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643390+0000", 2024-09-12T18:36:18.473 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0696000000000001e-05 2024-09-12T18:36:18.473 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.473 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.473 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:18.473 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643407+0000", 2024-09-12T18:36:18.473 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7563000000000001e-05 2024-09-12T18:36:18.473 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.473 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.474 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:18.474 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643420+0000", 2024-09-12T18:36:18.474 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3277e-05 2024-09-12T18:36:18.474 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.474 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.474 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:18.474 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644906+0000", 2024-09-12T18:36:18.474 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001485945 2024-09-12T18:36:18.474 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.474 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.474 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:18.474 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645404+0000", 2024-09-12T18:36:18.474 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00049807599999999997 2024-09-12T18:36:18.475 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.475 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.475 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:18.475 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645846+0000", 2024-09-12T18:36:18.475 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00044190400000000002 2024-09-12T18:36:18.475 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.475 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.475 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:18.475 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654223+0000", 2024-09-12T18:36:18.475 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0083767419999999995 2024-09-12T18:36:18.475 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.475 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.476 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:18.476 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667026+0000", 2024-09-12T18:36:18.476 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012802531000000001 2024-09-12T18:36:18.476 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.476 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.476 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:18.476 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667162+0000", 2024-09-12T18:36:18.476 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000136112 2024-09-12T18:36:18.476 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.476 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.476 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:18.476 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667266+0000", 2024-09-12T18:36:18.477 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010443 2024-09-12T18:36:18.477 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:18.477 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:18.477 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:18.477 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.477 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.477 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:18.477 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643447+0000", 2024-09-12T18:36:18.477 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 52.716424467000003, 2024-09-12T18:36:18.477 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.022081562999999998, 2024-09-12T18:36:18.477 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:18.477 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:18.478 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:18.478 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:18.478 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.478 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:18.478 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643447+0000", 2024-09-12T18:36:18.478 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:18.478 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.478 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.478 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:18.478 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643447+0000", 2024-09-12T18:36:18.478 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:18.478 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.478 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.479 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:18.479 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643448+0000", 2024-09-12T18:36:18.479 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1629999999999999e-06 2024-09-12T18:36:18.479 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.479 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.479 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:18.479 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643458+0000", 2024-09-12T18:36:18.479 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.8400000000000007e-06 2024-09-12T18:36:18.479 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.479 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.479 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:18.479 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643475+0000", 2024-09-12T18:36:18.479 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6874000000000001e-05 2024-09-12T18:36:18.480 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.480 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.480 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:18.480 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643488+0000", 2024-09-12T18:36:18.480 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3026e-05 2024-09-12T18:36:18.480 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.480 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.480 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:18.480 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643931+0000", 2024-09-12T18:36:18.480 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00044307 2024-09-12T18:36:18.480 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.480 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.480 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:18.480 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644210+0000", 2024-09-12T18:36:18.481 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027908400000000003 2024-09-12T18:36:18.481 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.481 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.481 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:18.481 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644606+0000", 2024-09-12T18:36:18.481 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00039615400000000002 2024-09-12T18:36:18.481 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.481 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.481 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:18.481 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650552+0000", 2024-09-12T18:36:18.481 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0059455619999999997 2024-09-12T18:36:18.481 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.481 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.481 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:18.482 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665302+0000", 2024-09-12T18:36:18.482 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.014749962 2024-09-12T18:36:18.482 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.482 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.482 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:18.482 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665424+0000", 2024-09-12T18:36:18.482 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012214300000000001 2024-09-12T18:36:18.482 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.482 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.482 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:18.482 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665529+0000", 2024-09-12T18:36:18.482 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000104685 2024-09-12T18:36:18.482 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:18.482 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:18.482 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:18.483 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.483 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.483 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:18.483 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:36:18.483 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 52.716343274000003, 2024-09-12T18:36:18.483 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024222582999999999, 2024-09-12T18:36:18.483 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:18.483 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:18.483 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:18.483 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:18.483 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.483 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:18.483 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:36:18.483 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:18.484 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.484 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.484 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:18.484 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:36:18.484 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:18.484 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.484 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.484 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:18.484 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643530+0000", 2024-09-12T18:36:18.484 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.393e-06 2024-09-12T18:36:18.484 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.484 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.484 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:18.484 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643536+0000", 2024-09-12T18:36:18.485 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4130000000000003e-06 2024-09-12T18:36:18.485 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.485 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.485 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:18.485 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643554+0000", 2024-09-12T18:36:18.485 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7572999999999999e-05 2024-09-12T18:36:18.485 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.485 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.485 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:18.485 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643567+0000", 2024-09-12T18:36:18.485 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3393999999999999e-05 2024-09-12T18:36:18.485 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.485 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.485 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:18.486 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648198+0000", 2024-09-12T18:36:18.486 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0046304479999999997 2024-09-12T18:36:18.486 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.486 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.486 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:18.486 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648413+0000", 2024-09-12T18:36:18.486 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00021507500000000001 2024-09-12T18:36:18.486 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:18.486 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:18.486 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:18.486 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667751+0000", 2024-09-12T18:36:18.487 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.019338286999999999 2024-09-12T18:36:18.487 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:18.487 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:18.487 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:18.487 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:18.487 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:18.487 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:36:18.488 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is set 2024-09-12T18:36:18.489 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:36:18.490 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:18.484+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:18.590 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:18.588+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:18.650 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:18.650 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:36:18.650 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.650 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:81125 5.0 e39/21 5:0012f649:::benchmark_data_smithi073_23739_object81124:head v 39'5142, mlcod=39'5140)", 2024-09-12T18:36:18.650 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:18.641494+0000", 2024-09-12T18:36:18.650 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0062998849999999999, 2024-09-12T18:36:18.651 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0063169360000000004, 2024-09-12T18:36:18.651 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:18.651 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:18.651 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:18.651 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:18.651 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.651 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:18.651 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.641494+0000", 2024-09-12T18:36:18.651 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:18.651 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.651 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.651 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:18.651 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.641494+0000", 2024-09-12T18:36:18.652 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:18.652 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.652 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.652 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:18.652 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.641495+0000", 2024-09-12T18:36:18.652 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0699999999999998e-07 2024-09-12T18:36:18.652 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.652 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.652 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:18.652 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.641530+0000", 2024-09-12T18:36:18.652 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.5642000000000002e-05 2024-09-12T18:36:18.652 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.652 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.653 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:18.653 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.641538+0000", 2024-09-12T18:36:18.653 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.7079999999999997e-06 2024-09-12T18:36:18.653 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.653 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.653 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:18.653 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.641544+0000", 2024-09-12T18:36:18.653 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1870000000000002e-06 2024-09-12T18:36:18.653 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.653 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.653 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:18.653 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.644313+0000", 2024-09-12T18:36:18.653 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.002768969 2024-09-12T18:36:18.653 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.654 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.654 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:18.654 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.644332+0000", 2024-09-12T18:36:18.654 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8326e-05 2024-09-12T18:36:18.654 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:18.654 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:18.654 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:18.654 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.654 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.654 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:81128 5.b e39/21 5:d5930096:::benchmark_data_smithi073_23739_object81127:head v 39'5175, mlcod=39'5172)", 2024-09-12T18:36:18.654 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:18.642266+0000", 2024-09-12T18:36:18.654 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0055278819999999996, 2024-09-12T18:36:18.655 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0055821619999999999, 2024-09-12T18:36:18.655 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:18.655 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:18.655 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:18.655 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:18.655 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.655 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:18.655 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.642266+0000", 2024-09-12T18:36:18.655 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:18.655 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.655 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.655 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:18.655 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.642266+0000", 2024-09-12T18:36:18.656 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:18.656 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.656 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.656 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:18.656 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.642267+0000", 2024-09-12T18:36:18.656 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.3799999999999997e-07 2024-09-12T18:36:18.656 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.656 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.656 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:18.656 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.642292+0000", 2024-09-12T18:36:18.656 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.5429999999999999e-05 2024-09-12T18:36:18.656 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.656 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.657 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:18.657 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.642301+0000", 2024-09-12T18:36:18.657 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6740000000000003e-06 2024-09-12T18:36:18.657 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.657 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.657 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:18.657 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.642305+0000", 2024-09-12T18:36:18.657 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.532e-06 2024-09-12T18:36:18.657 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.657 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.657 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:18.657 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.642402+0000", 2024-09-12T18:36:18.657 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.6977000000000003e-05 2024-09-12T18:36:18.658 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.658 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.658 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:18.658 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.642419+0000", 2024-09-12T18:36:18.658 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6639000000000001e-05 2024-09-12T18:36:18.658 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:18.658 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:18.658 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:18.658 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.658 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.658 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:81126 5.2 e39/21 5:41de1808:::benchmark_data_smithi073_23739_object81125:head v 39'5067, mlcod=39'5063)", 2024-09-12T18:36:18.658 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:18.642606+0000", 2024-09-12T18:36:18.658 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0051879439999999999, 2024-09-12T18:36:18.659 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0052703840000000004, 2024-09-12T18:36:18.659 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:18.659 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:18.659 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:18.659 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:18.659 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.659 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:18.659 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.642606+0000", 2024-09-12T18:36:18.659 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:18.659 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.659 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.659 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:18.659 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.642606+0000", 2024-09-12T18:36:18.660 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:18.660 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.660 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.660 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:18.660 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.642607+0000", 2024-09-12T18:36:18.660 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.7800000000000002e-07 2024-09-12T18:36:18.660 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.660 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.660 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:18.660 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.642649+0000", 2024-09-12T18:36:18.660 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2057000000000001e-05 2024-09-12T18:36:18.660 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.660 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.661 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:18.661 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.642657+0000", 2024-09-12T18:36:18.661 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5120000000000008e-06 2024-09-12T18:36:18.661 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.661 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.661 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:18.661 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.642664+0000", 2024-09-12T18:36:18.661 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5869999999999998e-06 2024-09-12T18:36:18.661 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.661 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.661 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:18.661 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.642754+0000", 2024-09-12T18:36:18.661 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.9856000000000002e-05 2024-09-12T18:36:18.661 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.662 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.662 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:18.662 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.642770+0000", 2024-09-12T18:36:18.662 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6410999999999999e-05 2024-09-12T18:36:18.662 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:18.662 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:18.662 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:18.662 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.662 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.662 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:81132 5.5 5:a50734a1:::benchmark_data_smithi073_23739_object81131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T18:36:18.662 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:18.643062+0000", 2024-09-12T18:36:18.662 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0047318580000000002, 2024-09-12T18:36:18.662 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0048532100000000002, 2024-09-12T18:36:18.663 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:18.663 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:18.663 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:18.663 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:18.663 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:18.663 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:18.663 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 81132 2024-09-12T18:36:18.663 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.663 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:18.663 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.663 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:18.663 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.643062+0000", 2024-09-12T18:36:18.663 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:18.663 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.664 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.664 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:18.664 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.643062+0000", 2024-09-12T18:36:18.664 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:18.664 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.664 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.664 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:18.664 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.643063+0000", 2024-09-12T18:36:18.664 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1939999999999999e-06 2024-09-12T18:36:18.664 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.664 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.664 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:18.664 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.643124+0000", 2024-09-12T18:36:18.664 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.0343000000000001e-05 2024-09-12T18:36:18.665 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.665 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.665 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:18.665 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.643135+0000", 2024-09-12T18:36:18.665 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1321000000000001e-05 2024-09-12T18:36:18.665 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.665 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.665 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:18.665 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.643142+0000", 2024-09-12T18:36:18.665 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5230000000000001e-06 2024-09-12T18:36:18.665 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.665 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.665 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:18.666 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.643186+0000", 2024-09-12T18:36:18.666 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4251e-05 2024-09-12T18:36:18.666 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.666 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.666 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:18.666 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.643280+0000", 2024-09-12T18:36:18.666 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.3832999999999994e-05 2024-09-12T18:36:18.666 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.666 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.666 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:18.666 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.643361+0000", 2024-09-12T18:36:18.666 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0859999999999995e-05 2024-09-12T18:36:18.666 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:18.667 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:18.667 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:18.667 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.667 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.667 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:81129 5.7 e39/21 5:e0f70905:::benchmark_data_smithi073_23739_object81128:head v 39'5054, mlcod=39'5052)", 2024-09-12T18:36:18.667 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:18.644087+0000", 2024-09-12T18:36:18.667 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.003706867, 2024-09-12T18:36:18.667 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.003867204, 2024-09-12T18:36:18.667 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:18.667 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:18.667 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:18.667 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:18.667 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.668 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:18.668 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.644087+0000", 2024-09-12T18:36:18.668 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:18.668 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.668 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.668 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:18.668 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.644087+0000", 2024-09-12T18:36:18.668 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:18.668 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.668 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.668 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:18.668 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.644088+0000", 2024-09-12T18:36:18.668 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.7399999999999999e-07 2024-09-12T18:36:18.669 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.669 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.669 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:18.669 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.644126+0000", 2024-09-12T18:36:18.669 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8189000000000003e-05 2024-09-12T18:36:18.669 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.669 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.669 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:18.669 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.644134+0000", 2024-09-12T18:36:18.669 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2009999999999999e-06 2024-09-12T18:36:18.669 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.669 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.669 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:18.670 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.644140+0000", 2024-09-12T18:36:18.670 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4759999999999997e-06 2024-09-12T18:36:18.670 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.670 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.670 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:18.670 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.644188+0000", 2024-09-12T18:36:18.670 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8448000000000001e-05 2024-09-12T18:36:18.670 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.670 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.670 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:18.670 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.644205+0000", 2024-09-12T18:36:18.670 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6937000000000001e-05 2024-09-12T18:36:18.670 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:18.671 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:18.671 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:18.671 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.671 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.671 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:81133 5.1 e39/21 5:82a18fab:::benchmark_data_smithi073_23739_object81132:head v 39'5054, mlcod=39'5052)", 2024-09-12T18:36:18.671 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:18.644154+0000", 2024-09-12T18:36:18.671 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0036402130000000002, 2024-09-12T18:36:18.671 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00382906, 2024-09-12T18:36:18.671 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:18.671 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:18.671 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:18.671 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:18.671 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.672 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:18.672 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.644154+0000", 2024-09-12T18:36:18.672 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:18.672 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.672 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.672 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:18.672 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.644154+0000", 2024-09-12T18:36:18.672 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:18.672 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.672 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.672 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:18.672 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.644154+0000", 2024-09-12T18:36:18.672 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.6899999999999998e-07 2024-09-12T18:36:18.673 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.673 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.673 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:18.673 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.644180+0000", 2024-09-12T18:36:18.673 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.5429999999999999e-05 2024-09-12T18:36:18.673 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.673 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.673 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:18.673 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.644186+0000", 2024-09-12T18:36:18.673 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2339999999999999e-06 2024-09-12T18:36:18.673 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.673 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.673 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:18.673 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.644191+0000", 2024-09-12T18:36:18.674 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8760000000000004e-06 2024-09-12T18:36:18.674 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.674 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.674 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:18.674 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.645844+0000", 2024-09-12T18:36:18.674 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001652875 2024-09-12T18:36:18.674 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.674 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.674 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:18.674 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.645857+0000", 2024-09-12T18:36:18.674 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2981e-05 2024-09-12T18:36:18.674 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:18.674 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:18.675 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:18.675 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.675 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.675 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:81131 5.2 e39/21 5:48650e95:::benchmark_data_smithi073_23739_object81130:head v 39'5068, mlcod=39'5063)", 2024-09-12T18:36:18.675 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:18.644598+0000", 2024-09-12T18:36:18.675 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0031966529999999998, 2024-09-12T18:36:18.675 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0034144990000000001, 2024-09-12T18:36:18.675 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:18.675 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:18.675 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:18.675 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:18.675 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.675 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:18.676 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.644598+0000", 2024-09-12T18:36:18.676 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:18.676 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.676 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.676 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:18.676 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.644598+0000", 2024-09-12T18:36:18.676 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:18.676 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.676 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.676 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:18.676 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.644598+0000", 2024-09-12T18:36:18.676 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6100000000000001e-07 2024-09-12T18:36:18.676 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.676 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.677 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:18.677 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.644692+0000", 2024-09-12T18:36:18.677 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.3848e-05 2024-09-12T18:36:18.677 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.677 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.677 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:18.677 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.644703+0000", 2024-09-12T18:36:18.677 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0593e-05 2024-09-12T18:36:18.677 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.677 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.677 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:18.677 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.644709+0000", 2024-09-12T18:36:18.677 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1140000000000002e-06 2024-09-12T18:36:18.678 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.678 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.678 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:18.678 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.644749+0000", 2024-09-12T18:36:18.678 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0638e-05 2024-09-12T18:36:18.678 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.678 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.678 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:18.678 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.644765+0000", 2024-09-12T18:36:18.679 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5600999999999999e-05 2024-09-12T18:36:18.679 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:18.679 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:18.679 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:18.679 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.679 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.679 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:81136 5.5 5:acf53683:::benchmark_data_smithi073_23739_object81135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T18:36:18.679 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:18.644629+0000", 2024-09-12T18:36:18.679 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0031647870000000001, 2024-09-12T18:36:18.679 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0034121690000000001, 2024-09-12T18:36:18.679 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:18.679 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:18.679 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:18.680 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:18.680 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:18.680 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:18.680 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 81136 2024-09-12T18:36:18.680 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.680 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:18.680 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.680 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:18.680 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.644629+0000", 2024-09-12T18:36:18.680 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:18.680 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.680 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.680 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:18.681 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.644629+0000", 2024-09-12T18:36:18.681 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:18.681 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.681 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.681 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:18.681 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.644630+0000", 2024-09-12T18:36:18.681 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.7399999999999991e-07 2024-09-12T18:36:18.681 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.681 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.681 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:18.681 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.644725+0000", 2024-09-12T18:36:18.681 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4783000000000004e-05 2024-09-12T18:36:18.681 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.682 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.682 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:18.682 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.644734+0000", 2024-09-12T18:36:18.682 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6319999999999997e-06 2024-09-12T18:36:18.682 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.682 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.682 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:18.682 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.644741+0000", 2024-09-12T18:36:18.682 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:36:18.682 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.682 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.682 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:18.682 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.645082+0000", 2024-09-12T18:36:18.683 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00034128799999999998 2024-09-12T18:36:18.683 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.683 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.683 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:18.683 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.645213+0000", 2024-09-12T18:36:18.683 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013058000000000001 2024-09-12T18:36:18.683 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.683 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.683 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:18.683 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.645358+0000", 2024-09-12T18:36:18.683 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000145427 2024-09-12T18:36:18.683 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:18.683 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:18.683 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:18.684 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.684 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.684 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:81130 5.7 e39/21 5:e496bdc4:::benchmark_data_smithi073_23739_object81129:head v 39'5055, mlcod=39'5052)", 2024-09-12T18:36:18.684 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:18.645911+0000", 2024-09-12T18:36:18.684 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.001883621, 2024-09-12T18:36:18.684 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0021655849999999998, 2024-09-12T18:36:18.684 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:18.684 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:18.684 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:18.684 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:18.684 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.684 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:18.685 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.645911+0000", 2024-09-12T18:36:18.685 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:18.685 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.685 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.685 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:18.685 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.645911+0000", 2024-09-12T18:36:18.685 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:18.685 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.685 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.685 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:18.685 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.645911+0000", 2024-09-12T18:36:18.685 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9800000000000004e-07 2024-09-12T18:36:18.685 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.685 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.686 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:18.686 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.645997+0000", 2024-09-12T18:36:18.686 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5548000000000002e-05 2024-09-12T18:36:18.686 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.686 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.686 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:18.686 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.646015+0000", 2024-09-12T18:36:18.686 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8374999999999999e-05 2024-09-12T18:36:18.686 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.686 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.686 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:18.686 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.646021+0000", 2024-09-12T18:36:18.686 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8599999999999998e-06 2024-09-12T18:36:18.687 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.687 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.687 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:18.687 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.646064+0000", 2024-09-12T18:36:18.687 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2765000000000001e-05 2024-09-12T18:36:18.687 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.687 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.687 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:18.687 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.646079+0000", 2024-09-12T18:36:18.687 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5875e-05 2024-09-12T18:36:18.687 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:18.687 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:18.688 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:18.688 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.688 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.688 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:81134 5.2 e39/21 5:40bd1b34:::benchmark_data_smithi073_23739_object81133:head v 39'5069, mlcod=39'5063)", 2024-09-12T18:36:18.688 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:18.646464+0000", 2024-09-12T18:36:18.688 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0013301210000000001, 2024-09-12T18:36:18.688 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001638095, 2024-09-12T18:36:18.688 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:18.688 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:18.688 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:18.688 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:18.688 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.688 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:18.689 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.646464+0000", 2024-09-12T18:36:18.689 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:18.689 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.689 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.689 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:18.689 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.646464+0000", 2024-09-12T18:36:18.689 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:18.689 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.689 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.689 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:18.689 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.646464+0000", 2024-09-12T18:36:18.689 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5900000000000002e-07 2024-09-12T18:36:18.689 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.690 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.690 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:18.690 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.646540+0000", 2024-09-12T18:36:18.690 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5638999999999999e-05 2024-09-12T18:36:18.690 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.690 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.690 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:18.690 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.646554+0000", 2024-09-12T18:36:18.690 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4147e-05 2024-09-12T18:36:18.690 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.690 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.690 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:18.690 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.646561+0000", 2024-09-12T18:36:18.690 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7669999999999998e-06 2024-09-12T18:36:18.691 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.691 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.691 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:18.691 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.646616+0000", 2024-09-12T18:36:18.691 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5271e-05 2024-09-12T18:36:18.691 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.691 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.691 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:18.691 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.646634+0000", 2024-09-12T18:36:18.691 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8159999999999999e-05 2024-09-12T18:36:18.691 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:18.691 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:18.691 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:18.692 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.692 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.692 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:81138 5.0 e39/21 5:051e8ee3:::benchmark_data_smithi073_23739_object81137:head v 39'5143, mlcod=39'5140)", 2024-09-12T18:36:18.692 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:18.647779+0000", 2024-09-12T18:36:18.692 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 1.4776e-05, 2024-09-12T18:36:18.692 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00034845999999999998, 2024-09-12T18:36:18.692 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:18.692 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:18.692 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:18.692 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:18.692 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.692 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:18.692 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.647779+0000", 2024-09-12T18:36:18.693 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:18.693 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.693 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.693 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:18.693 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.647779+0000", 2024-09-12T18:36:18.693 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:18.693 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.693 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.693 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:18.693 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.647780+0000", 2024-09-12T18:36:18.693 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9400000000000005e-07 2024-09-12T18:36:18.693 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.693 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.694 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:18.694 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.647845+0000", 2024-09-12T18:36:18.694 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4850000000000004e-05 2024-09-12T18:36:18.694 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.694 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.694 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:18.694 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.647862+0000", 2024-09-12T18:36:18.694 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7142e-05 2024-09-12T18:36:18.694 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.694 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.694 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:18.694 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.647868+0000", 2024-09-12T18:36:18.694 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1639999999999998e-06 2024-09-12T18:36:18.694 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.695 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.695 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:18.695 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.647918+0000", 2024-09-12T18:36:18.695 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9746000000000001e-05 2024-09-12T18:36:18.695 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.695 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.695 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:18.695 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.647942+0000", 2024-09-12T18:36:18.695 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4187999999999999e-05 2024-09-12T18:36:18.695 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:18.695 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:18.695 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:18.695 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.696 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.696 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:81139 5.4 e39/21 5:25234940:::benchmark_data_smithi073_23739_object81138:head v 39'5014, mlcod=39'5012)", 2024-09-12T18:36:18.696 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:18.647885+0000", 2024-09-12T18:36:18.696 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4294967295.9999089, 2024-09-12T18:36:18.696 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00026928199999999997, 2024-09-12T18:36:18.696 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:18.696 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:18.696 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:18.696 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:18.696 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.696 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:18.696 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.647885+0000", 2024-09-12T18:36:18.696 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:18.697 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.697 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.697 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:18.697 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.647885+0000", 2024-09-12T18:36:18.697 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:18.697 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.697 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.697 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:18.697 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.647886+0000", 2024-09-12T18:36:18.697 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0999999999999999e-07 2024-09-12T18:36:18.697 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.697 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.697 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:18.697 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.647935+0000", 2024-09-12T18:36:18.698 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8628999999999998e-05 2024-09-12T18:36:18.698 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.698 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.698 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:18.698 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.647942+0000", 2024-09-12T18:36:18.698 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.7889999999999995e-06 2024-09-12T18:36:18.698 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.698 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.698 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:18.698 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.647948+0000", 2024-09-12T18:36:18.698 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2979999999999999e-06 2024-09-12T18:36:18.698 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.698 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.699 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:18.699 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.648019+0000", 2024-09-12T18:36:18.699 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1212999999999997e-05 2024-09-12T18:36:18.699 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:18.699 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:18.699 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:18.699 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.648036+0000", 2024-09-12T18:36:18.699 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7235e-05 2024-09-12T18:36:18.699 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:18.699 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:18.699 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:18.699 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:18.699 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-12T18:36:18.699 INFO:teuthology.orchestra.run.smithi114.stdout: "num_ops": 12 2024-09-12T18:36:18.700 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:18.701 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:36:18.702 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:18.700+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:18.801 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:18.796+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:18.817 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:36:18.854 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:18.854 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2024-09-12T18:36:18.854 INFO:teuthology.orchestra.run.smithi114.stdout: "complaint_time": 30, 2024-09-12T18:36:18.854 INFO:teuthology.orchestra.run.smithi114.stdout: "num_blocked_ops": 0 2024-09-12T18:36:18.854 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:18.872 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:36:18.873 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 33 16 81588 81572 154.476 127.938 0.0077591 0.00646874 2024-09-12T18:36:18.903 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:18.897+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:18.978 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:36:18.978 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:36:18.996 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:36:18.996 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:36:19.003 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:19.000+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:19.015 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:36:19.015 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:36:19.069 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:19.070 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:19.089 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:36:19.136 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:19.135+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:19.206 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:19.201+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:19.238 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:19.238 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:19.261 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:36:19.348 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:19.347+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:19.407 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:19.403+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:19.457 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:19.458 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:19.478 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:36:19.520 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:19.519+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:19.608 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:19.607+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:19.680 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:19.680 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:19.703 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:36:19.709 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:19.704+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:19.811 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:19.804+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:19.858 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:19.858 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:19.872 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 34 16 83656 83640 153.734 129.25 0.00618032 0.00649973 2024-09-12T18:36:19.878 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:36:19.911 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:19.907+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:20.012 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:20.011+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:20.033 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:20.033 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:20.053 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:36:20.113 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:20.108+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:20.214 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:20.208+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:20.215 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:20.215 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:20.235 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:36:20.316 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:20.311+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:20.392 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:20.392 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:20.412 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:36:20.416 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:20.408+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:20.502 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T18:36:20.517 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:20.515+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:20.563 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:20.563 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:20.583 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:36:20.631 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:20.628+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:20.720 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:20.715+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:20.736 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:20.736 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:20.753 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:36:20.820 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:20.816+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:20.872 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 35 16 85725 85709 153.035 129.312 0.00467732 0.00652943 2024-09-12T18:36:20.914 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:20.914 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:20.920 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:20.916+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:20.933 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:36:21.021 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:21.016+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:21.032 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:36:21.084 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:21.084 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:21.104 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:36:21.148 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:21.147+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:21.196 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:36:21.196 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:36:21.214 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:36:21.214 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:36:21.222 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:21.216+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:21.235 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:36:21.236 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:36:21.261 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:21.261 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-09-12T18:36:21.261 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-09-12T18:36:21.261 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:36:21.261 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.261 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:21.261 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:21.261 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 55.626228038999997, 2024-09-12T18:36:21.261 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025088781000000001, 2024-09-12T18:36:21.261 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:21.261 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:21.262 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:21.262 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:21.262 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.262 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:21.262 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:21.262 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:21.262 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.262 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.262 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:21.262 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:21.262 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:21.262 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.262 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.262 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:21.263 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632518+0000", 2024-09-12T18:36:21.263 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:36:21.263 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.263 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.263 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:21.263 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632533+0000", 2024-09-12T18:36:21.263 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5130000000000001e-05 2024-09-12T18:36:21.263 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.263 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.263 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:21.263 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632564+0000", 2024-09-12T18:36:21.263 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0788999999999999e-05 2024-09-12T18:36:21.263 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.263 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.264 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:21.264 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632590+0000", 2024-09-12T18:36:21.264 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6057000000000001e-05 2024-09-12T18:36:21.264 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.264 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.264 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:21.264 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.635931+0000", 2024-09-12T18:36:21.264 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033411320000000001 2024-09-12T18:36:21.264 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.264 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.264 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:21.264 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636186+0000", 2024-09-12T18:36:21.264 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025452500000000002 2024-09-12T18:36:21.265 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.265 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.265 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:21.265 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636445+0000", 2024-09-12T18:36:21.265 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000259268 2024-09-12T18:36:21.265 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.265 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.265 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:21.265 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639562+0000", 2024-09-12T18:36:21.265 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031167 2024-09-12T18:36:21.265 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.265 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.266 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:21.266 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657314+0000", 2024-09-12T18:36:21.266 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017752562 2024-09-12T18:36:21.266 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.266 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.266 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:21.266 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657445+0000", 2024-09-12T18:36:21.266 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013105899999999999 2024-09-12T18:36:21.266 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.266 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.266 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:21.266 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657598+0000", 2024-09-12T18:36:21.266 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015247899999999999 2024-09-12T18:36:21.266 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:21.267 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:21.267 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:21.267 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.267 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.267 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:21.267 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:21.267 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 55.626101835999997, 2024-09-12T18:36:21.267 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025643131999999999, 2024-09-12T18:36:21.267 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:21.267 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:21.267 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:21.267 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:21.267 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.268 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:21.268 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:21.268 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:21.268 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.268 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.268 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:21.268 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:21.268 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:21.268 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.268 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.268 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:21.268 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632637+0000", 2024-09-12T18:36:21.268 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5600000000000001e-06 2024-09-12T18:36:21.269 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.269 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.269 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:21.269 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632650+0000", 2024-09-12T18:36:21.269 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3186e-05 2024-09-12T18:36:21.269 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.269 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.269 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:21.269 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632672+0000", 2024-09-12T18:36:21.269 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2013000000000001e-05 2024-09-12T18:36:21.269 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.269 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.270 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:21.270 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632687+0000", 2024-09-12T18:36:21.270 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5109999999999999e-05 2024-09-12T18:36:21.270 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.270 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.270 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:21.270 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636994+0000", 2024-09-12T18:36:21.270 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0043065539999999998 2024-09-12T18:36:21.270 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.270 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.270 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:21.270 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637198+0000", 2024-09-12T18:36:21.270 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020387199999999999 2024-09-12T18:36:21.271 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.271 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.271 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:21.271 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637475+0000", 2024-09-12T18:36:21.271 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027731000000000001 2024-09-12T18:36:21.271 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.271 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.271 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:21.271 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639574+0000", 2024-09-12T18:36:21.271 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020988999999999999 2024-09-12T18:36:21.271 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.271 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.271 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:21.272 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658057+0000", 2024-09-12T18:36:21.272 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018482926 2024-09-12T18:36:21.272 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.272 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.272 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:21.272 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658184+0000", 2024-09-12T18:36:21.272 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012756200000000001 2024-09-12T18:36:21.272 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.272 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.272 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:21.272 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658278+0000", 2024-09-12T18:36:21.272 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4139000000000001e-05 2024-09-12T18:36:21.272 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:21.273 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:21.273 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:21.273 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.273 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.273 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:21.273 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:21.273 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 55.626026744000001, 2024-09-12T18:36:21.273 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025238883, 2024-09-12T18:36:21.273 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:21.273 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:21.273 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:21.273 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:21.274 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.274 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:21.274 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:21.274 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:21.274 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.274 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.274 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:21.274 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:21.274 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:21.274 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.274 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.274 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:21.275 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632712+0000", 2024-09-12T18:36:21.275 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6869999999999999e-06 2024-09-12T18:36:21.275 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.275 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.275 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:21.275 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632719+0000", 2024-09-12T18:36:21.275 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6059999999999999e-06 2024-09-12T18:36:21.275 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.275 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.275 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:21.275 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632737+0000", 2024-09-12T18:36:21.275 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7983999999999999e-05 2024-09-12T18:36:21.276 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.276 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.276 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:21.276 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632751+0000", 2024-09-12T18:36:21.276 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4473e-05 2024-09-12T18:36:21.276 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.276 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.276 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:21.276 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636961+0000", 2024-09-12T18:36:21.276 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042100840000000002 2024-09-12T18:36:21.276 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.277 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.277 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:21.277 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637211+0000", 2024-09-12T18:36:21.277 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000249738 2024-09-12T18:36:21.277 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.277 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.277 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:21.277 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637504+0000", 2024-09-12T18:36:21.277 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00029271499999999998 2024-09-12T18:36:21.277 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.277 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.277 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:21.277 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639582+0000", 2024-09-12T18:36:21.278 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020783389999999998 2024-09-12T18:36:21.278 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.278 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.278 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:21.278 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657709+0000", 2024-09-12T18:36:21.278 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018126758999999999 2024-09-12T18:36:21.278 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.278 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.278 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:21.278 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657830+0000", 2024-09-12T18:36:21.278 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000121329 2024-09-12T18:36:21.278 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.278 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.279 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:21.279 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657949+0000", 2024-09-12T18:36:21.279 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000119169 2024-09-12T18:36:21.279 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:21.279 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:21.279 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:21.279 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.279 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.279 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:21.279 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:21.279 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 55.625962698000002, 2024-09-12T18:36:21.279 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026711823999999999, 2024-09-12T18:36:21.279 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:21.280 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:21.280 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:21.280 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:21.280 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.280 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:21.280 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:21.280 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:21.280 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.280 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.280 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:21.280 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:21.280 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:21.281 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.281 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.281 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:21.281 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632775+0000", 2024-09-12T18:36:21.281 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9999999999999995e-07 2024-09-12T18:36:21.281 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.281 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.281 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:21.281 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632788+0000", 2024-09-12T18:36:21.281 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2629999999999999e-05 2024-09-12T18:36:21.281 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.281 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.281 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:21.281 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632806+0000", 2024-09-12T18:36:21.282 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:36:21.282 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.282 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.282 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:21.282 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632820+0000", 2024-09-12T18:36:21.282 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3777e-05 2024-09-12T18:36:21.282 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.282 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.282 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:21.282 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638310+0000", 2024-09-12T18:36:21.282 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054898280000000004 2024-09-12T18:36:21.282 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.283 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.283 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:21.283 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638480+0000", 2024-09-12T18:36:21.283 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016968199999999999 2024-09-12T18:36:21.283 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.283 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.283 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:21.283 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638799+0000", 2024-09-12T18:36:21.283 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031915999999999997 2024-09-12T18:36:21.283 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.283 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.283 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:21.283 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639866+0000", 2024-09-12T18:36:21.284 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001067405 2024-09-12T18:36:21.284 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.284 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.284 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:21.284 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658398+0000", 2024-09-12T18:36:21.284 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018531542000000002 2024-09-12T18:36:21.284 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.284 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.284 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:21.284 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658643+0000", 2024-09-12T18:36:21.284 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00024531500000000002 2024-09-12T18:36:21.284 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.284 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.285 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:21.285 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.659486+0000", 2024-09-12T18:36:21.285 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00084316899999999995 2024-09-12T18:36:21.285 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:21.285 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:21.285 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:21.285 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.285 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.285 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:21.285 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:36:21.285 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 55.625735636000002, 2024-09-12T18:36:21.285 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.021357139000000001, 2024-09-12T18:36:21.285 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:21.286 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:21.286 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:21.286 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:21.286 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.286 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:21.286 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:36:21.286 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:21.286 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.286 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.286 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:21.286 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:36:21.286 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:21.286 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.287 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.287 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:21.287 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633003+0000", 2024-09-12T18:36:21.287 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.53e-06 2024-09-12T18:36:21.287 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.287 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.287 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:21.287 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633012+0000", 2024-09-12T18:36:21.287 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9290000000000004e-06 2024-09-12T18:36:21.287 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.287 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.287 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:21.287 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633034+0000", 2024-09-12T18:36:21.287 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2127e-05 2024-09-12T18:36:21.288 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.288 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.288 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:21.288 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633054+0000", 2024-09-12T18:36:21.288 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9476000000000001e-05 2024-09-12T18:36:21.288 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.288 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.288 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:21.288 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636657+0000", 2024-09-12T18:36:21.288 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036038839999999999 2024-09-12T18:36:21.288 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.288 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.288 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:21.289 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636885+0000", 2024-09-12T18:36:21.289 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022798800000000001 2024-09-12T18:36:21.289 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.289 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.289 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:21.289 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637189+0000", 2024-09-12T18:36:21.289 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030392100000000002 2024-09-12T18:36:21.289 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.289 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.289 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:21.289 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639271+0000", 2024-09-12T18:36:21.289 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020817460000000002 2024-09-12T18:36:21.289 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.289 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.290 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:21.290 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.652371+0000", 2024-09-12T18:36:21.290 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013099417 2024-09-12T18:36:21.290 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.290 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.290 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:21.290 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654255+0000", 2024-09-12T18:36:21.290 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018846049999999999 2024-09-12T18:36:21.290 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.290 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.290 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:21.290 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654359+0000", 2024-09-12T18:36:21.290 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000103516 2024-09-12T18:36:21.290 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:21.291 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:21.291 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:21.291 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.291 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.291 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:21.291 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:21.291 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 55.625653944, 2024-09-12T18:36:21.291 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026938645000000001, 2024-09-12T18:36:21.291 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:21.291 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:21.291 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:21.291 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:21.291 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.292 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:21.292 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:21.292 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:21.292 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.292 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.292 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:21.292 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:21.292 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:21.292 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.292 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.292 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:21.292 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633085+0000", 2024-09-12T18:36:21.292 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:21.292 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.293 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.293 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:21.293 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633093+0000", 2024-09-12T18:36:21.293 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3999999999999992e-06 2024-09-12T18:36:21.293 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.293 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.293 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:21.293 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633111+0000", 2024-09-12T18:36:21.293 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8070000000000001e-05 2024-09-12T18:36:21.293 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.293 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.293 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:21.293 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633126+0000", 2024-09-12T18:36:21.294 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4487e-05 2024-09-12T18:36:21.294 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.294 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.294 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:21.294 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638290+0000", 2024-09-12T18:36:21.294 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0051640269999999999 2024-09-12T18:36:21.294 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.294 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.294 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:21.294 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638547+0000", 2024-09-12T18:36:21.294 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025714100000000001 2024-09-12T18:36:21.294 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.294 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.295 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:21.295 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638850+0000", 2024-09-12T18:36:21.295 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030278400000000001 2024-09-12T18:36:21.295 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.295 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.295 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:21.295 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.640706+0000", 2024-09-12T18:36:21.295 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018564580000000001 2024-09-12T18:36:21.295 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.295 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.295 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:21.295 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658420+0000", 2024-09-12T18:36:21.295 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017714395000000001 2024-09-12T18:36:21.295 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.296 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.296 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:21.296 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658635+0000", 2024-09-12T18:36:21.296 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021413500000000001 2024-09-12T18:36:21.296 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.296 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.296 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:21.296 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.660022+0000", 2024-09-12T18:36:21.296 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001387318 2024-09-12T18:36:21.296 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:21.296 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:21.296 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:21.296 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.297 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.297 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:21.297 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:36:21.297 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 55.625309432999998, 2024-09-12T18:36:21.297 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.020709867, 2024-09-12T18:36:21.297 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:21.297 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:21.297 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:21.297 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:21.297 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.297 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:21.297 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:36:21.297 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:21.298 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.298 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.298 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:21.298 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:36:21.298 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:21.298 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.298 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.298 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:21.298 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633429+0000", 2024-09-12T18:36:21.298 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.313e-06 2024-09-12T18:36:21.298 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.298 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.298 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:21.298 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633462+0000", 2024-09-12T18:36:21.299 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3197000000000001e-05 2024-09-12T18:36:21.299 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.299 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.299 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:21.299 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633485+0000", 2024-09-12T18:36:21.299 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3243000000000001e-05 2024-09-12T18:36:21.299 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.299 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.299 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:21.299 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633501+0000", 2024-09-12T18:36:21.299 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5383000000000002e-05 2024-09-12T18:36:21.299 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.299 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.299 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:21.300 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633642+0000", 2024-09-12T18:36:21.300 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000141168 2024-09-12T18:36:21.300 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.300 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.300 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:21.300 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633982+0000", 2024-09-12T18:36:21.300 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000340067 2024-09-12T18:36:21.300 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.300 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.300 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:21.300 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654138+0000", 2024-09-12T18:36:21.300 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.020155495999999998 2024-09-12T18:36:21.300 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:21.301 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:21.301 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:21.301 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.301 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.301 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:40639 5.8 5:16bd0f48:::benchmark_data_smithi073_23739_object40638:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:36:21.301 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:00.010888+0000", 2024-09-12T18:36:21.301 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 21.247849023000001, 2024-09-12T18:36:21.301 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017069808999999998, 2024-09-12T18:36:21.301 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:21.301 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:21.301 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:21.301 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:21.301 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:21.301 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:21.302 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 40639 2024-09-12T18:36:21.302 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.302 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:21.302 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.302 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:21.302 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010888+0000", 2024-09-12T18:36:21.302 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:21.302 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.302 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.302 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:21.302 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010888+0000", 2024-09-12T18:36:21.302 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:21.302 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.302 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.303 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:21.303 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010889+0000", 2024-09-12T18:36:21.303 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.004e-06 2024-09-12T18:36:21.303 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.303 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.303 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:21.303 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010921+0000", 2024-09-12T18:36:21.303 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1745000000000002e-05 2024-09-12T18:36:21.303 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.303 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.303 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:21.303 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010933+0000", 2024-09-12T18:36:21.303 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2476999999999999e-05 2024-09-12T18:36:21.304 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.304 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.304 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:21.304 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.010941+0000", 2024-09-12T18:36:21.304 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1810000000000004e-06 2024-09-12T18:36:21.304 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.304 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.304 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:21.304 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.019947+0000", 2024-09-12T18:36:21.304 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0090069190000000004 2024-09-12T18:36:21.304 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.304 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.304 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:21.304 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.020062+0000", 2024-09-12T18:36:21.305 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000114851 2024-09-12T18:36:21.305 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.305 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.305 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:21.305 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.020148+0000", 2024-09-12T18:36:21.305 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5579000000000002e-05 2024-09-12T18:36:21.305 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.305 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.305 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:21.305 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.026347+0000", 2024-09-12T18:36:21.305 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0061988820000000002 2024-09-12T18:36:21.305 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.305 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.306 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:21.306 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.027866+0000", 2024-09-12T18:36:21.306 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015197190000000001 2024-09-12T18:36:21.306 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.306 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.306 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:21.306 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.027914+0000", 2024-09-12T18:36:21.306 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8009000000000001e-05 2024-09-12T18:36:21.306 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.306 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.306 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:21.306 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:00.027958+0000", 2024-09-12T18:36:21.306 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3442999999999997e-05 2024-09-12T18:36:21.308 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:21.308 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:21.308 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:21.308 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.309 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.309 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:49141 5.d 5:bce526e5:::benchmark_data_smithi073_23739_object49140:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T18:36:21.309 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:03.538808+0000", 2024-09-12T18:36:21.309 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 17.719929387000001, 2024-09-12T18:36:21.309 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.019659019, 2024-09-12T18:36:21.309 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:21.309 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:21.309 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:21.309 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:21.309 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:21.309 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:21.309 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 49141 2024-09-12T18:36:21.309 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.310 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:21.310 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.310 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:21.310 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538808+0000", 2024-09-12T18:36:21.310 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:21.310 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.310 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.310 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:21.310 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538808+0000", 2024-09-12T18:36:21.310 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:21.310 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.310 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.310 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:21.310 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538809+0000", 2024-09-12T18:36:21.311 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.065e-06 2024-09-12T18:36:21.311 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.311 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.311 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:21.311 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538914+0000", 2024-09-12T18:36:21.311 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010528599999999999 2024-09-12T18:36:21.311 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.311 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.311 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:21.311 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538924+0000", 2024-09-12T18:36:21.311 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4420000000000004e-06 2024-09-12T18:36:21.311 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.311 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.312 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:21.312 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538944+0000", 2024-09-12T18:36:21.312 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0460000000000001e-05 2024-09-12T18:36:21.312 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.312 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.312 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:21.312 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.539034+0000", 2024-09-12T18:36:21.312 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9512000000000006e-05 2024-09-12T18:36:21.312 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.312 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.312 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:21.312 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.539161+0000", 2024-09-12T18:36:21.312 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012782399999999999 2024-09-12T18:36:21.312 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.313 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.313 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:21.313 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.539246+0000", 2024-09-12T18:36:21.313 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4927999999999997e-05 2024-09-12T18:36:21.313 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.313 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.313 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:21.313 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.541390+0000", 2024-09-12T18:36:21.313 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0021439509999999998 2024-09-12T18:36:21.313 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.313 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.313 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:21.313 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.558236+0000", 2024-09-12T18:36:21.314 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016845619999999999 2024-09-12T18:36:21.314 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.314 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.314 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:21.314 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.558368+0000", 2024-09-12T18:36:21.314 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013241300000000001 2024-09-12T18:36:21.314 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.314 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.314 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:21.314 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.558467+0000", 2024-09-12T18:36:21.314 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8517999999999994e-05 2024-09-12T18:36:21.314 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:21.314 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:21.314 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:21.315 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.315 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.315 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:52993 5.0 5:00f9e688:::benchmark_data_smithi073_23739_object52992:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:36:21.315 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:05.209109+0000", 2024-09-12T18:36:21.315 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 16.049628314, 2024-09-12T18:36:21.315 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017556391000000001, 2024-09-12T18:36:21.315 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:21.315 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:21.315 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:21.315 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:21.315 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:21.315 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:21.315 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 52993 2024-09-12T18:36:21.316 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.316 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:21.316 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.316 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:21.316 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.209109+0000", 2024-09-12T18:36:21.316 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:21.316 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.316 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.316 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:21.316 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.209109+0000", 2024-09-12T18:36:21.316 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:21.316 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.316 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.317 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:21.317 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.209110+0000", 2024-09-12T18:36:21.317 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8000000000000004e-07 2024-09-12T18:36:21.317 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.317 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.317 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:21.317 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.209246+0000", 2024-09-12T18:36:21.317 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013595 2024-09-12T18:36:21.317 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.317 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.317 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:21.317 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.209256+0000", 2024-09-12T18:36:21.317 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9580000000000002e-06 2024-09-12T18:36:21.317 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.318 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.318 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:21.318 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.209262+0000", 2024-09-12T18:36:21.318 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7950000000000002e-06 2024-09-12T18:36:21.318 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.318 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.318 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:21.318 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.212362+0000", 2024-09-12T18:36:21.318 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003099606 2024-09-12T18:36:21.318 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.318 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.318 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:21.318 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.212569+0000", 2024-09-12T18:36:21.319 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020737699999999999 2024-09-12T18:36:21.319 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.319 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.319 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:21.319 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.212907+0000", 2024-09-12T18:36:21.319 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00033730499999999998 2024-09-12T18:36:21.319 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.319 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.319 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:21.319 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.226511+0000", 2024-09-12T18:36:21.319 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.01360451 2024-09-12T18:36:21.319 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.319 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.319 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:21.320 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.226567+0000", 2024-09-12T18:36:21.320 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5371000000000002e-05 2024-09-12T18:36:21.320 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.320 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.320 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:21.320 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.226624+0000", 2024-09-12T18:36:21.320 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7355999999999998e-05 2024-09-12T18:36:21.320 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.320 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.320 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:21.320 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.226665+0000", 2024-09-12T18:36:21.320 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1282999999999998e-05 2024-09-12T18:36:21.321 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:21.321 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:21.321 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:21.321 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.321 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.321 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:61561 5.e 5:715fe5e4:::benchmark_data_smithi073_23739_object61560:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:36:21.321 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:09.221864+0000", 2024-09-12T18:36:21.321 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 12.036872971999999, 2024-09-12T18:36:21.321 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017993663999999999, 2024-09-12T18:36:21.321 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:21.321 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:21.322 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:21.322 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:21.322 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:21.322 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:21.322 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 61561 2024-09-12T18:36:21.322 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.322 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:21.322 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.322 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:21.322 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.221864+0000", 2024-09-12T18:36:21.322 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:21.322 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.322 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.323 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:21.323 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.221864+0000", 2024-09-12T18:36:21.323 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:21.323 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.323 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.323 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:21.323 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.221865+0000", 2024-09-12T18:36:21.323 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1310000000000001e-06 2024-09-12T18:36:21.323 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.323 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.323 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:21.324 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222022+0000", 2024-09-12T18:36:21.324 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015628500000000001 2024-09-12T18:36:21.324 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.324 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.324 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:21.324 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222034+0000", 2024-09-12T18:36:21.324 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2481e-05 2024-09-12T18:36:21.324 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.324 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.324 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:21.324 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222041+0000", 2024-09-12T18:36:21.324 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7469999999999999e-06 2024-09-12T18:36:21.325 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.325 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.325 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:21.325 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222103+0000", 2024-09-12T18:36:21.325 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1903999999999995e-05 2024-09-12T18:36:21.325 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.325 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.325 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:21.325 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222199+0000", 2024-09-12T18:36:21.325 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6664999999999997e-05 2024-09-12T18:36:21.325 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.326 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.326 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:21.326 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222286+0000", 2024-09-12T18:36:21.326 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6582999999999994e-05 2024-09-12T18:36:21.326 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.326 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.326 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:21.326 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.228622+0000", 2024-09-12T18:36:21.326 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063357520000000001 2024-09-12T18:36:21.326 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.326 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.326 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:21.326 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.239753+0000", 2024-09-12T18:36:21.327 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011131709 2024-09-12T18:36:21.327 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.327 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.327 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:21.327 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.239813+0000", 2024-09-12T18:36:21.327 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0007999999999999e-05 2024-09-12T18:36:21.327 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.327 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.327 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:21.327 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.239858+0000", 2024-09-12T18:36:21.327 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4399e-05 2024-09-12T18:36:21.327 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:21.327 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:21.328 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:21.328 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.328 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.328 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:77241 5.b 5:d9973dc8:::benchmark_data_smithi073_23739_object77240:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:21.328 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:16.792553+0000", 2024-09-12T18:36:21.328 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.4661837630000001, 2024-09-12T18:36:21.328 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.019966754999999999, 2024-09-12T18:36:21.328 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:21.328 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:21.328 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:21.328 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:21.328 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:21.328 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:21.329 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 77241 2024-09-12T18:36:21.329 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.329 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:21.329 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.329 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:21.329 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.792553+0000", 2024-09-12T18:36:21.329 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:21.329 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.329 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.329 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:21.329 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.792553+0000", 2024-09-12T18:36:21.329 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:21.329 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.330 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.330 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:21.330 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.792554+0000", 2024-09-12T18:36:21.330 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.16e-07 2024-09-12T18:36:21.330 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.330 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.330 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:21.330 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.792661+0000", 2024-09-12T18:36:21.330 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000106909 2024-09-12T18:36:21.330 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.330 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.330 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:21.330 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.792671+0000", 2024-09-12T18:36:21.331 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0268000000000001e-05 2024-09-12T18:36:21.331 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.331 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.331 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:21.331 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.792678+0000", 2024-09-12T18:36:21.331 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7510000000000002e-06 2024-09-12T18:36:21.331 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.331 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.331 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:21.331 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.794730+0000", 2024-09-12T18:36:21.331 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002051794 2024-09-12T18:36:21.331 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.331 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.331 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:21.332 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.794857+0000", 2024-09-12T18:36:21.332 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012728500000000001 2024-09-12T18:36:21.332 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.332 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.332 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:21.332 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.794987+0000", 2024-09-12T18:36:21.332 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012996899999999999 2024-09-12T18:36:21.332 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.332 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.332 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:21.332 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.797553+0000", 2024-09-12T18:36:21.332 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025652980000000001 2024-09-12T18:36:21.332 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.333 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.333 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:21.333 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.812460+0000", 2024-09-12T18:36:21.333 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.014907884 2024-09-12T18:36:21.333 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.333 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.333 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:21.333 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.812494+0000", 2024-09-12T18:36:21.333 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3525000000000002e-05 2024-09-12T18:36:21.333 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.333 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.333 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:21.333 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.812520+0000", 2024-09-12T18:36:21.334 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6156000000000002e-05 2024-09-12T18:36:21.334 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:21.334 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:21.334 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:21.334 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.334 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.334 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:77253 5.b 5:df1f7025:::benchmark_data_smithi073_23739_object77252:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:21.334 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:16.798099+0000", 2024-09-12T18:36:21.334 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.4606380730000001, 2024-09-12T18:36:21.334 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0182598, 2024-09-12T18:36:21.334 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:21.334 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:21.334 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:21.334 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:21.335 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:21.335 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:21.335 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 77253 2024-09-12T18:36:21.335 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.335 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:21.335 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.335 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:21.335 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798099+0000", 2024-09-12T18:36:21.335 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:21.335 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.335 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.335 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:21.336 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798099+0000", 2024-09-12T18:36:21.336 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:21.336 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.336 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.336 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:21.336 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798100+0000", 2024-09-12T18:36:21.336 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2449999999999999e-06 2024-09-12T18:36:21.336 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.336 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.336 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:21.336 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798159+0000", 2024-09-12T18:36:21.336 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8925999999999998e-05 2024-09-12T18:36:21.336 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.336 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.337 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:21.337 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798171+0000", 2024-09-12T18:36:21.337 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.206e-05 2024-09-12T18:36:21.337 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.337 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.337 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:21.337 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798178+0000", 2024-09-12T18:36:21.337 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9009999999999997e-06 2024-09-12T18:36:21.337 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.337 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.337 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:21.337 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798227+0000", 2024-09-12T18:36:21.337 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8794000000000001e-05 2024-09-12T18:36:21.338 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.338 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.338 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:21.338 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798314+0000", 2024-09-12T18:36:21.338 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7322000000000002e-05 2024-09-12T18:36:21.338 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.338 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.338 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:21.338 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798417+0000", 2024-09-12T18:36:21.338 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000102777 2024-09-12T18:36:21.338 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.338 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.338 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:21.339 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.800633+0000", 2024-09-12T18:36:21.339 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022157740000000002 2024-09-12T18:36:21.339 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.339 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.339 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:21.339 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.816295+0000", 2024-09-12T18:36:21.339 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015662359000000001 2024-09-12T18:36:21.339 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.339 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.339 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:21.339 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.816330+0000", 2024-09-12T18:36:21.339 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4353999999999997e-05 2024-09-12T18:36:21.339 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.340 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.340 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:21.340 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.816359+0000", 2024-09-12T18:36:21.340 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9288000000000001e-05 2024-09-12T18:36:21.340 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:21.340 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:21.340 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:21.340 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.340 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.340 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:80117 5.e 5:713efd60:::benchmark_data_smithi073_23739_object80116:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:21.340 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:18.149805+0000", 2024-09-12T18:36:21.340 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 3.1089325049999998, 2024-09-12T18:36:21.340 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018173544, 2024-09-12T18:36:21.341 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:21.341 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:21.341 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:21.341 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:21.341 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:21.341 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:21.341 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 80117 2024-09-12T18:36:21.341 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.341 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:21.341 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.341 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:21.341 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.149805+0000", 2024-09-12T18:36:21.341 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:21.342 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.342 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.342 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:21.342 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.149805+0000", 2024-09-12T18:36:21.342 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:21.342 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.342 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.342 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:21.342 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.149805+0000", 2024-09-12T18:36:21.342 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2399999999999997e-07 2024-09-12T18:36:21.342 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.342 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.343 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:21.343 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.149842+0000", 2024-09-12T18:36:21.343 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6396000000000002e-05 2024-09-12T18:36:21.343 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.343 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.343 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:21.343 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.149855+0000", 2024-09-12T18:36:21.343 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3247999999999999e-05 2024-09-12T18:36:21.343 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.343 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.343 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:21.343 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.149863+0000", 2024-09-12T18:36:21.344 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9189999999999999e-06 2024-09-12T18:36:21.344 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.344 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.344 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:21.344 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.155735+0000", 2024-09-12T18:36:21.344 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0058721600000000004 2024-09-12T18:36:21.344 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.344 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.344 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:21.344 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.155868+0000", 2024-09-12T18:36:21.344 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013283500000000001 2024-09-12T18:36:21.344 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.344 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.345 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:21.345 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.156033+0000", 2024-09-12T18:36:21.345 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016527999999999999 2024-09-12T18:36:21.345 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.345 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.345 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:21.345 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.160797+0000", 2024-09-12T18:36:21.345 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0047638439999999997 2024-09-12T18:36:21.345 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.345 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.345 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:21.345 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.167881+0000", 2024-09-12T18:36:21.345 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0070834670000000004 2024-09-12T18:36:21.346 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.346 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.346 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:21.346 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.167936+0000", 2024-09-12T18:36:21.346 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5473999999999998e-05 2024-09-12T18:36:21.346 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.346 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.346 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:21.346 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.167978+0000", 2024-09-12T18:36:21.346 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2097e-05 2024-09-12T18:36:21.346 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:21.346 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:21.346 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:21.347 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.347 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.347 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:81207 5.0 5:0c89eb16:::benchmark_data_smithi073_23739_object81206:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T18:36:21.347 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:18.680764+0000", 2024-09-12T18:36:21.347 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 2.5779732119999998, 2024-09-12T18:36:21.347 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017614778000000001, 2024-09-12T18:36:21.347 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:21.347 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:21.347 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:21.347 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:21.347 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:21.347 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:21.347 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 81207 2024-09-12T18:36:21.348 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.348 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:21.348 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.348 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:21.348 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.680764+0000", 2024-09-12T18:36:21.348 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:21.348 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.348 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.348 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:21.348 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.680764+0000", 2024-09-12T18:36:21.348 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:21.348 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.348 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.349 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:21.349 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.680765+0000", 2024-09-12T18:36:21.349 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0699999999999999e-06 2024-09-12T18:36:21.349 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.349 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.349 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:21.349 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.680883+0000", 2024-09-12T18:36:21.349 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000117753 2024-09-12T18:36:21.349 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.349 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.349 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:21.349 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.680898+0000", 2024-09-12T18:36:21.349 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5546e-05 2024-09-12T18:36:21.349 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.350 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.350 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:21.350 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.680905+0000", 2024-09-12T18:36:21.350 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0779999999999998e-06 2024-09-12T18:36:21.350 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.350 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.350 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:21.350 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.685631+0000", 2024-09-12T18:36:21.350 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0047256720000000002 2024-09-12T18:36:21.350 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.350 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.350 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:21.350 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.685800+0000", 2024-09-12T18:36:21.351 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016894800000000001 2024-09-12T18:36:21.351 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.351 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.351 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:21.351 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.686022+0000", 2024-09-12T18:36:21.351 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022225399999999999 2024-09-12T18:36:21.351 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.351 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.351 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:21.351 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.693548+0000", 2024-09-12T18:36:21.351 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0075253789999999996 2024-09-12T18:36:21.351 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.351 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.352 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:21.352 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.698317+0000", 2024-09-12T18:36:21.352 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0047689250000000002 2024-09-12T18:36:21.352 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.352 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.352 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:21.352 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.698345+0000", 2024-09-12T18:36:21.352 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8445999999999998e-05 2024-09-12T18:36:21.352 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.352 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.352 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:21.352 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.698379+0000", 2024-09-12T18:36:21.352 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3707000000000001e-05 2024-09-12T18:36:21.353 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:21.353 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:21.353 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:21.353 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.353 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.353 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:81208 5.8 5:179b411e:::benchmark_data_smithi073_23739_object81207:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T18:36:21.353 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:18.681140+0000", 2024-09-12T18:36:21.353 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 2.5775966480000001, 2024-09-12T18:36:21.353 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017405688999999998, 2024-09-12T18:36:21.353 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:21.353 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:21.353 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:21.354 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:21.354 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:21.354 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:21.354 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 81208 2024-09-12T18:36:21.354 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.354 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:21.354 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.354 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:21.354 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.681140+0000", 2024-09-12T18:36:21.354 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:21.354 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.354 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.354 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:21.355 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.681140+0000", 2024-09-12T18:36:21.355 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:21.355 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.355 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.355 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:21.355 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.681141+0000", 2024-09-12T18:36:21.355 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3500000000000005e-07 2024-09-12T18:36:21.355 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.355 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.355 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:21.355 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.681238+0000", 2024-09-12T18:36:21.355 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6549e-05 2024-09-12T18:36:21.356 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.356 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.356 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:21.356 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.681255+0000", 2024-09-12T18:36:21.356 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7161999999999999e-05 2024-09-12T18:36:21.356 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.356 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.356 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:21.356 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.681260+0000", 2024-09-12T18:36:21.356 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8910000000000003e-06 2024-09-12T18:36:21.356 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.357 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.357 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:21.357 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.688888+0000", 2024-09-12T18:36:21.357 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076285600000000004 2024-09-12T18:36:21.357 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.357 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.357 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:21.357 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.689159+0000", 2024-09-12T18:36:21.357 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027055100000000001 2024-09-12T18:36:21.357 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.357 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.357 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:21.357 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.689322+0000", 2024-09-12T18:36:21.358 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016309500000000001 2024-09-12T18:36:21.358 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.358 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.358 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:21.358 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.696528+0000", 2024-09-12T18:36:21.358 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0072059209999999997 2024-09-12T18:36:21.358 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.358 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.358 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:21.358 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.698500+0000", 2024-09-12T18:36:21.358 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019720549999999999 2024-09-12T18:36:21.358 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.358 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.359 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:21.359 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.698526+0000", 2024-09-12T18:36:21.359 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5962999999999999e-05 2024-09-12T18:36:21.359 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.359 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.359 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:21.359 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.698546+0000", 2024-09-12T18:36:21.359 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0106999999999999e-05 2024-09-12T18:36:21.359 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:21.359 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:21.359 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:21.359 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.359 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.360 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:81220 5.0 5:09982a6e:::benchmark_data_smithi073_23739_object81219:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T18:36:21.360 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:18.687299+0000", 2024-09-12T18:36:21.360 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 2.571438385, 2024-09-12T18:36:21.360 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017570822999999999, 2024-09-12T18:36:21.360 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:21.360 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:21.360 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:21.360 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:21.360 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:21.360 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:21.360 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 81220 2024-09-12T18:36:21.360 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.360 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:21.360 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.361 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:21.361 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.687299+0000", 2024-09-12T18:36:21.361 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:21.361 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.361 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.361 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:21.361 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.687299+0000", 2024-09-12T18:36:21.361 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:21.361 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.361 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.361 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:21.361 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.687299+0000", 2024-09-12T18:36:21.361 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4900000000000001e-07 2024-09-12T18:36:21.361 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.362 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.362 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:21.362 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.687326+0000", 2024-09-12T18:36:21.362 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6784999999999999e-05 2024-09-12T18:36:21.362 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.362 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.362 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:21.362 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.687332+0000", 2024-09-12T18:36:21.362 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1399999999999997e-06 2024-09-12T18:36:21.362 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.362 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.362 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:21.362 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.687336+0000", 2024-09-12T18:36:21.363 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0509999999999998e-06 2024-09-12T18:36:21.363 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.363 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.363 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:21.363 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.693722+0000", 2024-09-12T18:36:21.363 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063860289999999997 2024-09-12T18:36:21.363 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.363 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.363 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:21.363 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.693846+0000", 2024-09-12T18:36:21.363 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012385900000000001 2024-09-12T18:36:21.363 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.363 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.363 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:21.364 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.693957+0000", 2024-09-12T18:36:21.364 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000111425 2024-09-12T18:36:21.364 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.364 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.364 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:21.364 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.698492+0000", 2024-09-12T18:36:21.364 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0045343639999999999 2024-09-12T18:36:21.364 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.364 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.364 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:21.364 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.704787+0000", 2024-09-12T18:36:21.364 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062951980000000001 2024-09-12T18:36:21.365 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.365 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.365 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:21.365 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.704833+0000", 2024-09-12T18:36:21.365 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6174000000000002e-05 2024-09-12T18:36:21.365 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.365 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.365 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:21.365 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.704870+0000", 2024-09-12T18:36:21.365 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6449000000000003e-05 2024-09-12T18:36:21.365 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:21.365 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:21.365 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:21.366 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.366 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.366 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:81235 5.8 5:10f468f7:::benchmark_data_smithi073_23739_object81234:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T18:36:21.366 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:18.694250+0000", 2024-09-12T18:36:21.366 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 2.5644873229999998, 2024-09-12T18:36:21.366 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016878942000000001, 2024-09-12T18:36:21.366 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:21.366 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:21.366 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:21.366 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:21.366 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:21.366 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:21.366 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 81235 2024-09-12T18:36:21.366 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.367 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:21.367 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.367 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:21.367 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.694250+0000", 2024-09-12T18:36:21.367 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:21.367 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.367 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.367 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:21.367 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.694250+0000", 2024-09-12T18:36:21.367 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:21.367 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.367 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.367 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:21.368 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.694250+0000", 2024-09-12T18:36:21.368 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9900000000000001e-07 2024-09-12T18:36:21.368 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.368 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.368 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:21.368 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.694290+0000", 2024-09-12T18:36:21.368 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9821999999999999e-05 2024-09-12T18:36:21.368 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.368 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.368 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:21.368 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.694298+0000", 2024-09-12T18:36:21.368 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3350000000000007e-06 2024-09-12T18:36:21.368 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.369 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.369 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:21.369 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.694302+0000", 2024-09-12T18:36:21.369 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7910000000000002e-06 2024-09-12T18:36:21.369 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.369 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.369 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:21.369 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.702665+0000", 2024-09-12T18:36:21.369 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0083627609999999998 2024-09-12T18:36:21.369 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.369 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.369 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:21.369 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.702836+0000", 2024-09-12T18:36:21.370 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00017134299999999999 2024-09-12T18:36:21.370 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.370 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.370 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:21.370 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.703002+0000", 2024-09-12T18:36:21.370 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016552099999999999 2024-09-12T18:36:21.370 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.370 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.370 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:21.370 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.708975+0000", 2024-09-12T18:36:21.370 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0059729409999999998 2024-09-12T18:36:21.370 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.370 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.371 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:21.371 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.711046+0000", 2024-09-12T18:36:21.371 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002071126 2024-09-12T18:36:21.371 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.371 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.371 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:21.371 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.711095+0000", 2024-09-12T18:36:21.371 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8789000000000003e-05 2024-09-12T18:36:21.371 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.371 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.371 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:21.371 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.711129+0000", 2024-09-12T18:36:21.371 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4014000000000003e-05 2024-09-12T18:36:21.371 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:21.372 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:21.372 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:21.372 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.372 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.372 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:81237 5.8 5:135141da:::benchmark_data_smithi073_23739_object81236:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T18:36:21.372 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:18.696120+0000", 2024-09-12T18:36:21.372 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 2.562617505, 2024-09-12T18:36:21.372 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017490036, 2024-09-12T18:36:21.372 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:21.372 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:21.372 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:21.372 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:21.372 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:21.373 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:21.373 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 81237 2024-09-12T18:36:21.373 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.373 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:21.373 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.373 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:21.373 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.696120+0000", 2024-09-12T18:36:21.373 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:21.373 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.373 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.373 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:21.373 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.696120+0000", 2024-09-12T18:36:21.373 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:21.373 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.374 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.374 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:21.374 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.696120+0000", 2024-09-12T18:36:21.374 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1500000000000005e-07 2024-09-12T18:36:21.374 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.374 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.374 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:21.374 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.696214+0000", 2024-09-12T18:36:21.374 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.3523000000000006e-05 2024-09-12T18:36:21.374 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.374 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.374 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:21.374 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.696220+0000", 2024-09-12T18:36:21.375 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7089999999999996e-06 2024-09-12T18:36:21.375 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.375 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.375 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:21.375 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.696225+0000", 2024-09-12T18:36:21.375 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.69e-06 2024-09-12T18:36:21.375 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.375 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.375 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:21.375 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.704806+0000", 2024-09-12T18:36:21.375 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0085810469999999996 2024-09-12T18:36:21.375 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.375 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.375 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:21.376 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.704929+0000", 2024-09-12T18:36:21.376 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012257199999999999 2024-09-12T18:36:21.376 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.376 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.376 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:21.376 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.705016+0000", 2024-09-12T18:36:21.376 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7379999999999993e-05 2024-09-12T18:36:21.376 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.376 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.376 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:21.376 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.708982+0000", 2024-09-12T18:36:21.376 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0039663019999999997 2024-09-12T18:36:21.376 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.377 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.377 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:21.377 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.713547+0000", 2024-09-12T18:36:21.377 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0045647129999999998 2024-09-12T18:36:21.377 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.377 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.377 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:21.377 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.713587+0000", 2024-09-12T18:36:21.377 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9994999999999999e-05 2024-09-12T18:36:21.377 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.377 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.377 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:21.377 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.713610+0000", 2024-09-12T18:36:21.377 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2589999999999999e-05 2024-09-12T18:36:21.378 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:21.378 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:21.378 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:21.378 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.378 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.378 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:81723 5.4 5:29932484:::benchmark_data_smithi073_23739_object81722:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T18:36:21.378 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:18.936797+0000", 2024-09-12T18:36:21.378 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 2.3219400800000001, 2024-09-12T18:36:21.378 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016801745, 2024-09-12T18:36:21.378 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:21.378 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:21.378 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:21.378 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:21.379 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:21.379 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:21.379 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 81723 2024-09-12T18:36:21.379 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.379 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:21.379 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.379 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:21.379 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.936797+0000", 2024-09-12T18:36:21.379 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:21.379 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.379 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.379 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:21.379 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.936797+0000", 2024-09-12T18:36:21.380 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:21.380 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.380 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.380 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:21.380 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.936798+0000", 2024-09-12T18:36:21.380 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4899999999999995e-07 2024-09-12T18:36:21.380 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.380 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.380 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:21.380 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.936855+0000", 2024-09-12T18:36:21.380 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7287999999999998e-05 2024-09-12T18:36:21.380 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.381 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.381 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:21.381 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.936864+0000", 2024-09-12T18:36:21.381 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.1509999999999993e-06 2024-09-12T18:36:21.381 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.381 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.381 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:21.381 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.936868+0000", 2024-09-12T18:36:21.381 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2880000000000003e-06 2024-09-12T18:36:21.381 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.381 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.381 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:21.381 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.938964+0000", 2024-09-12T18:36:21.381 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002095179 2024-09-12T18:36:21.382 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.382 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.382 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:21.382 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.939053+0000", 2024-09-12T18:36:21.382 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9864999999999994e-05 2024-09-12T18:36:21.382 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.382 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.382 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:21.382 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.939150+0000", 2024-09-12T18:36:21.382 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6879999999999994e-05 2024-09-12T18:36:21.382 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.382 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.382 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:21.382 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.942074+0000", 2024-09-12T18:36:21.383 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0029238889999999998 2024-09-12T18:36:21.383 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.383 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.383 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:21.383 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.953513+0000", 2024-09-12T18:36:21.383 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011439260999999999 2024-09-12T18:36:21.383 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.383 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.383 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:21.383 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.953569+0000", 2024-09-12T18:36:21.383 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5500000000000001e-05 2024-09-12T18:36:21.383 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:21.383 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:21.384 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:21.384 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.953599+0000", 2024-09-12T18:36:21.384 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9895000000000001e-05 2024-09-12T18:36:21.384 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:21.384 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:21.384 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:21.384 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:21.384 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:21.384 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:21.386 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:36:21.386 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:21.384+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:21.485 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is set 2024-09-12T18:36:21.487 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:21.483+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:21.549 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:36:21.549 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:36:21.549 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.549 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:87140 5.7 5:ec5e2bd0:::benchmark_data_smithi073_23739_object87139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:36:21.549 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:21.546116+0000", 2024-09-12T18:36:21.549 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.001254528, 2024-09-12T18:36:21.549 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0012806919999999999, 2024-09-12T18:36:21.549 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:21.549 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:21.550 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:21.550 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:21.550 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:21.550 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:21.550 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 87140 2024-09-12T18:36:21.550 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.550 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:21.550 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.550 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:21.550 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.546116+0000", 2024-09-12T18:36:21.550 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:21.550 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.551 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.551 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:21.551 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.546116+0000", 2024-09-12T18:36:21.551 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:21.551 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.551 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.551 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:21.551 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.546118+0000", 2024-09-12T18:36:21.551 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2529999999999999e-06 2024-09-12T18:36:21.551 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.551 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.551 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:21.551 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.546180+0000", 2024-09-12T18:36:21.551 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2620999999999996e-05 2024-09-12T18:36:21.552 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.552 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.552 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:21.552 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.546191+0000", 2024-09-12T18:36:21.552 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0774000000000001e-05 2024-09-12T18:36:21.552 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.552 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.552 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:21.552 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.546196+0000", 2024-09-12T18:36:21.552 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.378e-06 2024-09-12T18:36:21.553 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.553 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.553 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:21.553 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.546250+0000", 2024-09-12T18:36:21.553 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3656999999999998e-05 2024-09-12T18:36:21.553 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.553 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.553 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:21.553 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.546384+0000", 2024-09-12T18:36:21.553 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013379700000000001 2024-09-12T18:36:21.553 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.553 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.554 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:21.554 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.546502+0000", 2024-09-12T18:36:21.554 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000118311 2024-09-12T18:36:21.554 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:21.554 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:21.554 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:21.554 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.554 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.554 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:87141 5.1 5:8b2b8f82:::benchmark_data_smithi073_23739_object87140:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:36:21.554 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:21.546213+0000", 2024-09-12T18:36:21.554 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.001158458, 2024-09-12T18:36:21.554 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0012554129999999999, 2024-09-12T18:36:21.554 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:21.555 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:21.555 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:21.555 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:21.555 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:21.555 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:21.555 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 87141 2024-09-12T18:36:21.555 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.555 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:21.555 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.555 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:21.555 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.546213+0000", 2024-09-12T18:36:21.555 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:21.555 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.555 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.556 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:21.556 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.546213+0000", 2024-09-12T18:36:21.556 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:21.556 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.556 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.556 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:21.556 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.546213+0000", 2024-09-12T18:36:21.556 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5499999999999998e-07 2024-09-12T18:36:21.556 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.556 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.556 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:21.556 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.546258+0000", 2024-09-12T18:36:21.556 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.5138e-05 2024-09-12T18:36:21.557 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.557 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.557 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:21.557 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.546266+0000", 2024-09-12T18:36:21.557 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.4340000000000003e-06 2024-09-12T18:36:21.557 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.557 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.557 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:21.557 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.546273+0000", 2024-09-12T18:36:21.557 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.1319999999999996e-06 2024-09-12T18:36:21.557 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.557 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.557 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:21.558 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.546316+0000", 2024-09-12T18:36:21.558 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.3436999999999998e-05 2024-09-12T18:36:21.558 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.558 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.558 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:21.558 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.546415+0000", 2024-09-12T18:36:21.558 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.8437999999999995e-05 2024-09-12T18:36:21.558 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.558 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.558 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:21.558 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.546561+0000", 2024-09-12T18:36:21.558 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014674800000000001 2024-09-12T18:36:21.558 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:21.559 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:21.559 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:21.559 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.559 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.559 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:87142 5.7 5.b4ce1857 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:36:21.559 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:21.546289+0000", 2024-09-12T18:36:21.559 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.001081898, 2024-09-12T18:36:21.559 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001240311, 2024-09-12T18:36:21.559 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:21.559 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:21.559 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:21.559 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:21.559 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:21.559 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:21.560 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 87142 2024-09-12T18:36:21.560 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.560 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:21.560 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.560 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:21.560 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.546289+0000", 2024-09-12T18:36:21.560 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:21.560 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.560 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.560 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:21.560 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.546289+0000", 2024-09-12T18:36:21.560 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:21.560 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.561 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.561 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:21.561 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.546290+0000", 2024-09-12T18:36:21.561 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2399999999999998e-07 2024-09-12T18:36:21.561 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.561 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.561 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:21.561 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.546374+0000", 2024-09-12T18:36:21.561 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4285999999999999e-05 2024-09-12T18:36:21.561 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.561 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.561 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:21.561 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.546382+0000", 2024-09-12T18:36:21.561 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4370000000000007e-06 2024-09-12T18:36:21.562 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.562 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.562 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:21.562 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.546389+0000", 2024-09-12T18:36:21.562 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.5699999999999998e-06 2024-09-12T18:36:21.562 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:21.562 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:21.562 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:21.562 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.562 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.562 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:87139 5.3 e40/21 5:caefc62f:::benchmark_data_smithi073_23739_object87138:head v 40'5377, mlcod=40'5375)", 2024-09-12T18:36:21.562 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:21.546496+0000", 2024-09-12T18:36:21.562 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.00087531999999999996, 2024-09-12T18:36:21.563 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0010791469999999999, 2024-09-12T18:36:21.563 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:21.563 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:21.563 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:21.563 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:21.563 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.563 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:21.563 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.546496+0000", 2024-09-12T18:36:21.563 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:21.563 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.563 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.563 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:21.563 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.546496+0000", 2024-09-12T18:36:21.563 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:21.564 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.564 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.564 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:21.564 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.546496+0000", 2024-09-12T18:36:21.564 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9999999999999997e-07 2024-09-12T18:36:21.564 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.564 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.564 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:21.564 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.546634+0000", 2024-09-12T18:36:21.564 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000138095 2024-09-12T18:36:21.564 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.564 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.564 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:21.565 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.546643+0000", 2024-09-12T18:36:21.565 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5259999999999993e-06 2024-09-12T18:36:21.565 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.565 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.565 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:21.565 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.546649+0000", 2024-09-12T18:36:21.565 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.964e-06 2024-09-12T18:36:21.565 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.565 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.565 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:21.565 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.546698+0000", 2024-09-12T18:36:21.565 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.9063000000000001e-05 2024-09-12T18:36:21.565 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.565 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.566 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:21.566 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.546716+0000", 2024-09-12T18:36:21.566 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.8315e-05 2024-09-12T18:36:21.566 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:21.566 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:21.566 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:21.566 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.566 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.566 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop_reply(client.4480.0:87137 5.7 e40/21)", 2024-09-12T18:36:21.566 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:21.546665+0000", 2024-09-12T18:36:21.566 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.00070595499999999997, 2024-09-12T18:36:21.566 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00095600299999999997, 2024-09-12T18:36:21.566 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:21.566 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:21.567 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:21.567 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:21.567 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.567 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:21.567 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.546665+0000", 2024-09-12T18:36:21.567 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:21.567 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.567 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.567 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:21.567 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.546665+0000", 2024-09-12T18:36:21.567 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:21.567 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.567 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.568 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:21.568 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.546665+0000", 2024-09-12T18:36:21.568 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.0900000000000002e-07 2024-09-12T18:36:21.568 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.568 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.568 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:21.568 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.546668+0000", 2024-09-12T18:36:21.568 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.464e-06 2024-09-12T18:36:21.568 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.568 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.568 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:21.568 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.546673+0000", 2024-09-12T18:36:21.568 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5759999999999996e-06 2024-09-12T18:36:21.568 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.569 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.569 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:21.569 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.546678+0000", 2024-09-12T18:36:21.569 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.2599999999999999e-06 2024-09-12T18:36:21.569 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:21.569 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:21.569 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:21.569 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.569 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.569 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:87144 5.9 5:94259f23:::benchmark_data_smithi073_23739_object87143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:36:21.569 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:21.547047+0000", 2024-09-12T18:36:21.569 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.00032366099999999999, 2024-09-12T18:36:21.569 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00061675200000000003, 2024-09-12T18:36:21.570 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:21.570 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:21.570 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:21.570 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:21.570 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:21.570 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:21.570 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 87144 2024-09-12T18:36:21.570 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.570 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:21.570 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.570 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:21.570 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.547047+0000", 2024-09-12T18:36:21.570 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:21.570 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.571 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.571 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:21.571 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.547047+0000", 2024-09-12T18:36:21.571 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:21.571 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.571 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.571 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:21.571 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.547048+0000", 2024-09-12T18:36:21.571 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4099999999999997e-07 2024-09-12T18:36:21.571 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.571 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.571 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:21.571 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.547132+0000", 2024-09-12T18:36:21.571 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.3516000000000005e-05 2024-09-12T18:36:21.572 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.572 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.572 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:21.572 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.547142+0000", 2024-09-12T18:36:21.572 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0788000000000001e-05 2024-09-12T18:36:21.572 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.572 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.572 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:21.572 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.547148+0000", 2024-09-12T18:36:21.572 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9959999999999999e-06 2024-09-12T18:36:21.572 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.572 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.572 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:21.573 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.547205+0000", 2024-09-12T18:36:21.573 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.6659000000000001e-05 2024-09-12T18:36:21.573 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.573 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.573 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:21.573 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.547348+0000", 2024-09-12T18:36:21.573 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014264400000000001 2024-09-12T18:36:21.573 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.573 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.573 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:21.573 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.547466+0000", 2024-09-12T18:36:21.573 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000117989 2024-09-12T18:36:21.573 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:21.573 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:21.574 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:21.574 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.574 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.574 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:87146 5.9 5.b17a21f9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:36:21.574 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:21.547160+0000", 2024-09-12T18:36:21.574 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.00021069, 2024-09-12T18:36:21.574 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00055960700000000005, 2024-09-12T18:36:21.574 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:21.574 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:21.574 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:21.574 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:21.574 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:21.574 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:21.574 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 87146 2024-09-12T18:36:21.575 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.575 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:21.575 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.575 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:21.575 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.547160+0000", 2024-09-12T18:36:21.575 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:21.575 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.575 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.575 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:21.575 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.547160+0000", 2024-09-12T18:36:21.575 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:21.575 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.575 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.575 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:21.576 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.547161+0000", 2024-09-12T18:36:21.576 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.6300000000000005e-07 2024-09-12T18:36:21.576 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.576 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.576 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:21.576 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.547237+0000", 2024-09-12T18:36:21.576 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.5708000000000001e-05 2024-09-12T18:36:21.576 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.576 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.576 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:21.576 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.547244+0000", 2024-09-12T18:36:21.576 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.7859999999999997e-06 2024-09-12T18:36:21.576 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.577 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.577 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:21.577 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.547250+0000", 2024-09-12T18:36:21.577 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2469999999999999e-06 2024-09-12T18:36:21.577 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:21.577 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:21.577 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:21.577 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.577 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.577 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:87147 5.9 5.14c28929 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:36:21.577 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:21.547326+0000", 2024-09-12T18:36:21.577 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 4.5123999999999997e-05, 2024-09-12T18:36:21.577 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00043541000000000001, 2024-09-12T18:36:21.577 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:21.578 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:21.578 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:21.578 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:21.578 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:21.578 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:21.578 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 87147 2024-09-12T18:36:21.578 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.578 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:21.578 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.578 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:21.578 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.547326+0000", 2024-09-12T18:36:21.578 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:21.578 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.579 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.579 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:21.579 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.547326+0000", 2024-09-12T18:36:21.579 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:21.579 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.579 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.579 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:21.579 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.547327+0000", 2024-09-12T18:36:21.579 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1370000000000001e-06 2024-09-12T18:36:21.579 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.579 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.579 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:21.579 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.547409+0000", 2024-09-12T18:36:21.579 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.2081000000000002e-05 2024-09-12T18:36:21.580 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.580 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.580 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:21.580 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.547422+0000", 2024-09-12T18:36:21.580 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2729e-05 2024-09-12T18:36:21.580 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.580 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.580 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:21.580 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.547429+0000", 2024-09-12T18:36:21.580 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.4919999999999996e-06 2024-09-12T18:36:21.580 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:21.580 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:21.580 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:21.581 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.581 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.581 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:87145 5.5 e40/21 5:a4603003:::benchmark_data_smithi073_23739_object87144:head v 40'5501, mlcod=40'5498)", 2024-09-12T18:36:21.581 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:21.547611+0000", 2024-09-12T18:36:21.581 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 4294967295.9997597, 2024-09-12T18:36:21.581 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019654399999999999, 2024-09-12T18:36:21.581 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:21.581 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:21.581 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:21.581 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:21.581 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.581 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:21.581 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.547611+0000", 2024-09-12T18:36:21.581 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:21.582 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.582 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.582 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:21.582 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.547611+0000", 2024-09-12T18:36:21.582 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:21.582 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.582 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.582 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:21.582 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.547612+0000", 2024-09-12T18:36:21.582 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.06e-07 2024-09-12T18:36:21.582 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.582 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.582 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:21.583 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.547655+0000", 2024-09-12T18:36:21.583 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.2701999999999999e-05 2024-09-12T18:36:21.583 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.583 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.583 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:21.583 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.547664+0000", 2024-09-12T18:36:21.583 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7119999999999995e-06 2024-09-12T18:36:21.583 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.583 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.583 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:21.583 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.547670+0000", 2024-09-12T18:36:21.583 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.772e-06 2024-09-12T18:36:21.583 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.583 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.584 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:21.584 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.547716+0000", 2024-09-12T18:36:21.584 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.5543000000000001e-05 2024-09-12T18:36:21.584 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.584 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.584 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:21.584 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.547733+0000", 2024-09-12T18:36:21.584 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6931000000000001e-05 2024-09-12T18:36:21.584 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:21.584 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:21.584 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:21.584 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.584 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.584 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:87143 5.c e40/21 5:32a4aeef:::benchmark_data_smithi073_23739_object87142:head v 40'5390, mlcod=40'5388)", 2024-09-12T18:36:21.585 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:21.547685+0000", 2024-09-12T18:36:21.585 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 4294967295.9996858, 2024-09-12T18:36:21.585 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000169357, 2024-09-12T18:36:21.585 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:21.585 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:21.585 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:21.585 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:21.585 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.585 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:21.585 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.547685+0000", 2024-09-12T18:36:21.585 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:21.585 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.585 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.586 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:21.586 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.547685+0000", 2024-09-12T18:36:21.586 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:21.586 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.586 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.586 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:21.586 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.547686+0000", 2024-09-12T18:36:21.586 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.2599999999999998e-07 2024-09-12T18:36:21.586 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.586 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.586 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:21.586 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.547722+0000", 2024-09-12T18:36:21.586 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.6102000000000001e-05 2024-09-12T18:36:21.587 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.587 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.587 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:21.587 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.547728+0000", 2024-09-12T18:36:21.587 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.6429999999999998e-06 2024-09-12T18:36:21.587 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.587 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.587 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:21.587 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.547733+0000", 2024-09-12T18:36:21.587 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6199999999999998e-06 2024-09-12T18:36:21.587 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.587 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.587 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:21.587 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.547774+0000", 2024-09-12T18:36:21.588 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.0547000000000003e-05 2024-09-12T18:36:21.588 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.588 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.588 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:21.588 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.547790+0000", 2024-09-12T18:36:21.588 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6756999999999999e-05 2024-09-12T18:36:21.588 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:21.588 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:21.588 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:21.588 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.588 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.588 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:87133 5.1 5:817c305b:::benchmark_data_smithi073_23739_object87132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:36:21.588 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:21.540917+0000", 2024-09-12T18:36:21.589 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0064539039999999999, 2024-09-12T18:36:21.589 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0069890669999999998, 2024-09-12T18:36:21.589 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:21.589 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:21.589 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:21.589 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:21.589 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:21.589 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:21.589 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 87133 2024-09-12T18:36:21.589 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.589 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:21.589 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.590 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:21.590 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.540917+0000", 2024-09-12T18:36:21.590 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:21.590 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.590 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.590 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:21.590 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.540917+0000", 2024-09-12T18:36:21.590 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:21.590 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.590 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.590 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:21.590 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.540918+0000", 2024-09-12T18:36:21.590 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1009999999999999e-06 2024-09-12T18:36:21.591 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.591 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.591 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:21.591 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.540989+0000", 2024-09-12T18:36:21.591 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0485e-05 2024-09-12T18:36:21.591 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.591 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.591 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:21.591 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.541000+0000", 2024-09-12T18:36:21.591 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1721e-05 2024-09-12T18:36:21.591 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.591 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.591 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:21.591 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.541007+0000", 2024-09-12T18:36:21.592 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0119999999999999e-06 2024-09-12T18:36:21.592 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.592 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.592 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:21.592 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.541259+0000", 2024-09-12T18:36:21.592 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00025151200000000001 2024-09-12T18:36:21.592 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.592 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.592 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:21.592 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.541341+0000", 2024-09-12T18:36:21.592 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.2130000000000001e-05 2024-09-12T18:36:21.592 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.592 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.593 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:21.593 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.541422+0000", 2024-09-12T18:36:21.593 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.0512000000000004e-05 2024-09-12T18:36:21.593 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.593 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.593 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:21.593 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.545516+0000", 2024-09-12T18:36:21.593 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0040942590000000003 2024-09-12T18:36:21.593 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:21.593 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:21.593 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:21.593 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.593 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.593 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:87137 5.7 5:e147fdc8:::benchmark_data_smithi073_23739_object87136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:36:21.594 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:21.543371+0000", 2024-09-12T18:36:21.594 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.003999898, 2024-09-12T18:36:21.594 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.004600659, 2024-09-12T18:36:21.594 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:21.594 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:21.594 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:21.594 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:21.594 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:21.594 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:21.594 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 87137 2024-09-12T18:36:21.594 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.594 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:21.594 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.595 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:21.595 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.543371+0000", 2024-09-12T18:36:21.595 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:21.595 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.595 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.595 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:21.595 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.543371+0000", 2024-09-12T18:36:21.595 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:21.595 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.595 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.595 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:21.595 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.543372+0000", 2024-09-12T18:36:21.595 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3349999999999999e-06 2024-09-12T18:36:21.595 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.596 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.596 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:21.596 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.543468+0000", 2024-09-12T18:36:21.596 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.6026000000000005e-05 2024-09-12T18:36:21.596 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.596 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.596 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:21.596 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.543480+0000", 2024-09-12T18:36:21.596 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.173e-05 2024-09-12T18:36:21.596 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.596 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.596 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:21.596 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.543486+0000", 2024-09-12T18:36:21.596 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5289999999999999e-06 2024-09-12T18:36:21.597 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.597 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.597 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:21.597 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.543528+0000", 2024-09-12T18:36:21.597 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.1853000000000001e-05 2024-09-12T18:36:21.597 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.597 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.597 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:21.597 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.543664+0000", 2024-09-12T18:36:21.597 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013616400000000001 2024-09-12T18:36:21.597 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.597 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.597 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:21.597 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:21.543772+0000", 2024-09-12T18:36:21.598 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000108304 2024-09-12T18:36:21.598 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:21.598 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:21.598 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:21.598 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:21.598 INFO:teuthology.orchestra.run.smithi162.stdout: ], 2024-09-12T18:36:21.598 INFO:teuthology.orchestra.run.smithi162.stdout: "num_ops": 12 2024-09-12T18:36:21.598 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:36:21.600 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:36:21.600 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:21.596+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:21.701 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:21.699+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:21.793 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:36:21.793 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [], 2024-09-12T18:36:21.793 INFO:teuthology.orchestra.run.smithi162.stdout: "complaint_time": 30, 2024-09-12T18:36:21.793 INFO:teuthology.orchestra.run.smithi162.stdout: "num_blocked_ops": 0 2024-09-12T18:36:21.794 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:36:21.802 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:21.799+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:21.815 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:36:21.872 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 36 16 87805 87789 152.395 130 0.00640197 0.00655749 2024-09-12T18:36:21.888 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:36:21.888 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:36:21.888 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-12T18:36:21.888 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T18:36:21.902 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:21.896+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:21.977 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:36:21.977 INFO:teuthology.orchestra.run.smithi162.stdout: "size": 20, 2024-09-12T18:36:21.978 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 600, 2024-09-12T18:36:21.978 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:36:21.978 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.978 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4154.0:123 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:36:21.978 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:36:21.978 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 67.998311103000006, 2024-09-12T18:36:21.978 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.022398096999999999, 2024-09-12T18:36:21.978 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:21.978 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:21.978 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:21.978 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:21.979 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4154", 2024-09-12T18:36:21.979 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/745129001", 2024-09-12T18:36:21.979 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 123 2024-09-12T18:36:21.979 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.979 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:21.979 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.979 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:21.979 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:36:21.979 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:21.979 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.979 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.980 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:21.980 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:36:21.980 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:21.980 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.980 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.980 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:21.980 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:36:21.980 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.8299999999999996e-07 2024-09-12T18:36:21.980 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.980 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.980 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:21.981 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976528+0000", 2024-09-12T18:36:21.981 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011393299999999999 2024-09-12T18:36:21.981 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.981 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.981 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:21.981 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976539+0000", 2024-09-12T18:36:21.981 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0763e-05 2024-09-12T18:36:21.981 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.981 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.981 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:21.981 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976547+0000", 2024-09-12T18:36:21.982 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8199999999999997e-06 2024-09-12T18:36:21.982 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.982 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.982 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:21.982 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.995057+0000", 2024-09-12T18:36:21.982 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.018510047000000002 2024-09-12T18:36:21.982 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.982 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.982 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:21.982 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.995301+0000", 2024-09-12T18:36:21.982 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00024375899999999999 2024-09-12T18:36:21.982 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.983 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.983 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:21.983 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.995642+0000", 2024-09-12T18:36:21.983 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00034121100000000001 2024-09-12T18:36:21.983 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.983 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.983 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:21.983 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998179+0000", 2024-09-12T18:36:21.983 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00253761 2024-09-12T18:36:21.983 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.983 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.984 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:21.984 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998665+0000", 2024-09-12T18:36:21.984 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00048574600000000001 2024-09-12T18:36:21.984 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.984 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.984 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:21.984 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998739+0000", 2024-09-12T18:36:21.984 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.4286e-05 2024-09-12T18:36:21.984 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.984 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.984 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:21.985 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998812+0000", 2024-09-12T18:36:21.985 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2238999999999997e-05 2024-09-12T18:36:21.985 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:21.985 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:21.985 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:21.985 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.985 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.985 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4154.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:36:21.985 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:36:21.985 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 67.998163871000003, 2024-09-12T18:36:21.985 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025950709999999998, 2024-09-12T18:36:21.985 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:21.986 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:21.986 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:21.986 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:21.986 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4154", 2024-09-12T18:36:21.986 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/745129001", 2024-09-12T18:36:21.986 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 124 2024-09-12T18:36:21.986 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.986 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:21.986 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.986 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:21.986 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:36:21.987 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:21.987 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.987 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.987 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:21.987 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:36:21.987 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:21.987 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.987 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.987 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:21.987 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976562+0000", 2024-09-12T18:36:21.987 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.2999999999999999e-07 2024-09-12T18:36:21.987 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.988 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.988 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:21.988 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976567+0000", 2024-09-12T18:36:21.988 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3430000000000003e-06 2024-09-12T18:36:21.988 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.988 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.988 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:21.988 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976576+0000", 2024-09-12T18:36:21.988 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8070000000000006e-06 2024-09-12T18:36:21.988 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.988 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.989 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:21.989 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976583+0000", 2024-09-12T18:36:21.989 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9959999999999996e-06 2024-09-12T18:36:21.989 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.989 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.989 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:21.989 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997107+0000", 2024-09-12T18:36:21.989 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.020524106 2024-09-12T18:36:21.989 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.989 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.989 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:21.989 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997225+0000", 2024-09-12T18:36:21.990 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000117909 2024-09-12T18:36:21.990 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.990 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.990 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:21.990 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997407+0000", 2024-09-12T18:36:21.990 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00018175900000000001 2024-09-12T18:36:21.990 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.990 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.990 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:21.990 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998839+0000", 2024-09-12T18:36:21.990 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001432539 2024-09-12T18:36:21.991 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.991 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.991 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:21.991 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002319+0000", 2024-09-12T18:36:21.991 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0034803529999999998 2024-09-12T18:36:21.991 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.991 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.991 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:21.991 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002405+0000", 2024-09-12T18:36:21.991 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5434999999999998e-05 2024-09-12T18:36:21.991 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.992 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.992 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:21.992 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002512+0000", 2024-09-12T18:36:21.992 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010663299999999999 2024-09-12T18:36:21.992 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:21.992 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:21.992 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:21.992 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.992 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.992 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:21.992 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:36:21.993 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 56.333366364, 2024-09-12T18:36:21.993 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025127867000000002, 2024-09-12T18:36:21.993 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:21.993 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:21.993 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:21.993 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:21.993 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.993 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:21.993 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:36:21.993 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:21.993 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.993 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.994 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:21.994 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:36:21.994 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:21.994 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.994 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.994 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:21.994 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641362+0000", 2024-09-12T18:36:21.994 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.2569999999999999e-06 2024-09-12T18:36:21.994 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.994 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.995 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:21.995 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641374+0000", 2024-09-12T18:36:21.995 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2696e-05 2024-09-12T18:36:21.995 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.995 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.995 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:21.995 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641403+0000", 2024-09-12T18:36:21.995 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.8756999999999999e-05 2024-09-12T18:36:21.995 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.995 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.996 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:21.996 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641430+0000", 2024-09-12T18:36:21.996 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.6452999999999999e-05 2024-09-12T18:36:21.996 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.996 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.996 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:21.996 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641585+0000", 2024-09-12T18:36:21.996 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000155799 2024-09-12T18:36:21.996 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.996 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.996 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:21.997 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641753+0000", 2024-09-12T18:36:21.997 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000167868 2024-09-12T18:36:21.997 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.997 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.997 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:21.997 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641916+0000", 2024-09-12T18:36:21.997 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000162903 2024-09-12T18:36:21.997 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.997 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.997 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:21.997 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653655+0000", 2024-09-12T18:36:21.998 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011738879000000001 2024-09-12T18:36:21.998 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.998 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.998 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:21.998 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665515+0000", 2024-09-12T18:36:21.998 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011859915 2024-09-12T18:36:21.998 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.998 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.998 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:21.998 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665646+0000", 2024-09-12T18:36:21.998 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013122599999999999 2024-09-12T18:36:21.999 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.999 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.999 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:21.999 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666486+0000", 2024-09-12T18:36:21.999 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00084011399999999999 2024-09-12T18:36:21.999 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:21.999 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:21.999 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:21.999 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:21.999 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:21.999 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:21.999 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:36:22.000 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 56.333251900999997, 2024-09-12T18:36:22.000 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025384584000000002, 2024-09-12T18:36:22.000 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:22.000 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:22.000 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:22.000 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:22.000 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.000 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:22.000 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:36:22.000 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:22.000 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.001 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.001 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:22.001 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:36:22.001 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:22.001 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.001 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.001 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:22.001 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641474+0000", 2024-09-12T18:36:22.001 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.39e-06 2024-09-12T18:36:22.001 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.001 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.002 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:22.002 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641482+0000", 2024-09-12T18:36:22.002 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3499999999999999e-06 2024-09-12T18:36:22.002 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.002 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.002 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:22.002 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641534+0000", 2024-09-12T18:36:22.002 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2533e-05 2024-09-12T18:36:22.002 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.002 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.002 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.003 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641551+0000", 2024-09-12T18:36:22.003 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6515999999999999e-05 2024-09-12T18:36:22.003 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.003 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.003 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:22.003 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642630+0000", 2024-09-12T18:36:22.003 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001079705 2024-09-12T18:36:22.003 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.003 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.003 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:22.003 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642909+0000", 2024-09-12T18:36:22.003 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027859800000000002 2024-09-12T18:36:22.004 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.004 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.004 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:22.004 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643137+0000", 2024-09-12T18:36:22.004 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022803799999999999 2024-09-12T18:36:22.004 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.004 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.004 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:22.004 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653669+0000", 2024-09-12T18:36:22.004 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010532032 2024-09-12T18:36:22.005 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.005 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.005 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:22.005 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666624+0000", 2024-09-12T18:36:22.005 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012954940999999999 2024-09-12T18:36:22.005 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.005 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.005 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:22.005 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666762+0000", 2024-09-12T18:36:22.005 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000137668 2024-09-12T18:36:22.006 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.006 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.006 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:22.006 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666857+0000", 2024-09-12T18:36:22.006 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.5812999999999999e-05 2024-09-12T18:36:22.006 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:22.006 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:22.006 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:22.006 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.006 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.006 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:22.007 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:36:22.007 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 56.333124106, 2024-09-12T18:36:22.007 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025661562999999998, 2024-09-12T18:36:22.007 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:22.007 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:22.007 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:22.007 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:22.007 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.008 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:22.008 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:36:22.009 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:22.009 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.009 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.009 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:22.009 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:36:22.009 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:22.009 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.009 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.010 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:22.010 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641602+0000", 2024-09-12T18:36:22.010 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3540000000000001e-06 2024-09-12T18:36:22.010 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.010 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.010 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:22.010 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641637+0000", 2024-09-12T18:36:22.010 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5145999999999999e-05 2024-09-12T18:36:22.010 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.010 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.010 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:22.010 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641659+0000", 2024-09-12T18:36:22.011 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2249999999999999e-05 2024-09-12T18:36:22.011 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.011 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.011 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.011 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641675+0000", 2024-09-12T18:36:22.011 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6059999999999999e-05 2024-09-12T18:36:22.011 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.011 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.011 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:22.011 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644570+0000", 2024-09-12T18:36:22.011 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028947069999999998 2024-09-12T18:36:22.012 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.012 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.012 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:22.012 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644900+0000", 2024-09-12T18:36:22.012 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000329401 2024-09-12T18:36:22.012 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.012 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.012 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:22.012 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645235+0000", 2024-09-12T18:36:22.012 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000335874 2024-09-12T18:36:22.012 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.013 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.013 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:22.013 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655459+0000", 2024-09-12T18:36:22.013 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010223441999999999 2024-09-12T18:36:22.013 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.013 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.013 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:22.013 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667028+0000", 2024-09-12T18:36:22.013 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011568673999999999 2024-09-12T18:36:22.013 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.014 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.014 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:22.014 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667163+0000", 2024-09-12T18:36:22.014 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013525500000000001 2024-09-12T18:36:22.014 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.014 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.014 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:22.014 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667262+0000", 2024-09-12T18:36:22.014 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9400000000000004e-05 2024-09-12T18:36:22.014 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:22.014 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:22.014 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:22.015 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.015 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.015 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:22.015 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:36:22.015 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 56.333022286000002, 2024-09-12T18:36:22.015 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025971339, 2024-09-12T18:36:22.015 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:22.015 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:22.015 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:22.015 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:22.015 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.016 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:22.016 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:36:22.016 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:22.016 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.016 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.016 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:22.016 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:36:22.016 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:22.016 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.016 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.016 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:22.017 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641704+0000", 2024-09-12T18:36:22.017 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.297e-06 2024-09-12T18:36:22.017 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.017 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.017 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:22.017 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641712+0000", 2024-09-12T18:36:22.017 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.9060000000000002e-06 2024-09-12T18:36:22.017 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.018 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.018 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:22.018 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641731+0000", 2024-09-12T18:36:22.018 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9083e-05 2024-09-12T18:36:22.018 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.018 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.018 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.018 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641745+0000", 2024-09-12T18:36:22.018 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4066999999999999e-05 2024-09-12T18:36:22.018 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.018 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.019 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:22.019 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646529+0000", 2024-09-12T18:36:22.019 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.004784033 2024-09-12T18:36:22.019 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.019 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.019 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:22.019 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646727+0000", 2024-09-12T18:36:22.019 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019841800000000001 2024-09-12T18:36:22.019 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.020 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.020 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:22.020 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647057+0000", 2024-09-12T18:36:22.020 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032926800000000002 2024-09-12T18:36:22.020 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.020 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.020 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:22.020 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655475+0000", 2024-09-12T18:36:22.021 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0084186250000000008 2024-09-12T18:36:22.021 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.021 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.021 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:22.021 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667424+0000", 2024-09-12T18:36:22.021 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011949257 2024-09-12T18:36:22.021 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.022 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.022 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:22.022 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667573+0000", 2024-09-12T18:36:22.022 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014851900000000001 2024-09-12T18:36:22.022 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.022 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.022 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:22.022 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667674+0000", 2024-09-12T18:36:22.022 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010086600000000001 2024-09-12T18:36:22.022 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:22.022 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:22.022 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:22.022 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.023 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.023 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:22.023 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:36:22.023 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 56.332959897000002, 2024-09-12T18:36:22.023 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026215008000000001, 2024-09-12T18:36:22.023 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:22.023 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:22.023 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:22.023 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:22.023 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.024 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:22.024 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:36:22.024 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:22.024 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.024 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.024 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:22.024 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:36:22.024 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:22.024 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.024 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.025 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:22.025 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641766+0000", 2024-09-12T18:36:22.025 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1200000000000001e-06 2024-09-12T18:36:22.025 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.025 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.025 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:22.025 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641775+0000", 2024-09-12T18:36:22.025 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.2499999999999995e-06 2024-09-12T18:36:22.025 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.026 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.026 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:22.026 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641793+0000", 2024-09-12T18:36:22.026 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7773000000000001e-05 2024-09-12T18:36:22.026 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.026 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.026 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.026 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641807+0000", 2024-09-12T18:36:22.026 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3814e-05 2024-09-12T18:36:22.026 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.026 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.026 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:22.026 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647626+0000", 2024-09-12T18:36:22.026 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0058193050000000003 2024-09-12T18:36:22.027 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.027 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.027 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:22.027 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647937+0000", 2024-09-12T18:36:22.027 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031112400000000003 2024-09-12T18:36:22.027 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.027 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.027 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:22.027 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648239+0000", 2024-09-12T18:36:22.027 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00030227500000000002 2024-09-12T18:36:22.027 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.027 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.027 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:22.027 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655487+0000", 2024-09-12T18:36:22.028 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072479129999999999 2024-09-12T18:36:22.028 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.028 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.028 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:22.028 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667823+0000", 2024-09-12T18:36:22.028 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012335505 2024-09-12T18:36:22.028 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.028 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.028 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:22.028 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667908+0000", 2024-09-12T18:36:22.028 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4843000000000001e-05 2024-09-12T18:36:22.028 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.028 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.028 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:22.029 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667980+0000", 2024-09-12T18:36:22.029 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2086000000000001e-05 2024-09-12T18:36:22.029 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:22.029 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:22.029 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:22.029 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.029 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.029 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:22.029 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:36:22.029 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 56.332899744000002, 2024-09-12T18:36:22.029 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026483236, 2024-09-12T18:36:22.029 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:22.029 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:22.029 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:22.030 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:22.030 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.030 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:22.030 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:36:22.030 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:22.030 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.030 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.030 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:22.030 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:36:22.030 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:22.030 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.030 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.030 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:22.031 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641826+0000", 2024-09-12T18:36:22.031 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:36:22.031 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.031 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.031 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:22.031 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641832+0000", 2024-09-12T18:36:22.031 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4199999999999998e-06 2024-09-12T18:36:22.031 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.031 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.031 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:22.031 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641848+0000", 2024-09-12T18:36:22.031 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6492999999999999e-05 2024-09-12T18:36:22.031 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.031 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.032 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.032 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641863+0000", 2024-09-12T18:36:22.032 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5427e-05 2024-09-12T18:36:22.032 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.032 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.032 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:22.032 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648887+0000", 2024-09-12T18:36:22.032 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0070230860000000004 2024-09-12T18:36:22.032 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.032 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.032 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:22.032 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649111+0000", 2024-09-12T18:36:22.032 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022425799999999999 2024-09-12T18:36:22.032 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.033 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.033 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:22.033 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649494+0000", 2024-09-12T18:36:22.033 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00038349400000000001 2024-09-12T18:36:22.033 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.033 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.033 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:22.033 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655499+0000", 2024-09-12T18:36:22.033 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0060047260000000002 2024-09-12T18:36:22.033 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.033 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.033 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:22.033 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668110+0000", 2024-09-12T18:36:22.034 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012610543 2024-09-12T18:36:22.034 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.034 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.034 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:22.034 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668252+0000", 2024-09-12T18:36:22.034 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014265600000000001 2024-09-12T18:36:22.034 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.034 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.034 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:22.034 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668308+0000", 2024-09-12T18:36:22.034 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5992999999999997e-05 2024-09-12T18:36:22.034 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:22.034 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:22.034 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:22.035 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.035 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.035 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:22.035 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:36:22.035 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 56.332844528000003, 2024-09-12T18:36:22.035 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026605302000000001, 2024-09-12T18:36:22.035 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:22.035 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:22.035 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:22.035 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:22.035 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.035 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:22.035 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:36:22.035 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:22.036 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.036 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.036 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:22.036 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:36:22.036 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:22.036 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.036 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.036 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:22.036 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641881+0000", 2024-09-12T18:36:22.036 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.057e-06 2024-09-12T18:36:22.036 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.036 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.036 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:22.037 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641887+0000", 2024-09-12T18:36:22.037 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.6629999999999998e-06 2024-09-12T18:36:22.037 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.037 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.037 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:22.037 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641903+0000", 2024-09-12T18:36:22.037 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6317e-05 2024-09-12T18:36:22.037 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.037 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.037 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.037 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641917+0000", 2024-09-12T18:36:22.037 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3339999999999999e-05 2024-09-12T18:36:22.037 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.038 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.038 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:22.038 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650708+0000", 2024-09-12T18:36:22.038 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.008791419 2024-09-12T18:36:22.038 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.038 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.038 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:22.038 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651021+0000", 2024-09-12T18:36:22.038 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031296699999999999 2024-09-12T18:36:22.038 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.038 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.038 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:22.038 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651349+0000", 2024-09-12T18:36:22.038 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032796499999999999 2024-09-12T18:36:22.039 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.039 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.039 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:22.039 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655742+0000", 2024-09-12T18:36:22.039 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0043934680000000002 2024-09-12T18:36:22.039 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.039 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.039 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:22.039 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668377+0000", 2024-09-12T18:36:22.039 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012634312999999999 2024-09-12T18:36:22.039 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.039 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.039 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:22.039 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668441+0000", 2024-09-12T18:36:22.040 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4369999999999995e-05 2024-09-12T18:36:22.040 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.040 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.040 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:22.040 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668485+0000", 2024-09-12T18:36:22.040 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4422999999999998e-05 2024-09-12T18:36:22.040 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:22.040 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:22.040 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:22.040 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.040 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.040 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:22.040 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:36:22.040 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 56.332787125000003, 2024-09-12T18:36:22.041 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026919499, 2024-09-12T18:36:22.041 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:22.041 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:22.041 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:22.041 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:22.041 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.041 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:22.041 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:36:22.041 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:22.041 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.041 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.041 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:22.041 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:36:22.041 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:22.042 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.042 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.042 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:22.042 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641939+0000", 2024-09-12T18:36:22.042 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9399999999999993e-07 2024-09-12T18:36:22.042 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.042 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.042 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:22.042 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641945+0000", 2024-09-12T18:36:22.042 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9200000000000001e-06 2024-09-12T18:36:22.042 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.042 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.042 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:22.042 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641961+0000", 2024-09-12T18:36:22.043 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6520000000000001e-05 2024-09-12T18:36:22.043 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.043 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.043 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.043 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641974+0000", 2024-09-12T18:36:22.043 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3413e-05 2024-09-12T18:36:22.043 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.043 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.043 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:22.043 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654560+0000", 2024-09-12T18:36:22.043 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012585308999999999 2024-09-12T18:36:22.043 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.043 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.043 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:22.043 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654822+0000", 2024-09-12T18:36:22.044 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026210099999999999 2024-09-12T18:36:22.044 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.044 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.044 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:22.044 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655059+0000", 2024-09-12T18:36:22.044 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00023747899999999999 2024-09-12T18:36:22.044 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.044 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.044 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:22.044 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.656315+0000", 2024-09-12T18:36:22.044 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0012555000000000001 2024-09-12T18:36:22.044 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.044 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.045 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:22.045 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668590+0000", 2024-09-12T18:36:22.045 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012274851999999999 2024-09-12T18:36:22.045 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.045 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.045 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:22.045 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668725+0000", 2024-09-12T18:36:22.045 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013524199999999999 2024-09-12T18:36:22.045 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.045 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.045 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:22.045 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668857+0000", 2024-09-12T18:36:22.045 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013216899999999999 2024-09-12T18:36:22.046 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:22.046 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:22.046 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:22.046 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.046 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.046 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:22.046 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:36:22.046 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 56.332733605000001, 2024-09-12T18:36:22.046 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023616723999999999, 2024-09-12T18:36:22.046 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:22.046 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:22.046 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:22.046 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:22.046 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.047 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:22.047 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:36:22.047 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:22.047 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.047 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.047 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:22.047 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:36:22.047 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:22.047 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.047 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.047 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:22.047 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641992+0000", 2024-09-12T18:36:22.047 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.08e-06 2024-09-12T18:36:22.048 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.048 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.048 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:22.048 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641998+0000", 2024-09-12T18:36:22.048 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4299999999999997e-06 2024-09-12T18:36:22.048 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.048 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.048 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:22.048 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642014+0000", 2024-09-12T18:36:22.048 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6266e-05 2024-09-12T18:36:22.048 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.048 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.048 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.049 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642026+0000", 2024-09-12T18:36:22.049 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2567e-05 2024-09-12T18:36:22.049 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.049 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.049 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:22.049 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642213+0000", 2024-09-12T18:36:22.049 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00018701899999999999 2024-09-12T18:36:22.049 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.049 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.049 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:22.049 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642507+0000", 2024-09-12T18:36:22.049 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00029394700000000002 2024-09-12T18:36:22.049 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.049 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.050 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:22.050 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642686+0000", 2024-09-12T18:36:22.050 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000178152 2024-09-12T18:36:22.050 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.050 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.050 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:22.050 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650952+0000", 2024-09-12T18:36:22.050 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0082663570000000002 2024-09-12T18:36:22.050 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.050 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.050 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:22.051 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665382+0000", 2024-09-12T18:36:22.051 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.014430111000000001 2024-09-12T18:36:22.051 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.051 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.051 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:22.051 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665508+0000", 2024-09-12T18:36:22.051 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000125986 2024-09-12T18:36:22.051 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.051 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.051 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:22.052 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665608+0000", 2024-09-12T18:36:22.052 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9809000000000006e-05 2024-09-12T18:36:22.052 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:22.052 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:22.052 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:22.052 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.052 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.052 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:22.052 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:36:22.052 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 56.332605739999998, 2024-09-12T18:36:22.052 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024670563, 2024-09-12T18:36:22.052 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:22.052 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:22.053 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:22.053 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:22.053 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.053 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:22.053 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:36:22.053 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:22.053 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.053 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.053 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:22.053 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:36:22.053 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:22.053 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.053 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.053 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:22.054 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642120+0000", 2024-09-12T18:36:22.054 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1769999999999999e-06 2024-09-12T18:36:22.054 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.054 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.054 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:22.054 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642128+0000", 2024-09-12T18:36:22.054 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3429999999999998e-06 2024-09-12T18:36:22.054 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.054 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.054 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:22.054 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642192+0000", 2024-09-12T18:36:22.054 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4406999999999995e-05 2024-09-12T18:36:22.054 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.054 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.055 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.055 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642223+0000", 2024-09-12T18:36:22.055 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.1266000000000002e-05 2024-09-12T18:36:22.055 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.055 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.055 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:22.055 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643201+0000", 2024-09-12T18:36:22.055 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0009778390000000001 2024-09-12T18:36:22.055 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.055 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.055 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:22.055 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643410+0000", 2024-09-12T18:36:22.055 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020874199999999999 2024-09-12T18:36:22.055 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.056 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.056 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:22.056 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643685+0000", 2024-09-12T18:36:22.056 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027520700000000002 2024-09-12T18:36:22.056 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.056 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.056 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:22.056 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650966+0000", 2024-09-12T18:36:22.056 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072810710000000001 2024-09-12T18:36:22.056 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.056 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.056 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:22.056 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666560+0000", 2024-09-12T18:36:22.056 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015594143 2024-09-12T18:36:22.057 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.057 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.057 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:22.057 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666691+0000", 2024-09-12T18:36:22.057 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000130359 2024-09-12T18:36:22.057 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.057 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.057 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:22.057 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666790+0000", 2024-09-12T18:36:22.057 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9009e-05 2024-09-12T18:36:22.057 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:22.057 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:22.057 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:22.057 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.057 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.058 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:22.058 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:36:22.058 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 56.331827451999999, 2024-09-12T18:36:22.058 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024891744, 2024-09-12T18:36:22.058 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:22.058 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:22.058 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:22.058 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:22.058 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.058 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:22.058 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:36:22.058 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:22.058 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.059 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.059 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:22.059 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:36:22.059 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:22.059 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.059 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.059 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:22.059 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642899+0000", 2024-09-12T18:36:22.059 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4729999999999999e-06 2024-09-12T18:36:22.059 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.059 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.059 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:22.059 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642912+0000", 2024-09-12T18:36:22.059 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3495999999999999e-05 2024-09-12T18:36:22.060 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.060 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.060 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:22.060 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642934+0000", 2024-09-12T18:36:22.060 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2033999999999999e-05 2024-09-12T18:36:22.060 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.060 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.060 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.060 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642949+0000", 2024-09-12T18:36:22.060 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4970000000000001e-05 2024-09-12T18:36:22.060 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.060 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.060 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:22.060 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644400+0000", 2024-09-12T18:36:22.061 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001450305 2024-09-12T18:36:22.061 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.061 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.061 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:22.061 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644617+0000", 2024-09-12T18:36:22.061 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000217302 2024-09-12T18:36:22.061 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.061 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.061 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:22.062 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645052+0000", 2024-09-12T18:36:22.062 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000434797 2024-09-12T18:36:22.062 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.062 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.062 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:22.062 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653860+0000", 2024-09-12T18:36:22.062 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0088082249999999994 2024-09-12T18:36:22.062 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.062 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.062 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:22.062 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667598+0000", 2024-09-12T18:36:22.062 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.013738451 2024-09-12T18:36:22.062 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.063 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.063 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:22.063 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667698+0000", 2024-09-12T18:36:22.063 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9854999999999999e-05 2024-09-12T18:36:22.063 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.063 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.063 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:22.063 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667789+0000", 2024-09-12T18:36:22.063 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0835999999999996e-05 2024-09-12T18:36:22.063 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:22.063 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:22.063 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:22.063 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.063 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.064 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:30 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:22.064 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:36:22.064 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 56.331752635999997, 2024-09-12T18:36:22.064 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023936852000000002, 2024-09-12T18:36:22.064 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:22.064 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:22.064 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:22.064 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:22.064 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.064 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:22.064 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:36:22.064 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:22.064 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.064 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.065 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:22.065 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:36:22.065 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:22.065 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.065 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.065 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:22.065 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642973+0000", 2024-09-12T18:36:22.065 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.11e-06 2024-09-12T18:36:22.065 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.065 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.065 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:22.065 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642994+0000", 2024-09-12T18:36:22.065 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.0699999999999998e-05 2024-09-12T18:36:22.065 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.066 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.066 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:22.066 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643011+0000", 2024-09-12T18:36:22.066 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7229999999999999e-05 2024-09-12T18:36:22.066 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.066 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.066 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.066 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643025+0000", 2024-09-12T18:36:22.066 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3803e-05 2024-09-12T18:36:22.066 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.066 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.066 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:22.066 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643143+0000", 2024-09-12T18:36:22.067 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000118225 2024-09-12T18:36:22.067 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.067 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.067 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:22.067 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643426+0000", 2024-09-12T18:36:22.067 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00028250500000000001 2024-09-12T18:36:22.067 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.067 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.067 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:22.067 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643864+0000", 2024-09-12T18:36:22.067 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00043856 2024-09-12T18:36:22.067 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.067 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.068 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:22.068 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651148+0000", 2024-09-12T18:36:22.068 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072836769999999997 2024-09-12T18:36:22.068 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.068 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.068 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:22.068 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666674+0000", 2024-09-12T18:36:22.068 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015525786999999999 2024-09-12T18:36:22.068 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.068 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.068 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:22.068 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666796+0000", 2024-09-12T18:36:22.068 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000122416 2024-09-12T18:36:22.069 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.069 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.069 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:22.069 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666909+0000", 2024-09-12T18:36:22.069 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011283899999999999 2024-09-12T18:36:22.069 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:22.069 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:22.069 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:22.069 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.069 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.069 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:22.069 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:36:22.069 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 56.331669929999997, 2024-09-12T18:36:22.069 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024100234000000002, 2024-09-12T18:36:22.070 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:22.070 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:22.070 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:22.070 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:22.070 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.070 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:22.070 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:36:22.070 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:22.070 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.070 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.070 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:22.070 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:36:22.070 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:22.070 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.071 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.071 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:22.071 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643056+0000", 2024-09-12T18:36:22.071 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.046e-06 2024-09-12T18:36:22.071 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.071 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.071 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:22.071 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643068+0000", 2024-09-12T18:36:22.071 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2106999999999999e-05 2024-09-12T18:36:22.071 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.071 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.071 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:22.071 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643085+0000", 2024-09-12T18:36:22.071 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7479999999999999e-05 2024-09-12T18:36:22.071 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.072 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.072 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.072 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643099+0000", 2024-09-12T18:36:22.072 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3730000000000001e-05 2024-09-12T18:36:22.072 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.072 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.072 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:22.072 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644623+0000", 2024-09-12T18:36:22.072 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0015236080000000001 2024-09-12T18:36:22.072 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.072 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.072 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:22.072 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644893+0000", 2024-09-12T18:36:22.072 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026990500000000003 2024-09-12T18:36:22.073 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.073 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.073 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:22.073 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645227+0000", 2024-09-12T18:36:22.073 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00033391300000000003 2024-09-12T18:36:22.073 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.073 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.073 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:22.073 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653926+0000", 2024-09-12T18:36:22.073 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0086993339999999995 2024-09-12T18:36:22.073 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.073 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.073 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:22.074 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666925+0000", 2024-09-12T18:36:22.074 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012998686000000001 2024-09-12T18:36:22.074 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.074 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.074 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:22.074 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667057+0000", 2024-09-12T18:36:22.074 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013255600000000001 2024-09-12T18:36:22.074 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.074 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.074 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:22.074 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667155+0000", 2024-09-12T18:36:22.074 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7868999999999994e-05 2024-09-12T18:36:22.074 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:22.074 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:22.075 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:22.075 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.075 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.075 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:22.075 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643139+0000", 2024-09-12T18:36:22.075 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 56.331585343999997, 2024-09-12T18:36:22.075 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.022417057000000001, 2024-09-12T18:36:22.075 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:22.075 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:22.075 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:22.075 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:22.075 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.075 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:22.075 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643139+0000", 2024-09-12T18:36:22.076 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:22.076 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.076 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.076 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:22.076 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643139+0000", 2024-09-12T18:36:22.076 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:22.076 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.076 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.076 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:22.076 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643140+0000", 2024-09-12T18:36:22.076 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0729999999999999e-06 2024-09-12T18:36:22.076 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.076 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.076 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:22.077 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643151+0000", 2024-09-12T18:36:22.077 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.039e-05 2024-09-12T18:36:22.077 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.077 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.077 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:22.077 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643168+0000", 2024-09-12T18:36:22.077 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7575999999999999e-05 2024-09-12T18:36:22.077 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.077 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.077 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.077 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643182+0000", 2024-09-12T18:36:22.077 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3224000000000001e-05 2024-09-12T18:36:22.077 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.077 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.078 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:22.078 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643358+0000", 2024-09-12T18:36:22.078 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00017676500000000001 2024-09-12T18:36:22.078 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.078 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.078 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:22.078 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643647+0000", 2024-09-12T18:36:22.078 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00028850499999999999 2024-09-12T18:36:22.078 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.078 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.078 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:22.078 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643924+0000", 2024-09-12T18:36:22.078 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000277547 2024-09-12T18:36:22.078 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.079 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.079 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:22.079 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650289+0000", 2024-09-12T18:36:22.079 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0063645350000000002 2024-09-12T18:36:22.079 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.079 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.079 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:22.079 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665333+0000", 2024-09-12T18:36:22.079 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015043531000000001 2024-09-12T18:36:22.079 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.079 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.079 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:22.079 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665454+0000", 2024-09-12T18:36:22.080 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000121302 2024-09-12T18:36:22.080 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.080 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.080 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:22.080 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665556+0000", 2024-09-12T18:36:22.080 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010260900000000001 2024-09-12T18:36:22.080 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:22.081 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:22.081 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:22.081 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.081 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.081 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:22.081 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:36:22.081 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 56.331474141000001, 2024-09-12T18:36:22.081 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024255982999999998, 2024-09-12T18:36:22.081 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:22.081 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:22.081 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:22.081 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:22.081 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.082 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:22.082 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:36:22.082 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:22.082 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.082 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.082 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:22.082 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:36:22.082 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:22.082 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.082 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.082 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:22.082 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643252+0000", 2024-09-12T18:36:22.082 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:22.082 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.083 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.083 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:22.083 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643287+0000", 2024-09-12T18:36:22.083 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5225999999999998e-05 2024-09-12T18:36:22.083 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.083 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.083 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:22.083 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643323+0000", 2024-09-12T18:36:22.083 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5488999999999999e-05 2024-09-12T18:36:22.083 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.083 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.083 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.083 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643357+0000", 2024-09-12T18:36:22.083 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.3853999999999998e-05 2024-09-12T18:36:22.084 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.084 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.084 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:22.084 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646716+0000", 2024-09-12T18:36:22.084 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003359 2024-09-12T18:36:22.084 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.084 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.084 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:22.084 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647037+0000", 2024-09-12T18:36:22.084 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032131800000000002 2024-09-12T18:36:22.084 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.084 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.084 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:22.084 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647337+0000", 2024-09-12T18:36:22.085 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000300208 2024-09-12T18:36:22.085 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.085 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.085 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:22.085 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654291+0000", 2024-09-12T18:36:22.085 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0069543089999999997 2024-09-12T18:36:22.085 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.085 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.085 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:22.085 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667297+0000", 2024-09-12T18:36:22.085 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.013005526 2024-09-12T18:36:22.085 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.085 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.085 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:22.086 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667416+0000", 2024-09-12T18:36:22.086 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000119416 2024-09-12T18:36:22.086 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.086 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.086 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:22.086 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667507+0000", 2024-09-12T18:36:22.086 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0206999999999999e-05 2024-09-12T18:36:22.086 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:22.086 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:22.086 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:22.086 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.086 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.086 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:22.086 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:36:22.087 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 56.331347045999998, 2024-09-12T18:36:22.087 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023888482999999999, 2024-09-12T18:36:22.087 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:22.087 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:22.087 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:22.087 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:22.087 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.087 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:22.087 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:36:22.087 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:22.087 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.087 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.087 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:22.088 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:36:22.088 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:22.088 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.088 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.088 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:22.088 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643379+0000", 2024-09-12T18:36:22.088 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.207e-06 2024-09-12T18:36:22.088 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.088 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.088 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:22.088 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643390+0000", 2024-09-12T18:36:22.088 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0696000000000001e-05 2024-09-12T18:36:22.088 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.089 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.089 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:22.089 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643407+0000", 2024-09-12T18:36:22.089 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7563000000000001e-05 2024-09-12T18:36:22.089 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.089 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.089 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.089 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643420+0000", 2024-09-12T18:36:22.089 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3277e-05 2024-09-12T18:36:22.089 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.089 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.089 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:22.089 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644906+0000", 2024-09-12T18:36:22.089 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001485945 2024-09-12T18:36:22.090 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.090 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.090 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:22.090 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645404+0000", 2024-09-12T18:36:22.090 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00049807599999999997 2024-09-12T18:36:22.090 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.090 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.090 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:22.090 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645846+0000", 2024-09-12T18:36:22.090 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00044190400000000002 2024-09-12T18:36:22.090 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.090 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.090 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:22.090 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654223+0000", 2024-09-12T18:36:22.091 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0083767419999999995 2024-09-12T18:36:22.091 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.091 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.091 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:22.091 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667026+0000", 2024-09-12T18:36:22.091 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012802531000000001 2024-09-12T18:36:22.091 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.091 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.091 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:22.091 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667162+0000", 2024-09-12T18:36:22.091 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000136112 2024-09-12T18:36:22.091 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.091 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.091 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:22.092 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667266+0000", 2024-09-12T18:36:22.092 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010443 2024-09-12T18:36:22.092 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:22.092 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:22.092 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:22.092 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.092 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.092 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:22.092 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643447+0000", 2024-09-12T18:36:22.092 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 56.33127752, 2024-09-12T18:36:22.092 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.022081562999999998, 2024-09-12T18:36:22.092 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:22.092 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:22.093 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:22.093 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:22.093 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.093 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:22.093 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643447+0000", 2024-09-12T18:36:22.093 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:22.093 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.093 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.093 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:22.093 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643447+0000", 2024-09-12T18:36:22.093 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:22.093 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.093 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.093 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:22.094 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643448+0000", 2024-09-12T18:36:22.094 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1629999999999999e-06 2024-09-12T18:36:22.094 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.094 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.094 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:22.094 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643458+0000", 2024-09-12T18:36:22.094 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.8400000000000007e-06 2024-09-12T18:36:22.094 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.094 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.094 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:22.094 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643475+0000", 2024-09-12T18:36:22.094 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6874000000000001e-05 2024-09-12T18:36:22.094 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.094 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.095 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.095 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643488+0000", 2024-09-12T18:36:22.095 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3026e-05 2024-09-12T18:36:22.095 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.095 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.095 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:22.095 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643931+0000", 2024-09-12T18:36:22.095 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00044307 2024-09-12T18:36:22.095 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.095 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.095 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:22.095 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644210+0000", 2024-09-12T18:36:22.095 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027908400000000003 2024-09-12T18:36:22.095 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.096 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.096 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:22.096 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644606+0000", 2024-09-12T18:36:22.096 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00039615400000000002 2024-09-12T18:36:22.096 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.096 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.096 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:22.096 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650552+0000", 2024-09-12T18:36:22.096 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0059455619999999997 2024-09-12T18:36:22.096 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.096 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.096 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:22.096 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665302+0000", 2024-09-12T18:36:22.096 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.014749962 2024-09-12T18:36:22.097 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.097 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.097 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:22.097 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665424+0000", 2024-09-12T18:36:22.097 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012214300000000001 2024-09-12T18:36:22.097 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.097 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.097 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:22.097 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665529+0000", 2024-09-12T18:36:22.097 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000104685 2024-09-12T18:36:22.097 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:22.097 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:22.097 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:22.097 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.098 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.098 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:22.098 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:36:22.098 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 56.331196327000001, 2024-09-12T18:36:22.098 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024222582999999999, 2024-09-12T18:36:22.098 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:22.098 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:22.098 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:22.098 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:22.098 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.098 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:22.098 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:36:22.098 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:22.098 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.099 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.099 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:22.099 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:36:22.099 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:22.099 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.099 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.099 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:22.099 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643530+0000", 2024-09-12T18:36:22.099 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.393e-06 2024-09-12T18:36:22.099 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.099 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.099 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:22.099 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643536+0000", 2024-09-12T18:36:22.099 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4130000000000003e-06 2024-09-12T18:36:22.100 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.100 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.100 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:22.100 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643554+0000", 2024-09-12T18:36:22.100 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7572999999999999e-05 2024-09-12T18:36:22.100 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.100 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.100 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.100 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643567+0000", 2024-09-12T18:36:22.100 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3393999999999999e-05 2024-09-12T18:36:22.100 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.100 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.100 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:22.101 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648198+0000", 2024-09-12T18:36:22.101 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0046304479999999997 2024-09-12T18:36:22.101 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.101 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.101 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:22.101 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648413+0000", 2024-09-12T18:36:22.101 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00021507500000000001 2024-09-12T18:36:22.101 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:22.101 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:22.101 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:22.101 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667751+0000", 2024-09-12T18:36:22.101 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.019338286999999999 2024-09-12T18:36:22.101 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:22.101 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:22.102 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:22.102 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:22.102 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:22.102 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:36:22.103 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:36:22.104 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:22.099+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:22.204 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:22.199+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:22.220 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:36:22.220 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T18:36:22.220 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 40, 2024-09-12T18:36:22.220 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "c08d5a84-711b-44bf-bdf1-e06ecc2c7c00", 2024-09-12T18:36:22.220 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-12T18:35:02.695853+0000", 2024-09-12T18:36:22.220 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-12T18:36:21.473587+0000", 2024-09-12T18:36:22.220 INFO:teuthology.orchestra.run.smithi073.stdout: "last_up_change": "2024-09-12T18:35:12.464628+0000", 2024-09-12T18:36:22.221 INFO:teuthology.orchestra.run.smithi073.stdout: "last_in_change": "2024-09-12T18:35:04.352525+0000", 2024-09-12T18:36:22.221 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T18:36:22.221 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_num": 5806080, 2024-09-12T18:36:22.221 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_set": [ 2024-09-12T18:36:22.221 INFO:teuthology.orchestra.run.smithi073.stdout: "nodeep-scrub", 2024-09-12T18:36:22.221 INFO:teuthology.orchestra.run.smithi073.stdout: "noscrub", 2024-09-12T18:36:22.221 INFO:teuthology.orchestra.run.smithi073.stdout: "pglog_hardlimit", 2024-09-12T18:36:22.221 INFO:teuthology.orchestra.run.smithi073.stdout: "purged_snapdirs", 2024-09-12T18:36:22.221 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_deletes", 2024-09-12T18:36:22.222 INFO:teuthology.orchestra.run.smithi073.stdout: "sortbitwise" 2024-09-12T18:36:22.222 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T18:36:22.222 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_version": 5, 2024-09-12T18:36:22.222 INFO:teuthology.orchestra.run.smithi073.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T18:36:22.222 INFO:teuthology.orchestra.run.smithi073.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T18:36:22.222 INFO:teuthology.orchestra.run.smithi073.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T18:36:22.222 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_snapshot": "", 2024-09-12T18:36:22.222 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_max": 5, 2024-09-12T18:36:22.222 INFO:teuthology.orchestra.run.smithi073.stdout: "max_osd": 3, 2024-09-12T18:36:22.222 INFO:teuthology.orchestra.run.smithi073.stdout: "require_min_compat_client": "luminous", 2024-09-12T18:36:22.222 INFO:teuthology.orchestra.run.smithi073.stdout: "min_compat_client": "jewel", 2024-09-12T18:36:22.222 INFO:teuthology.orchestra.run.smithi073.stdout: "require_osd_release": "squid", 2024-09-12T18:36:22.222 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_crimson": false, 2024-09-12T18:36:22.223 INFO:teuthology.orchestra.run.smithi073.stdout: "pools": [ 2024-09-12T18:36:22.223 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:22.223 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 1, 2024-09-12T18:36:22.223 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": ".mgr", 2024-09-12T18:36:22.223 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:12.418430+0000", 2024-09-12T18:36:22.223 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-12T18:36:22.223 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-09-12T18:36:22.223 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:36:22.223 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:36:22.223 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:36:22.223 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:36:22.223 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:36:22.223 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:36:22.224 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:36:22.224 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:36:22.224 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:36:22.224 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:36:22.224 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:36:22.224 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 1, 2024-09-12T18:36:22.224 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 1, 2024-09-12T18:36:22.224 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 1, 2024-09-12T18:36:22.224 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 1, 2024-09-12T18:36:22.224 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 1, 2024-09-12T18:36:22.224 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:36:22.224 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:36:22.224 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:36:22.225 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:36:22.225 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:36:22.225 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:36:22.225 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:36:22.225 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.225 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "11", 2024-09-12T18:36:22.225 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:36:22.225 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:36:22.225 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:36:22.225 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:36:22.225 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:36:22.226 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-09-12T18:36:22.226 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-09-12T18:36:22.226 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:36:22.226 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:36:22.226 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:36:22.226 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:36:22.226 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:36:22.226 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:36:22.226 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:36:22.227 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:36:22.227 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:36:22.227 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:36:22.227 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:36:22.227 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:36:22.227 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:36:22.227 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:36:22.227 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:36:22.227 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:36:22.227 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:36:22.227 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:36:22.227 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:36:22.228 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.228 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:36:22.228 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:36:22.228 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:36:22.228 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:36:22.228 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:36:22.228 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:36:22.228 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:36:22.228 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:36:22.228 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:36:22.228 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:36:22.228 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:36:22.228 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-09-12T18:36:22.229 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_max": 32, 2024-09-12T18:36:22.229 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 1 2024-09-12T18:36:22.229 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.229 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:36:22.229 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": {} 2024-09-12T18:36:22.229 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.229 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:36:22.229 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:36:22.229 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 2.9900000095367432, 2024-09-12T18:36:22.229 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 2.9900000095367432, 2024-09-12T18:36:22.229 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 0.67000001668930054, 2024-09-12T18:36:22.229 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 2, 2024-09-12T18:36:22.230 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 2, 2024-09-12T18:36:22.230 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:36:22.230 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:36:22.230 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:36:22.230 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:22.230 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.230 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:22.230 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 2, 2024-09-12T18:36:22.230 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "rbd", 2024-09-12T18:36:22.230 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:18.665309+0000", 2024-09-12T18:36:22.230 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 8193, 2024-09-12T18:36:22.230 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T18:36:22.230 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:36:22.231 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:36:22.231 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:36:22.231 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:36:22.231 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:36:22.231 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:36:22.231 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:36:22.231 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:36:22.231 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:36:22.231 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:36:22.231 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:36:22.231 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 8, 2024-09-12T18:36:22.232 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 8, 2024-09-12T18:36:22.232 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 8, 2024-09-12T18:36:22.232 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 8, 2024-09-12T18:36:22.232 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 8, 2024-09-12T18:36:22.232 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:36:22.232 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:36:22.232 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:36:22.232 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:36:22.232 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:36:22.233 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:36:22.233 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:36:22.233 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.233 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "15", 2024-09-12T18:36:22.233 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:36:22.233 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:36:22.233 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:36:22.233 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:36:22.233 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:36:22.233 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 2, 2024-09-12T18:36:22.233 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 15, 2024-09-12T18:36:22.233 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:36:22.233 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:36:22.234 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:36:22.234 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:36:22.234 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:36:22.234 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:36:22.234 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:36:22.234 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:36:22.234 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:36:22.234 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:36:22.234 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:36:22.234 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:36:22.234 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:36:22.234 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:36:22.234 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:36:22.235 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:36:22.235 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:36:22.235 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:36:22.235 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:36:22.235 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.235 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:36:22.235 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:36:22.235 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:36:22.235 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:36:22.235 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:36:22.235 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:36:22.235 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:36:22.235 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:36:22.236 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:36:22.236 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:36:22.236 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:36:22.236 INFO:teuthology.orchestra.run.smithi073.stdout: "options": {}, 2024-09-12T18:36:22.236 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:36:22.236 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd": {} 2024-09-12T18:36:22.236 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.236 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:36:22.236 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:36:22.236 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.5, 2024-09-12T18:36:22.236 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.5, 2024-09-12T18:36:22.236 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-09-12T18:36:22.237 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.5, 2024-09-12T18:36:22.237 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.5, 2024-09-12T18:36:22.237 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:36:22.237 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:36:22.237 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:36:22.237 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:22.237 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.237 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:22.237 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 3, 2024-09-12T18:36:22.237 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "cephfs_metadata", 2024-09-12T18:36:22.237 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:23.447845+0000", 2024-09-12T18:36:22.237 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-12T18:36:22.237 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-09-12T18:36:22.238 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:36:22.238 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:36:22.238 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:36:22.238 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:36:22.238 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:36:22.238 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:36:22.238 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:36:22.238 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:36:22.238 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:36:22.238 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:36:22.238 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:36:22.238 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 32, 2024-09-12T18:36:22.238 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 32, 2024-09-12T18:36:22.238 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 32, 2024-09-12T18:36:22.239 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 32, 2024-09-12T18:36:22.239 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 32, 2024-09-12T18:36:22.239 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:36:22.239 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:36:22.239 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:36:22.239 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:36:22.239 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:36:22.239 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:36:22.239 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:36:22.239 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.239 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "18", 2024-09-12T18:36:22.240 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:36:22.240 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:36:22.240 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:36:22.240 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:36:22.240 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:36:22.240 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-09-12T18:36:22.240 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-09-12T18:36:22.240 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:36:22.240 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:36:22.240 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:36:22.240 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:36:22.240 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:36:22.240 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:36:22.241 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:36:22.241 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:36:22.241 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:36:22.241 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:36:22.241 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:36:22.241 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:36:22.241 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:36:22.241 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:36:22.241 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:36:22.241 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:36:22.241 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:36:22.241 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:36:22.241 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:36:22.242 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.242 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:36:22.242 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:36:22.242 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:36:22.242 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:36:22.242 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:36:22.242 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:36:22.242 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:36:22.242 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:36:22.242 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:36:22.242 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:36:22.242 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:36:22.242 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-09-12T18:36:22.243 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_bias": 4, 2024-09-12T18:36:22.243 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 16, 2024-09-12T18:36:22.243 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_priority": 5 2024-09-12T18:36:22.243 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.243 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:36:22.243 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs": { 2024-09-12T18:36:22.243 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": "cephfs" 2024-09-12T18:36:22.243 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:22.243 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.243 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:36:22.243 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:36:22.243 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.1299999952316284, 2024-09-12T18:36:22.243 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.1299999952316284, 2024-09-12T18:36:22.244 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-09-12T18:36:22.244 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T18:36:22.244 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T18:36:22.244 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:36:22.244 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:36:22.244 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:36:22.244 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:22.244 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.244 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:22.244 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 4, 2024-09-12T18:36:22.244 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "cephfs_data", 2024-09-12T18:36:22.244 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:23.959973+0000", 2024-09-12T18:36:22.244 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-12T18:36:22.245 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-09-12T18:36:22.245 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:36:22.245 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:36:22.245 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:36:22.245 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:36:22.245 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:36:22.245 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:36:22.245 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:36:22.245 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:36:22.245 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:36:22.245 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:36:22.245 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:36:22.245 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 64, 2024-09-12T18:36:22.246 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 64, 2024-09-12T18:36:22.246 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 64, 2024-09-12T18:36:22.246 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 64, 2024-09-12T18:36:22.246 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 64, 2024-09-12T18:36:22.246 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:36:22.246 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:36:22.246 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:36:22.246 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:36:22.246 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:36:22.246 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:36:22.246 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:36:22.246 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.246 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "19", 2024-09-12T18:36:22.247 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:36:22.247 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:36:22.247 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:36:22.247 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:36:22.247 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:36:22.247 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-09-12T18:36:22.247 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-09-12T18:36:22.247 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:36:22.247 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:36:22.247 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:36:22.247 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:36:22.247 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:36:22.247 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:36:22.248 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:36:22.248 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:36:22.248 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:36:22.248 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:36:22.248 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:36:22.248 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:36:22.248 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:36:22.248 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:36:22.248 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:36:22.248 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:36:22.248 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:36:22.248 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:36:22.249 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:36:22.249 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.249 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:36:22.249 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:36:22.249 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:36:22.249 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:36:22.249 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:36:22.249 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:36:22.249 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:36:22.249 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:36:22.249 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:36:22.249 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:36:22.249 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:36:22.250 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-09-12T18:36:22.250 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 64, 2024-09-12T18:36:22.250 INFO:teuthology.orchestra.run.smithi073.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T18:36:22.250 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.250 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:36:22.250 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs": { 2024-09-12T18:36:22.250 INFO:teuthology.orchestra.run.smithi073.stdout: "data": "cephfs" 2024-09-12T18:36:22.250 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:22.250 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.250 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:36:22.250 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:36:22.250 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.1299999952316284, 2024-09-12T18:36:22.251 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.1299999952316284, 2024-09-12T18:36:22.251 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-09-12T18:36:22.251 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T18:36:22.251 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T18:36:22.251 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:36:22.251 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:36:22.251 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:36:22.251 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:22.251 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.251 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:22.251 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 5, 2024-09-12T18:36:22.251 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "unique_pool_0", 2024-09-12T18:36:22.252 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:43.562347+0000", 2024-09-12T18:36:22.252 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-12T18:36:22.252 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-09-12T18:36:22.252 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:36:22.252 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:36:22.252 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:36:22.252 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:36:22.252 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:36:22.252 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:36:22.252 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:36:22.252 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:36:22.252 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:36:22.252 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:36:22.252 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:36:22.253 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 16, 2024-09-12T18:36:22.253 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 16, 2024-09-12T18:36:22.253 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 16, 2024-09-12T18:36:22.253 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 16, 2024-09-12T18:36:22.253 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 16, 2024-09-12T18:36:22.253 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:36:22.253 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:36:22.253 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:36:22.253 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:36:22.253 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:36:22.253 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:36:22.253 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:36:22.254 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.254 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "23", 2024-09-12T18:36:22.254 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:36:22.254 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:36:22.254 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:36:22.254 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:36:22.254 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:36:22.254 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-09-12T18:36:22.254 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-09-12T18:36:22.254 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:36:22.254 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:36:22.254 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:36:22.254 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:36:22.254 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:36:22.255 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:36:22.255 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:36:22.255 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:36:22.255 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:36:22.255 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:36:22.255 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:36:22.255 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:36:22.255 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:36:22.255 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:36:22.255 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:36:22.255 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:36:22.255 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:36:22.255 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:36:22.256 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:36:22.256 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.256 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:36:22.256 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:36:22.256 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:36:22.256 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:36:22.256 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:36:22.256 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:36:22.256 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:36:22.256 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:36:22.256 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:36:22.256 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:36:22.256 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:36:22.257 INFO:teuthology.orchestra.run.smithi073.stdout: "options": {}, 2024-09-12T18:36:22.257 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:36:22.257 INFO:teuthology.orchestra.run.smithi073.stdout: "rados": {} 2024-09-12T18:36:22.257 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.257 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:36:22.257 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:36:22.257 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.1299999952316284, 2024-09-12T18:36:22.257 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.1299999952316284, 2024-09-12T18:36:22.257 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-09-12T18:36:22.257 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T18:36:22.257 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T18:36:22.257 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:36:22.258 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:36:22.258 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:36:22.258 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:22.258 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:22.258 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T18:36:22.258 INFO:teuthology.orchestra.run.smithi073.stdout: "osds": [ 2024-09-12T18:36:22.258 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:22.258 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-09-12T18:36:22.258 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "f1cf24e8-6179-4666-a444-fa81ef0d7482", 2024-09-12T18:36:22.258 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-09-12T18:36:22.258 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-09-12T18:36:22.258 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-09-12T18:36:22.258 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-09-12T18:36:22.258 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-09-12T18:36:22.259 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-09-12T18:36:22.259 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-09-12T18:36:22.259 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 21, 2024-09-12T18:36:22.259 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-09-12T18:36:22.259 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-09-12T18:36:22.259 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-12T18:36:22.259 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:22.259 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:22.259 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:22.259 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6800", 2024-09-12T18:36:22.259 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:36:22.259 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.259 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:22.260 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:22.260 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6801", 2024-09-12T18:36:22.260 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:36:22.260 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:22.260 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:22.260 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.260 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-09-12T18:36:22.260 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:22.260 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:22.260 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:22.260 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6802", 2024-09-12T18:36:22.260 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:36:22.261 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.261 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:22.261 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:22.261 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6803", 2024-09-12T18:36:22.261 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:36:22.261 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:22.261 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:22.261 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.261 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-09-12T18:36:22.261 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:22.261 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:22.261 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:22.262 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6806", 2024-09-12T18:36:22.262 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:36:22.262 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.262 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:22.262 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:22.262 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6807", 2024-09-12T18:36:22.262 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:36:22.262 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:22.262 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:22.262 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.262 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-09-12T18:36:22.262 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:22.263 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:22.263 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:22.263 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6804", 2024-09-12T18:36:22.263 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:36:22.263 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.263 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:22.263 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:22.263 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6805", 2024-09-12T18:36:22.263 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:36:22.263 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:22.263 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:22.263 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.264 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.114:6801/2710632206", 2024-09-12T18:36:22.264 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.114:6803/2710632206", 2024-09-12T18:36:22.264 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.114:6807/2710632206", 2024-09-12T18:36:22.264 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.114:6805/2710632206", 2024-09-12T18:36:22.264 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-09-12T18:36:22.264 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-09-12T18:36:22.264 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-09-12T18:36:22.264 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:22.264 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.264 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:22.264 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-09-12T18:36:22.264 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "3fdb0044-2820-4411-978b-4b6e94fbf0b1", 2024-09-12T18:36:22.265 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-09-12T18:36:22.265 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-09-12T18:36:22.265 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-09-12T18:36:22.265 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-09-12T18:36:22.265 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-09-12T18:36:22.265 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-09-12T18:36:22.265 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 9, 2024-09-12T18:36:22.265 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 21, 2024-09-12T18:36:22.265 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-09-12T18:36:22.265 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-09-12T18:36:22.265 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-12T18:36:22.265 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:22.266 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:22.266 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:22.266 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6800", 2024-09-12T18:36:22.266 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:36:22.266 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.266 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:22.266 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:22.266 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6801", 2024-09-12T18:36:22.266 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:36:22.266 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:22.266 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:22.266 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.266 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-09-12T18:36:22.267 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:22.267 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:22.267 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:22.267 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6802", 2024-09-12T18:36:22.267 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:36:22.267 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.267 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:22.267 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:22.267 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6803", 2024-09-12T18:36:22.268 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:36:22.268 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:22.268 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:22.268 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.268 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-09-12T18:36:22.268 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:22.268 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:22.268 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:22.268 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6806", 2024-09-12T18:36:22.268 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:36:22.268 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.268 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:22.269 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:22.269 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6807", 2024-09-12T18:36:22.269 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:36:22.269 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:22.269 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:22.269 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.269 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-09-12T18:36:22.269 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:22.269 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:22.269 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:22.269 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6804", 2024-09-12T18:36:22.269 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:36:22.269 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.270 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:22.270 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:22.270 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6805", 2024-09-12T18:36:22.270 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:36:22.270 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:22.270 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:22.270 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.270 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.143:6801/862189968", 2024-09-12T18:36:22.270 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.143:6803/862189968", 2024-09-12T18:36:22.270 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.143:6807/862189968", 2024-09-12T18:36:22.270 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.143:6805/862189968", 2024-09-12T18:36:22.271 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-09-12T18:36:22.271 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-09-12T18:36:22.271 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-09-12T18:36:22.271 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:22.271 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.271 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:22.271 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2024-09-12T18:36:22.271 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "6fb554da-561f-4aa2-b855-0e3adb98b057", 2024-09-12T18:36:22.271 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-09-12T18:36:22.272 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-09-12T18:36:22.272 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-09-12T18:36:22.272 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-09-12T18:36:22.272 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-09-12T18:36:22.272 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-09-12T18:36:22.272 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-09-12T18:36:22.272 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 21, 2024-09-12T18:36:22.272 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-09-12T18:36:22.272 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-09-12T18:36:22.272 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-12T18:36:22.272 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:22.272 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:22.273 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:22.273 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6800", 2024-09-12T18:36:22.273 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:36:22.273 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.273 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:22.273 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:22.273 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6801", 2024-09-12T18:36:22.273 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:36:22.273 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:22.273 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:22.273 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.273 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-09-12T18:36:22.273 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:22.274 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:22.274 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:22.274 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6802", 2024-09-12T18:36:22.274 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:36:22.274 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.274 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:22.274 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:22.274 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6803", 2024-09-12T18:36:22.274 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:36:22.274 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:22.274 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:22.274 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.274 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-09-12T18:36:22.275 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:22.275 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:22.275 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:22.275 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6806", 2024-09-12T18:36:22.275 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:36:22.275 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.275 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:22.275 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:22.275 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6807", 2024-09-12T18:36:22.275 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:36:22.275 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:22.275 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:22.276 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.276 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-09-12T18:36:22.276 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:22.276 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:22.276 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:22.276 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6804", 2024-09-12T18:36:22.276 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:36:22.276 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.276 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:22.276 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:22.276 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6805", 2024-09-12T18:36:22.276 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:36:22.276 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:22.277 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:22.277 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.277 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.162:6801/1397104153", 2024-09-12T18:36:22.277 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.162:6803/1397104153", 2024-09-12T18:36:22.277 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.162:6807/1397104153", 2024-09-12T18:36:22.277 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.162:6805/1397104153", 2024-09-12T18:36:22.277 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-09-12T18:36:22.277 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-09-12T18:36:22.277 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-09-12T18:36:22.277 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:22.277 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:22.277 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T18:36:22.278 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_xinfo": [ 2024-09-12T18:36:22.278 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:22.278 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-09-12T18:36:22.278 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-09-12T18:36:22.278 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-09-12T18:36:22.278 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-09-12T18:36:22.278 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540719139924082687, 2024-09-12T18:36:22.278 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-09-12T18:36:22.278 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-09-12T18:35:10.239320+0000", 2024-09-12T18:36:22.278 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-09-12T18:36:22.278 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.278 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:22.279 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-09-12T18:36:22.279 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-09-12T18:36:22.279 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-09-12T18:36:22.279 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-09-12T18:36:22.279 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540719139924082687, 2024-09-12T18:36:22.279 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-09-12T18:36:22.279 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-09-12T18:35:10.861760+0000", 2024-09-12T18:36:22.279 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-09-12T18:36:22.279 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.279 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:22.279 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2024-09-12T18:36:22.279 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-09-12T18:36:22.280 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-09-12T18:36:22.280 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-09-12T18:36:22.280 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540719139924082687, 2024-09-12T18:36:22.280 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-09-12T18:36:22.280 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-09-12T18:35:10.355997+0000", 2024-09-12T18:36:22.280 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-09-12T18:36:22.280 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:22.280 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T18:36:22.280 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap": [], 2024-09-12T18:36:22.280 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap_items": [], 2024-09-12T18:36:22.280 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap_primaries": [], 2024-09-12T18:36:22.280 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_temp": [], 2024-09-12T18:36:22.281 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_temp": [], 2024-09-12T18:36:22.281 INFO:teuthology.orchestra.run.smithi073.stdout: "blocklist": {}, 2024-09-12T18:36:22.281 INFO:teuthology.orchestra.run.smithi073.stdout: "range_blocklist": {}, 2024-09-12T18:36:22.281 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profiles": { 2024-09-12T18:36:22.281 INFO:teuthology.orchestra.run.smithi073.stdout: "default": { 2024-09-12T18:36:22.281 INFO:teuthology.orchestra.run.smithi073.stdout: "crush-failure-domain": "osd", 2024-09-12T18:36:22.281 INFO:teuthology.orchestra.run.smithi073.stdout: "k": "2", 2024-09-12T18:36:22.281 INFO:teuthology.orchestra.run.smithi073.stdout: "m": "1", 2024-09-12T18:36:22.282 INFO:teuthology.orchestra.run.smithi073.stdout: "plugin": "jerasure", 2024-09-12T18:36:22.282 INFO:teuthology.orchestra.run.smithi073.stdout: "technique": "reed_sol_van" 2024-09-12T18:36:22.282 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:22.282 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:22.282 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps_queue": [], 2024-09-12T18:36:22.282 INFO:teuthology.orchestra.run.smithi073.stdout: "new_removed_snaps": [], 2024-09-12T18:36:22.282 INFO:teuthology.orchestra.run.smithi073.stdout: "new_purged_snaps": [], 2024-09-12T18:36:22.282 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_node_flags": {}, 2024-09-12T18:36:22.282 INFO:teuthology.orchestra.run.smithi073.stdout: "device_class_flags": {}, 2024-09-12T18:36:22.282 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": { 2024-09-12T18:36:22.282 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode_enabled": false, 2024-09-12T18:36:22.282 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_bucket_count": 0, 2024-09-12T18:36:22.282 INFO:teuthology.orchestra.run.smithi073.stdout: "degraded_stretch_mode": 0, 2024-09-12T18:36:22.283 INFO:teuthology.orchestra.run.smithi073.stdout: "recovering_stretch_mode": 0, 2024-09-12T18:36:22.283 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode_bucket": 0 2024-09-12T18:36:22.283 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:22.283 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T18:36:22.285 INFO:tasks.thrashosds.thrasher:j is {'epoch': 40, 'fsid': 'c08d5a84-711b-44bf-bdf1-e06ecc2c7c00', 'created': '2024-09-12T18:35:02.695853+0000', 'modified': '2024-09-12T18:36:21.473587+0000', 'last_up_change': '2024-09-12T18:35:12.464628+0000', 'last_in_change': '2024-09-12T18:35:04.352525+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T18:35:12.418430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-12T18:35:18.665309+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 15, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T18:35:23.447845+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T18:35:23.959973+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2024-09-12T18:35:43.562347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'f1cf24e8-6179-4666-a444-fa81ef0d7482', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6800', 'nonce': 2710632206}, {'type': 'v1', 'addr': '172.21.15.114:6801', 'nonce': 2710632206}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6802', 'nonce': 2710632206}, {'type': 'v1', 'addr': '172.21.15.114:6803', 'nonce': 2710632206}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6806', 'nonce': 2710632206}, {'type': 'v1', 'addr': '172.21.15.114:6807', 'nonce': 2710632206}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6804', 'nonce': 2710632206}, {'type': 'v1', 'addr': '172.21.15.114:6805', 'nonce': 2710632206}]}, 'public_addr': '172.21.15.114:6801/2710632206', 'cluster_addr': '172.21.15.114:6803/2710632206', 'heartbeat_back_addr': '172.21.15.114:6807/2710632206', 'heartbeat_front_addr': '172.21.15.114:6805/2710632206', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '3fdb0044-2820-4411-978b-4b6e94fbf0b1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 9, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6800', 'nonce': 862189968}, {'type': 'v1', 'addr': '172.21.15.143:6801', 'nonce': 862189968}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6802', 'nonce': 862189968}, {'type': 'v1', 'addr': '172.21.15.143:6803', 'nonce': 862189968}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6806', 'nonce': 862189968}, {'type': 'v1', 'addr': '172.21.15.143:6807', 'nonce': 862189968}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6804', 'nonce': 862189968}, {'type': 'v1', 'addr': '172.21.15.143:6805', 'nonce': 862189968}]}, 'public_addr': '172.21.15.143:6801/862189968', 'cluster_addr': '172.21.15.143:6803/862189968', 'heartbeat_back_addr': '172.21.15.143:6807/862189968', 'heartbeat_front_addr': '172.21.15.143:6805/862189968', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '6fb554da-561f-4aa2-b855-0e3adb98b057', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6800', 'nonce': 1397104153}, {'type': 'v1', 'addr': '172.21.15.162:6801', 'nonce': 1397104153}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6802', 'nonce': 1397104153}, {'type': 'v1', 'addr': '172.21.15.162:6803', 'nonce': 1397104153}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6806', 'nonce': 1397104153}, {'type': 'v1', 'addr': '172.21.15.162:6807', 'nonce': 1397104153}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6804', 'nonce': 1397104153}, {'type': 'v1', 'addr': '172.21.15.162:6805', 'nonce': 1397104153}]}, 'public_addr': '172.21.15.162:6801/1397104153', 'cluster_addr': '172.21.15.162:6803/1397104153', 'heartbeat_back_addr': '172.21.15.162:6807/1397104153', 'heartbeat_front_addr': '172.21.15.162:6805/1397104153', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:35:10.239320+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:35:10.861760+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:35:10.355997+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T18:36:22.286 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-12T18:36:22.286 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:22.286 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:36:22.286 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.286 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:88585 5.8 e40/21 5:1f302dbc:::benchmark_data_smithi073_23739_object88584:head v 40'5404, mlcod=40'5402)", 2024-09-12T18:36:22.286 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:22.256063+0000", 2024-09-12T18:36:22.286 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0037917519999999998, 2024-09-12T18:36:22.286 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0038077010000000001, 2024-09-12T18:36:22.286 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:22.286 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:22.287 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:22.287 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:22.287 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.287 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:22.287 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.256063+0000", 2024-09-12T18:36:22.287 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.287 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.287 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.287 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:22.287 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.256063+0000", 2024-09-12T18:36:22.287 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.287 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.287 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.288 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:22.288 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.256064+0000", 2024-09-12T18:36:22.288 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.75e-07 2024-09-12T18:36:22.288 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.288 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.288 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:22.288 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.256095+0000", 2024-09-12T18:36:22.288 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.0719999999999997e-05 2024-09-12T18:36:22.288 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.288 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.288 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:22.288 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.256102+0000", 2024-09-12T18:36:22.289 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6059999999999997e-06 2024-09-12T18:36:22.289 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.289 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.289 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.289 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.256108+0000", 2024-09-12T18:36:22.289 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6330000000000001e-06 2024-09-12T18:36:22.289 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.289 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.289 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.289 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.256273+0000", 2024-09-12T18:36:22.289 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00016527999999999999 2024-09-12T18:36:22.289 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.290 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.290 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:22.290 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.256290+0000", 2024-09-12T18:36:22.290 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6528000000000002e-05 2024-09-12T18:36:22.290 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.290 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:22.290 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.290 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.290 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.290 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:88576 5.0 e40/21 5:0c3971f8:::benchmark_data_smithi073_23739_object88575:head v 40'5648, mlcod=40'5644)", 2024-09-12T18:36:22.290 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:22.256266+0000", 2024-09-12T18:36:22.290 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0035886329999999999, 2024-09-12T18:36:22.290 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.003635568, 2024-09-12T18:36:22.290 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:22.291 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:22.291 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:22.291 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:22.291 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.291 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:22.291 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.256266+0000", 2024-09-12T18:36:22.291 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.291 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.291 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.291 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:22.291 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.256266+0000", 2024-09-12T18:36:22.291 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.291 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.291 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.292 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:22.292 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.256267+0000", 2024-09-12T18:36:22.292 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2499999999999995e-07 2024-09-12T18:36:22.292 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.292 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.292 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:22.292 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.256381+0000", 2024-09-12T18:36:22.292 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000113946 2024-09-12T18:36:22.292 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.292 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.292 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:22.292 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.256399+0000", 2024-09-12T18:36:22.293 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8332999999999999e-05 2024-09-12T18:36:22.293 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.293 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.293 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.293 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.256406+0000", 2024-09-12T18:36:22.293 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8369999999999999e-06 2024-09-12T18:36:22.293 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.293 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.293 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.293 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.257713+0000", 2024-09-12T18:36:22.293 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0013068159999999999 2024-09-12T18:36:22.293 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.293 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.293 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:22.294 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.257729+0000", 2024-09-12T18:36:22.294 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6246e-05 2024-09-12T18:36:22.294 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.294 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:22.294 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.294 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.294 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.294 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:88588 5.6 5:677b68d4:::benchmark_data_smithi073_23739_object88587:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:36:22.294 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:22.256302+0000", 2024-09-12T18:36:22.294 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0035533510000000002, 2024-09-12T18:36:22.294 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0036314989999999998, 2024-09-12T18:36:22.294 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:22.294 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:22.295 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:22.295 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:22.295 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:22.295 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:22.295 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 88588 2024-09-12T18:36:22.295 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.295 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:22.295 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.295 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:22.295 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.256302+0000", 2024-09-12T18:36:22.295 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.295 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.295 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.295 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:22.296 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.256302+0000", 2024-09-12T18:36:22.296 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.296 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.296 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.296 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:22.296 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.256303+0000", 2024-09-12T18:36:22.296 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.7900000000000007e-07 2024-09-12T18:36:22.296 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.296 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.296 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:22.296 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.256421+0000", 2024-09-12T18:36:22.296 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000118651 2024-09-12T18:36:22.296 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.297 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.297 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:22.297 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.256432+0000", 2024-09-12T18:36:22.297 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0297e-05 2024-09-12T18:36:22.297 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.297 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.297 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.297 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.256456+0000", 2024-09-12T18:36:22.297 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4848e-05 2024-09-12T18:36:22.297 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.297 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.297 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.297 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.256508+0000", 2024-09-12T18:36:22.297 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1561000000000003e-05 2024-09-12T18:36:22.298 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.298 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.298 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:22.298 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.256637+0000", 2024-09-12T18:36:22.298 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012932800000000001 2024-09-12T18:36:22.298 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.298 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.298 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:22.298 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.256758+0000", 2024-09-12T18:36:22.298 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000120827 2024-09-12T18:36:22.298 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.298 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:22.298 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.299 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.299 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.299 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:88589 5.6 5.69eb8ad6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:36:22.299 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:22.256475+0000", 2024-09-12T18:36:22.299 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0033805509999999999, 2024-09-12T18:36:22.299 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0034914130000000001, 2024-09-12T18:36:22.299 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:22.299 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:22.299 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:22.299 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:22.299 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:22.299 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:22.299 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 88589 2024-09-12T18:36:22.299 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.300 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:22.300 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.300 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:22.300 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.256475+0000", 2024-09-12T18:36:22.300 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.300 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.300 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.300 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:22.300 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.256475+0000", 2024-09-12T18:36:22.300 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.300 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.300 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.300 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:22.301 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.256475+0000", 2024-09-12T18:36:22.301 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.06e-07 2024-09-12T18:36:22.301 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.301 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.301 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:22.301 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.256508+0000", 2024-09-12T18:36:22.301 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.2592000000000002e-05 2024-09-12T18:36:22.301 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.301 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.301 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:22.301 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.256515+0000", 2024-09-12T18:36:22.301 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6510000000000001e-06 2024-09-12T18:36:22.302 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.302 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.302 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.302 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.256521+0000", 2024-09-12T18:36:22.302 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5570000000000003e-06 2024-09-12T18:36:22.302 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.302 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:22.302 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.302 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.302 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.302 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:88590 5.2 e40/21 5:435ef6b7:::benchmark_data_smithi073_23739_object88589:head v 40'5505, mlcod=40'5503)", 2024-09-12T18:36:22.302 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:22.257111+0000", 2024-09-12T18:36:22.302 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0027443120000000001, 2024-09-12T18:36:22.302 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.002880624, 2024-09-12T18:36:22.303 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:22.303 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:22.303 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:22.303 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:22.303 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.303 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:22.303 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.257111+0000", 2024-09-12T18:36:22.303 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.303 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.303 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.303 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:22.303 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.257111+0000", 2024-09-12T18:36:22.303 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.304 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.304 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.304 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:22.304 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.257112+0000", 2024-09-12T18:36:22.304 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3799999999999996e-07 2024-09-12T18:36:22.304 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.304 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.304 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:22.304 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.257184+0000", 2024-09-12T18:36:22.304 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.2602999999999996e-05 2024-09-12T18:36:22.304 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.304 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.304 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:22.305 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.257195+0000", 2024-09-12T18:36:22.305 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0625000000000001e-05 2024-09-12T18:36:22.305 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.305 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.305 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.305 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.257201+0000", 2024-09-12T18:36:22.305 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.754e-06 2024-09-12T18:36:22.305 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.305 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.305 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.305 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.257244+0000", 2024-09-12T18:36:22.305 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2531000000000003e-05 2024-09-12T18:36:22.305 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.305 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.306 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:22.306 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.257261+0000", 2024-09-12T18:36:22.306 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6884e-05 2024-09-12T18:36:22.306 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.306 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:22.306 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.306 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.306 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.306 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:88584 5.c e40/21)", 2024-09-12T18:36:22.306 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:22.258698+0000", 2024-09-12T18:36:22.306 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.001157244, 2024-09-12T18:36:22.306 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00131718, 2024-09-12T18:36:22.307 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:22.307 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:22.307 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:22.307 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:22.307 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.307 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:22.307 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.258698+0000", 2024-09-12T18:36:22.307 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.307 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.307 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.307 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:22.307 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.258698+0000", 2024-09-12T18:36:22.308 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.308 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.308 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.308 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:22.308 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.258699+0000", 2024-09-12T18:36:22.308 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.2500000000000005e-07 2024-09-12T18:36:22.308 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.308 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.308 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:22.308 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.258703+0000", 2024-09-12T18:36:22.308 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0640000000000004e-06 2024-09-12T18:36:22.309 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.309 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.309 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:22.309 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.258715+0000", 2024-09-12T18:36:22.309 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2343e-05 2024-09-12T18:36:22.309 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.309 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.309 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.309 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.258722+0000", 2024-09-12T18:36:22.309 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.9410000000000001e-06 2024-09-12T18:36:22.309 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.309 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:22.309 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.310 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.310 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.310 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:88591 5.3 5:cd8430f9:::benchmark_data_smithi073_23739_object88590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:36:22.310 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:22.258972+0000", 2024-09-12T18:36:22.310 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00088336000000000003, 2024-09-12T18:36:22.310 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0010664450000000001, 2024-09-12T18:36:22.310 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:22.310 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:22.310 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:22.310 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:22.310 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:22.310 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:22.311 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 88591 2024-09-12T18:36:22.311 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.311 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:22.311 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.311 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:22.311 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.258972+0000", 2024-09-12T18:36:22.311 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.311 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.311 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.311 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:22.311 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.258972+0000", 2024-09-12T18:36:22.311 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.311 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.312 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.312 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:22.312 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.258973+0000", 2024-09-12T18:36:22.312 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.6099999999999999e-07 2024-09-12T18:36:22.312 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.312 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.312 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:22.312 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.259095+0000", 2024-09-12T18:36:22.312 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012191199999999999 2024-09-12T18:36:22.312 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.312 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.313 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:22.313 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.259104+0000", 2024-09-12T18:36:22.313 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.3740000000000004e-06 2024-09-12T18:36:22.313 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.313 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.313 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.313 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.259109+0000", 2024-09-12T18:36:22.313 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9300000000000002e-06 2024-09-12T18:36:22.313 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.313 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.313 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.313 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.259159+0000", 2024-09-12T18:36:22.313 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0392000000000001e-05 2024-09-12T18:36:22.314 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.314 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.314 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:22.314 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.259306+0000", 2024-09-12T18:36:22.314 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014714400000000001 2024-09-12T18:36:22.314 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.314 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.314 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:22.314 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.259464+0000", 2024-09-12T18:36:22.314 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015714400000000001 2024-09-12T18:36:22.314 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.314 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:22.315 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.315 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.315 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.315 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:88572 5.3 5:c7fa41e3:::benchmark_data_smithi073_23739_object88571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:36:22.315 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:22.248141+0000", 2024-09-12T18:36:22.315 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.011714272, 2024-09-12T18:36:22.315 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011940633000000001, 2024-09-12T18:36:22.315 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:22.315 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:22.315 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:22.315 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:22.315 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:22.316 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:22.316 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 88572 2024-09-12T18:36:22.316 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.316 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:22.316 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.316 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:22.316 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.248141+0000", 2024-09-12T18:36:22.316 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.316 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.316 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.316 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:22.316 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.248141+0000", 2024-09-12T18:36:22.316 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.316 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.317 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.317 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:22.317 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.248142+0000", 2024-09-12T18:36:22.317 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.175e-06 2024-09-12T18:36:22.317 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.317 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.317 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:22.317 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.248275+0000", 2024-09-12T18:36:22.317 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000133165 2024-09-12T18:36:22.317 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.317 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.317 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:22.318 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.248288+0000", 2024-09-12T18:36:22.318 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2556e-05 2024-09-12T18:36:22.318 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.318 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.318 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.318 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.248293+0000", 2024-09-12T18:36:22.318 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1240000000000004e-06 2024-09-12T18:36:22.318 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.318 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.318 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.318 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.248332+0000", 2024-09-12T18:36:22.318 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8782000000000002e-05 2024-09-12T18:36:22.318 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.319 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.319 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:22.319 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.248475+0000", 2024-09-12T18:36:22.319 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000143356 2024-09-12T18:36:22.319 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.319 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.319 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:22.319 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.248561+0000", 2024-09-12T18:36:22.319 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5698000000000005e-05 2024-09-12T18:36:22.319 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.319 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.320 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:22.320 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.251665+0000", 2024-09-12T18:36:22.320 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0031039190000000001 2024-09-12T18:36:22.320 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.320 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:22.320 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.320 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.320 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.320 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:88575 5.4 e40/21 5:210cc074:::benchmark_data_smithi073_23739_object88574:head v 40'5448, mlcod=40'5446)", 2024-09-12T18:36:22.320 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:22.250669+0000", 2024-09-12T18:36:22.320 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0091860729999999995, 2024-09-12T18:36:22.320 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0094803179999999997, 2024-09-12T18:36:22.321 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:22.321 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:22.321 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:22.321 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:22.321 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.321 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:22.321 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.250669+0000", 2024-09-12T18:36:22.321 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.321 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.321 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.321 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:22.321 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.250669+0000", 2024-09-12T18:36:22.321 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.322 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.322 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.322 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:22.322 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.250670+0000", 2024-09-12T18:36:22.322 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2499999999999995e-07 2024-09-12T18:36:22.322 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.322 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.322 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:22.322 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.250703+0000", 2024-09-12T18:36:22.322 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3794000000000002e-05 2024-09-12T18:36:22.322 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.322 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.322 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:22.323 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.250711+0000", 2024-09-12T18:36:22.323 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0760000000000003e-06 2024-09-12T18:36:22.323 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.323 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.323 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.323 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.250717+0000", 2024-09-12T18:36:22.323 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1680000000000003e-06 2024-09-12T18:36:22.323 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.323 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.323 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.323 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.250776+0000", 2024-09-12T18:36:22.323 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9567000000000001e-05 2024-09-12T18:36:22.324 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.324 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.324 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:22.324 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.250791+0000", 2024-09-12T18:36:22.324 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4528999999999999e-05 2024-09-12T18:36:22.324 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.324 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:22.324 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.324 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.324 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.324 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:88566 5.0 e40/21 5:04fdf327:::benchmark_data_smithi073_23739_object88565:head v 40'5646, mlcod=40'5643)", 2024-09-12T18:36:22.324 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:22.250735+0000", 2024-09-12T18:36:22.324 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0091205000000000001, 2024-09-12T18:36:22.325 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0094605769999999995, 2024-09-12T18:36:22.325 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:22.325 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:22.325 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:22.325 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:22.328 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.328 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:22.328 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.250735+0000", 2024-09-12T18:36:22.328 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.329 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.329 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.329 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:22.329 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.250735+0000", 2024-09-12T18:36:22.329 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.329 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.329 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.329 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:22.329 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.250735+0000", 2024-09-12T18:36:22.329 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4999999999999999e-07 2024-09-12T18:36:22.329 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.329 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.330 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:22.330 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.250760+0000", 2024-09-12T18:36:22.330 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.5120999999999999e-05 2024-09-12T18:36:22.330 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.330 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.330 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:22.330 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.250768+0000", 2024-09-12T18:36:22.330 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5839999999999997e-06 2024-09-12T18:36:22.330 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.330 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.330 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.330 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.250772+0000", 2024-09-12T18:36:22.331 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8350000000000003e-06 2024-09-12T18:36:22.331 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.331 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.331 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.331 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.250816+0000", 2024-09-12T18:36:22.331 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.388e-05 2024-09-12T18:36:22.331 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.331 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.331 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:22.331 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.250835+0000", 2024-09-12T18:36:22.331 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8872000000000002e-05 2024-09-12T18:36:22.331 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.331 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:22.332 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.332 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.332 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.332 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:88577 5.e e40/21 5:7d636256:::benchmark_data_smithi073_23739_object88576:head v 40'5585, mlcod=40'5582)", 2024-09-12T18:36:22.332 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:22.252873+0000", 2024-09-12T18:36:22.332 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.006982037, 2024-09-12T18:36:22.333 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0073486539999999996, 2024-09-12T18:36:22.333 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:22.333 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:22.333 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:22.333 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:22.333 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.333 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:22.333 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.252873+0000", 2024-09-12T18:36:22.333 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.333 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.333 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.333 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:22.334 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.252873+0000", 2024-09-12T18:36:22.334 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.334 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.334 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.334 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:22.334 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.252874+0000", 2024-09-12T18:36:22.334 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3499999999999995e-07 2024-09-12T18:36:22.334 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.334 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.334 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:22.334 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.252915+0000", 2024-09-12T18:36:22.334 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0840000000000002e-05 2024-09-12T18:36:22.334 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.335 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.335 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:22.335 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.252922+0000", 2024-09-12T18:36:22.335 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6979999999999998e-06 2024-09-12T18:36:22.335 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.335 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.335 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.335 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.252927+0000", 2024-09-12T18:36:22.335 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.7280000000000003e-06 2024-09-12T18:36:22.335 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.335 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.336 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.336 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.252984+0000", 2024-09-12T18:36:22.336 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7033000000000001e-05 2024-09-12T18:36:22.336 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.336 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.336 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:22.336 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.253000+0000", 2024-09-12T18:36:22.336 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6201e-05 2024-09-12T18:36:22.336 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.336 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:22.336 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.337 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.337 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.337 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:88580 5.b e40/21 5:dc5eae02:::benchmark_data_smithi073_23739_object88579:head v 40'5662, mlcod=40'5658)", 2024-09-12T18:36:22.337 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:22.252941+0000", 2024-09-12T18:36:22.337 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0069141369999999999, 2024-09-12T18:36:22.337 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0073232949999999996, 2024-09-12T18:36:22.337 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:22.337 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:22.337 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:22.337 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:22.337 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.338 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:22.338 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.252941+0000", 2024-09-12T18:36:22.338 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.338 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.338 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.338 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:22.338 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.252941+0000", 2024-09-12T18:36:22.338 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.338 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.338 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.338 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:22.338 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.252941+0000", 2024-09-12T18:36:22.338 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7099999999999998e-07 2024-09-12T18:36:22.338 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.339 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.339 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:22.339 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.252965+0000", 2024-09-12T18:36:22.339 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4209000000000001e-05 2024-09-12T18:36:22.339 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.339 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.339 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:22.339 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.252970+0000", 2024-09-12T18:36:22.339 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.1699999999999999e-06 2024-09-12T18:36:22.339 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.339 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.339 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.339 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.252972+0000", 2024-09-12T18:36:22.340 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7999999999999999e-06 2024-09-12T18:36:22.340 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.340 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.340 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.340 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.253012+0000", 2024-09-12T18:36:22.340 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.9171999999999997e-05 2024-09-12T18:36:22.340 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.340 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.340 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:22.340 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.253030+0000", 2024-09-12T18:36:22.340 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8660000000000001e-05 2024-09-12T18:36:22.340 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.340 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:22.341 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.341 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.341 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.341 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:88571 5.0 e40/21 5:083ad557:::benchmark_data_smithi073_23739_object88570:head v 40'5647, mlcod=40'5643)", 2024-09-12T18:36:22.341 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:22.253410+0000", 2024-09-12T18:36:22.341 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.006445264, 2024-09-12T18:36:22.341 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0069035030000000001, 2024-09-12T18:36:22.341 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:22.341 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:22.341 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:22.341 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:22.341 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.341 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:22.342 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.253410+0000", 2024-09-12T18:36:22.342 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.342 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.342 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.342 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:22.342 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.253410+0000", 2024-09-12T18:36:22.342 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.342 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.342 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.342 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:22.342 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.253410+0000", 2024-09-12T18:36:22.342 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7999999999999995e-07 2024-09-12T18:36:22.342 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.343 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.343 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:22.343 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.253500+0000", 2024-09-12T18:36:22.343 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.9321999999999996e-05 2024-09-12T18:36:22.343 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.343 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.343 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:22.343 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.253509+0000", 2024-09-12T18:36:22.343 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1689999999999998e-06 2024-09-12T18:36:22.343 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.343 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.343 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.343 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.253513+0000", 2024-09-12T18:36:22.343 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5929999999999999e-06 2024-09-12T18:36:22.344 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.344 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.344 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.344 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.253557+0000", 2024-09-12T18:36:22.344 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3751000000000002e-05 2024-09-12T18:36:22.344 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.344 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.344 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:22.344 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.253569+0000", 2024-09-12T18:36:22.344 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1353e-05 2024-09-12T18:36:22.344 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.344 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:22.345 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.345 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.345 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.345 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:88584 5.c 5:3772a669:::benchmark_data_smithi073_23739_object88583:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:36:22.345 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:22.255048+0000", 2024-09-12T18:36:22.345 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0048073009999999999, 2024-09-12T18:36:22.345 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.005317581, 2024-09-12T18:36:22.345 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:22.345 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:22.345 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:22.345 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:22.345 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:22.345 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:22.346 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 88584 2024-09-12T18:36:22.346 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.346 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:22.346 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.346 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:22.346 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.255048+0000", 2024-09-12T18:36:22.346 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.346 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.346 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.346 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:22.346 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.255048+0000", 2024-09-12T18:36:22.346 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.346 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.347 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.347 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:22.347 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.255050+0000", 2024-09-12T18:36:22.347 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7439999999999999e-06 2024-09-12T18:36:22.347 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.347 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.347 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:22.347 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.255154+0000", 2024-09-12T18:36:22.347 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000104901 2024-09-12T18:36:22.347 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.347 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.347 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:22.347 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.255164+0000", 2024-09-12T18:36:22.348 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0000000000000001e-05 2024-09-12T18:36:22.348 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.348 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.348 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.348 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.255169+0000", 2024-09-12T18:36:22.348 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9849999999999997e-06 2024-09-12T18:36:22.348 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.348 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.348 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.348 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.255206+0000", 2024-09-12T18:36:22.348 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.6550000000000001e-05 2024-09-12T18:36:22.348 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.348 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.349 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:22.349 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.255293+0000", 2024-09-12T18:36:22.349 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7170999999999996e-05 2024-09-12T18:36:22.349 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.349 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.349 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:22.349 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.255375+0000", 2024-09-12T18:36:22.349 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2113000000000005e-05 2024-09-12T18:36:22.349 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.349 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:22.349 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.349 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.349 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.350 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:88581 5.b e40/21 5:d214273e:::benchmark_data_smithi073_23739_object88580:head v 40'5663, mlcod=40'5660)", 2024-09-12T18:36:22.350 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:22.255496+0000", 2024-09-12T18:36:22.350 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0043594970000000004, 2024-09-12T18:36:22.350 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0049335669999999998, 2024-09-12T18:36:22.350 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:22.350 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:22.350 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:22.350 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:22.350 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.350 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:22.350 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.255496+0000", 2024-09-12T18:36:22.350 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.350 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.351 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.351 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:22.351 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.255496+0000", 2024-09-12T18:36:22.351 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.351 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.351 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.351 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:22.351 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.255496+0000", 2024-09-12T18:36:22.351 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1799999999999995e-07 2024-09-12T18:36:22.351 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.351 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.351 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:22.352 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.255630+0000", 2024-09-12T18:36:22.352 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013372300000000001 2024-09-12T18:36:22.352 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.352 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.352 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:22.352 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.255637+0000", 2024-09-12T18:36:22.352 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.272e-06 2024-09-12T18:36:22.352 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.352 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.352 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.352 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.255641+0000", 2024-09-12T18:36:22.352 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.172e-06 2024-09-12T18:36:22.352 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.353 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.353 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.353 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.255682+0000", 2024-09-12T18:36:22.353 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0979000000000002e-05 2024-09-12T18:36:22.353 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.353 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.353 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:22.353 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.255701+0000", 2024-09-12T18:36:22.353 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8445999999999999e-05 2024-09-12T18:36:22.353 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.353 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:22.353 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.354 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.354 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.354 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:88586 5.7 e40/21 5:eac66967:::benchmark_data_smithi073_23739_object88585:head v 40'5556, mlcod=40'5554)", 2024-09-12T18:36:22.354 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:22.255835+0000", 2024-09-12T18:36:22.354 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0040205320000000003, 2024-09-12T18:36:22.354 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0046495759999999999, 2024-09-12T18:36:22.354 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:22.354 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:22.354 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:22.354 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:22.354 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.354 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:22.354 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.255835+0000", 2024-09-12T18:36:22.355 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.355 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.355 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.355 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:22.355 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.255835+0000", 2024-09-12T18:36:22.355 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.355 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.355 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.355 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:22.355 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.255835+0000", 2024-09-12T18:36:22.355 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0299999999999998e-07 2024-09-12T18:36:22.355 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.355 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.355 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:22.356 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.255928+0000", 2024-09-12T18:36:22.356 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2380999999999995e-05 2024-09-12T18:36:22.356 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.356 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.356 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:22.356 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.255941+0000", 2024-09-12T18:36:22.356 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3505e-05 2024-09-12T18:36:22.356 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.356 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.356 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.356 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.255949+0000", 2024-09-12T18:36:22.356 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.678e-06 2024-09-12T18:36:22.357 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.357 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.357 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.357 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.256002+0000", 2024-09-12T18:36:22.357 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.3380000000000001e-05 2024-09-12T18:36:22.357 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.357 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.357 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:22.357 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.256020+0000", 2024-09-12T18:36:22.357 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7462999999999999e-05 2024-09-12T18:36:22.357 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.357 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:22.357 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.358 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.358 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.358 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:88587 5.5 5:aa4fb6e8:::benchmark_data_smithi073_23739_object88586:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:36:22.358 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:22.255794+0000", 2024-09-12T18:36:22.358 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0040610990000000003, 2024-09-12T18:36:22.358 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0047472440000000003, 2024-09-12T18:36:22.358 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:22.358 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:22.358 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:22.358 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:22.358 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:22.358 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:22.358 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 88587 2024-09-12T18:36:22.359 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.359 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:22.359 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.359 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:22.359 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.255794+0000", 2024-09-12T18:36:22.359 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.359 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.359 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.359 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:22.359 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.255794+0000", 2024-09-12T18:36:22.359 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.359 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.359 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.359 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:22.360 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.255795+0000", 2024-09-12T18:36:22.360 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7800000000000001e-07 2024-09-12T18:36:22.360 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.360 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.360 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:22.360 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.255950+0000", 2024-09-12T18:36:22.360 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000154869 2024-09-12T18:36:22.360 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.360 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.360 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:22.360 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.255971+0000", 2024-09-12T18:36:22.360 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1713999999999999e-05 2024-09-12T18:36:22.361 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.361 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.361 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.361 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.255980+0000", 2024-09-12T18:36:22.361 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6859999999999995e-06 2024-09-12T18:36:22.361 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.361 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.361 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.361 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.256031+0000", 2024-09-12T18:36:22.361 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1477000000000002e-05 2024-09-12T18:36:22.361 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.361 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.361 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:22.362 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.256142+0000", 2024-09-12T18:36:22.362 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000110913 2024-09-12T18:36:22.362 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.362 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.362 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:22.362 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:22.256268+0000", 2024-09-12T18:36:22.362 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012535500000000001 2024-09-12T18:36:22.362 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.362 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:22.362 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.362 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.362 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-12T18:36:22.362 INFO:teuthology.orchestra.run.smithi114.stdout: "num_ops": 17 2024-09-12T18:36:22.362 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:22.363 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:36:22.364 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:22.363+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:22.466 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:22.463+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:22.512 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:22.512 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2024-09-12T18:36:22.512 INFO:teuthology.orchestra.run.smithi114.stdout: "complaint_time": 30, 2024-09-12T18:36:22.512 INFO:teuthology.orchestra.run.smithi114.stdout: "num_blocked_ops": 0 2024-09-12T18:36:22.512 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:22.531 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:36:22.567 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:22.564+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:22.668 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:22.664+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:22.685 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:22.685 INFO:teuthology.orchestra.run.smithi114.stdout: "size": 20, 2024-09-12T18:36:22.685 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 600, 2024-09-12T18:36:22.685 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:36:22.685 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.685 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:22.685 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:22.685 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 57.052867474999999, 2024-09-12T18:36:22.686 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.042475618999999999, 2024-09-12T18:36:22.686 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:22.686 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:22.686 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:22.686 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:22.686 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.686 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:22.686 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:22.686 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.686 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.686 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.686 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:22.686 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:22.687 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.687 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.687 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.687 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:22.687 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628450+0000", 2024-09-12T18:36:22.687 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4212999999999999e-05 2024-09-12T18:36:22.687 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.687 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.687 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:22.687 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628463+0000", 2024-09-12T18:36:22.687 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2497000000000001e-05 2024-09-12T18:36:22.687 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.687 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.687 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:22.688 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628480+0000", 2024-09-12T18:36:22.688 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7232999999999999e-05 2024-09-12T18:36:22.688 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.688 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.688 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.688 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628496+0000", 2024-09-12T18:36:22.688 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6217000000000001e-05 2024-09-12T18:36:22.688 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.688 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.688 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.688 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628641+0000", 2024-09-12T18:36:22.688 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000144709 2024-09-12T18:36:22.688 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.689 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.689 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:22.689 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628657+0000", 2024-09-12T18:36:22.689 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6266e-05 2024-09-12T18:36:22.689 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.689 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.689 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.689 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663103+0000", 2024-09-12T18:36:22.689 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.034445523999999998 2024-09-12T18:36:22.689 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.689 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.689 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:22.689 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663373+0000", 2024-09-12T18:36:22.690 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00027085500000000002 2024-09-12T18:36:22.690 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.690 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.690 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:22.690 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663634+0000", 2024-09-12T18:36:22.690 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000260855 2024-09-12T18:36:22.690 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.690 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.690 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:22.690 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670294+0000", 2024-09-12T18:36:22.690 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0066597599999999998 2024-09-12T18:36:22.690 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.690 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.690 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:22.691 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670705+0000", 2024-09-12T18:36:22.691 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00041057099999999998 2024-09-12T18:36:22.691 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.691 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.691 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:22.691 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670820+0000", 2024-09-12T18:36:22.691 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000115111 2024-09-12T18:36:22.691 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.691 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.691 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:22.691 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670912+0000", 2024-09-12T18:36:22.691 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1807999999999999e-05 2024-09-12T18:36:22.691 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.692 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:22.692 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.692 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.692 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.692 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:22.692 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:22.692 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 57.052776729000001, 2024-09-12T18:36:22.692 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.044599273000000002, 2024-09-12T18:36:22.692 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:22.692 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:22.692 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:22.692 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:22.693 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.693 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:22.693 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:22.693 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.693 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.693 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.693 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:22.693 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:22.693 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.693 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.693 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.693 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:22.693 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628528+0000", 2024-09-12T18:36:22.693 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:22.694 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.694 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.694 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:22.694 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628537+0000", 2024-09-12T18:36:22.694 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6969999999999999e-06 2024-09-12T18:36:22.694 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.694 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.694 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:22.694 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628560+0000", 2024-09-12T18:36:22.694 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2889000000000001e-05 2024-09-12T18:36:22.694 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.694 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.694 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.695 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628576+0000", 2024-09-12T18:36:22.695 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.649e-05 2024-09-12T18:36:22.695 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.695 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.695 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.695 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628846+0000", 2024-09-12T18:36:22.695 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00026952500000000001 2024-09-12T18:36:22.695 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.695 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.695 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:22.695 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628853+0000", 2024-09-12T18:36:22.695 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6559999999999992e-06 2024-09-12T18:36:22.695 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.695 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.696 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.696 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665284+0000", 2024-09-12T18:36:22.696 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.036431140000000001 2024-09-12T18:36:22.696 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.696 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.696 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:22.696 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665494+0000", 2024-09-12T18:36:22.696 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000209762 2024-09-12T18:36:22.696 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.696 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.696 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:22.696 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665816+0000", 2024-09-12T18:36:22.696 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00032162299999999999 2024-09-12T18:36:22.697 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.697 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.697 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:22.697 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670382+0000", 2024-09-12T18:36:22.697 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0045656739999999996 2024-09-12T18:36:22.697 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.697 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.697 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:22.697 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.672978+0000", 2024-09-12T18:36:22.697 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.002596068 2024-09-12T18:36:22.697 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.697 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.697 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:22.697 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673058+0000", 2024-09-12T18:36:22.698 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0198999999999996e-05 2024-09-12T18:36:22.698 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.698 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.698 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:22.698 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673126+0000", 2024-09-12T18:36:22.698 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8120000000000005e-05 2024-09-12T18:36:22.698 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.698 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:22.698 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.698 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.698 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.698 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:23 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:22.698 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:22.699 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 57.052678923000002, 2024-09-12T18:36:22.699 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045539784, 2024-09-12T18:36:22.699 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:22.699 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:22.699 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:22.699 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:22.699 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.699 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:22.699 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:22.699 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.699 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.699 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.699 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:22.699 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:22.700 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.700 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.700 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.700 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:22.700 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628626+0000", 2024-09-12T18:36:22.700 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.573e-06 2024-09-12T18:36:22.700 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.700 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.700 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:22.700 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628640+0000", 2024-09-12T18:36:22.700 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3817e-05 2024-09-12T18:36:22.700 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.700 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.701 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:22.701 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628659+0000", 2024-09-12T18:36:22.701 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9539999999999999e-05 2024-09-12T18:36:22.701 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.701 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.701 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.701 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628675+0000", 2024-09-12T18:36:22.701 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5739e-05 2024-09-12T18:36:22.701 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.701 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.701 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.701 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628815+0000", 2024-09-12T18:36:22.701 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014003299999999999 2024-09-12T18:36:22.701 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.702 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.702 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:22.702 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628828+0000", 2024-09-12T18:36:22.702 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2849e-05 2024-09-12T18:36:22.702 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.702 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.702 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.702 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651162+0000", 2024-09-12T18:36:22.702 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.022334228000000001 2024-09-12T18:36:22.702 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.702 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.702 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:22.702 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651446+0000", 2024-09-12T18:36:22.703 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00028392800000000002 2024-09-12T18:36:22.703 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.703 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.703 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:22.703 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651746+0000", 2024-09-12T18:36:22.703 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000300091 2024-09-12T18:36:22.703 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.703 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.703 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:22.703 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665113+0000", 2024-09-12T18:36:22.703 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013366678 2024-09-12T18:36:22.703 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.703 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.703 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:22.704 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674010+0000", 2024-09-12T18:36:22.704 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0088970520000000008 2024-09-12T18:36:22.704 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.704 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.704 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:22.704 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674104+0000", 2024-09-12T18:36:22.704 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4124999999999998e-05 2024-09-12T18:36:22.704 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.704 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.704 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:22.704 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674164+0000", 2024-09-12T18:36:22.704 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.0130999999999997e-05 2024-09-12T18:36:22.704 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.704 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:22.705 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.705 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.705 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.705 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:26 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:22.705 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:22.705 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 57.052605716999999, 2024-09-12T18:36:22.705 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045702136999999997, 2024-09-12T18:36:22.705 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:22.705 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:22.705 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:22.706 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:22.706 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.706 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:22.706 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:22.706 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.706 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.706 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.706 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:22.706 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:22.706 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.706 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.706 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.706 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:22.706 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628699+0000", 2024-09-12T18:36:22.707 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3859999999999999e-06 2024-09-12T18:36:22.707 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.707 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.707 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:22.707 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628706+0000", 2024-09-12T18:36:22.707 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0169999999999999e-06 2024-09-12T18:36:22.707 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.707 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.707 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:22.707 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628725+0000", 2024-09-12T18:36:22.707 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8683000000000001e-05 2024-09-12T18:36:22.707 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.707 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.708 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.708 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628740+0000", 2024-09-12T18:36:22.708 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5413999999999998e-05 2024-09-12T18:36:22.708 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.708 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.708 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.708 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628907+0000", 2024-09-12T18:36:22.708 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00016670199999999999 2024-09-12T18:36:22.708 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.708 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.708 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:22.708 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628917+0000", 2024-09-12T18:36:22.708 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.046e-05 2024-09-12T18:36:22.709 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.709 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.709 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.709 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.660390+0000", 2024-09-12T18:36:22.709 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.031472364000000003 2024-09-12T18:36:22.709 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.709 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.709 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:22.709 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.661767+0000", 2024-09-12T18:36:22.709 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0013769190000000001 2024-09-12T18:36:22.709 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.709 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.709 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:22.710 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.662408+0000", 2024-09-12T18:36:22.710 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00064091099999999998 2024-09-12T18:36:22.710 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.710 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.710 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:22.710 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669577+0000", 2024-09-12T18:36:22.710 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.007169412 2024-09-12T18:36:22.710 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.710 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.710 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:22.710 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674244+0000", 2024-09-12T18:36:22.710 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0046671839999999996 2024-09-12T18:36:22.710 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.710 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.711 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:22.711 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674329+0000", 2024-09-12T18:36:22.711 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5276000000000001e-05 2024-09-12T18:36:22.711 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.711 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.711 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:22.711 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674400+0000", 2024-09-12T18:36:22.711 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0408999999999996e-05 2024-09-12T18:36:22.711 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.711 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:22.711 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.712 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.712 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.712 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:22.712 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:22.712 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 57.052498047999997, 2024-09-12T18:36:22.712 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.044572443000000003, 2024-09-12T18:36:22.712 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:22.712 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:22.712 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:22.712 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:22.712 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.712 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:22.712 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:22.712 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.713 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.713 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.713 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:22.713 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:22.713 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.713 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.713 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.713 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:22.713 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628807+0000", 2024-09-12T18:36:22.713 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3629999999999999e-06 2024-09-12T18:36:22.713 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.713 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.713 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:22.714 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628814+0000", 2024-09-12T18:36:22.714 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.2099999999999996e-06 2024-09-12T18:36:22.714 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.714 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.714 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:22.714 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628832+0000", 2024-09-12T18:36:22.714 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7972999999999999e-05 2024-09-12T18:36:22.714 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.714 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.714 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.714 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628854+0000", 2024-09-12T18:36:22.714 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1857000000000001e-05 2024-09-12T18:36:22.714 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.715 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.715 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.715 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628984+0000", 2024-09-12T18:36:22.715 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013013599999999999 2024-09-12T18:36:22.715 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.715 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.715 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:22.715 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628993+0000", 2024-09-12T18:36:22.715 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:36:22.715 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.715 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.715 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.715 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668176+0000", 2024-09-12T18:36:22.716 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.039182211000000002 2024-09-12T18:36:22.716 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.716 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.716 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:22.716 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668481+0000", 2024-09-12T18:36:22.716 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00030499200000000002 2024-09-12T18:36:22.716 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.716 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.716 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:22.716 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668771+0000", 2024-09-12T18:36:22.716 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00029018700000000002 2024-09-12T18:36:22.716 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.716 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.717 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:22.717 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.672674+0000", 2024-09-12T18:36:22.717 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0039031890000000001 2024-09-12T18:36:22.717 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.717 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.717 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:22.717 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673214+0000", 2024-09-12T18:36:22.717 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00053981600000000004 2024-09-12T18:36:22.717 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.717 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.717 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:22.717 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673310+0000", 2024-09-12T18:36:22.717 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.6682999999999996e-05 2024-09-12T18:36:22.718 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.718 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.718 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:22.718 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673378+0000", 2024-09-12T18:36:22.718 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7385999999999995e-05 2024-09-12T18:36:22.718 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.718 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:22.718 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.718 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.718 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.718 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:22.718 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:22.718 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 57.052362021999997, 2024-09-12T18:36:22.719 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.041480853999999998, 2024-09-12T18:36:22.719 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:22.719 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:22.719 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:22.719 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:22.719 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.719 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:22.719 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:22.719 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.719 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.719 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.719 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:22.719 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:22.720 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.720 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.720 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.720 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:22.720 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628943+0000", 2024-09-12T18:36:22.720 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.403e-06 2024-09-12T18:36:22.720 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.720 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.720 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:22.720 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628953+0000", 2024-09-12T18:36:22.720 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0273e-05 2024-09-12T18:36:22.720 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.720 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.720 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:22.721 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628973+0000", 2024-09-12T18:36:22.721 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9959999999999999e-05 2024-09-12T18:36:22.721 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.721 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.721 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.721 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628989+0000", 2024-09-12T18:36:22.721 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6447e-05 2024-09-12T18:36:22.721 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.721 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.721 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.721 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629144+0000", 2024-09-12T18:36:22.721 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015468900000000001 2024-09-12T18:36:22.721 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.722 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.722 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:22.722 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629162+0000", 2024-09-12T18:36:22.722 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7603000000000001e-05 2024-09-12T18:36:22.722 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.722 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.722 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.722 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.646927+0000", 2024-09-12T18:36:22.722 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.017765626 2024-09-12T18:36:22.722 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.722 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.722 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:22.722 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.647245+0000", 2024-09-12T18:36:22.722 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00031797699999999999 2024-09-12T18:36:22.723 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.723 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.723 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:22.723 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.647551+0000", 2024-09-12T18:36:22.723 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00030583500000000002 2024-09-12T18:36:22.723 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.723 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.723 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:22.723 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651738+0000", 2024-09-12T18:36:22.723 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0041864980000000003 2024-09-12T18:36:22.723 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.723 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.723 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:22.724 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670207+0000", 2024-09-12T18:36:22.724 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018469299000000002 2024-09-12T18:36:22.724 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.724 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.724 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:22.724 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670330+0000", 2024-09-12T18:36:22.724 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012284500000000001 2024-09-12T18:36:22.724 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.724 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.724 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:22.724 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670422+0000", 2024-09-12T18:36:22.724 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2398999999999994e-05 2024-09-12T18:36:22.724 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.724 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:22.725 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.725 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.725 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.725 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:22.725 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:22.725 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 57.052284769000003, 2024-09-12T18:36:22.725 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.041623741999999998, 2024-09-12T18:36:22.725 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:22.725 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:22.725 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:22.725 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:22.725 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.725 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:22.726 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:22.726 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.726 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.726 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.726 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:22.726 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:22.726 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.726 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.726 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.726 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:22.726 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629020+0000", 2024-09-12T18:36:22.726 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.15e-06 2024-09-12T18:36:22.726 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.726 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.727 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:22.727 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629023+0000", 2024-09-12T18:36:22.727 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4659999999999999e-06 2024-09-12T18:36:22.727 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.727 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.727 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:22.727 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629037+0000", 2024-09-12T18:36:22.727 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3857e-05 2024-09-12T18:36:22.727 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.727 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.727 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.727 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629062+0000", 2024-09-12T18:36:22.727 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4519999999999999e-05 2024-09-12T18:36:22.727 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.728 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.728 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.728 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629253+0000", 2024-09-12T18:36:22.728 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000191335 2024-09-12T18:36:22.728 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.728 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.728 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:22.728 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629266+0000", 2024-09-12T18:36:22.728 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3322999999999999e-05 2024-09-12T18:36:22.728 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.728 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.728 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.729 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648331+0000", 2024-09-12T18:36:22.729 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.019065060000000002 2024-09-12T18:36:22.729 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.729 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.729 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:22.729 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.650044+0000", 2024-09-12T18:36:22.729 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017123959999999999 2024-09-12T18:36:22.729 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.729 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.729 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:22.729 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670642+0000", 2024-09-12T18:36:22.729 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.020598635000000001 2024-09-12T18:36:22.729 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.729 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:22.730 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.730 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.730 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.730 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:22.730 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:22.730 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 57.052181437000002, 2024-09-12T18:36:22.730 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.046431252999999999, 2024-09-12T18:36:22.730 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:22.730 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:22.730 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:22.730 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:22.730 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.730 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:22.730 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:22.731 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.731 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.731 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.731 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:22.731 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:22.731 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.731 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.731 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.731 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:22.731 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629123+0000", 2024-09-12T18:36:22.731 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0899999999999999e-06 2024-09-12T18:36:22.731 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.731 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.731 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:22.731 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629138+0000", 2024-09-12T18:36:22.732 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4977000000000001e-05 2024-09-12T18:36:22.732 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.732 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.732 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:22.732 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629149+0000", 2024-09-12T18:36:22.732 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1182999999999999e-05 2024-09-12T18:36:22.732 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.732 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.732 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.732 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629157+0000", 2024-09-12T18:36:22.732 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8129999999999996e-06 2024-09-12T18:36:22.732 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.732 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.733 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.733 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629223+0000", 2024-09-12T18:36:22.733 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6463000000000004e-05 2024-09-12T18:36:22.733 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.733 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.733 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:22.733 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629230+0000", 2024-09-12T18:36:22.733 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1360000000000002e-06 2024-09-12T18:36:22.733 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.733 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.733 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.733 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669605+0000", 2024-09-12T18:36:22.733 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.040375518999999999 2024-09-12T18:36:22.733 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.734 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.734 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:22.734 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669840+0000", 2024-09-12T18:36:22.734 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00023520099999999999 2024-09-12T18:36:22.734 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.734 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.734 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:22.734 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.675553+0000", 2024-09-12T18:36:22.734 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0057128709999999996 2024-09-12T18:36:22.734 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.734 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:22.734 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.734 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.734 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.735 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:22.735 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:22.735 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 57.052126770000001, 2024-09-12T18:36:22.735 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.037357044999999998, 2024-09-12T18:36:22.735 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:22.735 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:22.735 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:22.735 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:22.735 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.735 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:22.735 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:22.735 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.735 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.735 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.736 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:22.736 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:22.736 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.736 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.736 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.736 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:22.736 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629178+0000", 2024-09-12T18:36:22.736 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.08e-06 2024-09-12T18:36:22.736 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.736 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.737 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:22.737 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629194+0000", 2024-09-12T18:36:22.737 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5899000000000001e-05 2024-09-12T18:36:22.737 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.737 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.737 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:22.737 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629211+0000", 2024-09-12T18:36:22.737 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7363e-05 2024-09-12T18:36:22.737 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.737 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.737 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.737 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629226+0000", 2024-09-12T18:36:22.737 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4567e-05 2024-09-12T18:36:22.737 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.738 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.738 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.738 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629299+0000", 2024-09-12T18:36:22.738 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3910000000000002e-05 2024-09-12T18:36:22.738 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.738 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.738 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:22.738 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629307+0000", 2024-09-12T18:36:22.738 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5299999999999999e-06 2024-09-12T18:36:22.738 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.738 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.738 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.738 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648185+0000", 2024-09-12T18:36:22.739 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018878533999999999 2024-09-12T18:36:22.739 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.739 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.739 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:22.739 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.649724+0000", 2024-09-12T18:36:22.739 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001538841 2024-09-12T18:36:22.739 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.739 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.739 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:22.739 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.666534+0000", 2024-09-12T18:36:22.739 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.016809320999999999 2024-09-12T18:36:22.739 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.739 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:22.739 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.740 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.740 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.740 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:61561 5.e e35/21 5:715fe5e4:::benchmark_data_smithi073_23739_object61560:head v 35'3863, mlcod=35'3861)", 2024-09-12T18:36:22.740 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:09.220994+0000", 2024-09-12T18:36:22.740 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 13.460309473000001, 2024-09-12T18:36:22.740 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.017185846000000001, 2024-09-12T18:36:22.740 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:22.740 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:22.740 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:22.740 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:22.740 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.740 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:22.740 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.220994+0000", 2024-09-12T18:36:22.741 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.741 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.741 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.741 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:22.741 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.220994+0000", 2024-09-12T18:36:22.741 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.741 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.741 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.741 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:22.741 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.220995+0000", 2024-09-12T18:36:22.741 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2799999999999996e-07 2024-09-12T18:36:22.741 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.741 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.741 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:22.742 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.221049+0000", 2024-09-12T18:36:22.742 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4506999999999998e-05 2024-09-12T18:36:22.742 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.742 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.742 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:22.742 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.221057+0000", 2024-09-12T18:36:22.742 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.4290000000000001e-06 2024-09-12T18:36:22.742 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.742 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.742 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.742 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.221063+0000", 2024-09-12T18:36:22.742 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7899999999999996e-06 2024-09-12T18:36:22.742 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.742 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.743 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.743 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.221135+0000", 2024-09-12T18:36:22.743 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1268999999999998e-05 2024-09-12T18:36:22.743 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.743 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.743 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:22.743 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.221153+0000", 2024-09-12T18:36:22.743 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8892000000000001e-05 2024-09-12T18:36:22.743 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.743 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.743 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:22.743 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.238141+0000", 2024-09-12T18:36:22.743 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.016988077000000001 2024-09-12T18:36:22.744 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.744 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.744 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:22.744 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.238180+0000", 2024-09-12T18:36:22.744 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8254000000000003e-05 2024-09-12T18:36:22.744 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.744 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:22.744 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.744 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.744 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.744 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:61578 5.6 5:638c8823:::benchmark_data_smithi073_23739_object61577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:36:22.744 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:09.232201+0000", 2024-09-12T18:36:22.745 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 13.449101984, 2024-09-12T18:36:22.745 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.017140757, 2024-09-12T18:36:22.745 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:22.745 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:22.745 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:22.745 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:22.745 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:22.745 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:22.745 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 61578 2024-09-12T18:36:22.745 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.745 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:22.745 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.745 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:22.746 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.232201+0000", 2024-09-12T18:36:22.746 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.746 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.746 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.746 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:22.746 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.232201+0000", 2024-09-12T18:36:22.746 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.746 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.746 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.746 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:22.746 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.232202+0000", 2024-09-12T18:36:22.746 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1299999999999998e-07 2024-09-12T18:36:22.746 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.747 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.747 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:22.747 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.232276+0000", 2024-09-12T18:36:22.747 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3298000000000002e-05 2024-09-12T18:36:22.747 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.747 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.747 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:22.747 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.232287+0000", 2024-09-12T18:36:22.747 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1049e-05 2024-09-12T18:36:22.747 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.747 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.747 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.747 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.232293+0000", 2024-09-12T18:36:22.747 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6710000000000002e-06 2024-09-12T18:36:22.748 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.748 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.748 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.748 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.238749+0000", 2024-09-12T18:36:22.748 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.006455199 2024-09-12T18:36:22.748 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.748 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.748 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:22.748 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.238868+0000", 2024-09-12T18:36:22.748 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000119651 2024-09-12T18:36:22.748 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.748 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.748 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:22.749 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.239038+0000", 2024-09-12T18:36:22.749 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000169696 2024-09-12T18:36:22.749 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.749 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.749 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:22.749 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.245237+0000", 2024-09-12T18:36:22.749 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0061988169999999997 2024-09-12T18:36:22.749 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.749 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.749 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:22.749 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.249223+0000", 2024-09-12T18:36:22.749 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0039859079999999998 2024-09-12T18:36:22.749 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.749 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.750 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:22.750 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.249288+0000", 2024-09-12T18:36:22.750 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5122000000000004e-05 2024-09-12T18:36:22.750 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.750 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.750 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:22.750 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.249342+0000", 2024-09-12T18:36:22.750 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4432999999999999e-05 2024-09-12T18:36:22.750 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.750 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:22.750 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.750 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.750 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.751 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:77246 5.3 5:ce8e943d:::benchmark_data_smithi073_23739_object77245:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:22.751 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:16.793012+0000", 2024-09-12T18:36:22.751 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 5.888291572, 2024-09-12T18:36:22.751 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.016348155, 2024-09-12T18:36:22.751 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:22.751 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:22.751 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:22.751 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:22.751 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:22.751 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:22.751 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 77246 2024-09-12T18:36:22.751 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.751 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:22.751 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.752 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:22.752 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.793012+0000", 2024-09-12T18:36:22.752 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.752 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.752 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.752 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:22.752 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.793012+0000", 2024-09-12T18:36:22.752 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.752 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.752 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.752 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:22.752 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.793012+0000", 2024-09-12T18:36:22.752 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9500000000000002e-07 2024-09-12T18:36:22.753 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.753 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.753 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:22.753 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.793101+0000", 2024-09-12T18:36:22.753 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.8889999999999998e-05 2024-09-12T18:36:22.753 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.753 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.753 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:22.753 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.793110+0000", 2024-09-12T18:36:22.753 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7159999999999992e-06 2024-09-12T18:36:22.753 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.753 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.753 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.753 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.793116+0000", 2024-09-12T18:36:22.754 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.0769999999999996e-06 2024-09-12T18:36:22.754 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.754 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.754 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.754 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.795789+0000", 2024-09-12T18:36:22.754 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0026725849999999999 2024-09-12T18:36:22.754 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.754 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.754 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:22.754 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.795930+0000", 2024-09-12T18:36:22.754 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014143000000000001 2024-09-12T18:36:22.754 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.754 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.755 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:22.755 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.796085+0000", 2024-09-12T18:36:22.755 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015526799999999999 2024-09-12T18:36:22.755 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.755 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.755 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:22.755 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.800536+0000", 2024-09-12T18:36:22.755 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.004450931 2024-09-12T18:36:22.755 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.755 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.755 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:22.755 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.809269+0000", 2024-09-12T18:36:22.755 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0087325730000000004 2024-09-12T18:36:22.755 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.756 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.756 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:22.756 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.809319+0000", 2024-09-12T18:36:22.756 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9675000000000001e-05 2024-09-12T18:36:22.756 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.756 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.756 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:22.756 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.809360+0000", 2024-09-12T18:36:22.756 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.1415000000000002e-05 2024-09-12T18:36:22.756 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.756 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:22.756 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.757 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.757 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.757 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:77241 5.b e38/21 5:d9973dc8:::benchmark_data_smithi073_23739_object77240:head v 38'4928, mlcod=38'4925)", 2024-09-12T18:36:22.757 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:16.794009+0000", 2024-09-12T18:36:22.757 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 5.8872939280000001, 2024-09-12T18:36:22.757 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.017144257999999999, 2024-09-12T18:36:22.757 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:22.757 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:22.757 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:22.757 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:22.757 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.757 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:22.757 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.794009+0000", 2024-09-12T18:36:22.758 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.758 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.758 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.758 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:22.758 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.794009+0000", 2024-09-12T18:36:22.758 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.758 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.758 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.758 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:22.758 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.794010+0000", 2024-09-12T18:36:22.758 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8799999999999998e-07 2024-09-12T18:36:22.758 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.758 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.759 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:22.759 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.794047+0000", 2024-09-12T18:36:22.759 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.7407000000000003e-05 2024-09-12T18:36:22.759 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.759 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.759 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:22.759 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.794055+0000", 2024-09-12T18:36:22.759 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5820000000000004e-06 2024-09-12T18:36:22.759 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.759 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.759 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.759 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.794059+0000", 2024-09-12T18:36:22.759 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5179999999999998e-06 2024-09-12T18:36:22.760 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.760 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.760 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.760 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.795771+0000", 2024-09-12T18:36:22.760 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017113600000000001 2024-09-12T18:36:22.760 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.760 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.760 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:22.760 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.795789+0000", 2024-09-12T18:36:22.760 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8422000000000001e-05 2024-09-12T18:36:22.760 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.760 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.760 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:22.760 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.811118+0000", 2024-09-12T18:36:22.761 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015329267000000001 2024-09-12T18:36:22.761 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.761 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.761 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:22.761 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.811154+0000", 2024-09-12T18:36:22.761 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.5314000000000001e-05 2024-09-12T18:36:22.761 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.761 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:22.761 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.761 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.761 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.761 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:77251 5.3 5:c0b45ab3:::benchmark_data_smithi073_23739_object77250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:22.761 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:16.796319+0000", 2024-09-12T18:36:22.762 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 5.8849839839999998, 2024-09-12T18:36:22.762 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018653991000000002, 2024-09-12T18:36:22.762 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:22.762 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:22.762 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:22.762 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:22.762 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:22.762 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:22.762 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 77251 2024-09-12T18:36:22.762 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.762 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:22.762 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.762 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:22.762 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.796319+0000", 2024-09-12T18:36:22.763 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.763 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.763 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.763 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:22.763 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.796319+0000", 2024-09-12T18:36:22.763 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.763 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.763 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.763 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:22.763 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.796320+0000", 2024-09-12T18:36:22.763 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1100000000000005e-07 2024-09-12T18:36:22.763 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.763 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.763 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:22.764 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.796353+0000", 2024-09-12T18:36:22.764 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3043000000000002e-05 2024-09-12T18:36:22.764 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.764 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.764 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:22.764 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.796361+0000", 2024-09-12T18:36:22.764 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3989999999999998e-06 2024-09-12T18:36:22.764 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.764 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.764 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.764 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.796367+0000", 2024-09-12T18:36:22.764 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9950000000000002e-06 2024-09-12T18:36:22.764 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.765 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.765 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.765 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.800568+0000", 2024-09-12T18:36:22.765 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0042010709999999998 2024-09-12T18:36:22.765 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.765 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.765 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:22.765 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.800679+0000", 2024-09-12T18:36:22.765 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000111119 2024-09-12T18:36:22.765 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.765 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.765 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:22.765 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.800802+0000", 2024-09-12T18:36:22.766 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000123418 2024-09-12T18:36:22.766 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.766 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.766 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:22.766 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.805536+0000", 2024-09-12T18:36:22.766 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0047341309999999999 2024-09-12T18:36:22.766 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.766 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.766 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:22.766 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.814921+0000", 2024-09-12T18:36:22.766 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0093849680000000005 2024-09-12T18:36:22.766 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.766 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.766 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:22.766 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.814951+0000", 2024-09-12T18:36:22.767 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.9189000000000001e-05 2024-09-12T18:36:22.767 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.767 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.767 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:22.767 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.814973+0000", 2024-09-12T18:36:22.767 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2847e-05 2024-09-12T18:36:22.767 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.767 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:22.767 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.767 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.767 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.767 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:77253 5.b e38/21 5:df1f7025:::benchmark_data_smithi073_23739_object77252:head v 38'4929, mlcod=38'4925)", 2024-09-12T18:36:22.767 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:16.797351+0000", 2024-09-12T18:36:22.768 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 5.88395286, 2024-09-12T18:36:22.768 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.017650757999999999, 2024-09-12T18:36:22.768 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:22.768 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:22.768 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:22.768 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:22.768 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.768 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:22.768 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.797351+0000", 2024-09-12T18:36:22.768 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.768 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.768 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.768 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:22.768 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.797351+0000", 2024-09-12T18:36:22.769 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.769 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.769 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.769 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:22.769 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.797351+0000", 2024-09-12T18:36:22.769 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4900000000000005e-07 2024-09-12T18:36:22.769 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.769 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.769 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:22.769 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.797404+0000", 2024-09-12T18:36:22.769 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.3038000000000003e-05 2024-09-12T18:36:22.769 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.769 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.769 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:22.770 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.797413+0000", 2024-09-12T18:36:22.770 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.0899999999999994e-06 2024-09-12T18:36:22.770 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.770 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.770 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.770 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.797419+0000", 2024-09-12T18:36:22.770 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1749999999999996e-06 2024-09-12T18:36:22.770 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.770 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.770 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.770 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.802808+0000", 2024-09-12T18:36:22.770 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0053890919999999998 2024-09-12T18:36:22.770 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.771 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.771 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:22.771 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.802819+0000", 2024-09-12T18:36:22.771 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1252e-05 2024-09-12T18:36:22.771 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.771 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.771 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:22.771 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.814977+0000", 2024-09-12T18:36:22.771 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012157651 2024-09-12T18:36:22.771 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.771 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.771 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:22.771 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.815001+0000", 2024-09-12T18:36:22.772 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4711000000000001e-05 2024-09-12T18:36:22.772 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.772 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:22.772 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.772 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.772 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.772 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:77565 5.5 5:aa0ac054:::benchmark_data_smithi073_23739_object77564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:22.772 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:16.948256+0000", 2024-09-12T18:36:22.772 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 5.7330471220000003, 2024-09-12T18:36:22.772 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.016609352000000001, 2024-09-12T18:36:22.772 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:22.772 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:22.772 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:22.772 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:22.772 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:22.773 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:22.773 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 77565 2024-09-12T18:36:22.773 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.773 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:22.773 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.773 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:22.773 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.948256+0000", 2024-09-12T18:36:22.773 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.773 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.773 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.773 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:22.773 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.948256+0000", 2024-09-12T18:36:22.773 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.773 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.774 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.774 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:22.774 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.948257+0000", 2024-09-12T18:36:22.774 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1699999999999998e-07 2024-09-12T18:36:22.774 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.774 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.774 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:22.774 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.948334+0000", 2024-09-12T18:36:22.774 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.7259e-05 2024-09-12T18:36:22.774 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.774 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.774 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:22.774 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.948342+0000", 2024-09-12T18:36:22.774 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.7559999999999999e-06 2024-09-12T18:36:22.775 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.775 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.775 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.775 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.948347+0000", 2024-09-12T18:36:22.775 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2310000000000004e-06 2024-09-12T18:36:22.775 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.775 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.775 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.775 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.948586+0000", 2024-09-12T18:36:22.775 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00023873699999999999 2024-09-12T18:36:22.775 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.775 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.776 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:22.776 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.948701+0000", 2024-09-12T18:36:22.776 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00011479 2024-09-12T18:36:22.776 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.776 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.776 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:22.776 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.948838+0000", 2024-09-12T18:36:22.776 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013765899999999999 2024-09-12T18:36:22.776 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.776 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.776 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:22.776 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.950952+0000", 2024-09-12T18:36:22.776 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0021142919999999998 2024-09-12T18:36:22.776 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.777 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.777 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:22.777 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.964738+0000", 2024-09-12T18:36:22.777 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013785577 2024-09-12T18:36:22.777 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.777 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.777 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:22.777 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.964815+0000", 2024-09-12T18:36:22.777 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6870000000000001e-05 2024-09-12T18:36:22.777 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.777 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.777 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:22.777 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.964866+0000", 2024-09-12T18:36:22.778 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0664000000000001e-05 2024-09-12T18:36:22.778 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.778 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:22.778 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.778 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.778 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.778 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:80960 5.a 5:5d86791e:::benchmark_data_smithi073_23739_object80959:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T18:36:22.778 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:18.558199+0000", 2024-09-12T18:36:22.778 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4.1231048560000003, 2024-09-12T18:36:22.778 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.019912458000000001, 2024-09-12T18:36:22.778 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:22.778 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:22.778 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:22.778 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:22.779 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:22.779 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:22.779 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 80960 2024-09-12T18:36:22.779 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.779 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:22.779 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.779 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:22.779 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558199+0000", 2024-09-12T18:36:22.779 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.779 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.779 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.779 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:22.779 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558199+0000", 2024-09-12T18:36:22.780 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.780 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.780 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.780 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:22.780 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558199+0000", 2024-09-12T18:36:22.780 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2999999999999999e-07 2024-09-12T18:36:22.780 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.780 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.780 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:22.780 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558255+0000", 2024-09-12T18:36:22.780 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5930999999999997e-05 2024-09-12T18:36:22.780 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.780 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.780 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:22.781 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558263+0000", 2024-09-12T18:36:22.781 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1450000000000008e-06 2024-09-12T18:36:22.781 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.781 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.781 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.781 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558272+0000", 2024-09-12T18:36:22.781 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2050000000000002e-06 2024-09-12T18:36:22.781 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.781 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.781 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.781 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558334+0000", 2024-09-12T18:36:22.781 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2481e-05 2024-09-12T18:36:22.782 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.782 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.782 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:22.782 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558425+0000", 2024-09-12T18:36:22.782 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1355999999999997e-05 2024-09-12T18:36:22.782 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.782 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.782 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:22.782 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558535+0000", 2024-09-12T18:36:22.782 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00010997699999999999 2024-09-12T18:36:22.782 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.782 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.782 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:22.782 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.569795+0000", 2024-09-12T18:36:22.783 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011260020000000001 2024-09-12T18:36:22.783 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.783 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.783 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:22.783 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.578026+0000", 2024-09-12T18:36:22.783 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0082307100000000005 2024-09-12T18:36:22.783 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.783 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.783 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:22.783 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.578072+0000", 2024-09-12T18:36:22.783 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.6291000000000001e-05 2024-09-12T18:36:22.783 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.783 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.783 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:22.784 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.578111+0000", 2024-09-12T18:36:22.784 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8512e-05 2024-09-12T18:36:22.784 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.784 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:22.784 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.784 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.784 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.784 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:80965 5.a 5:57bc697e:::benchmark_data_smithi073_23739_object80964:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T18:36:22.784 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:18.560690+0000", 2024-09-12T18:36:22.784 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4.1206131529999999, 2024-09-12T18:36:22.784 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.017504101000000001, 2024-09-12T18:36:22.784 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:22.784 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:22.784 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:22.785 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:22.785 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:22.785 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:22.785 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 80965 2024-09-12T18:36:22.785 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.785 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:22.785 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.785 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:22.785 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.560690+0000", 2024-09-12T18:36:22.785 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.785 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.785 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.786 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:22.786 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.560690+0000", 2024-09-12T18:36:22.786 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.786 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.786 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.786 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:22.786 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.560692+0000", 2024-09-12T18:36:22.786 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3909999999999999e-06 2024-09-12T18:36:22.786 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.786 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.786 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:22.786 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.560757+0000", 2024-09-12T18:36:22.786 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5594999999999998e-05 2024-09-12T18:36:22.786 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.787 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.787 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:22.787 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.560769+0000", 2024-09-12T18:36:22.787 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1863e-05 2024-09-12T18:36:22.787 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.787 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.787 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.787 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.560776+0000", 2024-09-12T18:36:22.787 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8279999999999997e-06 2024-09-12T18:36:22.787 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.787 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.787 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.787 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.562340+0000", 2024-09-12T18:36:22.788 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001563891 2024-09-12T18:36:22.788 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.788 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.788 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:22.788 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.562490+0000", 2024-09-12T18:36:22.788 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015055400000000001 2024-09-12T18:36:22.788 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.788 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.788 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:22.788 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.562642+0000", 2024-09-12T18:36:22.788 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015150600000000001 2024-09-12T18:36:22.788 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.788 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.788 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:22.789 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.569837+0000", 2024-09-12T18:36:22.789 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0071948749999999999 2024-09-12T18:36:22.789 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.789 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.789 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:22.789 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.578119+0000", 2024-09-12T18:36:22.789 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0082825550000000005 2024-09-12T18:36:22.789 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.789 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.789 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:22.789 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.578161+0000", 2024-09-12T18:36:22.789 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.1693000000000002e-05 2024-09-12T18:36:22.789 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.789 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.790 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:22.790 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.578194+0000", 2024-09-12T18:36:22.790 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3349999999999997e-05 2024-09-12T18:36:22.790 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.790 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:22.790 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.790 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.790 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.790 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:80967 5.a 5:5f4000f6:::benchmark_data_smithi073_23739_object80966:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T18:36:22.790 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:18.561016+0000", 2024-09-12T18:36:22.790 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4.1202871749999996, 2024-09-12T18:36:22.790 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021780831, 2024-09-12T18:36:22.790 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:22.790 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:22.791 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:22.791 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:22.791 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:22.791 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:22.791 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 80967 2024-09-12T18:36:22.791 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.791 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:22.791 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.791 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:22.791 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561016+0000", 2024-09-12T18:36:22.791 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.791 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.791 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.791 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:22.792 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561016+0000", 2024-09-12T18:36:22.792 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.792 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.792 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.792 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:22.792 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561017+0000", 2024-09-12T18:36:22.792 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7599999999999997e-07 2024-09-12T18:36:22.792 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.792 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.792 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:22.792 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561050+0000", 2024-09-12T18:36:22.792 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3524e-05 2024-09-12T18:36:22.793 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.793 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.793 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:22.793 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561058+0000", 2024-09-12T18:36:22.793 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0679999999999997e-06 2024-09-12T18:36:22.793 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.793 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.793 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.793 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561065+0000", 2024-09-12T18:36:22.793 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1990000000000003e-06 2024-09-12T18:36:22.793 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.793 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.793 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.793 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564735+0000", 2024-09-12T18:36:22.794 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0036706740000000001 2024-09-12T18:36:22.794 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.794 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.794 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:22.794 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564868+0000", 2024-09-12T18:36:22.794 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000133003 2024-09-12T18:36:22.794 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.794 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.794 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:22.794 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.565010+0000", 2024-09-12T18:36:22.794 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014224300000000001 2024-09-12T18:36:22.794 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.794 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.795 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:22.795 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.569871+0000", 2024-09-12T18:36:22.795 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0048600759999999996 2024-09-12T18:36:22.795 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.795 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.795 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:22.795 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.582729+0000", 2024-09-12T18:36:22.795 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012858090000000001 2024-09-12T18:36:22.795 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.795 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.795 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:22.795 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.582758+0000", 2024-09-12T18:36:22.795 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.9762999999999999e-05 2024-09-12T18:36:22.796 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.796 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.796 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:22.796 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.582797+0000", 2024-09-12T18:36:22.796 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8615000000000002e-05 2024-09-12T18:36:22.796 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.796 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:22.796 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.796 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.796 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.796 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:80971 5.2 e39/21 5:4205ebb1:::benchmark_data_smithi073_23739_object80970:head v 39'5054, mlcod=39'5052)", 2024-09-12T18:36:22.796 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:18.564320+0000", 2024-09-12T18:36:22.796 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4.1169832099999999, 2024-09-12T18:36:22.796 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.019963669999999999, 2024-09-12T18:36:22.797 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:22.797 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:22.797 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:22.797 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:22.797 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.797 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:22.797 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564320+0000", 2024-09-12T18:36:22.797 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.797 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.797 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.797 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:22.797 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564320+0000", 2024-09-12T18:36:22.797 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:22.798 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.798 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.798 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:22.798 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564321+0000", 2024-09-12T18:36:22.798 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.77e-07 2024-09-12T18:36:22.798 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.798 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.798 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:22.798 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564418+0000", 2024-09-12T18:36:22.798 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.7602000000000005e-05 2024-09-12T18:36:22.798 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.798 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.798 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:22.798 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564427+0000", 2024-09-12T18:36:22.799 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7439999999999996e-06 2024-09-12T18:36:22.799 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.799 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.799 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.799 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564442+0000", 2024-09-12T18:36:22.799 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5353e-05 2024-09-12T18:36:22.799 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.799 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.799 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:22.799 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.569512+0000", 2024-09-12T18:36:22.799 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0050701840000000001 2024-09-12T18:36:22.799 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.799 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.799 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:22.800 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.569531+0000", 2024-09-12T18:36:22.800 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8311000000000001e-05 2024-09-12T18:36:22.800 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.800 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.800 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:22.800 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.584246+0000", 2024-09-12T18:36:22.800 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.014714947000000001 2024-09-12T18:36:22.800 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:22.800 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:22.800 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:22.800 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.584284+0000", 2024-09-12T18:36:22.800 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8152000000000003e-05 2024-09-12T18:36:22.800 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.800 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:22.801 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.801 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:22.801 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:22.801 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:22.802 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:36:22.803 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:22.796+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:22.872 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 37 16 89860 89844 151.747 128.438 0.00624946 0.00658505 2024-09-12T18:36:22.903 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:22.900+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:22.964 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:22.964 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:36:22.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.965 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(client.4480.0:90039 5.8 e40/21)", 2024-09-12T18:36:22.965 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:22.960886+0000", 2024-09-12T18:36:22.965 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0018682589999999999, 2024-09-12T18:36:22.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018884100000000001, 2024-09-12T18:36:22.965 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:22.965 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:22.965 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:22.965 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:22.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:22.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.960886+0000", 2024-09-12T18:36:22.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:22.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:22.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.960886+0000", 2024-09-12T18:36:22.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:22.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:22.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.960886+0000", 2024-09-12T18:36:22.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9200000000000001e-07 2024-09-12T18:36:22.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:22.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.960889+0000", 2024-09-12T18:36:22.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9340000000000002e-06 2024-09-12T18:36:22.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:22.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.960896+0000", 2024-09-12T18:36:22.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5329999999999997e-06 2024-09-12T18:36:22.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.960902+0000", 2024-09-12T18:36:22.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3070000000000002e-06 2024-09-12T18:36:22.967 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:22.967 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:22.967 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:22.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.968 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:90050 5.e 5.205b5efe (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:36:22.968 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:22.961677+0000", 2024-09-12T18:36:22.968 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0010764640000000001, 2024-09-12T18:36:22.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001124482, 2024-09-12T18:36:22.968 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:22.968 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:22.968 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:22.968 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:22.968 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:22.968 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:22.968 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 90050 2024-09-12T18:36:22.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.968 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:22.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:22.969 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.961677+0000", 2024-09-12T18:36:22.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:22.969 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:22.969 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.961677+0000", 2024-09-12T18:36:22.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:22.969 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:22.969 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.961679+0000", 2024-09-12T18:36:22.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.356e-06 2024-09-12T18:36:22.970 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.970 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.970 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:22.970 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.961722+0000", 2024-09-12T18:36:22.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3163e-05 2024-09-12T18:36:22.970 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.970 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.970 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:22.970 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.961733+0000", 2024-09-12T18:36:22.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1005000000000001e-05 2024-09-12T18:36:22.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.961740+0000", 2024-09-12T18:36:22.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3900000000000004e-06 2024-09-12T18:36:22.971 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:22.971 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:22.971 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:22.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.971 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:90049 5.f e40/21 5:f14231f1:::benchmark_data_smithi073_23739_object90048:head v 40'5601, mlcod=40'5599)", 2024-09-12T18:36:22.972 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:22.961772+0000", 2024-09-12T18:36:22.972 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00098166599999999996, 2024-09-12T18:36:22.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0010587929999999999, 2024-09-12T18:36:22.972 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:22.972 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:22.972 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:22.972 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:22.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:22.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.961772+0000", 2024-09-12T18:36:22.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:22.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:22.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.961772+0000", 2024-09-12T18:36:22.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:22.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:22.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.961773+0000", 2024-09-12T18:36:22.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6199999999999998e-07 2024-09-12T18:36:22.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:22.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.961814+0000", 2024-09-12T18:36:22.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1377e-05 2024-09-12T18:36:22.974 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.974 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:22.974 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.961822+0000", 2024-09-12T18:36:22.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0059999999999992e-06 2024-09-12T18:36:22.974 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.974 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.974 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.961827+0000", 2024-09-12T18:36:22.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2939999999999996e-06 2024-09-12T18:36:22.975 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.975 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.975 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:22.975 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.961863+0000", 2024-09-12T18:36:22.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6111e-05 2024-09-12T18:36:22.975 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.975 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.975 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:22.975 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.961878+0000", 2024-09-12T18:36:22.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4255e-05 2024-09-12T18:36:22.975 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:22.975 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:22.975 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:22.975 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.976 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:90033 5.8 5:196899d5:::benchmark_data_smithi073_23739_object90032:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:36:22.976 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:22.954644+0000", 2024-09-12T18:36:22.976 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0081100689999999993, 2024-09-12T18:36:22.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0082261769999999994, 2024-09-12T18:36:22.976 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:22.976 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:22.976 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:22.976 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:22.976 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:22.976 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:22.976 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 90033 2024-09-12T18:36:22.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.976 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:22.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:22.977 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.954644+0000", 2024-09-12T18:36:22.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:22.977 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:22.977 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.954644+0000", 2024-09-12T18:36:22.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:22.977 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.978 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:22.978 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.954644+0000", 2024-09-12T18:36:22.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0200000000000003e-07 2024-09-12T18:36:22.978 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.978 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:22.978 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.954675+0000", 2024-09-12T18:36:22.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0720999999999999e-05 2024-09-12T18:36:22.978 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.978 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:22.978 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.954681+0000", 2024-09-12T18:36:22.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7799999999999997e-06 2024-09-12T18:36:22.978 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.979 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.954686+0000", 2024-09-12T18:36:22.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5790000000000003e-06 2024-09-12T18:36:22.979 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.979 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:22.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.956370+0000", 2024-09-12T18:36:22.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001683489 2024-09-12T18:36:22.979 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.979 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:22.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.956510+0000", 2024-09-12T18:36:22.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000140195 2024-09-12T18:36:22.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.980 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:22.980 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.956657+0000", 2024-09-12T18:36:22.980 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000147143 2024-09-12T18:36:22.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.980 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:22.980 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.962738+0000", 2024-09-12T18:36:22.980 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0060807639999999998 2024-09-12T18:36:22.980 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:22.980 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:22.980 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:22.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.981 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:90036 5.0 5:0e18efe6:::benchmark_data_smithi073_23739_object90035:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:36:22.981 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:22.955128+0000", 2024-09-12T18:36:22.981 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0076261269999999999, 2024-09-12T18:36:22.981 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0078107760000000002, 2024-09-12T18:36:22.981 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:22.981 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:22.981 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:22.981 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:22.981 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:22.981 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:22.981 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 90036 2024-09-12T18:36:22.981 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.981 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:22.981 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.982 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:22.982 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.955128+0000", 2024-09-12T18:36:22.982 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:22.982 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.982 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.982 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:22.982 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.955128+0000", 2024-09-12T18:36:22.982 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:22.982 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.982 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.982 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:22.982 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.955129+0000", 2024-09-12T18:36:22.982 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1880000000000001e-06 2024-09-12T18:36:22.982 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.983 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.983 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:22.983 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.955167+0000", 2024-09-12T18:36:22.983 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7886999999999998e-05 2024-09-12T18:36:22.983 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.983 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.983 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:22.983 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.955181+0000", 2024-09-12T18:36:22.983 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4107999999999999e-05 2024-09-12T18:36:22.983 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.983 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.983 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.983 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.955190+0000", 2024-09-12T18:36:22.983 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0999999999999993e-06 2024-09-12T18:36:22.983 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.984 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:22.984 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.956361+0000", 2024-09-12T18:36:22.984 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001171006 2024-09-12T18:36:22.984 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.984 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:22.984 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.956512+0000", 2024-09-12T18:36:22.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015078800000000001 2024-09-12T18:36:22.985 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.985 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.985 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:22.985 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.956657+0000", 2024-09-12T18:36:22.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000145322 2024-09-12T18:36:22.985 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.985 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.985 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:22.985 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.962745+0000", 2024-09-12T18:36:22.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0060882260000000004 2024-09-12T18:36:22.985 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.985 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.986 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:22.986 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.962877+0000", 2024-09-12T18:36:22.986 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000132006 2024-09-12T18:36:22.986 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.986 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.986 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:22.986 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.962906+0000", 2024-09-12T18:36:22.986 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8790999999999999e-05 2024-09-12T18:36:22.986 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.986 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.986 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:22.986 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.962938+0000", 2024-09-12T18:36:22.986 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2354000000000002e-05 2024-09-12T18:36:22.986 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:22.987 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:22.987 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:22.987 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.987 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.987 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:90038 5.d 5:bb7792b7:::benchmark_data_smithi073_23739_object90037:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:36:22.987 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:22.955973+0000", 2024-09-12T18:36:22.987 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0067806660000000003, 2024-09-12T18:36:22.987 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00707495, 2024-09-12T18:36:22.987 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:22.987 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:22.987 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:22.987 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:22.987 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:22.988 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:22.988 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 90038 2024-09-12T18:36:22.988 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.988 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:22.988 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.988 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:22.988 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.955973+0000", 2024-09-12T18:36:22.988 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:22.988 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.988 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.988 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:22.988 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.955973+0000", 2024-09-12T18:36:22.988 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:22.989 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.989 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.989 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:22.989 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.955974+0000", 2024-09-12T18:36:22.989 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0899999999999999e-06 2024-09-12T18:36:22.989 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.989 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.989 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:22.989 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.956017+0000", 2024-09-12T18:36:22.989 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3291000000000003e-05 2024-09-12T18:36:22.989 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.989 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.989 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:22.990 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.956032+0000", 2024-09-12T18:36:22.990 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4090000000000001e-05 2024-09-12T18:36:22.990 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.990 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.990 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.990 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.956039+0000", 2024-09-12T18:36:22.990 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6669999999999996e-06 2024-09-12T18:36:22.990 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.990 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.990 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:22.990 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.956090+0000", 2024-09-12T18:36:22.990 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0470000000000003e-05 2024-09-12T18:36:22.990 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.990 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.991 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:22.991 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.956242+0000", 2024-09-12T18:36:22.991 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015186999999999999 2024-09-12T18:36:22.991 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.991 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.991 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:22.991 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.956428+0000", 2024-09-12T18:36:22.991 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00018664800000000001 2024-09-12T18:36:22.991 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.991 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.991 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:22.991 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.961654+0000", 2024-09-12T18:36:22.992 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052258579999999999 2024-09-12T18:36:22.992 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:22.992 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:22.992 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:22.992 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.992 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.992 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:90041 5.d 5:b6e051ab:::benchmark_data_smithi073_23739_object90040:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:36:22.992 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:22.956650+0000", 2024-09-12T18:36:22.992 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0061035250000000003, 2024-09-12T18:36:22.992 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065196359999999997, 2024-09-12T18:36:22.992 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:22.992 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:22.992 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:22.993 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:22.993 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:22.993 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:22.993 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 90041 2024-09-12T18:36:22.993 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.993 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:22.993 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.993 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:22.993 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.956650+0000", 2024-09-12T18:36:22.993 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:22.993 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.993 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.993 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:22.993 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.956650+0000", 2024-09-12T18:36:22.994 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:22.994 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.994 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.994 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:22.994 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.956651+0000", 2024-09-12T18:36:22.994 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3300000000000002e-07 2024-09-12T18:36:22.994 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.994 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.994 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:22.994 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.956685+0000", 2024-09-12T18:36:22.994 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3995000000000002e-05 2024-09-12T18:36:22.994 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.994 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.995 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:22.995 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.956693+0000", 2024-09-12T18:36:22.995 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9270000000000005e-06 2024-09-12T18:36:22.995 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.995 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.995 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.995 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.956700+0000", 2024-09-12T18:36:22.995 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2849999999999997e-06 2024-09-12T18:36:22.995 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.995 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.995 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:22.995 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.959215+0000", 2024-09-12T18:36:22.995 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025150620000000002 2024-09-12T18:36:22.995 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.996 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.996 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:22.996 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.959312+0000", 2024-09-12T18:36:22.996 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6747000000000001e-05 2024-09-12T18:36:22.996 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.996 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.996 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:22.996 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.959397+0000", 2024-09-12T18:36:22.996 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4764000000000004e-05 2024-09-12T18:36:22.996 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:22.996 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:22.996 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:22.996 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.997 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.997 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:90042 5.e 5:78199196:::benchmark_data_smithi073_23739_object90041:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:36:22.997 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:22.959162+0000", 2024-09-12T18:36:22.997 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.003591491, 2024-09-12T18:36:22.997 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00405537, 2024-09-12T18:36:22.997 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:22.997 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:22.997 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:22.997 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:22.997 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:22.997 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:22.997 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 90042 2024-09-12T18:36:22.998 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.998 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:22.998 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.998 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:22.998 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.959162+0000", 2024-09-12T18:36:22.998 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:22.998 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.998 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.998 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:22.998 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.959162+0000", 2024-09-12T18:36:22.998 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:22.998 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.998 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.998 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:22.998 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.959164+0000", 2024-09-12T18:36:22.998 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.269e-06 2024-09-12T18:36:22.999 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.999 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.999 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:22.999 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.959234+0000", 2024-09-12T18:36:22.999 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0489999999999998e-05 2024-09-12T18:36:22.999 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.999 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.999 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:22.999 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.959245+0000", 2024-09-12T18:36:22.999 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1117e-05 2024-09-12T18:36:22.999 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:22.999 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:22.999 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:22.999 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.959254+0000", 2024-09-12T18:36:22.999 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4959999999999996e-06 2024-09-12T18:36:23.000 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.000 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.000 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:23.000 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.959306+0000", 2024-09-12T18:36:23.000 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2720999999999999e-05 2024-09-12T18:36:23.000 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.000 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.000 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:23.000 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.959382+0000", 2024-09-12T18:36:23.000 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6097e-05 2024-09-12T18:36:23.000 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.000 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.000 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:23.000 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.959463+0000", 2024-09-12T18:36:23.000 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0376000000000004e-05 2024-09-12T18:36:23.001 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.001 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:23.001 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.001 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.001 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.001 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:90043 5.8 5:1861505f:::benchmark_data_smithi073_23739_object90042:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:36:23.001 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:22.959276+0000", 2024-09-12T18:36:23.001 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0034777380000000002, 2024-09-12T18:36:23.001 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0039806930000000004, 2024-09-12T18:36:23.001 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:23.001 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:23.001 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:23.002 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:23.002 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:23.002 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:23.002 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 90043 2024-09-12T18:36:23.002 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.002 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:23.002 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.002 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:23.002 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.959276+0000", 2024-09-12T18:36:23.002 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.002 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.002 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.002 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:23.002 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.959276+0000", 2024-09-12T18:36:23.003 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.003 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.003 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.003 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:23.003 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.959277+0000", 2024-09-12T18:36:23.003 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6899999999999996e-07 2024-09-12T18:36:23.003 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.003 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.003 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:23.003 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.959329+0000", 2024-09-12T18:36:23.003 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1990000000000002e-05 2024-09-12T18:36:23.003 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.003 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.004 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:23.004 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.959339+0000", 2024-09-12T18:36:23.004 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0001e-05 2024-09-12T18:36:23.004 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.004 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.004 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:23.004 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.959348+0000", 2024-09-12T18:36:23.004 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2599999999999994e-06 2024-09-12T18:36:23.004 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.004 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.004 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:23.004 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.960849+0000", 2024-09-12T18:36:23.005 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001501269 2024-09-12T18:36:23.005 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.005 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.005 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:23.005 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.960960+0000", 2024-09-12T18:36:23.005 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000110825 2024-09-12T18:36:23.005 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.005 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.005 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:23.005 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.961042+0000", 2024-09-12T18:36:23.005 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2205000000000003e-05 2024-09-12T18:36:23.005 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.005 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:23.005 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.006 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.006 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.006 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:90044 5.e 5:70580e92:::benchmark_data_smithi073_23739_object90043:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:36:23.006 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:22.959361+0000", 2024-09-12T18:36:23.006 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.003393255, 2024-09-12T18:36:23.006 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0040287709999999996, 2024-09-12T18:36:23.006 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:23.006 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:23.006 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:23.006 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:23.006 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:23.006 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:23.006 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 90044 2024-09-12T18:36:23.006 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.006 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:23.007 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.007 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:23.007 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.959361+0000", 2024-09-12T18:36:23.007 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.007 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.007 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.007 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:23.007 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.959361+0000", 2024-09-12T18:36:23.007 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.007 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.007 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.007 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:23.007 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.959361+0000", 2024-09-12T18:36:23.007 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0500000000000003e-07 2024-09-12T18:36:23.008 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.008 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.008 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:23.008 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.959391+0000", 2024-09-12T18:36:23.008 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0023999999999999e-05 2024-09-12T18:36:23.008 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.008 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.008 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:23.008 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.959400+0000", 2024-09-12T18:36:23.008 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5490000000000006e-06 2024-09-12T18:36:23.008 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.008 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.008 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:23.008 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.959406+0000", 2024-09-12T18:36:23.009 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1870000000000002e-06 2024-09-12T18:36:23.009 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.009 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.009 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:23.009 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.961644+0000", 2024-09-12T18:36:23.009 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022379589999999999 2024-09-12T18:36:23.009 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.009 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.009 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:23.009 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.961726+0000", 2024-09-12T18:36:23.009 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2489000000000003e-05 2024-09-12T18:36:23.009 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.009 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.009 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:23.010 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.961833+0000", 2024-09-12T18:36:23.010 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010634299999999999 2024-09-12T18:36:23.010 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.010 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:23.010 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.010 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.010 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.010 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:90045 5.0 5:0481b7d0:::benchmark_data_smithi073_23739_object90044:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:36:23.010 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:22.959473+0000", 2024-09-12T18:36:23.010 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0032808970000000001, 2024-09-12T18:36:23.010 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.004011733, 2024-09-12T18:36:23.010 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:23.010 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:23.010 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:23.011 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:23.011 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:23.011 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:23.011 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 90045 2024-09-12T18:36:23.011 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.011 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:23.011 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.011 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:23.011 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.959473+0000", 2024-09-12T18:36:23.011 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.011 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.011 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.011 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:23.011 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.959473+0000", 2024-09-12T18:36:23.012 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.012 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.012 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.012 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:23.012 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.959474+0000", 2024-09-12T18:36:23.012 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7000000000000003e-07 2024-09-12T18:36:23.012 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.012 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.012 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:23.012 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.959562+0000", 2024-09-12T18:36:23.012 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8368000000000005e-05 2024-09-12T18:36:23.012 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.012 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.012 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:23.013 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.959577+0000", 2024-09-12T18:36:23.013 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4748e-05 2024-09-12T18:36:23.013 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.013 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.013 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:23.013 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.959584+0000", 2024-09-12T18:36:23.013 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9090000000000003e-06 2024-09-12T18:36:23.013 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.013 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.013 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:23.013 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.963059+0000", 2024-09-12T18:36:23.013 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0034751000000000001 2024-09-12T18:36:23.013 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.013 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.014 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:23.014 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.963160+0000", 2024-09-12T18:36:23.014 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000101531 2024-09-12T18:36:23.014 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.014 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.014 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:23.014 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.963298+0000", 2024-09-12T18:36:23.014 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013788299999999999 2024-09-12T18:36:23.014 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.014 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:23.014 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.014 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.014 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-09-12T18:36:23.014 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 11 2024-09-12T18:36:23.015 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:23.016 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:36:23.017 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:23.011+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:23.117 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:23.115+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:23.213 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:23.213 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-09-12T18:36:23.213 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-09-12T18:36:23.213 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-09-12T18:36:23.213 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:23.217 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:23.212+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:23.233 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:36:23.254 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:36:23.320 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:23.319+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:23.415 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:36:23.415 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:36:23.419 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:23.416+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:23.433 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:23.433 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-09-12T18:36:23.433 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-09-12T18:36:23.433 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:36:23.433 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.433 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:23.433 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:23.433 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 57.797996832999999, 2024-09-12T18:36:23.433 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025088781000000001, 2024-09-12T18:36:23.433 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:23.434 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:23.434 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:23.434 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:23.434 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.434 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:23.434 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:23.434 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.434 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.434 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.434 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:23.434 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:23.434 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.434 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.435 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.435 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:23.435 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632518+0000", 2024-09-12T18:36:23.435 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:36:23.435 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.435 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.435 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:23.435 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632533+0000", 2024-09-12T18:36:23.435 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5130000000000001e-05 2024-09-12T18:36:23.435 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.435 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.435 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:23.435 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632564+0000", 2024-09-12T18:36:23.435 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0788999999999999e-05 2024-09-12T18:36:23.436 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.436 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.436 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:23.436 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632590+0000", 2024-09-12T18:36:23.436 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6057000000000001e-05 2024-09-12T18:36:23.436 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.436 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.436 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:23.436 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.635931+0000", 2024-09-12T18:36:23.436 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033411320000000001 2024-09-12T18:36:23.436 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.436 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.436 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:23.437 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636186+0000", 2024-09-12T18:36:23.437 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025452500000000002 2024-09-12T18:36:23.437 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.437 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.437 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:23.437 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636445+0000", 2024-09-12T18:36:23.437 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000259268 2024-09-12T18:36:23.437 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.437 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.437 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:23.437 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639562+0000", 2024-09-12T18:36:23.437 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031167 2024-09-12T18:36:23.437 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.438 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.438 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:23.438 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657314+0000", 2024-09-12T18:36:23.438 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017752562 2024-09-12T18:36:23.438 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.438 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.438 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:23.438 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657445+0000", 2024-09-12T18:36:23.438 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013105899999999999 2024-09-12T18:36:23.438 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.438 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.438 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:23.438 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657598+0000", 2024-09-12T18:36:23.439 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015247899999999999 2024-09-12T18:36:23.439 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.439 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:23.439 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.439 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.439 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.439 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:23.439 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:23.439 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 57.797870629999998, 2024-09-12T18:36:23.439 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025643131999999999, 2024-09-12T18:36:23.439 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:23.439 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:23.439 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:23.440 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:23.440 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.440 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:23.440 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:23.440 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.440 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.440 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.440 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:23.440 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:23.440 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.440 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.440 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.441 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:23.441 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632637+0000", 2024-09-12T18:36:23.441 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5600000000000001e-06 2024-09-12T18:36:23.441 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.441 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.441 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:23.441 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632650+0000", 2024-09-12T18:36:23.441 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3186e-05 2024-09-12T18:36:23.441 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.441 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.441 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:23.441 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632672+0000", 2024-09-12T18:36:23.441 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2013000000000001e-05 2024-09-12T18:36:23.442 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.442 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.442 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:23.442 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632687+0000", 2024-09-12T18:36:23.442 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5109999999999999e-05 2024-09-12T18:36:23.442 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.442 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.442 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:23.442 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636994+0000", 2024-09-12T18:36:23.442 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0043065539999999998 2024-09-12T18:36:23.442 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.442 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.442 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:23.443 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637198+0000", 2024-09-12T18:36:23.443 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020387199999999999 2024-09-12T18:36:23.443 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.443 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.443 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:23.443 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637475+0000", 2024-09-12T18:36:23.443 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027731000000000001 2024-09-12T18:36:23.443 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.443 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.443 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:23.443 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639574+0000", 2024-09-12T18:36:23.443 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020988999999999999 2024-09-12T18:36:23.443 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.444 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.444 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:23.444 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658057+0000", 2024-09-12T18:36:23.444 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018482926 2024-09-12T18:36:23.444 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.444 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.444 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:23.444 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658184+0000", 2024-09-12T18:36:23.444 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012756200000000001 2024-09-12T18:36:23.444 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.444 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.444 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:23.445 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658278+0000", 2024-09-12T18:36:23.445 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4139000000000001e-05 2024-09-12T18:36:23.445 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.445 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:23.445 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.445 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.445 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.445 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:23.445 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:23.445 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 57.797795538000003, 2024-09-12T18:36:23.445 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025238883, 2024-09-12T18:36:23.445 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:23.445 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:23.445 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:23.446 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:23.446 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.446 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:23.446 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:23.446 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.446 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.446 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.446 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:23.446 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:23.446 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.446 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.446 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.446 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:23.447 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632712+0000", 2024-09-12T18:36:23.447 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6869999999999999e-06 2024-09-12T18:36:23.447 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.447 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.447 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:23.447 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632719+0000", 2024-09-12T18:36:23.447 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6059999999999999e-06 2024-09-12T18:36:23.447 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.447 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.447 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:23.447 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632737+0000", 2024-09-12T18:36:23.447 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7983999999999999e-05 2024-09-12T18:36:23.447 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.448 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.448 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:23.448 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632751+0000", 2024-09-12T18:36:23.448 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4473e-05 2024-09-12T18:36:23.448 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.448 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.448 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:23.448 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636961+0000", 2024-09-12T18:36:23.448 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042100840000000002 2024-09-12T18:36:23.448 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.448 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.448 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:23.449 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637211+0000", 2024-09-12T18:36:23.449 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000249738 2024-09-12T18:36:23.449 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.449 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.449 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:23.449 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637504+0000", 2024-09-12T18:36:23.449 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00029271499999999998 2024-09-12T18:36:23.449 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.449 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.449 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:23.449 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639582+0000", 2024-09-12T18:36:23.449 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020783389999999998 2024-09-12T18:36:23.449 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.450 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.450 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:23.450 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657709+0000", 2024-09-12T18:36:23.450 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018126758999999999 2024-09-12T18:36:23.450 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.450 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.450 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:23.450 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657830+0000", 2024-09-12T18:36:23.450 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000121329 2024-09-12T18:36:23.450 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.450 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.450 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:23.450 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657949+0000", 2024-09-12T18:36:23.451 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000119169 2024-09-12T18:36:23.451 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.451 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:23.451 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.451 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.451 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.451 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:23.451 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:23.451 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 57.797731491999997, 2024-09-12T18:36:23.451 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026711823999999999, 2024-09-12T18:36:23.451 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:23.451 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:23.451 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:23.451 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:23.452 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.452 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:23.452 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:23.452 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.452 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.452 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.452 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:23.452 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:23.452 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.452 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.452 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.452 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:23.452 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632775+0000", 2024-09-12T18:36:23.453 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9999999999999995e-07 2024-09-12T18:36:23.453 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.453 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.453 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:23.453 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632788+0000", 2024-09-12T18:36:23.453 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2629999999999999e-05 2024-09-12T18:36:23.453 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.453 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.453 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:23.453 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632806+0000", 2024-09-12T18:36:23.453 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:36:23.453 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.453 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.454 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:23.454 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632820+0000", 2024-09-12T18:36:23.454 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3777e-05 2024-09-12T18:36:23.454 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.454 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.454 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:23.454 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638310+0000", 2024-09-12T18:36:23.454 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054898280000000004 2024-09-12T18:36:23.454 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.454 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.454 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:23.454 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638480+0000", 2024-09-12T18:36:23.454 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016968199999999999 2024-09-12T18:36:23.455 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.455 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.455 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:23.455 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638799+0000", 2024-09-12T18:36:23.455 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031915999999999997 2024-09-12T18:36:23.455 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.455 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.455 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:23.455 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639866+0000", 2024-09-12T18:36:23.455 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001067405 2024-09-12T18:36:23.455 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.455 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.455 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:23.455 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658398+0000", 2024-09-12T18:36:23.456 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018531542000000002 2024-09-12T18:36:23.456 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.456 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.456 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:23.456 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658643+0000", 2024-09-12T18:36:23.456 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00024531500000000002 2024-09-12T18:36:23.456 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.456 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.456 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:23.456 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.659486+0000", 2024-09-12T18:36:23.456 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00084316899999999995 2024-09-12T18:36:23.456 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.456 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:23.457 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.457 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.457 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.457 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:23.457 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:36:23.457 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 57.797504430000004, 2024-09-12T18:36:23.457 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.021357139000000001, 2024-09-12T18:36:23.457 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:23.457 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:23.457 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:23.457 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:23.457 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.457 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:23.458 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:36:23.458 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.458 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.458 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.458 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:23.458 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:36:23.458 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.458 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.458 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.458 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:23.458 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633003+0000", 2024-09-12T18:36:23.458 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.53e-06 2024-09-12T18:36:23.458 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.459 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.459 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:23.459 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633012+0000", 2024-09-12T18:36:23.459 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9290000000000004e-06 2024-09-12T18:36:23.459 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.459 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.459 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:23.459 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633034+0000", 2024-09-12T18:36:23.459 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2127e-05 2024-09-12T18:36:23.459 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.459 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.459 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:23.459 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633054+0000", 2024-09-12T18:36:23.459 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9476000000000001e-05 2024-09-12T18:36:23.460 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.460 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.460 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:23.460 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636657+0000", 2024-09-12T18:36:23.460 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036038839999999999 2024-09-12T18:36:23.460 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.460 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.460 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:23.460 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636885+0000", 2024-09-12T18:36:23.460 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022798800000000001 2024-09-12T18:36:23.460 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.460 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.460 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:23.461 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637189+0000", 2024-09-12T18:36:23.461 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030392100000000002 2024-09-12T18:36:23.461 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.461 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.461 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:23.461 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639271+0000", 2024-09-12T18:36:23.461 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020817460000000002 2024-09-12T18:36:23.461 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.461 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.461 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:23.461 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.652371+0000", 2024-09-12T18:36:23.461 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013099417 2024-09-12T18:36:23.461 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.461 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.462 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:23.462 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654255+0000", 2024-09-12T18:36:23.462 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018846049999999999 2024-09-12T18:36:23.462 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.462 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.462 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:23.462 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654359+0000", 2024-09-12T18:36:23.462 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000103516 2024-09-12T18:36:23.462 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.462 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:23.462 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.462 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.463 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.463 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:23.463 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:23.463 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 57.797422738000002, 2024-09-12T18:36:23.463 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026938645000000001, 2024-09-12T18:36:23.463 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:23.463 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:23.463 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:23.463 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:23.463 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.463 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:23.463 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:23.463 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.463 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.464 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.464 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:23.464 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:23.464 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.464 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.464 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.464 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:23.464 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633085+0000", 2024-09-12T18:36:23.464 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:23.464 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.464 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.464 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:23.465 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633093+0000", 2024-09-12T18:36:23.465 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3999999999999992e-06 2024-09-12T18:36:23.465 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.465 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.465 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:23.465 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633111+0000", 2024-09-12T18:36:23.465 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8070000000000001e-05 2024-09-12T18:36:23.465 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.465 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.465 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:23.465 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633126+0000", 2024-09-12T18:36:23.465 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4487e-05 2024-09-12T18:36:23.465 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.465 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.466 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:23.466 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638290+0000", 2024-09-12T18:36:23.466 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0051640269999999999 2024-09-12T18:36:23.466 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.466 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.466 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:23.466 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638547+0000", 2024-09-12T18:36:23.466 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025714100000000001 2024-09-12T18:36:23.466 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.466 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.466 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:23.466 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638850+0000", 2024-09-12T18:36:23.466 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030278400000000001 2024-09-12T18:36:23.467 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.467 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.467 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:23.467 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.640706+0000", 2024-09-12T18:36:23.467 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018564580000000001 2024-09-12T18:36:23.467 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.467 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.467 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:23.467 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658420+0000", 2024-09-12T18:36:23.467 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017714395000000001 2024-09-12T18:36:23.467 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.467 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.467 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:23.468 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658635+0000", 2024-09-12T18:36:23.468 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021413500000000001 2024-09-12T18:36:23.468 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.468 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.468 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:23.468 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.660022+0000", 2024-09-12T18:36:23.468 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001387318 2024-09-12T18:36:23.468 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.468 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:23.468 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.468 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.468 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.469 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:23.469 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:36:23.469 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 57.797078227, 2024-09-12T18:36:23.469 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.020709867, 2024-09-12T18:36:23.469 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:23.469 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:23.469 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:23.469 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:23.469 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.469 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:23.469 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:36:23.469 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.470 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.470 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.470 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:23.470 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:36:23.470 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.470 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.470 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.470 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:23.470 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633429+0000", 2024-09-12T18:36:23.470 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.313e-06 2024-09-12T18:36:23.470 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.470 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.470 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:23.471 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633462+0000", 2024-09-12T18:36:23.471 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3197000000000001e-05 2024-09-12T18:36:23.471 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.471 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.471 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:23.471 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633485+0000", 2024-09-12T18:36:23.471 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3243000000000001e-05 2024-09-12T18:36:23.471 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.471 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.471 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:23.471 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633501+0000", 2024-09-12T18:36:23.471 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5383000000000002e-05 2024-09-12T18:36:23.471 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.472 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.472 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:23.472 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633642+0000", 2024-09-12T18:36:23.472 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000141168 2024-09-12T18:36:23.472 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.472 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.472 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:23.472 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633982+0000", 2024-09-12T18:36:23.472 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000340067 2024-09-12T18:36:23.472 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.472 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.472 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:23.472 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654138+0000", 2024-09-12T18:36:23.472 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.020155495999999998 2024-09-12T18:36:23.473 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.473 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:23.473 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.473 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.473 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.473 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:49141 5.d 5:bce526e5:::benchmark_data_smithi073_23739_object49140:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T18:36:23.473 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:03.538808+0000", 2024-09-12T18:36:23.473 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 19.891698180999999, 2024-09-12T18:36:23.473 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.019659019, 2024-09-12T18:36:23.473 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:23.473 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:23.473 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:23.473 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:23.474 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:23.474 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:23.474 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 49141 2024-09-12T18:36:23.474 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.474 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:23.474 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.474 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:23.474 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538808+0000", 2024-09-12T18:36:23.474 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.474 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.474 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.474 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:23.474 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538808+0000", 2024-09-12T18:36:23.474 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.475 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.475 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.475 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:23.475 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538809+0000", 2024-09-12T18:36:23.475 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.065e-06 2024-09-12T18:36:23.475 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.475 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.475 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:23.475 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538914+0000", 2024-09-12T18:36:23.475 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010528599999999999 2024-09-12T18:36:23.475 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.475 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.475 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:23.476 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538924+0000", 2024-09-12T18:36:23.476 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4420000000000004e-06 2024-09-12T18:36:23.476 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.476 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.476 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:23.476 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538944+0000", 2024-09-12T18:36:23.476 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0460000000000001e-05 2024-09-12T18:36:23.476 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.476 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.476 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:23.476 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.539034+0000", 2024-09-12T18:36:23.476 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9512000000000006e-05 2024-09-12T18:36:23.476 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.476 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.477 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:23.477 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.539161+0000", 2024-09-12T18:36:23.477 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012782399999999999 2024-09-12T18:36:23.477 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.477 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.477 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:23.477 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.539246+0000", 2024-09-12T18:36:23.477 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4927999999999997e-05 2024-09-12T18:36:23.477 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.477 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.477 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:23.477 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.541390+0000", 2024-09-12T18:36:23.478 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0021439509999999998 2024-09-12T18:36:23.478 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.478 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.478 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:23.478 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.558236+0000", 2024-09-12T18:36:23.478 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016845619999999999 2024-09-12T18:36:23.478 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.478 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.478 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:23.478 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.558368+0000", 2024-09-12T18:36:23.478 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013241300000000001 2024-09-12T18:36:23.478 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.478 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.479 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:23.479 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.558467+0000", 2024-09-12T18:36:23.479 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8517999999999994e-05 2024-09-12T18:36:23.479 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.479 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:23.479 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.479 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.479 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.479 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:52993 5.0 5:00f9e688:::benchmark_data_smithi073_23739_object52992:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:36:23.479 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:05.209109+0000", 2024-09-12T18:36:23.479 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 18.221397108000001, 2024-09-12T18:36:23.479 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017556391000000001, 2024-09-12T18:36:23.479 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:23.479 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:23.480 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:23.480 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:23.480 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:23.480 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:23.480 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 52993 2024-09-12T18:36:23.480 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.480 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:23.480 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.480 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:23.480 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.209109+0000", 2024-09-12T18:36:23.480 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.480 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.480 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.481 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:23.481 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.209109+0000", 2024-09-12T18:36:23.481 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.481 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.481 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.481 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:23.481 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.209110+0000", 2024-09-12T18:36:23.481 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8000000000000004e-07 2024-09-12T18:36:23.481 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.481 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.481 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:23.481 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.209246+0000", 2024-09-12T18:36:23.481 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013595 2024-09-12T18:36:23.482 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.482 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.482 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:23.482 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.209256+0000", 2024-09-12T18:36:23.482 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9580000000000002e-06 2024-09-12T18:36:23.482 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.482 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.482 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:23.482 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.209262+0000", 2024-09-12T18:36:23.482 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7950000000000002e-06 2024-09-12T18:36:23.482 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.482 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.482 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:23.483 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.212362+0000", 2024-09-12T18:36:23.483 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003099606 2024-09-12T18:36:23.483 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.483 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.483 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:23.483 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.212569+0000", 2024-09-12T18:36:23.483 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020737699999999999 2024-09-12T18:36:23.483 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.483 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.483 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:23.483 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.212907+0000", 2024-09-12T18:36:23.483 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00033730499999999998 2024-09-12T18:36:23.483 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.483 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.484 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:23.484 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.226511+0000", 2024-09-12T18:36:23.484 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.01360451 2024-09-12T18:36:23.484 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.484 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.484 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:23.484 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.226567+0000", 2024-09-12T18:36:23.484 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5371000000000002e-05 2024-09-12T18:36:23.484 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.484 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.484 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:23.484 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.226624+0000", 2024-09-12T18:36:23.485 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7355999999999998e-05 2024-09-12T18:36:23.485 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.485 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.485 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:23.485 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.226665+0000", 2024-09-12T18:36:23.485 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1282999999999998e-05 2024-09-12T18:36:23.485 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.485 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:23.485 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.485 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.485 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.485 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:61561 5.e 5:715fe5e4:::benchmark_data_smithi073_23739_object61560:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:36:23.485 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:09.221864+0000", 2024-09-12T18:36:23.486 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 14.208641766, 2024-09-12T18:36:23.486 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017993663999999999, 2024-09-12T18:36:23.486 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:23.486 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:23.486 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:23.486 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:23.486 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:23.486 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:23.486 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 61561 2024-09-12T18:36:23.486 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.486 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:23.486 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.486 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:23.487 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.221864+0000", 2024-09-12T18:36:23.487 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.487 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.487 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.487 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:23.487 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.221864+0000", 2024-09-12T18:36:23.487 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.487 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.487 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.487 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:23.487 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.221865+0000", 2024-09-12T18:36:23.487 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1310000000000001e-06 2024-09-12T18:36:23.487 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.487 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.488 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:23.488 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222022+0000", 2024-09-12T18:36:23.488 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015628500000000001 2024-09-12T18:36:23.488 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.488 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.488 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:23.488 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222034+0000", 2024-09-12T18:36:23.488 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2481e-05 2024-09-12T18:36:23.488 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.488 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.488 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:23.488 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222041+0000", 2024-09-12T18:36:23.488 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7469999999999999e-06 2024-09-12T18:36:23.489 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.489 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.489 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:23.489 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222103+0000", 2024-09-12T18:36:23.489 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1903999999999995e-05 2024-09-12T18:36:23.489 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.489 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.489 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:23.489 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222199+0000", 2024-09-12T18:36:23.489 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6664999999999997e-05 2024-09-12T18:36:23.489 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.489 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.489 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:23.490 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222286+0000", 2024-09-12T18:36:23.490 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6582999999999994e-05 2024-09-12T18:36:23.490 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.490 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.490 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:23.490 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.228622+0000", 2024-09-12T18:36:23.490 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063357520000000001 2024-09-12T18:36:23.490 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.490 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.490 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:23.490 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.239753+0000", 2024-09-12T18:36:23.490 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011131709 2024-09-12T18:36:23.490 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.490 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.491 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:23.491 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.239813+0000", 2024-09-12T18:36:23.491 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0007999999999999e-05 2024-09-12T18:36:23.491 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.491 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.491 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:23.491 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.239858+0000", 2024-09-12T18:36:23.491 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4399e-05 2024-09-12T18:36:23.491 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.491 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:23.491 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.491 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.491 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.492 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:77241 5.b 5:d9973dc8:::benchmark_data_smithi073_23739_object77240:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:23.492 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:16.792553+0000", 2024-09-12T18:36:23.492 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 6.6379525570000002, 2024-09-12T18:36:23.492 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.019966754999999999, 2024-09-12T18:36:23.492 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:23.492 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:23.492 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:23.492 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:23.492 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:23.492 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:23.492 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 77241 2024-09-12T18:36:23.492 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.492 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:23.493 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.493 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:23.493 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.792553+0000", 2024-09-12T18:36:23.493 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.493 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.493 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.493 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:23.493 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.792553+0000", 2024-09-12T18:36:23.493 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.493 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.493 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.493 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:23.493 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.792554+0000", 2024-09-12T18:36:23.494 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.16e-07 2024-09-12T18:36:23.494 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.494 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.494 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:23.494 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.792661+0000", 2024-09-12T18:36:23.494 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000106909 2024-09-12T18:36:23.494 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.494 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.494 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:23.494 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.792671+0000", 2024-09-12T18:36:23.494 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0268000000000001e-05 2024-09-12T18:36:23.494 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.494 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.495 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:23.495 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.792678+0000", 2024-09-12T18:36:23.495 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7510000000000002e-06 2024-09-12T18:36:23.495 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.495 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.495 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:23.495 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.794730+0000", 2024-09-12T18:36:23.495 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002051794 2024-09-12T18:36:23.495 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.495 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.495 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:23.495 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.794857+0000", 2024-09-12T18:36:23.495 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012728500000000001 2024-09-12T18:36:23.495 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.496 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.496 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:23.496 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.794987+0000", 2024-09-12T18:36:23.496 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012996899999999999 2024-09-12T18:36:23.496 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.496 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.496 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:23.496 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.797553+0000", 2024-09-12T18:36:23.496 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025652980000000001 2024-09-12T18:36:23.496 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.496 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.496 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:23.496 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.812460+0000", 2024-09-12T18:36:23.497 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.014907884 2024-09-12T18:36:23.497 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.497 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.497 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:23.497 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.812494+0000", 2024-09-12T18:36:23.497 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3525000000000002e-05 2024-09-12T18:36:23.497 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.497 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.497 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:23.497 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.812520+0000", 2024-09-12T18:36:23.497 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6156000000000002e-05 2024-09-12T18:36:23.497 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.498 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:23.498 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.498 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.498 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.498 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:77253 5.b 5:df1f7025:::benchmark_data_smithi073_23739_object77252:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:23.498 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:16.798099+0000", 2024-09-12T18:36:23.498 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 6.6324068670000003, 2024-09-12T18:36:23.498 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0182598, 2024-09-12T18:36:23.498 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:23.498 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:23.498 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:23.498 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:23.498 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:23.498 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:23.499 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 77253 2024-09-12T18:36:23.499 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.499 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:23.499 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.499 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:23.499 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798099+0000", 2024-09-12T18:36:23.499 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.499 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.499 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.499 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:23.499 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798099+0000", 2024-09-12T18:36:23.499 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.499 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.500 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.500 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:23.500 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798100+0000", 2024-09-12T18:36:23.500 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2449999999999999e-06 2024-09-12T18:36:23.500 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.500 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.500 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:23.500 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798159+0000", 2024-09-12T18:36:23.500 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8925999999999998e-05 2024-09-12T18:36:23.500 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.500 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.500 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:23.500 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798171+0000", 2024-09-12T18:36:23.501 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.206e-05 2024-09-12T18:36:23.501 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.501 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.501 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:23.501 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798178+0000", 2024-09-12T18:36:23.501 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9009999999999997e-06 2024-09-12T18:36:23.501 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.501 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.501 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:23.501 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798227+0000", 2024-09-12T18:36:23.501 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8794000000000001e-05 2024-09-12T18:36:23.501 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.501 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.502 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:23.502 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798314+0000", 2024-09-12T18:36:23.502 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7322000000000002e-05 2024-09-12T18:36:23.502 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.502 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.502 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:23.502 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798417+0000", 2024-09-12T18:36:23.502 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000102777 2024-09-12T18:36:23.502 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.502 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.502 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:23.502 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.800633+0000", 2024-09-12T18:36:23.502 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022157740000000002 2024-09-12T18:36:23.502 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.503 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.503 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:23.503 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.816295+0000", 2024-09-12T18:36:23.503 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015662359000000001 2024-09-12T18:36:23.503 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.503 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.503 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:23.503 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.816330+0000", 2024-09-12T18:36:23.503 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4353999999999997e-05 2024-09-12T18:36:23.503 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.503 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.503 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:23.503 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.816359+0000", 2024-09-12T18:36:23.504 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9288000000000001e-05 2024-09-12T18:36:23.504 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.504 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:23.504 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.504 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.504 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.504 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:80117 5.e 5:713efd60:::benchmark_data_smithi073_23739_object80116:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:23.504 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:18.149805+0000", 2024-09-12T18:36:23.504 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.2807012990000004, 2024-09-12T18:36:23.504 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018173544, 2024-09-12T18:36:23.504 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:23.504 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:23.504 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:23.505 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:23.505 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:23.505 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:23.505 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 80117 2024-09-12T18:36:23.505 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.505 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:23.505 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.505 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:23.505 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.149805+0000", 2024-09-12T18:36:23.505 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.505 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.505 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.505 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:23.506 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.149805+0000", 2024-09-12T18:36:23.506 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.506 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.506 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.506 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:23.506 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.149805+0000", 2024-09-12T18:36:23.506 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2399999999999997e-07 2024-09-12T18:36:23.506 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.506 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.506 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:23.506 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.149842+0000", 2024-09-12T18:36:23.506 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6396000000000002e-05 2024-09-12T18:36:23.506 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.507 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.507 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:23.507 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.149855+0000", 2024-09-12T18:36:23.507 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3247999999999999e-05 2024-09-12T18:36:23.507 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.507 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.507 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:23.507 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.149863+0000", 2024-09-12T18:36:23.507 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9189999999999999e-06 2024-09-12T18:36:23.507 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.507 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.507 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:23.507 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.155735+0000", 2024-09-12T18:36:23.507 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0058721600000000004 2024-09-12T18:36:23.508 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.508 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.508 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:23.508 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.155868+0000", 2024-09-12T18:36:23.508 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013283500000000001 2024-09-12T18:36:23.508 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.508 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.508 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:23.508 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.156033+0000", 2024-09-12T18:36:23.508 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016527999999999999 2024-09-12T18:36:23.508 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.508 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.508 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:23.509 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.160797+0000", 2024-09-12T18:36:23.509 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0047638439999999997 2024-09-12T18:36:23.509 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.509 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.509 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:23.509 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.167881+0000", 2024-09-12T18:36:23.509 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0070834670000000004 2024-09-12T18:36:23.509 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.509 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.509 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:23.509 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.167936+0000", 2024-09-12T18:36:23.509 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5473999999999998e-05 2024-09-12T18:36:23.509 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.510 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.510 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:23.510 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.167978+0000", 2024-09-12T18:36:23.510 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2097e-05 2024-09-12T18:36:23.510 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.510 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:23.510 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.510 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.510 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.510 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:81207 5.0 5:0c89eb16:::benchmark_data_smithi073_23739_object81206:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T18:36:23.510 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:18.680764+0000", 2024-09-12T18:36:23.510 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.749742006, 2024-09-12T18:36:23.510 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017614778000000001, 2024-09-12T18:36:23.510 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:23.511 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:23.511 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:23.511 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:23.511 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:23.511 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:23.511 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 81207 2024-09-12T18:36:23.511 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.511 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:23.511 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.511 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:23.511 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.680764+0000", 2024-09-12T18:36:23.511 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.511 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.512 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.512 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:23.512 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.680764+0000", 2024-09-12T18:36:23.512 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.512 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.512 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.512 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:23.512 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.680765+0000", 2024-09-12T18:36:23.512 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0699999999999999e-06 2024-09-12T18:36:23.512 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.512 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.512 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:23.512 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.680883+0000", 2024-09-12T18:36:23.513 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000117753 2024-09-12T18:36:23.513 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.513 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.513 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:23.513 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.680898+0000", 2024-09-12T18:36:23.513 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5546e-05 2024-09-12T18:36:23.513 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.513 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.513 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:23.513 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.680905+0000", 2024-09-12T18:36:23.513 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0779999999999998e-06 2024-09-12T18:36:23.513 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.513 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.514 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:23.514 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.685631+0000", 2024-09-12T18:36:23.514 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0047256720000000002 2024-09-12T18:36:23.514 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.514 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.514 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:23.514 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.685800+0000", 2024-09-12T18:36:23.514 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016894800000000001 2024-09-12T18:36:23.514 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.514 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.514 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:23.514 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.686022+0000", 2024-09-12T18:36:23.515 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022225399999999999 2024-09-12T18:36:23.515 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.515 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.515 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:23.515 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.693548+0000", 2024-09-12T18:36:23.515 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0075253789999999996 2024-09-12T18:36:23.515 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.515 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.515 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:23.515 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.698317+0000", 2024-09-12T18:36:23.515 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0047689250000000002 2024-09-12T18:36:23.515 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.515 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.516 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:23.516 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.698345+0000", 2024-09-12T18:36:23.516 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8445999999999998e-05 2024-09-12T18:36:23.516 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.516 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.516 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:23.516 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.698379+0000", 2024-09-12T18:36:23.516 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3707000000000001e-05 2024-09-12T18:36:23.516 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.516 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:23.516 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.516 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.516 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.517 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:81208 5.8 5:179b411e:::benchmark_data_smithi073_23739_object81207:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T18:36:23.517 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:18.681140+0000", 2024-09-12T18:36:23.517 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.7493654420000002, 2024-09-12T18:36:23.517 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017405688999999998, 2024-09-12T18:36:23.517 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:23.517 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:23.517 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:23.517 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:23.517 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:23.517 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:23.517 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 81208 2024-09-12T18:36:23.517 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.517 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:23.518 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.518 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:23.518 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.681140+0000", 2024-09-12T18:36:23.518 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.518 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.518 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.518 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:23.518 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.681140+0000", 2024-09-12T18:36:23.518 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.518 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.518 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.518 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:23.519 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.681141+0000", 2024-09-12T18:36:23.519 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3500000000000005e-07 2024-09-12T18:36:23.519 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.519 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.519 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:23.519 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.681238+0000", 2024-09-12T18:36:23.519 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6549e-05 2024-09-12T18:36:23.519 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.519 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.519 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:23.519 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.681255+0000", 2024-09-12T18:36:23.519 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7161999999999999e-05 2024-09-12T18:36:23.519 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.520 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.520 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:23.520 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.681260+0000", 2024-09-12T18:36:23.520 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8910000000000003e-06 2024-09-12T18:36:23.520 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.520 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.520 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:23.520 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.688888+0000", 2024-09-12T18:36:23.520 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076285600000000004 2024-09-12T18:36:23.520 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.520 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.520 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:23.521 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.689159+0000", 2024-09-12T18:36:23.521 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027055100000000001 2024-09-12T18:36:23.521 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.521 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.521 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:23.521 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.689322+0000", 2024-09-12T18:36:23.521 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016309500000000001 2024-09-12T18:36:23.521 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.521 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.521 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:23.521 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.696528+0000", 2024-09-12T18:36:23.521 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0072059209999999997 2024-09-12T18:36:23.521 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.521 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.522 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:23.522 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.698500+0000", 2024-09-12T18:36:23.522 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019720549999999999 2024-09-12T18:36:23.522 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.522 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.522 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:23.522 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.698526+0000", 2024-09-12T18:36:23.522 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5962999999999999e-05 2024-09-12T18:36:23.522 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.522 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.522 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:23.523 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.698546+0000", 2024-09-12T18:36:23.523 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0106999999999999e-05 2024-09-12T18:36:23.523 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.523 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:23.523 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.523 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.523 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.523 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:81220 5.0 5:09982a6e:::benchmark_data_smithi073_23739_object81219:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T18:36:23.523 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:18.687299+0000", 2024-09-12T18:36:23.523 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.7432071789999997, 2024-09-12T18:36:23.523 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017570822999999999, 2024-09-12T18:36:23.523 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:23.524 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:23.524 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:23.524 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:23.524 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:23.524 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:23.524 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 81220 2024-09-12T18:36:23.524 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.524 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:23.524 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.524 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:23.524 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.687299+0000", 2024-09-12T18:36:23.524 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.524 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.525 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.525 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:23.525 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.687299+0000", 2024-09-12T18:36:23.525 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.525 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.525 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.525 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:23.525 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.687299+0000", 2024-09-12T18:36:23.525 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4900000000000001e-07 2024-09-12T18:36:23.525 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.525 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.525 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:23.525 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.687326+0000", 2024-09-12T18:36:23.526 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6784999999999999e-05 2024-09-12T18:36:23.526 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.526 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.526 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:23.526 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.687332+0000", 2024-09-12T18:36:23.526 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1399999999999997e-06 2024-09-12T18:36:23.526 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.526 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.526 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:23.526 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.687336+0000", 2024-09-12T18:36:23.526 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0509999999999998e-06 2024-09-12T18:36:23.526 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.526 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.527 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:23.527 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.693722+0000", 2024-09-12T18:36:23.527 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063860289999999997 2024-09-12T18:36:23.527 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.527 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.527 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:23.527 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.693846+0000", 2024-09-12T18:36:23.527 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012385900000000001 2024-09-12T18:36:23.527 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.527 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.527 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:23.527 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.693957+0000", 2024-09-12T18:36:23.527 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000111425 2024-09-12T18:36:23.528 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.528 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.528 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:23.528 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.698492+0000", 2024-09-12T18:36:23.528 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0045343639999999999 2024-09-12T18:36:23.528 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.528 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.528 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:23.528 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.704787+0000", 2024-09-12T18:36:23.528 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062951980000000001 2024-09-12T18:36:23.528 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.528 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.528 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:23.529 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.704833+0000", 2024-09-12T18:36:23.529 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6174000000000002e-05 2024-09-12T18:36:23.529 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.529 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.529 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:23.529 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.704870+0000", 2024-09-12T18:36:23.529 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6449000000000003e-05 2024-09-12T18:36:23.529 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.529 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:23.529 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.529 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.529 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.529 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:81237 5.8 5:135141da:::benchmark_data_smithi073_23739_object81236:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T18:36:23.530 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:18.696120+0000", 2024-09-12T18:36:23.530 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.7343862989999996, 2024-09-12T18:36:23.530 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017490036, 2024-09-12T18:36:23.530 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:23.530 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:23.530 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:23.530 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:23.530 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:23.530 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:23.530 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 81237 2024-09-12T18:36:23.530 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.530 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:23.530 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.530 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:23.531 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.696120+0000", 2024-09-12T18:36:23.531 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.531 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.531 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.531 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:23.531 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.696120+0000", 2024-09-12T18:36:23.531 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.531 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.531 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.531 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:23.531 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.696120+0000", 2024-09-12T18:36:23.531 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1500000000000005e-07 2024-09-12T18:36:23.531 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.532 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.532 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:23.532 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.696214+0000", 2024-09-12T18:36:23.532 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.3523000000000006e-05 2024-09-12T18:36:23.532 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.532 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.532 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:23.532 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.696220+0000", 2024-09-12T18:36:23.532 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7089999999999996e-06 2024-09-12T18:36:23.532 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.532 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.532 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:23.532 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.696225+0000", 2024-09-12T18:36:23.533 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.69e-06 2024-09-12T18:36:23.533 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.533 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.533 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:23.533 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.704806+0000", 2024-09-12T18:36:23.533 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0085810469999999996 2024-09-12T18:36:23.533 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.533 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.533 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:23.533 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.704929+0000", 2024-09-12T18:36:23.533 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012257199999999999 2024-09-12T18:36:23.533 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.533 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.534 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:23.534 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.705016+0000", 2024-09-12T18:36:23.534 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7379999999999993e-05 2024-09-12T18:36:23.534 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.534 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.534 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:23.534 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.708982+0000", 2024-09-12T18:36:23.534 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0039663019999999997 2024-09-12T18:36:23.534 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.534 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.534 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:23.534 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.713547+0000", 2024-09-12T18:36:23.534 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0045647129999999998 2024-09-12T18:36:23.535 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.535 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.535 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:23.535 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.713587+0000", 2024-09-12T18:36:23.535 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9994999999999999e-05 2024-09-12T18:36:23.535 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.535 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.535 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:23.535 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.713610+0000", 2024-09-12T18:36:23.535 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2589999999999999e-05 2024-09-12T18:36:23.535 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.535 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:23.535 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.536 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.536 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.536 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:88245 5.d 5:beb54582:::benchmark_data_smithi073_23739_object88244:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:36:23.536 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:22.084417+0000", 2024-09-12T18:36:23.536 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.346088881, 2024-09-12T18:36:23.536 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017602936, 2024-09-12T18:36:23.536 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:23.536 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:23.536 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:23.536 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:23.536 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:23.536 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:23.536 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 88245 2024-09-12T18:36:23.537 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.537 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:23.537 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.537 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:23.537 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.084417+0000", 2024-09-12T18:36:23.537 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.537 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.537 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.537 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:23.537 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.084417+0000", 2024-09-12T18:36:23.537 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.537 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.537 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.538 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:23.538 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.084418+0000", 2024-09-12T18:36:23.538 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.7699999999999992e-07 2024-09-12T18:36:23.538 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.538 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.538 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:23.538 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.084446+0000", 2024-09-12T18:36:23.538 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8178e-05 2024-09-12T18:36:23.538 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.538 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.538 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:23.538 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.084458+0000", 2024-09-12T18:36:23.538 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2252999999999999e-05 2024-09-12T18:36:23.539 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.539 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.539 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:23.539 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.084467+0000", 2024-09-12T18:36:23.539 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5029999999999997e-06 2024-09-12T18:36:23.539 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.539 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.539 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:23.539 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.095012+0000", 2024-09-12T18:36:23.539 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.010545274 2024-09-12T18:36:23.539 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.539 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.539 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:23.539 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.095139+0000", 2024-09-12T18:36:23.540 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012659300000000001 2024-09-12T18:36:23.540 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.540 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.540 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:23.540 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.095306+0000", 2024-09-12T18:36:23.540 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016689600000000001 2024-09-12T18:36:23.540 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.540 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.540 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:23.540 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.097514+0000", 2024-09-12T18:36:23.540 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022079399999999998 2024-09-12T18:36:23.540 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.540 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.541 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:23.541 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.101952+0000", 2024-09-12T18:36:23.541 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0044387480000000002 2024-09-12T18:36:23.541 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.541 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.541 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:23.541 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.101992+0000", 2024-09-12T18:36:23.541 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9165000000000002e-05 2024-09-12T18:36:23.541 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.541 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.541 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:23.541 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.102020+0000", 2024-09-12T18:36:23.541 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8408999999999999e-05 2024-09-12T18:36:23.542 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.542 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:23.542 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.542 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.542 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.542 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:88599 5.b 5:d3a6061c:::benchmark_data_smithi073_23739_object88598:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:36:23.542 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:22.263566+0000", 2024-09-12T18:36:23.542 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.1669395140000001, 2024-09-12T18:36:23.542 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.020416237, 2024-09-12T18:36:23.542 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:23.542 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:23.542 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:23.542 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:23.543 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:23.543 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:23.543 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 88599 2024-09-12T18:36:23.543 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.543 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:23.543 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.543 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:23.543 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.263566+0000", 2024-09-12T18:36:23.543 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.543 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.543 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.543 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:23.543 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.263566+0000", 2024-09-12T18:36:23.543 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.544 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.544 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.544 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:23.544 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.263567+0000", 2024-09-12T18:36:23.544 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.088e-06 2024-09-12T18:36:23.544 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.544 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.544 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:23.544 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.263654+0000", 2024-09-12T18:36:23.544 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6632999999999995e-05 2024-09-12T18:36:23.544 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.544 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.544 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:23.545 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.263673+0000", 2024-09-12T18:36:23.545 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8984e-05 2024-09-12T18:36:23.545 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.545 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.545 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:23.545 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.263681+0000", 2024-09-12T18:36:23.545 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.371e-06 2024-09-12T18:36:23.545 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.545 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.545 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:23.545 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.266963+0000", 2024-09-12T18:36:23.545 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0032810410000000002 2024-09-12T18:36:23.545 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.546 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.546 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:23.546 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.267069+0000", 2024-09-12T18:36:23.546 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000106471 2024-09-12T18:36:23.546 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.546 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.546 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:23.546 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.267177+0000", 2024-09-12T18:36:23.546 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000108355 2024-09-12T18:36:23.546 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.546 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.546 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:23.546 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.268827+0000", 2024-09-12T18:36:23.546 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016492029999999999 2024-09-12T18:36:23.547 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.547 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.547 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:23.547 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.283931+0000", 2024-09-12T18:36:23.547 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015104783 2024-09-12T18:36:23.547 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.547 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.547 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:23.547 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.283960+0000", 2024-09-12T18:36:23.547 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8401000000000001e-05 2024-09-12T18:36:23.547 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.547 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.547 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:23.548 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.283983+0000", 2024-09-12T18:36:23.548 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2906999999999999e-05 2024-09-12T18:36:23.548 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.548 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:23.548 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.548 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.548 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.548 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:89277 5.b 5:d689659b:::benchmark_data_smithi073_23739_object89276:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:36:23.548 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:22.590286+0000", 2024-09-12T18:36:23.548 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.84021952799999999, 2024-09-12T18:36:23.548 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018995509000000001, 2024-09-12T18:36:23.549 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:23.549 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:23.549 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:23.549 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:23.549 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:23.549 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:23.549 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 89277 2024-09-12T18:36:23.549 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.549 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:23.549 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.549 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:23.549 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590286+0000", 2024-09-12T18:36:23.549 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.550 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.550 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.550 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:23.550 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590286+0000", 2024-09-12T18:36:23.550 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:23.550 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.550 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.550 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:23.550 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590288+0000", 2024-09-12T18:36:23.550 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.119e-06 2024-09-12T18:36:23.550 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.550 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.550 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:23.552 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590370+0000", 2024-09-12T18:36:23.552 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2025000000000002e-05 2024-09-12T18:36:23.552 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.552 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.552 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:23.552 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590380+0000", 2024-09-12T18:36:23.552 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0723999999999999e-05 2024-09-12T18:36:23.553 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.553 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.553 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:23.553 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590386+0000", 2024-09-12T18:36:23.553 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.609e-06 2024-09-12T18:36:23.553 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.553 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.553 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:23.553 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590444+0000", 2024-09-12T18:36:23.553 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7667000000000002e-05 2024-09-12T18:36:23.553 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.553 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.553 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:23.554 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590552+0000", 2024-09-12T18:36:23.554 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000108402 2024-09-12T18:36:23.554 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.554 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.554 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:23.554 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590687+0000", 2024-09-12T18:36:23.554 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000134602 2024-09-12T18:36:23.554 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.554 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.554 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:23.554 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.593694+0000", 2024-09-12T18:36:23.554 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003007249 2024-09-12T18:36:23.554 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.554 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.555 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:23.555 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.609224+0000", 2024-09-12T18:36:23.555 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015530552 2024-09-12T18:36:23.555 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.555 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.555 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:23.555 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.609256+0000", 2024-09-12T18:36:23.555 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1838999999999998e-05 2024-09-12T18:36:23.555 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:23.555 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:23.555 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:23.555 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.609282+0000", 2024-09-12T18:36:23.555 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5721e-05 2024-09-12T18:36:23.555 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.556 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:23.556 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.556 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:23.556 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:23.556 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:23.556 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T18:36:23.557 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:36:23.558 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:36:23.558 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:36:23.559 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:36:23.559 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:23.555+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:23.560 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:36:23.659 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:23.656+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:23.722 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:23.722 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:23.746 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:36:23.785 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:23.783+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:23.872 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 38 16 91939 91923 151.173 129.938 0.0069675 0.00661048 2024-09-12T18:36:23.886 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:23.883+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:23.937 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:23.937 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:23.960 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:36:23.986 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:23.980+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:24.087 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:24.083+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:24.112 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:24.113 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:24.134 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:36:24.188 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:24.184+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:24.290 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:24.284+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:24.290 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:24.290 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:24.311 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:36:24.399 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:24.396+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:24.492 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:24.491+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:24.510 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:24.511 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:24.511 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is unset 2024-09-12T18:36:24.532 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:36:24.593 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:24.592+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:24.694 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:24.688+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:24.728 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:24.728 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:24.749 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:36:24.795 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:24.791+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:24.873 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 39 16 94010 93994 150.615 129.438 0.00580424 0.00663477 2024-09-12T18:36:24.896 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:24.891+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:24.903 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:24.903 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:24.928 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:36:24.997 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:24.992+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:25.098 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:25.095+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:25.125 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:25.126 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:25.145 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:36:25.199 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:25.196+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:25.299 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:25.296+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:25.336 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:25.336 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:25.357 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:36:25.401 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:25.396+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:25.492 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:25.493 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:25.502 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:25.499+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:25.509 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:36:25.561 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:36:25.603 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:25.600+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:25.662 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:25.663 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:25.685 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:36:25.721 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:36:25.721 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:36:25.733 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:25.732+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:25.739 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:36:25.739 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:36:25.759 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:36:25.760 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:36:25.805 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:25.800+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:25.873 INFO:tasks.radosbench.radosbench.0.smithi073.stdout:2024-09-12T18:36:25.872065+0000 min lat: 0.00145327 max lat: 0.0837976 avg lat: 0.0066724 2024-09-12T18:36:25.873 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-12T18:36:25.873 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 40 16 95877 95861 149.767 116.688 0.00533417 0.0066724 2024-09-12T18:36:25.895 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:36:25.896 INFO:teuthology.orchestra.run.smithi162.stdout: "size": 20, 2024-09-12T18:36:25.896 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 600, 2024-09-12T18:36:25.896 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:36:25.896 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.896 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4154.0:123 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:36:25.896 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:36:25.896 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 71.916422698999995, 2024-09-12T18:36:25.896 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.022398096999999999, 2024-09-12T18:36:25.896 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:25.896 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:25.896 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:25.896 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:25.897 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4154", 2024-09-12T18:36:25.897 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/745129001", 2024-09-12T18:36:25.897 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 123 2024-09-12T18:36:25.897 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.897 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:25.898 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.898 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:25.898 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:36:25.898 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:25.898 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.898 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.899 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:25.899 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:36:25.899 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:25.899 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.899 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.900 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:25.900 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:36:25.900 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.8299999999999996e-07 2024-09-12T18:36:25.900 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.900 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.901 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:25.901 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976528+0000", 2024-09-12T18:36:25.901 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011393299999999999 2024-09-12T18:36:25.901 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.901 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.901 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:25.902 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976539+0000", 2024-09-12T18:36:25.902 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0763e-05 2024-09-12T18:36:25.902 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.902 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.902 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:25.902 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976547+0000", 2024-09-12T18:36:25.903 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8199999999999997e-06 2024-09-12T18:36:25.903 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.903 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.903 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:25.903 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.995057+0000", 2024-09-12T18:36:25.904 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.018510047000000002 2024-09-12T18:36:25.904 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.904 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.904 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:25.904 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.995301+0000", 2024-09-12T18:36:25.904 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00024375899999999999 2024-09-12T18:36:25.905 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.905 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.905 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:25.905 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.995642+0000", 2024-09-12T18:36:25.905 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00034121100000000001 2024-09-12T18:36:25.906 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.906 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.906 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:25.906 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998179+0000", 2024-09-12T18:36:25.906 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00253761 2024-09-12T18:36:25.906 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.907 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.907 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:25.907 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998665+0000", 2024-09-12T18:36:25.907 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00048574600000000001 2024-09-12T18:36:25.907 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.907 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.908 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:25.908 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998739+0000", 2024-09-12T18:36:25.908 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.4286e-05 2024-09-12T18:36:25.908 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.908 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.909 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:25.909 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998812+0000", 2024-09-12T18:36:25.909 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2238999999999997e-05 2024-09-12T18:36:25.909 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:25.909 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:25.909 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:25.910 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.910 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.910 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4154.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:36:25.910 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:36:25.910 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 71.916275467000006, 2024-09-12T18:36:25.911 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025950709999999998, 2024-09-12T18:36:25.911 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:25.911 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:25.911 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:25.911 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:25.911 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4154", 2024-09-12T18:36:25.912 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/745129001", 2024-09-12T18:36:25.912 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 124 2024-09-12T18:36:25.912 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.912 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:25.912 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.912 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:25.913 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:36:25.913 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:25.913 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.913 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.913 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:25.914 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:36:25.914 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:25.914 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.914 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.914 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:25.914 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976562+0000", 2024-09-12T18:36:25.915 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.2999999999999999e-07 2024-09-12T18:36:25.915 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.915 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.915 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:25.915 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976567+0000", 2024-09-12T18:36:25.916 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3430000000000003e-06 2024-09-12T18:36:25.916 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.916 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.916 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:25.916 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976576+0000", 2024-09-12T18:36:25.916 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8070000000000006e-06 2024-09-12T18:36:25.917 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.917 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.917 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:25.917 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976583+0000", 2024-09-12T18:36:25.917 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9959999999999996e-06 2024-09-12T18:36:25.918 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.918 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.918 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:25.918 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997107+0000", 2024-09-12T18:36:25.918 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.020524106 2024-09-12T18:36:25.918 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.919 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.919 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:25.919 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997225+0000", 2024-09-12T18:36:25.919 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000117909 2024-09-12T18:36:25.919 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.919 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.920 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:25.920 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997407+0000", 2024-09-12T18:36:25.920 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00018175900000000001 2024-09-12T18:36:25.920 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.920 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.921 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:25.921 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998839+0000", 2024-09-12T18:36:25.921 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001432539 2024-09-12T18:36:25.921 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.921 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.921 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:25.922 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002319+0000", 2024-09-12T18:36:25.922 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0034803529999999998 2024-09-12T18:36:25.922 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.922 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.922 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:25.922 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002405+0000", 2024-09-12T18:36:25.923 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5434999999999998e-05 2024-09-12T18:36:25.923 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.923 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.923 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:25.923 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002512+0000", 2024-09-12T18:36:25.923 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010663299999999999 2024-09-12T18:36:25.924 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:25.924 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:25.924 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:25.924 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.924 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.925 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:25.925 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:36:25.925 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 60.251477960000003, 2024-09-12T18:36:25.925 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025127867000000002, 2024-09-12T18:36:25.925 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:25.925 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:25.926 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:25.926 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:25.926 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.926 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:25.926 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:36:25.926 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:25.927 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.927 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.927 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:25.927 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:36:25.927 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:25.927 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.928 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.928 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:25.928 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641362+0000", 2024-09-12T18:36:25.928 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.2569999999999999e-06 2024-09-12T18:36:25.928 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.928 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.928 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:25.928 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641374+0000", 2024-09-12T18:36:25.929 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2696e-05 2024-09-12T18:36:25.929 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.929 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.929 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:25.929 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641403+0000", 2024-09-12T18:36:25.929 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.8756999999999999e-05 2024-09-12T18:36:25.929 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.929 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.929 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:25.929 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641430+0000", 2024-09-12T18:36:25.929 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.6452999999999999e-05 2024-09-12T18:36:25.930 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.930 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.930 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:25.930 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641585+0000", 2024-09-12T18:36:25.930 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000155799 2024-09-12T18:36:25.930 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.931 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.931 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:25.931 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641753+0000", 2024-09-12T18:36:25.931 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000167868 2024-09-12T18:36:25.931 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.931 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.931 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:25.931 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641916+0000", 2024-09-12T18:36:25.931 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000162903 2024-09-12T18:36:25.931 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.931 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.931 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:25.931 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653655+0000", 2024-09-12T18:36:25.931 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011738879000000001 2024-09-12T18:36:25.932 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.932 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.932 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:25.932 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665515+0000", 2024-09-12T18:36:25.932 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011859915 2024-09-12T18:36:25.932 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.932 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.932 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:25.932 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665646+0000", 2024-09-12T18:36:25.932 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013122599999999999 2024-09-12T18:36:25.932 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.932 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.933 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:25.933 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666486+0000", 2024-09-12T18:36:25.933 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00084011399999999999 2024-09-12T18:36:25.933 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:25.933 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:25.933 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:25.933 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.933 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.933 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:25.933 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:36:25.933 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 60.251363497, 2024-09-12T18:36:25.933 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025384584000000002, 2024-09-12T18:36:25.933 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:25.933 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:25.934 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:25.934 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:25.934 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.934 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:25.934 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:36:25.934 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:25.934 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.934 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.934 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:25.934 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:36:25.934 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:25.934 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.934 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.934 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:25.935 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641474+0000", 2024-09-12T18:36:25.935 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.39e-06 2024-09-12T18:36:25.935 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.935 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.935 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:25.935 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641482+0000", 2024-09-12T18:36:25.935 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3499999999999999e-06 2024-09-12T18:36:25.935 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.935 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.935 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:25.935 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641534+0000", 2024-09-12T18:36:25.935 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2533e-05 2024-09-12T18:36:25.935 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.935 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.936 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:25.936 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641551+0000", 2024-09-12T18:36:25.936 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6515999999999999e-05 2024-09-12T18:36:25.936 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.936 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.936 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:25.936 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642630+0000", 2024-09-12T18:36:25.936 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001079705 2024-09-12T18:36:25.936 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.936 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.936 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:25.936 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642909+0000", 2024-09-12T18:36:25.937 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027859800000000002 2024-09-12T18:36:25.937 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.937 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.937 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:25.937 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643137+0000", 2024-09-12T18:36:25.937 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022803799999999999 2024-09-12T18:36:25.937 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.937 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.937 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:25.937 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653669+0000", 2024-09-12T18:36:25.937 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010532032 2024-09-12T18:36:25.937 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.937 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.938 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:25.938 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666624+0000", 2024-09-12T18:36:25.938 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012954940999999999 2024-09-12T18:36:25.938 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.938 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.938 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:25.938 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666762+0000", 2024-09-12T18:36:25.938 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000137668 2024-09-12T18:36:25.938 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.938 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.938 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:25.938 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666857+0000", 2024-09-12T18:36:25.938 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.5812999999999999e-05 2024-09-12T18:36:25.938 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:25.939 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:25.939 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:25.939 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.939 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.939 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:25.939 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:36:25.939 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 60.251235702000002, 2024-09-12T18:36:25.939 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025661562999999998, 2024-09-12T18:36:25.939 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:25.939 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:25.939 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:25.939 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:25.939 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.939 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:25.940 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:36:25.940 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:25.940 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.940 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.940 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:25.940 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:36:25.940 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:25.940 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.940 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.940 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:25.940 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641602+0000", 2024-09-12T18:36:25.940 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3540000000000001e-06 2024-09-12T18:36:25.940 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.940 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.941 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:25.941 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641637+0000", 2024-09-12T18:36:25.941 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5145999999999999e-05 2024-09-12T18:36:25.941 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.941 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.941 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:25.942 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641659+0000", 2024-09-12T18:36:25.942 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2249999999999999e-05 2024-09-12T18:36:25.942 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.942 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.942 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:25.942 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641675+0000", 2024-09-12T18:36:25.942 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6059999999999999e-05 2024-09-12T18:36:25.943 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.943 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.943 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:25.943 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644570+0000", 2024-09-12T18:36:25.943 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028947069999999998 2024-09-12T18:36:25.943 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.944 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.944 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:25.944 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644900+0000", 2024-09-12T18:36:25.944 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000329401 2024-09-12T18:36:25.944 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.944 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.945 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:25.945 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645235+0000", 2024-09-12T18:36:25.945 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000335874 2024-09-12T18:36:25.945 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.945 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.945 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:25.945 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655459+0000", 2024-09-12T18:36:25.946 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010223441999999999 2024-09-12T18:36:25.946 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.946 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.946 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:25.946 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667028+0000", 2024-09-12T18:36:25.947 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011568673999999999 2024-09-12T18:36:25.947 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.947 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.947 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:25.947 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667163+0000", 2024-09-12T18:36:25.947 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013525500000000001 2024-09-12T18:36:25.948 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.948 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.948 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:25.948 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667262+0000", 2024-09-12T18:36:25.948 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9400000000000004e-05 2024-09-12T18:36:25.948 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:25.948 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:25.948 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:25.948 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.948 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.948 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:25.949 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:36:25.949 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 60.251133881999998, 2024-09-12T18:36:25.949 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025971339, 2024-09-12T18:36:25.949 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:25.949 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:25.949 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:25.949 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:25.950 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.950 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:25.950 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:36:25.950 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:25.950 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.950 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.950 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:25.951 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:36:25.951 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:25.951 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.951 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.951 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:25.951 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641704+0000", 2024-09-12T18:36:25.951 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.297e-06 2024-09-12T18:36:25.952 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.952 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.952 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:25.952 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641712+0000", 2024-09-12T18:36:25.952 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.9060000000000002e-06 2024-09-12T18:36:25.952 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.952 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.953 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:25.953 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641731+0000", 2024-09-12T18:36:25.953 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9083e-05 2024-09-12T18:36:25.953 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.953 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.953 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:25.953 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641745+0000", 2024-09-12T18:36:25.954 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4066999999999999e-05 2024-09-12T18:36:25.954 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.954 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.954 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:25.954 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646529+0000", 2024-09-12T18:36:25.954 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.004784033 2024-09-12T18:36:25.954 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.954 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.955 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:25.955 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646727+0000", 2024-09-12T18:36:25.955 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019841800000000001 2024-09-12T18:36:25.955 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.955 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.955 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:25.955 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647057+0000", 2024-09-12T18:36:25.956 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032926800000000002 2024-09-12T18:36:25.956 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.956 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.956 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:25.956 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655475+0000", 2024-09-12T18:36:25.956 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0084186250000000008 2024-09-12T18:36:25.956 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.957 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.957 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:25.957 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667424+0000", 2024-09-12T18:36:25.957 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011949257 2024-09-12T18:36:25.957 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.957 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.957 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:25.958 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667573+0000", 2024-09-12T18:36:25.958 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014851900000000001 2024-09-12T18:36:25.958 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.958 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.958 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:25.958 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667674+0000", 2024-09-12T18:36:25.958 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010086600000000001 2024-09-12T18:36:25.958 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:25.959 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:25.959 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:25.959 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.959 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.959 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:25.959 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:36:25.959 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 60.251071492999998, 2024-09-12T18:36:25.960 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026215008000000001, 2024-09-12T18:36:25.960 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:25.960 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:25.960 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:25.960 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:25.960 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.960 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:25.960 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:36:25.961 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:25.961 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.961 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.961 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:25.961 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:36:25.961 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:25.961 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.962 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.962 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:25.962 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641766+0000", 2024-09-12T18:36:25.962 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1200000000000001e-06 2024-09-12T18:36:25.962 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.962 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.962 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:25.963 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641775+0000", 2024-09-12T18:36:25.963 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.2499999999999995e-06 2024-09-12T18:36:25.963 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.963 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.963 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:25.963 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641793+0000", 2024-09-12T18:36:25.963 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7773000000000001e-05 2024-09-12T18:36:25.963 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.964 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.964 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:25.964 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641807+0000", 2024-09-12T18:36:25.964 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3814e-05 2024-09-12T18:36:25.964 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.964 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.964 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:25.965 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647626+0000", 2024-09-12T18:36:25.965 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0058193050000000003 2024-09-12T18:36:25.965 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.965 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.965 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:25.965 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647937+0000", 2024-09-12T18:36:25.965 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031112400000000003 2024-09-12T18:36:25.965 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.965 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.965 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:25.966 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648239+0000", 2024-09-12T18:36:25.966 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00030227500000000002 2024-09-12T18:36:25.966 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.966 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.966 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:25.966 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655487+0000", 2024-09-12T18:36:25.966 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072479129999999999 2024-09-12T18:36:25.966 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.966 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.966 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:25.967 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667823+0000", 2024-09-12T18:36:25.967 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012335505 2024-09-12T18:36:25.967 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.967 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.967 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:25.967 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667908+0000", 2024-09-12T18:36:25.967 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4843000000000001e-05 2024-09-12T18:36:25.967 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.967 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.968 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:25.968 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667980+0000", 2024-09-12T18:36:25.968 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2086000000000001e-05 2024-09-12T18:36:25.968 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:25.968 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:25.968 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:25.968 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.968 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.968 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:25.969 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:36:25.969 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 60.251011339999998, 2024-09-12T18:36:25.969 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026483236, 2024-09-12T18:36:25.969 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:25.969 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:25.969 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:25.969 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:25.970 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.970 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:25.970 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:36:25.970 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:25.970 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.970 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.970 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:25.971 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:36:25.971 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:25.971 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.971 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.971 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:25.971 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641826+0000", 2024-09-12T18:36:25.971 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:36:25.971 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.971 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.971 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:25.972 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641832+0000", 2024-09-12T18:36:25.972 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4199999999999998e-06 2024-09-12T18:36:25.972 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.972 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.972 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:25.972 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641848+0000", 2024-09-12T18:36:25.972 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6492999999999999e-05 2024-09-12T18:36:25.972 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.972 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.972 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:25.972 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641863+0000", 2024-09-12T18:36:25.972 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5427e-05 2024-09-12T18:36:25.972 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.973 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.973 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:25.973 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648887+0000", 2024-09-12T18:36:25.973 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0070230860000000004 2024-09-12T18:36:25.973 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.973 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.973 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:25.973 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649111+0000", 2024-09-12T18:36:25.973 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022425799999999999 2024-09-12T18:36:25.973 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.973 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.973 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:25.973 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649494+0000", 2024-09-12T18:36:25.973 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00038349400000000001 2024-09-12T18:36:25.974 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.974 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.974 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:25.974 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655499+0000", 2024-09-12T18:36:25.974 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0060047260000000002 2024-09-12T18:36:25.974 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.974 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.974 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:25.974 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668110+0000", 2024-09-12T18:36:25.974 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012610543 2024-09-12T18:36:25.974 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.974 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.974 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:25.974 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668252+0000", 2024-09-12T18:36:25.975 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014265600000000001 2024-09-12T18:36:25.975 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.975 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.975 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:25.975 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668308+0000", 2024-09-12T18:36:25.975 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5992999999999997e-05 2024-09-12T18:36:25.975 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:25.975 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:25.975 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:25.975 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.975 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.975 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:25.975 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:36:25.975 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 60.250956123999998, 2024-09-12T18:36:25.976 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026605302000000001, 2024-09-12T18:36:25.976 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:25.976 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:25.976 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:25.976 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:25.976 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.976 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:25.976 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:36:25.976 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:25.976 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.976 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.976 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:25.976 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:36:25.976 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:25.977 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.977 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.977 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:25.977 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641881+0000", 2024-09-12T18:36:25.977 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.057e-06 2024-09-12T18:36:25.977 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.977 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.977 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:25.977 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641887+0000", 2024-09-12T18:36:25.977 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.6629999999999998e-06 2024-09-12T18:36:25.977 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.977 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.977 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:25.977 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641903+0000", 2024-09-12T18:36:25.978 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6317e-05 2024-09-12T18:36:25.978 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.978 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.978 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:25.978 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641917+0000", 2024-09-12T18:36:25.978 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3339999999999999e-05 2024-09-12T18:36:25.978 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.978 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.978 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:25.978 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650708+0000", 2024-09-12T18:36:25.978 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.008791419 2024-09-12T18:36:25.978 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.978 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.978 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:25.979 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651021+0000", 2024-09-12T18:36:25.979 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031296699999999999 2024-09-12T18:36:25.979 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.979 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.979 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:25.979 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651349+0000", 2024-09-12T18:36:25.979 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032796499999999999 2024-09-12T18:36:25.979 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.979 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.979 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:25.979 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655742+0000", 2024-09-12T18:36:25.979 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0043934680000000002 2024-09-12T18:36:25.979 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.979 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.980 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:25.980 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668377+0000", 2024-09-12T18:36:25.980 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012634312999999999 2024-09-12T18:36:25.980 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.980 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.980 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:25.980 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668441+0000", 2024-09-12T18:36:25.980 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4369999999999995e-05 2024-09-12T18:36:25.980 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.980 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.980 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:25.980 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668485+0000", 2024-09-12T18:36:25.980 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4422999999999998e-05 2024-09-12T18:36:25.981 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:25.981 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:25.981 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:25.981 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.981 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.981 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:25.981 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:36:25.981 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 60.250898720999999, 2024-09-12T18:36:25.981 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026919499, 2024-09-12T18:36:25.981 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:25.981 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:25.981 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:25.981 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:25.981 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.982 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:25.982 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:36:25.982 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:25.982 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.982 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.982 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:25.982 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:36:25.982 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:25.982 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.982 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.982 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:25.982 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641939+0000", 2024-09-12T18:36:25.982 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9399999999999993e-07 2024-09-12T18:36:25.982 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.983 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.983 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:25.983 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641945+0000", 2024-09-12T18:36:25.983 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9200000000000001e-06 2024-09-12T18:36:25.983 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.983 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.983 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:25.983 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641961+0000", 2024-09-12T18:36:25.983 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6520000000000001e-05 2024-09-12T18:36:25.983 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.983 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.983 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:25.983 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641974+0000", 2024-09-12T18:36:25.983 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3413e-05 2024-09-12T18:36:25.984 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.984 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.984 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:25.984 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654560+0000", 2024-09-12T18:36:25.984 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012585308999999999 2024-09-12T18:36:25.984 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.984 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.984 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:25.984 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654822+0000", 2024-09-12T18:36:25.984 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026210099999999999 2024-09-12T18:36:25.984 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.984 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.984 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:25.984 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655059+0000", 2024-09-12T18:36:25.985 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00023747899999999999 2024-09-12T18:36:25.985 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.985 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.985 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:25.985 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.656315+0000", 2024-09-12T18:36:25.985 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0012555000000000001 2024-09-12T18:36:25.985 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.985 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.985 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:25.985 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668590+0000", 2024-09-12T18:36:25.985 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012274851999999999 2024-09-12T18:36:25.985 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.985 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.986 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:25.986 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668725+0000", 2024-09-12T18:36:25.986 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013524199999999999 2024-09-12T18:36:25.986 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.986 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.986 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:25.986 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668857+0000", 2024-09-12T18:36:25.986 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013216899999999999 2024-09-12T18:36:25.986 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:25.986 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:25.987 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:25.987 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.987 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.987 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:25.987 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:36:25.987 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 60.250845200999997, 2024-09-12T18:36:25.987 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023616723999999999, 2024-09-12T18:36:25.988 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:25.988 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:25.988 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:25.988 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:25.988 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.988 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:25.989 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:36:25.989 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:25.989 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.989 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.989 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:25.989 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:36:25.990 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:25.990 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.990 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.990 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:25.990 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641992+0000", 2024-09-12T18:36:25.990 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.08e-06 2024-09-12T18:36:25.990 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.990 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.990 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:25.990 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641998+0000", 2024-09-12T18:36:25.991 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4299999999999997e-06 2024-09-12T18:36:25.991 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.991 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.991 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:25.991 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642014+0000", 2024-09-12T18:36:25.991 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6266e-05 2024-09-12T18:36:25.991 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.991 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.991 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:25.991 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642026+0000", 2024-09-12T18:36:25.991 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2567e-05 2024-09-12T18:36:25.991 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.991 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.991 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:25.992 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642213+0000", 2024-09-12T18:36:25.992 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00018701899999999999 2024-09-12T18:36:25.992 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.992 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.992 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:25.992 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642507+0000", 2024-09-12T18:36:25.992 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00029394700000000002 2024-09-12T18:36:25.992 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.992 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.992 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:25.992 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642686+0000", 2024-09-12T18:36:25.992 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000178152 2024-09-12T18:36:25.992 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.992 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.993 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:25.993 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650952+0000", 2024-09-12T18:36:25.993 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0082663570000000002 2024-09-12T18:36:25.993 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.993 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.993 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:25.993 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665382+0000", 2024-09-12T18:36:25.993 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.014430111000000001 2024-09-12T18:36:25.993 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.993 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.993 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:25.993 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665508+0000", 2024-09-12T18:36:25.993 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000125986 2024-09-12T18:36:25.994 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.994 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.994 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:25.994 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665608+0000", 2024-09-12T18:36:25.994 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9809000000000006e-05 2024-09-12T18:36:25.994 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:25.994 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:25.994 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:25.994 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.994 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.994 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:25.994 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:36:25.994 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 60.250717336000001, 2024-09-12T18:36:25.994 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024670563, 2024-09-12T18:36:25.995 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:25.995 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:25.995 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:25.995 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:25.995 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.995 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:25.995 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:36:25.995 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:25.995 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.995 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.995 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:25.996 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:36:25.996 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:25.996 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.996 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.996 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:25.996 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642120+0000", 2024-09-12T18:36:25.996 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1769999999999999e-06 2024-09-12T18:36:25.996 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.996 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.996 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:25.996 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642128+0000", 2024-09-12T18:36:25.996 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3429999999999998e-06 2024-09-12T18:36:25.996 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.997 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.997 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:25.997 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642192+0000", 2024-09-12T18:36:25.997 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4406999999999995e-05 2024-09-12T18:36:25.997 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.997 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.997 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:25.997 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642223+0000", 2024-09-12T18:36:25.997 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.1266000000000002e-05 2024-09-12T18:36:25.997 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.997 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.997 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:25.997 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643201+0000", 2024-09-12T18:36:25.997 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0009778390000000001 2024-09-12T18:36:25.998 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.998 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.998 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:25.998 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643410+0000", 2024-09-12T18:36:25.998 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020874199999999999 2024-09-12T18:36:25.998 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.998 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.998 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:25.998 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643685+0000", 2024-09-12T18:36:25.998 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027520700000000002 2024-09-12T18:36:25.998 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.998 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.998 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:25.998 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650966+0000", 2024-09-12T18:36:25.998 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072810710000000001 2024-09-12T18:36:25.999 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.999 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.999 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:25.999 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666560+0000", 2024-09-12T18:36:25.999 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015594143 2024-09-12T18:36:25.999 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.999 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.999 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:25.999 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666691+0000", 2024-09-12T18:36:25.999 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000130359 2024-09-12T18:36:25.999 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:25.999 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:25.999 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:25.999 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666790+0000", 2024-09-12T18:36:26.000 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9009e-05 2024-09-12T18:36:26.000 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:26.000 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:26.000 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:26.000 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.000 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.000 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:26.000 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:36:26.000 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 60.249939048000002, 2024-09-12T18:36:26.000 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024891744, 2024-09-12T18:36:26.000 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:26.000 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:26.000 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:26.000 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:26.001 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.001 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:26.001 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:36:26.001 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:26.001 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.001 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.001 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:26.001 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:36:26.001 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:26.001 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.001 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.001 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:26.001 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642899+0000", 2024-09-12T18:36:26.002 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4729999999999999e-06 2024-09-12T18:36:26.002 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.002 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.002 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:26.002 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642912+0000", 2024-09-12T18:36:26.002 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3495999999999999e-05 2024-09-12T18:36:26.002 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.002 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.002 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:26.002 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642934+0000", 2024-09-12T18:36:26.002 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2033999999999999e-05 2024-09-12T18:36:26.002 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.002 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.002 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.003 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642949+0000", 2024-09-12T18:36:26.003 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4970000000000001e-05 2024-09-12T18:36:26.003 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.003 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.003 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:26.003 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644400+0000", 2024-09-12T18:36:26.003 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001450305 2024-09-12T18:36:26.003 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.003 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.003 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:26.004 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644617+0000", 2024-09-12T18:36:26.004 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000217302 2024-09-12T18:36:26.004 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.004 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.004 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:26.004 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645052+0000", 2024-09-12T18:36:26.004 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000434797 2024-09-12T18:36:26.004 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.004 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.004 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:26.004 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653860+0000", 2024-09-12T18:36:26.004 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0088082249999999994 2024-09-12T18:36:26.005 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.005 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.005 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:26.005 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667598+0000", 2024-09-12T18:36:26.005 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.013738451 2024-09-12T18:36:26.005 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.005 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.005 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:26.005 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667698+0000", 2024-09-12T18:36:26.005 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9854999999999999e-05 2024-09-12T18:36:26.006 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.006 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.006 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:26.006 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667789+0000", 2024-09-12T18:36:26.006 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0835999999999996e-05 2024-09-12T18:36:26.006 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:26.006 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:26.006 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:26.006 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.006 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.006 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:30 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:26.006 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:36:26.006 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 60.249864232, 2024-09-12T18:36:26.007 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023936852000000002, 2024-09-12T18:36:26.007 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:26.007 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:26.007 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:26.007 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:26.007 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.007 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:26.007 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:36:26.007 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:26.007 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.007 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.007 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:26.007 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:36:26.007 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:26.008 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.008 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.008 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:26.008 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642973+0000", 2024-09-12T18:36:26.008 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.11e-06 2024-09-12T18:36:26.008 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.008 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.008 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:26.008 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642994+0000", 2024-09-12T18:36:26.008 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.0699999999999998e-05 2024-09-12T18:36:26.008 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.008 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.008 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:26.009 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643011+0000", 2024-09-12T18:36:26.009 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7229999999999999e-05 2024-09-12T18:36:26.009 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.009 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.009 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.009 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643025+0000", 2024-09-12T18:36:26.009 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3803e-05 2024-09-12T18:36:26.009 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.009 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.009 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:26.009 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643143+0000", 2024-09-12T18:36:26.009 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000118225 2024-09-12T18:36:26.009 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.009 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.010 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:26.010 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643426+0000", 2024-09-12T18:36:26.010 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00028250500000000001 2024-09-12T18:36:26.010 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.010 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.010 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:26.010 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643864+0000", 2024-09-12T18:36:26.010 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00043856 2024-09-12T18:36:26.010 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.010 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.010 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:26.010 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651148+0000", 2024-09-12T18:36:26.010 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072836769999999997 2024-09-12T18:36:26.011 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.011 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.011 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:26.011 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666674+0000", 2024-09-12T18:36:26.011 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015525786999999999 2024-09-12T18:36:26.011 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.011 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.011 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:26.011 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666796+0000", 2024-09-12T18:36:26.011 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000122416 2024-09-12T18:36:26.011 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.011 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.011 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:26.011 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666909+0000", 2024-09-12T18:36:26.012 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011283899999999999 2024-09-12T18:36:26.012 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:26.012 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:26.012 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:26.012 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.012 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.012 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:26.012 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:36:26.012 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 60.249781526, 2024-09-12T18:36:26.012 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024100234000000002, 2024-09-12T18:36:26.012 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:26.012 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:26.012 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:26.012 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:26.013 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.013 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:26.013 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:36:26.013 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:26.013 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.013 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.013 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:26.013 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:36:26.013 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:26.014 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.014 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.014 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:26.014 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643056+0000", 2024-09-12T18:36:26.014 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.046e-06 2024-09-12T18:36:26.014 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.014 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.014 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:26.014 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643068+0000", 2024-09-12T18:36:26.014 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2106999999999999e-05 2024-09-12T18:36:26.014 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.014 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.014 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:26.014 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643085+0000", 2024-09-12T18:36:26.014 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7479999999999999e-05 2024-09-12T18:36:26.015 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.015 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.015 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.015 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643099+0000", 2024-09-12T18:36:26.015 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3730000000000001e-05 2024-09-12T18:36:26.015 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.015 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.015 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:26.015 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644623+0000", 2024-09-12T18:36:26.015 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0015236080000000001 2024-09-12T18:36:26.015 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.015 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.015 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:26.015 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644893+0000", 2024-09-12T18:36:26.016 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026990500000000003 2024-09-12T18:36:26.016 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.016 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.016 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:26.016 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645227+0000", 2024-09-12T18:36:26.016 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00033391300000000003 2024-09-12T18:36:26.016 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.016 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.016 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:26.016 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653926+0000", 2024-09-12T18:36:26.016 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0086993339999999995 2024-09-12T18:36:26.016 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.016 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.016 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:26.017 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666925+0000", 2024-09-12T18:36:26.017 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012998686000000001 2024-09-12T18:36:26.017 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.017 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.017 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:26.017 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667057+0000", 2024-09-12T18:36:26.017 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013255600000000001 2024-09-12T18:36:26.017 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.017 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.017 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:26.017 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667155+0000", 2024-09-12T18:36:26.017 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7868999999999994e-05 2024-09-12T18:36:26.017 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:26.017 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:26.018 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:26.018 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.018 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.018 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:26.018 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643139+0000", 2024-09-12T18:36:26.018 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 60.24969694, 2024-09-12T18:36:26.018 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.022417057000000001, 2024-09-12T18:36:26.018 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:26.018 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:26.018 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:26.018 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:26.018 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.018 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:26.018 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643139+0000", 2024-09-12T18:36:26.019 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:26.019 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.019 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.019 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:26.019 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643139+0000", 2024-09-12T18:36:26.019 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:26.019 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.019 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.019 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:26.019 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643140+0000", 2024-09-12T18:36:26.019 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0729999999999999e-06 2024-09-12T18:36:26.019 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.019 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.019 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:26.020 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643151+0000", 2024-09-12T18:36:26.020 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.039e-05 2024-09-12T18:36:26.020 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.020 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.020 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:26.020 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643168+0000", 2024-09-12T18:36:26.020 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7575999999999999e-05 2024-09-12T18:36:26.020 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.020 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.020 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.020 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643182+0000", 2024-09-12T18:36:26.020 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3224000000000001e-05 2024-09-12T18:36:26.020 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.020 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.021 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:26.021 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643358+0000", 2024-09-12T18:36:26.021 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00017676500000000001 2024-09-12T18:36:26.021 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.021 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.021 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:26.021 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643647+0000", 2024-09-12T18:36:26.021 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00028850499999999999 2024-09-12T18:36:26.021 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.021 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.021 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:26.021 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643924+0000", 2024-09-12T18:36:26.021 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000277547 2024-09-12T18:36:26.021 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.022 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.022 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:26.022 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650289+0000", 2024-09-12T18:36:26.022 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0063645350000000002 2024-09-12T18:36:26.022 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.022 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.022 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:26.022 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665333+0000", 2024-09-12T18:36:26.022 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015043531000000001 2024-09-12T18:36:26.022 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.022 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.022 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:26.022 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665454+0000", 2024-09-12T18:36:26.022 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000121302 2024-09-12T18:36:26.023 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.023 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.023 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:26.023 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665556+0000", 2024-09-12T18:36:26.023 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010260900000000001 2024-09-12T18:36:26.023 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:26.023 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:26.023 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:26.023 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.023 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.023 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:26.023 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:36:26.023 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 60.249585736999997, 2024-09-12T18:36:26.024 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024255982999999998, 2024-09-12T18:36:26.024 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:26.024 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:26.024 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:26.024 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:26.024 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.024 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:26.024 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:36:26.024 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:26.025 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.025 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.025 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:26.025 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:36:26.025 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:26.025 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.025 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.025 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:26.025 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643252+0000", 2024-09-12T18:36:26.025 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:26.025 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.025 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.025 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:26.026 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643287+0000", 2024-09-12T18:36:26.026 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5225999999999998e-05 2024-09-12T18:36:26.026 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.026 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.026 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:26.026 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643323+0000", 2024-09-12T18:36:26.026 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5488999999999999e-05 2024-09-12T18:36:26.027 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.027 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.027 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.027 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643357+0000", 2024-09-12T18:36:26.027 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.3853999999999998e-05 2024-09-12T18:36:26.027 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.027 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.028 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:26.028 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646716+0000", 2024-09-12T18:36:26.028 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003359 2024-09-12T18:36:26.028 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.028 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.028 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:26.028 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647037+0000", 2024-09-12T18:36:26.028 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032131800000000002 2024-09-12T18:36:26.028 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.028 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.028 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:26.028 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647337+0000", 2024-09-12T18:36:26.028 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000300208 2024-09-12T18:36:26.028 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.029 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.029 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:26.029 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654291+0000", 2024-09-12T18:36:26.029 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0069543089999999997 2024-09-12T18:36:26.029 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.029 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.029 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:26.029 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667297+0000", 2024-09-12T18:36:26.029 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.013005526 2024-09-12T18:36:26.029 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.029 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.029 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:26.029 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667416+0000", 2024-09-12T18:36:26.029 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000119416 2024-09-12T18:36:26.030 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.030 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.030 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:26.030 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667507+0000", 2024-09-12T18:36:26.030 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0206999999999999e-05 2024-09-12T18:36:26.030 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:26.030 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:26.030 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:26.030 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.030 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.030 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:26.030 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:36:26.030 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 60.249458642, 2024-09-12T18:36:26.031 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023888482999999999, 2024-09-12T18:36:26.031 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:26.031 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:26.031 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:26.031 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:26.031 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.031 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:26.032 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:36:26.032 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:26.032 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.032 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.032 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:26.032 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:36:26.032 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:26.033 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.033 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.033 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:26.033 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643379+0000", 2024-09-12T18:36:26.033 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.207e-06 2024-09-12T18:36:26.033 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.033 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.033 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:26.034 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643390+0000", 2024-09-12T18:36:26.034 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0696000000000001e-05 2024-09-12T18:36:26.034 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.034 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.034 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:26.034 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643407+0000", 2024-09-12T18:36:26.034 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7563000000000001e-05 2024-09-12T18:36:26.034 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.034 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.034 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.035 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643420+0000", 2024-09-12T18:36:26.035 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3277e-05 2024-09-12T18:36:26.035 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.035 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.035 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:26.035 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644906+0000", 2024-09-12T18:36:26.035 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001485945 2024-09-12T18:36:26.035 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.035 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.035 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:26.035 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645404+0000", 2024-09-12T18:36:26.036 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00049807599999999997 2024-09-12T18:36:26.036 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.036 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.036 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:26.036 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645846+0000", 2024-09-12T18:36:26.036 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00044190400000000002 2024-09-12T18:36:26.036 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.036 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.036 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:26.037 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654223+0000", 2024-09-12T18:36:26.037 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0083767419999999995 2024-09-12T18:36:26.037 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.037 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.037 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:26.037 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667026+0000", 2024-09-12T18:36:26.037 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012802531000000001 2024-09-12T18:36:26.037 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.037 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.037 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:26.037 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667162+0000", 2024-09-12T18:36:26.037 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000136112 2024-09-12T18:36:26.037 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.038 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.038 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:26.038 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667266+0000", 2024-09-12T18:36:26.038 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010443 2024-09-12T18:36:26.038 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:26.038 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:26.038 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:26.038 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.038 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.038 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:26.038 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643447+0000", 2024-09-12T18:36:26.038 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 60.249389116000003, 2024-09-12T18:36:26.038 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.022081562999999998, 2024-09-12T18:36:26.038 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:26.039 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:26.039 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:26.039 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:26.039 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.039 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:26.039 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643447+0000", 2024-09-12T18:36:26.039 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:26.039 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.039 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.039 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:26.039 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643447+0000", 2024-09-12T18:36:26.039 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:26.039 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.039 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.040 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:26.040 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643448+0000", 2024-09-12T18:36:26.040 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1629999999999999e-06 2024-09-12T18:36:26.040 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.040 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.040 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:26.040 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643458+0000", 2024-09-12T18:36:26.040 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.8400000000000007e-06 2024-09-12T18:36:26.040 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.040 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.040 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:26.040 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643475+0000", 2024-09-12T18:36:26.040 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6874000000000001e-05 2024-09-12T18:36:26.040 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.041 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.041 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.041 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643488+0000", 2024-09-12T18:36:26.041 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3026e-05 2024-09-12T18:36:26.041 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.041 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.041 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:26.041 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643931+0000", 2024-09-12T18:36:26.041 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00044307 2024-09-12T18:36:26.042 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.042 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.042 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:26.042 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644210+0000", 2024-09-12T18:36:26.042 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027908400000000003 2024-09-12T18:36:26.042 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.042 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.042 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:26.043 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644606+0000", 2024-09-12T18:36:26.043 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00039615400000000002 2024-09-12T18:36:26.043 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.043 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.043 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:26.043 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650552+0000", 2024-09-12T18:36:26.043 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0059455619999999997 2024-09-12T18:36:26.043 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.043 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.043 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:26.043 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665302+0000", 2024-09-12T18:36:26.043 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.014749962 2024-09-12T18:36:26.043 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.043 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.044 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:26.044 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665424+0000", 2024-09-12T18:36:26.044 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012214300000000001 2024-09-12T18:36:26.044 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.044 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.044 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:26.044 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665529+0000", 2024-09-12T18:36:26.044 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000104685 2024-09-12T18:36:26.044 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:26.044 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:26.044 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:26.044 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.044 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.044 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:26.045 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:36:26.045 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 60.249307923000003, 2024-09-12T18:36:26.045 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024222582999999999, 2024-09-12T18:36:26.045 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:26.045 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:26.045 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:26.045 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:26.045 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.045 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:26.045 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:36:26.045 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:26.045 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.045 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.045 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:26.046 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:36:26.046 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:26.046 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.046 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.046 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:26.046 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643530+0000", 2024-09-12T18:36:26.046 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.393e-06 2024-09-12T18:36:26.046 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.046 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.046 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:26.046 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643536+0000", 2024-09-12T18:36:26.046 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4130000000000003e-06 2024-09-12T18:36:26.046 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.046 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.047 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:26.047 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643554+0000", 2024-09-12T18:36:26.047 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7572999999999999e-05 2024-09-12T18:36:26.047 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.047 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.047 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.047 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643567+0000", 2024-09-12T18:36:26.047 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3393999999999999e-05 2024-09-12T18:36:26.047 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.047 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.047 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:26.047 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648198+0000", 2024-09-12T18:36:26.047 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0046304479999999997 2024-09-12T18:36:26.047 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.047 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.048 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:26.048 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648413+0000", 2024-09-12T18:36:26.048 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00021507500000000001 2024-09-12T18:36:26.048 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:26.048 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:26.048 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:26.048 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667751+0000", 2024-09-12T18:36:26.048 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.019338286999999999 2024-09-12T18:36:26.048 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:26.048 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:26.048 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:26.048 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:26.048 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:26.049 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:36:26.050 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:26.048+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:26.050 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:36:26.150 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:26.148+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:26.206 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:26.206 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:36:26.206 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.206 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:96548 5.b e41/21 5:d34362e3:::benchmark_data_smithi073_23739_object96547:head v 41'6178, mlcod=41'6176)", 2024-09-12T18:36:26.207 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:26.199516+0000", 2024-09-12T18:36:26.207 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0040789980000000003, 2024-09-12T18:36:26.207 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.004099264, 2024-09-12T18:36:26.207 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:26.207 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:26.207 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:26.208 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:26.208 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.208 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:26.208 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.199516+0000", 2024-09-12T18:36:26.208 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.208 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.209 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.209 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:26.209 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.199516+0000", 2024-09-12T18:36:26.209 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.209 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.209 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.210 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:26.210 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.199516+0000", 2024-09-12T18:36:26.210 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.3799999999999997e-07 2024-09-12T18:36:26.210 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.210 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.210 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:26.211 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.199596+0000", 2024-09-12T18:36:26.211 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0061000000000005e-05 2024-09-12T18:36:26.211 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.211 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.211 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:26.212 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.199605+0000", 2024-09-12T18:36:26.212 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.8100000000000004e-06 2024-09-12T18:36:26.212 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.212 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.212 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.212 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.199610+0000", 2024-09-12T18:36:26.213 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.152e-06 2024-09-12T18:36:26.213 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.213 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.213 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:26.213 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.199661+0000", 2024-09-12T18:36:26.213 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0343000000000002e-05 2024-09-12T18:36:26.214 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.214 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.214 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:26.214 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.199678+0000", 2024-09-12T18:36:26.214 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7087000000000001e-05 2024-09-12T18:36:26.214 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.215 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:26.215 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.215 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.215 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.215 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:96550 5.2 e41/21 5:4646fed5:::benchmark_data_smithi073_23739_object96549:head v 41'5984, mlcod=41'5981)", 2024-09-12T18:36:26.215 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:26.200250+0000", 2024-09-12T18:36:26.215 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0033449740000000001, 2024-09-12T18:36:26.216 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0034193470000000001, 2024-09-12T18:36:26.216 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:26.216 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:26.216 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:26.216 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:26.216 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.217 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:26.217 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.200250+0000", 2024-09-12T18:36:26.217 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.217 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.217 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.217 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:26.217 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.200250+0000", 2024-09-12T18:36:26.218 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.218 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.218 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.218 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:26.218 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.200250+0000", 2024-09-12T18:36:26.218 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5599999999999995e-07 2024-09-12T18:36:26.218 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.218 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.218 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:26.218 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.200316+0000", 2024-09-12T18:36:26.218 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6000999999999994e-05 2024-09-12T18:36:26.218 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.219 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.219 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:26.219 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.200326+0000", 2024-09-12T18:36:26.219 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0057e-05 2024-09-12T18:36:26.219 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.219 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.219 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.219 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.200332+0000", 2024-09-12T18:36:26.219 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.178e-06 2024-09-12T18:36:26.219 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.219 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.219 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:26.219 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.200377+0000", 2024-09-12T18:36:26.219 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4502999999999997e-05 2024-09-12T18:36:26.220 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.220 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.220 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:26.220 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.200395+0000", 2024-09-12T18:36:26.220 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8349999999999999e-05 2024-09-12T18:36:26.220 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.220 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:26.220 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.220 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.220 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.220 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:96552 5.5 5:a0ee57f2:::benchmark_data_smithi073_23739_object96551:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:36:26.220 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:26.200533+0000", 2024-09-12T18:36:26.220 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.003061341, 2024-09-12T18:36:26.221 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0031923699999999999, 2024-09-12T18:36:26.221 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:26.221 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:26.221 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:26.221 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:26.221 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:26.221 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:26.221 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 96552 2024-09-12T18:36:26.221 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.222 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:26.222 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.222 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:26.222 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.200533+0000", 2024-09-12T18:36:26.222 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.222 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.222 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.222 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:26.222 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.200533+0000", 2024-09-12T18:36:26.222 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.222 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.222 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.222 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:26.222 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.200534+0000", 2024-09-12T18:36:26.223 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.167e-06 2024-09-12T18:36:26.223 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.223 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.223 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:26.223 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.200577+0000", 2024-09-12T18:36:26.223 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2398999999999998e-05 2024-09-12T18:36:26.223 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.223 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.223 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:26.223 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.200596+0000", 2024-09-12T18:36:26.223 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9303000000000001e-05 2024-09-12T18:36:26.223 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.224 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.224 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.224 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.200605+0000", 2024-09-12T18:36:26.224 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.0650000000000005e-06 2024-09-12T18:36:26.224 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.224 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.224 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:26.224 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.200651+0000", 2024-09-12T18:36:26.224 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5881999999999999e-05 2024-09-12T18:36:26.224 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.224 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.224 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:26.225 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.200796+0000", 2024-09-12T18:36:26.225 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014536 2024-09-12T18:36:26.225 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.225 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.225 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:26.225 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.200942+0000", 2024-09-12T18:36:26.225 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014544800000000001 2024-09-12T18:36:26.225 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.225 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:26.225 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.225 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.225 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.225 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:96551 5.e e41/21 5:770ba34d:::benchmark_data_smithi073_23739_object96550:head v 41'6113, mlcod=41'6109)", 2024-09-12T18:36:26.225 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:26.200822+0000", 2024-09-12T18:36:26.226 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.002772666, 2024-09-12T18:36:26.226 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0029639269999999999, 2024-09-12T18:36:26.226 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:26.226 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:26.226 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:26.226 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:26.226 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.226 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:26.226 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.200822+0000", 2024-09-12T18:36:26.226 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.226 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.226 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.226 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:26.226 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.200822+0000", 2024-09-12T18:36:26.227 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.227 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.227 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.227 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:26.227 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.200823+0000", 2024-09-12T18:36:26.227 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.0100000000000005e-07 2024-09-12T18:36:26.227 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.227 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.227 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:26.227 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.200881+0000", 2024-09-12T18:36:26.227 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8514000000000003e-05 2024-09-12T18:36:26.227 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.227 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.228 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:26.228 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.200906+0000", 2024-09-12T18:36:26.228 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4909000000000002e-05 2024-09-12T18:36:26.228 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.228 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.228 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.228 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.200912+0000", 2024-09-12T18:36:26.228 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2129999999999996e-06 2024-09-12T18:36:26.228 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.228 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.228 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:26.228 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.201604+0000", 2024-09-12T18:36:26.229 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00069169399999999997 2024-09-12T18:36:26.229 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.229 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.229 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:26.229 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.201623+0000", 2024-09-12T18:36:26.229 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8604e-05 2024-09-12T18:36:26.229 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.229 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:26.229 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.229 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.229 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.229 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:96554 5.a 5:5a6042b5:::benchmark_data_smithi073_23739_object96553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:36:26.229 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:26.201372+0000", 2024-09-12T18:36:26.229 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0022223120000000002, 2024-09-12T18:36:26.230 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0024658050000000002, 2024-09-12T18:36:26.230 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:26.230 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:26.230 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:26.230 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:26.230 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:26.230 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:26.230 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 96554 2024-09-12T18:36:26.230 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.230 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:26.230 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.230 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:26.230 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.201372+0000", 2024-09-12T18:36:26.230 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.231 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.231 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.231 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:26.231 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.201372+0000", 2024-09-12T18:36:26.231 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.231 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.231 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.231 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:26.231 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.201373+0000", 2024-09-12T18:36:26.231 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2699999999999998e-07 2024-09-12T18:36:26.231 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.231 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.231 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:26.232 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.201427+0000", 2024-09-12T18:36:26.232 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.3406999999999999e-05 2024-09-12T18:36:26.232 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.232 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.232 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:26.232 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.201440+0000", 2024-09-12T18:36:26.232 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3930999999999999e-05 2024-09-12T18:36:26.232 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.232 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.232 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.232 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.201450+0000", 2024-09-12T18:36:26.232 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.0790000000000007e-06 2024-09-12T18:36:26.232 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.232 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.233 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:26.233 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.202252+0000", 2024-09-12T18:36:26.233 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00080286099999999998 2024-09-12T18:36:26.233 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.233 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.233 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:26.233 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.202341+0000", 2024-09-12T18:36:26.233 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.8351999999999997e-05 2024-09-12T18:36:26.233 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.233 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.234 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:26.234 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.202428+0000", 2024-09-12T18:36:26.234 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7651999999999994e-05 2024-09-12T18:36:26.234 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.234 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:26.234 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.234 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.234 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.234 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:96555 5.5 5:a1479c93:::benchmark_data_smithi073_23739_object96554:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:36:26.234 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:26.202869+0000", 2024-09-12T18:36:26.234 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00072612499999999999, 2024-09-12T18:36:26.234 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001031412, 2024-09-12T18:36:26.235 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:26.235 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:26.235 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:26.235 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:26.235 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:26.235 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:26.235 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 96555 2024-09-12T18:36:26.235 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.235 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:26.235 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.235 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:26.235 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.202869+0000", 2024-09-12T18:36:26.236 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.236 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.236 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.236 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:26.236 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.202869+0000", 2024-09-12T18:36:26.236 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.236 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.236 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.236 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:26.236 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.202869+0000", 2024-09-12T18:36:26.236 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.6700000000000002e-07 2024-09-12T18:36:26.237 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.237 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.237 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:26.237 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.202985+0000", 2024-09-12T18:36:26.237 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000115549 2024-09-12T18:36:26.237 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.237 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.237 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:26.238 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.202996+0000", 2024-09-12T18:36:26.238 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0604999999999999e-05 2024-09-12T18:36:26.238 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.238 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.238 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.238 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.203004+0000", 2024-09-12T18:36:26.238 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5590000000000006e-06 2024-09-12T18:36:26.238 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.238 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.238 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:26.238 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.203056+0000", 2024-09-12T18:36:26.238 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2015000000000003e-05 2024-09-12T18:36:26.238 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.239 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.239 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:26.239 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.203182+0000", 2024-09-12T18:36:26.239 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000125931 2024-09-12T18:36:26.239 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.239 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.239 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:26.239 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.203333+0000", 2024-09-12T18:36:26.239 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015057300000000001 2024-09-12T18:36:26.239 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.239 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:26.240 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.240 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.240 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.240 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:96553 5.e e41/21 5:7820a9f4:::benchmark_data_smithi073_23739_object96552:head v 41'6114, mlcod=41'6109)", 2024-09-12T18:36:26.240 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:26.203148+0000", 2024-09-12T18:36:26.240 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00044702799999999998, 2024-09-12T18:36:26.240 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00081591499999999996, 2024-09-12T18:36:26.240 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:26.240 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:26.240 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:26.240 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:26.241 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.241 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:26.241 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.203148+0000", 2024-09-12T18:36:26.241 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.241 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.241 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.241 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:26.241 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.203148+0000", 2024-09-12T18:36:26.241 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.241 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.241 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.241 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:26.241 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.203148+0000", 2024-09-12T18:36:26.241 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1399999999999997e-07 2024-09-12T18:36:26.242 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.242 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.242 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:26.242 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.203203+0000", 2024-09-12T18:36:26.242 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4401999999999999e-05 2024-09-12T18:36:26.242 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.242 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.242 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:26.242 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.203218+0000", 2024-09-12T18:36:26.242 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4966e-05 2024-09-12T18:36:26.243 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.243 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.243 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.243 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.203225+0000", 2024-09-12T18:36:26.243 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.9210000000000003e-06 2024-09-12T18:36:26.243 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.243 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.243 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:26.243 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.203431+0000", 2024-09-12T18:36:26.243 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00020612000000000001 2024-09-12T18:36:26.243 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.243 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.244 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:26.244 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.203453+0000", 2024-09-12T18:36:26.244 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2801000000000001e-05 2024-09-12T18:36:26.244 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.244 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:26.244 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.244 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.244 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.244 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:96556 5.0 e41/21 5:0a5211e0:::benchmark_data_smithi073_23739_object96555:head v 41'6139, mlcod=41'6137)", 2024-09-12T18:36:26.244 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:26.203447+0000", 2024-09-12T18:36:26.245 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00014809, 2024-09-12T18:36:26.245 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00057280500000000002, 2024-09-12T18:36:26.245 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:26.245 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:26.245 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:26.245 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:26.245 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.245 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:26.245 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.203447+0000", 2024-09-12T18:36:26.245 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.245 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.245 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.245 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:26.246 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.203447+0000", 2024-09-12T18:36:26.246 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.246 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.246 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.246 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:26.246 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.203447+0000", 2024-09-12T18:36:26.246 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3399999999999999e-07 2024-09-12T18:36:26.246 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.246 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.246 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:26.246 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.203539+0000", 2024-09-12T18:36:26.246 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2157999999999994e-05 2024-09-12T18:36:26.246 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.246 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.247 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:26.247 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.203550+0000", 2024-09-12T18:36:26.247 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0482000000000001e-05 2024-09-12T18:36:26.247 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.247 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.247 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.247 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.203557+0000", 2024-09-12T18:36:26.247 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.413e-06 2024-09-12T18:36:26.247 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.247 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.247 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:26.247 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.203616+0000", 2024-09-12T18:36:26.247 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8541000000000001e-05 2024-09-12T18:36:26.247 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.248 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.248 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:26.248 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.203637+0000", 2024-09-12T18:36:26.248 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1376999999999999e-05 2024-09-12T18:36:26.248 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.248 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:26.248 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.248 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.248 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-12T18:36:26.248 INFO:teuthology.orchestra.run.smithi114.stdout: "num_ops": 8 2024-09-12T18:36:26.248 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:26.249 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:36:26.251 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:26.244+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:26.352 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:26.348+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:26.409 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:26.409 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2024-09-12T18:36:26.409 INFO:teuthology.orchestra.run.smithi114.stdout: "complaint_time": 30, 2024-09-12T18:36:26.410 INFO:teuthology.orchestra.run.smithi114.stdout: "num_blocked_ops": 0 2024-09-12T18:36:26.410 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:26.430 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:36:26.454 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:26.452+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:26.536 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T18:36:26.555 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:26.548+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:26.631 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:26.631 INFO:teuthology.orchestra.run.smithi114.stdout: "size": 20, 2024-09-12T18:36:26.632 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 600, 2024-09-12T18:36:26.632 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:36:26.632 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.632 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:26.632 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:26.632 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 60.998889593000001, 2024-09-12T18:36:26.632 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.042475618999999999, 2024-09-12T18:36:26.632 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:26.632 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:26.632 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:26.632 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:26.632 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.633 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:26.633 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:26.633 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.633 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.633 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.633 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:26.633 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:26.633 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.633 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.633 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.633 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:26.633 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628450+0000", 2024-09-12T18:36:26.634 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4212999999999999e-05 2024-09-12T18:36:26.634 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.634 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.634 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:26.634 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628463+0000", 2024-09-12T18:36:26.634 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2497000000000001e-05 2024-09-12T18:36:26.634 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.634 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.634 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:26.635 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628480+0000", 2024-09-12T18:36:26.635 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7232999999999999e-05 2024-09-12T18:36:26.635 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.635 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.635 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.635 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628496+0000", 2024-09-12T18:36:26.635 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6217000000000001e-05 2024-09-12T18:36:26.635 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.635 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.635 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:26.635 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628641+0000", 2024-09-12T18:36:26.635 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000144709 2024-09-12T18:36:26.635 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.636 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.636 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:26.636 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628657+0000", 2024-09-12T18:36:26.636 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6266e-05 2024-09-12T18:36:26.636 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.636 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.636 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:26.636 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663103+0000", 2024-09-12T18:36:26.636 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.034445523999999998 2024-09-12T18:36:26.636 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.636 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.636 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:26.637 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663373+0000", 2024-09-12T18:36:26.637 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00027085500000000002 2024-09-12T18:36:26.637 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.637 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.637 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:26.637 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663634+0000", 2024-09-12T18:36:26.637 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000260855 2024-09-12T18:36:26.637 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.637 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.637 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:26.638 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670294+0000", 2024-09-12T18:36:26.638 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0066597599999999998 2024-09-12T18:36:26.638 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.638 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.638 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:26.638 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670705+0000", 2024-09-12T18:36:26.638 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00041057099999999998 2024-09-12T18:36:26.638 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.638 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.638 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:26.638 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670820+0000", 2024-09-12T18:36:26.638 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000115111 2024-09-12T18:36:26.638 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.638 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.639 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:26.639 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670912+0000", 2024-09-12T18:36:26.639 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1807999999999999e-05 2024-09-12T18:36:26.639 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.639 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:26.639 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.639 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.639 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.639 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:26.639 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:26.639 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 60.998798847000003, 2024-09-12T18:36:26.639 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.044599273000000002, 2024-09-12T18:36:26.639 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:26.640 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:26.640 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:26.640 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:26.640 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.640 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:26.640 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:26.640 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.640 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.640 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.640 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:26.640 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:26.640 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.641 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.641 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.641 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:26.641 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628528+0000", 2024-09-12T18:36:26.641 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:26.641 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.641 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.641 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:26.641 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628537+0000", 2024-09-12T18:36:26.641 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6969999999999999e-06 2024-09-12T18:36:26.641 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.641 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.641 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:26.642 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628560+0000", 2024-09-12T18:36:26.642 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2889000000000001e-05 2024-09-12T18:36:26.642 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.642 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.642 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.642 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628576+0000", 2024-09-12T18:36:26.642 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.649e-05 2024-09-12T18:36:26.642 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.642 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.642 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:26.642 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628846+0000", 2024-09-12T18:36:26.642 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00026952500000000001 2024-09-12T18:36:26.642 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.643 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.643 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:26.643 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628853+0000", 2024-09-12T18:36:26.643 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6559999999999992e-06 2024-09-12T18:36:26.643 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.643 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.643 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:26.644 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665284+0000", 2024-09-12T18:36:26.644 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.036431140000000001 2024-09-12T18:36:26.644 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.644 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.644 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:26.644 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665494+0000", 2024-09-12T18:36:26.644 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000209762 2024-09-12T18:36:26.644 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.644 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.644 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:26.645 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665816+0000", 2024-09-12T18:36:26.645 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00032162299999999999 2024-09-12T18:36:26.645 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.645 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.645 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:26.645 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670382+0000", 2024-09-12T18:36:26.645 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0045656739999999996 2024-09-12T18:36:26.645 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.645 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.645 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:26.645 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.672978+0000", 2024-09-12T18:36:26.645 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.002596068 2024-09-12T18:36:26.645 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.645 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.646 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:26.646 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673058+0000", 2024-09-12T18:36:26.646 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0198999999999996e-05 2024-09-12T18:36:26.646 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.646 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.646 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:26.646 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673126+0000", 2024-09-12T18:36:26.646 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8120000000000005e-05 2024-09-12T18:36:26.646 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.646 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:26.646 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.646 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.647 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.647 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:23 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:26.647 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:26.647 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 60.998701040999997, 2024-09-12T18:36:26.647 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045539784, 2024-09-12T18:36:26.647 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:26.647 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:26.647 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:26.647 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:26.647 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.647 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:26.647 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:26.647 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.647 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.648 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.648 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:26.648 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:26.648 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.648 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.648 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.648 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:26.648 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628626+0000", 2024-09-12T18:36:26.648 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.573e-06 2024-09-12T18:36:26.648 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.648 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.648 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:26.648 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628640+0000", 2024-09-12T18:36:26.649 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3817e-05 2024-09-12T18:36:26.649 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.649 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.649 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:26.649 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628659+0000", 2024-09-12T18:36:26.649 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9539999999999999e-05 2024-09-12T18:36:26.649 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.649 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.649 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.649 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628675+0000", 2024-09-12T18:36:26.649 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5739e-05 2024-09-12T18:36:26.649 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.650 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.650 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:26.650 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628815+0000", 2024-09-12T18:36:26.650 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014003299999999999 2024-09-12T18:36:26.650 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.650 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.650 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:26.650 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628828+0000", 2024-09-12T18:36:26.650 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2849e-05 2024-09-12T18:36:26.650 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.650 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.650 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:26.650 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651162+0000", 2024-09-12T18:36:26.651 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.022334228000000001 2024-09-12T18:36:26.651 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.651 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.651 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:26.651 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651446+0000", 2024-09-12T18:36:26.651 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00028392800000000002 2024-09-12T18:36:26.651 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.651 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.651 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:26.651 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651746+0000", 2024-09-12T18:36:26.651 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000300091 2024-09-12T18:36:26.651 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.652 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.652 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:26.652 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665113+0000", 2024-09-12T18:36:26.652 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013366678 2024-09-12T18:36:26.652 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.652 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.652 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:26.652 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674010+0000", 2024-09-12T18:36:26.652 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0088970520000000008 2024-09-12T18:36:26.652 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.653 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.653 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:26.653 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674104+0000", 2024-09-12T18:36:26.653 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4124999999999998e-05 2024-09-12T18:36:26.653 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.653 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.653 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:26.653 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674164+0000", 2024-09-12T18:36:26.653 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.0130999999999997e-05 2024-09-12T18:36:26.653 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.653 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:26.653 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.653 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.654 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.654 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:26 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:26.654 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:26.654 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 60.998627835000001, 2024-09-12T18:36:26.654 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045702136999999997, 2024-09-12T18:36:26.654 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:26.654 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:26.654 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:26.654 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:26.654 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.654 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:26.654 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:26.655 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.655 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.655 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.655 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:26.655 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:26.655 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.655 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.655 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.655 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:26.655 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628699+0000", 2024-09-12T18:36:26.655 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3859999999999999e-06 2024-09-12T18:36:26.656 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.656 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.656 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:26.656 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628706+0000", 2024-09-12T18:36:26.656 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0169999999999999e-06 2024-09-12T18:36:26.656 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.656 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.656 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:26.656 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628725+0000", 2024-09-12T18:36:26.656 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8683000000000001e-05 2024-09-12T18:36:26.656 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.656 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.657 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.657 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628740+0000", 2024-09-12T18:36:26.657 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5413999999999998e-05 2024-09-12T18:36:26.657 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.657 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.657 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:26.657 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628907+0000", 2024-09-12T18:36:26.657 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00016670199999999999 2024-09-12T18:36:26.657 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.657 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.657 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:26.657 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628917+0000", 2024-09-12T18:36:26.657 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.046e-05 2024-09-12T18:36:26.658 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.658 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.658 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:26.658 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.660390+0000", 2024-09-12T18:36:26.658 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.031472364000000003 2024-09-12T18:36:26.658 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.658 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.658 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:26.658 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.661767+0000", 2024-09-12T18:36:26.658 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0013769190000000001 2024-09-12T18:36:26.658 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.658 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.658 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:26.659 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.662408+0000", 2024-09-12T18:36:26.659 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00064091099999999998 2024-09-12T18:36:26.659 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.659 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.659 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:26.659 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669577+0000", 2024-09-12T18:36:26.659 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.007169412 2024-09-12T18:36:26.659 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.659 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.660 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:26.660 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674244+0000", 2024-09-12T18:36:26.660 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0046671839999999996 2024-09-12T18:36:26.660 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.660 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.660 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:26.660 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674329+0000", 2024-09-12T18:36:26.660 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5276000000000001e-05 2024-09-12T18:36:26.660 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.660 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.660 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:26.660 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674400+0000", 2024-09-12T18:36:26.660 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0408999999999996e-05 2024-09-12T18:36:26.661 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.661 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:26.661 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.661 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.661 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.661 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:26.661 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:26.661 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 60.998520165999999, 2024-09-12T18:36:26.661 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.044572443000000003, 2024-09-12T18:36:26.661 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:26.661 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:26.661 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:26.661 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:26.662 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.662 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:26.662 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:26.662 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.662 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.662 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.662 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:26.662 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:26.662 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.662 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.662 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.662 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:26.662 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628807+0000", 2024-09-12T18:36:26.662 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3629999999999999e-06 2024-09-12T18:36:26.663 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.663 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.663 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:26.663 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628814+0000", 2024-09-12T18:36:26.663 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.2099999999999996e-06 2024-09-12T18:36:26.663 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.663 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.663 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:26.663 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628832+0000", 2024-09-12T18:36:26.663 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7972999999999999e-05 2024-09-12T18:36:26.663 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.663 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.663 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.664 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628854+0000", 2024-09-12T18:36:26.664 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1857000000000001e-05 2024-09-12T18:36:26.664 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.664 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.664 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:26.664 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628984+0000", 2024-09-12T18:36:26.664 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013013599999999999 2024-09-12T18:36:26.664 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.664 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.664 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:26.664 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628993+0000", 2024-09-12T18:36:26.664 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:36:26.664 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.664 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.665 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:26.665 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668176+0000", 2024-09-12T18:36:26.665 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.039182211000000002 2024-09-12T18:36:26.665 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.665 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.665 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:26.665 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668481+0000", 2024-09-12T18:36:26.665 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00030499200000000002 2024-09-12T18:36:26.665 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.665 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.665 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:26.665 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668771+0000", 2024-09-12T18:36:26.665 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00029018700000000002 2024-09-12T18:36:26.666 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.666 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.666 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:26.666 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.672674+0000", 2024-09-12T18:36:26.666 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0039031890000000001 2024-09-12T18:36:26.666 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.666 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.666 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:26.666 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673214+0000", 2024-09-12T18:36:26.666 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00053981600000000004 2024-09-12T18:36:26.666 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.666 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.666 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:26.666 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673310+0000", 2024-09-12T18:36:26.667 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.6682999999999996e-05 2024-09-12T18:36:26.667 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.667 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.667 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:26.667 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673378+0000", 2024-09-12T18:36:26.667 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7385999999999995e-05 2024-09-12T18:36:26.667 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.667 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:26.667 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.667 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.668 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.668 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:26.668 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:26.668 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 60.998384139999999, 2024-09-12T18:36:26.668 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.041480853999999998, 2024-09-12T18:36:26.668 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:26.668 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:26.668 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:26.668 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:26.668 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.668 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:26.668 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:26.668 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.669 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.669 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.669 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:26.669 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:26.669 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.669 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.669 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.669 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:26.669 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628943+0000", 2024-09-12T18:36:26.669 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.403e-06 2024-09-12T18:36:26.669 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.669 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.669 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:26.670 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628953+0000", 2024-09-12T18:36:26.670 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0273e-05 2024-09-12T18:36:26.670 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.670 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.670 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:26.670 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628973+0000", 2024-09-12T18:36:26.670 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9959999999999999e-05 2024-09-12T18:36:26.670 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.670 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.670 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.670 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628989+0000", 2024-09-12T18:36:26.670 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6447e-05 2024-09-12T18:36:26.670 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.670 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.671 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:26.671 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629144+0000", 2024-09-12T18:36:26.671 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015468900000000001 2024-09-12T18:36:26.671 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.671 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.671 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:26.671 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629162+0000", 2024-09-12T18:36:26.671 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7603000000000001e-05 2024-09-12T18:36:26.671 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.671 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.671 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:26.671 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.646927+0000", 2024-09-12T18:36:26.672 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.017765626 2024-09-12T18:36:26.672 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.672 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.672 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:26.672 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.647245+0000", 2024-09-12T18:36:26.672 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00031797699999999999 2024-09-12T18:36:26.672 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.672 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.672 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:26.672 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.647551+0000", 2024-09-12T18:36:26.672 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00030583500000000002 2024-09-12T18:36:26.672 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.672 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.673 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:26.673 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651738+0000", 2024-09-12T18:36:26.673 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0041864980000000003 2024-09-12T18:36:26.673 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.673 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.673 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:26.673 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670207+0000", 2024-09-12T18:36:26.673 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018469299000000002 2024-09-12T18:36:26.673 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.673 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.674 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:26.674 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670330+0000", 2024-09-12T18:36:26.674 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012284500000000001 2024-09-12T18:36:26.674 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.674 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.674 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:26.674 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670422+0000", 2024-09-12T18:36:26.674 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2398999999999994e-05 2024-09-12T18:36:26.674 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.674 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:26.675 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.675 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.675 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.675 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:26.675 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:26.675 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 60.998306886999998, 2024-09-12T18:36:26.675 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.041623741999999998, 2024-09-12T18:36:26.675 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:26.675 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:26.675 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:26.676 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:26.676 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.676 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:26.676 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:26.676 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.676 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.676 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.677 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:26.677 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:26.677 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.677 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.677 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.677 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:26.677 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629020+0000", 2024-09-12T18:36:26.677 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.15e-06 2024-09-12T18:36:26.677 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.677 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.678 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:26.678 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629023+0000", 2024-09-12T18:36:26.678 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4659999999999999e-06 2024-09-12T18:36:26.678 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.678 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.678 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:26.678 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629037+0000", 2024-09-12T18:36:26.678 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3857e-05 2024-09-12T18:36:26.678 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.678 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.678 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.678 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629062+0000", 2024-09-12T18:36:26.678 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4519999999999999e-05 2024-09-12T18:36:26.679 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.679 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.679 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:26.679 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629253+0000", 2024-09-12T18:36:26.679 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000191335 2024-09-12T18:36:26.679 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.679 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.680 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:26.680 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629266+0000", 2024-09-12T18:36:26.680 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3322999999999999e-05 2024-09-12T18:36:26.680 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.680 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.680 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:26.680 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648331+0000", 2024-09-12T18:36:26.680 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.019065060000000002 2024-09-12T18:36:26.680 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.680 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.680 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:26.680 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.650044+0000", 2024-09-12T18:36:26.681 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017123959999999999 2024-09-12T18:36:26.681 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.681 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.681 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:26.681 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670642+0000", 2024-09-12T18:36:26.681 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.020598635000000001 2024-09-12T18:36:26.681 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.681 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:26.681 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.681 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.682 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.682 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:26.682 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:26.682 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 60.998203555000003, 2024-09-12T18:36:26.682 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.046431252999999999, 2024-09-12T18:36:26.682 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:26.682 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:26.682 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:26.682 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:26.682 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.682 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:26.682 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:26.683 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.683 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.683 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.683 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:26.683 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:26.683 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.683 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.683 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.683 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:26.683 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629123+0000", 2024-09-12T18:36:26.683 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0899999999999999e-06 2024-09-12T18:36:26.683 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.683 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.683 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:26.684 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629138+0000", 2024-09-12T18:36:26.684 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4977000000000001e-05 2024-09-12T18:36:26.684 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.684 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.684 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:26.684 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629149+0000", 2024-09-12T18:36:26.684 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1182999999999999e-05 2024-09-12T18:36:26.684 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.684 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.684 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.684 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629157+0000", 2024-09-12T18:36:26.684 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8129999999999996e-06 2024-09-12T18:36:26.684 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.685 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.685 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:26.685 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629223+0000", 2024-09-12T18:36:26.685 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6463000000000004e-05 2024-09-12T18:36:26.685 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.685 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.685 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:26.685 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629230+0000", 2024-09-12T18:36:26.685 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1360000000000002e-06 2024-09-12T18:36:26.685 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.685 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.685 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:26.686 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669605+0000", 2024-09-12T18:36:26.686 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.040375518999999999 2024-09-12T18:36:26.686 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.686 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.686 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:26.686 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669840+0000", 2024-09-12T18:36:26.686 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00023520099999999999 2024-09-12T18:36:26.686 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.687 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.687 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:26.687 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.675553+0000", 2024-09-12T18:36:26.687 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0057128709999999996 2024-09-12T18:36:26.687 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.687 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:26.687 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.688 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.688 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.688 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:26.688 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:26.688 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 60.998148888000003, 2024-09-12T18:36:26.688 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.037357044999999998, 2024-09-12T18:36:26.689 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:26.689 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:26.689 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:26.689 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:26.689 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.689 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:26.689 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:26.690 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.690 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.690 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.690 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:26.690 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:26.690 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.690 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.691 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.691 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:26.691 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629178+0000", 2024-09-12T18:36:26.691 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.08e-06 2024-09-12T18:36:26.691 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.691 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.691 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:26.692 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629194+0000", 2024-09-12T18:36:26.692 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5899000000000001e-05 2024-09-12T18:36:26.692 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.692 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.692 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:26.692 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629211+0000", 2024-09-12T18:36:26.692 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7363e-05 2024-09-12T18:36:26.693 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.693 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.693 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.693 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629226+0000", 2024-09-12T18:36:26.693 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4567e-05 2024-09-12T18:36:26.693 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.693 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.694 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:26.694 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629299+0000", 2024-09-12T18:36:26.694 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3910000000000002e-05 2024-09-12T18:36:26.694 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.694 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.694 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:26.694 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629307+0000", 2024-09-12T18:36:26.694 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5299999999999999e-06 2024-09-12T18:36:26.695 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.695 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.695 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:26.695 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648185+0000", 2024-09-12T18:36:26.695 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018878533999999999 2024-09-12T18:36:26.695 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.695 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.696 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:26.696 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.649724+0000", 2024-09-12T18:36:26.696 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001538841 2024-09-12T18:36:26.696 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.696 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.696 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:26.696 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.666534+0000", 2024-09-12T18:36:26.697 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.016809320999999999 2024-09-12T18:36:26.697 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.697 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:26.697 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.697 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.697 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.697 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:61561 5.e e35/21 5:715fe5e4:::benchmark_data_smithi073_23739_object61560:head v 35'3863, mlcod=35'3861)", 2024-09-12T18:36:26.698 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:09.220994+0000", 2024-09-12T18:36:26.698 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 17.406331591000001, 2024-09-12T18:36:26.698 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.017185846000000001, 2024-09-12T18:36:26.698 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:26.698 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:26.698 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:26.698 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:26.699 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.699 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:26.699 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.220994+0000", 2024-09-12T18:36:26.699 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.699 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.699 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.699 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:26.699 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.220994+0000", 2024-09-12T18:36:26.700 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.700 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.700 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.700 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:26.700 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.220995+0000", 2024-09-12T18:36:26.700 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2799999999999996e-07 2024-09-12T18:36:26.700 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.701 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.701 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:26.701 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.221049+0000", 2024-09-12T18:36:26.701 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4506999999999998e-05 2024-09-12T18:36:26.701 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.701 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.701 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:26.702 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.221057+0000", 2024-09-12T18:36:26.702 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.4290000000000001e-06 2024-09-12T18:36:26.702 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.702 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.702 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.702 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.221063+0000", 2024-09-12T18:36:26.702 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7899999999999996e-06 2024-09-12T18:36:26.703 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.703 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.703 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:26.703 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.221135+0000", 2024-09-12T18:36:26.703 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1268999999999998e-05 2024-09-12T18:36:26.703 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.703 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.703 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:26.703 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.221153+0000", 2024-09-12T18:36:26.703 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8892000000000001e-05 2024-09-12T18:36:26.703 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.703 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.704 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:26.704 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.238141+0000", 2024-09-12T18:36:26.704 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.016988077000000001 2024-09-12T18:36:26.704 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.704 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.704 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:26.704 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:09.238180+0000", 2024-09-12T18:36:26.704 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8254000000000003e-05 2024-09-12T18:36:26.705 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.705 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:26.705 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.705 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.705 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.705 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:77251 5.3 5:c0b45ab3:::benchmark_data_smithi073_23739_object77250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:26.705 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:16.796319+0000", 2024-09-12T18:36:26.705 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 9.8310061019999999, 2024-09-12T18:36:26.705 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018653991000000002, 2024-09-12T18:36:26.706 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:26.706 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:26.706 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:26.706 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:26.706 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:26.706 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:26.706 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 77251 2024-09-12T18:36:26.706 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.706 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:26.707 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.707 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:26.707 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.796319+0000", 2024-09-12T18:36:26.707 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.707 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.707 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.708 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:26.708 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.796319+0000", 2024-09-12T18:36:26.708 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.708 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.708 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.708 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:26.708 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.796320+0000", 2024-09-12T18:36:26.708 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1100000000000005e-07 2024-09-12T18:36:26.709 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.709 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.709 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:26.709 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.796353+0000", 2024-09-12T18:36:26.709 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3043000000000002e-05 2024-09-12T18:36:26.709 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.709 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.709 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:26.709 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.796361+0000", 2024-09-12T18:36:26.709 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3989999999999998e-06 2024-09-12T18:36:26.709 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.709 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.709 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.710 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.796367+0000", 2024-09-12T18:36:26.710 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9950000000000002e-06 2024-09-12T18:36:26.710 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.710 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.710 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:26.710 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.800568+0000", 2024-09-12T18:36:26.710 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0042010709999999998 2024-09-12T18:36:26.710 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.710 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.710 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:26.710 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.800679+0000", 2024-09-12T18:36:26.710 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000111119 2024-09-12T18:36:26.710 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.711 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.711 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:26.711 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.800802+0000", 2024-09-12T18:36:26.711 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000123418 2024-09-12T18:36:26.711 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.711 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.711 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:26.711 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.805536+0000", 2024-09-12T18:36:26.711 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0047341309999999999 2024-09-12T18:36:26.711 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.711 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.711 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:26.712 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.814921+0000", 2024-09-12T18:36:26.712 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0093849680000000005 2024-09-12T18:36:26.712 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.712 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.712 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:26.712 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.814951+0000", 2024-09-12T18:36:26.712 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.9189000000000001e-05 2024-09-12T18:36:26.712 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.712 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.712 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:26.712 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.814973+0000", 2024-09-12T18:36:26.712 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2847e-05 2024-09-12T18:36:26.712 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.713 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:26.713 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.713 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.713 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.713 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:77253 5.b e38/21 5:df1f7025:::benchmark_data_smithi073_23739_object77252:head v 38'4929, mlcod=38'4925)", 2024-09-12T18:36:26.713 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:16.797351+0000", 2024-09-12T18:36:26.713 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 9.8299749779999992, 2024-09-12T18:36:26.713 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.017650757999999999, 2024-09-12T18:36:26.713 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:26.713 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:26.713 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:26.713 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:26.713 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.714 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:26.714 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.797351+0000", 2024-09-12T18:36:26.714 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.714 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.714 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.714 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:26.714 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.797351+0000", 2024-09-12T18:36:26.714 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.714 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.714 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.714 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:26.714 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.797351+0000", 2024-09-12T18:36:26.714 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4900000000000005e-07 2024-09-12T18:36:26.714 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.715 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.715 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:26.715 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.797404+0000", 2024-09-12T18:36:26.715 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.3038000000000003e-05 2024-09-12T18:36:26.715 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.715 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.715 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:26.715 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.797413+0000", 2024-09-12T18:36:26.715 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.0899999999999994e-06 2024-09-12T18:36:26.715 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.715 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.715 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.715 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.797419+0000", 2024-09-12T18:36:26.716 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1749999999999996e-06 2024-09-12T18:36:26.716 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.716 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.716 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:26.716 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.802808+0000", 2024-09-12T18:36:26.716 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0053890919999999998 2024-09-12T18:36:26.716 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.716 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.716 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:26.716 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.802819+0000", 2024-09-12T18:36:26.716 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1252e-05 2024-09-12T18:36:26.716 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.716 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.716 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:26.717 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.814977+0000", 2024-09-12T18:36:26.717 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012157651 2024-09-12T18:36:26.717 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.717 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.717 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:26.717 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.815001+0000", 2024-09-12T18:36:26.717 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4711000000000001e-05 2024-09-12T18:36:26.717 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.717 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:26.717 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.717 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.717 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.717 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:80960 5.a 5:5d86791e:::benchmark_data_smithi073_23739_object80959:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T18:36:26.718 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:18.558199+0000", 2024-09-12T18:36:26.718 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 8.0691269739999996, 2024-09-12T18:36:26.718 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.019912458000000001, 2024-09-12T18:36:26.718 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:26.718 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:26.718 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:26.718 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:26.718 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:26.718 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:26.718 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 80960 2024-09-12T18:36:26.718 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.718 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:26.718 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.718 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:26.719 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558199+0000", 2024-09-12T18:36:26.719 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.719 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.719 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.719 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:26.719 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558199+0000", 2024-09-12T18:36:26.719 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.719 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.719 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.719 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:26.719 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558199+0000", 2024-09-12T18:36:26.719 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2999999999999999e-07 2024-09-12T18:36:26.719 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.720 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.720 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:26.720 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558255+0000", 2024-09-12T18:36:26.720 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5930999999999997e-05 2024-09-12T18:36:26.720 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.720 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.720 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:26.720 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558263+0000", 2024-09-12T18:36:26.720 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1450000000000008e-06 2024-09-12T18:36:26.720 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.720 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.720 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.721 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558272+0000", 2024-09-12T18:36:26.721 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2050000000000002e-06 2024-09-12T18:36:26.721 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.721 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.721 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:26.721 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558334+0000", 2024-09-12T18:36:26.722 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2481e-05 2024-09-12T18:36:26.722 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.722 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.722 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:26.722 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558425+0000", 2024-09-12T18:36:26.722 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1355999999999997e-05 2024-09-12T18:36:26.723 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.723 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.723 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:26.723 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558535+0000", 2024-09-12T18:36:26.723 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00010997699999999999 2024-09-12T18:36:26.723 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.723 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.723 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:26.723 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.569795+0000", 2024-09-12T18:36:26.723 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011260020000000001 2024-09-12T18:36:26.723 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.723 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.723 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:26.723 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.578026+0000", 2024-09-12T18:36:26.724 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0082307100000000005 2024-09-12T18:36:26.724 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.724 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.724 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:26.724 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.578072+0000", 2024-09-12T18:36:26.724 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.6291000000000001e-05 2024-09-12T18:36:26.724 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.724 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.724 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:26.724 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.578111+0000", 2024-09-12T18:36:26.724 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8512e-05 2024-09-12T18:36:26.725 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.725 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:26.725 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.725 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.725 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.725 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:80965 5.a 5:57bc697e:::benchmark_data_smithi073_23739_object80964:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T18:36:26.726 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:18.560690+0000", 2024-09-12T18:36:26.726 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 8.0666352709999991, 2024-09-12T18:36:26.726 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.017504101000000001, 2024-09-12T18:36:26.726 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:26.726 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:26.726 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:26.727 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:26.727 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:26.727 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:26.727 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 80965 2024-09-12T18:36:26.727 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.727 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:26.728 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.728 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:26.728 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.560690+0000", 2024-09-12T18:36:26.728 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.728 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.728 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.728 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:26.729 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.560690+0000", 2024-09-12T18:36:26.729 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.729 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.729 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.729 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:26.729 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.560692+0000", 2024-09-12T18:36:26.729 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3909999999999999e-06 2024-09-12T18:36:26.729 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.729 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.729 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:26.729 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.560757+0000", 2024-09-12T18:36:26.730 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5594999999999998e-05 2024-09-12T18:36:26.730 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.730 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.730 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:26.730 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.560769+0000", 2024-09-12T18:36:26.730 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1863e-05 2024-09-12T18:36:26.730 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.730 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.730 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.730 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.560776+0000", 2024-09-12T18:36:26.730 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8279999999999997e-06 2024-09-12T18:36:26.730 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.730 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.731 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:26.731 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.562340+0000", 2024-09-12T18:36:26.731 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001563891 2024-09-12T18:36:26.731 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.731 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.731 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:26.731 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.562490+0000", 2024-09-12T18:36:26.731 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015055400000000001 2024-09-12T18:36:26.731 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.731 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.731 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:26.731 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.562642+0000", 2024-09-12T18:36:26.731 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015150600000000001 2024-09-12T18:36:26.732 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.732 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.732 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:26.732 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.569837+0000", 2024-09-12T18:36:26.732 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0071948749999999999 2024-09-12T18:36:26.732 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.732 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.732 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:26.732 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.578119+0000", 2024-09-12T18:36:26.732 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0082825550000000005 2024-09-12T18:36:26.732 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.732 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.733 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:26.733 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.578161+0000", 2024-09-12T18:36:26.733 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.1693000000000002e-05 2024-09-12T18:36:26.733 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.733 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.733 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:26.733 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.578194+0000", 2024-09-12T18:36:26.733 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3349999999999997e-05 2024-09-12T18:36:26.733 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.733 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:26.733 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.733 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.733 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.734 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:80967 5.a 5:5f4000f6:::benchmark_data_smithi073_23739_object80966:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T18:36:26.734 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:18.561016+0000", 2024-09-12T18:36:26.734 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 8.0663092929999998, 2024-09-12T18:36:26.734 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021780831, 2024-09-12T18:36:26.734 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:26.734 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:26.734 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:26.734 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:26.734 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:26.734 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:26.734 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 80967 2024-09-12T18:36:26.734 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.734 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:26.735 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.735 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:26.735 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561016+0000", 2024-09-12T18:36:26.735 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.735 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.735 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.735 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:26.735 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561016+0000", 2024-09-12T18:36:26.735 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.735 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.735 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.736 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:26.736 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561017+0000", 2024-09-12T18:36:26.736 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7599999999999997e-07 2024-09-12T18:36:26.736 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.736 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.736 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:26.736 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561050+0000", 2024-09-12T18:36:26.736 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3524e-05 2024-09-12T18:36:26.736 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.736 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.736 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:26.736 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561058+0000", 2024-09-12T18:36:26.737 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0679999999999997e-06 2024-09-12T18:36:26.737 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.737 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.737 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.737 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561065+0000", 2024-09-12T18:36:26.737 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1990000000000003e-06 2024-09-12T18:36:26.737 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.737 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.737 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:26.738 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564735+0000", 2024-09-12T18:36:26.738 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0036706740000000001 2024-09-12T18:36:26.738 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.738 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.738 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:26.738 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564868+0000", 2024-09-12T18:36:26.738 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000133003 2024-09-12T18:36:26.738 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.738 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.738 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:26.738 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.565010+0000", 2024-09-12T18:36:26.739 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014224300000000001 2024-09-12T18:36:26.739 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.739 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.739 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:26.739 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.569871+0000", 2024-09-12T18:36:26.739 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0048600759999999996 2024-09-12T18:36:26.739 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.739 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.739 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:26.739 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.582729+0000", 2024-09-12T18:36:26.739 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012858090000000001 2024-09-12T18:36:26.739 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.740 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.740 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:26.740 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.582758+0000", 2024-09-12T18:36:26.740 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.9762999999999999e-05 2024-09-12T18:36:26.740 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.740 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.740 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:26.740 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.582797+0000", 2024-09-12T18:36:26.740 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8615000000000002e-05 2024-09-12T18:36:26.740 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.740 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:26.740 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.740 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.740 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.741 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:80971 5.2 e39/21 5:4205ebb1:::benchmark_data_smithi073_23739_object80970:head v 39'5054, mlcod=39'5052)", 2024-09-12T18:36:26.741 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:18.564320+0000", 2024-09-12T18:36:26.741 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 8.0630053279999991, 2024-09-12T18:36:26.741 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.019963669999999999, 2024-09-12T18:36:26.741 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:26.741 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:26.741 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:26.741 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:26.741 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.741 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:26.741 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564320+0000", 2024-09-12T18:36:26.741 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.741 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.742 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.742 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:26.742 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564320+0000", 2024-09-12T18:36:26.742 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.742 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.742 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.742 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:26.742 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564321+0000", 2024-09-12T18:36:26.742 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.77e-07 2024-09-12T18:36:26.742 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.742 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.742 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:26.742 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564418+0000", 2024-09-12T18:36:26.742 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.7602000000000005e-05 2024-09-12T18:36:26.743 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.743 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.743 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:26.743 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564427+0000", 2024-09-12T18:36:26.743 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7439999999999996e-06 2024-09-12T18:36:26.743 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.743 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.743 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.743 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564442+0000", 2024-09-12T18:36:26.743 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5353e-05 2024-09-12T18:36:26.744 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.744 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.744 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:26.744 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.569512+0000", 2024-09-12T18:36:26.744 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0050701840000000001 2024-09-12T18:36:26.744 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.744 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.744 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:26.744 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.569531+0000", 2024-09-12T18:36:26.745 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8311000000000001e-05 2024-09-12T18:36:26.745 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.745 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.745 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:26.745 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.584246+0000", 2024-09-12T18:36:26.745 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.014714947000000001 2024-09-12T18:36:26.745 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.745 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.745 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:26.745 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.584284+0000", 2024-09-12T18:36:26.745 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8152000000000003e-05 2024-09-12T18:36:26.746 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.746 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:26.746 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.746 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.746 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.746 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:95657 5.6 5:60d5bc5b:::benchmark_data_smithi073_23739_object95656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:36:26.746 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:25.760171+0000", 2024-09-12T18:36:26.746 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.86715413799999996, 2024-09-12T18:36:26.746 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018096398999999999, 2024-09-12T18:36:26.746 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:26.746 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:26.746 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:26.747 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:26.747 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:26.747 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:26.747 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 95657 2024-09-12T18:36:26.747 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.747 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:26.747 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.747 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:26.747 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.760171+0000", 2024-09-12T18:36:26.747 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.748 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.748 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.748 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:26.748 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.760171+0000", 2024-09-12T18:36:26.748 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.748 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.748 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.748 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:26.748 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.760172+0000", 2024-09-12T18:36:26.748 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4600000000000003e-07 2024-09-12T18:36:26.748 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.748 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.748 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:26.749 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.760226+0000", 2024-09-12T18:36:26.749 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.3359999999999997e-05 2024-09-12T18:36:26.749 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.749 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.749 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:26.749 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.760234+0000", 2024-09-12T18:36:26.749 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.4950000000000008e-06 2024-09-12T18:36:26.749 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.749 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.749 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.749 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.760240+0000", 2024-09-12T18:36:26.749 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.801e-06 2024-09-12T18:36:26.749 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.750 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.750 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:26.750 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.770465+0000", 2024-09-12T18:36:26.750 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.010224878999999999 2024-09-12T18:36:26.750 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.750 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.750 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:26.750 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.770584+0000", 2024-09-12T18:36:26.750 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000119276 2024-09-12T18:36:26.750 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.750 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.750 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:26.750 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.770735+0000", 2024-09-12T18:36:26.751 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000150994 2024-09-12T18:36:26.751 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.751 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.751 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:26.751 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.775049+0000", 2024-09-12T18:36:26.751 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0043141209999999998 2024-09-12T18:36:26.751 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.751 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.751 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:26.751 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.778195+0000", 2024-09-12T18:36:26.751 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.003145414 2024-09-12T18:36:26.751 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.751 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.752 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:26.752 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.778229+0000", 2024-09-12T18:36:26.752 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4474000000000002e-05 2024-09-12T18:36:26.752 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.752 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.752 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:26.752 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.778268+0000", 2024-09-12T18:36:26.752 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8639000000000001e-05 2024-09-12T18:36:26.752 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.752 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:26.752 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.753 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.753 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.753 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:96749 5.3 5:c505ae3b:::benchmark_data_smithi073_23739_object96748:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:36:26.753 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:26.291192+0000", 2024-09-12T18:36:26.753 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.33613389500000002, 2024-09-12T18:36:26.753 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.017836791000000001, 2024-09-12T18:36:26.753 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:26.753 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:26.753 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:26.753 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:26.753 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:26.753 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:26.753 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 96749 2024-09-12T18:36:26.754 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.754 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:26.754 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.754 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:26.754 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.291192+0000", 2024-09-12T18:36:26.754 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.754 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.754 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.754 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:26.754 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.291192+0000", 2024-09-12T18:36:26.754 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.754 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.755 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.755 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:26.755 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.291192+0000", 2024-09-12T18:36:26.755 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5600000000000005e-07 2024-09-12T18:36:26.755 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.755 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.755 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:26.755 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.291300+0000", 2024-09-12T18:36:26.755 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000107388 2024-09-12T18:36:26.755 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.755 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.756 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:26.756 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.291310+0000", 2024-09-12T18:36:26.756 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0426e-05 2024-09-12T18:36:26.756 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.756 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.756 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.756 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.291317+0000", 2024-09-12T18:36:26.756 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0940000000000002e-06 2024-09-12T18:36:26.756 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.756 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.756 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:26.756 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.300131+0000", 2024-09-12T18:36:26.756 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0088133980000000001 2024-09-12T18:36:26.757 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.757 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.757 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:26.757 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.300246+0000", 2024-09-12T18:36:26.757 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00011576199999999999 2024-09-12T18:36:26.757 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.757 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.757 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:26.757 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.300385+0000", 2024-09-12T18:36:26.757 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013833300000000001 2024-09-12T18:36:26.757 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.757 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.757 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:26.758 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.303176+0000", 2024-09-12T18:36:26.758 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0027914720000000001 2024-09-12T18:36:26.758 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.758 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.758 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:26.758 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.307219+0000", 2024-09-12T18:36:26.758 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0040424199999999997 2024-09-12T18:36:26.758 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.758 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.758 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:26.758 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.307309+0000", 2024-09-12T18:36:26.758 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.0241999999999994e-05 2024-09-12T18:36:26.758 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.758 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.759 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:26.759 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.309028+0000", 2024-09-12T18:36:26.759 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017195000000000001 2024-09-12T18:36:26.759 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.759 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:26.759 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.759 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.759 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.759 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:96974 5.4 e41/21 5:22c5e101:::benchmark_data_smithi073_23739_object96973:head v 41'5961, mlcod=41'5959)", 2024-09-12T18:36:26.759 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:26.404591+0000", 2024-09-12T18:36:26.760 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.222734607, 2024-09-12T18:36:26.760 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.017419793999999999, 2024-09-12T18:36:26.760 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:26.760 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:26.760 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:26.760 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:26.760 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.760 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:26.760 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.404591+0000", 2024-09-12T18:36:26.760 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.760 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.760 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.760 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:26.761 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.404591+0000", 2024-09-12T18:36:26.761 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.761 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.761 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.761 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:26.761 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.404592+0000", 2024-09-12T18:36:26.761 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4499999999999996e-07 2024-09-12T18:36:26.761 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.762 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.762 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:26.762 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.404652+0000", 2024-09-12T18:36:26.762 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.0202999999999999e-05 2024-09-12T18:36:26.762 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.762 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.763 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:26.763 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.404660+0000", 2024-09-12T18:36:26.763 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.4149999999999999e-06 2024-09-12T18:36:26.763 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.763 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.763 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.763 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.404667+0000", 2024-09-12T18:36:26.764 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.9550000000000003e-06 2024-09-12T18:36:26.764 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.764 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.764 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:26.764 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.409006+0000", 2024-09-12T18:36:26.764 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0043392750000000001 2024-09-12T18:36:26.765 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.765 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.765 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:26.765 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.409018+0000", 2024-09-12T18:36:26.765 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1389999999999999e-05 2024-09-12T18:36:26.765 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.766 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.766 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:26.766 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.421963+0000", 2024-09-12T18:36:26.766 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012945607 2024-09-12T18:36:26.766 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.766 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.766 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:26.767 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.422011+0000", 2024-09-12T18:36:26.767 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.7203999999999997e-05 2024-09-12T18:36:26.767 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.767 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:26.767 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.767 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.768 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.768 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:96980 5.c 5:314954af:::benchmark_data_smithi073_23739_object96979:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:36:26.768 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:26.406647+0000", 2024-09-12T18:36:26.768 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.22067896300000001, 2024-09-12T18:36:26.768 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018505462, 2024-09-12T18:36:26.768 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:26.769 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:26.769 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:26.769 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:26.769 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:26.769 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:26.770 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 96980 2024-09-12T18:36:26.770 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.770 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:26.770 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.770 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:26.770 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.406647+0000", 2024-09-12T18:36:26.770 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.771 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.771 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.771 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:26.771 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.406647+0000", 2024-09-12T18:36:26.771 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:26.772 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.772 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.772 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:26.772 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.406647+0000", 2024-09-12T18:36:26.772 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4000000000000002e-07 2024-09-12T18:36:26.772 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.773 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.773 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:26.773 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.406705+0000", 2024-09-12T18:36:26.773 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7685000000000001e-05 2024-09-12T18:36:26.773 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.773 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.774 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:26.774 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.406712+0000", 2024-09-12T18:36:26.774 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8120000000000002e-06 2024-09-12T18:36:26.774 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.775 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.775 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.775 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.406715+0000", 2024-09-12T18:36:26.775 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.6550000000000002e-06 2024-09-12T18:36:26.775 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.775 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.776 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:26.776 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.417564+0000", 2024-09-12T18:36:26.776 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.010849187999999999 2024-09-12T18:36:26.776 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.776 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.776 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:26.777 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.417648+0000", 2024-09-12T18:36:26.777 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.3924999999999994e-05 2024-09-12T18:36:26.777 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.777 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.777 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:26.777 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.417730+0000", 2024-09-12T18:36:26.777 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2016999999999998e-05 2024-09-12T18:36:26.778 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.778 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.778 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:26.778 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.422225+0000", 2024-09-12T18:36:26.778 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0044943149999999996 2024-09-12T18:36:26.778 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.779 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.779 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:26.779 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.425021+0000", 2024-09-12T18:36:26.779 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0027962479999999999 2024-09-12T18:36:26.779 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.779 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.779 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:26.779 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.425110+0000", 2024-09-12T18:36:26.779 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.8834999999999999e-05 2024-09-12T18:36:26.780 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:26.780 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:26.780 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:26.780 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.425152+0000", 2024-09-12T18:36:26.780 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2242e-05 2024-09-12T18:36:26.780 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.780 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:26.780 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.780 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:26.780 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:26.780 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:26.782 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:36:26.782 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:26.779+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:26.873 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 41 16 97928 97912 149.24 128.188 0.00624761 0.00669583 2024-09-12T18:36:26.882 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:26.876+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:26.946 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:26.946 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:36:26.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.946 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:98055 5.4 5:2a1e5d33:::benchmark_data_smithi073_23739_object98054:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:36:26.946 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:26.931712+0000", 2024-09-12T18:36:26.946 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0097330060000000006, 2024-09-12T18:36:26.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0097625439999999997, 2024-09-12T18:36:26.946 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:26.946 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:26.947 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:26.947 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:26.947 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:26.947 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:26.947 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 98055 2024-09-12T18:36:26.947 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.947 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:26.947 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.947 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:26.947 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.931712+0000", 2024-09-12T18:36:26.947 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:26.947 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:26.948 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.931712+0000", 2024-09-12T18:36:26.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:26.948 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:26.948 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.931713+0000", 2024-09-12T18:36:26.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7400000000000003e-07 2024-09-12T18:36:26.948 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:26.948 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.931786+0000", 2024-09-12T18:36:26.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3301999999999997e-05 2024-09-12T18:36:26.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:26.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.931794+0000", 2024-09-12T18:36:26.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6260000000000003e-06 2024-09-12T18:36:26.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.931800+0000", 2024-09-12T18:36:26.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2260000000000002e-06 2024-09-12T18:36:26.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.950 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:26.950 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.935998+0000", 2024-09-12T18:36:26.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041975340000000002 2024-09-12T18:36:26.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.950 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:26.950 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.936101+0000", 2024-09-12T18:36:26.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010282599999999999 2024-09-12T18:36:26.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.950 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:26.950 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.936189+0000", 2024-09-12T18:36:26.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8401999999999998e-05 2024-09-12T18:36:26.951 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.951 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:26.951 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.938971+0000", 2024-09-12T18:36:26.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0027815349999999999 2024-09-12T18:36:26.951 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:26.951 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:26.951 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:26.951 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.951 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:98058 5.b 5:d7334bc7:::benchmark_data_smithi073_23739_object98057:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:36:26.951 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:26.935200+0000", 2024-09-12T18:36:26.951 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0062456300000000003, 2024-09-12T18:36:26.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063502949999999997, 2024-09-12T18:36:26.952 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:26.952 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:26.952 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:26.952 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:26.952 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:26.952 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:26.952 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 98058 2024-09-12T18:36:26.952 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.952 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:26.952 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.952 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:26.952 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.935200+0000", 2024-09-12T18:36:26.953 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:26.953 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.953 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.953 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:26.953 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.935200+0000", 2024-09-12T18:36:26.953 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:26.953 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.953 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.953 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:26.953 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.935202+0000", 2024-09-12T18:36:26.953 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9199999999999998e-06 2024-09-12T18:36:26.953 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.953 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.954 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:26.954 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.935297+0000", 2024-09-12T18:36:26.954 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5370000000000003e-05 2024-09-12T18:36:26.954 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.954 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.954 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:26.954 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.935307+0000", 2024-09-12T18:36:26.954 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5440000000000004e-06 2024-09-12T18:36:26.954 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.954 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.954 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.954 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.935314+0000", 2024-09-12T18:36:26.954 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.888e-06 2024-09-12T18:36:26.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:26.955 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.935375+0000", 2024-09-12T18:36:26.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1512000000000003e-05 2024-09-12T18:36:26.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:26.956 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.935504+0000", 2024-09-12T18:36:26.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012872400000000001 2024-09-12T18:36:26.956 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.956 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.956 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:26.956 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.935649+0000", 2024-09-12T18:36:26.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000145449 2024-09-12T18:36:26.956 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.956 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.956 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:26.956 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.940649+0000", 2024-09-12T18:36:26.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0049998330000000004 2024-09-12T18:36:26.957 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.957 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.957 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:26.957 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.941472+0000", 2024-09-12T18:36:26.957 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00082311000000000005 2024-09-12T18:36:26.957 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.957 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.957 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:26.957 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.941525+0000", 2024-09-12T18:36:26.957 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2793000000000001e-05 2024-09-12T18:36:26.957 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:26.958 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:26.958 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:26.958 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.958 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.958 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:98059 5.b 5:d1853497:::benchmark_data_smithi073_23739_object98058:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:36:26.958 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:26.935922+0000", 2024-09-12T18:36:26.958 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.005523783, 2024-09-12T18:36:26.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0057129290000000003, 2024-09-12T18:36:26.958 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:26.958 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:26.958 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:26.958 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:26.958 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:26.959 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:26.959 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 98059 2024-09-12T18:36:26.959 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.959 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:26.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.959 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:26.959 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.935922+0000", 2024-09-12T18:36:26.959 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:26.959 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.959 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:26.959 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.935922+0000", 2024-09-12T18:36:26.959 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:26.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.960 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:26.960 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.935923+0000", 2024-09-12T18:36:26.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9199999999999999e-07 2024-09-12T18:36:26.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.960 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:26.960 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.936064+0000", 2024-09-12T18:36:26.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000141321 2024-09-12T18:36:26.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.960 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:26.960 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.936078+0000", 2024-09-12T18:36:26.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3706000000000001e-05 2024-09-12T18:36:26.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.936085+0000", 2024-09-12T18:36:26.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6469999999999998e-06 2024-09-12T18:36:26.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:26.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.937930+0000", 2024-09-12T18:36:26.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001844432 2024-09-12T18:36:26.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:26.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.938073+0000", 2024-09-12T18:36:26.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000143533 2024-09-12T18:36:26.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:26.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.938232+0000", 2024-09-12T18:36:26.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015887599999999999 2024-09-12T18:36:26.962 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:26.962 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:26.962 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:26.963 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.963 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.963 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:98060 5.e 5:7899b1e3:::benchmark_data_smithi073_23739_object98059:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:36:26.963 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:26.936101+0000", 2024-09-12T18:36:26.963 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0053447629999999998, 2024-09-12T18:36:26.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055974579999999996, 2024-09-12T18:36:26.963 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:26.963 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:26.963 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:26.963 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:26.963 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:26.963 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:26.964 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 98060 2024-09-12T18:36:26.964 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.964 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:26.964 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.964 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:26.964 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.936101+0000", 2024-09-12T18:36:26.964 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:26.964 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.964 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.964 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:26.964 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.936101+0000", 2024-09-12T18:36:26.964 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:26.964 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:26.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.936101+0000", 2024-09-12T18:36:26.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1500000000000004e-07 2024-09-12T18:36:26.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:26.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.936160+0000", 2024-09-12T18:36:26.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.9077999999999999e-05 2024-09-12T18:36:26.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:26.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.936171+0000", 2024-09-12T18:36:26.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0777e-05 2024-09-12T18:36:26.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.936185+0000", 2024-09-12T18:36:26.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4287999999999999e-05 2024-09-12T18:36:26.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:26.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.936235+0000", 2024-09-12T18:36:26.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9081e-05 2024-09-12T18:36:26.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:26.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.936364+0000", 2024-09-12T18:36:26.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012959199999999999 2024-09-12T18:36:26.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:26.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.936522+0000", 2024-09-12T18:36:26.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000158169 2024-09-12T18:36:26.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:26.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.941691+0000", 2024-09-12T18:36:26.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0051684859999999999 2024-09-12T18:36:26.968 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:26.968 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:26.968 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:26.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.968 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:98061 5.d 5:ba6665da:::benchmark_data_smithi073_23739_object98060:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:36:26.968 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:26.936206+0000", 2024-09-12T18:36:26.968 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0052390980000000002, 2024-09-12T18:36:26.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0055607039999999996, 2024-09-12T18:36:26.968 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:26.968 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:26.968 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:26.969 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:26.969 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:26.969 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:26.969 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 98061 2024-09-12T18:36:26.969 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.969 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:26.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:26.969 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.936206+0000", 2024-09-12T18:36:26.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:26.969 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:26.970 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.936206+0000", 2024-09-12T18:36:26.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:26.970 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.970 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.970 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:26.970 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.936207+0000", 2024-09-12T18:36:26.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.9599999999999999e-07 2024-09-12T18:36:26.970 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.970 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.970 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:26.970 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.936248+0000", 2024-09-12T18:36:26.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0781999999999997e-05 2024-09-12T18:36:26.970 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:26.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.936256+0000", 2024-09-12T18:36:26.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7299999999999994e-06 2024-09-12T18:36:26.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.936262+0000", 2024-09-12T18:36:26.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.93e-06 2024-09-12T18:36:26.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:26.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.936314+0000", 2024-09-12T18:36:26.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1184999999999999e-05 2024-09-12T18:36:26.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:26.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.936436+0000", 2024-09-12T18:36:26.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012233400000000001 2024-09-12T18:36:26.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:26.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.936591+0000", 2024-09-12T18:36:26.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000154757 2024-09-12T18:36:26.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:26.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.940940+0000", 2024-09-12T18:36:26.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0043489399999999999 2024-09-12T18:36:26.973 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:26.973 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:26.973 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:26.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.973 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:98062 5.f e41/21 5:f5b9d471:::benchmark_data_smithi073_23739_object98061:head v 41'6107, mlcod=41'6105)", 2024-09-12T18:36:26.973 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:26.936716+0000", 2024-09-12T18:36:26.973 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0047296480000000004, 2024-09-12T18:36:26.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0051166800000000002, 2024-09-12T18:36:26.973 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:26.974 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:26.974 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:26.974 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:26.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.974 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:26.974 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.936716+0000", 2024-09-12T18:36:26.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:26.974 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.974 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:26.974 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.936716+0000", 2024-09-12T18:36:26.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:26.974 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.975 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:26.975 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.936716+0000", 2024-09-12T18:36:26.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4000000000000002e-07 2024-09-12T18:36:26.975 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.975 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.975 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:26.975 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.936768+0000", 2024-09-12T18:36:26.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1653000000000002e-05 2024-09-12T18:36:26.975 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.975 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.975 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:26.975 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.936779+0000", 2024-09-12T18:36:26.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0847e-05 2024-09-12T18:36:26.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.976 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.976 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.936785+0000", 2024-09-12T18:36:26.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1360000000000002e-06 2024-09-12T18:36:26.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.976 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:26.976 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.936848+0000", 2024-09-12T18:36:26.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2838999999999999e-05 2024-09-12T18:36:26.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:26.977 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.936873+0000", 2024-09-12T18:36:26.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4936999999999999e-05 2024-09-12T18:36:26.977 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:26.977 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:26.977 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:26.977 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.977 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:98064 5.f e41/21 5:fd4e0f3d:::benchmark_data_smithi073_23739_object98063:head v 41'6108, mlcod=41'6105)", 2024-09-12T18:36:26.977 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:26.938868+0000", 2024-09-12T18:36:26.977 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0025773580000000001, 2024-09-12T18:36:26.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0030155859999999998, 2024-09-12T18:36:26.977 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:26.978 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:26.978 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:26.978 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:26.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.978 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:26.978 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.938868+0000", 2024-09-12T18:36:26.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:26.978 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.978 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:26.978 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.938868+0000", 2024-09-12T18:36:26.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:26.978 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.979 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:26.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.938869+0000", 2024-09-12T18:36:26.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1699999999999998e-07 2024-09-12T18:36:26.979 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.979 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:26.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.938915+0000", 2024-09-12T18:36:26.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6263000000000001e-05 2024-09-12T18:36:26.979 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.979 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:26.980 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.938925+0000", 2024-09-12T18:36:26.980 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6330000000000008e-06 2024-09-12T18:36:26.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.980 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.980 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.938993+0000", 2024-09-12T18:36:26.980 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8518999999999999e-05 2024-09-12T18:36:26.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.980 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:26.980 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.939029+0000", 2024-09-12T18:36:26.980 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5936000000000003e-05 2024-09-12T18:36:26.981 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.981 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.981 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:26.981 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.939041+0000", 2024-09-12T18:36:26.981 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1807999999999999e-05 2024-09-12T18:36:26.981 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:26.981 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:26.981 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:26.981 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.981 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.981 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:98065 5.8 5:1d50a35a:::benchmark_data_smithi073_23739_object98064:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:36:26.981 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:26.938780+0000", 2024-09-12T18:36:26.981 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0026649769999999998, 2024-09-12T18:36:26.982 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031550609999999998, 2024-09-12T18:36:26.982 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:26.982 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:26.982 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:26.982 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:26.982 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:26.982 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:26.982 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 98065 2024-09-12T18:36:26.982 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.982 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:26.982 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.982 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:26.982 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.938780+0000", 2024-09-12T18:36:26.983 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:26.983 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.983 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.983 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:26.983 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.938780+0000", 2024-09-12T18:36:26.983 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:26.983 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.983 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.983 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:26.983 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.938782+0000", 2024-09-12T18:36:26.983 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.311e-06 2024-09-12T18:36:26.983 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.984 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:26.984 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.939054+0000", 2024-09-12T18:36:26.984 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000272124 2024-09-12T18:36:26.984 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.984 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:26.984 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.939064+0000", 2024-09-12T18:36:26.984 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.594e-06 2024-09-12T18:36:26.984 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.984 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.984 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.939070+0000", 2024-09-12T18:36:26.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.241e-06 2024-09-12T18:36:26.985 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.985 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.985 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:26.985 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.939118+0000", 2024-09-12T18:36:26.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7966999999999997e-05 2024-09-12T18:36:26.985 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.985 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.985 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:26.985 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.939255+0000", 2024-09-12T18:36:26.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013769300000000001 2024-09-12T18:36:26.985 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.986 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.986 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:26.986 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.939382+0000", 2024-09-12T18:36:26.986 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000127016 2024-09-12T18:36:26.986 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:26.986 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:26.986 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:26.986 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.986 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.986 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:98066 5.8 5:12d6b1e8:::benchmark_data_smithi073_23739_object98065:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:36:26.986 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:26.939084+0000", 2024-09-12T18:36:26.986 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.002361419, 2024-09-12T18:36:26.986 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002913321, 2024-09-12T18:36:26.986 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:26.987 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:26.987 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:26.987 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:26.987 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:26.987 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:26.987 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 98066 2024-09-12T18:36:26.987 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.987 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:26.987 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.987 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:26.987 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.939084+0000", 2024-09-12T18:36:26.987 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:26.987 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.988 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.988 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:26.988 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.939084+0000", 2024-09-12T18:36:26.988 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:26.988 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.988 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.988 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:26.988 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.939085+0000", 2024-09-12T18:36:26.988 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7299999999999995e-07 2024-09-12T18:36:26.988 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.988 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.988 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:26.988 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.939200+0000", 2024-09-12T18:36:26.989 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000115392 2024-09-12T18:36:26.989 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.989 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.989 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:26.989 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.939209+0000", 2024-09-12T18:36:26.989 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2930000000000006e-06 2024-09-12T18:36:26.989 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.989 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.989 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.989 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.939216+0000", 2024-09-12T18:36:26.989 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.3899999999999998e-06 2024-09-12T18:36:26.989 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.989 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.990 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:26.990 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.941618+0000", 2024-09-12T18:36:26.990 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0024026949999999998 2024-09-12T18:36:26.990 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.990 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.990 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:26.990 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.941744+0000", 2024-09-12T18:36:26.990 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012505900000000001 2024-09-12T18:36:26.990 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.990 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.990 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:26.990 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.941891+0000", 2024-09-12T18:36:26.990 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000147768 2024-09-12T18:36:26.991 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:26.991 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:26.991 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:26.991 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.991 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.991 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:98067 5.e 5:7807d631:::benchmark_data_smithi073_23739_object98066:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:36:26.991 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:26.939229+0000", 2024-09-12T18:36:26.991 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0022168999999999999, 2024-09-12T18:36:26.991 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0028308399999999998, 2024-09-12T18:36:26.991 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:26.991 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:26.991 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:26.991 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:26.991 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:26.992 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:26.992 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 98067 2024-09-12T18:36:26.992 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.992 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:26.992 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.992 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:26.992 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.939229+0000", 2024-09-12T18:36:26.992 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:26.992 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.992 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.992 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:26.992 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.939229+0000", 2024-09-12T18:36:26.993 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:26.993 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.993 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.993 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:26.993 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.939229+0000", 2024-09-12T18:36:26.993 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9800000000000003e-07 2024-09-12T18:36:26.993 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.993 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.993 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:26.993 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.939268+0000", 2024-09-12T18:36:26.993 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9128999999999998e-05 2024-09-12T18:36:26.993 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.993 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.994 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:26.994 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.939276+0000", 2024-09-12T18:36:26.994 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9969999999999998e-06 2024-09-12T18:36:26.994 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.994 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.994 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.994 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.939283+0000", 2024-09-12T18:36:26.994 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4350000000000002e-06 2024-09-12T18:36:26.994 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.994 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.994 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:26.994 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.939328+0000", 2024-09-12T18:36:26.994 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5485999999999998e-05 2024-09-12T18:36:26.994 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.995 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.995 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:26.995 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.939441+0000", 2024-09-12T18:36:26.995 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112632 2024-09-12T18:36:26.995 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.995 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.995 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:26.995 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.939588+0000", 2024-09-12T18:36:26.995 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014677599999999999 2024-09-12T18:36:26.995 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:26.995 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:26.995 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:26.995 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.996 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.996 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:98069 5.4 5:268501e1:::benchmark_data_smithi073_23739_object98068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:36:26.996 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:26.939296+0000", 2024-09-12T18:36:26.996 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0021494470000000001, 2024-09-12T18:36:26.996 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0028260350000000002, 2024-09-12T18:36:26.996 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:26.996 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:26.996 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:26.996 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:26.996 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:26.996 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:26.996 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 98069 2024-09-12T18:36:26.996 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.997 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:26.997 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.997 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:26.997 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.939296+0000", 2024-09-12T18:36:26.997 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:26.997 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.997 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.997 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:26.997 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.939296+0000", 2024-09-12T18:36:26.997 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:26.997 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.997 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.997 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:26.997 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.939297+0000", 2024-09-12T18:36:26.998 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1600000000000001e-07 2024-09-12T18:36:26.998 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.998 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.998 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:26.998 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.939332+0000", 2024-09-12T18:36:26.998 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5809000000000002e-05 2024-09-12T18:36:26.998 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.998 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.998 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:26.999 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.939340+0000", 2024-09-12T18:36:26.999 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.8029999999999997e-06 2024-09-12T18:36:26.999 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.999 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.999 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:26.999 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.939346+0000", 2024-09-12T18:36:26.999 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1299999999999998e-06 2024-09-12T18:36:26.999 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:26.999 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:26.999 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:26.999 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.939410+0000", 2024-09-12T18:36:26.999 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.3390000000000001e-05 2024-09-12T18:36:27.000 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.000 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.000 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:27.000 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.939569+0000", 2024-09-12T18:36:27.000 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015944599999999999 2024-09-12T18:36:27.000 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.000 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.000 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:27.000 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.939722+0000", 2024-09-12T18:36:27.000 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015299700000000001 2024-09-12T18:36:27.000 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.000 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:27.000 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.001 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.001 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.001 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:98068 5.f e41/21 5:f0bfa217:::benchmark_data_smithi073_23739_object98067:head v 41'6109, mlcod=41'6105)", 2024-09-12T18:36:27.001 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:26.940532+0000", 2024-09-12T18:36:27.001 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00091373400000000003, 2024-09-12T18:36:27.001 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001648219, 2024-09-12T18:36:27.001 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:27.001 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:27.002 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:27.002 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:27.002 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.002 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:27.002 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.940532+0000", 2024-09-12T18:36:27.002 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.002 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.002 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.002 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:27.002 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.940532+0000", 2024-09-12T18:36:27.002 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.002 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.002 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.003 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:27.003 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.940532+0000", 2024-09-12T18:36:27.003 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8800000000000002e-07 2024-09-12T18:36:27.003 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.003 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.003 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:27.003 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.940583+0000", 2024-09-12T18:36:27.003 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1029000000000002e-05 2024-09-12T18:36:27.003 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.003 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.003 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:27.003 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.940595+0000", 2024-09-12T18:36:27.003 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1758e-05 2024-09-12T18:36:27.003 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.004 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.004 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:27.004 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.940602+0000", 2024-09-12T18:36:27.004 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2060000000000001e-06 2024-09-12T18:36:27.004 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.004 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.004 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:27.004 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.940998+0000", 2024-09-12T18:36:27.004 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00039577900000000002 2024-09-12T18:36:27.004 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.004 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.004 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:27.005 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.941014+0000", 2024-09-12T18:36:27.005 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6280999999999999e-05 2024-09-12T18:36:27.005 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.005 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:27.005 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.005 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.005 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.005 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:98072 5.0 5:0cdc0761:::benchmark_data_smithi073_23739_object98071:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:36:27.005 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:26.940924+0000", 2024-09-12T18:36:27.005 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00052126699999999995, 2024-09-12T18:36:27.005 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013087859999999999, 2024-09-12T18:36:27.005 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:27.006 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:27.006 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:27.006 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:27.006 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:27.006 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:27.006 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 98072 2024-09-12T18:36:27.006 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.006 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:27.006 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.006 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:27.006 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.940924+0000", 2024-09-12T18:36:27.006 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.007 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.007 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.007 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:27.007 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.940924+0000", 2024-09-12T18:36:27.007 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.007 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.007 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.007 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:27.007 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.940925+0000", 2024-09-12T18:36:27.007 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.119e-06 2024-09-12T18:36:27.007 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.007 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.007 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:27.008 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.941046+0000", 2024-09-12T18:36:27.008 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012115799999999999 2024-09-12T18:36:27.008 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.008 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.008 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:27.008 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.941059+0000", 2024-09-12T18:36:27.008 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2986000000000001e-05 2024-09-12T18:36:27.008 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.008 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.008 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:27.008 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.941067+0000", 2024-09-12T18:36:27.008 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9619999999999993e-06 2024-09-12T18:36:27.008 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.009 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.009 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:27.009 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.941595+0000", 2024-09-12T18:36:27.009 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00052807500000000003 2024-09-12T18:36:27.009 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.009 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.009 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:27.009 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.941717+0000", 2024-09-12T18:36:27.009 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000121853 2024-09-12T18:36:27.009 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.009 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.009 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:27.010 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.941834+0000", 2024-09-12T18:36:27.010 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000116829 2024-09-12T18:36:27.010 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.010 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:27.010 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.010 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.010 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-09-12T18:36:27.010 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 13 2024-09-12T18:36:27.010 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:27.012 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:36:27.013 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:27.007+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:27.113 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:27.111+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:27.206 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:27.206 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-09-12T18:36:27.206 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-09-12T18:36:27.206 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-09-12T18:36:27.207 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:27.214 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:27.211+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:27.227 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:36:27.286 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:36:27.286 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-12T18:36:27.314 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:27.308+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:27.415 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:27.412+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:27.429 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:27.429 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-09-12T18:36:27.429 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-09-12T18:36:27.429 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:36:27.429 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.429 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:27.430 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:27.430 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 61.793469459000001, 2024-09-12T18:36:27.430 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025088781000000001, 2024-09-12T18:36:27.430 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:27.430 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:27.430 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:27.430 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:27.430 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.430 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:27.430 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:27.430 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.430 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.430 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.431 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:27.431 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:27.431 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.431 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.431 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.431 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:27.431 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632518+0000", 2024-09-12T18:36:27.431 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:36:27.431 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.431 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.431 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:27.431 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632533+0000", 2024-09-12T18:36:27.431 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5130000000000001e-05 2024-09-12T18:36:27.432 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.432 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.432 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:27.432 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632564+0000", 2024-09-12T18:36:27.432 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0788999999999999e-05 2024-09-12T18:36:27.432 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.432 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.432 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:27.432 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632590+0000", 2024-09-12T18:36:27.432 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6057000000000001e-05 2024-09-12T18:36:27.432 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.432 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.432 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:27.433 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.635931+0000", 2024-09-12T18:36:27.433 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033411320000000001 2024-09-12T18:36:27.433 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.433 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.433 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:27.433 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636186+0000", 2024-09-12T18:36:27.433 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025452500000000002 2024-09-12T18:36:27.433 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.433 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.434 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:27.434 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636445+0000", 2024-09-12T18:36:27.434 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000259268 2024-09-12T18:36:27.434 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.434 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.434 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:27.434 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639562+0000", 2024-09-12T18:36:27.434 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031167 2024-09-12T18:36:27.434 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.434 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.434 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:27.434 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657314+0000", 2024-09-12T18:36:27.434 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017752562 2024-09-12T18:36:27.435 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.435 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.435 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:27.435 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657445+0000", 2024-09-12T18:36:27.435 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013105899999999999 2024-09-12T18:36:27.435 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.435 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.435 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:27.435 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657598+0000", 2024-09-12T18:36:27.435 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015247899999999999 2024-09-12T18:36:27.435 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.435 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:27.436 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.436 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.436 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.436 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:27.436 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:27.436 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 61.793343256, 2024-09-12T18:36:27.436 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025643131999999999, 2024-09-12T18:36:27.436 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:27.436 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:27.436 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:27.436 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:27.436 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.436 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:27.437 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:27.437 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.437 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.437 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.437 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:27.437 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:27.437 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.437 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.437 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.437 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:27.440 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632637+0000", 2024-09-12T18:36:27.440 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5600000000000001e-06 2024-09-12T18:36:27.440 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.440 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.440 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:27.441 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632650+0000", 2024-09-12T18:36:27.441 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3186e-05 2024-09-12T18:36:27.441 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.441 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.441 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:27.441 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632672+0000", 2024-09-12T18:36:27.441 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2013000000000001e-05 2024-09-12T18:36:27.441 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.441 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.441 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:27.441 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632687+0000", 2024-09-12T18:36:27.441 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5109999999999999e-05 2024-09-12T18:36:27.442 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.442 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.442 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:27.442 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636994+0000", 2024-09-12T18:36:27.442 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0043065539999999998 2024-09-12T18:36:27.442 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.442 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.442 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:27.442 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637198+0000", 2024-09-12T18:36:27.442 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020387199999999999 2024-09-12T18:36:27.442 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.442 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.442 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:27.443 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637475+0000", 2024-09-12T18:36:27.443 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027731000000000001 2024-09-12T18:36:27.443 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.443 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.443 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:27.443 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639574+0000", 2024-09-12T18:36:27.443 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020988999999999999 2024-09-12T18:36:27.443 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.443 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.443 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:27.443 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658057+0000", 2024-09-12T18:36:27.443 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018482926 2024-09-12T18:36:27.443 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.444 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.444 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:27.444 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658184+0000", 2024-09-12T18:36:27.444 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012756200000000001 2024-09-12T18:36:27.444 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.444 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.444 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:27.444 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658278+0000", 2024-09-12T18:36:27.444 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4139000000000001e-05 2024-09-12T18:36:27.444 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.444 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:27.444 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.445 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.445 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.445 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:27.445 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:27.445 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 61.793268163999997, 2024-09-12T18:36:27.445 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025238883, 2024-09-12T18:36:27.445 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:27.445 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:27.445 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:27.445 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:27.445 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.445 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:27.445 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:27.446 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.446 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.446 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.446 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:27.446 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:27.446 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.446 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.446 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.446 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:27.446 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632712+0000", 2024-09-12T18:36:27.446 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6869999999999999e-06 2024-09-12T18:36:27.446 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.446 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.447 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:27.447 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632719+0000", 2024-09-12T18:36:27.447 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6059999999999999e-06 2024-09-12T18:36:27.447 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.447 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.447 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:27.447 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632737+0000", 2024-09-12T18:36:27.447 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7983999999999999e-05 2024-09-12T18:36:27.447 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.448 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.448 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:27.448 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632751+0000", 2024-09-12T18:36:27.448 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4473e-05 2024-09-12T18:36:27.448 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.448 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.448 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:27.448 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636961+0000", 2024-09-12T18:36:27.448 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042100840000000002 2024-09-12T18:36:27.448 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.449 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.449 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:27.449 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637211+0000", 2024-09-12T18:36:27.449 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000249738 2024-09-12T18:36:27.449 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.449 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.449 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:27.449 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637504+0000", 2024-09-12T18:36:27.449 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00029271499999999998 2024-09-12T18:36:27.449 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.449 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.449 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:27.449 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639582+0000", 2024-09-12T18:36:27.449 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020783389999999998 2024-09-12T18:36:27.450 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.450 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.450 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:27.450 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657709+0000", 2024-09-12T18:36:27.450 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018126758999999999 2024-09-12T18:36:27.450 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.450 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.450 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:27.450 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657830+0000", 2024-09-12T18:36:27.450 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000121329 2024-09-12T18:36:27.450 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.450 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.451 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:27.451 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657949+0000", 2024-09-12T18:36:27.451 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000119169 2024-09-12T18:36:27.451 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.451 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:27.451 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.451 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.451 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.451 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:27.451 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:27.451 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 61.793204117999998, 2024-09-12T18:36:27.451 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026711823999999999, 2024-09-12T18:36:27.451 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:27.452 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:27.452 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:27.452 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:27.452 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.452 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:27.452 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:27.452 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.452 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.452 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.452 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:27.452 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:27.452 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.452 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.453 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.453 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:27.453 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632775+0000", 2024-09-12T18:36:27.453 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9999999999999995e-07 2024-09-12T18:36:27.453 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.453 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.453 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:27.453 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632788+0000", 2024-09-12T18:36:27.453 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2629999999999999e-05 2024-09-12T18:36:27.453 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.453 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.453 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:27.453 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632806+0000", 2024-09-12T18:36:27.454 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:36:27.454 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.454 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.454 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:27.454 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632820+0000", 2024-09-12T18:36:27.454 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3777e-05 2024-09-12T18:36:27.454 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.454 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.454 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:27.454 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638310+0000", 2024-09-12T18:36:27.454 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054898280000000004 2024-09-12T18:36:27.454 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.454 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.455 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:27.455 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638480+0000", 2024-09-12T18:36:27.455 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016968199999999999 2024-09-12T18:36:27.455 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.455 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.455 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:27.455 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638799+0000", 2024-09-12T18:36:27.455 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031915999999999997 2024-09-12T18:36:27.455 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.455 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.456 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:27.456 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639866+0000", 2024-09-12T18:36:27.456 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001067405 2024-09-12T18:36:27.456 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.456 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.456 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:27.456 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658398+0000", 2024-09-12T18:36:27.456 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018531542000000002 2024-09-12T18:36:27.456 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.456 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.456 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:27.456 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658643+0000", 2024-09-12T18:36:27.456 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00024531500000000002 2024-09-12T18:36:27.457 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.457 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.457 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:27.457 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.659486+0000", 2024-09-12T18:36:27.457 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00084316899999999995 2024-09-12T18:36:27.457 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.457 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:27.457 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.457 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.457 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.457 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:27.457 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:36:27.457 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 61.792977055999998, 2024-09-12T18:36:27.458 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.021357139000000001, 2024-09-12T18:36:27.458 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:27.458 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:27.458 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:27.458 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:27.458 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.458 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:27.458 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:36:27.458 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.458 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.458 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.458 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:27.458 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:36:27.459 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.459 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.459 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.459 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:27.459 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633003+0000", 2024-09-12T18:36:27.459 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.53e-06 2024-09-12T18:36:27.459 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.459 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.459 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:27.459 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633012+0000", 2024-09-12T18:36:27.459 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9290000000000004e-06 2024-09-12T18:36:27.459 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.459 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.459 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:27.460 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633034+0000", 2024-09-12T18:36:27.460 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2127e-05 2024-09-12T18:36:27.460 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.460 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.460 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:27.460 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633054+0000", 2024-09-12T18:36:27.460 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9476000000000001e-05 2024-09-12T18:36:27.460 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.460 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.460 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:27.460 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636657+0000", 2024-09-12T18:36:27.460 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036038839999999999 2024-09-12T18:36:27.460 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.461 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.461 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:27.461 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636885+0000", 2024-09-12T18:36:27.461 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022798800000000001 2024-09-12T18:36:27.461 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.461 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.461 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:27.461 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637189+0000", 2024-09-12T18:36:27.461 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030392100000000002 2024-09-12T18:36:27.461 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.461 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.461 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:27.461 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639271+0000", 2024-09-12T18:36:27.462 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020817460000000002 2024-09-12T18:36:27.462 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.462 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.462 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:27.462 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.652371+0000", 2024-09-12T18:36:27.462 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013099417 2024-09-12T18:36:27.462 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.462 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.462 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:27.462 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654255+0000", 2024-09-12T18:36:27.462 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018846049999999999 2024-09-12T18:36:27.462 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.462 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.463 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:27.463 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654359+0000", 2024-09-12T18:36:27.463 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000103516 2024-09-12T18:36:27.463 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.463 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:27.463 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.463 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.463 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.463 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:27.463 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:27.463 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 61.792895364000003, 2024-09-12T18:36:27.463 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026938645000000001, 2024-09-12T18:36:27.463 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:27.464 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:27.464 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:27.464 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:27.464 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.464 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:27.464 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:27.464 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.464 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.464 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.464 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:27.464 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:27.464 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.464 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.465 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.465 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:27.465 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633085+0000", 2024-09-12T18:36:27.465 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:27.465 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.465 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.465 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:27.465 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633093+0000", 2024-09-12T18:36:27.465 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3999999999999992e-06 2024-09-12T18:36:27.465 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.465 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.465 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:27.465 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633111+0000", 2024-09-12T18:36:27.465 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8070000000000001e-05 2024-09-12T18:36:27.466 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.466 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.466 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:27.466 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633126+0000", 2024-09-12T18:36:27.466 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4487e-05 2024-09-12T18:36:27.466 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.466 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.466 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:27.466 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638290+0000", 2024-09-12T18:36:27.466 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0051640269999999999 2024-09-12T18:36:27.466 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.466 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.466 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:27.467 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638547+0000", 2024-09-12T18:36:27.467 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025714100000000001 2024-09-12T18:36:27.467 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.467 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.467 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:27.467 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638850+0000", 2024-09-12T18:36:27.467 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030278400000000001 2024-09-12T18:36:27.467 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.467 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.467 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:27.467 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.640706+0000", 2024-09-12T18:36:27.467 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018564580000000001 2024-09-12T18:36:27.467 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.468 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.468 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:27.468 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658420+0000", 2024-09-12T18:36:27.468 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017714395000000001 2024-09-12T18:36:27.468 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.468 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.468 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:27.468 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658635+0000", 2024-09-12T18:36:27.468 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021413500000000001 2024-09-12T18:36:27.468 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.468 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.468 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:27.468 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.660022+0000", 2024-09-12T18:36:27.469 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001387318 2024-09-12T18:36:27.469 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.469 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:27.469 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.469 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.469 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.469 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:27.469 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:36:27.469 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 61.792550853000002, 2024-09-12T18:36:27.469 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.020709867, 2024-09-12T18:36:27.469 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:27.469 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:27.469 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:27.470 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:27.470 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.470 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:27.470 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:36:27.470 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.470 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.470 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.470 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:27.470 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:36:27.470 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.470 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.470 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.470 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:27.471 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633429+0000", 2024-09-12T18:36:27.471 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.313e-06 2024-09-12T18:36:27.471 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.471 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.471 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:27.471 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633462+0000", 2024-09-12T18:36:27.471 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3197000000000001e-05 2024-09-12T18:36:27.471 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.471 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.471 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:27.471 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633485+0000", 2024-09-12T18:36:27.471 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3243000000000001e-05 2024-09-12T18:36:27.471 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.472 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.472 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:27.472 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633501+0000", 2024-09-12T18:36:27.472 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5383000000000002e-05 2024-09-12T18:36:27.472 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.472 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.472 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:27.472 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633642+0000", 2024-09-12T18:36:27.472 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000141168 2024-09-12T18:36:27.472 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.472 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.472 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:27.472 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633982+0000", 2024-09-12T18:36:27.473 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000340067 2024-09-12T18:36:27.473 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.473 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.473 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:27.473 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654138+0000", 2024-09-12T18:36:27.473 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.020155495999999998 2024-09-12T18:36:27.473 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.473 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:27.473 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.473 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.473 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.473 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:49141 5.d 5:bce526e5:::benchmark_data_smithi073_23739_object49140:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T18:36:27.473 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:03.538808+0000", 2024-09-12T18:36:27.474 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.887170807, 2024-09-12T18:36:27.474 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.019659019, 2024-09-12T18:36:27.474 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:27.474 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:27.474 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:27.474 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:27.474 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:27.474 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:27.474 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 49141 2024-09-12T18:36:27.474 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.474 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:27.474 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.474 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:27.474 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538808+0000", 2024-09-12T18:36:27.475 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.475 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.475 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.475 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:27.475 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538808+0000", 2024-09-12T18:36:27.475 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.475 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.475 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.475 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:27.475 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538809+0000", 2024-09-12T18:36:27.475 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.065e-06 2024-09-12T18:36:27.475 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.475 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.476 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:27.476 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538914+0000", 2024-09-12T18:36:27.476 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010528599999999999 2024-09-12T18:36:27.476 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.476 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.476 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:27.476 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538924+0000", 2024-09-12T18:36:27.476 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4420000000000004e-06 2024-09-12T18:36:27.476 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.476 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.476 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:27.476 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538944+0000", 2024-09-12T18:36:27.476 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0460000000000001e-05 2024-09-12T18:36:27.476 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.477 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.477 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:27.477 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.539034+0000", 2024-09-12T18:36:27.477 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9512000000000006e-05 2024-09-12T18:36:27.477 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.477 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.477 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:27.477 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.539161+0000", 2024-09-12T18:36:27.477 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012782399999999999 2024-09-12T18:36:27.477 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.477 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.477 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:27.478 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.539246+0000", 2024-09-12T18:36:27.478 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4927999999999997e-05 2024-09-12T18:36:27.478 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.478 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.478 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:27.478 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.541390+0000", 2024-09-12T18:36:27.478 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0021439509999999998 2024-09-12T18:36:27.478 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.478 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.478 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:27.478 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.558236+0000", 2024-09-12T18:36:27.478 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016845619999999999 2024-09-12T18:36:27.478 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.479 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.479 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:27.479 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.558368+0000", 2024-09-12T18:36:27.479 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013241300000000001 2024-09-12T18:36:27.479 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.479 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.479 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:27.479 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.558467+0000", 2024-09-12T18:36:27.479 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8517999999999994e-05 2024-09-12T18:36:27.479 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.479 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:27.479 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.479 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.480 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.480 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:52993 5.0 5:00f9e688:::benchmark_data_smithi073_23739_object52992:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:36:27.480 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:05.209109+0000", 2024-09-12T18:36:27.480 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 22.216869733999999, 2024-09-12T18:36:27.480 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017556391000000001, 2024-09-12T18:36:27.480 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:27.480 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:27.480 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:27.480 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:27.480 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:27.480 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:27.480 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 52993 2024-09-12T18:36:27.480 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.481 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:27.481 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.481 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:27.481 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.209109+0000", 2024-09-12T18:36:27.481 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.481 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.481 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.481 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:27.481 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.209109+0000", 2024-09-12T18:36:27.481 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.481 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.481 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.481 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:27.482 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.209110+0000", 2024-09-12T18:36:27.482 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8000000000000004e-07 2024-09-12T18:36:27.482 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.482 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.482 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:27.482 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.209246+0000", 2024-09-12T18:36:27.482 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013595 2024-09-12T18:36:27.482 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.482 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.482 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:27.482 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.209256+0000", 2024-09-12T18:36:27.482 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9580000000000002e-06 2024-09-12T18:36:27.482 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.483 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.483 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:27.483 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.209262+0000", 2024-09-12T18:36:27.483 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7950000000000002e-06 2024-09-12T18:36:27.483 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.483 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.483 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:27.483 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.212362+0000", 2024-09-12T18:36:27.483 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003099606 2024-09-12T18:36:27.483 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.483 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.483 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:27.483 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.212569+0000", 2024-09-12T18:36:27.483 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020737699999999999 2024-09-12T18:36:27.484 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.484 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.484 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:27.484 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.212907+0000", 2024-09-12T18:36:27.484 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00033730499999999998 2024-09-12T18:36:27.484 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.484 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.484 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:27.484 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.226511+0000", 2024-09-12T18:36:27.484 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.01360451 2024-09-12T18:36:27.484 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.484 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.484 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:27.485 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.226567+0000", 2024-09-12T18:36:27.485 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5371000000000002e-05 2024-09-12T18:36:27.485 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.485 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.485 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:27.485 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.226624+0000", 2024-09-12T18:36:27.485 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7355999999999998e-05 2024-09-12T18:36:27.485 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.485 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.485 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:27.485 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:05.226665+0000", 2024-09-12T18:36:27.485 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1282999999999998e-05 2024-09-12T18:36:27.485 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.486 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:27.486 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.486 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.486 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.486 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:61561 5.e 5:715fe5e4:::benchmark_data_smithi073_23739_object61560:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:36:27.486 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:09.221864+0000", 2024-09-12T18:36:27.486 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 18.204114392000001, 2024-09-12T18:36:27.486 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017993663999999999, 2024-09-12T18:36:27.486 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:27.486 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:27.486 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:27.486 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:27.487 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:27.487 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:27.487 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 61561 2024-09-12T18:36:27.487 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.487 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:27.487 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.487 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:27.487 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.221864+0000", 2024-09-12T18:36:27.487 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.487 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.487 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.487 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:27.487 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.221864+0000", 2024-09-12T18:36:27.488 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.488 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.488 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.488 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:27.488 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.221865+0000", 2024-09-12T18:36:27.488 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1310000000000001e-06 2024-09-12T18:36:27.488 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.488 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.488 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:27.488 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222022+0000", 2024-09-12T18:36:27.488 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015628500000000001 2024-09-12T18:36:27.488 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.488 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.489 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:27.489 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222034+0000", 2024-09-12T18:36:27.489 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2481e-05 2024-09-12T18:36:27.489 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.489 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.489 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:27.489 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222041+0000", 2024-09-12T18:36:27.489 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7469999999999999e-06 2024-09-12T18:36:27.489 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.489 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.489 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:27.489 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222103+0000", 2024-09-12T18:36:27.489 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1903999999999995e-05 2024-09-12T18:36:27.490 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.490 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.490 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:27.490 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222199+0000", 2024-09-12T18:36:27.490 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6664999999999997e-05 2024-09-12T18:36:27.490 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.490 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.490 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:27.490 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222286+0000", 2024-09-12T18:36:27.490 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6582999999999994e-05 2024-09-12T18:36:27.490 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.490 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.490 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:27.491 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.228622+0000", 2024-09-12T18:36:27.491 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063357520000000001 2024-09-12T18:36:27.491 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.491 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.491 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:27.491 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.239753+0000", 2024-09-12T18:36:27.491 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011131709 2024-09-12T18:36:27.491 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.491 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.491 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:27.491 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.239813+0000", 2024-09-12T18:36:27.491 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0007999999999999e-05 2024-09-12T18:36:27.491 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.492 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.492 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:27.492 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.239858+0000", 2024-09-12T18:36:27.492 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4399e-05 2024-09-12T18:36:27.492 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.492 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:27.492 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.492 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.492 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.492 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:77241 5.b 5:d9973dc8:::benchmark_data_smithi073_23739_object77240:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:27.492 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:16.792553+0000", 2024-09-12T18:36:27.492 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 10.633425183, 2024-09-12T18:36:27.492 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.019966754999999999, 2024-09-12T18:36:27.493 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:27.493 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:27.493 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:27.493 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:27.493 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:27.493 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:27.493 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 77241 2024-09-12T18:36:27.493 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.493 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:27.493 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.493 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:27.493 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.792553+0000", 2024-09-12T18:36:27.493 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.494 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.494 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.494 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:27.494 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.792553+0000", 2024-09-12T18:36:27.494 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.494 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.494 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.494 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:27.494 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.792554+0000", 2024-09-12T18:36:27.494 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.16e-07 2024-09-12T18:36:27.494 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.494 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.494 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:27.495 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.792661+0000", 2024-09-12T18:36:27.495 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000106909 2024-09-12T18:36:27.495 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.495 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.495 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:27.495 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.792671+0000", 2024-09-12T18:36:27.495 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0268000000000001e-05 2024-09-12T18:36:27.495 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.495 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.495 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:27.495 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.792678+0000", 2024-09-12T18:36:27.495 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7510000000000002e-06 2024-09-12T18:36:27.495 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.496 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.496 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:27.496 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.794730+0000", 2024-09-12T18:36:27.496 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002051794 2024-09-12T18:36:27.496 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.496 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.496 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:27.496 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.794857+0000", 2024-09-12T18:36:27.496 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012728500000000001 2024-09-12T18:36:27.496 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.496 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.496 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:27.496 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.794987+0000", 2024-09-12T18:36:27.497 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012996899999999999 2024-09-12T18:36:27.497 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.497 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.497 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:27.497 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.797553+0000", 2024-09-12T18:36:27.497 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025652980000000001 2024-09-12T18:36:27.497 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.497 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.497 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:27.497 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.812460+0000", 2024-09-12T18:36:27.497 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.014907884 2024-09-12T18:36:27.497 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.498 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.498 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:27.498 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.812494+0000", 2024-09-12T18:36:27.498 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3525000000000002e-05 2024-09-12T18:36:27.498 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.498 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.498 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:27.498 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.812520+0000", 2024-09-12T18:36:27.498 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6156000000000002e-05 2024-09-12T18:36:27.498 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.498 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:27.498 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.498 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.498 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.499 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:77253 5.b 5:df1f7025:::benchmark_data_smithi073_23739_object77252:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:27.499 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:16.798099+0000", 2024-09-12T18:36:27.499 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 10.627879493, 2024-09-12T18:36:27.499 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0182598, 2024-09-12T18:36:27.499 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:27.499 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:27.499 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:27.499 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:27.499 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:27.499 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:27.499 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 77253 2024-09-12T18:36:27.499 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.500 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:27.500 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.500 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:27.500 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798099+0000", 2024-09-12T18:36:27.500 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.500 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.500 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.500 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:27.500 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798099+0000", 2024-09-12T18:36:27.501 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.501 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.501 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.501 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:27.501 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798100+0000", 2024-09-12T18:36:27.501 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2449999999999999e-06 2024-09-12T18:36:27.501 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.501 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.501 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:27.501 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798159+0000", 2024-09-12T18:36:27.501 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8925999999999998e-05 2024-09-12T18:36:27.501 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.501 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.502 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:27.502 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798171+0000", 2024-09-12T18:36:27.502 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.206e-05 2024-09-12T18:36:27.502 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.502 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.502 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:27.502 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798178+0000", 2024-09-12T18:36:27.502 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9009999999999997e-06 2024-09-12T18:36:27.502 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.502 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.502 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:27.502 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798227+0000", 2024-09-12T18:36:27.502 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8794000000000001e-05 2024-09-12T18:36:27.502 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.503 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.503 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:27.503 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798314+0000", 2024-09-12T18:36:27.503 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7322000000000002e-05 2024-09-12T18:36:27.503 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.503 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.503 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:27.503 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798417+0000", 2024-09-12T18:36:27.503 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000102777 2024-09-12T18:36:27.503 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.503 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.503 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:27.503 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.800633+0000", 2024-09-12T18:36:27.504 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022157740000000002 2024-09-12T18:36:27.504 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.504 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.504 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:27.504 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.816295+0000", 2024-09-12T18:36:27.504 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015662359000000001 2024-09-12T18:36:27.504 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.504 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.504 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:27.504 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.816330+0000", 2024-09-12T18:36:27.504 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4353999999999997e-05 2024-09-12T18:36:27.504 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.504 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.505 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:27.505 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.816359+0000", 2024-09-12T18:36:27.505 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9288000000000001e-05 2024-09-12T18:36:27.505 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.505 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:27.505 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.505 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.505 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.505 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:80117 5.e 5:713efd60:::benchmark_data_smithi073_23739_object80116:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:27.505 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:18.149805+0000", 2024-09-12T18:36:27.505 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 9.2761739250000002, 2024-09-12T18:36:27.505 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018173544, 2024-09-12T18:36:27.505 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:27.506 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:27.506 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:27.506 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:27.506 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:27.506 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:27.506 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 80117 2024-09-12T18:36:27.506 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.506 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:27.506 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.506 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:27.506 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.149805+0000", 2024-09-12T18:36:27.506 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.507 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.507 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.507 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:27.507 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.149805+0000", 2024-09-12T18:36:27.507 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.507 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.507 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.507 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:27.507 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.149805+0000", 2024-09-12T18:36:27.507 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2399999999999997e-07 2024-09-12T18:36:27.507 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.507 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.508 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:27.508 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.149842+0000", 2024-09-12T18:36:27.508 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6396000000000002e-05 2024-09-12T18:36:27.508 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.508 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.508 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:27.508 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.149855+0000", 2024-09-12T18:36:27.508 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3247999999999999e-05 2024-09-12T18:36:27.508 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.508 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.508 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:27.508 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.149863+0000", 2024-09-12T18:36:27.508 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9189999999999999e-06 2024-09-12T18:36:27.509 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.509 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.509 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:27.509 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.155735+0000", 2024-09-12T18:36:27.509 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0058721600000000004 2024-09-12T18:36:27.509 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.509 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.509 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:27.509 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.155868+0000", 2024-09-12T18:36:27.509 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013283500000000001 2024-09-12T18:36:27.509 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.509 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.510 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:27.510 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.156033+0000", 2024-09-12T18:36:27.510 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016527999999999999 2024-09-12T18:36:27.510 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.510 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.510 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:27.510 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.160797+0000", 2024-09-12T18:36:27.510 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0047638439999999997 2024-09-12T18:36:27.510 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.510 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.510 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:27.510 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.167881+0000", 2024-09-12T18:36:27.510 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0070834670000000004 2024-09-12T18:36:27.510 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.511 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.511 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:27.511 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.167936+0000", 2024-09-12T18:36:27.511 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5473999999999998e-05 2024-09-12T18:36:27.511 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.511 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.511 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:27.511 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.167978+0000", 2024-09-12T18:36:27.511 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2097e-05 2024-09-12T18:36:27.511 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.511 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:27.511 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.511 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.512 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.512 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:81207 5.0 5:0c89eb16:::benchmark_data_smithi073_23739_object81206:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T18:36:27.512 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:18.680764+0000", 2024-09-12T18:36:27.512 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 8.7452146319999997, 2024-09-12T18:36:27.512 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017614778000000001, 2024-09-12T18:36:27.512 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:27.512 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:27.512 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:27.512 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:27.512 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:27.512 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:27.512 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 81207 2024-09-12T18:36:27.513 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.513 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:27.513 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.513 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:27.513 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.680764+0000", 2024-09-12T18:36:27.513 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.513 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.513 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.513 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:27.513 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.680764+0000", 2024-09-12T18:36:27.513 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.513 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.513 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.514 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:27.514 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.680765+0000", 2024-09-12T18:36:27.514 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0699999999999999e-06 2024-09-12T18:36:27.514 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.514 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.514 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:27.514 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.680883+0000", 2024-09-12T18:36:27.514 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000117753 2024-09-12T18:36:27.514 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.514 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.514 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:27.514 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.680898+0000", 2024-09-12T18:36:27.515 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5546e-05 2024-09-12T18:36:27.515 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.515 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.515 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:27.515 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.680905+0000", 2024-09-12T18:36:27.515 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0779999999999998e-06 2024-09-12T18:36:27.515 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.515 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.515 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:27.515 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.685631+0000", 2024-09-12T18:36:27.515 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0047256720000000002 2024-09-12T18:36:27.515 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.515 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.516 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:27.516 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.685800+0000", 2024-09-12T18:36:27.516 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016894800000000001 2024-09-12T18:36:27.516 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.516 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.516 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:27.516 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.686022+0000", 2024-09-12T18:36:27.516 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022225399999999999 2024-09-12T18:36:27.516 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.516 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.516 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:27.516 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.693548+0000", 2024-09-12T18:36:27.516 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0075253789999999996 2024-09-12T18:36:27.517 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.517 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.517 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:27.517 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.698317+0000", 2024-09-12T18:36:27.517 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0047689250000000002 2024-09-12T18:36:27.517 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.517 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.517 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:27.517 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.698345+0000", 2024-09-12T18:36:27.517 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8445999999999998e-05 2024-09-12T18:36:27.517 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.517 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.517 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:27.518 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.698379+0000", 2024-09-12T18:36:27.518 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3707000000000001e-05 2024-09-12T18:36:27.518 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.518 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:27.518 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.518 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.518 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.518 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:81220 5.0 5:09982a6e:::benchmark_data_smithi073_23739_object81219:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T18:36:27.518 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:18.687299+0000", 2024-09-12T18:36:27.518 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 8.7386798050000003, 2024-09-12T18:36:27.518 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017570822999999999, 2024-09-12T18:36:27.518 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:27.518 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:27.519 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:27.519 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:27.519 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:27.519 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:27.519 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 81220 2024-09-12T18:36:27.519 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.519 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:27.519 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.519 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:27.519 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.687299+0000", 2024-09-12T18:36:27.519 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.519 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.519 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.519 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:27.520 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.687299+0000", 2024-09-12T18:36:27.520 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.520 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.520 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.520 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:27.520 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.687299+0000", 2024-09-12T18:36:27.520 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4900000000000001e-07 2024-09-12T18:36:27.520 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.520 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.520 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:27.520 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.687326+0000", 2024-09-12T18:36:27.520 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6784999999999999e-05 2024-09-12T18:36:27.520 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.521 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.521 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:27.521 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.687332+0000", 2024-09-12T18:36:27.521 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1399999999999997e-06 2024-09-12T18:36:27.521 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.521 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.521 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:27.521 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.687336+0000", 2024-09-12T18:36:27.521 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0509999999999998e-06 2024-09-12T18:36:27.521 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.521 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.521 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:27.521 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.693722+0000", 2024-09-12T18:36:27.522 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063860289999999997 2024-09-12T18:36:27.522 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.522 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.522 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:27.522 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.693846+0000", 2024-09-12T18:36:27.522 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012385900000000001 2024-09-12T18:36:27.522 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.522 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.522 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:27.522 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.693957+0000", 2024-09-12T18:36:27.522 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000111425 2024-09-12T18:36:27.522 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.522 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.523 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:27.523 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.698492+0000", 2024-09-12T18:36:27.523 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0045343639999999999 2024-09-12T18:36:27.523 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.523 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.523 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:27.523 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.704787+0000", 2024-09-12T18:36:27.523 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062951980000000001 2024-09-12T18:36:27.523 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.524 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.524 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:27.524 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.704833+0000", 2024-09-12T18:36:27.524 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6174000000000002e-05 2024-09-12T18:36:27.524 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.524 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.524 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:27.524 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.704870+0000", 2024-09-12T18:36:27.524 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6449000000000003e-05 2024-09-12T18:36:27.524 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.524 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:27.525 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.525 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.525 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.525 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:88245 5.d 5:beb54582:::benchmark_data_smithi073_23739_object88244:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:36:27.525 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:22.084417+0000", 2024-09-12T18:36:27.525 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.3415615069999998, 2024-09-12T18:36:27.525 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017602936, 2024-09-12T18:36:27.525 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:27.525 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:27.525 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:27.525 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:27.525 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:27.526 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:27.526 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 88245 2024-09-12T18:36:27.526 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.526 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:27.526 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.526 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:27.526 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.084417+0000", 2024-09-12T18:36:27.526 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.526 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.526 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.526 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:27.526 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.084417+0000", 2024-09-12T18:36:27.526 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.527 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.527 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.527 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:27.527 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.084418+0000", 2024-09-12T18:36:27.527 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.7699999999999992e-07 2024-09-12T18:36:27.527 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.527 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.527 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:27.527 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.084446+0000", 2024-09-12T18:36:27.527 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8178e-05 2024-09-12T18:36:27.527 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.527 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.527 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:27.528 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.084458+0000", 2024-09-12T18:36:27.528 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2252999999999999e-05 2024-09-12T18:36:27.528 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.528 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.528 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:27.528 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.084467+0000", 2024-09-12T18:36:27.528 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5029999999999997e-06 2024-09-12T18:36:27.528 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.528 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.528 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:27.528 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.095012+0000", 2024-09-12T18:36:27.528 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.010545274 2024-09-12T18:36:27.528 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.528 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.529 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:27.529 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.095139+0000", 2024-09-12T18:36:27.529 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012659300000000001 2024-09-12T18:36:27.529 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.529 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.529 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:27.529 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.095306+0000", 2024-09-12T18:36:27.529 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016689600000000001 2024-09-12T18:36:27.529 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.529 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.529 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:27.530 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.097514+0000", 2024-09-12T18:36:27.530 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022079399999999998 2024-09-12T18:36:27.530 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.530 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.530 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:27.530 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.101952+0000", 2024-09-12T18:36:27.530 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0044387480000000002 2024-09-12T18:36:27.530 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.530 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.530 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:27.530 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.101992+0000", 2024-09-12T18:36:27.530 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9165000000000002e-05 2024-09-12T18:36:27.530 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.530 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.531 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:27.531 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.102020+0000", 2024-09-12T18:36:27.531 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8408999999999999e-05 2024-09-12T18:36:27.531 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.531 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:27.531 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.531 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.531 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.531 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:88599 5.b 5:d3a6061c:::benchmark_data_smithi073_23739_object88598:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:36:27.531 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:22.263566+0000", 2024-09-12T18:36:27.531 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.1624121399999998, 2024-09-12T18:36:27.531 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.020416237, 2024-09-12T18:36:27.531 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:27.531 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:27.532 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:27.532 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:27.532 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:27.532 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:27.532 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 88599 2024-09-12T18:36:27.532 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.532 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:27.532 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.532 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:27.532 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.263566+0000", 2024-09-12T18:36:27.532 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.532 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.532 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.532 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:27.533 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.263566+0000", 2024-09-12T18:36:27.533 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.533 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.533 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.533 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:27.533 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.263567+0000", 2024-09-12T18:36:27.533 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.088e-06 2024-09-12T18:36:27.533 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.533 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.533 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:27.533 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.263654+0000", 2024-09-12T18:36:27.533 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6632999999999995e-05 2024-09-12T18:36:27.533 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.533 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.534 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:27.534 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.263673+0000", 2024-09-12T18:36:27.534 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8984e-05 2024-09-12T18:36:27.534 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.534 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.534 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:27.534 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.263681+0000", 2024-09-12T18:36:27.534 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.371e-06 2024-09-12T18:36:27.534 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.534 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.534 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:27.534 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.266963+0000", 2024-09-12T18:36:27.534 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0032810410000000002 2024-09-12T18:36:27.535 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.535 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.535 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:27.535 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.267069+0000", 2024-09-12T18:36:27.535 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000106471 2024-09-12T18:36:27.535 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.535 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.535 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:27.535 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.267177+0000", 2024-09-12T18:36:27.535 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000108355 2024-09-12T18:36:27.535 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.535 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.535 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:27.536 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.268827+0000", 2024-09-12T18:36:27.536 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016492029999999999 2024-09-12T18:36:27.536 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.536 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.536 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:27.536 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.283931+0000", 2024-09-12T18:36:27.536 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015104783 2024-09-12T18:36:27.536 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.536 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.536 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:27.536 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.283960+0000", 2024-09-12T18:36:27.537 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8401000000000001e-05 2024-09-12T18:36:27.537 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.537 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.537 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:27.537 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.283983+0000", 2024-09-12T18:36:27.537 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2906999999999999e-05 2024-09-12T18:36:27.537 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.537 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:27.537 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.537 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.537 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.537 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:89277 5.b 5:d689659b:::benchmark_data_smithi073_23739_object89276:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:36:27.538 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:22.590286+0000", 2024-09-12T18:36:27.538 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.8356921540000002, 2024-09-12T18:36:27.538 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018995509000000001, 2024-09-12T18:36:27.538 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:27.538 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:27.538 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:27.538 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:27.538 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:27.538 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:27.538 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 89277 2024-09-12T18:36:27.538 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.538 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:27.538 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.539 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:27.539 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590286+0000", 2024-09-12T18:36:27.539 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.539 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.539 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.539 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:27.539 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590286+0000", 2024-09-12T18:36:27.539 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.539 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.539 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.539 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:27.539 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590288+0000", 2024-09-12T18:36:27.539 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.119e-06 2024-09-12T18:36:27.540 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.540 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.540 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:27.540 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590370+0000", 2024-09-12T18:36:27.540 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2025000000000002e-05 2024-09-12T18:36:27.540 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.540 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.540 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:27.540 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590380+0000", 2024-09-12T18:36:27.540 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0723999999999999e-05 2024-09-12T18:36:27.540 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.540 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.541 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:27.541 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590386+0000", 2024-09-12T18:36:27.541 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.609e-06 2024-09-12T18:36:27.541 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.541 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.541 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:27.541 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590444+0000", 2024-09-12T18:36:27.541 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7667000000000002e-05 2024-09-12T18:36:27.541 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.541 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.541 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:27.541 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590552+0000", 2024-09-12T18:36:27.541 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000108402 2024-09-12T18:36:27.542 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.542 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.542 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:27.542 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590687+0000", 2024-09-12T18:36:27.542 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000134602 2024-09-12T18:36:27.542 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.542 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.542 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:27.542 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.593694+0000", 2024-09-12T18:36:27.542 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003007249 2024-09-12T18:36:27.542 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.542 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.542 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:27.542 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.609224+0000", 2024-09-12T18:36:27.543 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015530552 2024-09-12T18:36:27.543 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.543 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.543 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:27.543 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.609256+0000", 2024-09-12T18:36:27.543 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1838999999999998e-05 2024-09-12T18:36:27.543 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.543 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.543 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:27.543 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.609282+0000", 2024-09-12T18:36:27.543 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5721e-05 2024-09-12T18:36:27.544 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.544 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:27.544 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.544 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.544 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.544 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:95928 5.0 5:0771f238:::benchmark_data_smithi073_23739_object95927:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:36:27.544 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:25.895007+0000", 2024-09-12T18:36:27.544 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.530971941, 2024-09-12T18:36:27.544 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.02094159, 2024-09-12T18:36:27.544 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:27.544 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:27.544 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:27.544 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:27.545 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:27.545 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:27.545 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 95928 2024-09-12T18:36:27.545 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.545 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:27.545 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.545 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:27.545 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.895007+0000", 2024-09-12T18:36:27.545 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.545 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.545 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.545 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:27.545 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.895007+0000", 2024-09-12T18:36:27.546 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.546 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.546 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.546 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:27.546 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.895008+0000", 2024-09-12T18:36:27.546 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8400000000000002e-07 2024-09-12T18:36:27.546 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.546 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.546 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:27.546 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.895077+0000", 2024-09-12T18:36:27.546 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9220999999999993e-05 2024-09-12T18:36:27.546 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.547 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.547 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:27.547 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.895089+0000", 2024-09-12T18:36:27.547 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1701e-05 2024-09-12T18:36:27.547 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.547 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.547 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:27.547 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.895095+0000", 2024-09-12T18:36:27.547 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9240000000000001e-06 2024-09-12T18:36:27.547 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.547 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.547 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:27.547 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.902948+0000", 2024-09-12T18:36:27.548 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0078527110000000001 2024-09-12T18:36:27.548 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.548 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.548 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:27.548 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.903069+0000", 2024-09-12T18:36:27.548 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000120382 2024-09-12T18:36:27.548 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.548 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.548 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:27.548 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.903200+0000", 2024-09-12T18:36:27.548 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000130984 2024-09-12T18:36:27.548 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.549 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.549 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:27.549 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.915841+0000", 2024-09-12T18:36:27.549 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012641177 2024-09-12T18:36:27.549 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.549 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.549 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:27.549 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.915853+0000", 2024-09-12T18:36:27.549 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2707999999999999e-05 2024-09-12T18:36:27.549 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.549 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.549 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:27.549 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.915910+0000", 2024-09-12T18:36:27.550 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6226e-05 2024-09-12T18:36:27.550 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.550 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.550 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:27.550 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.915948+0000", 2024-09-12T18:36:27.550 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8572000000000003e-05 2024-09-12T18:36:27.550 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.550 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:27.550 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.550 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.550 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.550 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:96974 5.4 5:22c5e101:::benchmark_data_smithi073_23739_object96973:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:36:27.550 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:26.404987+0000", 2024-09-12T18:36:27.551 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.020991789, 2024-09-12T18:36:27.551 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018218356000000002, 2024-09-12T18:36:27.551 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:27.551 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:27.551 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:27.551 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:27.551 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:27.551 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:27.551 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 96974 2024-09-12T18:36:27.551 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.551 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:27.551 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.551 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:27.552 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.404987+0000", 2024-09-12T18:36:27.552 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.552 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.552 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.552 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:27.552 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.404987+0000", 2024-09-12T18:36:27.552 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:27.552 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.552 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.552 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:27.552 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.404988+0000", 2024-09-12T18:36:27.552 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0839999999999999e-06 2024-09-12T18:36:27.553 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.553 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.553 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:27.553 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.405025+0000", 2024-09-12T18:36:27.553 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7598000000000002e-05 2024-09-12T18:36:27.553 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.553 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.553 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:27.553 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.405039+0000", 2024-09-12T18:36:27.553 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3614999999999999e-05 2024-09-12T18:36:27.553 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.553 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.553 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:27.554 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.405045+0000", 2024-09-12T18:36:27.554 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7019999999999998e-06 2024-09-12T18:36:27.554 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.554 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.554 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:27.554 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.405124+0000", 2024-09-12T18:36:27.554 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9064000000000001e-05 2024-09-12T18:36:27.554 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.554 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.554 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:27.554 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.405261+0000", 2024-09-12T18:36:27.554 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013721499999999999 2024-09-12T18:36:27.554 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.555 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.555 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:27.555 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.405416+0000", 2024-09-12T18:36:27.555 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015480499999999999 2024-09-12T18:36:27.555 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.555 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.555 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:27.555 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.410834+0000", 2024-09-12T18:36:27.555 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054180690000000002 2024-09-12T18:36:27.555 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.555 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.555 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:27.556 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.423115+0000", 2024-09-12T18:36:27.556 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012280813 2024-09-12T18:36:27.556 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.556 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.556 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:27.556 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.423166+0000", 2024-09-12T18:36:27.556 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0849000000000001e-05 2024-09-12T18:36:27.556 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:27.556 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:27.556 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:27.556 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.423205+0000", 2024-09-12T18:36:27.556 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9542000000000002e-05 2024-09-12T18:36:27.556 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.556 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:27.557 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.557 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:27.557 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:27.557 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:27.558 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:27.552+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:27.559 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is unset 2024-09-12T18:36:27.560 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:36:27.659 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:27.652+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:27.714 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:36:27.715 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:36:27.715 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:27.715 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:99689 5.7 5:ebc8cc30:::benchmark_data_smithi073_23739_object99688:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:36:27.715 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:27.709636+0000", 2024-09-12T18:36:27.715 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.004111707, 2024-09-12T18:36:27.715 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0041388309999999999, 2024-09-12T18:36:27.715 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:27.715 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:27.715 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:27.715 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:27.715 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:27.715 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:27.716 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 99689 2024-09-12T18:36:27.716 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:27.716 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:27.716 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:27.716 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:27.716 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:27.709636+0000", 2024-09-12T18:36:27.716 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:27.716 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:27.716 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:27.716 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:27.716 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:27.709636+0000", 2024-09-12T18:36:27.716 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:27.716 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:27.717 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:27.717 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:27.717 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:27.709638+0000", 2024-09-12T18:36:27.717 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.73e-06 2024-09-12T18:36:27.717 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:27.717 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:27.717 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:27.717 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:27.709676+0000", 2024-09-12T18:36:27.717 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.8313999999999999e-05 2024-09-12T18:36:27.717 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:27.717 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:27.717 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:27.718 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:27.709689+0000", 2024-09-12T18:36:27.718 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3145999999999999e-05 2024-09-12T18:36:27.718 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:27.718 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:27.718 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:27.718 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:27.709696+0000", 2024-09-12T18:36:27.718 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0160000000000003e-06 2024-09-12T18:36:27.718 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:27.718 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:27.718 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:27.718 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:27.709750+0000", 2024-09-12T18:36:27.718 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3315e-05 2024-09-12T18:36:27.718 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:27.719 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:27.719 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:27.719 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:27.709873+0000", 2024-09-12T18:36:27.719 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000123745 2024-09-12T18:36:27.719 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:27.719 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:27.719 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:27.719 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:27.709963+0000", 2024-09-12T18:36:27.719 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.9500999999999996e-05 2024-09-12T18:36:27.719 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:27.719 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:27.719 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:27.720 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:27.711922+0000", 2024-09-12T18:36:27.720 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0019593029999999999 2024-09-12T18:36:27.720 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:27.720 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:27.720 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:27.720 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:27.720 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:27.720 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:99690 5.3 e42/21 5:c2facfd3:::benchmark_data_smithi073_23739_object99689:head v 42'6143, mlcod=42'6141)", 2024-09-12T18:36:27.720 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:27.712325+0000", 2024-09-12T18:36:27.720 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.001422584, 2024-09-12T18:36:27.720 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0015203409999999999, 2024-09-12T18:36:27.720 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:27.721 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:27.721 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:27.721 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:27.721 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:27.721 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:27.721 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:27.712325+0000", 2024-09-12T18:36:27.721 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:27.721 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:27.721 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:27.721 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:27.721 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:27.712325+0000", 2024-09-12T18:36:27.721 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:27.721 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:27.722 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:27.722 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:27.722 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:27.712326+0000", 2024-09-12T18:36:27.722 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.6499999999999998e-07 2024-09-12T18:36:27.722 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:27.722 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:27.722 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:27.722 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:27.712421+0000", 2024-09-12T18:36:27.722 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.4745000000000002e-05 2024-09-12T18:36:27.722 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:27.722 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:27.722 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:27.722 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:27.712439+0000", 2024-09-12T18:36:27.723 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.8610999999999999e-05 2024-09-12T18:36:27.723 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:27.723 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:27.723 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:27.723 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:27.712458+0000", 2024-09-12T18:36:27.723 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.8765000000000001e-05 2024-09-12T18:36:27.723 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:27.723 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:27.723 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:27.723 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:27.712527+0000", 2024-09-12T18:36:27.723 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.8573999999999998e-05 2024-09-12T18:36:27.723 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:27.723 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:27.724 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:27.724 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:27.712540+0000", 2024-09-12T18:36:27.724 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3631e-05 2024-09-12T18:36:27.724 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:27.724 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:27.724 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:27.724 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:27.724 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:27.724 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:99697 5.f 5:f2a6be7f:::benchmark_data_smithi073_23739_object99696:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:36:27.724 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:27.712450+0000", 2024-09-12T18:36:27.724 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.001297547, 2024-09-12T18:36:27.724 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001447753, 2024-09-12T18:36:27.724 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:27.725 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:27.725 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:27.725 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:27.725 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:27.725 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:27.725 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 99697 2024-09-12T18:36:27.725 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:27.725 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:27.725 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:27.725 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:27.725 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:27.712450+0000", 2024-09-12T18:36:27.725 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:27.725 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:27.726 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:27.726 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:27.726 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:27.712450+0000", 2024-09-12T18:36:27.726 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:27.726 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:27.726 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:27.726 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:27.726 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:27.712451+0000", 2024-09-12T18:36:27.726 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.029e-06 2024-09-12T18:36:27.726 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:27.726 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:27.726 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:27.726 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:27.712582+0000", 2024-09-12T18:36:27.727 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000130693 2024-09-12T18:36:27.727 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:27.727 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:27.727 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:27.727 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:27.712594+0000", 2024-09-12T18:36:27.727 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2037e-05 2024-09-12T18:36:27.727 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:27.727 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:27.727 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:27.727 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:27.712603+0000", 2024-09-12T18:36:27.727 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.5459999999999997e-06 2024-09-12T18:36:27.727 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:27.727 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:27.728 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:27.728 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:27.712654+0000", 2024-09-12T18:36:27.728 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.0117000000000001e-05 2024-09-12T18:36:27.728 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:27.728 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:27.728 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:27.728 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:27.712737+0000", 2024-09-12T18:36:27.728 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.3032000000000001e-05 2024-09-12T18:36:27.728 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:27.728 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:27.728 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:27.728 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:27.712832+0000", 2024-09-12T18:36:27.728 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.5322999999999995e-05 2024-09-12T18:36:27.728 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:27.729 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:27.729 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:27.729 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:27.729 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:27.729 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:99693 5.6 e42/21 5:616eb523:::benchmark_data_smithi073_23739_object99692:head v 42'6264, mlcod=42'6262)", 2024-09-12T18:36:27.729 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:27.712522+0000", 2024-09-12T18:36:27.729 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.00122557, 2024-09-12T18:36:27.729 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001433866, 2024-09-12T18:36:27.729 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:27.729 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:27.729 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:27.729 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:27.729 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:27.730 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:27.730 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:27.712522+0000", 2024-09-12T18:36:27.730 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:27.730 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:27.730 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:27.730 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:27.730 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:27.712522+0000", 2024-09-12T18:36:27.730 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:27.730 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:27.730 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:27.730 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:27.730 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:27.712523+0000", 2024-09-12T18:36:27.731 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1200000000000003e-07 2024-09-12T18:36:27.731 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:27.731 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:27.731 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:27.731 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:27.712607+0000", 2024-09-12T18:36:27.731 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4077000000000002e-05 2024-09-12T18:36:27.731 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:27.731 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:27.731 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:27.731 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:27.712614+0000", 2024-09-12T18:36:27.731 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.1130000000000003e-06 2024-09-12T18:36:27.731 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:27.731 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:27.731 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:27.732 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:27.712619+0000", 2024-09-12T18:36:27.732 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1420000000000001e-06 2024-09-12T18:36:27.732 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:27.732 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:27.732 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:27.732 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:27.712660+0000", 2024-09-12T18:36:27.732 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.0642000000000002e-05 2024-09-12T18:36:27.732 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:27.732 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:27.732 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:27.732 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:27.712672+0000", 2024-09-12T18:36:27.732 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2164000000000001e-05 2024-09-12T18:36:27.733 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:27.733 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:27.733 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:27.733 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:27.733 INFO:teuthology.orchestra.run.smithi162.stdout: ], 2024-09-12T18:36:27.733 INFO:teuthology.orchestra.run.smithi162.stdout: "num_ops": 4 2024-09-12T18:36:27.733 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:36:27.734 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:36:27.779 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:36:27.781 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:27.780+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:27.860 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:27.855+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:27.873 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 42 16 100027 100011 148.81 131.188 0.0064875 0.00671533 2024-09-12T18:36:27.890 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:36:27.890 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [], 2024-09-12T18:36:27.891 INFO:teuthology.orchestra.run.smithi162.stdout: "complaint_time": 30, 2024-09-12T18:36:27.891 INFO:teuthology.orchestra.run.smithi162.stdout: "num_blocked_ops": 0 2024-09-12T18:36:27.891 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:36:27.913 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:36:27.938 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:36:27.939 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:36:27.957 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:36:27.957 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:36:27.976 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:36:27.976 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:36:28.001 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:28.000+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:28.063 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:28.056+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:28.107 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:28.107 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:28.128 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:36:28.171 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:28.168+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:28.263 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:28.260+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:28.282 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:28.282 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:28.301 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:36:28.387 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:28.384+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:28.466 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:28.464+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:28.491 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:28.491 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:28.511 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:36:28.538 INFO:teuthology.orchestra.run.smithi073.stderr:reweighted osd.0 to 1 (10000) 2024-09-12T18:36:28.563 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-12T18:36:28.566 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:28.564+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:28.670 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:28.667+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:28.697 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:28.697 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:28.717 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:36:28.770 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:28.764+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:28.873 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:28.867+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:28.873 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 43 16 102033 102017 148.265 125.375 0.00878997 0.00674 2024-09-12T18:36:28.876 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:28.876 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:28.897 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:36:28.972 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:28.968+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:29.073 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:29.068+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:29.097 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:29.097 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:29.119 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:36:29.174 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:29.171+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:29.267 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:29.267 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:29.276 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:29.272+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:29.289 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:36:29.377 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:29.372+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:29.442 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:29.442 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:29.462 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:36:29.478 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:29.475+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:29.554 INFO:teuthology.orchestra.run.smithi073.stderr:reweighted osd.1 to 1 (10000) 2024-09-12T18:36:29.561 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T18:36:29.578 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:29.576+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:29.582 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-12T18:36:29.672 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:29.673 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:29.680 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:29.675+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:29.694 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:36:29.781 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:29.779+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:29.873 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 44 16 104079 104063 147.801 127.875 0.00429237 0.00676134 2024-09-12T18:36:29.881 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:29.875+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:29.887 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:29.887 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:29.908 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:36:29.982 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:29.975+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:29.994 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:36:30.061 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:30.061 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:30.081 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:36:30.083 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:30.080+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:30.145 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:36:30.145 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:36:30.164 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:36:30.164 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:36:30.183 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:36:30.183 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:36:30.184 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:30.179+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:30.276 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:30.276 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2024-09-12T18:36:30.276 INFO:teuthology.orchestra.run.smithi114.stdout: "complaint_time": 30, 2024-09-12T18:36:30.276 INFO:teuthology.orchestra.run.smithi114.stdout: "num_blocked_ops": 0 2024-09-12T18:36:30.276 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:30.285 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:30.283+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:30.299 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:36:30.387 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:30.383+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:30.486 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:30.483+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:30.502 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:30.502 INFO:teuthology.orchestra.run.smithi114.stdout: "size": 20, 2024-09-12T18:36:30.502 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 600, 2024-09-12T18:36:30.503 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:36:30.503 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.503 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:30.503 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:30.503 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 64.869849396000006, 2024-09-12T18:36:30.503 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.042475618999999999, 2024-09-12T18:36:30.503 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:30.503 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:30.503 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:30.503 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:30.503 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.503 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:30.503 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:30.503 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:30.504 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.504 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.504 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:30.504 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:30.504 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:30.504 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.504 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.504 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:30.504 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628450+0000", 2024-09-12T18:36:30.504 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4212999999999999e-05 2024-09-12T18:36:30.504 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.504 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.505 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:30.505 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628463+0000", 2024-09-12T18:36:30.505 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2497000000000001e-05 2024-09-12T18:36:30.505 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.505 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.505 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:30.505 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628480+0000", 2024-09-12T18:36:30.505 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7232999999999999e-05 2024-09-12T18:36:30.505 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.505 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.505 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:30.506 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628496+0000", 2024-09-12T18:36:30.506 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6217000000000001e-05 2024-09-12T18:36:30.506 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.506 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.506 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:30.506 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628641+0000", 2024-09-12T18:36:30.506 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000144709 2024-09-12T18:36:30.506 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.506 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.506 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:30.506 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628657+0000", 2024-09-12T18:36:30.506 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6266e-05 2024-09-12T18:36:30.507 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.507 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.507 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:30.507 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663103+0000", 2024-09-12T18:36:30.507 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.034445523999999998 2024-09-12T18:36:30.507 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.507 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.507 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:30.507 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663373+0000", 2024-09-12T18:36:30.507 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00027085500000000002 2024-09-12T18:36:30.507 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.507 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.507 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:30.508 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663634+0000", 2024-09-12T18:36:30.508 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000260855 2024-09-12T18:36:30.508 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.508 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.508 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:30.508 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670294+0000", 2024-09-12T18:36:30.508 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0066597599999999998 2024-09-12T18:36:30.508 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.508 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.508 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:30.508 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670705+0000", 2024-09-12T18:36:30.508 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00041057099999999998 2024-09-12T18:36:30.508 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.509 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.509 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:30.509 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670820+0000", 2024-09-12T18:36:30.509 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000115111 2024-09-12T18:36:30.509 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.509 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.509 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:30.509 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670912+0000", 2024-09-12T18:36:30.509 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1807999999999999e-05 2024-09-12T18:36:30.509 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:30.509 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:30.509 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:30.509 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.510 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.510 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:30.510 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:30.510 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 64.869758649999994, 2024-09-12T18:36:30.510 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.044599273000000002, 2024-09-12T18:36:30.510 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:30.510 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:30.510 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:30.510 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:30.510 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.510 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:30.510 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:30.510 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:30.511 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.511 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.511 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:30.511 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:30.511 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:30.511 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.511 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.511 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:30.511 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628528+0000", 2024-09-12T18:36:30.511 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:30.511 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.511 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.511 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:30.512 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628537+0000", 2024-09-12T18:36:30.512 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6969999999999999e-06 2024-09-12T18:36:30.512 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.512 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.512 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:30.512 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628560+0000", 2024-09-12T18:36:30.513 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2889000000000001e-05 2024-09-12T18:36:30.513 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.513 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.513 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:30.513 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628576+0000", 2024-09-12T18:36:30.513 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.649e-05 2024-09-12T18:36:30.513 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.513 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.513 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:30.513 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628846+0000", 2024-09-12T18:36:30.513 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00026952500000000001 2024-09-12T18:36:30.513 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.513 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.513 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:30.514 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628853+0000", 2024-09-12T18:36:30.514 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6559999999999992e-06 2024-09-12T18:36:30.514 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.514 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.514 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:30.514 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665284+0000", 2024-09-12T18:36:30.514 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.036431140000000001 2024-09-12T18:36:30.514 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.514 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.514 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:30.514 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665494+0000", 2024-09-12T18:36:30.515 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000209762 2024-09-12T18:36:30.515 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.515 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.515 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:30.515 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665816+0000", 2024-09-12T18:36:30.515 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00032162299999999999 2024-09-12T18:36:30.515 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.515 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.515 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:30.515 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670382+0000", 2024-09-12T18:36:30.515 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0045656739999999996 2024-09-12T18:36:30.515 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.515 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.516 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:30.516 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.672978+0000", 2024-09-12T18:36:30.516 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.002596068 2024-09-12T18:36:30.516 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.516 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.516 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:30.516 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673058+0000", 2024-09-12T18:36:30.516 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0198999999999996e-05 2024-09-12T18:36:30.516 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.516 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.516 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:30.516 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673126+0000", 2024-09-12T18:36:30.516 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8120000000000005e-05 2024-09-12T18:36:30.516 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:30.516 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:30.517 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:30.517 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.517 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.517 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:23 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:30.517 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:30.517 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 64.869660843999995, 2024-09-12T18:36:30.517 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045539784, 2024-09-12T18:36:30.517 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:30.517 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:30.517 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:30.517 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:30.517 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.517 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:30.518 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:30.518 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:30.518 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.518 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.518 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:30.518 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:30.518 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:30.518 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.518 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.518 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:30.518 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628626+0000", 2024-09-12T18:36:30.518 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.573e-06 2024-09-12T18:36:30.518 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.519 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.519 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:30.519 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628640+0000", 2024-09-12T18:36:30.519 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3817e-05 2024-09-12T18:36:30.519 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.519 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.519 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:30.519 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628659+0000", 2024-09-12T18:36:30.519 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9539999999999999e-05 2024-09-12T18:36:30.519 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.519 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.519 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:30.519 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628675+0000", 2024-09-12T18:36:30.520 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5739e-05 2024-09-12T18:36:30.520 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.520 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.520 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:30.520 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628815+0000", 2024-09-12T18:36:30.520 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014003299999999999 2024-09-12T18:36:30.520 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.520 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.520 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:30.520 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628828+0000", 2024-09-12T18:36:30.520 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2849e-05 2024-09-12T18:36:30.520 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.520 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.521 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:30.521 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651162+0000", 2024-09-12T18:36:30.521 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.022334228000000001 2024-09-12T18:36:30.521 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.521 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.521 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:30.521 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651446+0000", 2024-09-12T18:36:30.521 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00028392800000000002 2024-09-12T18:36:30.521 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.521 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.521 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:30.522 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651746+0000", 2024-09-12T18:36:30.522 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000300091 2024-09-12T18:36:30.522 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.522 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.522 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:30.522 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665113+0000", 2024-09-12T18:36:30.522 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013366678 2024-09-12T18:36:30.522 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.522 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.522 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:30.522 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674010+0000", 2024-09-12T18:36:30.522 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0088970520000000008 2024-09-12T18:36:30.522 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.523 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.523 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:30.523 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674104+0000", 2024-09-12T18:36:30.523 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4124999999999998e-05 2024-09-12T18:36:30.523 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.523 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.523 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:30.523 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674164+0000", 2024-09-12T18:36:30.523 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.0130999999999997e-05 2024-09-12T18:36:30.523 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:30.523 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:30.523 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:30.524 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.524 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.524 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:26 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:30.524 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:30.524 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 64.869587637999999, 2024-09-12T18:36:30.524 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045702136999999997, 2024-09-12T18:36:30.524 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:30.524 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:30.524 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:30.524 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:30.524 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.524 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:30.524 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:30.525 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:30.525 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.525 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.525 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:30.525 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:30.525 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:30.525 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.525 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.525 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:30.525 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628699+0000", 2024-09-12T18:36:30.525 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3859999999999999e-06 2024-09-12T18:36:30.525 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.525 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.526 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:30.526 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628706+0000", 2024-09-12T18:36:30.526 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0169999999999999e-06 2024-09-12T18:36:30.526 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.526 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.526 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:30.526 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628725+0000", 2024-09-12T18:36:30.526 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8683000000000001e-05 2024-09-12T18:36:30.526 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.526 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.526 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:30.526 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628740+0000", 2024-09-12T18:36:30.526 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5413999999999998e-05 2024-09-12T18:36:30.527 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.527 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.527 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:30.527 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628907+0000", 2024-09-12T18:36:30.527 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00016670199999999999 2024-09-12T18:36:30.527 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.527 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.527 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:30.527 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628917+0000", 2024-09-12T18:36:30.527 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.046e-05 2024-09-12T18:36:30.527 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.527 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.527 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:30.528 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.660390+0000", 2024-09-12T18:36:30.528 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.031472364000000003 2024-09-12T18:36:30.528 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.528 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.528 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:30.528 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.661767+0000", 2024-09-12T18:36:30.528 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0013769190000000001 2024-09-12T18:36:30.528 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.528 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.528 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:30.528 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.662408+0000", 2024-09-12T18:36:30.528 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00064091099999999998 2024-09-12T18:36:30.528 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.529 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.529 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:30.529 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669577+0000", 2024-09-12T18:36:30.529 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.007169412 2024-09-12T18:36:30.529 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.529 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.529 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:30.529 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674244+0000", 2024-09-12T18:36:30.529 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0046671839999999996 2024-09-12T18:36:30.529 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.529 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.529 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:30.529 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674329+0000", 2024-09-12T18:36:30.530 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5276000000000001e-05 2024-09-12T18:36:30.530 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.530 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.530 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:30.530 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674400+0000", 2024-09-12T18:36:30.530 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0408999999999996e-05 2024-09-12T18:36:30.530 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:30.530 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:30.530 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:30.530 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.530 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.530 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:30.530 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:30.531 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 64.869479968999997, 2024-09-12T18:36:30.531 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.044572443000000003, 2024-09-12T18:36:30.531 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:30.531 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:30.531 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:30.531 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:30.531 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.531 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:30.531 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:30.531 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:30.531 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.531 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.531 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:30.532 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:30.532 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:30.532 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.532 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.532 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:30.532 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628807+0000", 2024-09-12T18:36:30.532 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3629999999999999e-06 2024-09-12T18:36:30.532 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.532 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.532 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:30.532 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628814+0000", 2024-09-12T18:36:30.532 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.2099999999999996e-06 2024-09-12T18:36:30.532 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.533 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.533 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:30.533 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628832+0000", 2024-09-12T18:36:30.533 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7972999999999999e-05 2024-09-12T18:36:30.533 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.533 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.533 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:30.533 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628854+0000", 2024-09-12T18:36:30.533 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1857000000000001e-05 2024-09-12T18:36:30.533 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.534 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.534 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:30.534 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628984+0000", 2024-09-12T18:36:30.534 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013013599999999999 2024-09-12T18:36:30.534 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.534 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.534 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:30.534 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628993+0000", 2024-09-12T18:36:30.534 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:36:30.534 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.534 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.534 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:30.534 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668176+0000", 2024-09-12T18:36:30.534 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.039182211000000002 2024-09-12T18:36:30.535 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.535 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.535 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:30.535 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668481+0000", 2024-09-12T18:36:30.535 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00030499200000000002 2024-09-12T18:36:30.535 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.535 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.535 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:30.535 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668771+0000", 2024-09-12T18:36:30.535 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00029018700000000002 2024-09-12T18:36:30.535 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.535 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.535 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:30.536 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.672674+0000", 2024-09-12T18:36:30.536 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0039031890000000001 2024-09-12T18:36:30.536 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.536 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.536 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:30.536 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673214+0000", 2024-09-12T18:36:30.536 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00053981600000000004 2024-09-12T18:36:30.536 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.536 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.536 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:30.536 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673310+0000", 2024-09-12T18:36:30.537 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.6682999999999996e-05 2024-09-12T18:36:30.537 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.537 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.537 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:30.537 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673378+0000", 2024-09-12T18:36:30.537 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7385999999999995e-05 2024-09-12T18:36:30.537 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:30.537 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:30.537 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:30.537 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.537 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.537 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:30.537 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:30.538 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 64.869343943000004, 2024-09-12T18:36:30.538 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.041480853999999998, 2024-09-12T18:36:30.538 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:30.538 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:30.538 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:30.538 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:30.538 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.538 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:30.538 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:30.538 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:30.538 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.538 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.538 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:30.539 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:30.539 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:30.539 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.539 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.539 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:30.539 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628943+0000", 2024-09-12T18:36:30.539 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.403e-06 2024-09-12T18:36:30.539 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.539 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.539 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:30.539 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628953+0000", 2024-09-12T18:36:30.539 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0273e-05 2024-09-12T18:36:30.539 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.540 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.540 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:30.540 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628973+0000", 2024-09-12T18:36:30.540 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9959999999999999e-05 2024-09-12T18:36:30.540 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.540 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.540 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:30.540 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628989+0000", 2024-09-12T18:36:30.540 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6447e-05 2024-09-12T18:36:30.540 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.540 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.540 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:30.540 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629144+0000", 2024-09-12T18:36:30.541 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015468900000000001 2024-09-12T18:36:30.541 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.541 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.541 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:30.541 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629162+0000", 2024-09-12T18:36:30.541 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7603000000000001e-05 2024-09-12T18:36:30.541 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.541 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.541 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:30.541 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.646927+0000", 2024-09-12T18:36:30.541 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.017765626 2024-09-12T18:36:30.541 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.541 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.541 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:30.542 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.647245+0000", 2024-09-12T18:36:30.542 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00031797699999999999 2024-09-12T18:36:30.542 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.542 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.542 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:30.542 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.647551+0000", 2024-09-12T18:36:30.542 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00030583500000000002 2024-09-12T18:36:30.542 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.542 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.542 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:30.542 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651738+0000", 2024-09-12T18:36:30.542 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0041864980000000003 2024-09-12T18:36:30.542 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.542 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.543 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:30.543 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670207+0000", 2024-09-12T18:36:30.543 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018469299000000002 2024-09-12T18:36:30.543 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.543 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.543 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:30.543 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670330+0000", 2024-09-12T18:36:30.543 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012284500000000001 2024-09-12T18:36:30.543 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.543 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.543 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:30.543 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670422+0000", 2024-09-12T18:36:30.543 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2398999999999994e-05 2024-09-12T18:36:30.544 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:30.544 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:30.544 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:30.544 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.544 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.544 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:30.544 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:30.544 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 64.869266690000003, 2024-09-12T18:36:30.545 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.041623741999999998, 2024-09-12T18:36:30.545 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:30.545 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:30.545 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:30.545 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:30.545 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.545 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:30.545 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:30.545 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:30.545 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.545 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.545 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:30.546 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:30.546 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:30.546 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.546 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.546 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:30.546 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629020+0000", 2024-09-12T18:36:30.546 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.15e-06 2024-09-12T18:36:30.546 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.546 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.546 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:30.546 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629023+0000", 2024-09-12T18:36:30.546 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4659999999999999e-06 2024-09-12T18:36:30.546 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.547 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.547 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:30.547 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629037+0000", 2024-09-12T18:36:30.547 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3857e-05 2024-09-12T18:36:30.547 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.547 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.547 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:30.547 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629062+0000", 2024-09-12T18:36:30.547 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4519999999999999e-05 2024-09-12T18:36:30.547 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.547 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.547 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:30.548 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629253+0000", 2024-09-12T18:36:30.548 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000191335 2024-09-12T18:36:30.548 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.548 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.548 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:30.548 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629266+0000", 2024-09-12T18:36:30.548 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3322999999999999e-05 2024-09-12T18:36:30.548 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.548 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.548 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:30.549 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648331+0000", 2024-09-12T18:36:30.549 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.019065060000000002 2024-09-12T18:36:30.549 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.549 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.549 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:30.549 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.650044+0000", 2024-09-12T18:36:30.549 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017123959999999999 2024-09-12T18:36:30.549 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.549 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.549 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:30.549 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670642+0000", 2024-09-12T18:36:30.549 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.020598635000000001 2024-09-12T18:36:30.549 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:30.550 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:30.550 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:30.550 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.550 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.550 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:30.550 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:30.550 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 64.869163357999994, 2024-09-12T18:36:30.550 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.046431252999999999, 2024-09-12T18:36:30.550 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:30.550 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:30.550 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:30.550 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:30.550 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.551 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:30.551 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:30.551 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:30.551 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.551 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.551 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:30.551 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:30.551 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:30.551 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.551 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.551 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:30.551 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629123+0000", 2024-09-12T18:36:30.551 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0899999999999999e-06 2024-09-12T18:36:30.552 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.552 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.552 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:30.552 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629138+0000", 2024-09-12T18:36:30.552 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4977000000000001e-05 2024-09-12T18:36:30.552 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.552 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.552 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:30.552 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629149+0000", 2024-09-12T18:36:30.552 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1182999999999999e-05 2024-09-12T18:36:30.552 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.552 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.552 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:30.553 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629157+0000", 2024-09-12T18:36:30.553 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8129999999999996e-06 2024-09-12T18:36:30.553 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.553 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.553 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:30.553 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629223+0000", 2024-09-12T18:36:30.553 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6463000000000004e-05 2024-09-12T18:36:30.553 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.553 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.553 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:30.553 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629230+0000", 2024-09-12T18:36:30.553 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1360000000000002e-06 2024-09-12T18:36:30.554 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.554 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.554 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:30.554 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669605+0000", 2024-09-12T18:36:30.554 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.040375518999999999 2024-09-12T18:36:30.554 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.554 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.554 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:30.554 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669840+0000", 2024-09-12T18:36:30.554 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00023520099999999999 2024-09-12T18:36:30.554 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.554 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.554 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:30.555 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.675553+0000", 2024-09-12T18:36:30.555 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0057128709999999996 2024-09-12T18:36:30.555 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:30.555 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:30.555 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:30.555 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.555 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.555 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:30.555 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:30.555 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 64.869108690999994, 2024-09-12T18:36:30.555 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.037357044999999998, 2024-09-12T18:36:30.555 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:30.556 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:30.556 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:30.556 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:30.556 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.556 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:30.556 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:30.556 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:30.556 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.556 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.556 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:30.556 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:30.557 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:30.557 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.557 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.557 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:30.557 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629178+0000", 2024-09-12T18:36:30.557 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.08e-06 2024-09-12T18:36:30.557 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.557 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.557 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:30.557 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629194+0000", 2024-09-12T18:36:30.557 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5899000000000001e-05 2024-09-12T18:36:30.557 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.557 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.558 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:30.558 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629211+0000", 2024-09-12T18:36:30.558 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7363e-05 2024-09-12T18:36:30.558 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.558 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.558 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:30.558 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629226+0000", 2024-09-12T18:36:30.558 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4567e-05 2024-09-12T18:36:30.558 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.558 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.558 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:30.558 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629299+0000", 2024-09-12T18:36:30.558 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3910000000000002e-05 2024-09-12T18:36:30.558 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.559 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.559 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:30.559 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629307+0000", 2024-09-12T18:36:30.559 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5299999999999999e-06 2024-09-12T18:36:30.559 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.559 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.559 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:30.559 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648185+0000", 2024-09-12T18:36:30.559 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018878533999999999 2024-09-12T18:36:30.559 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.559 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.559 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:30.559 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.649724+0000", 2024-09-12T18:36:30.560 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001538841 2024-09-12T18:36:30.560 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.560 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.560 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:30.560 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.666534+0000", 2024-09-12T18:36:30.560 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.016809320999999999 2024-09-12T18:36:30.560 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:30.560 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:30.560 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:30.560 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.560 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.560 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:77251 5.3 5:c0b45ab3:::benchmark_data_smithi073_23739_object77250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:30.560 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:16.796319+0000", 2024-09-12T18:36:30.561 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 13.701965905, 2024-09-12T18:36:30.561 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018653991000000002, 2024-09-12T18:36:30.561 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:30.561 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:30.561 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:30.561 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:30.561 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:30.561 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:30.561 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 77251 2024-09-12T18:36:30.561 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.561 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:30.561 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.561 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:30.561 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.796319+0000", 2024-09-12T18:36:30.562 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:30.562 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.562 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.562 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:30.562 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.796319+0000", 2024-09-12T18:36:30.562 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:30.562 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.562 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.562 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:30.562 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.796320+0000", 2024-09-12T18:36:30.562 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1100000000000005e-07 2024-09-12T18:36:30.562 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.562 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.562 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:30.563 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.796353+0000", 2024-09-12T18:36:30.563 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3043000000000002e-05 2024-09-12T18:36:30.563 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.563 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.563 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:30.563 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.796361+0000", 2024-09-12T18:36:30.563 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3989999999999998e-06 2024-09-12T18:36:30.563 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.563 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.563 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:30.563 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.796367+0000", 2024-09-12T18:36:30.563 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9950000000000002e-06 2024-09-12T18:36:30.563 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.563 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.564 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:30.564 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.800568+0000", 2024-09-12T18:36:30.564 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0042010709999999998 2024-09-12T18:36:30.564 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.564 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.564 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:30.564 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.800679+0000", 2024-09-12T18:36:30.564 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000111119 2024-09-12T18:36:30.564 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.564 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.564 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:30.564 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.800802+0000", 2024-09-12T18:36:30.564 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000123418 2024-09-12T18:36:30.564 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.565 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.565 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:30.565 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.805536+0000", 2024-09-12T18:36:30.565 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0047341309999999999 2024-09-12T18:36:30.565 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.565 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.565 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:30.565 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.814921+0000", 2024-09-12T18:36:30.565 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0093849680000000005 2024-09-12T18:36:30.566 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.566 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.566 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:30.566 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.814951+0000", 2024-09-12T18:36:30.566 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.9189000000000001e-05 2024-09-12T18:36:30.566 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.566 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.566 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:30.566 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.814973+0000", 2024-09-12T18:36:30.566 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2847e-05 2024-09-12T18:36:30.566 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:30.566 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:30.566 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:30.566 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.567 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.567 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:77253 5.b e38/21 5:df1f7025:::benchmark_data_smithi073_23739_object77252:head v 38'4929, mlcod=38'4925)", 2024-09-12T18:36:30.567 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:16.797351+0000", 2024-09-12T18:36:30.567 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 13.700934781000001, 2024-09-12T18:36:30.567 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.017650757999999999, 2024-09-12T18:36:30.567 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:30.567 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:30.567 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:30.567 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:30.567 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.568 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:30.568 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.797351+0000", 2024-09-12T18:36:30.568 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:30.568 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.568 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.568 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:30.568 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.797351+0000", 2024-09-12T18:36:30.568 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:30.568 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.568 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.568 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:30.568 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.797351+0000", 2024-09-12T18:36:30.569 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4900000000000005e-07 2024-09-12T18:36:30.569 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.569 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.569 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:30.569 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.797404+0000", 2024-09-12T18:36:30.569 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.3038000000000003e-05 2024-09-12T18:36:30.569 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.569 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.569 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:30.569 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.797413+0000", 2024-09-12T18:36:30.569 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.0899999999999994e-06 2024-09-12T18:36:30.569 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.570 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.570 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:30.570 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.797419+0000", 2024-09-12T18:36:30.570 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1749999999999996e-06 2024-09-12T18:36:30.570 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.570 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.570 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:30.570 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.802808+0000", 2024-09-12T18:36:30.570 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0053890919999999998 2024-09-12T18:36:30.570 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.570 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.570 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:30.570 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.802819+0000", 2024-09-12T18:36:30.570 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1252e-05 2024-09-12T18:36:30.570 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.571 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.571 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:30.571 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.814977+0000", 2024-09-12T18:36:30.571 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012157651 2024-09-12T18:36:30.571 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.571 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.571 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:30.571 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.815001+0000", 2024-09-12T18:36:30.571 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4711000000000001e-05 2024-09-12T18:36:30.571 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:30.571 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:30.571 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:30.571 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.571 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.572 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:80960 5.a 5:5d86791e:::benchmark_data_smithi073_23739_object80959:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T18:36:30.572 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:18.558199+0000", 2024-09-12T18:36:30.572 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 11.940086776999999, 2024-09-12T18:36:30.572 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.019912458000000001, 2024-09-12T18:36:30.572 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:30.572 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:30.572 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:30.572 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:30.572 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:30.572 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:30.572 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 80960 2024-09-12T18:36:30.572 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.572 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:30.572 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.573 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:30.573 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558199+0000", 2024-09-12T18:36:30.573 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:30.573 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.573 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.573 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:30.573 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558199+0000", 2024-09-12T18:36:30.573 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:30.573 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.573 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.573 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:30.573 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558199+0000", 2024-09-12T18:36:30.573 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2999999999999999e-07 2024-09-12T18:36:30.573 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.574 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.574 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:30.574 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558255+0000", 2024-09-12T18:36:30.574 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5930999999999997e-05 2024-09-12T18:36:30.574 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.574 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.574 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:30.574 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558263+0000", 2024-09-12T18:36:30.574 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1450000000000008e-06 2024-09-12T18:36:30.574 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.574 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.574 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:30.574 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558272+0000", 2024-09-12T18:36:30.574 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2050000000000002e-06 2024-09-12T18:36:30.575 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.575 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.575 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:30.575 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558334+0000", 2024-09-12T18:36:30.575 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2481e-05 2024-09-12T18:36:30.575 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.575 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.575 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:30.575 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558425+0000", 2024-09-12T18:36:30.575 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1355999999999997e-05 2024-09-12T18:36:30.575 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.575 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.575 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:30.576 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558535+0000", 2024-09-12T18:36:30.576 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00010997699999999999 2024-09-12T18:36:30.576 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.576 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.576 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:30.576 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.569795+0000", 2024-09-12T18:36:30.576 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011260020000000001 2024-09-12T18:36:30.576 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.576 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.576 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:30.576 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.578026+0000", 2024-09-12T18:36:30.576 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0082307100000000005 2024-09-12T18:36:30.576 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.576 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.577 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:30.577 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.578072+0000", 2024-09-12T18:36:30.577 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.6291000000000001e-05 2024-09-12T18:36:30.577 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.577 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.577 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:30.577 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.578111+0000", 2024-09-12T18:36:30.577 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8512e-05 2024-09-12T18:36:30.577 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:30.577 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:30.577 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:30.577 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.577 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.577 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:80965 5.a 5:57bc697e:::benchmark_data_smithi073_23739_object80964:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T18:36:30.577 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:18.560690+0000", 2024-09-12T18:36:30.578 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 11.937595074000001, 2024-09-12T18:36:30.578 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.017504101000000001, 2024-09-12T18:36:30.578 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:30.578 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:30.578 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:30.578 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:30.578 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:30.578 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:30.578 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 80965 2024-09-12T18:36:30.578 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.578 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:30.578 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.578 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:30.579 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.560690+0000", 2024-09-12T18:36:30.579 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:30.579 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.579 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.579 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:30.579 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.560690+0000", 2024-09-12T18:36:30.579 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:30.579 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.579 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.579 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:30.579 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.560692+0000", 2024-09-12T18:36:30.579 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3909999999999999e-06 2024-09-12T18:36:30.579 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.579 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.580 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:30.580 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.560757+0000", 2024-09-12T18:36:30.580 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5594999999999998e-05 2024-09-12T18:36:30.580 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.580 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.580 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:30.580 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.560769+0000", 2024-09-12T18:36:30.580 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1863e-05 2024-09-12T18:36:30.580 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.580 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.580 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:30.580 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.560776+0000", 2024-09-12T18:36:30.580 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8279999999999997e-06 2024-09-12T18:36:30.581 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.581 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.581 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:30.581 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.562340+0000", 2024-09-12T18:36:30.581 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001563891 2024-09-12T18:36:30.581 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.581 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.581 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:30.581 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.562490+0000", 2024-09-12T18:36:30.581 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015055400000000001 2024-09-12T18:36:30.581 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.581 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.581 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:30.582 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.562642+0000", 2024-09-12T18:36:30.582 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015150600000000001 2024-09-12T18:36:30.582 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.582 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.582 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:30.582 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.569837+0000", 2024-09-12T18:36:30.582 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0071948749999999999 2024-09-12T18:36:30.582 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.582 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.582 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:30.582 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.578119+0000", 2024-09-12T18:36:30.582 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0082825550000000005 2024-09-12T18:36:30.582 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.582 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.582 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:30.583 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.578161+0000", 2024-09-12T18:36:30.583 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.1693000000000002e-05 2024-09-12T18:36:30.583 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.583 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.583 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:30.583 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.578194+0000", 2024-09-12T18:36:30.583 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3349999999999997e-05 2024-09-12T18:36:30.583 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:30.583 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:30.583 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:30.583 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.583 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.583 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:80967 5.a 5:5f4000f6:::benchmark_data_smithi073_23739_object80966:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T18:36:30.584 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:18.561016+0000", 2024-09-12T18:36:30.584 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 11.937269096, 2024-09-12T18:36:30.584 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021780831, 2024-09-12T18:36:30.584 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:30.584 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:30.584 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:30.584 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:30.584 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:30.584 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:30.584 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 80967 2024-09-12T18:36:30.584 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.584 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:30.584 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.584 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:30.585 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561016+0000", 2024-09-12T18:36:30.585 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:30.585 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.585 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.585 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:30.585 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561016+0000", 2024-09-12T18:36:30.585 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:30.585 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.585 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.585 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:30.585 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561017+0000", 2024-09-12T18:36:30.585 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7599999999999997e-07 2024-09-12T18:36:30.585 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.585 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.586 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:30.586 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561050+0000", 2024-09-12T18:36:30.586 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3524e-05 2024-09-12T18:36:30.586 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.586 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.586 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:30.586 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561058+0000", 2024-09-12T18:36:30.586 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0679999999999997e-06 2024-09-12T18:36:30.586 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.586 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.586 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:30.586 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561065+0000", 2024-09-12T18:36:30.586 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1990000000000003e-06 2024-09-12T18:36:30.587 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.587 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.587 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:30.587 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564735+0000", 2024-09-12T18:36:30.587 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0036706740000000001 2024-09-12T18:36:30.587 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.587 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.587 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:30.587 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564868+0000", 2024-09-12T18:36:30.587 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000133003 2024-09-12T18:36:30.587 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.587 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.587 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:30.587 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.565010+0000", 2024-09-12T18:36:30.587 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014224300000000001 2024-09-12T18:36:30.588 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.588 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.588 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:30.588 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.569871+0000", 2024-09-12T18:36:30.588 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0048600759999999996 2024-09-12T18:36:30.588 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.588 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.588 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:30.588 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.582729+0000", 2024-09-12T18:36:30.588 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012858090000000001 2024-09-12T18:36:30.588 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.588 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.589 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:30.589 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.582758+0000", 2024-09-12T18:36:30.589 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.9762999999999999e-05 2024-09-12T18:36:30.589 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.589 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.589 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:30.589 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.582797+0000", 2024-09-12T18:36:30.589 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8615000000000002e-05 2024-09-12T18:36:30.589 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:30.589 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:30.589 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:30.589 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.589 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.589 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:80971 5.2 e39/21 5:4205ebb1:::benchmark_data_smithi073_23739_object80970:head v 39'5054, mlcod=39'5052)", 2024-09-12T18:36:30.589 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:18.564320+0000", 2024-09-12T18:36:30.590 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 11.933965131000001, 2024-09-12T18:36:30.590 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.019963669999999999, 2024-09-12T18:36:30.590 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:30.590 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:30.590 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:30.590 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:30.590 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.590 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:30.590 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564320+0000", 2024-09-12T18:36:30.590 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:30.590 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.590 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.590 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:30.590 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564320+0000", 2024-09-12T18:36:30.590 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:30.591 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.591 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.591 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:30.591 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564321+0000", 2024-09-12T18:36:30.591 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.77e-07 2024-09-12T18:36:30.591 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.591 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.591 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:30.591 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564418+0000", 2024-09-12T18:36:30.591 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.7602000000000005e-05 2024-09-12T18:36:30.591 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.591 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.591 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:30.591 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564427+0000", 2024-09-12T18:36:30.592 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7439999999999996e-06 2024-09-12T18:36:30.592 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.592 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.592 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:30.592 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564442+0000", 2024-09-12T18:36:30.592 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5353e-05 2024-09-12T18:36:30.592 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.592 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.592 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:30.592 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.569512+0000", 2024-09-12T18:36:30.592 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0050701840000000001 2024-09-12T18:36:30.592 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.592 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.593 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:30.593 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.569531+0000", 2024-09-12T18:36:30.593 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8311000000000001e-05 2024-09-12T18:36:30.593 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.593 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.593 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:30.593 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.584246+0000", 2024-09-12T18:36:30.593 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.014714947000000001 2024-09-12T18:36:30.594 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.594 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.594 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:30.594 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.584284+0000", 2024-09-12T18:36:30.594 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8152000000000003e-05 2024-09-12T18:36:30.594 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:30.594 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:30.594 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:30.594 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.594 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.594 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:95657 5.6 5:60d5bc5b:::benchmark_data_smithi073_23739_object95656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:36:30.594 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:25.760171+0000", 2024-09-12T18:36:30.595 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4.7381139409999999, 2024-09-12T18:36:30.595 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018096398999999999, 2024-09-12T18:36:30.595 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:30.595 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:30.595 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:30.595 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:30.595 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:30.595 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:30.595 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 95657 2024-09-12T18:36:30.595 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.595 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:30.595 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.595 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:30.595 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.760171+0000", 2024-09-12T18:36:30.596 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:30.596 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.596 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.596 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:30.596 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.760171+0000", 2024-09-12T18:36:30.596 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:30.596 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.596 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.596 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:30.596 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.760172+0000", 2024-09-12T18:36:30.596 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4600000000000003e-07 2024-09-12T18:36:30.596 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.597 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.597 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:30.597 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.760226+0000", 2024-09-12T18:36:30.597 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.3359999999999997e-05 2024-09-12T18:36:30.597 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.597 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.597 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:30.597 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.760234+0000", 2024-09-12T18:36:30.597 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.4950000000000008e-06 2024-09-12T18:36:30.597 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.597 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.597 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:30.597 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.760240+0000", 2024-09-12T18:36:30.598 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.801e-06 2024-09-12T18:36:30.598 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.598 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.598 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:30.598 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.770465+0000", 2024-09-12T18:36:30.598 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.010224878999999999 2024-09-12T18:36:30.598 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.598 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.598 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:30.598 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.770584+0000", 2024-09-12T18:36:30.598 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000119276 2024-09-12T18:36:30.598 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.599 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.599 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:30.599 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.770735+0000", 2024-09-12T18:36:30.599 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000150994 2024-09-12T18:36:30.599 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.599 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.599 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:30.599 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.775049+0000", 2024-09-12T18:36:30.599 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0043141209999999998 2024-09-12T18:36:30.599 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.599 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.599 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:30.599 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.778195+0000", 2024-09-12T18:36:30.600 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.003145414 2024-09-12T18:36:30.600 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.600 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.600 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:30.600 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.778229+0000", 2024-09-12T18:36:30.600 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4474000000000002e-05 2024-09-12T18:36:30.600 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.600 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.600 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:30.600 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.778268+0000", 2024-09-12T18:36:30.600 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8639000000000001e-05 2024-09-12T18:36:30.600 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:30.600 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:30.601 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:30.601 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.601 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.601 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:96749 5.3 5:c505ae3b:::benchmark_data_smithi073_23739_object96748:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:36:30.601 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:26.291192+0000", 2024-09-12T18:36:30.601 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4.2070936979999995, 2024-09-12T18:36:30.601 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.017836791000000001, 2024-09-12T18:36:30.601 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:30.601 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:30.601 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:30.601 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:30.601 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:30.601 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:30.602 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 96749 2024-09-12T18:36:30.602 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.602 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:30.602 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.602 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:30.602 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.291192+0000", 2024-09-12T18:36:30.602 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:30.602 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.602 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.602 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:30.602 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.291192+0000", 2024-09-12T18:36:30.602 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:30.602 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.602 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.603 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:30.603 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.291192+0000", 2024-09-12T18:36:30.603 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5600000000000005e-07 2024-09-12T18:36:30.603 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.603 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.603 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:30.603 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.291300+0000", 2024-09-12T18:36:30.603 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000107388 2024-09-12T18:36:30.603 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.603 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.603 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:30.603 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.291310+0000", 2024-09-12T18:36:30.603 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0426e-05 2024-09-12T18:36:30.604 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.604 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.604 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:30.604 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.291317+0000", 2024-09-12T18:36:30.604 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0940000000000002e-06 2024-09-12T18:36:30.604 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.604 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.604 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:30.604 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.300131+0000", 2024-09-12T18:36:30.604 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0088133980000000001 2024-09-12T18:36:30.604 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.604 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.605 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:30.605 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.300246+0000", 2024-09-12T18:36:30.605 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00011576199999999999 2024-09-12T18:36:30.605 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.605 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.605 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:30.605 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.300385+0000", 2024-09-12T18:36:30.605 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013833300000000001 2024-09-12T18:36:30.605 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.605 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.605 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:30.605 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.303176+0000", 2024-09-12T18:36:30.605 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0027914720000000001 2024-09-12T18:36:30.605 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.606 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.606 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:30.606 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.307219+0000", 2024-09-12T18:36:30.606 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0040424199999999997 2024-09-12T18:36:30.606 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.606 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.606 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:30.606 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.307309+0000", 2024-09-12T18:36:30.606 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.0241999999999994e-05 2024-09-12T18:36:30.606 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.606 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.606 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:30.606 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.309028+0000", 2024-09-12T18:36:30.607 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017195000000000001 2024-09-12T18:36:30.607 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:30.607 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:30.607 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:30.607 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.607 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.607 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:96974 5.4 e41/21 5:22c5e101:::benchmark_data_smithi073_23739_object96973:head v 41'5961, mlcod=41'5959)", 2024-09-12T18:36:30.607 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:26.404591+0000", 2024-09-12T18:36:30.607 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4.0936944100000003, 2024-09-12T18:36:30.607 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.017419793999999999, 2024-09-12T18:36:30.607 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:30.607 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:30.607 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:30.607 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:30.608 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.608 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:30.608 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.404591+0000", 2024-09-12T18:36:30.608 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:30.608 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.608 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.608 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:30.608 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.404591+0000", 2024-09-12T18:36:30.608 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:30.608 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.608 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.608 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:30.608 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.404592+0000", 2024-09-12T18:36:30.609 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4499999999999996e-07 2024-09-12T18:36:30.609 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.609 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.609 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:30.609 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.404652+0000", 2024-09-12T18:36:30.609 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.0202999999999999e-05 2024-09-12T18:36:30.609 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.609 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.609 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:30.609 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.404660+0000", 2024-09-12T18:36:30.609 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.4149999999999999e-06 2024-09-12T18:36:30.609 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.609 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.609 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:30.610 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.404667+0000", 2024-09-12T18:36:30.610 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.9550000000000003e-06 2024-09-12T18:36:30.610 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.610 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.610 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:30.610 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.409006+0000", 2024-09-12T18:36:30.610 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0043392750000000001 2024-09-12T18:36:30.610 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.610 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.610 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:30.610 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.409018+0000", 2024-09-12T18:36:30.610 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1389999999999999e-05 2024-09-12T18:36:30.610 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.610 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.610 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:30.611 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.421963+0000", 2024-09-12T18:36:30.611 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012945607 2024-09-12T18:36:30.611 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.611 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.611 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:30.611 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.422011+0000", 2024-09-12T18:36:30.611 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.7203999999999997e-05 2024-09-12T18:36:30.611 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:30.611 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:30.611 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:30.611 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.611 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.611 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:96980 5.c 5:314954af:::benchmark_data_smithi073_23739_object96979:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:36:30.611 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:26.406647+0000", 2024-09-12T18:36:30.612 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4.091638766, 2024-09-12T18:36:30.612 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018505462, 2024-09-12T18:36:30.612 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:30.612 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:30.612 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:30.612 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:30.612 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:30.612 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:30.612 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 96980 2024-09-12T18:36:30.612 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.612 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:30.612 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.612 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:30.613 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.406647+0000", 2024-09-12T18:36:30.613 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:30.613 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.613 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.613 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:30.613 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.406647+0000", 2024-09-12T18:36:30.613 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:30.613 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.613 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.613 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:30.613 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.406647+0000", 2024-09-12T18:36:30.613 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4000000000000002e-07 2024-09-12T18:36:30.613 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.614 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.614 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:30.614 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.406705+0000", 2024-09-12T18:36:30.614 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7685000000000001e-05 2024-09-12T18:36:30.614 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.614 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.614 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:30.614 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.406712+0000", 2024-09-12T18:36:30.614 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8120000000000002e-06 2024-09-12T18:36:30.614 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.614 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.614 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:30.615 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.406715+0000", 2024-09-12T18:36:30.615 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.6550000000000002e-06 2024-09-12T18:36:30.615 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.615 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.615 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:30.615 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.417564+0000", 2024-09-12T18:36:30.615 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.010849187999999999 2024-09-12T18:36:30.615 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.615 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.615 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:30.615 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.417648+0000", 2024-09-12T18:36:30.615 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.3924999999999994e-05 2024-09-12T18:36:30.615 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.616 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.616 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:30.616 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.417730+0000", 2024-09-12T18:36:30.616 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2016999999999998e-05 2024-09-12T18:36:30.616 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.616 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.616 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:30.616 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.422225+0000", 2024-09-12T18:36:30.616 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0044943149999999996 2024-09-12T18:36:30.616 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.616 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.616 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:30.616 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.425021+0000", 2024-09-12T18:36:30.617 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0027962479999999999 2024-09-12T18:36:30.617 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.617 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.617 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:30.617 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.425110+0000", 2024-09-12T18:36:30.617 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.8834999999999999e-05 2024-09-12T18:36:30.617 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.617 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.617 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:30.617 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.425152+0000", 2024-09-12T18:36:30.617 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2242e-05 2024-09-12T18:36:30.617 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:30.617 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:30.618 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:30.618 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.618 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.618 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:99505 5.c 5:358150bc:::benchmark_data_smithi073_23739_object99504:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:36:30.618 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:27.620043+0000", 2024-09-12T18:36:30.618 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 2.8782427300000002, 2024-09-12T18:36:30.618 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.019666044000000001, 2024-09-12T18:36:30.618 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:30.618 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:30.618 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:30.618 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:30.618 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:30.618 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:30.619 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 99505 2024-09-12T18:36:30.619 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.619 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:30.619 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.619 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:30.619 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:27.620043+0000", 2024-09-12T18:36:30.619 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:30.619 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.619 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.619 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:30.619 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:27.620043+0000", 2024-09-12T18:36:30.619 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:30.619 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.619 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.620 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:30.620 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:27.620043+0000", 2024-09-12T18:36:30.620 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5200000000000002e-07 2024-09-12T18:36:30.620 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.620 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.620 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:30.620 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:27.620078+0000", 2024-09-12T18:36:30.620 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.5305000000000002e-05 2024-09-12T18:36:30.620 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.620 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.620 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:30.620 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:27.620085+0000", 2024-09-12T18:36:30.620 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3829999999999997e-06 2024-09-12T18:36:30.620 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.621 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.621 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:30.621 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:27.620090+0000", 2024-09-12T18:36:30.621 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4480000000000002e-06 2024-09-12T18:36:30.621 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.621 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.621 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:30.621 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:27.625971+0000", 2024-09-12T18:36:30.621 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0058812220000000002 2024-09-12T18:36:30.621 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.621 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.621 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:30.621 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:27.626101+0000", 2024-09-12T18:36:30.621 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012965900000000001 2024-09-12T18:36:30.621 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.622 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.622 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:30.622 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:27.626181+0000", 2024-09-12T18:36:30.622 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0408000000000007e-05 2024-09-12T18:36:30.622 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.622 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.622 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:30.622 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:27.632280+0000", 2024-09-12T18:36:30.622 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0060989979999999996 2024-09-12T18:36:30.622 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.622 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.622 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:30.622 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:27.639625+0000", 2024-09-12T18:36:30.623 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0073445810000000002 2024-09-12T18:36:30.623 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.623 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.623 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:30.623 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:27.639671+0000", 2024-09-12T18:36:30.623 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5902999999999997e-05 2024-09-12T18:36:30.623 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:30.623 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:30.623 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:30.623 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:27.639709+0000", 2024-09-12T18:36:30.623 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.7685000000000003e-05 2024-09-12T18:36:30.623 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:30.623 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:30.623 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:30.624 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:30.624 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:30.624 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:30.625 INFO:teuthology.orchestra.run.smithi073.stderr:reweighted osd.2 to 1 (10000) 2024-09-12T18:36:30.625 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:30.624+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:30.626 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is set 2024-09-12T18:36:30.627 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:36:30.627 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-12T18:36:30.627 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:36:30.727 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:30.724+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:30.782 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:30.782 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:36:30.782 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.782 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:105940 5.d 5:bcce70ea:::benchmark_data_smithi073_23739_object105939:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:36:30.782 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:30.777901+0000", 2024-09-12T18:36:30.782 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0032208969999999999, 2024-09-12T18:36:30.782 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0032478749999999999, 2024-09-12T18:36:30.783 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:30.783 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:30.783 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:30.783 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:30.783 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:30.783 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:30.783 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 105940 2024-09-12T18:36:30.783 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.783 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:30.783 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.783 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:30.783 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.777901+0000", 2024-09-12T18:36:30.783 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:30.783 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.784 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.784 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:30.784 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.777901+0000", 2024-09-12T18:36:30.784 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:30.784 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.784 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.784 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:30.784 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.777902+0000", 2024-09-12T18:36:30.784 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.063e-06 2024-09-12T18:36:30.784 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.784 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.784 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:30.784 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.778038+0000", 2024-09-12T18:36:30.784 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013617800000000001 2024-09-12T18:36:30.785 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.785 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.785 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:30.785 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.778048+0000", 2024-09-12T18:36:30.785 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4860000000000003e-06 2024-09-12T18:36:30.785 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.785 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.785 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:30.785 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.778053+0000", 2024-09-12T18:36:30.785 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8269999999999997e-06 2024-09-12T18:36:30.785 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.785 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.785 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:30.786 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.778128+0000", 2024-09-12T18:36:30.786 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5253000000000006e-05 2024-09-12T18:36:30.786 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.786 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.786 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:30.786 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.778241+0000", 2024-09-12T18:36:30.786 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112815 2024-09-12T18:36:30.786 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.786 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.786 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:30.786 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.778341+0000", 2024-09-12T18:36:30.786 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010061200000000001 2024-09-12T18:36:30.786 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:30.786 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:30.787 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:30.787 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.787 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.787 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:105943 5.e 5:7a782047:::benchmark_data_smithi073_23739_object105942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:36:30.787 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:30.778067+0000", 2024-09-12T18:36:30.787 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.003055239, 2024-09-12T18:36:30.787 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031545150000000001, 2024-09-12T18:36:30.787 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:30.787 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:30.787 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:30.787 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:30.787 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:30.787 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:30.788 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 105943 2024-09-12T18:36:30.788 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.788 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:30.788 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.788 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:30.788 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.778067+0000", 2024-09-12T18:36:30.788 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:30.788 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.788 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.788 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:30.788 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.778067+0000", 2024-09-12T18:36:30.788 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:30.789 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.789 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.789 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:30.789 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.778067+0000", 2024-09-12T18:36:30.789 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1699999999999999e-07 2024-09-12T18:36:30.789 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.789 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.789 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:30.789 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.778127+0000", 2024-09-12T18:36:30.789 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.9697000000000001e-05 2024-09-12T18:36:30.789 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.789 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.789 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:30.789 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.778136+0000", 2024-09-12T18:36:30.789 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4190000000000008e-06 2024-09-12T18:36:30.790 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.790 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.790 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:30.790 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.778141+0000", 2024-09-12T18:36:30.790 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.561e-06 2024-09-12T18:36:30.790 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.790 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.790 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:30.790 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.778179+0000", 2024-09-12T18:36:30.790 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8016999999999999e-05 2024-09-12T18:36:30.790 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.790 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.790 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:30.790 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.778266+0000", 2024-09-12T18:36:30.790 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6840000000000002e-05 2024-09-12T18:36:30.791 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.791 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.791 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:30.791 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.778347+0000", 2024-09-12T18:36:30.791 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1459999999999996e-05 2024-09-12T18:36:30.791 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.791 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.791 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:30.791 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.780471+0000", 2024-09-12T18:36:30.791 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0021234829999999998 2024-09-12T18:36:30.791 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:30.791 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:30.791 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:30.791 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.792 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.792 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:105944 5.d 5:b00dec24:::benchmark_data_smithi073_23739_object105943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:36:30.792 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:30.778150+0000", 2024-09-12T18:36:30.792 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0029717250000000001, 2024-09-12T18:36:30.792 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031409010000000002, 2024-09-12T18:36:30.792 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:30.792 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:30.792 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:30.792 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:30.792 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:30.792 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:30.792 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 105944 2024-09-12T18:36:30.792 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.793 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:30.793 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.793 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:30.793 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.778150+0000", 2024-09-12T18:36:30.793 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:30.793 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.793 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.793 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:30.793 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.778150+0000", 2024-09-12T18:36:30.793 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:30.793 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.793 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.794 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:30.794 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.778151+0000", 2024-09-12T18:36:30.794 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.9599999999999999e-07 2024-09-12T18:36:30.794 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.794 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.794 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:30.794 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.778187+0000", 2024-09-12T18:36:30.794 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6229999999999997e-05 2024-09-12T18:36:30.794 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.794 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.794 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:30.794 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.778193+0000", 2024-09-12T18:36:30.795 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.9859999999999999e-06 2024-09-12T18:36:30.795 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.795 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.795 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:30.795 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.778197+0000", 2024-09-12T18:36:30.795 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7960000000000002e-06 2024-09-12T18:36:30.795 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.795 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.795 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:30.795 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.780386+0000", 2024-09-12T18:36:30.795 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0021884930000000001 2024-09-12T18:36:30.795 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.795 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.795 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:30.795 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.780532+0000", 2024-09-12T18:36:30.796 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000146403 2024-09-12T18:36:30.796 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.796 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.796 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:30.796 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.780623+0000", 2024-09-12T18:36:30.796 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.1415999999999993e-05 2024-09-12T18:36:30.796 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:30.796 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:30.796 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:30.796 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.796 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.796 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:105945 5.9 e45/21 5:9a2f09d4:::benchmark_data_smithi073_23739_object105944:head v 45'6582, mlcod=45'6580)", 2024-09-12T18:36:30.796 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:30.779731+0000", 2024-09-12T18:36:30.796 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0013915010000000001, 2024-09-12T18:36:30.797 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001622697, 2024-09-12T18:36:30.797 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:30.797 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:30.797 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:30.797 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:30.797 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.797 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:30.797 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.779731+0000", 2024-09-12T18:36:30.797 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:30.797 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.797 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.797 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:30.797 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.779731+0000", 2024-09-12T18:36:30.798 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:30.798 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.798 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.798 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:30.798 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.779731+0000", 2024-09-12T18:36:30.798 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1699999999999998e-07 2024-09-12T18:36:30.798 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.798 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.798 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:30.798 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.779789+0000", 2024-09-12T18:36:30.798 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7995000000000003e-05 2024-09-12T18:36:30.798 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.798 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.798 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:30.799 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.779802+0000", 2024-09-12T18:36:30.799 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2648e-05 2024-09-12T18:36:30.799 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.799 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.799 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:30.799 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.779806+0000", 2024-09-12T18:36:30.799 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1309999999999999e-06 2024-09-12T18:36:30.799 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.799 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.799 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:30.799 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.779852+0000", 2024-09-12T18:36:30.799 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6461000000000001e-05 2024-09-12T18:36:30.799 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.800 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.800 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:30.800 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.779866+0000", 2024-09-12T18:36:30.800 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3057999999999999e-05 2024-09-12T18:36:30.800 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:30.800 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:30.800 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:30.800 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.800 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.800 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:105947 5.d 5.1c4492cd (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:36:30.800 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:30.780424+0000", 2024-09-12T18:36:30.800 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00069813999999999998, 2024-09-12T18:36:30.800 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00097622500000000005, 2024-09-12T18:36:30.800 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:30.800 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:30.801 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:30.801 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:30.801 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:30.801 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:30.801 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 105947 2024-09-12T18:36:30.801 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.801 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:30.801 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.801 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:30.801 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.780424+0000", 2024-09-12T18:36:30.801 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:30.801 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.801 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.801 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:30.802 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.780424+0000", 2024-09-12T18:36:30.802 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:30.802 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.802 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.802 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:30.802 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.780426+0000", 2024-09-12T18:36:30.802 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6759999999999999e-06 2024-09-12T18:36:30.802 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.802 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.802 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:30.802 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.780506+0000", 2024-09-12T18:36:30.802 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0168999999999998e-05 2024-09-12T18:36:30.802 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.802 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.802 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:30.802 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.780516+0000", 2024-09-12T18:36:30.803 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.049e-05 2024-09-12T18:36:30.803 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.803 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.803 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:30.803 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.780524+0000", 2024-09-12T18:36:30.803 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5889999999999997e-06 2024-09-12T18:36:30.803 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:30.803 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:30.803 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:30.803 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.803 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.803 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:105941 5.a e45/21 5:5bd7ba86:::benchmark_data_smithi073_23739_object105940:head v 45'6682, mlcod=45'6680)", 2024-09-12T18:36:30.803 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:30.780556+0000", 2024-09-12T18:36:30.803 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00056582799999999999, 2024-09-12T18:36:30.804 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00088917100000000002, 2024-09-12T18:36:30.804 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:30.804 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:30.804 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:30.804 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:30.804 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.804 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:30.804 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.780556+0000", 2024-09-12T18:36:30.804 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:30.804 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.804 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.804 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:30.804 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.780556+0000", 2024-09-12T18:36:30.804 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:30.805 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.805 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.805 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:30.805 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.780557+0000", 2024-09-12T18:36:30.805 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2799999999999995e-07 2024-09-12T18:36:30.805 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.805 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.805 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:30.805 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.780602+0000", 2024-09-12T18:36:30.805 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5009000000000002e-05 2024-09-12T18:36:30.805 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.805 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.805 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:30.805 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.780611+0000", 2024-09-12T18:36:30.806 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.3139999999999993e-06 2024-09-12T18:36:30.806 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.806 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.806 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:30.806 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.780618+0000", 2024-09-12T18:36:30.806 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2650000000000002e-06 2024-09-12T18:36:30.806 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.806 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.806 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:30.806 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.780674+0000", 2024-09-12T18:36:30.806 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6647999999999997e-05 2024-09-12T18:36:30.806 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:30.806 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:30.806 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:30.806 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.780690+0000", 2024-09-12T18:36:30.807 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5143000000000001e-05 2024-09-12T18:36:30.807 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:30.807 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:30.807 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:30.807 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:30.807 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-09-12T18:36:30.807 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 6 2024-09-12T18:36:30.807 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:30.808 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:36:30.853 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:30.851+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:30.873 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 45 16 106146 106130 147.387 129.188 0.00503207 0.00678022 2024-09-12T18:36:30.929 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:30.927+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:30.963 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:30.963 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-09-12T18:36:30.963 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-09-12T18:36:30.963 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-09-12T18:36:30.963 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:30.985 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:36:30.994 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:36:30.996 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T18:36:31.014 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":83,"stamp":"2024-09-12T18:36:30.563415+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6471814045,"num_objects":98769,"num_object_clones":0,"num_object_copies":197538,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98769,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":98935,"num_write_kb":6322240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60897,"ondisk_log_size":60897,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1096180,"kb_used_data":777712,"kb_used_omap":4,"kb_used_meta":318395,"kb_avail":282019340,"statfs":{"total":289910292480,"available":288787804160,"internally_reserved":0,"allocated":796377088,"data_stored":12719588656,"data_compressed":603981928,"data_compressed_allocated":794959872,"data_compressed_original":12719063040,"omap_allocated":4783,"internal_metadata":326036817},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,3,6,6,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":666894336,"num_objects":10176,"num_object_clones":0,"num_object_copies":20352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10176,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10176,"num_write_kb":651264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.168263"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.535363+0000","last_change":"2024-09-12T18:35:25.657389+0000","last_active":"2024-09-12T18:36:27.535363+0000","last_peered":"2024-09-12T18:36:27.535363+0000","last_clean":"2024-09-12T18:36:27.535363+0000","last_became_active":"2024-09-12T18:35:25.651857+0000","last_became_peered":"2024-09-12T18:35:25.651857+0000","last_unstale":"2024-09-12T18:36:27.535363+0000","last_undegraded":"2024-09-12T18:36:27.535363+0000","last_fullsized":"2024-09-12T18:36:27.535363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:50.264536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.535068+0000","last_change":"2024-09-12T18:35:25.659760+0000","last_active":"2024-09-12T18:36:27.535068+0000","last_peered":"2024-09-12T18:36:27.535068+0000","last_clean":"2024-09-12T18:36:27.535068+0000","last_became_active":"2024-09-12T18:35:25.654920+0000","last_became_peered":"2024-09-12T18:35:25.654920+0000","last_unstale":"2024-09-12T18:36:27.535068+0000","last_undegraded":"2024-09-12T18:36:27.535068+0000","last_fullsized":"2024-09-12T18:36:27.535068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:21.519881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.522116+0000","last_change":"2024-09-12T18:35:25.659460+0000","last_active":"2024-09-12T18:36:24.522116+0000","last_peered":"2024-09-12T18:36:24.522116+0000","last_clean":"2024-09-12T18:36:24.522116+0000","last_became_active":"2024-09-12T18:35:25.657782+0000","last_became_peered":"2024-09-12T18:35:25.657782+0000","last_unstale":"2024-09-12T18:36:24.522116+0000","last_undegraded":"2024-09-12T18:36:24.522116+0000","last_fullsized":"2024-09-12T18:36:24.522116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:38.544284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.524390+0000","last_change":"2024-09-12T18:35:25.663617+0000","last_active":"2024-09-12T18:36:24.524390+0000","last_peered":"2024-09-12T18:36:24.524390+0000","last_clean":"2024-09-12T18:36:24.524390+0000","last_became_active":"2024-09-12T18:35:25.661977+0000","last_became_peered":"2024-09-12T18:35:25.661977+0000","last_unstale":"2024-09-12T18:36:24.524390+0000","last_undegraded":"2024-09-12T18:36:24.524390+0000","last_fullsized":"2024-09-12T18:36:24.524390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:14.748234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.539334+0000","last_change":"2024-09-12T18:35:25.656566+0000","last_active":"2024-09-12T18:36:27.539334+0000","last_peered":"2024-09-12T18:36:27.539334+0000","last_clean":"2024-09-12T18:36:27.539334+0000","last_became_active":"2024-09-12T18:35:25.654898+0000","last_became_peered":"2024-09-12T18:35:25.654898+0000","last_unstale":"2024-09-12T18:36:27.539334+0000","last_undegraded":"2024-09-12T18:36:27.539334+0000","last_fullsized":"2024-09-12T18:36:27.539334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:36.113250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.521185+0000","last_change":"2024-09-12T18:35:25.652754+0000","last_active":"2024-09-12T18:36:24.521185+0000","last_peered":"2024-09-12T18:36:24.521185+0000","last_clean":"2024-09-12T18:36:24.521185+0000","last_became_active":"2024-09-12T18:35:25.651217+0000","last_became_peered":"2024-09-12T18:35:25.651217+0000","last_unstale":"2024-09-12T18:36:24.521185+0000","last_undegraded":"2024-09-12T18:36:24.521185+0000","last_fullsized":"2024-09-12T18:36:24.521185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:24.585774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.521278+0000","last_change":"2024-09-12T18:35:25.659811+0000","last_active":"2024-09-12T18:36:24.521278+0000","last_peered":"2024-09-12T18:36:24.521278+0000","last_clean":"2024-09-12T18:36:24.521278+0000","last_became_active":"2024-09-12T18:35:25.658998+0000","last_became_peered":"2024-09-12T18:35:25.658998+0000","last_unstale":"2024-09-12T18:36:24.521278+0000","last_undegraded":"2024-09-12T18:36:24.521278+0000","last_fullsized":"2024-09-12T18:36:24.521278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.520920+0000","last_change":"2024-09-12T18:35:25.653999+0000","last_active":"2024-09-12T18:36:24.520920+0000","last_peered":"2024-09-12T18:36:24.520920+0000","last_clean":"2024-09-12T18:36:24.520920+0000","last_became_active":"2024-09-12T18:35:25.653319+0000","last_became_peered":"2024-09-12T18:35:25.653319+0000","last_unstale":"2024-09-12T18:36:24.520920+0000","last_undegraded":"2024-09-12T18:36:24.520920+0000","last_fullsized":"2024-09-12T18:36:24.520920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:04.718000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.516676+0000","last_change":"2024-09-12T18:35:25.668339+0000","last_active":"2024-09-12T18:36:24.516676+0000","last_peered":"2024-09-12T18:36:24.516676+0000","last_clean":"2024-09-12T18:36:24.516676+0000","last_became_active":"2024-09-12T18:35:25.667608+0000","last_became_peered":"2024-09-12T18:35:25.667608+0000","last_unstale":"2024-09-12T18:36:24.516676+0000","last_undegraded":"2024-09-12T18:36:24.516676+0000","last_fullsized":"2024-09-12T18:36:24.516676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:15.699745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.537002+0000","last_change":"2024-09-12T18:35:25.660174+0000","last_active":"2024-09-12T18:36:27.537002+0000","last_peered":"2024-09-12T18:36:27.537002+0000","last_clean":"2024-09-12T18:36:27.537002+0000","last_became_active":"2024-09-12T18:35:25.656560+0000","last_became_peered":"2024-09-12T18:35:25.656560+0000","last_unstale":"2024-09-12T18:36:27.537002+0000","last_undegraded":"2024-09-12T18:36:27.537002+0000","last_fullsized":"2024-09-12T18:36:27.537002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:47.268505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.522203+0000","last_change":"2024-09-12T18:35:25.649858+0000","last_active":"2024-09-12T18:36:24.522203+0000","last_peered":"2024-09-12T18:36:24.522203+0000","last_clean":"2024-09-12T18:36:24.522203+0000","last_became_active":"2024-09-12T18:35:25.649090+0000","last_became_peered":"2024-09-12T18:35:25.649090+0000","last_unstale":"2024-09-12T18:36:24.522203+0000","last_undegraded":"2024-09-12T18:36:24.522203+0000","last_fullsized":"2024-09-12T18:36:24.522203+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:33.158421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.534943+0000","last_change":"2024-09-12T18:35:25.649885+0000","last_active":"2024-09-12T18:36:27.534943+0000","last_peered":"2024-09-12T18:36:27.534943+0000","last_clean":"2024-09-12T18:36:27.534943+0000","last_became_active":"2024-09-12T18:35:25.649111+0000","last_became_peered":"2024-09-12T18:35:25.649111+0000","last_unstale":"2024-09-12T18:36:27.534943+0000","last_undegraded":"2024-09-12T18:36:27.534943+0000","last_fullsized":"2024-09-12T18:36:27.534943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:17.162410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.539239+0000","last_change":"2024-09-12T18:35:25.651541+0000","last_active":"2024-09-12T18:36:27.539239+0000","last_peered":"2024-09-12T18:36:27.539239+0000","last_clean":"2024-09-12T18:36:27.539239+0000","last_became_active":"2024-09-12T18:35:25.650661+0000","last_became_peered":"2024-09-12T18:35:25.650661+0000","last_unstale":"2024-09-12T18:36:27.539239+0000","last_undegraded":"2024-09-12T18:36:27.539239+0000","last_fullsized":"2024-09-12T18:36:27.539239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:52.082734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.521343+0000","last_change":"2024-09-12T18:35:25.657913+0000","last_active":"2024-09-12T18:36:24.521343+0000","last_peered":"2024-09-12T18:36:24.521343+0000","last_clean":"2024-09-12T18:36:24.521343+0000","last_became_active":"2024-09-12T18:35:25.657082+0000","last_became_peered":"2024-09-12T18:35:25.657082+0000","last_unstale":"2024-09-12T18:36:24.521343+0000","last_undegraded":"2024-09-12T18:36:24.521343+0000","last_fullsized":"2024-09-12T18:36:24.521343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:21.538633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.521398+0000","last_change":"2024-09-12T18:35:25.658763+0000","last_active":"2024-09-12T18:36:24.521398+0000","last_peered":"2024-09-12T18:36:24.521398+0000","last_clean":"2024-09-12T18:36:24.521398+0000","last_became_active":"2024-09-12T18:35:25.657508+0000","last_became_peered":"2024-09-12T18:35:25.657508+0000","last_unstale":"2024-09-12T18:36:24.521398+0000","last_undegraded":"2024-09-12T18:36:24.521398+0000","last_fullsized":"2024-09-12T18:36:24.521398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:13.170519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.521053+0000","last_change":"2024-09-12T18:35:25.653730+0000","last_active":"2024-09-12T18:36:24.521053+0000","last_peered":"2024-09-12T18:36:24.521053+0000","last_clean":"2024-09-12T18:36:24.521053+0000","last_became_active":"2024-09-12T18:35:25.651535+0000","last_became_peered":"2024-09-12T18:35:25.651535+0000","last_unstale":"2024-09-12T18:36:24.521053+0000","last_undegraded":"2024-09-12T18:36:24.521053+0000","last_fullsized":"2024-09-12T18:36:24.521053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.517243+0000","last_change":"2024-09-12T18:35:25.656513+0000","last_active":"2024-09-12T18:36:24.517243+0000","last_peered":"2024-09-12T18:36:24.517243+0000","last_clean":"2024-09-12T18:36:24.517243+0000","last_became_active":"2024-09-12T18:35:25.653440+0000","last_became_peered":"2024-09-12T18:35:25.653440+0000","last_unstale":"2024-09-12T18:36:24.517243+0000","last_undegraded":"2024-09-12T18:36:24.517243+0000","last_fullsized":"2024-09-12T18:36:24.517243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:18.693161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.537113+0000","last_change":"2024-09-12T18:35:25.657991+0000","last_active":"2024-09-12T18:36:27.537113+0000","last_peered":"2024-09-12T18:36:27.537113+0000","last_clean":"2024-09-12T18:36:27.537113+0000","last_became_active":"2024-09-12T18:35:25.653934+0000","last_became_peered":"2024-09-12T18:35:25.653934+0000","last_unstale":"2024-09-12T18:36:27.537113+0000","last_undegraded":"2024-09-12T18:36:27.537113+0000","last_fullsized":"2024-09-12T18:36:27.537113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:05.418901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.518459+0000","last_change":"2024-09-12T18:35:25.658819+0000","last_active":"2024-09-12T18:36:24.518459+0000","last_peered":"2024-09-12T18:36:24.518459+0000","last_clean":"2024-09-12T18:36:24.518459+0000","last_became_active":"2024-09-12T18:35:25.656843+0000","last_became_peered":"2024-09-12T18:35:25.656843+0000","last_unstale":"2024-09-12T18:36:24.518459+0000","last_undegraded":"2024-09-12T18:36:24.518459+0000","last_fullsized":"2024-09-12T18:36:24.518459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:55.291963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.524490+0000","last_change":"2024-09-12T18:35:25.661176+0000","last_active":"2024-09-12T18:36:24.524490+0000","last_peered":"2024-09-12T18:36:24.524490+0000","last_clean":"2024-09-12T18:36:24.524490+0000","last_became_active":"2024-09-12T18:35:25.659534+0000","last_became_peered":"2024-09-12T18:35:25.659534+0000","last_unstale":"2024-09-12T18:36:24.524490+0000","last_undegraded":"2024-09-12T18:36:24.524490+0000","last_fullsized":"2024-09-12T18:36:24.524490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:40.145442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.523335+0000","last_change":"2024-09-12T18:35:25.650632+0000","last_active":"2024-09-12T18:36:24.523335+0000","last_peered":"2024-09-12T18:36:24.523335+0000","last_clean":"2024-09-12T18:36:24.523335+0000","last_became_active":"2024-09-12T18:35:25.649333+0000","last_became_peered":"2024-09-12T18:35:25.649333+0000","last_unstale":"2024-09-12T18:36:24.523335+0000","last_undegraded":"2024-09-12T18:36:24.523335+0000","last_fullsized":"2024-09-12T18:36:24.523335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:30.537572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.536624+0000","last_change":"2024-09-12T18:35:25.648245+0000","last_active":"2024-09-12T18:36:27.536624+0000","last_peered":"2024-09-12T18:36:27.536624+0000","last_clean":"2024-09-12T18:36:27.536624+0000","last_became_active":"2024-09-12T18:35:25.646357+0000","last_became_peered":"2024-09-12T18:35:25.646357+0000","last_unstale":"2024-09-12T18:36:27.536624+0000","last_undegraded":"2024-09-12T18:36:27.536624+0000","last_fullsized":"2024-09-12T18:36:27.536624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:05.662140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.514836+0000","last_change":"2024-09-12T18:35:25.661613+0000","last_active":"2024-09-12T18:36:24.514836+0000","last_peered":"2024-09-12T18:36:24.514836+0000","last_clean":"2024-09-12T18:36:24.514836+0000","last_became_active":"2024-09-12T18:35:25.658833+0000","last_became_peered":"2024-09-12T18:35:25.658833+0000","last_unstale":"2024-09-12T18:36:24.514836+0000","last_undegraded":"2024-09-12T18:36:24.514836+0000","last_fullsized":"2024-09-12T18:36:24.514836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:51.064080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.535432+0000","last_change":"2024-09-12T18:35:25.657782+0000","last_active":"2024-09-12T18:36:27.535432+0000","last_peered":"2024-09-12T18:36:27.535432+0000","last_clean":"2024-09-12T18:36:27.535432+0000","last_became_active":"2024-09-12T18:35:25.655295+0000","last_became_peered":"2024-09-12T18:35:25.655295+0000","last_unstale":"2024-09-12T18:36:27.535432+0000","last_undegraded":"2024-09-12T18:36:27.535432+0000","last_fullsized":"2024-09-12T18:36:27.535432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:37.744175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.535455+0000","last_change":"2024-09-12T18:35:25.654863+0000","last_active":"2024-09-12T18:36:27.535455+0000","last_peered":"2024-09-12T18:36:27.535455+0000","last_clean":"2024-09-12T18:36:27.535455+0000","last_became_active":"2024-09-12T18:35:25.650407+0000","last_became_peered":"2024-09-12T18:35:25.650407+0000","last_unstale":"2024-09-12T18:36:27.535455+0000","last_undegraded":"2024-09-12T18:36:27.535455+0000","last_fullsized":"2024-09-12T18:36:27.535455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:38.395666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.516913+0000","last_change":"2024-09-12T18:35:25.662414+0000","last_active":"2024-09-12T18:36:24.516913+0000","last_peered":"2024-09-12T18:36:24.516913+0000","last_clean":"2024-09-12T18:36:24.516913+0000","last_became_active":"2024-09-12T18:35:25.660126+0000","last_became_peered":"2024-09-12T18:35:25.660126+0000","last_unstale":"2024-09-12T18:36:24.516913+0000","last_undegraded":"2024-09-12T18:36:24.516913+0000","last_fullsized":"2024-09-12T18:36:24.516913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:48.437139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.522287+0000","last_change":"2024-09-12T18:35:25.661523+0000","last_active":"2024-09-12T18:36:24.522287+0000","last_peered":"2024-09-12T18:36:24.522287+0000","last_clean":"2024-09-12T18:36:24.522287+0000","last_became_active":"2024-09-12T18:35:25.659338+0000","last_became_peered":"2024-09-12T18:35:25.659338+0000","last_unstale":"2024-09-12T18:36:24.522287+0000","last_undegraded":"2024-09-12T18:36:24.522287+0000","last_fullsized":"2024-09-12T18:36:24.522287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:37.083820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.535223+0000","last_change":"2024-09-12T18:35:25.662445+0000","last_active":"2024-09-12T18:36:27.535223+0000","last_peered":"2024-09-12T18:36:27.535223+0000","last_clean":"2024-09-12T18:36:27.535223+0000","last_became_active":"2024-09-12T18:35:25.659496+0000","last_became_peered":"2024-09-12T18:35:25.659496+0000","last_unstale":"2024-09-12T18:36:27.535223+0000","last_undegraded":"2024-09-12T18:36:27.535223+0000","last_fullsized":"2024-09-12T18:36:27.535223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:03.270420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.516591+0000","last_change":"2024-09-12T18:35:25.662519+0000","last_active":"2024-09-12T18:36:24.516591+0000","last_peered":"2024-09-12T18:36:24.516591+0000","last_clean":"2024-09-12T18:36:24.516591+0000","last_became_active":"2024-09-12T18:35:25.652964+0000","last_became_peered":"2024-09-12T18:35:25.652964+0000","last_unstale":"2024-09-12T18:36:24.516591+0000","last_undegraded":"2024-09-12T18:36:24.516591+0000","last_fullsized":"2024-09-12T18:36:24.516591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:37.923468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.536822+0000","last_change":"2024-09-12T18:35:25.650507+0000","last_active":"2024-09-12T18:36:27.536822+0000","last_peered":"2024-09-12T18:36:27.536822+0000","last_clean":"2024-09-12T18:36:27.536822+0000","last_became_active":"2024-09-12T18:35:25.649415+0000","last_became_peered":"2024-09-12T18:35:25.649415+0000","last_unstale":"2024-09-12T18:36:27.536822+0000","last_undegraded":"2024-09-12T18:36:27.536822+0000","last_fullsized":"2024-09-12T18:36:27.536822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:23.081416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.514918+0000","last_change":"2024-09-12T18:35:25.653949+0000","last_active":"2024-09-12T18:36:24.514918+0000","last_peered":"2024-09-12T18:36:24.514918+0000","last_clean":"2024-09-12T18:36:24.514918+0000","last_became_active":"2024-09-12T18:35:25.652992+0000","last_became_peered":"2024-09-12T18:35:25.652992+0000","last_unstale":"2024-09-12T18:36:24.514918+0000","last_undegraded":"2024-09-12T18:36:24.514918+0000","last_fullsized":"2024-09-12T18:36:24.514918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:47.687372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.521061+0000","last_change":"2024-09-12T18:35:25.653159+0000","last_active":"2024-09-12T18:36:24.521061+0000","last_peered":"2024-09-12T18:36:24.521061+0000","last_clean":"2024-09-12T18:36:24.521061+0000","last_became_active":"2024-09-12T18:35:25.650551+0000","last_became_peered":"2024-09-12T18:35:25.650551+0000","last_unstale":"2024-09-12T18:36:24.521061+0000","last_undegraded":"2024-09-12T18:36:24.521061+0000","last_fullsized":"2024-09-12T18:36:24.521061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:16.245302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.535127+0000","last_change":"2024-09-12T18:35:25.651877+0000","last_active":"2024-09-12T18:36:27.535127+0000","last_peered":"2024-09-12T18:36:27.535127+0000","last_clean":"2024-09-12T18:36:27.535127+0000","last_became_active":"2024-09-12T18:35:25.651055+0000","last_became_peered":"2024-09-12T18:35:25.651055+0000","last_unstale":"2024-09-12T18:36:27.535127+0000","last_undegraded":"2024-09-12T18:36:27.535127+0000","last_fullsized":"2024-09-12T18:36:27.535127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:14.200080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":61,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.523527+0000","last_change":"2024-09-12T18:35:24.657739+0000","last_active":"2024-09-12T18:36:24.523527+0000","last_peered":"2024-09-12T18:36:24.523527+0000","last_clean":"2024-09-12T18:36:24.523527+0000","last_became_active":"2024-09-12T18:35:24.656208+0000","last_became_peered":"2024-09-12T18:35:24.656208+0000","last_unstale":"2024-09-12T18:36:24.523527+0000","last_undegraded":"2024-09-12T18:36:24.523527+0000","last_fullsized":"2024-09-12T18:36:24.523527+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:50.073716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.536554+0000","last_change":"2024-09-12T18:35:25.651651+0000","last_active":"2024-09-12T18:36:27.536554+0000","last_peered":"2024-09-12T18:36:27.536554+0000","last_clean":"2024-09-12T18:36:27.536554+0000","last_became_active":"2024-09-12T18:35:25.650849+0000","last_became_peered":"2024-09-12T18:35:25.650849+0000","last_unstale":"2024-09-12T18:36:27.536554+0000","last_undegraded":"2024-09-12T18:36:27.536554+0000","last_fullsized":"2024-09-12T18:36:27.536554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:18.555827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":59,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.517443+0000","last_change":"2024-09-12T18:35:24.656119+0000","last_active":"2024-09-12T18:36:24.517443+0000","last_peered":"2024-09-12T18:36:24.517443+0000","last_clean":"2024-09-12T18:36:24.517443+0000","last_became_active":"2024-09-12T18:35:24.653175+0000","last_became_peered":"2024-09-12T18:35:24.653175+0000","last_unstale":"2024-09-12T18:36:24.517443+0000","last_undegraded":"2024-09-12T18:36:24.517443+0000","last_fullsized":"2024-09-12T18:36:24.517443+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:00.551165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.517131+0000","last_change":"2024-09-12T18:35:25.655723+0000","last_active":"2024-09-12T18:36:24.517131+0000","last_peered":"2024-09-12T18:36:24.517131+0000","last_clean":"2024-09-12T18:36:24.517131+0000","last_became_active":"2024-09-12T18:35:25.653630+0000","last_became_peered":"2024-09-12T18:35:25.653630+0000","last_unstale":"2024-09-12T18:36:24.517131+0000","last_undegraded":"2024-09-12T18:36:24.517131+0000","last_fullsized":"2024-09-12T18:36:24.517131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:07.655792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":61,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.535811+0000","last_change":"2024-09-12T18:35:24.640096+0000","last_active":"2024-09-12T18:36:27.535811+0000","last_peered":"2024-09-12T18:36:27.535811+0000","last_clean":"2024-09-12T18:36:27.535811+0000","last_became_active":"2024-09-12T18:35:24.638230+0000","last_became_peered":"2024-09-12T18:35:24.638230+0000","last_unstale":"2024-09-12T18:36:27.535811+0000","last_undegraded":"2024-09-12T18:36:27.535811+0000","last_fullsized":"2024-09-12T18:36:27.535811+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:38.435296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.516759+0000","last_change":"2024-09-12T18:35:25.662692+0000","last_active":"2024-09-12T18:36:24.516759+0000","last_peered":"2024-09-12T18:36:24.516759+0000","last_clean":"2024-09-12T18:36:24.516759+0000","last_became_active":"2024-09-12T18:35:25.661885+0000","last_became_peered":"2024-09-12T18:35:25.661885+0000","last_unstale":"2024-09-12T18:36:24.516759+0000","last_undegraded":"2024-09-12T18:36:24.516759+0000","last_fullsized":"2024-09-12T18:36:24.516759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:41.264425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":67,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.521187+0000","last_change":"2024-09-12T18:35:24.653610+0000","last_active":"2024-09-12T18:36:24.521187+0000","last_peered":"2024-09-12T18:36:24.521187+0000","last_clean":"2024-09-12T18:36:24.521187+0000","last_became_active":"2024-09-12T18:35:24.652880+0000","last_became_peered":"2024-09-12T18:35:24.652880+0000","last_unstale":"2024-09-12T18:36:24.521187+0000","last_undegraded":"2024-09-12T18:36:24.521187+0000","last_fullsized":"2024-09-12T18:36:24.521187+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:57.636251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"41'6008","reported_seq":6057,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.469947+0000","last_change":"2024-09-12T18:35:44.771794+0000","last_active":"2024-09-12T18:36:26.469947+0000","last_peered":"2024-09-12T18:36:26.469947+0000","last_clean":"2024-09-12T18:36:26.469947+0000","last_became_active":"2024-09-12T18:35:44.771286+0000","last_became_peered":"2024-09-12T18:35:44.771286+0000","last_unstale":"2024-09-12T18:36:26.469947+0000","last_undegraded":"2024-09-12T18:36:26.469947+0000","last_fullsized":"2024-09-12T18:36:26.469947+0000","mapping_epoch":21,"log_start":"30'2300","ondisk_log_start":"30'2300","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3708,"log_dups_size":0,"ondisk_log_size":3708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:10.094729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393740288,"num_objects":6008,"num_object_clones":0,"num_object_copies":12016,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6008,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6008,"num_write_kb":384512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":60,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.524064+0000","last_change":"2024-09-12T18:35:24.653465+0000","last_active":"2024-09-12T18:36:24.524064+0000","last_peered":"2024-09-12T18:36:24.524064+0000","last_clean":"2024-09-12T18:36:24.524064+0000","last_became_active":"2024-09-12T18:35:24.652792+0000","last_became_peered":"2024-09-12T18:35:24.652792+0000","last_unstale":"2024-09-12T18:36:24.524064+0000","last_undegraded":"2024-09-12T18:36:24.524064+0000","last_fullsized":"2024-09-12T18:36:24.524064+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:14.588993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.534792+0000","last_change":"2024-09-12T18:35:25.655426+0000","last_active":"2024-09-12T18:36:27.534792+0000","last_peered":"2024-09-12T18:36:27.534792+0000","last_clean":"2024-09-12T18:36:27.534792+0000","last_became_active":"2024-09-12T18:35:25.648186+0000","last_became_peered":"2024-09-12T18:35:25.648186+0000","last_unstale":"2024-09-12T18:36:27.534792+0000","last_undegraded":"2024-09-12T18:36:27.534792+0000","last_fullsized":"2024-09-12T18:36:27.534792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:48.802815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"42'6180","reported_seq":6231,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:28.494331+0000","last_change":"2024-09-12T18:35:44.767860+0000","last_active":"2024-09-12T18:36:28.494331+0000","last_peered":"2024-09-12T18:36:28.494331+0000","last_clean":"2024-09-12T18:36:28.494331+0000","last_became_active":"2024-09-12T18:35:44.766986+0000","last_became_peered":"2024-09-12T18:35:44.766986+0000","last_unstale":"2024-09-12T18:36:28.494331+0000","last_undegraded":"2024-09-12T18:36:28.494331+0000","last_fullsized":"2024-09-12T18:36:28.494331+0000","mapping_epoch":21,"log_start":"29'2200","ondisk_log_start":"29'2200","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3980,"log_dups_size":0,"ondisk_log_size":3980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:49.109157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405012480,"num_objects":6180,"num_object_clones":0,"num_object_copies":12360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6180,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6180,"num_write_kb":395520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":63,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.537236+0000","last_change":"2024-09-12T18:35:24.648439+0000","last_active":"2024-09-12T18:36:27.537236+0000","last_peered":"2024-09-12T18:36:27.537236+0000","last_clean":"2024-09-12T18:36:27.537236+0000","last_became_active":"2024-09-12T18:35:24.647629+0000","last_became_peered":"2024-09-12T18:35:24.647629+0000","last_unstale":"2024-09-12T18:36:27.537236+0000","last_undegraded":"2024-09-12T18:36:27.537236+0000","last_fullsized":"2024-09-12T18:36:27.537236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:45.428223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.535728+0000","last_change":"2024-09-12T18:35:25.652496+0000","last_active":"2024-09-12T18:36:27.535728+0000","last_peered":"2024-09-12T18:36:27.535728+0000","last_clean":"2024-09-12T18:36:27.535728+0000","last_became_active":"2024-09-12T18:35:25.651628+0000","last_became_peered":"2024-09-12T18:35:25.651628+0000","last_unstale":"2024-09-12T18:36:27.535728+0000","last_undegraded":"2024-09-12T18:36:27.535728+0000","last_fullsized":"2024-09-12T18:36:27.535728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:44.920448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"42'6468","reported_seq":6519,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:28.502669+0000","last_change":"2024-09-12T18:35:44.767175+0000","last_active":"2024-09-12T18:36:28.502669+0000","last_peered":"2024-09-12T18:36:28.502669+0000","last_clean":"2024-09-12T18:36:28.502669+0000","last_became_active":"2024-09-12T18:35:44.766592+0000","last_became_peered":"2024-09-12T18:35:44.766592+0000","last_unstale":"2024-09-12T18:36:28.502669+0000","last_undegraded":"2024-09-12T18:36:28.502669+0000","last_fullsized":"2024-09-12T18:36:28.502669+0000","mapping_epoch":21,"log_start":"30'2500","ondisk_log_start":"30'2500","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3968,"log_dups_size":0,"ondisk_log_size":3968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:44.678279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423886848,"num_objects":6468,"num_object_clones":0,"num_object_copies":12936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6468,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6468,"num_write_kb":413952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":60,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.522670+0000","last_change":"2024-09-12T18:35:24.654976+0000","last_active":"2024-09-12T18:36:24.522670+0000","last_peered":"2024-09-12T18:36:24.522670+0000","last_clean":"2024-09-12T18:36:24.522670+0000","last_became_active":"2024-09-12T18:35:24.654264+0000","last_became_peered":"2024-09-12T18:35:24.654264+0000","last_unstale":"2024-09-12T18:36:24.522670+0000","last_undegraded":"2024-09-12T18:36:24.522670+0000","last_fullsized":"2024-09-12T18:36:24.522670+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:00.115408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.521458+0000","last_change":"2024-09-12T18:35:25.650577+0000","last_active":"2024-09-12T18:36:24.521458+0000","last_peered":"2024-09-12T18:36:24.521458+0000","last_clean":"2024-09-12T18:36:24.521458+0000","last_became_active":"2024-09-12T18:35:25.649172+0000","last_became_peered":"2024-09-12T18:35:25.649172+0000","last_unstale":"2024-09-12T18:36:24.521458+0000","last_undegraded":"2024-09-12T18:36:24.521458+0000","last_fullsized":"2024-09-12T18:36:24.521458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:55.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"41'6120","reported_seq":6169,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.468130+0000","last_change":"2024-09-12T18:35:44.763067+0000","last_active":"2024-09-12T18:36:26.468130+0000","last_peered":"2024-09-12T18:36:26.468130+0000","last_clean":"2024-09-12T18:36:26.468130+0000","last_became_active":"2024-09-12T18:35:44.762584+0000","last_became_peered":"2024-09-12T18:35:44.762584+0000","last_unstale":"2024-09-12T18:36:26.468130+0000","last_undegraded":"2024-09-12T18:36:26.468130+0000","last_fullsized":"2024-09-12T18:36:26.468130+0000","mapping_epoch":21,"log_start":"30'2500","ondisk_log_start":"30'2500","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3620,"log_dups_size":0,"ondisk_log_size":3620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:47.847399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":401080320,"num_objects":6120,"num_object_clones":0,"num_object_copies":12240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6120,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6120,"num_write_kb":391680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":59,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.524702+0000","last_change":"2024-09-12T18:35:24.657665+0000","last_active":"2024-09-12T18:36:24.524702+0000","last_peered":"2024-09-12T18:36:24.524702+0000","last_clean":"2024-09-12T18:36:24.524702+0000","last_became_active":"2024-09-12T18:35:24.657015+0000","last_became_peered":"2024-09-12T18:35:24.657015+0000","last_unstale":"2024-09-12T18:36:24.524702+0000","last_undegraded":"2024-09-12T18:36:24.524702+0000","last_fullsized":"2024-09-12T18:36:24.524702+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:03.171326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.516543+0000","last_change":"2024-09-12T18:35:25.665275+0000","last_active":"2024-09-12T18:36:24.516543+0000","last_peered":"2024-09-12T18:36:24.516543+0000","last_clean":"2024-09-12T18:36:24.516543+0000","last_became_active":"2024-09-12T18:35:25.659511+0000","last_became_peered":"2024-09-12T18:35:25.659511+0000","last_unstale":"2024-09-12T18:36:24.516543+0000","last_undegraded":"2024-09-12T18:36:24.516543+0000","last_fullsized":"2024-09-12T18:36:24.516543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"42'6394","reported_seq":6445,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:28.499015+0000","last_change":"2024-09-12T18:35:44.773526+0000","last_active":"2024-09-12T18:36:28.499015+0000","last_peered":"2024-09-12T18:36:28.499015+0000","last_clean":"2024-09-12T18:36:28.499015+0000","last_became_active":"2024-09-12T18:35:44.772974+0000","last_became_peered":"2024-09-12T18:35:44.772974+0000","last_unstale":"2024-09-12T18:36:28.499015+0000","last_undegraded":"2024-09-12T18:36:28.499015+0000","last_fullsized":"2024-09-12T18:36:28.499015+0000","mapping_epoch":21,"log_start":"30'2400","ondisk_log_start":"30'2400","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3994,"log_dups_size":0,"ondisk_log_size":3994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:23.676840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":419037184,"num_objects":6394,"num_object_clones":0,"num_object_copies":12788,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6394,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6394,"num_write_kb":409216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":61,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.516687+0000","last_change":"2024-09-12T18:35:24.651913+0000","last_active":"2024-09-12T18:36:24.516687+0000","last_peered":"2024-09-12T18:36:24.516687+0000","last_clean":"2024-09-12T18:36:24.516687+0000","last_became_active":"2024-09-12T18:35:24.650421+0000","last_became_peered":"2024-09-12T18:35:24.650421+0000","last_unstale":"2024-09-12T18:36:24.516687+0000","last_undegraded":"2024-09-12T18:36:24.516687+0000","last_fullsized":"2024-09-12T18:36:24.516687+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:57.685312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.524546+0000","last_change":"2024-09-12T18:35:25.651138+0000","last_active":"2024-09-12T18:36:24.524546+0000","last_peered":"2024-09-12T18:36:24.524546+0000","last_clean":"2024-09-12T18:36:24.524546+0000","last_became_active":"2024-09-12T18:35:25.650617+0000","last_became_peered":"2024-09-12T18:35:25.650617+0000","last_unstale":"2024-09-12T18:36:24.524546+0000","last_undegraded":"2024-09-12T18:36:24.524546+0000","last_fullsized":"2024-09-12T18:36:24.524546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:58.535066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"41'6036","reported_seq":6085,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.472038+0000","last_change":"2024-09-12T18:35:44.767970+0000","last_active":"2024-09-12T18:36:26.472038+0000","last_peered":"2024-09-12T18:36:26.472038+0000","last_clean":"2024-09-12T18:36:26.472038+0000","last_became_active":"2024-09-12T18:35:44.767348+0000","last_became_peered":"2024-09-12T18:35:44.767348+0000","last_unstale":"2024-09-12T18:36:26.472038+0000","last_undegraded":"2024-09-12T18:36:26.472038+0000","last_fullsized":"2024-09-12T18:36:26.472038+0000","mapping_epoch":21,"log_start":"30'2500","ondisk_log_start":"30'2500","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3536,"log_dups_size":0,"ondisk_log_size":3536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:48.745907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395575296,"num_objects":6036,"num_object_clones":0,"num_object_copies":12072,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6036,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6036,"num_write_kb":386304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":59,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.521753+0000","last_change":"2024-09-12T18:35:24.659019+0000","last_active":"2024-09-12T18:36:24.521753+0000","last_peered":"2024-09-12T18:36:24.521753+0000","last_clean":"2024-09-12T18:36:24.521753+0000","last_became_active":"2024-09-12T18:35:24.658423+0000","last_became_peered":"2024-09-12T18:35:24.658423+0000","last_unstale":"2024-09-12T18:36:24.521753+0000","last_undegraded":"2024-09-12T18:36:24.521753+0000","last_fullsized":"2024-09-12T18:36:24.521753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:37.668417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.522432+0000","last_change":"2024-09-12T18:35:25.662287+0000","last_active":"2024-09-12T18:36:24.522432+0000","last_peered":"2024-09-12T18:36:24.522432+0000","last_clean":"2024-09-12T18:36:24.522432+0000","last_became_active":"2024-09-12T18:35:25.660372+0000","last_became_peered":"2024-09-12T18:35:25.660372+0000","last_unstale":"2024-09-12T18:36:24.522432+0000","last_undegraded":"2024-09-12T18:36:24.522432+0000","last_fullsized":"2024-09-12T18:36:24.522432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:08.729541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.f","version":"41'6053","reported_seq":6101,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.480698+0000","last_change":"2024-09-12T18:35:44.774817+0000","last_active":"2024-09-12T18:36:26.480698+0000","last_peered":"2024-09-12T18:36:26.480698+0000","last_clean":"2024-09-12T18:36:26.480698+0000","last_became_active":"2024-09-12T18:35:44.774429+0000","last_became_peered":"2024-09-12T18:35:44.774429+0000","last_unstale":"2024-09-12T18:36:26.480698+0000","last_undegraded":"2024-09-12T18:36:26.480698+0000","last_fullsized":"2024-09-12T18:36:26.480698+0000","mapping_epoch":21,"log_start":"29'2300","ondisk_log_start":"29'2300","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3753,"log_dups_size":0,"ondisk_log_size":3753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:21.579103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":396689408,"num_objects":6053,"num_object_clones":0,"num_object_copies":12106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6053,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6053,"num_write_kb":387392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":61,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.535862+0000","last_change":"2024-09-12T18:35:24.648330+0000","last_active":"2024-09-12T18:36:27.535862+0000","last_peered":"2024-09-12T18:36:27.535862+0000","last_clean":"2024-09-12T18:36:27.535862+0000","last_became_active":"2024-09-12T18:35:24.647520+0000","last_became_peered":"2024-09-12T18:35:24.647520+0000","last_unstale":"2024-09-12T18:36:27.535862+0000","last_undegraded":"2024-09-12T18:36:27.535862+0000","last_fullsized":"2024-09-12T18:36:27.535862+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:25.552055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.523624+0000","last_change":"2024-09-12T18:35:25.658674+0000","last_active":"2024-09-12T18:36:24.523624+0000","last_peered":"2024-09-12T18:36:24.523624+0000","last_clean":"2024-09-12T18:36:24.523624+0000","last_became_active":"2024-09-12T18:35:25.657386+0000","last_became_peered":"2024-09-12T18:35:25.657386+0000","last_unstale":"2024-09-12T18:36:24.523624+0000","last_undegraded":"2024-09-12T18:36:24.523624+0000","last_fullsized":"2024-09-12T18:36:24.523624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:48.037086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"42'6433","reported_seq":6484,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:28.505626+0000","last_change":"2024-09-12T18:35:44.771738+0000","last_active":"2024-09-12T18:36:28.505626+0000","last_peered":"2024-09-12T18:36:28.505626+0000","last_clean":"2024-09-12T18:36:28.505626+0000","last_became_active":"2024-09-12T18:35:44.771227+0000","last_became_peered":"2024-09-12T18:35:44.771227+0000","last_unstale":"2024-09-12T18:36:28.505626+0000","last_undegraded":"2024-09-12T18:36:28.505626+0000","last_fullsized":"2024-09-12T18:36:28.505626+0000","mapping_epoch":21,"log_start":"30'2400","ondisk_log_start":"30'2400","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":4033,"log_dups_size":0,"ondisk_log_size":4033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:27.329732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421593088,"num_objects":6433,"num_object_clones":0,"num_object_copies":12866,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6433,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6433,"num_write_kb":411712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":61,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.534921+0000","last_change":"2024-09-12T18:35:24.646810+0000","last_active":"2024-09-12T18:36:27.534921+0000","last_peered":"2024-09-12T18:36:27.534921+0000","last_clean":"2024-09-12T18:36:27.534921+0000","last_became_active":"2024-09-12T18:35:24.646008+0000","last_became_peered":"2024-09-12T18:35:24.646008+0000","last_unstale":"2024-09-12T18:36:27.534921+0000","last_undegraded":"2024-09-12T18:36:27.534921+0000","last_fullsized":"2024-09-12T18:36:27.534921+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:43.888776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.516759+0000","last_change":"2024-09-12T18:35:25.667710+0000","last_active":"2024-09-12T18:36:24.516759+0000","last_peered":"2024-09-12T18:36:24.516759+0000","last_clean":"2024-09-12T18:36:24.516759+0000","last_became_active":"2024-09-12T18:35:25.666940+0000","last_became_peered":"2024-09-12T18:35:25.666940+0000","last_unstale":"2024-09-12T18:36:24.516759+0000","last_undegraded":"2024-09-12T18:36:24.516759+0000","last_fullsized":"2024-09-12T18:36:24.516759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:09.823085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"42'6237","reported_seq":6287,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:28.484204+0000","last_change":"2024-09-12T18:35:44.769127+0000","last_active":"2024-09-12T18:36:28.484204+0000","last_peered":"2024-09-12T18:36:28.484204+0000","last_clean":"2024-09-12T18:36:28.484204+0000","last_became_active":"2024-09-12T18:35:44.768382+0000","last_became_peered":"2024-09-12T18:35:44.768382+0000","last_unstale":"2024-09-12T18:36:28.484204+0000","last_undegraded":"2024-09-12T18:36:28.484204+0000","last_fullsized":"2024-09-12T18:36:28.484204+0000","mapping_epoch":21,"log_start":"29'2200","ondisk_log_start":"29'2200","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":4037,"log_dups_size":0,"ondisk_log_size":4037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:33.385476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408748032,"num_objects":6237,"num_object_clones":0,"num_object_copies":12474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6237,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6237,"num_write_kb":399168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":209,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.521325+0000","last_change":"2024-09-12T18:35:13.489018+0000","last_active":"2024-09-12T18:36:24.521325+0000","last_peered":"2024-09-12T18:36:24.521325+0000","last_clean":"2024-09-12T18:36:24.521325+0000","last_became_active":"2024-09-12T18:35:13.488346+0000","last_became_peered":"2024-09-12T18:35:13.488346+0000","last_unstale":"2024-09-12T18:36:24.521325+0000","last_undegraded":"2024-09-12T18:36:24.521325+0000","last_fullsized":"2024-09-12T18:36:24.521325+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_clean_scrub_stamp":"2024-09-12T18:35:12.464628+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:54.864640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":73,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.523633+0000","last_change":"2024-09-12T18:35:22.459694+0000","last_active":"2024-09-12T18:36:24.523633+0000","last_peered":"2024-09-12T18:36:24.523633+0000","last_clean":"2024-09-12T18:36:24.523633+0000","last_became_active":"2024-09-12T18:35:20.446796+0000","last_became_peered":"2024-09-12T18:35:20.446796+0000","last_unstale":"2024-09-12T18:36:24.523633+0000","last_undegraded":"2024-09-12T18:36:24.523633+0000","last_fullsized":"2024-09-12T18:36:24.523633+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:21.506024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016291610000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":59,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.517560+0000","last_change":"2024-09-12T18:35:24.651749+0000","last_active":"2024-09-12T18:36:24.517560+0000","last_peered":"2024-09-12T18:36:24.517560+0000","last_clean":"2024-09-12T18:36:24.517560+0000","last_became_active":"2024-09-12T18:35:24.649860+0000","last_became_peered":"2024-09-12T18:35:24.649860+0000","last_unstale":"2024-09-12T18:36:24.517560+0000","last_undegraded":"2024-09-12T18:36:24.517560+0000","last_fullsized":"2024-09-12T18:36:24.517560+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:35.430065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.522577+0000","last_change":"2024-09-12T18:35:25.662424+0000","last_active":"2024-09-12T18:36:24.522577+0000","last_peered":"2024-09-12T18:36:24.522577+0000","last_clean":"2024-09-12T18:36:24.522577+0000","last_became_active":"2024-09-12T18:35:25.661043+0000","last_became_peered":"2024-09-12T18:35:25.661043+0000","last_unstale":"2024-09-12T18:36:24.522577+0000","last_undegraded":"2024-09-12T18:36:24.522577+0000","last_fullsized":"2024-09-12T18:36:24.522577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:52.551802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.7","version":"41'6079","reported_seq":6128,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.482342+0000","last_change":"2024-09-12T18:35:44.774505+0000","last_active":"2024-09-12T18:36:26.482342+0000","last_peered":"2024-09-12T18:36:26.482342+0000","last_clean":"2024-09-12T18:36:26.482342+0000","last_became_active":"2024-09-12T18:35:44.774259+0000","last_became_peered":"2024-09-12T18:35:44.774259+0000","last_unstale":"2024-09-12T18:36:26.482342+0000","last_undegraded":"2024-09-12T18:36:26.482342+0000","last_fullsized":"2024-09-12T18:36:26.482342+0000","mapping_epoch":21,"log_start":"30'2300","ondisk_log_start":"30'2300","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3779,"log_dups_size":0,"ondisk_log_size":3779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:21.731670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398393344,"num_objects":6079,"num_object_clones":0,"num_object_copies":12158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6079,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6079,"num_write_kb":389056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":72,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.521432+0000","last_change":"2024-09-12T18:35:22.459090+0000","last_active":"2024-09-12T18:36:24.521432+0000","last_peered":"2024-09-12T18:36:24.521432+0000","last_clean":"2024-09-12T18:36:24.521432+0000","last_became_active":"2024-09-12T18:35:20.448553+0000","last_became_peered":"2024-09-12T18:35:20.448553+0000","last_unstale":"2024-09-12T18:36:24.521432+0000","last_undegraded":"2024-09-12T18:36:24.521432+0000","last_fullsized":"2024-09-12T18:36:24.521432+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:56.834808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001030836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":59,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.515156+0000","last_change":"2024-09-12T18:35:24.651597+0000","last_active":"2024-09-12T18:36:24.515156+0000","last_peered":"2024-09-12T18:36:24.515156+0000","last_clean":"2024-09-12T18:36:24.515156+0000","last_became_active":"2024-09-12T18:35:24.649940+0000","last_became_peered":"2024-09-12T18:35:24.649940+0000","last_unstale":"2024-09-12T18:36:24.515156+0000","last_undegraded":"2024-09-12T18:36:24.515156+0000","last_fullsized":"2024-09-12T18:36:24.515156+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:36.822432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.537185+0000","last_change":"2024-09-12T18:35:25.660529+0000","last_active":"2024-09-12T18:36:27.537185+0000","last_peered":"2024-09-12T18:36:27.537185+0000","last_clean":"2024-09-12T18:36:27.537185+0000","last_became_active":"2024-09-12T18:35:25.659537+0000","last_became_peered":"2024-09-12T18:35:25.659537+0000","last_unstale":"2024-09-12T18:36:27.537185+0000","last_undegraded":"2024-09-12T18:36:27.537185+0000","last_fullsized":"2024-09-12T18:36:27.537185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:51.790349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"41'6120","reported_seq":6168,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.475598+0000","last_change":"2024-09-12T18:35:44.770379+0000","last_active":"2024-09-12T18:36:26.475598+0000","last_peered":"2024-09-12T18:36:26.475598+0000","last_clean":"2024-09-12T18:36:26.475598+0000","last_became_active":"2024-09-12T18:35:44.769739+0000","last_became_peered":"2024-09-12T18:35:44.769739+0000","last_unstale":"2024-09-12T18:36:26.475598+0000","last_undegraded":"2024-09-12T18:36:26.475598+0000","last_fullsized":"2024-09-12T18:36:26.475598+0000","mapping_epoch":21,"log_start":"30'2500","ondisk_log_start":"30'2500","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3620,"log_dups_size":0,"ondisk_log_size":3620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:02:23.077263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":401080320,"num_objects":6120,"num_object_clones":0,"num_object_copies":12240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6120,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6120,"num_write_kb":391680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":72,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.515224+0000","last_change":"2024-09-12T18:35:22.464179+0000","last_active":"2024-09-12T18:36:24.515224+0000","last_peered":"2024-09-12T18:36:24.515224+0000","last_clean":"2024-09-12T18:36:24.515224+0000","last_became_active":"2024-09-12T18:35:20.442613+0000","last_became_peered":"2024-09-12T18:35:20.442613+0000","last_unstale":"2024-09-12T18:36:24.515224+0000","last_undegraded":"2024-09-12T18:36:24.515224+0000","last_fullsized":"2024-09-12T18:36:24.515224+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:17.636537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014134620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":61,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.535238+0000","last_change":"2024-09-12T18:35:24.641297+0000","last_active":"2024-09-12T18:36:27.535238+0000","last_peered":"2024-09-12T18:36:27.535238+0000","last_clean":"2024-09-12T18:36:27.535238+0000","last_became_active":"2024-09-12T18:35:24.637334+0000","last_became_peered":"2024-09-12T18:35:24.637334+0000","last_unstale":"2024-09-12T18:36:27.535238+0000","last_undegraded":"2024-09-12T18:36:27.535238+0000","last_fullsized":"2024-09-12T18:36:27.535238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:50.772074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.516864+0000","last_change":"2024-09-12T18:35:25.659209+0000","last_active":"2024-09-12T18:36:24.516864+0000","last_peered":"2024-09-12T18:36:24.516864+0000","last_clean":"2024-09-12T18:36:24.516864+0000","last_became_active":"2024-09-12T18:35:25.656170+0000","last_became_peered":"2024-09-12T18:35:25.656170+0000","last_unstale":"2024-09-12T18:36:24.516864+0000","last_undegraded":"2024-09-12T18:36:24.516864+0000","last_fullsized":"2024-09-12T18:36:24.516864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:40.925757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"41'6126","reported_seq":6175,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.478244+0000","last_change":"2024-09-12T18:35:44.770358+0000","last_active":"2024-09-12T18:36:26.478244+0000","last_peered":"2024-09-12T18:36:26.478244+0000","last_clean":"2024-09-12T18:36:26.478244+0000","last_became_active":"2024-09-12T18:35:44.769786+0000","last_became_peered":"2024-09-12T18:35:44.769786+0000","last_unstale":"2024-09-12T18:36:26.478244+0000","last_undegraded":"2024-09-12T18:36:26.478244+0000","last_fullsized":"2024-09-12T18:36:26.478244+0000","mapping_epoch":21,"log_start":"30'2500","ondisk_log_start":"30'2500","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3626,"log_dups_size":0,"ondisk_log_size":3626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:27.215502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":401473536,"num_objects":6126,"num_object_clones":0,"num_object_copies":12252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6126,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6126,"num_write_kb":392064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":74,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.521845+0000","last_change":"2024-09-12T18:35:22.459049+0000","last_active":"2024-09-12T18:36:24.521845+0000","last_peered":"2024-09-12T18:36:24.521845+0000","last_clean":"2024-09-12T18:36:24.521845+0000","last_became_active":"2024-09-12T18:35:20.446814+0000","last_became_peered":"2024-09-12T18:35:20.446814+0000","last_unstale":"2024-09-12T18:36:24.521845+0000","last_undegraded":"2024-09-12T18:36:24.521845+0000","last_fullsized":"2024-09-12T18:36:24.521845+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:18.033595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010716149999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":59,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.523581+0000","last_change":"2024-09-12T18:35:24.658273+0000","last_active":"2024-09-12T18:36:24.523581+0000","last_peered":"2024-09-12T18:36:24.523581+0000","last_clean":"2024-09-12T18:36:24.523581+0000","last_became_active":"2024-09-12T18:35:24.657433+0000","last_became_peered":"2024-09-12T18:35:24.657433+0000","last_unstale":"2024-09-12T18:36:24.523581+0000","last_undegraded":"2024-09-12T18:36:24.523581+0000","last_fullsized":"2024-09-12T18:36:24.523581+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:48.497218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.518554+0000","last_change":"2024-09-12T18:35:25.655830+0000","last_active":"2024-09-12T18:36:24.518554+0000","last_peered":"2024-09-12T18:36:24.518554+0000","last_clean":"2024-09-12T18:36:24.518554+0000","last_became_active":"2024-09-12T18:35:25.652126+0000","last_became_peered":"2024-09-12T18:35:25.652126+0000","last_unstale":"2024-09-12T18:36:24.518554+0000","last_undegraded":"2024-09-12T18:36:24.518554+0000","last_fullsized":"2024-09-12T18:36:24.518554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:04.080721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"41'5998","reported_seq":6047,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.466644+0000","last_change":"2024-09-12T18:35:44.770799+0000","last_active":"2024-09-12T18:36:26.466644+0000","last_peered":"2024-09-12T18:36:26.466644+0000","last_clean":"2024-09-12T18:36:26.466644+0000","last_became_active":"2024-09-12T18:35:44.770030+0000","last_became_peered":"2024-09-12T18:35:44.770030+0000","last_unstale":"2024-09-12T18:36:26.466644+0000","last_undegraded":"2024-09-12T18:36:26.466644+0000","last_fullsized":"2024-09-12T18:36:26.466644+0000","mapping_epoch":21,"log_start":"30'2400","ondisk_log_start":"30'2400","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3598,"log_dups_size":0,"ondisk_log_size":3598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:24.786452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393084928,"num_objects":5998,"num_object_clones":0,"num_object_copies":11996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5998,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5998,"num_write_kb":383872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":59,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.522778+0000","last_change":"2024-09-12T18:35:24.657618+0000","last_active":"2024-09-12T18:36:24.522778+0000","last_peered":"2024-09-12T18:36:24.522778+0000","last_clean":"2024-09-12T18:36:24.522778+0000","last_became_active":"2024-09-12T18:35:24.656741+0000","last_became_peered":"2024-09-12T18:35:24.656741+0000","last_unstale":"2024-09-12T18:36:24.522778+0000","last_undegraded":"2024-09-12T18:36:24.522778+0000","last_fullsized":"2024-09-12T18:36:24.522778+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:43.113104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":72,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.518698+0000","last_change":"2024-09-12T18:35:22.464180+0000","last_active":"2024-09-12T18:36:24.518698+0000","last_peered":"2024-09-12T18:36:24.518698+0000","last_clean":"2024-09-12T18:36:24.518698+0000","last_became_active":"2024-09-12T18:35:20.442566+0000","last_became_peered":"2024-09-12T18:35:20.442566+0000","last_unstale":"2024-09-12T18:36:24.518698+0000","last_undegraded":"2024-09-12T18:36:24.518698+0000","last_fullsized":"2024-09-12T18:36:24.518698+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:29.021710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001325786,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.536728+0000","last_change":"2024-09-12T18:35:25.650458+0000","last_active":"2024-09-12T18:36:27.536728+0000","last_peered":"2024-09-12T18:36:27.536728+0000","last_clean":"2024-09-12T18:36:27.536728+0000","last_became_active":"2024-09-12T18:35:25.648761+0000","last_became_peered":"2024-09-12T18:35:25.648761+0000","last_unstale":"2024-09-12T18:36:27.536728+0000","last_undegraded":"2024-09-12T18:36:27.536728+0000","last_fullsized":"2024-09-12T18:36:27.536728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:53.026950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"41'6011","reported_seq":6060,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.462105+0000","last_change":"2024-09-12T18:35:44.773801+0000","last_active":"2024-09-12T18:36:26.462105+0000","last_peered":"2024-09-12T18:36:26.462105+0000","last_clean":"2024-09-12T18:36:26.462105+0000","last_became_active":"2024-09-12T18:35:44.772787+0000","last_became_peered":"2024-09-12T18:35:44.772787+0000","last_unstale":"2024-09-12T18:36:26.462105+0000","last_undegraded":"2024-09-12T18:36:26.462105+0000","last_fullsized":"2024-09-12T18:36:26.462105+0000","mapping_epoch":21,"log_start":"30'2300","ondisk_log_start":"30'2300","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3711,"log_dups_size":0,"ondisk_log_size":3711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:13.758208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393936896,"num_objects":6011,"num_object_clones":0,"num_object_copies":12022,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6011,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6011,"num_write_kb":384704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":59,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.518637+0000","last_change":"2024-09-12T18:35:24.649669+0000","last_active":"2024-09-12T18:36:24.518637+0000","last_peered":"2024-09-12T18:36:24.518637+0000","last_clean":"2024-09-12T18:36:24.518637+0000","last_became_active":"2024-09-12T18:35:24.648881+0000","last_became_peered":"2024-09-12T18:35:24.648881+0000","last_unstale":"2024-09-12T18:36:24.518637+0000","last_undegraded":"2024-09-12T18:36:24.518637+0000","last_fullsized":"2024-09-12T18:36:24.518637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:23.614734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":74,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.536821+0000","last_change":"2024-09-12T18:35:22.458666+0000","last_active":"2024-09-12T18:36:27.536821+0000","last_peered":"2024-09-12T18:36:27.536821+0000","last_clean":"2024-09-12T18:36:27.536821+0000","last_became_active":"2024-09-12T18:35:20.442394+0000","last_became_peered":"2024-09-12T18:35:20.442394+0000","last_unstale":"2024-09-12T18:36:27.536821+0000","last_undegraded":"2024-09-12T18:36:27.536821+0000","last_fullsized":"2024-09-12T18:36:27.536821+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:51.840246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080163599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.539243+0000","last_change":"2024-09-12T18:35:25.650717+0000","last_active":"2024-09-12T18:36:27.539243+0000","last_peered":"2024-09-12T18:36:27.539243+0000","last_clean":"2024-09-12T18:36:27.539243+0000","last_became_active":"2024-09-12T18:35:25.649147+0000","last_became_peered":"2024-09-12T18:35:25.649147+0000","last_unstale":"2024-09-12T18:36:27.539243+0000","last_undegraded":"2024-09-12T18:36:27.539243+0000","last_fullsized":"2024-09-12T18:36:27.539243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:07.365888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"41'6045","reported_seq":6094,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.459288+0000","last_change":"2024-09-12T18:35:44.774031+0000","last_active":"2024-09-12T18:36:26.459288+0000","last_peered":"2024-09-12T18:36:26.459288+0000","last_clean":"2024-09-12T18:36:26.459288+0000","last_became_active":"2024-09-12T18:35:44.772874+0000","last_became_peered":"2024-09-12T18:35:44.772874+0000","last_unstale":"2024-09-12T18:36:26.459288+0000","last_undegraded":"2024-09-12T18:36:26.459288+0000","last_fullsized":"2024-09-12T18:36:26.459288+0000","mapping_epoch":21,"log_start":"30'2300","ondisk_log_start":"30'2300","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3745,"log_dups_size":0,"ondisk_log_size":3745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:27.897491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":396165120,"num_objects":6045,"num_object_clones":0,"num_object_copies":12090,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6045,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6045,"num_write_kb":386880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":61,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.517321+0000","last_change":"2024-09-12T18:35:24.657234+0000","last_active":"2024-09-12T18:36:24.517321+0000","last_peered":"2024-09-12T18:36:24.517321+0000","last_clean":"2024-09-12T18:36:24.517321+0000","last_became_active":"2024-09-12T18:35:24.655950+0000","last_became_peered":"2024-09-12T18:35:24.655950+0000","last_unstale":"2024-09-12T18:36:24.517321+0000","last_undegraded":"2024-09-12T18:36:24.517321+0000","last_fullsized":"2024-09-12T18:36:24.517321+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:17.466623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":72,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.517208+0000","last_change":"2024-09-12T18:35:22.464656+0000","last_active":"2024-09-12T18:36:24.517208+0000","last_peered":"2024-09-12T18:36:24.517208+0000","last_clean":"2024-09-12T18:36:24.517208+0000","last_became_active":"2024-09-12T18:35:20.445470+0000","last_became_peered":"2024-09-12T18:35:20.445470+0000","last_unstale":"2024-09-12T18:36:24.517208+0000","last_undegraded":"2024-09-12T18:36:24.517208+0000","last_fullsized":"2024-09-12T18:36:24.517208+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:58.947359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001742681,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.514935+0000","last_change":"2024-09-12T18:35:25.658887+0000","last_active":"2024-09-12T18:36:24.514935+0000","last_peered":"2024-09-12T18:36:24.514935+0000","last_clean":"2024-09-12T18:36:24.514935+0000","last_became_active":"2024-09-12T18:35:25.656829+0000","last_became_peered":"2024-09-12T18:35:25.656829+0000","last_unstale":"2024-09-12T18:36:24.514935+0000","last_undegraded":"2024-09-12T18:36:24.514935+0000","last_fullsized":"2024-09-12T18:36:24.514935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:50.109858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"42'6435","reported_seq":6486,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:28.469139+0000","last_change":"2024-09-12T18:35:44.767276+0000","last_active":"2024-09-12T18:36:28.469139+0000","last_peered":"2024-09-12T18:36:28.469139+0000","last_clean":"2024-09-12T18:36:28.469139+0000","last_became_active":"2024-09-12T18:35:44.766145+0000","last_became_peered":"2024-09-12T18:35:44.766145+0000","last_unstale":"2024-09-12T18:36:28.469139+0000","last_undegraded":"2024-09-12T18:36:28.469139+0000","last_fullsized":"2024-09-12T18:36:28.469139+0000","mapping_epoch":21,"log_start":"30'2400","ondisk_log_start":"30'2400","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":4035,"log_dups_size":0,"ondisk_log_size":4035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:47.423493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421724160,"num_objects":6435,"num_object_clones":0,"num_object_copies":12870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6435,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6435,"num_write_kb":411840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":60,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.517165+0000","last_change":"2024-09-12T18:35:24.654518+0000","last_active":"2024-09-12T18:36:24.517165+0000","last_peered":"2024-09-12T18:36:24.517165+0000","last_clean":"2024-09-12T18:36:24.517165+0000","last_became_active":"2024-09-12T18:35:24.650309+0000","last_became_peered":"2024-09-12T18:35:24.650309+0000","last_unstale":"2024-09-12T18:36:24.517165+0000","last_undegraded":"2024-09-12T18:36:24.517165+0000","last_fullsized":"2024-09-12T18:36:24.517165+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:16.669035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":72,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.524161+0000","last_change":"2024-09-12T18:35:22.459767+0000","last_active":"2024-09-12T18:36:24.524161+0000","last_peered":"2024-09-12T18:36:24.524161+0000","last_clean":"2024-09-12T18:36:24.524161+0000","last_became_active":"2024-09-12T18:35:20.448521+0000","last_became_peered":"2024-09-12T18:35:20.448521+0000","last_unstale":"2024-09-12T18:36:24.524161+0000","last_undegraded":"2024-09-12T18:36:24.524161+0000","last_fullsized":"2024-09-12T18:36:24.524161+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:33.463792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017009670000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.535777+0000","last_change":"2024-09-12T18:35:25.648150+0000","last_active":"2024-09-12T18:36:27.535777+0000","last_peered":"2024-09-12T18:36:27.535777+0000","last_clean":"2024-09-12T18:36:27.535777+0000","last_became_active":"2024-09-12T18:35:25.647347+0000","last_became_peered":"2024-09-12T18:35:25.647347+0000","last_unstale":"2024-09-12T18:36:27.535777+0000","last_undegraded":"2024-09-12T18:36:27.535777+0000","last_fullsized":"2024-09-12T18:36:27.535777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:48.968336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.523433+0000","last_change":"2024-09-12T18:35:25.660696+0000","last_active":"2024-09-12T18:36:24.523433+0000","last_peered":"2024-09-12T18:36:24.523433+0000","last_clean":"2024-09-12T18:36:24.523433+0000","last_became_active":"2024-09-12T18:35:25.659827+0000","last_became_peered":"2024-09-12T18:35:25.659827+0000","last_unstale":"2024-09-12T18:36:24.523433+0000","last_undegraded":"2024-09-12T18:36:24.523433+0000","last_fullsized":"2024-09-12T18:36:24.523433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:15.678289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":65,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.524639+0000","last_change":"2024-09-12T18:35:24.655051+0000","last_active":"2024-09-12T18:36:24.524639+0000","last_peered":"2024-09-12T18:36:24.524639+0000","last_clean":"2024-09-12T18:36:24.524639+0000","last_became_active":"2024-09-12T18:35:24.654282+0000","last_became_peered":"2024-09-12T18:35:24.654282+0000","last_unstale":"2024-09-12T18:36:24.524639+0000","last_undegraded":"2024-09-12T18:36:24.524639+0000","last_fullsized":"2024-09-12T18:36:24.524639+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:08.159799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.517325+0000","last_change":"2024-09-12T18:35:25.659237+0000","last_active":"2024-09-12T18:36:24.517325+0000","last_peered":"2024-09-12T18:36:24.517325+0000","last_clean":"2024-09-12T18:36:24.517325+0000","last_became_active":"2024-09-12T18:35:25.658423+0000","last_became_peered":"2024-09-12T18:35:25.658423+0000","last_unstale":"2024-09-12T18:36:24.517325+0000","last_undegraded":"2024-09-12T18:36:24.517325+0000","last_fullsized":"2024-09-12T18:36:24.517325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:42.956934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":64,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.536693+0000","last_change":"2024-09-12T18:35:24.648658+0000","last_active":"2024-09-12T18:36:27.536693+0000","last_peered":"2024-09-12T18:36:27.536693+0000","last_clean":"2024-09-12T18:36:27.536693+0000","last_became_active":"2024-09-12T18:35:24.647826+0000","last_became_peered":"2024-09-12T18:35:24.647826+0000","last_unstale":"2024-09-12T18:36:27.536693+0000","last_undegraded":"2024-09-12T18:36:27.536693+0000","last_fullsized":"2024-09-12T18:36:27.536693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:24.167549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":59,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.523729+0000","last_change":"2024-09-12T18:35:24.656855+0000","last_active":"2024-09-12T18:36:24.523729+0000","last_peered":"2024-09-12T18:36:24.523729+0000","last_clean":"2024-09-12T18:36:24.523729+0000","last_became_active":"2024-09-12T18:35:24.655935+0000","last_became_peered":"2024-09-12T18:35:24.655935+0000","last_unstale":"2024-09-12T18:36:24.523729+0000","last_undegraded":"2024-09-12T18:36:24.523729+0000","last_fullsized":"2024-09-12T18:36:24.523729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:35.430065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.514991+0000","last_change":"2024-09-12T18:35:25.661801+0000","last_active":"2024-09-12T18:36:24.514991+0000","last_peered":"2024-09-12T18:36:24.514991+0000","last_clean":"2024-09-12T18:36:24.514991+0000","last_became_active":"2024-09-12T18:35:25.658476+0000","last_became_peered":"2024-09-12T18:35:25.658476+0000","last_unstale":"2024-09-12T18:36:24.514991+0000","last_undegraded":"2024-09-12T18:36:24.514991+0000","last_fullsized":"2024-09-12T18:36:24.514991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:58.246449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":59,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.517169+0000","last_change":"2024-09-12T18:35:24.652399+0000","last_active":"2024-09-12T18:36:24.517169+0000","last_peered":"2024-09-12T18:36:24.517169+0000","last_clean":"2024-09-12T18:36:24.517169+0000","last_became_active":"2024-09-12T18:35:24.651416+0000","last_became_peered":"2024-09-12T18:35:24.651416+0000","last_unstale":"2024-09-12T18:36:24.517169+0000","last_undegraded":"2024-09-12T18:36:24.517169+0000","last_fullsized":"2024-09-12T18:36:24.517169+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:32.594978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.514862+0000","last_change":"2024-09-12T18:35:25.658570+0000","last_active":"2024-09-12T18:36:24.514862+0000","last_peered":"2024-09-12T18:36:24.514862+0000","last_clean":"2024-09-12T18:36:24.514862+0000","last_became_active":"2024-09-12T18:35:25.656561+0000","last_became_peered":"2024-09-12T18:35:25.656561+0000","last_unstale":"2024-09-12T18:36:24.514862+0000","last_undegraded":"2024-09-12T18:36:24.514862+0000","last_fullsized":"2024-09-12T18:36:24.514862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:22.225756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.535528+0000","last_change":"2024-09-12T18:35:25.651217+0000","last_active":"2024-09-12T18:36:27.535528+0000","last_peered":"2024-09-12T18:36:27.535528+0000","last_clean":"2024-09-12T18:36:27.535528+0000","last_became_active":"2024-09-12T18:35:25.649544+0000","last_became_peered":"2024-09-12T18:35:25.649544+0000","last_unstale":"2024-09-12T18:36:27.535528+0000","last_undegraded":"2024-09-12T18:36:27.535528+0000","last_fullsized":"2024-09-12T18:36:27.535528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:41.601376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":59,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.515054+0000","last_change":"2024-09-12T18:35:24.657489+0000","last_active":"2024-09-12T18:36:24.515054+0000","last_peered":"2024-09-12T18:36:24.515054+0000","last_clean":"2024-09-12T18:36:24.515054+0000","last_became_active":"2024-09-12T18:35:24.656030+0000","last_became_peered":"2024-09-12T18:35:24.656030+0000","last_unstale":"2024-09-12T18:36:24.515054+0000","last_undegraded":"2024-09-12T18:36:24.515054+0000","last_fullsized":"2024-09-12T18:36:24.515054+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:11.362759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.516838+0000","last_change":"2024-09-12T18:35:25.661544+0000","last_active":"2024-09-12T18:36:24.516838+0000","last_peered":"2024-09-12T18:36:24.516838+0000","last_clean":"2024-09-12T18:36:24.516838+0000","last_became_active":"2024-09-12T18:35:25.656985+0000","last_became_peered":"2024-09-12T18:35:25.656985+0000","last_unstale":"2024-09-12T18:36:24.516838+0000","last_undegraded":"2024-09-12T18:36:24.516838+0000","last_fullsized":"2024-09-12T18:36:24.516838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":59,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.515112+0000","last_change":"2024-09-12T18:35:24.646342+0000","last_active":"2024-09-12T18:36:24.515112+0000","last_peered":"2024-09-12T18:36:24.515112+0000","last_clean":"2024-09-12T18:36:24.515112+0000","last_became_active":"2024-09-12T18:35:24.644773+0000","last_became_peered":"2024-09-12T18:35:24.644773+0000","last_unstale":"2024-09-12T18:36:24.515112+0000","last_undegraded":"2024-09-12T18:36:24.515112+0000","last_fullsized":"2024-09-12T18:36:24.515112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:17.011231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.536454+0000","last_change":"2024-09-12T18:35:25.656712+0000","last_active":"2024-09-12T18:36:27.536454+0000","last_peered":"2024-09-12T18:36:27.536454+0000","last_clean":"2024-09-12T18:36:27.536454+0000","last_became_active":"2024-09-12T18:35:25.654473+0000","last_became_peered":"2024-09-12T18:35:25.654473+0000","last_unstale":"2024-09-12T18:36:27.536454+0000","last_undegraded":"2024-09-12T18:36:27.536454+0000","last_fullsized":"2024-09-12T18:36:27.536454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:01.464680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":62,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.536923+0000","last_change":"2024-09-12T18:35:24.659935+0000","last_active":"2024-09-12T18:36:27.536923+0000","last_peered":"2024-09-12T18:36:27.536923+0000","last_clean":"2024-09-12T18:36:27.536923+0000","last_became_active":"2024-09-12T18:35:24.659111+0000","last_became_peered":"2024-09-12T18:35:24.659111+0000","last_unstale":"2024-09-12T18:36:27.536923+0000","last_undegraded":"2024-09-12T18:36:27.536923+0000","last_fullsized":"2024-09-12T18:36:27.536923+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:11.480154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.535030+0000","last_change":"2024-09-12T18:35:25.660557+0000","last_active":"2024-09-12T18:36:27.535030+0000","last_peered":"2024-09-12T18:36:27.535030+0000","last_clean":"2024-09-12T18:36:27.535030+0000","last_became_active":"2024-09-12T18:35:25.652300+0000","last_became_peered":"2024-09-12T18:35:25.652300+0000","last_unstale":"2024-09-12T18:36:27.535030+0000","last_undegraded":"2024-09-12T18:36:27.535030+0000","last_fullsized":"2024-09-12T18:36:27.535030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:10:59.995841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":62,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.539341+0000","last_change":"2024-09-12T18:35:24.638538+0000","last_active":"2024-09-12T18:36:27.539341+0000","last_peered":"2024-09-12T18:36:27.539341+0000","last_clean":"2024-09-12T18:36:27.539341+0000","last_became_active":"2024-09-12T18:35:24.637242+0000","last_became_peered":"2024-09-12T18:35:24.637242+0000","last_unstale":"2024-09-12T18:36:27.539341+0000","last_undegraded":"2024-09-12T18:36:27.539341+0000","last_fullsized":"2024-09-12T18:36:27.539341+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:26.877441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.523405+0000","last_change":"2024-09-12T18:35:25.662537+0000","last_active":"2024-09-12T18:36:24.523405+0000","last_peered":"2024-09-12T18:36:24.523405+0000","last_clean":"2024-09-12T18:36:24.523405+0000","last_became_active":"2024-09-12T18:35:25.661441+0000","last_became_peered":"2024-09-12T18:35:25.661441+0000","last_unstale":"2024-09-12T18:36:24.523405+0000","last_undegraded":"2024-09-12T18:36:24.523405+0000","last_fullsized":"2024-09-12T18:36:24.523405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:14.397867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":61,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.524609+0000","last_change":"2024-09-12T18:35:24.657635+0000","last_active":"2024-09-12T18:36:24.524609+0000","last_peered":"2024-09-12T18:36:24.524609+0000","last_clean":"2024-09-12T18:36:24.524609+0000","last_became_active":"2024-09-12T18:35:24.655992+0000","last_became_peered":"2024-09-12T18:35:24.655992+0000","last_unstale":"2024-09-12T18:36:24.524609+0000","last_undegraded":"2024-09-12T18:36:24.524609+0000","last_fullsized":"2024-09-12T18:36:24.524609+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:33.536755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.521657+0000","last_change":"2024-09-12T18:35:25.651406+0000","last_active":"2024-09-12T18:36:24.521657+0000","last_peered":"2024-09-12T18:36:24.521657+0000","last_clean":"2024-09-12T18:36:24.521657+0000","last_became_active":"2024-09-12T18:35:25.649728+0000","last_became_peered":"2024-09-12T18:35:25.649728+0000","last_unstale":"2024-09-12T18:36:24.521657+0000","last_undegraded":"2024-09-12T18:36:24.521657+0000","last_fullsized":"2024-09-12T18:36:24.521657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:41.773283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":63,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.536583+0000","last_change":"2024-09-12T18:35:24.649153+0000","last_active":"2024-09-12T18:36:27.536583+0000","last_peered":"2024-09-12T18:36:27.536583+0000","last_clean":"2024-09-12T18:36:27.536583+0000","last_became_active":"2024-09-12T18:35:24.648512+0000","last_became_peered":"2024-09-12T18:35:24.648512+0000","last_unstale":"2024-09-12T18:36:27.536583+0000","last_undegraded":"2024-09-12T18:36:27.536583+0000","last_fullsized":"2024-09-12T18:36:27.536583+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:07.810456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.535888+0000","last_change":"2024-09-12T18:35:25.656799+0000","last_active":"2024-09-12T18:36:27.535888+0000","last_peered":"2024-09-12T18:36:27.535888+0000","last_clean":"2024-09-12T18:36:27.535888+0000","last_became_active":"2024-09-12T18:35:25.654980+0000","last_became_peered":"2024-09-12T18:35:25.654980+0000","last_unstale":"2024-09-12T18:36:27.535888+0000","last_undegraded":"2024-09-12T18:36:27.535888+0000","last_fullsized":"2024-09-12T18:36:27.535888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:10.735439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":60,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.517060+0000","last_change":"2024-09-12T18:35:24.656268+0000","last_active":"2024-09-12T18:36:24.517060+0000","last_peered":"2024-09-12T18:36:24.517060+0000","last_clean":"2024-09-12T18:36:24.517060+0000","last_became_active":"2024-09-12T18:35:24.655420+0000","last_became_peered":"2024-09-12T18:35:24.655420+0000","last_unstale":"2024-09-12T18:36:24.517060+0000","last_undegraded":"2024-09-12T18:36:24.517060+0000","last_fullsized":"2024-09-12T18:36:24.517060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:04.654666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.521208+0000","last_change":"2024-09-12T18:35:25.661042+0000","last_active":"2024-09-12T18:36:24.521208+0000","last_peered":"2024-09-12T18:36:24.521208+0000","last_clean":"2024-09-12T18:36:24.521208+0000","last_became_active":"2024-09-12T18:35:25.660163+0000","last_became_peered":"2024-09-12T18:35:25.660163+0000","last_unstale":"2024-09-12T18:36:24.521208+0000","last_undegraded":"2024-09-12T18:36:24.521208+0000","last_fullsized":"2024-09-12T18:36:24.521208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:37.682184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":63,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.517028+0000","last_change":"2024-09-12T18:35:24.652304+0000","last_active":"2024-09-12T18:36:24.517028+0000","last_peered":"2024-09-12T18:36:24.517028+0000","last_clean":"2024-09-12T18:36:24.517028+0000","last_became_active":"2024-09-12T18:35:24.651460+0000","last_became_peered":"2024-09-12T18:35:24.651460+0000","last_unstale":"2024-09-12T18:36:24.517028+0000","last_undegraded":"2024-09-12T18:36:24.517028+0000","last_fullsized":"2024-09-12T18:36:24.517028+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:42.050557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":6471221248,"num_objects":98743,"num_object_clones":0,"num_object_copies":197486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98743,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98743,"num_write_kb":6319552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":805425152,"data_stored":12886802432,"data_compressed":611932859,"data_compressed_allocated":805425152,"data_compressed_original":12886802432,"omap_allocated":0,"internal_metadata":0},"log_size":60743,"ondisk_log_size":60743,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705682,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310092,"kb_used_data":224752,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94061748,"statfs":{"total":96636764160,"available":96319229952,"internally_reserved":0,"allocated":230146048,"data_stored":3674574602,"data_compressed":174486602,"data_compressed_allocated":229658624,"data_compressed_original":3674390528,"omap_allocated":1594,"internal_metadata":87357894},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,0,5,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738386,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":341108,"kb_used_data":237728,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94030732,"statfs":{"total":96636764160,"available":96287469568,"internally_reserved":0,"allocated":243433472,"data_stored":3887169444,"data_compressed":184581843,"data_compressed_allocated":242946048,"data_compressed_original":3886989312,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738386,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":444980,"kb_used_data":315232,"kb_used_omap":1,"kb_used_meta":129726,"kb_avail":93926860,"statfs":{"total":96636764160,"available":96181104640,"internally_reserved":0,"allocated":322797568,"data_stored":5157844610,"data_compressed":244913483,"data_compressed_allocated":322355200,"data_compressed_original":5157683200,"omap_allocated":1594,"internal_metadata":132839878},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,6,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":323432448,"data_stored":5174919168,"data_compressed":245731939,"data_compressed_allocated":323432448,"data_compressed_original":5174919168,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":233857024,"data_stored":3741712384,"data_compressed":177676663,"data_compressed_allocated":233857024,"data_compressed_original":3741712384,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":248135680,"data_stored":3970170880,"data_compressed":188524257,"data_compressed_allocated":248135680,"data_compressed_original":3970170880,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:36:31.019 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:36:31.029 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:31.027+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:31.130 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:31.123+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:31.186 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:31.186 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-09-12T18:36:31.186 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-09-12T18:36:31.186 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:36:31.187 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.187 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:31.187 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:31.187 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 65.550559136000004, 2024-09-12T18:36:31.187 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025088781000000001, 2024-09-12T18:36:31.187 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:31.187 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:31.187 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:31.187 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:31.187 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.187 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:31.187 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:31.187 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:31.188 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.188 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.188 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:31.188 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:31.188 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:31.188 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.188 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.188 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:31.188 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632518+0000", 2024-09-12T18:36:31.188 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:36:31.188 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.188 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.188 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:31.189 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632533+0000", 2024-09-12T18:36:31.189 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5130000000000001e-05 2024-09-12T18:36:31.189 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.189 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.189 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:31.189 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632564+0000", 2024-09-12T18:36:31.189 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0788999999999999e-05 2024-09-12T18:36:31.189 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.189 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.189 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.189 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632590+0000", 2024-09-12T18:36:31.189 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6057000000000001e-05 2024-09-12T18:36:31.189 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.189 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.190 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:31.190 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.635931+0000", 2024-09-12T18:36:31.190 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033411320000000001 2024-09-12T18:36:31.190 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.190 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.190 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:31.190 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636186+0000", 2024-09-12T18:36:31.190 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025452500000000002 2024-09-12T18:36:31.190 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.190 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.190 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:31.190 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636445+0000", 2024-09-12T18:36:31.190 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000259268 2024-09-12T18:36:31.190 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.191 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.191 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:31.191 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639562+0000", 2024-09-12T18:36:31.191 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031167 2024-09-12T18:36:31.191 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.191 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.191 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:31.191 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657314+0000", 2024-09-12T18:36:31.191 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017752562 2024-09-12T18:36:31.191 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.191 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.191 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:31.191 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657445+0000", 2024-09-12T18:36:31.192 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013105899999999999 2024-09-12T18:36:31.192 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.192 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.192 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:31.192 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657598+0000", 2024-09-12T18:36:31.192 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015247899999999999 2024-09-12T18:36:31.192 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:31.192 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:31.192 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:31.192 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.192 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.192 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:31.192 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:31.193 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 65.550432932999996, 2024-09-12T18:36:31.193 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025643131999999999, 2024-09-12T18:36:31.193 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:31.193 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:31.193 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:31.193 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:31.193 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.193 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:31.193 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:31.193 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:31.193 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.193 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.193 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:31.193 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:31.194 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:31.194 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.194 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.194 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:31.194 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632637+0000", 2024-09-12T18:36:31.194 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5600000000000001e-06 2024-09-12T18:36:31.194 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.194 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.194 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:31.194 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632650+0000", 2024-09-12T18:36:31.194 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3186e-05 2024-09-12T18:36:31.194 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.194 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.195 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:31.195 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632672+0000", 2024-09-12T18:36:31.195 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2013000000000001e-05 2024-09-12T18:36:31.195 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.195 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.195 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.195 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632687+0000", 2024-09-12T18:36:31.195 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5109999999999999e-05 2024-09-12T18:36:31.195 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.195 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.195 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:31.195 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636994+0000", 2024-09-12T18:36:31.195 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0043065539999999998 2024-09-12T18:36:31.195 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.196 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.196 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:31.196 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637198+0000", 2024-09-12T18:36:31.196 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020387199999999999 2024-09-12T18:36:31.196 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.196 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.196 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:31.196 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637475+0000", 2024-09-12T18:36:31.196 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027731000000000001 2024-09-12T18:36:31.196 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.196 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.196 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:31.196 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639574+0000", 2024-09-12T18:36:31.197 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020988999999999999 2024-09-12T18:36:31.197 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.197 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.197 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:31.197 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658057+0000", 2024-09-12T18:36:31.197 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018482926 2024-09-12T18:36:31.197 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.197 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.197 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:31.197 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658184+0000", 2024-09-12T18:36:31.197 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012756200000000001 2024-09-12T18:36:31.197 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.197 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.197 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:31.198 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658278+0000", 2024-09-12T18:36:31.198 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4139000000000001e-05 2024-09-12T18:36:31.198 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:31.198 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:31.198 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:31.198 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.198 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.198 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:31.198 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:31.198 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 65.550357840999993, 2024-09-12T18:36:31.198 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025238883, 2024-09-12T18:36:31.198 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:31.198 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:31.198 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:31.199 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:31.199 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.199 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:31.199 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:31.199 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:31.199 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.199 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.199 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:31.199 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:31.199 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:31.199 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.199 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.199 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:31.199 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632712+0000", 2024-09-12T18:36:31.200 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6869999999999999e-06 2024-09-12T18:36:31.200 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.200 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.200 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:31.200 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632719+0000", 2024-09-12T18:36:31.200 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6059999999999999e-06 2024-09-12T18:36:31.200 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.200 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.200 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:31.200 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632737+0000", 2024-09-12T18:36:31.200 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7983999999999999e-05 2024-09-12T18:36:31.200 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.201 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.201 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.201 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632751+0000", 2024-09-12T18:36:31.201 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4473e-05 2024-09-12T18:36:31.201 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.201 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.201 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:31.201 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636961+0000", 2024-09-12T18:36:31.201 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042100840000000002 2024-09-12T18:36:31.201 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.201 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.201 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:31.201 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637211+0000", 2024-09-12T18:36:31.202 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000249738 2024-09-12T18:36:31.202 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.202 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.202 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:31.202 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637504+0000", 2024-09-12T18:36:31.202 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00029271499999999998 2024-09-12T18:36:31.202 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.202 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.202 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:31.202 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639582+0000", 2024-09-12T18:36:31.202 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020783389999999998 2024-09-12T18:36:31.202 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.202 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.202 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:31.203 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657709+0000", 2024-09-12T18:36:31.203 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018126758999999999 2024-09-12T18:36:31.203 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.203 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.203 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:31.203 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657830+0000", 2024-09-12T18:36:31.203 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000121329 2024-09-12T18:36:31.203 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.203 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.203 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:31.203 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657949+0000", 2024-09-12T18:36:31.203 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000119169 2024-09-12T18:36:31.203 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:31.204 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:31.204 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:31.204 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.204 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.204 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:31.204 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:31.204 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 65.550293795000002, 2024-09-12T18:36:31.204 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026711823999999999, 2024-09-12T18:36:31.204 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:31.204 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:31.204 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:31.204 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:31.204 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.204 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:31.205 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:31.205 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:31.205 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.205 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.205 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:31.205 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:31.205 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:31.205 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.205 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.205 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:31.205 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632775+0000", 2024-09-12T18:36:31.205 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9999999999999995e-07 2024-09-12T18:36:31.205 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.206 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.206 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:31.206 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632788+0000", 2024-09-12T18:36:31.206 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2629999999999999e-05 2024-09-12T18:36:31.206 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.206 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.206 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:31.206 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632806+0000", 2024-09-12T18:36:31.206 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:36:31.206 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.206 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.206 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.206 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632820+0000", 2024-09-12T18:36:31.206 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3777e-05 2024-09-12T18:36:31.207 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.207 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.207 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:31.207 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638310+0000", 2024-09-12T18:36:31.207 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054898280000000004 2024-09-12T18:36:31.207 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.207 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.207 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:31.207 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638480+0000", 2024-09-12T18:36:31.207 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016968199999999999 2024-09-12T18:36:31.207 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.207 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.207 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:31.207 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638799+0000", 2024-09-12T18:36:31.208 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031915999999999997 2024-09-12T18:36:31.208 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.208 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.208 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:31.208 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639866+0000", 2024-09-12T18:36:31.208 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001067405 2024-09-12T18:36:31.208 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.208 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.208 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:31.208 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658398+0000", 2024-09-12T18:36:31.208 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018531542000000002 2024-09-12T18:36:31.208 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.208 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.209 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:31.209 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658643+0000", 2024-09-12T18:36:31.209 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00024531500000000002 2024-09-12T18:36:31.209 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.209 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.209 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:31.209 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.659486+0000", 2024-09-12T18:36:31.209 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00084316899999999995 2024-09-12T18:36:31.209 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:31.209 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:31.209 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:31.209 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.209 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.210 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:31.210 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:36:31.210 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 65.550066732999994, 2024-09-12T18:36:31.210 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.021357139000000001, 2024-09-12T18:36:31.210 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:31.210 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:31.210 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:31.210 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:31.210 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.210 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:31.210 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:36:31.210 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:31.210 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.210 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.211 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:31.211 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:36:31.211 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:31.211 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.211 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.211 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:31.211 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633003+0000", 2024-09-12T18:36:31.211 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.53e-06 2024-09-12T18:36:31.211 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.211 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.211 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:31.211 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633012+0000", 2024-09-12T18:36:31.211 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9290000000000004e-06 2024-09-12T18:36:31.212 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.212 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.212 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:31.212 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633034+0000", 2024-09-12T18:36:31.212 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2127e-05 2024-09-12T18:36:31.212 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.212 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.212 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.212 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633054+0000", 2024-09-12T18:36:31.212 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9476000000000001e-05 2024-09-12T18:36:31.212 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.212 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.212 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:31.213 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636657+0000", 2024-09-12T18:36:31.213 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036038839999999999 2024-09-12T18:36:31.213 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.213 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.213 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:31.213 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636885+0000", 2024-09-12T18:36:31.213 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022798800000000001 2024-09-12T18:36:31.213 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.213 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.213 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:31.213 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637189+0000", 2024-09-12T18:36:31.213 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030392100000000002 2024-09-12T18:36:31.213 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.214 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.214 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:31.214 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639271+0000", 2024-09-12T18:36:31.214 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020817460000000002 2024-09-12T18:36:31.214 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.214 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.214 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:31.214 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.652371+0000", 2024-09-12T18:36:31.214 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013099417 2024-09-12T18:36:31.214 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.214 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.214 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:31.214 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654255+0000", 2024-09-12T18:36:31.214 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018846049999999999 2024-09-12T18:36:31.215 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.215 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.215 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:31.215 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654359+0000", 2024-09-12T18:36:31.215 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000103516 2024-09-12T18:36:31.215 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:31.215 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:31.215 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:31.215 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.215 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.215 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:31.215 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:31.216 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 65.549985040999999, 2024-09-12T18:36:31.216 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026938645000000001, 2024-09-12T18:36:31.216 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:31.216 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:31.216 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:31.216 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:31.216 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.216 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:31.216 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:31.216 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:31.216 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.216 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.216 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:31.217 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:31.217 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:31.217 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.217 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.217 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:31.217 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633085+0000", 2024-09-12T18:36:31.217 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:31.217 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.217 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.217 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:31.217 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633093+0000", 2024-09-12T18:36:31.217 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3999999999999992e-06 2024-09-12T18:36:31.217 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.218 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.218 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:31.218 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633111+0000", 2024-09-12T18:36:31.218 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8070000000000001e-05 2024-09-12T18:36:31.218 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.218 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.218 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.218 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633126+0000", 2024-09-12T18:36:31.218 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4487e-05 2024-09-12T18:36:31.218 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.218 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.218 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:31.218 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638290+0000", 2024-09-12T18:36:31.218 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0051640269999999999 2024-09-12T18:36:31.219 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.219 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.219 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:31.219 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638547+0000", 2024-09-12T18:36:31.219 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025714100000000001 2024-09-12T18:36:31.219 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.219 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.219 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:31.219 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638850+0000", 2024-09-12T18:36:31.219 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030278400000000001 2024-09-12T18:36:31.219 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.219 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.219 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:31.219 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.640706+0000", 2024-09-12T18:36:31.220 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018564580000000001 2024-09-12T18:36:31.220 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.220 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.220 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:31.220 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658420+0000", 2024-09-12T18:36:31.220 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017714395000000001 2024-09-12T18:36:31.220 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.220 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.220 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:31.220 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658635+0000", 2024-09-12T18:36:31.220 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021413500000000001 2024-09-12T18:36:31.220 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.220 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.220 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:31.221 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.660022+0000", 2024-09-12T18:36:31.221 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001387318 2024-09-12T18:36:31.221 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:31.221 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:31.221 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:31.221 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.221 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.221 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:31.221 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:36:31.221 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 65.549640530000005, 2024-09-12T18:36:31.221 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.020709867, 2024-09-12T18:36:31.221 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:31.221 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:31.222 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:31.222 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:31.222 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.222 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:31.222 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:36:31.222 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:31.222 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.222 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.222 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:31.222 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:36:31.222 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:31.222 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.222 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.222 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:31.223 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633429+0000", 2024-09-12T18:36:31.223 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.313e-06 2024-09-12T18:36:31.223 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.223 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.223 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:31.223 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633462+0000", 2024-09-12T18:36:31.223 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3197000000000001e-05 2024-09-12T18:36:31.223 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.223 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.223 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:31.223 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633485+0000", 2024-09-12T18:36:31.223 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3243000000000001e-05 2024-09-12T18:36:31.223 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.223 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.224 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.224 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633501+0000", 2024-09-12T18:36:31.224 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5383000000000002e-05 2024-09-12T18:36:31.224 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.224 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.224 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:31.224 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633642+0000", 2024-09-12T18:36:31.224 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000141168 2024-09-12T18:36:31.224 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.224 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.224 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:31.224 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633982+0000", 2024-09-12T18:36:31.225 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000340067 2024-09-12T18:36:31.225 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.225 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.225 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:31.225 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654138+0000", 2024-09-12T18:36:31.225 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.020155495999999998 2024-09-12T18:36:31.225 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:31.225 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:31.225 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:31.225 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.225 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.225 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:49141 5.d 5:bce526e5:::benchmark_data_smithi073_23739_object49140:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T18:36:31.225 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:03.538808+0000", 2024-09-12T18:36:31.225 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 27.644260484, 2024-09-12T18:36:31.226 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.019659019, 2024-09-12T18:36:31.226 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:31.226 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:31.226 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:31.226 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:31.226 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:31.226 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:31.226 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 49141 2024-09-12T18:36:31.226 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.226 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:31.226 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.226 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:31.226 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538808+0000", 2024-09-12T18:36:31.226 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:31.227 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.227 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.227 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:31.227 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538808+0000", 2024-09-12T18:36:31.227 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:31.227 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.227 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.227 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:31.227 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538809+0000", 2024-09-12T18:36:31.227 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.065e-06 2024-09-12T18:36:31.227 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.227 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.227 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:31.227 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538914+0000", 2024-09-12T18:36:31.228 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010528599999999999 2024-09-12T18:36:31.228 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.228 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.228 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:31.228 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538924+0000", 2024-09-12T18:36:31.228 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4420000000000004e-06 2024-09-12T18:36:31.228 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.228 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.228 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.228 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538944+0000", 2024-09-12T18:36:31.228 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0460000000000001e-05 2024-09-12T18:36:31.228 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.228 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.229 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:31.229 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.539034+0000", 2024-09-12T18:36:31.229 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9512000000000006e-05 2024-09-12T18:36:31.229 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.229 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.229 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:31.229 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.539161+0000", 2024-09-12T18:36:31.229 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012782399999999999 2024-09-12T18:36:31.229 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.229 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.229 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:31.229 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.539246+0000", 2024-09-12T18:36:31.229 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4927999999999997e-05 2024-09-12T18:36:31.230 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.230 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.230 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:31.230 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.541390+0000", 2024-09-12T18:36:31.230 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0021439509999999998 2024-09-12T18:36:31.230 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.230 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.230 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:31.230 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.558236+0000", 2024-09-12T18:36:31.230 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016845619999999999 2024-09-12T18:36:31.230 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.230 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.230 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:31.230 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.558368+0000", 2024-09-12T18:36:31.231 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013241300000000001 2024-09-12T18:36:31.231 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.231 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.231 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:31.231 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.558467+0000", 2024-09-12T18:36:31.231 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8517999999999994e-05 2024-09-12T18:36:31.231 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:31.231 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:31.231 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:31.231 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.231 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.231 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:61561 5.e 5:715fe5e4:::benchmark_data_smithi073_23739_object61560:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:36:31.231 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:09.221864+0000", 2024-09-12T18:36:31.231 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 21.961204069000001, 2024-09-12T18:36:31.231 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017993663999999999, 2024-09-12T18:36:31.232 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:31.232 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:31.232 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:31.232 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:31.232 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:31.232 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:31.232 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 61561 2024-09-12T18:36:31.232 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.232 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:31.232 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.232 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:31.232 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.221864+0000", 2024-09-12T18:36:31.232 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:31.233 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.233 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.233 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:31.233 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.221864+0000", 2024-09-12T18:36:31.233 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:31.233 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.233 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.233 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:31.233 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.221865+0000", 2024-09-12T18:36:31.233 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1310000000000001e-06 2024-09-12T18:36:31.233 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.233 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.233 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:31.234 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222022+0000", 2024-09-12T18:36:31.234 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015628500000000001 2024-09-12T18:36:31.234 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.234 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.234 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:31.234 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222034+0000", 2024-09-12T18:36:31.234 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2481e-05 2024-09-12T18:36:31.234 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.234 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.234 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.234 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222041+0000", 2024-09-12T18:36:31.234 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7469999999999999e-06 2024-09-12T18:36:31.234 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.235 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.235 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:31.235 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222103+0000", 2024-09-12T18:36:31.235 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1903999999999995e-05 2024-09-12T18:36:31.235 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.235 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.235 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:31.235 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222199+0000", 2024-09-12T18:36:31.235 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6664999999999997e-05 2024-09-12T18:36:31.235 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.235 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.235 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:31.235 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222286+0000", 2024-09-12T18:36:31.235 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6582999999999994e-05 2024-09-12T18:36:31.236 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.236 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.236 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:31.236 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.228622+0000", 2024-09-12T18:36:31.236 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063357520000000001 2024-09-12T18:36:31.236 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.236 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.236 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:31.236 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.239753+0000", 2024-09-12T18:36:31.236 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011131709 2024-09-12T18:36:31.236 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.236 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.236 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:31.237 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.239813+0000", 2024-09-12T18:36:31.237 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0007999999999999e-05 2024-09-12T18:36:31.237 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.237 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.237 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:31.237 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.239858+0000", 2024-09-12T18:36:31.237 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4399e-05 2024-09-12T18:36:31.237 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:31.237 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:31.237 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:31.237 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.237 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.237 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:77241 5.b 5:d9973dc8:::benchmark_data_smithi073_23739_object77240:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:31.237 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:16.792553+0000", 2024-09-12T18:36:31.238 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 14.39051486, 2024-09-12T18:36:31.238 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.019966754999999999, 2024-09-12T18:36:31.238 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:31.238 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:31.238 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:31.238 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:31.238 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:31.238 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:31.238 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 77241 2024-09-12T18:36:31.238 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.238 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:31.238 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.239 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:31.239 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.792553+0000", 2024-09-12T18:36:31.239 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:31.239 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.239 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.239 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:31.239 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.792553+0000", 2024-09-12T18:36:31.239 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:31.239 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.239 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.239 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:31.239 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.792554+0000", 2024-09-12T18:36:31.239 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.16e-07 2024-09-12T18:36:31.239 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.240 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.240 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:31.240 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.792661+0000", 2024-09-12T18:36:31.240 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000106909 2024-09-12T18:36:31.240 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.240 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.240 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:31.240 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.792671+0000", 2024-09-12T18:36:31.240 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0268000000000001e-05 2024-09-12T18:36:31.240 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.240 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.240 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.240 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.792678+0000", 2024-09-12T18:36:31.240 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7510000000000002e-06 2024-09-12T18:36:31.241 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.241 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.241 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:31.241 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.794730+0000", 2024-09-12T18:36:31.241 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002051794 2024-09-12T18:36:31.241 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.241 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.241 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:31.241 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.794857+0000", 2024-09-12T18:36:31.241 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012728500000000001 2024-09-12T18:36:31.241 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.241 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.241 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:31.241 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.794987+0000", 2024-09-12T18:36:31.242 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012996899999999999 2024-09-12T18:36:31.242 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.242 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.242 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:31.242 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.797553+0000", 2024-09-12T18:36:31.242 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025652980000000001 2024-09-12T18:36:31.242 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.242 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.242 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:31.242 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.812460+0000", 2024-09-12T18:36:31.242 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.014907884 2024-09-12T18:36:31.242 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.242 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.243 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:31.243 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.812494+0000", 2024-09-12T18:36:31.243 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3525000000000002e-05 2024-09-12T18:36:31.243 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.243 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.243 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:31.243 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.812520+0000", 2024-09-12T18:36:31.243 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6156000000000002e-05 2024-09-12T18:36:31.243 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:31.243 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:31.243 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:31.243 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.243 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.243 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:77253 5.b 5:df1f7025:::benchmark_data_smithi073_23739_object77252:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:31.244 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:16.798099+0000", 2024-09-12T18:36:31.244 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 14.38496917, 2024-09-12T18:36:31.244 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0182598, 2024-09-12T18:36:31.244 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:31.244 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:31.244 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:31.244 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:31.244 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:31.244 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:31.244 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 77253 2024-09-12T18:36:31.244 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.244 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:31.244 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.245 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:31.245 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798099+0000", 2024-09-12T18:36:31.245 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:31.245 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.245 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.245 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:31.245 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798099+0000", 2024-09-12T18:36:31.245 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:31.245 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.245 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.245 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:31.245 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798100+0000", 2024-09-12T18:36:31.245 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2449999999999999e-06 2024-09-12T18:36:31.245 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.246 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.246 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:31.246 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798159+0000", 2024-09-12T18:36:31.246 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8925999999999998e-05 2024-09-12T18:36:31.246 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.246 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.246 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:31.246 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798171+0000", 2024-09-12T18:36:31.246 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.206e-05 2024-09-12T18:36:31.246 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.246 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.246 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.247 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798178+0000", 2024-09-12T18:36:31.247 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9009999999999997e-06 2024-09-12T18:36:31.247 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.247 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.247 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:31.247 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798227+0000", 2024-09-12T18:36:31.247 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8794000000000001e-05 2024-09-12T18:36:31.247 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.247 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.247 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:31.247 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798314+0000", 2024-09-12T18:36:31.247 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7322000000000002e-05 2024-09-12T18:36:31.248 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.248 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.248 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:31.248 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798417+0000", 2024-09-12T18:36:31.248 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000102777 2024-09-12T18:36:31.248 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.248 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.248 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:31.248 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.800633+0000", 2024-09-12T18:36:31.248 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022157740000000002 2024-09-12T18:36:31.248 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.248 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.248 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:31.248 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.816295+0000", 2024-09-12T18:36:31.249 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015662359000000001 2024-09-12T18:36:31.249 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.249 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.249 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:31.249 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.816330+0000", 2024-09-12T18:36:31.249 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4353999999999997e-05 2024-09-12T18:36:31.249 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.249 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.249 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:31.249 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.816359+0000", 2024-09-12T18:36:31.249 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9288000000000001e-05 2024-09-12T18:36:31.249 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:31.249 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:31.250 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:31.250 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.250 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.250 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:80117 5.e 5:713efd60:::benchmark_data_smithi073_23739_object80116:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:31.250 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:18.149805+0000", 2024-09-12T18:36:31.250 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 13.033263602, 2024-09-12T18:36:31.250 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018173544, 2024-09-12T18:36:31.250 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:31.250 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:31.250 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:31.250 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:31.250 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:31.251 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:31.251 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 80117 2024-09-12T18:36:31.251 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.251 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:31.251 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.251 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:31.251 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.149805+0000", 2024-09-12T18:36:31.251 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:31.251 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.251 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.251 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:31.251 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.149805+0000", 2024-09-12T18:36:31.251 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:31.252 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.252 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.252 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:31.252 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.149805+0000", 2024-09-12T18:36:31.252 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2399999999999997e-07 2024-09-12T18:36:31.252 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.252 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.252 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:31.252 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.149842+0000", 2024-09-12T18:36:31.252 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6396000000000002e-05 2024-09-12T18:36:31.252 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.252 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.252 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:31.252 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.149855+0000", 2024-09-12T18:36:31.253 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3247999999999999e-05 2024-09-12T18:36:31.253 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.253 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.253 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.253 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.149863+0000", 2024-09-12T18:36:31.253 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9189999999999999e-06 2024-09-12T18:36:31.253 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.253 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.253 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:31.253 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.155735+0000", 2024-09-12T18:36:31.253 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0058721600000000004 2024-09-12T18:36:31.253 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.253 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.253 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:31.254 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.155868+0000", 2024-09-12T18:36:31.254 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013283500000000001 2024-09-12T18:36:31.254 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.254 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.254 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:31.254 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.156033+0000", 2024-09-12T18:36:31.254 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016527999999999999 2024-09-12T18:36:31.254 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.254 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.254 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:31.254 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.160797+0000", 2024-09-12T18:36:31.254 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0047638439999999997 2024-09-12T18:36:31.254 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.254 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.255 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:31.255 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.167881+0000", 2024-09-12T18:36:31.255 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0070834670000000004 2024-09-12T18:36:31.255 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.255 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.255 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:31.255 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.167936+0000", 2024-09-12T18:36:31.255 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5473999999999998e-05 2024-09-12T18:36:31.255 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.255 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.255 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:31.255 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.167978+0000", 2024-09-12T18:36:31.255 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2097e-05 2024-09-12T18:36:31.255 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:31.256 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:31.256 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:31.256 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.256 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.256 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:81207 5.0 5:0c89eb16:::benchmark_data_smithi073_23739_object81206:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T18:36:31.256 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:18.680764+0000", 2024-09-12T18:36:31.256 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 12.502304308999999, 2024-09-12T18:36:31.256 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017614778000000001, 2024-09-12T18:36:31.256 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:31.256 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:31.256 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:31.256 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:31.256 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:31.257 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:31.257 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 81207 2024-09-12T18:36:31.257 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.257 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:31.257 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.257 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:31.257 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.680764+0000", 2024-09-12T18:36:31.257 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:31.257 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.257 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.257 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:31.257 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.680764+0000", 2024-09-12T18:36:31.257 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:31.258 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.258 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.258 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:31.258 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.680765+0000", 2024-09-12T18:36:31.258 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0699999999999999e-06 2024-09-12T18:36:31.258 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.258 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.258 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:31.258 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.680883+0000", 2024-09-12T18:36:31.258 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000117753 2024-09-12T18:36:31.258 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.258 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.258 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:31.258 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.680898+0000", 2024-09-12T18:36:31.259 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5546e-05 2024-09-12T18:36:31.259 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.259 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.259 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.259 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.680905+0000", 2024-09-12T18:36:31.259 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0779999999999998e-06 2024-09-12T18:36:31.259 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.259 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.259 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:31.259 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.685631+0000", 2024-09-12T18:36:31.259 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0047256720000000002 2024-09-12T18:36:31.259 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.259 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.259 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:31.260 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.685800+0000", 2024-09-12T18:36:31.260 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016894800000000001 2024-09-12T18:36:31.260 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.260 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.260 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:31.260 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.686022+0000", 2024-09-12T18:36:31.260 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022225399999999999 2024-09-12T18:36:31.260 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.260 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.260 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:31.260 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.693548+0000", 2024-09-12T18:36:31.260 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0075253789999999996 2024-09-12T18:36:31.260 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.261 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.261 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:31.261 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.698317+0000", 2024-09-12T18:36:31.261 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0047689250000000002 2024-09-12T18:36:31.261 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.261 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.261 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:31.261 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.698345+0000", 2024-09-12T18:36:31.261 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8445999999999998e-05 2024-09-12T18:36:31.261 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.261 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.261 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:31.261 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.698379+0000", 2024-09-12T18:36:31.261 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3707000000000001e-05 2024-09-12T18:36:31.262 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:31.262 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:31.262 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:31.262 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.262 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.262 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:88599 5.b 5:d3a6061c:::benchmark_data_smithi073_23739_object88598:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:36:31.262 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:22.263566+0000", 2024-09-12T18:36:31.262 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 8.9195018170000004, 2024-09-12T18:36:31.262 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.020416237, 2024-09-12T18:36:31.262 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:31.262 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:31.262 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:31.262 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:31.263 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:31.263 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:31.263 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 88599 2024-09-12T18:36:31.263 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.263 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:31.263 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.263 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:31.263 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.263566+0000", 2024-09-12T18:36:31.263 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:31.263 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.263 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.263 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:31.263 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.263566+0000", 2024-09-12T18:36:31.263 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:31.264 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.264 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.264 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:31.264 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.263567+0000", 2024-09-12T18:36:31.264 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.088e-06 2024-09-12T18:36:31.264 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.264 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.264 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:31.264 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.263654+0000", 2024-09-12T18:36:31.264 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6632999999999995e-05 2024-09-12T18:36:31.264 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.264 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.264 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:31.265 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.263673+0000", 2024-09-12T18:36:31.265 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8984e-05 2024-09-12T18:36:31.265 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.265 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.265 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.265 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.263681+0000", 2024-09-12T18:36:31.265 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.371e-06 2024-09-12T18:36:31.265 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.265 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.265 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:31.265 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.266963+0000", 2024-09-12T18:36:31.265 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0032810410000000002 2024-09-12T18:36:31.265 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.265 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.266 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:31.266 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.267069+0000", 2024-09-12T18:36:31.266 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000106471 2024-09-12T18:36:31.266 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.266 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.266 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:31.266 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.267177+0000", 2024-09-12T18:36:31.266 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000108355 2024-09-12T18:36:31.266 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.266 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.266 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:31.266 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.268827+0000", 2024-09-12T18:36:31.266 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016492029999999999 2024-09-12T18:36:31.266 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.267 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.267 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:31.267 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.283931+0000", 2024-09-12T18:36:31.267 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015104783 2024-09-12T18:36:31.267 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.267 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.267 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:31.267 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.283960+0000", 2024-09-12T18:36:31.267 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8401000000000001e-05 2024-09-12T18:36:31.267 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.267 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.267 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:31.267 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.283983+0000", 2024-09-12T18:36:31.267 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2906999999999999e-05 2024-09-12T18:36:31.268 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:31.268 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:31.268 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:31.268 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.268 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.268 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:89277 5.b 5:d689659b:::benchmark_data_smithi073_23739_object89276:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:36:31.268 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:22.590286+0000", 2024-09-12T18:36:31.268 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 8.5927818309999999, 2024-09-12T18:36:31.268 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018995509000000001, 2024-09-12T18:36:31.268 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:31.268 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:31.268 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:31.268 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:31.269 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:31.269 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:31.269 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 89277 2024-09-12T18:36:31.269 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.269 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:31.269 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.269 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:31.269 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590286+0000", 2024-09-12T18:36:31.269 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:31.270 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.270 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.270 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:31.270 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590286+0000", 2024-09-12T18:36:31.270 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:31.270 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.270 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.270 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:31.270 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590288+0000", 2024-09-12T18:36:31.270 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.119e-06 2024-09-12T18:36:31.270 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.270 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.270 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:31.271 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590370+0000", 2024-09-12T18:36:31.271 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2025000000000002e-05 2024-09-12T18:36:31.271 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.271 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.271 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:31.271 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590380+0000", 2024-09-12T18:36:31.271 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0723999999999999e-05 2024-09-12T18:36:31.271 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.271 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.271 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.271 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590386+0000", 2024-09-12T18:36:31.271 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.609e-06 2024-09-12T18:36:31.271 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.272 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.272 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:31.272 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590444+0000", 2024-09-12T18:36:31.272 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7667000000000002e-05 2024-09-12T18:36:31.272 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.272 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.272 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:31.272 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590552+0000", 2024-09-12T18:36:31.272 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000108402 2024-09-12T18:36:31.272 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.272 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.272 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:31.272 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590687+0000", 2024-09-12T18:36:31.272 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000134602 2024-09-12T18:36:31.273 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.273 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.273 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:31.273 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.593694+0000", 2024-09-12T18:36:31.273 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003007249 2024-09-12T18:36:31.273 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.273 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.273 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:31.273 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.609224+0000", 2024-09-12T18:36:31.273 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015530552 2024-09-12T18:36:31.273 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.273 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.273 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:31.274 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.609256+0000", 2024-09-12T18:36:31.274 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1838999999999998e-05 2024-09-12T18:36:31.274 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.274 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.274 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:31.274 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.609282+0000", 2024-09-12T18:36:31.274 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5721e-05 2024-09-12T18:36:31.274 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:31.274 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:31.274 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:31.274 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.274 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.274 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:95928 5.0 5:0771f238:::benchmark_data_smithi073_23739_object95927:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:36:31.274 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:25.895007+0000", 2024-09-12T18:36:31.275 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 5.2880616180000004, 2024-09-12T18:36:31.275 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.02094159, 2024-09-12T18:36:31.275 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:31.275 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:31.275 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:31.275 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:31.275 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:31.275 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:31.275 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 95928 2024-09-12T18:36:31.275 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.275 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:31.275 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.275 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:31.275 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.895007+0000", 2024-09-12T18:36:31.276 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:31.276 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.276 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.276 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:31.276 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.895007+0000", 2024-09-12T18:36:31.276 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:31.276 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.276 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.276 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:31.276 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.895008+0000", 2024-09-12T18:36:31.276 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8400000000000002e-07 2024-09-12T18:36:31.276 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.276 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.277 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:31.277 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.895077+0000", 2024-09-12T18:36:31.277 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9220999999999993e-05 2024-09-12T18:36:31.277 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.277 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.277 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:31.277 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.895089+0000", 2024-09-12T18:36:31.277 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1701e-05 2024-09-12T18:36:31.277 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.277 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.277 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.277 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.895095+0000", 2024-09-12T18:36:31.277 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9240000000000001e-06 2024-09-12T18:36:31.277 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.278 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.278 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:31.278 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.902948+0000", 2024-09-12T18:36:31.278 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0078527110000000001 2024-09-12T18:36:31.278 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.278 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.278 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:31.278 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.903069+0000", 2024-09-12T18:36:31.278 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000120382 2024-09-12T18:36:31.278 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.278 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.278 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:31.278 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.903200+0000", 2024-09-12T18:36:31.278 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000130984 2024-09-12T18:36:31.279 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.279 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.279 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:31.279 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.915841+0000", 2024-09-12T18:36:31.279 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012641177 2024-09-12T18:36:31.279 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.279 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.279 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:31.279 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.915853+0000", 2024-09-12T18:36:31.279 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2707999999999999e-05 2024-09-12T18:36:31.279 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.279 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.279 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:31.280 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.915910+0000", 2024-09-12T18:36:31.280 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6226e-05 2024-09-12T18:36:31.280 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.280 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.280 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:31.280 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.915948+0000", 2024-09-12T18:36:31.280 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8572000000000003e-05 2024-09-12T18:36:31.280 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:31.280 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:31.280 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:31.280 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.280 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.280 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:96974 5.4 5:22c5e101:::benchmark_data_smithi073_23739_object96973:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:36:31.280 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:26.404987+0000", 2024-09-12T18:36:31.281 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.7780814659999997, 2024-09-12T18:36:31.281 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018218356000000002, 2024-09-12T18:36:31.281 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:31.281 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:31.281 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:31.281 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:31.281 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:31.281 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:31.281 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 96974 2024-09-12T18:36:31.281 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.281 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:31.281 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.281 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:31.282 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.404987+0000", 2024-09-12T18:36:31.282 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:31.282 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.282 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.282 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:31.282 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.404987+0000", 2024-09-12T18:36:31.282 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:31.282 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.282 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.282 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:31.282 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.404988+0000", 2024-09-12T18:36:31.282 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0839999999999999e-06 2024-09-12T18:36:31.282 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.282 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.283 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:31.283 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.405025+0000", 2024-09-12T18:36:31.283 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7598000000000002e-05 2024-09-12T18:36:31.283 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.283 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.283 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:31.283 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.405039+0000", 2024-09-12T18:36:31.283 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3614999999999999e-05 2024-09-12T18:36:31.283 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.283 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.283 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.283 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.405045+0000", 2024-09-12T18:36:31.283 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7019999999999998e-06 2024-09-12T18:36:31.283 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.284 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.284 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:31.284 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.405124+0000", 2024-09-12T18:36:31.284 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9064000000000001e-05 2024-09-12T18:36:31.284 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.284 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.284 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:31.284 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.405261+0000", 2024-09-12T18:36:31.284 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013721499999999999 2024-09-12T18:36:31.284 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.284 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.284 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:31.284 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.405416+0000", 2024-09-12T18:36:31.284 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015480499999999999 2024-09-12T18:36:31.285 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.285 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.285 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:31.285 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.410834+0000", 2024-09-12T18:36:31.285 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054180690000000002 2024-09-12T18:36:31.285 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.285 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.285 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:31.285 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.423115+0000", 2024-09-12T18:36:31.285 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012280813 2024-09-12T18:36:31.285 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.285 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.285 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:31.286 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.423166+0000", 2024-09-12T18:36:31.286 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0849000000000001e-05 2024-09-12T18:36:31.286 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.286 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.286 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:31.286 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.423205+0000", 2024-09-12T18:36:31.286 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9542000000000002e-05 2024-09-12T18:36:31.286 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:31.286 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:31.286 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:31.286 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.286 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.286 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:99510 5.4 5:223418b2:::benchmark_data_smithi073_23739_object99509:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:36:31.286 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:27.624696+0000", 2024-09-12T18:36:31.287 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 3.558371921, 2024-09-12T18:36:31.287 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017929684000000001, 2024-09-12T18:36:31.287 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:31.287 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:31.287 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:31.287 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:31.287 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:31.287 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:31.287 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 99510 2024-09-12T18:36:31.287 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.287 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:31.287 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.287 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:31.287 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:27.624696+0000", 2024-09-12T18:36:31.288 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:31.288 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.288 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.288 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:31.288 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:27.624696+0000", 2024-09-12T18:36:31.288 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:31.288 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.288 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.288 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:31.288 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:27.624697+0000", 2024-09-12T18:36:31.288 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9999999999999995e-07 2024-09-12T18:36:31.288 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.288 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.289 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:31.289 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:27.624798+0000", 2024-09-12T18:36:31.289 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000100652 2024-09-12T18:36:31.289 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.289 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.289 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:31.289 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:27.624808+0000", 2024-09-12T18:36:31.289 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8500000000000006e-06 2024-09-12T18:36:31.289 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.289 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.289 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.289 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:27.624813+0000", 2024-09-12T18:36:31.289 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0499999999999999e-06 2024-09-12T18:36:31.289 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.290 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.290 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:31.290 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:27.624863+0000", 2024-09-12T18:36:31.290 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0149999999999999e-05 2024-09-12T18:36:31.290 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.290 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.290 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:31.290 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:27.625003+0000", 2024-09-12T18:36:31.290 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014039099999999999 2024-09-12T18:36:31.290 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.290 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.290 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:31.290 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:27.625149+0000", 2024-09-12T18:36:31.290 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014520700000000001 2024-09-12T18:36:31.291 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.291 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.291 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:31.291 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:27.630260+0000", 2024-09-12T18:36:31.291 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0051114949999999998 2024-09-12T18:36:31.291 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.291 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.291 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:31.291 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:27.642524+0000", 2024-09-12T18:36:31.291 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012263838000000001 2024-09-12T18:36:31.291 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.291 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.291 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:31.291 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:27.642583+0000", 2024-09-12T18:36:31.292 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.9216999999999999e-05 2024-09-12T18:36:31.292 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.292 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.292 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:31.292 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:27.642626+0000", 2024-09-12T18:36:31.292 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2833999999999997e-05 2024-09-12T18:36:31.292 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:31.292 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:31.292 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:31.292 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.292 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.292 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:104764 5.0 5:0dfa202d:::benchmark_data_smithi073_23739_object104763:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T18:36:31.292 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:30.213356+0000", 2024-09-12T18:36:31.293 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.96971214699999997, 2024-09-12T18:36:31.293 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018447024999999999, 2024-09-12T18:36:31.293 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:31.293 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:31.293 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:31.293 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:31.293 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:31.293 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:31.293 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 104764 2024-09-12T18:36:31.293 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.293 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:31.293 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.293 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:31.293 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.213356+0000", 2024-09-12T18:36:31.294 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:31.294 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.294 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.294 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:31.294 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.213356+0000", 2024-09-12T18:36:31.294 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:31.294 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.294 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.294 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:31.294 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.213357+0000", 2024-09-12T18:36:31.294 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7100000000000001e-07 2024-09-12T18:36:31.294 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.294 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.294 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:31.295 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.213403+0000", 2024-09-12T18:36:31.295 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6467000000000001e-05 2024-09-12T18:36:31.295 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.295 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.295 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:31.295 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.213412+0000", 2024-09-12T18:36:31.295 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9649999999999997e-06 2024-09-12T18:36:31.295 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.295 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.295 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.295 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.213418+0000", 2024-09-12T18:36:31.295 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1099999999999999e-06 2024-09-12T18:36:31.295 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.295 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.296 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:31.296 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.216358+0000", 2024-09-12T18:36:31.296 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0029392950000000002 2024-09-12T18:36:31.296 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.296 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.296 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:31.296 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.216446+0000", 2024-09-12T18:36:31.296 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8208000000000007e-05 2024-09-12T18:36:31.296 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.296 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.296 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:31.296 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.216542+0000", 2024-09-12T18:36:31.296 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6206999999999996e-05 2024-09-12T18:36:31.297 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.297 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.297 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:31.297 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.224399+0000", 2024-09-12T18:36:31.297 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0078571119999999994 2024-09-12T18:36:31.297 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.297 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.297 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:31.297 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.231694+0000", 2024-09-12T18:36:31.297 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0072948240000000001 2024-09-12T18:36:31.297 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.297 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.297 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:31.297 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.231745+0000", 2024-09-12T18:36:31.298 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1415999999999997e-05 2024-09-12T18:36:31.298 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.298 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.298 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:31.298 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.231803+0000", 2024-09-12T18:36:31.298 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7750000000000001e-05 2024-09-12T18:36:31.298 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:31.298 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:31.298 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:31.298 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.298 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.298 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:104767 5.0 5:0a411b69:::benchmark_data_smithi073_23739_object104766:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T18:36:31.298 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:30.214230+0000", 2024-09-12T18:36:31.298 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.968838223, 2024-09-12T18:36:31.298 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017809439, 2024-09-12T18:36:31.299 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:31.299 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:31.299 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:31.299 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:31.299 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:31.299 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:31.299 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 104767 2024-09-12T18:36:31.299 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.299 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:31.299 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.299 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:31.299 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.214230+0000", 2024-09-12T18:36:31.299 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:31.300 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.300 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.300 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:31.300 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.214230+0000", 2024-09-12T18:36:31.300 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:31.300 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.300 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.300 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:31.300 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.214231+0000", 2024-09-12T18:36:31.300 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1289999999999999e-06 2024-09-12T18:36:31.300 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.300 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.300 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:31.301 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.214343+0000", 2024-09-12T18:36:31.301 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112138 2024-09-12T18:36:31.301 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.301 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.301 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:31.301 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.214356+0000", 2024-09-12T18:36:31.301 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2745000000000001e-05 2024-09-12T18:36:31.301 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.301 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.301 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.301 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.214363+0000", 2024-09-12T18:36:31.301 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5409999999999997e-06 2024-09-12T18:36:31.301 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.301 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.302 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:31.302 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.218757+0000", 2024-09-12T18:36:31.302 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.004394256 2024-09-12T18:36:31.302 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.302 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.302 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:31.302 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.218968+0000", 2024-09-12T18:36:31.302 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000210977 2024-09-12T18:36:31.302 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.302 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.302 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:31.302 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.219195+0000", 2024-09-12T18:36:31.302 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022698299999999999 2024-09-12T18:36:31.302 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.303 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.303 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:31.303 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.224402+0000", 2024-09-12T18:36:31.303 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052075639999999996 2024-09-12T18:36:31.303 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.303 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.303 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:31.303 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.231883+0000", 2024-09-12T18:36:31.303 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0074809400000000002 2024-09-12T18:36:31.303 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.303 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.303 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:31.303 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.231948+0000", 2024-09-12T18:36:31.303 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4375000000000006e-05 2024-09-12T18:36:31.304 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:31.304 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:31.304 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:31.304 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.232039+0000", 2024-09-12T18:36:31.304 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.1791000000000003e-05 2024-09-12T18:36:31.304 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:31.304 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:31.304 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:31.304 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:31.304 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:31.304 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:31.306 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:36:31.306 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:31.304+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:31.380 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:36:31.382 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T18:36:31.400 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":83,"stamp":"2024-09-12T18:36:30.563415+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6471814045,"num_objects":98769,"num_object_clones":0,"num_object_copies":197538,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98769,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":98935,"num_write_kb":6322240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60897,"ondisk_log_size":60897,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1096180,"kb_used_data":777712,"kb_used_omap":4,"kb_used_meta":318395,"kb_avail":282019340,"statfs":{"total":289910292480,"available":288787804160,"internally_reserved":0,"allocated":796377088,"data_stored":12719588656,"data_compressed":603981928,"data_compressed_allocated":794959872,"data_compressed_original":12719063040,"omap_allocated":4783,"internal_metadata":326036817},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,3,6,6,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":666894336,"num_objects":10176,"num_object_clones":0,"num_object_copies":20352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10176,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10176,"num_write_kb":651264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.168263"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.535363+0000","last_change":"2024-09-12T18:35:25.657389+0000","last_active":"2024-09-12T18:36:27.535363+0000","last_peered":"2024-09-12T18:36:27.535363+0000","last_clean":"2024-09-12T18:36:27.535363+0000","last_became_active":"2024-09-12T18:35:25.651857+0000","last_became_peered":"2024-09-12T18:35:25.651857+0000","last_unstale":"2024-09-12T18:36:27.535363+0000","last_undegraded":"2024-09-12T18:36:27.535363+0000","last_fullsized":"2024-09-12T18:36:27.535363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:50.264536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.535068+0000","last_change":"2024-09-12T18:35:25.659760+0000","last_active":"2024-09-12T18:36:27.535068+0000","last_peered":"2024-09-12T18:36:27.535068+0000","last_clean":"2024-09-12T18:36:27.535068+0000","last_became_active":"2024-09-12T18:35:25.654920+0000","last_became_peered":"2024-09-12T18:35:25.654920+0000","last_unstale":"2024-09-12T18:36:27.535068+0000","last_undegraded":"2024-09-12T18:36:27.535068+0000","last_fullsized":"2024-09-12T18:36:27.535068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:21.519881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.522116+0000","last_change":"2024-09-12T18:35:25.659460+0000","last_active":"2024-09-12T18:36:24.522116+0000","last_peered":"2024-09-12T18:36:24.522116+0000","last_clean":"2024-09-12T18:36:24.522116+0000","last_became_active":"2024-09-12T18:35:25.657782+0000","last_became_peered":"2024-09-12T18:35:25.657782+0000","last_unstale":"2024-09-12T18:36:24.522116+0000","last_undegraded":"2024-09-12T18:36:24.522116+0000","last_fullsized":"2024-09-12T18:36:24.522116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:38.544284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.524390+0000","last_change":"2024-09-12T18:35:25.663617+0000","last_active":"2024-09-12T18:36:24.524390+0000","last_peered":"2024-09-12T18:36:24.524390+0000","last_clean":"2024-09-12T18:36:24.524390+0000","last_became_active":"2024-09-12T18:35:25.661977+0000","last_became_peered":"2024-09-12T18:35:25.661977+0000","last_unstale":"2024-09-12T18:36:24.524390+0000","last_undegraded":"2024-09-12T18:36:24.524390+0000","last_fullsized":"2024-09-12T18:36:24.524390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:14.748234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.539334+0000","last_change":"2024-09-12T18:35:25.656566+0000","last_active":"2024-09-12T18:36:27.539334+0000","last_peered":"2024-09-12T18:36:27.539334+0000","last_clean":"2024-09-12T18:36:27.539334+0000","last_became_active":"2024-09-12T18:35:25.654898+0000","last_became_peered":"2024-09-12T18:35:25.654898+0000","last_unstale":"2024-09-12T18:36:27.539334+0000","last_undegraded":"2024-09-12T18:36:27.539334+0000","last_fullsized":"2024-09-12T18:36:27.539334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:36.113250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.521185+0000","last_change":"2024-09-12T18:35:25.652754+0000","last_active":"2024-09-12T18:36:24.521185+0000","last_peered":"2024-09-12T18:36:24.521185+0000","last_clean":"2024-09-12T18:36:24.521185+0000","last_became_active":"2024-09-12T18:35:25.651217+0000","last_became_peered":"2024-09-12T18:35:25.651217+0000","last_unstale":"2024-09-12T18:36:24.521185+0000","last_undegraded":"2024-09-12T18:36:24.521185+0000","last_fullsized":"2024-09-12T18:36:24.521185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:24.585774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.521278+0000","last_change":"2024-09-12T18:35:25.659811+0000","last_active":"2024-09-12T18:36:24.521278+0000","last_peered":"2024-09-12T18:36:24.521278+0000","last_clean":"2024-09-12T18:36:24.521278+0000","last_became_active":"2024-09-12T18:35:25.658998+0000","last_became_peered":"2024-09-12T18:35:25.658998+0000","last_unstale":"2024-09-12T18:36:24.521278+0000","last_undegraded":"2024-09-12T18:36:24.521278+0000","last_fullsized":"2024-09-12T18:36:24.521278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.520920+0000","last_change":"2024-09-12T18:35:25.653999+0000","last_active":"2024-09-12T18:36:24.520920+0000","last_peered":"2024-09-12T18:36:24.520920+0000","last_clean":"2024-09-12T18:36:24.520920+0000","last_became_active":"2024-09-12T18:35:25.653319+0000","last_became_peered":"2024-09-12T18:35:25.653319+0000","last_unstale":"2024-09-12T18:36:24.520920+0000","last_undegraded":"2024-09-12T18:36:24.520920+0000","last_fullsized":"2024-09-12T18:36:24.520920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:04.718000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.516676+0000","last_change":"2024-09-12T18:35:25.668339+0000","last_active":"2024-09-12T18:36:24.516676+0000","last_peered":"2024-09-12T18:36:24.516676+0000","last_clean":"2024-09-12T18:36:24.516676+0000","last_became_active":"2024-09-12T18:35:25.667608+0000","last_became_peered":"2024-09-12T18:35:25.667608+0000","last_unstale":"2024-09-12T18:36:24.516676+0000","last_undegraded":"2024-09-12T18:36:24.516676+0000","last_fullsized":"2024-09-12T18:36:24.516676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:15.699745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.537002+0000","last_change":"2024-09-12T18:35:25.660174+0000","last_active":"2024-09-12T18:36:27.537002+0000","last_peered":"2024-09-12T18:36:27.537002+0000","last_clean":"2024-09-12T18:36:27.537002+0000","last_became_active":"2024-09-12T18:35:25.656560+0000","last_became_peered":"2024-09-12T18:35:25.656560+0000","last_unstale":"2024-09-12T18:36:27.537002+0000","last_undegraded":"2024-09-12T18:36:27.537002+0000","last_fullsized":"2024-09-12T18:36:27.537002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:47.268505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.522203+0000","last_change":"2024-09-12T18:35:25.649858+0000","last_active":"2024-09-12T18:36:24.522203+0000","last_peered":"2024-09-12T18:36:24.522203+0000","last_clean":"2024-09-12T18:36:24.522203+0000","last_became_active":"2024-09-12T18:35:25.649090+0000","last_became_peered":"2024-09-12T18:35:25.649090+0000","last_unstale":"2024-09-12T18:36:24.522203+0000","last_undegraded":"2024-09-12T18:36:24.522203+0000","last_fullsized":"2024-09-12T18:36:24.522203+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:33.158421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.534943+0000","last_change":"2024-09-12T18:35:25.649885+0000","last_active":"2024-09-12T18:36:27.534943+0000","last_peered":"2024-09-12T18:36:27.534943+0000","last_clean":"2024-09-12T18:36:27.534943+0000","last_became_active":"2024-09-12T18:35:25.649111+0000","last_became_peered":"2024-09-12T18:35:25.649111+0000","last_unstale":"2024-09-12T18:36:27.534943+0000","last_undegraded":"2024-09-12T18:36:27.534943+0000","last_fullsized":"2024-09-12T18:36:27.534943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:17.162410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.539239+0000","last_change":"2024-09-12T18:35:25.651541+0000","last_active":"2024-09-12T18:36:27.539239+0000","last_peered":"2024-09-12T18:36:27.539239+0000","last_clean":"2024-09-12T18:36:27.539239+0000","last_became_active":"2024-09-12T18:35:25.650661+0000","last_became_peered":"2024-09-12T18:35:25.650661+0000","last_unstale":"2024-09-12T18:36:27.539239+0000","last_undegraded":"2024-09-12T18:36:27.539239+0000","last_fullsized":"2024-09-12T18:36:27.539239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:52.082734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.521343+0000","last_change":"2024-09-12T18:35:25.657913+0000","last_active":"2024-09-12T18:36:24.521343+0000","last_peered":"2024-09-12T18:36:24.521343+0000","last_clean":"2024-09-12T18:36:24.521343+0000","last_became_active":"2024-09-12T18:35:25.657082+0000","last_became_peered":"2024-09-12T18:35:25.657082+0000","last_unstale":"2024-09-12T18:36:24.521343+0000","last_undegraded":"2024-09-12T18:36:24.521343+0000","last_fullsized":"2024-09-12T18:36:24.521343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:21.538633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.521398+0000","last_change":"2024-09-12T18:35:25.658763+0000","last_active":"2024-09-12T18:36:24.521398+0000","last_peered":"2024-09-12T18:36:24.521398+0000","last_clean":"2024-09-12T18:36:24.521398+0000","last_became_active":"2024-09-12T18:35:25.657508+0000","last_became_peered":"2024-09-12T18:35:25.657508+0000","last_unstale":"2024-09-12T18:36:24.521398+0000","last_undegraded":"2024-09-12T18:36:24.521398+0000","last_fullsized":"2024-09-12T18:36:24.521398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:13.170519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.521053+0000","last_change":"2024-09-12T18:35:25.653730+0000","last_active":"2024-09-12T18:36:24.521053+0000","last_peered":"2024-09-12T18:36:24.521053+0000","last_clean":"2024-09-12T18:36:24.521053+0000","last_became_active":"2024-09-12T18:35:25.651535+0000","last_became_peered":"2024-09-12T18:35:25.651535+0000","last_unstale":"2024-09-12T18:36:24.521053+0000","last_undegraded":"2024-09-12T18:36:24.521053+0000","last_fullsized":"2024-09-12T18:36:24.521053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.517243+0000","last_change":"2024-09-12T18:35:25.656513+0000","last_active":"2024-09-12T18:36:24.517243+0000","last_peered":"2024-09-12T18:36:24.517243+0000","last_clean":"2024-09-12T18:36:24.517243+0000","last_became_active":"2024-09-12T18:35:25.653440+0000","last_became_peered":"2024-09-12T18:35:25.653440+0000","last_unstale":"2024-09-12T18:36:24.517243+0000","last_undegraded":"2024-09-12T18:36:24.517243+0000","last_fullsized":"2024-09-12T18:36:24.517243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:18.693161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.537113+0000","last_change":"2024-09-12T18:35:25.657991+0000","last_active":"2024-09-12T18:36:27.537113+0000","last_peered":"2024-09-12T18:36:27.537113+0000","last_clean":"2024-09-12T18:36:27.537113+0000","last_became_active":"2024-09-12T18:35:25.653934+0000","last_became_peered":"2024-09-12T18:35:25.653934+0000","last_unstale":"2024-09-12T18:36:27.537113+0000","last_undegraded":"2024-09-12T18:36:27.537113+0000","last_fullsized":"2024-09-12T18:36:27.537113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:05.418901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.518459+0000","last_change":"2024-09-12T18:35:25.658819+0000","last_active":"2024-09-12T18:36:24.518459+0000","last_peered":"2024-09-12T18:36:24.518459+0000","last_clean":"2024-09-12T18:36:24.518459+0000","last_became_active":"2024-09-12T18:35:25.656843+0000","last_became_peered":"2024-09-12T18:35:25.656843+0000","last_unstale":"2024-09-12T18:36:24.518459+0000","last_undegraded":"2024-09-12T18:36:24.518459+0000","last_fullsized":"2024-09-12T18:36:24.518459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:55.291963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.524490+0000","last_change":"2024-09-12T18:35:25.661176+0000","last_active":"2024-09-12T18:36:24.524490+0000","last_peered":"2024-09-12T18:36:24.524490+0000","last_clean":"2024-09-12T18:36:24.524490+0000","last_became_active":"2024-09-12T18:35:25.659534+0000","last_became_peered":"2024-09-12T18:35:25.659534+0000","last_unstale":"2024-09-12T18:36:24.524490+0000","last_undegraded":"2024-09-12T18:36:24.524490+0000","last_fullsized":"2024-09-12T18:36:24.524490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:40.145442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.523335+0000","last_change":"2024-09-12T18:35:25.650632+0000","last_active":"2024-09-12T18:36:24.523335+0000","last_peered":"2024-09-12T18:36:24.523335+0000","last_clean":"2024-09-12T18:36:24.523335+0000","last_became_active":"2024-09-12T18:35:25.649333+0000","last_became_peered":"2024-09-12T18:35:25.649333+0000","last_unstale":"2024-09-12T18:36:24.523335+0000","last_undegraded":"2024-09-12T18:36:24.523335+0000","last_fullsized":"2024-09-12T18:36:24.523335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:30.537572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.536624+0000","last_change":"2024-09-12T18:35:25.648245+0000","last_active":"2024-09-12T18:36:27.536624+0000","last_peered":"2024-09-12T18:36:27.536624+0000","last_clean":"2024-09-12T18:36:27.536624+0000","last_became_active":"2024-09-12T18:35:25.646357+0000","last_became_peered":"2024-09-12T18:35:25.646357+0000","last_unstale":"2024-09-12T18:36:27.536624+0000","last_undegraded":"2024-09-12T18:36:27.536624+0000","last_fullsized":"2024-09-12T18:36:27.536624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:05.662140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.514836+0000","last_change":"2024-09-12T18:35:25.661613+0000","last_active":"2024-09-12T18:36:24.514836+0000","last_peered":"2024-09-12T18:36:24.514836+0000","last_clean":"2024-09-12T18:36:24.514836+0000","last_became_active":"2024-09-12T18:35:25.658833+0000","last_became_peered":"2024-09-12T18:35:25.658833+0000","last_unstale":"2024-09-12T18:36:24.514836+0000","last_undegraded":"2024-09-12T18:36:24.514836+0000","last_fullsized":"2024-09-12T18:36:24.514836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:51.064080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.535432+0000","last_change":"2024-09-12T18:35:25.657782+0000","last_active":"2024-09-12T18:36:27.535432+0000","last_peered":"2024-09-12T18:36:27.535432+0000","last_clean":"2024-09-12T18:36:27.535432+0000","last_became_active":"2024-09-12T18:35:25.655295+0000","last_became_peered":"2024-09-12T18:35:25.655295+0000","last_unstale":"2024-09-12T18:36:27.535432+0000","last_undegraded":"2024-09-12T18:36:27.535432+0000","last_fullsized":"2024-09-12T18:36:27.535432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:37.744175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.535455+0000","last_change":"2024-09-12T18:35:25.654863+0000","last_active":"2024-09-12T18:36:27.535455+0000","last_peered":"2024-09-12T18:36:27.535455+0000","last_clean":"2024-09-12T18:36:27.535455+0000","last_became_active":"2024-09-12T18:35:25.650407+0000","last_became_peered":"2024-09-12T18:35:25.650407+0000","last_unstale":"2024-09-12T18:36:27.535455+0000","last_undegraded":"2024-09-12T18:36:27.535455+0000","last_fullsized":"2024-09-12T18:36:27.535455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:38.395666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.516913+0000","last_change":"2024-09-12T18:35:25.662414+0000","last_active":"2024-09-12T18:36:24.516913+0000","last_peered":"2024-09-12T18:36:24.516913+0000","last_clean":"2024-09-12T18:36:24.516913+0000","last_became_active":"2024-09-12T18:35:25.660126+0000","last_became_peered":"2024-09-12T18:35:25.660126+0000","last_unstale":"2024-09-12T18:36:24.516913+0000","last_undegraded":"2024-09-12T18:36:24.516913+0000","last_fullsized":"2024-09-12T18:36:24.516913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:48.437139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.522287+0000","last_change":"2024-09-12T18:35:25.661523+0000","last_active":"2024-09-12T18:36:24.522287+0000","last_peered":"2024-09-12T18:36:24.522287+0000","last_clean":"2024-09-12T18:36:24.522287+0000","last_became_active":"2024-09-12T18:35:25.659338+0000","last_became_peered":"2024-09-12T18:35:25.659338+0000","last_unstale":"2024-09-12T18:36:24.522287+0000","last_undegraded":"2024-09-12T18:36:24.522287+0000","last_fullsized":"2024-09-12T18:36:24.522287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:37.083820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.535223+0000","last_change":"2024-09-12T18:35:25.662445+0000","last_active":"2024-09-12T18:36:27.535223+0000","last_peered":"2024-09-12T18:36:27.535223+0000","last_clean":"2024-09-12T18:36:27.535223+0000","last_became_active":"2024-09-12T18:35:25.659496+0000","last_became_peered":"2024-09-12T18:35:25.659496+0000","last_unstale":"2024-09-12T18:36:27.535223+0000","last_undegraded":"2024-09-12T18:36:27.535223+0000","last_fullsized":"2024-09-12T18:36:27.535223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:03.270420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.516591+0000","last_change":"2024-09-12T18:35:25.662519+0000","last_active":"2024-09-12T18:36:24.516591+0000","last_peered":"2024-09-12T18:36:24.516591+0000","last_clean":"2024-09-12T18:36:24.516591+0000","last_became_active":"2024-09-12T18:35:25.652964+0000","last_became_peered":"2024-09-12T18:35:25.652964+0000","last_unstale":"2024-09-12T18:36:24.516591+0000","last_undegraded":"2024-09-12T18:36:24.516591+0000","last_fullsized":"2024-09-12T18:36:24.516591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:37.923468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.536822+0000","last_change":"2024-09-12T18:35:25.650507+0000","last_active":"2024-09-12T18:36:27.536822+0000","last_peered":"2024-09-12T18:36:27.536822+0000","last_clean":"2024-09-12T18:36:27.536822+0000","last_became_active":"2024-09-12T18:35:25.649415+0000","last_became_peered":"2024-09-12T18:35:25.649415+0000","last_unstale":"2024-09-12T18:36:27.536822+0000","last_undegraded":"2024-09-12T18:36:27.536822+0000","last_fullsized":"2024-09-12T18:36:27.536822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:23.081416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.514918+0000","last_change":"2024-09-12T18:35:25.653949+0000","last_active":"2024-09-12T18:36:24.514918+0000","last_peered":"2024-09-12T18:36:24.514918+0000","last_clean":"2024-09-12T18:36:24.514918+0000","last_became_active":"2024-09-12T18:35:25.652992+0000","last_became_peered":"2024-09-12T18:35:25.652992+0000","last_unstale":"2024-09-12T18:36:24.514918+0000","last_undegraded":"2024-09-12T18:36:24.514918+0000","last_fullsized":"2024-09-12T18:36:24.514918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:47.687372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.521061+0000","last_change":"2024-09-12T18:35:25.653159+0000","last_active":"2024-09-12T18:36:24.521061+0000","last_peered":"2024-09-12T18:36:24.521061+0000","last_clean":"2024-09-12T18:36:24.521061+0000","last_became_active":"2024-09-12T18:35:25.650551+0000","last_became_peered":"2024-09-12T18:35:25.650551+0000","last_unstale":"2024-09-12T18:36:24.521061+0000","last_undegraded":"2024-09-12T18:36:24.521061+0000","last_fullsized":"2024-09-12T18:36:24.521061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:16.245302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.535127+0000","last_change":"2024-09-12T18:35:25.651877+0000","last_active":"2024-09-12T18:36:27.535127+0000","last_peered":"2024-09-12T18:36:27.535127+0000","last_clean":"2024-09-12T18:36:27.535127+0000","last_became_active":"2024-09-12T18:35:25.651055+0000","last_became_peered":"2024-09-12T18:35:25.651055+0000","last_unstale":"2024-09-12T18:36:27.535127+0000","last_undegraded":"2024-09-12T18:36:27.535127+0000","last_fullsized":"2024-09-12T18:36:27.535127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:14.200080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":61,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.523527+0000","last_change":"2024-09-12T18:35:24.657739+0000","last_active":"2024-09-12T18:36:24.523527+0000","last_peered":"2024-09-12T18:36:24.523527+0000","last_clean":"2024-09-12T18:36:24.523527+0000","last_became_active":"2024-09-12T18:35:24.656208+0000","last_became_peered":"2024-09-12T18:35:24.656208+0000","last_unstale":"2024-09-12T18:36:24.523527+0000","last_undegraded":"2024-09-12T18:36:24.523527+0000","last_fullsized":"2024-09-12T18:36:24.523527+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:50.073716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.536554+0000","last_change":"2024-09-12T18:35:25.651651+0000","last_active":"2024-09-12T18:36:27.536554+0000","last_peered":"2024-09-12T18:36:27.536554+0000","last_clean":"2024-09-12T18:36:27.536554+0000","last_became_active":"2024-09-12T18:35:25.650849+0000","last_became_peered":"2024-09-12T18:35:25.650849+0000","last_unstale":"2024-09-12T18:36:27.536554+0000","last_undegraded":"2024-09-12T18:36:27.536554+0000","last_fullsized":"2024-09-12T18:36:27.536554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:18.555827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":59,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.517443+0000","last_change":"2024-09-12T18:35:24.656119+0000","last_active":"2024-09-12T18:36:24.517443+0000","last_peered":"2024-09-12T18:36:24.517443+0000","last_clean":"2024-09-12T18:36:24.517443+0000","last_became_active":"2024-09-12T18:35:24.653175+0000","last_became_peered":"2024-09-12T18:35:24.653175+0000","last_unstale":"2024-09-12T18:36:24.517443+0000","last_undegraded":"2024-09-12T18:36:24.517443+0000","last_fullsized":"2024-09-12T18:36:24.517443+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:00.551165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.517131+0000","last_change":"2024-09-12T18:35:25.655723+0000","last_active":"2024-09-12T18:36:24.517131+0000","last_peered":"2024-09-12T18:36:24.517131+0000","last_clean":"2024-09-12T18:36:24.517131+0000","last_became_active":"2024-09-12T18:35:25.653630+0000","last_became_peered":"2024-09-12T18:35:25.653630+0000","last_unstale":"2024-09-12T18:36:24.517131+0000","last_undegraded":"2024-09-12T18:36:24.517131+0000","last_fullsized":"2024-09-12T18:36:24.517131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:07.655792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":61,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.535811+0000","last_change":"2024-09-12T18:35:24.640096+0000","last_active":"2024-09-12T18:36:27.535811+0000","last_peered":"2024-09-12T18:36:27.535811+0000","last_clean":"2024-09-12T18:36:27.535811+0000","last_became_active":"2024-09-12T18:35:24.638230+0000","last_became_peered":"2024-09-12T18:35:24.638230+0000","last_unstale":"2024-09-12T18:36:27.535811+0000","last_undegraded":"2024-09-12T18:36:27.535811+0000","last_fullsized":"2024-09-12T18:36:27.535811+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:38.435296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.516759+0000","last_change":"2024-09-12T18:35:25.662692+0000","last_active":"2024-09-12T18:36:24.516759+0000","last_peered":"2024-09-12T18:36:24.516759+0000","last_clean":"2024-09-12T18:36:24.516759+0000","last_became_active":"2024-09-12T18:35:25.661885+0000","last_became_peered":"2024-09-12T18:35:25.661885+0000","last_unstale":"2024-09-12T18:36:24.516759+0000","last_undegraded":"2024-09-12T18:36:24.516759+0000","last_fullsized":"2024-09-12T18:36:24.516759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:41.264425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":67,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.521187+0000","last_change":"2024-09-12T18:35:24.653610+0000","last_active":"2024-09-12T18:36:24.521187+0000","last_peered":"2024-09-12T18:36:24.521187+0000","last_clean":"2024-09-12T18:36:24.521187+0000","last_became_active":"2024-09-12T18:35:24.652880+0000","last_became_peered":"2024-09-12T18:35:24.652880+0000","last_unstale":"2024-09-12T18:36:24.521187+0000","last_undegraded":"2024-09-12T18:36:24.521187+0000","last_fullsized":"2024-09-12T18:36:24.521187+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:57.636251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"41'6008","reported_seq":6057,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.469947+0000","last_change":"2024-09-12T18:35:44.771794+0000","last_active":"2024-09-12T18:36:26.469947+0000","last_peered":"2024-09-12T18:36:26.469947+0000","last_clean":"2024-09-12T18:36:26.469947+0000","last_became_active":"2024-09-12T18:35:44.771286+0000","last_became_peered":"2024-09-12T18:35:44.771286+0000","last_unstale":"2024-09-12T18:36:26.469947+0000","last_undegraded":"2024-09-12T18:36:26.469947+0000","last_fullsized":"2024-09-12T18:36:26.469947+0000","mapping_epoch":21,"log_start":"30'2300","ondisk_log_start":"30'2300","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3708,"log_dups_size":0,"ondisk_log_size":3708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:10.094729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393740288,"num_objects":6008,"num_object_clones":0,"num_object_copies":12016,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6008,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6008,"num_write_kb":384512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":60,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.524064+0000","last_change":"2024-09-12T18:35:24.653465+0000","last_active":"2024-09-12T18:36:24.524064+0000","last_peered":"2024-09-12T18:36:24.524064+0000","last_clean":"2024-09-12T18:36:24.524064+0000","last_became_active":"2024-09-12T18:35:24.652792+0000","last_became_peered":"2024-09-12T18:35:24.652792+0000","last_unstale":"2024-09-12T18:36:24.524064+0000","last_undegraded":"2024-09-12T18:36:24.524064+0000","last_fullsized":"2024-09-12T18:36:24.524064+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:14.588993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.534792+0000","last_change":"2024-09-12T18:35:25.655426+0000","last_active":"2024-09-12T18:36:27.534792+0000","last_peered":"2024-09-12T18:36:27.534792+0000","last_clean":"2024-09-12T18:36:27.534792+0000","last_became_active":"2024-09-12T18:35:25.648186+0000","last_became_peered":"2024-09-12T18:35:25.648186+0000","last_unstale":"2024-09-12T18:36:27.534792+0000","last_undegraded":"2024-09-12T18:36:27.534792+0000","last_fullsized":"2024-09-12T18:36:27.534792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:48.802815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"42'6180","reported_seq":6231,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:28.494331+0000","last_change":"2024-09-12T18:35:44.767860+0000","last_active":"2024-09-12T18:36:28.494331+0000","last_peered":"2024-09-12T18:36:28.494331+0000","last_clean":"2024-09-12T18:36:28.494331+0000","last_became_active":"2024-09-12T18:35:44.766986+0000","last_became_peered":"2024-09-12T18:35:44.766986+0000","last_unstale":"2024-09-12T18:36:28.494331+0000","last_undegraded":"2024-09-12T18:36:28.494331+0000","last_fullsized":"2024-09-12T18:36:28.494331+0000","mapping_epoch":21,"log_start":"29'2200","ondisk_log_start":"29'2200","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3980,"log_dups_size":0,"ondisk_log_size":3980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:49.109157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405012480,"num_objects":6180,"num_object_clones":0,"num_object_copies":12360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6180,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6180,"num_write_kb":395520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":63,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.537236+0000","last_change":"2024-09-12T18:35:24.648439+0000","last_active":"2024-09-12T18:36:27.537236+0000","last_peered":"2024-09-12T18:36:27.537236+0000","last_clean":"2024-09-12T18:36:27.537236+0000","last_became_active":"2024-09-12T18:35:24.647629+0000","last_became_peered":"2024-09-12T18:35:24.647629+0000","last_unstale":"2024-09-12T18:36:27.537236+0000","last_undegraded":"2024-09-12T18:36:27.537236+0000","last_fullsized":"2024-09-12T18:36:27.537236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:45.428223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.535728+0000","last_change":"2024-09-12T18:35:25.652496+0000","last_active":"2024-09-12T18:36:27.535728+0000","last_peered":"2024-09-12T18:36:27.535728+0000","last_clean":"2024-09-12T18:36:27.535728+0000","last_became_active":"2024-09-12T18:35:25.651628+0000","last_became_peered":"2024-09-12T18:35:25.651628+0000","last_unstale":"2024-09-12T18:36:27.535728+0000","last_undegraded":"2024-09-12T18:36:27.535728+0000","last_fullsized":"2024-09-12T18:36:27.535728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:44.920448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"42'6468","reported_seq":6519,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:28.502669+0000","last_change":"2024-09-12T18:35:44.767175+0000","last_active":"2024-09-12T18:36:28.502669+0000","last_peered":"2024-09-12T18:36:28.502669+0000","last_clean":"2024-09-12T18:36:28.502669+0000","last_became_active":"2024-09-12T18:35:44.766592+0000","last_became_peered":"2024-09-12T18:35:44.766592+0000","last_unstale":"2024-09-12T18:36:28.502669+0000","last_undegraded":"2024-09-12T18:36:28.502669+0000","last_fullsized":"2024-09-12T18:36:28.502669+0000","mapping_epoch":21,"log_start":"30'2500","ondisk_log_start":"30'2500","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3968,"log_dups_size":0,"ondisk_log_size":3968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:44.678279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423886848,"num_objects":6468,"num_object_clones":0,"num_object_copies":12936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6468,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6468,"num_write_kb":413952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":60,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.522670+0000","last_change":"2024-09-12T18:35:24.654976+0000","last_active":"2024-09-12T18:36:24.522670+0000","last_peered":"2024-09-12T18:36:24.522670+0000","last_clean":"2024-09-12T18:36:24.522670+0000","last_became_active":"2024-09-12T18:35:24.654264+0000","last_became_peered":"2024-09-12T18:35:24.654264+0000","last_unstale":"2024-09-12T18:36:24.522670+0000","last_undegraded":"2024-09-12T18:36:24.522670+0000","last_fullsized":"2024-09-12T18:36:24.522670+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:00.115408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.521458+0000","last_change":"2024-09-12T18:35:25.650577+0000","last_active":"2024-09-12T18:36:24.521458+0000","last_peered":"2024-09-12T18:36:24.521458+0000","last_clean":"2024-09-12T18:36:24.521458+0000","last_became_active":"2024-09-12T18:35:25.649172+0000","last_became_peered":"2024-09-12T18:35:25.649172+0000","last_unstale":"2024-09-12T18:36:24.521458+0000","last_undegraded":"2024-09-12T18:36:24.521458+0000","last_fullsized":"2024-09-12T18:36:24.521458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:55.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"41'6120","reported_seq":6169,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.468130+0000","last_change":"2024-09-12T18:35:44.763067+0000","last_active":"2024-09-12T18:36:26.468130+0000","last_peered":"2024-09-12T18:36:26.468130+0000","last_clean":"2024-09-12T18:36:26.468130+0000","last_became_active":"2024-09-12T18:35:44.762584+0000","last_became_peered":"2024-09-12T18:35:44.762584+0000","last_unstale":"2024-09-12T18:36:26.468130+0000","last_undegraded":"2024-09-12T18:36:26.468130+0000","last_fullsized":"2024-09-12T18:36:26.468130+0000","mapping_epoch":21,"log_start":"30'2500","ondisk_log_start":"30'2500","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3620,"log_dups_size":0,"ondisk_log_size":3620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:47.847399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":401080320,"num_objects":6120,"num_object_clones":0,"num_object_copies":12240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6120,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6120,"num_write_kb":391680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":59,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.524702+0000","last_change":"2024-09-12T18:35:24.657665+0000","last_active":"2024-09-12T18:36:24.524702+0000","last_peered":"2024-09-12T18:36:24.524702+0000","last_clean":"2024-09-12T18:36:24.524702+0000","last_became_active":"2024-09-12T18:35:24.657015+0000","last_became_peered":"2024-09-12T18:35:24.657015+0000","last_unstale":"2024-09-12T18:36:24.524702+0000","last_undegraded":"2024-09-12T18:36:24.524702+0000","last_fullsized":"2024-09-12T18:36:24.524702+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:03.171326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.516543+0000","last_change":"2024-09-12T18:35:25.665275+0000","last_active":"2024-09-12T18:36:24.516543+0000","last_peered":"2024-09-12T18:36:24.516543+0000","last_clean":"2024-09-12T18:36:24.516543+0000","last_became_active":"2024-09-12T18:35:25.659511+0000","last_became_peered":"2024-09-12T18:35:25.659511+0000","last_unstale":"2024-09-12T18:36:24.516543+0000","last_undegraded":"2024-09-12T18:36:24.516543+0000","last_fullsized":"2024-09-12T18:36:24.516543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"42'6394","reported_seq":6445,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:28.499015+0000","last_change":"2024-09-12T18:35:44.773526+0000","last_active":"2024-09-12T18:36:28.499015+0000","last_peered":"2024-09-12T18:36:28.499015+0000","last_clean":"2024-09-12T18:36:28.499015+0000","last_became_active":"2024-09-12T18:35:44.772974+0000","last_became_peered":"2024-09-12T18:35:44.772974+0000","last_unstale":"2024-09-12T18:36:28.499015+0000","last_undegraded":"2024-09-12T18:36:28.499015+0000","last_fullsized":"2024-09-12T18:36:28.499015+0000","mapping_epoch":21,"log_start":"30'2400","ondisk_log_start":"30'2400","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3994,"log_dups_size":0,"ondisk_log_size":3994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:23.676840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":419037184,"num_objects":6394,"num_object_clones":0,"num_object_copies":12788,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6394,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6394,"num_write_kb":409216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":61,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.516687+0000","last_change":"2024-09-12T18:35:24.651913+0000","last_active":"2024-09-12T18:36:24.516687+0000","last_peered":"2024-09-12T18:36:24.516687+0000","last_clean":"2024-09-12T18:36:24.516687+0000","last_became_active":"2024-09-12T18:35:24.650421+0000","last_became_peered":"2024-09-12T18:35:24.650421+0000","last_unstale":"2024-09-12T18:36:24.516687+0000","last_undegraded":"2024-09-12T18:36:24.516687+0000","last_fullsized":"2024-09-12T18:36:24.516687+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:57.685312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.524546+0000","last_change":"2024-09-12T18:35:25.651138+0000","last_active":"2024-09-12T18:36:24.524546+0000","last_peered":"2024-09-12T18:36:24.524546+0000","last_clean":"2024-09-12T18:36:24.524546+0000","last_became_active":"2024-09-12T18:35:25.650617+0000","last_became_peered":"2024-09-12T18:35:25.650617+0000","last_unstale":"2024-09-12T18:36:24.524546+0000","last_undegraded":"2024-09-12T18:36:24.524546+0000","last_fullsized":"2024-09-12T18:36:24.524546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:58.535066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"41'6036","reported_seq":6085,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.472038+0000","last_change":"2024-09-12T18:35:44.767970+0000","last_active":"2024-09-12T18:36:26.472038+0000","last_peered":"2024-09-12T18:36:26.472038+0000","last_clean":"2024-09-12T18:36:26.472038+0000","last_became_active":"2024-09-12T18:35:44.767348+0000","last_became_peered":"2024-09-12T18:35:44.767348+0000","last_unstale":"2024-09-12T18:36:26.472038+0000","last_undegraded":"2024-09-12T18:36:26.472038+0000","last_fullsized":"2024-09-12T18:36:26.472038+0000","mapping_epoch":21,"log_start":"30'2500","ondisk_log_start":"30'2500","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3536,"log_dups_size":0,"ondisk_log_size":3536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:48.745907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395575296,"num_objects":6036,"num_object_clones":0,"num_object_copies":12072,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6036,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6036,"num_write_kb":386304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":59,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.521753+0000","last_change":"2024-09-12T18:35:24.659019+0000","last_active":"2024-09-12T18:36:24.521753+0000","last_peered":"2024-09-12T18:36:24.521753+0000","last_clean":"2024-09-12T18:36:24.521753+0000","last_became_active":"2024-09-12T18:35:24.658423+0000","last_became_peered":"2024-09-12T18:35:24.658423+0000","last_unstale":"2024-09-12T18:36:24.521753+0000","last_undegraded":"2024-09-12T18:36:24.521753+0000","last_fullsized":"2024-09-12T18:36:24.521753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:37.668417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.522432+0000","last_change":"2024-09-12T18:35:25.662287+0000","last_active":"2024-09-12T18:36:24.522432+0000","last_peered":"2024-09-12T18:36:24.522432+0000","last_clean":"2024-09-12T18:36:24.522432+0000","last_became_active":"2024-09-12T18:35:25.660372+0000","last_became_peered":"2024-09-12T18:35:25.660372+0000","last_unstale":"2024-09-12T18:36:24.522432+0000","last_undegraded":"2024-09-12T18:36:24.522432+0000","last_fullsized":"2024-09-12T18:36:24.522432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:08.729541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.f","version":"41'6053","reported_seq":6101,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.480698+0000","last_change":"2024-09-12T18:35:44.774817+0000","last_active":"2024-09-12T18:36:26.480698+0000","last_peered":"2024-09-12T18:36:26.480698+0000","last_clean":"2024-09-12T18:36:26.480698+0000","last_became_active":"2024-09-12T18:35:44.774429+0000","last_became_peered":"2024-09-12T18:35:44.774429+0000","last_unstale":"2024-09-12T18:36:26.480698+0000","last_undegraded":"2024-09-12T18:36:26.480698+0000","last_fullsized":"2024-09-12T18:36:26.480698+0000","mapping_epoch":21,"log_start":"29'2300","ondisk_log_start":"29'2300","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3753,"log_dups_size":0,"ondisk_log_size":3753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:21.579103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":396689408,"num_objects":6053,"num_object_clones":0,"num_object_copies":12106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6053,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6053,"num_write_kb":387392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":61,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.535862+0000","last_change":"2024-09-12T18:35:24.648330+0000","last_active":"2024-09-12T18:36:27.535862+0000","last_peered":"2024-09-12T18:36:27.535862+0000","last_clean":"2024-09-12T18:36:27.535862+0000","last_became_active":"2024-09-12T18:35:24.647520+0000","last_became_peered":"2024-09-12T18:35:24.647520+0000","last_unstale":"2024-09-12T18:36:27.535862+0000","last_undegraded":"2024-09-12T18:36:27.535862+0000","last_fullsized":"2024-09-12T18:36:27.535862+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:25.552055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.523624+0000","last_change":"2024-09-12T18:35:25.658674+0000","last_active":"2024-09-12T18:36:24.523624+0000","last_peered":"2024-09-12T18:36:24.523624+0000","last_clean":"2024-09-12T18:36:24.523624+0000","last_became_active":"2024-09-12T18:35:25.657386+0000","last_became_peered":"2024-09-12T18:35:25.657386+0000","last_unstale":"2024-09-12T18:36:24.523624+0000","last_undegraded":"2024-09-12T18:36:24.523624+0000","last_fullsized":"2024-09-12T18:36:24.523624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:48.037086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"42'6433","reported_seq":6484,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:28.505626+0000","last_change":"2024-09-12T18:35:44.771738+0000","last_active":"2024-09-12T18:36:28.505626+0000","last_peered":"2024-09-12T18:36:28.505626+0000","last_clean":"2024-09-12T18:36:28.505626+0000","last_became_active":"2024-09-12T18:35:44.771227+0000","last_became_peered":"2024-09-12T18:35:44.771227+0000","last_unstale":"2024-09-12T18:36:28.505626+0000","last_undegraded":"2024-09-12T18:36:28.505626+0000","last_fullsized":"2024-09-12T18:36:28.505626+0000","mapping_epoch":21,"log_start":"30'2400","ondisk_log_start":"30'2400","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":4033,"log_dups_size":0,"ondisk_log_size":4033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:27.329732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421593088,"num_objects":6433,"num_object_clones":0,"num_object_copies":12866,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6433,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6433,"num_write_kb":411712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":61,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.534921+0000","last_change":"2024-09-12T18:35:24.646810+0000","last_active":"2024-09-12T18:36:27.534921+0000","last_peered":"2024-09-12T18:36:27.534921+0000","last_clean":"2024-09-12T18:36:27.534921+0000","last_became_active":"2024-09-12T18:35:24.646008+0000","last_became_peered":"2024-09-12T18:35:24.646008+0000","last_unstale":"2024-09-12T18:36:27.534921+0000","last_undegraded":"2024-09-12T18:36:27.534921+0000","last_fullsized":"2024-09-12T18:36:27.534921+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:43.888776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.516759+0000","last_change":"2024-09-12T18:35:25.667710+0000","last_active":"2024-09-12T18:36:24.516759+0000","last_peered":"2024-09-12T18:36:24.516759+0000","last_clean":"2024-09-12T18:36:24.516759+0000","last_became_active":"2024-09-12T18:35:25.666940+0000","last_became_peered":"2024-09-12T18:35:25.666940+0000","last_unstale":"2024-09-12T18:36:24.516759+0000","last_undegraded":"2024-09-12T18:36:24.516759+0000","last_fullsized":"2024-09-12T18:36:24.516759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:09.823085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"42'6237","reported_seq":6287,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:28.484204+0000","last_change":"2024-09-12T18:35:44.769127+0000","last_active":"2024-09-12T18:36:28.484204+0000","last_peered":"2024-09-12T18:36:28.484204+0000","last_clean":"2024-09-12T18:36:28.484204+0000","last_became_active":"2024-09-12T18:35:44.768382+0000","last_became_peered":"2024-09-12T18:35:44.768382+0000","last_unstale":"2024-09-12T18:36:28.484204+0000","last_undegraded":"2024-09-12T18:36:28.484204+0000","last_fullsized":"2024-09-12T18:36:28.484204+0000","mapping_epoch":21,"log_start":"29'2200","ondisk_log_start":"29'2200","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":4037,"log_dups_size":0,"ondisk_log_size":4037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:33.385476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408748032,"num_objects":6237,"num_object_clones":0,"num_object_copies":12474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6237,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6237,"num_write_kb":399168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":209,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.521325+0000","last_change":"2024-09-12T18:35:13.489018+0000","last_active":"2024-09-12T18:36:24.521325+0000","last_peered":"2024-09-12T18:36:24.521325+0000","last_clean":"2024-09-12T18:36:24.521325+0000","last_became_active":"2024-09-12T18:35:13.488346+0000","last_became_peered":"2024-09-12T18:35:13.488346+0000","last_unstale":"2024-09-12T18:36:24.521325+0000","last_undegraded":"2024-09-12T18:36:24.521325+0000","last_fullsized":"2024-09-12T18:36:24.521325+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_clean_scrub_stamp":"2024-09-12T18:35:12.464628+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:54.864640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":73,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.523633+0000","last_change":"2024-09-12T18:35:22.459694+0000","last_active":"2024-09-12T18:36:24.523633+0000","last_peered":"2024-09-12T18:36:24.523633+0000","last_clean":"2024-09-12T18:36:24.523633+0000","last_became_active":"2024-09-12T18:35:20.446796+0000","last_became_peered":"2024-09-12T18:35:20.446796+0000","last_unstale":"2024-09-12T18:36:24.523633+0000","last_undegraded":"2024-09-12T18:36:24.523633+0000","last_fullsized":"2024-09-12T18:36:24.523633+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:21.506024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016291610000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":59,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.517560+0000","last_change":"2024-09-12T18:35:24.651749+0000","last_active":"2024-09-12T18:36:24.517560+0000","last_peered":"2024-09-12T18:36:24.517560+0000","last_clean":"2024-09-12T18:36:24.517560+0000","last_became_active":"2024-09-12T18:35:24.649860+0000","last_became_peered":"2024-09-12T18:35:24.649860+0000","last_unstale":"2024-09-12T18:36:24.517560+0000","last_undegraded":"2024-09-12T18:36:24.517560+0000","last_fullsized":"2024-09-12T18:36:24.517560+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:35.430065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.522577+0000","last_change":"2024-09-12T18:35:25.662424+0000","last_active":"2024-09-12T18:36:24.522577+0000","last_peered":"2024-09-12T18:36:24.522577+0000","last_clean":"2024-09-12T18:36:24.522577+0000","last_became_active":"2024-09-12T18:35:25.661043+0000","last_became_peered":"2024-09-12T18:35:25.661043+0000","last_unstale":"2024-09-12T18:36:24.522577+0000","last_undegraded":"2024-09-12T18:36:24.522577+0000","last_fullsized":"2024-09-12T18:36:24.522577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:52.551802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.7","version":"41'6079","reported_seq":6128,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.482342+0000","last_change":"2024-09-12T18:35:44.774505+0000","last_active":"2024-09-12T18:36:26.482342+0000","last_peered":"2024-09-12T18:36:26.482342+0000","last_clean":"2024-09-12T18:36:26.482342+0000","last_became_active":"2024-09-12T18:35:44.774259+0000","last_became_peered":"2024-09-12T18:35:44.774259+0000","last_unstale":"2024-09-12T18:36:26.482342+0000","last_undegraded":"2024-09-12T18:36:26.482342+0000","last_fullsized":"2024-09-12T18:36:26.482342+0000","mapping_epoch":21,"log_start":"30'2300","ondisk_log_start":"30'2300","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3779,"log_dups_size":0,"ondisk_log_size":3779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:21.731670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398393344,"num_objects":6079,"num_object_clones":0,"num_object_copies":12158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6079,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6079,"num_write_kb":389056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":72,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.521432+0000","last_change":"2024-09-12T18:35:22.459090+0000","last_active":"2024-09-12T18:36:24.521432+0000","last_peered":"2024-09-12T18:36:24.521432+0000","last_clean":"2024-09-12T18:36:24.521432+0000","last_became_active":"2024-09-12T18:35:20.448553+0000","last_became_peered":"2024-09-12T18:35:20.448553+0000","last_unstale":"2024-09-12T18:36:24.521432+0000","last_undegraded":"2024-09-12T18:36:24.521432+0000","last_fullsized":"2024-09-12T18:36:24.521432+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:56.834808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001030836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":59,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.515156+0000","last_change":"2024-09-12T18:35:24.651597+0000","last_active":"2024-09-12T18:36:24.515156+0000","last_peered":"2024-09-12T18:36:24.515156+0000","last_clean":"2024-09-12T18:36:24.515156+0000","last_became_active":"2024-09-12T18:35:24.649940+0000","last_became_peered":"2024-09-12T18:35:24.649940+0000","last_unstale":"2024-09-12T18:36:24.515156+0000","last_undegraded":"2024-09-12T18:36:24.515156+0000","last_fullsized":"2024-09-12T18:36:24.515156+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:36.822432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.537185+0000","last_change":"2024-09-12T18:35:25.660529+0000","last_active":"2024-09-12T18:36:27.537185+0000","last_peered":"2024-09-12T18:36:27.537185+0000","last_clean":"2024-09-12T18:36:27.537185+0000","last_became_active":"2024-09-12T18:35:25.659537+0000","last_became_peered":"2024-09-12T18:35:25.659537+0000","last_unstale":"2024-09-12T18:36:27.537185+0000","last_undegraded":"2024-09-12T18:36:27.537185+0000","last_fullsized":"2024-09-12T18:36:27.537185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:51.790349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"41'6120","reported_seq":6168,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.475598+0000","last_change":"2024-09-12T18:35:44.770379+0000","last_active":"2024-09-12T18:36:26.475598+0000","last_peered":"2024-09-12T18:36:26.475598+0000","last_clean":"2024-09-12T18:36:26.475598+0000","last_became_active":"2024-09-12T18:35:44.769739+0000","last_became_peered":"2024-09-12T18:35:44.769739+0000","last_unstale":"2024-09-12T18:36:26.475598+0000","last_undegraded":"2024-09-12T18:36:26.475598+0000","last_fullsized":"2024-09-12T18:36:26.475598+0000","mapping_epoch":21,"log_start":"30'2500","ondisk_log_start":"30'2500","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3620,"log_dups_size":0,"ondisk_log_size":3620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:02:23.077263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":401080320,"num_objects":6120,"num_object_clones":0,"num_object_copies":12240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6120,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6120,"num_write_kb":391680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":72,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.515224+0000","last_change":"2024-09-12T18:35:22.464179+0000","last_active":"2024-09-12T18:36:24.515224+0000","last_peered":"2024-09-12T18:36:24.515224+0000","last_clean":"2024-09-12T18:36:24.515224+0000","last_became_active":"2024-09-12T18:35:20.442613+0000","last_became_peered":"2024-09-12T18:35:20.442613+0000","last_unstale":"2024-09-12T18:36:24.515224+0000","last_undegraded":"2024-09-12T18:36:24.515224+0000","last_fullsized":"2024-09-12T18:36:24.515224+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:17.636537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014134620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":61,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.535238+0000","last_change":"2024-09-12T18:35:24.641297+0000","last_active":"2024-09-12T18:36:27.535238+0000","last_peered":"2024-09-12T18:36:27.535238+0000","last_clean":"2024-09-12T18:36:27.535238+0000","last_became_active":"2024-09-12T18:35:24.637334+0000","last_became_peered":"2024-09-12T18:35:24.637334+0000","last_unstale":"2024-09-12T18:36:27.535238+0000","last_undegraded":"2024-09-12T18:36:27.535238+0000","last_fullsized":"2024-09-12T18:36:27.535238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:50.772074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.516864+0000","last_change":"2024-09-12T18:35:25.659209+0000","last_active":"2024-09-12T18:36:24.516864+0000","last_peered":"2024-09-12T18:36:24.516864+0000","last_clean":"2024-09-12T18:36:24.516864+0000","last_became_active":"2024-09-12T18:35:25.656170+0000","last_became_peered":"2024-09-12T18:35:25.656170+0000","last_unstale":"2024-09-12T18:36:24.516864+0000","last_undegraded":"2024-09-12T18:36:24.516864+0000","last_fullsized":"2024-09-12T18:36:24.516864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:40.925757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"41'6126","reported_seq":6175,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.478244+0000","last_change":"2024-09-12T18:35:44.770358+0000","last_active":"2024-09-12T18:36:26.478244+0000","last_peered":"2024-09-12T18:36:26.478244+0000","last_clean":"2024-09-12T18:36:26.478244+0000","last_became_active":"2024-09-12T18:35:44.769786+0000","last_became_peered":"2024-09-12T18:35:44.769786+0000","last_unstale":"2024-09-12T18:36:26.478244+0000","last_undegraded":"2024-09-12T18:36:26.478244+0000","last_fullsized":"2024-09-12T18:36:26.478244+0000","mapping_epoch":21,"log_start":"30'2500","ondisk_log_start":"30'2500","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3626,"log_dups_size":0,"ondisk_log_size":3626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:27.215502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":401473536,"num_objects":6126,"num_object_clones":0,"num_object_copies":12252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6126,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6126,"num_write_kb":392064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":74,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.521845+0000","last_change":"2024-09-12T18:35:22.459049+0000","last_active":"2024-09-12T18:36:24.521845+0000","last_peered":"2024-09-12T18:36:24.521845+0000","last_clean":"2024-09-12T18:36:24.521845+0000","last_became_active":"2024-09-12T18:35:20.446814+0000","last_became_peered":"2024-09-12T18:35:20.446814+0000","last_unstale":"2024-09-12T18:36:24.521845+0000","last_undegraded":"2024-09-12T18:36:24.521845+0000","last_fullsized":"2024-09-12T18:36:24.521845+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:18.033595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010716149999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":59,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.523581+0000","last_change":"2024-09-12T18:35:24.658273+0000","last_active":"2024-09-12T18:36:24.523581+0000","last_peered":"2024-09-12T18:36:24.523581+0000","last_clean":"2024-09-12T18:36:24.523581+0000","last_became_active":"2024-09-12T18:35:24.657433+0000","last_became_peered":"2024-09-12T18:35:24.657433+0000","last_unstale":"2024-09-12T18:36:24.523581+0000","last_undegraded":"2024-09-12T18:36:24.523581+0000","last_fullsized":"2024-09-12T18:36:24.523581+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:48.497218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.518554+0000","last_change":"2024-09-12T18:35:25.655830+0000","last_active":"2024-09-12T18:36:24.518554+0000","last_peered":"2024-09-12T18:36:24.518554+0000","last_clean":"2024-09-12T18:36:24.518554+0000","last_became_active":"2024-09-12T18:35:25.652126+0000","last_became_peered":"2024-09-12T18:35:25.652126+0000","last_unstale":"2024-09-12T18:36:24.518554+0000","last_undegraded":"2024-09-12T18:36:24.518554+0000","last_fullsized":"2024-09-12T18:36:24.518554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:04.080721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"41'5998","reported_seq":6047,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.466644+0000","last_change":"2024-09-12T18:35:44.770799+0000","last_active":"2024-09-12T18:36:26.466644+0000","last_peered":"2024-09-12T18:36:26.466644+0000","last_clean":"2024-09-12T18:36:26.466644+0000","last_became_active":"2024-09-12T18:35:44.770030+0000","last_became_peered":"2024-09-12T18:35:44.770030+0000","last_unstale":"2024-09-12T18:36:26.466644+0000","last_undegraded":"2024-09-12T18:36:26.466644+0000","last_fullsized":"2024-09-12T18:36:26.466644+0000","mapping_epoch":21,"log_start":"30'2400","ondisk_log_start":"30'2400","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3598,"log_dups_size":0,"ondisk_log_size":3598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:24.786452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393084928,"num_objects":5998,"num_object_clones":0,"num_object_copies":11996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5998,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5998,"num_write_kb":383872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":59,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.522778+0000","last_change":"2024-09-12T18:35:24.657618+0000","last_active":"2024-09-12T18:36:24.522778+0000","last_peered":"2024-09-12T18:36:24.522778+0000","last_clean":"2024-09-12T18:36:24.522778+0000","last_became_active":"2024-09-12T18:35:24.656741+0000","last_became_peered":"2024-09-12T18:35:24.656741+0000","last_unstale":"2024-09-12T18:36:24.522778+0000","last_undegraded":"2024-09-12T18:36:24.522778+0000","last_fullsized":"2024-09-12T18:36:24.522778+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:43.113104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":72,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.518698+0000","last_change":"2024-09-12T18:35:22.464180+0000","last_active":"2024-09-12T18:36:24.518698+0000","last_peered":"2024-09-12T18:36:24.518698+0000","last_clean":"2024-09-12T18:36:24.518698+0000","last_became_active":"2024-09-12T18:35:20.442566+0000","last_became_peered":"2024-09-12T18:35:20.442566+0000","last_unstale":"2024-09-12T18:36:24.518698+0000","last_undegraded":"2024-09-12T18:36:24.518698+0000","last_fullsized":"2024-09-12T18:36:24.518698+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:29.021710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001325786,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.536728+0000","last_change":"2024-09-12T18:35:25.650458+0000","last_active":"2024-09-12T18:36:27.536728+0000","last_peered":"2024-09-12T18:36:27.536728+0000","last_clean":"2024-09-12T18:36:27.536728+0000","last_became_active":"2024-09-12T18:35:25.648761+0000","last_became_peered":"2024-09-12T18:35:25.648761+0000","last_unstale":"2024-09-12T18:36:27.536728+0000","last_undegraded":"2024-09-12T18:36:27.536728+0000","last_fullsized":"2024-09-12T18:36:27.536728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:53.026950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"41'6011","reported_seq":6060,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.462105+0000","last_change":"2024-09-12T18:35:44.773801+0000","last_active":"2024-09-12T18:36:26.462105+0000","last_peered":"2024-09-12T18:36:26.462105+0000","last_clean":"2024-09-12T18:36:26.462105+0000","last_became_active":"2024-09-12T18:35:44.772787+0000","last_became_peered":"2024-09-12T18:35:44.772787+0000","last_unstale":"2024-09-12T18:36:26.462105+0000","last_undegraded":"2024-09-12T18:36:26.462105+0000","last_fullsized":"2024-09-12T18:36:26.462105+0000","mapping_epoch":21,"log_start":"30'2300","ondisk_log_start":"30'2300","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3711,"log_dups_size":0,"ondisk_log_size":3711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:13.758208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393936896,"num_objects":6011,"num_object_clones":0,"num_object_copies":12022,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6011,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6011,"num_write_kb":384704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":59,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.518637+0000","last_change":"2024-09-12T18:35:24.649669+0000","last_active":"2024-09-12T18:36:24.518637+0000","last_peered":"2024-09-12T18:36:24.518637+0000","last_clean":"2024-09-12T18:36:24.518637+0000","last_became_active":"2024-09-12T18:35:24.648881+0000","last_became_peered":"2024-09-12T18:35:24.648881+0000","last_unstale":"2024-09-12T18:36:24.518637+0000","last_undegraded":"2024-09-12T18:36:24.518637+0000","last_fullsized":"2024-09-12T18:36:24.518637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:23.614734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":74,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.536821+0000","last_change":"2024-09-12T18:35:22.458666+0000","last_active":"2024-09-12T18:36:27.536821+0000","last_peered":"2024-09-12T18:36:27.536821+0000","last_clean":"2024-09-12T18:36:27.536821+0000","last_became_active":"2024-09-12T18:35:20.442394+0000","last_became_peered":"2024-09-12T18:35:20.442394+0000","last_unstale":"2024-09-12T18:36:27.536821+0000","last_undegraded":"2024-09-12T18:36:27.536821+0000","last_fullsized":"2024-09-12T18:36:27.536821+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:51.840246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080163599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.539243+0000","last_change":"2024-09-12T18:35:25.650717+0000","last_active":"2024-09-12T18:36:27.539243+0000","last_peered":"2024-09-12T18:36:27.539243+0000","last_clean":"2024-09-12T18:36:27.539243+0000","last_became_active":"2024-09-12T18:35:25.649147+0000","last_became_peered":"2024-09-12T18:35:25.649147+0000","last_unstale":"2024-09-12T18:36:27.539243+0000","last_undegraded":"2024-09-12T18:36:27.539243+0000","last_fullsized":"2024-09-12T18:36:27.539243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:07.365888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"41'6045","reported_seq":6094,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.459288+0000","last_change":"2024-09-12T18:35:44.774031+0000","last_active":"2024-09-12T18:36:26.459288+0000","last_peered":"2024-09-12T18:36:26.459288+0000","last_clean":"2024-09-12T18:36:26.459288+0000","last_became_active":"2024-09-12T18:35:44.772874+0000","last_became_peered":"2024-09-12T18:35:44.772874+0000","last_unstale":"2024-09-12T18:36:26.459288+0000","last_undegraded":"2024-09-12T18:36:26.459288+0000","last_fullsized":"2024-09-12T18:36:26.459288+0000","mapping_epoch":21,"log_start":"30'2300","ondisk_log_start":"30'2300","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3745,"log_dups_size":0,"ondisk_log_size":3745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:27.897491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":396165120,"num_objects":6045,"num_object_clones":0,"num_object_copies":12090,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6045,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6045,"num_write_kb":386880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":61,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.517321+0000","last_change":"2024-09-12T18:35:24.657234+0000","last_active":"2024-09-12T18:36:24.517321+0000","last_peered":"2024-09-12T18:36:24.517321+0000","last_clean":"2024-09-12T18:36:24.517321+0000","last_became_active":"2024-09-12T18:35:24.655950+0000","last_became_peered":"2024-09-12T18:35:24.655950+0000","last_unstale":"2024-09-12T18:36:24.517321+0000","last_undegraded":"2024-09-12T18:36:24.517321+0000","last_fullsized":"2024-09-12T18:36:24.517321+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:17.466623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":72,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.517208+0000","last_change":"2024-09-12T18:35:22.464656+0000","last_active":"2024-09-12T18:36:24.517208+0000","last_peered":"2024-09-12T18:36:24.517208+0000","last_clean":"2024-09-12T18:36:24.517208+0000","last_became_active":"2024-09-12T18:35:20.445470+0000","last_became_peered":"2024-09-12T18:35:20.445470+0000","last_unstale":"2024-09-12T18:36:24.517208+0000","last_undegraded":"2024-09-12T18:36:24.517208+0000","last_fullsized":"2024-09-12T18:36:24.517208+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:58.947359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001742681,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.514935+0000","last_change":"2024-09-12T18:35:25.658887+0000","last_active":"2024-09-12T18:36:24.514935+0000","last_peered":"2024-09-12T18:36:24.514935+0000","last_clean":"2024-09-12T18:36:24.514935+0000","last_became_active":"2024-09-12T18:35:25.656829+0000","last_became_peered":"2024-09-12T18:35:25.656829+0000","last_unstale":"2024-09-12T18:36:24.514935+0000","last_undegraded":"2024-09-12T18:36:24.514935+0000","last_fullsized":"2024-09-12T18:36:24.514935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:50.109858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"42'6435","reported_seq":6486,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:28.469139+0000","last_change":"2024-09-12T18:35:44.767276+0000","last_active":"2024-09-12T18:36:28.469139+0000","last_peered":"2024-09-12T18:36:28.469139+0000","last_clean":"2024-09-12T18:36:28.469139+0000","last_became_active":"2024-09-12T18:35:44.766145+0000","last_became_peered":"2024-09-12T18:35:44.766145+0000","last_unstale":"2024-09-12T18:36:28.469139+0000","last_undegraded":"2024-09-12T18:36:28.469139+0000","last_fullsized":"2024-09-12T18:36:28.469139+0000","mapping_epoch":21,"log_start":"30'2400","ondisk_log_start":"30'2400","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":4035,"log_dups_size":0,"ondisk_log_size":4035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:47.423493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421724160,"num_objects":6435,"num_object_clones":0,"num_object_copies":12870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6435,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6435,"num_write_kb":411840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":60,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.517165+0000","last_change":"2024-09-12T18:35:24.654518+0000","last_active":"2024-09-12T18:36:24.517165+0000","last_peered":"2024-09-12T18:36:24.517165+0000","last_clean":"2024-09-12T18:36:24.517165+0000","last_became_active":"2024-09-12T18:35:24.650309+0000","last_became_peered":"2024-09-12T18:35:24.650309+0000","last_unstale":"2024-09-12T18:36:24.517165+0000","last_undegraded":"2024-09-12T18:36:24.517165+0000","last_fullsized":"2024-09-12T18:36:24.517165+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:16.669035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":72,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.524161+0000","last_change":"2024-09-12T18:35:22.459767+0000","last_active":"2024-09-12T18:36:24.524161+0000","last_peered":"2024-09-12T18:36:24.524161+0000","last_clean":"2024-09-12T18:36:24.524161+0000","last_became_active":"2024-09-12T18:35:20.448521+0000","last_became_peered":"2024-09-12T18:35:20.448521+0000","last_unstale":"2024-09-12T18:36:24.524161+0000","last_undegraded":"2024-09-12T18:36:24.524161+0000","last_fullsized":"2024-09-12T18:36:24.524161+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:33.463792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017009670000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.535777+0000","last_change":"2024-09-12T18:35:25.648150+0000","last_active":"2024-09-12T18:36:27.535777+0000","last_peered":"2024-09-12T18:36:27.535777+0000","last_clean":"2024-09-12T18:36:27.535777+0000","last_became_active":"2024-09-12T18:35:25.647347+0000","last_became_peered":"2024-09-12T18:35:25.647347+0000","last_unstale":"2024-09-12T18:36:27.535777+0000","last_undegraded":"2024-09-12T18:36:27.535777+0000","last_fullsized":"2024-09-12T18:36:27.535777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:48.968336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.523433+0000","last_change":"2024-09-12T18:35:25.660696+0000","last_active":"2024-09-12T18:36:24.523433+0000","last_peered":"2024-09-12T18:36:24.523433+0000","last_clean":"2024-09-12T18:36:24.523433+0000","last_became_active":"2024-09-12T18:35:25.659827+0000","last_became_peered":"2024-09-12T18:35:25.659827+0000","last_unstale":"2024-09-12T18:36:24.523433+0000","last_undegraded":"2024-09-12T18:36:24.523433+0000","last_fullsized":"2024-09-12T18:36:24.523433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:15.678289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":65,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.524639+0000","last_change":"2024-09-12T18:35:24.655051+0000","last_active":"2024-09-12T18:36:24.524639+0000","last_peered":"2024-09-12T18:36:24.524639+0000","last_clean":"2024-09-12T18:36:24.524639+0000","last_became_active":"2024-09-12T18:35:24.654282+0000","last_became_peered":"2024-09-12T18:35:24.654282+0000","last_unstale":"2024-09-12T18:36:24.524639+0000","last_undegraded":"2024-09-12T18:36:24.524639+0000","last_fullsized":"2024-09-12T18:36:24.524639+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:08.159799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.517325+0000","last_change":"2024-09-12T18:35:25.659237+0000","last_active":"2024-09-12T18:36:24.517325+0000","last_peered":"2024-09-12T18:36:24.517325+0000","last_clean":"2024-09-12T18:36:24.517325+0000","last_became_active":"2024-09-12T18:35:25.658423+0000","last_became_peered":"2024-09-12T18:35:25.658423+0000","last_unstale":"2024-09-12T18:36:24.517325+0000","last_undegraded":"2024-09-12T18:36:24.517325+0000","last_fullsized":"2024-09-12T18:36:24.517325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:42.956934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":64,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.536693+0000","last_change":"2024-09-12T18:35:24.648658+0000","last_active":"2024-09-12T18:36:27.536693+0000","last_peered":"2024-09-12T18:36:27.536693+0000","last_clean":"2024-09-12T18:36:27.536693+0000","last_became_active":"2024-09-12T18:35:24.647826+0000","last_became_peered":"2024-09-12T18:35:24.647826+0000","last_unstale":"2024-09-12T18:36:27.536693+0000","last_undegraded":"2024-09-12T18:36:27.536693+0000","last_fullsized":"2024-09-12T18:36:27.536693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:24.167549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":59,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.523729+0000","last_change":"2024-09-12T18:35:24.656855+0000","last_active":"2024-09-12T18:36:24.523729+0000","last_peered":"2024-09-12T18:36:24.523729+0000","last_clean":"2024-09-12T18:36:24.523729+0000","last_became_active":"2024-09-12T18:35:24.655935+0000","last_became_peered":"2024-09-12T18:35:24.655935+0000","last_unstale":"2024-09-12T18:36:24.523729+0000","last_undegraded":"2024-09-12T18:36:24.523729+0000","last_fullsized":"2024-09-12T18:36:24.523729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:35.430065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.514991+0000","last_change":"2024-09-12T18:35:25.661801+0000","last_active":"2024-09-12T18:36:24.514991+0000","last_peered":"2024-09-12T18:36:24.514991+0000","last_clean":"2024-09-12T18:36:24.514991+0000","last_became_active":"2024-09-12T18:35:25.658476+0000","last_became_peered":"2024-09-12T18:35:25.658476+0000","last_unstale":"2024-09-12T18:36:24.514991+0000","last_undegraded":"2024-09-12T18:36:24.514991+0000","last_fullsized":"2024-09-12T18:36:24.514991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:58.246449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":59,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.517169+0000","last_change":"2024-09-12T18:35:24.652399+0000","last_active":"2024-09-12T18:36:24.517169+0000","last_peered":"2024-09-12T18:36:24.517169+0000","last_clean":"2024-09-12T18:36:24.517169+0000","last_became_active":"2024-09-12T18:35:24.651416+0000","last_became_peered":"2024-09-12T18:35:24.651416+0000","last_unstale":"2024-09-12T18:36:24.517169+0000","last_undegraded":"2024-09-12T18:36:24.517169+0000","last_fullsized":"2024-09-12T18:36:24.517169+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:32.594978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.514862+0000","last_change":"2024-09-12T18:35:25.658570+0000","last_active":"2024-09-12T18:36:24.514862+0000","last_peered":"2024-09-12T18:36:24.514862+0000","last_clean":"2024-09-12T18:36:24.514862+0000","last_became_active":"2024-09-12T18:35:25.656561+0000","last_became_peered":"2024-09-12T18:35:25.656561+0000","last_unstale":"2024-09-12T18:36:24.514862+0000","last_undegraded":"2024-09-12T18:36:24.514862+0000","last_fullsized":"2024-09-12T18:36:24.514862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:22.225756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.535528+0000","last_change":"2024-09-12T18:35:25.651217+0000","last_active":"2024-09-12T18:36:27.535528+0000","last_peered":"2024-09-12T18:36:27.535528+0000","last_clean":"2024-09-12T18:36:27.535528+0000","last_became_active":"2024-09-12T18:35:25.649544+0000","last_became_peered":"2024-09-12T18:35:25.649544+0000","last_unstale":"2024-09-12T18:36:27.535528+0000","last_undegraded":"2024-09-12T18:36:27.535528+0000","last_fullsized":"2024-09-12T18:36:27.535528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:41.601376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":59,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.515054+0000","last_change":"2024-09-12T18:35:24.657489+0000","last_active":"2024-09-12T18:36:24.515054+0000","last_peered":"2024-09-12T18:36:24.515054+0000","last_clean":"2024-09-12T18:36:24.515054+0000","last_became_active":"2024-09-12T18:35:24.656030+0000","last_became_peered":"2024-09-12T18:35:24.656030+0000","last_unstale":"2024-09-12T18:36:24.515054+0000","last_undegraded":"2024-09-12T18:36:24.515054+0000","last_fullsized":"2024-09-12T18:36:24.515054+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:11.362759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.516838+0000","last_change":"2024-09-12T18:35:25.661544+0000","last_active":"2024-09-12T18:36:24.516838+0000","last_peered":"2024-09-12T18:36:24.516838+0000","last_clean":"2024-09-12T18:36:24.516838+0000","last_became_active":"2024-09-12T18:35:25.656985+0000","last_became_peered":"2024-09-12T18:35:25.656985+0000","last_unstale":"2024-09-12T18:36:24.516838+0000","last_undegraded":"2024-09-12T18:36:24.516838+0000","last_fullsized":"2024-09-12T18:36:24.516838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":59,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.515112+0000","last_change":"2024-09-12T18:35:24.646342+0000","last_active":"2024-09-12T18:36:24.515112+0000","last_peered":"2024-09-12T18:36:24.515112+0000","last_clean":"2024-09-12T18:36:24.515112+0000","last_became_active":"2024-09-12T18:35:24.644773+0000","last_became_peered":"2024-09-12T18:35:24.644773+0000","last_unstale":"2024-09-12T18:36:24.515112+0000","last_undegraded":"2024-09-12T18:36:24.515112+0000","last_fullsized":"2024-09-12T18:36:24.515112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:17.011231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.536454+0000","last_change":"2024-09-12T18:35:25.656712+0000","last_active":"2024-09-12T18:36:27.536454+0000","last_peered":"2024-09-12T18:36:27.536454+0000","last_clean":"2024-09-12T18:36:27.536454+0000","last_became_active":"2024-09-12T18:35:25.654473+0000","last_became_peered":"2024-09-12T18:35:25.654473+0000","last_unstale":"2024-09-12T18:36:27.536454+0000","last_undegraded":"2024-09-12T18:36:27.536454+0000","last_fullsized":"2024-09-12T18:36:27.536454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:01.464680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":62,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.536923+0000","last_change":"2024-09-12T18:35:24.659935+0000","last_active":"2024-09-12T18:36:27.536923+0000","last_peered":"2024-09-12T18:36:27.536923+0000","last_clean":"2024-09-12T18:36:27.536923+0000","last_became_active":"2024-09-12T18:35:24.659111+0000","last_became_peered":"2024-09-12T18:35:24.659111+0000","last_unstale":"2024-09-12T18:36:27.536923+0000","last_undegraded":"2024-09-12T18:36:27.536923+0000","last_fullsized":"2024-09-12T18:36:27.536923+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:11.480154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.535030+0000","last_change":"2024-09-12T18:35:25.660557+0000","last_active":"2024-09-12T18:36:27.535030+0000","last_peered":"2024-09-12T18:36:27.535030+0000","last_clean":"2024-09-12T18:36:27.535030+0000","last_became_active":"2024-09-12T18:35:25.652300+0000","last_became_peered":"2024-09-12T18:35:25.652300+0000","last_unstale":"2024-09-12T18:36:27.535030+0000","last_undegraded":"2024-09-12T18:36:27.535030+0000","last_fullsized":"2024-09-12T18:36:27.535030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:10:59.995841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":62,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.539341+0000","last_change":"2024-09-12T18:35:24.638538+0000","last_active":"2024-09-12T18:36:27.539341+0000","last_peered":"2024-09-12T18:36:27.539341+0000","last_clean":"2024-09-12T18:36:27.539341+0000","last_became_active":"2024-09-12T18:35:24.637242+0000","last_became_peered":"2024-09-12T18:35:24.637242+0000","last_unstale":"2024-09-12T18:36:27.539341+0000","last_undegraded":"2024-09-12T18:36:27.539341+0000","last_fullsized":"2024-09-12T18:36:27.539341+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:26.877441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.523405+0000","last_change":"2024-09-12T18:35:25.662537+0000","last_active":"2024-09-12T18:36:24.523405+0000","last_peered":"2024-09-12T18:36:24.523405+0000","last_clean":"2024-09-12T18:36:24.523405+0000","last_became_active":"2024-09-12T18:35:25.661441+0000","last_became_peered":"2024-09-12T18:35:25.661441+0000","last_unstale":"2024-09-12T18:36:24.523405+0000","last_undegraded":"2024-09-12T18:36:24.523405+0000","last_fullsized":"2024-09-12T18:36:24.523405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:14.397867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":61,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.524609+0000","last_change":"2024-09-12T18:35:24.657635+0000","last_active":"2024-09-12T18:36:24.524609+0000","last_peered":"2024-09-12T18:36:24.524609+0000","last_clean":"2024-09-12T18:36:24.524609+0000","last_became_active":"2024-09-12T18:35:24.655992+0000","last_became_peered":"2024-09-12T18:35:24.655992+0000","last_unstale":"2024-09-12T18:36:24.524609+0000","last_undegraded":"2024-09-12T18:36:24.524609+0000","last_fullsized":"2024-09-12T18:36:24.524609+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:33.536755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.521657+0000","last_change":"2024-09-12T18:35:25.651406+0000","last_active":"2024-09-12T18:36:24.521657+0000","last_peered":"2024-09-12T18:36:24.521657+0000","last_clean":"2024-09-12T18:36:24.521657+0000","last_became_active":"2024-09-12T18:35:25.649728+0000","last_became_peered":"2024-09-12T18:35:25.649728+0000","last_unstale":"2024-09-12T18:36:24.521657+0000","last_undegraded":"2024-09-12T18:36:24.521657+0000","last_fullsized":"2024-09-12T18:36:24.521657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:41.773283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":63,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.536583+0000","last_change":"2024-09-12T18:35:24.649153+0000","last_active":"2024-09-12T18:36:27.536583+0000","last_peered":"2024-09-12T18:36:27.536583+0000","last_clean":"2024-09-12T18:36:27.536583+0000","last_became_active":"2024-09-12T18:35:24.648512+0000","last_became_peered":"2024-09-12T18:35:24.648512+0000","last_unstale":"2024-09-12T18:36:27.536583+0000","last_undegraded":"2024-09-12T18:36:27.536583+0000","last_fullsized":"2024-09-12T18:36:27.536583+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:07.810456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":59,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.535888+0000","last_change":"2024-09-12T18:35:25.656799+0000","last_active":"2024-09-12T18:36:27.535888+0000","last_peered":"2024-09-12T18:36:27.535888+0000","last_clean":"2024-09-12T18:36:27.535888+0000","last_became_active":"2024-09-12T18:35:25.654980+0000","last_became_peered":"2024-09-12T18:35:25.654980+0000","last_unstale":"2024-09-12T18:36:27.535888+0000","last_undegraded":"2024-09-12T18:36:27.535888+0000","last_fullsized":"2024-09-12T18:36:27.535888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:10.735439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":60,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.517060+0000","last_change":"2024-09-12T18:35:24.656268+0000","last_active":"2024-09-12T18:36:24.517060+0000","last_peered":"2024-09-12T18:36:24.517060+0000","last_clean":"2024-09-12T18:36:24.517060+0000","last_became_active":"2024-09-12T18:35:24.655420+0000","last_became_peered":"2024-09-12T18:35:24.655420+0000","last_unstale":"2024-09-12T18:36:24.517060+0000","last_undegraded":"2024-09-12T18:36:24.517060+0000","last_fullsized":"2024-09-12T18:36:24.517060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:04.654666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.521208+0000","last_change":"2024-09-12T18:35:25.661042+0000","last_active":"2024-09-12T18:36:24.521208+0000","last_peered":"2024-09-12T18:36:24.521208+0000","last_clean":"2024-09-12T18:36:24.521208+0000","last_became_active":"2024-09-12T18:35:25.660163+0000","last_became_peered":"2024-09-12T18:35:25.660163+0000","last_unstale":"2024-09-12T18:36:24.521208+0000","last_undegraded":"2024-09-12T18:36:24.521208+0000","last_fullsized":"2024-09-12T18:36:24.521208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:37.682184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":63,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.517028+0000","last_change":"2024-09-12T18:35:24.652304+0000","last_active":"2024-09-12T18:36:24.517028+0000","last_peered":"2024-09-12T18:36:24.517028+0000","last_clean":"2024-09-12T18:36:24.517028+0000","last_became_active":"2024-09-12T18:35:24.651460+0000","last_became_peered":"2024-09-12T18:35:24.651460+0000","last_unstale":"2024-09-12T18:36:24.517028+0000","last_undegraded":"2024-09-12T18:36:24.517028+0000","last_fullsized":"2024-09-12T18:36:24.517028+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:42.050557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":6471221248,"num_objects":98743,"num_object_clones":0,"num_object_copies":197486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98743,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98743,"num_write_kb":6319552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":805425152,"data_stored":12886802432,"data_compressed":611932859,"data_compressed_allocated":805425152,"data_compressed_original":12886802432,"omap_allocated":0,"internal_metadata":0},"log_size":60743,"ondisk_log_size":60743,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705682,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310092,"kb_used_data":224752,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94061748,"statfs":{"total":96636764160,"available":96319229952,"internally_reserved":0,"allocated":230146048,"data_stored":3674574602,"data_compressed":174486602,"data_compressed_allocated":229658624,"data_compressed_original":3674390528,"omap_allocated":1594,"internal_metadata":87357894},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,0,5,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738386,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":341108,"kb_used_data":237728,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94030732,"statfs":{"total":96636764160,"available":96287469568,"internally_reserved":0,"allocated":243433472,"data_stored":3887169444,"data_compressed":184581843,"data_compressed_allocated":242946048,"data_compressed_original":3886989312,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738386,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":444980,"kb_used_data":315232,"kb_used_omap":1,"kb_used_meta":129726,"kb_avail":93926860,"statfs":{"total":96636764160,"available":96181104640,"internally_reserved":0,"allocated":322797568,"data_stored":5157844610,"data_compressed":244913483,"data_compressed_allocated":322355200,"data_compressed_original":5157683200,"omap_allocated":1594,"internal_metadata":132839878},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,6,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":323432448,"data_stored":5174919168,"data_compressed":245731939,"data_compressed_allocated":323432448,"data_compressed_original":5174919168,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":233857024,"data_stored":3741712384,"data_compressed":177676663,"data_compressed_allocated":233857024,"data_compressed_original":3741712384,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":248135680,"data_stored":3970170880,"data_compressed":188524257,"data_compressed_allocated":248135680,"data_compressed_original":3970170880,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:36:31.405 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-12T18:36:31.405 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:36:31.405 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-12T18:36:31.405 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T18:36:31.406 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:31.399+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:31.466 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:36:31.466 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:36:31.466 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.466 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:107390 5.9 5.3faafaf9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:36:31.466 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:31.461326+0000", 2024-09-12T18:36:31.466 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0028435550000000002, 2024-09-12T18:36:31.466 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028636930000000001, 2024-09-12T18:36:31.466 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:31.466 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:31.466 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:31.466 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:31.467 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:31.467 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:31.467 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 107390 2024-09-12T18:36:31.467 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.467 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:31.467 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.467 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:31.467 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.461326+0000", 2024-09-12T18:36:31.467 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.467 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.467 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.467 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:31.467 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.461326+0000", 2024-09-12T18:36:31.468 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.468 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.468 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.468 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:31.468 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.461326+0000", 2024-09-12T18:36:31.468 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.3900000000000004e-07 2024-09-12T18:36:31.468 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.468 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.468 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:31.468 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.461381+0000", 2024-09-12T18:36:31.468 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4948000000000003e-05 2024-09-12T18:36:31.468 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.468 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.468 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:31.469 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.461405+0000", 2024-09-12T18:36:31.469 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.3674999999999999e-05 2024-09-12T18:36:31.469 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.469 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.469 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.469 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.461411+0000", 2024-09-12T18:36:31.469 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9730000000000002e-06 2024-09-12T18:36:31.469 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.469 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:31.469 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.469 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.469 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.469 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:107391 5.f 5:f9ee2b38:::benchmark_data_smithi073_23739_object107390:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:36:31.470 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:31.461435+0000", 2024-09-12T18:36:31.470 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.002733648, 2024-09-12T18:36:31.470 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028220799999999998, 2024-09-12T18:36:31.470 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:31.470 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:31.470 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:31.470 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:31.470 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:31.470 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:31.470 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 107391 2024-09-12T18:36:31.470 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.470 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:31.471 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.471 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:31.471 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.461435+0000", 2024-09-12T18:36:31.471 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.471 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.471 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.471 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:31.471 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.461435+0000", 2024-09-12T18:36:31.471 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.471 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.471 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.471 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:31.471 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.461436+0000", 2024-09-12T18:36:31.471 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4199999999999996e-07 2024-09-12T18:36:31.472 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.472 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.472 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:31.472 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.461470+0000", 2024-09-12T18:36:31.472 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.4184999999999999e-05 2024-09-12T18:36:31.472 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.472 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.472 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:31.472 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.461480+0000", 2024-09-12T18:36:31.472 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.6600000000000007e-06 2024-09-12T18:36:31.472 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.472 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.472 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.473 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.461485+0000", 2024-09-12T18:36:31.473 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1739999999999999e-06 2024-09-12T18:36:31.473 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.473 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.473 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:31.473 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.461534+0000", 2024-09-12T18:36:31.473 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.9081e-05 2024-09-12T18:36:31.473 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.473 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.473 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:31.473 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.461667+0000", 2024-09-12T18:36:31.473 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013322599999999999 2024-09-12T18:36:31.473 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.474 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.474 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:31.474 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.461775+0000", 2024-09-12T18:36:31.474 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010757 2024-09-12T18:36:31.474 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.474 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:31.474 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.474 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.474 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.474 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:107387 5.6 e45/21 5:68fb81af:::benchmark_data_smithi073_23739_object107386:head v 45'6736, mlcod=45'6733)", 2024-09-12T18:36:31.474 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:31.462228+0000", 2024-09-12T18:36:31.474 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.00194063, 2024-09-12T18:36:31.474 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.002098394, 2024-09-12T18:36:31.474 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:31.475 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:31.475 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:31.475 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:31.475 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.475 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:31.475 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.462228+0000", 2024-09-12T18:36:31.475 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.475 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.475 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.475 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:31.475 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.462228+0000", 2024-09-12T18:36:31.475 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.475 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.476 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.476 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:31.476 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.462229+0000", 2024-09-12T18:36:31.476 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8199999999999999e-07 2024-09-12T18:36:31.476 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.476 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.476 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:31.476 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.462297+0000", 2024-09-12T18:36:31.476 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.7467999999999998e-05 2024-09-12T18:36:31.476 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.476 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.476 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:31.476 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.462308+0000", 2024-09-12T18:36:31.476 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.131e-05 2024-09-12T18:36:31.477 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.477 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.477 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.477 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.462314+0000", 2024-09-12T18:36:31.477 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.3509999999999998e-06 2024-09-12T18:36:31.477 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.477 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.477 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:31.477 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.462364+0000", 2024-09-12T18:36:31.477 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.9506999999999999e-05 2024-09-12T18:36:31.477 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.477 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.477 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:31.478 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.462378+0000", 2024-09-12T18:36:31.478 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4367e-05 2024-09-12T18:36:31.478 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.478 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:31.478 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.478 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.478 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.478 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:107389 5.6 e45/21 5:69ad99ca:::benchmark_data_smithi073_23739_object107388:head v 45'6737, mlcod=45'6733)", 2024-09-12T18:36:31.478 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:31.464042+0000", 2024-09-12T18:36:31.478 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.00012749300000000001, 2024-09-12T18:36:31.478 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000331859, 2024-09-12T18:36:31.478 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:31.478 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:31.479 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:31.479 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:31.479 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.479 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:31.479 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.464042+0000", 2024-09-12T18:36:31.479 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.479 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.479 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.479 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:31.479 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.464042+0000", 2024-09-12T18:36:31.479 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.479 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.479 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.480 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:31.480 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.464042+0000", 2024-09-12T18:36:31.480 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.99e-07 2024-09-12T18:36:31.480 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.480 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.480 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:31.480 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.464077+0000", 2024-09-12T18:36:31.480 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.4351999999999999e-05 2024-09-12T18:36:31.480 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.480 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.480 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:31.480 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.464091+0000", 2024-09-12T18:36:31.481 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4011e-05 2024-09-12T18:36:31.481 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.481 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.481 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.481 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.464096+0000", 2024-09-12T18:36:31.481 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.6760000000000004e-06 2024-09-12T18:36:31.481 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.481 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.481 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:31.481 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.464144+0000", 2024-09-12T18:36:31.481 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8109999999999998e-05 2024-09-12T18:36:31.481 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.481 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.481 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:31.482 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.464162+0000", 2024-09-12T18:36:31.482 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.8025000000000001e-05 2024-09-12T18:36:31.482 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.482 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:31.482 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.482 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.482 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.482 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop_reply(client.4480.0:107383 5.1 e45/21)", 2024-09-12T18:36:31.482 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:31.464112+0000", 2024-09-12T18:36:31.482 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 5.6758000000000001e-05, 2024-09-12T18:36:31.482 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000287225, 2024-09-12T18:36:31.482 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:31.482 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:31.483 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:31.483 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:31.483 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.483 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:31.483 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.464112+0000", 2024-09-12T18:36:31.483 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.483 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.483 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.483 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:31.483 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.464112+0000", 2024-09-12T18:36:31.483 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.483 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.483 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.483 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:31.484 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.464113+0000", 2024-09-12T18:36:31.484 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5100000000000001e-07 2024-09-12T18:36:31.484 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.484 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.484 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:31.484 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.464115+0000", 2024-09-12T18:36:31.484 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.063e-06 2024-09-12T18:36:31.484 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.484 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.484 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:31.484 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.464120+0000", 2024-09-12T18:36:31.484 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.7879999999999997e-06 2024-09-12T18:36:31.484 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.485 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.485 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.485 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.464122+0000", 2024-09-12T18:36:31.485 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.8990000000000001e-06 2024-09-12T18:36:31.485 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.485 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:31.485 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.485 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.485 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.485 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:107396 5.f 5:f1944780:::benchmark_data_smithi073_23739_object107395:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:36:31.485 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:31.464254+0000", 2024-09-12T18:36:31.485 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 4294967295.9999156, 2024-09-12T18:36:31.485 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00017341700000000001, 2024-09-12T18:36:31.485 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:31.486 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:31.486 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "reached pg", 2024-09-12T18:36:31.486 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:31.486 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:31.486 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:31.486 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 107396 2024-09-12T18:36:31.486 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.486 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:31.486 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.486 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:31.486 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.464254+0000", 2024-09-12T18:36:31.486 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.486 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.487 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.487 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:31.487 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.464254+0000", 2024-09-12T18:36:31.487 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.487 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.487 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.487 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:31.487 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.464255+0000", 2024-09-12T18:36:31.487 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.285e-06 2024-09-12T18:36:31.487 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.487 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.487 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:31.487 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.464295+0000", 2024-09-12T18:36:31.487 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.0113e-05 2024-09-12T18:36:31.488 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.488 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.488 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:31.488 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.464308+0000", 2024-09-12T18:36:31.488 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3183999999999999e-05 2024-09-12T18:36:31.488 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.488 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.488 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.488 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.464316+0000", 2024-09-12T18:36:31.488 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.6769999999999995e-06 2024-09-12T18:36:31.488 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.488 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.488 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:31.488 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.464378+0000", 2024-09-12T18:36:31.489 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.1550999999999994e-05 2024-09-12T18:36:31.489 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.489 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:31.489 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.489 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.489 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.489 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:107379 5.9 5:91f278ee:::benchmark_data_smithi073_23739_object107378:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:36:31.489 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:31.457628+0000", 2024-09-12T18:36:31.489 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0065415229999999996, 2024-09-12T18:36:31.489 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0068311839999999997, 2024-09-12T18:36:31.489 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:31.489 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:31.489 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:31.489 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:31.490 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:31.490 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:31.490 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 107379 2024-09-12T18:36:31.490 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.490 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:31.490 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.490 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:31.490 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.457628+0000", 2024-09-12T18:36:31.490 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.490 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.490 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.490 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:31.490 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.457628+0000", 2024-09-12T18:36:31.491 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.491 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.491 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.491 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:31.491 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.457628+0000", 2024-09-12T18:36:31.491 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.7300000000000005e-07 2024-09-12T18:36:31.491 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.491 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.491 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:31.491 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.457710+0000", 2024-09-12T18:36:31.491 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.2138999999999994e-05 2024-09-12T18:36:31.491 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.491 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.492 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:31.492 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.457721+0000", 2024-09-12T18:36:31.492 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0746e-05 2024-09-12T18:36:31.492 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.492 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.492 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.492 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.457727+0000", 2024-09-12T18:36:31.492 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.8320000000000002e-06 2024-09-12T18:36:31.492 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.492 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.492 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:31.492 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.458215+0000", 2024-09-12T18:36:31.492 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00048777800000000002 2024-09-12T18:36:31.492 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.493 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.493 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:31.493 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.458360+0000", 2024-09-12T18:36:31.493 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014550199999999999 2024-09-12T18:36:31.493 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.493 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.493 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:31.493 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.458518+0000", 2024-09-12T18:36:31.493 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015735099999999999 2024-09-12T18:36:31.493 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.493 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.493 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:31.493 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.461156+0000", 2024-09-12T18:36:31.493 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.002638123 2024-09-12T18:36:31.494 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.494 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:31.494 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.494 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.494 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.494 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:107383 5.1 5:8b50e082:::benchmark_data_smithi073_23739_object107382:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:36:31.494 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:31.459438+0000", 2024-09-12T18:36:31.494 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0047311790000000003, 2024-09-12T18:36:31.494 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0050578480000000002, 2024-09-12T18:36:31.494 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:31.494 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:31.494 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:31.494 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:31.495 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:31.495 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:31.495 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 107383 2024-09-12T18:36:31.495 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.495 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:31.495 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.495 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:31.495 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.459438+0000", 2024-09-12T18:36:31.495 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.495 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.495 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.495 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:31.495 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.459438+0000", 2024-09-12T18:36:31.495 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.496 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.496 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.496 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:31.496 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.459439+0000", 2024-09-12T18:36:31.496 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.006e-06 2024-09-12T18:36:31.496 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.496 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.496 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:31.496 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.459529+0000", 2024-09-12T18:36:31.496 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.9783000000000004e-05 2024-09-12T18:36:31.496 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.496 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.496 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:31.497 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.459542+0000", 2024-09-12T18:36:31.497 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3274e-05 2024-09-12T18:36:31.497 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.497 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.497 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.497 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.459549+0000", 2024-09-12T18:36:31.497 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.391e-06 2024-09-12T18:36:31.497 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.497 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.497 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:31.497 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.461164+0000", 2024-09-12T18:36:31.497 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001614435 2024-09-12T18:36:31.497 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.497 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.498 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:31.498 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.461304+0000", 2024-09-12T18:36:31.498 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014063300000000001 2024-09-12T18:36:31.498 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.498 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.498 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:31.498 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.461462+0000", 2024-09-12T18:36:31.498 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015770700000000001 2024-09-12T18:36:31.498 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.498 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:31.498 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.498 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.498 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.498 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:107384 5.9 5:9af7cdcb:::benchmark_data_smithi073_23739_object107383:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:36:31.499 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:31.459565+0000", 2024-09-12T18:36:31.499 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0046045180000000002, 2024-09-12T18:36:31.499 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0049805120000000003, 2024-09-12T18:36:31.499 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:31.499 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:31.499 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:31.499 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:31.499 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:31.499 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:31.499 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 107384 2024-09-12T18:36:31.499 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.499 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:31.499 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.499 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:31.500 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.459565+0000", 2024-09-12T18:36:31.500 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.500 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.500 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.500 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:31.500 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.459565+0000", 2024-09-12T18:36:31.500 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.500 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.500 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.500 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:31.500 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.459565+0000", 2024-09-12T18:36:31.500 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2499999999999995e-07 2024-09-12T18:36:31.500 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.500 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.501 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:31.501 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.459619+0000", 2024-09-12T18:36:31.501 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3953999999999999e-05 2024-09-12T18:36:31.501 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.501 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.501 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:31.501 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.459631+0000", 2024-09-12T18:36:31.501 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1445e-05 2024-09-12T18:36:31.501 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.501 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.501 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.501 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.459636+0000", 2024-09-12T18:36:31.501 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.908e-06 2024-09-12T18:36:31.501 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.502 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.502 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:31.502 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.461186+0000", 2024-09-12T18:36:31.502 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0015491999999999999 2024-09-12T18:36:31.502 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.502 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.502 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:31.502 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.461316+0000", 2024-09-12T18:36:31.502 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013070099999999999 2024-09-12T18:36:31.502 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.502 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.502 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:31.502 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.461466+0000", 2024-09-12T18:36:31.502 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014942300000000001 2024-09-12T18:36:31.503 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.503 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:31.503 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.503 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.503 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.503 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:107385 5.9 5:9172b01e:::benchmark_data_smithi073_23739_object107384:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:36:31.503 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:31.459649+0000", 2024-09-12T18:36:31.503 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0045196239999999999, 2024-09-12T18:36:31.503 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0049669800000000002, 2024-09-12T18:36:31.503 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:31.503 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:31.503 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:31.503 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:31.503 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:31.504 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:31.504 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 107385 2024-09-12T18:36:31.504 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.504 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:31.504 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.504 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:31.504 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.459649+0000", 2024-09-12T18:36:31.504 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.504 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.504 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.504 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:31.504 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.459649+0000", 2024-09-12T18:36:31.504 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.505 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.505 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.505 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:31.505 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.459650+0000", 2024-09-12T18:36:31.505 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.6599999999999996e-07 2024-09-12T18:36:31.505 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.505 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.505 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:31.505 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.459727+0000", 2024-09-12T18:36:31.505 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.7173000000000001e-05 2024-09-12T18:36:31.505 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.505 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.505 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:31.505 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.459741+0000", 2024-09-12T18:36:31.505 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3939e-05 2024-09-12T18:36:31.506 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.506 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.506 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.506 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.459748+0000", 2024-09-12T18:36:31.506 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.8000000000000001e-06 2024-09-12T18:36:31.506 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.506 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.506 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:31.506 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.463429+0000", 2024-09-12T18:36:31.506 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0036813570000000001 2024-09-12T18:36:31.506 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.506 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.506 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:31.507 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.463619+0000", 2024-09-12T18:36:31.507 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000189495 2024-09-12T18:36:31.507 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.507 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.507 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:31.507 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.463780+0000", 2024-09-12T18:36:31.507 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00016105399999999999 2024-09-12T18:36:31.507 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.507 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:31.507 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.507 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.507 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.507 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:107386 5.6 e45/21 5:67aff407:::benchmark_data_smithi073_23739_object107385:head v 45'6735, mlcod=45'6733)", 2024-09-12T18:36:31.507 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:31.460139+0000", 2024-09-12T18:36:31.507 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0040301069999999998, 2024-09-12T18:36:31.508 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0045305040000000003, 2024-09-12T18:36:31.508 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:31.508 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:31.508 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:31.508 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:31.508 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.508 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:31.508 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.460139+0000", 2024-09-12T18:36:31.508 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.508 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.508 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.508 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:31.508 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.460139+0000", 2024-09-12T18:36:31.509 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.509 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.509 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.509 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:31.509 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.460140+0000", 2024-09-12T18:36:31.509 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.37e-07 2024-09-12T18:36:31.509 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.509 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.509 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:31.509 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.460208+0000", 2024-09-12T18:36:31.509 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.8088000000000003e-05 2024-09-12T18:36:31.509 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.509 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.509 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:31.510 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.460216+0000", 2024-09-12T18:36:31.510 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4239999999999993e-06 2024-09-12T18:36:31.510 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.510 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.510 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.510 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.460220+0000", 2024-09-12T18:36:31.510 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.844e-06 2024-09-12T18:36:31.510 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.510 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.510 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:31.510 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.460254+0000", 2024-09-12T18:36:31.510 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.4010999999999997e-05 2024-09-12T18:36:31.510 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.510 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.511 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:31.511 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.460268+0000", 2024-09-12T18:36:31.511 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4260000000000001e-05 2024-09-12T18:36:31.511 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.511 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:31.511 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.511 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.511 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.511 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:107388 5.1 5:89f294b8:::benchmark_data_smithi073_23739_object107387:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:36:31.511 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:31.461136+0000", 2024-09-12T18:36:31.511 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0030327710000000001, 2024-09-12T18:36:31.511 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0035650489999999998, 2024-09-12T18:36:31.511 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:31.512 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:31.512 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:31.512 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:31.512 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:31.512 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:31.512 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 107388 2024-09-12T18:36:31.512 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.512 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:31.512 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.512 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:31.512 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.461136+0000", 2024-09-12T18:36:31.512 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.512 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.512 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.513 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:31.513 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.461136+0000", 2024-09-12T18:36:31.513 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.513 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.513 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.513 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:31.513 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.461137+0000", 2024-09-12T18:36:31.513 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.116e-06 2024-09-12T18:36:31.513 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.513 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.513 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:31.513 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.461246+0000", 2024-09-12T18:36:31.513 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010813 2024-09-12T18:36:31.513 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.514 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.514 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:31.514 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.461266+0000", 2024-09-12T18:36:31.514 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.0761999999999999e-05 2024-09-12T18:36:31.514 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.514 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.514 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.514 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.461281+0000", 2024-09-12T18:36:31.514 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4671000000000001e-05 2024-09-12T18:36:31.514 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.514 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.514 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:31.514 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.463855+0000", 2024-09-12T18:36:31.514 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0025740559999999999 2024-09-12T18:36:31.515 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.515 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.515 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:31.515 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.464020+0000", 2024-09-12T18:36:31.515 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00016479299999999999 2024-09-12T18:36:31.515 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.515 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.515 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:31.515 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:31.464171+0000", 2024-09-12T18:36:31.515 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015131500000000001 2024-09-12T18:36:31.516 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.516 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:31.516 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.516 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.516 INFO:teuthology.orchestra.run.smithi162.stdout: ], 2024-09-12T18:36:31.516 INFO:teuthology.orchestra.run.smithi162.stdout: "num_ops": 12 2024-09-12T18:36:31.516 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:36:31.517 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:36:31.518 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:31.511+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:31.618 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:31.615+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:31.680 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:36:31.680 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [], 2024-09-12T18:36:31.680 INFO:teuthology.orchestra.run.smithi162.stdout: "complaint_time": 30, 2024-09-12T18:36:31.680 INFO:teuthology.orchestra.run.smithi162.stdout: "num_blocked_ops": 0 2024-09-12T18:36:31.680 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:36:31.699 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:36:31.745 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:31.744+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:31.756 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:36:31.756 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T18:36:31.756 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 45, 2024-09-12T18:36:31.756 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "c08d5a84-711b-44bf-bdf1-e06ecc2c7c00", 2024-09-12T18:36:31.756 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-12T18:35:02.695853+0000", 2024-09-12T18:36:31.756 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-12T18:36:30.547628+0000", 2024-09-12T18:36:31.756 INFO:teuthology.orchestra.run.smithi073.stdout: "last_up_change": "2024-09-12T18:35:12.464628+0000", 2024-09-12T18:36:31.756 INFO:teuthology.orchestra.run.smithi073.stdout: "last_in_change": "2024-09-12T18:35:04.352525+0000", 2024-09-12T18:36:31.757 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T18:36:31.757 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_num": 5801984, 2024-09-12T18:36:31.757 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_set": [ 2024-09-12T18:36:31.757 INFO:teuthology.orchestra.run.smithi073.stdout: "noscrub", 2024-09-12T18:36:31.757 INFO:teuthology.orchestra.run.smithi073.stdout: "pglog_hardlimit", 2024-09-12T18:36:31.757 INFO:teuthology.orchestra.run.smithi073.stdout: "purged_snapdirs", 2024-09-12T18:36:31.757 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_deletes", 2024-09-12T18:36:31.757 INFO:teuthology.orchestra.run.smithi073.stdout: "sortbitwise" 2024-09-12T18:36:31.757 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T18:36:31.757 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_version": 5, 2024-09-12T18:36:31.757 INFO:teuthology.orchestra.run.smithi073.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T18:36:31.757 INFO:teuthology.orchestra.run.smithi073.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T18:36:31.757 INFO:teuthology.orchestra.run.smithi073.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T18:36:31.758 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_snapshot": "", 2024-09-12T18:36:31.758 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_max": 5, 2024-09-12T18:36:31.758 INFO:teuthology.orchestra.run.smithi073.stdout: "max_osd": 3, 2024-09-12T18:36:31.758 INFO:teuthology.orchestra.run.smithi073.stdout: "require_min_compat_client": "luminous", 2024-09-12T18:36:31.758 INFO:teuthology.orchestra.run.smithi073.stdout: "min_compat_client": "jewel", 2024-09-12T18:36:31.758 INFO:teuthology.orchestra.run.smithi073.stdout: "require_osd_release": "squid", 2024-09-12T18:36:31.758 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_crimson": false, 2024-09-12T18:36:31.758 INFO:teuthology.orchestra.run.smithi073.stdout: "pools": [ 2024-09-12T18:36:31.758 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:31.758 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 1, 2024-09-12T18:36:31.758 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": ".mgr", 2024-09-12T18:36:31.758 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:12.418430+0000", 2024-09-12T18:36:31.758 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-12T18:36:31.759 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-09-12T18:36:31.759 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:36:31.759 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:36:31.759 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:36:31.759 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:36:31.759 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:36:31.759 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:36:31.759 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:36:31.759 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:36:31.760 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:36:31.760 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:36:31.760 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:36:31.760 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 1, 2024-09-12T18:36:31.760 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 1, 2024-09-12T18:36:31.760 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 1, 2024-09-12T18:36:31.760 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 1, 2024-09-12T18:36:31.760 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 1, 2024-09-12T18:36:31.760 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:36:31.760 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:36:31.760 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:36:31.760 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:36:31.760 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:36:31.761 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:36:31.761 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:36:31.761 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.761 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "11", 2024-09-12T18:36:31.761 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:36:31.761 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:36:31.761 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:36:31.761 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:36:31.761 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:36:31.761 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-09-12T18:36:31.761 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-09-12T18:36:31.761 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:36:31.761 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:36:31.762 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:36:31.762 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:36:31.762 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:36:31.762 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:36:31.762 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:36:31.762 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:36:31.762 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:36:31.762 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:36:31.762 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:36:31.762 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:36:31.762 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:36:31.762 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:36:31.762 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:36:31.763 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:36:31.763 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:36:31.763 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:36:31.763 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:36:31.763 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.763 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:36:31.763 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:36:31.763 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:36:31.763 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:36:31.763 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:36:31.763 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:36:31.763 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:36:31.763 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:36:31.764 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:36:31.764 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:36:31.764 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:36:31.764 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-09-12T18:36:31.764 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_max": 32, 2024-09-12T18:36:31.764 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 1 2024-09-12T18:36:31.764 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.764 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:36:31.764 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": {} 2024-09-12T18:36:31.764 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.764 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:36:31.764 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:36:31.764 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 2.9900000095367432, 2024-09-12T18:36:31.765 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 2.9900000095367432, 2024-09-12T18:36:31.765 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 0.67000001668930054, 2024-09-12T18:36:31.765 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 2, 2024-09-12T18:36:31.765 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 2, 2024-09-12T18:36:31.765 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:36:31.765 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:36:31.765 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:36:31.765 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:31.765 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.765 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:31.765 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 2, 2024-09-12T18:36:31.765 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "rbd", 2024-09-12T18:36:31.765 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:18.665309+0000", 2024-09-12T18:36:31.766 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 8193, 2024-09-12T18:36:31.766 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T18:36:31.766 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:36:31.766 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:36:31.766 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:36:31.766 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:36:31.766 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:36:31.766 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:36:31.766 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:36:31.766 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:36:31.766 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:36:31.766 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:36:31.766 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:36:31.767 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 8, 2024-09-12T18:36:31.767 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 8, 2024-09-12T18:36:31.767 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 8, 2024-09-12T18:36:31.767 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 8, 2024-09-12T18:36:31.767 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 8, 2024-09-12T18:36:31.767 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:36:31.767 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:36:31.767 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:36:31.767 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:36:31.767 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:36:31.767 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:36:31.767 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:36:31.767 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.768 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "15", 2024-09-12T18:36:31.768 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:36:31.768 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:36:31.768 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:36:31.768 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:36:31.768 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:36:31.768 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 2, 2024-09-12T18:36:31.768 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 15, 2024-09-12T18:36:31.768 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:36:31.768 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:36:31.768 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:36:31.768 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:36:31.769 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:36:31.769 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:36:31.769 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:36:31.769 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:36:31.769 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:36:31.769 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:36:31.769 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:36:31.769 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:36:31.769 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:36:31.769 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:36:31.769 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:36:31.769 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:36:31.769 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:36:31.770 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:36:31.770 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:36:31.770 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.770 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:36:31.770 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:36:31.770 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:36:31.770 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:36:31.770 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:36:31.770 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:36:31.770 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:36:31.770 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:36:31.770 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:36:31.770 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:36:31.771 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:36:31.771 INFO:teuthology.orchestra.run.smithi073.stdout: "options": {}, 2024-09-12T18:36:31.771 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:36:31.771 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd": {} 2024-09-12T18:36:31.771 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.771 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:36:31.771 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:36:31.771 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.5, 2024-09-12T18:36:31.771 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.5, 2024-09-12T18:36:31.771 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-09-12T18:36:31.771 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.5, 2024-09-12T18:36:31.771 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.5, 2024-09-12T18:36:31.771 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:36:31.772 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:36:31.772 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:36:31.772 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:31.772 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.772 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:31.772 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 3, 2024-09-12T18:36:31.772 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "cephfs_metadata", 2024-09-12T18:36:31.772 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:23.447845+0000", 2024-09-12T18:36:31.772 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-12T18:36:31.772 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-09-12T18:36:31.772 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:36:31.772 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:36:31.772 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:36:31.773 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:36:31.773 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:36:31.773 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:36:31.773 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:36:31.773 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:36:31.773 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:36:31.773 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:36:31.773 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:36:31.773 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 32, 2024-09-12T18:36:31.773 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 32, 2024-09-12T18:36:31.773 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 32, 2024-09-12T18:36:31.773 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 32, 2024-09-12T18:36:31.773 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 32, 2024-09-12T18:36:31.774 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:36:31.774 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:36:31.774 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:36:31.774 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:36:31.774 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:36:31.774 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:36:31.774 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:36:31.774 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.774 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "18", 2024-09-12T18:36:31.774 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:36:31.774 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:36:31.775 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:36:31.775 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:36:31.775 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:36:31.775 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-09-12T18:36:31.775 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-09-12T18:36:31.775 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:36:31.775 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:36:31.775 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:36:31.775 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:36:31.775 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:36:31.775 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:36:31.775 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:36:31.775 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:36:31.775 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:36:31.776 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:36:31.776 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:36:31.776 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:36:31.776 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:36:31.776 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:36:31.776 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:36:31.776 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:36:31.776 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:36:31.776 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:36:31.776 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:36:31.776 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.776 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:36:31.776 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:36:31.777 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:36:31.777 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:36:31.777 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:36:31.777 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:36:31.777 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:36:31.777 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:36:31.777 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:36:31.777 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:36:31.777 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:36:31.777 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-09-12T18:36:31.777 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_bias": 4, 2024-09-12T18:36:31.777 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 16, 2024-09-12T18:36:31.778 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_priority": 5 2024-09-12T18:36:31.778 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.778 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:36:31.778 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs": { 2024-09-12T18:36:31.778 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": "cephfs" 2024-09-12T18:36:31.778 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:31.778 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.778 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:36:31.778 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:36:31.778 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.1299999952316284, 2024-09-12T18:36:31.778 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.1299999952316284, 2024-09-12T18:36:31.778 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-09-12T18:36:31.779 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T18:36:31.779 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T18:36:31.779 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:36:31.779 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:36:31.779 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:36:31.779 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:31.779 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.779 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:31.779 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 4, 2024-09-12T18:36:31.779 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "cephfs_data", 2024-09-12T18:36:31.779 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:23.959973+0000", 2024-09-12T18:36:31.779 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-12T18:36:31.779 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-09-12T18:36:31.780 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:36:31.780 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:36:31.780 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:36:31.780 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:36:31.780 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:36:31.780 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:36:31.780 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:36:31.780 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:36:31.780 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:36:31.780 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:36:31.780 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:36:31.780 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 64, 2024-09-12T18:36:31.780 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 64, 2024-09-12T18:36:31.781 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 64, 2024-09-12T18:36:31.781 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 64, 2024-09-12T18:36:31.781 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 64, 2024-09-12T18:36:31.781 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:36:31.781 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:36:31.781 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:36:31.781 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:36:31.781 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:36:31.781 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:36:31.781 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:36:31.781 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.781 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "19", 2024-09-12T18:36:31.781 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:36:31.782 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:36:31.782 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:36:31.782 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:36:31.782 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:36:31.782 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-09-12T18:36:31.782 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-09-12T18:36:31.782 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:36:31.782 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:36:31.782 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:36:31.782 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:36:31.782 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:36:31.782 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:36:31.782 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:36:31.783 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:36:31.783 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:36:31.783 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:36:31.783 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:36:31.783 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:36:31.783 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:36:31.783 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:36:31.783 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:36:31.783 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:36:31.783 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:36:31.783 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:36:31.783 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:36:31.784 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.784 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:36:31.784 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:36:31.784 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:36:31.784 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:36:31.784 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:36:31.784 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:36:31.784 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:36:31.784 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:36:31.784 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:36:31.784 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:36:31.784 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:36:31.784 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-09-12T18:36:31.785 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 64, 2024-09-12T18:36:31.785 INFO:teuthology.orchestra.run.smithi073.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T18:36:31.785 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.785 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:36:31.785 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs": { 2024-09-12T18:36:31.785 INFO:teuthology.orchestra.run.smithi073.stdout: "data": "cephfs" 2024-09-12T18:36:31.785 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:31.785 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.785 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:36:31.785 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:36:31.785 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.1299999952316284, 2024-09-12T18:36:31.785 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.1299999952316284, 2024-09-12T18:36:31.785 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-09-12T18:36:31.786 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T18:36:31.786 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T18:36:31.786 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:36:31.786 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:36:31.786 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:36:31.786 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:31.786 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.786 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:31.786 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 5, 2024-09-12T18:36:31.786 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "unique_pool_0", 2024-09-12T18:36:31.786 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:43.562347+0000", 2024-09-12T18:36:31.786 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-12T18:36:31.786 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-09-12T18:36:31.787 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:36:31.787 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:36:31.787 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:36:31.787 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:36:31.787 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:36:31.787 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:36:31.787 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:36:31.787 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:36:31.787 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:36:31.787 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:36:31.787 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:36:31.787 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 16, 2024-09-12T18:36:31.787 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 16, 2024-09-12T18:36:31.788 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 16, 2024-09-12T18:36:31.788 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 16, 2024-09-12T18:36:31.788 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 16, 2024-09-12T18:36:31.788 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:36:31.788 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:36:31.788 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:36:31.788 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:36:31.788 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:36:31.788 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:36:31.788 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:36:31.788 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.788 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "23", 2024-09-12T18:36:31.789 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:36:31.789 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:36:31.789 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:36:31.789 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:36:31.789 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:36:31.789 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-09-12T18:36:31.789 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-09-12T18:36:31.789 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:36:31.789 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:36:31.789 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:36:31.789 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:36:31.789 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:36:31.789 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:36:31.790 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:36:31.790 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:36:31.790 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:36:31.790 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:36:31.790 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:36:31.790 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:36:31.790 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:36:31.790 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:36:31.790 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:36:31.790 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:36:31.790 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:36:31.790 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:36:31.790 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:36:31.790 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.791 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:36:31.791 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:36:31.791 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:36:31.791 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:36:31.791 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:36:31.791 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:36:31.791 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:36:31.791 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:36:31.791 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:36:31.791 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:36:31.791 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:36:31.791 INFO:teuthology.orchestra.run.smithi073.stdout: "options": {}, 2024-09-12T18:36:31.791 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:36:31.791 INFO:teuthology.orchestra.run.smithi073.stdout: "rados": {} 2024-09-12T18:36:31.792 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.792 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:36:31.792 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:36:31.793 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.1299999952316284, 2024-09-12T18:36:31.793 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.1299999952316284, 2024-09-12T18:36:31.793 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-09-12T18:36:31.793 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T18:36:31.793 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T18:36:31.794 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:36:31.794 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:36:31.794 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:36:31.794 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:31.794 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:31.794 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T18:36:31.794 INFO:teuthology.orchestra.run.smithi073.stdout: "osds": [ 2024-09-12T18:36:31.794 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:31.794 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-09-12T18:36:31.794 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "f1cf24e8-6179-4666-a444-fa81ef0d7482", 2024-09-12T18:36:31.794 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-09-12T18:36:31.794 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-09-12T18:36:31.794 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-09-12T18:36:31.794 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-09-12T18:36:31.795 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-09-12T18:36:31.795 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-09-12T18:36:31.795 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-09-12T18:36:31.795 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 21, 2024-09-12T18:36:31.795 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-09-12T18:36:31.795 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-09-12T18:36:31.795 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-12T18:36:31.795 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:31.795 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:31.795 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:31.795 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6800", 2024-09-12T18:36:31.795 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:36:31.795 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.796 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:31.796 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:31.796 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6801", 2024-09-12T18:36:31.796 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:36:31.796 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:31.796 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:31.796 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.796 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-09-12T18:36:31.796 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:31.796 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:31.796 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:31.796 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6802", 2024-09-12T18:36:31.797 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:36:31.797 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.797 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:31.797 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:31.797 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6803", 2024-09-12T18:36:31.797 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:36:31.797 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:31.797 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:31.797 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.797 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-09-12T18:36:31.797 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:31.797 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:31.797 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:31.798 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6806", 2024-09-12T18:36:31.798 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:36:31.798 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.798 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:31.798 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:31.798 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6807", 2024-09-12T18:36:31.798 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:36:31.798 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:31.798 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:31.798 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.798 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-09-12T18:36:31.798 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:31.798 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:31.799 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:31.799 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6804", 2024-09-12T18:36:31.799 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:36:31.799 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.799 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:31.799 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:31.799 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6805", 2024-09-12T18:36:31.799 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:36:31.799 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:31.799 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:31.799 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.799 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.114:6801/2710632206", 2024-09-12T18:36:31.799 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.114:6803/2710632206", 2024-09-12T18:36:31.800 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.114:6807/2710632206", 2024-09-12T18:36:31.800 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.114:6805/2710632206", 2024-09-12T18:36:31.800 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-09-12T18:36:31.800 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-09-12T18:36:31.800 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-09-12T18:36:31.800 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:31.800 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.800 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:31.800 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-09-12T18:36:31.800 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "3fdb0044-2820-4411-978b-4b6e94fbf0b1", 2024-09-12T18:36:31.800 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-09-12T18:36:31.800 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-09-12T18:36:31.801 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-09-12T18:36:31.801 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-09-12T18:36:31.801 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-09-12T18:36:31.801 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-09-12T18:36:31.801 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 9, 2024-09-12T18:36:31.801 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 21, 2024-09-12T18:36:31.801 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-09-12T18:36:31.801 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-09-12T18:36:31.801 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-12T18:36:31.801 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:31.801 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:31.801 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:31.801 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6800", 2024-09-12T18:36:31.801 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:36:31.802 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.802 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:31.802 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:31.802 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6801", 2024-09-12T18:36:31.802 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:36:31.802 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:31.802 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:31.802 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.802 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-09-12T18:36:31.802 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:31.802 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:31.802 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:31.802 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6802", 2024-09-12T18:36:31.803 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:36:31.803 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.803 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:31.803 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:31.803 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6803", 2024-09-12T18:36:31.803 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:36:31.803 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:31.803 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:31.803 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.803 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-09-12T18:36:31.803 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:31.803 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:31.804 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:31.804 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6806", 2024-09-12T18:36:31.804 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:36:31.804 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.804 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:31.804 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:31.804 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6807", 2024-09-12T18:36:31.804 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:36:31.804 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:31.804 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:31.804 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.804 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-09-12T18:36:31.804 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:31.805 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:31.805 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:31.805 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6804", 2024-09-12T18:36:31.805 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:36:31.805 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.805 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:31.805 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:31.805 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6805", 2024-09-12T18:36:31.805 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:36:31.805 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:31.805 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:31.805 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.806 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.143:6801/862189968", 2024-09-12T18:36:31.806 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.143:6803/862189968", 2024-09-12T18:36:31.806 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.143:6807/862189968", 2024-09-12T18:36:31.806 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.143:6805/862189968", 2024-09-12T18:36:31.806 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-09-12T18:36:31.806 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-09-12T18:36:31.806 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-09-12T18:36:31.806 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:31.806 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.806 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:31.806 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2024-09-12T18:36:31.806 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "6fb554da-561f-4aa2-b855-0e3adb98b057", 2024-09-12T18:36:31.806 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-09-12T18:36:31.806 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-09-12T18:36:31.807 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-09-12T18:36:31.807 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-09-12T18:36:31.807 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-09-12T18:36:31.807 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-09-12T18:36:31.807 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-09-12T18:36:31.807 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 21, 2024-09-12T18:36:31.807 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-09-12T18:36:31.807 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-09-12T18:36:31.807 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-12T18:36:31.807 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:31.807 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:31.807 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:31.807 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6800", 2024-09-12T18:36:31.808 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:36:31.808 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.808 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:31.808 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:31.808 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6801", 2024-09-12T18:36:31.808 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:36:31.808 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:31.808 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:31.808 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.808 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-09-12T18:36:31.808 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:31.808 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:31.809 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:31.809 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6802", 2024-09-12T18:36:31.809 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:36:31.809 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.809 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:31.809 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:31.809 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6803", 2024-09-12T18:36:31.809 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:36:31.809 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:31.809 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:31.809 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.809 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-09-12T18:36:31.809 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:31.810 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:31.810 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:31.810 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6806", 2024-09-12T18:36:31.810 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:36:31.810 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.810 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:31.810 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:31.810 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6807", 2024-09-12T18:36:31.810 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:36:31.810 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:31.810 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:31.810 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.810 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-09-12T18:36:31.810 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:31.811 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:31.811 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:31.811 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6804", 2024-09-12T18:36:31.811 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:36:31.811 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.811 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:31.811 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:31.811 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6805", 2024-09-12T18:36:31.811 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:36:31.811 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:31.811 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:31.811 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.811 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.162:6801/1397104153", 2024-09-12T18:36:31.812 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.162:6803/1397104153", 2024-09-12T18:36:31.812 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.162:6807/1397104153", 2024-09-12T18:36:31.812 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.162:6805/1397104153", 2024-09-12T18:36:31.812 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-09-12T18:36:31.812 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-09-12T18:36:31.812 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-09-12T18:36:31.812 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:31.812 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:31.812 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T18:36:31.812 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_xinfo": [ 2024-09-12T18:36:31.812 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:31.812 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-09-12T18:36:31.812 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-09-12T18:36:31.813 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-09-12T18:36:31.813 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-09-12T18:36:31.813 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540719139924082687, 2024-09-12T18:36:31.813 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-09-12T18:36:31.813 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-09-12T18:35:10.239320+0000", 2024-09-12T18:36:31.813 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-09-12T18:36:31.813 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.813 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:31.813 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-09-12T18:36:31.813 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-09-12T18:36:31.813 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-09-12T18:36:31.813 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-09-12T18:36:31.813 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540719139924082687, 2024-09-12T18:36:31.814 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-09-12T18:36:31.814 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-09-12T18:35:10.861760+0000", 2024-09-12T18:36:31.814 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-09-12T18:36:31.814 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.814 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:31.814 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2024-09-12T18:36:31.814 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-09-12T18:36:31.814 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-09-12T18:36:31.814 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-09-12T18:36:31.814 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540719139924082687, 2024-09-12T18:36:31.814 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-09-12T18:36:31.814 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-09-12T18:35:10.355997+0000", 2024-09-12T18:36:31.814 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-09-12T18:36:31.815 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:31.815 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T18:36:31.815 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap": [], 2024-09-12T18:36:31.815 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap_items": [], 2024-09-12T18:36:31.815 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap_primaries": [], 2024-09-12T18:36:31.815 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_temp": [], 2024-09-12T18:36:31.815 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_temp": [], 2024-09-12T18:36:31.815 INFO:teuthology.orchestra.run.smithi073.stdout: "blocklist": {}, 2024-09-12T18:36:31.815 INFO:teuthology.orchestra.run.smithi073.stdout: "range_blocklist": {}, 2024-09-12T18:36:31.815 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profiles": { 2024-09-12T18:36:31.815 INFO:teuthology.orchestra.run.smithi073.stdout: "default": { 2024-09-12T18:36:31.815 INFO:teuthology.orchestra.run.smithi073.stdout: "crush-failure-domain": "osd", 2024-09-12T18:36:31.815 INFO:teuthology.orchestra.run.smithi073.stdout: "k": "2", 2024-09-12T18:36:31.815 INFO:teuthology.orchestra.run.smithi073.stdout: "m": "1", 2024-09-12T18:36:31.816 INFO:teuthology.orchestra.run.smithi073.stdout: "plugin": "jerasure", 2024-09-12T18:36:31.816 INFO:teuthology.orchestra.run.smithi073.stdout: "technique": "reed_sol_van" 2024-09-12T18:36:31.816 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:31.816 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:31.816 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps_queue": [], 2024-09-12T18:36:31.816 INFO:teuthology.orchestra.run.smithi073.stdout: "new_removed_snaps": [], 2024-09-12T18:36:31.816 INFO:teuthology.orchestra.run.smithi073.stdout: "new_purged_snaps": [], 2024-09-12T18:36:31.816 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_node_flags": {}, 2024-09-12T18:36:31.816 INFO:teuthology.orchestra.run.smithi073.stdout: "device_class_flags": {}, 2024-09-12T18:36:31.817 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": { 2024-09-12T18:36:31.817 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode_enabled": false, 2024-09-12T18:36:31.817 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_bucket_count": 0, 2024-09-12T18:36:31.817 INFO:teuthology.orchestra.run.smithi073.stdout: "degraded_stretch_mode": 0, 2024-09-12T18:36:31.817 INFO:teuthology.orchestra.run.smithi073.stdout: "recovering_stretch_mode": 0, 2024-09-12T18:36:31.817 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode_bucket": 0 2024-09-12T18:36:31.817 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:31.817 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T18:36:31.819 INFO:tasks.thrashosds.thrasher:j is {'epoch': 45, 'fsid': 'c08d5a84-711b-44bf-bdf1-e06ecc2c7c00', 'created': '2024-09-12T18:35:02.695853+0000', 'modified': '2024-09-12T18:36:30.547628+0000', 'last_up_change': '2024-09-12T18:35:12.464628+0000', 'last_in_change': '2024-09-12T18:35:04.352525+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T18:35:12.418430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-12T18:35:18.665309+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 15, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T18:35:23.447845+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T18:35:23.959973+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2024-09-12T18:35:43.562347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'f1cf24e8-6179-4666-a444-fa81ef0d7482', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6800', 'nonce': 2710632206}, {'type': 'v1', 'addr': '172.21.15.114:6801', 'nonce': 2710632206}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6802', 'nonce': 2710632206}, {'type': 'v1', 'addr': '172.21.15.114:6803', 'nonce': 2710632206}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6806', 'nonce': 2710632206}, {'type': 'v1', 'addr': '172.21.15.114:6807', 'nonce': 2710632206}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6804', 'nonce': 2710632206}, {'type': 'v1', 'addr': '172.21.15.114:6805', 'nonce': 2710632206}]}, 'public_addr': '172.21.15.114:6801/2710632206', 'cluster_addr': '172.21.15.114:6803/2710632206', 'heartbeat_back_addr': '172.21.15.114:6807/2710632206', 'heartbeat_front_addr': '172.21.15.114:6805/2710632206', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '3fdb0044-2820-4411-978b-4b6e94fbf0b1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 9, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6800', 'nonce': 862189968}, {'type': 'v1', 'addr': '172.21.15.143:6801', 'nonce': 862189968}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6802', 'nonce': 862189968}, {'type': 'v1', 'addr': '172.21.15.143:6803', 'nonce': 862189968}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6806', 'nonce': 862189968}, {'type': 'v1', 'addr': '172.21.15.143:6807', 'nonce': 862189968}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6804', 'nonce': 862189968}, {'type': 'v1', 'addr': '172.21.15.143:6805', 'nonce': 862189968}]}, 'public_addr': '172.21.15.143:6801/862189968', 'cluster_addr': '172.21.15.143:6803/862189968', 'heartbeat_back_addr': '172.21.15.143:6807/862189968', 'heartbeat_front_addr': '172.21.15.143:6805/862189968', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '6fb554da-561f-4aa2-b855-0e3adb98b057', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6800', 'nonce': 1397104153}, {'type': 'v1', 'addr': '172.21.15.162:6801', 'nonce': 1397104153}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6802', 'nonce': 1397104153}, {'type': 'v1', 'addr': '172.21.15.162:6803', 'nonce': 1397104153}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6806', 'nonce': 1397104153}, {'type': 'v1', 'addr': '172.21.15.162:6807', 'nonce': 1397104153}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6804', 'nonce': 1397104153}, {'type': 'v1', 'addr': '172.21.15.162:6805', 'nonce': 1397104153}]}, 'public_addr': '172.21.15.162:6801/1397104153', 'cluster_addr': '172.21.15.162:6803/1397104153', 'heartbeat_back_addr': '172.21.15.162:6807/1397104153', 'heartbeat_front_addr': '172.21.15.162:6805/1397104153', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:35:10.239320+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:35:10.861760+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:35:10.355997+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T18:36:31.819 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-12T18:36:31.820 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:31.815+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:31.861 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:36:31.861 INFO:teuthology.orchestra.run.smithi162.stdout: "size": 20, 2024-09-12T18:36:31.861 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 600, 2024-09-12T18:36:31.861 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:36:31.861 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.861 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4154.0:123 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:36:31.861 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:36:31.861 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 77.881392806999997, 2024-09-12T18:36:31.861 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.022398096999999999, 2024-09-12T18:36:31.861 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:31.862 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:31.862 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:31.862 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:31.862 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4154", 2024-09-12T18:36:31.862 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/745129001", 2024-09-12T18:36:31.862 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 123 2024-09-12T18:36:31.862 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.862 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:31.862 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.862 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:31.862 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:36:31.862 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.862 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.863 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.863 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:31.863 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:36:31.863 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.863 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.863 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.863 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:31.863 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:36:31.863 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.8299999999999996e-07 2024-09-12T18:36:31.863 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.863 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.863 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:31.863 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976528+0000", 2024-09-12T18:36:31.864 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011393299999999999 2024-09-12T18:36:31.864 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.864 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.864 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:31.864 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976539+0000", 2024-09-12T18:36:31.864 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0763e-05 2024-09-12T18:36:31.864 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.864 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.864 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.864 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976547+0000", 2024-09-12T18:36:31.864 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8199999999999997e-06 2024-09-12T18:36:31.864 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.864 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.865 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:31.865 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.995057+0000", 2024-09-12T18:36:31.865 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.018510047000000002 2024-09-12T18:36:31.865 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.865 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.865 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:31.865 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.995301+0000", 2024-09-12T18:36:31.865 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00024375899999999999 2024-09-12T18:36:31.865 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.865 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.865 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:31.865 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.995642+0000", 2024-09-12T18:36:31.865 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00034121100000000001 2024-09-12T18:36:31.866 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.866 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.866 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:31.866 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998179+0000", 2024-09-12T18:36:31.866 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00253761 2024-09-12T18:36:31.866 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.866 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.866 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:31.866 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998665+0000", 2024-09-12T18:36:31.866 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00048574600000000001 2024-09-12T18:36:31.866 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.866 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.866 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:31.866 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998739+0000", 2024-09-12T18:36:31.867 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.4286e-05 2024-09-12T18:36:31.867 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.867 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.867 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:31.867 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998812+0000", 2024-09-12T18:36:31.867 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2238999999999997e-05 2024-09-12T18:36:31.867 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.867 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:31.867 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.867 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.867 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.867 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4154.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:36:31.867 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:36:31.867 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 77.881245574999994, 2024-09-12T18:36:31.868 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025950709999999998, 2024-09-12T18:36:31.868 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:31.868 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:31.868 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:31.868 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:31.868 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4154", 2024-09-12T18:36:31.868 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/745129001", 2024-09-12T18:36:31.868 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 124 2024-09-12T18:36:31.868 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.868 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:31.868 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.868 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:31.868 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:36:31.869 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.869 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.869 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.869 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:31.869 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:36:31.869 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.869 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.869 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.869 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:31.869 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976562+0000", 2024-09-12T18:36:31.869 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.2999999999999999e-07 2024-09-12T18:36:31.869 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.869 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.870 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:31.870 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976567+0000", 2024-09-12T18:36:31.870 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3430000000000003e-06 2024-09-12T18:36:31.870 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.870 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.870 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:31.870 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976576+0000", 2024-09-12T18:36:31.870 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8070000000000006e-06 2024-09-12T18:36:31.870 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.870 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.870 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.870 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976583+0000", 2024-09-12T18:36:31.871 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9959999999999996e-06 2024-09-12T18:36:31.871 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.871 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.871 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:31.871 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997107+0000", 2024-09-12T18:36:31.871 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.020524106 2024-09-12T18:36:31.871 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.871 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.871 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:31.871 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997225+0000", 2024-09-12T18:36:31.871 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000117909 2024-09-12T18:36:31.871 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.872 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.872 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:31.872 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997407+0000", 2024-09-12T18:36:31.872 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00018175900000000001 2024-09-12T18:36:31.872 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.872 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.872 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:31.872 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998839+0000", 2024-09-12T18:36:31.872 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001432539 2024-09-12T18:36:31.872 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.872 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.872 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:31.872 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002319+0000", 2024-09-12T18:36:31.873 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0034803529999999998 2024-09-12T18:36:31.873 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.873 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.873 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:31.873 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002405+0000", 2024-09-12T18:36:31.873 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5434999999999998e-05 2024-09-12T18:36:31.873 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.873 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.873 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:31.873 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002512+0000", 2024-09-12T18:36:31.873 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010663299999999999 2024-09-12T18:36:31.873 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.873 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:31.874 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.874 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.874 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.874 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:31.874 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:36:31.874 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 66.216448068000005, 2024-09-12T18:36:31.874 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025127867000000002, 2024-09-12T18:36:31.874 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:31.874 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:31.874 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:31.874 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:31.874 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.874 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:31.874 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:36:31.875 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.875 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.875 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.875 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:31.875 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:36:31.875 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.875 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.875 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.875 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:31.875 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641362+0000", 2024-09-12T18:36:31.875 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.2569999999999999e-06 2024-09-12T18:36:31.875 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.875 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.876 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:31.876 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641374+0000", 2024-09-12T18:36:31.876 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2696e-05 2024-09-12T18:36:31.876 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.876 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.876 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:31.876 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641403+0000", 2024-09-12T18:36:31.876 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.8756999999999999e-05 2024-09-12T18:36:31.876 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.876 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.876 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.876 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641430+0000", 2024-09-12T18:36:31.877 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.6452999999999999e-05 2024-09-12T18:36:31.877 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.877 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.877 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:31.877 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641585+0000", 2024-09-12T18:36:31.877 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000155799 2024-09-12T18:36:31.877 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.877 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.877 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:31.877 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641753+0000", 2024-09-12T18:36:31.877 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000167868 2024-09-12T18:36:31.877 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.877 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.878 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:31.878 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641916+0000", 2024-09-12T18:36:31.878 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000162903 2024-09-12T18:36:31.878 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.878 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.878 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:31.878 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653655+0000", 2024-09-12T18:36:31.878 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011738879000000001 2024-09-12T18:36:31.878 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.878 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.878 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:31.878 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665515+0000", 2024-09-12T18:36:31.879 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011859915 2024-09-12T18:36:31.879 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.879 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.879 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:31.879 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665646+0000", 2024-09-12T18:36:31.879 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013122599999999999 2024-09-12T18:36:31.879 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.879 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.879 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:31.879 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666486+0000", 2024-09-12T18:36:31.879 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00084011399999999999 2024-09-12T18:36:31.879 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.879 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:31.880 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.880 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.880 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.880 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:31.880 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:36:31.880 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 66.216333605000003, 2024-09-12T18:36:31.880 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025384584000000002, 2024-09-12T18:36:31.880 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:31.880 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:31.880 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:31.880 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:31.880 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.881 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:31.881 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:36:31.881 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.881 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.881 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.881 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:31.881 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:36:31.881 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.881 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.881 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.881 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:31.881 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641474+0000", 2024-09-12T18:36:31.881 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.39e-06 2024-09-12T18:36:31.881 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.882 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.882 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:31.882 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641482+0000", 2024-09-12T18:36:31.882 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3499999999999999e-06 2024-09-12T18:36:31.882 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.882 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.882 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:31.882 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641534+0000", 2024-09-12T18:36:31.882 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2533e-05 2024-09-12T18:36:31.882 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.882 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.882 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.882 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641551+0000", 2024-09-12T18:36:31.883 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6515999999999999e-05 2024-09-12T18:36:31.883 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.883 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.883 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:31.883 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642630+0000", 2024-09-12T18:36:31.883 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001079705 2024-09-12T18:36:31.883 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.883 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.883 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:31.883 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642909+0000", 2024-09-12T18:36:31.883 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027859800000000002 2024-09-12T18:36:31.883 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.883 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.884 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:31.884 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643137+0000", 2024-09-12T18:36:31.884 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022803799999999999 2024-09-12T18:36:31.884 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.884 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.884 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:31.884 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653669+0000", 2024-09-12T18:36:31.884 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010532032 2024-09-12T18:36:31.884 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.884 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.884 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:31.885 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666624+0000", 2024-09-12T18:36:31.885 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012954940999999999 2024-09-12T18:36:31.885 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.885 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.885 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:31.885 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666762+0000", 2024-09-12T18:36:31.885 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000137668 2024-09-12T18:36:31.885 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.885 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.885 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:31.885 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666857+0000", 2024-09-12T18:36:31.885 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.5812999999999999e-05 2024-09-12T18:36:31.885 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.886 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:31.886 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.886 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.886 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.886 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:31.886 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:36:31.886 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 66.216205810000005, 2024-09-12T18:36:31.886 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025661562999999998, 2024-09-12T18:36:31.886 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:31.886 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:31.886 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:31.886 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:31.886 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.887 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:31.887 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:36:31.887 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.887 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.887 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.887 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:31.887 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:36:31.887 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.887 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.887 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.887 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:31.887 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641602+0000", 2024-09-12T18:36:31.887 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3540000000000001e-06 2024-09-12T18:36:31.888 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.888 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.888 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:31.888 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641637+0000", 2024-09-12T18:36:31.888 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5145999999999999e-05 2024-09-12T18:36:31.888 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.888 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.888 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:31.888 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641659+0000", 2024-09-12T18:36:31.888 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2249999999999999e-05 2024-09-12T18:36:31.888 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.888 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.888 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.889 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641675+0000", 2024-09-12T18:36:31.889 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6059999999999999e-05 2024-09-12T18:36:31.889 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.889 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.889 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:31.889 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644570+0000", 2024-09-12T18:36:31.889 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028947069999999998 2024-09-12T18:36:31.889 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.889 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.889 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:31.889 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644900+0000", 2024-09-12T18:36:31.889 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000329401 2024-09-12T18:36:31.890 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.890 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.890 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:31.890 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645235+0000", 2024-09-12T18:36:31.890 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000335874 2024-09-12T18:36:31.890 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.890 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.890 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:31.890 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655459+0000", 2024-09-12T18:36:31.890 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010223441999999999 2024-09-12T18:36:31.890 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.890 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.891 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:31.891 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667028+0000", 2024-09-12T18:36:31.891 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011568673999999999 2024-09-12T18:36:31.891 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.891 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.891 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:31.891 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667163+0000", 2024-09-12T18:36:31.891 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013525500000000001 2024-09-12T18:36:31.891 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.891 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.891 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:31.891 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667262+0000", 2024-09-12T18:36:31.891 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9400000000000004e-05 2024-09-12T18:36:31.891 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.892 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:31.892 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.892 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.892 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.892 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:31.892 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:36:31.892 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 66.216103989999993, 2024-09-12T18:36:31.892 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025971339, 2024-09-12T18:36:31.892 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:31.892 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:31.892 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:31.892 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:31.893 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.893 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:31.893 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:36:31.893 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.893 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.893 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.893 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:31.893 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:36:31.893 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.893 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.893 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.893 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:31.893 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641704+0000", 2024-09-12T18:36:31.893 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.297e-06 2024-09-12T18:36:31.894 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.894 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.894 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:31.894 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641712+0000", 2024-09-12T18:36:31.894 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.9060000000000002e-06 2024-09-12T18:36:31.894 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.894 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.894 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:31.894 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641731+0000", 2024-09-12T18:36:31.894 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9083e-05 2024-09-12T18:36:31.894 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.894 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.894 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.895 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641745+0000", 2024-09-12T18:36:31.895 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4066999999999999e-05 2024-09-12T18:36:31.895 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.895 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.895 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:31.895 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646529+0000", 2024-09-12T18:36:31.895 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.004784033 2024-09-12T18:36:31.895 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.895 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.895 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:31.895 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646727+0000", 2024-09-12T18:36:31.895 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019841800000000001 2024-09-12T18:36:31.895 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.896 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.896 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:31.896 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647057+0000", 2024-09-12T18:36:31.896 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032926800000000002 2024-09-12T18:36:31.896 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.896 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.896 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:31.896 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655475+0000", 2024-09-12T18:36:31.896 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0084186250000000008 2024-09-12T18:36:31.896 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.896 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.896 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:31.897 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667424+0000", 2024-09-12T18:36:31.897 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011949257 2024-09-12T18:36:31.897 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.897 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.897 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:31.897 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667573+0000", 2024-09-12T18:36:31.897 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014851900000000001 2024-09-12T18:36:31.897 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.897 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.897 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:31.897 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667674+0000", 2024-09-12T18:36:31.897 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010086600000000001 2024-09-12T18:36:31.897 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.897 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:31.898 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.898 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.898 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.898 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:31.898 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:36:31.898 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 66.216041601000001, 2024-09-12T18:36:31.898 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026215008000000001, 2024-09-12T18:36:31.898 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:31.898 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:31.898 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:31.898 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:31.898 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.898 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:31.899 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:36:31.899 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.899 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.899 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.899 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:31.899 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:36:31.899 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.899 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.899 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.899 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:31.899 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641766+0000", 2024-09-12T18:36:31.899 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1200000000000001e-06 2024-09-12T18:36:31.899 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.900 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.900 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:31.900 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641775+0000", 2024-09-12T18:36:31.900 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.2499999999999995e-06 2024-09-12T18:36:31.900 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.900 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.900 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:31.900 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641793+0000", 2024-09-12T18:36:31.900 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7773000000000001e-05 2024-09-12T18:36:31.900 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.900 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.900 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.900 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641807+0000", 2024-09-12T18:36:31.901 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3814e-05 2024-09-12T18:36:31.901 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.901 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.901 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:31.901 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647626+0000", 2024-09-12T18:36:31.901 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0058193050000000003 2024-09-12T18:36:31.901 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.901 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.901 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:31.901 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647937+0000", 2024-09-12T18:36:31.901 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031112400000000003 2024-09-12T18:36:31.901 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.901 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.902 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:31.902 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648239+0000", 2024-09-12T18:36:31.902 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00030227500000000002 2024-09-12T18:36:31.902 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.902 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.902 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:31.902 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655487+0000", 2024-09-12T18:36:31.902 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072479129999999999 2024-09-12T18:36:31.902 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.902 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.902 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:31.902 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667823+0000", 2024-09-12T18:36:31.902 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012335505 2024-09-12T18:36:31.902 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.903 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.903 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:31.903 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667908+0000", 2024-09-12T18:36:31.903 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4843000000000001e-05 2024-09-12T18:36:31.903 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.903 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.903 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:31.903 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667980+0000", 2024-09-12T18:36:31.903 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2086000000000001e-05 2024-09-12T18:36:31.903 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.903 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:31.903 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.903 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.903 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.904 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:31.904 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:36:31.904 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 66.215981447999994, 2024-09-12T18:36:31.904 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026483236, 2024-09-12T18:36:31.904 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:31.904 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:31.904 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:31.904 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:31.904 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.904 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:31.904 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:36:31.904 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.904 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.904 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.905 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:31.905 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:36:31.905 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.905 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.905 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.905 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:31.905 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641826+0000", 2024-09-12T18:36:31.905 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:36:31.905 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.905 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.905 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:31.905 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641832+0000", 2024-09-12T18:36:31.905 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4199999999999998e-06 2024-09-12T18:36:31.906 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.906 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.906 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:31.906 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641848+0000", 2024-09-12T18:36:31.906 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6492999999999999e-05 2024-09-12T18:36:31.906 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.906 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.906 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.906 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641863+0000", 2024-09-12T18:36:31.906 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5427e-05 2024-09-12T18:36:31.906 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.906 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.906 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:31.906 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648887+0000", 2024-09-12T18:36:31.907 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0070230860000000004 2024-09-12T18:36:31.907 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.907 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.907 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:31.907 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649111+0000", 2024-09-12T18:36:31.907 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022425799999999999 2024-09-12T18:36:31.907 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.907 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.907 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:31.907 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649494+0000", 2024-09-12T18:36:31.907 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00038349400000000001 2024-09-12T18:36:31.907 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.907 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.907 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:31.908 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655499+0000", 2024-09-12T18:36:31.908 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0060047260000000002 2024-09-12T18:36:31.908 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.908 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.908 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:31.908 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668110+0000", 2024-09-12T18:36:31.908 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012610543 2024-09-12T18:36:31.908 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.908 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.908 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:31.908 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668252+0000", 2024-09-12T18:36:31.908 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014265600000000001 2024-09-12T18:36:31.908 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.909 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.909 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:31.909 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668308+0000", 2024-09-12T18:36:31.909 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5992999999999997e-05 2024-09-12T18:36:31.909 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.909 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:31.909 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.909 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.909 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.909 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:31.909 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:36:31.909 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 66.215926232000001, 2024-09-12T18:36:31.909 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026605302000000001, 2024-09-12T18:36:31.909 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:31.910 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:31.910 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:31.910 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:31.910 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.910 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:31.910 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:36:31.910 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.910 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.910 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.910 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:31.910 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:36:31.910 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.910 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.910 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.911 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:31.911 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641881+0000", 2024-09-12T18:36:31.911 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.057e-06 2024-09-12T18:36:31.911 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.911 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.911 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:31.911 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641887+0000", 2024-09-12T18:36:31.911 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.6629999999999998e-06 2024-09-12T18:36:31.911 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.911 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.911 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:31.911 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641903+0000", 2024-09-12T18:36:31.911 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6317e-05 2024-09-12T18:36:31.911 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.912 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.912 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.912 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641917+0000", 2024-09-12T18:36:31.912 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3339999999999999e-05 2024-09-12T18:36:31.912 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.912 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.912 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:31.912 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650708+0000", 2024-09-12T18:36:31.912 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.008791419 2024-09-12T18:36:31.912 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.912 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.912 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:31.912 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651021+0000", 2024-09-12T18:36:31.913 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031296699999999999 2024-09-12T18:36:31.913 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.913 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.913 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:31.913 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651349+0000", 2024-09-12T18:36:31.913 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032796499999999999 2024-09-12T18:36:31.913 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.913 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.913 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:31.913 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655742+0000", 2024-09-12T18:36:31.913 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0043934680000000002 2024-09-12T18:36:31.913 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.913 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.913 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:31.914 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668377+0000", 2024-09-12T18:36:31.914 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012634312999999999 2024-09-12T18:36:31.914 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.914 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.914 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:31.914 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668441+0000", 2024-09-12T18:36:31.914 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4369999999999995e-05 2024-09-12T18:36:31.914 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.914 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.914 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:31.914 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668485+0000", 2024-09-12T18:36:31.914 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4422999999999998e-05 2024-09-12T18:36:31.914 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.914 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:31.915 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.915 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.915 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.915 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:31.915 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:36:31.915 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 66.215868829000001, 2024-09-12T18:36:31.915 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026919499, 2024-09-12T18:36:31.915 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:31.915 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:31.915 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:31.915 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:31.915 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.915 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:31.915 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:36:31.916 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.916 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.916 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.916 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:31.916 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:36:31.916 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.916 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.916 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.916 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:31.916 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641939+0000", 2024-09-12T18:36:31.916 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9399999999999993e-07 2024-09-12T18:36:31.916 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.916 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.917 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:31.917 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641945+0000", 2024-09-12T18:36:31.917 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9200000000000001e-06 2024-09-12T18:36:31.917 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.917 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.917 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:31.917 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641961+0000", 2024-09-12T18:36:31.917 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6520000000000001e-05 2024-09-12T18:36:31.917 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.918 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.918 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.918 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641974+0000", 2024-09-12T18:36:31.918 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3413e-05 2024-09-12T18:36:31.918 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.918 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.918 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:31.918 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654560+0000", 2024-09-12T18:36:31.918 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012585308999999999 2024-09-12T18:36:31.918 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.918 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.918 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:31.918 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654822+0000", 2024-09-12T18:36:31.919 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026210099999999999 2024-09-12T18:36:31.919 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.919 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.919 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:31.919 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655059+0000", 2024-09-12T18:36:31.919 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00023747899999999999 2024-09-12T18:36:31.919 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.919 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.919 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:31.919 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.656315+0000", 2024-09-12T18:36:31.919 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0012555000000000001 2024-09-12T18:36:31.919 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.920 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.920 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:31.920 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668590+0000", 2024-09-12T18:36:31.920 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012274851999999999 2024-09-12T18:36:31.920 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.920 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.920 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:31.920 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668725+0000", 2024-09-12T18:36:31.920 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013524199999999999 2024-09-12T18:36:31.920 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.920 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.920 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:31.920 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668857+0000", 2024-09-12T18:36:31.921 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013216899999999999 2024-09-12T18:36:31.921 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.921 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:31.921 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.921 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.921 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.921 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:31.921 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:36:31.921 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 66.215815309000007, 2024-09-12T18:36:31.921 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023616723999999999, 2024-09-12T18:36:31.921 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:31.921 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:31.921 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:31.921 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:31.922 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.922 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:31.922 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:36:31.922 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.922 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.922 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.922 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:31.922 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:36:31.922 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.922 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.922 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.922 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:31.922 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641992+0000", 2024-09-12T18:36:31.923 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.08e-06 2024-09-12T18:36:31.923 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.923 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.923 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:31.923 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641998+0000", 2024-09-12T18:36:31.923 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4299999999999997e-06 2024-09-12T18:36:31.923 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.923 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.923 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:31.923 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642014+0000", 2024-09-12T18:36:31.923 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6266e-05 2024-09-12T18:36:31.923 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.923 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.924 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.924 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642026+0000", 2024-09-12T18:36:31.924 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2567e-05 2024-09-12T18:36:31.924 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.924 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.924 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:31.924 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642213+0000", 2024-09-12T18:36:31.924 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00018701899999999999 2024-09-12T18:36:31.924 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.924 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.924 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:31.924 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642507+0000", 2024-09-12T18:36:31.924 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00029394700000000002 2024-09-12T18:36:31.925 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.925 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.925 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:31.925 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642686+0000", 2024-09-12T18:36:31.925 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000178152 2024-09-12T18:36:31.925 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.925 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.925 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:31.925 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650952+0000", 2024-09-12T18:36:31.925 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0082663570000000002 2024-09-12T18:36:31.925 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.925 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.926 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:31.926 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665382+0000", 2024-09-12T18:36:31.926 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.014430111000000001 2024-09-12T18:36:31.926 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.926 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.926 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:31.926 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665508+0000", 2024-09-12T18:36:31.926 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000125986 2024-09-12T18:36:31.926 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.926 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.926 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:31.926 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665608+0000", 2024-09-12T18:36:31.926 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9809000000000006e-05 2024-09-12T18:36:31.926 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.927 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:31.927 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.927 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.927 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.927 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:31.927 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:36:31.927 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 66.215687443999997, 2024-09-12T18:36:31.927 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024670563, 2024-09-12T18:36:31.927 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:31.927 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:31.927 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:31.927 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:31.927 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.928 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:31.928 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:36:31.928 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.928 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.928 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.928 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:31.928 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:36:31.928 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.928 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.928 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.928 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:31.928 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642120+0000", 2024-09-12T18:36:31.928 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1769999999999999e-06 2024-09-12T18:36:31.929 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.929 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.929 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:31.929 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642128+0000", 2024-09-12T18:36:31.929 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3429999999999998e-06 2024-09-12T18:36:31.929 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.929 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.929 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:31.929 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642192+0000", 2024-09-12T18:36:31.929 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4406999999999995e-05 2024-09-12T18:36:31.929 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.929 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.929 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.930 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642223+0000", 2024-09-12T18:36:31.930 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.1266000000000002e-05 2024-09-12T18:36:31.930 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.930 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.930 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:31.930 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643201+0000", 2024-09-12T18:36:31.930 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0009778390000000001 2024-09-12T18:36:31.930 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.930 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.930 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:31.930 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643410+0000", 2024-09-12T18:36:31.930 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020874199999999999 2024-09-12T18:36:31.930 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.930 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.931 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:31.931 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643685+0000", 2024-09-12T18:36:31.931 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027520700000000002 2024-09-12T18:36:31.931 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.931 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.931 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:31.931 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650966+0000", 2024-09-12T18:36:31.931 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072810710000000001 2024-09-12T18:36:31.931 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.931 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.931 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:31.931 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666560+0000", 2024-09-12T18:36:31.931 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015594143 2024-09-12T18:36:31.931 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.932 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.932 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:31.932 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666691+0000", 2024-09-12T18:36:31.932 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000130359 2024-09-12T18:36:31.932 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.932 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.932 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:31.932 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666790+0000", 2024-09-12T18:36:31.932 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9009e-05 2024-09-12T18:36:31.932 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.932 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:31.932 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.932 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.933 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.933 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:31.933 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:36:31.933 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 66.214909156000004, 2024-09-12T18:36:31.933 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024891744, 2024-09-12T18:36:31.933 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:31.933 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:31.933 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:31.933 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:31.933 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.934 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:31.934 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:36:31.934 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.934 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.934 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.934 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:31.934 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:36:31.934 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.934 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.934 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.935 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:31.935 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642899+0000", 2024-09-12T18:36:31.935 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4729999999999999e-06 2024-09-12T18:36:31.935 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.935 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.935 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:31.935 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642912+0000", 2024-09-12T18:36:31.935 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3495999999999999e-05 2024-09-12T18:36:31.935 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.935 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.935 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:31.935 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642934+0000", 2024-09-12T18:36:31.935 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2033999999999999e-05 2024-09-12T18:36:31.935 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.936 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.936 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.936 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642949+0000", 2024-09-12T18:36:31.936 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4970000000000001e-05 2024-09-12T18:36:31.936 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.936 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.936 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:31.936 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644400+0000", 2024-09-12T18:36:31.936 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001450305 2024-09-12T18:36:31.936 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.936 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.936 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:31.937 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644617+0000", 2024-09-12T18:36:31.937 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000217302 2024-09-12T18:36:31.937 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.937 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.937 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:31.940 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645052+0000", 2024-09-12T18:36:31.940 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000434797 2024-09-12T18:36:31.940 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.941 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.941 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:31.941 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653860+0000", 2024-09-12T18:36:31.941 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0088082249999999994 2024-09-12T18:36:31.941 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.941 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.941 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:31.941 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667598+0000", 2024-09-12T18:36:31.941 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.013738451 2024-09-12T18:36:31.941 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.941 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.941 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:31.942 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667698+0000", 2024-09-12T18:36:31.942 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9854999999999999e-05 2024-09-12T18:36:31.942 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.942 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.942 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:31.942 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667789+0000", 2024-09-12T18:36:31.942 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0835999999999996e-05 2024-09-12T18:36:31.942 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.942 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:31.942 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.942 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.942 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.942 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:30 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:31.943 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:36:31.943 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 66.214834339999996, 2024-09-12T18:36:31.943 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023936852000000002, 2024-09-12T18:36:31.943 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:31.943 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:31.943 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:31.943 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:31.943 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.943 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:31.943 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:36:31.943 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.943 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.943 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.944 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:31.944 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:36:31.944 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.944 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.944 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.944 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:31.944 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642973+0000", 2024-09-12T18:36:31.944 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.11e-06 2024-09-12T18:36:31.944 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.944 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.944 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:31.944 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642994+0000", 2024-09-12T18:36:31.945 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.0699999999999998e-05 2024-09-12T18:36:31.945 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.945 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.945 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:31.945 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643011+0000", 2024-09-12T18:36:31.945 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7229999999999999e-05 2024-09-12T18:36:31.945 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.945 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.945 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.945 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643025+0000", 2024-09-12T18:36:31.945 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3803e-05 2024-09-12T18:36:31.945 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.945 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.946 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:31.946 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643143+0000", 2024-09-12T18:36:31.946 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000118225 2024-09-12T18:36:31.946 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.946 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.946 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:31.946 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643426+0000", 2024-09-12T18:36:31.946 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00028250500000000001 2024-09-12T18:36:31.946 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.946 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.946 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:31.946 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643864+0000", 2024-09-12T18:36:31.947 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00043856 2024-09-12T18:36:31.947 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.947 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.947 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:31.947 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651148+0000", 2024-09-12T18:36:31.947 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072836769999999997 2024-09-12T18:36:31.947 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.947 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.947 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:31.947 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666674+0000", 2024-09-12T18:36:31.947 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015525786999999999 2024-09-12T18:36:31.947 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.947 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.947 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:31.948 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666796+0000", 2024-09-12T18:36:31.948 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000122416 2024-09-12T18:36:31.948 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.948 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.948 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:31.948 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666909+0000", 2024-09-12T18:36:31.948 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011283899999999999 2024-09-12T18:36:31.948 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.948 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:31.948 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.948 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.948 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.948 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:31.949 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:36:31.949 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 66.214751633999995, 2024-09-12T18:36:31.949 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024100234000000002, 2024-09-12T18:36:31.949 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:31.949 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:31.949 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:31.949 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:31.949 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.949 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:31.949 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:36:31.949 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.949 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.949 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.950 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:31.950 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:36:31.950 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.950 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.950 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.950 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:31.950 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643056+0000", 2024-09-12T18:36:31.950 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.046e-06 2024-09-12T18:36:31.950 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.950 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.950 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:31.950 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643068+0000", 2024-09-12T18:36:31.950 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2106999999999999e-05 2024-09-12T18:36:31.950 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.951 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.951 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:31.951 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643085+0000", 2024-09-12T18:36:31.951 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7479999999999999e-05 2024-09-12T18:36:31.951 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.951 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.951 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.951 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643099+0000", 2024-09-12T18:36:31.951 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3730000000000001e-05 2024-09-12T18:36:31.951 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.951 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.951 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:31.951 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644623+0000", 2024-09-12T18:36:31.952 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0015236080000000001 2024-09-12T18:36:31.952 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.952 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.952 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:31.952 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644893+0000", 2024-09-12T18:36:31.952 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026990500000000003 2024-09-12T18:36:31.952 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.952 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.952 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:31.952 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645227+0000", 2024-09-12T18:36:31.952 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00033391300000000003 2024-09-12T18:36:31.952 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.952 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.953 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:31.953 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653926+0000", 2024-09-12T18:36:31.953 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0086993339999999995 2024-09-12T18:36:31.953 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.953 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.953 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:31.953 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666925+0000", 2024-09-12T18:36:31.953 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012998686000000001 2024-09-12T18:36:31.953 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.953 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.953 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:31.953 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667057+0000", 2024-09-12T18:36:31.953 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013255600000000001 2024-09-12T18:36:31.953 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.954 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.954 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:31.954 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667155+0000", 2024-09-12T18:36:31.954 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7868999999999994e-05 2024-09-12T18:36:31.954 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.954 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:31.954 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.954 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.954 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.954 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:31.954 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643139+0000", 2024-09-12T18:36:31.954 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 66.214667047999995, 2024-09-12T18:36:31.954 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.022417057000000001, 2024-09-12T18:36:31.955 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:31.955 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:31.955 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:31.955 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:31.955 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.955 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:31.955 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643139+0000", 2024-09-12T18:36:31.955 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.955 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.955 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.955 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:31.955 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643139+0000", 2024-09-12T18:36:31.955 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.955 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.955 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.956 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:31.956 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643140+0000", 2024-09-12T18:36:31.956 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0729999999999999e-06 2024-09-12T18:36:31.956 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.956 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.956 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:31.956 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643151+0000", 2024-09-12T18:36:31.956 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.039e-05 2024-09-12T18:36:31.956 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.956 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.956 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:31.956 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643168+0000", 2024-09-12T18:36:31.957 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7575999999999999e-05 2024-09-12T18:36:31.957 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.957 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.957 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.957 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643182+0000", 2024-09-12T18:36:31.957 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3224000000000001e-05 2024-09-12T18:36:31.957 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.957 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.957 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:31.957 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643358+0000", 2024-09-12T18:36:31.957 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00017676500000000001 2024-09-12T18:36:31.957 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.957 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.958 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:31.958 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643647+0000", 2024-09-12T18:36:31.958 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00028850499999999999 2024-09-12T18:36:31.958 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.958 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.958 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:31.958 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643924+0000", 2024-09-12T18:36:31.958 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000277547 2024-09-12T18:36:31.958 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.958 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.958 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:31.958 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650289+0000", 2024-09-12T18:36:31.958 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0063645350000000002 2024-09-12T18:36:31.958 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.959 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.959 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:31.959 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665333+0000", 2024-09-12T18:36:31.959 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015043531000000001 2024-09-12T18:36:31.959 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.959 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.959 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:31.959 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665454+0000", 2024-09-12T18:36:31.959 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000121302 2024-09-12T18:36:31.959 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.959 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.959 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:31.960 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665556+0000", 2024-09-12T18:36:31.960 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010260900000000001 2024-09-12T18:36:31.960 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.960 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:31.960 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.960 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.960 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.960 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:31.960 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:36:31.960 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 66.214555845000007, 2024-09-12T18:36:31.960 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024255982999999998, 2024-09-12T18:36:31.961 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:31.961 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:31.961 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:31.961 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:31.961 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.961 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:31.961 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:36:31.961 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.961 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.961 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.961 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:31.961 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:36:31.962 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.962 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.962 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.962 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:31.962 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643252+0000", 2024-09-12T18:36:31.962 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:31.962 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.962 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.962 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:31.962 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643287+0000", 2024-09-12T18:36:31.962 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5225999999999998e-05 2024-09-12T18:36:31.962 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.962 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.963 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:31.963 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643323+0000", 2024-09-12T18:36:31.963 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5488999999999999e-05 2024-09-12T18:36:31.963 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.963 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.963 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.963 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643357+0000", 2024-09-12T18:36:31.963 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.3853999999999998e-05 2024-09-12T18:36:31.963 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.963 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.963 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:31.963 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646716+0000", 2024-09-12T18:36:31.963 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003359 2024-09-12T18:36:31.964 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.964 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.964 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:31.964 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647037+0000", 2024-09-12T18:36:31.964 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032131800000000002 2024-09-12T18:36:31.964 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.964 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.964 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:31.964 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647337+0000", 2024-09-12T18:36:31.964 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000300208 2024-09-12T18:36:31.964 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.964 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.965 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:31.965 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654291+0000", 2024-09-12T18:36:31.965 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0069543089999999997 2024-09-12T18:36:31.965 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.965 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.965 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:31.965 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667297+0000", 2024-09-12T18:36:31.965 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.013005526 2024-09-12T18:36:31.965 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.965 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.965 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:31.965 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667416+0000", 2024-09-12T18:36:31.965 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000119416 2024-09-12T18:36:31.965 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.966 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.966 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:31.966 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667507+0000", 2024-09-12T18:36:31.966 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0206999999999999e-05 2024-09-12T18:36:31.966 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.966 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:31.966 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.966 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.966 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.966 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:31.966 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:36:31.966 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 66.214428749999996, 2024-09-12T18:36:31.966 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023888482999999999, 2024-09-12T18:36:31.967 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:31.967 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:31.967 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:31.967 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:31.967 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.967 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:31.967 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:36:31.967 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.967 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.967 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.967 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:31.967 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:36:31.967 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.968 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.968 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.968 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:31.968 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643379+0000", 2024-09-12T18:36:31.968 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.207e-06 2024-09-12T18:36:31.968 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.968 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.968 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:31.968 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643390+0000", 2024-09-12T18:36:31.968 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0696000000000001e-05 2024-09-12T18:36:31.968 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.968 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.969 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:31.969 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643407+0000", 2024-09-12T18:36:31.969 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7563000000000001e-05 2024-09-12T18:36:31.969 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.969 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.969 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.969 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643420+0000", 2024-09-12T18:36:31.969 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3277e-05 2024-09-12T18:36:31.969 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.969 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.969 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:31.969 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644906+0000", 2024-09-12T18:36:31.969 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001485945 2024-09-12T18:36:31.970 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.970 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.970 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:31.970 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645404+0000", 2024-09-12T18:36:31.970 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00049807599999999997 2024-09-12T18:36:31.970 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.970 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.970 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:31.970 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645846+0000", 2024-09-12T18:36:31.970 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00044190400000000002 2024-09-12T18:36:31.970 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.970 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.970 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:31.971 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654223+0000", 2024-09-12T18:36:31.971 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0083767419999999995 2024-09-12T18:36:31.971 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.971 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.971 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:31.971 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667026+0000", 2024-09-12T18:36:31.971 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012802531000000001 2024-09-12T18:36:31.971 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.971 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.971 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:31.971 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667162+0000", 2024-09-12T18:36:31.971 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000136112 2024-09-12T18:36:31.971 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.971 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.972 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:31.972 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667266+0000", 2024-09-12T18:36:31.972 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010443 2024-09-12T18:36:31.972 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.972 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:31.972 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.972 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.972 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.972 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:31.972 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643447+0000", 2024-09-12T18:36:31.972 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 66.214359224000006, 2024-09-12T18:36:31.972 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.022081562999999998, 2024-09-12T18:36:31.972 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:31.973 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:31.973 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:31.973 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:31.973 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.973 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:31.973 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643447+0000", 2024-09-12T18:36:31.973 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.973 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.973 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.973 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:31.973 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643447+0000", 2024-09-12T18:36:31.973 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.973 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.973 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.974 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:31.974 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643448+0000", 2024-09-12T18:36:31.974 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1629999999999999e-06 2024-09-12T18:36:31.974 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.974 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.974 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:31.974 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643458+0000", 2024-09-12T18:36:31.974 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.8400000000000007e-06 2024-09-12T18:36:31.974 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.974 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.974 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:31.974 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643475+0000", 2024-09-12T18:36:31.974 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6874000000000001e-05 2024-09-12T18:36:31.975 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.975 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.975 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.975 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643488+0000", 2024-09-12T18:36:31.975 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3026e-05 2024-09-12T18:36:31.975 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.975 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.975 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:31.975 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643931+0000", 2024-09-12T18:36:31.975 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00044307 2024-09-12T18:36:31.975 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.975 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.975 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:31.976 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644210+0000", 2024-09-12T18:36:31.976 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027908400000000003 2024-09-12T18:36:31.976 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.976 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.976 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:31.976 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644606+0000", 2024-09-12T18:36:31.976 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00039615400000000002 2024-09-12T18:36:31.976 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.976 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.976 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:31.976 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650552+0000", 2024-09-12T18:36:31.976 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0059455619999999997 2024-09-12T18:36:31.976 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.977 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.977 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:31.977 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665302+0000", 2024-09-12T18:36:31.977 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.014749962 2024-09-12T18:36:31.977 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.977 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.977 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:31.977 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665424+0000", 2024-09-12T18:36:31.977 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012214300000000001 2024-09-12T18:36:31.977 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.977 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.977 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:31.977 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665529+0000", 2024-09-12T18:36:31.977 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000104685 2024-09-12T18:36:31.978 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.978 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:31.978 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.978 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.978 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.978 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:31.978 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:36:31.978 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 66.214278031000006, 2024-09-12T18:36:31.978 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024222582999999999, 2024-09-12T18:36:31.978 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:31.978 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:31.978 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:31.978 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:31.979 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.979 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:31.979 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:36:31.979 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.979 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.979 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.979 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:31.979 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:36:31.979 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:31.979 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.979 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.979 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:31.979 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643530+0000", 2024-09-12T18:36:31.979 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.393e-06 2024-09-12T18:36:31.979 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.980 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.980 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:31.980 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643536+0000", 2024-09-12T18:36:31.980 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4130000000000003e-06 2024-09-12T18:36:31.980 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.980 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.980 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:31.980 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643554+0000", 2024-09-12T18:36:31.980 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7572999999999999e-05 2024-09-12T18:36:31.980 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.980 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.980 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:31.980 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643567+0000", 2024-09-12T18:36:31.980 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3393999999999999e-05 2024-09-12T18:36:31.981 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.981 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.981 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:31.981 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648198+0000", 2024-09-12T18:36:31.981 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0046304479999999997 2024-09-12T18:36:31.981 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.981 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.981 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:31.981 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648413+0000", 2024-09-12T18:36:31.981 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00021507500000000001 2024-09-12T18:36:31.981 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:31.981 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:31.981 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:31.981 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667751+0000", 2024-09-12T18:36:31.982 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.019338286999999999 2024-09-12T18:36:31.982 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.982 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:31.982 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.982 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:31.982 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:31.982 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:36:31.983 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 46 16 108268 108252 147.066 132.625 0.00739637 0.00679509 2024-09-12T18:36:31.983 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:31.979+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:31.984 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:36:32.084 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:32.083+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:32.136 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:32.136 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:36:32.136 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.136 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:108777 5.8 e45/21 5:1701021e:::benchmark_data_smithi073_23739_object108776:head v 45'6645, mlcod=45'6643)", 2024-09-12T18:36:32.136 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:32.131126+0000", 2024-09-12T18:36:32.136 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.002194489, 2024-09-12T18:36:32.136 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0022114040000000001, 2024-09-12T18:36:32.136 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:32.137 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:32.137 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:32.137 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:32.137 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.137 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:32.137 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.131126+0000", 2024-09-12T18:36:32.137 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:32.137 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.137 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.137 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:32.137 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.131126+0000", 2024-09-12T18:36:32.138 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:32.138 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.138 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.138 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:32.138 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.131127+0000", 2024-09-12T18:36:32.138 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2599999999999998e-07 2024-09-12T18:36:32.138 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.138 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.138 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:32.138 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.131198+0000", 2024-09-12T18:36:32.139 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1402000000000005e-05 2024-09-12T18:36:32.139 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.139 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.139 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:32.139 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.131206+0000", 2024-09-12T18:36:32.139 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.7379999999999994e-06 2024-09-12T18:36:32.139 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.139 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.139 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:32.139 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.131211+0000", 2024-09-12T18:36:32.139 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0560000000000004e-06 2024-09-12T18:36:32.140 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.140 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.140 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:32.140 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.131270+0000", 2024-09-12T18:36:32.140 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9533000000000001e-05 2024-09-12T18:36:32.140 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.140 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.140 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:32.140 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.131287+0000", 2024-09-12T18:36:32.140 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6345e-05 2024-09-12T18:36:32.141 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:32.141 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:32.141 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:32.141 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.141 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.141 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:108779 5.3 5:ca7f60af:::benchmark_data_smithi073_23739_object108778:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:36:32.141 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:32.131749+0000", 2024-09-12T18:36:32.141 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0015720669999999999, 2024-09-12T18:36:32.142 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0016500969999999999, 2024-09-12T18:36:32.142 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:32.144 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:32.144 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:32.144 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:32.144 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:32.145 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:32.145 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 108779 2024-09-12T18:36:32.145 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.145 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:32.145 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.145 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:32.145 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.131749+0000", 2024-09-12T18:36:32.145 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:32.145 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.145 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.145 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:32.145 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.131749+0000", 2024-09-12T18:36:32.146 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:32.146 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.146 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.146 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:32.146 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.131750+0000", 2024-09-12T18:36:32.146 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.3699999999999999e-07 2024-09-12T18:36:32.146 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.146 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.146 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:32.146 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.131838+0000", 2024-09-12T18:36:32.147 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7927e-05 2024-09-12T18:36:32.147 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.147 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.147 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:32.147 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.131850+0000", 2024-09-12T18:36:32.147 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1989e-05 2024-09-12T18:36:32.147 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.147 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.147 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:32.148 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.131857+0000", 2024-09-12T18:36:32.148 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4229999999999999e-06 2024-09-12T18:36:32.148 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.148 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.148 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:32.148 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.131907+0000", 2024-09-12T18:36:32.148 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0251999999999999e-05 2024-09-12T18:36:32.148 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.148 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.148 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:32.148 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.131977+0000", 2024-09-12T18:36:32.148 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.9741999999999997e-05 2024-09-12T18:36:32.149 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.149 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.149 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:32.149 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.132051+0000", 2024-09-12T18:36:32.149 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4098999999999996e-05 2024-09-12T18:36:32.149 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:32.149 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:32.149 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:32.149 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.149 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.149 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:108780 5.3 5.879eeeb3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:36:32.149 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:32.132994+0000", 2024-09-12T18:36:32.149 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00032630499999999999, 2024-09-12T18:36:32.150 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00047432600000000001, 2024-09-12T18:36:32.150 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:32.150 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:32.150 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:32.150 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:32.150 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:32.150 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:32.150 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 108780 2024-09-12T18:36:32.150 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.150 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:32.150 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.150 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:32.150 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.132994+0000", 2024-09-12T18:36:32.150 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:32.151 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.151 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.151 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:32.151 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.132994+0000", 2024-09-12T18:36:32.151 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:32.151 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.151 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.151 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:32.151 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.132995+0000", 2024-09-12T18:36:32.151 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.9099999999999991e-07 2024-09-12T18:36:32.151 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.152 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.152 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:32.152 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.133049+0000", 2024-09-12T18:36:32.152 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.3390000000000002e-05 2024-09-12T18:36:32.152 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.152 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.152 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:32.152 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.133061+0000", 2024-09-12T18:36:32.152 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2405999999999999e-05 2024-09-12T18:36:32.152 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.152 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.152 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:32.153 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.133069+0000", 2024-09-12T18:36:32.153 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.9540000000000004e-06 2024-09-12T18:36:32.153 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:32.153 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:32.153 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:32.153 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.153 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.153 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:108781 5.a 5:5a445457:::benchmark_data_smithi073_23739_object108780:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:36:32.153 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:32.133310+0000", 2024-09-12T18:36:32.153 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 1.0842999999999999e-05, 2024-09-12T18:36:32.153 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00021760099999999999, 2024-09-12T18:36:32.153 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:32.153 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:32.153 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:32.154 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:32.154 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:32.154 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:32.154 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 108781 2024-09-12T18:36:32.154 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.154 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:32.154 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.154 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:32.154 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.133310+0000", 2024-09-12T18:36:32.154 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:32.154 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.154 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.154 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:32.155 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.133310+0000", 2024-09-12T18:36:32.155 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:32.155 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.155 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.155 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:32.155 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.133311+0000", 2024-09-12T18:36:32.155 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.75e-07 2024-09-12T18:36:32.155 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.155 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.155 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:32.155 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.133338+0000", 2024-09-12T18:36:32.155 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7005e-05 2024-09-12T18:36:32.155 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.156 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.156 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:32.156 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.133347+0000", 2024-09-12T18:36:32.156 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.8539999999999992e-06 2024-09-12T18:36:32.156 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.156 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.156 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:32.156 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.133352+0000", 2024-09-12T18:36:32.156 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.797e-06 2024-09-12T18:36:32.157 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.157 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.157 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:32.157 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.133385+0000", 2024-09-12T18:36:32.157 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.2851000000000001e-05 2024-09-12T18:36:32.157 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.157 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.157 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:32.157 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.133467+0000", 2024-09-12T18:36:32.157 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1515999999999997e-05 2024-09-12T18:36:32.158 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:32.158 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:32.158 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:32.158 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.158 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.158 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:108764 5.a 5:5b6ac5b9:::benchmark_data_smithi073_23739_object108763:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:36:32.158 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:32.124236+0000", 2024-09-12T18:36:32.158 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0090850240000000006, 2024-09-12T18:36:32.158 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0093633439999999991, 2024-09-12T18:36:32.158 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:32.158 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:32.158 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:32.159 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:32.159 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:32.159 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:32.159 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 108764 2024-09-12T18:36:32.159 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.159 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:32.159 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.159 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:32.159 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.124236+0000", 2024-09-12T18:36:32.159 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:32.160 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.160 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.160 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:32.160 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.124236+0000", 2024-09-12T18:36:32.160 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:32.160 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.160 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.160 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:32.160 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.124237+0000", 2024-09-12T18:36:32.160 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.271e-06 2024-09-12T18:36:32.160 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.160 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.161 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:32.161 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.124265+0000", 2024-09-12T18:36:32.161 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.8442e-05 2024-09-12T18:36:32.161 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.161 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.161 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:32.161 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.124275+0000", 2024-09-12T18:36:32.161 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.8819999999999996e-06 2024-09-12T18:36:32.161 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.161 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.161 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:32.161 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.124283+0000", 2024-09-12T18:36:32.161 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3189999999999997e-06 2024-09-12T18:36:32.161 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.162 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.162 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:32.162 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.127736+0000", 2024-09-12T18:36:32.162 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0034531309999999999 2024-09-12T18:36:32.162 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.162 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.162 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:32.162 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.127852+0000", 2024-09-12T18:36:32.162 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000116248 2024-09-12T18:36:32.162 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.162 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.162 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:32.162 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.127979+0000", 2024-09-12T18:36:32.163 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012707500000000001 2024-09-12T18:36:32.163 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.163 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.163 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:32.163 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.132614+0000", 2024-09-12T18:36:32.163 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0046343959999999998 2024-09-12T18:36:32.163 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:32.163 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:32.163 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:32.163 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.163 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.163 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:108765 5.4 e45/21 5:25b5d0f1:::benchmark_data_smithi073_23739_object108764:head v 45'6721, mlcod=45'6719)", 2024-09-12T18:36:32.163 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:32.124826+0000", 2024-09-12T18:36:32.163 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0084946959999999995, 2024-09-12T18:36:32.164 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0088503009999999997, 2024-09-12T18:36:32.164 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:32.164 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:32.164 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:32.164 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:32.164 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.164 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:32.164 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.124826+0000", 2024-09-12T18:36:32.164 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:32.164 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.164 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.164 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:32.165 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.124826+0000", 2024-09-12T18:36:32.165 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:32.165 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.165 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.165 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:32.165 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.124827+0000", 2024-09-12T18:36:32.165 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1999999999999999e-07 2024-09-12T18:36:32.165 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.165 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.165 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:32.165 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.124895+0000", 2024-09-12T18:36:32.165 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7840000000000001e-05 2024-09-12T18:36:32.165 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.165 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.166 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:32.166 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.124901+0000", 2024-09-12T18:36:32.166 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.9190000000000002e-06 2024-09-12T18:36:32.166 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.166 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.166 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:32.166 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.124906+0000", 2024-09-12T18:36:32.166 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3959999999999999e-06 2024-09-12T18:36:32.166 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.167 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.167 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:32.167 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.124950+0000", 2024-09-12T18:36:32.167 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4141000000000003e-05 2024-09-12T18:36:32.167 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.167 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.167 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:32.167 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.124966+0000", 2024-09-12T18:36:32.168 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5733999999999999e-05 2024-09-12T18:36:32.168 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:32.168 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:32.168 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:32.168 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.168 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.168 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:108771 5.5 5:ad3bba9c:::benchmark_data_smithi073_23739_object108770:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:36:32.168 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:32.126123+0000", 2024-09-12T18:36:32.168 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0071977760000000003, 2024-09-12T18:36:32.169 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0076113800000000001, 2024-09-12T18:36:32.169 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:32.169 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:32.169 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:32.169 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:32.169 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:32.169 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:32.169 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 108771 2024-09-12T18:36:32.169 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.169 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:32.169 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.169 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:32.169 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.126123+0000", 2024-09-12T18:36:32.169 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:32.170 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.170 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.170 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:32.170 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.126123+0000", 2024-09-12T18:36:32.170 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:32.170 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.170 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.170 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:32.170 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.126124+0000", 2024-09-12T18:36:32.170 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.8299999999999995e-07 2024-09-12T18:36:32.171 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.171 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.171 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:32.171 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.126159+0000", 2024-09-12T18:36:32.171 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4919999999999998e-05 2024-09-12T18:36:32.171 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.171 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.171 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:32.171 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.126169+0000", 2024-09-12T18:36:32.171 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0030999999999999e-05 2024-09-12T18:36:32.171 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.171 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.171 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:32.172 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.126175+0000", 2024-09-12T18:36:32.172 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5409999999999997e-06 2024-09-12T18:36:32.172 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.172 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.172 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:32.172 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.129988+0000", 2024-09-12T18:36:32.172 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0038120509999999999 2024-09-12T18:36:32.172 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.173 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.173 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:32.173 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.130089+0000", 2024-09-12T18:36:32.173 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000101004 2024-09-12T18:36:32.173 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.173 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.174 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:32.174 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.130188+0000", 2024-09-12T18:36:32.174 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.9374000000000001e-05 2024-09-12T18:36:32.174 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.174 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.174 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:32.174 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.132857+0000", 2024-09-12T18:36:32.174 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0026691639999999999 2024-09-12T18:36:32.174 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:32.174 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:32.174 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:32.174 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.175 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.175 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:108770 5.4 e45/21 5:2870b57a:::benchmark_data_smithi073_23739_object108769:head v 45'6722, mlcod=45'6719)", 2024-09-12T18:36:32.175 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:32.127159+0000", 2024-09-12T18:36:32.175 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0061620349999999997, 2024-09-12T18:36:32.175 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.006649337, 2024-09-12T18:36:32.175 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:32.175 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:32.175 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:32.175 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:32.175 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.175 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:32.176 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.127159+0000", 2024-09-12T18:36:32.176 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:32.176 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.176 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.176 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:32.176 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.127159+0000", 2024-09-12T18:36:32.176 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:32.176 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.177 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.177 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:32.177 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.127159+0000", 2024-09-12T18:36:32.177 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3399999999999998e-07 2024-09-12T18:36:32.177 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.177 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.177 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:32.177 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.127204+0000", 2024-09-12T18:36:32.178 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4719999999999999e-05 2024-09-12T18:36:32.178 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.178 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.178 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:32.178 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.127214+0000", 2024-09-12T18:36:32.178 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.3200000000000006e-06 2024-09-12T18:36:32.179 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.179 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.179 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:32.179 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.127220+0000", 2024-09-12T18:36:32.179 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1639999999999998e-06 2024-09-12T18:36:32.179 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.179 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.179 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:32.179 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.129650+0000", 2024-09-12T18:36:32.179 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0024299759999999999 2024-09-12T18:36:32.180 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.180 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.180 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:32.180 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.129666+0000", 2024-09-12T18:36:32.180 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6697999999999998e-05 2024-09-12T18:36:32.180 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:32.180 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:32.180 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:32.180 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.180 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.180 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:108772 5.c 5:358a329b:::benchmark_data_smithi073_23739_object108771:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:36:32.181 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:32.128117+0000", 2024-09-12T18:36:32.181 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.005204129, 2024-09-12T18:36:32.181 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0057511009999999998, 2024-09-12T18:36:32.181 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:32.181 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:32.181 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:32.181 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:32.181 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:32.181 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:32.181 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 108772 2024-09-12T18:36:32.181 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.181 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:32.182 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.182 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:32.182 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.128117+0000", 2024-09-12T18:36:32.182 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:32.182 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.182 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.182 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:32.182 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.128117+0000", 2024-09-12T18:36:32.182 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:32.182 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.182 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.183 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:32.183 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.128118+0000", 2024-09-12T18:36:32.183 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.11e-06 2024-09-12T18:36:32.183 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.183 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.183 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:32.183 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.128181+0000", 2024-09-12T18:36:32.183 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3567999999999999e-05 2024-09-12T18:36:32.183 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.183 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.183 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:32.184 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.128201+0000", 2024-09-12T18:36:32.184 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9707e-05 2024-09-12T18:36:32.184 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.184 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.184 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:32.184 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.128208+0000", 2024-09-12T18:36:32.184 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7469999999999999e-06 2024-09-12T18:36:32.184 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.184 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.185 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:32.185 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.129642+0000", 2024-09-12T18:36:32.185 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001434458 2024-09-12T18:36:32.185 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.185 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.185 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:32.185 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.129801+0000", 2024-09-12T18:36:32.185 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015838500000000001 2024-09-12T18:36:32.185 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.185 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.186 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:32.186 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.129927+0000", 2024-09-12T18:36:32.186 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012673299999999999 2024-09-12T18:36:32.186 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.186 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.186 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:32.186 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.133250+0000", 2024-09-12T18:36:32.186 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.003322312 2024-09-12T18:36:32.186 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:32.186 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:32.186 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:32.187 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.187 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.187 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:108774 5.7 e45/21 5:e16b7fd3:::benchmark_data_smithi073_23739_object108773:head v 45'6802, mlcod=45'6800)", 2024-09-12T18:36:32.187 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:32.130605+0000", 2024-09-12T18:36:32.187 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0027160320000000002, 2024-09-12T18:36:32.187 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0033352550000000001, 2024-09-12T18:36:32.187 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:32.187 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:32.187 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:32.188 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:32.188 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.188 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:32.188 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.130605+0000", 2024-09-12T18:36:32.188 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:32.188 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.188 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.188 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:32.188 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.130605+0000", 2024-09-12T18:36:32.188 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:32.188 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.189 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.189 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:32.189 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.130605+0000", 2024-09-12T18:36:32.189 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.75e-07 2024-09-12T18:36:32.189 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.189 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.189 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:32.189 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.130696+0000", 2024-09-12T18:36:32.189 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1032000000000005e-05 2024-09-12T18:36:32.189 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.190 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.190 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:32.190 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.130706+0000", 2024-09-12T18:36:32.190 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.6919999999999997e-06 2024-09-12T18:36:32.190 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.190 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.190 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:32.190 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.130714+0000", 2024-09-12T18:36:32.190 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8229999999999995e-06 2024-09-12T18:36:32.190 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.190 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.190 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:32.190 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.130788+0000", 2024-09-12T18:36:32.190 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4389999999999998e-05 2024-09-12T18:36:32.191 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.191 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.191 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:32.191 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.130811+0000", 2024-09-12T18:36:32.191 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2566999999999999e-05 2024-09-12T18:36:32.191 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:32.191 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:32.191 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:32.191 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.192 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.192 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:108778 5.6 5:68522974:::benchmark_data_smithi073_23739_object108777:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:36:32.192 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:32.130656+0000", 2024-09-12T18:36:32.192 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0026649450000000002, 2024-09-12T18:36:32.192 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0033408589999999998, 2024-09-12T18:36:32.192 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:32.192 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:32.192 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:32.192 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:32.192 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:32.192 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:32.192 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 108778 2024-09-12T18:36:32.192 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.193 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:32.193 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.193 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:32.193 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.130656+0000", 2024-09-12T18:36:32.193 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:32.193 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.193 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.193 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:32.193 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.130656+0000", 2024-09-12T18:36:32.194 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:32.194 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.194 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.194 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:32.194 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.130665+0000", 2024-09-12T18:36:32.194 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2879999999999998e-06 2024-09-12T18:36:32.194 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.194 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.194 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:32.194 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.130737+0000", 2024-09-12T18:36:32.194 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1985999999999998e-05 2024-09-12T18:36:32.194 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.194 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.194 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:32.195 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.130755+0000", 2024-09-12T18:36:32.195 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7982000000000002e-05 2024-09-12T18:36:32.195 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.195 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.195 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:32.195 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.130764+0000", 2024-09-12T18:36:32.195 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.8780000000000004e-06 2024-09-12T18:36:32.195 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.195 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.195 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:32.195 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.130814+0000", 2024-09-12T18:36:32.195 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0059999999999998e-05 2024-09-12T18:36:32.195 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.196 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.196 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:32.196 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.130929+0000", 2024-09-12T18:36:32.196 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000115202 2024-09-12T18:36:32.196 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.196 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.196 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:32.196 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.131056+0000", 2024-09-12T18:36:32.196 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012644199999999999 2024-09-12T18:36:32.196 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.196 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.196 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:32.196 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.133647+0000", 2024-09-12T18:36:32.196 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0025910550000000001 2024-09-12T18:36:32.197 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:32.197 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:32.197 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:32.197 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.197 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.197 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:108776 5.4 e45/21 5:2b138f0e:::benchmark_data_smithi073_23739_object108775:head v 45'6723, mlcod=45'6719)", 2024-09-12T18:36:32.197 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:32.130740+0000", 2024-09-12T18:36:32.197 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0025807180000000001, 2024-09-12T18:36:32.197 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0033240129999999998, 2024-09-12T18:36:32.197 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:32.197 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:32.197 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:32.198 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:32.198 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.198 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:32.198 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.130740+0000", 2024-09-12T18:36:32.198 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:32.198 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.198 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.198 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:32.198 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.130740+0000", 2024-09-12T18:36:32.198 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:32.199 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.199 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.199 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:32.199 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.130741+0000", 2024-09-12T18:36:32.199 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2399999999999997e-07 2024-09-12T18:36:32.199 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.199 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.199 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:32.199 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.130780+0000", 2024-09-12T18:36:32.199 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.888e-05 2024-09-12T18:36:32.199 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.200 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.200 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:32.200 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.130789+0000", 2024-09-12T18:36:32.200 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.8640000000000002e-06 2024-09-12T18:36:32.200 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.200 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.200 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:32.200 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.130795+0000", 2024-09-12T18:36:32.200 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9859999999999999e-06 2024-09-12T18:36:32.200 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.200 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.200 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:32.201 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.133706+0000", 2024-09-12T18:36:32.201 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.002911145 2024-09-12T18:36:32.201 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:32.201 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:32.201 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:32.201 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.133718+0000", 2024-09-12T18:36:32.201 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2227e-05 2024-09-12T18:36:32.201 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:32.201 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:32.201 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:32.202 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:32.202 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-12T18:36:32.202 INFO:teuthology.orchestra.run.smithi114.stdout: "num_ops": 12 2024-09-12T18:36:32.202 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:32.202 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:36:32.204 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:32.200+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:32.205 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:36:32.304 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:32.300+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:32.359 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:36:32.359 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:36:32.364 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:32.364 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:32.377 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:36:32.377 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:36:32.383 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:36:32.394 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:36:32.395 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:36:32.405 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:32.400+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:32.506 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:32.503+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:32.541 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:32.541 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:32.561 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:36:32.608 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:32.603+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:32.630 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T18:36:32.709 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:32.707+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:32.721 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:32.721 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:32.744 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:36:32.810 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:32.803+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:32.874 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 47 16 110326 110310 146.673 128.625 0.00473128 0.00681317 2024-09-12T18:36:32.910 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:32.903+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:32.943 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:32.943 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:32.964 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:36:33.012 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:33.008+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:33.113 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:33.107+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:33.120 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:33.120 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:33.142 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:36:33.213 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:33.212+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:33.295 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:33.295 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:33.314 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:33.312+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:33.316 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:36:33.417 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:33.411+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:33.510 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:33.510 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:33.516 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:33.512+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:33.534 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:36:33.579 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is set 2024-09-12T18:36:33.617 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:33.615+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:33.719 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:33.715+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:33.735 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:33.735 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:33.756 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:36:33.819 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:33.815+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:33.874 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 48 16 112389 112373 146.303 128.938 0.00786463 0.00683057 2024-09-12T18:36:33.910 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:33.910 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:33.920 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:33.916+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:33.930 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:36:34.021 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:34.020+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:34.076 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:34.077 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:34.098 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:36:34.122 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:34.120+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:34.223 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:34.219+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:34.247 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:34.248 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:34.267 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:36:34.324 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:34.320+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:34.411 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:36:34.417 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:34.417 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:34.425 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:34.419+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:34.439 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:36:34.526 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:34.523+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:34.571 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:36:34.572 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:36:34.592 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:36:34.593 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:36:34.593 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:34.593 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-09-12T18:36:34.593 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-09-12T18:36:34.593 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-09-12T18:36:34.593 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:34.611 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:36:34.612 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:36:34.613 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:36:34.657 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:34.655+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:34.729 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:34.728+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:34.813 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:34.813 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-09-12T18:36:34.813 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-09-12T18:36:34.813 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:36:34.813 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.813 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:34.814 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:34.814 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 69.177087976999999, 2024-09-12T18:36:34.814 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025088781000000001, 2024-09-12T18:36:34.814 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:34.814 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:34.814 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:34.814 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:34.814 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.814 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:34.814 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:34.814 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:34.815 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.815 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.815 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:34.815 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:34.815 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:34.815 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.815 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.815 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:34.815 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632518+0000", 2024-09-12T18:36:34.815 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:36:34.815 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.815 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.816 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:34.816 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632533+0000", 2024-09-12T18:36:34.816 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5130000000000001e-05 2024-09-12T18:36:34.816 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.816 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.816 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:34.816 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632564+0000", 2024-09-12T18:36:34.816 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0788999999999999e-05 2024-09-12T18:36:34.816 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.816 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.817 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:34.817 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632590+0000", 2024-09-12T18:36:34.817 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6057000000000001e-05 2024-09-12T18:36:34.817 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.817 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.817 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:34.817 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.635931+0000", 2024-09-12T18:36:34.817 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033411320000000001 2024-09-12T18:36:34.817 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.817 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.818 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:34.818 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636186+0000", 2024-09-12T18:36:34.818 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025452500000000002 2024-09-12T18:36:34.818 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.818 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.818 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:34.818 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636445+0000", 2024-09-12T18:36:34.818 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000259268 2024-09-12T18:36:34.818 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.818 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.818 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:34.819 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639562+0000", 2024-09-12T18:36:34.819 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031167 2024-09-12T18:36:34.819 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.819 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.819 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:34.819 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657314+0000", 2024-09-12T18:36:34.819 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017752562 2024-09-12T18:36:34.819 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.819 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.819 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:34.819 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657445+0000", 2024-09-12T18:36:34.820 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013105899999999999 2024-09-12T18:36:34.820 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.820 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.820 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:34.820 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657598+0000", 2024-09-12T18:36:34.820 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015247899999999999 2024-09-12T18:36:34.820 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:34.820 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:34.820 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:34.820 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.820 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.821 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:34.821 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:34.821 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 69.176961774000006, 2024-09-12T18:36:34.821 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025643131999999999, 2024-09-12T18:36:34.821 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:34.821 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:34.821 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:34.823 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:34.823 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.823 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:34.823 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:34.823 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:34.824 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.824 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.824 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:34.824 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:34.824 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:34.824 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.824 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.824 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:34.824 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632637+0000", 2024-09-12T18:36:34.824 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5600000000000001e-06 2024-09-12T18:36:34.824 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.824 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.825 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:34.825 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632650+0000", 2024-09-12T18:36:34.825 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3186e-05 2024-09-12T18:36:34.825 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.825 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.826 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:34.826 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632672+0000", 2024-09-12T18:36:34.826 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2013000000000001e-05 2024-09-12T18:36:34.826 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.826 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.826 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:34.826 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632687+0000", 2024-09-12T18:36:34.826 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5109999999999999e-05 2024-09-12T18:36:34.826 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.826 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.826 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:34.826 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636994+0000", 2024-09-12T18:36:34.826 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0043065539999999998 2024-09-12T18:36:34.827 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.827 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.827 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:34.827 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637198+0000", 2024-09-12T18:36:34.827 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020387199999999999 2024-09-12T18:36:34.827 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.827 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.828 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:34.828 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637475+0000", 2024-09-12T18:36:34.828 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027731000000000001 2024-09-12T18:36:34.828 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.829 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.829 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:34.829 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639574+0000", 2024-09-12T18:36:34.829 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020988999999999999 2024-09-12T18:36:34.829 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.829 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.830 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:34.830 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658057+0000", 2024-09-12T18:36:34.830 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018482926 2024-09-12T18:36:34.830 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.830 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.830 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:34.830 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658184+0000", 2024-09-12T18:36:34.830 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012756200000000001 2024-09-12T18:36:34.831 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.831 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.831 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:34.831 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658278+0000", 2024-09-12T18:36:34.831 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4139000000000001e-05 2024-09-12T18:36:34.831 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:34.831 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:34.832 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:34.832 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.832 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.832 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:34.832 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:34.832 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 69.176886682000003, 2024-09-12T18:36:34.833 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025238883, 2024-09-12T18:36:34.833 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:34.833 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:34.833 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:34.833 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:34.834 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.834 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:34.834 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:34.834 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:34.834 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.835 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.835 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:34.835 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:34.835 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:34.835 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.835 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.836 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:34.836 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632712+0000", 2024-09-12T18:36:34.836 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6869999999999999e-06 2024-09-12T18:36:34.836 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.836 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.836 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:34.836 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632719+0000", 2024-09-12T18:36:34.836 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6059999999999999e-06 2024-09-12T18:36:34.836 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.836 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.836 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:34.837 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632737+0000", 2024-09-12T18:36:34.837 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7983999999999999e-05 2024-09-12T18:36:34.837 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.837 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.837 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:34.837 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632751+0000", 2024-09-12T18:36:34.837 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4473e-05 2024-09-12T18:36:34.837 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.837 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.837 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:34.837 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636961+0000", 2024-09-12T18:36:34.837 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042100840000000002 2024-09-12T18:36:34.837 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.838 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.838 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:34.838 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637211+0000", 2024-09-12T18:36:34.838 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000249738 2024-09-12T18:36:34.838 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.838 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.838 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:34.838 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637504+0000", 2024-09-12T18:36:34.838 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00029271499999999998 2024-09-12T18:36:34.838 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.838 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.838 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:34.838 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639582+0000", 2024-09-12T18:36:34.838 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020783389999999998 2024-09-12T18:36:34.839 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.839 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.839 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:34.839 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657709+0000", 2024-09-12T18:36:34.839 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018126758999999999 2024-09-12T18:36:34.839 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.839 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.839 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:34.839 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657830+0000", 2024-09-12T18:36:34.839 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000121329 2024-09-12T18:36:34.839 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.839 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.839 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:34.840 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657949+0000", 2024-09-12T18:36:34.840 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000119169 2024-09-12T18:36:34.840 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:34.840 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:34.840 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:34.840 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.840 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.840 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:34.840 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:34.840 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 69.176822635999997, 2024-09-12T18:36:34.840 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026711823999999999, 2024-09-12T18:36:34.840 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:34.840 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:34.841 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:34.841 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:34.841 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.841 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:34.841 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:34.841 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:34.841 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.841 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.841 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:34.841 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:34.841 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:34.841 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.841 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.842 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:34.842 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632775+0000", 2024-09-12T18:36:34.842 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9999999999999995e-07 2024-09-12T18:36:34.842 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.842 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.842 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:34.842 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632788+0000", 2024-09-12T18:36:34.842 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2629999999999999e-05 2024-09-12T18:36:34.842 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.842 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.842 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:34.842 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632806+0000", 2024-09-12T18:36:34.842 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:36:34.842 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.843 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.843 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:34.843 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632820+0000", 2024-09-12T18:36:34.843 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3777e-05 2024-09-12T18:36:34.843 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.843 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.843 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:34.843 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638310+0000", 2024-09-12T18:36:34.843 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054898280000000004 2024-09-12T18:36:34.843 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.843 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.843 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:34.843 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638480+0000", 2024-09-12T18:36:34.844 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016968199999999999 2024-09-12T18:36:34.844 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.844 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.844 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:34.844 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638799+0000", 2024-09-12T18:36:34.844 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031915999999999997 2024-09-12T18:36:34.844 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.844 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.844 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:34.844 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639866+0000", 2024-09-12T18:36:34.844 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001067405 2024-09-12T18:36:34.844 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.844 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.845 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:34.845 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658398+0000", 2024-09-12T18:36:34.845 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018531542000000002 2024-09-12T18:36:34.845 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.845 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.845 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:34.845 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658643+0000", 2024-09-12T18:36:34.845 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00024531500000000002 2024-09-12T18:36:34.845 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.845 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.845 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:34.845 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.659486+0000", 2024-09-12T18:36:34.845 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00084316899999999995 2024-09-12T18:36:34.846 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:34.846 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:34.846 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:34.846 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.846 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.846 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:34.846 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:36:34.846 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 69.176595574000004, 2024-09-12T18:36:34.846 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.021357139000000001, 2024-09-12T18:36:34.846 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:34.847 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:34.847 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:34.847 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:34.847 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.847 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:34.847 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:36:34.847 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:34.847 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.847 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.847 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:34.847 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:36:34.847 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:34.847 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.848 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.848 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:34.848 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633003+0000", 2024-09-12T18:36:34.848 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.53e-06 2024-09-12T18:36:34.848 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.848 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.848 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:34.848 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633012+0000", 2024-09-12T18:36:34.848 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9290000000000004e-06 2024-09-12T18:36:34.848 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.848 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.848 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:34.849 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633034+0000", 2024-09-12T18:36:34.849 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2127e-05 2024-09-12T18:36:34.849 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.849 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.849 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:34.849 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633054+0000", 2024-09-12T18:36:34.849 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9476000000000001e-05 2024-09-12T18:36:34.849 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.849 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.849 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:34.849 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636657+0000", 2024-09-12T18:36:34.849 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036038839999999999 2024-09-12T18:36:34.849 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.850 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.850 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:34.850 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636885+0000", 2024-09-12T18:36:34.850 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022798800000000001 2024-09-12T18:36:34.850 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.850 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.850 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:34.850 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637189+0000", 2024-09-12T18:36:34.850 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030392100000000002 2024-09-12T18:36:34.850 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.850 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.850 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:34.850 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639271+0000", 2024-09-12T18:36:34.851 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020817460000000002 2024-09-12T18:36:34.851 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.851 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.851 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:34.851 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.652371+0000", 2024-09-12T18:36:34.851 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013099417 2024-09-12T18:36:34.851 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.851 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.851 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:34.851 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654255+0000", 2024-09-12T18:36:34.851 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018846049999999999 2024-09-12T18:36:34.851 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.852 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.852 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:34.852 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654359+0000", 2024-09-12T18:36:34.852 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000103516 2024-09-12T18:36:34.852 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:34.852 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:34.852 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:34.852 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.852 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.852 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:34.852 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:34.852 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 69.176513881999995, 2024-09-12T18:36:34.852 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026938645000000001, 2024-09-12T18:36:34.853 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:34.853 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:34.853 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:34.853 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:34.853 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.853 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:34.853 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:34.853 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:34.853 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.853 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.853 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:34.853 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:34.853 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:34.854 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.854 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.854 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:34.854 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633085+0000", 2024-09-12T18:36:34.854 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:34.854 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.854 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.854 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:34.854 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633093+0000", 2024-09-12T18:36:34.854 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3999999999999992e-06 2024-09-12T18:36:34.854 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.854 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.854 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:34.854 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633111+0000", 2024-09-12T18:36:34.854 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8070000000000001e-05 2024-09-12T18:36:34.855 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.855 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.855 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:34.855 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633126+0000", 2024-09-12T18:36:34.855 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4487e-05 2024-09-12T18:36:34.855 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.855 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.855 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:34.855 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638290+0000", 2024-09-12T18:36:34.855 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0051640269999999999 2024-09-12T18:36:34.855 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.855 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.855 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:34.855 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638547+0000", 2024-09-12T18:36:34.855 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025714100000000001 2024-09-12T18:36:34.856 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.856 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.856 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:34.856 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638850+0000", 2024-09-12T18:36:34.856 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030278400000000001 2024-09-12T18:36:34.856 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.856 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.856 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:34.856 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.640706+0000", 2024-09-12T18:36:34.856 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018564580000000001 2024-09-12T18:36:34.856 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.856 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.856 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:34.857 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658420+0000", 2024-09-12T18:36:34.857 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017714395000000001 2024-09-12T18:36:34.857 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.857 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.857 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:34.857 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658635+0000", 2024-09-12T18:36:34.857 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021413500000000001 2024-09-12T18:36:34.857 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.857 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.857 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:34.857 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.660022+0000", 2024-09-12T18:36:34.857 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001387318 2024-09-12T18:36:34.857 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:34.857 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:34.858 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:34.858 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.858 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.858 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:34.858 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:36:34.858 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 69.176169371, 2024-09-12T18:36:34.858 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.020709867, 2024-09-12T18:36:34.858 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:34.858 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:34.858 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:34.858 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:34.858 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.858 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:34.859 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:36:34.859 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:34.859 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.859 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.859 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:34.859 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:36:34.859 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:34.859 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.859 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.859 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:34.859 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633429+0000", 2024-09-12T18:36:34.859 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.313e-06 2024-09-12T18:36:34.859 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.860 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.860 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:34.860 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633462+0000", 2024-09-12T18:36:34.860 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3197000000000001e-05 2024-09-12T18:36:34.860 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.860 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.860 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:34.860 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633485+0000", 2024-09-12T18:36:34.860 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3243000000000001e-05 2024-09-12T18:36:34.860 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.860 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.860 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:34.860 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633501+0000", 2024-09-12T18:36:34.861 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5383000000000002e-05 2024-09-12T18:36:34.861 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.861 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.861 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:34.861 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633642+0000", 2024-09-12T18:36:34.861 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000141168 2024-09-12T18:36:34.861 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.861 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.861 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:34.861 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633982+0000", 2024-09-12T18:36:34.861 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000340067 2024-09-12T18:36:34.861 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.861 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.862 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:34.862 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654138+0000", 2024-09-12T18:36:34.862 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.020155495999999998 2024-09-12T18:36:34.862 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:34.862 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:34.862 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:34.862 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.862 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.862 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:49141 5.d 5:bce526e5:::benchmark_data_smithi073_23739_object49140:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T18:36:34.862 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:03.538808+0000", 2024-09-12T18:36:34.862 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 31.270789324999999, 2024-09-12T18:36:34.862 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.019659019, 2024-09-12T18:36:34.862 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:34.863 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:34.863 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:34.863 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:34.863 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:34.863 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:34.863 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 49141 2024-09-12T18:36:34.863 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.863 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:34.863 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.863 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:34.863 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538808+0000", 2024-09-12T18:36:34.863 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:34.863 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.863 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.864 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:34.864 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538808+0000", 2024-09-12T18:36:34.864 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:34.864 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.864 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.864 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:34.864 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538809+0000", 2024-09-12T18:36:34.864 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.065e-06 2024-09-12T18:36:34.864 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.864 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.864 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:34.864 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538914+0000", 2024-09-12T18:36:34.864 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010528599999999999 2024-09-12T18:36:34.865 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.865 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.865 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:34.865 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538924+0000", 2024-09-12T18:36:34.865 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4420000000000004e-06 2024-09-12T18:36:34.865 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.865 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.865 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:34.865 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538944+0000", 2024-09-12T18:36:34.865 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0460000000000001e-05 2024-09-12T18:36:34.865 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.865 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.865 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:34.865 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.539034+0000", 2024-09-12T18:36:34.866 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9512000000000006e-05 2024-09-12T18:36:34.866 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.866 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.866 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:34.866 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.539161+0000", 2024-09-12T18:36:34.866 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012782399999999999 2024-09-12T18:36:34.866 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.866 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.866 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:34.866 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.539246+0000", 2024-09-12T18:36:34.866 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4927999999999997e-05 2024-09-12T18:36:34.866 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.866 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.867 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:34.867 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.541390+0000", 2024-09-12T18:36:34.867 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0021439509999999998 2024-09-12T18:36:34.867 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.867 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.867 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:34.867 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.558236+0000", 2024-09-12T18:36:34.867 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016845619999999999 2024-09-12T18:36:34.867 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.867 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.867 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:34.867 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.558368+0000", 2024-09-12T18:36:34.867 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013241300000000001 2024-09-12T18:36:34.868 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.868 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.868 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:34.868 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.558467+0000", 2024-09-12T18:36:34.868 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8517999999999994e-05 2024-09-12T18:36:34.868 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:34.868 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:34.868 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:34.868 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.868 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.868 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:61561 5.e 5:715fe5e4:::benchmark_data_smithi073_23739_object61560:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:36:34.869 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:09.221864+0000", 2024-09-12T18:36:34.869 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 25.58773291, 2024-09-12T18:36:34.869 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017993663999999999, 2024-09-12T18:36:34.869 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:34.869 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:34.869 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:34.869 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:34.869 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:34.869 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:34.869 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 61561 2024-09-12T18:36:34.869 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.869 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:34.869 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.870 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:34.870 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.221864+0000", 2024-09-12T18:36:34.870 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:34.870 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.870 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.870 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:34.870 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.221864+0000", 2024-09-12T18:36:34.870 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:34.870 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.870 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.870 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:34.870 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.221865+0000", 2024-09-12T18:36:34.871 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1310000000000001e-06 2024-09-12T18:36:34.871 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.871 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.871 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:34.871 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222022+0000", 2024-09-12T18:36:34.871 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015628500000000001 2024-09-12T18:36:34.871 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.871 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.871 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:34.871 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222034+0000", 2024-09-12T18:36:34.871 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2481e-05 2024-09-12T18:36:34.871 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.871 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.872 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:34.872 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222041+0000", 2024-09-12T18:36:34.872 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7469999999999999e-06 2024-09-12T18:36:34.872 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.872 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.872 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:34.872 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222103+0000", 2024-09-12T18:36:34.872 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1903999999999995e-05 2024-09-12T18:36:34.872 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.872 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.872 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:34.873 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222199+0000", 2024-09-12T18:36:34.873 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6664999999999997e-05 2024-09-12T18:36:34.873 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.873 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.873 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:34.873 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222286+0000", 2024-09-12T18:36:34.873 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6582999999999994e-05 2024-09-12T18:36:34.873 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.874 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.874 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:34.874 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.228622+0000", 2024-09-12T18:36:34.874 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063357520000000001 2024-09-12T18:36:34.874 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.874 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.874 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:34.874 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.239753+0000", 2024-09-12T18:36:34.874 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011131709 2024-09-12T18:36:34.874 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.874 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.874 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:34.874 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.239813+0000", 2024-09-12T18:36:34.875 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0007999999999999e-05 2024-09-12T18:36:34.875 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.875 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.875 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:34.875 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.239858+0000", 2024-09-12T18:36:34.875 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4399e-05 2024-09-12T18:36:34.875 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:34.875 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:34.875 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:34.875 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.875 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.875 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:77241 5.b 5:d9973dc8:::benchmark_data_smithi073_23739_object77240:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:34.876 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:16.792553+0000", 2024-09-12T18:36:34.876 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 18.017043700999999, 2024-09-12T18:36:34.876 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.019966754999999999, 2024-09-12T18:36:34.876 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:34.876 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:34.876 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:34.876 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:34.876 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:34.876 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:34.876 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 77241 2024-09-12T18:36:34.876 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.876 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:34.876 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.876 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:34.877 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.792553+0000", 2024-09-12T18:36:34.877 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:34.877 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.877 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.877 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:34.877 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.792553+0000", 2024-09-12T18:36:34.877 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:34.877 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.877 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.877 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:34.877 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.792554+0000", 2024-09-12T18:36:34.877 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.16e-07 2024-09-12T18:36:34.877 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.878 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.878 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:34.878 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.792661+0000", 2024-09-12T18:36:34.878 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000106909 2024-09-12T18:36:34.878 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.878 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.878 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:34.878 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.792671+0000", 2024-09-12T18:36:34.878 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0268000000000001e-05 2024-09-12T18:36:34.878 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.878 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.878 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:34.878 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.792678+0000", 2024-09-12T18:36:34.878 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7510000000000002e-06 2024-09-12T18:36:34.879 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.879 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.879 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:34.879 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.794730+0000", 2024-09-12T18:36:34.879 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002051794 2024-09-12T18:36:34.879 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.879 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.879 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:34.879 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.794857+0000", 2024-09-12T18:36:34.879 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012728500000000001 2024-09-12T18:36:34.879 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.879 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.879 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:34.880 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.794987+0000", 2024-09-12T18:36:34.880 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012996899999999999 2024-09-12T18:36:34.880 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.880 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.880 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:34.880 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.797553+0000", 2024-09-12T18:36:34.880 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025652980000000001 2024-09-12T18:36:34.880 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.880 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.880 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:34.880 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.812460+0000", 2024-09-12T18:36:34.880 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.014907884 2024-09-12T18:36:34.880 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.881 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.881 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:34.881 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.812494+0000", 2024-09-12T18:36:34.881 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3525000000000002e-05 2024-09-12T18:36:34.881 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.881 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.881 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:34.881 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.812520+0000", 2024-09-12T18:36:34.881 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6156000000000002e-05 2024-09-12T18:36:34.881 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:34.881 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:34.881 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:34.881 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.882 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.882 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:77253 5.b 5:df1f7025:::benchmark_data_smithi073_23739_object77252:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:34.882 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:16.798099+0000", 2024-09-12T18:36:34.882 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 18.011498011, 2024-09-12T18:36:34.882 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0182598, 2024-09-12T18:36:34.882 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:34.882 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:34.882 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:34.882 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:34.882 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:34.882 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:34.882 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 77253 2024-09-12T18:36:34.882 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.882 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:34.882 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.883 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:34.883 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798099+0000", 2024-09-12T18:36:34.883 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:34.883 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.883 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.883 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:34.883 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798099+0000", 2024-09-12T18:36:34.883 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:34.883 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.883 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.883 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:34.883 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798100+0000", 2024-09-12T18:36:34.883 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2449999999999999e-06 2024-09-12T18:36:34.883 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.884 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.884 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:34.884 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798159+0000", 2024-09-12T18:36:34.884 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8925999999999998e-05 2024-09-12T18:36:34.884 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.884 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.884 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:34.884 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798171+0000", 2024-09-12T18:36:34.884 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.206e-05 2024-09-12T18:36:34.884 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.884 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.884 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:34.884 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798178+0000", 2024-09-12T18:36:34.884 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9009999999999997e-06 2024-09-12T18:36:34.884 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.885 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.885 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:34.885 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798227+0000", 2024-09-12T18:36:34.885 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8794000000000001e-05 2024-09-12T18:36:34.885 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.885 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.885 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:34.885 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798314+0000", 2024-09-12T18:36:34.885 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7322000000000002e-05 2024-09-12T18:36:34.885 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.886 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.886 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:34.886 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798417+0000", 2024-09-12T18:36:34.886 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000102777 2024-09-12T18:36:34.886 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.886 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.887 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:34.887 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.800633+0000", 2024-09-12T18:36:34.887 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022157740000000002 2024-09-12T18:36:34.887 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.887 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.887 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:34.887 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.816295+0000", 2024-09-12T18:36:34.887 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015662359000000001 2024-09-12T18:36:34.887 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.887 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.887 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:34.887 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.816330+0000", 2024-09-12T18:36:34.887 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4353999999999997e-05 2024-09-12T18:36:34.888 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.888 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.888 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:34.888 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.816359+0000", 2024-09-12T18:36:34.888 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9288000000000001e-05 2024-09-12T18:36:34.888 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:34.888 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:34.888 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:34.888 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.888 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.888 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:80117 5.e 5:713efd60:::benchmark_data_smithi073_23739_object80116:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:34.888 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:18.149805+0000", 2024-09-12T18:36:34.888 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 16.659792443000001, 2024-09-12T18:36:34.889 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018173544, 2024-09-12T18:36:34.889 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:34.889 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:34.889 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:34.889 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:34.889 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:34.889 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:34.889 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 80117 2024-09-12T18:36:34.889 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.889 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:34.889 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.890 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:34.890 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.149805+0000", 2024-09-12T18:36:34.890 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:34.890 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.890 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.890 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:34.890 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.149805+0000", 2024-09-12T18:36:34.890 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:34.890 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.890 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.891 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:34.891 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.149805+0000", 2024-09-12T18:36:34.891 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2399999999999997e-07 2024-09-12T18:36:34.891 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.891 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.891 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:34.891 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.149842+0000", 2024-09-12T18:36:34.891 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6396000000000002e-05 2024-09-12T18:36:34.891 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.891 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.891 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:34.891 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.149855+0000", 2024-09-12T18:36:34.891 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3247999999999999e-05 2024-09-12T18:36:34.892 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.892 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.892 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:34.892 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.149863+0000", 2024-09-12T18:36:34.892 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9189999999999999e-06 2024-09-12T18:36:34.892 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.892 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.892 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:34.892 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.155735+0000", 2024-09-12T18:36:34.892 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0058721600000000004 2024-09-12T18:36:34.892 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.892 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.893 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:34.893 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.155868+0000", 2024-09-12T18:36:34.893 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013283500000000001 2024-09-12T18:36:34.893 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.893 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.893 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:34.893 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.156033+0000", 2024-09-12T18:36:34.893 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016527999999999999 2024-09-12T18:36:34.893 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.893 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.893 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:34.893 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.160797+0000", 2024-09-12T18:36:34.893 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0047638439999999997 2024-09-12T18:36:34.893 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.894 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.894 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:34.894 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.167881+0000", 2024-09-12T18:36:34.894 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0070834670000000004 2024-09-12T18:36:34.894 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.894 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.894 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:34.894 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.167936+0000", 2024-09-12T18:36:34.894 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5473999999999998e-05 2024-09-12T18:36:34.894 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.894 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.894 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:34.894 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.167978+0000", 2024-09-12T18:36:34.895 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2097e-05 2024-09-12T18:36:34.895 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:34.895 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:34.895 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:34.895 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.895 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.895 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:81207 5.0 5:0c89eb16:::benchmark_data_smithi073_23739_object81206:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T18:36:34.895 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:18.680764+0000", 2024-09-12T18:36:34.895 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 16.128833149999998, 2024-09-12T18:36:34.895 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017614778000000001, 2024-09-12T18:36:34.895 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:34.895 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:34.895 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:34.895 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:34.896 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:34.896 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:34.896 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 81207 2024-09-12T18:36:34.896 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.896 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:34.896 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.896 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:34.896 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.680764+0000", 2024-09-12T18:36:34.896 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:34.896 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.896 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.896 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:34.896 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.680764+0000", 2024-09-12T18:36:34.897 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:34.897 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.897 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.897 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:34.897 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.680765+0000", 2024-09-12T18:36:34.897 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0699999999999999e-06 2024-09-12T18:36:34.897 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.897 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.897 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:34.897 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.680883+0000", 2024-09-12T18:36:34.897 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000117753 2024-09-12T18:36:34.897 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.897 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.898 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:34.898 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.680898+0000", 2024-09-12T18:36:34.898 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5546e-05 2024-09-12T18:36:34.898 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.898 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.898 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:34.898 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.680905+0000", 2024-09-12T18:36:34.898 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0779999999999998e-06 2024-09-12T18:36:34.898 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.898 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.898 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:34.898 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.685631+0000", 2024-09-12T18:36:34.898 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0047256720000000002 2024-09-12T18:36:34.899 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.899 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.899 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:34.899 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.685800+0000", 2024-09-12T18:36:34.899 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016894800000000001 2024-09-12T18:36:34.899 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.899 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.899 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:34.899 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.686022+0000", 2024-09-12T18:36:34.899 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022225399999999999 2024-09-12T18:36:34.899 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.899 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.899 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:34.899 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.693548+0000", 2024-09-12T18:36:34.900 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0075253789999999996 2024-09-12T18:36:34.900 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.900 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.900 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:34.900 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.698317+0000", 2024-09-12T18:36:34.900 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0047689250000000002 2024-09-12T18:36:34.900 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.900 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.900 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:34.900 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.698345+0000", 2024-09-12T18:36:34.900 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8445999999999998e-05 2024-09-12T18:36:34.900 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.900 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.901 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:34.901 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.698379+0000", 2024-09-12T18:36:34.901 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3707000000000001e-05 2024-09-12T18:36:34.901 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:34.901 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:34.901 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:34.901 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.901 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.901 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:88599 5.b 5:d3a6061c:::benchmark_data_smithi073_23739_object88598:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:36:34.901 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:22.263566+0000", 2024-09-12T18:36:34.901 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 12.546030657999999, 2024-09-12T18:36:34.901 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.020416237, 2024-09-12T18:36:34.901 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:34.901 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:34.902 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:34.902 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:34.902 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:34.902 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:34.902 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 88599 2024-09-12T18:36:34.902 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.902 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:34.902 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.902 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:34.902 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.263566+0000", 2024-09-12T18:36:34.902 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:34.902 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.902 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.903 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:34.903 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.263566+0000", 2024-09-12T18:36:34.903 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:34.903 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.903 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.903 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:34.903 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.263567+0000", 2024-09-12T18:36:34.903 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.088e-06 2024-09-12T18:36:34.903 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.903 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.903 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:34.903 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.263654+0000", 2024-09-12T18:36:34.903 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6632999999999995e-05 2024-09-12T18:36:34.903 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.903 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.904 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:34.904 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.263673+0000", 2024-09-12T18:36:34.904 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8984e-05 2024-09-12T18:36:34.904 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.904 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.904 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:34.904 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.263681+0000", 2024-09-12T18:36:34.904 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.371e-06 2024-09-12T18:36:34.904 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.904 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.904 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:34.904 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.266963+0000", 2024-09-12T18:36:34.905 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0032810410000000002 2024-09-12T18:36:34.905 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.905 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.905 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:34.905 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.267069+0000", 2024-09-12T18:36:34.905 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000106471 2024-09-12T18:36:34.905 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.905 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.905 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:34.905 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.267177+0000", 2024-09-12T18:36:34.905 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000108355 2024-09-12T18:36:34.905 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.905 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.906 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:34.906 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.268827+0000", 2024-09-12T18:36:34.906 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016492029999999999 2024-09-12T18:36:34.906 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.906 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.906 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:34.906 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.283931+0000", 2024-09-12T18:36:34.906 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015104783 2024-09-12T18:36:34.906 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.906 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.906 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:34.906 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.283960+0000", 2024-09-12T18:36:34.907 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8401000000000001e-05 2024-09-12T18:36:34.907 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.907 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.907 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:34.907 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.283983+0000", 2024-09-12T18:36:34.907 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2906999999999999e-05 2024-09-12T18:36:34.907 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:34.907 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:34.907 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:34.907 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.907 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.907 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:89277 5.b 5:d689659b:::benchmark_data_smithi073_23739_object89276:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:36:34.907 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:22.590286+0000", 2024-09-12T18:36:34.907 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 12.219310672000001, 2024-09-12T18:36:34.908 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018995509000000001, 2024-09-12T18:36:34.908 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:34.908 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:34.908 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:34.908 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:34.908 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:34.908 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:34.908 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 89277 2024-09-12T18:36:34.908 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.908 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:34.908 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.908 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:34.909 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590286+0000", 2024-09-12T18:36:34.909 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:34.909 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.909 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.909 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:34.909 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590286+0000", 2024-09-12T18:36:34.909 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:34.909 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.909 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.909 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:34.909 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590288+0000", 2024-09-12T18:36:34.909 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.119e-06 2024-09-12T18:36:34.909 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.910 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.910 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:34.910 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590370+0000", 2024-09-12T18:36:34.910 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2025000000000002e-05 2024-09-12T18:36:34.910 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.910 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.910 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:34.910 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590380+0000", 2024-09-12T18:36:34.910 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0723999999999999e-05 2024-09-12T18:36:34.910 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.910 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.910 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:34.910 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590386+0000", 2024-09-12T18:36:34.911 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.609e-06 2024-09-12T18:36:34.911 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.911 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.911 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:34.911 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590444+0000", 2024-09-12T18:36:34.911 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7667000000000002e-05 2024-09-12T18:36:34.911 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.911 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.911 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:34.911 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590552+0000", 2024-09-12T18:36:34.911 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000108402 2024-09-12T18:36:34.911 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.911 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.911 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:34.912 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590687+0000", 2024-09-12T18:36:34.912 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000134602 2024-09-12T18:36:34.912 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.912 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.912 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:34.912 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.593694+0000", 2024-09-12T18:36:34.912 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003007249 2024-09-12T18:36:34.912 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.912 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.912 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:34.912 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.609224+0000", 2024-09-12T18:36:34.912 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015530552 2024-09-12T18:36:34.912 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.913 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.913 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:34.913 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.609256+0000", 2024-09-12T18:36:34.913 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1838999999999998e-05 2024-09-12T18:36:34.913 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.913 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.913 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:34.913 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.609282+0000", 2024-09-12T18:36:34.913 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5721e-05 2024-09-12T18:36:34.913 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:34.913 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:34.913 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:34.913 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.913 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.914 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:95928 5.0 5:0771f238:::benchmark_data_smithi073_23739_object95927:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:36:34.914 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:25.895007+0000", 2024-09-12T18:36:34.914 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 8.9145904589999994, 2024-09-12T18:36:34.914 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.02094159, 2024-09-12T18:36:34.914 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:34.914 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:34.914 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:34.914 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:34.914 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:34.914 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:34.914 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 95928 2024-09-12T18:36:34.914 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.914 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:34.915 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.915 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:34.915 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.895007+0000", 2024-09-12T18:36:34.915 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:34.915 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.915 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.915 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:34.915 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.895007+0000", 2024-09-12T18:36:34.915 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:34.915 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.915 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.915 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:34.915 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.895008+0000", 2024-09-12T18:36:34.915 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8400000000000002e-07 2024-09-12T18:36:34.916 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.916 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.916 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:34.916 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.895077+0000", 2024-09-12T18:36:34.916 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9220999999999993e-05 2024-09-12T18:36:34.916 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.916 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.916 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:34.916 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.895089+0000", 2024-09-12T18:36:34.916 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1701e-05 2024-09-12T18:36:34.916 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.916 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.916 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:34.917 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.895095+0000", 2024-09-12T18:36:34.917 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9240000000000001e-06 2024-09-12T18:36:34.917 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.917 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.917 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:34.917 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.902948+0000", 2024-09-12T18:36:34.917 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0078527110000000001 2024-09-12T18:36:34.917 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.917 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.917 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:34.917 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.903069+0000", 2024-09-12T18:36:34.917 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000120382 2024-09-12T18:36:34.917 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.918 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.918 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:34.918 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.903200+0000", 2024-09-12T18:36:34.918 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000130984 2024-09-12T18:36:34.918 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.918 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.918 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:34.918 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.915841+0000", 2024-09-12T18:36:34.918 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012641177 2024-09-12T18:36:34.918 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.918 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.918 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:34.919 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.915853+0000", 2024-09-12T18:36:34.919 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2707999999999999e-05 2024-09-12T18:36:34.919 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.919 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.919 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:34.919 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.915910+0000", 2024-09-12T18:36:34.919 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6226e-05 2024-09-12T18:36:34.919 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.919 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.919 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:34.919 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.915948+0000", 2024-09-12T18:36:34.919 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8572000000000003e-05 2024-09-12T18:36:34.919 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:34.920 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:34.920 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:34.920 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.920 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.920 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:96974 5.4 5:22c5e101:::benchmark_data_smithi073_23739_object96973:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:36:34.920 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:26.404987+0000", 2024-09-12T18:36:34.920 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 8.4046103070000004, 2024-09-12T18:36:34.920 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018218356000000002, 2024-09-12T18:36:34.920 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:34.920 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:34.920 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:34.920 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:34.921 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:34.921 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:34.921 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 96974 2024-09-12T18:36:34.921 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.921 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:34.921 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.921 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:34.921 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.404987+0000", 2024-09-12T18:36:34.921 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:34.921 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.921 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.921 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:34.921 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.404987+0000", 2024-09-12T18:36:34.921 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:34.922 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.922 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.922 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:34.922 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.404988+0000", 2024-09-12T18:36:34.922 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0839999999999999e-06 2024-09-12T18:36:34.922 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.922 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.922 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:34.922 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.405025+0000", 2024-09-12T18:36:34.922 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7598000000000002e-05 2024-09-12T18:36:34.922 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.922 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.922 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:34.922 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.405039+0000", 2024-09-12T18:36:34.923 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3614999999999999e-05 2024-09-12T18:36:34.923 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.923 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.923 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:34.923 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.405045+0000", 2024-09-12T18:36:34.923 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7019999999999998e-06 2024-09-12T18:36:34.923 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.923 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.923 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:34.923 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.405124+0000", 2024-09-12T18:36:34.923 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9064000000000001e-05 2024-09-12T18:36:34.923 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.923 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.923 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:34.924 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.405261+0000", 2024-09-12T18:36:34.924 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013721499999999999 2024-09-12T18:36:34.924 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.924 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.924 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:34.924 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.405416+0000", 2024-09-12T18:36:34.924 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015480499999999999 2024-09-12T18:36:34.924 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.924 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.924 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:34.924 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.410834+0000", 2024-09-12T18:36:34.924 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054180690000000002 2024-09-12T18:36:34.924 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.925 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.925 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:34.925 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.423115+0000", 2024-09-12T18:36:34.925 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012280813 2024-09-12T18:36:34.925 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.925 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.925 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:34.925 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.423166+0000", 2024-09-12T18:36:34.925 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0849000000000001e-05 2024-09-12T18:36:34.925 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.925 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.925 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:34.925 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.423205+0000", 2024-09-12T18:36:34.926 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9542000000000002e-05 2024-09-12T18:36:34.926 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:34.926 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:34.926 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:34.926 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.926 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.926 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:99510 5.4 5:223418b2:::benchmark_data_smithi073_23739_object99509:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:36:34.926 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:27.624696+0000", 2024-09-12T18:36:34.926 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 7.1849007619999998, 2024-09-12T18:36:34.926 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017929684000000001, 2024-09-12T18:36:34.926 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:34.926 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:34.926 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:34.926 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:34.927 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:34.927 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:34.927 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 99510 2024-09-12T18:36:34.927 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.927 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:34.927 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.927 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:34.927 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:27.624696+0000", 2024-09-12T18:36:34.927 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:34.927 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.927 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.927 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:34.927 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:27.624696+0000", 2024-09-12T18:36:34.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:34.928 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.928 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:34.928 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:27.624697+0000", 2024-09-12T18:36:34.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9999999999999995e-07 2024-09-12T18:36:34.928 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.928 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:34.928 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:27.624798+0000", 2024-09-12T18:36:34.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000100652 2024-09-12T18:36:34.928 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.929 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.929 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:34.929 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:27.624808+0000", 2024-09-12T18:36:34.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8500000000000006e-06 2024-09-12T18:36:34.929 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.929 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.929 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:34.929 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:27.624813+0000", 2024-09-12T18:36:34.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0499999999999999e-06 2024-09-12T18:36:34.929 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.929 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.929 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:34.929 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:27.624863+0000", 2024-09-12T18:36:34.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0149999999999999e-05 2024-09-12T18:36:34.930 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.930 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:34.930 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:27.625003+0000", 2024-09-12T18:36:34.930 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014039099999999999 2024-09-12T18:36:34.930 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.930 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:34.930 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:27.625149+0000", 2024-09-12T18:36:34.930 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014520700000000001 2024-09-12T18:36:34.930 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.931 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.931 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:34.931 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:27.630260+0000", 2024-09-12T18:36:34.931 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0051114949999999998 2024-09-12T18:36:34.931 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.931 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.931 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:34.931 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:27.642524+0000", 2024-09-12T18:36:34.931 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012263838000000001 2024-09-12T18:36:34.931 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.931 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.931 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:34.932 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:27.642583+0000", 2024-09-12T18:36:34.932 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.9216999999999999e-05 2024-09-12T18:36:34.932 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.932 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.932 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:34.932 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:27.642626+0000", 2024-09-12T18:36:34.932 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2833999999999997e-05 2024-09-12T18:36:34.932 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:34.932 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:34.932 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:34.932 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.932 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.933 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:104764 5.0 5:0dfa202d:::benchmark_data_smithi073_23739_object104763:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T18:36:34.933 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:30.213356+0000", 2024-09-12T18:36:34.933 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.5962409879999999, 2024-09-12T18:36:34.933 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018447024999999999, 2024-09-12T18:36:34.933 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:34.933 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:34.933 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:34.933 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:34.933 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:34.933 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:34.933 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 104764 2024-09-12T18:36:34.933 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.933 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:34.934 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.934 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:34.934 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.213356+0000", 2024-09-12T18:36:34.934 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:34.934 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.934 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.934 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:34.934 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.213356+0000", 2024-09-12T18:36:34.934 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:34.934 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.934 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.934 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:34.934 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.213357+0000", 2024-09-12T18:36:34.935 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7100000000000001e-07 2024-09-12T18:36:34.935 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.935 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:34.935 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.213403+0000", 2024-09-12T18:36:34.935 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6467000000000001e-05 2024-09-12T18:36:34.935 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.935 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:34.935 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.213412+0000", 2024-09-12T18:36:34.935 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9649999999999997e-06 2024-09-12T18:36:34.935 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.935 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:34.936 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.213418+0000", 2024-09-12T18:36:34.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1099999999999999e-06 2024-09-12T18:36:34.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.936 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.936 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:34.936 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.216358+0000", 2024-09-12T18:36:34.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0029392950000000002 2024-09-12T18:36:34.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.936 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.936 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:34.936 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.216446+0000", 2024-09-12T18:36:34.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8208000000000007e-05 2024-09-12T18:36:34.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.937 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.937 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:34.937 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.216542+0000", 2024-09-12T18:36:34.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6206999999999996e-05 2024-09-12T18:36:34.937 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.937 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.937 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:34.937 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.224399+0000", 2024-09-12T18:36:34.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0078571119999999994 2024-09-12T18:36:34.937 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.937 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.937 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:34.937 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.231694+0000", 2024-09-12T18:36:34.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0072948240000000001 2024-09-12T18:36:34.938 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.938 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.938 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:34.938 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.231745+0000", 2024-09-12T18:36:34.938 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1415999999999997e-05 2024-09-12T18:36:34.938 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.938 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.938 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:34.938 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.231803+0000", 2024-09-12T18:36:34.938 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7750000000000001e-05 2024-09-12T18:36:34.938 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:34.938 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:34.938 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:34.939 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.939 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.939 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:104767 5.0 5:0a411b69:::benchmark_data_smithi073_23739_object104766:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T18:36:34.939 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:30.214230+0000", 2024-09-12T18:36:34.939 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.5953670639999995, 2024-09-12T18:36:34.939 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017809439, 2024-09-12T18:36:34.939 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:34.939 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:34.939 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:34.939 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:34.939 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:34.939 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:34.939 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 104767 2024-09-12T18:36:34.940 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.940 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:34.940 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.940 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:34.940 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.214230+0000", 2024-09-12T18:36:34.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:34.940 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.940 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.940 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:34.940 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.214230+0000", 2024-09-12T18:36:34.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:34.940 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.940 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.941 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:34.941 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.214231+0000", 2024-09-12T18:36:34.941 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1289999999999999e-06 2024-09-12T18:36:34.941 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.941 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.941 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:34.941 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.214343+0000", 2024-09-12T18:36:34.941 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112138 2024-09-12T18:36:34.941 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.941 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.941 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:34.941 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.214356+0000", 2024-09-12T18:36:34.941 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2745000000000001e-05 2024-09-12T18:36:34.941 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.942 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:34.942 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.214363+0000", 2024-09-12T18:36:34.942 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5409999999999997e-06 2024-09-12T18:36:34.942 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.942 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:34.942 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.218757+0000", 2024-09-12T18:36:34.942 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.004394256 2024-09-12T18:36:34.942 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.942 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:34.942 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.218968+0000", 2024-09-12T18:36:34.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000210977 2024-09-12T18:36:34.943 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:34.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.219195+0000", 2024-09-12T18:36:34.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022698299999999999 2024-09-12T18:36:34.943 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:34.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.224402+0000", 2024-09-12T18:36:34.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052075639999999996 2024-09-12T18:36:34.943 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:34.944 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.231883+0000", 2024-09-12T18:36:34.944 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0074809400000000002 2024-09-12T18:36:34.944 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.944 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.944 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:34.944 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.231948+0000", 2024-09-12T18:36:34.944 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4375000000000006e-05 2024-09-12T18:36:34.944 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:34.944 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:34.944 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:34.944 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.232039+0000", 2024-09-12T18:36:34.944 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.1791000000000003e-05 2024-09-12T18:36:34.944 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:34.944 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:34.945 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:34.945 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:34.945 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:34.945 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:34.946 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 49 16 114423 114407 145.911 127.125 0.0171374 0.00684894 2024-09-12T18:36:34.947 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:36:34.947 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:34.943+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:35.047 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:35.043+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:35.103 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:36:35.103 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:36:35.103 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.104 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:114893 5.6 e46/21 5:622b745f:::benchmark_data_smithi073_23739_object114892:head v 46'7182, mlcod=46'7179)", 2024-09-12T18:36:35.104 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:35.100897+0000", 2024-09-12T18:36:35.104 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.00090218099999999995, 2024-09-12T18:36:35.104 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00091981599999999995, 2024-09-12T18:36:35.104 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:35.104 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:35.104 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:35.104 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:35.104 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.104 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:35.104 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.100897+0000", 2024-09-12T18:36:35.104 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.105 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.105 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.105 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:35.105 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.100897+0000", 2024-09-12T18:36:35.105 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.105 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.105 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.105 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:35.105 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.100897+0000", 2024-09-12T18:36:35.105 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.5800000000000001e-07 2024-09-12T18:36:35.105 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.105 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.106 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:35.106 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.100939+0000", 2024-09-12T18:36:35.106 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.1505000000000003e-05 2024-09-12T18:36:35.106 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.106 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.106 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:35.106 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.100947+0000", 2024-09-12T18:36:35.106 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.6600000000000001e-06 2024-09-12T18:36:35.106 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.106 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.106 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:35.106 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.100952+0000", 2024-09-12T18:36:35.106 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.9910000000000002e-06 2024-09-12T18:36:35.106 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.107 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.107 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:35.107 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.101016+0000", 2024-09-12T18:36:35.107 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.3816e-05 2024-09-12T18:36:35.107 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.107 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.107 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:35.107 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.101036+0000", 2024-09-12T18:36:35.107 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9859000000000001e-05 2024-09-12T18:36:35.107 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.107 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:35.107 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.107 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.108 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.108 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:114875 5.1 5:8258a172:::benchmark_data_smithi073_23739_object114874:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:36:35.108 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:35.091723+0000", 2024-09-12T18:36:35.108 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.010075807000000001, 2024-09-12T18:36:35.108 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010150795000000001, 2024-09-12T18:36:35.108 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:35.108 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:35.108 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:35.108 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:35.108 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:35.108 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:35.108 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 114875 2024-09-12T18:36:35.109 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.109 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:35.109 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.109 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:35.109 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.091723+0000", 2024-09-12T18:36:35.109 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.109 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.109 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.109 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:35.109 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.091723+0000", 2024-09-12T18:36:35.109 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.109 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.109 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.109 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:35.110 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.091724+0000", 2024-09-12T18:36:35.110 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.9899999999999999e-07 2024-09-12T18:36:35.110 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.110 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.110 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:35.110 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.091792+0000", 2024-09-12T18:36:35.110 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.7515000000000007e-05 2024-09-12T18:36:35.110 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.110 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.110 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:35.111 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.091802+0000", 2024-09-12T18:36:35.111 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7699999999999996e-06 2024-09-12T18:36:35.111 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.111 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.111 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:35.111 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.091808+0000", 2024-09-12T18:36:35.111 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.7710000000000001e-06 2024-09-12T18:36:35.111 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.111 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.111 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:35.111 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.094944+0000", 2024-09-12T18:36:35.111 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0031353129999999998 2024-09-12T18:36:35.111 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.111 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.112 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:35.112 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.095089+0000", 2024-09-12T18:36:35.112 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014493700000000001 2024-09-12T18:36:35.112 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.112 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.112 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:35.112 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.095250+0000", 2024-09-12T18:36:35.112 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00016157000000000001 2024-09-12T18:36:35.112 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.112 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.112 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:35.112 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.099593+0000", 2024-09-12T18:36:35.112 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0043432210000000004 2024-09-12T18:36:35.113 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.113 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.113 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:35.113 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.101797+0000", 2024-09-12T18:36:35.113 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0022032810000000001 2024-09-12T18:36:35.113 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.113 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:35.113 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.113 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.113 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.113 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:114878 5.1 5:86704190:::benchmark_data_smithi073_23739_object114877:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:36:35.113 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:35.092230+0000", 2024-09-12T18:36:35.113 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0095695759999999998, 2024-09-12T18:36:35.113 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0097188050000000005, 2024-09-12T18:36:35.114 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:35.114 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:35.114 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:35.114 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:35.114 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:35.114 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:35.114 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 114878 2024-09-12T18:36:35.114 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.114 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:35.114 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.114 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:35.114 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.092230+0000", 2024-09-12T18:36:35.114 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.114 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.115 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.115 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:35.115 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.092230+0000", 2024-09-12T18:36:35.115 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.115 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.115 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.115 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:35.115 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.092230+0000", 2024-09-12T18:36:35.115 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.6700000000000003e-07 2024-09-12T18:36:35.115 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.115 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.115 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:35.115 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.092288+0000", 2024-09-12T18:36:35.115 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.7238000000000003e-05 2024-09-12T18:36:35.116 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.116 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.116 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:35.116 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.092299+0000", 2024-09-12T18:36:35.116 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1389000000000001e-05 2024-09-12T18:36:35.116 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.116 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.116 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:35.116 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.092307+0000", 2024-09-12T18:36:35.116 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.7370000000000006e-06 2024-09-12T18:36:35.116 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.116 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.116 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:35.116 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.097119+0000", 2024-09-12T18:36:35.117 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0048125640000000001 2024-09-12T18:36:35.117 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.117 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.117 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:35.117 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.097240+0000", 2024-09-12T18:36:35.117 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000120906 2024-09-12T18:36:35.117 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.117 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.117 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:35.117 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.097370+0000", 2024-09-12T18:36:35.117 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000129753 2024-09-12T18:36:35.117 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.117 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:35.117 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.117 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.118 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.118 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:114877 5.3 e46/21 5:c38a1fac:::benchmark_data_smithi073_23739_object114876:head v 46'7106, mlcod=46'7102)", 2024-09-12T18:36:35.118 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:35.095980+0000", 2024-09-12T18:36:35.118 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0058192219999999998, 2024-09-12T18:36:35.118 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0060060360000000002, 2024-09-12T18:36:35.118 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:35.118 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:35.118 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:35.118 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:35.118 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.118 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:35.118 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.095980+0000", 2024-09-12T18:36:35.118 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.119 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.119 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.119 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:35.119 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.095980+0000", 2024-09-12T18:36:35.119 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.119 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.119 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.119 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:35.119 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.095980+0000", 2024-09-12T18:36:35.119 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.3699999999999999e-07 2024-09-12T18:36:35.119 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.119 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.119 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:35.120 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.096005+0000", 2024-09-12T18:36:35.120 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.512e-05 2024-09-12T18:36:35.120 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.120 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.120 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:35.120 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.096010+0000", 2024-09-12T18:36:35.120 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.3449999999999999e-06 2024-09-12T18:36:35.120 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.120 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.120 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:35.121 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.096013+0000", 2024-09-12T18:36:35.121 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.8449999999999999e-06 2024-09-12T18:36:35.121 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.121 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.121 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:35.121 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.096052+0000", 2024-09-12T18:36:35.121 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.9787999999999999e-05 2024-09-12T18:36:35.121 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.121 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.121 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:35.121 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.096071+0000", 2024-09-12T18:36:35.121 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.8876e-05 2024-09-12T18:36:35.121 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.122 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:35.122 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.122 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.122 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.122 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:114886 5.f 5:ff0205fe:::benchmark_data_smithi073_23739_object114885:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:36:35.122 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:35.096360+0000", 2024-09-12T18:36:35.122 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0054396089999999998, 2024-09-12T18:36:35.122 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0056566849999999998, 2024-09-12T18:36:35.122 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:35.122 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:35.122 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:35.122 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:35.122 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:35.122 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:35.123 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 114886 2024-09-12T18:36:35.123 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.123 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:35.123 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.123 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:35.123 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.096360+0000", 2024-09-12T18:36:35.123 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.123 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.123 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.123 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:35.124 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.096360+0000", 2024-09-12T18:36:35.124 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.124 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.124 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.124 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:35.124 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.096361+0000", 2024-09-12T18:36:35.124 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.381e-06 2024-09-12T18:36:35.124 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.125 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.125 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:35.125 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.096447+0000", 2024-09-12T18:36:35.125 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5981000000000002e-05 2024-09-12T18:36:35.125 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.125 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.125 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:35.125 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.096465+0000", 2024-09-12T18:36:35.125 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7532000000000001e-05 2024-09-12T18:36:35.125 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.125 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.125 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:35.125 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.096472+0000", 2024-09-12T18:36:35.125 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8849999999999999e-06 2024-09-12T18:36:35.126 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.126 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.126 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:35.126 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.096534+0000", 2024-09-12T18:36:35.126 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2076000000000007e-05 2024-09-12T18:36:35.126 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.126 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.126 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:35.126 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.096658+0000", 2024-09-12T18:36:35.126 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012364799999999999 2024-09-12T18:36:35.126 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.126 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.126 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:35.126 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.096784+0000", 2024-09-12T18:36:35.127 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012588599999999999 2024-09-12T18:36:35.127 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.127 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.127 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:35.127 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.099796+0000", 2024-09-12T18:36:35.127 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0030122159999999999 2024-09-12T18:36:35.127 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.127 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:35.127 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.127 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.127 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.127 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:114888 5.2 5:47d99824:::benchmark_data_smithi073_23739_object114887:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:36:35.127 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:35.097263+0000", 2024-09-12T18:36:35.127 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0045364120000000001, 2024-09-12T18:36:35.128 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0047940159999999999, 2024-09-12T18:36:35.128 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:35.128 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:35.128 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:35.128 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:35.128 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:35.128 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:35.128 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 114888 2024-09-12T18:36:35.128 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.128 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:35.128 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.128 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:35.128 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.097263+0000", 2024-09-12T18:36:35.129 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.129 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.129 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.129 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:35.129 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.097263+0000", 2024-09-12T18:36:35.129 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.129 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.129 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.129 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:35.129 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.097264+0000", 2024-09-12T18:36:35.129 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.147e-06 2024-09-12T18:36:35.129 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.129 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.129 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:35.130 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.097332+0000", 2024-09-12T18:36:35.130 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.7960999999999995e-05 2024-09-12T18:36:35.130 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.130 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.130 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:35.130 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.097343+0000", 2024-09-12T18:36:35.130 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0611000000000001e-05 2024-09-12T18:36:35.130 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.130 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.130 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:35.130 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.097350+0000", 2024-09-12T18:36:35.130 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9670000000000004e-06 2024-09-12T18:36:35.130 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.130 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.131 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:35.131 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.097750+0000", 2024-09-12T18:36:35.131 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00040050600000000002 2024-09-12T18:36:35.131 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.131 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.131 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:35.131 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.097884+0000", 2024-09-12T18:36:35.131 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013412100000000001 2024-09-12T18:36:35.131 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.131 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.131 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:35.131 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.098042+0000", 2024-09-12T18:36:35.131 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015772599999999999 2024-09-12T18:36:35.132 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.132 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:35.132 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.132 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.132 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.132 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:114889 5.2 5:4a732545:::benchmark_data_smithi073_23739_object114888:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:36:35.132 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:35.097373+0000", 2024-09-12T18:36:35.132 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0044264949999999999, 2024-09-12T18:36:35.132 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.004751473, 2024-09-12T18:36:35.132 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:35.132 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:35.132 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:35.132 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:35.132 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:35.133 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:35.133 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 114889 2024-09-12T18:36:35.133 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.133 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:35.133 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.133 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:35.133 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.097373+0000", 2024-09-12T18:36:35.133 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.133 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.133 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.133 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:35.133 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.097373+0000", 2024-09-12T18:36:35.133 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.134 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.134 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.134 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:35.134 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.097373+0000", 2024-09-12T18:36:35.134 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2e-07 2024-09-12T18:36:35.134 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.134 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.134 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:35.134 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.097408+0000", 2024-09-12T18:36:35.134 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.4554999999999997e-05 2024-09-12T18:36:35.134 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.134 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.135 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:35.135 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.097416+0000", 2024-09-12T18:36:35.135 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.7740000000000004e-06 2024-09-12T18:36:35.135 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.135 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.135 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:35.135 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.097421+0000", 2024-09-12T18:36:35.135 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3149999999999999e-06 2024-09-12T18:36:35.135 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.135 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.135 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:35.135 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.100139+0000", 2024-09-12T18:36:35.135 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.002717672 2024-09-12T18:36:35.136 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.136 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.136 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:35.136 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.100331+0000", 2024-09-12T18:36:35.136 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019223600000000001 2024-09-12T18:36:35.136 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.136 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.136 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:35.136 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.100413+0000", 2024-09-12T18:36:35.136 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1922000000000006e-05 2024-09-12T18:36:35.136 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.136 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:35.136 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.137 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.137 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.137 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:114887 5.6 e46/21 5:6959480f:::benchmark_data_smithi073_23739_object114886:head v 46'7181, mlcod=46'7179)", 2024-09-12T18:36:35.137 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:35.097578+0000", 2024-09-12T18:36:35.137 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.004221163, 2024-09-12T18:36:35.137 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0046142320000000002, 2024-09-12T18:36:35.137 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:35.137 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:35.137 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:35.137 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:35.137 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.137 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:35.137 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.097578+0000", 2024-09-12T18:36:35.138 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.138 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.138 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.138 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:35.138 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.097578+0000", 2024-09-12T18:36:35.138 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.138 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.138 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.138 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:35.138 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.097579+0000", 2024-09-12T18:36:35.138 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.82e-07 2024-09-12T18:36:35.138 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.139 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.139 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:35.139 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.097699+0000", 2024-09-12T18:36:35.139 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012055799999999999 2024-09-12T18:36:35.139 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.139 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.139 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:35.139 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.097709+0000", 2024-09-12T18:36:35.139 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9869999999999994e-06 2024-09-12T18:36:35.139 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.139 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.139 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:35.139 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.097716+0000", 2024-09-12T18:36:35.139 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.238e-06 2024-09-12T18:36:35.140 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.140 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.140 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:35.140 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.097776+0000", 2024-09-12T18:36:35.140 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.0044999999999999e-05 2024-09-12T18:36:35.140 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.140 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.140 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:35.140 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.097796+0000", 2024-09-12T18:36:35.140 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9168e-05 2024-09-12T18:36:35.140 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.140 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:35.141 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.141 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.141 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.141 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:114892 5.1 5:8b3d520d:::benchmark_data_smithi073_23739_object114891:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:36:35.141 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:35.099251+0000", 2024-09-12T18:36:35.141 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.002548692, 2024-09-12T18:36:35.141 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.002998667, 2024-09-12T18:36:35.141 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:35.141 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:35.141 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:35.141 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:35.142 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:35.142 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:35.142 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 114892 2024-09-12T18:36:35.142 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.142 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:35.142 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.142 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:35.142 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.099251+0000", 2024-09-12T18:36:35.142 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.142 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.142 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.142 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:35.142 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.099251+0000", 2024-09-12T18:36:35.142 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.143 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.143 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.143 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:35.143 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.099252+0000", 2024-09-12T18:36:35.143 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.299e-06 2024-09-12T18:36:35.143 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.143 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.143 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:35.143 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.099344+0000", 2024-09-12T18:36:35.143 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.2610999999999998e-05 2024-09-12T18:36:35.143 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.143 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.144 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:35.144 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.099352+0000", 2024-09-12T18:36:35.144 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8439999999999998e-06 2024-09-12T18:36:35.144 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.144 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.144 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:35.144 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.099358+0000", 2024-09-12T18:36:35.144 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4240000000000001e-06 2024-09-12T18:36:35.144 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.144 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.144 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:35.144 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.099627+0000", 2024-09-12T18:36:35.145 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026888699999999999 2024-09-12T18:36:35.145 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.145 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.145 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:35.145 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.099742+0000", 2024-09-12T18:36:35.145 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000115569 2024-09-12T18:36:35.145 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.145 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.145 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:35.145 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.099886+0000", 2024-09-12T18:36:35.145 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000144263 2024-09-12T18:36:35.145 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.145 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:35.145 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.146 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.146 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.146 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:114894 5.7 5:e44b0b0d:::benchmark_data_smithi073_23739_object114893:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:36:35.146 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:35.099798+0000", 2024-09-12T18:36:35.146 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0020007649999999998, 2024-09-12T18:36:35.146 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0025222809999999999, 2024-09-12T18:36:35.146 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:35.146 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:35.146 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:35.146 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:35.146 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:35.146 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:35.146 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 114894 2024-09-12T18:36:35.146 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.146 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:35.147 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.147 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:35.147 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.099798+0000", 2024-09-12T18:36:35.147 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.147 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.147 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.147 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:35.147 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.099798+0000", 2024-09-12T18:36:35.147 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.147 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.147 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.147 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:35.147 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.099799+0000", 2024-09-12T18:36:35.147 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.5600000000000004e-07 2024-09-12T18:36:35.148 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.148 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.148 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:35.148 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.099851+0000", 2024-09-12T18:36:35.148 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1691999999999999e-05 2024-09-12T18:36:35.148 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.148 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.148 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:35.148 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.099862+0000", 2024-09-12T18:36:35.148 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0698e-05 2024-09-12T18:36:35.148 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.148 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.148 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:35.148 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.099870+0000", 2024-09-12T18:36:35.149 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4400000000000005e-06 2024-09-12T18:36:35.149 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.149 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.149 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:35.149 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.099920+0000", 2024-09-12T18:36:35.149 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.0226000000000003e-05 2024-09-12T18:36:35.149 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.149 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.149 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:35.149 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.100012+0000", 2024-09-12T18:36:35.149 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.1903000000000004e-05 2024-09-12T18:36:35.149 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.149 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.149 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:35.150 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.100111+0000", 2024-09-12T18:36:35.150 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.8573999999999995e-05 2024-09-12T18:36:35.150 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.150 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:35.150 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.150 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.150 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.150 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:114890 5.3 e46/21 5:c68981fa:::benchmark_data_smithi073_23739_object114889:head v 46'7107, mlcod=46'7104)", 2024-09-12T18:36:35.150 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:35.100008+0000", 2024-09-12T18:36:35.150 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.001791583, 2024-09-12T18:36:35.150 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0023806560000000001, 2024-09-12T18:36:35.150 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:35.150 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:35.151 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:35.151 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:35.151 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.151 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:35.151 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.100008+0000", 2024-09-12T18:36:35.151 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.151 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.151 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.151 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:35.151 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.100008+0000", 2024-09-12T18:36:35.151 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.151 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.151 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.151 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:35.152 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.100008+0000", 2024-09-12T18:36:35.152 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4499999999999996e-07 2024-09-12T18:36:35.152 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.152 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.152 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:35.152 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.100049+0000", 2024-09-12T18:36:35.152 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.0507999999999999e-05 2024-09-12T18:36:35.152 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.152 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.152 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:35.152 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.100060+0000", 2024-09-12T18:36:35.152 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0560000000000001e-05 2024-09-12T18:36:35.152 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.152 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.153 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:35.153 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.100066+0000", 2024-09-12T18:36:35.153 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.5729999999999996e-06 2024-09-12T18:36:35.153 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.153 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.153 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:35.153 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.100156+0000", 2024-09-12T18:36:35.153 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.9364999999999996e-05 2024-09-12T18:36:35.153 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.153 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.153 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:35.153 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.100174+0000", 2024-09-12T18:36:35.153 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.8612999999999999e-05 2024-09-12T18:36:35.153 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.154 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:35.154 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.154 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.154 INFO:teuthology.orchestra.run.smithi162.stdout: ], 2024-09-12T18:36:35.154 INFO:teuthology.orchestra.run.smithi162.stdout: "num_ops": 11 2024-09-12T18:36:35.154 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:36:35.155 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:35.151+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:35.156 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:36:35.256 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:35.251+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:35.314 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:36:35.315 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [], 2024-09-12T18:36:35.315 INFO:teuthology.orchestra.run.smithi162.stdout: "complaint_time": 30, 2024-09-12T18:36:35.315 INFO:teuthology.orchestra.run.smithi162.stdout: "num_blocked_ops": 0 2024-09-12T18:36:35.315 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:36:35.339 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:36:35.385 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:35.384+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:35.458 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:35.456+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:35.494 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:36:35.494 INFO:teuthology.orchestra.run.smithi162.stdout: "size": 20, 2024-09-12T18:36:35.495 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 600, 2024-09-12T18:36:35.495 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:36:35.495 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.495 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4154.0:123 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:36:35.495 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:36:35.495 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 81.515437265000003, 2024-09-12T18:36:35.495 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.022398096999999999, 2024-09-12T18:36:35.495 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:35.495 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:35.495 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:35.495 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:35.495 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4154", 2024-09-12T18:36:35.495 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/745129001", 2024-09-12T18:36:35.496 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 123 2024-09-12T18:36:35.496 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.496 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:35.496 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.496 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:35.496 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:36:35.496 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.496 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.496 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.496 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:35.496 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:36:35.496 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.497 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.497 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.497 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:35.497 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976414+0000", 2024-09-12T18:36:35.497 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.8299999999999996e-07 2024-09-12T18:36:35.497 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.497 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.497 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:35.497 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976528+0000", 2024-09-12T18:36:35.498 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011393299999999999 2024-09-12T18:36:35.498 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.498 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.498 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:35.498 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976539+0000", 2024-09-12T18:36:35.498 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0763e-05 2024-09-12T18:36:35.498 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.498 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.498 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:35.498 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976547+0000", 2024-09-12T18:36:35.498 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8199999999999997e-06 2024-09-12T18:36:35.498 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.498 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.499 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:35.499 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.995057+0000", 2024-09-12T18:36:35.499 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.018510047000000002 2024-09-12T18:36:35.499 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.499 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.499 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:35.499 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.995301+0000", 2024-09-12T18:36:35.499 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00024375899999999999 2024-09-12T18:36:35.499 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.499 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.499 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:35.499 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.995642+0000", 2024-09-12T18:36:35.499 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00034121100000000001 2024-09-12T18:36:35.500 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.500 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.500 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:35.500 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998179+0000", 2024-09-12T18:36:35.500 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00253761 2024-09-12T18:36:35.500 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.500 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.500 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:35.500 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998665+0000", 2024-09-12T18:36:35.500 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00048574600000000001 2024-09-12T18:36:35.500 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.500 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.500 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:35.501 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998739+0000", 2024-09-12T18:36:35.501 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.4286e-05 2024-09-12T18:36:35.501 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.501 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.501 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:35.501 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998812+0000", 2024-09-12T18:36:35.501 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2238999999999997e-05 2024-09-12T18:36:35.501 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.501 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:35.501 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.501 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.501 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.501 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4154.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:36:35.501 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:36:35.502 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 81.515290032999999, 2024-09-12T18:36:35.502 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025950709999999998, 2024-09-12T18:36:35.502 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:35.502 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:35.502 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:35.502 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:35.502 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4154", 2024-09-12T18:36:35.503 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/745129001", 2024-09-12T18:36:35.503 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 124 2024-09-12T18:36:35.503 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.503 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:35.503 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.503 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:35.503 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:36:35.503 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.503 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.503 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.503 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:35.504 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:36:35.504 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.504 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.504 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.504 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:35.504 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976562+0000", 2024-09-12T18:36:35.504 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.2999999999999999e-07 2024-09-12T18:36:35.504 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.504 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.504 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:35.504 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976567+0000", 2024-09-12T18:36:35.504 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3430000000000003e-06 2024-09-12T18:36:35.504 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.505 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.505 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:35.505 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976576+0000", 2024-09-12T18:36:35.505 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8070000000000006e-06 2024-09-12T18:36:35.505 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.505 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.505 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:35.505 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976583+0000", 2024-09-12T18:36:35.505 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9959999999999996e-06 2024-09-12T18:36:35.505 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.505 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.505 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:35.505 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997107+0000", 2024-09-12T18:36:35.506 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.020524106 2024-09-12T18:36:35.506 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.506 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.506 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:35.506 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997225+0000", 2024-09-12T18:36:35.506 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000117909 2024-09-12T18:36:35.506 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.506 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.506 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:35.506 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997407+0000", 2024-09-12T18:36:35.506 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00018175900000000001 2024-09-12T18:36:35.506 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.506 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.507 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:35.507 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998839+0000", 2024-09-12T18:36:35.507 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001432539 2024-09-12T18:36:35.507 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.507 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.507 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:35.507 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002319+0000", 2024-09-12T18:36:35.507 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0034803529999999998 2024-09-12T18:36:35.507 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.507 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.507 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:35.507 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002405+0000", 2024-09-12T18:36:35.507 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5434999999999998e-05 2024-09-12T18:36:35.507 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.508 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.508 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:35.508 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002512+0000", 2024-09-12T18:36:35.508 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010663299999999999 2024-09-12T18:36:35.508 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.508 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:35.508 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.508 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.508 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.508 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:35.508 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:36:35.508 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 69.850492525999996, 2024-09-12T18:36:35.509 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025127867000000002, 2024-09-12T18:36:35.509 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:35.509 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:35.509 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:35.509 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:35.509 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.509 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:35.509 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:36:35.509 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.509 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.510 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.510 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:35.510 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:36:35.510 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.510 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.510 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.510 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:35.510 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641362+0000", 2024-09-12T18:36:35.510 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.2569999999999999e-06 2024-09-12T18:36:35.510 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.510 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.510 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:35.510 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641374+0000", 2024-09-12T18:36:35.511 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2696e-05 2024-09-12T18:36:35.511 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.511 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.511 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:35.511 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641403+0000", 2024-09-12T18:36:35.511 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.8756999999999999e-05 2024-09-12T18:36:35.511 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.511 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.511 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:35.511 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641430+0000", 2024-09-12T18:36:35.511 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.6452999999999999e-05 2024-09-12T18:36:35.511 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.511 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.512 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:35.512 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641585+0000", 2024-09-12T18:36:35.512 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000155799 2024-09-12T18:36:35.512 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.512 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.512 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:35.512 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641753+0000", 2024-09-12T18:36:35.512 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000167868 2024-09-12T18:36:35.512 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.512 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.512 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:35.513 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641916+0000", 2024-09-12T18:36:35.513 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000162903 2024-09-12T18:36:35.513 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.513 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.513 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:35.513 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653655+0000", 2024-09-12T18:36:35.513 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011738879000000001 2024-09-12T18:36:35.513 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.513 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.514 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:35.514 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665515+0000", 2024-09-12T18:36:35.514 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011859915 2024-09-12T18:36:35.514 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.514 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.514 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:35.514 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665646+0000", 2024-09-12T18:36:35.514 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013122599999999999 2024-09-12T18:36:35.514 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.514 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.514 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:35.514 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666486+0000", 2024-09-12T18:36:35.514 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00084011399999999999 2024-09-12T18:36:35.514 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.515 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:35.515 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.515 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.515 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.515 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:35.515 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:36:35.515 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 69.850378062999994, 2024-09-12T18:36:35.515 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025384584000000002, 2024-09-12T18:36:35.515 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:35.515 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:35.515 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:35.515 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:35.515 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.516 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:35.516 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:36:35.516 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.516 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.516 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.516 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:35.516 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:36:35.516 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.516 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.516 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.516 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:35.516 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641474+0000", 2024-09-12T18:36:35.516 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.39e-06 2024-09-12T18:36:35.517 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.517 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.517 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:35.517 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641482+0000", 2024-09-12T18:36:35.517 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3499999999999999e-06 2024-09-12T18:36:35.517 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.517 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.517 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:35.517 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641534+0000", 2024-09-12T18:36:35.517 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2533e-05 2024-09-12T18:36:35.517 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.517 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.517 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:35.517 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641551+0000", 2024-09-12T18:36:35.518 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6515999999999999e-05 2024-09-12T18:36:35.518 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.518 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.518 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:35.518 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642630+0000", 2024-09-12T18:36:35.518 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001079705 2024-09-12T18:36:35.518 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.518 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.518 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:35.518 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642909+0000", 2024-09-12T18:36:35.518 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027859800000000002 2024-09-12T18:36:35.518 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.518 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.519 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:35.519 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643137+0000", 2024-09-12T18:36:35.519 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022803799999999999 2024-09-12T18:36:35.519 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.519 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.519 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:35.519 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653669+0000", 2024-09-12T18:36:35.519 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010532032 2024-09-12T18:36:35.519 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.520 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.520 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:35.520 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666624+0000", 2024-09-12T18:36:35.520 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012954940999999999 2024-09-12T18:36:35.520 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.520 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.520 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:35.520 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666762+0000", 2024-09-12T18:36:35.520 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000137668 2024-09-12T18:36:35.520 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.520 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.520 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:35.520 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666857+0000", 2024-09-12T18:36:35.521 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.5812999999999999e-05 2024-09-12T18:36:35.521 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.521 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:35.521 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.521 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.521 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.521 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:35.521 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:36:35.521 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 69.850250267999996, 2024-09-12T18:36:35.521 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025661562999999998, 2024-09-12T18:36:35.521 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:35.521 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:35.521 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:35.522 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:35.522 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.522 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:35.522 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:36:35.522 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.522 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.522 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.522 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:35.522 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:36:35.522 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.522 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.522 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.522 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:35.523 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641602+0000", 2024-09-12T18:36:35.523 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3540000000000001e-06 2024-09-12T18:36:35.523 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.523 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.524 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:35.524 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641637+0000", 2024-09-12T18:36:35.524 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5145999999999999e-05 2024-09-12T18:36:35.524 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.524 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.524 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:35.524 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641659+0000", 2024-09-12T18:36:35.524 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2249999999999999e-05 2024-09-12T18:36:35.524 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.524 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.524 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:35.524 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641675+0000", 2024-09-12T18:36:35.524 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6059999999999999e-05 2024-09-12T18:36:35.525 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.525 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.525 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:35.525 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644570+0000", 2024-09-12T18:36:35.525 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028947069999999998 2024-09-12T18:36:35.525 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.525 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.525 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:35.525 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644900+0000", 2024-09-12T18:36:35.525 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000329401 2024-09-12T18:36:35.526 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.526 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.526 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:35.526 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645235+0000", 2024-09-12T18:36:35.526 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000335874 2024-09-12T18:36:35.526 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.526 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.526 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:35.526 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655459+0000", 2024-09-12T18:36:35.526 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010223441999999999 2024-09-12T18:36:35.526 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.526 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.526 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:35.527 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667028+0000", 2024-09-12T18:36:35.527 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011568673999999999 2024-09-12T18:36:35.527 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.527 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.527 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:35.527 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667163+0000", 2024-09-12T18:36:35.527 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013525500000000001 2024-09-12T18:36:35.527 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.527 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.527 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:35.527 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667262+0000", 2024-09-12T18:36:35.527 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9400000000000004e-05 2024-09-12T18:36:35.527 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.528 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:35.528 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.528 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.528 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.528 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:35.528 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:36:35.528 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 69.850148447999999, 2024-09-12T18:36:35.528 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025971339, 2024-09-12T18:36:35.528 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:35.528 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:35.528 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:35.528 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:35.528 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.529 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:35.529 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:36:35.529 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.529 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.529 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.529 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:35.529 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:36:35.529 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.529 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.529 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.529 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:35.529 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641704+0000", 2024-09-12T18:36:35.529 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.297e-06 2024-09-12T18:36:35.529 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.530 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.530 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:35.530 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641712+0000", 2024-09-12T18:36:35.530 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.9060000000000002e-06 2024-09-12T18:36:35.530 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.530 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.530 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:35.530 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641731+0000", 2024-09-12T18:36:35.530 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9083e-05 2024-09-12T18:36:35.530 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.530 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.530 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:35.530 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641745+0000", 2024-09-12T18:36:35.531 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4066999999999999e-05 2024-09-12T18:36:35.531 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.531 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.531 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:35.531 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646529+0000", 2024-09-12T18:36:35.531 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.004784033 2024-09-12T18:36:35.531 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.531 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.531 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:35.531 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646727+0000", 2024-09-12T18:36:35.531 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019841800000000001 2024-09-12T18:36:35.531 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.531 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.531 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:35.532 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647057+0000", 2024-09-12T18:36:35.532 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032926800000000002 2024-09-12T18:36:35.532 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.532 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.532 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:35.532 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655475+0000", 2024-09-12T18:36:35.532 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0084186250000000008 2024-09-12T18:36:35.532 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.532 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.532 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:35.532 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667424+0000", 2024-09-12T18:36:35.532 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011949257 2024-09-12T18:36:35.532 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.533 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.533 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:35.533 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667573+0000", 2024-09-12T18:36:35.533 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014851900000000001 2024-09-12T18:36:35.533 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.533 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.534 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:35.534 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667674+0000", 2024-09-12T18:36:35.534 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010086600000000001 2024-09-12T18:36:35.534 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.534 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:35.534 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.534 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.534 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.534 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:35.534 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:36:35.534 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 69.850086059000006, 2024-09-12T18:36:35.534 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026215008000000001, 2024-09-12T18:36:35.534 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:35.535 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:35.535 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:35.535 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:35.535 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.535 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:35.535 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:36:35.535 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.535 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.535 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.535 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:35.535 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:36:35.536 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.536 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.536 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.536 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:35.536 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641766+0000", 2024-09-12T18:36:35.536 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1200000000000001e-06 2024-09-12T18:36:35.536 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.536 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.536 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:35.536 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641775+0000", 2024-09-12T18:36:35.537 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.2499999999999995e-06 2024-09-12T18:36:35.537 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.537 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.537 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:35.537 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641793+0000", 2024-09-12T18:36:35.537 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7773000000000001e-05 2024-09-12T18:36:35.537 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.537 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.537 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:35.537 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641807+0000", 2024-09-12T18:36:35.537 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3814e-05 2024-09-12T18:36:35.538 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.538 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.538 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:35.538 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647626+0000", 2024-09-12T18:36:35.538 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0058193050000000003 2024-09-12T18:36:35.538 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.538 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.538 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:35.538 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647937+0000", 2024-09-12T18:36:35.538 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031112400000000003 2024-09-12T18:36:35.538 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.538 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.539 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:35.539 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648239+0000", 2024-09-12T18:36:35.539 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00030227500000000002 2024-09-12T18:36:35.539 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.539 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.539 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:35.539 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655487+0000", 2024-09-12T18:36:35.539 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072479129999999999 2024-09-12T18:36:35.539 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.539 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.539 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:35.539 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667823+0000", 2024-09-12T18:36:35.539 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012335505 2024-09-12T18:36:35.540 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.540 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.540 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:35.540 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667908+0000", 2024-09-12T18:36:35.540 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4843000000000001e-05 2024-09-12T18:36:35.540 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.540 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.540 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:35.540 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667980+0000", 2024-09-12T18:36:35.540 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2086000000000001e-05 2024-09-12T18:36:35.540 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.540 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:35.540 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.541 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.541 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.541 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:35.541 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:36:35.541 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 69.850025905999999, 2024-09-12T18:36:35.541 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026483236, 2024-09-12T18:36:35.541 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:35.541 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:35.541 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:35.541 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:35.541 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.541 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:35.541 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:36:35.542 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.542 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.542 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.542 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:35.542 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:36:35.542 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.542 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.542 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.542 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:35.542 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641826+0000", 2024-09-12T18:36:35.543 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:36:35.543 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.543 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.543 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:35.543 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641832+0000", 2024-09-12T18:36:35.543 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4199999999999998e-06 2024-09-12T18:36:35.543 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.543 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.544 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:35.544 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641848+0000", 2024-09-12T18:36:35.544 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6492999999999999e-05 2024-09-12T18:36:35.544 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.544 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.544 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:35.544 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641863+0000", 2024-09-12T18:36:35.544 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5427e-05 2024-09-12T18:36:35.544 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.544 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.544 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:35.544 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648887+0000", 2024-09-12T18:36:35.545 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0070230860000000004 2024-09-12T18:36:35.545 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.545 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.545 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:35.545 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649111+0000", 2024-09-12T18:36:35.545 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022425799999999999 2024-09-12T18:36:35.545 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.545 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.545 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:35.546 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649494+0000", 2024-09-12T18:36:35.546 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00038349400000000001 2024-09-12T18:36:35.546 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.546 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.546 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:35.546 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655499+0000", 2024-09-12T18:36:35.546 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0060047260000000002 2024-09-12T18:36:35.546 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.546 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.546 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:35.546 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668110+0000", 2024-09-12T18:36:35.546 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012610543 2024-09-12T18:36:35.546 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.547 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.547 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:35.547 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668252+0000", 2024-09-12T18:36:35.547 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014265600000000001 2024-09-12T18:36:35.547 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.547 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.547 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:35.547 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668308+0000", 2024-09-12T18:36:35.547 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5992999999999997e-05 2024-09-12T18:36:35.547 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.547 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:35.547 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.547 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.547 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.548 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:35.548 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:36:35.548 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 69.849970690000006, 2024-09-12T18:36:35.548 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026605302000000001, 2024-09-12T18:36:35.548 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:35.548 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:35.548 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:35.548 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:35.549 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.549 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:35.549 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:36:35.549 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.549 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.549 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.549 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:35.549 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:36:35.549 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.550 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.550 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.550 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:35.550 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641881+0000", 2024-09-12T18:36:35.550 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.057e-06 2024-09-12T18:36:35.550 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.550 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.550 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:35.550 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641887+0000", 2024-09-12T18:36:35.551 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.6629999999999998e-06 2024-09-12T18:36:35.551 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.551 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.551 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:35.551 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641903+0000", 2024-09-12T18:36:35.551 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6317e-05 2024-09-12T18:36:35.551 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.551 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.551 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:35.551 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641917+0000", 2024-09-12T18:36:35.551 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3339999999999999e-05 2024-09-12T18:36:35.551 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.551 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.552 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:35.552 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650708+0000", 2024-09-12T18:36:35.552 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.008791419 2024-09-12T18:36:35.552 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.552 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.552 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:35.552 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651021+0000", 2024-09-12T18:36:35.552 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031296699999999999 2024-09-12T18:36:35.552 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.552 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.552 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:35.552 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651349+0000", 2024-09-12T18:36:35.553 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032796499999999999 2024-09-12T18:36:35.553 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.553 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.553 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:35.553 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655742+0000", 2024-09-12T18:36:35.553 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0043934680000000002 2024-09-12T18:36:35.553 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.553 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.553 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:35.553 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668377+0000", 2024-09-12T18:36:35.553 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012634312999999999 2024-09-12T18:36:35.553 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.553 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.554 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:35.554 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668441+0000", 2024-09-12T18:36:35.554 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4369999999999995e-05 2024-09-12T18:36:35.554 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.554 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.554 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:35.554 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668485+0000", 2024-09-12T18:36:35.554 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4422999999999998e-05 2024-09-12T18:36:35.554 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.554 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:35.555 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.555 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.555 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.555 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:35.555 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:36:35.555 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 69.849913287000007, 2024-09-12T18:36:35.555 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026919499, 2024-09-12T18:36:35.555 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:35.556 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:35.556 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:35.556 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:35.556 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.556 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:35.556 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:36:35.556 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.556 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.556 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.556 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:35.556 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:36:35.557 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.557 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.557 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.557 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:35.557 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641939+0000", 2024-09-12T18:36:35.557 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9399999999999993e-07 2024-09-12T18:36:35.557 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.557 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.557 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:35.557 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641945+0000", 2024-09-12T18:36:35.557 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9200000000000001e-06 2024-09-12T18:36:35.557 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.557 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.558 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:35.558 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641961+0000", 2024-09-12T18:36:35.558 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6520000000000001e-05 2024-09-12T18:36:35.558 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.558 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.558 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:35.558 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641974+0000", 2024-09-12T18:36:35.558 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3413e-05 2024-09-12T18:36:35.558 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.558 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.558 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:35.559 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654560+0000", 2024-09-12T18:36:35.559 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012585308999999999 2024-09-12T18:36:35.559 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.559 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.559 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:35.559 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654822+0000", 2024-09-12T18:36:35.559 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026210099999999999 2024-09-12T18:36:35.559 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.559 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.560 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:35.560 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655059+0000", 2024-09-12T18:36:35.560 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00023747899999999999 2024-09-12T18:36:35.560 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.560 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.560 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:35.560 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.656315+0000", 2024-09-12T18:36:35.560 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0012555000000000001 2024-09-12T18:36:35.560 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.560 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.560 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:35.561 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668590+0000", 2024-09-12T18:36:35.561 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012274851999999999 2024-09-12T18:36:35.561 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.561 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.561 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:35.561 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668725+0000", 2024-09-12T18:36:35.561 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013524199999999999 2024-09-12T18:36:35.561 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.561 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.561 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:35.561 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668857+0000", 2024-09-12T18:36:35.561 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013216899999999999 2024-09-12T18:36:35.562 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.562 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:35.562 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.562 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.562 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.562 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:35.562 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:36:35.563 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 69.849859766999998, 2024-09-12T18:36:35.563 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023616723999999999, 2024-09-12T18:36:35.563 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:35.563 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:35.563 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:35.563 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:35.563 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.563 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:35.563 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:36:35.563 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.563 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.563 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.563 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:35.564 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:36:35.564 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.564 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.564 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.564 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:35.564 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641992+0000", 2024-09-12T18:36:35.564 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.08e-06 2024-09-12T18:36:35.564 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.564 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.565 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:35.565 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641998+0000", 2024-09-12T18:36:35.565 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4299999999999997e-06 2024-09-12T18:36:35.565 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.565 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.565 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:35.565 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642014+0000", 2024-09-12T18:36:35.565 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6266e-05 2024-09-12T18:36:35.565 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.565 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.565 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:35.565 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642026+0000", 2024-09-12T18:36:35.565 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2567e-05 2024-09-12T18:36:35.566 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.566 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.566 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:35.566 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642213+0000", 2024-09-12T18:36:35.566 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00018701899999999999 2024-09-12T18:36:35.566 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.566 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.566 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:35.566 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642507+0000", 2024-09-12T18:36:35.566 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00029394700000000002 2024-09-12T18:36:35.566 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.566 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.567 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:35.567 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642686+0000", 2024-09-12T18:36:35.567 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000178152 2024-09-12T18:36:35.567 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.567 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.567 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:35.567 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650952+0000", 2024-09-12T18:36:35.567 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0082663570000000002 2024-09-12T18:36:35.567 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.567 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.567 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:35.568 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665382+0000", 2024-09-12T18:36:35.568 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.014430111000000001 2024-09-12T18:36:35.568 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.568 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.568 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:35.568 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665508+0000", 2024-09-12T18:36:35.568 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000125986 2024-09-12T18:36:35.568 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.568 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.568 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:35.568 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665608+0000", 2024-09-12T18:36:35.568 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9809000000000006e-05 2024-09-12T18:36:35.569 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.569 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:35.569 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.569 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.569 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.569 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:35.569 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:36:35.569 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 69.849731902000002, 2024-09-12T18:36:35.569 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024670563, 2024-09-12T18:36:35.569 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:35.569 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:35.569 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:35.569 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:35.570 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.570 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:35.570 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:36:35.570 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.570 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.570 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.570 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:35.570 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:36:35.571 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.571 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.571 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.571 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:35.571 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642120+0000", 2024-09-12T18:36:35.571 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1769999999999999e-06 2024-09-12T18:36:35.571 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.572 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.572 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:35.572 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642128+0000", 2024-09-12T18:36:35.572 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3429999999999998e-06 2024-09-12T18:36:35.572 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.572 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.572 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:35.572 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642192+0000", 2024-09-12T18:36:35.573 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4406999999999995e-05 2024-09-12T18:36:35.573 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.573 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.573 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:35.573 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642223+0000", 2024-09-12T18:36:35.573 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.1266000000000002e-05 2024-09-12T18:36:35.573 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.573 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.573 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:35.573 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643201+0000", 2024-09-12T18:36:35.573 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0009778390000000001 2024-09-12T18:36:35.573 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.573 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.574 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:35.574 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643410+0000", 2024-09-12T18:36:35.574 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020874199999999999 2024-09-12T18:36:35.574 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.574 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.574 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:35.574 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643685+0000", 2024-09-12T18:36:35.574 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027520700000000002 2024-09-12T18:36:35.574 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.574 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.574 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:35.574 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650966+0000", 2024-09-12T18:36:35.574 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072810710000000001 2024-09-12T18:36:35.575 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.575 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.575 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:35.575 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666560+0000", 2024-09-12T18:36:35.575 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015594143 2024-09-12T18:36:35.575 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.575 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.575 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:35.575 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666691+0000", 2024-09-12T18:36:35.575 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000130359 2024-09-12T18:36:35.575 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.576 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.576 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:35.576 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666790+0000", 2024-09-12T18:36:35.576 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9009e-05 2024-09-12T18:36:35.576 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.576 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:35.576 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.576 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.576 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.576 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:35.577 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:36:35.577 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 69.848953613999996, 2024-09-12T18:36:35.577 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024891744, 2024-09-12T18:36:35.577 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:35.577 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:35.577 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:35.577 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:35.577 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.577 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:35.577 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:36:35.578 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.578 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.578 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.578 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:35.578 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:36:35.578 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.579 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.579 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.579 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:35.579 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642899+0000", 2024-09-12T18:36:35.579 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4729999999999999e-06 2024-09-12T18:36:35.580 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.580 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.580 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:35.580 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642912+0000", 2024-09-12T18:36:35.580 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3495999999999999e-05 2024-09-12T18:36:35.580 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.581 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.581 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:35.581 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642934+0000", 2024-09-12T18:36:35.581 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2033999999999999e-05 2024-09-12T18:36:35.581 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.581 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.581 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:35.581 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642949+0000", 2024-09-12T18:36:35.581 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4970000000000001e-05 2024-09-12T18:36:35.581 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.582 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.582 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:35.582 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644400+0000", 2024-09-12T18:36:35.582 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001450305 2024-09-12T18:36:35.582 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.582 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.582 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:35.582 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644617+0000", 2024-09-12T18:36:35.582 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000217302 2024-09-12T18:36:35.582 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.582 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.582 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:35.582 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645052+0000", 2024-09-12T18:36:35.582 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000434797 2024-09-12T18:36:35.583 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.583 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.583 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:35.583 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653860+0000", 2024-09-12T18:36:35.583 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0088082249999999994 2024-09-12T18:36:35.583 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.583 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.583 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:35.583 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667598+0000", 2024-09-12T18:36:35.583 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.013738451 2024-09-12T18:36:35.583 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.583 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.584 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:35.584 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667698+0000", 2024-09-12T18:36:35.584 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9854999999999999e-05 2024-09-12T18:36:35.584 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.584 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.584 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:35.584 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667789+0000", 2024-09-12T18:36:35.584 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0835999999999996e-05 2024-09-12T18:36:35.584 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.584 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:35.584 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.584 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.584 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.585 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:30 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:35.585 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:36:35.585 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 69.848878798000001, 2024-09-12T18:36:35.585 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023936852000000002, 2024-09-12T18:36:35.585 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:35.585 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:35.585 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:35.585 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:35.585 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.586 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:35.586 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:36:35.586 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.586 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.586 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.586 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:35.586 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:36:35.586 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.586 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.586 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.586 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:35.586 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642973+0000", 2024-09-12T18:36:35.586 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.11e-06 2024-09-12T18:36:35.587 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.587 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.587 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:35.587 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642994+0000", 2024-09-12T18:36:35.587 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.0699999999999998e-05 2024-09-12T18:36:35.587 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.587 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.587 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:35.587 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643011+0000", 2024-09-12T18:36:35.587 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7229999999999999e-05 2024-09-12T18:36:35.587 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.587 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.588 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:35.588 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643025+0000", 2024-09-12T18:36:35.588 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3803e-05 2024-09-12T18:36:35.588 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.588 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.588 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:35.588 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643143+0000", 2024-09-12T18:36:35.588 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000118225 2024-09-12T18:36:35.588 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.588 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.588 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:35.588 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643426+0000", 2024-09-12T18:36:35.589 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00028250500000000001 2024-09-12T18:36:35.589 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.589 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.589 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:35.589 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643864+0000", 2024-09-12T18:36:35.589 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00043856 2024-09-12T18:36:35.589 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.589 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.590 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:35.590 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651148+0000", 2024-09-12T18:36:35.590 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072836769999999997 2024-09-12T18:36:35.590 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.590 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.590 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:35.590 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666674+0000", 2024-09-12T18:36:35.591 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015525786999999999 2024-09-12T18:36:35.591 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.591 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.591 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:35.591 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666796+0000", 2024-09-12T18:36:35.591 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000122416 2024-09-12T18:36:35.592 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.592 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.592 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:35.592 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666909+0000", 2024-09-12T18:36:35.592 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011283899999999999 2024-09-12T18:36:35.592 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.593 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:35.593 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.593 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.593 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.593 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:35.593 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:36:35.593 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 69.848796092000001, 2024-09-12T18:36:35.593 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024100234000000002, 2024-09-12T18:36:35.594 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:35.594 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:35.594 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:35.594 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:35.594 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.594 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:35.594 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:36:35.594 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.595 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.595 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.595 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:35.595 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:36:35.595 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.595 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.595 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.595 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:35.596 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643056+0000", 2024-09-12T18:36:35.596 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.046e-06 2024-09-12T18:36:35.596 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.596 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.596 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:35.596 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643068+0000", 2024-09-12T18:36:35.596 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2106999999999999e-05 2024-09-12T18:36:35.596 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.597 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.597 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:35.597 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643085+0000", 2024-09-12T18:36:35.597 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7479999999999999e-05 2024-09-12T18:36:35.597 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.597 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.597 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:35.597 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643099+0000", 2024-09-12T18:36:35.598 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3730000000000001e-05 2024-09-12T18:36:35.598 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.598 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.598 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:35.598 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644623+0000", 2024-09-12T18:36:35.598 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0015236080000000001 2024-09-12T18:36:35.598 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.598 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.599 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:35.599 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644893+0000", 2024-09-12T18:36:35.599 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026990500000000003 2024-09-12T18:36:35.599 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.599 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.599 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:35.599 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645227+0000", 2024-09-12T18:36:35.599 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00033391300000000003 2024-09-12T18:36:35.599 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.599 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.599 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:35.600 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653926+0000", 2024-09-12T18:36:35.600 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0086993339999999995 2024-09-12T18:36:35.600 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.600 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.600 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:35.600 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666925+0000", 2024-09-12T18:36:35.600 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012998686000000001 2024-09-12T18:36:35.600 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.600 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.600 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:35.600 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667057+0000", 2024-09-12T18:36:35.600 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013255600000000001 2024-09-12T18:36:35.600 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.601 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.601 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:35.601 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667155+0000", 2024-09-12T18:36:35.601 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7868999999999994e-05 2024-09-12T18:36:35.601 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.601 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:35.601 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.601 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.601 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.601 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:35.601 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643139+0000", 2024-09-12T18:36:35.601 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 69.848711506000001, 2024-09-12T18:36:35.601 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.022417057000000001, 2024-09-12T18:36:35.602 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:35.602 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:35.602 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:35.602 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:35.602 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.602 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:35.602 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643139+0000", 2024-09-12T18:36:35.602 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.602 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.602 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.602 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:35.602 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643139+0000", 2024-09-12T18:36:35.602 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.602 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.603 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.603 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:35.603 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643140+0000", 2024-09-12T18:36:35.603 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0729999999999999e-06 2024-09-12T18:36:35.603 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.603 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.603 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:35.603 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643151+0000", 2024-09-12T18:36:35.603 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.039e-05 2024-09-12T18:36:35.603 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.603 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.603 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:35.603 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643168+0000", 2024-09-12T18:36:35.604 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7575999999999999e-05 2024-09-12T18:36:35.604 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.604 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.604 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:35.604 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643182+0000", 2024-09-12T18:36:35.604 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3224000000000001e-05 2024-09-12T18:36:35.604 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.604 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.604 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:35.604 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643358+0000", 2024-09-12T18:36:35.604 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00017676500000000001 2024-09-12T18:36:35.604 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.604 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.605 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:35.605 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643647+0000", 2024-09-12T18:36:35.605 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00028850499999999999 2024-09-12T18:36:35.605 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.605 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.605 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:35.605 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643924+0000", 2024-09-12T18:36:35.605 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000277547 2024-09-12T18:36:35.605 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.605 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.605 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:35.605 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650289+0000", 2024-09-12T18:36:35.605 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0063645350000000002 2024-09-12T18:36:35.606 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.606 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.606 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:35.606 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665333+0000", 2024-09-12T18:36:35.606 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015043531000000001 2024-09-12T18:36:35.606 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.606 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.606 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:35.606 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665454+0000", 2024-09-12T18:36:35.606 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000121302 2024-09-12T18:36:35.607 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.607 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.607 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:35.607 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665556+0000", 2024-09-12T18:36:35.607 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010260900000000001 2024-09-12T18:36:35.607 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.607 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:35.607 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.607 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.607 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.607 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:35.607 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:36:35.608 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 69.848600302999998, 2024-09-12T18:36:35.608 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024255982999999998, 2024-09-12T18:36:35.608 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:35.608 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:35.608 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:35.608 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:35.608 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.608 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:35.608 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:36:35.608 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.608 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.608 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.608 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:35.609 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:36:35.609 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.609 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.609 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.609 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:35.609 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643252+0000", 2024-09-12T18:36:35.609 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:35.609 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.609 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.609 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:35.609 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643287+0000", 2024-09-12T18:36:35.609 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5225999999999998e-05 2024-09-12T18:36:35.609 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.610 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.610 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:35.610 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643323+0000", 2024-09-12T18:36:35.610 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5488999999999999e-05 2024-09-12T18:36:35.610 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.610 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.610 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:35.610 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643357+0000", 2024-09-12T18:36:35.610 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.3853999999999998e-05 2024-09-12T18:36:35.610 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.610 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.610 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:35.610 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646716+0000", 2024-09-12T18:36:35.610 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003359 2024-09-12T18:36:35.611 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.611 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.611 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:35.611 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647037+0000", 2024-09-12T18:36:35.611 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032131800000000002 2024-09-12T18:36:35.611 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.611 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.611 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:35.611 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647337+0000", 2024-09-12T18:36:35.611 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000300208 2024-09-12T18:36:35.611 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.611 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.611 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:35.611 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654291+0000", 2024-09-12T18:36:35.612 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0069543089999999997 2024-09-12T18:36:35.612 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.612 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.612 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:35.612 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667297+0000", 2024-09-12T18:36:35.612 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.013005526 2024-09-12T18:36:35.612 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.612 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.612 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:35.612 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667416+0000", 2024-09-12T18:36:35.612 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000119416 2024-09-12T18:36:35.612 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.612 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.613 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:35.613 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667507+0000", 2024-09-12T18:36:35.613 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0206999999999999e-05 2024-09-12T18:36:35.613 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.613 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:35.613 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.613 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.613 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.613 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:35.614 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:36:35.614 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 69.848473208000001, 2024-09-12T18:36:35.614 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023888482999999999, 2024-09-12T18:36:35.614 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:35.614 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:35.614 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:35.614 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:35.614 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.614 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:35.614 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:36:35.614 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.614 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.614 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.615 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:35.615 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:36:35.615 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.615 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.615 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.615 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:35.615 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643379+0000", 2024-09-12T18:36:35.615 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.207e-06 2024-09-12T18:36:35.615 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.615 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.616 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:35.616 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643390+0000", 2024-09-12T18:36:35.616 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0696000000000001e-05 2024-09-12T18:36:35.616 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.616 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.616 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:35.617 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643407+0000", 2024-09-12T18:36:35.617 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7563000000000001e-05 2024-09-12T18:36:35.617 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.617 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.617 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:35.617 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643420+0000", 2024-09-12T18:36:35.617 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3277e-05 2024-09-12T18:36:35.617 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.617 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.617 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:35.618 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644906+0000", 2024-09-12T18:36:35.618 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001485945 2024-09-12T18:36:35.618 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.618 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.618 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:35.618 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645404+0000", 2024-09-12T18:36:35.618 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00049807599999999997 2024-09-12T18:36:35.618 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.618 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.618 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:35.618 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645846+0000", 2024-09-12T18:36:35.618 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00044190400000000002 2024-09-12T18:36:35.618 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.619 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.619 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:35.619 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654223+0000", 2024-09-12T18:36:35.619 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0083767419999999995 2024-09-12T18:36:35.619 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.619 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.619 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:35.619 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667026+0000", 2024-09-12T18:36:35.619 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012802531000000001 2024-09-12T18:36:35.619 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.619 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.619 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:35.620 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667162+0000", 2024-09-12T18:36:35.620 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000136112 2024-09-12T18:36:35.620 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.620 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.620 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:35.620 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667266+0000", 2024-09-12T18:36:35.620 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010443 2024-09-12T18:36:35.620 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.620 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:35.620 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.620 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.620 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.620 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:35.621 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:36:35.621 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 69.848322488999997, 2024-09-12T18:36:35.621 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024222582999999999, 2024-09-12T18:36:35.621 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:35.621 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:35.621 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:35.621 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:35.621 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.621 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:35.621 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:36:35.621 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.621 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.621 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.622 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:35.622 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:36:35.622 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.622 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.622 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.622 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:35.622 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643530+0000", 2024-09-12T18:36:35.622 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.393e-06 2024-09-12T18:36:35.622 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.622 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.622 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:35.623 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643536+0000", 2024-09-12T18:36:35.623 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4130000000000003e-06 2024-09-12T18:36:35.623 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.623 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.623 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:35.623 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643554+0000", 2024-09-12T18:36:35.624 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7572999999999999e-05 2024-09-12T18:36:35.624 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.624 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.624 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:35.624 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643567+0000", 2024-09-12T18:36:35.624 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3393999999999999e-05 2024-09-12T18:36:35.625 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.625 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.625 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:35.625 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648198+0000", 2024-09-12T18:36:35.625 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0046304479999999997 2024-09-12T18:36:35.625 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.625 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.625 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:35.625 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648413+0000", 2024-09-12T18:36:35.625 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00021507500000000001 2024-09-12T18:36:35.625 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.625 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.625 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:35.626 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667751+0000", 2024-09-12T18:36:35.626 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.019338286999999999 2024-09-12T18:36:35.626 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.626 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:35.626 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.626 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.626 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.626 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:115344 5.1 5:8e7d96ac:::benchmark_data_smithi073_23739_object115343:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:36:35.626 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:35.318284+0000", 2024-09-12T18:36:35.626 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.17356734900000001, 2024-09-12T18:36:35.626 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.022845300999999998, 2024-09-12T18:36:35.627 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:35.627 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:35.627 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:35.627 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:35.627 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:35.627 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:35.627 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 115344 2024-09-12T18:36:35.627 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.627 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:35.628 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.628 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:35.628 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.318284+0000", 2024-09-12T18:36:35.628 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.628 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.628 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.628 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:35.628 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.318284+0000", 2024-09-12T18:36:35.628 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:35.628 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.629 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.629 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:35.629 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.318284+0000", 2024-09-12T18:36:35.629 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9999999999999997e-07 2024-09-12T18:36:35.629 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.629 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.629 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:35.629 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.318351+0000", 2024-09-12T18:36:35.629 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.7253000000000001e-05 2024-09-12T18:36:35.629 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.629 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.630 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:35.630 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.318361+0000", 2024-09-12T18:36:35.630 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0499999999999997e-06 2024-09-12T18:36:35.630 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.630 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.630 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:35.630 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.318367+0000", 2024-09-12T18:36:35.630 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.5339999999999996e-06 2024-09-12T18:36:35.630 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.630 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.630 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:35.631 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.323502+0000", 2024-09-12T18:36:35.631 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0051345490000000004 2024-09-12T18:36:35.631 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.631 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.631 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:35.631 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.323614+0000", 2024-09-12T18:36:35.631 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011212 2024-09-12T18:36:35.631 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.631 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.631 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:35.631 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.323702+0000", 2024-09-12T18:36:35.632 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8067999999999998e-05 2024-09-12T18:36:35.632 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.632 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.632 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:35.632 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.328859+0000", 2024-09-12T18:36:35.632 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0051567970000000003 2024-09-12T18:36:35.632 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.632 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.632 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:35.632 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.341004+0000", 2024-09-12T18:36:35.632 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012145606 2024-09-12T18:36:35.633 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.633 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.633 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:35.633 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.341074+0000", 2024-09-12T18:36:35.633 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9499999999999995e-05 2024-09-12T18:36:35.633 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:35.634 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:35.634 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:35.634 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.341129+0000", 2024-09-12T18:36:35.634 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5124000000000003e-05 2024-09-12T18:36:35.634 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.635 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:35.635 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.635 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:35.635 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:35.635 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:36:35.635 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T18:36:35.637 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:35.632+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:35.637 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:36:35.737 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:35.731+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:35.793 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:35.793 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:36:35.794 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.794 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:116301 5.e e46/21 5:7df091e1:::benchmark_data_smithi073_23739_object116300:head v 46'7392, mlcod=46'7390)", 2024-09-12T18:36:35.794 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:35.785918+0000", 2024-09-12T18:36:35.794 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.005049011, 2024-09-12T18:36:35.794 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0050682039999999998, 2024-09-12T18:36:35.794 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:35.794 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:35.794 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:35.794 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:35.794 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.794 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:35.794 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.785918+0000", 2024-09-12T18:36:35.795 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:35.795 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.795 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.795 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:35.795 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.785918+0000", 2024-09-12T18:36:35.795 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:35.795 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.795 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.795 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:35.795 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.785918+0000", 2024-09-12T18:36:35.795 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8400000000000004e-07 2024-09-12T18:36:35.795 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.795 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.795 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:35.796 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.785962+0000", 2024-09-12T18:36:35.796 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3358000000000001e-05 2024-09-12T18:36:35.796 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.796 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.796 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:35.796 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.785968+0000", 2024-09-12T18:36:35.796 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8419999999999999e-06 2024-09-12T18:36:35.796 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.796 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.796 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:35.796 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.785974+0000", 2024-09-12T18:36:35.796 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1399999999999999e-06 2024-09-12T18:36:35.796 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.797 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.797 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:35.797 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.786039+0000", 2024-09-12T18:36:35.797 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5848999999999999e-05 2024-09-12T18:36:35.797 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.797 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.797 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:35.797 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.786058+0000", 2024-09-12T18:36:35.797 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8793000000000001e-05 2024-09-12T18:36:35.797 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:35.797 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:35.797 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:35.797 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.798 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.798 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:116303 5.4 e46/21 5:201d520c:::benchmark_data_smithi073_23739_object116302:head v 46'7196, mlcod=46'7194)", 2024-09-12T18:36:35.798 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:35.785990+0000", 2024-09-12T18:36:35.798 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0049770580000000003, 2024-09-12T18:36:35.798 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0050477589999999998, 2024-09-12T18:36:35.798 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:35.798 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:35.798 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:35.798 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:35.798 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.798 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:35.798 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.785990+0000", 2024-09-12T18:36:35.798 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:35.799 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.799 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.799 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:35.799 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.785990+0000", 2024-09-12T18:36:35.799 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:35.799 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.799 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.799 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:35.799 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.785990+0000", 2024-09-12T18:36:35.799 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.6399999999999998e-07 2024-09-12T18:36:35.799 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.800 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.800 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:35.800 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.786036+0000", 2024-09-12T18:36:35.800 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.6458000000000001e-05 2024-09-12T18:36:35.800 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.801 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.801 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:35.801 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.786044+0000", 2024-09-12T18:36:35.801 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6369999999999999e-06 2024-09-12T18:36:35.801 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.801 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.801 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:35.801 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.786049+0000", 2024-09-12T18:36:35.801 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0889999999999999e-06 2024-09-12T18:36:35.801 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.801 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.802 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:35.802 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.786142+0000", 2024-09-12T18:36:35.802 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.3101000000000002e-05 2024-09-12T18:36:35.802 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.802 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.802 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:35.802 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.786160+0000", 2024-09-12T18:36:35.802 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.774e-05 2024-09-12T18:36:35.802 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:35.802 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:35.803 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:35.803 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.803 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.803 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:116307 5.c 5:38040149:::benchmark_data_smithi073_23739_object116306:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:36:35.803 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:35.786206+0000", 2024-09-12T18:36:35.803 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.004760294, 2024-09-12T18:36:35.803 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0048834630000000002, 2024-09-12T18:36:35.803 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:35.803 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:35.803 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:35.803 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:35.803 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:35.803 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:35.804 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 116307 2024-09-12T18:36:35.804 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.804 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:35.804 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.804 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:35.804 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.786206+0000", 2024-09-12T18:36:35.804 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:35.804 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.804 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.804 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:35.804 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.786206+0000", 2024-09-12T18:36:35.804 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:35.804 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.805 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.805 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:35.805 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.786207+0000", 2024-09-12T18:36:35.805 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1200000000000002e-07 2024-09-12T18:36:35.805 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.805 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.805 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:35.805 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.786227+0000", 2024-09-12T18:36:35.805 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9673e-05 2024-09-12T18:36:35.805 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.805 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.806 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:35.806 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.786233+0000", 2024-09-12T18:36:35.806 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5880000000000003e-06 2024-09-12T18:36:35.806 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.806 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.806 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:35.806 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.786238+0000", 2024-09-12T18:36:35.806 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.33e-06 2024-09-12T18:36:35.806 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.806 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.807 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:35.807 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.786276+0000", 2024-09-12T18:36:35.807 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8217999999999999e-05 2024-09-12T18:36:35.807 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.807 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.807 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:35.807 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.786393+0000", 2024-09-12T18:36:35.807 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000116619 2024-09-12T18:36:35.807 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.807 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.807 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:35.807 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.786516+0000", 2024-09-12T18:36:35.807 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000123335 2024-09-12T18:36:35.808 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.808 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.808 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:35.808 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.789507+0000", 2024-09-12T18:36:35.808 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0029910039999999998 2024-09-12T18:36:35.808 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:35.808 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:35.808 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:35.808 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.808 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.808 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:116308 5.a 5:5b817f69:::benchmark_data_smithi073_23739_object116307:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:36:35.808 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:35.786881+0000", 2024-09-12T18:36:35.808 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0040852270000000003, 2024-09-12T18:36:35.809 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0042750510000000002, 2024-09-12T18:36:35.809 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:35.809 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:35.809 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:35.809 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:35.809 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:35.809 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:35.809 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 116308 2024-09-12T18:36:35.809 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.809 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:35.809 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.809 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:35.809 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.786881+0000", 2024-09-12T18:36:35.810 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:35.810 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.810 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.810 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:35.810 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.786881+0000", 2024-09-12T18:36:35.810 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:35.810 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.810 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.810 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:35.810 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.786882+0000", 2024-09-12T18:36:35.810 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1999999999999998e-07 2024-09-12T18:36:35.810 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.810 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.810 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:35.811 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.786952+0000", 2024-09-12T18:36:35.811 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.9456999999999996e-05 2024-09-12T18:36:35.811 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.811 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.811 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:35.811 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.786962+0000", 2024-09-12T18:36:35.811 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0631e-05 2024-09-12T18:36:35.811 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.811 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.811 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:35.811 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.786968+0000", 2024-09-12T18:36:35.811 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.117e-06 2024-09-12T18:36:35.811 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.811 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.812 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:35.812 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.787825+0000", 2024-09-12T18:36:35.812 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00085647399999999997 2024-09-12T18:36:35.812 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.812 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.812 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:35.812 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.787966+0000", 2024-09-12T18:36:35.812 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014153399999999999 2024-09-12T18:36:35.812 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.812 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.812 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:35.812 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.788355+0000", 2024-09-12T18:36:35.813 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00038883 2024-09-12T18:36:35.813 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:35.813 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:35.813 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:35.813 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.813 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.813 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:116310 5.5 5:a353f6ae:::benchmark_data_smithi073_23739_object116309:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:36:35.813 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:35.787917+0000", 2024-09-12T18:36:35.813 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0030493009999999999, 2024-09-12T18:36:35.813 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0033017350000000001, 2024-09-12T18:36:35.813 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:35.813 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:35.813 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:35.814 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:35.814 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:35.814 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:35.814 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 116310 2024-09-12T18:36:35.814 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.814 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:35.814 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.814 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:35.814 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.787917+0000", 2024-09-12T18:36:35.814 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:35.814 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.814 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.814 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:35.814 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.787917+0000", 2024-09-12T18:36:35.815 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:35.815 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.815 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.815 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:35.815 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.787918+0000", 2024-09-12T18:36:35.815 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.8800000000000001e-07 2024-09-12T18:36:35.815 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.815 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.815 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:35.815 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.788025+0000", 2024-09-12T18:36:35.815 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00010646599999999999 2024-09-12T18:36:35.815 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.815 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.815 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:35.816 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.788033+0000", 2024-09-12T18:36:35.816 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6030000000000005e-06 2024-09-12T18:36:35.816 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.816 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.816 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:35.816 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.788039+0000", 2024-09-12T18:36:35.816 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7060000000000001e-06 2024-09-12T18:36:35.816 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.816 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.816 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:35.816 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.788085+0000", 2024-09-12T18:36:35.816 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5627000000000002e-05 2024-09-12T18:36:35.817 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.817 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.817 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:35.817 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.788215+0000", 2024-09-12T18:36:35.817 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013077799999999999 2024-09-12T18:36:35.817 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.817 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.817 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:35.817 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.788355+0000", 2024-09-12T18:36:35.817 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013987 2024-09-12T18:36:35.817 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.817 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.817 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:35.818 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.791139+0000", 2024-09-12T18:36:35.818 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0027842190000000001 2024-09-12T18:36:35.818 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:35.818 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:35.818 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:35.818 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.818 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.818 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:116311 5.4 e46/21 5:2e9eb298:::benchmark_data_smithi073_23739_object116310:head v 46'7197, mlcod=46'7194)", 2024-09-12T18:36:35.818 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:35.789391+0000", 2024-09-12T18:36:35.818 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0015758090000000001, 2024-09-12T18:36:35.818 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0018890739999999999, 2024-09-12T18:36:35.818 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:35.818 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:35.819 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:35.819 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:35.819 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.819 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:35.819 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.789391+0000", 2024-09-12T18:36:35.819 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:35.819 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.819 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.819 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:35.819 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.789391+0000", 2024-09-12T18:36:35.819 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:35.819 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.819 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.819 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:35.820 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.789392+0000", 2024-09-12T18:36:35.820 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6600000000000005e-07 2024-09-12T18:36:35.820 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.820 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.820 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:35.820 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.789459+0000", 2024-09-12T18:36:35.820 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7558999999999995e-05 2024-09-12T18:36:35.820 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.820 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.820 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:35.820 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.789469+0000", 2024-09-12T18:36:35.820 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.7440000000000002e-06 2024-09-12T18:36:35.820 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.821 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.821 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:35.821 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.789475+0000", 2024-09-12T18:36:35.821 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.947e-06 2024-09-12T18:36:35.821 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.821 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.821 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:35.821 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.790287+0000", 2024-09-12T18:36:35.821 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00081202300000000004 2024-09-12T18:36:35.821 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.821 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.821 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:35.821 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.790315+0000", 2024-09-12T18:36:35.821 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.8187999999999998e-05 2024-09-12T18:36:35.822 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:35.822 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:35.824 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:35.824 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.824 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.824 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:116312 5.c 5:37284d7b:::benchmark_data_smithi073_23739_object116311:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:36:35.824 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:35.789471+0000", 2024-09-12T18:36:35.824 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0014953690000000001, 2024-09-12T18:36:35.824 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0018579790000000001, 2024-09-12T18:36:35.825 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:35.825 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:35.825 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:35.825 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:35.825 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:35.825 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:35.825 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 116312 2024-09-12T18:36:35.825 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.825 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:35.825 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.825 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:35.825 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.789471+0000", 2024-09-12T18:36:35.825 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:35.825 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.826 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.826 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:35.826 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.789471+0000", 2024-09-12T18:36:35.826 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:35.826 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.826 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.826 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:35.826 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.789484+0000", 2024-09-12T18:36:35.826 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2864000000000001e-05 2024-09-12T18:36:35.826 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.826 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.826 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:35.826 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.789580+0000", 2024-09-12T18:36:35.827 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.5747000000000003e-05 2024-09-12T18:36:35.827 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.827 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.827 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:35.827 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.789593+0000", 2024-09-12T18:36:35.827 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3183000000000001e-05 2024-09-12T18:36:35.827 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.827 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.827 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:35.827 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.789601+0000", 2024-09-12T18:36:35.827 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.7810000000000005e-06 2024-09-12T18:36:35.827 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.827 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.827 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:35.828 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.790258+0000", 2024-09-12T18:36:35.828 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000657404 2024-09-12T18:36:35.828 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.828 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.828 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:35.828 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.790413+0000", 2024-09-12T18:36:35.828 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015510799999999999 2024-09-12T18:36:35.828 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.828 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.828 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:35.828 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.790544+0000", 2024-09-12T18:36:35.828 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000131116 2024-09-12T18:36:35.828 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:35.829 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:35.829 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:35.829 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.829 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.829 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:116314 5.c 5.82e0f97c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:36:35.829 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:35.789783+0000", 2024-09-12T18:36:35.829 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0011836570000000001, 2024-09-12T18:36:35.829 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0016022479999999999, 2024-09-12T18:36:35.829 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:35.829 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:35.829 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:35.829 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:35.829 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:35.830 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:35.830 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 116314 2024-09-12T18:36:35.830 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.830 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:35.830 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.830 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:35.830 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.789783+0000", 2024-09-12T18:36:35.830 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:35.830 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.830 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.830 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:35.830 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.789783+0000", 2024-09-12T18:36:35.830 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:35.830 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.831 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.831 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:35.831 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.789784+0000", 2024-09-12T18:36:35.831 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.4499999999999996e-07 2024-09-12T18:36:35.831 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.831 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.831 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:35.831 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.789916+0000", 2024-09-12T18:36:35.831 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013237700000000001 2024-09-12T18:36:35.831 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.831 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.831 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:35.831 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.789924+0000", 2024-09-12T18:36:35.832 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8390000000000007e-06 2024-09-12T18:36:35.832 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.832 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.832 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:35.832 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.789931+0000", 2024-09-12T18:36:35.832 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.9029999999999998e-06 2024-09-12T18:36:35.832 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:35.832 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:35.832 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:35.832 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.832 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.832 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:116316 5.8 e46/21 5:11fb2b2c:::benchmark_data_smithi073_23739_object116315:head v 46'7106, mlcod=46'7104)", 2024-09-12T18:36:35.832 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:35.790673+0000", 2024-09-12T18:36:35.833 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00029387400000000001, 2024-09-12T18:36:35.833 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00075463099999999997, 2024-09-12T18:36:35.833 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:35.833 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:35.833 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:35.833 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:35.833 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.833 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:35.833 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.790673+0000", 2024-09-12T18:36:35.833 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:35.833 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.833 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.833 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:35.833 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.790673+0000", 2024-09-12T18:36:35.834 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:35.834 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.834 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.834 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:35.834 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.790673+0000", 2024-09-12T18:36:35.834 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6300000000000005e-07 2024-09-12T18:36:35.834 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.834 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.834 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:35.834 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.790772+0000", 2024-09-12T18:36:35.834 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.8562999999999998e-05 2024-09-12T18:36:35.834 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.834 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.835 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:35.835 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.790780+0000", 2024-09-12T18:36:35.835 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.3110000000000006e-06 2024-09-12T18:36:35.835 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.835 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.835 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:35.835 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.790786+0000", 2024-09-12T18:36:35.835 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.716e-06 2024-09-12T18:36:35.835 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.835 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.835 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:35.835 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.790832+0000", 2024-09-12T18:36:35.835 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.6303e-05 2024-09-12T18:36:35.836 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.836 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.836 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:35.836 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.790848+0000", 2024-09-12T18:36:35.836 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5888000000000001e-05 2024-09-12T18:36:35.836 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:35.836 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:35.836 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:35.836 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.836 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.836 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:116318 5.a 5:5d7c16e5:::benchmark_data_smithi073_23739_object116317:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:36:35.836 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:35.790658+0000", 2024-09-12T18:36:35.836 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.000308392, 2024-09-12T18:36:35.837 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00081848700000000001, 2024-09-12T18:36:35.837 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:35.837 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:35.837 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:35.837 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:35.837 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:35.837 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:35.837 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 116318 2024-09-12T18:36:35.837 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.837 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:35.837 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.837 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:35.837 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.790658+0000", 2024-09-12T18:36:35.838 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:35.838 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.838 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.838 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:35.838 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.790658+0000", 2024-09-12T18:36:35.838 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:35.838 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.838 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.838 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:35.838 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.790659+0000", 2024-09-12T18:36:35.838 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3399999999999998e-07 2024-09-12T18:36:35.838 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.838 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.838 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:35.839 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.790777+0000", 2024-09-12T18:36:35.839 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00011830200000000001 2024-09-12T18:36:35.839 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.839 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.839 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:35.839 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.790785+0000", 2024-09-12T18:36:35.839 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5530000000000004e-06 2024-09-12T18:36:35.839 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.839 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.839 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:35.839 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.790798+0000", 2024-09-12T18:36:35.839 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3020000000000001e-05 2024-09-12T18:36:35.839 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.839 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.840 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:35.840 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.790856+0000", 2024-09-12T18:36:35.840 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7756000000000001e-05 2024-09-12T18:36:35.840 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.840 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.840 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:35.840 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.790984+0000", 2024-09-12T18:36:35.840 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012826600000000001 2024-09-12T18:36:35.840 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.840 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.840 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:35.840 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.791129+0000", 2024-09-12T18:36:35.840 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000144871 2024-09-12T18:36:35.841 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:35.841 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:35.841 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:35.841 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.841 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.841 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:116319 5.6 5:6100eae8:::benchmark_data_smithi073_23739_object116318:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:36:35.841 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:35.790816+0000", 2024-09-12T18:36:35.841 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.000150488, 2024-09-12T18:36:35.841 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00071910500000000005, 2024-09-12T18:36:35.841 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:35.841 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:35.841 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:35.841 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:35.842 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:35.842 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:35.842 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 116319 2024-09-12T18:36:35.842 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.842 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:35.842 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.842 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:35.842 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.790816+0000", 2024-09-12T18:36:35.842 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:35.842 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.842 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.842 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:35.842 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.790816+0000", 2024-09-12T18:36:35.842 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:35.843 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.843 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.843 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:35.843 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.790816+0000", 2024-09-12T18:36:35.843 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.96e-07 2024-09-12T18:36:35.843 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.843 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.843 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:35.843 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.790850+0000", 2024-09-12T18:36:35.843 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3407e-05 2024-09-12T18:36:35.843 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.843 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.843 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:35.844 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.790858+0000", 2024-09-12T18:36:35.844 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.9980000000000003e-06 2024-09-12T18:36:35.844 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.844 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.844 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:35.844 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.790864+0000", 2024-09-12T18:36:35.844 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7989999999999999e-06 2024-09-12T18:36:35.844 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.844 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.844 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:35.844 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.790925+0000", 2024-09-12T18:36:35.844 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1432000000000004e-05 2024-09-12T18:36:35.844 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.845 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.845 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:35.845 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.791076+0000", 2024-09-12T18:36:35.845 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015117700000000001 2024-09-12T18:36:35.845 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.845 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.845 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:35.845 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.791213+0000", 2024-09-12T18:36:35.845 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013624500000000001 2024-09-12T18:36:35.845 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:35.845 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:35.845 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:35.845 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.845 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.846 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:116320 5.3 5:cdb727d9:::benchmark_data_smithi073_23739_object116319:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:36:35.846 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:35.790877+0000", 2024-09-12T18:36:35.846 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 8.9128000000000005e-05, 2024-09-12T18:36:35.846 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00071590300000000005, 2024-09-12T18:36:35.846 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:35.846 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:35.846 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:35.846 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:35.846 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:35.846 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:35.846 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 116320 2024-09-12T18:36:35.846 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.846 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:35.846 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.847 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:35.847 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.790877+0000", 2024-09-12T18:36:35.847 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:35.847 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.847 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.847 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:35.847 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.790877+0000", 2024-09-12T18:36:35.847 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:35.847 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.847 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.847 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:35.847 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.790878+0000", 2024-09-12T18:36:35.847 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5000000000000002e-07 2024-09-12T18:36:35.847 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.848 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.848 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:35.848 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.790933+0000", 2024-09-12T18:36:35.848 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4475999999999998e-05 2024-09-12T18:36:35.848 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.848 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.848 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:35.848 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.790940+0000", 2024-09-12T18:36:35.848 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.2420000000000003e-06 2024-09-12T18:36:35.848 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.848 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.848 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:35.848 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.790945+0000", 2024-09-12T18:36:35.849 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5310000000000001e-06 2024-09-12T18:36:35.849 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.849 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.849 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:35.849 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.791012+0000", 2024-09-12T18:36:35.849 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6359000000000006e-05 2024-09-12T18:36:35.849 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.849 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.849 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:35.849 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.791219+0000", 2024-09-12T18:36:35.849 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000207624 2024-09-12T18:36:35.849 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:35.850 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:35.850 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:35.850 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.791376+0000", 2024-09-12T18:36:35.850 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015614900000000001 2024-09-12T18:36:35.850 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:35.850 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:35.850 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:35.850 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:35.850 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-12T18:36:35.850 INFO:teuthology.orchestra.run.smithi114.stdout: "num_ops": 12 2024-09-12T18:36:35.850 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:35.852 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:36:35.852 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:35.847+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:35.874 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 50 16 116490 116474 145.577 129.188 0.00371838 0.00686459 2024-09-12T18:36:35.952 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:35.948+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:36.033 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is unset 2024-09-12T18:36:36.048 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:36.048 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2024-09-12T18:36:36.049 INFO:teuthology.orchestra.run.smithi114.stdout: "complaint_time": 30, 2024-09-12T18:36:36.049 INFO:teuthology.orchestra.run.smithi114.stdout: "num_blocked_ops": 0 2024-09-12T18:36:36.049 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:36.053 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:36.048+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:36.069 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:36:36.154 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:36.151+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:36.223 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:36.223 INFO:teuthology.orchestra.run.smithi114.stdout: "size": 20, 2024-09-12T18:36:36.223 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 600, 2024-09-12T18:36:36.223 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:36:36.224 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.224 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:36.224 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:36.224 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 70.591585979000001, 2024-09-12T18:36:36.224 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.042475618999999999, 2024-09-12T18:36:36.224 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:36.224 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:36.224 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:36.224 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:36.224 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.224 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:36.224 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:36.224 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:36.225 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.225 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.225 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:36.225 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:36.225 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:36.225 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.225 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.225 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:36.225 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628450+0000", 2024-09-12T18:36:36.225 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4212999999999999e-05 2024-09-12T18:36:36.225 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.225 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.225 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:36.226 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628463+0000", 2024-09-12T18:36:36.226 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2497000000000001e-05 2024-09-12T18:36:36.226 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.226 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.226 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:36.226 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628480+0000", 2024-09-12T18:36:36.226 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7232999999999999e-05 2024-09-12T18:36:36.226 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.226 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.226 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:36.226 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628496+0000", 2024-09-12T18:36:36.226 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6217000000000001e-05 2024-09-12T18:36:36.226 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.226 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.227 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:36.227 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628641+0000", 2024-09-12T18:36:36.227 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000144709 2024-09-12T18:36:36.227 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.227 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.227 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:36.227 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628657+0000", 2024-09-12T18:36:36.227 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6266e-05 2024-09-12T18:36:36.227 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.227 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.227 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:36.227 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663103+0000", 2024-09-12T18:36:36.227 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.034445523999999998 2024-09-12T18:36:36.227 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.228 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.228 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:36.228 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663373+0000", 2024-09-12T18:36:36.228 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00027085500000000002 2024-09-12T18:36:36.228 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.228 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.228 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:36.228 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663634+0000", 2024-09-12T18:36:36.228 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000260855 2024-09-12T18:36:36.228 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.228 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.228 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:36.228 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670294+0000", 2024-09-12T18:36:36.229 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0066597599999999998 2024-09-12T18:36:36.229 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.229 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.229 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:36.229 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670705+0000", 2024-09-12T18:36:36.229 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00041057099999999998 2024-09-12T18:36:36.229 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.229 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.229 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:36.229 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670820+0000", 2024-09-12T18:36:36.229 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000115111 2024-09-12T18:36:36.229 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.229 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.230 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:36.230 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670912+0000", 2024-09-12T18:36:36.230 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1807999999999999e-05 2024-09-12T18:36:36.230 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:36.230 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:36.230 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:36.230 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.230 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.230 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:36.230 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:36.230 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 70.591495233000003, 2024-09-12T18:36:36.231 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.044599273000000002, 2024-09-12T18:36:36.231 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:36.231 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:36.231 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:36.231 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:36.231 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.231 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:36.231 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:36.231 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:36.231 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.231 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.231 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:36.231 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:36.231 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:36.232 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.232 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.232 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:36.232 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628528+0000", 2024-09-12T18:36:36.232 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:36.232 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.232 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.232 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:36.232 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628537+0000", 2024-09-12T18:36:36.232 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6969999999999999e-06 2024-09-12T18:36:36.232 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.232 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.232 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:36.233 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628560+0000", 2024-09-12T18:36:36.233 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2889000000000001e-05 2024-09-12T18:36:36.233 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.233 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.233 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:36.233 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628576+0000", 2024-09-12T18:36:36.233 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.649e-05 2024-09-12T18:36:36.233 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.238 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.238 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:36.238 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628846+0000", 2024-09-12T18:36:36.238 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00026952500000000001 2024-09-12T18:36:36.238 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.238 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.238 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:36.238 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628853+0000", 2024-09-12T18:36:36.238 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6559999999999992e-06 2024-09-12T18:36:36.238 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.239 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.239 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:36.239 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665284+0000", 2024-09-12T18:36:36.239 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.036431140000000001 2024-09-12T18:36:36.239 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.239 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.239 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:36.239 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665494+0000", 2024-09-12T18:36:36.239 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000209762 2024-09-12T18:36:36.239 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.239 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.239 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:36.239 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665816+0000", 2024-09-12T18:36:36.239 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00032162299999999999 2024-09-12T18:36:36.240 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.240 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.240 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:36.240 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670382+0000", 2024-09-12T18:36:36.240 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0045656739999999996 2024-09-12T18:36:36.240 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.240 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.240 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:36.240 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.672978+0000", 2024-09-12T18:36:36.240 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.002596068 2024-09-12T18:36:36.240 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.240 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.240 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:36.241 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673058+0000", 2024-09-12T18:36:36.241 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0198999999999996e-05 2024-09-12T18:36:36.241 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.241 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.241 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:36.241 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673126+0000", 2024-09-12T18:36:36.241 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8120000000000005e-05 2024-09-12T18:36:36.241 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:36.241 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:36.241 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:36.241 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.241 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.241 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:23 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:36.241 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:36.242 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 70.591397427000004, 2024-09-12T18:36:36.242 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045539784, 2024-09-12T18:36:36.242 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:36.242 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:36.242 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:36.242 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:36.242 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.242 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:36.242 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:36.242 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:36.242 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.242 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.242 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:36.243 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:36.243 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:36.243 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.243 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.243 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:36.243 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628626+0000", 2024-09-12T18:36:36.243 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.573e-06 2024-09-12T18:36:36.243 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.243 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.243 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:36.243 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628640+0000", 2024-09-12T18:36:36.243 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3817e-05 2024-09-12T18:36:36.243 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.243 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.244 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:36.244 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628659+0000", 2024-09-12T18:36:36.244 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9539999999999999e-05 2024-09-12T18:36:36.244 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.244 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.244 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:36.244 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628675+0000", 2024-09-12T18:36:36.244 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5739e-05 2024-09-12T18:36:36.244 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.244 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.244 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:36.244 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628815+0000", 2024-09-12T18:36:36.244 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014003299999999999 2024-09-12T18:36:36.244 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.245 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.245 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:36.245 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628828+0000", 2024-09-12T18:36:36.245 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2849e-05 2024-09-12T18:36:36.245 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.245 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.245 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:36.245 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651162+0000", 2024-09-12T18:36:36.245 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.022334228000000001 2024-09-12T18:36:36.245 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.245 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.245 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:36.245 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651446+0000", 2024-09-12T18:36:36.246 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00028392800000000002 2024-09-12T18:36:36.246 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.246 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.246 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:36.246 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651746+0000", 2024-09-12T18:36:36.246 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000300091 2024-09-12T18:36:36.246 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.246 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.246 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:36.246 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665113+0000", 2024-09-12T18:36:36.246 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013366678 2024-09-12T18:36:36.246 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.246 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.246 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:36.247 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674010+0000", 2024-09-12T18:36:36.247 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0088970520000000008 2024-09-12T18:36:36.247 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.247 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.247 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:36.247 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674104+0000", 2024-09-12T18:36:36.247 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4124999999999998e-05 2024-09-12T18:36:36.247 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.247 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.247 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:36.247 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674164+0000", 2024-09-12T18:36:36.247 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.0130999999999997e-05 2024-09-12T18:36:36.247 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:36.247 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:36.248 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:36.248 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.248 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.248 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:26 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:36.248 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:36.248 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 70.591324220999994, 2024-09-12T18:36:36.248 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045702136999999997, 2024-09-12T18:36:36.248 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:36.248 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:36.248 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:36.248 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:36.248 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.248 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:36.249 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:36.249 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:36.249 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.249 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.249 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:36.249 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:36.249 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:36.249 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.249 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.249 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:36.249 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628699+0000", 2024-09-12T18:36:36.249 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3859999999999999e-06 2024-09-12T18:36:36.249 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.249 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.250 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:36.250 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628706+0000", 2024-09-12T18:36:36.250 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0169999999999999e-06 2024-09-12T18:36:36.250 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.250 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.250 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:36.250 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628725+0000", 2024-09-12T18:36:36.250 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8683000000000001e-05 2024-09-12T18:36:36.250 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.250 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.250 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:36.250 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628740+0000", 2024-09-12T18:36:36.250 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5413999999999998e-05 2024-09-12T18:36:36.251 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.251 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.251 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:36.251 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628907+0000", 2024-09-12T18:36:36.251 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00016670199999999999 2024-09-12T18:36:36.251 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.251 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.251 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:36.251 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628917+0000", 2024-09-12T18:36:36.252 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.046e-05 2024-09-12T18:36:36.252 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.252 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.252 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:36.252 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.660390+0000", 2024-09-12T18:36:36.252 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.031472364000000003 2024-09-12T18:36:36.252 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.252 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.252 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:36.252 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.661767+0000", 2024-09-12T18:36:36.252 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0013769190000000001 2024-09-12T18:36:36.252 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.252 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.252 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:36.253 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.662408+0000", 2024-09-12T18:36:36.253 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00064091099999999998 2024-09-12T18:36:36.253 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.253 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.253 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:36.253 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669577+0000", 2024-09-12T18:36:36.253 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.007169412 2024-09-12T18:36:36.253 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.253 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.253 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:36.253 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674244+0000", 2024-09-12T18:36:36.253 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0046671839999999996 2024-09-12T18:36:36.253 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.254 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.254 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:36.254 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674329+0000", 2024-09-12T18:36:36.254 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5276000000000001e-05 2024-09-12T18:36:36.254 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.254 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.254 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:36.254 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674400+0000", 2024-09-12T18:36:36.254 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0408999999999996e-05 2024-09-12T18:36:36.254 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:36.254 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:36.254 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:36.254 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.254 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.255 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:36.255 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:36.255 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 70.591216552000006, 2024-09-12T18:36:36.255 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.044572443000000003, 2024-09-12T18:36:36.255 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:36.255 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:36.255 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:36.255 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:36.255 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.255 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:36.255 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:36.255 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:36.255 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.255 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.256 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:36.256 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:36.256 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:36.256 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.256 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.256 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:36.256 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628807+0000", 2024-09-12T18:36:36.256 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3629999999999999e-06 2024-09-12T18:36:36.256 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.256 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.256 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:36.256 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628814+0000", 2024-09-12T18:36:36.256 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.2099999999999996e-06 2024-09-12T18:36:36.257 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.257 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.257 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:36.257 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628832+0000", 2024-09-12T18:36:36.257 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7972999999999999e-05 2024-09-12T18:36:36.257 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.257 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.257 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:36.257 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628854+0000", 2024-09-12T18:36:36.257 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1857000000000001e-05 2024-09-12T18:36:36.257 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.257 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.257 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:36.257 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628984+0000", 2024-09-12T18:36:36.258 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013013599999999999 2024-09-12T18:36:36.258 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.258 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.258 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:36.258 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628993+0000", 2024-09-12T18:36:36.258 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:36:36.258 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.258 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.258 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:36.258 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668176+0000", 2024-09-12T18:36:36.258 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.039182211000000002 2024-09-12T18:36:36.258 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.258 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.258 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:36.259 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668481+0000", 2024-09-12T18:36:36.259 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00030499200000000002 2024-09-12T18:36:36.259 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.259 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.259 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:36.259 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668771+0000", 2024-09-12T18:36:36.259 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00029018700000000002 2024-09-12T18:36:36.259 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.259 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.259 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:36.259 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.672674+0000", 2024-09-12T18:36:36.259 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0039031890000000001 2024-09-12T18:36:36.259 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.259 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.260 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:36.260 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673214+0000", 2024-09-12T18:36:36.260 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00053981600000000004 2024-09-12T18:36:36.260 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.260 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.260 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:36.260 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673310+0000", 2024-09-12T18:36:36.260 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.6682999999999996e-05 2024-09-12T18:36:36.260 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.260 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.260 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:36.260 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673378+0000", 2024-09-12T18:36:36.260 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7385999999999995e-05 2024-09-12T18:36:36.261 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:36.261 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:36.261 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:36.261 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.261 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.261 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:36.261 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:36.261 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 70.591080525999999, 2024-09-12T18:36:36.261 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.041480853999999998, 2024-09-12T18:36:36.261 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:36.261 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:36.261 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:36.261 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:36.261 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.262 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:36.262 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:36.262 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:36.262 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.262 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.262 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:36.262 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:36.262 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:36.262 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.262 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.262 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:36.262 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628943+0000", 2024-09-12T18:36:36.262 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.403e-06 2024-09-12T18:36:36.262 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.263 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.263 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:36.263 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628953+0000", 2024-09-12T18:36:36.263 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0273e-05 2024-09-12T18:36:36.263 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.263 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.263 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:36.263 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628973+0000", 2024-09-12T18:36:36.263 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9959999999999999e-05 2024-09-12T18:36:36.263 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.263 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.263 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:36.263 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628989+0000", 2024-09-12T18:36:36.263 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6447e-05 2024-09-12T18:36:36.264 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.264 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.264 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:36.264 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629144+0000", 2024-09-12T18:36:36.264 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015468900000000001 2024-09-12T18:36:36.264 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.264 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.264 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:36.264 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629162+0000", 2024-09-12T18:36:36.264 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7603000000000001e-05 2024-09-12T18:36:36.264 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.264 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.264 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:36.265 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.646927+0000", 2024-09-12T18:36:36.265 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.017765626 2024-09-12T18:36:36.265 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.265 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.265 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:36.265 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.647245+0000", 2024-09-12T18:36:36.265 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00031797699999999999 2024-09-12T18:36:36.265 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.265 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.265 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:36.265 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.647551+0000", 2024-09-12T18:36:36.265 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00030583500000000002 2024-09-12T18:36:36.265 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.265 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.266 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:36.266 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651738+0000", 2024-09-12T18:36:36.266 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0041864980000000003 2024-09-12T18:36:36.266 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.266 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.266 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:36.266 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670207+0000", 2024-09-12T18:36:36.266 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018469299000000002 2024-09-12T18:36:36.266 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.266 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.266 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:36.266 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670330+0000", 2024-09-12T18:36:36.266 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012284500000000001 2024-09-12T18:36:36.266 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.267 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.267 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:36.267 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670422+0000", 2024-09-12T18:36:36.267 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2398999999999994e-05 2024-09-12T18:36:36.267 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:36.267 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:36.267 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:36.267 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.267 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.267 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:36.267 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:36.267 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 70.591003272999998, 2024-09-12T18:36:36.267 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.041623741999999998, 2024-09-12T18:36:36.268 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:36.268 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:36.268 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:36.268 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:36.268 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.268 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:36.268 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:36.268 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:36.268 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.268 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.268 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:36.268 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:36.268 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:36.268 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.269 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.269 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:36.269 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629020+0000", 2024-09-12T18:36:36.269 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.15e-06 2024-09-12T18:36:36.269 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.269 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.269 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:36.269 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629023+0000", 2024-09-12T18:36:36.269 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4659999999999999e-06 2024-09-12T18:36:36.269 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.269 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.269 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:36.269 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629037+0000", 2024-09-12T18:36:36.270 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3857e-05 2024-09-12T18:36:36.270 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.270 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.270 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:36.270 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629062+0000", 2024-09-12T18:36:36.270 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4519999999999999e-05 2024-09-12T18:36:36.270 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.270 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.270 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:36.270 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629253+0000", 2024-09-12T18:36:36.270 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000191335 2024-09-12T18:36:36.270 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.270 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.270 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:36.271 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629266+0000", 2024-09-12T18:36:36.271 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3322999999999999e-05 2024-09-12T18:36:36.271 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.271 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.271 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:36.271 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648331+0000", 2024-09-12T18:36:36.271 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.019065060000000002 2024-09-12T18:36:36.271 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.271 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.271 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:36.271 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.650044+0000", 2024-09-12T18:36:36.271 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017123959999999999 2024-09-12T18:36:36.271 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.272 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.272 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:36.272 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670642+0000", 2024-09-12T18:36:36.272 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.020598635000000001 2024-09-12T18:36:36.272 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:36.272 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:36.272 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:36.272 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.272 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.272 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:36.272 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:36.272 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 70.590899941000004, 2024-09-12T18:36:36.272 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.046431252999999999, 2024-09-12T18:36:36.273 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:36.273 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:36.273 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:36.273 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:36.273 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.273 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:36.273 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:36.273 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:36.273 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.273 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.273 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:36.273 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:36.273 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:36.273 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.274 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.274 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:36.274 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629123+0000", 2024-09-12T18:36:36.274 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0899999999999999e-06 2024-09-12T18:36:36.274 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.274 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.274 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:36.274 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629138+0000", 2024-09-12T18:36:36.274 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4977000000000001e-05 2024-09-12T18:36:36.274 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.274 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.274 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:36.274 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629149+0000", 2024-09-12T18:36:36.275 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1182999999999999e-05 2024-09-12T18:36:36.275 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.275 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.275 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:36.275 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629157+0000", 2024-09-12T18:36:36.275 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8129999999999996e-06 2024-09-12T18:36:36.275 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.275 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.275 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:36.275 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629223+0000", 2024-09-12T18:36:36.275 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6463000000000004e-05 2024-09-12T18:36:36.275 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.275 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.276 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:36.276 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629230+0000", 2024-09-12T18:36:36.276 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1360000000000002e-06 2024-09-12T18:36:36.276 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.276 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.276 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:36.276 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669605+0000", 2024-09-12T18:36:36.276 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.040375518999999999 2024-09-12T18:36:36.276 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.276 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.276 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:36.276 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669840+0000", 2024-09-12T18:36:36.276 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00023520099999999999 2024-09-12T18:36:36.276 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.277 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.277 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:36.277 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.675553+0000", 2024-09-12T18:36:36.277 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0057128709999999996 2024-09-12T18:36:36.277 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:36.277 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:36.277 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:36.277 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.277 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.277 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:36.277 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:36.277 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 70.590845274000003, 2024-09-12T18:36:36.277 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.037357044999999998, 2024-09-12T18:36:36.278 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:36.278 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:36.278 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:36.278 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:36.278 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.278 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:36.278 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:36.278 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:36.278 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.278 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.278 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:36.278 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:36.278 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:36.279 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.279 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.279 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:36.279 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629178+0000", 2024-09-12T18:36:36.279 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.08e-06 2024-09-12T18:36:36.279 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.279 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.279 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:36.279 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629194+0000", 2024-09-12T18:36:36.279 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5899000000000001e-05 2024-09-12T18:36:36.279 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.279 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.279 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:36.279 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629211+0000", 2024-09-12T18:36:36.280 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7363e-05 2024-09-12T18:36:36.280 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.280 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.280 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:36.280 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629226+0000", 2024-09-12T18:36:36.280 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4567e-05 2024-09-12T18:36:36.280 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.280 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.280 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:36.280 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629299+0000", 2024-09-12T18:36:36.280 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3910000000000002e-05 2024-09-12T18:36:36.280 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.280 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.280 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:36.281 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629307+0000", 2024-09-12T18:36:36.281 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5299999999999999e-06 2024-09-12T18:36:36.281 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.281 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.281 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:36.281 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648185+0000", 2024-09-12T18:36:36.281 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018878533999999999 2024-09-12T18:36:36.281 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.281 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.281 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:36.281 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.649724+0000", 2024-09-12T18:36:36.281 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001538841 2024-09-12T18:36:36.281 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.281 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.282 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:36.282 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.666534+0000", 2024-09-12T18:36:36.282 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.016809320999999999 2024-09-12T18:36:36.282 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:36.282 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:36.282 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:36.282 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.282 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.282 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:77251 5.3 5:c0b45ab3:::benchmark_data_smithi073_23739_object77250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:36.282 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:16.796319+0000", 2024-09-12T18:36:36.282 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 19.423702488, 2024-09-12T18:36:36.282 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018653991000000002, 2024-09-12T18:36:36.282 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:36.283 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:36.283 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:36.283 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:36.283 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:36.283 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:36.283 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 77251 2024-09-12T18:36:36.283 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.283 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:36.283 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.283 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:36.283 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.796319+0000", 2024-09-12T18:36:36.283 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:36.283 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.283 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.284 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:36.284 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.796319+0000", 2024-09-12T18:36:36.284 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:36.284 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.284 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.284 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:36.284 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.796320+0000", 2024-09-12T18:36:36.284 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1100000000000005e-07 2024-09-12T18:36:36.284 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.284 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.284 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:36.284 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.796353+0000", 2024-09-12T18:36:36.284 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3043000000000002e-05 2024-09-12T18:36:36.284 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.285 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.285 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:36.285 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.796361+0000", 2024-09-12T18:36:36.285 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3989999999999998e-06 2024-09-12T18:36:36.285 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.285 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.285 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:36.285 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.796367+0000", 2024-09-12T18:36:36.285 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9950000000000002e-06 2024-09-12T18:36:36.285 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.285 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.285 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:36.285 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.800568+0000", 2024-09-12T18:36:36.286 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0042010709999999998 2024-09-12T18:36:36.286 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.286 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.286 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:36.286 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.800679+0000", 2024-09-12T18:36:36.286 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000111119 2024-09-12T18:36:36.286 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.286 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.286 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:36.286 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.800802+0000", 2024-09-12T18:36:36.286 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000123418 2024-09-12T18:36:36.286 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.286 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.286 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:36.287 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.805536+0000", 2024-09-12T18:36:36.287 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0047341309999999999 2024-09-12T18:36:36.287 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.287 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.287 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:36.287 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.814921+0000", 2024-09-12T18:36:36.287 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0093849680000000005 2024-09-12T18:36:36.287 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.287 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.287 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:36.287 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.814951+0000", 2024-09-12T18:36:36.287 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.9189000000000001e-05 2024-09-12T18:36:36.287 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.287 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.288 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:36.288 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.814973+0000", 2024-09-12T18:36:36.288 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2847e-05 2024-09-12T18:36:36.288 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:36.288 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:36.288 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:36.288 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.288 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.288 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:80960 5.a 5:5d86791e:::benchmark_data_smithi073_23739_object80959:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T18:36:36.288 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:18.558199+0000", 2024-09-12T18:36:36.288 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 17.66182336, 2024-09-12T18:36:36.288 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.019912458000000001, 2024-09-12T18:36:36.288 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:36.288 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:36.289 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:36.289 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:36.289 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:36.289 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:36.289 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 80960 2024-09-12T18:36:36.289 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.289 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:36.289 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.289 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:36.289 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558199+0000", 2024-09-12T18:36:36.289 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:36.289 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.289 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.289 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:36.290 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558199+0000", 2024-09-12T18:36:36.290 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:36.290 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.290 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.290 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:36.290 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558199+0000", 2024-09-12T18:36:36.290 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2999999999999999e-07 2024-09-12T18:36:36.290 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.290 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.290 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:36.290 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558255+0000", 2024-09-12T18:36:36.290 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5930999999999997e-05 2024-09-12T18:36:36.290 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.290 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.291 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:36.291 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558263+0000", 2024-09-12T18:36:36.291 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1450000000000008e-06 2024-09-12T18:36:36.291 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.291 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.291 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:36.291 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558272+0000", 2024-09-12T18:36:36.291 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2050000000000002e-06 2024-09-12T18:36:36.291 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.291 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.291 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:36.291 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558334+0000", 2024-09-12T18:36:36.291 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2481e-05 2024-09-12T18:36:36.292 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.292 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.292 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:36.292 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558425+0000", 2024-09-12T18:36:36.292 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1355999999999997e-05 2024-09-12T18:36:36.292 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.292 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.292 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:36.292 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558535+0000", 2024-09-12T18:36:36.292 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00010997699999999999 2024-09-12T18:36:36.292 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.292 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.292 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:36.293 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.569795+0000", 2024-09-12T18:36:36.293 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011260020000000001 2024-09-12T18:36:36.293 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.293 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.293 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:36.293 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.578026+0000", 2024-09-12T18:36:36.293 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0082307100000000005 2024-09-12T18:36:36.293 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.293 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.293 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:36.293 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.578072+0000", 2024-09-12T18:36:36.293 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.6291000000000001e-05 2024-09-12T18:36:36.293 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.294 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.294 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:36.294 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.578111+0000", 2024-09-12T18:36:36.294 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8512e-05 2024-09-12T18:36:36.294 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:36.294 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:36.294 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:36.294 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.294 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.294 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:80967 5.a 5:5f4000f6:::benchmark_data_smithi073_23739_object80966:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T18:36:36.294 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:18.561016+0000", 2024-09-12T18:36:36.295 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 17.659005679, 2024-09-12T18:36:36.295 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021780831, 2024-09-12T18:36:36.295 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:36.295 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:36.295 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:36.295 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:36.295 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:36.295 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:36.295 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 80967 2024-09-12T18:36:36.295 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.295 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:36.295 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.295 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:36.296 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561016+0000", 2024-09-12T18:36:36.296 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:36.296 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.296 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.296 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:36.296 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561016+0000", 2024-09-12T18:36:36.296 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:36.296 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.297 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.297 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:36.297 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561017+0000", 2024-09-12T18:36:36.297 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7599999999999997e-07 2024-09-12T18:36:36.297 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.297 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.297 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:36.297 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561050+0000", 2024-09-12T18:36:36.297 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3524e-05 2024-09-12T18:36:36.297 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.297 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.297 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:36.297 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561058+0000", 2024-09-12T18:36:36.297 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0679999999999997e-06 2024-09-12T18:36:36.298 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.298 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.298 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:36.298 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561065+0000", 2024-09-12T18:36:36.298 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1990000000000003e-06 2024-09-12T18:36:36.298 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.298 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.298 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:36.298 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564735+0000", 2024-09-12T18:36:36.298 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0036706740000000001 2024-09-12T18:36:36.298 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.298 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.298 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:36.298 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564868+0000", 2024-09-12T18:36:36.299 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000133003 2024-09-12T18:36:36.299 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.299 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.299 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:36.299 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.565010+0000", 2024-09-12T18:36:36.299 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014224300000000001 2024-09-12T18:36:36.299 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.299 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.299 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:36.299 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.569871+0000", 2024-09-12T18:36:36.299 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0048600759999999996 2024-09-12T18:36:36.299 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.299 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.300 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:36.300 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.582729+0000", 2024-09-12T18:36:36.300 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012858090000000001 2024-09-12T18:36:36.300 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.300 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.300 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:36.300 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.582758+0000", 2024-09-12T18:36:36.300 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.9762999999999999e-05 2024-09-12T18:36:36.300 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.300 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.300 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:36.300 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.582797+0000", 2024-09-12T18:36:36.300 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8615000000000002e-05 2024-09-12T18:36:36.301 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:36.301 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:36.301 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:36.301 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.301 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.301 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:80971 5.2 e39/21 5:4205ebb1:::benchmark_data_smithi073_23739_object80970:head v 39'5054, mlcod=39'5052)", 2024-09-12T18:36:36.301 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:18.564320+0000", 2024-09-12T18:36:36.301 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 17.655701713999999, 2024-09-12T18:36:36.301 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.019963669999999999, 2024-09-12T18:36:36.301 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:36.301 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:36.301 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:36.301 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:36.301 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.302 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:36.302 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564320+0000", 2024-09-12T18:36:36.302 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:36.302 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.302 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.302 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:36.302 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564320+0000", 2024-09-12T18:36:36.302 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:36.302 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.302 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.302 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:36.302 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564321+0000", 2024-09-12T18:36:36.302 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.77e-07 2024-09-12T18:36:36.302 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.303 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.303 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:36.303 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564418+0000", 2024-09-12T18:36:36.303 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.7602000000000005e-05 2024-09-12T18:36:36.303 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.303 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.303 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:36.303 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564427+0000", 2024-09-12T18:36:36.303 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7439999999999996e-06 2024-09-12T18:36:36.303 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.303 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.303 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:36.303 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564442+0000", 2024-09-12T18:36:36.303 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5353e-05 2024-09-12T18:36:36.304 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.304 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.304 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:36.304 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.569512+0000", 2024-09-12T18:36:36.304 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0050701840000000001 2024-09-12T18:36:36.304 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.304 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.304 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:36.304 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.569531+0000", 2024-09-12T18:36:36.304 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8311000000000001e-05 2024-09-12T18:36:36.304 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.304 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.304 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:36.305 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.584246+0000", 2024-09-12T18:36:36.305 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.014714947000000001 2024-09-12T18:36:36.305 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.305 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.305 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:36.305 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.584284+0000", 2024-09-12T18:36:36.305 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8152000000000003e-05 2024-09-12T18:36:36.305 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:36.305 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:36.305 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:36.305 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.305 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.305 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:95657 5.6 5:60d5bc5b:::benchmark_data_smithi073_23739_object95656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:36:36.305 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:25.760171+0000", 2024-09-12T18:36:36.306 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 10.459850524, 2024-09-12T18:36:36.306 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018096398999999999, 2024-09-12T18:36:36.306 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:36.306 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:36.306 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:36.306 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:36.306 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:36.306 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:36.306 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 95657 2024-09-12T18:36:36.306 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.306 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:36.306 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.306 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:36.307 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.760171+0000", 2024-09-12T18:36:36.307 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:36.307 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.307 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.307 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:36.307 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.760171+0000", 2024-09-12T18:36:36.307 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:36.307 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.307 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.307 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:36.307 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.760172+0000", 2024-09-12T18:36:36.307 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4600000000000003e-07 2024-09-12T18:36:36.307 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.307 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.308 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:36.308 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.760226+0000", 2024-09-12T18:36:36.308 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.3359999999999997e-05 2024-09-12T18:36:36.308 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.308 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.308 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:36.308 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.760234+0000", 2024-09-12T18:36:36.308 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.4950000000000008e-06 2024-09-12T18:36:36.308 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.308 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.308 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:36.308 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.760240+0000", 2024-09-12T18:36:36.308 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.801e-06 2024-09-12T18:36:36.309 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.309 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.309 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:36.309 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.770465+0000", 2024-09-12T18:36:36.309 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.010224878999999999 2024-09-12T18:36:36.309 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.309 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.309 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:36.309 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.770584+0000", 2024-09-12T18:36:36.309 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000119276 2024-09-12T18:36:36.309 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.309 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.309 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:36.309 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.770735+0000", 2024-09-12T18:36:36.310 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000150994 2024-09-12T18:36:36.310 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.310 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.310 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:36.310 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.775049+0000", 2024-09-12T18:36:36.310 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0043141209999999998 2024-09-12T18:36:36.310 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.310 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.310 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:36.310 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.778195+0000", 2024-09-12T18:36:36.310 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.003145414 2024-09-12T18:36:36.310 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.310 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.310 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:36.311 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.778229+0000", 2024-09-12T18:36:36.311 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4474000000000002e-05 2024-09-12T18:36:36.311 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.311 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.311 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:36.311 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.778268+0000", 2024-09-12T18:36:36.311 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8639000000000001e-05 2024-09-12T18:36:36.311 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:36.311 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:36.311 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:36.311 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.311 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.311 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:96980 5.c 5:314954af:::benchmark_data_smithi073_23739_object96979:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:36:36.311 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:26.406647+0000", 2024-09-12T18:36:36.312 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 9.8133753489999993, 2024-09-12T18:36:36.312 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018505462, 2024-09-12T18:36:36.312 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:36.312 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:36.312 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:36.312 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:36.312 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:36.312 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:36.312 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 96980 2024-09-12T18:36:36.312 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.312 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:36.312 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.312 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:36.312 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.406647+0000", 2024-09-12T18:36:36.313 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:36.313 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.313 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.313 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:36.313 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.406647+0000", 2024-09-12T18:36:36.313 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:36.313 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.313 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.313 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:36.313 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.406647+0000", 2024-09-12T18:36:36.313 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4000000000000002e-07 2024-09-12T18:36:36.313 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.313 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.314 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:36.314 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.406705+0000", 2024-09-12T18:36:36.314 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7685000000000001e-05 2024-09-12T18:36:36.314 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.314 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.314 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:36.314 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.406712+0000", 2024-09-12T18:36:36.314 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8120000000000002e-06 2024-09-12T18:36:36.314 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.314 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.314 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:36.314 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.406715+0000", 2024-09-12T18:36:36.314 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.6550000000000002e-06 2024-09-12T18:36:36.314 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.315 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.315 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:36.315 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.417564+0000", 2024-09-12T18:36:36.315 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.010849187999999999 2024-09-12T18:36:36.315 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.315 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.315 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:36.315 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.417648+0000", 2024-09-12T18:36:36.315 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.3924999999999994e-05 2024-09-12T18:36:36.315 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.315 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.315 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:36.315 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.417730+0000", 2024-09-12T18:36:36.315 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2016999999999998e-05 2024-09-12T18:36:36.316 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.316 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.316 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:36.316 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.422225+0000", 2024-09-12T18:36:36.316 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0044943149999999996 2024-09-12T18:36:36.316 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.316 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.316 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:36.317 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.425021+0000", 2024-09-12T18:36:36.317 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0027962479999999999 2024-09-12T18:36:36.317 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.317 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.317 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:36.317 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.425110+0000", 2024-09-12T18:36:36.317 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.8834999999999999e-05 2024-09-12T18:36:36.317 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.317 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.317 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:36.317 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.425152+0000", 2024-09-12T18:36:36.317 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2242e-05 2024-09-12T18:36:36.317 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:36.317 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:36.318 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:36.318 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.318 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.318 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:99505 5.c 5:358150bc:::benchmark_data_smithi073_23739_object99504:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:36:36.318 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:27.620043+0000", 2024-09-12T18:36:36.318 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 8.5999793130000004, 2024-09-12T18:36:36.318 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.019666044000000001, 2024-09-12T18:36:36.318 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:36.318 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:36.318 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:36.318 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:36.318 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:36.318 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:36.318 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 99505 2024-09-12T18:36:36.319 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.319 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:36.319 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.319 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:36.319 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:27.620043+0000", 2024-09-12T18:36:36.319 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:36.319 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.319 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.319 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:36.319 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:27.620043+0000", 2024-09-12T18:36:36.319 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:36.319 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.319 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.319 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:36.320 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:27.620043+0000", 2024-09-12T18:36:36.320 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5200000000000002e-07 2024-09-12T18:36:36.320 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.320 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.320 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:36.320 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:27.620078+0000", 2024-09-12T18:36:36.320 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.5305000000000002e-05 2024-09-12T18:36:36.320 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.320 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.320 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:36.320 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:27.620085+0000", 2024-09-12T18:36:36.320 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3829999999999997e-06 2024-09-12T18:36:36.320 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.321 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.321 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:36.321 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:27.620090+0000", 2024-09-12T18:36:36.321 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4480000000000002e-06 2024-09-12T18:36:36.321 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.321 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.321 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:36.321 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:27.625971+0000", 2024-09-12T18:36:36.321 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0058812220000000002 2024-09-12T18:36:36.321 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.321 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.321 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:36.321 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:27.626101+0000", 2024-09-12T18:36:36.321 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012965900000000001 2024-09-12T18:36:36.322 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.322 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.322 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:36.322 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:27.626181+0000", 2024-09-12T18:36:36.322 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0408000000000007e-05 2024-09-12T18:36:36.322 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.322 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.322 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:36.322 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:27.632280+0000", 2024-09-12T18:36:36.322 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0060989979999999996 2024-09-12T18:36:36.322 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.322 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.322 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:36.322 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:27.639625+0000", 2024-09-12T18:36:36.323 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0073445810000000002 2024-09-12T18:36:36.323 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.323 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.323 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:36.323 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:27.639671+0000", 2024-09-12T18:36:36.323 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5902999999999997e-05 2024-09-12T18:36:36.323 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.323 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.323 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:36.323 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:27.639709+0000", 2024-09-12T18:36:36.323 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.7685000000000003e-05 2024-09-12T18:36:36.323 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:36.323 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:36.323 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:36.324 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.324 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.324 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:105754 5.a 5:56dab506:::benchmark_data_smithi073_23739_object105753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:36:36.324 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:30.686671+0000", 2024-09-12T18:36:36.324 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 5.5333512149999997, 2024-09-12T18:36:36.324 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018673453999999999, 2024-09-12T18:36:36.324 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:36.324 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:36.324 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:36.324 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:36.324 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:36.324 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:36.324 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 105754 2024-09-12T18:36:36.325 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.325 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:36.325 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.325 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:36.325 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:30.686671+0000", 2024-09-12T18:36:36.325 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:36.325 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.325 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.325 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:36.325 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:30.686671+0000", 2024-09-12T18:36:36.325 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:36.325 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.325 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.325 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:36.326 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:30.686671+0000", 2024-09-12T18:36:36.326 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2699999999999999e-07 2024-09-12T18:36:36.326 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.326 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.326 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:36.326 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:30.686695+0000", 2024-09-12T18:36:36.326 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.37e-05 2024-09-12T18:36:36.326 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.326 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.326 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:36.326 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:30.686702+0000", 2024-09-12T18:36:36.326 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0899999999999999e-06 2024-09-12T18:36:36.326 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.326 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.327 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:36.327 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:30.686707+0000", 2024-09-12T18:36:36.327 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0000000000000004e-06 2024-09-12T18:36:36.327 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.327 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.327 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:36.327 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:30.695226+0000", 2024-09-12T18:36:36.327 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0085186540000000005 2024-09-12T18:36:36.327 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.327 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.327 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:36.327 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:30.695362+0000", 2024-09-12T18:36:36.327 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013635200000000001 2024-09-12T18:36:36.327 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.328 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.328 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:36.328 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:30.695511+0000", 2024-09-12T18:36:36.328 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0001485 2024-09-12T18:36:36.328 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.328 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.328 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:36.328 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:30.701241+0000", 2024-09-12T18:36:36.328 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0057303060000000001 2024-09-12T18:36:36.328 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.328 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.328 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:36.328 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:30.705277+0000", 2024-09-12T18:36:36.328 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0040362879999999999 2024-09-12T18:36:36.329 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.329 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.329 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:36.329 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:30.705306+0000", 2024-09-12T18:36:36.329 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.8779999999999999e-05 2024-09-12T18:36:36.329 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.329 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.329 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:36.329 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:30.705344+0000", 2024-09-12T18:36:36.329 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8157000000000001e-05 2024-09-12T18:36:36.329 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:36.329 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:36.329 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:36.329 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.330 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.330 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:108511 5.6 5:608a30a3:::benchmark_data_smithi073_23739_object108510:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:36:36.330 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:31.986730+0000", 2024-09-12T18:36:36.330 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4.2332918050000004, 2024-09-12T18:36:36.330 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021507117999999999, 2024-09-12T18:36:36.330 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:36.330 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:36.330 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:36.330 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:36.330 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:36.330 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:36.330 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 108511 2024-09-12T18:36:36.330 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.330 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:36.331 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.331 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:36.331 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986730+0000", 2024-09-12T18:36:36.331 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:36.331 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.331 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.331 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:36.331 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986730+0000", 2024-09-12T18:36:36.331 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:36.331 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.331 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.331 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:36.331 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986731+0000", 2024-09-12T18:36:36.331 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.9100000000000003e-07 2024-09-12T18:36:36.332 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.332 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.332 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:36.332 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986804+0000", 2024-09-12T18:36:36.332 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3647999999999997e-05 2024-09-12T18:36:36.332 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.332 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.332 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:36.332 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986812+0000", 2024-09-12T18:36:36.332 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.34e-06 2024-09-12T18:36:36.332 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.332 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.332 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:36.332 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986836+0000", 2024-09-12T18:36:36.333 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4213e-05 2024-09-12T18:36:36.333 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.333 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.333 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:36.333 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.997047+0000", 2024-09-12T18:36:36.333 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.010210649 2024-09-12T18:36:36.333 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.333 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.333 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:36.333 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.997169+0000", 2024-09-12T18:36:36.333 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012269700000000001 2024-09-12T18:36:36.333 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.333 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.333 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:36.334 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.997300+0000", 2024-09-12T18:36:36.334 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000130858 2024-09-12T18:36:36.334 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.334 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.334 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:36.334 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.002398+0000", 2024-09-12T18:36:36.334 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0050981580000000002 2024-09-12T18:36:36.334 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.334 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.334 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:36.334 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.008093+0000", 2024-09-12T18:36:36.334 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0056941930000000002 2024-09-12T18:36:36.334 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.334 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.335 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:36.335 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.008151+0000", 2024-09-12T18:36:36.335 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8328999999999997e-05 2024-09-12T18:36:36.335 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.335 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.335 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:36.335 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.008237+0000", 2024-09-12T18:36:36.335 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6341999999999994e-05 2024-09-12T18:36:36.335 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:36.335 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:36.335 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:36.335 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.335 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.335 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:108623 5.c 5:33792cd3:::benchmark_data_smithi073_23739_object108622:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:36:36.336 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:32.046609+0000", 2024-09-12T18:36:36.336 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4.1734130289999998, 2024-09-12T18:36:36.336 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021062860999999999, 2024-09-12T18:36:36.336 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:36.336 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:36.336 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:36.336 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:36.336 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:36.336 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:36.336 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 108623 2024-09-12T18:36:36.336 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.336 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:36.336 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.337 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:36.337 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.046609+0000", 2024-09-12T18:36:36.337 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:36.337 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.337 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.337 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:36.337 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.046609+0000", 2024-09-12T18:36:36.337 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:36.337 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.337 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.337 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:36.337 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.046609+0000", 2024-09-12T18:36:36.337 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.37e-07 2024-09-12T18:36:36.337 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.338 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.338 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:36.338 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.046690+0000", 2024-09-12T18:36:36.338 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0212999999999999e-05 2024-09-12T18:36:36.338 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.338 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.338 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:36.339 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.046698+0000", 2024-09-12T18:36:36.339 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6430000000000001e-06 2024-09-12T18:36:36.339 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.339 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.339 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:36.339 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.046704+0000", 2024-09-12T18:36:36.339 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7699999999999998e-06 2024-09-12T18:36:36.339 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.339 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.339 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:36.339 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.056808+0000", 2024-09-12T18:36:36.339 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.010103562999999999 2024-09-12T18:36:36.339 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.339 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.340 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:36.340 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.056989+0000", 2024-09-12T18:36:36.340 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000181196 2024-09-12T18:36:36.340 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.340 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.340 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:36.340 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.057162+0000", 2024-09-12T18:36:36.340 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000173396 2024-09-12T18:36:36.340 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.340 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.340 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:36.340 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.063269+0000", 2024-09-12T18:36:36.340 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0061066100000000002 2024-09-12T18:36:36.341 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.341 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.341 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:36.341 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.067578+0000", 2024-09-12T18:36:36.341 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0043092570000000004 2024-09-12T18:36:36.341 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.341 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.341 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:36.341 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.067628+0000", 2024-09-12T18:36:36.341 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0136999999999998e-05 2024-09-12T18:36:36.341 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.341 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.341 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:36.341 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.067672+0000", 2024-09-12T18:36:36.342 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3439000000000002e-05 2024-09-12T18:36:36.342 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:36.342 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:36.342 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:36.342 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.342 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.342 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:115360 5.c 5:3eab790c:::benchmark_data_smithi073_23739_object115359:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:36:36.342 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:35.325499+0000", 2024-09-12T18:36:36.342 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.89452310499999999, 2024-09-12T18:36:36.342 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.020147082, 2024-09-12T18:36:36.342 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:36.342 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:36.342 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:36.343 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:36.343 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:36.343 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:36.343 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 115360 2024-09-12T18:36:36.343 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.343 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:36.343 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.343 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:36.343 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.325499+0000", 2024-09-12T18:36:36.343 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:36.343 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.343 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.343 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:36.343 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.325499+0000", 2024-09-12T18:36:36.344 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:36.344 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.344 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.344 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:36.344 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.325500+0000", 2024-09-12T18:36:36.344 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.9999999999999996e-07 2024-09-12T18:36:36.344 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.344 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.344 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:36.344 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.325556+0000", 2024-09-12T18:36:36.344 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6665e-05 2024-09-12T18:36:36.344 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.344 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.344 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:36.345 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.325568+0000", 2024-09-12T18:36:36.345 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1311000000000001e-05 2024-09-12T18:36:36.345 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.345 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.345 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:36.345 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.325575+0000", 2024-09-12T18:36:36.345 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.7649999999999993e-06 2024-09-12T18:36:36.345 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.345 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.345 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:36.345 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.327911+0000", 2024-09-12T18:36:36.345 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0023351359999999998 2024-09-12T18:36:36.345 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.345 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.346 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:36.346 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.328046+0000", 2024-09-12T18:36:36.346 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000135444 2024-09-12T18:36:36.346 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.346 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.346 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:36.346 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.328173+0000", 2024-09-12T18:36:36.346 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012734199999999999 2024-09-12T18:36:36.346 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.346 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.346 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:36.346 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.332254+0000", 2024-09-12T18:36:36.346 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0040805320000000004 2024-09-12T18:36:36.346 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.347 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.347 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:36.347 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.345519+0000", 2024-09-12T18:36:36.347 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013265403 2024-09-12T18:36:36.347 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.347 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.347 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:36.347 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.345583+0000", 2024-09-12T18:36:36.347 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3545000000000002e-05 2024-09-12T18:36:36.347 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:36.347 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:36.347 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:36.347 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.345646+0000", 2024-09-12T18:36:36.347 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3039000000000004e-05 2024-09-12T18:36:36.348 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:36.348 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:36.348 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:36.348 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:36.348 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:36.348 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:36.349 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:36:36.350 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:36.343+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:36.450 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:36.448+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:36.508 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:36.508 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:36:36.508 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.509 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:117787 5.8 5:1d9a6fe9:::benchmark_data_smithi073_23739_object117786:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T18:36:36.509 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:36.503017+0000", 2024-09-12T18:36:36.509 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0040463000000000001, 2024-09-12T18:36:36.509 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0040728520000000001, 2024-09-12T18:36:36.509 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:36.509 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:36.509 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:36.509 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:36.509 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:36.509 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:36.509 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 117787 2024-09-12T18:36:36.510 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.510 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:36.510 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.510 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:36.510 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.503017+0000", 2024-09-12T18:36:36.510 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:36.510 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.510 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.510 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:36.510 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.503017+0000", 2024-09-12T18:36:36.510 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:36.510 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.510 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.510 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:36.511 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.503018+0000", 2024-09-12T18:36:36.511 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1480000000000001e-06 2024-09-12T18:36:36.511 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.511 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.511 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:36.511 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.503199+0000", 2024-09-12T18:36:36.511 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00018125300000000001 2024-09-12T18:36:36.511 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.512 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.512 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:36.512 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.503209+0000", 2024-09-12T18:36:36.513 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5759999999999995e-06 2024-09-12T18:36:36.513 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.513 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.513 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:36.513 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.503215+0000", 2024-09-12T18:36:36.513 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.9939999999999997e-06 2024-09-12T18:36:36.513 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.513 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.513 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:36.513 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.503272+0000", 2024-09-12T18:36:36.513 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6653000000000001e-05 2024-09-12T18:36:36.513 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.513 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.514 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:36.514 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.503409+0000", 2024-09-12T18:36:36.514 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013703200000000001 2024-09-12T18:36:36.514 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.514 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.514 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:36.514 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.503626+0000", 2024-09-12T18:36:36.514 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021752699999999999 2024-09-12T18:36:36.514 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:36.514 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:36.514 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:36.514 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.515 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.515 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:117790 5.e 5:7c29b9a5:::benchmark_data_smithi073_23739_object117789:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T18:36:36.515 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:36.503228+0000", 2024-09-12T18:36:36.515 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0038348309999999999, 2024-09-12T18:36:36.515 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0039331799999999997, 2024-09-12T18:36:36.515 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:36.515 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:36.515 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:36.515 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:36.515 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:36.515 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:36.515 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 117790 2024-09-12T18:36:36.515 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.515 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:36.516 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.516 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:36.516 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.503228+0000", 2024-09-12T18:36:36.516 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:36.516 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.516 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.516 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:36.516 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.503228+0000", 2024-09-12T18:36:36.516 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:36.516 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.516 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.517 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:36.517 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.503229+0000", 2024-09-12T18:36:36.517 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5600000000000001e-07 2024-09-12T18:36:36.517 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.517 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.517 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:36.517 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.503270+0000", 2024-09-12T18:36:36.517 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1165000000000003e-05 2024-09-12T18:36:36.517 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.517 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.517 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:36.517 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.503275+0000", 2024-09-12T18:36:36.518 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2939999999999996e-06 2024-09-12T18:36:36.518 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.518 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.518 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:36.518 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.503279+0000", 2024-09-12T18:36:36.518 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9079999999999997e-06 2024-09-12T18:36:36.518 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.518 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.518 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:36.518 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.503324+0000", 2024-09-12T18:36:36.518 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5244000000000003e-05 2024-09-12T18:36:36.518 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.518 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.519 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:36.519 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.503555+0000", 2024-09-12T18:36:36.519 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000230452 2024-09-12T18:36:36.519 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.519 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.519 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:36.519 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.503652+0000", 2024-09-12T18:36:36.519 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.7413999999999999e-05 2024-09-12T18:36:36.519 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:36.519 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:36.519 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:36.519 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.519 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.520 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:117791 5.8 5:16bc1880:::benchmark_data_smithi073_23739_object117790:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T18:36:36.520 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:36.503382+0000", 2024-09-12T18:36:36.520 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0036813760000000001, 2024-09-12T18:36:36.520 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0038432589999999999, 2024-09-12T18:36:36.520 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:36.520 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:36.520 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:36.520 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:36.520 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:36.520 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:36.520 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 117791 2024-09-12T18:36:36.520 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.520 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:36.521 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.521 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:36.521 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.503382+0000", 2024-09-12T18:36:36.521 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:36.521 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.521 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.521 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:36.521 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.503382+0000", 2024-09-12T18:36:36.521 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:36.521 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.521 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.521 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:36.521 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.503382+0000", 2024-09-12T18:36:36.522 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7100000000000002e-07 2024-09-12T18:36:36.522 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.522 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.522 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:36.522 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.503443+0000", 2024-09-12T18:36:36.522 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0111000000000001e-05 2024-09-12T18:36:36.522 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.522 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.522 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:36.522 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.503449+0000", 2024-09-12T18:36:36.522 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.3570000000000003e-06 2024-09-12T18:36:36.522 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.522 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.522 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:36.523 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.503453+0000", 2024-09-12T18:36:36.523 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.743e-06 2024-09-12T18:36:36.523 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.523 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.523 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:36.523 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.505778+0000", 2024-09-12T18:36:36.523 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0023248769999999999 2024-09-12T18:36:36.523 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.523 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.523 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:36.523 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.505918+0000", 2024-09-12T18:36:36.523 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014057699999999999 2024-09-12T18:36:36.523 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.523 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.524 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:36.524 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.506057+0000", 2024-09-12T18:36:36.524 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000138641 2024-09-12T18:36:36.524 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:36.524 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:36.524 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:36.524 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.524 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.524 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:117792 5.e 5:77366979:::benchmark_data_smithi073_23739_object117791:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T18:36:36.524 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:36.503461+0000", 2024-09-12T18:36:36.524 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0036023980000000001, 2024-09-12T18:36:36.524 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0038303270000000001, 2024-09-12T18:36:36.525 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:36.525 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:36.525 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:36.525 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:36.525 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:36.525 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:36.525 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 117792 2024-09-12T18:36:36.525 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.525 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:36.525 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.525 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:36.525 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.503461+0000", 2024-09-12T18:36:36.525 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:36.525 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.526 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.526 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:36.526 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.503461+0000", 2024-09-12T18:36:36.526 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:36.526 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.526 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.526 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:36.526 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.503461+0000", 2024-09-12T18:36:36.526 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2899999999999999e-07 2024-09-12T18:36:36.526 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.526 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.526 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:36.526 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.503504+0000", 2024-09-12T18:36:36.527 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2932000000000002e-05 2024-09-12T18:36:36.527 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.527 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.527 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:36.527 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.503511+0000", 2024-09-12T18:36:36.527 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9199999999999998e-06 2024-09-12T18:36:36.527 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.528 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.528 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:36.528 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.503516+0000", 2024-09-12T18:36:36.528 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1909999999999999e-06 2024-09-12T18:36:36.528 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.528 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.528 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:36.528 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.505900+0000", 2024-09-12T18:36:36.528 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002383512 2024-09-12T18:36:36.528 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.528 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.528 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:36.528 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.505987+0000", 2024-09-12T18:36:36.529 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7120000000000006e-05 2024-09-12T18:36:36.529 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.529 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.529 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:36.529 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.506071+0000", 2024-09-12T18:36:36.529 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3961999999999993e-05 2024-09-12T18:36:36.529 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:36.529 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:36.529 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:36.529 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.529 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.529 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:117793 5.0 5:02744f0c:::benchmark_data_smithi073_23739_object117792:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T18:36:36.529 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:36.503530+0000", 2024-09-12T18:36:36.529 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.003533619, 2024-09-12T18:36:36.530 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0038231910000000001, 2024-09-12T18:36:36.530 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:36.530 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:36.530 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-09-12T18:36:36.530 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:36.530 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:36.530 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:36.530 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 117793 2024-09-12T18:36:36.530 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.530 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:36.530 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.530 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:36.530 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.503530+0000", 2024-09-12T18:36:36.530 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:36.531 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.531 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.531 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:36.531 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.503530+0000", 2024-09-12T18:36:36.531 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:36.531 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.531 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.531 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:36.531 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.503530+0000", 2024-09-12T18:36:36.531 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3500000000000002e-07 2024-09-12T18:36:36.531 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.531 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.531 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:36.531 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.503614+0000", 2024-09-12T18:36:36.532 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4175e-05 2024-09-12T18:36:36.532 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.532 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.532 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:36.532 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.503622+0000", 2024-09-12T18:36:36.532 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7740000000000004e-06 2024-09-12T18:36:36.532 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.532 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.532 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:36.532 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.503628+0000", 2024-09-12T18:36:36.532 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8220000000000003e-06 2024-09-12T18:36:36.532 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.532 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.533 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:36.533 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.505693+0000", 2024-09-12T18:36:36.533 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020656759999999998 2024-09-12T18:36:36.533 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:36.533 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:36.533 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:36.533 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.533 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.533 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:117794 5.8 5.3994f2c8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T18:36:36.533 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:36.506744+0000", 2024-09-12T18:36:36.533 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00031963299999999999, 2024-09-12T18:36:36.533 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00065650699999999997, 2024-09-12T18:36:36.533 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:36.533 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:36.534 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:36.534 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:36.534 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:36.534 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:36.534 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 117794 2024-09-12T18:36:36.534 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.534 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:36.534 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.534 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:36.534 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.506744+0000", 2024-09-12T18:36:36.534 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:36.534 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.534 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.535 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:36.535 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.506744+0000", 2024-09-12T18:36:36.535 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:36.535 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.535 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.535 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:36.535 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.506745+0000", 2024-09-12T18:36:36.535 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6789999999999999e-06 2024-09-12T18:36:36.535 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.535 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.535 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:36.535 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.506841+0000", 2024-09-12T18:36:36.535 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5293999999999999e-05 2024-09-12T18:36:36.535 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.536 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.536 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:36.536 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.506856+0000", 2024-09-12T18:36:36.536 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5739999999999998e-05 2024-09-12T18:36:36.536 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.536 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.536 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:36.536 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.506867+0000", 2024-09-12T18:36:36.536 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0873000000000001e-05 2024-09-12T18:36:36.536 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:36.536 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:36.536 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:36.536 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.537 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.537 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:117798 5.b 5:d67e4d67:::benchmark_data_smithi073_23739_object117797:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T18:36:36.537 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:36.507092+0000", 2024-09-12T18:36:36.537 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4294967295.9999714, 2024-09-12T18:36:36.537 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00035675799999999999, 2024-09-12T18:36:36.537 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:36.537 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:36.537 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:36.537 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:36.537 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:36.537 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:36.537 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 117798 2024-09-12T18:36:36.537 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.537 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:36.538 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.538 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:36.538 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.507092+0000", 2024-09-12T18:36:36.538 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:36.538 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.538 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.538 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:36.538 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.507092+0000", 2024-09-12T18:36:36.538 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:36.538 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.538 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.538 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:36.539 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.507093+0000", 2024-09-12T18:36:36.539 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6599999999999995e-07 2024-09-12T18:36:36.539 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.539 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.539 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:36.539 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.507170+0000", 2024-09-12T18:36:36.539 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7034999999999997e-05 2024-09-12T18:36:36.539 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.539 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.539 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:36.539 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.507180+0000", 2024-09-12T18:36:36.539 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8169999999999994e-06 2024-09-12T18:36:36.539 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.540 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.540 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:36.540 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.507185+0000", 2024-09-12T18:36:36.540 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9099999999999996e-06 2024-09-12T18:36:36.540 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.540 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.540 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:36.540 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.507240+0000", 2024-09-12T18:36:36.540 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5772000000000001e-05 2024-09-12T18:36:36.540 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.540 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.540 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:36.541 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.507380+0000", 2024-09-12T18:36:36.541 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013947499999999999 2024-09-12T18:36:36.541 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:36.541 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:36.541 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:36.541 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.541 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.541 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:117785 5.9 e47/21)", 2024-09-12T18:36:36.541 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:36.507114+0000", 2024-09-12T18:36:36.541 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4294967295.999949, 2024-09-12T18:36:36.541 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00038831299999999999, 2024-09-12T18:36:36.541 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:36.541 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:36.542 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:36.542 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:36.542 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.542 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:36.542 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.507114+0000", 2024-09-12T18:36:36.542 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:36.542 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.542 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.542 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:36.542 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.507114+0000", 2024-09-12T18:36:36.542 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:36.542 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.542 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.543 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:36.543 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.507115+0000", 2024-09-12T18:36:36.543 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.28e-07 2024-09-12T18:36:36.543 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.543 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.543 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:36.543 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.507230+0000", 2024-09-12T18:36:36.543 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000115678 2024-09-12T18:36:36.543 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.543 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.543 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:36.543 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.507236+0000", 2024-09-12T18:36:36.543 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.772e-06 2024-09-12T18:36:36.543 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:36.544 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:36.544 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:36.544 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.507240+0000", 2024-09-12T18:36:36.544 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8070000000000001e-06 2024-09-12T18:36:36.544 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:36.544 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:36.544 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:36.544 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:36.544 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-09-12T18:36:36.544 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 8 2024-09-12T18:36:36.544 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:36.546 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:36:36.551 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:36.548+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:36.629 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:36:36.652 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:36.647+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:36.703 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:36.703 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-09-12T18:36:36.703 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-09-12T18:36:36.703 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-09-12T18:36:36.703 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:36.721 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:36:36.752 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:36.747+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:36.789 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:36:36.789 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:36:36.808 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:36:36.809 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:36:36.820 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:36:36.820 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:36:36.820 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '1000', 'type': 'reweight-by-utilization'} 2024-09-12T18:36:36.820 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 0.05 2024-09-12T18:36:36.827 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:36:36.828 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:36:36.853 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:36.847+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:36.874 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 51 16 118564 118548 145.263 129.625 0.00786761 0.00687955 2024-09-12T18:36:36.875 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:36.875 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:36.897 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:36:36.954 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:36.947+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:37.054 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:37.051+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:37.055 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:37.055 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:37.076 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:36:37.131 INFO:teuthology.orchestra.run.smithi073.stdout:moved 0 / 242 (0%) 2024-09-12T18:36:37.131 INFO:teuthology.orchestra.run.smithi073.stdout:avg 80.6667 2024-09-12T18:36:37.131 INFO:teuthology.orchestra.run.smithi073.stdout:stddev 3.68179 -> 3.68179 (expected baseline 7.33333) 2024-09-12T18:36:37.131 INFO:teuthology.orchestra.run.smithi073.stdout:min osd.1 with 76 -> 76 pgs (0.942149 -> 0.942149 * mean) 2024-09-12T18:36:37.131 INFO:teuthology.orchestra.run.smithi073.stdout:max osd.0 with 85 -> 85 pgs (1.05372 -> 1.05372 * mean) 2024-09-12T18:36:37.131 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:36:37.131 INFO:teuthology.orchestra.run.smithi073.stdout:oload 1000 2024-09-12T18:36:37.131 INFO:teuthology.orchestra.run.smithi073.stdout:max_change 0.05 2024-09-12T18:36:37.131 INFO:teuthology.orchestra.run.smithi073.stdout:max_change_osds 4 2024-09-12T18:36:37.131 INFO:teuthology.orchestra.run.smithi073.stdout:average_utilization 0.0042 2024-09-12T18:36:37.131 INFO:teuthology.orchestra.run.smithi073.stdout:overload_utilization 0.0424 2024-09-12T18:36:37.132 INFO:teuthology.orchestra.run.smithi073.stderr:no change 2024-09-12T18:36:37.151 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-09-12T18:36:37.151 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 3.0 2024-09-12T18:36:37.155 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:37.152+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:37.228 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:37.228 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:37.249 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:36:37.256 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:37.255+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:37.357 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:37.351+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:37.456 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:37.456 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:37.458 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:37.455+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:37.479 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:36:37.515 INFO:teuthology.orchestra.run.smithi073.stdout:moved 0 / 242 (0%) 2024-09-12T18:36:37.515 INFO:teuthology.orchestra.run.smithi073.stdout:avg 80.6667 2024-09-12T18:36:37.515 INFO:teuthology.orchestra.run.smithi073.stdout:stddev 3.68179 -> 3.68179 (expected baseline 7.33333) 2024-09-12T18:36:37.515 INFO:teuthology.orchestra.run.smithi073.stdout:min osd.1 with 76 -> 76 pgs (0.942149 -> 0.942149 * mean) 2024-09-12T18:36:37.515 INFO:teuthology.orchestra.run.smithi073.stdout:max osd.0 with 85 -> 85 pgs (1.05372 -> 1.05372 * mean) 2024-09-12T18:36:37.515 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:36:37.515 INFO:teuthology.orchestra.run.smithi073.stdout:oload 1000 2024-09-12T18:36:37.515 INFO:teuthology.orchestra.run.smithi073.stdout:max_change 3 2024-09-12T18:36:37.515 INFO:teuthology.orchestra.run.smithi073.stdout:max_change_osds 4 2024-09-12T18:36:37.516 INFO:teuthology.orchestra.run.smithi073.stdout:average_utilization 0.0042 2024-09-12T18:36:37.516 INFO:teuthology.orchestra.run.smithi073.stdout:overload_utilization 0.0424 2024-09-12T18:36:37.516 INFO:teuthology.orchestra.run.smithi073.stderr:no change 2024-09-12T18:36:37.536 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-09-12T18:36:37.536 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 3.0 2024-09-12T18:36:37.559 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:37.556+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:37.631 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:37.631 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:37.653 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:36:37.660 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:37.656+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:37.762 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:37.758+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:37.807 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:37.808 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:37.829 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:36:37.874 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 52 16 120654 120638 144.982 130.625 0.00746314 0.00689268 2024-09-12T18:36:37.875 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:37.871+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:37.963 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:37.959+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:37.987 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:37.987 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:38.008 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:36:38.055 INFO:teuthology.orchestra.run.smithi073.stdout:moved 17 / 242 (7.02479%) 2024-09-12T18:36:38.055 INFO:teuthology.orchestra.run.smithi073.stdout:avg 80.6667 2024-09-12T18:36:38.055 INFO:teuthology.orchestra.run.smithi073.stdout:stddev 3.68179 -> 9.28559 (expected baseline 7.33333) 2024-09-12T18:36:38.056 INFO:teuthology.orchestra.run.smithi073.stdout:min osd.1 with 76 -> 84 pgs (0.942149 -> 1.04132 * mean) 2024-09-12T18:36:38.056 INFO:teuthology.orchestra.run.smithi073.stdout:max osd.0 with 85 -> 68 pgs (1.05372 -> 0.842975 * mean) 2024-09-12T18:36:38.056 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:36:38.056 INFO:teuthology.orchestra.run.smithi073.stdout:oload 110 2024-09-12T18:36:38.056 INFO:teuthology.orchestra.run.smithi073.stdout:max_change 3 2024-09-12T18:36:38.056 INFO:teuthology.orchestra.run.smithi073.stdout:max_change_osds 4 2024-09-12T18:36:38.056 INFO:teuthology.orchestra.run.smithi073.stdout:average_utilization 0.0042 2024-09-12T18:36:38.056 INFO:teuthology.orchestra.run.smithi073.stdout:overload_utilization 0.0047 2024-09-12T18:36:38.056 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0 weight 1.0000 -> 0.8377 2024-09-12T18:36:38.057 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T18:36:38.064 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:38.060+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:38.081 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-09-12T18:36:38.081 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 1.0 2024-09-12T18:36:38.139 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:38.140 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:38.153 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:36:38.165 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:38.164+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:38.267 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:38.263+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:38.271 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:38.271 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:38.285 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:36:38.367 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:38.364+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:38.409 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:38.409 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:38.425 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:36:38.469 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:38.466+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:38.557 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:38.557 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:38.570 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:38.568+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:38.571 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:36:38.671 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:38.663+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:38.738 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:38.738 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:38.752 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:36:38.797 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:38.796+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:38.846 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:36:38.872 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:38.867+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:38.874 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:38.874 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:38.874 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 53 16 121093 121077 142.764 27.4375 0.00381272 0.00689501 2024-09-12T18:36:38.888 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:36:38.973 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:38.972+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:39.006 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:36:39.007 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:36:39.015 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:39.015 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2024-09-12T18:36:39.015 INFO:teuthology.orchestra.run.smithi114.stdout: "num_ops": 0 2024-09-12T18:36:39.015 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:39.028 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:36:39.028 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:36:39.029 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:36:39.048 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:36:39.048 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:36:39.053 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is unset 2024-09-12T18:36:39.054 INFO:teuthology.orchestra.run.smithi073.stdout:moved 19 / 242 (7.85124%) 2024-09-12T18:36:39.054 INFO:teuthology.orchestra.run.smithi073.stdout:avg 80.6667 2024-09-12T18:36:39.054 INFO:teuthology.orchestra.run.smithi073.stdout:stddev 9.28559 -> 22.4846 (expected baseline 7.33333) 2024-09-12T18:36:39.054 INFO:teuthology.orchestra.run.smithi073.stdout:min osd.0 with 68 -> 49 pgs (0.842975 -> 0.607438 * mean) 2024-09-12T18:36:39.054 INFO:teuthology.orchestra.run.smithi073.stdout:max osd.2 with 90 -> 99 pgs (1.1157 -> 1.22727 * mean) 2024-09-12T18:36:39.054 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:36:39.054 INFO:teuthology.orchestra.run.smithi073.stdout:oload 110 2024-09-12T18:36:39.054 INFO:teuthology.orchestra.run.smithi073.stdout:max_change 1 2024-09-12T18:36:39.054 INFO:teuthology.orchestra.run.smithi073.stdout:max_change_osds 4 2024-09-12T18:36:39.054 INFO:teuthology.orchestra.run.smithi073.stdout:average_utilization 0.0047 2024-09-12T18:36:39.054 INFO:teuthology.orchestra.run.smithi073.stdout:overload_utilization 0.0052 2024-09-12T18:36:39.054 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0 weight 0.8377 -> 0.6372 2024-09-12T18:36:39.075 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:39.070+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:39.082 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-09-12T18:36:39.083 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 3.0 2024-09-12T18:36:39.150 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:39.150 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2024-09-12T18:36:39.150 INFO:teuthology.orchestra.run.smithi114.stdout: "complaint_time": 30, 2024-09-12T18:36:39.150 INFO:teuthology.orchestra.run.smithi114.stdout: "num_blocked_ops": 0 2024-09-12T18:36:39.150 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:39.162 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:36:39.207 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:39.203+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:39.276 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:39.272+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:39.279 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:39.279 INFO:teuthology.orchestra.run.smithi114.stdout: "size": 20, 2024-09-12T18:36:39.279 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 600, 2024-09-12T18:36:39.279 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:36:39.280 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.280 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:39.280 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:39.280 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 73.646118074, 2024-09-12T18:36:39.280 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.042475618999999999, 2024-09-12T18:36:39.280 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:39.280 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:39.280 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:39.280 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:39.280 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.280 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:39.280 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:39.281 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:39.281 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.281 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.281 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:39.281 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:39.281 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:39.281 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.281 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.281 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:39.281 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628450+0000", 2024-09-12T18:36:39.281 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4212999999999999e-05 2024-09-12T18:36:39.281 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.281 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.282 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:39.282 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628463+0000", 2024-09-12T18:36:39.282 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2497000000000001e-05 2024-09-12T18:36:39.282 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.282 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.282 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:39.282 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628480+0000", 2024-09-12T18:36:39.282 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7232999999999999e-05 2024-09-12T18:36:39.282 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.282 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.282 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:39.282 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628496+0000", 2024-09-12T18:36:39.282 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6217000000000001e-05 2024-09-12T18:36:39.283 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.283 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.283 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:39.283 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628641+0000", 2024-09-12T18:36:39.283 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000144709 2024-09-12T18:36:39.283 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.283 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.283 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:39.283 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628657+0000", 2024-09-12T18:36:39.283 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6266e-05 2024-09-12T18:36:39.283 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.283 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.283 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:39.283 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663103+0000", 2024-09-12T18:36:39.284 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.034445523999999998 2024-09-12T18:36:39.284 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.284 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.284 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:39.284 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663373+0000", 2024-09-12T18:36:39.284 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00027085500000000002 2024-09-12T18:36:39.284 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.284 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.284 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:39.284 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663634+0000", 2024-09-12T18:36:39.284 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000260855 2024-09-12T18:36:39.284 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.284 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.285 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:39.285 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670294+0000", 2024-09-12T18:36:39.285 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0066597599999999998 2024-09-12T18:36:39.285 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.285 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.285 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:39.285 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670705+0000", 2024-09-12T18:36:39.285 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00041057099999999998 2024-09-12T18:36:39.285 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.285 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.285 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:39.285 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670820+0000", 2024-09-12T18:36:39.286 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000115111 2024-09-12T18:36:39.286 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.286 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.286 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:39.286 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670912+0000", 2024-09-12T18:36:39.286 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1807999999999999e-05 2024-09-12T18:36:39.286 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:39.286 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:39.286 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:39.286 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.286 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.286 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:39.286 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:39.287 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 73.646027328000002, 2024-09-12T18:36:39.287 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.044599273000000002, 2024-09-12T18:36:39.287 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:39.287 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:39.287 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:39.287 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:39.287 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.287 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:39.287 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:39.287 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:39.287 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.287 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.287 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:39.288 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:39.288 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:39.288 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.288 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.288 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:39.288 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628528+0000", 2024-09-12T18:36:39.288 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:39.288 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.288 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.288 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:39.288 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628537+0000", 2024-09-12T18:36:39.288 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6969999999999999e-06 2024-09-12T18:36:39.288 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.288 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.289 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:39.289 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628560+0000", 2024-09-12T18:36:39.289 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2889000000000001e-05 2024-09-12T18:36:39.289 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.289 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.289 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:39.289 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628576+0000", 2024-09-12T18:36:39.289 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.649e-05 2024-09-12T18:36:39.289 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.289 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.289 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:39.289 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628846+0000", 2024-09-12T18:36:39.289 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00026952500000000001 2024-09-12T18:36:39.290 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.290 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.290 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:39.290 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628853+0000", 2024-09-12T18:36:39.290 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6559999999999992e-06 2024-09-12T18:36:39.290 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.290 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.290 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:39.290 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665284+0000", 2024-09-12T18:36:39.290 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.036431140000000001 2024-09-12T18:36:39.290 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.290 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.290 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:39.291 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665494+0000", 2024-09-12T18:36:39.291 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000209762 2024-09-12T18:36:39.291 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.291 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.291 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:39.291 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665816+0000", 2024-09-12T18:36:39.291 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00032162299999999999 2024-09-12T18:36:39.291 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.291 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.291 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:39.291 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670382+0000", 2024-09-12T18:36:39.291 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0045656739999999996 2024-09-12T18:36:39.291 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.291 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.292 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:39.292 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.672978+0000", 2024-09-12T18:36:39.292 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.002596068 2024-09-12T18:36:39.292 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.292 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.292 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:39.292 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673058+0000", 2024-09-12T18:36:39.292 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0198999999999996e-05 2024-09-12T18:36:39.292 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.292 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.292 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:39.292 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673126+0000", 2024-09-12T18:36:39.292 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8120000000000005e-05 2024-09-12T18:36:39.293 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:39.293 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:39.293 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:39.293 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.293 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.293 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:23 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:39.293 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:39.293 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 73.645929522000003, 2024-09-12T18:36:39.293 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045539784, 2024-09-12T18:36:39.293 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:39.293 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:39.293 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:39.293 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:39.293 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.294 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:39.294 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:39.294 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:39.294 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.294 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.294 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:39.294 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:39.294 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:39.294 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.294 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.294 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:39.294 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628626+0000", 2024-09-12T18:36:39.294 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.573e-06 2024-09-12T18:36:39.295 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.295 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.295 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:39.295 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628640+0000", 2024-09-12T18:36:39.295 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3817e-05 2024-09-12T18:36:39.295 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.295 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.295 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:39.295 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628659+0000", 2024-09-12T18:36:39.295 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9539999999999999e-05 2024-09-12T18:36:39.295 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.295 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.295 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:39.296 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628675+0000", 2024-09-12T18:36:39.296 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5739e-05 2024-09-12T18:36:39.296 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.296 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.296 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:39.296 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628815+0000", 2024-09-12T18:36:39.296 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014003299999999999 2024-09-12T18:36:39.296 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.296 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.296 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:39.296 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628828+0000", 2024-09-12T18:36:39.296 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2849e-05 2024-09-12T18:36:39.296 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.297 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.297 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:39.297 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651162+0000", 2024-09-12T18:36:39.297 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.022334228000000001 2024-09-12T18:36:39.297 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.297 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.297 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:39.297 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651446+0000", 2024-09-12T18:36:39.297 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00028392800000000002 2024-09-12T18:36:39.297 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.297 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.297 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:39.297 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651746+0000", 2024-09-12T18:36:39.298 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000300091 2024-09-12T18:36:39.298 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.298 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.298 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:39.298 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665113+0000", 2024-09-12T18:36:39.298 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013366678 2024-09-12T18:36:39.298 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.298 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.298 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:39.298 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674010+0000", 2024-09-12T18:36:39.298 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0088970520000000008 2024-09-12T18:36:39.298 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.298 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.298 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:39.299 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674104+0000", 2024-09-12T18:36:39.299 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4124999999999998e-05 2024-09-12T18:36:39.299 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.299 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.299 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:39.299 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674164+0000", 2024-09-12T18:36:39.299 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.0130999999999997e-05 2024-09-12T18:36:39.299 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:39.299 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:39.299 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:39.299 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.299 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.299 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:26 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:39.299 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:39.299 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 73.645856316000007, 2024-09-12T18:36:39.300 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045702136999999997, 2024-09-12T18:36:39.300 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:39.300 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:39.300 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:39.300 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:39.300 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.300 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:39.300 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:39.300 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:39.300 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.300 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.300 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:39.300 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:39.300 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:39.301 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.301 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.301 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:39.301 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628699+0000", 2024-09-12T18:36:39.301 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3859999999999999e-06 2024-09-12T18:36:39.301 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.301 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.301 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:39.301 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628706+0000", 2024-09-12T18:36:39.301 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0169999999999999e-06 2024-09-12T18:36:39.301 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.301 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.301 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:39.301 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628725+0000", 2024-09-12T18:36:39.302 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8683000000000001e-05 2024-09-12T18:36:39.302 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.302 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.302 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:39.302 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628740+0000", 2024-09-12T18:36:39.302 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5413999999999998e-05 2024-09-12T18:36:39.302 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.302 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.302 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:39.302 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628907+0000", 2024-09-12T18:36:39.302 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00016670199999999999 2024-09-12T18:36:39.302 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.302 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.303 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:39.303 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628917+0000", 2024-09-12T18:36:39.303 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.046e-05 2024-09-12T18:36:39.303 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.303 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.303 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:39.303 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.660390+0000", 2024-09-12T18:36:39.303 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.031472364000000003 2024-09-12T18:36:39.303 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.303 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.303 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:39.303 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.661767+0000", 2024-09-12T18:36:39.303 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0013769190000000001 2024-09-12T18:36:39.303 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.304 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.304 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:39.304 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.662408+0000", 2024-09-12T18:36:39.304 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00064091099999999998 2024-09-12T18:36:39.304 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.304 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.304 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:39.304 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669577+0000", 2024-09-12T18:36:39.304 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.007169412 2024-09-12T18:36:39.304 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.304 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.304 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:39.304 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674244+0000", 2024-09-12T18:36:39.305 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0046671839999999996 2024-09-12T18:36:39.305 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.305 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.305 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:39.305 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674329+0000", 2024-09-12T18:36:39.308 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5276000000000001e-05 2024-09-12T18:36:39.308 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.308 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.308 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:39.309 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674400+0000", 2024-09-12T18:36:39.309 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0408999999999996e-05 2024-09-12T18:36:39.309 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:39.309 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:39.309 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:39.309 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.309 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.309 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:39.309 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:39.309 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 73.645748647000005, 2024-09-12T18:36:39.309 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.044572443000000003, 2024-09-12T18:36:39.309 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:39.309 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:39.309 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:39.310 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:39.310 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.310 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:39.310 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:39.310 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:39.310 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.310 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.310 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:39.310 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:39.310 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:39.310 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.310 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.310 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:39.310 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628807+0000", 2024-09-12T18:36:39.310 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3629999999999999e-06 2024-09-12T18:36:39.310 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.311 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.311 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:39.311 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628814+0000", 2024-09-12T18:36:39.311 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.2099999999999996e-06 2024-09-12T18:36:39.311 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.311 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.311 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:39.311 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628832+0000", 2024-09-12T18:36:39.311 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7972999999999999e-05 2024-09-12T18:36:39.311 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.311 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.311 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:39.311 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628854+0000", 2024-09-12T18:36:39.312 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1857000000000001e-05 2024-09-12T18:36:39.312 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.312 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.312 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:39.312 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628984+0000", 2024-09-12T18:36:39.312 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013013599999999999 2024-09-12T18:36:39.312 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.312 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.312 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:39.312 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628993+0000", 2024-09-12T18:36:39.312 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:36:39.313 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.313 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.313 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:39.313 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668176+0000", 2024-09-12T18:36:39.313 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.039182211000000002 2024-09-12T18:36:39.313 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.313 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.313 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:39.313 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668481+0000", 2024-09-12T18:36:39.313 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00030499200000000002 2024-09-12T18:36:39.313 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.313 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.313 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:39.314 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668771+0000", 2024-09-12T18:36:39.314 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00029018700000000002 2024-09-12T18:36:39.314 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.314 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.314 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:39.314 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.672674+0000", 2024-09-12T18:36:39.314 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0039031890000000001 2024-09-12T18:36:39.314 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.314 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.314 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:39.314 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673214+0000", 2024-09-12T18:36:39.314 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00053981600000000004 2024-09-12T18:36:39.315 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.315 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.315 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:39.315 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673310+0000", 2024-09-12T18:36:39.315 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.6682999999999996e-05 2024-09-12T18:36:39.315 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.315 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.315 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:39.315 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673378+0000", 2024-09-12T18:36:39.315 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7385999999999995e-05 2024-09-12T18:36:39.315 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:39.316 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:39.316 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:39.316 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.316 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.316 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:39.316 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:39.316 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 73.645612620999998, 2024-09-12T18:36:39.316 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.041480853999999998, 2024-09-12T18:36:39.316 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:39.316 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:39.316 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:39.316 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:39.316 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.317 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:39.317 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:39.317 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:39.317 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.317 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.317 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:39.317 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:39.317 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:39.317 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.317 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.317 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:39.317 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628943+0000", 2024-09-12T18:36:39.317 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.403e-06 2024-09-12T18:36:39.318 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.318 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.318 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:39.318 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628953+0000", 2024-09-12T18:36:39.318 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0273e-05 2024-09-12T18:36:39.318 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.318 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.318 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:39.318 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628973+0000", 2024-09-12T18:36:39.318 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9959999999999999e-05 2024-09-12T18:36:39.318 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.318 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.318 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:39.318 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628989+0000", 2024-09-12T18:36:39.319 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6447e-05 2024-09-12T18:36:39.319 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.319 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.319 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:39.319 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629144+0000", 2024-09-12T18:36:39.319 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015468900000000001 2024-09-12T18:36:39.319 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.319 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.319 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:39.319 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629162+0000", 2024-09-12T18:36:39.319 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7603000000000001e-05 2024-09-12T18:36:39.319 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.319 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.320 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:39.320 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.646927+0000", 2024-09-12T18:36:39.320 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.017765626 2024-09-12T18:36:39.320 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.320 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.320 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:39.320 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.647245+0000", 2024-09-12T18:36:39.320 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00031797699999999999 2024-09-12T18:36:39.320 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.320 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.320 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:39.320 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.647551+0000", 2024-09-12T18:36:39.320 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00030583500000000002 2024-09-12T18:36:39.321 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.321 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.321 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:39.321 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651738+0000", 2024-09-12T18:36:39.321 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0041864980000000003 2024-09-12T18:36:39.321 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.321 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.321 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:39.321 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670207+0000", 2024-09-12T18:36:39.321 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018469299000000002 2024-09-12T18:36:39.321 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.321 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.321 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:39.321 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670330+0000", 2024-09-12T18:36:39.322 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012284500000000001 2024-09-12T18:36:39.322 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.322 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.322 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:39.322 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670422+0000", 2024-09-12T18:36:39.322 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2398999999999994e-05 2024-09-12T18:36:39.322 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:39.322 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:39.322 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:39.322 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.322 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.322 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:39.322 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:39.322 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 73.645535367999997, 2024-09-12T18:36:39.323 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.041623741999999998, 2024-09-12T18:36:39.323 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:39.323 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:39.323 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:39.323 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:39.323 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.323 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:39.323 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:39.323 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:39.323 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.323 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.323 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:39.323 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:39.323 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:39.324 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.324 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.324 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:39.324 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629020+0000", 2024-09-12T18:36:39.324 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.15e-06 2024-09-12T18:36:39.324 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.324 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.324 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:39.324 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629023+0000", 2024-09-12T18:36:39.324 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4659999999999999e-06 2024-09-12T18:36:39.324 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.324 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.324 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:39.325 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629037+0000", 2024-09-12T18:36:39.325 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3857e-05 2024-09-12T18:36:39.325 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.325 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.325 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:39.325 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629062+0000", 2024-09-12T18:36:39.325 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4519999999999999e-05 2024-09-12T18:36:39.325 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.325 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.325 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:39.325 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629253+0000", 2024-09-12T18:36:39.325 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000191335 2024-09-12T18:36:39.325 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.326 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.326 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:39.326 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629266+0000", 2024-09-12T18:36:39.326 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3322999999999999e-05 2024-09-12T18:36:39.326 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.326 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.326 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:39.326 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648331+0000", 2024-09-12T18:36:39.326 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.019065060000000002 2024-09-12T18:36:39.326 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.326 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.327 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:39.327 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.650044+0000", 2024-09-12T18:36:39.327 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017123959999999999 2024-09-12T18:36:39.327 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.327 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.327 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:39.327 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670642+0000", 2024-09-12T18:36:39.327 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.020598635000000001 2024-09-12T18:36:39.327 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:39.327 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:39.327 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:39.327 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.328 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.328 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:39.328 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:39.328 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 73.645432036000003, 2024-09-12T18:36:39.328 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.046431252999999999, 2024-09-12T18:36:39.328 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:39.328 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:39.329 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:39.329 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:39.329 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.329 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:39.329 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:39.329 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:39.329 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.329 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.329 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:39.329 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:39.329 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:39.329 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.329 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.330 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:39.330 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629123+0000", 2024-09-12T18:36:39.330 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0899999999999999e-06 2024-09-12T18:36:39.330 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.330 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.330 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:39.330 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629138+0000", 2024-09-12T18:36:39.330 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4977000000000001e-05 2024-09-12T18:36:39.330 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.330 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.330 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:39.330 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629149+0000", 2024-09-12T18:36:39.330 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1182999999999999e-05 2024-09-12T18:36:39.331 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.331 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.331 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:39.331 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629157+0000", 2024-09-12T18:36:39.331 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8129999999999996e-06 2024-09-12T18:36:39.331 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.331 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.331 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:39.331 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629223+0000", 2024-09-12T18:36:39.331 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6463000000000004e-05 2024-09-12T18:36:39.331 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.331 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.331 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:39.331 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629230+0000", 2024-09-12T18:36:39.332 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1360000000000002e-06 2024-09-12T18:36:39.332 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.332 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.332 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:39.332 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669605+0000", 2024-09-12T18:36:39.332 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.040375518999999999 2024-09-12T18:36:39.332 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.332 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.332 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:39.332 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669840+0000", 2024-09-12T18:36:39.332 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00023520099999999999 2024-09-12T18:36:39.332 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.332 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.333 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:39.333 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.675553+0000", 2024-09-12T18:36:39.333 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0057128709999999996 2024-09-12T18:36:39.333 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:39.333 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:39.333 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:39.333 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.333 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.333 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:39.333 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:39.333 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 73.645377369000002, 2024-09-12T18:36:39.333 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.037357044999999998, 2024-09-12T18:36:39.333 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:39.333 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:39.334 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:39.334 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:39.334 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.334 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:39.334 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:39.334 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:39.334 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.334 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.334 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:39.334 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:39.334 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:39.334 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.335 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.335 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:39.335 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629178+0000", 2024-09-12T18:36:39.335 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.08e-06 2024-09-12T18:36:39.335 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.335 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.335 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:39.335 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629194+0000", 2024-09-12T18:36:39.335 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5899000000000001e-05 2024-09-12T18:36:39.335 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.335 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.335 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:39.335 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629211+0000", 2024-09-12T18:36:39.336 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7363e-05 2024-09-12T18:36:39.336 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.336 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.336 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:39.336 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629226+0000", 2024-09-12T18:36:39.336 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4567e-05 2024-09-12T18:36:39.336 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.336 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.336 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:39.336 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629299+0000", 2024-09-12T18:36:39.336 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3910000000000002e-05 2024-09-12T18:36:39.336 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.336 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.337 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:39.337 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629307+0000", 2024-09-12T18:36:39.337 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5299999999999999e-06 2024-09-12T18:36:39.337 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.337 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.337 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:39.337 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648185+0000", 2024-09-12T18:36:39.337 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018878533999999999 2024-09-12T18:36:39.337 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.337 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.337 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:39.337 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.649724+0000", 2024-09-12T18:36:39.338 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001538841 2024-09-12T18:36:39.338 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.338 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.338 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:39.338 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.666534+0000", 2024-09-12T18:36:39.338 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.016809320999999999 2024-09-12T18:36:39.338 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:39.338 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:39.338 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:39.338 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.338 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.338 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:77251 5.3 5:c0b45ab3:::benchmark_data_smithi073_23739_object77250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:39.338 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:16.796319+0000", 2024-09-12T18:36:39.339 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 22.478234582999999, 2024-09-12T18:36:39.339 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018653991000000002, 2024-09-12T18:36:39.339 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:39.339 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:39.339 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:39.339 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:39.339 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:39.339 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:39.339 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 77251 2024-09-12T18:36:39.339 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.339 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:39.339 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.339 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:39.340 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.796319+0000", 2024-09-12T18:36:39.340 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:39.340 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.340 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.340 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:39.340 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.796319+0000", 2024-09-12T18:36:39.340 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:39.340 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.340 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.340 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:39.340 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.796320+0000", 2024-09-12T18:36:39.340 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1100000000000005e-07 2024-09-12T18:36:39.341 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.341 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.341 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:39.341 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.796353+0000", 2024-09-12T18:36:39.341 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3043000000000002e-05 2024-09-12T18:36:39.341 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.341 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.341 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:39.341 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.796361+0000", 2024-09-12T18:36:39.341 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3989999999999998e-06 2024-09-12T18:36:39.341 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.341 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.341 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:39.341 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.796367+0000", 2024-09-12T18:36:39.342 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9950000000000002e-06 2024-09-12T18:36:39.342 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.342 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.342 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:39.342 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.800568+0000", 2024-09-12T18:36:39.342 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0042010709999999998 2024-09-12T18:36:39.342 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.342 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.342 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:39.342 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.800679+0000", 2024-09-12T18:36:39.342 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000111119 2024-09-12T18:36:39.342 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.342 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.343 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:39.343 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.800802+0000", 2024-09-12T18:36:39.343 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000123418 2024-09-12T18:36:39.343 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.343 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.343 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:39.343 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.805536+0000", 2024-09-12T18:36:39.343 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0047341309999999999 2024-09-12T18:36:39.343 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.343 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.343 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:39.343 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.814921+0000", 2024-09-12T18:36:39.343 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0093849680000000005 2024-09-12T18:36:39.343 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.344 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.344 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:39.344 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.814951+0000", 2024-09-12T18:36:39.344 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.9189000000000001e-05 2024-09-12T18:36:39.344 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.344 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.344 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:39.344 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:16.814973+0000", 2024-09-12T18:36:39.344 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2847e-05 2024-09-12T18:36:39.344 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:39.344 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:39.345 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:39.345 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.345 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.345 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:80960 5.a 5:5d86791e:::benchmark_data_smithi073_23739_object80959:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T18:36:39.345 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:18.558199+0000", 2024-09-12T18:36:39.345 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 20.716355454999999, 2024-09-12T18:36:39.345 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.019912458000000001, 2024-09-12T18:36:39.345 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:39.345 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:39.345 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:39.345 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:39.345 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:39.345 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:39.346 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 80960 2024-09-12T18:36:39.346 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.346 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:39.346 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.346 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:39.346 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558199+0000", 2024-09-12T18:36:39.346 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:39.346 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.346 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.346 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:39.346 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558199+0000", 2024-09-12T18:36:39.346 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:39.346 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.347 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.347 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:39.347 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558199+0000", 2024-09-12T18:36:39.347 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2999999999999999e-07 2024-09-12T18:36:39.347 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.347 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.347 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:39.347 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558255+0000", 2024-09-12T18:36:39.347 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5930999999999997e-05 2024-09-12T18:36:39.347 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.347 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.347 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:39.348 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558263+0000", 2024-09-12T18:36:39.348 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1450000000000008e-06 2024-09-12T18:36:39.348 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.348 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.348 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:39.348 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558272+0000", 2024-09-12T18:36:39.348 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2050000000000002e-06 2024-09-12T18:36:39.348 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.348 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.348 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:39.348 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558334+0000", 2024-09-12T18:36:39.348 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2481e-05 2024-09-12T18:36:39.349 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.349 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.349 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:39.349 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558425+0000", 2024-09-12T18:36:39.349 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1355999999999997e-05 2024-09-12T18:36:39.349 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.349 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.349 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:39.349 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.558535+0000", 2024-09-12T18:36:39.349 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00010997699999999999 2024-09-12T18:36:39.349 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.349 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.349 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:39.350 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.569795+0000", 2024-09-12T18:36:39.350 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011260020000000001 2024-09-12T18:36:39.350 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.350 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.350 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:39.350 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.578026+0000", 2024-09-12T18:36:39.350 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0082307100000000005 2024-09-12T18:36:39.350 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.351 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.351 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:39.351 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.578072+0000", 2024-09-12T18:36:39.351 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.6291000000000001e-05 2024-09-12T18:36:39.351 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.351 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.351 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:39.351 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.578111+0000", 2024-09-12T18:36:39.351 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8512e-05 2024-09-12T18:36:39.351 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:39.351 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:39.351 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:39.351 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.351 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.352 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:80967 5.a 5:5f4000f6:::benchmark_data_smithi073_23739_object80966:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T18:36:39.352 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:18.561016+0000", 2024-09-12T18:36:39.352 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 20.713537773999999, 2024-09-12T18:36:39.352 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021780831, 2024-09-12T18:36:39.352 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:39.352 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:39.352 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:39.352 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:39.352 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:39.352 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:39.352 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 80967 2024-09-12T18:36:39.352 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.352 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:39.353 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.353 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:39.353 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561016+0000", 2024-09-12T18:36:39.353 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:39.353 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.353 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.353 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:39.353 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561016+0000", 2024-09-12T18:36:39.353 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:39.353 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.353 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.353 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:39.353 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561017+0000", 2024-09-12T18:36:39.353 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7599999999999997e-07 2024-09-12T18:36:39.354 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.354 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.354 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:39.354 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561050+0000", 2024-09-12T18:36:39.354 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3524e-05 2024-09-12T18:36:39.354 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.354 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.354 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:39.354 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561058+0000", 2024-09-12T18:36:39.354 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0679999999999997e-06 2024-09-12T18:36:39.354 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.354 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.355 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:39.355 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561065+0000", 2024-09-12T18:36:39.355 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1990000000000003e-06 2024-09-12T18:36:39.355 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.355 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.355 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:39.355 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564735+0000", 2024-09-12T18:36:39.355 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0036706740000000001 2024-09-12T18:36:39.355 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.355 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.355 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:39.355 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564868+0000", 2024-09-12T18:36:39.355 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000133003 2024-09-12T18:36:39.355 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.356 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.356 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:39.356 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.565010+0000", 2024-09-12T18:36:39.356 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014224300000000001 2024-09-12T18:36:39.356 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.356 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.356 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:39.356 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.569871+0000", 2024-09-12T18:36:39.356 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0048600759999999996 2024-09-12T18:36:39.356 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.356 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.356 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:39.356 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.582729+0000", 2024-09-12T18:36:39.357 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012858090000000001 2024-09-12T18:36:39.357 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.357 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.357 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:39.357 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.582758+0000", 2024-09-12T18:36:39.357 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.9762999999999999e-05 2024-09-12T18:36:39.357 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.357 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.357 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:39.357 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.582797+0000", 2024-09-12T18:36:39.357 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8615000000000002e-05 2024-09-12T18:36:39.358 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:39.358 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:39.358 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:39.358 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.358 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.358 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:80971 5.2 e39/21 5:4205ebb1:::benchmark_data_smithi073_23739_object80970:head v 39'5054, mlcod=39'5052)", 2024-09-12T18:36:39.358 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:18.564320+0000", 2024-09-12T18:36:39.358 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 20.710233809000002, 2024-09-12T18:36:39.358 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.019963669999999999, 2024-09-12T18:36:39.358 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:39.358 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:39.358 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:39.358 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:39.358 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.359 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:39.359 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564320+0000", 2024-09-12T18:36:39.359 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:39.359 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.359 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.359 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:39.359 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564320+0000", 2024-09-12T18:36:39.359 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:39.359 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.359 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.359 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:39.359 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564321+0000", 2024-09-12T18:36:39.359 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.77e-07 2024-09-12T18:36:39.360 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.360 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.360 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:39.360 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564418+0000", 2024-09-12T18:36:39.360 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.7602000000000005e-05 2024-09-12T18:36:39.360 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.360 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.360 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:39.360 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564427+0000", 2024-09-12T18:36:39.360 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7439999999999996e-06 2024-09-12T18:36:39.360 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.360 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.361 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:39.361 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564442+0000", 2024-09-12T18:36:39.361 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5353e-05 2024-09-12T18:36:39.361 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.361 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.361 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:39.361 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.569512+0000", 2024-09-12T18:36:39.361 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0050701840000000001 2024-09-12T18:36:39.361 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.361 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.361 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:39.362 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.569531+0000", 2024-09-12T18:36:39.362 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8311000000000001e-05 2024-09-12T18:36:39.362 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.362 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.362 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:39.362 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.584246+0000", 2024-09-12T18:36:39.362 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.014714947000000001 2024-09-12T18:36:39.362 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.362 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.362 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:39.362 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.584284+0000", 2024-09-12T18:36:39.363 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8152000000000003e-05 2024-09-12T18:36:39.363 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:39.363 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:39.363 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:39.363 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.363 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.363 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:95657 5.6 5:60d5bc5b:::benchmark_data_smithi073_23739_object95656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:36:39.363 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:25.760171+0000", 2024-09-12T18:36:39.363 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 13.514382618999999, 2024-09-12T18:36:39.363 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018096398999999999, 2024-09-12T18:36:39.363 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:39.363 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:39.363 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:39.363 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:39.364 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:39.364 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:39.364 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 95657 2024-09-12T18:36:39.364 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.364 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:39.364 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.364 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:39.364 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.760171+0000", 2024-09-12T18:36:39.364 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:39.364 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.364 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.364 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:39.364 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.760171+0000", 2024-09-12T18:36:39.365 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:39.365 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.365 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.365 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:39.365 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.760172+0000", 2024-09-12T18:36:39.365 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4600000000000003e-07 2024-09-12T18:36:39.365 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.365 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.365 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:39.365 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.760226+0000", 2024-09-12T18:36:39.365 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.3359999999999997e-05 2024-09-12T18:36:39.366 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.366 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.366 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:39.366 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.760234+0000", 2024-09-12T18:36:39.366 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.4950000000000008e-06 2024-09-12T18:36:39.366 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.366 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.366 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:39.366 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.760240+0000", 2024-09-12T18:36:39.366 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.801e-06 2024-09-12T18:36:39.366 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.366 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.366 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:39.366 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.770465+0000", 2024-09-12T18:36:39.367 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.010224878999999999 2024-09-12T18:36:39.367 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.367 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.367 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:39.367 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.770584+0000", 2024-09-12T18:36:39.367 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000119276 2024-09-12T18:36:39.367 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.367 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.367 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:39.367 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.770735+0000", 2024-09-12T18:36:39.367 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000150994 2024-09-12T18:36:39.367 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.367 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.367 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:39.368 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.775049+0000", 2024-09-12T18:36:39.368 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0043141209999999998 2024-09-12T18:36:39.368 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.368 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.368 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:39.368 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.778195+0000", 2024-09-12T18:36:39.368 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.003145414 2024-09-12T18:36:39.368 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.368 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.368 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:39.368 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.778229+0000", 2024-09-12T18:36:39.368 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4474000000000002e-05 2024-09-12T18:36:39.368 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.368 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.369 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:39.369 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:25.778268+0000", 2024-09-12T18:36:39.369 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8639000000000001e-05 2024-09-12T18:36:39.369 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:39.369 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:39.369 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:39.369 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.369 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.369 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:96980 5.c 5:314954af:::benchmark_data_smithi073_23739_object96979:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:36:39.369 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:26.406647+0000", 2024-09-12T18:36:39.369 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 12.867907444, 2024-09-12T18:36:39.369 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018505462, 2024-09-12T18:36:39.369 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:39.369 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:39.370 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:39.370 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:39.370 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:39.370 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:39.370 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 96980 2024-09-12T18:36:39.370 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.370 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:39.370 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.370 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:39.370 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.406647+0000", 2024-09-12T18:36:39.370 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:39.370 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.370 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.370 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:39.371 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.406647+0000", 2024-09-12T18:36:39.371 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:39.371 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.371 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.371 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:39.371 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.406647+0000", 2024-09-12T18:36:39.371 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4000000000000002e-07 2024-09-12T18:36:39.371 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.371 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.371 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:39.371 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.406705+0000", 2024-09-12T18:36:39.371 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7685000000000001e-05 2024-09-12T18:36:39.371 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.371 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.372 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:39.372 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.406712+0000", 2024-09-12T18:36:39.372 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8120000000000002e-06 2024-09-12T18:36:39.372 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.372 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.372 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:39.372 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.406715+0000", 2024-09-12T18:36:39.372 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.6550000000000002e-06 2024-09-12T18:36:39.372 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.372 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.372 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:39.372 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.417564+0000", 2024-09-12T18:36:39.372 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.010849187999999999 2024-09-12T18:36:39.372 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.373 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.373 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:39.373 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.417648+0000", 2024-09-12T18:36:39.373 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.3924999999999994e-05 2024-09-12T18:36:39.373 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.373 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.373 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:39.373 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.417730+0000", 2024-09-12T18:36:39.373 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2016999999999998e-05 2024-09-12T18:36:39.373 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.373 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.373 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:39.373 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.422225+0000", 2024-09-12T18:36:39.374 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0044943149999999996 2024-09-12T18:36:39.374 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.374 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.374 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:39.374 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.425021+0000", 2024-09-12T18:36:39.374 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0027962479999999999 2024-09-12T18:36:39.374 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.374 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.374 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:39.374 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.425110+0000", 2024-09-12T18:36:39.374 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.8834999999999999e-05 2024-09-12T18:36:39.374 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.374 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.374 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:39.374 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:26.425152+0000", 2024-09-12T18:36:39.375 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2242e-05 2024-09-12T18:36:39.375 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:39.375 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:39.375 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:39.375 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.375 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.375 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:99505 5.c 5:358150bc:::benchmark_data_smithi073_23739_object99504:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:36:39.375 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:27.620043+0000", 2024-09-12T18:36:39.375 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 11.654511407999999, 2024-09-12T18:36:39.375 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.019666044000000001, 2024-09-12T18:36:39.375 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:39.375 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:39.375 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:39.376 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:39.376 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:39.376 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:39.376 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 99505 2024-09-12T18:36:39.376 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.376 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:39.376 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.376 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:39.376 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:27.620043+0000", 2024-09-12T18:36:39.376 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:39.376 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.376 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.376 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:39.376 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:27.620043+0000", 2024-09-12T18:36:39.376 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:39.377 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.377 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.377 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:39.377 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:27.620043+0000", 2024-09-12T18:36:39.377 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5200000000000002e-07 2024-09-12T18:36:39.377 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.377 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.377 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:39.377 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:27.620078+0000", 2024-09-12T18:36:39.377 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.5305000000000002e-05 2024-09-12T18:36:39.377 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.377 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.377 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:39.377 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:27.620085+0000", 2024-09-12T18:36:39.377 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3829999999999997e-06 2024-09-12T18:36:39.378 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.378 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.378 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:39.378 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:27.620090+0000", 2024-09-12T18:36:39.378 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4480000000000002e-06 2024-09-12T18:36:39.378 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.378 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.378 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:39.378 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:27.625971+0000", 2024-09-12T18:36:39.378 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0058812220000000002 2024-09-12T18:36:39.378 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.378 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.378 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:39.378 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:27.626101+0000", 2024-09-12T18:36:39.378 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012965900000000001 2024-09-12T18:36:39.379 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.379 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.379 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:39.379 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:27.626181+0000", 2024-09-12T18:36:39.379 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0408000000000007e-05 2024-09-12T18:36:39.379 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.379 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.379 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:39.379 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:27.632280+0000", 2024-09-12T18:36:39.379 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0060989979999999996 2024-09-12T18:36:39.379 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.379 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.379 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:39.379 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:27.639625+0000", 2024-09-12T18:36:39.379 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0073445810000000002 2024-09-12T18:36:39.380 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.380 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.380 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:39.380 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:27.639671+0000", 2024-09-12T18:36:39.380 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5902999999999997e-05 2024-09-12T18:36:39.380 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.380 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.380 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:39.380 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:27.639709+0000", 2024-09-12T18:36:39.380 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.7685000000000003e-05 2024-09-12T18:36:39.380 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:39.380 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:39.380 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:39.380 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.381 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.381 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:105754 5.a 5:56dab506:::benchmark_data_smithi073_23739_object105753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:36:39.381 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:30.686671+0000", 2024-09-12T18:36:39.381 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 8.5878833100000005, 2024-09-12T18:36:39.381 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018673453999999999, 2024-09-12T18:36:39.381 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:39.381 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:39.381 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:39.381 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:39.381 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:39.381 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:39.381 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 105754 2024-09-12T18:36:39.381 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.381 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:39.381 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.382 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:39.382 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:30.686671+0000", 2024-09-12T18:36:39.382 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:39.382 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.382 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.382 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:39.382 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:30.686671+0000", 2024-09-12T18:36:39.382 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:39.382 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.382 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.382 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:39.382 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:30.686671+0000", 2024-09-12T18:36:39.382 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2699999999999999e-07 2024-09-12T18:36:39.382 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.383 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.383 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:39.383 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:30.686695+0000", 2024-09-12T18:36:39.383 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.37e-05 2024-09-12T18:36:39.383 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.383 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.383 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:39.383 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:30.686702+0000", 2024-09-12T18:36:39.383 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0899999999999999e-06 2024-09-12T18:36:39.383 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.383 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.383 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:39.383 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:30.686707+0000", 2024-09-12T18:36:39.383 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0000000000000004e-06 2024-09-12T18:36:39.384 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.384 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.384 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:39.384 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:30.695226+0000", 2024-09-12T18:36:39.384 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0085186540000000005 2024-09-12T18:36:39.384 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.384 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.384 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:39.384 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:30.695362+0000", 2024-09-12T18:36:39.384 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013635200000000001 2024-09-12T18:36:39.384 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.384 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.385 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:39.385 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:30.695511+0000", 2024-09-12T18:36:39.385 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0001485 2024-09-12T18:36:39.385 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.385 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.385 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:39.385 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:30.701241+0000", 2024-09-12T18:36:39.385 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0057303060000000001 2024-09-12T18:36:39.385 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.385 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.385 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:39.385 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:30.705277+0000", 2024-09-12T18:36:39.385 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0040362879999999999 2024-09-12T18:36:39.386 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.386 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.386 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:39.386 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:30.705306+0000", 2024-09-12T18:36:39.386 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.8779999999999999e-05 2024-09-12T18:36:39.386 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.386 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.386 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:39.386 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:30.705344+0000", 2024-09-12T18:36:39.386 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8157000000000001e-05 2024-09-12T18:36:39.386 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:39.386 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:39.386 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:39.386 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.387 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.387 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:108511 5.6 5:608a30a3:::benchmark_data_smithi073_23739_object108510:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:36:39.387 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:31.986730+0000", 2024-09-12T18:36:39.387 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 7.2878239000000002, 2024-09-12T18:36:39.387 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021507117999999999, 2024-09-12T18:36:39.387 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:39.387 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:39.387 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:39.387 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:39.387 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:39.387 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:39.387 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 108511 2024-09-12T18:36:39.387 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.388 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:39.388 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.388 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:39.388 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986730+0000", 2024-09-12T18:36:39.388 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:39.388 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.388 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.388 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:39.388 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986730+0000", 2024-09-12T18:36:39.388 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:39.388 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.388 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.388 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:39.389 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986731+0000", 2024-09-12T18:36:39.389 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.9100000000000003e-07 2024-09-12T18:36:39.389 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.389 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.389 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:39.389 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986804+0000", 2024-09-12T18:36:39.389 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3647999999999997e-05 2024-09-12T18:36:39.389 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.389 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.389 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:39.389 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986812+0000", 2024-09-12T18:36:39.389 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.34e-06 2024-09-12T18:36:39.390 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.390 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.390 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:39.390 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986836+0000", 2024-09-12T18:36:39.390 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4213e-05 2024-09-12T18:36:39.390 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.390 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.390 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:39.390 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.997047+0000", 2024-09-12T18:36:39.390 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.010210649 2024-09-12T18:36:39.390 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.390 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.390 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:39.391 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.997169+0000", 2024-09-12T18:36:39.391 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012269700000000001 2024-09-12T18:36:39.391 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.391 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.391 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:39.391 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.997300+0000", 2024-09-12T18:36:39.391 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000130858 2024-09-12T18:36:39.391 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.391 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.391 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:39.391 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.002398+0000", 2024-09-12T18:36:39.391 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0050981580000000002 2024-09-12T18:36:39.391 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.392 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.392 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:39.392 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.008093+0000", 2024-09-12T18:36:39.392 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0056941930000000002 2024-09-12T18:36:39.392 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.392 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.392 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:39.392 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.008151+0000", 2024-09-12T18:36:39.392 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8328999999999997e-05 2024-09-12T18:36:39.392 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.392 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.392 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:39.392 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.008237+0000", 2024-09-12T18:36:39.392 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6341999999999994e-05 2024-09-12T18:36:39.393 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:39.393 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:39.393 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:39.393 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.393 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.393 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:108623 5.c 5:33792cd3:::benchmark_data_smithi073_23739_object108622:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:36:39.393 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:32.046609+0000", 2024-09-12T18:36:39.393 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 7.2279451239999997, 2024-09-12T18:36:39.393 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021062860999999999, 2024-09-12T18:36:39.393 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:39.393 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:39.393 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:39.393 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:39.394 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:39.394 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:39.394 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 108623 2024-09-12T18:36:39.394 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.394 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:39.394 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.394 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:39.394 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.046609+0000", 2024-09-12T18:36:39.394 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:39.394 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.394 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.394 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:39.394 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.046609+0000", 2024-09-12T18:36:39.395 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:39.395 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.395 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.395 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:39.395 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.046609+0000", 2024-09-12T18:36:39.395 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.37e-07 2024-09-12T18:36:39.395 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.395 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.395 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:39.395 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.046690+0000", 2024-09-12T18:36:39.395 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0212999999999999e-05 2024-09-12T18:36:39.395 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.395 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.396 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:39.396 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.046698+0000", 2024-09-12T18:36:39.396 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6430000000000001e-06 2024-09-12T18:36:39.396 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.396 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.396 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:39.396 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.046704+0000", 2024-09-12T18:36:39.396 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7699999999999998e-06 2024-09-12T18:36:39.396 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.396 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.396 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:39.396 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.056808+0000", 2024-09-12T18:36:39.396 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.010103562999999999 2024-09-12T18:36:39.396 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.397 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.397 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:39.397 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.056989+0000", 2024-09-12T18:36:39.397 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000181196 2024-09-12T18:36:39.397 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.397 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.397 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:39.397 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.057162+0000", 2024-09-12T18:36:39.397 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000173396 2024-09-12T18:36:39.397 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.397 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.397 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:39.398 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.063269+0000", 2024-09-12T18:36:39.398 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0061066100000000002 2024-09-12T18:36:39.398 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.398 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.398 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:39.398 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.067578+0000", 2024-09-12T18:36:39.398 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0043092570000000004 2024-09-12T18:36:39.398 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.398 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.398 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:39.398 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.067628+0000", 2024-09-12T18:36:39.398 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0136999999999998e-05 2024-09-12T18:36:39.398 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.399 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.399 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:39.399 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.067672+0000", 2024-09-12T18:36:39.399 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3439000000000002e-05 2024-09-12T18:36:39.399 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:39.399 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:39.399 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:39.399 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.399 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.399 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:115360 5.c 5:3eab790c:::benchmark_data_smithi073_23739_object115359:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:36:39.399 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:35.325499+0000", 2024-09-12T18:36:39.399 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 3.9490552000000001, 2024-09-12T18:36:39.399 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.020147082, 2024-09-12T18:36:39.400 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:39.400 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:39.400 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:39.400 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:39.400 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:39.400 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:39.400 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 115360 2024-09-12T18:36:39.400 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.400 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:39.400 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.400 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:39.400 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.325499+0000", 2024-09-12T18:36:39.401 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:39.401 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.401 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.401 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:39.401 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.325499+0000", 2024-09-12T18:36:39.401 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:39.401 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.401 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.401 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:39.401 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.325500+0000", 2024-09-12T18:36:39.401 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.9999999999999996e-07 2024-09-12T18:36:39.401 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.401 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.402 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:39.402 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.325556+0000", 2024-09-12T18:36:39.402 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6665e-05 2024-09-12T18:36:39.402 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.402 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.402 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:39.402 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.325568+0000", 2024-09-12T18:36:39.402 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1311000000000001e-05 2024-09-12T18:36:39.402 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.402 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.402 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:39.402 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.325575+0000", 2024-09-12T18:36:39.402 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.7649999999999993e-06 2024-09-12T18:36:39.402 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.403 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.403 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:39.403 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.327911+0000", 2024-09-12T18:36:39.403 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0023351359999999998 2024-09-12T18:36:39.403 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.403 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.403 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:39.403 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.328046+0000", 2024-09-12T18:36:39.403 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000135444 2024-09-12T18:36:39.403 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.403 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.403 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:39.403 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.328173+0000", 2024-09-12T18:36:39.403 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012734199999999999 2024-09-12T18:36:39.403 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.404 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.404 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:39.404 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.332254+0000", 2024-09-12T18:36:39.404 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0040805320000000004 2024-09-12T18:36:39.404 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.404 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.404 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:39.404 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.345519+0000", 2024-09-12T18:36:39.404 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013265403 2024-09-12T18:36:39.404 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.404 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.404 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:39.404 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.345583+0000", 2024-09-12T18:36:39.405 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3545000000000002e-05 2024-09-12T18:36:39.405 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:39.405 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:39.405 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:39.405 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.345646+0000", 2024-09-12T18:36:39.405 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3039000000000004e-05 2024-09-12T18:36:39.405 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:39.405 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:39.405 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:39.405 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:39.405 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:39.405 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:39.407 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:36:39.408 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:39.399+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:39.424 INFO:teuthology.orchestra.run.smithi073.stdout:moved 0 / 242 (0%) 2024-09-12T18:36:39.425 INFO:teuthology.orchestra.run.smithi073.stdout:avg 80.6667 2024-09-12T18:36:39.425 INFO:teuthology.orchestra.run.smithi073.stdout:stddev 22.4846 -> 22.4846 (expected baseline 7.33333) 2024-09-12T18:36:39.425 INFO:teuthology.orchestra.run.smithi073.stdout:min osd.0 with 49 -> 49 pgs (0.607438 -> 0.607438 * mean) 2024-09-12T18:36:39.425 INFO:teuthology.orchestra.run.smithi073.stdout:max osd.2 with 99 -> 99 pgs (1.22727 -> 1.22727 * mean) 2024-09-12T18:36:39.425 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:36:39.425 INFO:teuthology.orchestra.run.smithi073.stdout:oload 1000 2024-09-12T18:36:39.425 INFO:teuthology.orchestra.run.smithi073.stdout:max_change 3 2024-09-12T18:36:39.425 INFO:teuthology.orchestra.run.smithi073.stdout:max_change_osds 4 2024-09-12T18:36:39.425 INFO:teuthology.orchestra.run.smithi073.stdout:average_utilization 0.0048 2024-09-12T18:36:39.425 INFO:teuthology.orchestra.run.smithi073.stdout:overload_utilization 0.0479 2024-09-12T18:36:39.425 INFO:teuthology.orchestra.run.smithi073.stderr:no change 2024-09-12T18:36:39.507 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:39.503+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:39.538 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:39.538 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-09-12T18:36:39.538 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-09-12T18:36:39.538 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:39.552 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:36:39.609 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:39.606+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:39.668 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:39.668 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-09-12T18:36:39.668 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-09-12T18:36:39.668 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-09-12T18:36:39.668 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:39.682 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:36:39.709 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:39.703+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:39.810 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:39.807+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:39.854 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:39.855 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-09-12T18:36:39.855 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-09-12T18:36:39.855 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:36:39.855 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.855 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:39.855 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:39.855 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 74.217810329000002, 2024-09-12T18:36:39.855 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025088781000000001, 2024-09-12T18:36:39.855 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:39.855 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:39.855 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:39.855 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:39.856 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.856 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:39.856 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:39.856 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:39.856 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.856 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.856 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:39.856 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:39.856 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:39.856 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.856 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.856 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:39.856 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632518+0000", 2024-09-12T18:36:39.857 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:36:39.857 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.857 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.857 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:39.857 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632533+0000", 2024-09-12T18:36:39.857 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5130000000000001e-05 2024-09-12T18:36:39.857 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.857 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.857 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:39.857 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632564+0000", 2024-09-12T18:36:39.857 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0788999999999999e-05 2024-09-12T18:36:39.857 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.857 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.857 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:39.858 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632590+0000", 2024-09-12T18:36:39.858 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6057000000000001e-05 2024-09-12T18:36:39.858 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.858 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.858 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:39.858 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.635931+0000", 2024-09-12T18:36:39.858 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033411320000000001 2024-09-12T18:36:39.858 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.858 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.858 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:39.858 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636186+0000", 2024-09-12T18:36:39.858 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025452500000000002 2024-09-12T18:36:39.858 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.858 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.859 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:39.859 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636445+0000", 2024-09-12T18:36:39.859 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000259268 2024-09-12T18:36:39.859 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.859 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.859 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:39.859 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639562+0000", 2024-09-12T18:36:39.859 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031167 2024-09-12T18:36:39.859 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.859 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.859 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:39.859 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657314+0000", 2024-09-12T18:36:39.859 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017752562 2024-09-12T18:36:39.860 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.860 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.860 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:39.860 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657445+0000", 2024-09-12T18:36:39.860 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013105899999999999 2024-09-12T18:36:39.860 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.860 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.860 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:39.860 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657598+0000", 2024-09-12T18:36:39.860 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015247899999999999 2024-09-12T18:36:39.860 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:39.860 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:39.860 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:39.860 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.861 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.861 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:39.861 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:39.861 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 74.217684125999995, 2024-09-12T18:36:39.861 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025643131999999999, 2024-09-12T18:36:39.861 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:39.861 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:39.861 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:39.861 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:39.861 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.861 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:39.861 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:39.861 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:39.862 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.862 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.862 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:39.862 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:39.862 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:39.862 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.862 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.862 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:39.862 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632637+0000", 2024-09-12T18:36:39.862 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5600000000000001e-06 2024-09-12T18:36:39.862 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.862 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.862 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:39.862 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632650+0000", 2024-09-12T18:36:39.863 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3186e-05 2024-09-12T18:36:39.863 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.863 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.863 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:39.863 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632672+0000", 2024-09-12T18:36:39.863 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2013000000000001e-05 2024-09-12T18:36:39.863 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.863 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.863 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:39.863 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632687+0000", 2024-09-12T18:36:39.863 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5109999999999999e-05 2024-09-12T18:36:39.863 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.863 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.863 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:39.864 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636994+0000", 2024-09-12T18:36:39.864 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0043065539999999998 2024-09-12T18:36:39.864 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.864 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.864 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:39.864 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637198+0000", 2024-09-12T18:36:39.864 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020387199999999999 2024-09-12T18:36:39.864 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.864 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.864 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:39.864 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637475+0000", 2024-09-12T18:36:39.864 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027731000000000001 2024-09-12T18:36:39.864 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.864 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.865 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:39.865 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639574+0000", 2024-09-12T18:36:39.865 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020988999999999999 2024-09-12T18:36:39.865 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.865 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.865 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:39.865 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658057+0000", 2024-09-12T18:36:39.865 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018482926 2024-09-12T18:36:39.865 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.865 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.865 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:39.865 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658184+0000", 2024-09-12T18:36:39.865 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012756200000000001 2024-09-12T18:36:39.866 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.866 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.866 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:39.866 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658278+0000", 2024-09-12T18:36:39.866 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4139000000000001e-05 2024-09-12T18:36:39.866 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:39.866 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:39.866 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:39.866 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.866 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.866 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:39.866 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:39.866 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 74.217609034000006, 2024-09-12T18:36:39.866 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025238883, 2024-09-12T18:36:39.867 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:39.867 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:39.867 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:39.867 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:39.867 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.867 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:39.867 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:39.867 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:39.867 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.867 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.867 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:39.867 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:39.867 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:39.868 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.868 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.868 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:39.868 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632712+0000", 2024-09-12T18:36:39.868 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6869999999999999e-06 2024-09-12T18:36:39.868 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.868 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.868 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:39.868 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632719+0000", 2024-09-12T18:36:39.868 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6059999999999999e-06 2024-09-12T18:36:39.868 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.868 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.868 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:39.868 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632737+0000", 2024-09-12T18:36:39.869 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7983999999999999e-05 2024-09-12T18:36:39.869 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.869 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.869 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:39.869 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632751+0000", 2024-09-12T18:36:39.869 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4473e-05 2024-09-12T18:36:39.869 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.869 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.869 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:39.869 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636961+0000", 2024-09-12T18:36:39.869 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042100840000000002 2024-09-12T18:36:39.869 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.869 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.870 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:39.870 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637211+0000", 2024-09-12T18:36:39.870 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000249738 2024-09-12T18:36:39.870 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.870 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.870 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:39.870 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637504+0000", 2024-09-12T18:36:39.870 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00029271499999999998 2024-09-12T18:36:39.870 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.870 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.870 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:39.870 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639582+0000", 2024-09-12T18:36:39.870 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020783389999999998 2024-09-12T18:36:39.871 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.871 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.871 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:39.871 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657709+0000", 2024-09-12T18:36:39.871 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018126758999999999 2024-09-12T18:36:39.871 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.871 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.871 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:39.871 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657830+0000", 2024-09-12T18:36:39.871 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000121329 2024-09-12T18:36:39.871 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.871 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.871 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:39.871 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657949+0000", 2024-09-12T18:36:39.872 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000119169 2024-09-12T18:36:39.872 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:39.872 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:39.872 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:39.872 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.872 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.872 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:39.872 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:39.872 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 74.217544988, 2024-09-12T18:36:39.872 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026711823999999999, 2024-09-12T18:36:39.872 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:39.872 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:39.872 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:39.872 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:39.873 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.873 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:39.873 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:39.873 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:39.873 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.873 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.873 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:39.873 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:39.873 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:39.873 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.873 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.873 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:39.873 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632775+0000", 2024-09-12T18:36:39.874 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9999999999999995e-07 2024-09-12T18:36:39.874 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.874 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.874 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:39.874 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632788+0000", 2024-09-12T18:36:39.874 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2629999999999999e-05 2024-09-12T18:36:39.874 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.874 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.874 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:39.874 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632806+0000", 2024-09-12T18:36:39.874 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:36:39.874 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.874 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.874 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:39.875 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632820+0000", 2024-09-12T18:36:39.875 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3777e-05 2024-09-12T18:36:39.875 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.875 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.875 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:39.875 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638310+0000", 2024-09-12T18:36:39.875 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054898280000000004 2024-09-12T18:36:39.875 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.875 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.875 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:39.875 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638480+0000", 2024-09-12T18:36:39.875 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016968199999999999 2024-09-12T18:36:39.875 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.875 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.876 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:39.876 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638799+0000", 2024-09-12T18:36:39.876 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031915999999999997 2024-09-12T18:36:39.876 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.876 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.876 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:39.876 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639866+0000", 2024-09-12T18:36:39.876 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001067405 2024-09-12T18:36:39.876 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.876 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.876 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:39.876 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658398+0000", 2024-09-12T18:36:39.876 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018531542000000002 2024-09-12T18:36:39.877 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.877 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.877 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:39.877 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658643+0000", 2024-09-12T18:36:39.877 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00024531500000000002 2024-09-12T18:36:39.877 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.877 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.877 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:39.877 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.659486+0000", 2024-09-12T18:36:39.877 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00084316899999999995 2024-09-12T18:36:39.877 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:39.877 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:39.877 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:39.877 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.878 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.878 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:39.878 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:36:39.878 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 74.217317926000007, 2024-09-12T18:36:39.878 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.021357139000000001, 2024-09-12T18:36:39.878 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:39.878 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:39.878 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:39.878 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:39.878 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.878 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:39.878 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:36:39.878 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:39.879 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.879 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.879 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:39.879 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:36:39.879 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:39.879 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.879 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.879 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:39.879 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633003+0000", 2024-09-12T18:36:39.879 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.53e-06 2024-09-12T18:36:39.879 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.879 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.879 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:39.880 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633012+0000", 2024-09-12T18:36:39.880 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9290000000000004e-06 2024-09-12T18:36:39.880 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.880 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.880 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:39.880 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633034+0000", 2024-09-12T18:36:39.880 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2127e-05 2024-09-12T18:36:39.880 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.880 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.880 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:39.880 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633054+0000", 2024-09-12T18:36:39.880 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9476000000000001e-05 2024-09-12T18:36:39.880 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.881 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.881 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:39.881 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636657+0000", 2024-09-12T18:36:39.881 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036038839999999999 2024-09-12T18:36:39.881 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.881 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.881 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:39.881 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636885+0000", 2024-09-12T18:36:39.881 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022798800000000001 2024-09-12T18:36:39.881 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.881 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.881 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:39.881 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637189+0000", 2024-09-12T18:36:39.882 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030392100000000002 2024-09-12T18:36:39.882 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.882 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.882 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:39.882 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639271+0000", 2024-09-12T18:36:39.882 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020817460000000002 2024-09-12T18:36:39.882 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.882 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.882 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:39.882 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.652371+0000", 2024-09-12T18:36:39.882 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013099417 2024-09-12T18:36:39.882 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.882 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.882 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:39.882 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654255+0000", 2024-09-12T18:36:39.883 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018846049999999999 2024-09-12T18:36:39.883 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.883 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.883 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:39.883 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654359+0000", 2024-09-12T18:36:39.883 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000103516 2024-09-12T18:36:39.883 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:39.883 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:39.883 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:39.883 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.883 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.883 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:39.883 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:39.883 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 74.217236233999998, 2024-09-12T18:36:39.884 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026938645000000001, 2024-09-12T18:36:39.884 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:39.884 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:39.884 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:39.884 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:39.884 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.884 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:39.884 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:39.884 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:39.884 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.884 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.884 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:39.884 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:39.885 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:39.885 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.885 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.885 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:39.885 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633085+0000", 2024-09-12T18:36:39.885 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:39.885 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.885 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.885 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:39.885 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633093+0000", 2024-09-12T18:36:39.885 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3999999999999992e-06 2024-09-12T18:36:39.885 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.885 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.885 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:39.886 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633111+0000", 2024-09-12T18:36:39.886 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8070000000000001e-05 2024-09-12T18:36:39.886 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.886 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.886 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:39.886 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633126+0000", 2024-09-12T18:36:39.886 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4487e-05 2024-09-12T18:36:39.886 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.886 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.886 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:39.886 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638290+0000", 2024-09-12T18:36:39.886 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0051640269999999999 2024-09-12T18:36:39.886 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.887 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.887 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:39.887 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638547+0000", 2024-09-12T18:36:39.887 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025714100000000001 2024-09-12T18:36:39.887 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.887 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.887 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:39.887 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638850+0000", 2024-09-12T18:36:39.887 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030278400000000001 2024-09-12T18:36:39.887 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.887 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.887 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:39.887 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.640706+0000", 2024-09-12T18:36:39.887 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018564580000000001 2024-09-12T18:36:39.888 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.888 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.888 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:39.888 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658420+0000", 2024-09-12T18:36:39.888 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017714395000000001 2024-09-12T18:36:39.888 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.888 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.888 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:39.888 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658635+0000", 2024-09-12T18:36:39.888 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021413500000000001 2024-09-12T18:36:39.888 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.888 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.888 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:39.888 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.660022+0000", 2024-09-12T18:36:39.889 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001387318 2024-09-12T18:36:39.889 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:39.889 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:39.889 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:39.889 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.889 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.889 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:39.889 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:36:39.889 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 74.216891723000003, 2024-09-12T18:36:39.889 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.020709867, 2024-09-12T18:36:39.889 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:39.889 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:39.889 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:39.890 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:39.890 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.890 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:39.890 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:36:39.890 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:39.890 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.890 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.890 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:39.890 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633428+0000", 2024-09-12T18:36:39.890 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:39.890 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.890 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.890 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:39.890 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633429+0000", 2024-09-12T18:36:39.891 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.313e-06 2024-09-12T18:36:39.891 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.891 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.891 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:39.891 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633462+0000", 2024-09-12T18:36:39.891 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3197000000000001e-05 2024-09-12T18:36:39.891 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.891 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.891 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:39.891 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633485+0000", 2024-09-12T18:36:39.891 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3243000000000001e-05 2024-09-12T18:36:39.891 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.891 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.892 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:39.892 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633501+0000", 2024-09-12T18:36:39.892 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5383000000000002e-05 2024-09-12T18:36:39.892 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.892 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.892 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:39.892 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633642+0000", 2024-09-12T18:36:39.892 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000141168 2024-09-12T18:36:39.892 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.892 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.892 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:39.892 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633982+0000", 2024-09-12T18:36:39.892 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000340067 2024-09-12T18:36:39.892 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.893 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.893 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:39.893 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654138+0000", 2024-09-12T18:36:39.893 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.020155495999999998 2024-09-12T18:36:39.893 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:39.893 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:39.893 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:39.893 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.893 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.893 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:49141 5.d 5:bce526e5:::benchmark_data_smithi073_23739_object49140:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T18:36:39.893 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:03.538808+0000", 2024-09-12T18:36:39.893 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 36.311511676999999, 2024-09-12T18:36:39.893 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.019659019, 2024-09-12T18:36:39.894 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:39.894 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:39.894 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:39.894 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:39.894 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:39.894 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:39.894 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 49141 2024-09-12T18:36:39.894 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.894 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:39.894 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.894 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:39.894 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538808+0000", 2024-09-12T18:36:39.894 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:39.894 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.895 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.895 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:39.895 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538808+0000", 2024-09-12T18:36:39.895 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:39.895 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.895 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.895 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:39.895 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538809+0000", 2024-09-12T18:36:39.895 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.065e-06 2024-09-12T18:36:39.895 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.895 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.895 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:39.895 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538914+0000", 2024-09-12T18:36:39.895 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010528599999999999 2024-09-12T18:36:39.896 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.896 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.896 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:39.896 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538924+0000", 2024-09-12T18:36:39.896 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4420000000000004e-06 2024-09-12T18:36:39.896 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.896 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.896 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:39.896 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.538944+0000", 2024-09-12T18:36:39.896 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0460000000000001e-05 2024-09-12T18:36:39.896 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.896 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.896 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:39.896 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.539034+0000", 2024-09-12T18:36:39.896 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9512000000000006e-05 2024-09-12T18:36:39.897 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.897 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.897 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:39.897 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.539161+0000", 2024-09-12T18:36:39.897 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012782399999999999 2024-09-12T18:36:39.897 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.897 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.897 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:39.897 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.539246+0000", 2024-09-12T18:36:39.897 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4927999999999997e-05 2024-09-12T18:36:39.897 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.897 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.897 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:39.898 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.541390+0000", 2024-09-12T18:36:39.898 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0021439509999999998 2024-09-12T18:36:39.898 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.898 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.898 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:39.898 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.558236+0000", 2024-09-12T18:36:39.898 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016845619999999999 2024-09-12T18:36:39.898 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.898 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.898 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:39.898 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.558368+0000", 2024-09-12T18:36:39.898 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013241300000000001 2024-09-12T18:36:39.898 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.898 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.899 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:39.899 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:03.558467+0000", 2024-09-12T18:36:39.899 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8517999999999994e-05 2024-09-12T18:36:39.899 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:39.899 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:39.899 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:39.899 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.899 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.899 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:61561 5.e 5:715fe5e4:::benchmark_data_smithi073_23739_object61560:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:36:39.900 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:09.221864+0000", 2024-09-12T18:36:39.900 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 30.628455261999999, 2024-09-12T18:36:39.900 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017993663999999999, 2024-09-12T18:36:39.900 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:39.900 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:39.900 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:39.900 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:39.900 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:39.900 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:39.900 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 61561 2024-09-12T18:36:39.900 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.900 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:39.900 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.901 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:39.901 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.221864+0000", 2024-09-12T18:36:39.901 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:39.901 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.901 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.901 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:39.901 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.221864+0000", 2024-09-12T18:36:39.901 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:39.901 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.901 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.901 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:39.901 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.221865+0000", 2024-09-12T18:36:39.901 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1310000000000001e-06 2024-09-12T18:36:39.901 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.902 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.902 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:39.902 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222022+0000", 2024-09-12T18:36:39.902 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015628500000000001 2024-09-12T18:36:39.902 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.902 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.902 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:39.902 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222034+0000", 2024-09-12T18:36:39.902 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2481e-05 2024-09-12T18:36:39.902 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.902 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.902 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:39.902 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222041+0000", 2024-09-12T18:36:39.903 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7469999999999999e-06 2024-09-12T18:36:39.903 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.903 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.903 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:39.903 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222103+0000", 2024-09-12T18:36:39.903 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1903999999999995e-05 2024-09-12T18:36:39.903 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.903 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.903 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:39.903 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222199+0000", 2024-09-12T18:36:39.903 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6664999999999997e-05 2024-09-12T18:36:39.903 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.903 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.903 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:39.903 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.222286+0000", 2024-09-12T18:36:39.904 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6582999999999994e-05 2024-09-12T18:36:39.904 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.904 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.904 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:39.904 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.228622+0000", 2024-09-12T18:36:39.904 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063357520000000001 2024-09-12T18:36:39.904 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.904 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.904 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:39.904 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.239753+0000", 2024-09-12T18:36:39.904 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011131709 2024-09-12T18:36:39.904 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.904 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.905 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:39.905 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.239813+0000", 2024-09-12T18:36:39.905 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0007999999999999e-05 2024-09-12T18:36:39.905 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.905 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.905 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:39.905 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:09.239858+0000", 2024-09-12T18:36:39.905 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4399e-05 2024-09-12T18:36:39.905 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:39.905 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:39.905 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:39.905 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.905 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.905 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:77241 5.b 5:d9973dc8:::benchmark_data_smithi073_23739_object77240:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:39.906 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:16.792553+0000", 2024-09-12T18:36:39.906 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.057766053000002, 2024-09-12T18:36:39.906 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.019966754999999999, 2024-09-12T18:36:39.906 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:39.906 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:39.906 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:39.906 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:39.906 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:39.906 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:39.906 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 77241 2024-09-12T18:36:39.906 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.906 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:39.906 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.906 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:39.907 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.792553+0000", 2024-09-12T18:36:39.907 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:39.907 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.907 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.907 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:39.907 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.792553+0000", 2024-09-12T18:36:39.907 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:39.907 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.907 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.907 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:39.907 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.792554+0000", 2024-09-12T18:36:39.907 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.16e-07 2024-09-12T18:36:39.907 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.907 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.908 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:39.908 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.792661+0000", 2024-09-12T18:36:39.908 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000106909 2024-09-12T18:36:39.908 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.908 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.908 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:39.908 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.792671+0000", 2024-09-12T18:36:39.908 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0268000000000001e-05 2024-09-12T18:36:39.908 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.908 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.908 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:39.908 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.792678+0000", 2024-09-12T18:36:39.908 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7510000000000002e-06 2024-09-12T18:36:39.908 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.909 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.909 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:39.909 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.794730+0000", 2024-09-12T18:36:39.909 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002051794 2024-09-12T18:36:39.909 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.909 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.909 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:39.909 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.794857+0000", 2024-09-12T18:36:39.909 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012728500000000001 2024-09-12T18:36:39.909 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.909 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.909 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:39.909 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.794987+0000", 2024-09-12T18:36:39.909 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012996899999999999 2024-09-12T18:36:39.909 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.910 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.910 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:39.910 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.797553+0000", 2024-09-12T18:36:39.910 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025652980000000001 2024-09-12T18:36:39.910 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.910 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.910 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:39.910 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.812460+0000", 2024-09-12T18:36:39.910 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.014907884 2024-09-12T18:36:39.910 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.910 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.910 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:39.910 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.812494+0000", 2024-09-12T18:36:39.910 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3525000000000002e-05 2024-09-12T18:36:39.911 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.911 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.911 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:39.911 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.812520+0000", 2024-09-12T18:36:39.911 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6156000000000002e-05 2024-09-12T18:36:39.911 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:39.911 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:39.911 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:39.911 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.911 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.911 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:77253 5.b 5:df1f7025:::benchmark_data_smithi073_23739_object77252:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:39.911 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:16.798099+0000", 2024-09-12T18:36:39.911 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 23.052220363, 2024-09-12T18:36:39.911 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0182598, 2024-09-12T18:36:39.912 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:39.912 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:39.912 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:39.912 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:39.912 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:39.912 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:39.912 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 77253 2024-09-12T18:36:39.912 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.912 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:39.912 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.912 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:39.912 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798099+0000", 2024-09-12T18:36:39.912 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:39.913 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.913 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.913 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:39.913 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798099+0000", 2024-09-12T18:36:39.913 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:39.913 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.913 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.913 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:39.913 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798100+0000", 2024-09-12T18:36:39.913 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2449999999999999e-06 2024-09-12T18:36:39.913 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.913 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.913 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:39.913 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798159+0000", 2024-09-12T18:36:39.914 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8925999999999998e-05 2024-09-12T18:36:39.914 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.914 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.914 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:39.914 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798171+0000", 2024-09-12T18:36:39.914 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.206e-05 2024-09-12T18:36:39.914 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.914 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.914 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:39.914 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798178+0000", 2024-09-12T18:36:39.914 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9009999999999997e-06 2024-09-12T18:36:39.914 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.914 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.914 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:39.915 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798227+0000", 2024-09-12T18:36:39.915 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8794000000000001e-05 2024-09-12T18:36:39.915 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.915 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.915 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:39.915 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798314+0000", 2024-09-12T18:36:39.915 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7322000000000002e-05 2024-09-12T18:36:39.915 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.915 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.915 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:39.915 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.798417+0000", 2024-09-12T18:36:39.915 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000102777 2024-09-12T18:36:39.915 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.916 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.916 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:39.916 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.800633+0000", 2024-09-12T18:36:39.916 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022157740000000002 2024-09-12T18:36:39.916 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.916 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.916 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:39.916 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.816295+0000", 2024-09-12T18:36:39.916 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015662359000000001 2024-09-12T18:36:39.916 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.916 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.916 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:39.916 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.816330+0000", 2024-09-12T18:36:39.916 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4353999999999997e-05 2024-09-12T18:36:39.917 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.917 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.917 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:39.917 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:16.816359+0000", 2024-09-12T18:36:39.917 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9288000000000001e-05 2024-09-12T18:36:39.917 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:39.917 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:39.917 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:39.920 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.920 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.920 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:80117 5.e 5:713efd60:::benchmark_data_smithi073_23739_object80116:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:36:39.920 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:18.149805+0000", 2024-09-12T18:36:39.921 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 21.700514795, 2024-09-12T18:36:39.921 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018173544, 2024-09-12T18:36:39.921 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:39.921 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:39.921 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:39.921 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:39.921 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:39.921 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:39.921 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 80117 2024-09-12T18:36:39.921 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.921 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:39.921 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.921 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:39.922 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.149805+0000", 2024-09-12T18:36:39.922 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:39.922 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.922 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.922 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:39.922 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.149805+0000", 2024-09-12T18:36:39.922 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:39.922 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.922 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.922 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:39.922 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.149805+0000", 2024-09-12T18:36:39.922 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2399999999999997e-07 2024-09-12T18:36:39.922 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.922 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.923 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:39.923 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.149842+0000", 2024-09-12T18:36:39.923 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6396000000000002e-05 2024-09-12T18:36:39.923 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.923 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.923 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:39.923 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.149855+0000", 2024-09-12T18:36:39.923 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3247999999999999e-05 2024-09-12T18:36:39.923 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.923 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.923 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:39.923 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.149863+0000", 2024-09-12T18:36:39.923 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9189999999999999e-06 2024-09-12T18:36:39.923 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.924 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.924 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:39.924 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.155735+0000", 2024-09-12T18:36:39.924 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0058721600000000004 2024-09-12T18:36:39.924 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.924 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.924 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:39.924 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.155868+0000", 2024-09-12T18:36:39.924 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013283500000000001 2024-09-12T18:36:39.924 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.924 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.924 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:39.924 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.156033+0000", 2024-09-12T18:36:39.925 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016527999999999999 2024-09-12T18:36:39.925 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.925 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.925 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:39.925 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.160797+0000", 2024-09-12T18:36:39.925 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0047638439999999997 2024-09-12T18:36:39.925 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.925 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.925 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:39.925 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.167881+0000", 2024-09-12T18:36:39.925 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0070834670000000004 2024-09-12T18:36:39.925 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.925 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.925 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:39.926 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.167936+0000", 2024-09-12T18:36:39.926 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5473999999999998e-05 2024-09-12T18:36:39.926 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.926 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.926 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:39.926 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:18.167978+0000", 2024-09-12T18:36:39.926 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2097e-05 2024-09-12T18:36:39.926 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:39.926 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:39.926 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:39.926 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.926 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.926 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:88599 5.b 5:d3a6061c:::benchmark_data_smithi073_23739_object88598:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:36:39.927 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:22.263566+0000", 2024-09-12T18:36:39.927 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 17.586753009999999, 2024-09-12T18:36:39.927 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.020416237, 2024-09-12T18:36:39.927 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:39.927 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:39.927 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:39.927 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:39.927 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:39.927 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:39.927 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 88599 2024-09-12T18:36:39.927 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.927 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:39.927 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.927 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:39.928 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.263566+0000", 2024-09-12T18:36:39.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:39.928 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.928 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:39.928 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.263566+0000", 2024-09-12T18:36:39.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:39.928 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.928 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:39.928 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.263567+0000", 2024-09-12T18:36:39.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.088e-06 2024-09-12T18:36:39.928 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.929 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:39.929 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.263654+0000", 2024-09-12T18:36:39.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6632999999999995e-05 2024-09-12T18:36:39.929 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.929 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.929 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:39.929 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.263673+0000", 2024-09-12T18:36:39.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8984e-05 2024-09-12T18:36:39.929 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.929 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.929 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:39.929 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.263681+0000", 2024-09-12T18:36:39.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.371e-06 2024-09-12T18:36:39.930 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.930 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:39.930 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.266963+0000", 2024-09-12T18:36:39.930 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0032810410000000002 2024-09-12T18:36:39.930 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.930 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:39.930 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.267069+0000", 2024-09-12T18:36:39.930 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000106471 2024-09-12T18:36:39.930 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.930 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:39.930 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.267177+0000", 2024-09-12T18:36:39.930 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000108355 2024-09-12T18:36:39.931 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.931 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.931 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:39.931 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.268827+0000", 2024-09-12T18:36:39.931 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016492029999999999 2024-09-12T18:36:39.931 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.931 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.931 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:39.931 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.283931+0000", 2024-09-12T18:36:39.931 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015104783 2024-09-12T18:36:39.931 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.931 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.931 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:39.931 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.283960+0000", 2024-09-12T18:36:39.932 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8401000000000001e-05 2024-09-12T18:36:39.932 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.932 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.932 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:39.932 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.283983+0000", 2024-09-12T18:36:39.932 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2906999999999999e-05 2024-09-12T18:36:39.932 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:39.932 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:39.932 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:39.932 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.932 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.932 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:89277 5.b 5:d689659b:::benchmark_data_smithi073_23739_object89276:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:36:39.932 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:22.590286+0000", 2024-09-12T18:36:39.933 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 17.260033023999998, 2024-09-12T18:36:39.933 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018995509000000001, 2024-09-12T18:36:39.933 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:39.933 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:39.933 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:39.933 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:39.933 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:39.933 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:39.933 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 89277 2024-09-12T18:36:39.933 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.933 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:39.933 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.933 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:39.933 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590286+0000", 2024-09-12T18:36:39.933 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:39.934 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.934 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.934 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:39.934 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590286+0000", 2024-09-12T18:36:39.934 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:39.934 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.934 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.934 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:39.934 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590288+0000", 2024-09-12T18:36:39.934 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.119e-06 2024-09-12T18:36:39.934 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.934 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.934 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:39.934 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590370+0000", 2024-09-12T18:36:39.935 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2025000000000002e-05 2024-09-12T18:36:39.935 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.935 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:39.935 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590380+0000", 2024-09-12T18:36:39.935 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0723999999999999e-05 2024-09-12T18:36:39.935 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.935 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:39.935 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590386+0000", 2024-09-12T18:36:39.935 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.609e-06 2024-09-12T18:36:39.935 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.936 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:39.936 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590444+0000", 2024-09-12T18:36:39.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7667000000000002e-05 2024-09-12T18:36:39.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.936 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.936 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:39.936 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590552+0000", 2024-09-12T18:36:39.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000108402 2024-09-12T18:36:39.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.936 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.936 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:39.936 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.590687+0000", 2024-09-12T18:36:39.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000134602 2024-09-12T18:36:39.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.937 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.937 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:39.937 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.593694+0000", 2024-09-12T18:36:39.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003007249 2024-09-12T18:36:39.937 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.937 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.937 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:39.937 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.609224+0000", 2024-09-12T18:36:39.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015530552 2024-09-12T18:36:39.937 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.937 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.937 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:39.937 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.609256+0000", 2024-09-12T18:36:39.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1838999999999998e-05 2024-09-12T18:36:39.938 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.938 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.938 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:39.938 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:22.609282+0000", 2024-09-12T18:36:39.938 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5721e-05 2024-09-12T18:36:39.938 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:39.938 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:39.938 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:39.938 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.938 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.938 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:95928 5.0 5:0771f238:::benchmark_data_smithi073_23739_object95927:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:36:39.938 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:25.895007+0000", 2024-09-12T18:36:39.938 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 13.955312811000001, 2024-09-12T18:36:39.939 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.02094159, 2024-09-12T18:36:39.939 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:39.939 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:39.939 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:39.939 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:39.939 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:39.939 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:39.939 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 95928 2024-09-12T18:36:39.939 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.939 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:39.939 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.939 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:39.939 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.895007+0000", 2024-09-12T18:36:39.939 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:39.939 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.940 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.940 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:39.940 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.895007+0000", 2024-09-12T18:36:39.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:39.940 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.940 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.940 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:39.940 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.895008+0000", 2024-09-12T18:36:39.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8400000000000002e-07 2024-09-12T18:36:39.940 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.940 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.940 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:39.940 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.895077+0000", 2024-09-12T18:36:39.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9220999999999993e-05 2024-09-12T18:36:39.941 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.941 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.941 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:39.941 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.895089+0000", 2024-09-12T18:36:39.941 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1701e-05 2024-09-12T18:36:39.941 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.941 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.941 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:39.941 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.895095+0000", 2024-09-12T18:36:39.941 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9240000000000001e-06 2024-09-12T18:36:39.941 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.941 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.941 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:39.942 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.902948+0000", 2024-09-12T18:36:39.942 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0078527110000000001 2024-09-12T18:36:39.942 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.942 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:39.942 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.903069+0000", 2024-09-12T18:36:39.942 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000120382 2024-09-12T18:36:39.942 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.942 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:39.942 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.903200+0000", 2024-09-12T18:36:39.942 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000130984 2024-09-12T18:36:39.942 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:39.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.915841+0000", 2024-09-12T18:36:39.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012641177 2024-09-12T18:36:39.943 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:39.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.915853+0000", 2024-09-12T18:36:39.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2707999999999999e-05 2024-09-12T18:36:39.943 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:39.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.915910+0000", 2024-09-12T18:36:39.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6226e-05 2024-09-12T18:36:39.944 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.944 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.944 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:39.944 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:25.915948+0000", 2024-09-12T18:36:39.944 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8572000000000003e-05 2024-09-12T18:36:39.944 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:39.944 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:39.944 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:39.944 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.944 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.944 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:96974 5.4 5:22c5e101:::benchmark_data_smithi073_23739_object96973:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:36:39.944 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:26.404987+0000", 2024-09-12T18:36:39.944 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 13.445332659, 2024-09-12T18:36:39.944 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018218356000000002, 2024-09-12T18:36:39.945 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:39.945 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:39.945 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:39.945 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:39.945 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:39.945 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:39.945 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 96974 2024-09-12T18:36:39.945 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.945 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:39.945 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.945 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:39.945 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.404987+0000", 2024-09-12T18:36:39.945 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:39.946 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.946 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:39.946 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.404987+0000", 2024-09-12T18:36:39.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:39.946 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.946 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:39.946 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.404988+0000", 2024-09-12T18:36:39.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0839999999999999e-06 2024-09-12T18:36:39.946 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.946 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:39.946 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.405025+0000", 2024-09-12T18:36:39.947 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7598000000000002e-05 2024-09-12T18:36:39.947 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.947 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.947 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:39.947 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.405039+0000", 2024-09-12T18:36:39.947 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3614999999999999e-05 2024-09-12T18:36:39.947 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.947 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.947 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:39.947 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.405045+0000", 2024-09-12T18:36:39.947 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7019999999999998e-06 2024-09-12T18:36:39.947 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.947 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:39.948 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.405124+0000", 2024-09-12T18:36:39.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9064000000000001e-05 2024-09-12T18:36:39.948 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:39.948 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.405261+0000", 2024-09-12T18:36:39.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013721499999999999 2024-09-12T18:36:39.948 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:39.948 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.405416+0000", 2024-09-12T18:36:39.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015480499999999999 2024-09-12T18:36:39.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:39.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.410834+0000", 2024-09-12T18:36:39.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054180690000000002 2024-09-12T18:36:39.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:39.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.423115+0000", 2024-09-12T18:36:39.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012280813 2024-09-12T18:36:39.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:39.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.423166+0000", 2024-09-12T18:36:39.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0849000000000001e-05 2024-09-12T18:36:39.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.950 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:39.950 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:26.423205+0000", 2024-09-12T18:36:39.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9542000000000002e-05 2024-09-12T18:36:39.950 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:39.950 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:39.950 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:39.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.950 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:104764 5.0 5:0dfa202d:::benchmark_data_smithi073_23739_object104763:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T18:36:39.950 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:30.213356+0000", 2024-09-12T18:36:39.951 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 9.6369633399999994, 2024-09-12T18:36:39.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018447024999999999, 2024-09-12T18:36:39.951 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:39.951 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:39.951 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:39.951 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:39.951 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:39.951 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:39.951 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 104764 2024-09-12T18:36:39.951 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.951 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:39.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.951 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:39.951 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.213356+0000", 2024-09-12T18:36:39.952 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:39.952 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.952 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.953 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:39.953 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.213356+0000", 2024-09-12T18:36:39.953 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:39.953 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.953 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.953 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:39.953 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.213357+0000", 2024-09-12T18:36:39.953 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7100000000000001e-07 2024-09-12T18:36:39.953 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.953 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.953 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:39.953 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.213403+0000", 2024-09-12T18:36:39.953 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6467000000000001e-05 2024-09-12T18:36:39.954 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.954 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.954 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:39.954 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.213412+0000", 2024-09-12T18:36:39.954 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9649999999999997e-06 2024-09-12T18:36:39.954 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.954 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.954 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:39.954 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.213418+0000", 2024-09-12T18:36:39.954 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1099999999999999e-06 2024-09-12T18:36:39.954 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.954 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.954 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:39.954 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.216358+0000", 2024-09-12T18:36:39.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0029392950000000002 2024-09-12T18:36:39.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:39.955 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.216446+0000", 2024-09-12T18:36:39.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8208000000000007e-05 2024-09-12T18:36:39.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:39.955 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.216542+0000", 2024-09-12T18:36:39.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6206999999999996e-05 2024-09-12T18:36:39.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.956 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:39.956 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.224399+0000", 2024-09-12T18:36:39.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0078571119999999994 2024-09-12T18:36:39.956 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.956 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.956 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:39.956 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.231694+0000", 2024-09-12T18:36:39.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0072948240000000001 2024-09-12T18:36:39.956 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.956 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.956 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:39.956 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.231745+0000", 2024-09-12T18:36:39.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1415999999999997e-05 2024-09-12T18:36:39.957 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.957 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.957 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:39.957 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:30.231803+0000", 2024-09-12T18:36:39.957 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7750000000000001e-05 2024-09-12T18:36:39.957 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:39.957 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:39.957 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:39.957 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.957 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.957 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:116478 5.0 5:0773f155:::benchmark_data_smithi073_23739_object116477:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:36:39.957 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:35.867943+0000", 2024-09-12T18:36:39.957 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 3.9823760909999999, 2024-09-12T18:36:39.957 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018484377, 2024-09-12T18:36:39.958 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:39.958 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:39.958 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:39.958 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:39.958 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:39.958 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:39.958 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 116478 2024-09-12T18:36:39.958 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.958 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:39.958 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.958 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:39.958 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:35.867943+0000", 2024-09-12T18:36:39.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:39.958 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.959 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:39.959 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:35.867943+0000", 2024-09-12T18:36:39.959 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:39.959 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.959 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:39.959 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:35.867944+0000", 2024-09-12T18:36:39.959 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9100000000000003e-07 2024-09-12T18:36:39.959 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.959 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:39.959 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:35.867989+0000", 2024-09-12T18:36:39.959 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4443999999999997e-05 2024-09-12T18:36:39.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.960 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:39.960 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:35.867998+0000", 2024-09-12T18:36:39.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.7000000000000003e-06 2024-09-12T18:36:39.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.960 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:39.960 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:35.868006+0000", 2024-09-12T18:36:39.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6660000000000008e-06 2024-09-12T18:36:39.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.960 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:39.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:35.872241+0000", 2024-09-12T18:36:39.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042350629999999998 2024-09-12T18:36:39.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:39.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:35.872404+0000", 2024-09-12T18:36:39.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000163294 2024-09-12T18:36:39.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:39.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:35.872537+0000", 2024-09-12T18:36:39.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000132461 2024-09-12T18:36:39.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:39.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:35.876871+0000", 2024-09-12T18:36:39.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0043344810000000003 2024-09-12T18:36:39.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:39.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:35.886358+0000", 2024-09-12T18:36:39.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0094868130000000002 2024-09-12T18:36:39.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:39.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:35.886391+0000", 2024-09-12T18:36:39.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3039e-05 2024-09-12T18:36:39.963 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.963 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.963 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:39.963 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:35.886428+0000", 2024-09-12T18:36:39.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6625000000000003e-05 2024-09-12T18:36:39.963 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:39.963 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:39.963 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:39.963 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.963 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.963 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:116480 5.8 5:17fe1cf3:::benchmark_data_smithi073_23739_object116479:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:36:39.963 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:35.868508+0000", 2024-09-12T18:36:39.964 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 3.98181114, 2024-09-12T18:36:39.964 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.020615971, 2024-09-12T18:36:39.964 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:39.964 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:39.964 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:39.964 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:39.964 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:39.964 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:39.964 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 116480 2024-09-12T18:36:39.964 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.964 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:39.964 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.964 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:39.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:35.868508+0000", 2024-09-12T18:36:39.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:39.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:39.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:35.868508+0000", 2024-09-12T18:36:39.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:39.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:39.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:35.868509+0000", 2024-09-12T18:36:39.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.062e-06 2024-09-12T18:36:39.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:39.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:35.868558+0000", 2024-09-12T18:36:39.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8233999999999999e-05 2024-09-12T18:36:39.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:39.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:35.868572+0000", 2024-09-12T18:36:39.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4055e-05 2024-09-12T18:36:39.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:39.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:35.868579+0000", 2024-09-12T18:36:39.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6769999999999995e-06 2024-09-12T18:36:39.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:39.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:35.874404+0000", 2024-09-12T18:36:39.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0058249069999999998 2024-09-12T18:36:39.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:39.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:35.874535+0000", 2024-09-12T18:36:39.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000130984 2024-09-12T18:36:39.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:39.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:35.874675+0000", 2024-09-12T18:36:39.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014022000000000001 2024-09-12T18:36:39.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.968 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:39.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:35.882869+0000", 2024-09-12T18:36:39.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.008193456 2024-09-12T18:36:39.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.968 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:39.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:35.889058+0000", 2024-09-12T18:36:39.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0061895220000000003 2024-09-12T18:36:39.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.968 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:39.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:35.889087+0000", 2024-09-12T18:36:39.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8552999999999999e-05 2024-09-12T18:36:39.969 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:39.969 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:35.889124+0000", 2024-09-12T18:36:39.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7301000000000001e-05 2024-09-12T18:36:39.969 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:39.969 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:39.969 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:39.969 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.969 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:116845 5.b 5:d9e2df84:::benchmark_data_smithi073_23739_object116844:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T18:36:39.969 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:36.049562+0000", 2024-09-12T18:36:39.970 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 3.8007574929999999, 2024-09-12T18:36:39.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018054443999999999, 2024-09-12T18:36:39.970 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:39.970 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:39.970 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:39.970 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:39.970 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:39.970 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:39.970 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 116845 2024-09-12T18:36:39.970 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.970 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:39.970 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.970 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:39.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.049562+0000", 2024-09-12T18:36:39.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:39.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:39.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.049562+0000", 2024-09-12T18:36:39.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:39.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:39.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.049563+0000", 2024-09-12T18:36:39.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0800000000000004e-07 2024-09-12T18:36:39.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:39.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.049637+0000", 2024-09-12T18:36:39.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4635999999999995e-05 2024-09-12T18:36:39.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:39.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.049646+0000", 2024-09-12T18:36:39.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8089999999999999e-06 2024-09-12T18:36:39.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:39.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.049651+0000", 2024-09-12T18:36:39.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.242e-06 2024-09-12T18:36:39.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:39.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.057458+0000", 2024-09-12T18:36:39.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0078063170000000001 2024-09-12T18:36:39.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:39.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.057563+0000", 2024-09-12T18:36:39.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000105438 2024-09-12T18:36:39.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:39.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.057672+0000", 2024-09-12T18:36:39.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000108398 2024-09-12T18:36:39.974 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.974 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:39.974 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.067538+0000", 2024-09-12T18:36:39.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0098668890000000002 2024-09-12T18:36:39.974 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.974 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:39.974 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.067549+0000", 2024-09-12T18:36:39.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0740000000000001e-05 2024-09-12T18:36:39.974 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.974 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:39.974 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.067579+0000", 2024-09-12T18:36:39.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9672999999999999e-05 2024-09-12T18:36:39.975 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:39.975 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:39.975 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:39.975 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:36.067616+0000", 2024-09-12T18:36:39.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7493999999999997e-05 2024-09-12T18:36:39.975 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:39.975 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:39.975 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:39.975 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:39.975 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:39.975 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:39.976 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 54 16 121093 121077 140.12 0 - 0.00689501 2024-09-12T18:36:39.977 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:36:39.978 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:39.976+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:40.077 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:40.076+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:40.114 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:36:40.114 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [], 2024-09-12T18:36:40.114 INFO:teuthology.orchestra.run.smithi162.stdout: "num_ops": 0 2024-09-12T18:36:40.115 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:36:40.133 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:36:40.178 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:40.171+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:40.279 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:40.275+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:40.330 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:36:40.330 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [], 2024-09-12T18:36:40.330 INFO:teuthology.orchestra.run.smithi162.stdout: "complaint_time": 30, 2024-09-12T18:36:40.330 INFO:teuthology.orchestra.run.smithi162.stdout: "num_blocked_ops": 0 2024-09-12T18:36:40.330 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:36:40.354 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:36:40.379 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:40.374+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:40.480 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:40.475+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:40.521 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:36:40.522 INFO:teuthology.orchestra.run.smithi162.stdout: "size": 20, 2024-09-12T18:36:40.522 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 600, 2024-09-12T18:36:40.522 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:36:40.522 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.522 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4154.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:36:40.522 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:36:40.522 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 86.542198197000005, 2024-09-12T18:36:40.522 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025950709999999998, 2024-09-12T18:36:40.522 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:40.522 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:40.522 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:40.522 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:40.523 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4154", 2024-09-12T18:36:40.523 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/745129001", 2024-09-12T18:36:40.523 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 124 2024-09-12T18:36:40.523 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.523 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:40.523 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.523 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:40.523 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:36:40.523 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:40.523 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.523 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.523 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:40.523 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:36:40.523 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:40.524 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.524 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.524 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:40.524 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976562+0000", 2024-09-12T18:36:40.524 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.2999999999999999e-07 2024-09-12T18:36:40.524 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.524 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.524 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:40.524 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976567+0000", 2024-09-12T18:36:40.524 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3430000000000003e-06 2024-09-12T18:36:40.524 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.524 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.525 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:40.525 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976576+0000", 2024-09-12T18:36:40.525 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8070000000000006e-06 2024-09-12T18:36:40.525 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.525 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.525 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:40.525 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976583+0000", 2024-09-12T18:36:40.525 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9959999999999996e-06 2024-09-12T18:36:40.525 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.525 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.525 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:40.525 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997107+0000", 2024-09-12T18:36:40.525 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.020524106 2024-09-12T18:36:40.526 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.526 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.526 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:40.526 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997225+0000", 2024-09-12T18:36:40.526 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000117909 2024-09-12T18:36:40.526 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.526 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.526 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:40.526 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997407+0000", 2024-09-12T18:36:40.526 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00018175900000000001 2024-09-12T18:36:40.526 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.526 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.526 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:40.527 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998839+0000", 2024-09-12T18:36:40.527 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001432539 2024-09-12T18:36:40.527 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.527 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.527 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:40.527 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002319+0000", 2024-09-12T18:36:40.527 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0034803529999999998 2024-09-12T18:36:40.527 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.527 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.527 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:40.527 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002405+0000", 2024-09-12T18:36:40.527 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5434999999999998e-05 2024-09-12T18:36:40.527 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.528 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.528 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:40.528 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002512+0000", 2024-09-12T18:36:40.528 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010663299999999999 2024-09-12T18:36:40.528 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:40.528 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:40.528 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:40.528 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.528 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.528 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:40.528 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:36:40.528 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 74.877400690000002, 2024-09-12T18:36:40.528 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025127867000000002, 2024-09-12T18:36:40.529 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:40.529 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:40.529 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:40.529 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:40.533 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.533 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:40.533 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:36:40.533 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:40.533 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.533 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.533 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:40.533 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:36:40.533 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:40.533 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.533 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.534 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:40.534 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641362+0000", 2024-09-12T18:36:40.534 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.2569999999999999e-06 2024-09-12T18:36:40.534 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.534 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.534 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:40.534 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641374+0000", 2024-09-12T18:36:40.534 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2696e-05 2024-09-12T18:36:40.534 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.534 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.534 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:40.534 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641403+0000", 2024-09-12T18:36:40.534 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.8756999999999999e-05 2024-09-12T18:36:40.535 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.535 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.535 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:40.535 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641430+0000", 2024-09-12T18:36:40.535 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.6452999999999999e-05 2024-09-12T18:36:40.535 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.535 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.535 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:40.535 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641585+0000", 2024-09-12T18:36:40.535 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000155799 2024-09-12T18:36:40.535 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.535 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.535 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:40.536 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641753+0000", 2024-09-12T18:36:40.536 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000167868 2024-09-12T18:36:40.536 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.536 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.536 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:40.536 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641916+0000", 2024-09-12T18:36:40.536 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000162903 2024-09-12T18:36:40.536 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.536 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.536 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:40.536 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653655+0000", 2024-09-12T18:36:40.536 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011738879000000001 2024-09-12T18:36:40.537 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.537 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.537 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:40.537 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665515+0000", 2024-09-12T18:36:40.537 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011859915 2024-09-12T18:36:40.537 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.537 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.537 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:40.537 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665646+0000", 2024-09-12T18:36:40.537 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013122599999999999 2024-09-12T18:36:40.537 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.537 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.537 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:40.538 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666486+0000", 2024-09-12T18:36:40.538 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00084011399999999999 2024-09-12T18:36:40.538 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:40.538 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:40.538 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:40.538 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.538 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.538 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:40.538 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:36:40.538 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 74.877286226999999, 2024-09-12T18:36:40.538 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025384584000000002, 2024-09-12T18:36:40.538 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:40.538 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:40.538 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:40.539 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:40.539 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.539 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:40.539 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:36:40.539 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:40.539 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.539 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.539 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:40.539 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:36:40.539 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:40.539 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.539 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.539 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:40.539 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641474+0000", 2024-09-12T18:36:40.540 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.39e-06 2024-09-12T18:36:40.540 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.540 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.540 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:40.540 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641482+0000", 2024-09-12T18:36:40.540 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3499999999999999e-06 2024-09-12T18:36:40.540 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.540 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.540 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:40.540 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641534+0000", 2024-09-12T18:36:40.540 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2533e-05 2024-09-12T18:36:40.540 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.540 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.541 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:40.541 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641551+0000", 2024-09-12T18:36:40.541 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6515999999999999e-05 2024-09-12T18:36:40.541 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.541 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.541 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:40.541 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642630+0000", 2024-09-12T18:36:40.541 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001079705 2024-09-12T18:36:40.541 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.541 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.541 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:40.541 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642909+0000", 2024-09-12T18:36:40.541 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027859800000000002 2024-09-12T18:36:40.542 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.542 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.542 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:40.542 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643137+0000", 2024-09-12T18:36:40.542 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022803799999999999 2024-09-12T18:36:40.542 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.542 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.542 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:40.542 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653669+0000", 2024-09-12T18:36:40.542 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010532032 2024-09-12T18:36:40.542 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.542 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.542 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:40.542 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666624+0000", 2024-09-12T18:36:40.543 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012954940999999999 2024-09-12T18:36:40.543 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.543 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.543 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:40.543 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666762+0000", 2024-09-12T18:36:40.543 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000137668 2024-09-12T18:36:40.543 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.543 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.543 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:40.543 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666857+0000", 2024-09-12T18:36:40.543 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.5812999999999999e-05 2024-09-12T18:36:40.543 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:40.543 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:40.543 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:40.544 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.544 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.544 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:40.544 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:36:40.544 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 74.877158432000002, 2024-09-12T18:36:40.544 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025661562999999998, 2024-09-12T18:36:40.544 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:40.544 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:40.544 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:40.544 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:40.544 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.544 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:40.544 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:36:40.545 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:40.545 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.545 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.545 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:40.545 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:36:40.545 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:40.545 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.545 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.545 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:40.545 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641602+0000", 2024-09-12T18:36:40.545 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3540000000000001e-06 2024-09-12T18:36:40.545 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.545 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.545 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:40.546 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641637+0000", 2024-09-12T18:36:40.546 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5145999999999999e-05 2024-09-12T18:36:40.546 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.546 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.546 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:40.546 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641659+0000", 2024-09-12T18:36:40.546 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2249999999999999e-05 2024-09-12T18:36:40.546 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.546 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.546 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:40.546 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641675+0000", 2024-09-12T18:36:40.546 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6059999999999999e-05 2024-09-12T18:36:40.547 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.547 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.547 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:40.547 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644570+0000", 2024-09-12T18:36:40.547 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028947069999999998 2024-09-12T18:36:40.547 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.547 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.547 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:40.547 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644900+0000", 2024-09-12T18:36:40.547 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000329401 2024-09-12T18:36:40.547 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.547 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.547 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:40.547 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645235+0000", 2024-09-12T18:36:40.548 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000335874 2024-09-12T18:36:40.548 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.548 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.548 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:40.548 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655459+0000", 2024-09-12T18:36:40.548 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010223441999999999 2024-09-12T18:36:40.548 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.548 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.548 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:40.548 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667028+0000", 2024-09-12T18:36:40.549 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011568673999999999 2024-09-12T18:36:40.549 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.549 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.549 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:40.549 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667163+0000", 2024-09-12T18:36:40.549 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013525500000000001 2024-09-12T18:36:40.549 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.549 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.549 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:40.549 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667262+0000", 2024-09-12T18:36:40.549 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9400000000000004e-05 2024-09-12T18:36:40.549 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:40.550 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:40.550 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:40.550 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.550 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.550 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:40.550 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:36:40.550 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 74.877056612000004, 2024-09-12T18:36:40.550 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025971339, 2024-09-12T18:36:40.550 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:40.550 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:40.550 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:40.550 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:40.550 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.550 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:40.551 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:36:40.551 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:40.551 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.551 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.551 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:40.551 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:36:40.551 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:40.551 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.551 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.551 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:40.551 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641704+0000", 2024-09-12T18:36:40.551 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.297e-06 2024-09-12T18:36:40.551 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.552 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.552 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:40.552 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641712+0000", 2024-09-12T18:36:40.552 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.9060000000000002e-06 2024-09-12T18:36:40.552 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.552 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.552 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:40.552 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641731+0000", 2024-09-12T18:36:40.552 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9083e-05 2024-09-12T18:36:40.552 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.552 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.552 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:40.552 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641745+0000", 2024-09-12T18:36:40.552 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4066999999999999e-05 2024-09-12T18:36:40.553 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.553 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.553 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:40.553 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646529+0000", 2024-09-12T18:36:40.553 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.004784033 2024-09-12T18:36:40.553 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.553 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.553 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:40.553 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646727+0000", 2024-09-12T18:36:40.553 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019841800000000001 2024-09-12T18:36:40.553 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.553 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.553 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:40.553 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647057+0000", 2024-09-12T18:36:40.554 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032926800000000002 2024-09-12T18:36:40.554 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.554 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.554 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:40.554 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655475+0000", 2024-09-12T18:36:40.554 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0084186250000000008 2024-09-12T18:36:40.554 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.554 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.554 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:40.555 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667424+0000", 2024-09-12T18:36:40.555 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011949257 2024-09-12T18:36:40.555 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.555 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.555 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:40.555 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667573+0000", 2024-09-12T18:36:40.555 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014851900000000001 2024-09-12T18:36:40.555 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.555 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.555 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:40.555 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667674+0000", 2024-09-12T18:36:40.555 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010086600000000001 2024-09-12T18:36:40.556 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:40.556 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:40.556 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:40.556 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.556 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.556 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:40.556 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:36:40.556 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 74.876994222999997, 2024-09-12T18:36:40.556 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026215008000000001, 2024-09-12T18:36:40.556 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:40.556 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:40.556 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:40.557 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:40.557 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.557 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:40.557 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:36:40.557 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:40.557 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.557 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.557 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:40.557 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:36:40.557 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:40.557 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.557 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.557 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:40.557 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641766+0000", 2024-09-12T18:36:40.558 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1200000000000001e-06 2024-09-12T18:36:40.558 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.558 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.558 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:40.558 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641775+0000", 2024-09-12T18:36:40.558 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.2499999999999995e-06 2024-09-12T18:36:40.558 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.558 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.558 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:40.558 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641793+0000", 2024-09-12T18:36:40.558 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7773000000000001e-05 2024-09-12T18:36:40.558 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.558 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.558 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:40.559 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641807+0000", 2024-09-12T18:36:40.559 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3814e-05 2024-09-12T18:36:40.559 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.559 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.559 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:40.559 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647626+0000", 2024-09-12T18:36:40.559 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0058193050000000003 2024-09-12T18:36:40.559 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.559 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.559 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:40.559 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647937+0000", 2024-09-12T18:36:40.559 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031112400000000003 2024-09-12T18:36:40.559 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.559 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.560 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:40.560 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648239+0000", 2024-09-12T18:36:40.560 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00030227500000000002 2024-09-12T18:36:40.560 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.560 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.560 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:40.560 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655487+0000", 2024-09-12T18:36:40.560 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072479129999999999 2024-09-12T18:36:40.560 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.560 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.560 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:40.560 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667823+0000", 2024-09-12T18:36:40.560 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012335505 2024-09-12T18:36:40.561 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.561 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.561 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:40.561 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667908+0000", 2024-09-12T18:36:40.561 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4843000000000001e-05 2024-09-12T18:36:40.561 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.561 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.561 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:40.561 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667980+0000", 2024-09-12T18:36:40.561 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2086000000000001e-05 2024-09-12T18:36:40.561 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:40.561 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:40.562 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:40.562 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.562 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.562 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:40.562 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:36:40.562 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 74.876934070000004, 2024-09-12T18:36:40.562 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026483236, 2024-09-12T18:36:40.562 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:40.562 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:40.562 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:40.562 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:40.562 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.562 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:40.562 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:36:40.563 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:40.563 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.563 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.563 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:40.563 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:36:40.563 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:40.563 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.563 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.563 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:40.563 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641826+0000", 2024-09-12T18:36:40.563 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:36:40.563 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.563 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.563 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:40.564 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641832+0000", 2024-09-12T18:36:40.564 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4199999999999998e-06 2024-09-12T18:36:40.564 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.564 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.564 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:40.564 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641848+0000", 2024-09-12T18:36:40.564 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6492999999999999e-05 2024-09-12T18:36:40.564 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.564 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.564 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:40.564 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641863+0000", 2024-09-12T18:36:40.564 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5427e-05 2024-09-12T18:36:40.565 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.565 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.565 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:40.565 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648887+0000", 2024-09-12T18:36:40.565 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0070230860000000004 2024-09-12T18:36:40.565 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.565 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.565 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:40.565 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649111+0000", 2024-09-12T18:36:40.565 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022425799999999999 2024-09-12T18:36:40.565 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.565 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.565 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:40.566 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649494+0000", 2024-09-12T18:36:40.566 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00038349400000000001 2024-09-12T18:36:40.566 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.566 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.566 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:40.566 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655499+0000", 2024-09-12T18:36:40.566 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0060047260000000002 2024-09-12T18:36:40.566 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.566 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.566 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:40.566 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668110+0000", 2024-09-12T18:36:40.566 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012610543 2024-09-12T18:36:40.566 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.566 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.566 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:40.567 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668252+0000", 2024-09-12T18:36:40.567 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014265600000000001 2024-09-12T18:36:40.567 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.567 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.567 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:40.567 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668308+0000", 2024-09-12T18:36:40.567 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5992999999999997e-05 2024-09-12T18:36:40.567 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:40.567 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:40.567 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:40.567 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.567 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.567 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:40.568 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:36:40.568 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 74.876878853999997, 2024-09-12T18:36:40.568 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026605302000000001, 2024-09-12T18:36:40.568 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:40.568 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:40.568 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:40.568 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:40.568 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.568 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:40.568 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:36:40.568 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:40.568 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.568 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.568 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:40.569 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:36:40.569 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:40.569 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.569 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.569 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:40.569 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641881+0000", 2024-09-12T18:36:40.569 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.057e-06 2024-09-12T18:36:40.569 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.569 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.569 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:40.569 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641887+0000", 2024-09-12T18:36:40.569 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.6629999999999998e-06 2024-09-12T18:36:40.569 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.570 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.570 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:40.570 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641903+0000", 2024-09-12T18:36:40.570 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6317e-05 2024-09-12T18:36:40.570 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.570 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.570 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:40.570 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641917+0000", 2024-09-12T18:36:40.570 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3339999999999999e-05 2024-09-12T18:36:40.570 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.570 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.570 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:40.570 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650708+0000", 2024-09-12T18:36:40.571 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.008791419 2024-09-12T18:36:40.571 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.571 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.571 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:40.571 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651021+0000", 2024-09-12T18:36:40.571 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031296699999999999 2024-09-12T18:36:40.571 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.571 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.571 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:40.571 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651349+0000", 2024-09-12T18:36:40.571 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032796499999999999 2024-09-12T18:36:40.571 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.571 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.571 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:40.572 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655742+0000", 2024-09-12T18:36:40.572 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0043934680000000002 2024-09-12T18:36:40.572 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.572 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.572 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:40.572 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668377+0000", 2024-09-12T18:36:40.572 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012634312999999999 2024-09-12T18:36:40.572 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.572 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.572 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:40.572 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668441+0000", 2024-09-12T18:36:40.572 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4369999999999995e-05 2024-09-12T18:36:40.572 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.573 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.573 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:40.573 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668485+0000", 2024-09-12T18:36:40.573 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4422999999999998e-05 2024-09-12T18:36:40.573 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:40.573 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:40.573 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:40.573 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.573 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.573 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:40.573 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:36:40.573 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 74.876821450999998, 2024-09-12T18:36:40.573 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026919499, 2024-09-12T18:36:40.574 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:40.574 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:40.574 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:40.574 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:40.574 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.574 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:40.574 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:36:40.574 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:40.574 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.574 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.574 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:40.574 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:36:40.574 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:40.574 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.575 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.575 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:40.575 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641939+0000", 2024-09-12T18:36:40.575 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9399999999999993e-07 2024-09-12T18:36:40.575 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.575 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.575 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:40.575 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641945+0000", 2024-09-12T18:36:40.575 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9200000000000001e-06 2024-09-12T18:36:40.575 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.575 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.575 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:40.575 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641961+0000", 2024-09-12T18:36:40.576 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6520000000000001e-05 2024-09-12T18:36:40.576 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.576 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.576 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:40.576 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641974+0000", 2024-09-12T18:36:40.576 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3413e-05 2024-09-12T18:36:40.576 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.576 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.576 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:40.576 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654560+0000", 2024-09-12T18:36:40.576 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012585308999999999 2024-09-12T18:36:40.576 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.577 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.577 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:40.577 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654822+0000", 2024-09-12T18:36:40.577 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026210099999999999 2024-09-12T18:36:40.577 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.577 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.577 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:40.577 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655059+0000", 2024-09-12T18:36:40.577 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00023747899999999999 2024-09-12T18:36:40.577 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.577 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.577 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:40.577 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.656315+0000", 2024-09-12T18:36:40.577 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0012555000000000001 2024-09-12T18:36:40.578 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.578 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.578 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:40.578 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668590+0000", 2024-09-12T18:36:40.578 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012274851999999999 2024-09-12T18:36:40.578 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.578 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.578 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:40.578 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668725+0000", 2024-09-12T18:36:40.578 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013524199999999999 2024-09-12T18:36:40.578 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.578 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.579 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:40.579 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668857+0000", 2024-09-12T18:36:40.579 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013216899999999999 2024-09-12T18:36:40.579 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:40.579 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:40.579 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:40.579 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.579 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.579 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:40.579 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:36:40.579 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 74.876767931000003, 2024-09-12T18:36:40.579 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023616723999999999, 2024-09-12T18:36:40.579 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:40.579 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:40.580 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:40.580 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:40.580 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.580 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:40.580 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:36:40.580 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:40.580 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.580 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.580 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:40.580 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:36:40.580 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:40.580 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.580 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.581 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:40.581 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641992+0000", 2024-09-12T18:36:40.581 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.08e-06 2024-09-12T18:36:40.581 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.581 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.581 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:40.581 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641998+0000", 2024-09-12T18:36:40.581 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4299999999999997e-06 2024-09-12T18:36:40.581 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.581 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.581 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:40.581 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642014+0000", 2024-09-12T18:36:40.581 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6266e-05 2024-09-12T18:36:40.582 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.582 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.582 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:40.582 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642026+0000", 2024-09-12T18:36:40.582 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2567e-05 2024-09-12T18:36:40.582 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.582 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.582 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:40.582 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642213+0000", 2024-09-12T18:36:40.582 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00018701899999999999 2024-09-12T18:36:40.582 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.582 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.582 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:40.583 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642507+0000", 2024-09-12T18:36:40.583 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00029394700000000002 2024-09-12T18:36:40.583 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.583 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.583 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:40.583 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642686+0000", 2024-09-12T18:36:40.583 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000178152 2024-09-12T18:36:40.583 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.583 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.583 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:40.583 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650952+0000", 2024-09-12T18:36:40.583 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0082663570000000002 2024-09-12T18:36:40.583 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.583 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.584 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:40.584 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665382+0000", 2024-09-12T18:36:40.584 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.014430111000000001 2024-09-12T18:36:40.584 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.584 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.584 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:40.584 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665508+0000", 2024-09-12T18:36:40.584 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000125986 2024-09-12T18:36:40.584 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.584 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.584 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:40.584 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665608+0000", 2024-09-12T18:36:40.584 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9809000000000006e-05 2024-09-12T18:36:40.585 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:40.585 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:40.585 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:40.585 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.585 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.585 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:40.585 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:36:40.585 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 74.876640065999993, 2024-09-12T18:36:40.585 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024670563, 2024-09-12T18:36:40.585 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:40.585 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:40.585 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:40.585 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:40.585 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.586 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:40.586 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:36:40.586 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:40.586 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.586 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.586 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:40.586 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:36:40.586 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:40.586 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.586 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.586 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:40.586 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642120+0000", 2024-09-12T18:36:40.586 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1769999999999999e-06 2024-09-12T18:36:40.587 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.587 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.587 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:40.587 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642128+0000", 2024-09-12T18:36:40.587 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3429999999999998e-06 2024-09-12T18:36:40.587 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.587 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.587 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:40.587 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642192+0000", 2024-09-12T18:36:40.587 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4406999999999995e-05 2024-09-12T18:36:40.587 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.587 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.587 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:40.588 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642223+0000", 2024-09-12T18:36:40.588 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.1266000000000002e-05 2024-09-12T18:36:40.588 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.588 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.588 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:40.588 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643201+0000", 2024-09-12T18:36:40.588 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0009778390000000001 2024-09-12T18:36:40.588 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.588 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.588 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:40.588 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643410+0000", 2024-09-12T18:36:40.588 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020874199999999999 2024-09-12T18:36:40.588 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.588 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.589 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:40.589 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643685+0000", 2024-09-12T18:36:40.589 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027520700000000002 2024-09-12T18:36:40.589 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.589 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.589 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:40.589 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650966+0000", 2024-09-12T18:36:40.589 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072810710000000001 2024-09-12T18:36:40.589 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.589 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.589 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:40.589 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666560+0000", 2024-09-12T18:36:40.589 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015594143 2024-09-12T18:36:40.589 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.590 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.590 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:40.590 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666691+0000", 2024-09-12T18:36:40.590 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000130359 2024-09-12T18:36:40.590 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.590 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.590 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:40.590 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666790+0000", 2024-09-12T18:36:40.590 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9009e-05 2024-09-12T18:36:40.590 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:40.590 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:40.590 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:40.590 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.590 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.591 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:40.591 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:36:40.591 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 74.875861778000001, 2024-09-12T18:36:40.591 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024891744, 2024-09-12T18:36:40.591 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:40.591 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:40.591 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:40.591 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:40.591 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.591 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:40.591 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:36:40.591 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:40.591 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.592 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.592 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:40.592 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:36:40.592 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:40.592 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.592 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.592 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:40.592 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642899+0000", 2024-09-12T18:36:40.592 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4729999999999999e-06 2024-09-12T18:36:40.592 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.592 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.592 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:40.592 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642912+0000", 2024-09-12T18:36:40.592 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3495999999999999e-05 2024-09-12T18:36:40.593 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.593 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.593 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:40.593 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642934+0000", 2024-09-12T18:36:40.593 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2033999999999999e-05 2024-09-12T18:36:40.593 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.593 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.593 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:40.593 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642949+0000", 2024-09-12T18:36:40.593 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4970000000000001e-05 2024-09-12T18:36:40.593 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.593 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.593 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:40.593 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644400+0000", 2024-09-12T18:36:40.594 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001450305 2024-09-12T18:36:40.594 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.594 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.594 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:40.594 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644617+0000", 2024-09-12T18:36:40.594 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000217302 2024-09-12T18:36:40.594 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.594 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.594 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:40.594 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645052+0000", 2024-09-12T18:36:40.594 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000434797 2024-09-12T18:36:40.594 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.594 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.594 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:40.595 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653860+0000", 2024-09-12T18:36:40.595 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0088082249999999994 2024-09-12T18:36:40.595 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.595 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.595 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:40.595 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667598+0000", 2024-09-12T18:36:40.595 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.013738451 2024-09-12T18:36:40.595 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.595 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.595 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:40.595 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667698+0000", 2024-09-12T18:36:40.595 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9854999999999999e-05 2024-09-12T18:36:40.595 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.595 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.596 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:40.596 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667789+0000", 2024-09-12T18:36:40.596 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0835999999999996e-05 2024-09-12T18:36:40.596 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:40.596 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:40.596 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:40.596 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.596 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.596 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:30 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:40.596 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:36:40.596 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 74.875786962000006, 2024-09-12T18:36:40.596 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023936852000000002, 2024-09-12T18:36:40.596 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:40.596 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:40.597 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:40.597 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:40.597 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.597 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:40.597 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:36:40.597 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:40.597 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.597 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.597 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:40.597 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:36:40.597 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:40.597 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.597 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.598 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:40.598 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642973+0000", 2024-09-12T18:36:40.598 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.11e-06 2024-09-12T18:36:40.598 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.598 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.598 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:40.598 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642994+0000", 2024-09-12T18:36:40.598 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.0699999999999998e-05 2024-09-12T18:36:40.599 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.599 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.599 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:40.599 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643011+0000", 2024-09-12T18:36:40.599 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7229999999999999e-05 2024-09-12T18:36:40.600 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.600 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.600 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:40.600 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643025+0000", 2024-09-12T18:36:40.600 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3803e-05 2024-09-12T18:36:40.600 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.600 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.600 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:40.600 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643143+0000", 2024-09-12T18:36:40.600 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000118225 2024-09-12T18:36:40.600 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.600 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.600 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:40.601 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643426+0000", 2024-09-12T18:36:40.601 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00028250500000000001 2024-09-12T18:36:40.601 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.601 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.601 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:40.601 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643864+0000", 2024-09-12T18:36:40.601 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00043856 2024-09-12T18:36:40.601 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.601 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.601 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:40.601 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651148+0000", 2024-09-12T18:36:40.601 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072836769999999997 2024-09-12T18:36:40.601 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.601 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.602 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:40.602 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666674+0000", 2024-09-12T18:36:40.602 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015525786999999999 2024-09-12T18:36:40.602 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.602 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.602 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:40.602 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666796+0000", 2024-09-12T18:36:40.602 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000122416 2024-09-12T18:36:40.602 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.602 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.602 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:40.602 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666909+0000", 2024-09-12T18:36:40.602 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011283899999999999 2024-09-12T18:36:40.603 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:40.603 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:40.603 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:40.603 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.603 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.603 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:40.603 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:36:40.603 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 74.875704256000006, 2024-09-12T18:36:40.603 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024100234000000002, 2024-09-12T18:36:40.603 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:40.603 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:40.603 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:40.603 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:40.603 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.604 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:40.604 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:36:40.604 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:40.604 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.604 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.604 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:40.604 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:36:40.604 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:40.604 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.604 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.604 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:40.604 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643056+0000", 2024-09-12T18:36:40.604 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.046e-06 2024-09-12T18:36:40.604 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.605 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.605 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:40.605 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643068+0000", 2024-09-12T18:36:40.605 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2106999999999999e-05 2024-09-12T18:36:40.605 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.605 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.605 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:40.605 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643085+0000", 2024-09-12T18:36:40.605 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7479999999999999e-05 2024-09-12T18:36:40.605 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.605 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.605 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:40.605 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643099+0000", 2024-09-12T18:36:40.606 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3730000000000001e-05 2024-09-12T18:36:40.606 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.606 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.606 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:40.606 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644623+0000", 2024-09-12T18:36:40.606 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0015236080000000001 2024-09-12T18:36:40.606 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.606 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.606 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:40.606 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644893+0000", 2024-09-12T18:36:40.606 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026990500000000003 2024-09-12T18:36:40.606 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.606 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.606 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:40.607 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645227+0000", 2024-09-12T18:36:40.607 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00033391300000000003 2024-09-12T18:36:40.607 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.607 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.607 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:40.607 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653926+0000", 2024-09-12T18:36:40.607 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0086993339999999995 2024-09-12T18:36:40.607 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.607 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.607 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:40.607 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666925+0000", 2024-09-12T18:36:40.607 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012998686000000001 2024-09-12T18:36:40.607 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.607 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.608 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:40.608 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667057+0000", 2024-09-12T18:36:40.608 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013255600000000001 2024-09-12T18:36:40.608 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.608 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.608 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:40.608 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667155+0000", 2024-09-12T18:36:40.608 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7868999999999994e-05 2024-09-12T18:36:40.608 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:40.608 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:40.608 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:40.608 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.608 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.609 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:40.609 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:36:40.609 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 74.875508467000003, 2024-09-12T18:36:40.609 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024255982999999998, 2024-09-12T18:36:40.609 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:40.609 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:40.609 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:40.609 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:40.609 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.609 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:40.609 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:36:40.609 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:40.609 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.609 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.610 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:40.610 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:36:40.610 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:40.610 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.610 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.610 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:40.610 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643252+0000", 2024-09-12T18:36:40.610 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:40.610 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.610 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.610 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:40.610 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643287+0000", 2024-09-12T18:36:40.610 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5225999999999998e-05 2024-09-12T18:36:40.611 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.611 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.611 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:40.611 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643323+0000", 2024-09-12T18:36:40.611 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5488999999999999e-05 2024-09-12T18:36:40.611 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.611 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.611 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:40.611 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643357+0000", 2024-09-12T18:36:40.611 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.3853999999999998e-05 2024-09-12T18:36:40.611 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.611 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.611 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:40.611 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646716+0000", 2024-09-12T18:36:40.612 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003359 2024-09-12T18:36:40.612 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.612 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.612 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:40.612 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647037+0000", 2024-09-12T18:36:40.612 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032131800000000002 2024-09-12T18:36:40.612 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.612 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.612 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:40.612 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647337+0000", 2024-09-12T18:36:40.612 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000300208 2024-09-12T18:36:40.612 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.612 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.612 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:40.613 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654291+0000", 2024-09-12T18:36:40.613 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0069543089999999997 2024-09-12T18:36:40.613 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.613 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.613 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:40.613 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667297+0000", 2024-09-12T18:36:40.613 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.013005526 2024-09-12T18:36:40.613 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.613 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.613 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:40.613 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667416+0000", 2024-09-12T18:36:40.613 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000119416 2024-09-12T18:36:40.614 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.614 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.614 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:40.614 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667507+0000", 2024-09-12T18:36:40.614 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0206999999999999e-05 2024-09-12T18:36:40.614 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:40.614 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:40.614 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:40.614 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.614 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.614 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:40.614 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:36:40.614 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 74.875381372000007, 2024-09-12T18:36:40.614 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023888482999999999, 2024-09-12T18:36:40.615 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:40.615 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:40.615 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:40.615 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:40.615 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.615 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:40.615 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:36:40.615 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:40.615 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.615 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.615 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:40.615 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:36:40.615 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:40.615 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.616 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.616 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:40.616 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643379+0000", 2024-09-12T18:36:40.616 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.207e-06 2024-09-12T18:36:40.616 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.616 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.616 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:40.616 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643390+0000", 2024-09-12T18:36:40.616 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0696000000000001e-05 2024-09-12T18:36:40.616 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.616 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.616 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:40.616 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643407+0000", 2024-09-12T18:36:40.616 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7563000000000001e-05 2024-09-12T18:36:40.617 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.617 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.617 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:40.617 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643420+0000", 2024-09-12T18:36:40.617 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3277e-05 2024-09-12T18:36:40.617 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.617 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.617 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:40.617 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644906+0000", 2024-09-12T18:36:40.617 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001485945 2024-09-12T18:36:40.617 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.617 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.617 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:40.617 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645404+0000", 2024-09-12T18:36:40.618 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00049807599999999997 2024-09-12T18:36:40.618 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.618 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.618 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:40.618 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645846+0000", 2024-09-12T18:36:40.618 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00044190400000000002 2024-09-12T18:36:40.618 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.618 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.618 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:40.618 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654223+0000", 2024-09-12T18:36:40.618 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0083767419999999995 2024-09-12T18:36:40.618 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.618 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.618 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:40.619 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667026+0000", 2024-09-12T18:36:40.619 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012802531000000001 2024-09-12T18:36:40.619 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.619 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.619 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:40.619 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667162+0000", 2024-09-12T18:36:40.619 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000136112 2024-09-12T18:36:40.619 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.619 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.619 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:40.619 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667266+0000", 2024-09-12T18:36:40.619 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010443 2024-09-12T18:36:40.619 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:40.619 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:40.620 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:40.620 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.620 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.620 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:40.620 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:36:40.620 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 74.875230653000003, 2024-09-12T18:36:40.620 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024222582999999999, 2024-09-12T18:36:40.620 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:40.620 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:40.620 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:40.620 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:40.620 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.620 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:40.621 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:36:40.621 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:40.621 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.621 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.621 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:40.621 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:36:40.621 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:40.621 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.621 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.621 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:40.621 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643530+0000", 2024-09-12T18:36:40.621 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.393e-06 2024-09-12T18:36:40.621 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.621 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.622 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:40.622 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643536+0000", 2024-09-12T18:36:40.622 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4130000000000003e-06 2024-09-12T18:36:40.622 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.622 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.622 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:40.622 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643554+0000", 2024-09-12T18:36:40.622 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7572999999999999e-05 2024-09-12T18:36:40.622 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.622 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.622 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:40.622 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643567+0000", 2024-09-12T18:36:40.622 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3393999999999999e-05 2024-09-12T18:36:40.622 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.623 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.623 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:40.623 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648198+0000", 2024-09-12T18:36:40.623 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0046304479999999997 2024-09-12T18:36:40.623 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.623 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.623 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:40.623 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648413+0000", 2024-09-12T18:36:40.623 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00021507500000000001 2024-09-12T18:36:40.623 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.623 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.623 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:40.623 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667751+0000", 2024-09-12T18:36:40.623 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.019338286999999999 2024-09-12T18:36:40.624 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:40.624 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:40.624 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:40.624 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.624 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.624 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:115344 5.1 5:8e7d96ac:::benchmark_data_smithi073_23739_object115343:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:36:40.624 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:35.318284+0000", 2024-09-12T18:36:40.624 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 5.2004755129999998, 2024-09-12T18:36:40.624 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.022845300999999998, 2024-09-12T18:36:40.624 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:40.624 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:40.624 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:40.624 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:40.624 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:40.625 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:40.625 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 115344 2024-09-12T18:36:40.625 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.625 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:40.625 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.625 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:40.625 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.318284+0000", 2024-09-12T18:36:40.625 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:40.625 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.625 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.625 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:40.625 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.318284+0000", 2024-09-12T18:36:40.625 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:40.625 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.626 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.626 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:40.626 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.318284+0000", 2024-09-12T18:36:40.626 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9999999999999997e-07 2024-09-12T18:36:40.626 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.626 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.626 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:40.626 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.318351+0000", 2024-09-12T18:36:40.626 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.7253000000000001e-05 2024-09-12T18:36:40.626 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.626 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.626 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:40.626 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.318361+0000", 2024-09-12T18:36:40.626 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0499999999999997e-06 2024-09-12T18:36:40.627 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.627 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.627 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:40.627 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.318367+0000", 2024-09-12T18:36:40.627 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.5339999999999996e-06 2024-09-12T18:36:40.627 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.627 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.627 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:40.627 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.323502+0000", 2024-09-12T18:36:40.627 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0051345490000000004 2024-09-12T18:36:40.627 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.627 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.627 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:40.627 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.323614+0000", 2024-09-12T18:36:40.628 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011212 2024-09-12T18:36:40.628 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.628 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.628 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:40.628 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.323702+0000", 2024-09-12T18:36:40.628 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8067999999999998e-05 2024-09-12T18:36:40.628 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.628 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.628 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:40.628 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.328859+0000", 2024-09-12T18:36:40.628 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0051567970000000003 2024-09-12T18:36:40.628 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.629 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.630 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:40.630 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.341004+0000", 2024-09-12T18:36:40.630 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012145606 2024-09-12T18:36:40.630 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.630 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.630 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:40.630 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.341074+0000", 2024-09-12T18:36:40.630 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9499999999999995e-05 2024-09-12T18:36:40.630 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.630 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.630 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:40.631 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.341129+0000", 2024-09-12T18:36:40.631 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5124000000000003e-05 2024-09-12T18:36:40.631 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:40.631 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:40.631 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:40.631 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.631 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.631 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:121106 5.d e50/21 5:b4a9a221:::benchmark_data_smithi073_23739_object121105:head v 50'7658, mlcod=48'7656)", 2024-09-12T18:36:40.631 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:40.238637+0000", 2024-09-12T18:36:40.631 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.28012205200000001, 2024-09-12T18:36:40.631 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.033154694999999998, 2024-09-12T18:36:40.631 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:40.632 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:40.632 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:40.632 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:40.632 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.632 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:40.632 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238637+0000", 2024-09-12T18:36:40.632 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:40.632 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.632 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.632 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:40.632 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238637+0000", 2024-09-12T18:36:40.632 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:40.632 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.633 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.633 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:40.633 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238639+0000", 2024-09-12T18:36:40.633 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.8560000000000001e-06 2024-09-12T18:36:40.633 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.633 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.633 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:40.633 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238723+0000", 2024-09-12T18:36:40.633 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4314999999999995e-05 2024-09-12T18:36:40.634 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.634 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.634 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:40.634 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238753+0000", 2024-09-12T18:36:40.634 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.9726e-05 2024-09-12T18:36:40.634 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.634 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.634 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:40.634 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238773+0000", 2024-09-12T18:36:40.634 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9789e-05 2024-09-12T18:36:40.634 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.634 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.634 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:40.635 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.241557+0000", 2024-09-12T18:36:40.635 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0027843910000000002 2024-09-12T18:36:40.635 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.635 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.635 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:40.635 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.241581+0000", 2024-09-12T18:36:40.635 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.4224999999999999e-05 2024-09-12T18:36:40.635 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.635 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.635 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:40.635 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.271722+0000", 2024-09-12T18:36:40.635 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.030141194 2024-09-12T18:36:40.635 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.636 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.636 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:40.636 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.271792+0000", 2024-09-12T18:36:40.636 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9198999999999999e-05 2024-09-12T18:36:40.636 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:40.636 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:40.636 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:40.636 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.636 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.636 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:121110 5.2 5:4dc37b93:::benchmark_data_smithi073_23739_object121109:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:40.636 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:40.241070+0000", 2024-09-12T18:36:40.636 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.27768895799999999, 2024-09-12T18:36:40.636 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023075783999999998, 2024-09-12T18:36:40.637 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:40.637 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:40.637 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:40.637 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:40.637 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:40.637 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:40.637 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 121110 2024-09-12T18:36:40.637 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.637 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:40.637 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.637 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:40.637 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.241070+0000", 2024-09-12T18:36:40.637 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:40.638 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.638 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.638 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:40.638 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.241070+0000", 2024-09-12T18:36:40.638 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:40.638 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.638 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.638 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:40.638 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.241072+0000", 2024-09-12T18:36:40.639 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.858e-06 2024-09-12T18:36:40.639 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.639 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.639 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:40.639 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.241123+0000", 2024-09-12T18:36:40.639 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1511000000000002e-05 2024-09-12T18:36:40.639 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.640 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.640 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:40.640 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.241151+0000", 2024-09-12T18:36:40.640 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.7616000000000001e-05 2024-09-12T18:36:40.640 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.640 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.640 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:40.641 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.241162+0000", 2024-09-12T18:36:40.641 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.136e-05 2024-09-12T18:36:40.641 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.641 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.641 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:40.641 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.241228+0000", 2024-09-12T18:36:40.641 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.5988999999999994e-05 2024-09-12T18:36:40.641 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.641 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.641 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:40.641 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.241389+0000", 2024-09-12T18:36:40.641 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000161001 2024-09-12T18:36:40.641 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.641 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.642 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:40.642 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.241803+0000", 2024-09-12T18:36:40.642 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00041360000000000002 2024-09-12T18:36:40.642 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.642 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.642 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:40.642 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.252025+0000", 2024-09-12T18:36:40.642 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010221768000000001 2024-09-12T18:36:40.642 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.642 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.642 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:40.642 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.264034+0000", 2024-09-12T18:36:40.642 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012009136 2024-09-12T18:36:40.643 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.643 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.643 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:40.643 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.264095+0000", 2024-09-12T18:36:40.643 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.1148999999999993e-05 2024-09-12T18:36:40.643 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:40.643 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:40.643 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:40.643 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.264146+0000", 2024-09-12T18:36:40.643 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.0796e-05 2024-09-12T18:36:40.643 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:40.643 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:40.643 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:40.644 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:40.644 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:40.644 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:36:40.645 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:36:40.646 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:40.642+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:40.747 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:40.739+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:40.802 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:40.802 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:36:40.802 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.803 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:122159 5.6 5:6086a592:::benchmark_data_smithi073_23739_object122158:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:40.803 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:40.793756+0000", 2024-09-12T18:36:40.803 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0064384840000000004, 2024-09-12T18:36:40.803 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.006458671, 2024-09-12T18:36:40.803 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:40.803 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:40.803 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:40.803 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:40.803 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:40.803 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:40.804 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 122159 2024-09-12T18:36:40.804 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.804 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:40.804 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.804 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:40.804 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.793756+0000", 2024-09-12T18:36:40.804 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:40.805 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.805 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.805 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:40.805 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.793756+0000", 2024-09-12T18:36:40.805 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:40.805 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.805 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.805 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:40.805 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.793757+0000", 2024-09-12T18:36:40.805 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6499999999999998e-07 2024-09-12T18:36:40.805 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.805 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.805 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:40.806 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.793837+0000", 2024-09-12T18:36:40.806 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0273999999999997e-05 2024-09-12T18:36:40.806 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.806 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.806 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:40.806 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.793849+0000", 2024-09-12T18:36:40.806 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2567e-05 2024-09-12T18:36:40.806 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.806 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.806 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:40.806 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.793858+0000", 2024-09-12T18:36:40.806 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.4190000000000002e-06 2024-09-12T18:36:40.806 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.807 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.807 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:40.807 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.793924+0000", 2024-09-12T18:36:40.807 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6512000000000003e-05 2024-09-12T18:36:40.807 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.807 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.807 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:40.807 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.794056+0000", 2024-09-12T18:36:40.807 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000131447 2024-09-12T18:36:40.807 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.807 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.807 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:40.807 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.794178+0000", 2024-09-12T18:36:40.808 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012262199999999999 2024-09-12T18:36:40.808 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:40.808 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:40.808 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:40.808 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.808 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.808 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:122164 5.6 5:6dfaf05a:::benchmark_data_smithi073_23739_object122163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:40.808 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:40.797190+0000", 2024-09-12T18:36:40.808 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00300381, 2024-09-12T18:36:40.808 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.003069287, 2024-09-12T18:36:40.808 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:40.808 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:40.809 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:40.809 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:40.809 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:40.809 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:40.809 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 122164 2024-09-12T18:36:40.809 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.809 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:40.809 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.809 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:40.810 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.797190+0000", 2024-09-12T18:36:40.810 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:40.810 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.810 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.810 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:40.810 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.797190+0000", 2024-09-12T18:36:40.810 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:40.810 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.810 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.810 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:40.810 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.797192+0000", 2024-09-12T18:36:40.810 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.623e-06 2024-09-12T18:36:40.810 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.811 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.811 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:40.811 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.797257+0000", 2024-09-12T18:36:40.811 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5417000000000001e-05 2024-09-12T18:36:40.811 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.811 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.811 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:40.811 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.797267+0000", 2024-09-12T18:36:40.811 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.5680000000000005e-06 2024-09-12T18:36:40.811 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.811 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.811 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:40.812 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.797275+0000", 2024-09-12T18:36:40.812 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4569999999999999e-06 2024-09-12T18:36:40.812 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.812 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.812 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:40.812 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.797315+0000", 2024-09-12T18:36:40.812 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0433999999999999e-05 2024-09-12T18:36:40.812 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.812 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.812 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:40.812 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.797416+0000", 2024-09-12T18:36:40.812 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000101047 2024-09-12T18:36:40.813 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.813 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.813 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:40.813 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.797511+0000", 2024-09-12T18:36:40.813 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4648000000000006e-05 2024-09-12T18:36:40.813 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:40.813 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:40.813 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:40.813 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.813 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.813 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:122167 5.6 5.a6697f16 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:40.813 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:40.798057+0000", 2024-09-12T18:36:40.814 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0021377259999999999, 2024-09-12T18:36:40.814 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0022508210000000001, 2024-09-12T18:36:40.814 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:40.814 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:40.814 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:40.814 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:40.814 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:40.814 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:40.814 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 122167 2024-09-12T18:36:40.814 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.814 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:40.814 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.815 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:40.815 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.798057+0000", 2024-09-12T18:36:40.815 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:40.815 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.815 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.815 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:40.815 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.798057+0000", 2024-09-12T18:36:40.815 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:40.815 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.815 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.815 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:40.815 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.798058+0000", 2024-09-12T18:36:40.815 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.7199999999999997e-07 2024-09-12T18:36:40.815 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.816 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.816 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:40.816 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.798101+0000", 2024-09-12T18:36:40.816 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3820999999999999e-05 2024-09-12T18:36:40.816 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.816 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.816 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:40.816 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.798118+0000", 2024-09-12T18:36:40.816 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6424000000000001e-05 2024-09-12T18:36:40.816 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.816 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.816 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:40.817 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.798125+0000", 2024-09-12T18:36:40.817 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4760000000000001e-06 2024-09-12T18:36:40.817 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:40.817 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:40.817 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:40.817 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.817 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.817 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:122169 5.c 5:3f973c11:::benchmark_data_smithi073_23739_object122168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:40.817 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:40.798169+0000", 2024-09-12T18:36:40.817 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0020251319999999998, 2024-09-12T18:36:40.818 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0021877649999999999, 2024-09-12T18:36:40.818 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:40.818 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:40.818 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:40.818 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:40.818 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:40.818 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:40.818 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 122169 2024-09-12T18:36:40.818 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.819 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:40.819 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.819 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:40.819 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.798169+0000", 2024-09-12T18:36:40.819 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:40.819 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.819 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.819 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:40.819 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.798169+0000", 2024-09-12T18:36:40.819 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:40.819 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.819 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.820 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:40.820 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.798170+0000", 2024-09-12T18:36:40.820 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3399999999999998e-07 2024-09-12T18:36:40.820 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.820 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.820 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:40.820 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.798203+0000", 2024-09-12T18:36:40.820 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.2731000000000002e-05 2024-09-12T18:36:40.820 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.820 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.820 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:40.820 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.798211+0000", 2024-09-12T18:36:40.820 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.174e-06 2024-09-12T18:36:40.821 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.821 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.821 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:40.821 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.798219+0000", 2024-09-12T18:36:40.821 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5629999999999992e-06 2024-09-12T18:36:40.821 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.821 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.821 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:40.821 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.798271+0000", 2024-09-12T18:36:40.821 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1363999999999998e-05 2024-09-12T18:36:40.821 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.821 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.822 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:40.822 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.798389+0000", 2024-09-12T18:36:40.822 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000118532 2024-09-12T18:36:40.822 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.822 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.822 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:40.822 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.798506+0000", 2024-09-12T18:36:40.822 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000116424 2024-09-12T18:36:40.822 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:40.822 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:40.822 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:40.822 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.822 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.822 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:122166 5.4 e50/21 5:22a9b4e7:::benchmark_data_smithi073_23739_object122165:head v 50'7582, mlcod=50'7580)", 2024-09-12T18:36:40.823 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:40.798262+0000", 2024-09-12T18:36:40.823 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.001931936, 2024-09-12T18:36:40.823 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0021612329999999998, 2024-09-12T18:36:40.823 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:40.823 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:40.823 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:40.823 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:40.823 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.823 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:40.823 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.798262+0000", 2024-09-12T18:36:40.823 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:40.823 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.823 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.824 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:40.824 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.798262+0000", 2024-09-12T18:36:40.824 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:40.824 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.824 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.824 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:40.824 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.798263+0000", 2024-09-12T18:36:40.824 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.61e-07 2024-09-12T18:36:40.824 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.824 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.824 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:40.824 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.798305+0000", 2024-09-12T18:36:40.824 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2301e-05 2024-09-12T18:36:40.824 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.825 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.825 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:40.825 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.798316+0000", 2024-09-12T18:36:40.825 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0719e-05 2024-09-12T18:36:40.825 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.825 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.825 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:40.825 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.798322+0000", 2024-09-12T18:36:40.825 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1120000000000001e-06 2024-09-12T18:36:40.825 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.825 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.825 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:40.825 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.798372+0000", 2024-09-12T18:36:40.826 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9327999999999999e-05 2024-09-12T18:36:40.826 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.826 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.826 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:40.826 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.798392+0000", 2024-09-12T18:36:40.826 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.0237e-05 2024-09-12T18:36:40.826 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:40.826 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:40.826 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:40.826 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.826 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.826 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:122168 5.2 e50/21 5:4fd1fcd1:::benchmark_data_smithi073_23739_object122167:head v 50'7576, mlcod=50'7574)", 2024-09-12T18:36:40.826 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:40.798737+0000", 2024-09-12T18:36:40.826 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0014573419999999999, 2024-09-12T18:36:40.827 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017181799999999999, 2024-09-12T18:36:40.827 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:40.827 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:40.827 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:40.827 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:40.827 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.827 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:40.827 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.798737+0000", 2024-09-12T18:36:40.827 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:40.827 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.827 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.827 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:40.827 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.798737+0000", 2024-09-12T18:36:40.827 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:40.828 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.828 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.828 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:40.828 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.798738+0000", 2024-09-12T18:36:40.828 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8800000000000002e-07 2024-09-12T18:36:40.828 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.828 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.828 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:40.828 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.798839+0000", 2024-09-12T18:36:40.828 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00010158900000000001 2024-09-12T18:36:40.828 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.828 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.828 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:40.828 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.798849+0000", 2024-09-12T18:36:40.829 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.031e-05 2024-09-12T18:36:40.829 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.829 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.829 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:40.829 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.798855+0000", 2024-09-12T18:36:40.829 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8420000000000001e-06 2024-09-12T18:36:40.829 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.829 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.829 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:40.829 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.799412+0000", 2024-09-12T18:36:40.829 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00055662300000000001 2024-09-12T18:36:40.829 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.829 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.829 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:40.830 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.799429+0000", 2024-09-12T18:36:40.830 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.732e-05 2024-09-12T18:36:40.830 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:40.830 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:40.830 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:40.830 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.830 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.830 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:122170 5.0 e50/49 5:04380307:::benchmark_data_smithi073_23739_object122169:head v 50'7697, mlcod=50'7695)", 2024-09-12T18:36:40.830 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:40.798733+0000", 2024-09-12T18:36:40.830 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0014609040000000001, 2024-09-12T18:36:40.830 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001770932, 2024-09-12T18:36:40.830 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:40.831 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:40.831 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:40.831 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:40.831 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.831 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:40.831 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.798733+0000", 2024-09-12T18:36:40.831 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:40.831 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.831 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.831 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:40.831 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.798733+0000", 2024-09-12T18:36:40.831 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:40.831 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.831 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.832 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:40.832 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.798734+0000", 2024-09-12T18:36:40.832 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2600000000000001e-07 2024-09-12T18:36:40.832 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.832 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.832 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:40.832 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.798840+0000", 2024-09-12T18:36:40.832 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000106258 2024-09-12T18:36:40.832 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.832 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.832 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:40.832 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.798852+0000", 2024-09-12T18:36:40.833 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1208e-05 2024-09-12T18:36:40.833 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.833 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.833 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:40.833 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.798859+0000", 2024-09-12T18:36:40.833 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1670000000000002e-06 2024-09-12T18:36:40.833 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.833 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.833 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:40.833 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.798911+0000", 2024-09-12T18:36:40.833 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2385000000000001e-05 2024-09-12T18:36:40.833 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.833 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.834 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:40.834 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.798931+0000", 2024-09-12T18:36:40.834 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9573e-05 2024-09-12T18:36:40.834 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:40.834 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:40.834 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:40.834 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.834 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.834 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:122171 5.b e50/21 5:d3074c8e:::benchmark_data_smithi073_23739_object122170:head v 50'7699, mlcod=50'7697)", 2024-09-12T18:36:40.834 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:40.799104+0000", 2024-09-12T18:36:40.834 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0010902360000000001, 2024-09-12T18:36:40.834 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001460622, 2024-09-12T18:36:40.834 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:40.835 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:40.835 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:40.835 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:40.835 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.835 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:40.835 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.799104+0000", 2024-09-12T18:36:40.835 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:40.835 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.835 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.835 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:40.835 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.799104+0000", 2024-09-12T18:36:40.835 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:40.835 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.836 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.836 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:40.836 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.799105+0000", 2024-09-12T18:36:40.836 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3399999999999998e-07 2024-09-12T18:36:40.836 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.836 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.836 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:40.836 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.799175+0000", 2024-09-12T18:36:40.836 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0290000000000006e-05 2024-09-12T18:36:40.836 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.836 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.836 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:40.837 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.799186+0000", 2024-09-12T18:36:40.837 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0903999999999999e-05 2024-09-12T18:36:40.837 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.837 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.837 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:40.837 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.799193+0000", 2024-09-12T18:36:40.837 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.9349999999999997e-06 2024-09-12T18:36:40.837 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.837 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.837 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:40.837 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.799241+0000", 2024-09-12T18:36:40.837 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8182e-05 2024-09-12T18:36:40.837 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:40.838 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:40.838 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:40.838 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.799258+0000", 2024-09-12T18:36:40.838 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7263000000000001e-05 2024-09-12T18:36:40.838 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:40.838 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:40.838 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:40.838 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:40.838 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-12T18:36:40.838 INFO:teuthology.orchestra.run.smithi114.stdout: "num_ops": 8 2024-09-12T18:36:40.838 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:40.839 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:36:40.847 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:40.844+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:40.875 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 55 16 122319 122303 138.966 38.3125 0.010563 0.00719138 2024-09-12T18:36:40.947 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:40.942+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:41.037 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:41.037 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2024-09-12T18:36:41.037 INFO:teuthology.orchestra.run.smithi114.stdout: "complaint_time": 30, 2024-09-12T18:36:41.037 INFO:teuthology.orchestra.run.smithi114.stdout: "num_blocked_ops": 0 2024-09-12T18:36:41.037 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:41.048 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:41.044+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:41.058 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:36:41.075 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:36:41.082 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T18:36:41.150 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:41.148+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:41.222 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:41.222 INFO:teuthology.orchestra.run.smithi114.stdout: "size": 20, 2024-09-12T18:36:41.222 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 600, 2024-09-12T18:36:41.223 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:36:41.223 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.223 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:41.223 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:41.223 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 75.590294415000002, 2024-09-12T18:36:41.223 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.042475618999999999, 2024-09-12T18:36:41.223 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:41.223 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:41.223 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:41.223 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:41.223 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.223 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:41.223 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:41.223 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:41.224 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.224 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.224 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:41.224 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:41.224 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:41.224 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.224 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.224 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:41.224 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628450+0000", 2024-09-12T18:36:41.224 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4212999999999999e-05 2024-09-12T18:36:41.224 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.224 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.225 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:41.225 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628463+0000", 2024-09-12T18:36:41.225 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2497000000000001e-05 2024-09-12T18:36:41.225 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.225 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.225 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:41.225 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628480+0000", 2024-09-12T18:36:41.225 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7232999999999999e-05 2024-09-12T18:36:41.225 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.225 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.225 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:41.225 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628496+0000", 2024-09-12T18:36:41.225 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6217000000000001e-05 2024-09-12T18:36:41.225 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.226 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.226 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:41.226 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628641+0000", 2024-09-12T18:36:41.226 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000144709 2024-09-12T18:36:41.226 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.226 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.226 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:41.226 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628657+0000", 2024-09-12T18:36:41.226 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6266e-05 2024-09-12T18:36:41.226 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.226 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.226 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:41.226 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663103+0000", 2024-09-12T18:36:41.226 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.034445523999999998 2024-09-12T18:36:41.227 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.227 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.227 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:41.227 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663373+0000", 2024-09-12T18:36:41.227 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00027085500000000002 2024-09-12T18:36:41.227 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.227 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.227 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:41.227 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663634+0000", 2024-09-12T18:36:41.227 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000260855 2024-09-12T18:36:41.227 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.227 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.227 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:41.227 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670294+0000", 2024-09-12T18:36:41.228 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0066597599999999998 2024-09-12T18:36:41.228 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.228 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.228 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:41.228 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670705+0000", 2024-09-12T18:36:41.228 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00041057099999999998 2024-09-12T18:36:41.228 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.228 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.228 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:41.228 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670820+0000", 2024-09-12T18:36:41.228 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000115111 2024-09-12T18:36:41.228 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.228 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.229 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:41.229 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670912+0000", 2024-09-12T18:36:41.229 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1807999999999999e-05 2024-09-12T18:36:41.229 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:41.229 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:41.229 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:41.229 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.229 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.229 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:41.229 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:41.229 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 75.590203669000005, 2024-09-12T18:36:41.229 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.044599273000000002, 2024-09-12T18:36:41.229 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:41.229 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:41.230 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:41.230 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:41.230 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.230 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:41.230 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:41.230 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:41.230 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.230 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.230 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:41.230 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:41.230 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:41.230 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.230 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.230 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:41.231 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628528+0000", 2024-09-12T18:36:41.231 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:41.231 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.231 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.231 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:41.231 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628537+0000", 2024-09-12T18:36:41.231 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6969999999999999e-06 2024-09-12T18:36:41.231 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.231 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.231 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:41.231 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628560+0000", 2024-09-12T18:36:41.231 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2889000000000001e-05 2024-09-12T18:36:41.231 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.231 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.231 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:41.232 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628576+0000", 2024-09-12T18:36:41.232 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.649e-05 2024-09-12T18:36:41.232 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.232 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.232 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:41.232 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628846+0000", 2024-09-12T18:36:41.232 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00026952500000000001 2024-09-12T18:36:41.232 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.232 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.232 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:41.232 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628853+0000", 2024-09-12T18:36:41.232 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6559999999999992e-06 2024-09-12T18:36:41.232 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.232 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.232 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:41.233 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665284+0000", 2024-09-12T18:36:41.233 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.036431140000000001 2024-09-12T18:36:41.233 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.233 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.233 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:41.233 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665494+0000", 2024-09-12T18:36:41.233 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000209762 2024-09-12T18:36:41.233 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.233 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.233 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:41.233 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665816+0000", 2024-09-12T18:36:41.233 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00032162299999999999 2024-09-12T18:36:41.233 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.233 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.234 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:41.234 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670382+0000", 2024-09-12T18:36:41.234 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0045656739999999996 2024-09-12T18:36:41.234 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.234 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.234 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:41.234 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.672978+0000", 2024-09-12T18:36:41.234 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.002596068 2024-09-12T18:36:41.234 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.234 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.234 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:41.234 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673058+0000", 2024-09-12T18:36:41.234 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0198999999999996e-05 2024-09-12T18:36:41.234 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.235 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.235 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:41.235 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673126+0000", 2024-09-12T18:36:41.235 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8120000000000005e-05 2024-09-12T18:36:41.235 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:41.235 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:41.235 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:41.235 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.235 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.235 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:23 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:41.235 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:41.235 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 75.590105863000005, 2024-09-12T18:36:41.235 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045539784, 2024-09-12T18:36:41.236 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:41.236 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:41.236 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:41.236 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:41.236 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.236 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:41.236 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:41.236 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:41.236 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.236 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.236 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:41.236 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:41.237 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:41.237 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.237 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.237 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:41.237 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628626+0000", 2024-09-12T18:36:41.237 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.573e-06 2024-09-12T18:36:41.237 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.237 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.237 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:41.237 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628640+0000", 2024-09-12T18:36:41.237 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3817e-05 2024-09-12T18:36:41.237 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.237 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.238 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:41.238 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628659+0000", 2024-09-12T18:36:41.238 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9539999999999999e-05 2024-09-12T18:36:41.238 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.238 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.238 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:41.238 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628675+0000", 2024-09-12T18:36:41.238 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5739e-05 2024-09-12T18:36:41.238 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.238 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.238 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:41.238 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628815+0000", 2024-09-12T18:36:41.238 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014003299999999999 2024-09-12T18:36:41.239 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.239 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.239 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:41.239 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628828+0000", 2024-09-12T18:36:41.239 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2849e-05 2024-09-12T18:36:41.239 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.239 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.239 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:41.239 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651162+0000", 2024-09-12T18:36:41.239 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.022334228000000001 2024-09-12T18:36:41.239 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.239 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.239 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:41.240 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651446+0000", 2024-09-12T18:36:41.240 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00028392800000000002 2024-09-12T18:36:41.240 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.240 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.240 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:41.240 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651746+0000", 2024-09-12T18:36:41.240 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000300091 2024-09-12T18:36:41.240 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.240 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.240 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:41.240 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665113+0000", 2024-09-12T18:36:41.240 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013366678 2024-09-12T18:36:41.240 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.241 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.241 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:41.241 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674010+0000", 2024-09-12T18:36:41.241 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0088970520000000008 2024-09-12T18:36:41.241 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.241 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.241 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:41.241 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674104+0000", 2024-09-12T18:36:41.241 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4124999999999998e-05 2024-09-12T18:36:41.241 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.241 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.241 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:41.241 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674164+0000", 2024-09-12T18:36:41.241 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.0130999999999997e-05 2024-09-12T18:36:41.242 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:41.242 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:41.242 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:41.242 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.242 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.242 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:26 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:41.242 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:41.242 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 75.590032656999995, 2024-09-12T18:36:41.242 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045702136999999997, 2024-09-12T18:36:41.242 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:41.242 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:41.242 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:41.242 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:41.243 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.243 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:41.243 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:41.243 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:41.243 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.243 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.243 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:41.243 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:41.243 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:41.243 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.243 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.243 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:41.243 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628699+0000", 2024-09-12T18:36:41.244 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3859999999999999e-06 2024-09-12T18:36:41.244 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.244 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.244 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:41.244 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628706+0000", 2024-09-12T18:36:41.244 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0169999999999999e-06 2024-09-12T18:36:41.244 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.244 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.244 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:41.244 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628725+0000", 2024-09-12T18:36:41.244 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8683000000000001e-05 2024-09-12T18:36:41.244 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.244 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.245 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:41.245 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628740+0000", 2024-09-12T18:36:41.245 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5413999999999998e-05 2024-09-12T18:36:41.245 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.245 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.245 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:41.245 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628907+0000", 2024-09-12T18:36:41.245 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00016670199999999999 2024-09-12T18:36:41.245 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.245 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.245 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:41.245 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628917+0000", 2024-09-12T18:36:41.245 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.046e-05 2024-09-12T18:36:41.246 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.246 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.246 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:41.246 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.660390+0000", 2024-09-12T18:36:41.246 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.031472364000000003 2024-09-12T18:36:41.246 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.246 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.246 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:41.246 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.661767+0000", 2024-09-12T18:36:41.246 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0013769190000000001 2024-09-12T18:36:41.246 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.246 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.246 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:41.246 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.662408+0000", 2024-09-12T18:36:41.247 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00064091099999999998 2024-09-12T18:36:41.247 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.247 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.247 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:41.247 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669577+0000", 2024-09-12T18:36:41.247 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.007169412 2024-09-12T18:36:41.247 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.247 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.247 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:41.247 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674244+0000", 2024-09-12T18:36:41.247 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0046671839999999996 2024-09-12T18:36:41.247 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.247 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.247 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:41.248 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674329+0000", 2024-09-12T18:36:41.248 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5276000000000001e-05 2024-09-12T18:36:41.248 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.248 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.248 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:41.248 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674400+0000", 2024-09-12T18:36:41.248 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0408999999999996e-05 2024-09-12T18:36:41.248 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:41.248 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:41.248 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:41.248 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.248 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.248 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:41.249 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:41.249 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 75.589924988000007, 2024-09-12T18:36:41.249 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.044572443000000003, 2024-09-12T18:36:41.249 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:41.249 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:41.249 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:41.249 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:41.249 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.249 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:41.249 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:41.249 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:41.249 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.249 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.249 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:41.250 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:41.250 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:41.250 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.250 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.250 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:41.250 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628807+0000", 2024-09-12T18:36:41.250 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3629999999999999e-06 2024-09-12T18:36:41.250 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.250 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.250 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:41.250 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628814+0000", 2024-09-12T18:36:41.250 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.2099999999999996e-06 2024-09-12T18:36:41.250 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.251 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.251 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:41.251 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628832+0000", 2024-09-12T18:36:41.251 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7972999999999999e-05 2024-09-12T18:36:41.251 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.251 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.251 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:41.251 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628854+0000", 2024-09-12T18:36:41.251 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1857000000000001e-05 2024-09-12T18:36:41.251 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.251 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.251 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:41.251 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628984+0000", 2024-09-12T18:36:41.252 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013013599999999999 2024-09-12T18:36:41.252 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.252 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.252 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:41.252 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628993+0000", 2024-09-12T18:36:41.252 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:36:41.252 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.252 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.252 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:41.252 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668176+0000", 2024-09-12T18:36:41.252 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.039182211000000002 2024-09-12T18:36:41.252 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.252 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.253 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:41.253 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668481+0000", 2024-09-12T18:36:41.253 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00030499200000000002 2024-09-12T18:36:41.253 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.253 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.253 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:41.253 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668771+0000", 2024-09-12T18:36:41.253 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00029018700000000002 2024-09-12T18:36:41.253 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.253 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.253 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:41.253 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.672674+0000", 2024-09-12T18:36:41.253 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0039031890000000001 2024-09-12T18:36:41.254 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.254 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.254 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:41.254 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673214+0000", 2024-09-12T18:36:41.254 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00053981600000000004 2024-09-12T18:36:41.254 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.254 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.254 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:41.254 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673310+0000", 2024-09-12T18:36:41.254 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.6682999999999996e-05 2024-09-12T18:36:41.254 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.254 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.254 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:41.254 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673378+0000", 2024-09-12T18:36:41.255 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7385999999999995e-05 2024-09-12T18:36:41.255 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:41.255 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:41.255 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:41.255 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.255 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.255 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:41.255 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:41.255 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 75.589788962, 2024-09-12T18:36:41.255 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.041480853999999998, 2024-09-12T18:36:41.255 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:41.255 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:41.255 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:41.256 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:41.256 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.256 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:41.256 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:41.256 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:41.256 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.256 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.256 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:41.256 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:41.256 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:41.256 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.256 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.256 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:41.256 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628943+0000", 2024-09-12T18:36:41.257 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.403e-06 2024-09-12T18:36:41.257 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.257 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.257 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:41.257 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628953+0000", 2024-09-12T18:36:41.257 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0273e-05 2024-09-12T18:36:41.257 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.257 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.257 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:41.257 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628973+0000", 2024-09-12T18:36:41.257 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9959999999999999e-05 2024-09-12T18:36:41.257 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.257 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.258 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:41.258 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628989+0000", 2024-09-12T18:36:41.258 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6447e-05 2024-09-12T18:36:41.258 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.258 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.258 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:41.258 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629144+0000", 2024-09-12T18:36:41.258 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015468900000000001 2024-09-12T18:36:41.258 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.258 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.258 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:41.258 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629162+0000", 2024-09-12T18:36:41.258 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7603000000000001e-05 2024-09-12T18:36:41.258 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.259 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.259 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:41.259 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.646927+0000", 2024-09-12T18:36:41.259 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.017765626 2024-09-12T18:36:41.259 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.259 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.259 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:41.259 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.647245+0000", 2024-09-12T18:36:41.259 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00031797699999999999 2024-09-12T18:36:41.259 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.259 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.259 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:41.259 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.647551+0000", 2024-09-12T18:36:41.260 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00030583500000000002 2024-09-12T18:36:41.260 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.260 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.260 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:41.260 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651738+0000", 2024-09-12T18:36:41.260 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0041864980000000003 2024-09-12T18:36:41.260 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.260 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.260 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:41.260 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670207+0000", 2024-09-12T18:36:41.260 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018469299000000002 2024-09-12T18:36:41.260 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.260 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.261 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:41.261 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670330+0000", 2024-09-12T18:36:41.261 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012284500000000001 2024-09-12T18:36:41.261 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.261 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.261 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:41.261 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670422+0000", 2024-09-12T18:36:41.261 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2398999999999994e-05 2024-09-12T18:36:41.261 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:41.261 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:41.261 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:41.261 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.261 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.262 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:41.262 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:41.262 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 75.589711708999999, 2024-09-12T18:36:41.262 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.041623741999999998, 2024-09-12T18:36:41.262 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:41.262 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:41.262 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:41.262 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:41.262 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.262 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:41.262 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:41.262 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:41.262 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.263 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.263 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:41.263 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:41.263 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:41.263 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.263 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.263 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:41.263 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629020+0000", 2024-09-12T18:36:41.263 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.15e-06 2024-09-12T18:36:41.263 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.263 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.263 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:41.263 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629023+0000", 2024-09-12T18:36:41.263 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4659999999999999e-06 2024-09-12T18:36:41.264 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.264 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.264 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:41.264 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629037+0000", 2024-09-12T18:36:41.264 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3857e-05 2024-09-12T18:36:41.264 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.264 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.264 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:41.264 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629062+0000", 2024-09-12T18:36:41.264 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4519999999999999e-05 2024-09-12T18:36:41.264 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.264 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.264 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:41.265 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629253+0000", 2024-09-12T18:36:41.265 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000191335 2024-09-12T18:36:41.265 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.265 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.265 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:41.265 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629266+0000", 2024-09-12T18:36:41.265 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3322999999999999e-05 2024-09-12T18:36:41.265 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.265 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.265 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:41.265 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648331+0000", 2024-09-12T18:36:41.265 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.019065060000000002 2024-09-12T18:36:41.265 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.266 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.266 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:41.266 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.650044+0000", 2024-09-12T18:36:41.266 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017123959999999999 2024-09-12T18:36:41.266 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.266 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.266 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:41.266 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670642+0000", 2024-09-12T18:36:41.266 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.020598635000000001 2024-09-12T18:36:41.266 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:41.266 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:41.266 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:41.266 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.267 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.267 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:41.267 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:41.267 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 75.589608377000005, 2024-09-12T18:36:41.267 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.046431252999999999, 2024-09-12T18:36:41.267 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:41.267 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:41.267 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:41.267 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:41.267 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.267 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:41.267 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:41.267 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:41.267 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.268 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.268 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:41.268 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:41.268 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:41.268 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.268 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.268 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:41.268 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629123+0000", 2024-09-12T18:36:41.268 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0899999999999999e-06 2024-09-12T18:36:41.268 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.268 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.268 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:41.268 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629138+0000", 2024-09-12T18:36:41.269 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4977000000000001e-05 2024-09-12T18:36:41.269 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.269 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.269 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:41.269 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629149+0000", 2024-09-12T18:36:41.269 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1182999999999999e-05 2024-09-12T18:36:41.269 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.269 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.269 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:41.269 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629157+0000", 2024-09-12T18:36:41.269 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8129999999999996e-06 2024-09-12T18:36:41.269 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.269 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.270 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:41.270 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629223+0000", 2024-09-12T18:36:41.270 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6463000000000004e-05 2024-09-12T18:36:41.270 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.270 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.270 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:41.270 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629230+0000", 2024-09-12T18:36:41.270 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1360000000000002e-06 2024-09-12T18:36:41.270 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.270 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.270 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:41.270 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669605+0000", 2024-09-12T18:36:41.270 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.040375518999999999 2024-09-12T18:36:41.270 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.271 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.271 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:41.271 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669840+0000", 2024-09-12T18:36:41.271 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00023520099999999999 2024-09-12T18:36:41.271 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.271 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.271 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:41.271 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.675553+0000", 2024-09-12T18:36:41.271 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0057128709999999996 2024-09-12T18:36:41.271 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:41.271 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:41.271 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:41.271 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.272 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.272 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:41.272 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:41.272 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 75.589553710000004, 2024-09-12T18:36:41.272 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.037357044999999998, 2024-09-12T18:36:41.272 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:41.272 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:41.272 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:41.272 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:41.272 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.272 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:41.272 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:41.272 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:41.273 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.273 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.273 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:41.273 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:41.273 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:41.273 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.273 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.273 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:41.273 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629178+0000", 2024-09-12T18:36:41.273 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.08e-06 2024-09-12T18:36:41.273 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.273 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.273 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:41.274 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629194+0000", 2024-09-12T18:36:41.274 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5899000000000001e-05 2024-09-12T18:36:41.274 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.274 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.274 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:41.274 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629211+0000", 2024-09-12T18:36:41.274 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7363e-05 2024-09-12T18:36:41.274 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.274 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.274 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:41.274 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629226+0000", 2024-09-12T18:36:41.274 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4567e-05 2024-09-12T18:36:41.274 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.275 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.275 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:41.275 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629299+0000", 2024-09-12T18:36:41.275 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3910000000000002e-05 2024-09-12T18:36:41.275 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.275 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.275 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:41.275 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629307+0000", 2024-09-12T18:36:41.275 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5299999999999999e-06 2024-09-12T18:36:41.275 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.275 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.275 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:41.275 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648185+0000", 2024-09-12T18:36:41.275 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018878533999999999 2024-09-12T18:36:41.276 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.276 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.276 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:41.276 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.649724+0000", 2024-09-12T18:36:41.276 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001538841 2024-09-12T18:36:41.276 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.276 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.276 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:41.276 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.666534+0000", 2024-09-12T18:36:41.276 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.016809320999999999 2024-09-12T18:36:41.276 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:41.276 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:41.276 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:41.277 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.277 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.277 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:80967 5.a 5:5f4000f6:::benchmark_data_smithi073_23739_object80966:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T18:36:41.277 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:18.561016+0000", 2024-09-12T18:36:41.277 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 22.657714115000001, 2024-09-12T18:36:41.277 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021780831, 2024-09-12T18:36:41.277 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:41.277 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:41.277 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:41.277 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:41.277 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:41.277 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:41.277 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 80967 2024-09-12T18:36:41.278 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.278 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:41.278 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.278 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:41.278 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561016+0000", 2024-09-12T18:36:41.278 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:41.278 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.278 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.278 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:41.278 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561016+0000", 2024-09-12T18:36:41.278 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:41.278 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.278 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.278 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:41.279 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561017+0000", 2024-09-12T18:36:41.279 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7599999999999997e-07 2024-09-12T18:36:41.279 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.279 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.279 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:41.279 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561050+0000", 2024-09-12T18:36:41.279 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3524e-05 2024-09-12T18:36:41.279 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.279 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.279 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:41.279 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561058+0000", 2024-09-12T18:36:41.279 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0679999999999997e-06 2024-09-12T18:36:41.280 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.280 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.280 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:41.280 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561065+0000", 2024-09-12T18:36:41.280 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1990000000000003e-06 2024-09-12T18:36:41.280 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.280 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.280 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:41.280 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564735+0000", 2024-09-12T18:36:41.280 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0036706740000000001 2024-09-12T18:36:41.280 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.280 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.280 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:41.281 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564868+0000", 2024-09-12T18:36:41.281 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000133003 2024-09-12T18:36:41.281 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.281 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.281 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:41.281 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.565010+0000", 2024-09-12T18:36:41.281 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014224300000000001 2024-09-12T18:36:41.281 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.281 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.281 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:41.281 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.569871+0000", 2024-09-12T18:36:41.281 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0048600759999999996 2024-09-12T18:36:41.281 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.282 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.282 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:41.282 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.582729+0000", 2024-09-12T18:36:41.282 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012858090000000001 2024-09-12T18:36:41.282 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.282 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.282 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:41.282 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.582758+0000", 2024-09-12T18:36:41.282 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.9762999999999999e-05 2024-09-12T18:36:41.282 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.282 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.282 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:41.282 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.582797+0000", 2024-09-12T18:36:41.283 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8615000000000002e-05 2024-09-12T18:36:41.283 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:41.283 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:41.283 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:41.283 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.283 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.283 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:80971 5.2 e39/21 5:4205ebb1:::benchmark_data_smithi073_23739_object80970:head v 39'5054, mlcod=39'5052)", 2024-09-12T18:36:41.283 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:18.564320+0000", 2024-09-12T18:36:41.283 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 22.65441015, 2024-09-12T18:36:41.283 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.019963669999999999, 2024-09-12T18:36:41.283 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:41.283 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:41.283 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:41.283 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:41.284 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.284 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:41.284 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564320+0000", 2024-09-12T18:36:41.284 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:41.284 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.284 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.284 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:41.284 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564320+0000", 2024-09-12T18:36:41.284 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:41.284 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.284 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.284 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:41.284 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564321+0000", 2024-09-12T18:36:41.285 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.77e-07 2024-09-12T18:36:41.285 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.285 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.285 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:41.285 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564418+0000", 2024-09-12T18:36:41.285 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.7602000000000005e-05 2024-09-12T18:36:41.285 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.285 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.285 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:41.285 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564427+0000", 2024-09-12T18:36:41.285 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7439999999999996e-06 2024-09-12T18:36:41.285 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.285 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.286 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:41.286 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564442+0000", 2024-09-12T18:36:41.286 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5353e-05 2024-09-12T18:36:41.286 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.286 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.286 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:41.286 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.569512+0000", 2024-09-12T18:36:41.286 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0050701840000000001 2024-09-12T18:36:41.286 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.286 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.286 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:41.286 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.569531+0000", 2024-09-12T18:36:41.286 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8311000000000001e-05 2024-09-12T18:36:41.287 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.287 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.287 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:41.287 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.584246+0000", 2024-09-12T18:36:41.287 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.014714947000000001 2024-09-12T18:36:41.287 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.287 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.287 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:41.287 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.584284+0000", 2024-09-12T18:36:41.287 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8152000000000003e-05 2024-09-12T18:36:41.287 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:41.287 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:41.287 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:41.287 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.288 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.288 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:108511 5.6 5:608a30a3:::benchmark_data_smithi073_23739_object108510:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:36:41.288 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:31.986730+0000", 2024-09-12T18:36:41.288 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 9.2320002409999997, 2024-09-12T18:36:41.288 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021507117999999999, 2024-09-12T18:36:41.288 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:41.288 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:41.288 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:41.288 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:41.288 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:41.288 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:41.288 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 108511 2024-09-12T18:36:41.289 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.289 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:41.289 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.289 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:41.289 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986730+0000", 2024-09-12T18:36:41.289 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:41.289 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.289 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.289 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:41.289 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986730+0000", 2024-09-12T18:36:41.289 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:41.289 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.289 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.289 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:41.290 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986731+0000", 2024-09-12T18:36:41.290 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.9100000000000003e-07 2024-09-12T18:36:41.290 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.290 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.290 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:41.290 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986804+0000", 2024-09-12T18:36:41.290 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3647999999999997e-05 2024-09-12T18:36:41.290 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.290 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.290 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:41.290 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986812+0000", 2024-09-12T18:36:41.290 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.34e-06 2024-09-12T18:36:41.290 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.290 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.291 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:41.291 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986836+0000", 2024-09-12T18:36:41.291 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4213e-05 2024-09-12T18:36:41.291 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.291 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.291 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:41.291 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.997047+0000", 2024-09-12T18:36:41.291 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.010210649 2024-09-12T18:36:41.291 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.291 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.291 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:41.291 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.997169+0000", 2024-09-12T18:36:41.291 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012269700000000001 2024-09-12T18:36:41.292 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.292 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.292 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:41.292 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.997300+0000", 2024-09-12T18:36:41.292 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000130858 2024-09-12T18:36:41.292 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.292 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.292 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:41.292 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.002398+0000", 2024-09-12T18:36:41.292 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0050981580000000002 2024-09-12T18:36:41.292 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.292 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.292 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:41.293 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.008093+0000", 2024-09-12T18:36:41.293 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0056941930000000002 2024-09-12T18:36:41.293 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.293 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.293 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:41.293 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.008151+0000", 2024-09-12T18:36:41.293 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8328999999999997e-05 2024-09-12T18:36:41.293 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.293 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.293 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:41.293 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.008237+0000", 2024-09-12T18:36:41.293 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6341999999999994e-05 2024-09-12T18:36:41.293 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:41.293 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:41.294 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:41.294 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.294 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.294 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:108623 5.c 5:33792cd3:::benchmark_data_smithi073_23739_object108622:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:36:41.294 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:32.046609+0000", 2024-09-12T18:36:41.294 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 9.172121465, 2024-09-12T18:36:41.294 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021062860999999999, 2024-09-12T18:36:41.294 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:41.294 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:41.294 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:41.294 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:41.294 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:41.295 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:41.295 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 108623 2024-09-12T18:36:41.295 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.295 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:41.295 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.295 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:41.295 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.046609+0000", 2024-09-12T18:36:41.295 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:41.295 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.295 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.295 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:41.295 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.046609+0000", 2024-09-12T18:36:41.295 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:41.296 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.296 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.296 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:41.296 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.046609+0000", 2024-09-12T18:36:41.296 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.37e-07 2024-09-12T18:36:41.296 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.296 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.296 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:41.296 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.046690+0000", 2024-09-12T18:36:41.296 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0212999999999999e-05 2024-09-12T18:36:41.296 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.296 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.296 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:41.297 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.046698+0000", 2024-09-12T18:36:41.297 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6430000000000001e-06 2024-09-12T18:36:41.297 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.297 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.297 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:41.297 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.046704+0000", 2024-09-12T18:36:41.297 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7699999999999998e-06 2024-09-12T18:36:41.297 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.297 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.297 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:41.297 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.056808+0000", 2024-09-12T18:36:41.297 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.010103562999999999 2024-09-12T18:36:41.297 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.297 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.298 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:41.298 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.056989+0000", 2024-09-12T18:36:41.298 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000181196 2024-09-12T18:36:41.298 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.298 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.298 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:41.298 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.057162+0000", 2024-09-12T18:36:41.298 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000173396 2024-09-12T18:36:41.298 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.298 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.298 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:41.298 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.063269+0000", 2024-09-12T18:36:41.298 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0061066100000000002 2024-09-12T18:36:41.299 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.299 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.299 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:41.299 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.067578+0000", 2024-09-12T18:36:41.299 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0043092570000000004 2024-09-12T18:36:41.299 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.299 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.299 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:41.299 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.067628+0000", 2024-09-12T18:36:41.299 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0136999999999998e-05 2024-09-12T18:36:41.299 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.299 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.299 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:41.299 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.067672+0000", 2024-09-12T18:36:41.300 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3439000000000002e-05 2024-09-12T18:36:41.300 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:41.300 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:41.300 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:41.300 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.300 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.300 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:115360 5.c 5:3eab790c:::benchmark_data_smithi073_23739_object115359:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:36:41.300 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:35.325499+0000", 2024-09-12T18:36:41.300 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 5.8932315410000005, 2024-09-12T18:36:41.300 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.020147082, 2024-09-12T18:36:41.300 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:41.300 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:41.300 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:41.301 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:41.301 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:41.301 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:41.301 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 115360 2024-09-12T18:36:41.301 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.301 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:41.301 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.301 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:41.301 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.325499+0000", 2024-09-12T18:36:41.301 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:41.301 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.301 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.301 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:41.302 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.325499+0000", 2024-09-12T18:36:41.302 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:41.302 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.302 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.302 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:41.302 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.325500+0000", 2024-09-12T18:36:41.302 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.9999999999999996e-07 2024-09-12T18:36:41.302 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.302 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.302 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:41.302 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.325556+0000", 2024-09-12T18:36:41.302 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6665e-05 2024-09-12T18:36:41.303 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.303 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.303 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:41.303 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.325568+0000", 2024-09-12T18:36:41.303 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1311000000000001e-05 2024-09-12T18:36:41.303 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.303 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.303 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:41.303 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.325575+0000", 2024-09-12T18:36:41.303 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.7649999999999993e-06 2024-09-12T18:36:41.303 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.303 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.303 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:41.303 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.327911+0000", 2024-09-12T18:36:41.304 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0023351359999999998 2024-09-12T18:36:41.304 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.304 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.304 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:41.304 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.328046+0000", 2024-09-12T18:36:41.304 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000135444 2024-09-12T18:36:41.304 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.304 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.304 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:41.304 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.328173+0000", 2024-09-12T18:36:41.304 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012734199999999999 2024-09-12T18:36:41.304 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.304 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.305 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:41.305 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.332254+0000", 2024-09-12T18:36:41.305 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0040805320000000004 2024-09-12T18:36:41.305 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.305 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.305 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:41.305 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.345519+0000", 2024-09-12T18:36:41.305 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013265403 2024-09-12T18:36:41.305 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.305 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.305 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:41.305 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.345583+0000", 2024-09-12T18:36:41.305 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3545000000000002e-05 2024-09-12T18:36:41.305 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.306 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.306 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:41.306 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.345646+0000", 2024-09-12T18:36:41.306 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3039000000000004e-05 2024-09-12T18:36:41.306 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:41.306 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:41.306 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:41.306 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.306 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.306 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:121033 5.0 e50/49 5:0b3817c1:::benchmark_data_smithi073_23739_object121032:head v 50'7620, mlcod=0'0)", 2024-09-12T18:36:41.306 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:40.165057+0000", 2024-09-12T18:36:41.306 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 1.0536737430000001, 2024-09-12T18:36:41.306 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.030641286, 2024-09-12T18:36:41.306 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:41.307 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:41.307 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:41.307 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:41.307 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.307 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:41.307 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.165057+0000", 2024-09-12T18:36:41.307 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:41.307 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.307 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.307 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:41.307 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.165057+0000", 2024-09-12T18:36:41.307 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:41.307 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.307 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.308 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:41.308 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.165057+0000", 2024-09-12T18:36:41.308 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8599999999999998e-07 2024-09-12T18:36:41.308 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.308 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.308 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:41.308 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.165109+0000", 2024-09-12T18:36:41.308 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2086000000000002e-05 2024-09-12T18:36:41.308 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.308 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.308 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:41.308 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.165161+0000", 2024-09-12T18:36:41.308 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1415000000000002e-05 2024-09-12T18:36:41.309 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.309 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.309 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:41.309 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.165178+0000", 2024-09-12T18:36:41.309 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7790000000000001e-05 2024-09-12T18:36:41.309 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.309 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.309 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:41.309 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.168784+0000", 2024-09-12T18:36:41.309 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0036052050000000002 2024-09-12T18:36:41.309 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.309 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.309 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:41.310 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.168854+0000", 2024-09-12T18:36:41.310 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0814000000000003e-05 2024-09-12T18:36:41.310 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.310 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.310 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:41.310 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.195600+0000", 2024-09-12T18:36:41.310 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.026745173000000001 2024-09-12T18:36:41.310 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.310 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.310 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:41.310 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.195698+0000", 2024-09-12T18:36:41.310 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.8317000000000001e-05 2024-09-12T18:36:41.310 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:41.310 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:41.311 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:41.311 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.311 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.311 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:121044 5.1 e50/49 5:83bf711a:::benchmark_data_smithi073_23739_object121043:head v 50'7532, mlcod=0'0)", 2024-09-12T18:36:41.311 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:40.200337+0000", 2024-09-12T18:36:41.311 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 1.018393742, 2024-09-12T18:36:41.311 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.023483312999999999, 2024-09-12T18:36:41.311 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:41.311 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:41.311 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:41.311 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:41.311 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.311 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:41.312 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200337+0000", 2024-09-12T18:36:41.312 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:41.312 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.312 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.312 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:41.312 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200337+0000", 2024-09-12T18:36:41.312 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:41.312 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.312 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.312 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:41.312 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200338+0000", 2024-09-12T18:36:41.312 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.877e-06 2024-09-12T18:36:41.312 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.313 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.313 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:41.313 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200558+0000", 2024-09-12T18:36:41.313 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00021912799999999999 2024-09-12T18:36:41.313 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.313 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.313 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:41.313 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200584+0000", 2024-09-12T18:36:41.313 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.6333e-05 2024-09-12T18:36:41.313 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.313 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.313 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:41.313 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200602+0000", 2024-09-12T18:36:41.313 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.853e-05 2024-09-12T18:36:41.314 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.314 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.314 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:41.314 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200753+0000", 2024-09-12T18:36:41.314 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015061299999999999 2024-09-12T18:36:41.314 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.314 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.314 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:41.314 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200790+0000", 2024-09-12T18:36:41.314 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.7398999999999999e-05 2024-09-12T18:36:41.314 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.314 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.314 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:41.315 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.223743+0000", 2024-09-12T18:36:41.315 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.022952455 2024-09-12T18:36:41.315 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.315 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.315 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:41.315 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.223820+0000", 2024-09-12T18:36:41.315 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6977999999999994e-05 2024-09-12T18:36:41.315 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:41.315 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:41.315 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:41.315 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.315 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.315 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:121110 5.2 e50/21 5:4dc37b93:::benchmark_data_smithi073_23739_object121109:head v 50'7513, mlcod=48'7511)", 2024-09-12T18:36:41.316 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:40.241103+0000", 2024-09-12T18:36:41.316 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.97762770099999996, 2024-09-12T18:36:41.316 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021833894, 2024-09-12T18:36:41.316 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:41.316 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:41.316 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:41.316 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:41.316 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.316 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:41.316 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241103+0000", 2024-09-12T18:36:41.316 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:41.316 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.316 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.317 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:41.317 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241103+0000", 2024-09-12T18:36:41.317 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:41.317 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.317 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.317 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:41.318 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241104+0000", 2024-09-12T18:36:41.318 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.7999999999999993e-07 2024-09-12T18:36:41.318 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.318 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.318 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:41.318 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241162+0000", 2024-09-12T18:36:41.319 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8319000000000002e-05 2024-09-12T18:36:41.319 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.319 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.319 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:41.319 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241181+0000", 2024-09-12T18:36:41.319 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9055999999999998e-05 2024-09-12T18:36:41.319 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.319 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.319 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:41.319 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241191+0000", 2024-09-12T18:36:41.319 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.9359999999999994e-06 2024-09-12T18:36:41.319 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.319 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.320 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:41.320 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241305+0000", 2024-09-12T18:36:41.320 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000114134 2024-09-12T18:36:41.320 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.320 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.320 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:41.320 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241372+0000", 2024-09-12T18:36:41.320 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6521999999999998e-05 2024-09-12T18:36:41.320 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.321 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.321 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:41.321 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.262837+0000", 2024-09-12T18:36:41.321 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021465766000000001 2024-09-12T18:36:41.321 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.321 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.321 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:41.321 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.262937+0000", 2024-09-12T18:36:41.321 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.9180999999999998e-05 2024-09-12T18:36:41.321 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:41.321 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:41.321 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:41.321 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.322 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.322 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:121113 5.7 e50/21 5:ecb54668:::benchmark_data_smithi073_23739_object121112:head v 50'7600, mlcod=48'7598)", 2024-09-12T18:36:41.322 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:40.243664+0000", 2024-09-12T18:36:41.322 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.97506656400000002, 2024-09-12T18:36:41.322 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.020378377999999999, 2024-09-12T18:36:41.322 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:41.322 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:41.322 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:41.322 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:41.322 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.322 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:41.322 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.243664+0000", 2024-09-12T18:36:41.322 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:41.322 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.323 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.323 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:41.323 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.243664+0000", 2024-09-12T18:36:41.323 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:41.323 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.323 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.323 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:41.323 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.243665+0000", 2024-09-12T18:36:41.323 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.48e-06 2024-09-12T18:36:41.323 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.323 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.323 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:41.323 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.243740+0000", 2024-09-12T18:36:41.323 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5197999999999994e-05 2024-09-12T18:36:41.324 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.324 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.324 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:41.324 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.243763+0000", 2024-09-12T18:36:41.324 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2348999999999999e-05 2024-09-12T18:36:41.324 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.324 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.324 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:41.324 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.243783+0000", 2024-09-12T18:36:41.324 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.0716999999999998e-05 2024-09-12T18:36:41.324 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.324 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.324 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:41.325 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.243972+0000", 2024-09-12T18:36:41.325 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000188946 2024-09-12T18:36:41.325 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.325 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.325 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:41.325 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.244008+0000", 2024-09-12T18:36:41.325 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.5806000000000002e-05 2024-09-12T18:36:41.325 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.325 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.325 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:41.325 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.263922+0000", 2024-09-12T18:36:41.325 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.019913614999999999 2024-09-12T18:36:41.325 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.326 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.326 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:41.326 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.264042+0000", 2024-09-12T18:36:41.326 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012026700000000001 2024-09-12T18:36:41.326 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:41.326 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:41.326 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:41.326 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.326 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.326 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:121148 5.4 e50/21 5:2a9bde06:::benchmark_data_smithi073_23739_object121147:head v 50'7521, mlcod=48'7519)", 2024-09-12T18:36:41.326 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:40.281756+0000", 2024-09-12T18:36:41.326 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.93697433399999996, 2024-09-12T18:36:41.326 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.020077747999999999, 2024-09-12T18:36:41.327 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:41.327 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:41.327 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:41.327 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:41.327 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.327 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:41.327 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.281756+0000", 2024-09-12T18:36:41.327 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:41.327 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.327 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.327 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:41.327 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.281756+0000", 2024-09-12T18:36:41.327 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:41.327 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.328 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.328 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:41.328 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.281758+0000", 2024-09-12T18:36:41.328 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5710000000000001e-06 2024-09-12T18:36:41.328 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.328 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.328 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:41.328 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.281845+0000", 2024-09-12T18:36:41.328 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7270999999999998e-05 2024-09-12T18:36:41.328 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.328 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.328 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:41.328 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.281864+0000", 2024-09-12T18:36:41.329 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9508e-05 2024-09-12T18:36:41.329 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.329 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.329 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:41.329 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.281884+0000", 2024-09-12T18:36:41.329 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9550000000000001e-05 2024-09-12T18:36:41.329 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.329 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.329 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:41.329 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.282053+0000", 2024-09-12T18:36:41.329 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000168624 2024-09-12T18:36:41.329 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.329 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.329 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:41.330 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.282090+0000", 2024-09-12T18:36:41.330 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.7682000000000003e-05 2024-09-12T18:36:41.330 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.330 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.330 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:41.330 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.301749+0000", 2024-09-12T18:36:41.330 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.019658364000000001 2024-09-12T18:36:41.330 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.330 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.330 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:41.330 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.301834+0000", 2024-09-12T18:36:41.330 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5178000000000003e-05 2024-09-12T18:36:41.330 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:41.330 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:41.331 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:41.331 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.331 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.331 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:121160 5.b e50/21 5:d4730c8e:::benchmark_data_smithi073_23739_object121159:head v 50'7640, mlcod=47'7638)", 2024-09-12T18:36:41.331 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:40.289729+0000", 2024-09-12T18:36:41.331 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.92900115500000002, 2024-09-12T18:36:41.331 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021365733000000001, 2024-09-12T18:36:41.331 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:41.331 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:41.331 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:41.331 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:41.331 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.331 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:41.332 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.289729+0000", 2024-09-12T18:36:41.332 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:41.332 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.332 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.332 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:41.332 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.289729+0000", 2024-09-12T18:36:41.332 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:41.332 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.332 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.332 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:41.332 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.289730+0000", 2024-09-12T18:36:41.332 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1799999999999995e-07 2024-09-12T18:36:41.332 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.333 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.333 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:41.333 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.289831+0000", 2024-09-12T18:36:41.333 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000101122 2024-09-12T18:36:41.333 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.333 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.333 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:41.333 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.289847+0000", 2024-09-12T18:36:41.333 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5787999999999999e-05 2024-09-12T18:36:41.333 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.333 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.333 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:41.333 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.289859+0000", 2024-09-12T18:36:41.333 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2439000000000001e-05 2024-09-12T18:36:41.334 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.334 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.334 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:41.334 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.289998+0000", 2024-09-12T18:36:41.334 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000138725 2024-09-12T18:36:41.334 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.334 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.334 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:41.334 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.290055+0000", 2024-09-12T18:36:41.334 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7166000000000001e-05 2024-09-12T18:36:41.334 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.334 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.334 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:41.334 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.311028+0000", 2024-09-12T18:36:41.335 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.020972602 2024-09-12T18:36:41.335 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:41.335 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:41.335 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:41.335 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.311095+0000", 2024-09-12T18:36:41.335 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7273000000000005e-05 2024-09-12T18:36:41.335 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:41.335 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:41.335 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:41.335 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:41.335 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:41.335 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:41.336 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:36:41.337 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:36:41.337 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:36:41.338 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:36:41.338 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:36:41.339 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:41.331+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:41.339 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:36:41.340 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:36:41.438 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:41.434+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:41.504 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:41.504 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:41.529 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:36:41.538 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:41.531+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:41.639 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:41.634+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:41.735 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:41.735 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:41.740 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:41.736+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:41.755 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:36:41.841 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:41.840+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:41.875 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 56 16 124329 124313 138.727 125.625 0.0080087 0.00720361 2024-09-12T18:36:41.942 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:41.935+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:41.957 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:41.957 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:41.979 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:36:42.043 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:42.038+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:42.076 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is set 2024-09-12T18:36:42.143 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:42.143 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:42.143 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:42.139+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:42.164 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:36:42.244 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:42.238+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:42.324 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:42.325 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:42.345 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:42.340+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:42.347 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:36:42.446 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:42.439+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:42.547 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:42.543+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:42.556 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:42.556 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:42.580 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:36:42.649 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:42.643+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:42.742 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:42.743 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:42.750 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:42.746+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:42.765 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:36:42.851 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:42.846+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:42.875 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 57 16 126302 126286 138.456 123.312 0.00793725 0.00721782 2024-09-12T18:36:42.951 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:42.946+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:42.972 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:42.972 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:42.991 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:36:43.052 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:43.046+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:43.153 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:43.153 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:43.154 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:43.152+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:43.172 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:36:43.255 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:43.247+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:43.324 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:43.324 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:43.341 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:36:43.343 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:36:43.355 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:43.347+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:43.456 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:43.451+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:43.498 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:43.498 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:43.505 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:36:43.505 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:36:43.519 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:36:43.523 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:36:43.523 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:36:43.543 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:36:43.543 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:36:43.566 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:43.562+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:43.657 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:43.656+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:43.672 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:43.673 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-09-12T18:36:43.673 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-09-12T18:36:43.673 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:36:43.673 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.674 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:43.674 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:43.674 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 78.036372857000003, 2024-09-12T18:36:43.674 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025088781000000001, 2024-09-12T18:36:43.674 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:43.674 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:43.675 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:43.675 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:43.675 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.675 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:43.675 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:43.676 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:43.676 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.676 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.676 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:43.676 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:43.677 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:43.677 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.677 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.677 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:43.677 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632518+0000", 2024-09-12T18:36:43.677 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:36:43.678 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.678 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.678 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:43.678 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632533+0000", 2024-09-12T18:36:43.678 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5130000000000001e-05 2024-09-12T18:36:43.679 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.679 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.679 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:43.679 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632564+0000", 2024-09-12T18:36:43.679 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0788999999999999e-05 2024-09-12T18:36:43.680 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.680 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.680 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:43.680 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632590+0000", 2024-09-12T18:36:43.680 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6057000000000001e-05 2024-09-12T18:36:43.680 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.681 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.681 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:43.681 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.635931+0000", 2024-09-12T18:36:43.681 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033411320000000001 2024-09-12T18:36:43.681 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.682 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.682 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:43.682 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636186+0000", 2024-09-12T18:36:43.682 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025452500000000002 2024-09-12T18:36:43.682 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.683 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.683 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:43.683 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636445+0000", 2024-09-12T18:36:43.683 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000259268 2024-09-12T18:36:43.683 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.684 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.684 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:43.684 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639562+0000", 2024-09-12T18:36:43.684 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031167 2024-09-12T18:36:43.684 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.685 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.685 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:43.685 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657314+0000", 2024-09-12T18:36:43.685 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017752562 2024-09-12T18:36:43.685 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.685 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.686 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:43.686 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657445+0000", 2024-09-12T18:36:43.686 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013105899999999999 2024-09-12T18:36:43.686 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.686 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.687 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:43.687 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657598+0000", 2024-09-12T18:36:43.687 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015247899999999999 2024-09-12T18:36:43.687 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:43.687 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:43.688 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:43.688 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.688 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.688 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:43.688 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:43.689 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 78.036246653999996, 2024-09-12T18:36:43.689 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025643131999999999, 2024-09-12T18:36:43.689 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:43.689 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:43.689 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:43.690 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:43.690 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.690 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:43.690 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:43.690 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:43.691 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.691 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.691 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:43.691 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:43.691 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:43.692 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.692 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.692 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:43.692 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632637+0000", 2024-09-12T18:36:43.692 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5600000000000001e-06 2024-09-12T18:36:43.692 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.693 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.693 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:43.693 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632650+0000", 2024-09-12T18:36:43.693 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3186e-05 2024-09-12T18:36:43.693 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.694 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.694 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:43.694 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632672+0000", 2024-09-12T18:36:43.694 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2013000000000001e-05 2024-09-12T18:36:43.694 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.695 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.695 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:43.695 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632687+0000", 2024-09-12T18:36:43.695 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5109999999999999e-05 2024-09-12T18:36:43.695 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.695 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.696 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:43.696 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636994+0000", 2024-09-12T18:36:43.696 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0043065539999999998 2024-09-12T18:36:43.696 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.696 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.697 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:43.697 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637198+0000", 2024-09-12T18:36:43.697 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020387199999999999 2024-09-12T18:36:43.697 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.697 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.698 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:43.698 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637475+0000", 2024-09-12T18:36:43.698 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027731000000000001 2024-09-12T18:36:43.698 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.698 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.699 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:43.699 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639574+0000", 2024-09-12T18:36:43.699 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020988999999999999 2024-09-12T18:36:43.699 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.699 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.700 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:43.700 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658057+0000", 2024-09-12T18:36:43.700 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018482926 2024-09-12T18:36:43.700 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.700 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.701 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:43.701 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658184+0000", 2024-09-12T18:36:43.701 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012756200000000001 2024-09-12T18:36:43.701 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.701 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.702 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:43.702 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658278+0000", 2024-09-12T18:36:43.702 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4139000000000001e-05 2024-09-12T18:36:43.702 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:43.702 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:43.702 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:43.703 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.703 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.703 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:43.703 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:43.703 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 78.036171562000007, 2024-09-12T18:36:43.704 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025238883, 2024-09-12T18:36:43.704 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:43.704 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:43.704 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:43.704 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:43.705 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.705 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:43.705 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:43.705 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:43.705 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.706 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.706 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:43.706 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:43.706 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:43.706 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.706 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.707 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:43.707 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632712+0000", 2024-09-12T18:36:43.707 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6869999999999999e-06 2024-09-12T18:36:43.707 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.707 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.708 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:43.708 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632719+0000", 2024-09-12T18:36:43.708 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6059999999999999e-06 2024-09-12T18:36:43.708 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.708 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.709 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:43.709 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632737+0000", 2024-09-12T18:36:43.709 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7983999999999999e-05 2024-09-12T18:36:43.709 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.709 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.710 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:43.710 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632751+0000", 2024-09-12T18:36:43.710 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4473e-05 2024-09-12T18:36:43.710 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.710 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.710 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:43.711 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636961+0000", 2024-09-12T18:36:43.711 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042100840000000002 2024-09-12T18:36:43.711 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.711 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.711 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:43.712 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637211+0000", 2024-09-12T18:36:43.712 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000249738 2024-09-12T18:36:43.712 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.712 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.712 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:43.713 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637504+0000", 2024-09-12T18:36:43.713 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00029271499999999998 2024-09-12T18:36:43.713 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.713 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.713 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:43.713 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639582+0000", 2024-09-12T18:36:43.714 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020783389999999998 2024-09-12T18:36:43.714 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.714 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.714 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:43.714 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657709+0000", 2024-09-12T18:36:43.715 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018126758999999999 2024-09-12T18:36:43.715 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.715 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.715 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:43.715 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657830+0000", 2024-09-12T18:36:43.716 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000121329 2024-09-12T18:36:43.716 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.716 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.716 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:43.716 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657949+0000", 2024-09-12T18:36:43.716 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000119169 2024-09-12T18:36:43.717 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:43.717 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:43.717 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:43.717 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.717 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.718 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:43.718 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:43.718 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 78.036107516000001, 2024-09-12T18:36:43.718 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026711823999999999, 2024-09-12T18:36:43.718 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:43.718 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:43.718 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:43.718 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:43.718 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.718 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:43.718 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:43.718 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:43.718 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.719 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.719 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:43.719 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:43.719 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:43.719 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.719 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.719 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:43.719 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632775+0000", 2024-09-12T18:36:43.719 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9999999999999995e-07 2024-09-12T18:36:43.719 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.719 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.719 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:43.719 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632788+0000", 2024-09-12T18:36:43.719 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2629999999999999e-05 2024-09-12T18:36:43.720 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.720 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.720 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:43.720 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632806+0000", 2024-09-12T18:36:43.720 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:36:43.720 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.720 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.720 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:43.720 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632820+0000", 2024-09-12T18:36:43.720 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3777e-05 2024-09-12T18:36:43.720 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.720 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.720 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:43.720 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638310+0000", 2024-09-12T18:36:43.721 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054898280000000004 2024-09-12T18:36:43.721 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.721 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.721 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:43.721 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638480+0000", 2024-09-12T18:36:43.721 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016968199999999999 2024-09-12T18:36:43.721 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.721 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.721 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:43.721 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638799+0000", 2024-09-12T18:36:43.721 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031915999999999997 2024-09-12T18:36:43.721 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.721 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.721 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:43.722 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639866+0000", 2024-09-12T18:36:43.722 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001067405 2024-09-12T18:36:43.722 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.722 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.722 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:43.722 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658398+0000", 2024-09-12T18:36:43.722 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018531542000000002 2024-09-12T18:36:43.722 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.722 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.722 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:43.722 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658643+0000", 2024-09-12T18:36:43.722 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00024531500000000002 2024-09-12T18:36:43.722 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.722 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.723 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:43.723 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.659486+0000", 2024-09-12T18:36:43.723 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00084316899999999995 2024-09-12T18:36:43.723 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:43.723 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:43.723 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:43.723 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.723 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.723 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:24 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:43.723 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:36:43.723 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 78.035880453999994, 2024-09-12T18:36:43.723 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.021357139000000001, 2024-09-12T18:36:43.723 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:43.723 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:43.724 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:43.724 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:43.724 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.724 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:43.724 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:36:43.724 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:43.724 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.724 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.724 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:43.724 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633001+0000", 2024-09-12T18:36:43.724 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:43.724 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.724 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.724 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:43.725 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633003+0000", 2024-09-12T18:36:43.725 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.53e-06 2024-09-12T18:36:43.725 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.725 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.725 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:43.725 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633012+0000", 2024-09-12T18:36:43.725 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9290000000000004e-06 2024-09-12T18:36:43.725 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.725 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.725 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:43.725 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633034+0000", 2024-09-12T18:36:43.725 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2127e-05 2024-09-12T18:36:43.725 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.725 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.726 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:43.726 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633054+0000", 2024-09-12T18:36:43.726 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9476000000000001e-05 2024-09-12T18:36:43.726 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.726 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.726 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:43.726 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636657+0000", 2024-09-12T18:36:43.726 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036038839999999999 2024-09-12T18:36:43.726 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.726 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.726 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:43.726 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636885+0000", 2024-09-12T18:36:43.726 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022798800000000001 2024-09-12T18:36:43.726 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.727 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.727 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:43.727 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637189+0000", 2024-09-12T18:36:43.727 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030392100000000002 2024-09-12T18:36:43.727 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.727 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.727 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:43.727 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639271+0000", 2024-09-12T18:36:43.727 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020817460000000002 2024-09-12T18:36:43.727 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.727 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.727 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:43.727 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.652371+0000", 2024-09-12T18:36:43.727 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013099417 2024-09-12T18:36:43.728 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.728 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.728 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:43.728 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654255+0000", 2024-09-12T18:36:43.728 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018846049999999999 2024-09-12T18:36:43.728 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.728 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.728 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:43.728 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.654359+0000", 2024-09-12T18:36:43.728 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000103516 2024-09-12T18:36:43.728 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:43.728 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:43.728 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:43.729 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.729 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.729 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:43.729 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:43.729 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 78.035798761999999, 2024-09-12T18:36:43.729 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026938645000000001, 2024-09-12T18:36:43.729 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:43.729 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:43.729 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:43.729 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:43.729 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.729 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:43.729 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:43.729 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:43.729 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.730 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.730 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:43.730 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:43.730 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:43.730 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.730 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.730 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:43.730 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633085+0000", 2024-09-12T18:36:43.730 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:43.730 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.730 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.730 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:43.730 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633093+0000", 2024-09-12T18:36:43.730 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3999999999999992e-06 2024-09-12T18:36:43.731 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.731 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.731 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:43.731 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633111+0000", 2024-09-12T18:36:43.731 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8070000000000001e-05 2024-09-12T18:36:43.731 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.731 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.731 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:43.731 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633126+0000", 2024-09-12T18:36:43.731 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4487e-05 2024-09-12T18:36:43.731 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.731 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.731 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:43.731 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638290+0000", 2024-09-12T18:36:43.732 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0051640269999999999 2024-09-12T18:36:43.732 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.732 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.732 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:43.732 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638547+0000", 2024-09-12T18:36:43.732 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025714100000000001 2024-09-12T18:36:43.732 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.732 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.732 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:43.732 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638850+0000", 2024-09-12T18:36:43.732 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030278400000000001 2024-09-12T18:36:43.732 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.732 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.732 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:43.733 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.640706+0000", 2024-09-12T18:36:43.733 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018564580000000001 2024-09-12T18:36:43.733 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.733 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.733 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:43.733 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658420+0000", 2024-09-12T18:36:43.733 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017714395000000001 2024-09-12T18:36:43.733 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.733 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.733 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:43.733 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658635+0000", 2024-09-12T18:36:43.733 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021413500000000001 2024-09-12T18:36:43.733 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.733 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.734 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:43.734 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.660022+0000", 2024-09-12T18:36:43.734 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001387318 2024-09-12T18:36:43.734 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:43.734 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:43.734 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:43.734 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.734 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.734 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121096 5.8 5:13503891:::benchmark_data_smithi073_23739_object121095:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:43.734 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:36:43.734 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 3.4903057949999998, 2024-09-12T18:36:43.734 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064025391000000001, 2024-09-12T18:36:43.734 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:43.734 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:43.735 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:43.735 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:43.735 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:43.735 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:43.735 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121096 2024-09-12T18:36:43.735 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.735 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:43.735 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.735 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:43.735 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:36:43.735 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:43.735 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.735 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.735 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:43.736 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:36:43.736 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:43.736 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.736 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.736 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:43.736 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178579+0000", 2024-09-12T18:36:43.736 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7369999999999998e-06 2024-09-12T18:36:43.736 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.736 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.736 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:43.736 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178846+0000", 2024-09-12T18:36:43.736 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026752699999999999 2024-09-12T18:36:43.736 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.737 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.737 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:43.737 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178877+0000", 2024-09-12T18:36:43.737 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1081999999999998e-05 2024-09-12T18:36:43.737 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.737 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.737 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:43.737 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178896+0000", 2024-09-12T18:36:43.737 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8522e-05 2024-09-12T18:36:43.737 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.737 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.737 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:43.737 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.192591+0000", 2024-09-12T18:36:43.737 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013695067 2024-09-12T18:36:43.738 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.738 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.738 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:43.738 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.192944+0000", 2024-09-12T18:36:43.738 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00035273699999999999 2024-09-12T18:36:43.738 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.738 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.738 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:43.738 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.193732+0000", 2024-09-12T18:36:43.738 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078849599999999997 2024-09-12T18:36:43.738 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.738 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.738 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:43.738 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.213583+0000", 2024-09-12T18:36:43.739 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.019851164000000001 2024-09-12T18:36:43.739 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.739 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.739 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:43.739 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242386+0000", 2024-09-12T18:36:43.739 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028802924000000001 2024-09-12T18:36:43.739 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.739 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.739 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:43.739 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242501+0000", 2024-09-12T18:36:43.739 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000114932 2024-09-12T18:36:43.739 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.739 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.739 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:43.739 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242602+0000", 2024-09-12T18:36:43.740 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000100203 2024-09-12T18:36:43.740 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:43.740 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:43.740 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:43.740 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.740 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.740 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121097 5.8 5:1b31a99e:::benchmark_data_smithi073_23739_object121096:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:43.740 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:36:43.740 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 3.4745775050000001, 2024-09-12T18:36:43.740 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048475917, 2024-09-12T18:36:43.740 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:43.740 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:43.740 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:43.741 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:43.741 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:43.741 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:43.741 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121097 2024-09-12T18:36:43.741 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.741 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:43.741 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.741 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:43.741 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:36:43.741 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:43.741 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.741 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.741 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:43.741 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:36:43.742 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:43.742 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.742 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.742 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:43.742 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194308+0000", 2024-09-12T18:36:43.742 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2789999999999999e-06 2024-09-12T18:36:43.742 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.742 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.742 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:43.742 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194396+0000", 2024-09-12T18:36:43.742 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8324000000000003e-05 2024-09-12T18:36:43.742 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.742 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.742 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:43.743 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194424+0000", 2024-09-12T18:36:43.743 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7565000000000001e-05 2024-09-12T18:36:43.743 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.743 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.743 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:43.743 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194444+0000", 2024-09-12T18:36:43.743 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0363000000000001e-05 2024-09-12T18:36:43.743 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.743 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.743 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:43.743 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.206888+0000", 2024-09-12T18:36:43.743 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012443997 2024-09-12T18:36:43.743 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.743 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.744 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:43.744 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.207138+0000", 2024-09-12T18:36:43.744 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025035900000000002 2024-09-12T18:36:43.744 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.744 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.744 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:43.744 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.207365+0000", 2024-09-12T18:36:43.744 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000226407 2024-09-12T18:36:43.744 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.744 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.744 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:43.744 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.215059+0000", 2024-09-12T18:36:43.744 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076946860000000001 2024-09-12T18:36:43.744 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.745 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.745 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:43.745 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242619+0000", 2024-09-12T18:36:43.745 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.027559975 2024-09-12T18:36:43.745 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.745 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.745 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:43.745 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242706+0000", 2024-09-12T18:36:43.745 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6384999999999994e-05 2024-09-12T18:36:43.745 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.745 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.745 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:43.745 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242780+0000", 2024-09-12T18:36:43.745 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4577000000000001e-05 2024-09-12T18:36:43.746 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:43.746 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:43.746 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:43.746 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.746 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.746 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:121044 5.1 e50/49 5:83bf711a:::benchmark_data_smithi073_23739_object121043:head v 50'7532, mlcod=0'0)", 2024-09-12T18:36:43.746 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.201054+0000", 2024-09-12T18:36:43.746 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 3.4678282839999999, 2024-09-12T18:36:43.746 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026157387000000001, 2024-09-12T18:36:43.746 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:43.746 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:43.746 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:43.746 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:43.747 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.747 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:43.747 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201054+0000", 2024-09-12T18:36:43.747 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:43.747 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.747 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.747 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:43.747 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201054+0000", 2024-09-12T18:36:43.747 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:43.747 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.747 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.747 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:43.747 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201056+0000", 2024-09-12T18:36:43.747 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.99e-06 2024-09-12T18:36:43.748 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.748 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.748 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:43.748 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201068+0000", 2024-09-12T18:36:43.748 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2799000000000001e-05 2024-09-12T18:36:43.748 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.748 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.748 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:43.748 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201093+0000", 2024-09-12T18:36:43.748 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4766e-05 2024-09-12T18:36:43.748 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.748 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.748 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:43.748 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201115+0000", 2024-09-12T18:36:43.749 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1988999999999999e-05 2024-09-12T18:36:43.749 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.749 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.749 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:43.749 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201233+0000", 2024-09-12T18:36:43.749 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000118229 2024-09-12T18:36:43.749 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.749 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.749 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:43.749 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201273+0000", 2024-09-12T18:36:43.749 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9171999999999997e-05 2024-09-12T18:36:43.749 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.749 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.749 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:43.750 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.227080+0000", 2024-09-12T18:36:43.750 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025807611000000001 2024-09-12T18:36:43.750 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.750 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.750 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:43.750 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.227211+0000", 2024-09-12T18:36:43.750 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013083100000000001 2024-09-12T18:36:43.750 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:43.750 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:43.750 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:43.750 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.750 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.750 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:121064 5.1 e50/49 5:80993cb9:::benchmark_data_smithi073_23739_object121063:head v 50'7533, mlcod=0'0)", 2024-09-12T18:36:43.750 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.206796+0000", 2024-09-12T18:36:43.751 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 3.4620856820000001, 2024-09-12T18:36:43.751 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.021897060999999999, 2024-09-12T18:36:43.751 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:43.751 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:43.751 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:43.751 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:43.751 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.751 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:43.751 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.206796+0000", 2024-09-12T18:36:43.751 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:43.751 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.751 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.751 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:43.752 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.206796+0000", 2024-09-12T18:36:43.752 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:43.752 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.752 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.752 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:43.752 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.206799+0000", 2024-09-12T18:36:43.752 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.384e-06 2024-09-12T18:36:43.752 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.752 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.752 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:43.752 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.206815+0000", 2024-09-12T18:36:43.752 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6412000000000001e-05 2024-09-12T18:36:43.752 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.752 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.753 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:43.753 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.206840+0000", 2024-09-12T18:36:43.753 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5026000000000001e-05 2024-09-12T18:36:43.753 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.753 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.753 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:43.753 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.206859+0000", 2024-09-12T18:36:43.753 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8770000000000002e-05 2024-09-12T18:36:43.753 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.753 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.753 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:43.753 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.217912+0000", 2024-09-12T18:36:43.753 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011052726000000001 2024-09-12T18:36:43.754 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.754 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.754 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:43.754 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.217951+0000", 2024-09-12T18:36:43.754 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9610999999999997e-05 2024-09-12T18:36:43.754 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.754 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.754 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:43.754 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.228595+0000", 2024-09-12T18:36:43.754 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.010643846 2024-09-12T18:36:43.754 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.754 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.754 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:43.755 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.228693+0000", 2024-09-12T18:36:43.755 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8286000000000001e-05 2024-09-12T18:36:43.755 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:43.755 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:43.755 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:43.755 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.755 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.755 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121101 5.e 5:7e18e9ed:::benchmark_data_smithi073_23739_object121100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:43.755 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.209084+0000", 2024-09-12T18:36:43.755 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 3.4597974499999999, 2024-09-12T18:36:43.755 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028988566, 2024-09-12T18:36:43.755 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:43.755 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:43.755 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:43.756 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:43.756 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:43.756 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:43.756 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121101 2024-09-12T18:36:43.756 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.756 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:43.756 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.756 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:43.756 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209084+0000", 2024-09-12T18:36:43.756 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:43.756 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.756 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.756 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:43.757 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209084+0000", 2024-09-12T18:36:43.757 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:43.757 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.757 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.757 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:43.757 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209087+0000", 2024-09-12T18:36:43.757 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6800000000000002e-06 2024-09-12T18:36:43.757 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.757 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.757 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:43.757 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209182+0000", 2024-09-12T18:36:43.757 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5084e-05 2024-09-12T18:36:43.757 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.758 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.758 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:43.758 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209212+0000", 2024-09-12T18:36:43.758 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9825e-05 2024-09-12T18:36:43.758 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.758 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.758 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:43.758 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209234+0000", 2024-09-12T18:36:43.758 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1416e-05 2024-09-12T18:36:43.758 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.758 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.758 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:43.758 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209497+0000", 2024-09-12T18:36:43.758 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026390400000000003 2024-09-12T18:36:43.759 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.759 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.759 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:43.759 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209810+0000", 2024-09-12T18:36:43.759 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000313023 2024-09-12T18:36:43.759 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.759 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.759 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:43.759 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.210468+0000", 2024-09-12T18:36:43.759 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00065779300000000005 2024-09-12T18:36:43.759 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.759 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.759 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:43.759 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.235905+0000", 2024-09-12T18:36:43.760 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025436881000000001 2024-09-12T18:36:43.760 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.760 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.760 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:43.760 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237797+0000", 2024-09-12T18:36:43.760 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001892007 2024-09-12T18:36:43.760 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.760 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.760 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:43.760 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237941+0000", 2024-09-12T18:36:43.760 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000143411 2024-09-12T18:36:43.760 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.761 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.761 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:43.761 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.238073+0000", 2024-09-12T18:36:43.761 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013254200000000001 2024-09-12T18:36:43.761 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:43.761 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:43.761 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:43.761 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.761 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.761 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121102 5.8 5:1f118f4b:::benchmark_data_smithi073_23739_object121101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:43.761 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.218682+0000", 2024-09-12T18:36:43.761 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 3.4502000900000001, 2024-09-12T18:36:43.761 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024264885, 2024-09-12T18:36:43.761 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:43.762 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:43.762 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:43.762 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:43.762 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:43.762 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:43.762 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121102 2024-09-12T18:36:43.762 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.762 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:43.762 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.762 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:43.762 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218682+0000", 2024-09-12T18:36:43.762 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:43.762 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.763 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.763 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:43.763 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218682+0000", 2024-09-12T18:36:43.763 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:43.763 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.763 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.763 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:43.763 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218685+0000", 2024-09-12T18:36:43.763 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6059999999999999e-06 2024-09-12T18:36:43.763 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.763 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.763 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:43.763 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218743+0000", 2024-09-12T18:36:43.763 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7160999999999997e-05 2024-09-12T18:36:43.764 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.764 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.764 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:43.764 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218768+0000", 2024-09-12T18:36:43.764 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5052e-05 2024-09-12T18:36:43.764 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.764 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.764 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:43.764 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218785+0000", 2024-09-12T18:36:43.764 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7436999999999999e-05 2024-09-12T18:36:43.764 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.764 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.764 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:43.765 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218952+0000", 2024-09-12T18:36:43.765 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016691300000000001 2024-09-12T18:36:43.765 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.765 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.765 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:43.765 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.219437+0000", 2024-09-12T18:36:43.765 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048465900000000002 2024-09-12T18:36:43.765 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.765 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.765 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:43.765 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.219893+0000", 2024-09-12T18:36:43.765 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00045642799999999999 2024-09-12T18:36:43.765 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.765 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.766 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:43.766 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.226416+0000", 2024-09-12T18:36:43.766 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065225630000000003 2024-09-12T18:36:43.766 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.766 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.766 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:43.766 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242796+0000", 2024-09-12T18:36:43.766 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016379857000000001 2024-09-12T18:36:43.766 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.766 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.766 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:43.766 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242879+0000", 2024-09-12T18:36:43.766 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3913999999999997e-05 2024-09-12T18:36:43.766 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.767 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.767 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:43.767 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242947+0000", 2024-09-12T18:36:43.767 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7294999999999999e-05 2024-09-12T18:36:43.767 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:43.767 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:43.767 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:43.767 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.767 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.767 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121106 5.d 5:b4a9a221:::benchmark_data_smithi073_23739_object121105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:43.767 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:36:43.767 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 3.431702569, 2024-09-12T18:36:43.767 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.034882274999999997, 2024-09-12T18:36:43.767 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:43.768 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:43.768 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:43.768 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:43.768 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:43.768 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:43.768 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121106 2024-09-12T18:36:43.768 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.768 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:43.768 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.768 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:43.768 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:36:43.768 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:43.768 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.769 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.769 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:43.769 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:36:43.769 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:43.769 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.769 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.769 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:43.769 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237182+0000", 2024-09-12T18:36:43.769 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6019999999999998e-06 2024-09-12T18:36:43.769 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.769 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.769 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:43.769 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237257+0000", 2024-09-12T18:36:43.770 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5420999999999995e-05 2024-09-12T18:36:43.770 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.770 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.770 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:43.770 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237305+0000", 2024-09-12T18:36:43.770 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7207999999999999e-05 2024-09-12T18:36:43.770 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.770 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.770 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:43.770 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237325+0000", 2024-09-12T18:36:43.770 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0001e-05 2024-09-12T18:36:43.770 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.770 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.770 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:43.771 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237505+0000", 2024-09-12T18:36:43.771 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000180798 2024-09-12T18:36:43.771 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.771 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.771 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:43.771 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237764+0000", 2024-09-12T18:36:43.771 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025862299999999998 2024-09-12T18:36:43.771 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.771 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.771 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:43.771 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.238264+0000", 2024-09-12T18:36:43.771 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00050016100000000005 2024-09-12T18:36:43.771 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.772 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.772 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:43.772 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256525+0000", 2024-09-12T18:36:43.772 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018260508000000002 2024-09-12T18:36:43.772 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.772 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.772 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:43.772 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.271903+0000", 2024-09-12T18:36:43.772 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015378739000000001 2024-09-12T18:36:43.772 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.772 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.772 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:43.772 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.271999+0000", 2024-09-12T18:36:43.773 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5989000000000005e-05 2024-09-12T18:36:43.773 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.773 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.773 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:43.773 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272062+0000", 2024-09-12T18:36:43.773 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2224999999999995e-05 2024-09-12T18:36:43.773 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:43.773 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:43.773 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:43.773 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.773 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.773 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121112 5.d 5:b9a2d671:::benchmark_data_smithi073_23739_object121111:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:43.773 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.243446+0000", 2024-09-12T18:36:43.773 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 3.4254358439999999, 2024-09-12T18:36:43.774 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.02889415, 2024-09-12T18:36:43.774 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:43.774 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:43.774 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:43.774 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:43.774 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:43.774 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:43.774 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121112 2024-09-12T18:36:43.774 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.774 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:43.774 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.774 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:43.774 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243446+0000", 2024-09-12T18:36:43.774 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:43.775 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.775 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.775 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:43.775 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243446+0000", 2024-09-12T18:36:43.775 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:43.775 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.775 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.775 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:43.775 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243448+0000", 2024-09-12T18:36:43.775 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0829999999999998e-06 2024-09-12T18:36:43.775 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.775 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.775 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:43.775 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243527+0000", 2024-09-12T18:36:43.776 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9173999999999998e-05 2024-09-12T18:36:43.776 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.776 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.776 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:43.776 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243549+0000", 2024-09-12T18:36:43.776 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1169e-05 2024-09-12T18:36:43.776 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.776 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.776 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:43.776 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243564+0000", 2024-09-12T18:36:43.776 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5866999999999999e-05 2024-09-12T18:36:43.776 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.776 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.776 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:43.777 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.249905+0000", 2024-09-12T18:36:43.777 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063410360000000004 2024-09-12T18:36:43.777 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.777 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.777 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:43.777 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.250166+0000", 2024-09-12T18:36:43.777 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026052999999999997 2024-09-12T18:36:43.777 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.777 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.777 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:43.777 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.250486+0000", 2024-09-12T18:36:43.777 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00032002700000000002 2024-09-12T18:36:43.777 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.777 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.778 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:43.778 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.259263+0000", 2024-09-12T18:36:43.778 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0087774770000000005 2024-09-12T18:36:43.778 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.778 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.778 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:43.778 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272186+0000", 2024-09-12T18:36:43.778 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.01292213 2024-09-12T18:36:43.778 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.778 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.778 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:43.778 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272267+0000", 2024-09-12T18:36:43.778 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1153e-05 2024-09-12T18:36:43.778 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.779 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.779 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:43.779 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272340+0000", 2024-09-12T18:36:43.779 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3504000000000006e-05 2024-09-12T18:36:43.779 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:43.779 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:43.779 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:43.779 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.779 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.779 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121114 5.d 5:b8870c11:::benchmark_data_smithi073_23739_object121113:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:43.779 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.243603+0000", 2024-09-12T18:36:43.779 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 3.4252785929999998, 2024-09-12T18:36:43.779 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028945746000000001, 2024-09-12T18:36:43.779 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:43.780 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:43.780 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:43.780 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:43.780 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:43.780 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:43.780 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121114 2024-09-12T18:36:43.780 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.780 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:43.780 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.780 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:43.780 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243603+0000", 2024-09-12T18:36:43.780 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:43.780 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.781 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.781 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:43.781 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243603+0000", 2024-09-12T18:36:43.781 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:43.781 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.781 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.781 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:43.781 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243605+0000", 2024-09-12T18:36:43.781 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.268e-06 2024-09-12T18:36:43.781 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.781 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.781 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:43.781 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243674+0000", 2024-09-12T18:36:43.781 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9375000000000006e-05 2024-09-12T18:36:43.782 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.782 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.782 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:43.782 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243691+0000", 2024-09-12T18:36:43.782 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6517000000000001e-05 2024-09-12T18:36:43.782 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.782 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.782 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:43.782 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243702+0000", 2024-09-12T18:36:43.782 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1905999999999999e-05 2024-09-12T18:36:43.782 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.782 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.782 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:43.782 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.253789+0000", 2024-09-12T18:36:43.783 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.010086776 2024-09-12T18:36:43.783 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.783 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.783 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:43.783 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.253959+0000", 2024-09-12T18:36:43.783 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00017000000000000001 2024-09-12T18:36:43.783 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.783 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.783 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:43.783 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.254179+0000", 2024-09-12T18:36:43.783 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022003699999999999 2024-09-12T18:36:43.783 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.783 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.784 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:43.784 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.259330+0000", 2024-09-12T18:36:43.784 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0051511559999999996 2024-09-12T18:36:43.784 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.784 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.784 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:43.784 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272403+0000", 2024-09-12T18:36:43.784 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013072342000000001 2024-09-12T18:36:43.784 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.784 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.784 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:43.784 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272493+0000", 2024-09-12T18:36:43.784 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0595999999999998e-05 2024-09-12T18:36:43.784 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.785 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.785 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:43.785 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272549+0000", 2024-09-12T18:36:43.785 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5773000000000003e-05 2024-09-12T18:36:43.785 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:43.785 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:43.785 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:43.785 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.785 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.785 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121115 5.d 5:bd4a51ea:::benchmark_data_smithi073_23739_object121114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:43.785 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.245059+0000", 2024-09-12T18:36:43.785 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 3.423822919, 2024-09-12T18:36:43.785 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.02767406, 2024-09-12T18:36:43.786 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:43.786 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:43.786 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:43.786 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:43.786 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:43.786 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:43.786 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121115 2024-09-12T18:36:43.786 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.786 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:43.786 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.786 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:43.786 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245059+0000", 2024-09-12T18:36:43.786 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:43.786 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.787 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.787 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:43.787 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245059+0000", 2024-09-12T18:36:43.787 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:43.787 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.787 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.787 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:43.787 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245061+0000", 2024-09-12T18:36:43.787 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9759999999999998e-06 2024-09-12T18:36:43.787 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.787 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.787 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:43.787 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245111+0000", 2024-09-12T18:36:43.787 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9838e-05 2024-09-12T18:36:43.788 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.788 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.788 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:43.788 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245132+0000", 2024-09-12T18:36:43.788 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1469999999999999e-05 2024-09-12T18:36:43.788 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.788 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.788 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:43.788 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245146+0000", 2024-09-12T18:36:43.788 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3377000000000001e-05 2024-09-12T18:36:43.788 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.788 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.788 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:43.789 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256596+0000", 2024-09-12T18:36:43.789 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011450241999999999 2024-09-12T18:36:43.789 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.789 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.789 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:43.789 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256838+0000", 2024-09-12T18:36:43.789 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000242255 2024-09-12T18:36:43.789 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.789 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.789 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:43.789 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.257095+0000", 2024-09-12T18:36:43.789 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025679300000000001 2024-09-12T18:36:43.789 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.789 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.790 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:43.790 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.259928+0000", 2024-09-12T18:36:43.790 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0028326290000000001 2024-09-12T18:36:43.790 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.790 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.790 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:43.790 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272607+0000", 2024-09-12T18:36:43.790 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012679466 2024-09-12T18:36:43.790 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.790 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.790 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:43.790 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272681+0000", 2024-09-12T18:36:43.790 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3580999999999999e-05 2024-09-12T18:36:43.790 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.791 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.791 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:43.791 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272733+0000", 2024-09-12T18:36:43.791 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2432999999999998e-05 2024-09-12T18:36:43.791 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:43.791 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:43.791 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:43.791 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.791 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.791 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121148 5.4 5:2a9bde06:::benchmark_data_smithi073_23739_object121147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:43.791 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.281423+0000", 2024-09-12T18:36:43.791 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 3.387459277, 2024-09-12T18:36:43.791 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025774785000000001, 2024-09-12T18:36:43.792 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:43.792 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:43.792 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:43.792 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:43.792 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:43.792 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:43.792 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121148 2024-09-12T18:36:43.792 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.792 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:43.792 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.792 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:43.792 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281423+0000", 2024-09-12T18:36:43.792 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:43.793 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.793 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.793 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:43.793 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281423+0000", 2024-09-12T18:36:43.793 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:43.793 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.793 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.793 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:43.793 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281424+0000", 2024-09-12T18:36:43.793 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.048e-06 2024-09-12T18:36:43.793 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.793 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.793 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:43.793 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281496+0000", 2024-09-12T18:36:43.794 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2099000000000002e-05 2024-09-12T18:36:43.794 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.794 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.794 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:43.794 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281509+0000", 2024-09-12T18:36:43.794 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3379e-05 2024-09-12T18:36:43.794 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.794 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.794 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:43.794 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281515+0000", 2024-09-12T18:36:43.794 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.28e-06 2024-09-12T18:36:43.794 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.794 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.794 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:43.795 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281688+0000", 2024-09-12T18:36:43.795 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00017203100000000001 2024-09-12T18:36:43.795 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.795 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.795 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:43.795 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281834+0000", 2024-09-12T18:36:43.795 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014645899999999999 2024-09-12T18:36:43.795 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.795 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.795 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:43.795 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.282319+0000", 2024-09-12T18:36:43.795 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048535000000000001 2024-09-12T18:36:43.795 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.795 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.796 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:43.796 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307086+0000", 2024-09-12T18:36:43.796 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024766989999999999 2024-09-12T18:36:43.796 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.796 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.796 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:43.796 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307108+0000", 2024-09-12T18:36:43.796 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1795999999999999e-05 2024-09-12T18:36:43.796 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.796 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.796 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:43.796 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307157+0000", 2024-09-12T18:36:43.796 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8729000000000001e-05 2024-09-12T18:36:43.796 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.797 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.797 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:43.797 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307197+0000", 2024-09-12T18:36:43.797 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0624000000000003e-05 2024-09-12T18:36:43.797 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:43.797 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:43.797 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:43.797 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.797 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.797 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121155 5.4 5:2af257d1:::benchmark_data_smithi073_23739_object121154:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:43.797 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.283163+0000", 2024-09-12T18:36:43.797 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 3.3857186019999999, 2024-09-12T18:36:43.797 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024186485000000001, 2024-09-12T18:36:43.797 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:43.798 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:43.798 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:43.798 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:43.798 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:43.798 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:43.798 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121155 2024-09-12T18:36:43.798 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.798 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:43.798 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.798 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:43.798 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283163+0000", 2024-09-12T18:36:43.798 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:43.798 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.798 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.798 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:43.799 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283163+0000", 2024-09-12T18:36:43.799 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:43.799 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.799 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.799 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:43.799 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283165+0000", 2024-09-12T18:36:43.799 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.748e-06 2024-09-12T18:36:43.799 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.799 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.799 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:43.799 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283218+0000", 2024-09-12T18:36:43.799 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2695000000000003e-05 2024-09-12T18:36:43.799 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.799 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.800 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:43.800 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283244+0000", 2024-09-12T18:36:43.800 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6072e-05 2024-09-12T18:36:43.800 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.800 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.800 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:43.800 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283257+0000", 2024-09-12T18:36:43.800 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3054000000000001e-05 2024-09-12T18:36:43.800 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.800 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.800 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:43.800 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.294509+0000", 2024-09-12T18:36:43.800 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011251677999999999 2024-09-12T18:36:43.801 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.801 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.801 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:43.801 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.294705+0000", 2024-09-12T18:36:43.801 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000196369 2024-09-12T18:36:43.801 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.801 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.801 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:43.801 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.294907+0000", 2024-09-12T18:36:43.801 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020184700000000001 2024-09-12T18:36:43.801 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.801 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.801 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:43.801 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307208+0000", 2024-09-12T18:36:43.802 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012301068 2024-09-12T18:36:43.802 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.802 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.802 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:43.802 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307273+0000", 2024-09-12T18:36:43.802 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5611000000000006e-05 2024-09-12T18:36:43.802 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.802 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.802 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:43.802 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307320+0000", 2024-09-12T18:36:43.802 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6220999999999997e-05 2024-09-12T18:36:43.802 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.802 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.802 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:43.803 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307350+0000", 2024-09-12T18:36:43.803 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0122000000000001e-05 2024-09-12T18:36:43.803 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:43.803 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:43.803 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:43.803 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.803 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.803 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121160 5.b 5:d4730c8e:::benchmark_data_smithi073_23739_object121159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:43.803 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.289262+0000", 2024-09-12T18:36:43.803 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 3.379619586, 2024-09-12T18:36:43.803 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024618870000000001, 2024-09-12T18:36:43.803 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:43.803 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:43.803 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:43.804 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:43.804 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:43.804 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:43.804 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121160 2024-09-12T18:36:43.804 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.804 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:43.804 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.804 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:43.804 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289262+0000", 2024-09-12T18:36:43.804 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:43.804 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.804 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.804 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:43.805 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289262+0000", 2024-09-12T18:36:43.805 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:43.805 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.805 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.805 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:43.805 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289264+0000", 2024-09-12T18:36:43.805 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.945e-06 2024-09-12T18:36:43.805 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.805 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.805 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:43.805 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289331+0000", 2024-09-12T18:36:43.805 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6594999999999995e-05 2024-09-12T18:36:43.805 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.805 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.806 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:43.806 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289359+0000", 2024-09-12T18:36:43.806 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7988999999999999e-05 2024-09-12T18:36:43.806 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.806 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.806 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:43.806 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289375+0000", 2024-09-12T18:36:43.806 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5639000000000001e-05 2024-09-12T18:36:43.806 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.806 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.806 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:43.806 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289515+0000", 2024-09-12T18:36:43.806 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000140254 2024-09-12T18:36:43.806 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.807 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.807 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:43.807 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289740+0000", 2024-09-12T18:36:43.807 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022513500000000001 2024-09-12T18:36:43.807 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.807 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.807 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:43.807 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.290232+0000", 2024-09-12T18:36:43.807 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00049247500000000003 2024-09-12T18:36:43.807 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.807 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.807 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:43.807 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.312221+0000", 2024-09-12T18:36:43.807 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.021988939999999998 2024-09-12T18:36:43.807 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.808 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.808 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:43.808 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.313807+0000", 2024-09-12T18:36:43.808 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015859100000000001 2024-09-12T18:36:43.808 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.808 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.808 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:43.808 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.313852+0000", 2024-09-12T18:36:43.808 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4305999999999999e-05 2024-09-12T18:36:43.808 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.808 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.808 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:43.808 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.313881+0000", 2024-09-12T18:36:43.809 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9682000000000001e-05 2024-09-12T18:36:43.809 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:43.809 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:43.809 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:43.809 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.809 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.809 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121172 5.b 5:dccf88e8:::benchmark_data_smithi073_23739_object121171:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:43.809 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.298158+0000", 2024-09-12T18:36:43.809 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 3.3707237719999998, 2024-09-12T18:36:43.809 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.021440837000000001, 2024-09-12T18:36:43.809 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:43.809 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:43.809 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:43.809 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:43.810 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:43.810 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:43.810 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121172 2024-09-12T18:36:43.810 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.810 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:43.810 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.810 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:43.810 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.298158+0000", 2024-09-12T18:36:43.810 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:43.810 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.810 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.810 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:43.810 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.298158+0000", 2024-09-12T18:36:43.810 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:43.810 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.811 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.811 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:43.811 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.298159+0000", 2024-09-12T18:36:43.811 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9300000000000006e-07 2024-09-12T18:36:43.811 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.811 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.811 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:43.811 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.298239+0000", 2024-09-12T18:36:43.811 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9354e-05 2024-09-12T18:36:43.811 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.811 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.811 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:43.811 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.298250+0000", 2024-09-12T18:36:43.812 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.154e-05 2024-09-12T18:36:43.812 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.812 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.812 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:43.812 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.298259+0000", 2024-09-12T18:36:43.812 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.3419999999999997e-06 2024-09-12T18:36:43.812 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.812 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.812 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:43.812 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.305569+0000", 2024-09-12T18:36:43.812 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0073094029999999999 2024-09-12T18:36:43.812 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.812 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.812 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:43.813 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.305721+0000", 2024-09-12T18:36:43.813 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015262500000000001 2024-09-12T18:36:43.813 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.813 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.813 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:43.813 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.305963+0000", 2024-09-12T18:36:43.813 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00024107499999999999 2024-09-12T18:36:43.813 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.813 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.813 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:43.813 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.314004+0000", 2024-09-12T18:36:43.813 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080412350000000007 2024-09-12T18:36:43.813 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.813 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.814 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:43.814 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.319476+0000", 2024-09-12T18:36:43.814 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054722069999999998 2024-09-12T18:36:43.814 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.814 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.814 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:43.814 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.319538+0000", 2024-09-12T18:36:43.814 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1791000000000005e-05 2024-09-12T18:36:43.814 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:43.814 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:43.814 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:43.814 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.319599+0000", 2024-09-12T18:36:43.814 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1272000000000006e-05 2024-09-12T18:36:43.814 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:43.815 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:43.815 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:43.815 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:43.815 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:43.815 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:43.816 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:36:43.817 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:43.812+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:43.875 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 58 16 128290 128274 138.211 124.25 0.00474644 0.00723076 2024-09-12T18:36:43.917 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:43.916+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:43.984 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:36:43.984 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:36:43.984 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:43.984 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:128487 5.7 5:e46bd2b5:::benchmark_data_smithi073_23739_object128486:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:36:43.984 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:43.975462+0000", 2024-09-12T18:36:43.984 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0067289589999999996, 2024-09-12T18:36:43.984 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0067621579999999999, 2024-09-12T18:36:43.984 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:43.984 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:43.985 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:43.985 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:43.985 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:43.985 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:43.985 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 128487 2024-09-12T18:36:43.985 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:43.985 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:43.985 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:43.985 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:43.985 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.975462+0000", 2024-09-12T18:36:43.985 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:43.985 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:43.985 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:43.986 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:43.986 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.975462+0000", 2024-09-12T18:36:43.986 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:43.986 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:43.986 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:43.986 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:43.986 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.975463+0000", 2024-09-12T18:36:43.986 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4079999999999999e-06 2024-09-12T18:36:43.986 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:43.986 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:43.986 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:43.986 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.975508+0000", 2024-09-12T18:36:43.986 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4217e-05 2024-09-12T18:36:43.986 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:43.986 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:43.987 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:43.987 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.975516+0000", 2024-09-12T18:36:43.987 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.9330000000000001e-06 2024-09-12T18:36:43.987 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:43.987 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:43.987 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:43.987 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.975521+0000", 2024-09-12T18:36:43.987 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.028e-06 2024-09-12T18:36:43.987 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:43.987 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:43.987 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:43.987 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.975564+0000", 2024-09-12T18:36:43.987 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.3538000000000002e-05 2024-09-12T18:36:43.987 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:43.988 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:43.988 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:43.988 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.975657+0000", 2024-09-12T18:36:43.988 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.2991999999999993e-05 2024-09-12T18:36:43.988 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:43.988 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:43.988 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:43.988 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.975742+0000", 2024-09-12T18:36:43.988 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5112999999999996e-05 2024-09-12T18:36:43.988 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:43.988 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:43.988 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:43.988 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.977626+0000", 2024-09-12T18:36:43.989 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0018838469999999999 2024-09-12T18:36:43.989 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:43.989 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:43.989 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:43.989 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:43.989 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:43.989 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:128486 5.c e51/21 5:3df92e83:::benchmark_data_smithi073_23739_object128485:head v 51'7940, mlcod=51'7937)", 2024-09-12T18:36:43.989 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:43.978551+0000", 2024-09-12T18:36:43.989 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0036395619999999998, 2024-09-12T18:36:43.989 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0037584509999999999, 2024-09-12T18:36:43.989 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:43.989 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:43.989 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:43.989 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:43.989 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:43.990 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:43.990 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.978551+0000", 2024-09-12T18:36:43.990 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:43.990 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:43.990 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:43.990 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:43.990 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.978551+0000", 2024-09-12T18:36:43.990 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:43.990 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:43.990 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:43.990 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:43.990 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.978552+0000", 2024-09-12T18:36:43.990 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.3299999999999998e-07 2024-09-12T18:36:43.991 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:43.991 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:43.991 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:43.991 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.978614+0000", 2024-09-12T18:36:43.991 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2011e-05 2024-09-12T18:36:43.991 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:43.991 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:43.991 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:43.991 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.978622+0000", 2024-09-12T18:36:43.991 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.3329999999999997e-06 2024-09-12T18:36:43.991 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:43.991 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:43.991 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:43.991 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.978628+0000", 2024-09-12T18:36:43.992 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5659999999999997e-06 2024-09-12T18:36:43.992 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:43.992 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:43.992 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:43.992 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.978676+0000", 2024-09-12T18:36:43.992 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8136000000000001e-05 2024-09-12T18:36:43.992 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:43.992 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:43.992 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:43.992 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.978695+0000", 2024-09-12T18:36:43.992 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.8853000000000001e-05 2024-09-12T18:36:43.992 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:43.992 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:43.992 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:43.993 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:43.993 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:43.993 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:128488 5.c e51/21 5:3b01df56:::benchmark_data_smithi073_23739_object128487:head v 51'7941, mlcod=51'7937)", 2024-09-12T18:36:43.993 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:43.978715+0000", 2024-09-12T18:36:43.993 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.003475587, 2024-09-12T18:36:43.993 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0036945010000000002, 2024-09-12T18:36:43.993 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:43.993 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:43.993 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:43.993 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:43.993 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:43.993 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:43.993 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.978715+0000", 2024-09-12T18:36:43.994 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:43.994 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:43.994 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:43.994 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:43.994 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.978715+0000", 2024-09-12T18:36:43.994 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:43.994 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:43.994 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:43.994 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:43.994 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.978716+0000", 2024-09-12T18:36:43.994 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5700000000000002e-07 2024-09-12T18:36:43.994 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:43.994 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:43.994 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:43.994 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.978776+0000", 2024-09-12T18:36:43.995 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.0421999999999998e-05 2024-09-12T18:36:43.995 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:43.995 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:43.995 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:43.995 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.978784+0000", 2024-09-12T18:36:43.995 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.9959999999999993e-06 2024-09-12T18:36:43.995 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:43.995 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:43.995 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:43.995 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.978790+0000", 2024-09-12T18:36:43.995 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.643e-06 2024-09-12T18:36:43.995 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:43.995 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:43.995 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:43.995 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.980709+0000", 2024-09-12T18:36:43.995 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001918571 2024-09-12T18:36:43.996 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:43.996 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:43.996 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:43.996 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.980723+0000", 2024-09-12T18:36:43.996 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4012000000000001e-05 2024-09-12T18:36:43.996 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:43.996 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:43.996 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:43.996 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:43.996 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:43.996 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:128495 5.f 5:fbc846cd:::benchmark_data_smithi073_23739_object128494:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:36:43.996 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:43.979975+0000", 2024-09-12T18:36:43.996 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0022160090000000001, 2024-09-12T18:36:43.996 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0025196559999999999, 2024-09-12T18:36:43.996 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:43.997 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:43.997 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:43.997 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:43.997 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:43.997 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:43.997 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 128495 2024-09-12T18:36:43.997 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:43.997 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:43.997 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:43.997 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:43.997 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.979975+0000", 2024-09-12T18:36:43.997 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:43.998 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:43.998 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:43.998 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:43.998 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.979975+0000", 2024-09-12T18:36:43.998 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:43.998 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:43.998 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:43.998 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:43.998 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.979976+0000", 2024-09-12T18:36:43.999 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.195e-06 2024-09-12T18:36:43.999 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:43.999 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:43.999 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:43.999 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.980040+0000", 2024-09-12T18:36:43.999 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.3967999999999995e-05 2024-09-12T18:36:43.999 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:43.999 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:43.999 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:43.999 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.980052+0000", 2024-09-12T18:36:43.999 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1413000000000001e-05 2024-09-12T18:36:43.999 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:43.999 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:43.999 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:44.000 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.980059+0000", 2024-09-12T18:36:44.000 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0099999999999998e-06 2024-09-12T18:36:44.000 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.000 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.000 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:44.000 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.980113+0000", 2024-09-12T18:36:44.000 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4577000000000003e-05 2024-09-12T18:36:44.000 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.000 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.000 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:44.000 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.980244+0000", 2024-09-12T18:36:44.000 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013113600000000001 2024-09-12T18:36:44.000 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.000 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.000 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:44.001 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.980395+0000", 2024-09-12T18:36:44.001 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000150686 2024-09-12T18:36:44.001 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.001 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:44.001 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.001 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.001 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.001 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:128499 5.2 5:4ba02a91:::benchmark_data_smithi073_23739_object128498:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:36:44.001 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:43.982205+0000", 2024-09-12T18:36:44.001 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 4294967295.9999862, 2024-09-12T18:36:44.001 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000367129, 2024-09-12T18:36:44.001 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:44.001 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:44.002 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:44.002 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:44.002 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:44.002 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:44.002 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 128499 2024-09-12T18:36:44.002 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.002 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:44.002 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.002 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:44.002 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.982205+0000", 2024-09-12T18:36:44.002 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.002 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.002 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.002 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:44.003 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.982205+0000", 2024-09-12T18:36:44.003 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.003 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.003 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.003 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:44.003 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.982206+0000", 2024-09-12T18:36:44.003 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1179999999999999e-06 2024-09-12T18:36:44.003 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.003 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.003 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:44.003 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.982270+0000", 2024-09-12T18:36:44.003 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4035000000000006e-05 2024-09-12T18:36:44.003 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.003 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.003 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:44.004 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.982281+0000", 2024-09-12T18:36:44.004 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0975000000000001e-05 2024-09-12T18:36:44.004 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.004 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.004 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:44.004 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.982286+0000", 2024-09-12T18:36:44.004 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3399999999999997e-06 2024-09-12T18:36:44.004 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.004 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.004 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:44.004 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.982348+0000", 2024-09-12T18:36:44.004 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.1515999999999999e-05 2024-09-12T18:36:44.004 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.005 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.005 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:44.005 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.982501+0000", 2024-09-12T18:36:44.005 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000153299 2024-09-12T18:36:44.005 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.005 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:44.005 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.005 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.005 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.005 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:128498 5.d e51/21 5:b6896c4f:::benchmark_data_smithi073_23739_object128497:head v 51'8143, mlcod=51'8141)", 2024-09-12T18:36:44.005 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:43.982337+0000", 2024-09-12T18:36:44.005 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 4294967295.9998536, 2024-09-12T18:36:44.005 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00029649599999999999, 2024-09-12T18:36:44.005 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:44.006 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:44.006 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:44.006 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:44.006 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.006 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:44.006 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.982337+0000", 2024-09-12T18:36:44.006 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.006 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.006 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.006 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:44.006 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.982337+0000", 2024-09-12T18:36:44.006 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.006 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.006 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.007 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:44.007 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.982338+0000", 2024-09-12T18:36:44.007 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2099999999999996e-07 2024-09-12T18:36:44.007 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.007 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.007 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:44.007 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.982474+0000", 2024-09-12T18:36:44.007 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013662400000000001 2024-09-12T18:36:44.007 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.007 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.007 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:44.007 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.982483+0000", 2024-09-12T18:36:44.007 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0329999999999997e-06 2024-09-12T18:36:44.008 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.008 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.008 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:44.008 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.982490+0000", 2024-09-12T18:36:44.008 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4169999999999997e-06 2024-09-12T18:36:44.008 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.008 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.008 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:44.008 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.982575+0000", 2024-09-12T18:36:44.008 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4814000000000005e-05 2024-09-12T18:36:44.008 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.008 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.008 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:44.009 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.982596+0000", 2024-09-12T18:36:44.009 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.1022e-05 2024-09-12T18:36:44.009 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.009 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:44.009 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.009 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.009 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.009 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:128500 5.9 5:9ab9210d:::benchmark_data_smithi073_23739_object128499:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:36:44.009 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:43.982369+0000", 2024-09-12T18:36:44.009 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 4294967295.9998217, 2024-09-12T18:36:44.009 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032474700000000001, 2024-09-12T18:36:44.009 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:44.009 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:44.009 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "reached pg", 2024-09-12T18:36:44.010 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:44.010 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:44.010 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:44.010 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 128500 2024-09-12T18:36:44.010 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.010 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:44.010 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.010 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:44.010 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.982369+0000", 2024-09-12T18:36:44.010 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.010 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.010 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.010 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:44.010 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.982369+0000", 2024-09-12T18:36:44.011 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.011 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.011 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.011 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:44.011 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.982370+0000", 2024-09-12T18:36:44.011 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.5899999999999995e-07 2024-09-12T18:36:44.011 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.011 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.011 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:44.011 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.982488+0000", 2024-09-12T18:36:44.011 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000117951 2024-09-12T18:36:44.011 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.011 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.011 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:44.012 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.982500+0000", 2024-09-12T18:36:44.012 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1753000000000001e-05 2024-09-12T18:36:44.012 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.012 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.012 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:44.012 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.982507+0000", 2024-09-12T18:36:44.012 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3969999999999997e-06 2024-09-12T18:36:44.012 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.012 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.012 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:44.012 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.982587+0000", 2024-09-12T18:36:44.012 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.9511999999999994e-05 2024-09-12T18:36:44.012 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.012 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:44.013 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.013 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.013 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.013 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:128501 5.9 5.9378c3f9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:36:44.013 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:43.982529+0000", 2024-09-12T18:36:44.013 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 4294967295.9996619, 2024-09-12T18:36:44.013 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00021963899999999999, 2024-09-12T18:36:44.013 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:44.013 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:44.013 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:44.013 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:44.013 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:44.013 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:44.014 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 128501 2024-09-12T18:36:44.014 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.014 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:44.014 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.014 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:44.014 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.982529+0000", 2024-09-12T18:36:44.014 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.014 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.014 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.014 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:44.014 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.982529+0000", 2024-09-12T18:36:44.014 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.014 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.015 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.015 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:44.015 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.982530+0000", 2024-09-12T18:36:44.015 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.68e-07 2024-09-12T18:36:44.015 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.015 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.015 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:44.015 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.982568+0000", 2024-09-12T18:36:44.015 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.7973999999999999e-05 2024-09-12T18:36:44.015 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.015 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.015 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:44.015 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.982576+0000", 2024-09-12T18:36:44.015 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5869999999999993e-06 2024-09-12T18:36:44.016 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.016 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.016 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:44.016 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.982584+0000", 2024-09-12T18:36:44.016 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8949999999999998e-06 2024-09-12T18:36:44.016 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.016 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:44.016 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.016 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.016 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.016 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:128497 5.0 e51/49)", 2024-09-12T18:36:44.016 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:43.982675+0000", 2024-09-12T18:36:44.016 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 4294967295.999516, 2024-09-12T18:36:44.016 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010108899999999999, 2024-09-12T18:36:44.017 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:44.017 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:44.017 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:44.017 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:44.017 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.017 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:44.017 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.982675+0000", 2024-09-12T18:36:44.017 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.017 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.017 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.017 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:44.017 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.982675+0000", 2024-09-12T18:36:44.017 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.018 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.018 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.018 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:44.018 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.982676+0000", 2024-09-12T18:36:44.018 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4600000000000005e-07 2024-09-12T18:36:44.018 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.018 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.018 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:44.018 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.982680+0000", 2024-09-12T18:36:44.018 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6360000000000002e-06 2024-09-12T18:36:44.018 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.018 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.018 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:44.018 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.982688+0000", 2024-09-12T18:36:44.019 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.469e-06 2024-09-12T18:36:44.019 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.019 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.019 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:44.019 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.982693+0000", 2024-09-12T18:36:44.019 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5899999999999998e-06 2024-09-12T18:36:44.019 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.019 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:44.019 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.019 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.019 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.019 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:128478 5.1 5:8a42b1d8:::benchmark_data_smithi073_23739_object128477:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:36:44.019 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:43.972266+0000", 2024-09-12T18:36:44.020 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0099247429999999998, 2024-09-12T18:36:44.020 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010538886000000001, 2024-09-12T18:36:44.020 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:44.020 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:44.020 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:44.020 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:44.020 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:44.020 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:44.020 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 128478 2024-09-12T18:36:44.020 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.020 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:44.020 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.020 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:44.020 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.972266+0000", 2024-09-12T18:36:44.021 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.021 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.021 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.021 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:44.021 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.972266+0000", 2024-09-12T18:36:44.021 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.021 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.021 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.021 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:44.021 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.972267+0000", 2024-09-12T18:36:44.021 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.6000000000000004e-07 2024-09-12T18:36:44.021 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.021 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.021 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:44.022 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.972299+0000", 2024-09-12T18:36:44.022 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.2333999999999999e-05 2024-09-12T18:36:44.022 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.022 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.022 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:44.022 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.972307+0000", 2024-09-12T18:36:44.022 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.9009999999999994e-06 2024-09-12T18:36:44.022 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.022 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.022 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:44.022 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.972313+0000", 2024-09-12T18:36:44.022 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2169999999999999e-06 2024-09-12T18:36:44.022 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.022 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.023 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:44.023 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.975225+0000", 2024-09-12T18:36:44.023 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0029121220000000001 2024-09-12T18:36:44.023 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.023 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.023 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:44.023 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.975403+0000", 2024-09-12T18:36:44.023 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00017723500000000001 2024-09-12T18:36:44.023 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.023 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.023 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:36:44.023 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.975613+0000", 2024-09-12T18:36:44.023 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00021076100000000001 2024-09-12T18:36:44.023 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.023 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.024 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:44.024 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.979435+0000", 2024-09-12T18:36:44.024 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003822031 2024-09-12T18:36:44.024 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.024 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.024 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:44.024 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.979450+0000", 2024-09-12T18:36:44.024 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4586999999999999e-05 2024-09-12T18:36:44.024 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.024 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:44.024 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.024 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.024 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.024 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:128480 5.1 5:8dae58ac:::benchmark_data_smithi073_23739_object128479:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:36:44.025 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:43.972324+0000", 2024-09-12T18:36:44.025 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0098673609999999998, 2024-09-12T18:36:44.025 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010528851000000001, 2024-09-12T18:36:44.025 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:44.025 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:44.025 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:44.025 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:44.025 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:44.025 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:44.025 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 128480 2024-09-12T18:36:44.025 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.025 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:44.025 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.026 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:44.026 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.972324+0000", 2024-09-12T18:36:44.026 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.026 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.026 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.026 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:44.026 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.972324+0000", 2024-09-12T18:36:44.026 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.026 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.026 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.026 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:44.026 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.972324+0000", 2024-09-12T18:36:44.026 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4499999999999997e-07 2024-09-12T18:36:44.027 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.027 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.027 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:44.027 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.972353+0000", 2024-09-12T18:36:44.027 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.9152000000000001e-05 2024-09-12T18:36:44.027 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.027 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.027 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:44.027 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.972361+0000", 2024-09-12T18:36:44.027 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1599999999999998e-06 2024-09-12T18:36:44.027 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.027 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.027 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:44.028 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.972367+0000", 2024-09-12T18:36:44.028 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.7209999999999999e-06 2024-09-12T18:36:44.028 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.028 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.028 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:44.028 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.977698+0000", 2024-09-12T18:36:44.028 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0053303200000000004 2024-09-12T18:36:44.028 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.028 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.028 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:44.028 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.977794+0000", 2024-09-12T18:36:44.028 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.6743999999999994e-05 2024-09-12T18:36:44.028 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.028 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.029 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:36:44.029 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.977896+0000", 2024-09-12T18:36:44.029 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000101714 2024-09-12T18:36:44.029 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.029 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.029 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:44.029 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.981175+0000", 2024-09-12T18:36:44.029 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0032788700000000001 2024-09-12T18:36:44.029 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.029 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.029 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:44.029 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:43.981847+0000", 2024-09-12T18:36:44.029 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000672078 2024-09-12T18:36:44.029 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.029 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:44.030 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.030 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.030 INFO:teuthology.orchestra.run.smithi162.stdout: ], 2024-09-12T18:36:44.030 INFO:teuthology.orchestra.run.smithi162.stdout: "num_ops": 11 2024-09-12T18:36:44.030 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:36:44.031 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:36:44.032 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:44.027+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:44.105 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T18:36:44.132 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:44.126+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:44.233 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:44.230+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:44.239 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:36:44.239 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [], 2024-09-12T18:36:44.239 INFO:teuthology.orchestra.run.smithi162.stdout: "complaint_time": 30, 2024-09-12T18:36:44.239 INFO:teuthology.orchestra.run.smithi162.stdout: "num_blocked_ops": 0 2024-09-12T18:36:44.239 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:36:44.263 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:36:44.334 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:44.327+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:44.433 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:36:44.433 INFO:teuthology.orchestra.run.smithi162.stdout: "size": 20, 2024-09-12T18:36:44.433 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 600, 2024-09-12T18:36:44.433 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:36:44.433 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.434 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4154.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:36:44.434 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:36:44.434 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 90.454320354999993, 2024-09-12T18:36:44.434 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025950709999999998, 2024-09-12T18:36:44.434 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:44.434 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:44.434 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:44.434 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:44.434 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4154", 2024-09-12T18:36:44.434 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/745129001", 2024-09-12T18:36:44.434 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 124 2024-09-12T18:36:44.434 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.434 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:44.435 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.435 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:44.435 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:36:44.435 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.435 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.435 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.435 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:44.435 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:36:44.435 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.435 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.435 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.435 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:44.435 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976562+0000", 2024-09-12T18:36:44.435 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.2999999999999999e-07 2024-09-12T18:36:44.436 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.436 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.436 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:44.436 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976567+0000", 2024-09-12T18:36:44.436 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3430000000000003e-06 2024-09-12T18:36:44.436 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.436 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.436 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:44.436 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976576+0000", 2024-09-12T18:36:44.436 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8070000000000006e-06 2024-09-12T18:36:44.436 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.436 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.436 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:44.436 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976583+0000", 2024-09-12T18:36:44.437 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9959999999999996e-06 2024-09-12T18:36:44.437 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.437 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.437 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:44.437 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997107+0000", 2024-09-12T18:36:44.437 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.020524106 2024-09-12T18:36:44.437 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.437 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.437 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:44.437 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997225+0000", 2024-09-12T18:36:44.437 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000117909 2024-09-12T18:36:44.437 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.437 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.437 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:44.438 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997407+0000", 2024-09-12T18:36:44.438 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00018175900000000001 2024-09-12T18:36:44.438 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.438 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.438 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:44.438 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998839+0000", 2024-09-12T18:36:44.438 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001432539 2024-09-12T18:36:44.438 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.438 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.438 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:44.438 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002319+0000", 2024-09-12T18:36:44.438 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0034803529999999998 2024-09-12T18:36:44.438 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.438 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.439 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:44.439 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002405+0000", 2024-09-12T18:36:44.439 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5434999999999998e-05 2024-09-12T18:36:44.439 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.439 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.439 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:44.439 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002512+0000", 2024-09-12T18:36:44.439 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010663299999999999 2024-09-12T18:36:44.439 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.439 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:44.439 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.439 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.439 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.440 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:44.440 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:36:44.440 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 78.789522848000004, 2024-09-12T18:36:44.440 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025127867000000002, 2024-09-12T18:36:44.440 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:44.440 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:44.440 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:44.440 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:44.440 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.440 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:44.440 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:36:44.440 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.440 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.441 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.441 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:44.441 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:36:44.441 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.441 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.441 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.441 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:44.441 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641362+0000", 2024-09-12T18:36:44.441 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.2569999999999999e-06 2024-09-12T18:36:44.441 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.441 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.441 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:44.441 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641374+0000", 2024-09-12T18:36:44.441 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2696e-05 2024-09-12T18:36:44.442 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.442 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.442 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:44.442 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641403+0000", 2024-09-12T18:36:44.442 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.8756999999999999e-05 2024-09-12T18:36:44.442 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.442 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.442 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:44.442 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641430+0000", 2024-09-12T18:36:44.442 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.6452999999999999e-05 2024-09-12T18:36:44.442 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.442 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.442 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:44.443 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641585+0000", 2024-09-12T18:36:44.443 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000155799 2024-09-12T18:36:44.443 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.443 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.443 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:44.443 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641753+0000", 2024-09-12T18:36:44.443 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000167868 2024-09-12T18:36:44.443 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.443 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.443 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:44.443 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641916+0000", 2024-09-12T18:36:44.443 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000162903 2024-09-12T18:36:44.443 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.443 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.444 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:44.444 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653655+0000", 2024-09-12T18:36:44.444 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011738879000000001 2024-09-12T18:36:44.444 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.444 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.444 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:44.444 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665515+0000", 2024-09-12T18:36:44.444 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011859915 2024-09-12T18:36:44.444 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.444 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.444 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:44.444 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665646+0000", 2024-09-12T18:36:44.444 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013122599999999999 2024-09-12T18:36:44.445 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.445 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.445 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:44.445 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666486+0000", 2024-09-12T18:36:44.445 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00084011399999999999 2024-09-12T18:36:44.445 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.445 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:44.445 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.445 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.445 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.445 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:44.445 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:36:44.445 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 78.789408385000002, 2024-09-12T18:36:44.445 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025384584000000002, 2024-09-12T18:36:44.446 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:44.446 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:44.446 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:44.446 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:44.446 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.446 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:44.446 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:36:44.446 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.446 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.446 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.446 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:44.446 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:36:44.446 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.446 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.446 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.447 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:44.447 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641474+0000", 2024-09-12T18:36:44.447 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.39e-06 2024-09-12T18:36:44.447 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.447 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.447 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:44.447 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641482+0000", 2024-09-12T18:36:44.447 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3499999999999999e-06 2024-09-12T18:36:44.447 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.447 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.447 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:44.447 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641534+0000", 2024-09-12T18:36:44.448 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2533e-05 2024-09-12T18:36:44.448 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.448 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.448 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:44.448 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641551+0000", 2024-09-12T18:36:44.448 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6515999999999999e-05 2024-09-12T18:36:44.448 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.448 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.448 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:44.448 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642630+0000", 2024-09-12T18:36:44.448 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001079705 2024-09-12T18:36:44.448 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.448 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.448 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:44.449 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642909+0000", 2024-09-12T18:36:44.449 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027859800000000002 2024-09-12T18:36:44.449 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.449 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.449 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:44.449 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643137+0000", 2024-09-12T18:36:44.449 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022803799999999999 2024-09-12T18:36:44.449 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.449 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.449 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:44.449 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653669+0000", 2024-09-12T18:36:44.449 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010532032 2024-09-12T18:36:44.449 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.449 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.450 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:44.450 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666624+0000", 2024-09-12T18:36:44.450 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012954940999999999 2024-09-12T18:36:44.450 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.450 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.450 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:44.450 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666762+0000", 2024-09-12T18:36:44.450 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000137668 2024-09-12T18:36:44.450 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.450 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.450 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:44.450 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666857+0000", 2024-09-12T18:36:44.450 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.5812999999999999e-05 2024-09-12T18:36:44.450 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.451 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:44.451 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.451 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.451 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.451 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:44.451 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:36:44.451 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 78.789280590000004, 2024-09-12T18:36:44.451 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025661562999999998, 2024-09-12T18:36:44.451 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:44.451 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:44.451 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:44.451 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:44.451 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.451 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:44.451 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:36:44.452 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.452 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.452 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.452 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:44.452 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:36:44.452 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.452 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.452 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.452 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:44.452 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641602+0000", 2024-09-12T18:36:44.452 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3540000000000001e-06 2024-09-12T18:36:44.452 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.452 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.453 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:44.453 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641637+0000", 2024-09-12T18:36:44.453 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5145999999999999e-05 2024-09-12T18:36:44.453 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.453 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.453 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:44.453 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641659+0000", 2024-09-12T18:36:44.453 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2249999999999999e-05 2024-09-12T18:36:44.453 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.453 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.453 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:44.453 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641675+0000", 2024-09-12T18:36:44.453 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6059999999999999e-05 2024-09-12T18:36:44.453 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.454 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.454 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:44.454 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644570+0000", 2024-09-12T18:36:44.454 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028947069999999998 2024-09-12T18:36:44.454 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.454 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.454 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:44.454 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644900+0000", 2024-09-12T18:36:44.454 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000329401 2024-09-12T18:36:44.454 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.454 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.454 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:44.454 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645235+0000", 2024-09-12T18:36:44.454 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000335874 2024-09-12T18:36:44.454 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.455 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.455 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:44.455 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655459+0000", 2024-09-12T18:36:44.455 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010223441999999999 2024-09-12T18:36:44.455 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.455 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.455 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:44.455 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667028+0000", 2024-09-12T18:36:44.455 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011568673999999999 2024-09-12T18:36:44.455 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.455 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.455 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:44.455 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667163+0000", 2024-09-12T18:36:44.455 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013525500000000001 2024-09-12T18:36:44.456 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.456 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.456 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:44.456 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667262+0000", 2024-09-12T18:36:44.456 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9400000000000004e-05 2024-09-12T18:36:44.456 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.456 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:44.456 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.456 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.456 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.456 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:44.456 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:36:44.457 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 78.789178770000007, 2024-09-12T18:36:44.457 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025971339, 2024-09-12T18:36:44.457 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:44.457 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:44.457 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:44.457 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:44.457 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.457 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:44.457 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:36:44.457 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.457 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.457 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.457 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:44.457 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:36:44.458 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.458 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.458 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.458 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:44.458 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641704+0000", 2024-09-12T18:36:44.458 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.297e-06 2024-09-12T18:36:44.458 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.458 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.458 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:44.458 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641712+0000", 2024-09-12T18:36:44.458 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.9060000000000002e-06 2024-09-12T18:36:44.458 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.458 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.458 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:44.459 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641731+0000", 2024-09-12T18:36:44.459 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9083e-05 2024-09-12T18:36:44.459 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.459 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.459 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:44.459 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641745+0000", 2024-09-12T18:36:44.459 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4066999999999999e-05 2024-09-12T18:36:44.459 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.459 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.459 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:44.459 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646529+0000", 2024-09-12T18:36:44.459 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.004784033 2024-09-12T18:36:44.459 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.459 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.460 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:44.460 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646727+0000", 2024-09-12T18:36:44.460 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019841800000000001 2024-09-12T18:36:44.460 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.460 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.460 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:44.460 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647057+0000", 2024-09-12T18:36:44.460 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032926800000000002 2024-09-12T18:36:44.460 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.460 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.460 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:44.460 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655475+0000", 2024-09-12T18:36:44.460 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0084186250000000008 2024-09-12T18:36:44.460 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.461 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.461 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:44.461 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667424+0000", 2024-09-12T18:36:44.461 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011949257 2024-09-12T18:36:44.461 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.461 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.461 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:44.461 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667573+0000", 2024-09-12T18:36:44.461 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014851900000000001 2024-09-12T18:36:44.461 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.461 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.461 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:44.461 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667674+0000", 2024-09-12T18:36:44.461 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010086600000000001 2024-09-12T18:36:44.462 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.462 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:44.462 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.462 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.462 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.462 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:44.462 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:36:44.462 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 78.789116380999999, 2024-09-12T18:36:44.462 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026215008000000001, 2024-09-12T18:36:44.462 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:44.462 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:44.462 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:44.462 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:44.462 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.463 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:44.463 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:36:44.463 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.463 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.463 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.463 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:44.463 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:36:44.463 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.463 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.463 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.463 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:44.463 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641766+0000", 2024-09-12T18:36:44.463 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1200000000000001e-06 2024-09-12T18:36:44.463 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.464 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.464 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:44.464 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641775+0000", 2024-09-12T18:36:44.464 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.2499999999999995e-06 2024-09-12T18:36:44.464 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.464 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.464 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:44.464 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641793+0000", 2024-09-12T18:36:44.464 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7773000000000001e-05 2024-09-12T18:36:44.464 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.464 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.464 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:44.464 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641807+0000", 2024-09-12T18:36:44.464 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3814e-05 2024-09-12T18:36:44.465 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.465 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.465 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:44.465 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647626+0000", 2024-09-12T18:36:44.465 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0058193050000000003 2024-09-12T18:36:44.465 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.465 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.465 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:44.465 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647937+0000", 2024-09-12T18:36:44.465 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031112400000000003 2024-09-12T18:36:44.465 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.465 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.465 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:44.465 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648239+0000", 2024-09-12T18:36:44.466 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00030227500000000002 2024-09-12T18:36:44.466 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.466 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.466 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:44.466 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655487+0000", 2024-09-12T18:36:44.466 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072479129999999999 2024-09-12T18:36:44.466 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.466 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.466 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:44.466 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667823+0000", 2024-09-12T18:36:44.466 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012335505 2024-09-12T18:36:44.466 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.466 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.466 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:44.467 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667908+0000", 2024-09-12T18:36:44.467 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4843000000000001e-05 2024-09-12T18:36:44.467 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.467 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.467 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:44.467 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667980+0000", 2024-09-12T18:36:44.467 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2086000000000001e-05 2024-09-12T18:36:44.467 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.467 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:44.467 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.467 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.467 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.467 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:44.467 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:36:44.468 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 78.789056228000007, 2024-09-12T18:36:44.468 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026483236, 2024-09-12T18:36:44.468 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:44.468 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:44.468 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:44.468 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:44.468 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.468 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:44.468 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:36:44.468 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.468 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.468 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.468 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:44.469 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:36:44.469 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.469 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.469 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.469 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:44.469 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641826+0000", 2024-09-12T18:36:44.469 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:36:44.469 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.469 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.469 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:44.469 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641832+0000", 2024-09-12T18:36:44.469 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4199999999999998e-06 2024-09-12T18:36:44.469 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.469 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.470 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:44.470 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641848+0000", 2024-09-12T18:36:44.470 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6492999999999999e-05 2024-09-12T18:36:44.470 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.470 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.470 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:44.470 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641863+0000", 2024-09-12T18:36:44.470 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5427e-05 2024-09-12T18:36:44.470 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.470 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.470 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:44.470 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648887+0000", 2024-09-12T18:36:44.470 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0070230860000000004 2024-09-12T18:36:44.470 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.471 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.471 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:44.471 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649111+0000", 2024-09-12T18:36:44.471 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022425799999999999 2024-09-12T18:36:44.471 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.471 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.471 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:44.471 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649494+0000", 2024-09-12T18:36:44.471 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00038349400000000001 2024-09-12T18:36:44.471 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.471 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.471 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:44.471 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655499+0000", 2024-09-12T18:36:44.471 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0060047260000000002 2024-09-12T18:36:44.471 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.472 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.472 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:44.472 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668110+0000", 2024-09-12T18:36:44.472 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012610543 2024-09-12T18:36:44.472 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.472 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.472 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:44.472 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668252+0000", 2024-09-12T18:36:44.472 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014265600000000001 2024-09-12T18:36:44.472 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.472 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.472 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:44.472 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668308+0000", 2024-09-12T18:36:44.472 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5992999999999997e-05 2024-09-12T18:36:44.473 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.473 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:44.473 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.473 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.473 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.473 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:44.473 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:36:44.473 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 78.789001012, 2024-09-12T18:36:44.473 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026605302000000001, 2024-09-12T18:36:44.473 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:44.473 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:44.473 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:44.473 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:44.473 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.474 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:44.474 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:36:44.474 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.474 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.474 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.474 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:44.474 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:36:44.474 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.474 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.474 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.474 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:44.474 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641881+0000", 2024-09-12T18:36:44.474 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.057e-06 2024-09-12T18:36:44.474 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.475 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.475 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:44.475 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641887+0000", 2024-09-12T18:36:44.475 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.6629999999999998e-06 2024-09-12T18:36:44.475 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.475 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.475 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:44.475 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641903+0000", 2024-09-12T18:36:44.475 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6317e-05 2024-09-12T18:36:44.475 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.475 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.475 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:44.475 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641917+0000", 2024-09-12T18:36:44.475 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3339999999999999e-05 2024-09-12T18:36:44.476 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.476 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.476 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:44.476 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650708+0000", 2024-09-12T18:36:44.476 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.008791419 2024-09-12T18:36:44.476 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.476 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.476 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:44.476 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651021+0000", 2024-09-12T18:36:44.476 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031296699999999999 2024-09-12T18:36:44.476 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.476 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.476 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:44.477 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651349+0000", 2024-09-12T18:36:44.477 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032796499999999999 2024-09-12T18:36:44.477 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.477 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.477 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:44.477 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655742+0000", 2024-09-12T18:36:44.477 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0043934680000000002 2024-09-12T18:36:44.477 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.477 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.477 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:44.477 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668377+0000", 2024-09-12T18:36:44.477 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012634312999999999 2024-09-12T18:36:44.477 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.477 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.478 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:44.478 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668441+0000", 2024-09-12T18:36:44.478 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4369999999999995e-05 2024-09-12T18:36:44.478 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.478 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.478 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:44.478 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668485+0000", 2024-09-12T18:36:44.478 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4422999999999998e-05 2024-09-12T18:36:44.478 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.478 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:44.478 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.478 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.478 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.478 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:44.479 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:36:44.479 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 78.788943609, 2024-09-12T18:36:44.479 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026919499, 2024-09-12T18:36:44.479 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:44.479 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:44.479 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:44.479 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:44.479 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.479 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:44.479 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:36:44.479 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.479 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.479 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.479 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:44.480 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:36:44.480 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.480 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.480 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.480 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:44.480 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641939+0000", 2024-09-12T18:36:44.480 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9399999999999993e-07 2024-09-12T18:36:44.480 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.480 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.480 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:44.480 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641945+0000", 2024-09-12T18:36:44.480 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9200000000000001e-06 2024-09-12T18:36:44.480 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.480 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.481 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:44.481 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641961+0000", 2024-09-12T18:36:44.481 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6520000000000001e-05 2024-09-12T18:36:44.481 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.481 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.481 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:44.481 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641974+0000", 2024-09-12T18:36:44.481 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3413e-05 2024-09-12T18:36:44.481 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.481 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.481 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:44.481 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654560+0000", 2024-09-12T18:36:44.481 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012585308999999999 2024-09-12T18:36:44.481 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.482 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.482 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:44.482 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654822+0000", 2024-09-12T18:36:44.482 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026210099999999999 2024-09-12T18:36:44.482 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.482 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.482 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:44.482 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655059+0000", 2024-09-12T18:36:44.482 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00023747899999999999 2024-09-12T18:36:44.482 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.482 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.482 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:44.482 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.656315+0000", 2024-09-12T18:36:44.482 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0012555000000000001 2024-09-12T18:36:44.483 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.483 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.483 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:44.483 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668590+0000", 2024-09-12T18:36:44.483 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012274851999999999 2024-09-12T18:36:44.483 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.483 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.483 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:44.483 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668725+0000", 2024-09-12T18:36:44.483 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013524199999999999 2024-09-12T18:36:44.483 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.483 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.483 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:44.483 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668857+0000", 2024-09-12T18:36:44.484 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013216899999999999 2024-09-12T18:36:44.484 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.484 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:44.484 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.484 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.484 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.484 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:44.484 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:36:44.484 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 78.788890089000006, 2024-09-12T18:36:44.484 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023616723999999999, 2024-09-12T18:36:44.484 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:44.484 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:44.484 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:44.484 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:44.485 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.485 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:44.485 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:36:44.485 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.485 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.485 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.485 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:44.485 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:36:44.485 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.485 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.485 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.485 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:44.485 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641992+0000", 2024-09-12T18:36:44.485 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.08e-06 2024-09-12T18:36:44.486 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.486 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.486 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:44.486 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641998+0000", 2024-09-12T18:36:44.486 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4299999999999997e-06 2024-09-12T18:36:44.486 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.486 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.486 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:44.486 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642014+0000", 2024-09-12T18:36:44.486 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6266e-05 2024-09-12T18:36:44.486 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.486 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.486 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:44.486 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642026+0000", 2024-09-12T18:36:44.487 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2567e-05 2024-09-12T18:36:44.487 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.487 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.487 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:44.487 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642213+0000", 2024-09-12T18:36:44.487 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00018701899999999999 2024-09-12T18:36:44.487 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.487 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.487 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:44.487 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642507+0000", 2024-09-12T18:36:44.487 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00029394700000000002 2024-09-12T18:36:44.487 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.487 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.487 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:44.488 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642686+0000", 2024-09-12T18:36:44.488 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000178152 2024-09-12T18:36:44.488 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.488 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.488 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:44.488 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650952+0000", 2024-09-12T18:36:44.488 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0082663570000000002 2024-09-12T18:36:44.488 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.488 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.488 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:44.488 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665382+0000", 2024-09-12T18:36:44.488 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.014430111000000001 2024-09-12T18:36:44.488 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.488 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.489 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:44.489 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665508+0000", 2024-09-12T18:36:44.489 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000125986 2024-09-12T18:36:44.489 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.489 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.489 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:44.489 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665608+0000", 2024-09-12T18:36:44.489 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9809000000000006e-05 2024-09-12T18:36:44.489 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.489 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:44.489 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.489 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.489 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.489 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:44.490 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:36:44.490 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 78.788762223999996, 2024-09-12T18:36:44.490 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024670563, 2024-09-12T18:36:44.490 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:44.490 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:44.490 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:44.490 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:44.490 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.490 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:44.490 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:36:44.490 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.490 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.490 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.490 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:44.491 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:36:44.491 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.491 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.491 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.491 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:44.491 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642120+0000", 2024-09-12T18:36:44.491 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1769999999999999e-06 2024-09-12T18:36:44.491 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.491 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.491 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:44.491 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642128+0000", 2024-09-12T18:36:44.491 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3429999999999998e-06 2024-09-12T18:36:44.491 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.491 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.492 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:44.492 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642192+0000", 2024-09-12T18:36:44.492 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4406999999999995e-05 2024-09-12T18:36:44.492 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.492 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.492 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:44.492 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642223+0000", 2024-09-12T18:36:44.492 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.1266000000000002e-05 2024-09-12T18:36:44.492 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.492 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.492 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:44.492 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643201+0000", 2024-09-12T18:36:44.492 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0009778390000000001 2024-09-12T18:36:44.492 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.493 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.493 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:44.493 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643410+0000", 2024-09-12T18:36:44.493 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020874199999999999 2024-09-12T18:36:44.493 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.493 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.493 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:44.493 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643685+0000", 2024-09-12T18:36:44.493 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027520700000000002 2024-09-12T18:36:44.493 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.493 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.493 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:44.493 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650966+0000", 2024-09-12T18:36:44.493 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072810710000000001 2024-09-12T18:36:44.494 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.494 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.494 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:44.494 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666560+0000", 2024-09-12T18:36:44.494 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015594143 2024-09-12T18:36:44.494 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.494 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.494 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:44.494 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666691+0000", 2024-09-12T18:36:44.494 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000130359 2024-09-12T18:36:44.494 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.494 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.494 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:44.494 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666790+0000", 2024-09-12T18:36:44.495 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9009e-05 2024-09-12T18:36:44.495 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.495 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:44.495 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.495 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.495 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.495 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:44.495 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:36:44.495 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 78.787983936000003, 2024-09-12T18:36:44.495 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024891744, 2024-09-12T18:36:44.495 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:44.495 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:44.495 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:44.496 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:44.496 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.496 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:44.496 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:36:44.496 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.496 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.496 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.496 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:44.496 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:36:44.496 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.496 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.496 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.496 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:44.496 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642899+0000", 2024-09-12T18:36:44.497 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4729999999999999e-06 2024-09-12T18:36:44.497 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.497 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.497 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:44.497 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642912+0000", 2024-09-12T18:36:44.497 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3495999999999999e-05 2024-09-12T18:36:44.497 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.497 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.497 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:44.497 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642934+0000", 2024-09-12T18:36:44.497 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2033999999999999e-05 2024-09-12T18:36:44.497 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.497 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.498 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:44.498 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642949+0000", 2024-09-12T18:36:44.498 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4970000000000001e-05 2024-09-12T18:36:44.498 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.498 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.498 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:44.498 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644400+0000", 2024-09-12T18:36:44.498 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001450305 2024-09-12T18:36:44.498 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.498 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.498 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:44.498 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644617+0000", 2024-09-12T18:36:44.498 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000217302 2024-09-12T18:36:44.498 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.499 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.499 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:44.499 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645052+0000", 2024-09-12T18:36:44.499 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000434797 2024-09-12T18:36:44.499 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.499 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.499 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:44.499 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653860+0000", 2024-09-12T18:36:44.499 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0088082249999999994 2024-09-12T18:36:44.499 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.499 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.499 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:44.499 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667598+0000", 2024-09-12T18:36:44.500 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.013738451 2024-09-12T18:36:44.500 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.500 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.500 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:44.500 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667698+0000", 2024-09-12T18:36:44.500 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9854999999999999e-05 2024-09-12T18:36:44.500 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.500 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.500 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:44.500 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667789+0000", 2024-09-12T18:36:44.500 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0835999999999996e-05 2024-09-12T18:36:44.500 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.500 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:44.501 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.501 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.501 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.501 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:30 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:44.501 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:36:44.501 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 78.787909119999995, 2024-09-12T18:36:44.501 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023936852000000002, 2024-09-12T18:36:44.501 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:44.501 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:44.501 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:44.501 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:44.501 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.501 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:44.501 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:36:44.502 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.502 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.502 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.502 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:44.502 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:36:44.502 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.502 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.502 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.502 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:44.502 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642973+0000", 2024-09-12T18:36:44.502 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.11e-06 2024-09-12T18:36:44.502 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.502 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.503 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:44.503 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642994+0000", 2024-09-12T18:36:44.503 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.0699999999999998e-05 2024-09-12T18:36:44.503 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.503 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.503 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:44.503 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643011+0000", 2024-09-12T18:36:44.503 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7229999999999999e-05 2024-09-12T18:36:44.503 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.503 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.503 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:44.503 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643025+0000", 2024-09-12T18:36:44.503 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3803e-05 2024-09-12T18:36:44.503 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.504 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.504 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:44.504 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643143+0000", 2024-09-12T18:36:44.504 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000118225 2024-09-12T18:36:44.504 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.504 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.504 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:44.504 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643426+0000", 2024-09-12T18:36:44.504 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00028250500000000001 2024-09-12T18:36:44.504 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.504 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.504 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:44.504 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643864+0000", 2024-09-12T18:36:44.505 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00043856 2024-09-12T18:36:44.505 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.505 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.505 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:44.505 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651148+0000", 2024-09-12T18:36:44.505 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072836769999999997 2024-09-12T18:36:44.505 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.505 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.505 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:44.505 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666674+0000", 2024-09-12T18:36:44.505 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015525786999999999 2024-09-12T18:36:44.505 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.505 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.505 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:44.506 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666796+0000", 2024-09-12T18:36:44.506 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000122416 2024-09-12T18:36:44.506 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.506 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.506 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:44.506 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666909+0000", 2024-09-12T18:36:44.506 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011283899999999999 2024-09-12T18:36:44.506 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.506 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:44.506 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.506 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.506 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.506 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:44.507 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:36:44.507 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 78.787826413999994, 2024-09-12T18:36:44.507 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024100234000000002, 2024-09-12T18:36:44.507 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:44.507 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:44.507 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:44.507 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:44.507 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.507 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:44.507 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:36:44.507 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.507 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.507 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.507 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:44.508 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:36:44.508 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.508 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.508 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.508 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:44.508 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643056+0000", 2024-09-12T18:36:44.508 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.046e-06 2024-09-12T18:36:44.508 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.508 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.508 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:44.508 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643068+0000", 2024-09-12T18:36:44.508 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2106999999999999e-05 2024-09-12T18:36:44.508 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.508 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.509 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:44.509 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643085+0000", 2024-09-12T18:36:44.509 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7479999999999999e-05 2024-09-12T18:36:44.509 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.509 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.509 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:44.509 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643099+0000", 2024-09-12T18:36:44.509 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3730000000000001e-05 2024-09-12T18:36:44.509 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.509 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.509 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:44.509 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644623+0000", 2024-09-12T18:36:44.509 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0015236080000000001 2024-09-12T18:36:44.509 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.510 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.510 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:44.510 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644893+0000", 2024-09-12T18:36:44.510 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026990500000000003 2024-09-12T18:36:44.510 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.510 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.510 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:44.510 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645227+0000", 2024-09-12T18:36:44.510 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00033391300000000003 2024-09-12T18:36:44.510 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.510 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.510 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:44.510 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653926+0000", 2024-09-12T18:36:44.510 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0086993339999999995 2024-09-12T18:36:44.511 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.511 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.511 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:44.511 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666925+0000", 2024-09-12T18:36:44.511 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012998686000000001 2024-09-12T18:36:44.511 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.511 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.511 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:44.511 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667057+0000", 2024-09-12T18:36:44.511 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013255600000000001 2024-09-12T18:36:44.511 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.511 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.511 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:44.511 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667155+0000", 2024-09-12T18:36:44.512 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7868999999999994e-05 2024-09-12T18:36:44.512 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.512 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:44.512 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.512 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.512 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.512 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:44.512 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:36:44.512 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 78.787630625000006, 2024-09-12T18:36:44.512 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024255982999999998, 2024-09-12T18:36:44.512 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:44.512 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:44.512 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:44.513 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:44.513 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.513 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:44.513 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:36:44.513 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.513 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.513 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.513 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:44.513 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:36:44.513 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.513 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.513 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.513 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:44.513 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643252+0000", 2024-09-12T18:36:44.514 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:44.514 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.514 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.514 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:44.514 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643287+0000", 2024-09-12T18:36:44.514 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5225999999999998e-05 2024-09-12T18:36:44.514 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.514 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.514 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:44.514 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643323+0000", 2024-09-12T18:36:44.514 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5488999999999999e-05 2024-09-12T18:36:44.514 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.514 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.514 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:44.515 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643357+0000", 2024-09-12T18:36:44.515 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.3853999999999998e-05 2024-09-12T18:36:44.515 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.515 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.515 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:44.515 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646716+0000", 2024-09-12T18:36:44.515 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003359 2024-09-12T18:36:44.515 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.515 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.515 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:44.515 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647037+0000", 2024-09-12T18:36:44.515 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032131800000000002 2024-09-12T18:36:44.515 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.515 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.515 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:44.516 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647337+0000", 2024-09-12T18:36:44.516 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000300208 2024-09-12T18:36:44.516 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.516 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.516 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:44.516 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654291+0000", 2024-09-12T18:36:44.516 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0069543089999999997 2024-09-12T18:36:44.516 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.516 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.516 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:44.516 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667297+0000", 2024-09-12T18:36:44.516 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.013005526 2024-09-12T18:36:44.516 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.517 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.517 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:44.517 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667416+0000", 2024-09-12T18:36:44.517 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000119416 2024-09-12T18:36:44.517 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.517 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.517 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:44.517 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667507+0000", 2024-09-12T18:36:44.517 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0206999999999999e-05 2024-09-12T18:36:44.517 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.517 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:44.517 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.517 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.518 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.518 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:44.518 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:36:44.518 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 78.787503529999995, 2024-09-12T18:36:44.518 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023888482999999999, 2024-09-12T18:36:44.518 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:44.518 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:44.518 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:44.518 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:44.518 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.518 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:44.518 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:36:44.518 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.519 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.519 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.519 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:44.519 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:36:44.519 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.519 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.519 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.519 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:44.519 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643379+0000", 2024-09-12T18:36:44.519 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.207e-06 2024-09-12T18:36:44.519 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.519 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.519 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:44.519 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643390+0000", 2024-09-12T18:36:44.520 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0696000000000001e-05 2024-09-12T18:36:44.520 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.520 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.520 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:44.520 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643407+0000", 2024-09-12T18:36:44.520 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7563000000000001e-05 2024-09-12T18:36:44.520 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.520 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.520 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:44.520 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643420+0000", 2024-09-12T18:36:44.520 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3277e-05 2024-09-12T18:36:44.520 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.520 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.521 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:44.521 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644906+0000", 2024-09-12T18:36:44.521 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001485945 2024-09-12T18:36:44.521 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.521 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.521 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:44.521 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645404+0000", 2024-09-12T18:36:44.521 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00049807599999999997 2024-09-12T18:36:44.521 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.521 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.521 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:44.521 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645846+0000", 2024-09-12T18:36:44.521 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00044190400000000002 2024-09-12T18:36:44.522 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.522 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.522 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:44.522 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654223+0000", 2024-09-12T18:36:44.522 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0083767419999999995 2024-09-12T18:36:44.522 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.522 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.522 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:44.522 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667026+0000", 2024-09-12T18:36:44.522 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012802531000000001 2024-09-12T18:36:44.522 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.522 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.522 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:44.522 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667162+0000", 2024-09-12T18:36:44.523 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000136112 2024-09-12T18:36:44.523 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.523 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.523 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:44.523 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667266+0000", 2024-09-12T18:36:44.523 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010443 2024-09-12T18:36:44.523 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.523 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:44.523 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.523 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.523 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.523 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:44.523 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:36:44.523 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 78.787352811000005, 2024-09-12T18:36:44.524 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024222582999999999, 2024-09-12T18:36:44.524 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:44.524 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:44.524 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:44.524 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:44.524 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.524 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:44.524 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:36:44.524 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.524 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.524 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.524 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:44.524 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:36:44.525 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.525 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.525 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.525 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:44.525 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643530+0000", 2024-09-12T18:36:44.525 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.393e-06 2024-09-12T18:36:44.525 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.525 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.525 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:44.525 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643536+0000", 2024-09-12T18:36:44.525 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4130000000000003e-06 2024-09-12T18:36:44.525 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.525 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.526 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:44.526 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643554+0000", 2024-09-12T18:36:44.526 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7572999999999999e-05 2024-09-12T18:36:44.526 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.526 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.526 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:44.526 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643567+0000", 2024-09-12T18:36:44.526 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3393999999999999e-05 2024-09-12T18:36:44.526 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.526 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.526 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:44.526 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648198+0000", 2024-09-12T18:36:44.526 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0046304479999999997 2024-09-12T18:36:44.526 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.527 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.527 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:44.527 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648413+0000", 2024-09-12T18:36:44.527 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00021507500000000001 2024-09-12T18:36:44.527 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.527 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.527 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:44.527 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667751+0000", 2024-09-12T18:36:44.527 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.019338286999999999 2024-09-12T18:36:44.527 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.527 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:44.527 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.527 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.528 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.528 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:115344 5.1 5:8e7d96ac:::benchmark_data_smithi073_23739_object115343:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:36:44.528 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:35.318284+0000", 2024-09-12T18:36:44.528 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 9.1125976709999996, 2024-09-12T18:36:44.528 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.022845300999999998, 2024-09-12T18:36:44.528 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:44.528 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:44.528 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:44.528 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:44.528 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:44.528 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:44.528 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 115344 2024-09-12T18:36:44.528 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.529 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:44.529 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.529 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:44.529 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.318284+0000", 2024-09-12T18:36:44.529 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.529 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.529 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.529 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:44.529 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.318284+0000", 2024-09-12T18:36:44.529 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.529 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.529 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.529 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:44.530 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.318284+0000", 2024-09-12T18:36:44.530 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9999999999999997e-07 2024-09-12T18:36:44.530 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.530 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.530 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:44.530 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.318351+0000", 2024-09-12T18:36:44.530 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.7253000000000001e-05 2024-09-12T18:36:44.530 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.530 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.530 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:44.530 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.318361+0000", 2024-09-12T18:36:44.530 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0499999999999997e-06 2024-09-12T18:36:44.530 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.530 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.531 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:44.531 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.318367+0000", 2024-09-12T18:36:44.531 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.5339999999999996e-06 2024-09-12T18:36:44.531 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.531 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.531 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:44.531 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.323502+0000", 2024-09-12T18:36:44.531 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0051345490000000004 2024-09-12T18:36:44.531 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.531 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.531 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:44.531 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.323614+0000", 2024-09-12T18:36:44.531 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011212 2024-09-12T18:36:44.531 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.532 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.532 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:44.532 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.323702+0000", 2024-09-12T18:36:44.532 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8067999999999998e-05 2024-09-12T18:36:44.532 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.532 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.532 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:44.532 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.328859+0000", 2024-09-12T18:36:44.532 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0051567970000000003 2024-09-12T18:36:44.532 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.532 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.532 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:44.532 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.341004+0000", 2024-09-12T18:36:44.533 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012145606 2024-09-12T18:36:44.533 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.533 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.533 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:44.533 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.341074+0000", 2024-09-12T18:36:44.533 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9499999999999995e-05 2024-09-12T18:36:44.533 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.533 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.533 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:44.533 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:35.341129+0000", 2024-09-12T18:36:44.533 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5124000000000003e-05 2024-09-12T18:36:44.533 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.533 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:44.533 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.534 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.534 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.534 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:121106 5.d e50/21 5:b4a9a221:::benchmark_data_smithi073_23739_object121105:head v 50'7658, mlcod=48'7656)", 2024-09-12T18:36:44.534 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:40.238637+0000", 2024-09-12T18:36:44.534 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 4.1922442100000001, 2024-09-12T18:36:44.534 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.033154694999999998, 2024-09-12T18:36:44.534 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:44.534 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:44.534 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:44.534 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:44.534 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.534 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:44.534 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238637+0000", 2024-09-12T18:36:44.535 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.535 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.535 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.535 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:44.535 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238637+0000", 2024-09-12T18:36:44.535 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.535 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.535 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.535 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:44.535 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238639+0000", 2024-09-12T18:36:44.535 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.8560000000000001e-06 2024-09-12T18:36:44.535 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.535 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.535 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:44.536 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238723+0000", 2024-09-12T18:36:44.536 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4314999999999995e-05 2024-09-12T18:36:44.536 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.536 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.536 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:44.536 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238753+0000", 2024-09-12T18:36:44.536 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.9726e-05 2024-09-12T18:36:44.536 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.536 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.536 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:44.536 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238773+0000", 2024-09-12T18:36:44.536 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9789e-05 2024-09-12T18:36:44.536 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.536 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.537 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:44.537 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.241557+0000", 2024-09-12T18:36:44.537 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0027843910000000002 2024-09-12T18:36:44.537 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.537 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.537 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:44.537 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.241581+0000", 2024-09-12T18:36:44.537 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.4224999999999999e-05 2024-09-12T18:36:44.537 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.537 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.537 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:44.537 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.271722+0000", 2024-09-12T18:36:44.537 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.030141194 2024-09-12T18:36:44.538 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.538 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.538 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:44.538 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.271792+0000", 2024-09-12T18:36:44.538 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9198999999999999e-05 2024-09-12T18:36:44.538 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.538 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:44.538 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.538 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.538 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.538 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:121110 5.2 5:4dc37b93:::benchmark_data_smithi073_23739_object121109:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:44.538 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:40.241070+0000", 2024-09-12T18:36:44.538 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 4.1898111159999996, 2024-09-12T18:36:44.539 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023075783999999998, 2024-09-12T18:36:44.539 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:44.539 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:44.539 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:44.539 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:44.539 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:44.539 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:44.539 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 121110 2024-09-12T18:36:44.539 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.539 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:44.539 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.539 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:44.539 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.241070+0000", 2024-09-12T18:36:44.539 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.540 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.540 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.540 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:44.540 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.241070+0000", 2024-09-12T18:36:44.540 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:44.540 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.540 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.540 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:44.540 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.241072+0000", 2024-09-12T18:36:44.540 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.858e-06 2024-09-12T18:36:44.540 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.540 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.540 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:44.541 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.241123+0000", 2024-09-12T18:36:44.541 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1511000000000002e-05 2024-09-12T18:36:44.541 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.541 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.541 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:44.541 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.241151+0000", 2024-09-12T18:36:44.541 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.7616000000000001e-05 2024-09-12T18:36:44.541 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.541 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.541 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:44.541 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.241162+0000", 2024-09-12T18:36:44.541 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.136e-05 2024-09-12T18:36:44.541 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.541 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.542 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:44.542 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.241228+0000", 2024-09-12T18:36:44.542 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.5988999999999994e-05 2024-09-12T18:36:44.542 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.542 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.542 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:44.542 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.241389+0000", 2024-09-12T18:36:44.542 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000161001 2024-09-12T18:36:44.542 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.542 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.542 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:44.542 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.241803+0000", 2024-09-12T18:36:44.542 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00041360000000000002 2024-09-12T18:36:44.542 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.543 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.543 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:44.543 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.252025+0000", 2024-09-12T18:36:44.543 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010221768000000001 2024-09-12T18:36:44.543 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.543 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.543 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:44.543 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.264034+0000", 2024-09-12T18:36:44.543 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012009136 2024-09-12T18:36:44.543 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.543 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.543 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:44.543 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.264095+0000", 2024-09-12T18:36:44.544 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.1148999999999993e-05 2024-09-12T18:36:44.544 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:44.544 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:44.544 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:44.544 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.264146+0000", 2024-09-12T18:36:44.544 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.0796e-05 2024-09-12T18:36:44.544 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.544 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:44.544 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.544 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:44.544 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:44.544 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:36:44.545 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:36:44.545 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:36:44.545 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-12T18:36:44.545 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T18:36:44.547 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:44.542+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:44.547 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:36:44.646 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:44.644+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:44.709 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:44.709 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:36:44.710 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.710 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:129939 5.c 5:388804b7:::benchmark_data_smithi073_23739_object129938:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:36:44.710 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:44.699954+0000", 2024-09-12T18:36:44.710 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.007010507, 2024-09-12T18:36:44.710 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0070392709999999997, 2024-09-12T18:36:44.710 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:44.710 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:44.710 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:44.710 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:44.710 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:44.710 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:44.710 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 129939 2024-09-12T18:36:44.710 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.711 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:44.711 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.711 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:44.711 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.699954+0000", 2024-09-12T18:36:44.711 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:44.711 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.711 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.711 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:44.711 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.699954+0000", 2024-09-12T18:36:44.711 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:44.711 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.711 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.712 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:44.712 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.699955+0000", 2024-09-12T18:36:44.712 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2589999999999999e-06 2024-09-12T18:36:44.712 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.712 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.712 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:44.712 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.700005+0000", 2024-09-12T18:36:44.712 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9672000000000001e-05 2024-09-12T18:36:44.712 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.712 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.712 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:44.712 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.700019+0000", 2024-09-12T18:36:44.712 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4773999999999999e-05 2024-09-12T18:36:44.712 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.713 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.713 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:44.713 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.700024+0000", 2024-09-12T18:36:44.713 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0610000000000003e-06 2024-09-12T18:36:44.713 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.713 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.713 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:44.713 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.700061+0000", 2024-09-12T18:36:44.713 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.6223000000000002e-05 2024-09-12T18:36:44.713 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.713 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.713 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:44.713 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.700182+0000", 2024-09-12T18:36:44.714 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000121731 2024-09-12T18:36:44.714 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.714 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.714 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:44.714 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.700323+0000", 2024-09-12T18:36:44.714 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014078100000000001 2024-09-12T18:36:44.714 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.714 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.714 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:44.714 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.704161+0000", 2024-09-12T18:36:44.714 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0038375900000000001 2024-09-12T18:36:44.714 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:44.714 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:44.715 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:44.715 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.715 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.715 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:129941 5.c 5:3bdd3fbd:::benchmark_data_smithi073_23739_object129940:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:36:44.715 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:44.700637+0000", 2024-09-12T18:36:44.715 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0063270430000000001, 2024-09-12T18:36:44.715 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0064319479999999998, 2024-09-12T18:36:44.715 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:44.715 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:44.715 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:44.715 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:44.715 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:44.715 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:44.716 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 129941 2024-09-12T18:36:44.716 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.716 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:44.716 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.716 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:44.716 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.700637+0000", 2024-09-12T18:36:44.716 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:44.716 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.716 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.716 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:44.716 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.700637+0000", 2024-09-12T18:36:44.716 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:44.716 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.716 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.717 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:44.717 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.700638+0000", 2024-09-12T18:36:44.717 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.158e-06 2024-09-12T18:36:44.717 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.717 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.717 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:44.717 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.700705+0000", 2024-09-12T18:36:44.717 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6616000000000001e-05 2024-09-12T18:36:44.717 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.717 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.717 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:44.717 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.700718+0000", 2024-09-12T18:36:44.717 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2762000000000001e-05 2024-09-12T18:36:44.718 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.718 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.718 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:44.718 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.700726+0000", 2024-09-12T18:36:44.718 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6670000000000002e-06 2024-09-12T18:36:44.718 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.718 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.718 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:44.718 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.704184+0000", 2024-09-12T18:36:44.718 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.003457445 2024-09-12T18:36:44.718 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.718 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.718 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:44.719 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.704360+0000", 2024-09-12T18:36:44.719 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00017592500000000001 2024-09-12T18:36:44.719 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.719 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.719 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:44.719 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.704513+0000", 2024-09-12T18:36:44.719 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015332099999999999 2024-09-12T18:36:44.719 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:44.719 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:44.719 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:44.719 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.719 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.719 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:129938 5.4 e51/21 5:2ca722b3:::benchmark_data_smithi073_23739_object129937:head v 51'8046, mlcod=51'8042)", 2024-09-12T18:36:44.719 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:44.700725+0000", 2024-09-12T18:36:44.720 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0062389979999999999, 2024-09-12T18:36:44.720 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0064145210000000003, 2024-09-12T18:36:44.720 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:44.720 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:44.720 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:44.720 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:44.720 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.720 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:44.720 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.700725+0000", 2024-09-12T18:36:44.720 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:44.720 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.720 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.720 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:44.721 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.700725+0000", 2024-09-12T18:36:44.721 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:44.721 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.721 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.721 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:44.721 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.700726+0000", 2024-09-12T18:36:44.721 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.51e-07 2024-09-12T18:36:44.721 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.721 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.721 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:44.721 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.700837+0000", 2024-09-12T18:36:44.721 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00011164599999999999 2024-09-12T18:36:44.721 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.722 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.722 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:44.722 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.700845+0000", 2024-09-12T18:36:44.722 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3359999999999997e-06 2024-09-12T18:36:44.722 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.722 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.722 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:44.722 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.700850+0000", 2024-09-12T18:36:44.722 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9030000000000003e-06 2024-09-12T18:36:44.722 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.722 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.722 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:44.722 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.702362+0000", 2024-09-12T18:36:44.722 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001512294 2024-09-12T18:36:44.722 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.723 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.723 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:44.723 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.702374+0000", 2024-09-12T18:36:44.723 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1745e-05 2024-09-12T18:36:44.723 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:44.723 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:44.723 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:44.723 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.723 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.723 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:129944 5.c 5.392824ec (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:36:44.723 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:44.703465+0000", 2024-09-12T18:36:44.723 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0034988559999999998, 2024-09-12T18:36:44.723 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0037305289999999998, 2024-09-12T18:36:44.724 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:44.724 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:44.724 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:44.724 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:44.724 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:44.724 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:44.724 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 129944 2024-09-12T18:36:44.724 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.725 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:44.725 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.725 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:44.725 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.703465+0000", 2024-09-12T18:36:44.725 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:44.725 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.725 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.725 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:44.725 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.703465+0000", 2024-09-12T18:36:44.725 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:44.725 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.725 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.726 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:44.726 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.703467+0000", 2024-09-12T18:36:44.726 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4109999999999999e-06 2024-09-12T18:36:44.726 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.726 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.726 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:44.726 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.703513+0000", 2024-09-12T18:36:44.726 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.6359000000000001e-05 2024-09-12T18:36:44.726 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.726 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.726 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:44.726 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.703525+0000", 2024-09-12T18:36:44.726 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1997000000000001e-05 2024-09-12T18:36:44.726 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.726 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.727 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:44.727 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.703533+0000", 2024-09-12T18:36:44.727 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.9610000000000005e-06 2024-09-12T18:36:44.727 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:44.727 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:44.727 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:44.727 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.727 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.727 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:129948 5.3 5:cbe3d239:::benchmark_data_smithi073_23739_object129947:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:36:44.727 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:44.704138+0000", 2024-09-12T18:36:44.727 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0028259589999999998, 2024-09-12T18:36:44.727 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0031173770000000002, 2024-09-12T18:36:44.727 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:44.727 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:44.727 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:44.727 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:44.728 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:44.728 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:44.728 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 129948 2024-09-12T18:36:44.728 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.728 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:44.728 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.728 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:44.728 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.704138+0000", 2024-09-12T18:36:44.728 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:44.728 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.728 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.728 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:44.728 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.704138+0000", 2024-09-12T18:36:44.729 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:44.729 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.729 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.729 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:44.729 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.704139+0000", 2024-09-12T18:36:44.729 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.145e-06 2024-09-12T18:36:44.729 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.729 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.729 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:44.729 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.704211+0000", 2024-09-12T18:36:44.729 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1361999999999999e-05 2024-09-12T18:36:44.729 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.729 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.729 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:44.730 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.704222+0000", 2024-09-12T18:36:44.730 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1435e-05 2024-09-12T18:36:44.730 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.730 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.730 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:44.730 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.704230+0000", 2024-09-12T18:36:44.730 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.7419999999999997e-06 2024-09-12T18:36:44.730 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.730 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.730 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:44.730 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.704285+0000", 2024-09-12T18:36:44.730 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4635000000000001e-05 2024-09-12T18:36:44.730 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.731 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.731 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:44.731 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.704452+0000", 2024-09-12T18:36:44.731 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000167338 2024-09-12T18:36:44.731 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.731 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.731 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:44.731 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.704584+0000", 2024-09-12T18:36:44.731 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013171799999999999 2024-09-12T18:36:44.731 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:44.731 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:44.731 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:44.732 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.732 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.732 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:129951 5.3 5:c41b29e9:::benchmark_data_smithi073_23739_object129950:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:36:44.732 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:44.704702+0000", 2024-09-12T18:36:44.732 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0022621479999999998, 2024-09-12T18:36:44.732 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0026266499999999999, 2024-09-12T18:36:44.732 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:44.732 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:44.732 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:44.732 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:44.732 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:44.732 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:44.732 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 129951 2024-09-12T18:36:44.733 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.733 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:44.733 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.733 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:44.733 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.704702+0000", 2024-09-12T18:36:44.733 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:44.733 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.733 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.733 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:44.733 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.704702+0000", 2024-09-12T18:36:44.733 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:44.733 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.733 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.733 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:44.733 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.704703+0000", 2024-09-12T18:36:44.734 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0109999999999999e-06 2024-09-12T18:36:44.734 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.734 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.734 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:44.734 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.704771+0000", 2024-09-12T18:36:44.734 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8246999999999999e-05 2024-09-12T18:36:44.734 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.734 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.734 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:44.734 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.704785+0000", 2024-09-12T18:36:44.734 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3767e-05 2024-09-12T18:36:44.734 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.734 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.734 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:44.735 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.704793+0000", 2024-09-12T18:36:44.735 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4769999999999997e-06 2024-09-12T18:36:44.735 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.735 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.735 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:44.735 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.707124+0000", 2024-09-12T18:36:44.735 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.002331713 2024-09-12T18:36:44.735 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.735 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.735 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:44.735 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.707267+0000", 2024-09-12T18:36:44.735 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014226199999999999 2024-09-12T18:36:44.735 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:44.736 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:44.736 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:44.736 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.736 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.736 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:129949 5.4 e51/21 5:2194f816:::benchmark_data_smithi073_23739_object129948:head v 51'8047, mlcod=51'8044)", 2024-09-12T18:36:44.736 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:44.704851+0000", 2024-09-12T18:36:44.736 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0021129500000000002, 2024-09-12T18:36:44.736 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0025370129999999999, 2024-09-12T18:36:44.736 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:44.736 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:44.736 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:44.736 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:44.736 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.736 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:44.737 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.704851+0000", 2024-09-12T18:36:44.737 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:44.737 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.737 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.737 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:44.737 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.704851+0000", 2024-09-12T18:36:44.737 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:44.737 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.737 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.737 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:44.737 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.704852+0000", 2024-09-12T18:36:44.737 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9500000000000002e-07 2024-09-12T18:36:44.737 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.738 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.738 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:44.738 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.704905+0000", 2024-09-12T18:36:44.738 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2726999999999998e-05 2024-09-12T18:36:44.738 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.738 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.738 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:44.738 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.704914+0000", 2024-09-12T18:36:44.738 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.8120000000000002e-06 2024-09-12T18:36:44.738 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.738 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.738 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:44.738 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.704921+0000", 2024-09-12T18:36:44.738 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2140000000000001e-06 2024-09-12T18:36:44.738 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.739 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.739 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:44.739 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.707119+0000", 2024-09-12T18:36:44.739 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0021988379999999998 2024-09-12T18:36:44.739 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.739 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.739 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:44.739 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.707136+0000", 2024-09-12T18:36:44.739 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6460000000000002e-05 2024-09-12T18:36:44.739 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:44.739 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:44.739 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:44.739 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.740 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.740 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:129950 5.0 e51/49 5:074030dd:::benchmark_data_smithi073_23739_object129949:head v 51'8199, mlcod=51'8197)", 2024-09-12T18:36:44.740 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:44.705267+0000", 2024-09-12T18:36:44.740 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0016972179999999999, 2024-09-12T18:36:44.740 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0021773510000000001, 2024-09-12T18:36:44.740 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:44.740 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:44.740 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:44.740 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:44.740 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.740 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:44.740 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.705267+0000", 2024-09-12T18:36:44.740 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:44.741 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.741 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.741 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:44.741 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.705267+0000", 2024-09-12T18:36:44.741 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:44.741 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.741 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.741 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:44.741 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.705268+0000", 2024-09-12T18:36:44.741 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.9500000000000002e-07 2024-09-12T18:36:44.741 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.741 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.741 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:44.742 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.705316+0000", 2024-09-12T18:36:44.742 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8795000000000003e-05 2024-09-12T18:36:44.742 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.742 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.742 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:44.742 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.705342+0000", 2024-09-12T18:36:44.742 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.5358999999999999e-05 2024-09-12T18:36:44.742 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.742 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.742 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:44.742 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.705349+0000", 2024-09-12T18:36:44.742 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1350000000000003e-06 2024-09-12T18:36:44.742 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.743 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.743 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:44.743 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.705409+0000", 2024-09-12T18:36:44.743 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.0263000000000002e-05 2024-09-12T18:36:44.743 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.743 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.743 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:44.743 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.705431+0000", 2024-09-12T18:36:44.743 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1352000000000002e-05 2024-09-12T18:36:44.743 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:44.743 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:44.743 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:44.743 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.744 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.744 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:129952 5.3 5.f6259c93 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:36:44.744 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:44.707361+0000", 2024-09-12T18:36:44.744 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4294967295.9996028, 2024-09-12T18:36:44.744 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014045, 2024-09-12T18:36:44.744 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:44.744 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:44.744 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:44.744 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:44.744 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:44.744 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:44.744 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 129952 2024-09-12T18:36:44.744 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.745 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:44.745 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.745 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:44.745 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.707361+0000", 2024-09-12T18:36:44.745 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:44.745 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.745 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.745 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:44.745 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.707361+0000", 2024-09-12T18:36:44.745 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:44.745 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.745 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.745 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:44.746 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.707363+0000", 2024-09-12T18:36:44.746 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.291e-06 2024-09-12T18:36:44.746 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.746 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.746 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:44.746 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.707466+0000", 2024-09-12T18:36:44.746 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000102932 2024-09-12T18:36:44.746 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.746 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.746 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:44.746 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.707478+0000", 2024-09-12T18:36:44.746 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2289e-05 2024-09-12T18:36:44.746 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:44.746 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:44.747 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:44.747 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:44.707488+0000", 2024-09-12T18:36:44.747 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0299000000000001e-05 2024-09-12T18:36:44.747 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:44.747 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:44.747 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:44.747 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:44.747 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-12T18:36:44.747 INFO:teuthology.orchestra.run.smithi114.stdout: "num_ops": 9 2024-09-12T18:36:44.747 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:44.749 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:36:44.750 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:44.742+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:44.850 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:44.843+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:44.875 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 59 16 130284 130268 137.981 124.625 0.00884776 0.00724264 2024-09-12T18:36:44.877 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:36:44.878 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T18:36:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 51, 2024-09-12T18:36:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "c08d5a84-711b-44bf-bdf1-e06ecc2c7c00", 2024-09-12T18:36:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-12T18:35:02.695853+0000", 2024-09-12T18:36:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-12T18:36:42.071602+0000", 2024-09-12T18:36:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: "last_up_change": "2024-09-12T18:35:12.464628+0000", 2024-09-12T18:36:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: "last_in_change": "2024-09-12T18:35:04.352525+0000", 2024-09-12T18:36:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T18:36:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_num": 5801984, 2024-09-12T18:36:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_set": [ 2024-09-12T18:36:44.879 INFO:teuthology.orchestra.run.smithi073.stdout: "noscrub", 2024-09-12T18:36:44.879 INFO:teuthology.orchestra.run.smithi073.stdout: "pglog_hardlimit", 2024-09-12T18:36:44.879 INFO:teuthology.orchestra.run.smithi073.stdout: "purged_snapdirs", 2024-09-12T18:36:44.879 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_deletes", 2024-09-12T18:36:44.879 INFO:teuthology.orchestra.run.smithi073.stdout: "sortbitwise" 2024-09-12T18:36:44.879 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T18:36:44.879 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_version": 5, 2024-09-12T18:36:44.879 INFO:teuthology.orchestra.run.smithi073.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T18:36:44.880 INFO:teuthology.orchestra.run.smithi073.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T18:36:44.880 INFO:teuthology.orchestra.run.smithi073.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T18:36:44.880 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_snapshot": "", 2024-09-12T18:36:44.880 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_max": 5, 2024-09-12T18:36:44.880 INFO:teuthology.orchestra.run.smithi073.stdout: "max_osd": 3, 2024-09-12T18:36:44.880 INFO:teuthology.orchestra.run.smithi073.stdout: "require_min_compat_client": "luminous", 2024-09-12T18:36:44.880 INFO:teuthology.orchestra.run.smithi073.stdout: "min_compat_client": "jewel", 2024-09-12T18:36:44.880 INFO:teuthology.orchestra.run.smithi073.stdout: "require_osd_release": "squid", 2024-09-12T18:36:44.880 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_crimson": false, 2024-09-12T18:36:44.880 INFO:teuthology.orchestra.run.smithi073.stdout: "pools": [ 2024-09-12T18:36:44.880 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:44.880 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 1, 2024-09-12T18:36:44.881 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": ".mgr", 2024-09-12T18:36:44.881 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:12.418430+0000", 2024-09-12T18:36:44.881 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-12T18:36:44.881 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-09-12T18:36:44.881 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:36:44.881 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:36:44.881 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:36:44.881 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:36:44.881 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:36:44.881 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:36:44.881 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:36:44.881 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:36:44.882 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:36:44.882 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:36:44.882 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:36:44.882 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 1, 2024-09-12T18:36:44.882 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 1, 2024-09-12T18:36:44.882 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 1, 2024-09-12T18:36:44.882 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 1, 2024-09-12T18:36:44.882 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 1, 2024-09-12T18:36:44.882 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:36:44.882 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:36:44.882 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:36:44.882 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:36:44.883 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:36:44.883 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:36:44.883 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:36:44.883 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.883 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "11", 2024-09-12T18:36:44.883 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:36:44.883 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:36:44.883 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:36:44.883 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:36:44.884 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:36:44.884 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-09-12T18:36:44.884 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-09-12T18:36:44.884 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:36:44.884 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:36:44.884 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:36:44.884 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:36:44.884 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:36:44.884 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:36:44.885 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:36:44.885 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:36:44.885 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:36:44.885 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:36:44.885 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:36:44.885 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:36:44.885 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:36:44.885 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:36:44.886 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:36:44.886 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:36:44.886 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:36:44.886 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:36:44.886 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:36:44.886 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.886 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:36:44.886 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:36:44.886 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:36:44.886 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:36:44.886 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:36:44.887 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:36:44.887 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:36:44.887 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:36:44.887 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:36:44.887 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:36:44.887 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:36:44.887 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-09-12T18:36:44.888 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_max": 32, 2024-09-12T18:36:44.888 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 1 2024-09-12T18:36:44.888 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.888 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:36:44.888 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": {} 2024-09-12T18:36:44.888 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.888 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:36:44.888 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:36:44.888 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 2.9900000095367432, 2024-09-12T18:36:44.888 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 2.9900000095367432, 2024-09-12T18:36:44.888 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 0.67000001668930054, 2024-09-12T18:36:44.888 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 2, 2024-09-12T18:36:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 2, 2024-09-12T18:36:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:36:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:36:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:36:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 2, 2024-09-12T18:36:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "rbd", 2024-09-12T18:36:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:18.665309+0000", 2024-09-12T18:36:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 8193, 2024-09-12T18:36:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T18:36:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:36:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:36:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:36:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:36:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:36:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:36:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:36:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:36:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:36:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:36:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:36:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 8, 2024-09-12T18:36:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 8, 2024-09-12T18:36:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 8, 2024-09-12T18:36:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 8, 2024-09-12T18:36:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 8, 2024-09-12T18:36:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:36:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:36:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:36:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:36:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:36:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:36:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:36:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "15", 2024-09-12T18:36:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:36:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:36:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:36:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:36:44.893 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:36:44.893 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 2, 2024-09-12T18:36:44.893 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 15, 2024-09-12T18:36:44.893 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:36:44.893 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:36:44.893 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:36:44.893 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:36:44.893 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:36:44.893 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:36:44.893 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:36:44.893 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:36:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:36:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:36:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:36:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:36:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:36:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:36:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:36:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:36:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:36:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:36:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:36:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:36:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:36:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:36:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:36:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:36:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:36:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:36:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:36:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:36:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:36:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:36:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: "options": {}, 2024-09-12T18:36:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:36:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd": {} 2024-09-12T18:36:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:36:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:36:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.5, 2024-09-12T18:36:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.5, 2024-09-12T18:36:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-09-12T18:36:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.5, 2024-09-12T18:36:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.5, 2024-09-12T18:36:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:36:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:36:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:36:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 3, 2024-09-12T18:36:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "cephfs_metadata", 2024-09-12T18:36:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:23.447845+0000", 2024-09-12T18:36:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-12T18:36:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-09-12T18:36:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:36:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:36:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:36:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:36:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:36:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:36:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:36:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:36:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:36:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:36:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:36:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 32, 2024-09-12T18:36:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 32, 2024-09-12T18:36:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 32, 2024-09-12T18:36:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 32, 2024-09-12T18:36:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 32, 2024-09-12T18:36:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:36:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:36:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:36:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:36:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:36:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:36:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:36:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "18", 2024-09-12T18:36:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:36:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:36:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:36:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:36:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:36:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-09-12T18:36:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-09-12T18:36:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:36:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:36:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:36:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:36:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:36:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:36:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:36:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:36:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:36:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:36:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:36:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:36:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:36:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:36:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:36:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:36:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:36:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:36:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:36:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:36:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:36:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:36:44.904 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:36:44.904 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:36:44.904 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:36:44.904 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:36:44.904 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:36:44.904 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:36:44.904 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:36:44.904 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:36:44.904 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-09-12T18:36:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_bias": 4, 2024-09-12T18:36:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 16, 2024-09-12T18:36:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_priority": 5 2024-09-12T18:36:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:36:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs": { 2024-09-12T18:36:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": "cephfs" 2024-09-12T18:36:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:44.906 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.906 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:36:44.906 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:36:44.906 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.4099999666213989, 2024-09-12T18:36:44.906 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.4099999666213989, 2024-09-12T18:36:44.906 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-09-12T18:36:44.906 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.4099999666213989, 2024-09-12T18:36:44.906 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.4099999666213989, 2024-09-12T18:36:44.906 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:36:44.906 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:36:44.906 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:36:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 4, 2024-09-12T18:36:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "cephfs_data", 2024-09-12T18:36:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:23.959973+0000", 2024-09-12T18:36:44.908 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-12T18:36:44.908 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-09-12T18:36:44.908 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:36:44.908 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:36:44.908 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:36:44.908 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:36:44.908 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:36:44.908 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:36:44.908 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:36:44.908 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:36:44.908 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:36:44.909 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:36:44.909 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:36:44.909 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 64, 2024-09-12T18:36:44.909 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 64, 2024-09-12T18:36:44.909 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 64, 2024-09-12T18:36:44.909 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 64, 2024-09-12T18:36:44.909 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 64, 2024-09-12T18:36:44.909 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:36:44.909 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:36:44.909 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:36:44.909 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:36:44.910 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:36:44.910 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:36:44.910 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:36:44.910 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.910 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "19", 2024-09-12T18:36:44.910 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:36:44.910 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:36:44.910 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:36:44.910 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:36:44.910 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:36:44.910 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-09-12T18:36:44.911 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-09-12T18:36:44.911 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:36:44.911 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:36:44.911 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:36:44.911 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:36:44.911 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:36:44.911 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:36:44.911 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:36:44.911 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:36:44.911 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:36:44.912 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:36:44.912 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:36:44.912 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:36:44.912 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:36:44.912 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:36:44.912 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:36:44.912 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:36:44.912 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:36:44.912 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:36:44.912 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:36:44.913 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.913 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:36:44.913 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:36:44.913 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:36:44.913 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:36:44.913 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:36:44.913 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:36:44.913 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:36:44.913 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:36:44.913 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:36:44.914 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:36:44.914 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:36:44.914 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-09-12T18:36:44.914 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 64, 2024-09-12T18:36:44.914 INFO:teuthology.orchestra.run.smithi073.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T18:36:44.914 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.914 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:36:44.914 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs": { 2024-09-12T18:36:44.914 INFO:teuthology.orchestra.run.smithi073.stdout: "data": "cephfs" 2024-09-12T18:36:44.914 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:44.914 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.915 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:36:44.915 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:36:44.915 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.4099999666213989, 2024-09-12T18:36:44.915 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.4099999666213989, 2024-09-12T18:36:44.915 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-09-12T18:36:44.915 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.4099999666213989, 2024-09-12T18:36:44.915 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.4099999666213989, 2024-09-12T18:36:44.915 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:36:44.915 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:36:44.916 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:36:44.916 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:44.916 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.916 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:44.916 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 5, 2024-09-12T18:36:44.916 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "unique_pool_0", 2024-09-12T18:36:44.916 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:43.562347+0000", 2024-09-12T18:36:44.916 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-12T18:36:44.916 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-09-12T18:36:44.917 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:36:44.917 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:36:44.917 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:36:44.917 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:36:44.917 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:36:44.917 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:36:44.917 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:36:44.917 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:36:44.918 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:36:44.918 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:36:44.918 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:36:44.918 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 16, 2024-09-12T18:36:44.918 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 16, 2024-09-12T18:36:44.918 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 16, 2024-09-12T18:36:44.918 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 16, 2024-09-12T18:36:44.918 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 16, 2024-09-12T18:36:44.918 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:36:44.918 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:36:44.918 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:36:44.919 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:36:44.919 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:36:44.919 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:36:44.919 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:36:44.919 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.919 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "23", 2024-09-12T18:36:44.919 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:36:44.919 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:36:44.919 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:36:44.920 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:36:44.920 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:36:44.920 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-09-12T18:36:44.920 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-09-12T18:36:44.920 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:36:44.920 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:36:44.920 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:36:44.920 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:36:44.920 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:36:44.920 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:36:44.920 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:36:44.921 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:36:44.921 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:36:44.921 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:36:44.921 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:36:44.921 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:36:44.921 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:36:44.921 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:36:44.921 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:36:44.921 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:36:44.922 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:36:44.922 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:36:44.922 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:36:44.922 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.922 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:36:44.922 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:36:44.922 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:36:44.922 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:36:44.922 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:36:44.922 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:36:44.922 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:36:44.923 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:36:44.923 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:36:44.923 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:36:44.923 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:36:44.923 INFO:teuthology.orchestra.run.smithi073.stdout: "options": {}, 2024-09-12T18:36:44.923 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:36:44.923 INFO:teuthology.orchestra.run.smithi073.stdout: "rados": {} 2024-09-12T18:36:44.923 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.923 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:36:44.923 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:36:44.924 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.1299999952316284, 2024-09-12T18:36:44.924 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.1299999952316284, 2024-09-12T18:36:44.924 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-09-12T18:36:44.924 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T18:36:44.924 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T18:36:44.924 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:36:44.924 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:36:44.925 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:36:44.925 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:44.925 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:44.925 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T18:36:44.925 INFO:teuthology.orchestra.run.smithi073.stdout: "osds": [ 2024-09-12T18:36:44.925 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:44.925 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-09-12T18:36:44.925 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "f1cf24e8-6179-4666-a444-fa81ef0d7482", 2024-09-12T18:36:44.926 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-09-12T18:36:44.926 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-09-12T18:36:44.926 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0.6371612548828125, 2024-09-12T18:36:44.926 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-09-12T18:36:44.926 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-09-12T18:36:44.926 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-09-12T18:36:44.926 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-09-12T18:36:44.926 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 21, 2024-09-12T18:36:44.926 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-09-12T18:36:44.927 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-09-12T18:36:44.927 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-12T18:36:44.927 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:44.927 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:44.927 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:44.927 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6800", 2024-09-12T18:36:44.927 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:36:44.927 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.927 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:44.927 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:44.927 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6801", 2024-09-12T18:36:44.928 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:36:44.928 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:44.928 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:44.928 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.928 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-09-12T18:36:44.928 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:44.928 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:44.928 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:44.929 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6802", 2024-09-12T18:36:44.929 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:36:44.929 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.929 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:44.929 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:44.929 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6803", 2024-09-12T18:36:44.929 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:36:44.929 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:44.929 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:44.929 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.930 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-09-12T18:36:44.930 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:44.930 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:44.930 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:44.930 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6806", 2024-09-12T18:36:44.930 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:36:44.930 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.930 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:44.930 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:44.930 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6807", 2024-09-12T18:36:44.930 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:36:44.930 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:44.931 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:44.931 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.931 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-09-12T18:36:44.931 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:44.931 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:44.931 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:44.931 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6804", 2024-09-12T18:36:44.931 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:36:44.931 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.931 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:44.931 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:44.931 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6805", 2024-09-12T18:36:44.932 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:36:44.932 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:44.932 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:44.932 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.932 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.114:6801/2710632206", 2024-09-12T18:36:44.932 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.114:6803/2710632206", 2024-09-12T18:36:44.932 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.114:6807/2710632206", 2024-09-12T18:36:44.932 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.114:6805/2710632206", 2024-09-12T18:36:44.933 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-09-12T18:36:44.933 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-09-12T18:36:44.933 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-09-12T18:36:44.933 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:44.933 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.933 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:44.933 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-09-12T18:36:44.933 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "3fdb0044-2820-4411-978b-4b6e94fbf0b1", 2024-09-12T18:36:44.933 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-09-12T18:36:44.933 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-09-12T18:36:44.933 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-09-12T18:36:44.933 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-09-12T18:36:44.934 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-09-12T18:36:44.934 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-09-12T18:36:44.934 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 9, 2024-09-12T18:36:44.934 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 49, 2024-09-12T18:36:44.934 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-09-12T18:36:44.934 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-09-12T18:36:44.934 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-12T18:36:44.934 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:44.934 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:44.934 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:44.934 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6800", 2024-09-12T18:36:44.934 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:36:44.935 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.935 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:44.935 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:44.935 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6801", 2024-09-12T18:36:44.935 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:36:44.935 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:44.935 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:44.935 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.935 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-09-12T18:36:44.935 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:44.936 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:44.936 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:44.936 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6802", 2024-09-12T18:36:44.936 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:36:44.936 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.936 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:44.936 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:44.936 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6803", 2024-09-12T18:36:44.936 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:36:44.937 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:44.937 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:44.937 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.937 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-09-12T18:36:44.937 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:44.937 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:44.937 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:44.937 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6806", 2024-09-12T18:36:44.937 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:36:44.937 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.937 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:44.938 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:44.938 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6807", 2024-09-12T18:36:44.938 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:36:44.938 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:44.938 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:44.938 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.938 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-09-12T18:36:44.938 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:44.938 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:44.938 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:44.938 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6804", 2024-09-12T18:36:44.938 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:36:44.938 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.939 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:44.939 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:44.939 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6805", 2024-09-12T18:36:44.939 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:36:44.939 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:44.939 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:44.939 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.939 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.143:6801/862189968", 2024-09-12T18:36:44.939 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.143:6803/862189968", 2024-09-12T18:36:44.939 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.143:6807/862189968", 2024-09-12T18:36:44.939 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.143:6805/862189968", 2024-09-12T18:36:44.939 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-09-12T18:36:44.939 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-09-12T18:36:44.940 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-09-12T18:36:44.940 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:44.940 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.940 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:44.940 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2024-09-12T18:36:44.940 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "6fb554da-561f-4aa2-b855-0e3adb98b057", 2024-09-12T18:36:44.940 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-09-12T18:36:44.940 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-09-12T18:36:44.940 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-09-12T18:36:44.940 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-09-12T18:36:44.940 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-09-12T18:36:44.940 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-09-12T18:36:44.940 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-09-12T18:36:44.941 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 49, 2024-09-12T18:36:44.941 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-09-12T18:36:44.941 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-09-12T18:36:44.941 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-12T18:36:44.941 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:44.941 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:44.941 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:44.941 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6800", 2024-09-12T18:36:44.941 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:36:44.941 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.941 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:44.941 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:44.941 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6801", 2024-09-12T18:36:44.942 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:36:44.942 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:44.942 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:44.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.942 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-09-12T18:36:44.942 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:44.942 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:44.942 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:44.942 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6802", 2024-09-12T18:36:44.942 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:36:44.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.942 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:44.942 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:44.942 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6803", 2024-09-12T18:36:44.943 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:36:44.943 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:44.943 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:44.943 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.943 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-09-12T18:36:44.943 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:44.943 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:44.943 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:44.943 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6806", 2024-09-12T18:36:44.943 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:36:44.943 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.943 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:44.943 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:44.944 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6807", 2024-09-12T18:36:44.944 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:36:44.944 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:44.944 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:44.944 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.944 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-09-12T18:36:44.944 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:44.944 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:44.944 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:44.944 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6804", 2024-09-12T18:36:44.944 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:36:44.944 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.944 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:44.944 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:44.945 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6805", 2024-09-12T18:36:44.945 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:36:44.945 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:44.945 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:44.945 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.945 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.162:6801/1397104153", 2024-09-12T18:36:44.945 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.162:6803/1397104153", 2024-09-12T18:36:44.945 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.162:6807/1397104153", 2024-09-12T18:36:44.945 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.162:6805/1397104153", 2024-09-12T18:36:44.946 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-09-12T18:36:44.946 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-09-12T18:36:44.946 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-09-12T18:36:44.946 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:44.946 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:44.946 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T18:36:44.946 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_xinfo": [ 2024-09-12T18:36:44.946 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:44.946 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-09-12T18:36:44.946 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-09-12T18:36:44.946 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-09-12T18:36:44.946 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-09-12T18:36:44.946 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540719139924082687, 2024-09-12T18:36:44.947 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-09-12T18:36:44.947 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-09-12T18:35:10.239320+0000", 2024-09-12T18:36:44.947 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-09-12T18:36:44.947 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.947 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:44.947 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-09-12T18:36:44.947 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-09-12T18:36:44.947 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-09-12T18:36:44.947 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-09-12T18:36:44.947 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540719139924082687, 2024-09-12T18:36:44.947 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-09-12T18:36:44.947 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-09-12T18:35:10.861760+0000", 2024-09-12T18:36:44.948 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-09-12T18:36:44.948 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.948 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:44.948 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2024-09-12T18:36:44.948 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-09-12T18:36:44.948 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-09-12T18:36:44.948 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-09-12T18:36:44.948 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540719139924082687, 2024-09-12T18:36:44.948 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-09-12T18:36:44.948 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-09-12T18:35:10.355997+0000", 2024-09-12T18:36:44.948 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-09-12T18:36:44.948 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:44.949 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T18:36:44.949 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap": [], 2024-09-12T18:36:44.949 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap_items": [], 2024-09-12T18:36:44.949 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap_primaries": [], 2024-09-12T18:36:44.949 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_temp": [ 2024-09-12T18:36:44.949 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:44.949 INFO:teuthology.orchestra.run.smithi073.stdout: "pgid": "5.0", 2024-09-12T18:36:44.949 INFO:teuthology.orchestra.run.smithi073.stdout: "osds": [ 2024-09-12T18:36:44.949 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-12T18:36:44.949 INFO:teuthology.orchestra.run.smithi073.stdout: 0 2024-09-12T18:36:44.949 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:44.949 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.949 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:44.950 INFO:teuthology.orchestra.run.smithi073.stdout: "pgid": "5.1", 2024-09-12T18:36:44.950 INFO:teuthology.orchestra.run.smithi073.stdout: "osds": [ 2024-09-12T18:36:44.950 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-12T18:36:44.950 INFO:teuthology.orchestra.run.smithi073.stdout: 0 2024-09-12T18:36:44.950 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:44.950 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.950 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:44.950 INFO:teuthology.orchestra.run.smithi073.stdout: "pgid": "5.5", 2024-09-12T18:36:44.950 INFO:teuthology.orchestra.run.smithi073.stdout: "osds": [ 2024-09-12T18:36:44.950 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-12T18:36:44.950 INFO:teuthology.orchestra.run.smithi073.stdout: 0 2024-09-12T18:36:44.950 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:44.950 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:44.950 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T18:36:44.951 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_temp": [], 2024-09-12T18:36:44.951 INFO:teuthology.orchestra.run.smithi073.stdout: "blocklist": {}, 2024-09-12T18:36:44.951 INFO:teuthology.orchestra.run.smithi073.stdout: "range_blocklist": {}, 2024-09-12T18:36:44.951 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profiles": { 2024-09-12T18:36:44.951 INFO:teuthology.orchestra.run.smithi073.stdout: "default": { 2024-09-12T18:36:44.951 INFO:teuthology.orchestra.run.smithi073.stdout: "crush-failure-domain": "osd", 2024-09-12T18:36:44.951 INFO:teuthology.orchestra.run.smithi073.stdout: "k": "2", 2024-09-12T18:36:44.951 INFO:teuthology.orchestra.run.smithi073.stdout: "m": "1", 2024-09-12T18:36:44.951 INFO:teuthology.orchestra.run.smithi073.stdout: "plugin": "jerasure", 2024-09-12T18:36:44.951 INFO:teuthology.orchestra.run.smithi073.stdout: "technique": "reed_sol_van" 2024-09-12T18:36:44.951 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:44.951 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:44.951 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps_queue": [], 2024-09-12T18:36:44.952 INFO:teuthology.orchestra.run.smithi073.stdout: "new_removed_snaps": [], 2024-09-12T18:36:44.952 INFO:teuthology.orchestra.run.smithi073.stdout: "new_purged_snaps": [], 2024-09-12T18:36:44.952 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_node_flags": {}, 2024-09-12T18:36:44.952 INFO:teuthology.orchestra.run.smithi073.stdout: "device_class_flags": {}, 2024-09-12T18:36:44.952 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": { 2024-09-12T18:36:44.952 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode_enabled": false, 2024-09-12T18:36:44.952 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_bucket_count": 0, 2024-09-12T18:36:44.952 INFO:teuthology.orchestra.run.smithi073.stdout: "degraded_stretch_mode": 0, 2024-09-12T18:36:44.952 INFO:teuthology.orchestra.run.smithi073.stdout: "recovering_stretch_mode": 0, 2024-09-12T18:36:44.952 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode_bucket": 0 2024-09-12T18:36:44.952 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:44.952 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T18:36:44.954 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:44.950+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:44.955 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:44.955 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2024-09-12T18:36:44.955 INFO:teuthology.orchestra.run.smithi114.stdout: "complaint_time": 30, 2024-09-12T18:36:44.955 INFO:teuthology.orchestra.run.smithi114.stdout: "num_blocked_ops": 0 2024-09-12T18:36:44.955 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:44.956 INFO:tasks.thrashosds.thrasher:j is {'epoch': 51, 'fsid': 'c08d5a84-711b-44bf-bdf1-e06ecc2c7c00', 'created': '2024-09-12T18:35:02.695853+0000', 'modified': '2024-09-12T18:36:42.071602+0000', 'last_up_change': '2024-09-12T18:35:12.464628+0000', 'last_in_change': '2024-09-12T18:35:04.352525+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T18:35:12.418430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-12T18:35:18.665309+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 15, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T18:35:23.447845+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.409999966621399, 'score_stable': 1.409999966621399, 'optimal_score': 1, 'raw_score_acting': 1.409999966621399, 'raw_score_stable': 1.409999966621399, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T18:35:23.959973+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.409999966621399, 'score_stable': 1.409999966621399, 'optimal_score': 1, 'raw_score_acting': 1.409999966621399, 'raw_score_stable': 1.409999966621399, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2024-09-12T18:35:43.562347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'f1cf24e8-6179-4666-a444-fa81ef0d7482', 'up': 1, 'in': 1, 'weight': 0.6371612548828125, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6800', 'nonce': 2710632206}, {'type': 'v1', 'addr': '172.21.15.114:6801', 'nonce': 2710632206}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6802', 'nonce': 2710632206}, {'type': 'v1', 'addr': '172.21.15.114:6803', 'nonce': 2710632206}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6806', 'nonce': 2710632206}, {'type': 'v1', 'addr': '172.21.15.114:6807', 'nonce': 2710632206}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6804', 'nonce': 2710632206}, {'type': 'v1', 'addr': '172.21.15.114:6805', 'nonce': 2710632206}]}, 'public_addr': '172.21.15.114:6801/2710632206', 'cluster_addr': '172.21.15.114:6803/2710632206', 'heartbeat_back_addr': '172.21.15.114:6807/2710632206', 'heartbeat_front_addr': '172.21.15.114:6805/2710632206', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '3fdb0044-2820-4411-978b-4b6e94fbf0b1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 9, 'up_thru': 49, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6800', 'nonce': 862189968}, {'type': 'v1', 'addr': '172.21.15.143:6801', 'nonce': 862189968}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6802', 'nonce': 862189968}, {'type': 'v1', 'addr': '172.21.15.143:6803', 'nonce': 862189968}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6806', 'nonce': 862189968}, {'type': 'v1', 'addr': '172.21.15.143:6807', 'nonce': 862189968}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6804', 'nonce': 862189968}, {'type': 'v1', 'addr': '172.21.15.143:6805', 'nonce': 862189968}]}, 'public_addr': '172.21.15.143:6801/862189968', 'cluster_addr': '172.21.15.143:6803/862189968', 'heartbeat_back_addr': '172.21.15.143:6807/862189968', 'heartbeat_front_addr': '172.21.15.143:6805/862189968', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '6fb554da-561f-4aa2-b855-0e3adb98b057', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 49, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6800', 'nonce': 1397104153}, {'type': 'v1', 'addr': '172.21.15.162:6801', 'nonce': 1397104153}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6802', 'nonce': 1397104153}, {'type': 'v1', 'addr': '172.21.15.162:6803', 'nonce': 1397104153}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6806', 'nonce': 1397104153}, {'type': 'v1', 'addr': '172.21.15.162:6807', 'nonce': 1397104153}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6804', 'nonce': 1397104153}, {'type': 'v1', 'addr': '172.21.15.162:6805', 'nonce': 1397104153}]}, 'public_addr': '172.21.15.162:6801/1397104153', 'cluster_addr': '172.21.15.162:6803/1397104153', 'heartbeat_back_addr': '172.21.15.162:6807/1397104153', 'heartbeat_front_addr': '172.21.15.162:6805/1397104153', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:35:10.239320+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:35:10.861760+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:35:10.355997+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [{'pgid': '5.0', 'osds': [1, 0]}, {'pgid': '5.1', 'osds': [2, 0]}, {'pgid': '5.5', 'osds': [2, 0]}], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T18:36:44.956 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:36:44.957 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:36:45.054 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:45.052+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:45.105 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is set 2024-09-12T18:36:45.156 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:45.150+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:45.157 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:45.157 INFO:teuthology.orchestra.run.smithi114.stdout: "size": 20, 2024-09-12T18:36:45.157 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 600, 2024-09-12T18:36:45.157 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:36:45.157 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.157 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:45.157 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:45.157 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 79.524654198999997, 2024-09-12T18:36:45.157 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.042475618999999999, 2024-09-12T18:36:45.157 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:45.158 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:45.158 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:45.158 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:45.158 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.158 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:45.158 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:45.158 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:45.158 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.158 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.158 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:45.158 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:45.158 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:45.158 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.159 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.159 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:45.159 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628450+0000", 2024-09-12T18:36:45.159 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4212999999999999e-05 2024-09-12T18:36:45.159 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.159 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.159 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:45.159 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628463+0000", 2024-09-12T18:36:45.159 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2497000000000001e-05 2024-09-12T18:36:45.159 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.159 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.159 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:45.159 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628480+0000", 2024-09-12T18:36:45.160 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7232999999999999e-05 2024-09-12T18:36:45.160 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.160 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.160 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:45.160 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628496+0000", 2024-09-12T18:36:45.160 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6217000000000001e-05 2024-09-12T18:36:45.160 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.160 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.160 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:45.160 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628641+0000", 2024-09-12T18:36:45.160 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000144709 2024-09-12T18:36:45.160 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.160 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.161 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:45.161 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628657+0000", 2024-09-12T18:36:45.161 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6266e-05 2024-09-12T18:36:45.161 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.161 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.161 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:45.161 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663103+0000", 2024-09-12T18:36:45.161 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.034445523999999998 2024-09-12T18:36:45.161 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.161 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.161 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:45.161 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663373+0000", 2024-09-12T18:36:45.162 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00027085500000000002 2024-09-12T18:36:45.162 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.162 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.162 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:45.162 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663634+0000", 2024-09-12T18:36:45.162 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000260855 2024-09-12T18:36:45.162 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.162 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.162 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:45.162 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670294+0000", 2024-09-12T18:36:45.163 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0066597599999999998 2024-09-12T18:36:45.163 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.163 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.163 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:45.163 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670705+0000", 2024-09-12T18:36:45.163 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00041057099999999998 2024-09-12T18:36:45.163 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.163 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.163 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:45.163 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670820+0000", 2024-09-12T18:36:45.163 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000115111 2024-09-12T18:36:45.163 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.163 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.163 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:45.164 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670912+0000", 2024-09-12T18:36:45.164 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1807999999999999e-05 2024-09-12T18:36:45.164 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:45.164 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:45.164 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:45.164 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.164 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.164 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:45.164 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:45.164 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 79.524563452999999, 2024-09-12T18:36:45.164 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.044599273000000002, 2024-09-12T18:36:45.165 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:45.165 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:45.165 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:45.165 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:45.165 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.165 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:45.165 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:45.165 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:45.165 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.165 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.165 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:45.165 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:45.165 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:45.166 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.166 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.166 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:45.166 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628528+0000", 2024-09-12T18:36:45.166 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:45.166 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.166 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.166 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:45.166 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628537+0000", 2024-09-12T18:36:45.166 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6969999999999999e-06 2024-09-12T18:36:45.166 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.166 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.167 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:45.167 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628560+0000", 2024-09-12T18:36:45.167 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2889000000000001e-05 2024-09-12T18:36:45.167 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.167 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.167 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:45.167 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628576+0000", 2024-09-12T18:36:45.167 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.649e-05 2024-09-12T18:36:45.167 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.167 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.167 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:45.167 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628846+0000", 2024-09-12T18:36:45.168 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00026952500000000001 2024-09-12T18:36:45.168 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.168 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.168 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:45.168 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628853+0000", 2024-09-12T18:36:45.168 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6559999999999992e-06 2024-09-12T18:36:45.168 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.168 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.168 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:45.168 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665284+0000", 2024-09-12T18:36:45.168 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.036431140000000001 2024-09-12T18:36:45.168 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.168 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.169 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:45.169 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665494+0000", 2024-09-12T18:36:45.169 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000209762 2024-09-12T18:36:45.169 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.169 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.169 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:45.169 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665816+0000", 2024-09-12T18:36:45.169 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00032162299999999999 2024-09-12T18:36:45.169 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.169 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.169 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:45.170 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670382+0000", 2024-09-12T18:36:45.170 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0045656739999999996 2024-09-12T18:36:45.170 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.170 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.170 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:45.170 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.672978+0000", 2024-09-12T18:36:45.170 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.002596068 2024-09-12T18:36:45.170 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.170 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.170 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:45.170 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673058+0000", 2024-09-12T18:36:45.171 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0198999999999996e-05 2024-09-12T18:36:45.171 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.171 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.171 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:45.171 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673126+0000", 2024-09-12T18:36:45.171 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8120000000000005e-05 2024-09-12T18:36:45.171 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:45.171 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:45.171 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:45.171 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.171 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.171 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:23 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:45.171 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:45.172 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 79.524465647, 2024-09-12T18:36:45.172 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045539784, 2024-09-12T18:36:45.172 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:45.172 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:45.172 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:45.172 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:45.172 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.172 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:45.172 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:45.172 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:45.173 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.173 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.173 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:45.173 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:45.173 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:45.173 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.173 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.173 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:45.173 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628626+0000", 2024-09-12T18:36:45.173 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.573e-06 2024-09-12T18:36:45.173 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.173 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.174 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:45.174 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628640+0000", 2024-09-12T18:36:45.174 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3817e-05 2024-09-12T18:36:45.174 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.174 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.174 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:45.174 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628659+0000", 2024-09-12T18:36:45.174 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9539999999999999e-05 2024-09-12T18:36:45.174 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.174 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.174 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:45.174 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628675+0000", 2024-09-12T18:36:45.174 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5739e-05 2024-09-12T18:36:45.174 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.175 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.175 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:45.175 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628815+0000", 2024-09-12T18:36:45.175 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014003299999999999 2024-09-12T18:36:45.175 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.175 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.175 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:45.176 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628828+0000", 2024-09-12T18:36:45.176 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2849e-05 2024-09-12T18:36:45.176 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.176 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.176 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:45.176 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651162+0000", 2024-09-12T18:36:45.176 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.022334228000000001 2024-09-12T18:36:45.176 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.176 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.176 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:45.176 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651446+0000", 2024-09-12T18:36:45.177 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00028392800000000002 2024-09-12T18:36:45.177 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.177 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.177 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:45.177 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651746+0000", 2024-09-12T18:36:45.178 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000300091 2024-09-12T18:36:45.178 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.178 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.178 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:45.178 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665113+0000", 2024-09-12T18:36:45.178 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013366678 2024-09-12T18:36:45.178 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.178 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.178 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:45.178 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674010+0000", 2024-09-12T18:36:45.178 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0088970520000000008 2024-09-12T18:36:45.178 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.178 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.179 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:45.179 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674104+0000", 2024-09-12T18:36:45.179 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4124999999999998e-05 2024-09-12T18:36:45.179 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.179 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.179 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:45.179 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674164+0000", 2024-09-12T18:36:45.179 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.0130999999999997e-05 2024-09-12T18:36:45.179 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:45.179 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:45.179 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:45.179 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.180 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.180 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:26 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:45.180 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:45.180 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 79.524392441000003, 2024-09-12T18:36:45.180 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045702136999999997, 2024-09-12T18:36:45.180 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:45.180 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:45.180 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:45.180 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:45.180 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.180 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:45.180 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:45.181 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:45.181 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.181 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.181 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:45.181 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:45.181 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:45.181 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.181 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.181 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:45.181 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628699+0000", 2024-09-12T18:36:45.181 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3859999999999999e-06 2024-09-12T18:36:45.181 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.181 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.182 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:45.182 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628706+0000", 2024-09-12T18:36:45.182 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0169999999999999e-06 2024-09-12T18:36:45.182 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.182 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.182 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:45.182 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628725+0000", 2024-09-12T18:36:45.182 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8683000000000001e-05 2024-09-12T18:36:45.182 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.182 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.182 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:45.182 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628740+0000", 2024-09-12T18:36:45.183 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5413999999999998e-05 2024-09-12T18:36:45.183 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.183 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.183 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:45.183 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628907+0000", 2024-09-12T18:36:45.183 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00016670199999999999 2024-09-12T18:36:45.183 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.183 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.183 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:45.183 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628917+0000", 2024-09-12T18:36:45.184 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.046e-05 2024-09-12T18:36:45.184 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.184 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.184 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:45.184 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.660390+0000", 2024-09-12T18:36:45.184 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.031472364000000003 2024-09-12T18:36:45.184 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.184 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.184 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:45.184 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.661767+0000", 2024-09-12T18:36:45.184 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0013769190000000001 2024-09-12T18:36:45.184 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.185 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.185 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:45.185 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.662408+0000", 2024-09-12T18:36:45.185 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00064091099999999998 2024-09-12T18:36:45.185 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.185 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.185 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:45.185 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669577+0000", 2024-09-12T18:36:45.185 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.007169412 2024-09-12T18:36:45.185 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.185 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.185 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:45.186 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674244+0000", 2024-09-12T18:36:45.186 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0046671839999999996 2024-09-12T18:36:45.186 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.186 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.186 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:45.186 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674329+0000", 2024-09-12T18:36:45.186 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5276000000000001e-05 2024-09-12T18:36:45.186 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.186 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.186 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:45.186 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674400+0000", 2024-09-12T18:36:45.186 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0408999999999996e-05 2024-09-12T18:36:45.187 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:45.187 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:45.187 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:45.187 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.187 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.187 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:45.187 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:45.187 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 79.524284772000001, 2024-09-12T18:36:45.187 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.044572443000000003, 2024-09-12T18:36:45.187 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:45.187 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:45.187 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:45.187 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:45.188 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.188 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:45.188 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:45.188 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:45.188 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.188 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.188 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:45.188 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:45.188 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:45.188 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.188 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.188 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:45.188 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628807+0000", 2024-09-12T18:36:45.189 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3629999999999999e-06 2024-09-12T18:36:45.189 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.189 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.189 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:45.189 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628814+0000", 2024-09-12T18:36:45.189 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.2099999999999996e-06 2024-09-12T18:36:45.189 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.189 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.189 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:45.189 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628832+0000", 2024-09-12T18:36:45.189 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7972999999999999e-05 2024-09-12T18:36:45.189 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.189 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.190 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:45.190 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628854+0000", 2024-09-12T18:36:45.190 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1857000000000001e-05 2024-09-12T18:36:45.190 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.190 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.190 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:45.190 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628984+0000", 2024-09-12T18:36:45.190 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013013599999999999 2024-09-12T18:36:45.190 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.190 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.190 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:45.190 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628993+0000", 2024-09-12T18:36:45.190 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:36:45.191 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.191 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.191 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:45.191 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668176+0000", 2024-09-12T18:36:45.191 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.039182211000000002 2024-09-12T18:36:45.191 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.191 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.191 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:45.191 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668481+0000", 2024-09-12T18:36:45.191 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00030499200000000002 2024-09-12T18:36:45.191 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.191 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.191 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:45.192 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668771+0000", 2024-09-12T18:36:45.192 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00029018700000000002 2024-09-12T18:36:45.192 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.192 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.192 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:45.192 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.672674+0000", 2024-09-12T18:36:45.192 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0039031890000000001 2024-09-12T18:36:45.192 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.192 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.192 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:45.192 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673214+0000", 2024-09-12T18:36:45.192 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00053981600000000004 2024-09-12T18:36:45.193 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.193 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.193 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:45.193 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673310+0000", 2024-09-12T18:36:45.193 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.6682999999999996e-05 2024-09-12T18:36:45.193 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.193 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.193 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:45.193 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673378+0000", 2024-09-12T18:36:45.193 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7385999999999995e-05 2024-09-12T18:36:45.194 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:45.194 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:45.194 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:45.194 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.194 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.194 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:45.194 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:45.194 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 79.524148745999995, 2024-09-12T18:36:45.194 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.041480853999999998, 2024-09-12T18:36:45.194 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:45.194 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:45.194 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:45.194 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:45.195 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.195 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:45.195 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:45.195 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:45.195 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.195 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.195 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:45.195 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:45.195 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:45.195 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.195 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.195 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:45.195 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628943+0000", 2024-09-12T18:36:45.196 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.403e-06 2024-09-12T18:36:45.196 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.196 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.196 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:45.196 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628953+0000", 2024-09-12T18:36:45.196 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0273e-05 2024-09-12T18:36:45.196 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.196 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.196 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:45.196 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628973+0000", 2024-09-12T18:36:45.196 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9959999999999999e-05 2024-09-12T18:36:45.196 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.196 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.197 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:45.197 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628989+0000", 2024-09-12T18:36:45.197 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6447e-05 2024-09-12T18:36:45.197 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.197 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.197 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:45.197 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629144+0000", 2024-09-12T18:36:45.197 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015468900000000001 2024-09-12T18:36:45.197 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.197 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.197 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:45.197 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629162+0000", 2024-09-12T18:36:45.198 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7603000000000001e-05 2024-09-12T18:36:45.198 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.198 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.198 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:45.198 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.646927+0000", 2024-09-12T18:36:45.198 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.017765626 2024-09-12T18:36:45.198 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.198 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.198 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:45.198 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.647245+0000", 2024-09-12T18:36:45.198 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00031797699999999999 2024-09-12T18:36:45.198 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.198 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.198 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:45.199 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.647551+0000", 2024-09-12T18:36:45.199 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00030583500000000002 2024-09-12T18:36:45.199 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.199 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.199 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:45.199 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651738+0000", 2024-09-12T18:36:45.199 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0041864980000000003 2024-09-12T18:36:45.199 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.199 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.199 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:45.199 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670207+0000", 2024-09-12T18:36:45.199 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018469299000000002 2024-09-12T18:36:45.200 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.200 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.200 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:45.200 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670330+0000", 2024-09-12T18:36:45.200 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012284500000000001 2024-09-12T18:36:45.200 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.200 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.200 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:45.200 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670422+0000", 2024-09-12T18:36:45.200 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2398999999999994e-05 2024-09-12T18:36:45.200 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:45.201 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:45.201 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:45.201 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.201 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.201 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:45.201 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:45.202 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 79.524071492999994, 2024-09-12T18:36:45.202 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.041623741999999998, 2024-09-12T18:36:45.202 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:45.202 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:45.202 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:45.202 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:45.203 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.203 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:45.203 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:45.203 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:45.203 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.203 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.203 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:45.204 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:45.204 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:45.204 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.204 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.204 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:45.204 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629020+0000", 2024-09-12T18:36:45.205 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.15e-06 2024-09-12T18:36:45.205 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.205 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.205 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:45.205 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629023+0000", 2024-09-12T18:36:45.205 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4659999999999999e-06 2024-09-12T18:36:45.205 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.205 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.206 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:45.206 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629037+0000", 2024-09-12T18:36:45.206 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3857e-05 2024-09-12T18:36:45.206 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.206 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.206 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:45.207 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629062+0000", 2024-09-12T18:36:45.207 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4519999999999999e-05 2024-09-12T18:36:45.207 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.207 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.207 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:45.207 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629253+0000", 2024-09-12T18:36:45.208 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000191335 2024-09-12T18:36:45.208 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.208 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.208 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:45.208 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629266+0000", 2024-09-12T18:36:45.208 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3322999999999999e-05 2024-09-12T18:36:45.209 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.209 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.209 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:45.209 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648331+0000", 2024-09-12T18:36:45.209 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.019065060000000002 2024-09-12T18:36:45.209 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.210 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.210 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:45.210 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.650044+0000", 2024-09-12T18:36:45.210 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017123959999999999 2024-09-12T18:36:45.210 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.210 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.210 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:45.210 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670642+0000", 2024-09-12T18:36:45.210 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.020598635000000001 2024-09-12T18:36:45.210 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:45.210 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:45.210 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:45.211 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.211 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.211 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:45.211 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:45.211 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 79.523968160999999, 2024-09-12T18:36:45.211 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.046431252999999999, 2024-09-12T18:36:45.211 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:45.211 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:45.211 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:45.211 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:45.211 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.211 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:45.211 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:45.212 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:45.212 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.212 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.212 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:45.212 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:45.212 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:45.212 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.212 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.212 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:45.212 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629123+0000", 2024-09-12T18:36:45.212 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0899999999999999e-06 2024-09-12T18:36:45.212 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.213 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.213 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:45.213 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629138+0000", 2024-09-12T18:36:45.213 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4977000000000001e-05 2024-09-12T18:36:45.213 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.213 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.213 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:45.213 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629149+0000", 2024-09-12T18:36:45.213 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1182999999999999e-05 2024-09-12T18:36:45.213 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.213 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.213 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:45.213 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629157+0000", 2024-09-12T18:36:45.214 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8129999999999996e-06 2024-09-12T18:36:45.214 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.214 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.214 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:45.214 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629223+0000", 2024-09-12T18:36:45.214 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6463000000000004e-05 2024-09-12T18:36:45.214 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.214 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.214 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:45.214 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629230+0000", 2024-09-12T18:36:45.214 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1360000000000002e-06 2024-09-12T18:36:45.214 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.214 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.214 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:45.215 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669605+0000", 2024-09-12T18:36:45.215 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.040375518999999999 2024-09-12T18:36:45.215 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.215 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.215 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:45.215 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669840+0000", 2024-09-12T18:36:45.215 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00023520099999999999 2024-09-12T18:36:45.215 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.215 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.215 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:45.215 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.675553+0000", 2024-09-12T18:36:45.215 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0057128709999999996 2024-09-12T18:36:45.216 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:45.216 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:45.216 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:45.216 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.216 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.216 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:45.216 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:45.216 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 79.523913493999999, 2024-09-12T18:36:45.216 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.037357044999999998, 2024-09-12T18:36:45.216 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:45.216 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:45.216 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:45.216 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:45.217 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.217 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:45.217 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:45.217 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:45.217 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.217 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.217 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:45.218 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:45.218 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:45.218 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.218 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.218 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:45.218 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629178+0000", 2024-09-12T18:36:45.218 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.08e-06 2024-09-12T18:36:45.219 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.219 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.219 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:45.219 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629194+0000", 2024-09-12T18:36:45.219 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5899000000000001e-05 2024-09-12T18:36:45.219 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.219 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.219 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:45.219 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629211+0000", 2024-09-12T18:36:45.219 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7363e-05 2024-09-12T18:36:45.219 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.219 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.220 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:45.220 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629226+0000", 2024-09-12T18:36:45.220 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4567e-05 2024-09-12T18:36:45.220 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.220 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.220 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:45.220 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629299+0000", 2024-09-12T18:36:45.220 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3910000000000002e-05 2024-09-12T18:36:45.220 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.220 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.220 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:45.220 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629307+0000", 2024-09-12T18:36:45.221 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5299999999999999e-06 2024-09-12T18:36:45.221 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.221 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.221 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:45.221 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648185+0000", 2024-09-12T18:36:45.221 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018878533999999999 2024-09-12T18:36:45.221 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.221 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.221 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:45.221 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.649724+0000", 2024-09-12T18:36:45.221 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001538841 2024-09-12T18:36:45.221 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.221 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.222 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:45.222 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.666534+0000", 2024-09-12T18:36:45.222 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.016809320999999999 2024-09-12T18:36:45.222 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:45.222 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:45.222 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:45.222 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.222 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.222 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:80967 5.a 5:5f4000f6:::benchmark_data_smithi073_23739_object80966:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T18:36:45.222 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:18.561016+0000", 2024-09-12T18:36:45.222 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 26.592073898999999, 2024-09-12T18:36:45.222 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021780831, 2024-09-12T18:36:45.222 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:45.223 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:45.223 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:45.223 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:45.223 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:45.223 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:45.223 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 80967 2024-09-12T18:36:45.223 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.223 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:45.223 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.223 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:45.223 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561016+0000", 2024-09-12T18:36:45.223 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:45.223 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.224 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.224 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:45.224 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561016+0000", 2024-09-12T18:36:45.224 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:45.224 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.224 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.224 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:45.224 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561017+0000", 2024-09-12T18:36:45.224 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7599999999999997e-07 2024-09-12T18:36:45.224 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.224 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.225 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:45.225 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561050+0000", 2024-09-12T18:36:45.225 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3524e-05 2024-09-12T18:36:45.225 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.225 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.225 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:45.225 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561058+0000", 2024-09-12T18:36:45.225 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0679999999999997e-06 2024-09-12T18:36:45.225 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.225 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.225 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:45.226 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561065+0000", 2024-09-12T18:36:45.226 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1990000000000003e-06 2024-09-12T18:36:45.226 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.226 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.226 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:45.226 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564735+0000", 2024-09-12T18:36:45.226 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0036706740000000001 2024-09-12T18:36:45.226 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.226 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.226 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:45.226 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564868+0000", 2024-09-12T18:36:45.226 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000133003 2024-09-12T18:36:45.226 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.227 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.227 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:45.227 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.565010+0000", 2024-09-12T18:36:45.227 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014224300000000001 2024-09-12T18:36:45.227 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.227 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.227 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:45.227 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.569871+0000", 2024-09-12T18:36:45.227 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0048600759999999996 2024-09-12T18:36:45.227 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.227 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.227 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:45.227 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.582729+0000", 2024-09-12T18:36:45.228 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012858090000000001 2024-09-12T18:36:45.228 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.228 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.228 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:45.228 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.582758+0000", 2024-09-12T18:36:45.228 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.9762999999999999e-05 2024-09-12T18:36:45.228 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.228 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.228 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:45.228 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.582797+0000", 2024-09-12T18:36:45.228 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8615000000000002e-05 2024-09-12T18:36:45.228 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:45.229 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:45.229 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:45.229 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.229 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.229 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:80971 5.2 e39/21 5:4205ebb1:::benchmark_data_smithi073_23739_object80970:head v 39'5054, mlcod=39'5052)", 2024-09-12T18:36:45.229 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:18.564320+0000", 2024-09-12T18:36:45.229 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 26.588769933999998, 2024-09-12T18:36:45.229 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.019963669999999999, 2024-09-12T18:36:45.229 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:45.229 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:45.229 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:45.229 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:45.229 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.230 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:45.230 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564320+0000", 2024-09-12T18:36:45.230 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:45.230 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.230 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.230 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:45.230 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564320+0000", 2024-09-12T18:36:45.230 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:45.230 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.230 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.230 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:45.230 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564321+0000", 2024-09-12T18:36:45.230 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.77e-07 2024-09-12T18:36:45.231 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.231 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.231 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:45.231 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564418+0000", 2024-09-12T18:36:45.231 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.7602000000000005e-05 2024-09-12T18:36:45.231 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.231 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.231 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:45.231 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564427+0000", 2024-09-12T18:36:45.231 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7439999999999996e-06 2024-09-12T18:36:45.231 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.231 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.231 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:45.231 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564442+0000", 2024-09-12T18:36:45.231 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5353e-05 2024-09-12T18:36:45.232 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.232 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.232 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:45.232 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.569512+0000", 2024-09-12T18:36:45.232 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0050701840000000001 2024-09-12T18:36:45.232 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.232 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.232 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:45.232 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.569531+0000", 2024-09-12T18:36:45.232 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8311000000000001e-05 2024-09-12T18:36:45.232 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.232 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.233 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:45.233 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.584246+0000", 2024-09-12T18:36:45.233 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.014714947000000001 2024-09-12T18:36:45.233 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.233 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.233 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:45.233 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.584284+0000", 2024-09-12T18:36:45.233 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8152000000000003e-05 2024-09-12T18:36:45.233 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:45.233 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:45.233 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:45.233 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.234 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.234 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:108511 5.6 5:608a30a3:::benchmark_data_smithi073_23739_object108510:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:36:45.234 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:31.986730+0000", 2024-09-12T18:36:45.234 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 13.166360024999999, 2024-09-12T18:36:45.234 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021507117999999999, 2024-09-12T18:36:45.234 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:45.234 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:45.234 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:45.234 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:45.234 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:45.234 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:45.234 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 108511 2024-09-12T18:36:45.234 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.235 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:45.235 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.235 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:45.235 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986730+0000", 2024-09-12T18:36:45.235 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:45.235 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.235 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.235 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:45.235 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986730+0000", 2024-09-12T18:36:45.235 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:45.236 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.236 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.236 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:45.236 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986731+0000", 2024-09-12T18:36:45.236 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.9100000000000003e-07 2024-09-12T18:36:45.236 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.236 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.236 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:45.236 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986804+0000", 2024-09-12T18:36:45.236 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3647999999999997e-05 2024-09-12T18:36:45.236 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.236 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.237 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:45.237 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986812+0000", 2024-09-12T18:36:45.237 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.34e-06 2024-09-12T18:36:45.237 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.237 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.237 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:45.237 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986836+0000", 2024-09-12T18:36:45.237 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4213e-05 2024-09-12T18:36:45.237 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.237 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.237 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:45.237 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.997047+0000", 2024-09-12T18:36:45.238 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.010210649 2024-09-12T18:36:45.238 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.238 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.238 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:45.238 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.997169+0000", 2024-09-12T18:36:45.238 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012269700000000001 2024-09-12T18:36:45.238 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.238 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.238 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:45.238 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.997300+0000", 2024-09-12T18:36:45.238 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000130858 2024-09-12T18:36:45.238 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.238 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.238 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:45.239 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.002398+0000", 2024-09-12T18:36:45.239 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0050981580000000002 2024-09-12T18:36:45.239 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.239 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.239 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:45.239 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.008093+0000", 2024-09-12T18:36:45.239 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0056941930000000002 2024-09-12T18:36:45.239 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.239 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.239 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:45.239 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.008151+0000", 2024-09-12T18:36:45.239 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8328999999999997e-05 2024-09-12T18:36:45.239 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.239 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.240 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:45.240 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.008237+0000", 2024-09-12T18:36:45.240 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6341999999999994e-05 2024-09-12T18:36:45.240 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:45.240 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:45.240 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:45.240 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.240 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.240 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:108623 5.c 5:33792cd3:::benchmark_data_smithi073_23739_object108622:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:36:45.240 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:32.046609+0000", 2024-09-12T18:36:45.240 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 13.106481249, 2024-09-12T18:36:45.240 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021062860999999999, 2024-09-12T18:36:45.241 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:45.241 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:45.241 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:45.241 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:45.241 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:45.241 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:45.241 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 108623 2024-09-12T18:36:45.241 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.241 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:45.241 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.241 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:45.241 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.046609+0000", 2024-09-12T18:36:45.241 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:45.242 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.242 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.242 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:45.242 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.046609+0000", 2024-09-12T18:36:45.242 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:45.242 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.242 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.242 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:45.242 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.046609+0000", 2024-09-12T18:36:45.242 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.37e-07 2024-09-12T18:36:45.242 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.242 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.242 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:45.243 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.046690+0000", 2024-09-12T18:36:45.243 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0212999999999999e-05 2024-09-12T18:36:45.243 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.243 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.243 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:45.243 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.046698+0000", 2024-09-12T18:36:45.243 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6430000000000001e-06 2024-09-12T18:36:45.243 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.243 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.243 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:45.243 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.046704+0000", 2024-09-12T18:36:45.243 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7699999999999998e-06 2024-09-12T18:36:45.243 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.243 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.244 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:45.244 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.056808+0000", 2024-09-12T18:36:45.244 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.010103562999999999 2024-09-12T18:36:45.244 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.244 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.244 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:45.244 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.056989+0000", 2024-09-12T18:36:45.244 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000181196 2024-09-12T18:36:45.244 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.244 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.244 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:45.244 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.057162+0000", 2024-09-12T18:36:45.244 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000173396 2024-09-12T18:36:45.245 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.245 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.245 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:45.245 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.063269+0000", 2024-09-12T18:36:45.245 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0061066100000000002 2024-09-12T18:36:45.245 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.245 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.245 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:45.245 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.067578+0000", 2024-09-12T18:36:45.246 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0043092570000000004 2024-09-12T18:36:45.246 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.246 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.246 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:45.246 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.067628+0000", 2024-09-12T18:36:45.246 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0136999999999998e-05 2024-09-12T18:36:45.246 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.246 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.246 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:45.246 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.067672+0000", 2024-09-12T18:36:45.246 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3439000000000002e-05 2024-09-12T18:36:45.246 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:45.246 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:45.247 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:45.247 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.247 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.247 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:115360 5.c 5:3eab790c:::benchmark_data_smithi073_23739_object115359:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:36:45.247 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:35.325499+0000", 2024-09-12T18:36:45.247 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 9.8275913250000002, 2024-09-12T18:36:45.247 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.020147082, 2024-09-12T18:36:45.247 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:45.247 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:45.247 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:45.247 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:45.247 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:45.248 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:45.248 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 115360 2024-09-12T18:36:45.248 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.248 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:45.248 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.248 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:45.248 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.325499+0000", 2024-09-12T18:36:45.248 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:45.248 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.248 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.248 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:45.249 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.325499+0000", 2024-09-12T18:36:45.249 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:45.249 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.249 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.249 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:45.249 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.325500+0000", 2024-09-12T18:36:45.249 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.9999999999999996e-07 2024-09-12T18:36:45.249 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.249 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.249 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:45.249 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.325556+0000", 2024-09-12T18:36:45.249 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6665e-05 2024-09-12T18:36:45.249 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.250 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.250 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:45.250 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.325568+0000", 2024-09-12T18:36:45.250 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1311000000000001e-05 2024-09-12T18:36:45.250 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.250 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.250 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:45.250 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.325575+0000", 2024-09-12T18:36:45.250 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.7649999999999993e-06 2024-09-12T18:36:45.250 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.250 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.250 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:45.250 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.327911+0000", 2024-09-12T18:36:45.250 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0023351359999999998 2024-09-12T18:36:45.251 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.251 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.251 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:45.251 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.328046+0000", 2024-09-12T18:36:45.251 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000135444 2024-09-12T18:36:45.251 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.251 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.251 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:45.251 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.328173+0000", 2024-09-12T18:36:45.251 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012734199999999999 2024-09-12T18:36:45.251 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.251 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.251 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:45.252 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.332254+0000", 2024-09-12T18:36:45.252 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0040805320000000004 2024-09-12T18:36:45.252 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.252 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.252 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:45.252 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.345519+0000", 2024-09-12T18:36:45.252 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013265403 2024-09-12T18:36:45.252 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.252 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.252 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:45.252 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.345583+0000", 2024-09-12T18:36:45.252 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3545000000000002e-05 2024-09-12T18:36:45.252 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.253 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.253 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:45.253 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:35.345646+0000", 2024-09-12T18:36:45.253 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3039000000000004e-05 2024-09-12T18:36:45.253 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:45.253 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:45.253 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:45.253 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.253 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.253 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:121033 5.0 e50/49 5:0b3817c1:::benchmark_data_smithi073_23739_object121032:head v 50'7620, mlcod=0'0)", 2024-09-12T18:36:45.253 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:40.165057+0000", 2024-09-12T18:36:45.253 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4.9880335269999998, 2024-09-12T18:36:45.254 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.030641286, 2024-09-12T18:36:45.254 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:45.254 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:45.254 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:45.254 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:45.254 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.254 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:45.254 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.165057+0000", 2024-09-12T18:36:45.254 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:45.255 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.255 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.255 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:45.255 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.165057+0000", 2024-09-12T18:36:45.255 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:45.255 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.255 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.255 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:45.255 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.165057+0000", 2024-09-12T18:36:45.255 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8599999999999998e-07 2024-09-12T18:36:45.255 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.255 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.255 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:45.255 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.165109+0000", 2024-09-12T18:36:45.256 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2086000000000002e-05 2024-09-12T18:36:45.256 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.256 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.256 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:45.256 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.165161+0000", 2024-09-12T18:36:45.256 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1415000000000002e-05 2024-09-12T18:36:45.256 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.256 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.256 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:45.256 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.165178+0000", 2024-09-12T18:36:45.257 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7790000000000001e-05 2024-09-12T18:36:45.257 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.257 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.257 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:45.257 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.168784+0000", 2024-09-12T18:36:45.257 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0036052050000000002 2024-09-12T18:36:45.257 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.257 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.257 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:45.257 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.168854+0000", 2024-09-12T18:36:45.257 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0814000000000003e-05 2024-09-12T18:36:45.257 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.257 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.258 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:45.258 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.195600+0000", 2024-09-12T18:36:45.258 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.026745173000000001 2024-09-12T18:36:45.258 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.258 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.258 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:45.258 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.195698+0000", 2024-09-12T18:36:45.258 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.8317000000000001e-05 2024-09-12T18:36:45.258 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:45.258 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:45.258 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:45.258 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.259 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.259 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:121044 5.1 e50/49 5:83bf711a:::benchmark_data_smithi073_23739_object121043:head v 50'7532, mlcod=0'0)", 2024-09-12T18:36:45.259 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:40.200337+0000", 2024-09-12T18:36:45.259 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4.9527535260000004, 2024-09-12T18:36:45.259 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.023483312999999999, 2024-09-12T18:36:45.259 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:45.259 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:45.259 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:45.259 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:45.259 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.259 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:45.260 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200337+0000", 2024-09-12T18:36:45.260 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:45.260 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.260 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.260 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:45.260 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200337+0000", 2024-09-12T18:36:45.260 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:45.260 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.260 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.260 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:45.260 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200338+0000", 2024-09-12T18:36:45.260 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.877e-06 2024-09-12T18:36:45.261 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.261 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.261 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:45.261 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200558+0000", 2024-09-12T18:36:45.261 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00021912799999999999 2024-09-12T18:36:45.261 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.261 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.261 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:45.261 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200584+0000", 2024-09-12T18:36:45.261 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.6333e-05 2024-09-12T18:36:45.261 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.261 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.262 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:45.262 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200602+0000", 2024-09-12T18:36:45.262 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.853e-05 2024-09-12T18:36:45.262 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.262 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.262 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:45.262 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200753+0000", 2024-09-12T18:36:45.262 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015061299999999999 2024-09-12T18:36:45.262 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.262 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.262 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:45.262 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200790+0000", 2024-09-12T18:36:45.262 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.7398999999999999e-05 2024-09-12T18:36:45.262 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.263 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.263 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:45.263 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.223743+0000", 2024-09-12T18:36:45.263 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.022952455 2024-09-12T18:36:45.263 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.263 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.263 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:45.263 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.223820+0000", 2024-09-12T18:36:45.263 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6977999999999994e-05 2024-09-12T18:36:45.263 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:45.263 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:45.263 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:45.263 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.264 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.264 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:121110 5.2 e50/21 5:4dc37b93:::benchmark_data_smithi073_23739_object121109:head v 50'7513, mlcod=48'7511)", 2024-09-12T18:36:45.264 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:40.241103+0000", 2024-09-12T18:36:45.264 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4.911987485, 2024-09-12T18:36:45.264 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021833894, 2024-09-12T18:36:45.264 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:45.264 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:45.264 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:45.264 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:45.264 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.264 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:45.264 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241103+0000", 2024-09-12T18:36:45.264 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:45.265 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.265 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.265 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:45.265 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241103+0000", 2024-09-12T18:36:45.265 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:45.265 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.265 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.265 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:45.265 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241104+0000", 2024-09-12T18:36:45.265 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.7999999999999993e-07 2024-09-12T18:36:45.265 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.265 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.265 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:45.266 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241162+0000", 2024-09-12T18:36:45.266 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8319000000000002e-05 2024-09-12T18:36:45.266 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.266 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.266 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:45.266 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241181+0000", 2024-09-12T18:36:45.266 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9055999999999998e-05 2024-09-12T18:36:45.266 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.266 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.266 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:45.267 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241191+0000", 2024-09-12T18:36:45.267 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.9359999999999994e-06 2024-09-12T18:36:45.267 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.267 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.267 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:45.267 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241305+0000", 2024-09-12T18:36:45.267 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000114134 2024-09-12T18:36:45.267 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.267 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.267 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:45.267 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241372+0000", 2024-09-12T18:36:45.267 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6521999999999998e-05 2024-09-12T18:36:45.267 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.268 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.268 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:45.268 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.262837+0000", 2024-09-12T18:36:45.268 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021465766000000001 2024-09-12T18:36:45.268 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.268 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.268 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:45.268 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.262937+0000", 2024-09-12T18:36:45.268 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.9180999999999998e-05 2024-09-12T18:36:45.268 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:45.268 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:45.268 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:45.268 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.269 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.269 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:121113 5.7 e50/21 5:ecb54668:::benchmark_data_smithi073_23739_object121112:head v 50'7600, mlcod=48'7598)", 2024-09-12T18:36:45.269 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:40.243664+0000", 2024-09-12T18:36:45.269 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4.9094263480000002, 2024-09-12T18:36:45.269 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.020378377999999999, 2024-09-12T18:36:45.269 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:45.269 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:45.269 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:45.269 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:45.269 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.269 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:45.269 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.243664+0000", 2024-09-12T18:36:45.269 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:45.270 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.270 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.270 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:45.270 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.243664+0000", 2024-09-12T18:36:45.270 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:45.270 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.270 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.270 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:45.270 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.243665+0000", 2024-09-12T18:36:45.270 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.48e-06 2024-09-12T18:36:45.270 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.271 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.271 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:45.271 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.243740+0000", 2024-09-12T18:36:45.271 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5197999999999994e-05 2024-09-12T18:36:45.271 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.271 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.271 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:45.271 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.243763+0000", 2024-09-12T18:36:45.271 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2348999999999999e-05 2024-09-12T18:36:45.271 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.271 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.271 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:45.271 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.243783+0000", 2024-09-12T18:36:45.272 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.0716999999999998e-05 2024-09-12T18:36:45.272 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.272 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.272 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:45.272 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.243972+0000", 2024-09-12T18:36:45.272 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000188946 2024-09-12T18:36:45.272 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.272 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.272 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:45.272 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.244008+0000", 2024-09-12T18:36:45.272 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.5806000000000002e-05 2024-09-12T18:36:45.272 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.272 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.273 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:45.273 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.263922+0000", 2024-09-12T18:36:45.273 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.019913614999999999 2024-09-12T18:36:45.273 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.273 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.273 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:45.273 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.264042+0000", 2024-09-12T18:36:45.273 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012026700000000001 2024-09-12T18:36:45.273 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:45.273 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:45.273 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:45.273 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.273 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.274 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:121148 5.4 e50/21 5:2a9bde06:::benchmark_data_smithi073_23739_object121147:head v 50'7521, mlcod=48'7519)", 2024-09-12T18:36:45.274 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:40.281756+0000", 2024-09-12T18:36:45.274 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4.871334118, 2024-09-12T18:36:45.274 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.020077747999999999, 2024-09-12T18:36:45.274 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:45.274 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:45.274 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:45.274 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:45.274 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.274 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:45.274 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.281756+0000", 2024-09-12T18:36:45.274 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:45.274 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.275 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.275 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:45.275 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.281756+0000", 2024-09-12T18:36:45.275 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:45.275 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.275 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.275 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:45.275 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.281758+0000", 2024-09-12T18:36:45.275 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5710000000000001e-06 2024-09-12T18:36:45.275 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.275 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.275 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:45.275 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.281845+0000", 2024-09-12T18:36:45.275 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7270999999999998e-05 2024-09-12T18:36:45.276 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.276 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.276 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:45.276 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.281864+0000", 2024-09-12T18:36:45.276 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9508e-05 2024-09-12T18:36:45.276 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.276 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.276 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:45.276 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.281884+0000", 2024-09-12T18:36:45.276 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9550000000000001e-05 2024-09-12T18:36:45.277 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.277 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.277 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:45.277 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.282053+0000", 2024-09-12T18:36:45.277 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000168624 2024-09-12T18:36:45.277 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.278 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.278 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:45.278 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.282090+0000", 2024-09-12T18:36:45.278 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.7682000000000003e-05 2024-09-12T18:36:45.278 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.278 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.279 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:45.279 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.301749+0000", 2024-09-12T18:36:45.279 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.019658364000000001 2024-09-12T18:36:45.279 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.279 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.279 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:45.279 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.301834+0000", 2024-09-12T18:36:45.279 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5178000000000003e-05 2024-09-12T18:36:45.279 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:45.279 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:45.279 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:45.279 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.279 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.280 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:121160 5.b e50/21 5:d4730c8e:::benchmark_data_smithi073_23739_object121159:head v 50'7640, mlcod=47'7638)", 2024-09-12T18:36:45.280 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:40.289729+0000", 2024-09-12T18:36:45.280 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4.8633609389999997, 2024-09-12T18:36:45.280 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021365733000000001, 2024-09-12T18:36:45.280 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:45.280 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:45.280 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:45.280 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:45.280 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.280 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:45.280 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.289729+0000", 2024-09-12T18:36:45.280 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:45.281 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.281 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.281 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:45.281 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.289729+0000", 2024-09-12T18:36:45.281 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:45.281 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.281 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.281 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:45.281 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.289730+0000", 2024-09-12T18:36:45.281 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1799999999999995e-07 2024-09-12T18:36:45.281 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.281 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.281 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:45.282 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.289831+0000", 2024-09-12T18:36:45.282 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000101122 2024-09-12T18:36:45.282 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.282 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.282 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:45.282 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.289847+0000", 2024-09-12T18:36:45.282 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5787999999999999e-05 2024-09-12T18:36:45.282 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.282 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.282 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:45.282 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.289859+0000", 2024-09-12T18:36:45.282 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2439000000000001e-05 2024-09-12T18:36:45.282 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.283 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.283 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:45.283 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.289998+0000", 2024-09-12T18:36:45.283 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000138725 2024-09-12T18:36:45.283 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.283 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.283 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:45.283 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.290055+0000", 2024-09-12T18:36:45.283 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7166000000000001e-05 2024-09-12T18:36:45.283 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.283 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.283 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:45.283 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.311028+0000", 2024-09-12T18:36:45.284 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.020972602 2024-09-12T18:36:45.284 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:45.284 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:45.284 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:45.284 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.311095+0000", 2024-09-12T18:36:45.284 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7273000000000005e-05 2024-09-12T18:36:45.284 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:45.284 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:45.284 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:45.284 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:45.284 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:45.284 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:45.286 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:45.282+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:45.287 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:36:45.292 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:36:45.294 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T18:36:45.308 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":97,"stamp":"2024-09-12T18:36:45.107165+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8197376925,"num_objects":125099,"num_object_clones":0,"num_object_copies":250198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":22774,"num_objects_unfound":0,"num_objects_dirty":125099,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":125265,"num_write_kb":8007360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":769,"num_bytes_recovered":50070086,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":53075,"ondisk_log_size":53075,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":278,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1419448,"kb_used_data":996852,"kb_used_omap":4,"kb_used_meta":422523,"kb_avail":281696072,"statfs":{"total":289910292480,"available":288456777728,"internally_reserved":0,"allocated":1020776448,"data_stored":16304796933,"data_compressed":774268997,"data_compressed_allocated":1019027456,"data_compressed_original":16304144384,"omap_allocated":4783,"internal_metadata":432663889},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,1,3,2,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":396951552,"num_objects":6057,"num_object_clones":0,"num_object_copies":12114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":22774,"num_objects_unfound":0,"num_objects_dirty":6057,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6057,"num_write_kb":387648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":769,"num_bytes_recovered":50070086,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.058064"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":83,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.080361+0000","last_change":"2024-09-12T18:36:40.076316+0000","last_active":"2024-09-12T18:36:42.080361+0000","last_peered":"2024-09-12T18:36:42.080361+0000","last_clean":"2024-09-12T18:36:42.080361+0000","last_became_active":"2024-09-12T18:36:40.074014+0000","last_became_peered":"2024-09-12T18:36:40.074014+0000","last_unstale":"2024-09-12T18:36:42.080361+0000","last_undegraded":"2024-09-12T18:36:42.080361+0000","last_fullsized":"2024-09-12T18:36:42.080361+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:20.167564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":77,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.078545+0000","last_change":"2024-09-12T18:35:25.659760+0000","last_active":"2024-09-12T18:36:42.078545+0000","last_peered":"2024-09-12T18:36:42.078545+0000","last_clean":"2024-09-12T18:36:42.078545+0000","last_became_active":"2024-09-12T18:35:25.654920+0000","last_became_peered":"2024-09-12T18:35:25.654920+0000","last_unstale":"2024-09-12T18:36:42.078545+0000","last_undegraded":"2024-09-12T18:36:42.078545+0000","last_fullsized":"2024-09-12T18:36:42.078545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:21.519881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":75,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.057297+0000","last_change":"2024-09-12T18:35:25.659460+0000","last_active":"2024-09-12T18:36:40.057297+0000","last_peered":"2024-09-12T18:36:40.057297+0000","last_clean":"2024-09-12T18:36:40.057297+0000","last_became_active":"2024-09-12T18:35:25.657782+0000","last_became_peered":"2024-09-12T18:35:25.657782+0000","last_unstale":"2024-09-12T18:36:40.057297+0000","last_undegraded":"2024-09-12T18:36:40.057297+0000","last_fullsized":"2024-09-12T18:36:40.057297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:38.544284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":75,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.056477+0000","last_change":"2024-09-12T18:35:25.663617+0000","last_active":"2024-09-12T18:36:40.056477+0000","last_peered":"2024-09-12T18:36:40.056477+0000","last_clean":"2024-09-12T18:36:40.056477+0000","last_became_active":"2024-09-12T18:35:25.661977+0000","last_became_peered":"2024-09-12T18:35:25.661977+0000","last_unstale":"2024-09-12T18:36:40.056477+0000","last_undegraded":"2024-09-12T18:36:40.056477+0000","last_fullsized":"2024-09-12T18:36:40.056477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:14.748234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":77,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.078612+0000","last_change":"2024-09-12T18:35:25.656566+0000","last_active":"2024-09-12T18:36:42.078612+0000","last_peered":"2024-09-12T18:36:42.078612+0000","last_clean":"2024-09-12T18:36:42.078612+0000","last_became_active":"2024-09-12T18:35:25.654898+0000","last_became_peered":"2024-09-12T18:35:25.654898+0000","last_unstale":"2024-09-12T18:36:42.078612+0000","last_undegraded":"2024-09-12T18:36:42.078612+0000","last_fullsized":"2024-09-12T18:36:42.078612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:36.113250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":81,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.067926+0000","last_change":"2024-09-12T18:36:40.067812+0000","last_active":"2024-09-12T18:36:40.067926+0000","last_peered":"2024-09-12T18:36:40.067926+0000","last_clean":"2024-09-12T18:36:40.067926+0000","last_became_active":"2024-09-12T18:36:40.067396+0000","last_became_peered":"2024-09-12T18:36:40.067396+0000","last_unstale":"2024-09-12T18:36:40.067926+0000","last_undegraded":"2024-09-12T18:36:40.067926+0000","last_fullsized":"2024-09-12T18:36:40.067926+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:46.485518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":75,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.055063+0000","last_change":"2024-09-12T18:35:25.659811+0000","last_active":"2024-09-12T18:36:40.055063+0000","last_peered":"2024-09-12T18:36:40.055063+0000","last_clean":"2024-09-12T18:36:40.055063+0000","last_became_active":"2024-09-12T18:35:25.658998+0000","last_became_peered":"2024-09-12T18:35:25.658998+0000","last_unstale":"2024-09-12T18:36:40.055063+0000","last_undegraded":"2024-09-12T18:36:40.055063+0000","last_fullsized":"2024-09-12T18:36:40.055063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":81,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.154702+0000","last_change":"2024-09-12T18:36:40.154635+0000","last_active":"2024-09-12T18:36:40.154702+0000","last_peered":"2024-09-12T18:36:40.154702+0000","last_clean":"2024-09-12T18:36:40.154702+0000","last_became_active":"2024-09-12T18:36:40.153818+0000","last_became_peered":"2024-09-12T18:36:40.153818+0000","last_unstale":"2024-09-12T18:36:40.154702+0000","last_undegraded":"2024-09-12T18:36:40.154702+0000","last_fullsized":"2024-09-12T18:36:40.154702+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:54.571879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":75,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.061500+0000","last_change":"2024-09-12T18:35:25.668339+0000","last_active":"2024-09-12T18:36:40.061500+0000","last_peered":"2024-09-12T18:36:40.061500+0000","last_clean":"2024-09-12T18:36:40.061500+0000","last_became_active":"2024-09-12T18:35:25.667608+0000","last_became_peered":"2024-09-12T18:35:25.667608+0000","last_unstale":"2024-09-12T18:36:40.061500+0000","last_undegraded":"2024-09-12T18:36:40.061500+0000","last_fullsized":"2024-09-12T18:36:40.061500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:15.699745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":83,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.078755+0000","last_change":"2024-09-12T18:36:40.075686+0000","last_active":"2024-09-12T18:36:42.078755+0000","last_peered":"2024-09-12T18:36:42.078755+0000","last_clean":"2024-09-12T18:36:42.078755+0000","last_became_active":"2024-09-12T18:36:40.072911+0000","last_became_peered":"2024-09-12T18:36:40.072911+0000","last_unstale":"2024-09-12T18:36:42.078755+0000","last_undegraded":"2024-09-12T18:36:42.078755+0000","last_fullsized":"2024-09-12T18:36:42.078755+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:24.687842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":81,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.057094+0000","last_change":"2024-09-12T18:36:39.072342+0000","last_active":"2024-09-12T18:36:40.057094+0000","last_peered":"2024-09-12T18:36:40.057094+0000","last_clean":"2024-09-12T18:36:40.057094+0000","last_became_active":"2024-09-12T18:36:39.071488+0000","last_became_peered":"2024-09-12T18:36:39.071488+0000","last_unstale":"2024-09-12T18:36:40.057094+0000","last_undegraded":"2024-09-12T18:36:40.057094+0000","last_fullsized":"2024-09-12T18:36:40.057094+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:27.845874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":77,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.079977+0000","last_change":"2024-09-12T18:35:25.649885+0000","last_active":"2024-09-12T18:36:42.079977+0000","last_peered":"2024-09-12T18:36:42.079977+0000","last_clean":"2024-09-12T18:36:42.079977+0000","last_became_active":"2024-09-12T18:35:25.649111+0000","last_became_peered":"2024-09-12T18:35:25.649111+0000","last_unstale":"2024-09-12T18:36:42.079977+0000","last_undegraded":"2024-09-12T18:36:42.079977+0000","last_fullsized":"2024-09-12T18:36:42.079977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:17.162410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":83,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.078359+0000","last_change":"2024-09-12T18:36:39.074873+0000","last_active":"2024-09-12T18:36:42.078359+0000","last_peered":"2024-09-12T18:36:42.078359+0000","last_clean":"2024-09-12T18:36:42.078359+0000","last_became_active":"2024-09-12T18:36:39.074049+0000","last_became_peered":"2024-09-12T18:36:39.074049+0000","last_unstale":"2024-09-12T18:36:42.078359+0000","last_undegraded":"2024-09-12T18:36:42.078359+0000","last_fullsized":"2024-09-12T18:36:42.078359+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:14.773044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":75,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.055205+0000","last_change":"2024-09-12T18:35:25.657913+0000","last_active":"2024-09-12T18:36:40.055205+0000","last_peered":"2024-09-12T18:36:40.055205+0000","last_clean":"2024-09-12T18:36:40.055205+0000","last_became_active":"2024-09-12T18:35:25.657082+0000","last_became_peered":"2024-09-12T18:35:25.657082+0000","last_unstale":"2024-09-12T18:36:40.055205+0000","last_undegraded":"2024-09-12T18:36:40.055205+0000","last_fullsized":"2024-09-12T18:36:40.055205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:21.538633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":75,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.055251+0000","last_change":"2024-09-12T18:35:25.658763+0000","last_active":"2024-09-12T18:36:40.055251+0000","last_peered":"2024-09-12T18:36:40.055251+0000","last_clean":"2024-09-12T18:36:40.055251+0000","last_became_active":"2024-09-12T18:35:25.657508+0000","last_became_peered":"2024-09-12T18:35:25.657508+0000","last_unstale":"2024-09-12T18:36:40.055251+0000","last_undegraded":"2024-09-12T18:36:40.055251+0000","last_fullsized":"2024-09-12T18:36:40.055251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:13.170519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":75,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.054494+0000","last_change":"2024-09-12T18:35:25.653730+0000","last_active":"2024-09-12T18:36:40.054494+0000","last_peered":"2024-09-12T18:36:40.054494+0000","last_clean":"2024-09-12T18:36:40.054494+0000","last_became_active":"2024-09-12T18:35:25.651535+0000","last_became_peered":"2024-09-12T18:35:25.651535+0000","last_unstale":"2024-09-12T18:36:40.054494+0000","last_undegraded":"2024-09-12T18:36:40.054494+0000","last_fullsized":"2024-09-12T18:36:40.054494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":75,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.062498+0000","last_change":"2024-09-12T18:35:25.656513+0000","last_active":"2024-09-12T18:36:40.062498+0000","last_peered":"2024-09-12T18:36:40.062498+0000","last_clean":"2024-09-12T18:36:40.062498+0000","last_became_active":"2024-09-12T18:35:25.653440+0000","last_became_peered":"2024-09-12T18:35:25.653440+0000","last_unstale":"2024-09-12T18:36:40.062498+0000","last_undegraded":"2024-09-12T18:36:40.062498+0000","last_fullsized":"2024-09-12T18:36:40.062498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:18.693161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":77,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.078912+0000","last_change":"2024-09-12T18:35:25.657991+0000","last_active":"2024-09-12T18:36:42.078912+0000","last_peered":"2024-09-12T18:36:42.078912+0000","last_clean":"2024-09-12T18:36:42.078912+0000","last_became_active":"2024-09-12T18:35:25.653934+0000","last_became_peered":"2024-09-12T18:35:25.653934+0000","last_unstale":"2024-09-12T18:36:42.078912+0000","last_undegraded":"2024-09-12T18:36:42.078912+0000","last_fullsized":"2024-09-12T18:36:42.078912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:05.418901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.079809+0000","last_change":"2024-09-12T18:36:39.075412+0000","last_active":"2024-09-12T18:36:42.079809+0000","last_peered":"2024-09-12T18:36:42.079809+0000","last_clean":"2024-09-12T18:36:42.079809+0000","last_became_active":"2024-09-12T18:36:39.074539+0000","last_became_peered":"2024-09-12T18:36:39.074539+0000","last_unstale":"2024-09-12T18:36:42.079809+0000","last_undegraded":"2024-09-12T18:36:42.079809+0000","last_fullsized":"2024-09-12T18:36:42.079809+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:34.322250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":75,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.056774+0000","last_change":"2024-09-12T18:35:25.661176+0000","last_active":"2024-09-12T18:36:40.056774+0000","last_peered":"2024-09-12T18:36:40.056774+0000","last_clean":"2024-09-12T18:36:40.056774+0000","last_became_active":"2024-09-12T18:35:25.659534+0000","last_became_peered":"2024-09-12T18:35:25.659534+0000","last_unstale":"2024-09-12T18:36:40.056774+0000","last_undegraded":"2024-09-12T18:36:40.056774+0000","last_fullsized":"2024-09-12T18:36:40.056774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:40.145442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":75,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.055666+0000","last_change":"2024-09-12T18:35:25.650632+0000","last_active":"2024-09-12T18:36:40.055666+0000","last_peered":"2024-09-12T18:36:40.055666+0000","last_clean":"2024-09-12T18:36:40.055666+0000","last_became_active":"2024-09-12T18:35:25.649333+0000","last_became_peered":"2024-09-12T18:35:25.649333+0000","last_unstale":"2024-09-12T18:36:40.055666+0000","last_undegraded":"2024-09-12T18:36:40.055666+0000","last_fullsized":"2024-09-12T18:36:40.055666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:30.537572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":77,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.079976+0000","last_change":"2024-09-12T18:35:25.648245+0000","last_active":"2024-09-12T18:36:42.079976+0000","last_peered":"2024-09-12T18:36:42.079976+0000","last_clean":"2024-09-12T18:36:42.079976+0000","last_became_active":"2024-09-12T18:35:25.646357+0000","last_became_peered":"2024-09-12T18:35:25.646357+0000","last_unstale":"2024-09-12T18:36:42.079976+0000","last_undegraded":"2024-09-12T18:36:42.079976+0000","last_fullsized":"2024-09-12T18:36:42.079976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:05.662140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":75,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.059645+0000","last_change":"2024-09-12T18:35:25.661613+0000","last_active":"2024-09-12T18:36:40.059645+0000","last_peered":"2024-09-12T18:36:40.059645+0000","last_clean":"2024-09-12T18:36:40.059645+0000","last_became_active":"2024-09-12T18:35:25.658833+0000","last_became_peered":"2024-09-12T18:35:25.658833+0000","last_unstale":"2024-09-12T18:36:40.059645+0000","last_undegraded":"2024-09-12T18:36:40.059645+0000","last_fullsized":"2024-09-12T18:36:40.059645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:51.064080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":77,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.078514+0000","last_change":"2024-09-12T18:35:25.657782+0000","last_active":"2024-09-12T18:36:42.078514+0000","last_peered":"2024-09-12T18:36:42.078514+0000","last_clean":"2024-09-12T18:36:42.078514+0000","last_became_active":"2024-09-12T18:35:25.655295+0000","last_became_peered":"2024-09-12T18:35:25.655295+0000","last_unstale":"2024-09-12T18:36:42.078514+0000","last_undegraded":"2024-09-12T18:36:42.078514+0000","last_fullsized":"2024-09-12T18:36:42.078514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:37.744175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":77,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.080468+0000","last_change":"2024-09-12T18:35:25.654863+0000","last_active":"2024-09-12T18:36:42.080468+0000","last_peered":"2024-09-12T18:36:42.080468+0000","last_clean":"2024-09-12T18:36:42.080468+0000","last_became_active":"2024-09-12T18:35:25.650407+0000","last_became_peered":"2024-09-12T18:35:25.650407+0000","last_unstale":"2024-09-12T18:36:42.080468+0000","last_undegraded":"2024-09-12T18:36:42.080468+0000","last_fullsized":"2024-09-12T18:36:42.080468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:38.395666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":75,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.062077+0000","last_change":"2024-09-12T18:35:25.662414+0000","last_active":"2024-09-12T18:36:40.062077+0000","last_peered":"2024-09-12T18:36:40.062077+0000","last_clean":"2024-09-12T18:36:40.062077+0000","last_became_active":"2024-09-12T18:35:25.660126+0000","last_became_peered":"2024-09-12T18:35:25.660126+0000","last_unstale":"2024-09-12T18:36:40.062077+0000","last_undegraded":"2024-09-12T18:36:40.062077+0000","last_fullsized":"2024-09-12T18:36:40.062077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:48.437139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":75,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.057086+0000","last_change":"2024-09-12T18:35:25.661523+0000","last_active":"2024-09-12T18:36:40.057086+0000","last_peered":"2024-09-12T18:36:40.057086+0000","last_clean":"2024-09-12T18:36:40.057086+0000","last_became_active":"2024-09-12T18:35:25.659338+0000","last_became_peered":"2024-09-12T18:35:25.659338+0000","last_unstale":"2024-09-12T18:36:40.057086+0000","last_undegraded":"2024-09-12T18:36:40.057086+0000","last_fullsized":"2024-09-12T18:36:40.057086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:37.083820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":77,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.080311+0000","last_change":"2024-09-12T18:35:25.662445+0000","last_active":"2024-09-12T18:36:42.080311+0000","last_peered":"2024-09-12T18:36:42.080311+0000","last_clean":"2024-09-12T18:36:42.080311+0000","last_became_active":"2024-09-12T18:35:25.659496+0000","last_became_peered":"2024-09-12T18:35:25.659496+0000","last_unstale":"2024-09-12T18:36:42.080311+0000","last_undegraded":"2024-09-12T18:36:42.080311+0000","last_fullsized":"2024-09-12T18:36:42.080311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:03.270420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.078269+0000","last_change":"2024-09-12T18:36:39.074532+0000","last_active":"2024-09-12T18:36:42.078269+0000","last_peered":"2024-09-12T18:36:42.078269+0000","last_clean":"2024-09-12T18:36:42.078269+0000","last_became_active":"2024-09-12T18:36:39.073676+0000","last_became_peered":"2024-09-12T18:36:39.073676+0000","last_unstale":"2024-09-12T18:36:42.078269+0000","last_undegraded":"2024-09-12T18:36:42.078269+0000","last_fullsized":"2024-09-12T18:36:42.078269+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:53.080797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":77,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.080154+0000","last_change":"2024-09-12T18:35:25.650507+0000","last_active":"2024-09-12T18:36:42.080154+0000","last_peered":"2024-09-12T18:36:42.080154+0000","last_clean":"2024-09-12T18:36:42.080154+0000","last_became_active":"2024-09-12T18:35:25.649415+0000","last_became_peered":"2024-09-12T18:35:25.649415+0000","last_unstale":"2024-09-12T18:36:42.080154+0000","last_undegraded":"2024-09-12T18:36:42.080154+0000","last_fullsized":"2024-09-12T18:36:42.080154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:23.081416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":75,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.059512+0000","last_change":"2024-09-12T18:35:25.653949+0000","last_active":"2024-09-12T18:36:40.059512+0000","last_peered":"2024-09-12T18:36:40.059512+0000","last_clean":"2024-09-12T18:36:40.059512+0000","last_became_active":"2024-09-12T18:35:25.652992+0000","last_became_peered":"2024-09-12T18:35:25.652992+0000","last_unstale":"2024-09-12T18:36:40.059512+0000","last_undegraded":"2024-09-12T18:36:40.059512+0000","last_fullsized":"2024-09-12T18:36:40.059512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:47.687372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":81,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.155084+0000","last_change":"2024-09-12T18:36:40.154958+0000","last_active":"2024-09-12T18:36:40.155084+0000","last_peered":"2024-09-12T18:36:40.155084+0000","last_clean":"2024-09-12T18:36:40.155084+0000","last_became_active":"2024-09-12T18:36:40.154422+0000","last_became_peered":"2024-09-12T18:36:40.154422+0000","last_unstale":"2024-09-12T18:36:40.155084+0000","last_undegraded":"2024-09-12T18:36:40.155084+0000","last_fullsized":"2024-09-12T18:36:40.155084+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:33.288844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":83,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.080218+0000","last_change":"2024-09-12T18:36:40.079440+0000","last_active":"2024-09-12T18:36:42.080218+0000","last_peered":"2024-09-12T18:36:42.080218+0000","last_clean":"2024-09-12T18:36:42.080218+0000","last_became_active":"2024-09-12T18:36:40.076955+0000","last_became_peered":"2024-09-12T18:36:40.076955+0000","last_unstale":"2024-09-12T18:36:42.080218+0000","last_undegraded":"2024-09-12T18:36:42.080218+0000","last_fullsized":"2024-09-12T18:36:42.080218+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:18.565373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":79,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.056262+0000","last_change":"2024-09-12T18:35:24.657739+0000","last_active":"2024-09-12T18:36:40.056262+0000","last_peered":"2024-09-12T18:36:40.056262+0000","last_clean":"2024-09-12T18:36:40.056262+0000","last_became_active":"2024-09-12T18:35:24.656208+0000","last_became_peered":"2024-09-12T18:35:24.656208+0000","last_unstale":"2024-09-12T18:36:40.056262+0000","last_undegraded":"2024-09-12T18:36:40.056262+0000","last_fullsized":"2024-09-12T18:36:40.056262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:50.073716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":77,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.079569+0000","last_change":"2024-09-12T18:35:25.651651+0000","last_active":"2024-09-12T18:36:42.079569+0000","last_peered":"2024-09-12T18:36:42.079569+0000","last_clean":"2024-09-12T18:36:42.079569+0000","last_became_active":"2024-09-12T18:35:25.650849+0000","last_became_peered":"2024-09-12T18:35:25.650849+0000","last_unstale":"2024-09-12T18:36:42.079569+0000","last_undegraded":"2024-09-12T18:36:42.079569+0000","last_fullsized":"2024-09-12T18:36:42.079569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:18.555827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":77,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.060842+0000","last_change":"2024-09-12T18:35:24.656119+0000","last_active":"2024-09-12T18:36:40.060842+0000","last_peered":"2024-09-12T18:36:40.060842+0000","last_clean":"2024-09-12T18:36:40.060842+0000","last_became_active":"2024-09-12T18:35:24.653175+0000","last_became_peered":"2024-09-12T18:35:24.653175+0000","last_unstale":"2024-09-12T18:36:40.060842+0000","last_undegraded":"2024-09-12T18:36:40.060842+0000","last_fullsized":"2024-09-12T18:36:40.060842+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:00.551165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.091945+0000","last_change":"2024-09-12T18:36:40.090805+0000","last_active":"2024-09-12T18:36:40.091945+0000","last_peered":"2024-09-12T18:36:40.091945+0000","last_clean":"2024-09-12T18:36:40.091945+0000","last_became_active":"2024-09-12T18:36:40.090318+0000","last_became_peered":"2024-09-12T18:36:40.090318+0000","last_unstale":"2024-09-12T18:36:40.091945+0000","last_undegraded":"2024-09-12T18:36:40.091945+0000","last_fullsized":"2024-09-12T18:36:40.091945+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:15.103437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":79,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.078422+0000","last_change":"2024-09-12T18:35:24.640096+0000","last_active":"2024-09-12T18:36:42.078422+0000","last_peered":"2024-09-12T18:36:42.078422+0000","last_clean":"2024-09-12T18:36:42.078422+0000","last_became_active":"2024-09-12T18:35:24.638230+0000","last_became_peered":"2024-09-12T18:35:24.638230+0000","last_unstale":"2024-09-12T18:36:42.078422+0000","last_undegraded":"2024-09-12T18:36:42.078422+0000","last_fullsized":"2024-09-12T18:36:42.078422+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:38.435296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.078052+0000","last_change":"2024-09-12T18:36:40.075962+0000","last_active":"2024-09-12T18:36:40.078052+0000","last_peered":"2024-09-12T18:36:40.078052+0000","last_clean":"2024-09-12T18:36:40.078052+0000","last_became_active":"2024-09-12T18:36:40.075081+0000","last_became_peered":"2024-09-12T18:36:40.075081+0000","last_unstale":"2024-09-12T18:36:40.078052+0000","last_undegraded":"2024-09-12T18:36:40.078052+0000","last_fullsized":"2024-09-12T18:36:40.078052+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:00.410639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":85,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.055496+0000","last_change":"2024-09-12T18:35:24.653610+0000","last_active":"2024-09-12T18:36:40.055496+0000","last_peered":"2024-09-12T18:36:40.055496+0000","last_clean":"2024-09-12T18:36:40.055496+0000","last_became_active":"2024-09-12T18:35:24.652880+0000","last_became_peered":"2024-09-12T18:35:24.652880+0000","last_unstale":"2024-09-12T18:36:40.055496+0000","last_undegraded":"2024-09-12T18:36:40.055496+0000","last_fullsized":"2024-09-12T18:36:40.055496+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:57.636251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"50'7743","reported_seq":7810,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:41.477734+0000","last_change":"2024-09-12T18:35:44.771794+0000","last_active":"2024-09-12T18:36:41.477734+0000","last_peered":"2024-09-12T18:36:41.477734+0000","last_clean":"2024-09-12T18:36:41.477734+0000","last_became_active":"2024-09-12T18:35:44.771286+0000","last_became_peered":"2024-09-12T18:35:44.771286+0000","last_unstale":"2024-09-12T18:36:41.477734+0000","last_undegraded":"2024-09-12T18:36:41.477734+0000","last_fullsized":"2024-09-12T18:36:41.477734+0000","mapping_epoch":21,"log_start":"38'4653","ondisk_log_start":"38'4653","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3090,"log_dups_size":0,"ondisk_log_size":3090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:10.094729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":507445248,"num_objects":7743,"num_object_clones":0,"num_object_copies":15486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7743,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7743,"num_write_kb":495552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":78,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.060254+0000","last_change":"2024-09-12T18:35:24.653465+0000","last_active":"2024-09-12T18:36:40.060254+0000","last_peered":"2024-09-12T18:36:40.060254+0000","last_clean":"2024-09-12T18:36:40.060254+0000","last_became_active":"2024-09-12T18:35:24.652792+0000","last_became_peered":"2024-09-12T18:35:24.652792+0000","last_unstale":"2024-09-12T18:36:40.060254+0000","last_undegraded":"2024-09-12T18:36:40.060254+0000","last_fullsized":"2024-09-12T18:36:40.060254+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:14.588993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":77,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.078282+0000","last_change":"2024-09-12T18:35:25.655426+0000","last_active":"2024-09-12T18:36:42.078282+0000","last_peered":"2024-09-12T18:36:42.078282+0000","last_clean":"2024-09-12T18:36:42.078282+0000","last_became_active":"2024-09-12T18:35:25.648186+0000","last_became_peered":"2024-09-12T18:35:25.648186+0000","last_unstale":"2024-09-12T18:36:42.078282+0000","last_undegraded":"2024-09-12T18:36:42.078282+0000","last_fullsized":"2024-09-12T18:36:42.078282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:48.802815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"51'7826","reported_seq":7893,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:43.490077+0000","last_change":"2024-09-12T18:35:44.767860+0000","last_active":"2024-09-12T18:36:43.490077+0000","last_peered":"2024-09-12T18:36:43.490077+0000","last_clean":"2024-09-12T18:36:43.490077+0000","last_became_active":"2024-09-12T18:35:44.766986+0000","last_became_peered":"2024-09-12T18:35:44.766986+0000","last_unstale":"2024-09-12T18:36:43.490077+0000","last_undegraded":"2024-09-12T18:36:43.490077+0000","last_fullsized":"2024-09-12T18:36:43.490077+0000","mapping_epoch":21,"log_start":"38'4535","ondisk_log_start":"38'4535","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3291,"log_dups_size":0,"ondisk_log_size":3291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:49.109157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":512884736,"num_objects":7826,"num_object_clones":0,"num_object_copies":15652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7826,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7826,"num_write_kb":500864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":81,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.079018+0000","last_change":"2024-09-12T18:35:24.648439+0000","last_active":"2024-09-12T18:36:42.079018+0000","last_peered":"2024-09-12T18:36:42.079018+0000","last_clean":"2024-09-12T18:36:42.079018+0000","last_became_active":"2024-09-12T18:35:24.647629+0000","last_became_peered":"2024-09-12T18:35:24.647629+0000","last_unstale":"2024-09-12T18:36:42.079018+0000","last_undegraded":"2024-09-12T18:36:42.079018+0000","last_fullsized":"2024-09-12T18:36:42.079018+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:45.428223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":77,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.078137+0000","last_change":"2024-09-12T18:35:25.652496+0000","last_active":"2024-09-12T18:36:42.078137+0000","last_peered":"2024-09-12T18:36:42.078137+0000","last_clean":"2024-09-12T18:36:42.078137+0000","last_became_active":"2024-09-12T18:35:25.651628+0000","last_became_peered":"2024-09-12T18:35:25.651628+0000","last_unstale":"2024-09-12T18:36:42.078137+0000","last_undegraded":"2024-09-12T18:36:42.078137+0000","last_fullsized":"2024-09-12T18:36:42.078137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:44.920448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"51'8057","reported_seq":8126,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:43.505735+0000","last_change":"2024-09-12T18:35:44.767175+0000","last_active":"2024-09-12T18:36:43.505735+0000","last_peered":"2024-09-12T18:36:43.505735+0000","last_clean":"2024-09-12T18:36:43.505735+0000","last_became_active":"2024-09-12T18:35:44.766592+0000","last_became_peered":"2024-09-12T18:35:44.766592+0000","last_unstale":"2024-09-12T18:36:43.505735+0000","last_undegraded":"2024-09-12T18:36:43.505735+0000","last_fullsized":"2024-09-12T18:36:43.505735+0000","mapping_epoch":21,"log_start":"38'4848","ondisk_log_start":"38'4848","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3209,"log_dups_size":0,"ondisk_log_size":3209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:44.678279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528023552,"num_objects":8057,"num_object_clones":0,"num_object_copies":16114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8057,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8057,"num_write_kb":515648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":78,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.056063+0000","last_change":"2024-09-12T18:35:24.654976+0000","last_active":"2024-09-12T18:36:40.056063+0000","last_peered":"2024-09-12T18:36:40.056063+0000","last_clean":"2024-09-12T18:36:40.056063+0000","last_became_active":"2024-09-12T18:35:24.654264+0000","last_became_peered":"2024-09-12T18:35:24.654264+0000","last_unstale":"2024-09-12T18:36:40.056063+0000","last_undegraded":"2024-09-12T18:36:40.056063+0000","last_fullsized":"2024-09-12T18:36:40.056063+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:00.115408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":81,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.071016+0000","last_change":"2024-09-12T18:36:40.070910+0000","last_active":"2024-09-12T18:36:40.071016+0000","last_peered":"2024-09-12T18:36:40.071016+0000","last_clean":"2024-09-12T18:36:40.071016+0000","last_became_active":"2024-09-12T18:36:40.070516+0000","last_became_peered":"2024-09-12T18:36:40.070516+0000","last_unstale":"2024-09-12T18:36:40.071016+0000","last_undegraded":"2024-09-12T18:36:40.071016+0000","last_fullsized":"2024-09-12T18:36:40.071016+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:23.962788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"50'7811","reported_seq":7878,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:41.466073+0000","last_change":"2024-09-12T18:35:44.763067+0000","last_active":"2024-09-12T18:36:41.466073+0000","last_peered":"2024-09-12T18:36:41.466073+0000","last_clean":"2024-09-12T18:36:41.466073+0000","last_became_active":"2024-09-12T18:35:44.762584+0000","last_became_peered":"2024-09-12T18:35:44.762584+0000","last_unstale":"2024-09-12T18:36:41.466073+0000","last_undegraded":"2024-09-12T18:36:41.466073+0000","last_fullsized":"2024-09-12T18:36:41.466073+0000","mapping_epoch":21,"log_start":"36'4100","ondisk_log_start":"36'4100","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3711,"log_dups_size":0,"ondisk_log_size":3711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:47.847399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":511901696,"num_objects":7811,"num_object_clones":0,"num_object_copies":15622,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7811,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7811,"num_write_kb":499904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":77,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.057445+0000","last_change":"2024-09-12T18:35:24.657665+0000","last_active":"2024-09-12T18:36:40.057445+0000","last_peered":"2024-09-12T18:36:40.057445+0000","last_clean":"2024-09-12T18:36:40.057445+0000","last_became_active":"2024-09-12T18:35:24.657015+0000","last_became_peered":"2024-09-12T18:35:24.657015+0000","last_unstale":"2024-09-12T18:36:40.057445+0000","last_undegraded":"2024-09-12T18:36:40.057445+0000","last_fullsized":"2024-09-12T18:36:40.057445+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:03.171326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":75,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.060811+0000","last_change":"2024-09-12T18:35:25.665275+0000","last_active":"2024-09-12T18:36:40.060811+0000","last_peered":"2024-09-12T18:36:40.060811+0000","last_clean":"2024-09-12T18:36:40.060811+0000","last_became_active":"2024-09-12T18:35:25.659511+0000","last_became_peered":"2024-09-12T18:35:25.659511+0000","last_unstale":"2024-09-12T18:36:40.060811+0000","last_undegraded":"2024-09-12T18:36:40.060811+0000","last_fullsized":"2024-09-12T18:36:40.060811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"51'8081","reported_seq":8150,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:43.511963+0000","last_change":"2024-09-12T18:35:44.773526+0000","last_active":"2024-09-12T18:36:43.511963+0000","last_peered":"2024-09-12T18:36:43.511963+0000","last_clean":"2024-09-12T18:36:43.511963+0000","last_became_active":"2024-09-12T18:35:44.772974+0000","last_became_peered":"2024-09-12T18:35:44.772974+0000","last_unstale":"2024-09-12T18:36:43.511963+0000","last_undegraded":"2024-09-12T18:36:43.511963+0000","last_fullsized":"2024-09-12T18:36:43.511963+0000","mapping_epoch":21,"log_start":"38'4866","ondisk_log_start":"38'4866","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3215,"log_dups_size":0,"ondisk_log_size":3215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:23.676840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":529596416,"num_objects":8081,"num_object_clones":0,"num_object_copies":16162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8081,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8081,"num_write_kb":517184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":27,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.116602+0000","last_change":"2024-09-12T18:36:40.115783+0000","last_active":"2024-09-12T18:36:40.116602+0000","last_peered":"2024-09-12T18:36:40.116602+0000","last_clean":"2024-09-12T18:36:40.116602+0000","last_became_active":"2024-09-12T18:36:40.068020+0000","last_became_peered":"2024-09-12T18:36:40.068020+0000","last_unstale":"2024-09-12T18:36:40.116602+0000","last_undegraded":"2024-09-12T18:36:40.116602+0000","last_fullsized":"2024-09-12T18:36:40.116602+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:02.999068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":81,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.057199+0000","last_change":"2024-09-12T18:36:39.071809+0000","last_active":"2024-09-12T18:36:40.057199+0000","last_peered":"2024-09-12T18:36:40.057199+0000","last_clean":"2024-09-12T18:36:40.057199+0000","last_became_active":"2024-09-12T18:36:39.070888+0000","last_became_peered":"2024-09-12T18:36:39.070888+0000","last_unstale":"2024-09-12T18:36:40.057199+0000","last_undegraded":"2024-09-12T18:36:40.057199+0000","last_fullsized":"2024-09-12T18:36:40.057199+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:19.740732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"50'7665","reported_seq":7732,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:41.480441+0000","last_change":"2024-09-12T18:35:44.767970+0000","last_active":"2024-09-12T18:36:41.480441+0000","last_peered":"2024-09-12T18:36:41.480441+0000","last_clean":"2024-09-12T18:36:41.480441+0000","last_became_active":"2024-09-12T18:35:44.767348+0000","last_became_peered":"2024-09-12T18:35:44.767348+0000","last_unstale":"2024-09-12T18:36:41.480441+0000","last_undegraded":"2024-09-12T18:36:41.480441+0000","last_fullsized":"2024-09-12T18:36:41.480441+0000","mapping_epoch":21,"log_start":"35'3900","ondisk_log_start":"35'3900","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3765,"log_dups_size":0,"ondisk_log_size":3765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:48.745907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502333440,"num_objects":7665,"num_object_clones":0,"num_object_copies":15330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7665,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7665,"num_write_kb":490560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":77,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.056171+0000","last_change":"2024-09-12T18:35:24.659019+0000","last_active":"2024-09-12T18:36:40.056171+0000","last_peered":"2024-09-12T18:36:40.056171+0000","last_clean":"2024-09-12T18:36:40.056171+0000","last_became_active":"2024-09-12T18:35:24.658423+0000","last_became_peered":"2024-09-12T18:35:24.658423+0000","last_unstale":"2024-09-12T18:36:40.056171+0000","last_undegraded":"2024-09-12T18:36:40.056171+0000","last_fullsized":"2024-09-12T18:36:40.056171+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:37.668417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":75,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.056699+0000","last_change":"2024-09-12T18:35:25.662287+0000","last_active":"2024-09-12T18:36:40.056699+0000","last_peered":"2024-09-12T18:36:40.056699+0000","last_clean":"2024-09-12T18:36:40.056699+0000","last_became_active":"2024-09-12T18:35:25.660372+0000","last_became_peered":"2024-09-12T18:35:25.660372+0000","last_unstale":"2024-09-12T18:36:40.056699+0000","last_undegraded":"2024-09-12T18:36:40.056699+0000","last_fullsized":"2024-09-12T18:36:40.056699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:08.729541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.f","version":"50'7626","reported_seq":7693,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:41.495401+0000","last_change":"2024-09-12T18:35:44.774817+0000","last_active":"2024-09-12T18:36:41.495401+0000","last_peered":"2024-09-12T18:36:41.495401+0000","last_clean":"2024-09-12T18:36:41.495401+0000","last_became_active":"2024-09-12T18:35:44.774429+0000","last_became_peered":"2024-09-12T18:35:44.774429+0000","last_unstale":"2024-09-12T18:36:41.495401+0000","last_undegraded":"2024-09-12T18:36:41.495401+0000","last_fullsized":"2024-09-12T18:36:41.495401+0000","mapping_epoch":21,"log_start":"37'4524","ondisk_log_start":"37'4524","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3102,"log_dups_size":0,"ondisk_log_size":3102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:21.579103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":499777536,"num_objects":7626,"num_object_clones":0,"num_object_copies":15252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7626,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7626,"num_write_kb":488064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":79,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.078518+0000","last_change":"2024-09-12T18:35:24.648330+0000","last_active":"2024-09-12T18:36:42.078518+0000","last_peered":"2024-09-12T18:36:42.078518+0000","last_clean":"2024-09-12T18:36:42.078518+0000","last_became_active":"2024-09-12T18:35:24.647520+0000","last_became_peered":"2024-09-12T18:35:24.647520+0000","last_unstale":"2024-09-12T18:36:42.078518+0000","last_undegraded":"2024-09-12T18:36:42.078518+0000","last_fullsized":"2024-09-12T18:36:42.078518+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:25.552055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":75,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.057852+0000","last_change":"2024-09-12T18:35:25.658674+0000","last_active":"2024-09-12T18:36:40.057852+0000","last_peered":"2024-09-12T18:36:40.057852+0000","last_clean":"2024-09-12T18:36:40.057852+0000","last_became_active":"2024-09-12T18:35:25.657386+0000","last_became_peered":"2024-09-12T18:35:25.657386+0000","last_unstale":"2024-09-12T18:36:40.057852+0000","last_undegraded":"2024-09-12T18:36:40.057852+0000","last_fullsized":"2024-09-12T18:36:40.057852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:48.037086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"51'8076","reported_seq":8145,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:43.494376+0000","last_change":"2024-09-12T18:35:44.771738+0000","last_active":"2024-09-12T18:36:43.494376+0000","last_peered":"2024-09-12T18:36:43.494376+0000","last_clean":"2024-09-12T18:36:43.494376+0000","last_became_active":"2024-09-12T18:35:44.771227+0000","last_became_peered":"2024-09-12T18:35:44.771227+0000","last_unstale":"2024-09-12T18:36:43.494376+0000","last_undegraded":"2024-09-12T18:36:43.494376+0000","last_fullsized":"2024-09-12T18:36:43.494376+0000","mapping_epoch":21,"log_start":"38'4793","ondisk_log_start":"38'4793","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3283,"log_dups_size":0,"ondisk_log_size":3283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:27.329732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":529268736,"num_objects":8076,"num_object_clones":0,"num_object_copies":16152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8076,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8076,"num_write_kb":516864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":79,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.078230+0000","last_change":"2024-09-12T18:35:24.646810+0000","last_active":"2024-09-12T18:36:42.078230+0000","last_peered":"2024-09-12T18:36:42.078230+0000","last_clean":"2024-09-12T18:36:42.078230+0000","last_became_active":"2024-09-12T18:35:24.646008+0000","last_became_peered":"2024-09-12T18:35:24.646008+0000","last_unstale":"2024-09-12T18:36:42.078230+0000","last_undegraded":"2024-09-12T18:36:42.078230+0000","last_fullsized":"2024-09-12T18:36:42.078230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:43.888776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":75,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.061788+0000","last_change":"2024-09-12T18:35:25.667710+0000","last_active":"2024-09-12T18:36:40.061788+0000","last_peered":"2024-09-12T18:36:40.061788+0000","last_clean":"2024-09-12T18:36:40.061788+0000","last_became_active":"2024-09-12T18:35:25.666940+0000","last_became_peered":"2024-09-12T18:35:25.666940+0000","last_unstale":"2024-09-12T18:36:40.061788+0000","last_undegraded":"2024-09-12T18:36:40.061788+0000","last_fullsized":"2024-09-12T18:36:40.061788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:09.823085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"51'7897","reported_seq":7965,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:43.506246+0000","last_change":"2024-09-12T18:35:44.769127+0000","last_active":"2024-09-12T18:36:43.506246+0000","last_peered":"2024-09-12T18:36:43.506246+0000","last_clean":"2024-09-12T18:36:43.506246+0000","last_became_active":"2024-09-12T18:35:44.768382+0000","last_became_peered":"2024-09-12T18:35:44.768382+0000","last_unstale":"2024-09-12T18:36:43.506246+0000","last_undegraded":"2024-09-12T18:36:43.506246+0000","last_fullsized":"2024-09-12T18:36:43.506246+0000","mapping_epoch":21,"log_start":"38'4629","ondisk_log_start":"38'4629","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3268,"log_dups_size":0,"ondisk_log_size":3268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:33.385476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":517537792,"num_objects":7897,"num_object_clones":0,"num_object_copies":15794,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7897,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7897,"num_write_kb":505408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":227,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.056343+0000","last_change":"2024-09-12T18:35:13.489018+0000","last_active":"2024-09-12T18:36:40.056343+0000","last_peered":"2024-09-12T18:36:40.056343+0000","last_clean":"2024-09-12T18:36:40.056343+0000","last_became_active":"2024-09-12T18:35:13.488346+0000","last_became_peered":"2024-09-12T18:35:13.488346+0000","last_unstale":"2024-09-12T18:36:40.056343+0000","last_undegraded":"2024-09-12T18:36:40.056343+0000","last_fullsized":"2024-09-12T18:36:40.056343+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_clean_scrub_stamp":"2024-09-12T18:35:12.464628+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:54.864640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":91,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.056556+0000","last_change":"2024-09-12T18:35:22.459694+0000","last_active":"2024-09-12T18:36:40.056556+0000","last_peered":"2024-09-12T18:36:40.056556+0000","last_clean":"2024-09-12T18:36:40.056556+0000","last_became_active":"2024-09-12T18:35:20.446796+0000","last_became_peered":"2024-09-12T18:35:20.446796+0000","last_unstale":"2024-09-12T18:36:40.056556+0000","last_undegraded":"2024-09-12T18:36:40.056556+0000","last_fullsized":"2024-09-12T18:36:40.056556+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:21.506024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016291610000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.079896+0000","last_change":"2024-09-12T18:36:39.072775+0000","last_active":"2024-09-12T18:36:42.079896+0000","last_peered":"2024-09-12T18:36:42.079896+0000","last_clean":"2024-09-12T18:36:42.079896+0000","last_became_active":"2024-09-12T18:36:39.072247+0000","last_became_peered":"2024-09-12T18:36:39.072247+0000","last_unstale":"2024-09-12T18:36:42.079896+0000","last_undegraded":"2024-09-12T18:36:42.079896+0000","last_fullsized":"2024-09-12T18:36:42.079896+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:07.105080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":75,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.056982+0000","last_change":"2024-09-12T18:35:25.662424+0000","last_active":"2024-09-12T18:36:40.056982+0000","last_peered":"2024-09-12T18:36:40.056982+0000","last_clean":"2024-09-12T18:36:40.056982+0000","last_became_active":"2024-09-12T18:35:25.661043+0000","last_became_peered":"2024-09-12T18:35:25.661043+0000","last_unstale":"2024-09-12T18:36:40.056982+0000","last_undegraded":"2024-09-12T18:36:40.056982+0000","last_fullsized":"2024-09-12T18:36:40.056982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:52.551802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.7","version":"50'7775","reported_seq":7842,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:41.486100+0000","last_change":"2024-09-12T18:35:44.774505+0000","last_active":"2024-09-12T18:36:41.486100+0000","last_peered":"2024-09-12T18:36:41.486100+0000","last_clean":"2024-09-12T18:36:41.486100+0000","last_became_active":"2024-09-12T18:35:44.774259+0000","last_became_peered":"2024-09-12T18:35:44.774259+0000","last_unstale":"2024-09-12T18:36:41.486100+0000","last_undegraded":"2024-09-12T18:36:41.486100+0000","last_fullsized":"2024-09-12T18:36:41.486100+0000","mapping_epoch":21,"log_start":"38'4669","ondisk_log_start":"38'4669","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3106,"log_dups_size":0,"ondisk_log_size":3106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:21.731670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":509542400,"num_objects":7775,"num_object_clones":0,"num_object_copies":15550,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7775,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7775,"num_write_kb":497600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":90,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.055800+0000","last_change":"2024-09-12T18:35:22.459090+0000","last_active":"2024-09-12T18:36:40.055800+0000","last_peered":"2024-09-12T18:36:40.055800+0000","last_clean":"2024-09-12T18:36:40.055800+0000","last_became_active":"2024-09-12T18:35:20.448553+0000","last_became_peered":"2024-09-12T18:35:20.448553+0000","last_unstale":"2024-09-12T18:36:40.055800+0000","last_undegraded":"2024-09-12T18:36:40.055800+0000","last_fullsized":"2024-09-12T18:36:40.055800+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:56.834808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001030836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":77,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.060167+0000","last_change":"2024-09-12T18:35:24.651597+0000","last_active":"2024-09-12T18:36:40.060167+0000","last_peered":"2024-09-12T18:36:40.060167+0000","last_clean":"2024-09-12T18:36:40.060167+0000","last_became_active":"2024-09-12T18:35:24.649940+0000","last_became_peered":"2024-09-12T18:35:24.649940+0000","last_unstale":"2024-09-12T18:36:40.060167+0000","last_undegraded":"2024-09-12T18:36:40.060167+0000","last_fullsized":"2024-09-12T18:36:40.060167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:36.822432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":83,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.078955+0000","last_change":"2024-09-12T18:36:39.076901+0000","last_active":"2024-09-12T18:36:42.078955+0000","last_peered":"2024-09-12T18:36:42.078955+0000","last_clean":"2024-09-12T18:36:42.078955+0000","last_became_active":"2024-09-12T18:36:39.076178+0000","last_became_peered":"2024-09-12T18:36:39.076178+0000","last_unstale":"2024-09-12T18:36:42.078955+0000","last_undegraded":"2024-09-12T18:36:42.078955+0000","last_fullsized":"2024-09-12T18:36:42.078955+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:42.901643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"50'7707","reported_seq":7774,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:41.474169+0000","last_change":"2024-09-12T18:35:44.770379+0000","last_active":"2024-09-12T18:36:41.474169+0000","last_peered":"2024-09-12T18:36:41.474169+0000","last_clean":"2024-09-12T18:36:41.474169+0000","last_became_active":"2024-09-12T18:35:44.769739+0000","last_became_peered":"2024-09-12T18:35:44.769739+0000","last_unstale":"2024-09-12T18:36:41.474169+0000","last_undegraded":"2024-09-12T18:36:41.474169+0000","last_fullsized":"2024-09-12T18:36:41.474169+0000","mapping_epoch":21,"log_start":"35'4000","ondisk_log_start":"35'4000","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3707,"log_dups_size":0,"ondisk_log_size":3707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:02:23.077263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505085952,"num_objects":7707,"num_object_clones":0,"num_object_copies":15414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7707,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7707,"num_write_kb":493248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":90,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.060374+0000","last_change":"2024-09-12T18:35:22.464179+0000","last_active":"2024-09-12T18:36:40.060374+0000","last_peered":"2024-09-12T18:36:40.060374+0000","last_clean":"2024-09-12T18:36:40.060374+0000","last_became_active":"2024-09-12T18:35:20.442613+0000","last_became_peered":"2024-09-12T18:35:20.442613+0000","last_unstale":"2024-09-12T18:36:40.060374+0000","last_undegraded":"2024-09-12T18:36:40.060374+0000","last_fullsized":"2024-09-12T18:36:40.060374+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:17.636537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014134620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":79,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.078139+0000","last_change":"2024-09-12T18:35:24.641297+0000","last_active":"2024-09-12T18:36:42.078139+0000","last_peered":"2024-09-12T18:36:42.078139+0000","last_clean":"2024-09-12T18:36:42.078139+0000","last_became_active":"2024-09-12T18:35:24.637334+0000","last_became_peered":"2024-09-12T18:35:24.637334+0000","last_unstale":"2024-09-12T18:36:42.078139+0000","last_undegraded":"2024-09-12T18:36:42.078139+0000","last_fullsized":"2024-09-12T18:36:42.078139+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:50.772074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.080780+0000","last_change":"2024-09-12T18:36:40.073534+0000","last_active":"2024-09-12T18:36:42.080780+0000","last_peered":"2024-09-12T18:36:42.080780+0000","last_clean":"2024-09-12T18:36:42.080780+0000","last_became_active":"2024-09-12T18:36:40.071694+0000","last_became_peered":"2024-09-12T18:36:40.071694+0000","last_unstale":"2024-09-12T18:36:42.080780+0000","last_undegraded":"2024-09-12T18:36:42.080780+0000","last_fullsized":"2024-09-12T18:36:42.080780+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:16.018454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"50'7817","reported_seq":7885,"reported_epoch":50,"state":"active+remapped+backfill_wait","last_fresh":"2024-09-12T18:36:41.501420+0000","last_change":"2024-09-12T18:36:40.237669+0000","last_active":"2024-09-12T18:36:41.501420+0000","last_peered":"2024-09-12T18:36:41.501420+0000","last_clean":"2024-09-12T18:36:38.032256+0000","last_became_active":"2024-09-12T18:36:40.219923+0000","last_became_peered":"2024-09-12T18:36:40.219923+0000","last_unstale":"2024-09-12T18:36:41.501420+0000","last_undegraded":"2024-09-12T18:36:41.501420+0000","last_fullsized":"2024-09-12T18:36:41.501420+0000","mapping_epoch":49,"log_start":"38'4724","ondisk_log_start":"38'4724","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3093,"log_dups_size":0,"ondisk_log_size":3093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":512294912,"num_objects":7817,"num_object_clones":0,"num_object_copies":15634,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":7817,"num_objects_unfound":0,"num_objects_dirty":7817,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7817,"num_write_kb":500288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[{"shards":"0,2","objects":7817}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":92,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.056233+0000","last_change":"2024-09-12T18:35:22.459049+0000","last_active":"2024-09-12T18:36:40.056233+0000","last_peered":"2024-09-12T18:36:40.056233+0000","last_clean":"2024-09-12T18:36:40.056233+0000","last_became_active":"2024-09-12T18:35:20.446814+0000","last_became_peered":"2024-09-12T18:35:20.446814+0000","last_unstale":"2024-09-12T18:36:40.056233+0000","last_undegraded":"2024-09-12T18:36:40.056233+0000","last_fullsized":"2024-09-12T18:36:40.056233+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:18.033595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010716149999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":77,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.056448+0000","last_change":"2024-09-12T18:35:24.658273+0000","last_active":"2024-09-12T18:36:40.056448+0000","last_peered":"2024-09-12T18:36:40.056448+0000","last_clean":"2024-09-12T18:36:40.056448+0000","last_became_active":"2024-09-12T18:35:24.657433+0000","last_became_peered":"2024-09-12T18:35:24.657433+0000","last_unstale":"2024-09-12T18:36:40.056448+0000","last_undegraded":"2024-09-12T18:36:40.056448+0000","last_fullsized":"2024-09-12T18:36:40.056448+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:48.497218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.079857+0000","last_change":"2024-09-12T18:36:40.076054+0000","last_active":"2024-09-12T18:36:42.079857+0000","last_peered":"2024-09-12T18:36:42.079857+0000","last_clean":"2024-09-12T18:36:42.079857+0000","last_became_active":"2024-09-12T18:36:40.073803+0000","last_became_peered":"2024-09-12T18:36:40.073803+0000","last_unstale":"2024-09-12T18:36:42.079857+0000","last_undegraded":"2024-09-12T18:36:42.079857+0000","last_fullsized":"2024-09-12T18:36:42.079857+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:49.085420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"50'7589","reported_seq":7656,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:41.470751+0000","last_change":"2024-09-12T18:35:44.770799+0000","last_active":"2024-09-12T18:36:41.470751+0000","last_peered":"2024-09-12T18:36:41.470751+0000","last_clean":"2024-09-12T18:36:41.470751+0000","last_became_active":"2024-09-12T18:35:44.770030+0000","last_became_peered":"2024-09-12T18:35:44.770030+0000","last_unstale":"2024-09-12T18:36:41.470751+0000","last_undegraded":"2024-09-12T18:36:41.470751+0000","last_fullsized":"2024-09-12T18:36:41.470751+0000","mapping_epoch":21,"log_start":"36'3900","ondisk_log_start":"36'3900","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3689,"log_dups_size":0,"ondisk_log_size":3689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:24.786452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":497352704,"num_objects":7589,"num_object_clones":0,"num_object_copies":15178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7589,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7589,"num_write_kb":485696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":77,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.055965+0000","last_change":"2024-09-12T18:35:24.657618+0000","last_active":"2024-09-12T18:36:40.055965+0000","last_peered":"2024-09-12T18:36:40.055965+0000","last_clean":"2024-09-12T18:36:40.055965+0000","last_became_active":"2024-09-12T18:35:24.656741+0000","last_became_peered":"2024-09-12T18:35:24.656741+0000","last_unstale":"2024-09-12T18:36:40.055965+0000","last_undegraded":"2024-09-12T18:36:40.055965+0000","last_fullsized":"2024-09-12T18:36:40.055965+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:43.113104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":90,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.061446+0000","last_change":"2024-09-12T18:35:22.464180+0000","last_active":"2024-09-12T18:36:40.061446+0000","last_peered":"2024-09-12T18:36:40.061446+0000","last_clean":"2024-09-12T18:36:40.061446+0000","last_became_active":"2024-09-12T18:35:20.442566+0000","last_became_peered":"2024-09-12T18:35:20.442566+0000","last_unstale":"2024-09-12T18:36:40.061446+0000","last_undegraded":"2024-09-12T18:36:40.061446+0000","last_fullsized":"2024-09-12T18:36:40.061446+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:29.021710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001325786,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":77,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.080070+0000","last_change":"2024-09-12T18:35:25.650458+0000","last_active":"2024-09-12T18:36:42.080070+0000","last_peered":"2024-09-12T18:36:42.080070+0000","last_clean":"2024-09-12T18:36:42.080070+0000","last_became_active":"2024-09-12T18:35:25.648761+0000","last_became_peered":"2024-09-12T18:35:25.648761+0000","last_unstale":"2024-09-12T18:36:42.080070+0000","last_undegraded":"2024-09-12T18:36:42.080070+0000","last_fullsized":"2024-09-12T18:36:42.080070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:53.026950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"50'7668","reported_seq":7735,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:41.488951+0000","last_change":"2024-09-12T18:35:44.773801+0000","last_active":"2024-09-12T18:36:41.488951+0000","last_peered":"2024-09-12T18:36:41.488951+0000","last_clean":"2024-09-12T18:36:41.488951+0000","last_became_active":"2024-09-12T18:35:44.772787+0000","last_became_peered":"2024-09-12T18:35:44.772787+0000","last_unstale":"2024-09-12T18:36:41.488951+0000","last_undegraded":"2024-09-12T18:36:41.488951+0000","last_fullsized":"2024-09-12T18:36:41.488951+0000","mapping_epoch":21,"log_start":"37'4582","ondisk_log_start":"37'4582","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3086,"log_dups_size":0,"ondisk_log_size":3086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:13.758208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502530048,"num_objects":7668,"num_object_clones":0,"num_object_copies":15336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7668,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7668,"num_write_kb":490752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.080031+0000","last_change":"2024-09-12T18:36:40.076936+0000","last_active":"2024-09-12T18:36:42.080031+0000","last_peered":"2024-09-12T18:36:42.080031+0000","last_clean":"2024-09-12T18:36:42.080031+0000","last_became_active":"2024-09-12T18:36:40.075987+0000","last_became_peered":"2024-09-12T18:36:40.075987+0000","last_unstale":"2024-09-12T18:36:42.080031+0000","last_undegraded":"2024-09-12T18:36:42.080031+0000","last_fullsized":"2024-09-12T18:36:42.080031+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:31.242588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":98,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.079429+0000","last_change":"2024-09-12T18:36:40.107062+0000","last_active":"2024-09-12T18:36:42.079429+0000","last_peered":"2024-09-12T18:36:42.079429+0000","last_clean":"2024-09-12T18:36:42.079429+0000","last_became_active":"2024-09-12T18:36:40.106366+0000","last_became_peered":"2024-09-12T18:36:40.106366+0000","last_unstale":"2024-09-12T18:36:42.079429+0000","last_undegraded":"2024-09-12T18:36:42.079429+0000","last_fullsized":"2024-09-12T18:36:42.079429+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:43.504139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080163599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":77,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.078523+0000","last_change":"2024-09-12T18:35:25.650717+0000","last_active":"2024-09-12T18:36:42.078523+0000","last_peered":"2024-09-12T18:36:42.078523+0000","last_clean":"2024-09-12T18:36:42.078523+0000","last_became_active":"2024-09-12T18:35:25.649147+0000","last_became_peered":"2024-09-12T18:35:25.649147+0000","last_unstale":"2024-09-12T18:36:42.078523+0000","last_undegraded":"2024-09-12T18:36:42.078523+0000","last_fullsized":"2024-09-12T18:36:42.078523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:07.365888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"50'7696","reported_seq":8186,"reported_epoch":50,"state":"active+remapped+backfilling","last_fresh":"2024-09-12T18:36:41.497470+0000","last_change":"2024-09-12T18:36:40.227197+0000","last_active":"2024-09-12T18:36:41.497470+0000","last_peered":"2024-09-12T18:36:41.497470+0000","last_clean":"2024-09-12T18:36:38.046067+0000","last_became_active":"2024-09-12T18:36:40.197657+0000","last_became_peered":"2024-09-12T18:36:40.197657+0000","last_unstale":"2024-09-12T18:36:41.497470+0000","last_undegraded":"2024-09-12T18:36:41.497470+0000","last_fullsized":"2024-09-12T18:36:41.497470+0000","mapping_epoch":49,"log_start":"37'4601","ondisk_log_start":"37'4601","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3095,"log_dups_size":0,"ondisk_log_size":3095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":504365056,"num_objects":7696,"num_object_clones":0,"num_object_copies":15392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":7483,"num_objects_unfound":0,"num_objects_dirty":7696,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7696,"num_write_kb":492544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":210,"num_bytes_recovered":13762560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[{"shards":"0,2","objects":7696}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":79,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.062570+0000","last_change":"2024-09-12T18:35:24.657234+0000","last_active":"2024-09-12T18:36:40.062570+0000","last_peered":"2024-09-12T18:36:40.062570+0000","last_clean":"2024-09-12T18:36:40.062570+0000","last_became_active":"2024-09-12T18:35:24.655950+0000","last_became_peered":"2024-09-12T18:35:24.655950+0000","last_unstale":"2024-09-12T18:36:40.062570+0000","last_undegraded":"2024-09-12T18:36:40.062570+0000","last_fullsized":"2024-09-12T18:36:40.062570+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:17.466623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.079113+0000","last_change":"2024-09-12T18:36:40.076943+0000","last_active":"2024-09-12T18:36:42.079113+0000","last_peered":"2024-09-12T18:36:42.079113+0000","last_clean":"2024-09-12T18:36:42.079113+0000","last_became_active":"2024-09-12T18:36:40.075968+0000","last_became_peered":"2024-09-12T18:36:40.075968+0000","last_unstale":"2024-09-12T18:36:42.079113+0000","last_undegraded":"2024-09-12T18:36:42.079113+0000","last_fullsized":"2024-09-12T18:36:42.079113+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:41.716022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.054413+0000","last_change":"2024-09-12T18:36:39.071682+0000","last_active":"2024-09-12T18:36:40.054413+0000","last_peered":"2024-09-12T18:36:40.054413+0000","last_clean":"2024-09-12T18:36:40.054413+0000","last_became_active":"2024-09-12T18:36:39.070834+0000","last_became_peered":"2024-09-12T18:36:39.070834+0000","last_unstale":"2024-09-12T18:36:40.054413+0000","last_undegraded":"2024-09-12T18:36:40.054413+0000","last_fullsized":"2024-09-12T18:36:40.054413+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:58.394442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"51'8039","reported_seq":9223,"reported_epoch":51,"state":"active+remapped+backfilling","last_fresh":"2024-09-12T18:36:43.509312+0000","last_change":"2024-09-12T18:36:40.210823+0000","last_active":"2024-09-12T18:36:43.509312+0000","last_peered":"2024-09-12T18:36:43.509312+0000","last_clean":"2024-09-12T18:36:38.043464+0000","last_became_active":"2024-09-12T18:36:40.156565+0000","last_became_peered":"2024-09-12T18:36:40.156565+0000","last_unstale":"2024-09-12T18:36:43.509312+0000","last_undegraded":"2024-09-12T18:36:43.509312+0000","last_fullsized":"2024-09-12T18:36:43.509312+0000","mapping_epoch":49,"log_start":"38'4828","ondisk_log_start":"38'4828","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3211,"log_dups_size":0,"ondisk_log_size":3211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526843904,"num_objects":8039,"num_object_clones":0,"num_object_copies":16078,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":7474,"num_objects_unfound":0,"num_objects_dirty":8039,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8039,"num_write_kb":514496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":554,"num_bytes_recovered":36306944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":8039}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":30,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.123976+0000","last_change":"2024-09-12T18:36:40.122885+0000","last_active":"2024-09-12T18:36:40.123976+0000","last_peered":"2024-09-12T18:36:40.123976+0000","last_clean":"2024-09-12T18:36:40.123976+0000","last_became_active":"2024-09-12T18:36:40.090372+0000","last_became_peered":"2024-09-12T18:36:40.090372+0000","last_unstale":"2024-09-12T18:36:40.123976+0000","last_undegraded":"2024-09-12T18:36:40.123976+0000","last_fullsized":"2024-09-12T18:36:40.123976+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:55.648109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":90,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.060390+0000","last_change":"2024-09-12T18:35:22.459767+0000","last_active":"2024-09-12T18:36:40.060390+0000","last_peered":"2024-09-12T18:36:40.060390+0000","last_clean":"2024-09-12T18:36:40.060390+0000","last_became_active":"2024-09-12T18:35:20.448521+0000","last_became_peered":"2024-09-12T18:35:20.448521+0000","last_unstale":"2024-09-12T18:36:40.060390+0000","last_undegraded":"2024-09-12T18:36:40.060390+0000","last_fullsized":"2024-09-12T18:36:40.060390+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:33.463792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017009670000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":77,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.078319+0000","last_change":"2024-09-12T18:35:25.648150+0000","last_active":"2024-09-12T18:36:42.078319+0000","last_peered":"2024-09-12T18:36:42.078319+0000","last_clean":"2024-09-12T18:36:42.078319+0000","last_became_active":"2024-09-12T18:35:25.647347+0000","last_became_peered":"2024-09-12T18:35:25.647347+0000","last_unstale":"2024-09-12T18:36:42.078319+0000","last_undegraded":"2024-09-12T18:36:42.078319+0000","last_fullsized":"2024-09-12T18:36:42.078319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:48.968336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":75,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.055921+0000","last_change":"2024-09-12T18:35:25.660696+0000","last_active":"2024-09-12T18:36:40.055921+0000","last_peered":"2024-09-12T18:36:40.055921+0000","last_clean":"2024-09-12T18:36:40.055921+0000","last_became_active":"2024-09-12T18:35:25.659827+0000","last_became_peered":"2024-09-12T18:35:25.659827+0000","last_unstale":"2024-09-12T18:36:40.055921+0000","last_undegraded":"2024-09-12T18:36:40.055921+0000","last_fullsized":"2024-09-12T18:36:40.055921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:15.678289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":83,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.057343+0000","last_change":"2024-09-12T18:35:24.655051+0000","last_active":"2024-09-12T18:36:40.057343+0000","last_peered":"2024-09-12T18:36:40.057343+0000","last_clean":"2024-09-12T18:36:40.057343+0000","last_became_active":"2024-09-12T18:35:24.654282+0000","last_became_peered":"2024-09-12T18:35:24.654282+0000","last_unstale":"2024-09-12T18:36:40.057343+0000","last_undegraded":"2024-09-12T18:36:40.057343+0000","last_fullsized":"2024-09-12T18:36:40.057343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:08.159799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.078062+0000","last_change":"2024-09-12T18:36:40.073370+0000","last_active":"2024-09-12T18:36:42.078062+0000","last_peered":"2024-09-12T18:36:42.078062+0000","last_clean":"2024-09-12T18:36:42.078062+0000","last_became_active":"2024-09-12T18:36:40.071392+0000","last_became_peered":"2024-09-12T18:36:40.071392+0000","last_unstale":"2024-09-12T18:36:42.078062+0000","last_undegraded":"2024-09-12T18:36:42.078062+0000","last_fullsized":"2024-09-12T18:36:42.078062+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:32:33.237004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":82,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.079504+0000","last_change":"2024-09-12T18:35:24.648658+0000","last_active":"2024-09-12T18:36:42.079504+0000","last_peered":"2024-09-12T18:36:42.079504+0000","last_clean":"2024-09-12T18:36:42.079504+0000","last_became_active":"2024-09-12T18:35:24.647826+0000","last_became_peered":"2024-09-12T18:35:24.647826+0000","last_unstale":"2024-09-12T18:36:42.079504+0000","last_undegraded":"2024-09-12T18:36:42.079504+0000","last_fullsized":"2024-09-12T18:36:42.079504+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:24.167549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":83,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.091307+0000","last_change":"2024-09-12T18:36:40.091223+0000","last_active":"2024-09-12T18:36:40.091307+0000","last_peered":"2024-09-12T18:36:40.091307+0000","last_clean":"2024-09-12T18:36:40.091307+0000","last_became_active":"2024-09-12T18:36:40.090813+0000","last_became_peered":"2024-09-12T18:36:40.090813+0000","last_unstale":"2024-09-12T18:36:40.091307+0000","last_undegraded":"2024-09-12T18:36:40.091307+0000","last_fullsized":"2024-09-12T18:36:40.091307+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:26.055034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":75,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.059862+0000","last_change":"2024-09-12T18:35:25.661801+0000","last_active":"2024-09-12T18:36:40.059862+0000","last_peered":"2024-09-12T18:36:40.059862+0000","last_clean":"2024-09-12T18:36:40.059862+0000","last_became_active":"2024-09-12T18:35:25.658476+0000","last_became_peered":"2024-09-12T18:35:25.658476+0000","last_unstale":"2024-09-12T18:36:40.059862+0000","last_undegraded":"2024-09-12T18:36:40.059862+0000","last_fullsized":"2024-09-12T18:36:40.059862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:58.246449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":77,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.062293+0000","last_change":"2024-09-12T18:35:24.652399+0000","last_active":"2024-09-12T18:36:40.062293+0000","last_peered":"2024-09-12T18:36:40.062293+0000","last_clean":"2024-09-12T18:36:40.062293+0000","last_became_active":"2024-09-12T18:35:24.651416+0000","last_became_peered":"2024-09-12T18:35:24.651416+0000","last_unstale":"2024-09-12T18:36:40.062293+0000","last_undegraded":"2024-09-12T18:36:40.062293+0000","last_fullsized":"2024-09-12T18:36:40.062293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:32.594978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.078873+0000","last_change":"2024-09-12T18:36:39.073330+0000","last_active":"2024-09-12T18:36:42.078873+0000","last_peered":"2024-09-12T18:36:42.078873+0000","last_clean":"2024-09-12T18:36:42.078873+0000","last_became_active":"2024-09-12T18:36:39.072515+0000","last_became_peered":"2024-09-12T18:36:39.072515+0000","last_unstale":"2024-09-12T18:36:42.078873+0000","last_undegraded":"2024-09-12T18:36:42.078873+0000","last_fullsized":"2024-09-12T18:36:42.078873+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:17.697509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":77,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.080572+0000","last_change":"2024-09-12T18:35:25.651217+0000","last_active":"2024-09-12T18:36:42.080572+0000","last_peered":"2024-09-12T18:36:42.080572+0000","last_clean":"2024-09-12T18:36:42.080572+0000","last_became_active":"2024-09-12T18:35:25.649544+0000","last_became_peered":"2024-09-12T18:35:25.649544+0000","last_unstale":"2024-09-12T18:36:42.080572+0000","last_undegraded":"2024-09-12T18:36:42.080572+0000","last_fullsized":"2024-09-12T18:36:42.080572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:41.601376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.078033+0000","last_change":"2024-09-12T18:36:39.076239+0000","last_active":"2024-09-12T18:36:42.078033+0000","last_peered":"2024-09-12T18:36:42.078033+0000","last_clean":"2024-09-12T18:36:42.078033+0000","last_became_active":"2024-09-12T18:36:39.075023+0000","last_became_peered":"2024-09-12T18:36:39.075023+0000","last_unstale":"2024-09-12T18:36:42.078033+0000","last_undegraded":"2024-09-12T18:36:42.078033+0000","last_fullsized":"2024-09-12T18:36:42.078033+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:19.618576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":75,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.061635+0000","last_change":"2024-09-12T18:35:25.661544+0000","last_active":"2024-09-12T18:36:40.061635+0000","last_peered":"2024-09-12T18:36:40.061635+0000","last_clean":"2024-09-12T18:36:40.061635+0000","last_became_active":"2024-09-12T18:35:25.656985+0000","last_became_peered":"2024-09-12T18:35:25.656985+0000","last_unstale":"2024-09-12T18:36:40.061635+0000","last_undegraded":"2024-09-12T18:36:40.061635+0000","last_fullsized":"2024-09-12T18:36:40.061635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.054991+0000","last_change":"2024-09-12T18:36:39.073200+0000","last_active":"2024-09-12T18:36:40.054991+0000","last_peered":"2024-09-12T18:36:40.054991+0000","last_clean":"2024-09-12T18:36:40.054991+0000","last_became_active":"2024-09-12T18:36:39.072553+0000","last_became_peered":"2024-09-12T18:36:39.072553+0000","last_unstale":"2024-09-12T18:36:40.054991+0000","last_undegraded":"2024-09-12T18:36:40.054991+0000","last_fullsized":"2024-09-12T18:36:40.054991+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:02.283482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":77,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.079718+0000","last_change":"2024-09-12T18:35:25.656712+0000","last_active":"2024-09-12T18:36:42.079718+0000","last_peered":"2024-09-12T18:36:42.079718+0000","last_clean":"2024-09-12T18:36:42.079718+0000","last_became_active":"2024-09-12T18:35:25.654473+0000","last_became_peered":"2024-09-12T18:35:25.654473+0000","last_unstale":"2024-09-12T18:36:42.079718+0000","last_undegraded":"2024-09-12T18:36:42.079718+0000","last_fullsized":"2024-09-12T18:36:42.079718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:01.464680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":80,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.080235+0000","last_change":"2024-09-12T18:35:24.659935+0000","last_active":"2024-09-12T18:36:42.080235+0000","last_peered":"2024-09-12T18:36:42.080235+0000","last_clean":"2024-09-12T18:36:42.080235+0000","last_became_active":"2024-09-12T18:35:24.659111+0000","last_became_peered":"2024-09-12T18:35:24.659111+0000","last_unstale":"2024-09-12T18:36:42.080235+0000","last_undegraded":"2024-09-12T18:36:42.080235+0000","last_fullsized":"2024-09-12T18:36:42.080235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:11.480154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":83,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.080133+0000","last_change":"2024-09-12T18:36:39.076804+0000","last_active":"2024-09-12T18:36:42.080133+0000","last_peered":"2024-09-12T18:36:42.080133+0000","last_clean":"2024-09-12T18:36:42.080133+0000","last_became_active":"2024-09-12T18:36:39.075916+0000","last_became_peered":"2024-09-12T18:36:39.075916+0000","last_unstale":"2024-09-12T18:36:42.080133+0000","last_undegraded":"2024-09-12T18:36:42.080133+0000","last_fullsized":"2024-09-12T18:36:42.080133+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:36.280719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":80,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.078698+0000","last_change":"2024-09-12T18:35:24.638538+0000","last_active":"2024-09-12T18:36:42.078698+0000","last_peered":"2024-09-12T18:36:42.078698+0000","last_clean":"2024-09-12T18:36:42.078698+0000","last_became_active":"2024-09-12T18:35:24.637242+0000","last_became_peered":"2024-09-12T18:35:24.637242+0000","last_unstale":"2024-09-12T18:36:42.078698+0000","last_undegraded":"2024-09-12T18:36:42.078698+0000","last_fullsized":"2024-09-12T18:36:42.078698+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:26.877441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":75,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.055797+0000","last_change":"2024-09-12T18:35:25.662537+0000","last_active":"2024-09-12T18:36:40.055797+0000","last_peered":"2024-09-12T18:36:40.055797+0000","last_clean":"2024-09-12T18:36:40.055797+0000","last_became_active":"2024-09-12T18:35:25.661441+0000","last_became_peered":"2024-09-12T18:35:25.661441+0000","last_unstale":"2024-09-12T18:36:40.055797+0000","last_undegraded":"2024-09-12T18:36:40.055797+0000","last_fullsized":"2024-09-12T18:36:40.055797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:14.397867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":89,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.057221+0000","last_change":"2024-09-12T18:36:39.091935+0000","last_active":"2024-09-12T18:36:40.057221+0000","last_peered":"2024-09-12T18:36:40.057221+0000","last_clean":"2024-09-12T18:36:40.057221+0000","last_became_active":"2024-09-12T18:36:39.071545+0000","last_became_peered":"2024-09-12T18:36:39.071545+0000","last_unstale":"2024-09-12T18:36:40.057221+0000","last_undegraded":"2024-09-12T18:36:40.057221+0000","last_fullsized":"2024-09-12T18:36:40.057221+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:35.815126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":75,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.056039+0000","last_change":"2024-09-12T18:35:25.651406+0000","last_active":"2024-09-12T18:36:40.056039+0000","last_peered":"2024-09-12T18:36:40.056039+0000","last_clean":"2024-09-12T18:36:40.056039+0000","last_became_active":"2024-09-12T18:35:25.649728+0000","last_became_peered":"2024-09-12T18:35:25.649728+0000","last_unstale":"2024-09-12T18:36:40.056039+0000","last_undegraded":"2024-09-12T18:36:40.056039+0000","last_fullsized":"2024-09-12T18:36:40.056039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:41.773283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":81,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.079660+0000","last_change":"2024-09-12T18:35:24.649153+0000","last_active":"2024-09-12T18:36:42.079660+0000","last_peered":"2024-09-12T18:36:42.079660+0000","last_clean":"2024-09-12T18:36:42.079660+0000","last_became_active":"2024-09-12T18:35:24.648512+0000","last_became_peered":"2024-09-12T18:35:24.648512+0000","last_unstale":"2024-09-12T18:36:42.079660+0000","last_undegraded":"2024-09-12T18:36:42.079660+0000","last_fullsized":"2024-09-12T18:36:42.079660+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:07.810456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":77,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.078605+0000","last_change":"2024-09-12T18:35:25.656799+0000","last_active":"2024-09-12T18:36:42.078605+0000","last_peered":"2024-09-12T18:36:42.078605+0000","last_clean":"2024-09-12T18:36:42.078605+0000","last_became_active":"2024-09-12T18:35:25.654980+0000","last_became_peered":"2024-09-12T18:35:25.654980+0000","last_unstale":"2024-09-12T18:36:42.078605+0000","last_undegraded":"2024-09-12T18:36:42.078605+0000","last_fullsized":"2024-09-12T18:36:42.078605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:10.735439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":78,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.062455+0000","last_change":"2024-09-12T18:35:24.656268+0000","last_active":"2024-09-12T18:36:40.062455+0000","last_peered":"2024-09-12T18:36:40.062455+0000","last_clean":"2024-09-12T18:36:40.062455+0000","last_became_active":"2024-09-12T18:35:24.655420+0000","last_became_peered":"2024-09-12T18:35:24.655420+0000","last_unstale":"2024-09-12T18:36:40.062455+0000","last_undegraded":"2024-09-12T18:36:40.062455+0000","last_fullsized":"2024-09-12T18:36:40.062455+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:04.654666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":81,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.154872+0000","last_change":"2024-09-12T18:36:40.154820+0000","last_active":"2024-09-12T18:36:40.154872+0000","last_peered":"2024-09-12T18:36:40.154872+0000","last_clean":"2024-09-12T18:36:40.154872+0000","last_became_active":"2024-09-12T18:36:40.154431+0000","last_became_peered":"2024-09-12T18:36:40.154431+0000","last_unstale":"2024-09-12T18:36:40.154872+0000","last_undegraded":"2024-09-12T18:36:40.154872+0000","last_fullsized":"2024-09-12T18:36:40.154872+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:04.432378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":31,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.061011+0000","last_change":"2024-09-12T18:36:39.087685+0000","last_active":"2024-09-12T18:36:40.061011+0000","last_peered":"2024-09-12T18:36:40.061011+0000","last_clean":"2024-09-12T18:36:40.061011+0000","last_became_active":"2024-09-12T18:36:39.071493+0000","last_became_peered":"2024-09-12T18:36:39.071493+0000","last_unstale":"2024-09-12T18:36:40.061011+0000","last_undegraded":"2024-09-12T18:36:40.061011+0000","last_fullsized":"2024-09-12T18:36:40.061011+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:13.765236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":8196784128,"num_objects":125073,"num_object_clones":0,"num_object_copies":250146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":22774,"num_objects_unfound":0,"num_objects_dirty":125073,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125073,"num_write_kb":8004672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":764,"num_bytes_recovered":50069504,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1024827392,"data_stored":16397238272,"data_compressed":778675927,"data_compressed_allocated":1024827392,"data_compressed_original":16397238272,"omap_allocated":0,"internal_metadata":0},"log_size":52921,"ondisk_log_size":52921,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705685,"num_pgs":94,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":398736,"kb_used_data":287040,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":93973104,"statfs":{"total":96636764160,"available":96228458496,"internally_reserved":0,"allocated":293928960,"data_stored":4693309137,"data_compressed":222874427,"data_compressed_allocated":293326848,"data_compressed_original":4693082112,"omap_allocated":1594,"internal_metadata":114358726},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738389,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":426220,"kb_used_data":308944,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":93945620,"statfs":{"total":96636764160,"available":96200314880,"internally_reserved":0,"allocated":316358656,"data_stored":5052245198,"data_compressed":239918421,"data_compressed_allocated":315760640,"data_compressed_original":5052022784,"omap_allocated":1595,"internal_metadata":120060357},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,1,3,2,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738389,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":594492,"kb_used_data":400868,"kb_used_omap":1,"kb_used_meta":193598,"kb_avail":93777348,"statfs":{"total":96636764160,"available":96028004352,"internally_reserved":0,"allocated":410488832,"data_stored":6559242598,"data_compressed":311476149,"data_compressed_allocated":409939968,"data_compressed_original":6559039488,"omap_allocated":1594,"internal_metadata":198244806},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":411242496,"data_stored":6579879936,"data_compressed":312466083,"data_compressed_allocated":411242496,"data_compressed_original":6579879936,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":296865792,"data_stored":4749852672,"data_compressed":225563482,"data_compressed_allocated":296865792,"data_compressed_original":4749852672,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":316719104,"data_stored":5067505664,"data_compressed":240646362,"data_compressed_allocated":316719104,"data_compressed_original":5067505664,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:36:45.313 INFO:tasks.thrashosds.thrasher:Setting 4.b to [0, 2] 2024-09-12T18:36:45.313 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '4.b', '0', '2'] 2024-09-12T18:36:45.313 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 4.b 0 2 2024-09-12T18:36:45.387 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:45.382+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:45.456 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:45.456 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:36:45.456 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.456 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:131452 5.a e52/21 5:5c396fab:::benchmark_data_smithi073_23739_object131451:head v 52'8337, mlcod=52'8335)", 2024-09-12T18:36:45.456 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:45.450971+0000", 2024-09-12T18:36:45.456 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0029050500000000002, 2024-09-12T18:36:45.456 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0029296309999999998, 2024-09-12T18:36:45.456 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:45.456 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:45.457 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:45.457 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:45.457 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.457 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:45.457 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.450971+0000", 2024-09-12T18:36:45.457 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:45.457 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.457 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.457 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:45.457 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.450971+0000", 2024-09-12T18:36:45.457 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:45.457 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.457 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.458 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:45.458 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.450972+0000", 2024-09-12T18:36:45.458 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8699999999999995e-07 2024-09-12T18:36:45.458 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.458 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.458 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:45.458 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.451031+0000", 2024-09-12T18:36:45.458 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.9441000000000002e-05 2024-09-12T18:36:45.458 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.458 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.458 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:45.458 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.451043+0000", 2024-09-12T18:36:45.458 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1498000000000001e-05 2024-09-12T18:36:45.458 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.458 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.459 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:45.459 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.451048+0000", 2024-09-12T18:36:45.459 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6219999999999997e-06 2024-09-12T18:36:45.459 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.459 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.459 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:45.459 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.451098+0000", 2024-09-12T18:36:45.459 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9809999999999999e-05 2024-09-12T18:36:45.459 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.459 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.459 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:45.459 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.451122+0000", 2024-09-12T18:36:45.460 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3941e-05 2024-09-12T18:36:45.460 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:45.460 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:45.460 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:45.460 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.460 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.460 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:131450 5.e 5:7c1aeb49:::benchmark_data_smithi073_23739_object131449:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:36:45.460 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:45.451544+0000", 2024-09-12T18:36:45.460 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0023320839999999999, 2024-09-12T18:36:45.460 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002423307, 2024-09-12T18:36:45.460 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:45.461 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:45.461 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:45.461 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:45.461 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:45.461 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:45.461 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 131450 2024-09-12T18:36:45.461 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.461 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:45.461 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.461 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:45.461 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.451544+0000", 2024-09-12T18:36:45.461 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:45.461 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.461 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.462 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:45.462 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.451544+0000", 2024-09-12T18:36:45.462 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:45.462 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.462 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.462 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:45.462 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.451545+0000", 2024-09-12T18:36:45.462 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.288e-06 2024-09-12T18:36:45.462 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.462 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.462 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:45.463 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.451581+0000", 2024-09-12T18:36:45.463 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6059999999999997e-05 2024-09-12T18:36:45.463 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.463 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.463 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:45.463 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.451594+0000", 2024-09-12T18:36:45.463 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2462e-05 2024-09-12T18:36:45.463 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.463 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.463 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:45.463 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.451605+0000", 2024-09-12T18:36:45.463 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1277000000000001e-05 2024-09-12T18:36:45.463 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.464 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.464 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:45.464 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.451675+0000", 2024-09-12T18:36:45.464 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9710999999999997e-05 2024-09-12T18:36:45.464 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.464 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.464 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:45.464 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.451796+0000", 2024-09-12T18:36:45.464 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000121283 2024-09-12T18:36:45.464 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.464 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.464 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:45.465 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.451938+0000", 2024-09-12T18:36:45.465 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014201799999999999 2024-09-12T18:36:45.465 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:45.465 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:45.465 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:45.465 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.465 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.465 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:131451 5.b 5:d64426b8:::benchmark_data_smithi073_23739_object131450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:36:45.466 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:45.452306+0000", 2024-09-12T18:36:45.466 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.001569998, 2024-09-12T18:36:45.466 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0017341119999999999, 2024-09-12T18:36:45.466 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:45.466 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:45.466 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:45.466 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:45.466 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:45.466 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:45.467 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 131451 2024-09-12T18:36:45.467 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.467 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:45.467 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.467 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:45.467 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.452306+0000", 2024-09-12T18:36:45.467 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:45.467 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.467 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.467 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:45.467 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.452306+0000", 2024-09-12T18:36:45.467 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:45.467 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.467 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.468 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:45.468 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.452307+0000", 2024-09-12T18:36:45.468 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2200000000000003e-07 2024-09-12T18:36:45.468 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.468 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.468 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:45.468 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.452353+0000", 2024-09-12T18:36:45.468 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6267999999999998e-05 2024-09-12T18:36:45.468 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.468 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.468 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:45.469 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.452366+0000", 2024-09-12T18:36:45.469 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2462e-05 2024-09-12T18:36:45.469 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.469 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.469 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:45.469 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.452373+0000", 2024-09-12T18:36:45.469 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8950000000000001e-06 2024-09-12T18:36:45.469 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.469 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.469 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:45.469 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.452440+0000", 2024-09-12T18:36:45.469 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7131000000000005e-05 2024-09-12T18:36:45.470 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.470 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.470 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:45.470 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.452552+0000", 2024-09-12T18:36:45.470 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112205 2024-09-12T18:36:45.470 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.470 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.470 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:45.470 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.452682+0000", 2024-09-12T18:36:45.470 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000129715 2024-09-12T18:36:45.470 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:45.470 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:45.470 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:45.470 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.471 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.471 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:131454 5.4 5:2388d10d:::benchmark_data_smithi073_23739_object131453:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:36:45.471 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:45.452398+0000", 2024-09-12T18:36:45.471 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.001478392, 2024-09-12T18:36:45.471 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001715364, 2024-09-12T18:36:45.471 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:45.471 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:45.471 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:45.471 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:45.471 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:45.471 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:45.471 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 131454 2024-09-12T18:36:45.472 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.472 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:45.472 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.472 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:45.472 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.452398+0000", 2024-09-12T18:36:45.473 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:45.473 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.473 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.473 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:45.473 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.452398+0000", 2024-09-12T18:36:45.473 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:45.473 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.473 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.473 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:45.473 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.452398+0000", 2024-09-12T18:36:45.473 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9900000000000001e-07 2024-09-12T18:36:45.474 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.474 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.474 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:45.474 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.452448+0000", 2024-09-12T18:36:45.474 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9812999999999999e-05 2024-09-12T18:36:45.474 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.474 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.474 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:45.474 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.452457+0000", 2024-09-12T18:36:45.475 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4040000000000001e-06 2024-09-12T18:36:45.475 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.475 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.475 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:45.475 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.452463+0000", 2024-09-12T18:36:45.475 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2429999999999996e-06 2024-09-12T18:36:45.475 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.475 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.475 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:45.475 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.452529+0000", 2024-09-12T18:36:45.475 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6007999999999995e-05 2024-09-12T18:36:45.476 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.476 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.476 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:45.476 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.452648+0000", 2024-09-12T18:36:45.476 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000119257 2024-09-12T18:36:45.476 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.476 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.476 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:45.476 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.452793+0000", 2024-09-12T18:36:45.476 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014486300000000001 2024-09-12T18:36:45.476 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:45.476 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:45.476 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:45.477 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.477 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.477 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:131455 5.4 5.46d43d54 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:36:45.477 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:45.452488+0000", 2024-09-12T18:36:45.477 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0013886009999999999, 2024-09-12T18:36:45.477 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001692376, 2024-09-12T18:36:45.477 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:45.477 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:45.477 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:45.477 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:45.477 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:45.477 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:45.478 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 131455 2024-09-12T18:36:45.478 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.478 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:45.478 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.478 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:45.478 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.452488+0000", 2024-09-12T18:36:45.478 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:45.478 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.478 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.478 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:45.478 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.452488+0000", 2024-09-12T18:36:45.478 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:45.478 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.479 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.479 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:45.479 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.452488+0000", 2024-09-12T18:36:45.479 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1500000000000005e-07 2024-09-12T18:36:45.479 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.479 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.479 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:45.479 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.452533+0000", 2024-09-12T18:36:45.479 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5117000000000002e-05 2024-09-12T18:36:45.479 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.479 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.479 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:45.479 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.452540+0000", 2024-09-12T18:36:45.479 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6449999999999999e-06 2024-09-12T18:36:45.480 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.480 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.480 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:45.480 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.452545+0000", 2024-09-12T18:36:45.480 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0860000000000001e-06 2024-09-12T18:36:45.480 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:45.480 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:45.480 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:45.480 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.480 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.480 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(client.4480.0:131445 5.0 e52/49)", 2024-09-12T18:36:45.480 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:45.453463+0000", 2024-09-12T18:36:45.480 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00041331700000000001, 2024-09-12T18:36:45.480 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00076146600000000003, 2024-09-12T18:36:45.481 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:45.481 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:45.481 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:45.481 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:45.481 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.481 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:45.481 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.453463+0000", 2024-09-12T18:36:45.481 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:45.481 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.481 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.482 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:45.482 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.453463+0000", 2024-09-12T18:36:45.482 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:45.482 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.482 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.482 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:45.482 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.453464+0000", 2024-09-12T18:36:45.482 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1900000000000002e-07 2024-09-12T18:36:45.482 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.482 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.482 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:45.482 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.453468+0000", 2024-09-12T18:36:45.483 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0090000000000001e-06 2024-09-12T18:36:45.483 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.483 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.483 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:45.483 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.453476+0000", 2024-09-12T18:36:45.483 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6540000000000005e-06 2024-09-12T18:36:45.483 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.483 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.483 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:45.483 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.453484+0000", 2024-09-12T18:36:45.483 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0169999999999996e-06 2024-09-12T18:36:45.483 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:45.483 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:45.484 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:45.484 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.484 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.484 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:131456 5.e 5:72acc160:::benchmark_data_smithi073_23739_object131455:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:36:45.484 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:45.453459+0000", 2024-09-12T18:36:45.485 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00041751000000000001, 2024-09-12T18:36:45.485 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00081148799999999997, 2024-09-12T18:36:45.485 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:45.485 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:45.485 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:45.485 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:45.485 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:45.485 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:45.485 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 131456 2024-09-12T18:36:45.485 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.485 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:45.485 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.485 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:45.485 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.453459+0000", 2024-09-12T18:36:45.486 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:45.486 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.486 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.486 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:45.486 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.453459+0000", 2024-09-12T18:36:45.486 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:45.486 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.486 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.486 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:45.486 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.453460+0000", 2024-09-12T18:36:45.486 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0210000000000001e-06 2024-09-12T18:36:45.486 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.486 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.487 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:45.487 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.453491+0000", 2024-09-12T18:36:45.487 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0930999999999999e-05 2024-09-12T18:36:45.487 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.487 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.487 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:45.487 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.453501+0000", 2024-09-12T18:36:45.487 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0383999999999999e-05 2024-09-12T18:36:45.487 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.487 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.487 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:45.487 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.453508+0000", 2024-09-12T18:36:45.488 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7730000000000002e-06 2024-09-12T18:36:45.488 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.488 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.488 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:45.488 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.453726+0000", 2024-09-12T18:36:45.488 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021825100000000001 2024-09-12T18:36:45.488 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.488 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.488 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:45.488 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.453850+0000", 2024-09-12T18:36:45.488 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012352500000000001 2024-09-12T18:36:45.488 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.489 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.489 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:45.489 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.453985+0000", 2024-09-12T18:36:45.489 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013520900000000001 2024-09-12T18:36:45.489 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:45.489 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:45.489 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:45.489 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.489 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.489 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:131442 5.0 5:0c12ce9e:::benchmark_data_smithi073_23739_object131441:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:36:45.489 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:45.447816+0000", 2024-09-12T18:36:45.489 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0060605559999999999, 2024-09-12T18:36:45.489 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065197299999999996, 2024-09-12T18:36:45.490 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:45.490 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:45.490 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:45.490 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:45.490 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:45.490 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:45.490 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 131442 2024-09-12T18:36:45.490 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.490 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:45.490 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.490 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:45.490 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.447816+0000", 2024-09-12T18:36:45.490 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:45.491 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.491 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.491 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:45.491 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.447816+0000", 2024-09-12T18:36:45.491 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:45.491 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.491 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.491 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:45.491 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.447817+0000", 2024-09-12T18:36:45.491 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4339999999999999e-06 2024-09-12T18:36:45.491 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.491 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.491 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:45.492 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.447858+0000", 2024-09-12T18:36:45.492 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0624999999999998e-05 2024-09-12T18:36:45.492 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.492 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.492 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:45.492 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.447867+0000", 2024-09-12T18:36:45.492 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4909999999999994e-06 2024-09-12T18:36:45.492 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.492 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.492 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:45.492 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.447874+0000", 2024-09-12T18:36:45.492 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5200000000000003e-06 2024-09-12T18:36:45.492 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.493 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.493 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:45.493 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.447944+0000", 2024-09-12T18:36:45.493 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9863999999999994e-05 2024-09-12T18:36:45.493 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.493 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.493 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:45.493 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.448067+0000", 2024-09-12T18:36:45.493 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012315000000000001 2024-09-12T18:36:45.493 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.493 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.493 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0,2", 2024-09-12T18:36:45.493 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.448171+0000", 2024-09-12T18:36:45.494 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000104261 2024-09-12T18:36:45.494 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.494 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.494 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:45.494 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.452722+0000", 2024-09-12T18:36:45.494 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0045514090000000002 2024-09-12T18:36:45.494 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.494 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.494 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:45.494 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.452771+0000", 2024-09-12T18:36:45.495 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8860999999999999e-05 2024-09-12T18:36:45.495 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:45.495 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:45.495 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:45.495 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.495 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.495 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:131445 5.0 5:07d71434:::benchmark_data_smithi073_23739_object131444:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:36:45.495 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:45.448923+0000", 2024-09-12T18:36:45.495 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.004953219, 2024-09-12T18:36:45.495 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054863300000000002, 2024-09-12T18:36:45.495 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:45.496 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:45.496 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:45.496 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:45.496 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:45.496 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:45.496 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 131445 2024-09-12T18:36:45.496 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.496 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:45.496 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.496 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:45.496 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.448923+0000", 2024-09-12T18:36:45.496 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:45.497 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.497 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.497 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:45.497 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.448923+0000", 2024-09-12T18:36:45.497 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:45.497 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.497 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.497 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:45.497 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.448924+0000", 2024-09-12T18:36:45.497 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8500000000000001e-07 2024-09-12T18:36:45.497 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.497 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.497 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:45.498 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.449027+0000", 2024-09-12T18:36:45.498 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000103779 2024-09-12T18:36:45.498 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.498 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.498 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:45.498 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.449036+0000", 2024-09-12T18:36:45.498 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4400000000000005e-06 2024-09-12T18:36:45.498 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.498 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.498 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:45.498 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.449043+0000", 2024-09-12T18:36:45.498 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8700000000000003e-06 2024-09-12T18:36:45.498 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.499 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.499 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:45.499 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.450179+0000", 2024-09-12T18:36:45.499 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001136408 2024-09-12T18:36:45.499 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.499 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.499 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:45.499 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.450341+0000", 2024-09-12T18:36:45.499 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000162206 2024-09-12T18:36:45.499 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.499 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.499 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0,2", 2024-09-12T18:36:45.499 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.450498+0000", 2024-09-12T18:36:45.499 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000156835 2024-09-12T18:36:45.499 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:45.500 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:45.500 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:45.500 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.500 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.500 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:131447 5.d 5:b9310eb6:::benchmark_data_smithi073_23739_object131446:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:36:45.500 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:45.449089+0000", 2024-09-12T18:36:45.500 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.004787192, 2024-09-12T18:36:45.500 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0053881830000000004, 2024-09-12T18:36:45.500 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:45.500 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:45.500 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:45.500 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:45.500 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:45.500 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:45.501 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 131447 2024-09-12T18:36:45.501 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.501 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:45.501 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.501 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:45.501 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.449089+0000", 2024-09-12T18:36:45.501 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:45.501 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.501 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.501 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:45.501 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.449089+0000", 2024-09-12T18:36:45.501 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:45.501 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.502 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.502 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:45.502 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.449090+0000", 2024-09-12T18:36:45.502 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7199999999999998e-07 2024-09-12T18:36:45.502 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.502 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.502 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:45.502 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.449151+0000", 2024-09-12T18:36:45.502 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0893000000000001e-05 2024-09-12T18:36:45.502 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.503 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.503 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:45.503 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.449158+0000", 2024-09-12T18:36:45.503 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0509999999999999e-06 2024-09-12T18:36:45.503 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.503 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.503 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:45.503 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.449163+0000", 2024-09-12T18:36:45.503 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8069999999999996e-06 2024-09-12T18:36:45.503 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.503 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.503 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:45.503 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.449620+0000", 2024-09-12T18:36:45.504 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00045639200000000002 2024-09-12T18:36:45.504 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.504 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.504 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:45.504 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.449745+0000", 2024-09-12T18:36:45.504 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012514899999999999 2024-09-12T18:36:45.504 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.504 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.504 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:45.504 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.449884+0000", 2024-09-12T18:36:45.504 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013893900000000001 2024-09-12T18:36:45.504 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:45.505 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:45.505 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:45.505 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.505 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.505 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:131448 5.d 5:ba7a143f:::benchmark_data_smithi073_23739_object131447:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:36:45.505 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:45.449617+0000", 2024-09-12T18:36:45.505 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0042593910000000004, 2024-09-12T18:36:45.505 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0049271510000000003, 2024-09-12T18:36:45.505 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:45.505 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:45.505 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:45.505 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:45.506 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:45.506 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:45.506 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 131448 2024-09-12T18:36:45.506 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.506 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:45.506 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.506 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:45.506 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.449617+0000", 2024-09-12T18:36:45.506 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:45.506 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.506 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.506 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:45.506 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.449617+0000", 2024-09-12T18:36:45.507 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:45.507 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.507 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.507 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:45.507 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.449617+0000", 2024-09-12T18:36:45.507 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8700000000000005e-07 2024-09-12T18:36:45.507 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.507 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.507 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:45.507 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.449650+0000", 2024-09-12T18:36:45.507 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2515999999999998e-05 2024-09-12T18:36:45.507 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.508 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.508 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:45.508 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.449659+0000", 2024-09-12T18:36:45.508 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9400000000000008e-06 2024-09-12T18:36:45.508 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.508 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.508 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:45.508 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.449665+0000", 2024-09-12T18:36:45.508 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1029999999999998e-06 2024-09-12T18:36:45.508 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.508 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.508 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:45.508 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.451650+0000", 2024-09-12T18:36:45.509 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001985049 2024-09-12T18:36:45.509 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.509 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.509 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:45.509 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.451743+0000", 2024-09-12T18:36:45.509 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.3036999999999997e-05 2024-09-12T18:36:45.509 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.509 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.509 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:45.509 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.451850+0000", 2024-09-12T18:36:45.509 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010656499999999999 2024-09-12T18:36:45.509 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:45.509 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:45.509 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:45.510 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.510 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.510 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:131446 5.9 e52/21 5:972ed404:::benchmark_data_smithi073_23739_object131445:head v 52'8238, mlcod=52'8235)", 2024-09-12T18:36:45.510 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:45.449780+0000", 2024-09-12T18:36:45.510 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0040963229999999998, 2024-09-12T18:36:45.510 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0048247719999999997, 2024-09-12T18:36:45.510 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:45.510 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:45.510 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:45.510 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:45.510 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.510 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:45.510 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.449780+0000", 2024-09-12T18:36:45.510 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:45.511 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.511 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.511 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:45.511 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.449780+0000", 2024-09-12T18:36:45.511 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:45.511 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.511 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.511 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:45.511 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.449780+0000", 2024-09-12T18:36:45.511 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.96e-07 2024-09-12T18:36:45.511 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.511 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.511 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:45.511 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.449810+0000", 2024-09-12T18:36:45.512 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9437e-05 2024-09-12T18:36:45.512 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.512 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.512 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:45.512 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.449818+0000", 2024-09-12T18:36:45.512 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5779999999999999e-06 2024-09-12T18:36:45.512 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.512 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.512 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:45.512 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.449823+0000", 2024-09-12T18:36:45.512 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9280000000000001e-06 2024-09-12T18:36:45.512 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.512 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.513 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:45.513 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.449918+0000", 2024-09-12T18:36:45.513 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5080000000000004e-05 2024-09-12T18:36:45.513 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.513 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.513 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:45.513 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.449937+0000", 2024-09-12T18:36:45.513 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8623000000000001e-05 2024-09-12T18:36:45.513 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.513 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.513 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:45.513 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.454573+0000", 2024-09-12T18:36:45.513 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0046360009999999998 2024-09-12T18:36:45.514 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:45.514 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:45.514 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:45.514 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.454605+0000", 2024-09-12T18:36:45.514 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2277000000000003e-05 2024-09-12T18:36:45.514 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:45.514 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:45.514 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:45.514 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:45.514 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-09-12T18:36:45.514 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 12 2024-09-12T18:36:45.514 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:45.516 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:36:45.516 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:45.511+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:45.562 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:36:45.617 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:45.612+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:45.703 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:36:45.703 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:36:45.717 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:45.716+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:45.720 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:36:45.721 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:36:45.721 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:45.721 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:45.737 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:36:45.738 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:36:45.742 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:36:45.818 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:45.811+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:45.875 INFO:tasks.radosbench.radosbench.0.smithi073.stdout:2024-09-12T18:36:45.874299+0000 min lat: 0.00145327 max lat: 2.19445 avg lat: 0.00725405 2024-09-12T18:36:45.875 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-12T18:36:45.875 INFO:tasks.radosbench.radosbench.0.smithi073.stdout: 60 1 132274 132273 137.769 125.312 0.00850276 0.00725405 2024-09-12T18:36:45.891 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:45.891 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:45.906 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:36:45.919 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:45.914+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:46.020 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:46.016+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:46.026 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:46.026 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:46.041 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:36:46.110 INFO:teuthology.orchestra.run.smithi073.stderr:set 4.b pg_upmap mapping to [0,2] 2024-09-12T18:36:46.129 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:46.128+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:46.211 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:46.211 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:46.222 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:46.219+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:46.226 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:36:46.323 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:46.319+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:46.402 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:46.402 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:46.419 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:36:46.423 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:46.418+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:46.525 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:46.520+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:46.544 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:46.544 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:46.557 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:36:46.625 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:46.624+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:46.664 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:46.664 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:46.676 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:36:46.727 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:46.722+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:46.796 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:46.796 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:46.811 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:36:46.857 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:46.854+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:46.875 INFO:tasks.radosbench.radosbench.0.smithi073.stdout:Total time run: 60.0088 2024-09-12T18:36:46.875 INFO:tasks.radosbench.radosbench.0.smithi073.stdout:Total writes made: 132274 2024-09-12T18:36:46.875 INFO:tasks.radosbench.radosbench.0.smithi073.stdout:Write size: 65536 2024-09-12T18:36:46.875 INFO:tasks.radosbench.radosbench.0.smithi073.stdout:Object size: 65536 2024-09-12T18:36:46.876 INFO:tasks.radosbench.radosbench.0.smithi073.stdout:Bandwidth (MB/sec): 137.765 2024-09-12T18:36:46.876 INFO:tasks.radosbench.radosbench.0.smithi073.stdout:Stddev Bandwidth: 36.9276 2024-09-12T18:36:46.876 INFO:tasks.radosbench.radosbench.0.smithi073.stdout:Max bandwidth (MB/sec): 251.75 2024-09-12T18:36:46.876 INFO:tasks.radosbench.radosbench.0.smithi073.stdout:Min bandwidth (MB/sec): 0 2024-09-12T18:36:46.876 INFO:tasks.radosbench.radosbench.0.smithi073.stdout:Average IOPS: 2204 2024-09-12T18:36:46.876 INFO:tasks.radosbench.radosbench.0.smithi073.stdout:Stddev IOPS: 590.841 2024-09-12T18:36:46.876 INFO:tasks.radosbench.radosbench.0.smithi073.stdout:Max IOPS: 4028 2024-09-12T18:36:46.876 INFO:tasks.radosbench.radosbench.0.smithi073.stdout:Min IOPS: 0 2024-09-12T18:36:46.876 INFO:tasks.radosbench.radosbench.0.smithi073.stdout:Average Latency(s): 0.00725407 2024-09-12T18:36:46.877 INFO:tasks.radosbench.radosbench.0.smithi073.stdout:Stddev Latency(s): 0.0238073 2024-09-12T18:36:46.877 INFO:tasks.radosbench.radosbench.0.smithi073.stdout:Max latency(s): 2.19445 2024-09-12T18:36:46.877 INFO:tasks.radosbench.radosbench.0.smithi073.stdout:Min latency(s): 0.00145327 2024-09-12T18:36:46.884 INFO:tasks.radosbench.radosbench.0.smithi073.stdout:Cleaning up (deleting benchmark objects) 2024-09-12T18:36:46.928 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:46.923+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:46.975 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:46.975 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:46.997 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:36:47.028 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:47.024+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:47.129 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:47.124+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:47.130 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T18:36:47.198 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:47.198 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:47.220 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:36:47.229 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:47.223+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:47.330 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:47.326+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:47.381 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:47.381 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:47.403 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:36:47.449 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:47.448+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:47.532 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:47.528+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:47.569 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:47.569 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:47.593 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:36:47.634 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:47.632+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:47.734 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:47.732+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:47.753 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:36:47.793 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:47.793 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:47.813 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:36:47.835 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:47.830+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:47.912 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:36:47.912 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:36:47.929 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:36:47.929 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:36:47.935 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:47.930+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:47.948 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:36:47.949 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:36:48.023 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:36:48.023 INFO:teuthology.orchestra.run.smithi162.stdout: "size": 20, 2024-09-12T18:36:48.023 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 600, 2024-09-12T18:36:48.023 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:36:48.023 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.023 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4154.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:36:48.023 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:36:48.023 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 94.043089695999996, 2024-09-12T18:36:48.023 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025950709999999998, 2024-09-12T18:36:48.023 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:48.024 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:48.024 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:48.024 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:48.024 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4154", 2024-09-12T18:36:48.024 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/745129001", 2024-09-12T18:36:48.024 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 124 2024-09-12T18:36:48.024 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.024 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:48.024 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.024 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:48.024 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:36:48.024 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:48.025 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.025 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.025 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:48.025 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:36:48.025 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:48.025 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.025 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.025 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:48.025 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976562+0000", 2024-09-12T18:36:48.025 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.2999999999999999e-07 2024-09-12T18:36:48.025 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.025 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.025 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:48.026 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976567+0000", 2024-09-12T18:36:48.026 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3430000000000003e-06 2024-09-12T18:36:48.026 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.026 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.026 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:48.026 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976576+0000", 2024-09-12T18:36:48.026 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8070000000000006e-06 2024-09-12T18:36:48.026 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.026 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.026 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.026 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976583+0000", 2024-09-12T18:36:48.026 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9959999999999996e-06 2024-09-12T18:36:48.026 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.027 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.027 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:48.027 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997107+0000", 2024-09-12T18:36:48.027 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.020524106 2024-09-12T18:36:48.027 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.027 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.027 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:48.028 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997225+0000", 2024-09-12T18:36:48.028 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000117909 2024-09-12T18:36:48.028 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.028 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.028 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:48.028 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997407+0000", 2024-09-12T18:36:48.028 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00018175900000000001 2024-09-12T18:36:48.028 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.028 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.028 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:48.028 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998839+0000", 2024-09-12T18:36:48.028 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001432539 2024-09-12T18:36:48.028 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.029 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.029 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:48.029 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002319+0000", 2024-09-12T18:36:48.029 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0034803529999999998 2024-09-12T18:36:48.029 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.029 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.029 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:48.029 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002405+0000", 2024-09-12T18:36:48.029 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5434999999999998e-05 2024-09-12T18:36:48.029 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.030 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.030 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:48.030 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002512+0000", 2024-09-12T18:36:48.030 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010663299999999999 2024-09-12T18:36:48.030 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:48.030 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:48.030 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:48.030 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.030 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.030 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:48.030 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:36:48.030 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 82.378292189000007, 2024-09-12T18:36:48.030 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025127867000000002, 2024-09-12T18:36:48.031 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:48.031 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:48.031 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:48.031 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:48.031 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.031 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:48.031 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:36:48.031 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:48.032 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.032 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.032 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:48.032 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:36:48.032 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:48.032 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.032 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.032 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:48.032 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641362+0000", 2024-09-12T18:36:48.032 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.2569999999999999e-06 2024-09-12T18:36:48.032 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.032 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.032 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:48.032 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641374+0000", 2024-09-12T18:36:48.033 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2696e-05 2024-09-12T18:36:48.033 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.033 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.033 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:48.033 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641403+0000", 2024-09-12T18:36:48.033 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.8756999999999999e-05 2024-09-12T18:36:48.033 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.033 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.034 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.034 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641430+0000", 2024-09-12T18:36:48.034 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.6452999999999999e-05 2024-09-12T18:36:48.034 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.034 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.034 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:48.034 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641585+0000", 2024-09-12T18:36:48.034 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000155799 2024-09-12T18:36:48.034 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.034 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.034 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:48.035 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641753+0000", 2024-09-12T18:36:48.035 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000167868 2024-09-12T18:36:48.035 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.035 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.035 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:48.035 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641916+0000", 2024-09-12T18:36:48.035 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000162903 2024-09-12T18:36:48.035 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.035 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.035 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:48.035 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653655+0000", 2024-09-12T18:36:48.035 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011738879000000001 2024-09-12T18:36:48.035 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.036 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.036 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:48.036 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665515+0000", 2024-09-12T18:36:48.036 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011859915 2024-09-12T18:36:48.036 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.036 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.036 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:48.036 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665646+0000", 2024-09-12T18:36:48.036 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013122599999999999 2024-09-12T18:36:48.036 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.036 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.036 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:48.036 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666486+0000", 2024-09-12T18:36:48.037 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00084011399999999999 2024-09-12T18:36:48.037 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:48.037 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:48.037 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:48.037 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.037 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.037 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:48.037 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:36:48.037 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 82.378177726000004, 2024-09-12T18:36:48.037 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025384584000000002, 2024-09-12T18:36:48.037 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:48.037 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:48.037 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:48.038 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:48.038 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.038 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:48.038 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:36:48.038 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:48.038 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.038 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.038 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:48.038 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:36:48.038 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:48.038 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.038 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.038 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:48.038 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641474+0000", 2024-09-12T18:36:48.039 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.39e-06 2024-09-12T18:36:48.039 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.039 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.039 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:48.039 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641482+0000", 2024-09-12T18:36:48.039 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3499999999999999e-06 2024-09-12T18:36:48.039 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.039 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.039 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:48.039 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641534+0000", 2024-09-12T18:36:48.039 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2533e-05 2024-09-12T18:36:48.039 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.039 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.039 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.040 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641551+0000", 2024-09-12T18:36:48.040 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6515999999999999e-05 2024-09-12T18:36:48.040 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.040 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.040 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:48.040 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642630+0000", 2024-09-12T18:36:48.040 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001079705 2024-09-12T18:36:48.040 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.040 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.040 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:48.040 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642909+0000", 2024-09-12T18:36:48.040 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027859800000000002 2024-09-12T18:36:48.041 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.041 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.041 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:48.041 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643137+0000", 2024-09-12T18:36:48.041 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022803799999999999 2024-09-12T18:36:48.041 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.041 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.041 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:48.041 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653669+0000", 2024-09-12T18:36:48.041 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010532032 2024-09-12T18:36:48.041 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.041 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.041 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:48.041 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666624+0000", 2024-09-12T18:36:48.042 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012954940999999999 2024-09-12T18:36:48.042 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.042 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.042 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:48.042 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666762+0000", 2024-09-12T18:36:48.042 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000137668 2024-09-12T18:36:48.042 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.042 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.042 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:48.042 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666857+0000", 2024-09-12T18:36:48.042 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.5812999999999999e-05 2024-09-12T18:36:48.042 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:48.043 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:48.043 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:48.043 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.043 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.043 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:48.043 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:36:48.043 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 82.378049931000007, 2024-09-12T18:36:48.043 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025661562999999998, 2024-09-12T18:36:48.043 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:48.043 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:48.043 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:48.043 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:48.043 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.043 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:48.044 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:36:48.044 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:48.044 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.044 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.044 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:48.044 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:36:48.044 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:48.044 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.044 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.044 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:48.044 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641602+0000", 2024-09-12T18:36:48.044 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3540000000000001e-06 2024-09-12T18:36:48.044 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.045 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.045 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:48.045 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641637+0000", 2024-09-12T18:36:48.045 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5145999999999999e-05 2024-09-12T18:36:48.045 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.045 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.045 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:48.045 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641659+0000", 2024-09-12T18:36:48.045 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2249999999999999e-05 2024-09-12T18:36:48.045 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.045 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.045 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.045 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641675+0000", 2024-09-12T18:36:48.045 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6059999999999999e-05 2024-09-12T18:36:48.046 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.046 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.046 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:48.046 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644570+0000", 2024-09-12T18:36:48.046 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028947069999999998 2024-09-12T18:36:48.046 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.046 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.046 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:48.046 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644900+0000", 2024-09-12T18:36:48.046 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000329401 2024-09-12T18:36:48.046 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.046 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.046 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:48.046 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645235+0000", 2024-09-12T18:36:48.047 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000335874 2024-09-12T18:36:48.047 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.047 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.047 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:48.047 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655459+0000", 2024-09-12T18:36:48.047 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010223441999999999 2024-09-12T18:36:48.047 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.047 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.047 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:48.047 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667028+0000", 2024-09-12T18:36:48.047 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011568673999999999 2024-09-12T18:36:48.047 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.047 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.048 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:48.048 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667163+0000", 2024-09-12T18:36:48.048 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013525500000000001 2024-09-12T18:36:48.048 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.048 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.048 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:48.048 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667262+0000", 2024-09-12T18:36:48.048 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9400000000000004e-05 2024-09-12T18:36:48.048 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:48.048 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:48.048 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:48.048 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.048 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.048 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:48.049 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:36:48.049 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 82.377948110999995, 2024-09-12T18:36:48.049 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025971339, 2024-09-12T18:36:48.049 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:48.049 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:48.049 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:48.049 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:48.049 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.049 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:48.049 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:36:48.049 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:48.049 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.049 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.049 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:48.050 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:36:48.050 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:48.050 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.050 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.050 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:48.050 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641704+0000", 2024-09-12T18:36:48.050 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.297e-06 2024-09-12T18:36:48.050 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.050 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.050 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:48.050 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641712+0000", 2024-09-12T18:36:48.050 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.9060000000000002e-06 2024-09-12T18:36:48.050 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.050 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.050 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:48.051 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641731+0000", 2024-09-12T18:36:48.051 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9083e-05 2024-09-12T18:36:48.051 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.051 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.051 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.051 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641745+0000", 2024-09-12T18:36:48.051 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4066999999999999e-05 2024-09-12T18:36:48.051 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.051 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.051 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:48.051 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646529+0000", 2024-09-12T18:36:48.051 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.004784033 2024-09-12T18:36:48.051 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.051 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.052 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:48.052 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646727+0000", 2024-09-12T18:36:48.052 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019841800000000001 2024-09-12T18:36:48.052 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.052 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.052 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:48.052 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647057+0000", 2024-09-12T18:36:48.052 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032926800000000002 2024-09-12T18:36:48.052 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.052 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.052 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:48.052 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655475+0000", 2024-09-12T18:36:48.052 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0084186250000000008 2024-09-12T18:36:48.052 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.052 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.053 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:48.053 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667424+0000", 2024-09-12T18:36:48.053 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011949257 2024-09-12T18:36:48.053 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.053 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.053 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:48.053 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667573+0000", 2024-09-12T18:36:48.053 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014851900000000001 2024-09-12T18:36:48.053 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.053 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.053 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:48.053 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667674+0000", 2024-09-12T18:36:48.053 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010086600000000001 2024-09-12T18:36:48.054 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:48.054 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:48.054 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:48.054 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.054 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.054 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:48.054 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:36:48.054 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 82.377885722000002, 2024-09-12T18:36:48.054 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026215008000000001, 2024-09-12T18:36:48.054 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:48.054 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:48.054 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:48.054 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:48.055 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.055 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:48.055 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:36:48.055 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:48.055 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.055 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.055 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:48.055 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:36:48.055 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:48.055 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.055 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.055 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:48.055 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641766+0000", 2024-09-12T18:36:48.055 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1200000000000001e-06 2024-09-12T18:36:48.056 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.056 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.056 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:48.056 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641775+0000", 2024-09-12T18:36:48.056 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.2499999999999995e-06 2024-09-12T18:36:48.056 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.056 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.056 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:48.056 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641793+0000", 2024-09-12T18:36:48.056 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7773000000000001e-05 2024-09-12T18:36:48.056 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.056 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.056 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.057 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641807+0000", 2024-09-12T18:36:48.057 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3814e-05 2024-09-12T18:36:48.057 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.057 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.057 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:48.057 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647626+0000", 2024-09-12T18:36:48.057 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0058193050000000003 2024-09-12T18:36:48.057 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.057 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.057 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:48.057 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647937+0000", 2024-09-12T18:36:48.057 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031112400000000003 2024-09-12T18:36:48.057 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.057 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.058 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:48.058 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648239+0000", 2024-09-12T18:36:48.058 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00030227500000000002 2024-09-12T18:36:48.058 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.058 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.058 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:48.058 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655487+0000", 2024-09-12T18:36:48.058 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072479129999999999 2024-09-12T18:36:48.058 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.058 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.058 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:48.058 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667823+0000", 2024-09-12T18:36:48.058 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012335505 2024-09-12T18:36:48.059 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.059 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.059 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:48.059 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667908+0000", 2024-09-12T18:36:48.059 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4843000000000001e-05 2024-09-12T18:36:48.059 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.059 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.059 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:48.059 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667980+0000", 2024-09-12T18:36:48.059 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2086000000000001e-05 2024-09-12T18:36:48.059 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:48.059 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:48.059 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:48.059 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.059 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.060 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:48.060 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:36:48.060 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 82.377825568999995, 2024-09-12T18:36:48.060 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026483236, 2024-09-12T18:36:48.060 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:48.060 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:48.060 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:48.060 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:48.060 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.060 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:48.060 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:36:48.060 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:48.060 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.060 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.060 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:48.061 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:36:48.061 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:48.061 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.061 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.061 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:48.061 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641826+0000", 2024-09-12T18:36:48.061 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:36:48.061 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.061 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.061 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:48.061 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641832+0000", 2024-09-12T18:36:48.061 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4199999999999998e-06 2024-09-12T18:36:48.061 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.061 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.062 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:48.062 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641848+0000", 2024-09-12T18:36:48.062 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6492999999999999e-05 2024-09-12T18:36:48.062 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.062 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.062 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.062 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641863+0000", 2024-09-12T18:36:48.062 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5427e-05 2024-09-12T18:36:48.062 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.062 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.062 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:48.062 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648887+0000", 2024-09-12T18:36:48.062 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0070230860000000004 2024-09-12T18:36:48.062 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.062 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.063 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:48.063 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649111+0000", 2024-09-12T18:36:48.063 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022425799999999999 2024-09-12T18:36:48.063 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.063 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.063 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:48.063 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649494+0000", 2024-09-12T18:36:48.063 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00038349400000000001 2024-09-12T18:36:48.063 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.063 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.063 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:48.063 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655499+0000", 2024-09-12T18:36:48.063 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0060047260000000002 2024-09-12T18:36:48.064 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.064 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.064 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:48.064 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668110+0000", 2024-09-12T18:36:48.064 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012610543 2024-09-12T18:36:48.064 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.064 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.064 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:48.064 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668252+0000", 2024-09-12T18:36:48.064 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014265600000000001 2024-09-12T18:36:48.064 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.064 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.064 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:48.065 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668308+0000", 2024-09-12T18:36:48.065 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5992999999999997e-05 2024-09-12T18:36:48.065 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:48.065 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:48.065 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:48.065 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.065 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.065 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:48.065 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:36:48.065 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 82.377770353000003, 2024-09-12T18:36:48.065 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026605302000000001, 2024-09-12T18:36:48.065 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:48.065 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:48.065 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:48.066 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:48.066 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.066 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:48.066 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:36:48.066 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:48.066 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.066 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.066 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:48.066 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:36:48.066 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:48.066 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.066 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.066 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:48.067 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641881+0000", 2024-09-12T18:36:48.067 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.057e-06 2024-09-12T18:36:48.067 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.067 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.067 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:48.067 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641887+0000", 2024-09-12T18:36:48.067 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.6629999999999998e-06 2024-09-12T18:36:48.067 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.068 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.068 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:48.068 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641903+0000", 2024-09-12T18:36:48.068 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6317e-05 2024-09-12T18:36:48.068 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.068 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.068 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.068 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641917+0000", 2024-09-12T18:36:48.068 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3339999999999999e-05 2024-09-12T18:36:48.068 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.068 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.068 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:48.068 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650708+0000", 2024-09-12T18:36:48.069 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.008791419 2024-09-12T18:36:48.069 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.069 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.069 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:48.069 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651021+0000", 2024-09-12T18:36:48.069 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031296699999999999 2024-09-12T18:36:48.069 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.069 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.069 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:48.069 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651349+0000", 2024-09-12T18:36:48.069 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032796499999999999 2024-09-12T18:36:48.069 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.069 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.069 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:48.070 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655742+0000", 2024-09-12T18:36:48.070 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0043934680000000002 2024-09-12T18:36:48.070 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.070 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.070 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:48.070 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668377+0000", 2024-09-12T18:36:48.070 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012634312999999999 2024-09-12T18:36:48.070 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.070 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.070 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:48.070 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668441+0000", 2024-09-12T18:36:48.070 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4369999999999995e-05 2024-09-12T18:36:48.070 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.070 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.070 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:48.071 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668485+0000", 2024-09-12T18:36:48.071 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4422999999999998e-05 2024-09-12T18:36:48.071 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:48.071 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:48.071 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:48.071 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.071 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.071 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:48.071 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:36:48.071 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 82.377712950000003, 2024-09-12T18:36:48.071 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026919499, 2024-09-12T18:36:48.071 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:48.071 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:48.071 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:48.072 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:48.072 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.072 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:48.072 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:36:48.072 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:48.072 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.072 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.072 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:48.072 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:36:48.072 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:48.072 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.072 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.073 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:48.073 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641939+0000", 2024-09-12T18:36:48.073 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9399999999999993e-07 2024-09-12T18:36:48.073 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.073 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.073 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:48.073 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641945+0000", 2024-09-12T18:36:48.073 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9200000000000001e-06 2024-09-12T18:36:48.073 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.073 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.073 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:48.073 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641961+0000", 2024-09-12T18:36:48.073 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6520000000000001e-05 2024-09-12T18:36:48.073 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.074 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.074 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.074 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641974+0000", 2024-09-12T18:36:48.074 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3413e-05 2024-09-12T18:36:48.074 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.074 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.074 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:48.074 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654560+0000", 2024-09-12T18:36:48.074 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012585308999999999 2024-09-12T18:36:48.074 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.074 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.074 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:48.074 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654822+0000", 2024-09-12T18:36:48.074 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026210099999999999 2024-09-12T18:36:48.075 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.075 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.075 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:48.075 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655059+0000", 2024-09-12T18:36:48.075 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00023747899999999999 2024-09-12T18:36:48.075 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.075 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.075 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:48.075 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.656315+0000", 2024-09-12T18:36:48.075 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0012555000000000001 2024-09-12T18:36:48.075 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.075 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.075 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:48.075 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668590+0000", 2024-09-12T18:36:48.076 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012274851999999999 2024-09-12T18:36:48.076 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.076 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.076 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:48.076 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668725+0000", 2024-09-12T18:36:48.076 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013524199999999999 2024-09-12T18:36:48.076 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.076 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.076 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:48.076 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668857+0000", 2024-09-12T18:36:48.076 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013216899999999999 2024-09-12T18:36:48.076 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:48.076 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:48.077 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:48.077 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.077 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.077 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:48.077 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:36:48.077 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 82.377659429999994, 2024-09-12T18:36:48.077 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023616723999999999, 2024-09-12T18:36:48.077 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:48.077 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:48.077 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:48.077 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:48.077 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.077 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:48.077 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:36:48.078 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:48.078 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.078 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.078 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:48.078 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:36:48.078 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:48.078 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.078 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.078 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:48.078 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641992+0000", 2024-09-12T18:36:48.078 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.08e-06 2024-09-12T18:36:48.078 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.078 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.078 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:48.079 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641998+0000", 2024-09-12T18:36:48.079 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4299999999999997e-06 2024-09-12T18:36:48.079 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.079 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.079 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:48.079 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642014+0000", 2024-09-12T18:36:48.079 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6266e-05 2024-09-12T18:36:48.079 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.079 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.079 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.079 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642026+0000", 2024-09-12T18:36:48.079 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2567e-05 2024-09-12T18:36:48.079 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.079 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.080 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:48.080 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642213+0000", 2024-09-12T18:36:48.080 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00018701899999999999 2024-09-12T18:36:48.080 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.080 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.080 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:48.080 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642507+0000", 2024-09-12T18:36:48.080 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00029394700000000002 2024-09-12T18:36:48.080 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.080 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.080 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:48.080 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642686+0000", 2024-09-12T18:36:48.080 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000178152 2024-09-12T18:36:48.081 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.081 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.081 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:48.081 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650952+0000", 2024-09-12T18:36:48.081 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0082663570000000002 2024-09-12T18:36:48.081 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.081 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.081 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:48.081 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665382+0000", 2024-09-12T18:36:48.081 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.014430111000000001 2024-09-12T18:36:48.081 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.081 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.081 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:48.081 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665508+0000", 2024-09-12T18:36:48.082 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000125986 2024-09-12T18:36:48.082 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.082 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.082 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:48.082 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665608+0000", 2024-09-12T18:36:48.082 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9809000000000006e-05 2024-09-12T18:36:48.082 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:48.082 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:48.082 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:48.082 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.082 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.082 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:48.082 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:36:48.082 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 82.377531564999998, 2024-09-12T18:36:48.083 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024670563, 2024-09-12T18:36:48.083 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:48.083 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:48.083 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:48.083 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:48.083 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.083 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:48.083 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:36:48.083 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:48.083 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.083 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.083 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:48.083 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:36:48.083 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:48.084 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.084 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.084 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:48.084 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642120+0000", 2024-09-12T18:36:48.084 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1769999999999999e-06 2024-09-12T18:36:48.084 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.084 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.084 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:48.084 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642128+0000", 2024-09-12T18:36:48.084 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3429999999999998e-06 2024-09-12T18:36:48.084 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.084 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.084 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:48.085 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642192+0000", 2024-09-12T18:36:48.085 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4406999999999995e-05 2024-09-12T18:36:48.085 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.085 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.085 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.085 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642223+0000", 2024-09-12T18:36:48.085 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.1266000000000002e-05 2024-09-12T18:36:48.085 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.085 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.085 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:48.085 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643201+0000", 2024-09-12T18:36:48.085 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0009778390000000001 2024-09-12T18:36:48.085 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.086 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.086 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:48.086 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643410+0000", 2024-09-12T18:36:48.086 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020874199999999999 2024-09-12T18:36:48.086 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.086 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.086 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:48.086 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643685+0000", 2024-09-12T18:36:48.086 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027520700000000002 2024-09-12T18:36:48.086 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.086 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.086 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:48.086 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650966+0000", 2024-09-12T18:36:48.087 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072810710000000001 2024-09-12T18:36:48.087 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.087 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.087 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:48.087 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666560+0000", 2024-09-12T18:36:48.087 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015594143 2024-09-12T18:36:48.087 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.087 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.087 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:48.087 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666691+0000", 2024-09-12T18:36:48.087 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000130359 2024-09-12T18:36:48.087 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.087 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.087 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:48.087 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666790+0000", 2024-09-12T18:36:48.088 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9009e-05 2024-09-12T18:36:48.088 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:48.088 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:48.088 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:48.088 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.088 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.088 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:48.088 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:36:48.088 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 82.376753277000006, 2024-09-12T18:36:48.088 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024891744, 2024-09-12T18:36:48.088 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:48.088 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:48.088 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:48.089 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:48.089 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.089 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:48.089 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:36:48.089 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:48.089 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.089 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.089 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:48.089 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:36:48.089 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:48.089 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.089 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.089 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:48.090 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642899+0000", 2024-09-12T18:36:48.090 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4729999999999999e-06 2024-09-12T18:36:48.090 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.090 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.090 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:48.090 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642912+0000", 2024-09-12T18:36:48.090 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3495999999999999e-05 2024-09-12T18:36:48.090 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.090 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.090 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:48.090 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642934+0000", 2024-09-12T18:36:48.090 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2033999999999999e-05 2024-09-12T18:36:48.090 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.090 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.091 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.091 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642949+0000", 2024-09-12T18:36:48.091 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4970000000000001e-05 2024-09-12T18:36:48.091 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.091 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.091 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:48.091 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644400+0000", 2024-09-12T18:36:48.091 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001450305 2024-09-12T18:36:48.091 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.091 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.091 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:48.091 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644617+0000", 2024-09-12T18:36:48.091 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000217302 2024-09-12T18:36:48.091 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.092 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.092 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:48.092 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645052+0000", 2024-09-12T18:36:48.092 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000434797 2024-09-12T18:36:48.092 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.092 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.092 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:48.092 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653860+0000", 2024-09-12T18:36:48.092 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0088082249999999994 2024-09-12T18:36:48.092 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.092 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.092 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:48.092 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667598+0000", 2024-09-12T18:36:48.093 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.013738451 2024-09-12T18:36:48.093 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.093 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.093 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:48.093 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667698+0000", 2024-09-12T18:36:48.093 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9854999999999999e-05 2024-09-12T18:36:48.093 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.093 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.093 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:48.093 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667789+0000", 2024-09-12T18:36:48.093 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0835999999999996e-05 2024-09-12T18:36:48.093 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:48.093 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:48.093 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:48.094 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.094 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.094 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:30 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:48.094 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:36:48.094 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 82.376678460999997, 2024-09-12T18:36:48.094 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023936852000000002, 2024-09-12T18:36:48.094 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:48.094 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:48.094 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:48.094 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:48.094 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.094 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:48.094 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:36:48.094 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:48.094 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.095 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.095 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:48.095 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:36:48.095 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:48.095 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.095 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.095 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:48.095 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642973+0000", 2024-09-12T18:36:48.095 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.11e-06 2024-09-12T18:36:48.095 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.095 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.095 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:48.095 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642994+0000", 2024-09-12T18:36:48.095 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.0699999999999998e-05 2024-09-12T18:36:48.096 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.096 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.096 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:48.096 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643011+0000", 2024-09-12T18:36:48.096 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7229999999999999e-05 2024-09-12T18:36:48.096 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.096 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.096 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.096 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643025+0000", 2024-09-12T18:36:48.096 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3803e-05 2024-09-12T18:36:48.096 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.096 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.096 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:48.097 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643143+0000", 2024-09-12T18:36:48.097 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000118225 2024-09-12T18:36:48.097 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.097 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.097 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:48.097 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643426+0000", 2024-09-12T18:36:48.097 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00028250500000000001 2024-09-12T18:36:48.097 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.097 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.097 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:48.097 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643864+0000", 2024-09-12T18:36:48.097 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00043856 2024-09-12T18:36:48.097 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.097 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.098 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:48.098 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651148+0000", 2024-09-12T18:36:48.098 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072836769999999997 2024-09-12T18:36:48.098 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.098 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.098 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:48.099 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666674+0000", 2024-09-12T18:36:48.100 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015525786999999999 2024-09-12T18:36:48.100 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.100 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.100 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:48.100 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666796+0000", 2024-09-12T18:36:48.100 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000122416 2024-09-12T18:36:48.100 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.100 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.100 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:48.100 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666909+0000", 2024-09-12T18:36:48.100 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011283899999999999 2024-09-12T18:36:48.100 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:48.100 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:48.101 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:48.101 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.101 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.101 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:48.101 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:36:48.101 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 82.376595754999997, 2024-09-12T18:36:48.101 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024100234000000002, 2024-09-12T18:36:48.101 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:48.101 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:48.101 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:48.101 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:48.101 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.101 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:48.101 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:36:48.102 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:48.102 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.102 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.102 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:48.102 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:36:48.102 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:48.102 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.102 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.102 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:48.102 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643056+0000", 2024-09-12T18:36:48.102 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.046e-06 2024-09-12T18:36:48.102 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.103 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.103 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:48.103 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643068+0000", 2024-09-12T18:36:48.103 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2106999999999999e-05 2024-09-12T18:36:48.103 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.103 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.103 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:48.103 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643085+0000", 2024-09-12T18:36:48.103 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7479999999999999e-05 2024-09-12T18:36:48.103 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.103 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.103 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.103 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643099+0000", 2024-09-12T18:36:48.104 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3730000000000001e-05 2024-09-12T18:36:48.104 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.104 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.104 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:48.104 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644623+0000", 2024-09-12T18:36:48.104 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0015236080000000001 2024-09-12T18:36:48.104 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.104 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.104 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:48.104 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644893+0000", 2024-09-12T18:36:48.104 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026990500000000003 2024-09-12T18:36:48.104 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.104 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.105 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:48.105 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645227+0000", 2024-09-12T18:36:48.105 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00033391300000000003 2024-09-12T18:36:48.105 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.105 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.105 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:48.105 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653926+0000", 2024-09-12T18:36:48.105 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0086993339999999995 2024-09-12T18:36:48.105 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.105 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.105 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:48.105 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666925+0000", 2024-09-12T18:36:48.105 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012998686000000001 2024-09-12T18:36:48.106 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.106 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.106 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:48.106 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667057+0000", 2024-09-12T18:36:48.106 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013255600000000001 2024-09-12T18:36:48.106 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.106 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.106 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:48.106 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667155+0000", 2024-09-12T18:36:48.106 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7868999999999994e-05 2024-09-12T18:36:48.106 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:48.106 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:48.106 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:48.106 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.107 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.107 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:48.107 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:36:48.107 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 82.376399965999994, 2024-09-12T18:36:48.107 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024255982999999998, 2024-09-12T18:36:48.107 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:48.107 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:48.107 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:48.107 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:48.107 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.107 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:48.107 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:36:48.107 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:48.107 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.108 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.108 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:48.108 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:36:48.108 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:48.108 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.108 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.108 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:48.108 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643252+0000", 2024-09-12T18:36:48.108 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:48.108 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.108 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.108 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:48.108 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643287+0000", 2024-09-12T18:36:48.108 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5225999999999998e-05 2024-09-12T18:36:48.109 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.109 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.109 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:48.109 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643323+0000", 2024-09-12T18:36:48.109 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5488999999999999e-05 2024-09-12T18:36:48.109 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.109 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.109 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.109 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643357+0000", 2024-09-12T18:36:48.109 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.3853999999999998e-05 2024-09-12T18:36:48.109 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.109 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.109 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:48.110 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646716+0000", 2024-09-12T18:36:48.110 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003359 2024-09-12T18:36:48.110 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.110 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.110 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:48.110 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647037+0000", 2024-09-12T18:36:48.110 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032131800000000002 2024-09-12T18:36:48.110 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.110 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.110 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:48.110 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647337+0000", 2024-09-12T18:36:48.110 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000300208 2024-09-12T18:36:48.110 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.111 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.111 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:48.111 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654291+0000", 2024-09-12T18:36:48.111 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0069543089999999997 2024-09-12T18:36:48.111 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.111 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.111 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:48.111 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667297+0000", 2024-09-12T18:36:48.111 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.013005526 2024-09-12T18:36:48.111 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.111 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.111 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:48.111 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667416+0000", 2024-09-12T18:36:48.111 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000119416 2024-09-12T18:36:48.112 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.112 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.112 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:48.112 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667507+0000", 2024-09-12T18:36:48.112 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0206999999999999e-05 2024-09-12T18:36:48.112 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:48.112 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:48.112 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:48.112 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.112 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.112 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:48.112 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:36:48.113 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 82.376272870999998, 2024-09-12T18:36:48.113 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023888482999999999, 2024-09-12T18:36:48.113 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:48.113 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:48.113 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:48.113 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:48.113 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.113 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:48.113 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:36:48.113 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:48.113 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.113 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.113 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:48.113 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:36:48.114 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:48.114 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.114 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.114 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:48.114 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643379+0000", 2024-09-12T18:36:48.114 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.207e-06 2024-09-12T18:36:48.114 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.114 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.114 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:48.114 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643390+0000", 2024-09-12T18:36:48.114 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0696000000000001e-05 2024-09-12T18:36:48.114 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.114 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.115 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:48.115 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643407+0000", 2024-09-12T18:36:48.115 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7563000000000001e-05 2024-09-12T18:36:48.115 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.115 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.115 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.115 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643420+0000", 2024-09-12T18:36:48.115 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3277e-05 2024-09-12T18:36:48.115 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.115 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.115 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:48.115 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644906+0000", 2024-09-12T18:36:48.115 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001485945 2024-09-12T18:36:48.115 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.116 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.116 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:48.116 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645404+0000", 2024-09-12T18:36:48.116 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00049807599999999997 2024-09-12T18:36:48.116 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.116 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.116 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:48.116 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645846+0000", 2024-09-12T18:36:48.116 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00044190400000000002 2024-09-12T18:36:48.116 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.116 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.116 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:48.116 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654223+0000", 2024-09-12T18:36:48.117 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0083767419999999995 2024-09-12T18:36:48.117 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.117 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.117 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:48.117 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667026+0000", 2024-09-12T18:36:48.117 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012802531000000001 2024-09-12T18:36:48.117 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.117 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.117 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:48.117 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667162+0000", 2024-09-12T18:36:48.117 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000136112 2024-09-12T18:36:48.117 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.117 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.117 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:48.118 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667266+0000", 2024-09-12T18:36:48.118 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010443 2024-09-12T18:36:48.118 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:48.118 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:48.118 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:48.118 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.118 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.118 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:48.118 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:36:48.118 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 82.376122151999994, 2024-09-12T18:36:48.118 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024222582999999999, 2024-09-12T18:36:48.118 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:48.118 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:48.118 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:48.119 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:48.119 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.119 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:48.119 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:36:48.119 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:48.119 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.119 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.119 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:48.119 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:36:48.119 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:48.119 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.119 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.119 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:48.119 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643530+0000", 2024-09-12T18:36:48.120 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.393e-06 2024-09-12T18:36:48.120 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.120 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.120 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:48.120 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643536+0000", 2024-09-12T18:36:48.120 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4130000000000003e-06 2024-09-12T18:36:48.120 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.120 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.120 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:48.120 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643554+0000", 2024-09-12T18:36:48.120 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7572999999999999e-05 2024-09-12T18:36:48.120 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.120 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.120 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.121 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643567+0000", 2024-09-12T18:36:48.121 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3393999999999999e-05 2024-09-12T18:36:48.121 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.121 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.121 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:48.121 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648198+0000", 2024-09-12T18:36:48.121 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0046304479999999997 2024-09-12T18:36:48.121 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.121 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.121 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:48.121 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648413+0000", 2024-09-12T18:36:48.121 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00021507500000000001 2024-09-12T18:36:48.121 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.121 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.122 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:48.122 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667751+0000", 2024-09-12T18:36:48.122 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.019338286999999999 2024-09-12T18:36:48.122 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:48.122 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:48.122 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:48.122 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.122 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.122 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:121106 5.d e50/21 5:b4a9a221:::benchmark_data_smithi073_23739_object121105:head v 50'7658, mlcod=48'7656)", 2024-09-12T18:36:48.122 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:40.238637+0000", 2024-09-12T18:36:48.122 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 7.781013551, 2024-09-12T18:36:48.122 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.033154694999999998, 2024-09-12T18:36:48.122 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:48.122 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:48.123 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:48.123 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:48.123 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.123 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:48.123 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238637+0000", 2024-09-12T18:36:48.123 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:48.123 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.123 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.123 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:48.123 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238637+0000", 2024-09-12T18:36:48.123 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:48.123 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.123 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.123 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:48.123 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238639+0000", 2024-09-12T18:36:48.124 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.8560000000000001e-06 2024-09-12T18:36:48.124 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.124 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.124 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:48.124 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238723+0000", 2024-09-12T18:36:48.124 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4314999999999995e-05 2024-09-12T18:36:48.124 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.124 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.124 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:48.124 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238753+0000", 2024-09-12T18:36:48.124 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.9726e-05 2024-09-12T18:36:48.124 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.124 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.124 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.125 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238773+0000", 2024-09-12T18:36:48.125 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9789e-05 2024-09-12T18:36:48.125 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.125 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.125 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:48.125 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.241557+0000", 2024-09-12T18:36:48.125 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0027843910000000002 2024-09-12T18:36:48.125 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.125 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.125 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:48.125 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.241581+0000", 2024-09-12T18:36:48.125 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.4224999999999999e-05 2024-09-12T18:36:48.125 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.125 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.126 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:48.126 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.271722+0000", 2024-09-12T18:36:48.126 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.030141194 2024-09-12T18:36:48.126 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.126 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.126 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:48.126 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.271792+0000", 2024-09-12T18:36:48.126 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9198999999999999e-05 2024-09-12T18:36:48.126 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:48.126 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:48.126 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:48.126 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.126 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.126 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:131553 5.9 5:99f85f54:::benchmark_data_smithi073_23739_object131552:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:36:48.127 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:45.500398+0000", 2024-09-12T18:36:48.127 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 2.5192523910000002, 2024-09-12T18:36:48.127 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024615648, 2024-09-12T18:36:48.127 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:48.127 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:48.127 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:48.127 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:48.127 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:48.127 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:48.127 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 131553 2024-09-12T18:36:48.127 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.127 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:48.127 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.127 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:48.127 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500398+0000", 2024-09-12T18:36:48.128 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:48.128 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.128 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.128 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:48.128 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500398+0000", 2024-09-12T18:36:48.128 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:48.128 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.128 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.128 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:48.128 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500399+0000", 2024-09-12T18:36:48.128 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.54e-07 2024-09-12T18:36:48.128 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.128 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.129 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:48.129 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500521+0000", 2024-09-12T18:36:48.129 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012212599999999999 2024-09-12T18:36:48.129 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.129 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.129 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:48.129 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500528+0000", 2024-09-12T18:36:48.129 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.6619999999999999e-06 2024-09-12T18:36:48.129 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.129 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.129 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.129 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500532+0000", 2024-09-12T18:36:48.129 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6110000000000004e-06 2024-09-12T18:36:48.129 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.129 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.130 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:48.130 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500576+0000", 2024-09-12T18:36:48.130 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.3563000000000003e-05 2024-09-12T18:36:48.130 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.130 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.130 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:48.130 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500688+0000", 2024-09-12T18:36:48.130 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011260900000000001 2024-09-12T18:36:48.130 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.130 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.130 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:48.130 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.517383+0000", 2024-09-12T18:36:48.130 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.016694154999999999 2024-09-12T18:36:48.130 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.131 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.131 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:48.131 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.523998+0000", 2024-09-12T18:36:48.131 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0066157919999999997 2024-09-12T18:36:48.131 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.131 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.131 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:48.131 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.524943+0000", 2024-09-12T18:36:48.131 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00094417500000000001 2024-09-12T18:36:48.131 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.131 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.131 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:48.131 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.524981+0000", 2024-09-12T18:36:48.131 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.8179000000000002e-05 2024-09-12T18:36:48.132 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.132 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.132 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:48.132 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.525014+0000", 2024-09-12T18:36:48.132 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.3022000000000003e-05 2024-09-12T18:36:48.132 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:48.132 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:48.132 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:48.132 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.132 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.132 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:131551 5.d e52/21 5:b8f8c77a:::benchmark_data_smithi073_23739_object131550:head v 52'8341, mlcod=52'8338)", 2024-09-12T18:36:48.132 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:45.500609+0000", 2024-09-12T18:36:48.132 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 2.5190413710000001, 2024-09-12T18:36:48.132 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024752877, 2024-09-12T18:36:48.133 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:48.133 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:48.133 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:48.133 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:48.133 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.133 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:48.133 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500609+0000", 2024-09-12T18:36:48.133 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:48.133 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.133 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.133 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:48.133 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500609+0000", 2024-09-12T18:36:48.133 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:48.133 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.134 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.134 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:48.134 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500610+0000", 2024-09-12T18:36:48.134 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5499999999999998e-07 2024-09-12T18:36:48.134 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.134 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.134 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:48.134 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500669+0000", 2024-09-12T18:36:48.134 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9244999999999999e-05 2024-09-12T18:36:48.135 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.135 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.135 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:48.135 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500676+0000", 2024-09-12T18:36:48.135 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3030000000000002e-06 2024-09-12T18:36:48.135 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.135 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.135 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.135 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500681+0000", 2024-09-12T18:36:48.135 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8720000000000001e-06 2024-09-12T18:36:48.135 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.135 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.135 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:48.135 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.517128+0000", 2024-09-12T18:36:48.136 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.016446485 2024-09-12T18:36:48.136 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.136 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.136 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:48.136 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.517159+0000", 2024-09-12T18:36:48.136 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.0926000000000002e-05 2024-09-12T18:36:48.136 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.136 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.136 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:48.136 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.525325+0000", 2024-09-12T18:36:48.136 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0081661460000000009 2024-09-12T18:36:48.136 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:48.137 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:48.137 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:48.137 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.525362+0000", 2024-09-12T18:36:48.137 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.7345000000000002e-05 2024-09-12T18:36:48.137 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:48.137 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:48.137 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:48.137 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:48.137 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:48.137 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:36:48.138 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is unset 2024-09-12T18:36:48.139 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:48.136+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:48.139 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:36:48.239 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:48.235+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:48.297 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:48.298 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:36:48.298 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.298 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:135389 5.3 5:c65e1d9a:::benchmark_data_smithi073_23739_object3112:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T18:36:48.298 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:48.286634+0000", 2024-09-12T18:36:48.298 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0088080680000000005, 2024-09-12T18:36:48.298 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0088392620000000005, 2024-09-12T18:36:48.298 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:48.298 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:48.298 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:48.298 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:48.299 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:48.299 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:48.299 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 135389 2024-09-12T18:36:48.299 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.299 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:48.299 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.299 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:48.299 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.286634+0000", 2024-09-12T18:36:48.299 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.299 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.299 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.299 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:48.299 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.286634+0000", 2024-09-12T18:36:48.299 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.300 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.300 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.300 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:48.300 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.286635+0000", 2024-09-12T18:36:48.300 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.8000000000000004e-07 2024-09-12T18:36:48.300 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.300 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.300 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:48.300 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.286643+0000", 2024-09-12T18:36:48.300 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0129999999999993e-06 2024-09-12T18:36:48.300 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.300 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.301 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:48.301 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.286655+0000", 2024-09-12T18:36:48.301 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2014000000000001e-05 2024-09-12T18:36:48.301 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.301 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.301 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.301 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.286663+0000", 2024-09-12T18:36:48.301 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8879999999999997e-06 2024-09-12T18:36:48.301 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.301 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.301 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:48.301 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.286742+0000", 2024-09-12T18:36:48.301 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.9158000000000003e-05 2024-09-12T18:36:48.301 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.302 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.302 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:48.302 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.286875+0000", 2024-09-12T18:36:48.302 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000132979 2024-09-12T18:36:48.302 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.302 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.302 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:48.302 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.286983+0000", 2024-09-12T18:36:48.302 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00010838800000000001 2024-09-12T18:36:48.302 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.302 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.302 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:48.302 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.290961+0000", 2024-09-12T18:36:48.303 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0039777600000000003 2024-09-12T18:36:48.303 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.303 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:48.303 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.303 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.303 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.303 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:135390 5.b e54/21 5:daba7a48:::benchmark_data_smithi073_23739_object3113:head v 54'8572, mlcod=54'8567)", 2024-09-12T18:36:48.303 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:48.287733+0000", 2024-09-12T18:36:48.303 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0077091590000000002, 2024-09-12T18:36:48.303 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0078129600000000007, 2024-09-12T18:36:48.303 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:48.303 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:48.303 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:48.304 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:48.304 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.304 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:48.304 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.287733+0000", 2024-09-12T18:36:48.304 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.304 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.304 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.304 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:48.304 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.287733+0000", 2024-09-12T18:36:48.304 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.304 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.304 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.304 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:48.304 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.287733+0000", 2024-09-12T18:36:48.305 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4700000000000001e-07 2024-09-12T18:36:48.305 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.305 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.305 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:48.305 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.287738+0000", 2024-09-12T18:36:48.305 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0350000000000001e-06 2024-09-12T18:36:48.305 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.305 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.305 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:48.305 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.287747+0000", 2024-09-12T18:36:48.305 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7050000000000005e-06 2024-09-12T18:36:48.305 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.305 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.305 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.306 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.287754+0000", 2024-09-12T18:36:48.306 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8340000000000001e-06 2024-09-12T18:36:48.306 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.306 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.306 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:48.306 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.291005+0000", 2024-09-12T18:36:48.306 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0032508749999999999 2024-09-12T18:36:48.307 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.307 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.308 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:48.308 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.291023+0000", 2024-09-12T18:36:48.308 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8202e-05 2024-09-12T18:36:48.308 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.308 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:48.308 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.308 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.308 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.308 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:135398 5.8 e54/21 5:16f73c64:::benchmark_data_smithi073_23739_object3121:head v 54'8291, mlcod=54'8287)", 2024-09-12T18:36:48.308 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:48.291255+0000", 2024-09-12T18:36:48.308 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0041872690000000004, 2024-09-12T18:36:48.308 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0043402279999999998, 2024-09-12T18:36:48.308 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:48.309 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:48.309 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:48.309 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:48.309 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.309 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:48.309 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.291255+0000", 2024-09-12T18:36:48.309 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.309 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.309 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.309 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:48.309 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.291255+0000", 2024-09-12T18:36:48.309 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.309 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.309 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.310 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:48.310 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.291255+0000", 2024-09-12T18:36:48.310 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1200000000000003e-07 2024-09-12T18:36:48.310 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.310 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.310 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:48.310 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.291260+0000", 2024-09-12T18:36:48.310 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.7380000000000002e-06 2024-09-12T18:36:48.310 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.310 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.310 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:48.310 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.291267+0000", 2024-09-12T18:36:48.310 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8059999999999997e-06 2024-09-12T18:36:48.311 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.311 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.311 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.311 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.291271+0000", 2024-09-12T18:36:48.311 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3409999999999996e-06 2024-09-12T18:36:48.311 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.311 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.311 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:48.311 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.291712+0000", 2024-09-12T18:36:48.311 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00044053799999999998 2024-09-12T18:36:48.311 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.311 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.311 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:48.312 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.291731+0000", 2024-09-12T18:36:48.312 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9639999999999998e-05 2024-09-12T18:36:48.312 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.312 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:48.312 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.312 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.312 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.312 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:135400 5.6 5:650c8164:::benchmark_data_smithi073_23739_object3123:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T18:36:48.312 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:48.291520+0000", 2024-09-12T18:36:48.312 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0039218459999999997, 2024-09-12T18:36:48.312 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0041236579999999997, 2024-09-12T18:36:48.312 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:48.312 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:48.312 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:48.313 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:48.313 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:48.313 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:48.313 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 135400 2024-09-12T18:36:48.313 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.313 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:48.313 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.313 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:48.313 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.291520+0000", 2024-09-12T18:36:48.313 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.313 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.313 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.313 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:48.314 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.291520+0000", 2024-09-12T18:36:48.314 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.314 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.314 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.314 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:48.314 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.291521+0000", 2024-09-12T18:36:48.314 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0610000000000001e-06 2024-09-12T18:36:48.314 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.314 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.314 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:48.314 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.291525+0000", 2024-09-12T18:36:48.314 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2100000000000003e-06 2024-09-12T18:36:48.314 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.315 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.315 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:48.315 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.291533+0000", 2024-09-12T18:36:48.315 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.7880000000000007e-06 2024-09-12T18:36:48.315 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.315 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.315 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.315 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.291537+0000", 2024-09-12T18:36:48.315 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.1389999999999997e-06 2024-09-12T18:36:48.315 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.315 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.315 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:48.315 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.291583+0000", 2024-09-12T18:36:48.316 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5646999999999999e-05 2024-09-12T18:36:48.316 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.316 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.316 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:48.316 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.291718+0000", 2024-09-12T18:36:48.316 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013531599999999999 2024-09-12T18:36:48.316 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.316 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.316 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:48.316 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.291833+0000", 2024-09-12T18:36:48.316 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00011487199999999999 2024-09-12T18:36:48.316 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.316 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:48.317 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.317 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.317 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.317 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:135399 5.1 e54/49 5:8acb3b77:::benchmark_data_smithi073_23739_object3122:head v 54'8451, mlcod=54'8448)", 2024-09-12T18:36:48.317 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:48.291823+0000", 2024-09-12T18:36:48.317 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0036189389999999998, 2024-09-12T18:36:48.317 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0038833359999999998, 2024-09-12T18:36:48.317 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:48.317 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:48.317 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:48.317 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:48.317 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.317 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:48.318 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.291823+0000", 2024-09-12T18:36:48.318 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.318 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.318 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.318 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:48.318 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.291823+0000", 2024-09-12T18:36:48.318 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.318 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.318 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.318 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:48.318 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.291824+0000", 2024-09-12T18:36:48.318 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2399999999999997e-07 2024-09-12T18:36:48.318 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.318 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.319 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:48.319 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.291829+0000", 2024-09-12T18:36:48.319 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4199999999999998e-06 2024-09-12T18:36:48.319 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.319 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.319 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:48.319 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.291840+0000", 2024-09-12T18:36:48.319 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0925e-05 2024-09-12T18:36:48.319 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.319 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.319 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.319 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.291846+0000", 2024-09-12T18:36:48.319 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1179999999999997e-06 2024-09-12T18:36:48.320 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.320 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.320 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:48.320 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.291902+0000", 2024-09-12T18:36:48.320 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6258000000000002e-05 2024-09-12T18:36:48.320 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.320 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.320 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:48.320 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.291922+0000", 2024-09-12T18:36:48.320 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9592000000000001e-05 2024-09-12T18:36:48.320 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.320 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:48.321 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.321 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.321 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.321 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:135401 5.4 e54/21 5:25dcd777:::benchmark_data_smithi073_23739_object3124:head v 54'8372, mlcod=54'8370)", 2024-09-12T18:36:48.321 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:48.291854+0000", 2024-09-12T18:36:48.321 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0035879800000000002, 2024-09-12T18:36:48.321 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.003899427, 2024-09-12T18:36:48.321 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:48.321 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:48.321 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:48.321 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:48.321 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.321 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:48.321 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.291854+0000", 2024-09-12T18:36:48.322 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.322 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.322 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.322 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:48.322 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.291854+0000", 2024-09-12T18:36:48.322 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.322 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.322 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.322 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:48.322 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.291855+0000", 2024-09-12T18:36:48.322 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0500000000000002e-07 2024-09-12T18:36:48.322 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.323 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.323 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:48.323 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.291860+0000", 2024-09-12T18:36:48.323 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.169e-06 2024-09-12T18:36:48.323 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.323 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.323 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:48.323 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.291869+0000", 2024-09-12T18:36:48.323 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2259999999999994e-06 2024-09-12T18:36:48.323 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.323 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.323 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.323 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.291876+0000", 2024-09-12T18:36:48.323 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0129999999999996e-06 2024-09-12T18:36:48.324 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.324 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.324 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:48.324 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.291924+0000", 2024-09-12T18:36:48.324 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8236999999999999e-05 2024-09-12T18:36:48.324 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.324 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.325 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:48.325 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.291943+0000", 2024-09-12T18:36:48.325 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8428999999999999e-05 2024-09-12T18:36:48.325 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.325 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:48.325 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.325 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.325 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.325 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:135403 5.3 5:ccdc5202:::benchmark_data_smithi073_23739_object3126:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T18:36:48.325 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:48.292965+0000", 2024-09-12T18:36:48.325 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0024765799999999999, 2024-09-12T18:36:48.325 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0028436690000000001, 2024-09-12T18:36:48.325 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:48.326 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:48.326 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:48.326 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:48.326 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:48.326 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:48.326 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 135403 2024-09-12T18:36:48.326 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.326 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:48.326 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.326 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:48.326 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.292965+0000", 2024-09-12T18:36:48.326 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.326 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.327 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.327 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:48.327 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.292965+0000", 2024-09-12T18:36:48.327 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.327 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.327 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.327 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:48.327 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.292966+0000", 2024-09-12T18:36:48.327 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.265e-06 2024-09-12T18:36:48.327 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.327 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.327 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:48.327 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.292971+0000", 2024-09-12T18:36:48.327 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0200000000000002e-06 2024-09-12T18:36:48.328 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.328 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.328 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:48.328 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.292985+0000", 2024-09-12T18:36:48.328 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3322999999999999e-05 2024-09-12T18:36:48.328 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.328 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.328 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.328 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.292992+0000", 2024-09-12T18:36:48.328 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0670000000000003e-06 2024-09-12T18:36:48.328 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.328 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.328 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:48.329 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.293042+0000", 2024-09-12T18:36:48.329 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0271e-05 2024-09-12T18:36:48.329 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.329 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.329 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:48.329 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.293164+0000", 2024-09-12T18:36:48.329 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012205300000000001 2024-09-12T18:36:48.329 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.329 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.329 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:48.329 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.293269+0000", 2024-09-12T18:36:48.329 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000104722 2024-09-12T18:36:48.329 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.330 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:48.330 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.330 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.330 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.330 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:135404 5.3 5:c62f548c:::benchmark_data_smithi073_23739_object3127:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T18:36:48.330 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:48.293012+0000", 2024-09-12T18:36:48.330 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0024298200000000001, 2024-09-12T18:36:48.330 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0028584510000000001, 2024-09-12T18:36:48.330 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:48.330 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:48.330 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:48.330 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:48.330 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:48.331 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:48.331 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 135404 2024-09-12T18:36:48.331 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.331 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:48.331 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.331 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:48.331 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.293012+0000", 2024-09-12T18:36:48.331 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.331 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.331 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.331 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:48.331 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.293012+0000", 2024-09-12T18:36:48.331 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.331 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.332 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.332 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:48.332 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.293013+0000", 2024-09-12T18:36:48.332 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7800000000000001e-07 2024-09-12T18:36:48.332 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.332 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.332 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:48.332 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.293015+0000", 2024-09-12T18:36:48.332 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.6450000000000001e-06 2024-09-12T18:36:48.332 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.332 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.332 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:48.333 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.293022+0000", 2024-09-12T18:36:48.333 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7410000000000003e-06 2024-09-12T18:36:48.333 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.333 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.333 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.333 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.293027+0000", 2024-09-12T18:36:48.333 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9919999999999998e-06 2024-09-12T18:36:48.333 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.333 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.333 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:48.333 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.295135+0000", 2024-09-12T18:36:48.333 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0021081870000000001 2024-09-12T18:36:48.333 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.334 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.334 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:48.334 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.295234+0000", 2024-09-12T18:36:48.334 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.8875000000000005e-05 2024-09-12T18:36:48.334 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.334 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.334 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:48.334 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.295320+0000", 2024-09-12T18:36:48.334 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5626999999999999e-05 2024-09-12T18:36:48.334 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.334 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:48.334 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.334 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.335 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.335 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:135402 5.b e54/21 5:d5ec648c:::benchmark_data_smithi073_23739_object3125:head v 54'8573, mlcod=54'8570)", 2024-09-12T18:36:48.335 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:48.293185+0000", 2024-09-12T18:36:48.335 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0022570720000000002, 2024-09-12T18:36:48.335 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0027435979999999999, 2024-09-12T18:36:48.335 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:48.335 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:48.335 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:48.335 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:48.335 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.335 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:48.335 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.293185+0000", 2024-09-12T18:36:48.335 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.336 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.336 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.336 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:48.336 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.293185+0000", 2024-09-12T18:36:48.336 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.336 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.336 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.336 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:48.336 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.293185+0000", 2024-09-12T18:36:48.336 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4099999999999998e-07 2024-09-12T18:36:48.336 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.336 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.336 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:48.337 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.293190+0000", 2024-09-12T18:36:48.337 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9790000000000001e-06 2024-09-12T18:36:48.337 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.337 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.337 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:48.337 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.293207+0000", 2024-09-12T18:36:48.337 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7025999999999999e-05 2024-09-12T18:36:48.337 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.337 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.337 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.337 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.293214+0000", 2024-09-12T18:36:48.337 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.562e-06 2024-09-12T18:36:48.337 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.338 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.338 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:48.338 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.295097+0000", 2024-09-12T18:36:48.338 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0018825269999999999 2024-09-12T18:36:48.338 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.338 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.338 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:48.338 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.295108+0000", 2024-09-12T18:36:48.338 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1875000000000001e-05 2024-09-12T18:36:48.338 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.338 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:48.338 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.338 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.338 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.339 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:135389 5.3 e54/21)", 2024-09-12T18:36:48.339 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:48.293324+0000", 2024-09-12T18:36:48.339 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.002117351, 2024-09-12T18:36:48.339 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0026478780000000002, 2024-09-12T18:36:48.339 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:48.339 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:48.339 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:48.339 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:48.339 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.339 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:48.339 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.293324+0000", 2024-09-12T18:36:48.339 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.339 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.339 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.340 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:48.340 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.293324+0000", 2024-09-12T18:36:48.340 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.340 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.340 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.340 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:48.340 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.293325+0000", 2024-09-12T18:36:48.340 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7400000000000003e-07 2024-09-12T18:36:48.340 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.340 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.340 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:48.340 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.293329+0000", 2024-09-12T18:36:48.341 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.7450000000000001e-06 2024-09-12T18:36:48.341 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.341 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.341 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:48.341 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.293337+0000", 2024-09-12T18:36:48.341 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.9789999999999993e-06 2024-09-12T18:36:48.341 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.341 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.341 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.341 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:48.293343+0000", 2024-09-12T18:36:48.341 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3740000000000003e-06 2024-09-12T18:36:48.341 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.341 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:48.341 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.342 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.342 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-12T18:36:48.342 INFO:teuthology.orchestra.run.smithi114.stdout: "num_ops": 10 2024-09-12T18:36:48.342 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:48.343 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:36:48.344 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:48.339+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:48.444 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:48.439+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:48.543 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:48.544 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2024-09-12T18:36:48.544 INFO:teuthology.orchestra.run.smithi114.stdout: "complaint_time": 30, 2024-09-12T18:36:48.544 INFO:teuthology.orchestra.run.smithi114.stdout: "num_blocked_ops": 0 2024-09-12T18:36:48.544 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:48.545 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:48.540+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:48.564 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:36:48.651 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:48.647+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:48.747 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:48.739+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:48.765 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:48.765 INFO:teuthology.orchestra.run.smithi114.stdout: "size": 20, 2024-09-12T18:36:48.765 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 600, 2024-09-12T18:36:48.765 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:36:48.765 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.766 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:48.766 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:48.766 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 83.133601564000003, 2024-09-12T18:36:48.766 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.042475618999999999, 2024-09-12T18:36:48.766 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:48.766 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:48.766 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:48.766 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:48.766 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.766 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:48.766 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:48.766 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.766 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.766 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.767 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:48.767 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:48.767 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.767 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.767 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.767 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:48.767 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628450+0000", 2024-09-12T18:36:48.767 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4212999999999999e-05 2024-09-12T18:36:48.767 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.767 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.767 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:48.767 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628463+0000", 2024-09-12T18:36:48.768 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2497000000000001e-05 2024-09-12T18:36:48.768 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.768 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.768 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:48.768 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628480+0000", 2024-09-12T18:36:48.768 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7232999999999999e-05 2024-09-12T18:36:48.768 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.768 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.768 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.768 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628496+0000", 2024-09-12T18:36:48.768 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6217000000000001e-05 2024-09-12T18:36:48.768 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.768 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.769 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:48.769 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628641+0000", 2024-09-12T18:36:48.769 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000144709 2024-09-12T18:36:48.769 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.769 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.769 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:48.769 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628657+0000", 2024-09-12T18:36:48.769 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6266e-05 2024-09-12T18:36:48.769 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.769 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.769 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:48.769 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663103+0000", 2024-09-12T18:36:48.769 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.034445523999999998 2024-09-12T18:36:48.769 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.770 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.770 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:48.770 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663373+0000", 2024-09-12T18:36:48.770 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00027085500000000002 2024-09-12T18:36:48.770 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.770 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.770 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:48.770 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663634+0000", 2024-09-12T18:36:48.770 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000260855 2024-09-12T18:36:48.770 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.770 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.770 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:48.770 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670294+0000", 2024-09-12T18:36:48.770 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0066597599999999998 2024-09-12T18:36:48.771 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.771 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.771 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:48.771 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670705+0000", 2024-09-12T18:36:48.771 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00041057099999999998 2024-09-12T18:36:48.771 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.771 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.771 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:48.771 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670820+0000", 2024-09-12T18:36:48.771 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000115111 2024-09-12T18:36:48.771 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.771 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.771 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:48.772 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670912+0000", 2024-09-12T18:36:48.772 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1807999999999999e-05 2024-09-12T18:36:48.772 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.772 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:48.772 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.772 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.772 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.772 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:48.772 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:48.772 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 83.133510818000005, 2024-09-12T18:36:48.772 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.044599273000000002, 2024-09-12T18:36:48.772 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:48.772 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:48.773 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:48.773 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:48.773 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.773 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:48.773 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:48.773 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.773 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.773 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.773 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:48.773 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:48.773 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.773 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.773 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.774 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:48.774 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628528+0000", 2024-09-12T18:36:48.774 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:48.774 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.774 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.774 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:48.774 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628537+0000", 2024-09-12T18:36:48.774 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6969999999999999e-06 2024-09-12T18:36:48.774 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.774 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.774 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:48.774 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628560+0000", 2024-09-12T18:36:48.774 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2889000000000001e-05 2024-09-12T18:36:48.775 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.775 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.775 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.775 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628576+0000", 2024-09-12T18:36:48.775 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.649e-05 2024-09-12T18:36:48.775 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.775 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.775 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:48.775 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628846+0000", 2024-09-12T18:36:48.775 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00026952500000000001 2024-09-12T18:36:48.775 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.775 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.775 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:48.776 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628853+0000", 2024-09-12T18:36:48.776 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6559999999999992e-06 2024-09-12T18:36:48.776 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.776 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.776 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:48.776 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665284+0000", 2024-09-12T18:36:48.776 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.036431140000000001 2024-09-12T18:36:48.776 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.776 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.776 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:48.776 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665494+0000", 2024-09-12T18:36:48.776 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000209762 2024-09-12T18:36:48.776 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.776 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.777 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:48.777 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665816+0000", 2024-09-12T18:36:48.777 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00032162299999999999 2024-09-12T18:36:48.777 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.777 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.777 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:48.777 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670382+0000", 2024-09-12T18:36:48.777 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0045656739999999996 2024-09-12T18:36:48.777 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.777 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.777 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:48.777 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.672978+0000", 2024-09-12T18:36:48.777 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.002596068 2024-09-12T18:36:48.778 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.778 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.778 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:48.778 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673058+0000", 2024-09-12T18:36:48.778 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0198999999999996e-05 2024-09-12T18:36:48.778 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.778 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.778 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:48.778 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673126+0000", 2024-09-12T18:36:48.778 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8120000000000005e-05 2024-09-12T18:36:48.778 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.778 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:48.778 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.778 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.779 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.779 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:23 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:48.779 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:48.779 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 83.133413012000005, 2024-09-12T18:36:48.779 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045539784, 2024-09-12T18:36:48.779 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:48.779 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:48.779 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:48.779 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:48.779 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.779 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:48.779 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:48.779 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.780 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.780 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.780 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:48.780 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:48.780 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.780 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.780 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.780 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:48.780 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628626+0000", 2024-09-12T18:36:48.780 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.573e-06 2024-09-12T18:36:48.780 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.780 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.780 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:48.781 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628640+0000", 2024-09-12T18:36:48.781 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3817e-05 2024-09-12T18:36:48.781 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.781 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.781 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:48.781 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628659+0000", 2024-09-12T18:36:48.781 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9539999999999999e-05 2024-09-12T18:36:48.781 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.781 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.781 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.781 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628675+0000", 2024-09-12T18:36:48.781 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5739e-05 2024-09-12T18:36:48.781 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.782 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.782 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:48.782 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628815+0000", 2024-09-12T18:36:48.782 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014003299999999999 2024-09-12T18:36:48.782 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.782 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.782 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:48.782 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628828+0000", 2024-09-12T18:36:48.782 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2849e-05 2024-09-12T18:36:48.782 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.782 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.782 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:48.782 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651162+0000", 2024-09-12T18:36:48.783 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.022334228000000001 2024-09-12T18:36:48.783 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.783 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.783 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:48.783 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651446+0000", 2024-09-12T18:36:48.783 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00028392800000000002 2024-09-12T18:36:48.783 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.783 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.783 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:48.783 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651746+0000", 2024-09-12T18:36:48.783 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000300091 2024-09-12T18:36:48.783 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.783 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.784 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:48.784 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665113+0000", 2024-09-12T18:36:48.784 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013366678 2024-09-12T18:36:48.784 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.784 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.784 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:48.784 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674010+0000", 2024-09-12T18:36:48.784 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0088970520000000008 2024-09-12T18:36:48.784 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.784 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.784 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:48.784 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674104+0000", 2024-09-12T18:36:48.784 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4124999999999998e-05 2024-09-12T18:36:48.785 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.785 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.785 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:48.785 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674164+0000", 2024-09-12T18:36:48.785 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.0130999999999997e-05 2024-09-12T18:36:48.785 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.785 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:48.785 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.785 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.785 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.785 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:26 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:48.785 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:48.785 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 83.133339805999995, 2024-09-12T18:36:48.785 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045702136999999997, 2024-09-12T18:36:48.786 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:48.786 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:48.786 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:48.786 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:48.786 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.786 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:48.786 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:48.786 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.786 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.786 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.786 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:48.786 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:48.786 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.787 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.787 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.787 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:48.787 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628699+0000", 2024-09-12T18:36:48.787 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3859999999999999e-06 2024-09-12T18:36:48.787 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.787 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.787 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:48.787 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628706+0000", 2024-09-12T18:36:48.787 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0169999999999999e-06 2024-09-12T18:36:48.787 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.787 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.787 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:48.787 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628725+0000", 2024-09-12T18:36:48.788 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8683000000000001e-05 2024-09-12T18:36:48.788 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.788 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.788 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.788 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628740+0000", 2024-09-12T18:36:48.788 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5413999999999998e-05 2024-09-12T18:36:48.788 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.788 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.788 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:48.788 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628907+0000", 2024-09-12T18:36:48.788 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00016670199999999999 2024-09-12T18:36:48.788 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.788 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.789 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:48.789 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628917+0000", 2024-09-12T18:36:48.789 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.046e-05 2024-09-12T18:36:48.789 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.789 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.789 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:48.789 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.660390+0000", 2024-09-12T18:36:48.789 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.031472364000000003 2024-09-12T18:36:48.789 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.789 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.789 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:48.789 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.661767+0000", 2024-09-12T18:36:48.789 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0013769190000000001 2024-09-12T18:36:48.790 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.790 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.790 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:48.790 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.662408+0000", 2024-09-12T18:36:48.790 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00064091099999999998 2024-09-12T18:36:48.790 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.790 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.790 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:48.790 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669577+0000", 2024-09-12T18:36:48.790 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.007169412 2024-09-12T18:36:48.790 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.790 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.790 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:48.790 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674244+0000", 2024-09-12T18:36:48.791 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0046671839999999996 2024-09-12T18:36:48.791 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.791 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.791 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:48.791 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674329+0000", 2024-09-12T18:36:48.791 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5276000000000001e-05 2024-09-12T18:36:48.791 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.791 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.791 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:48.791 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674400+0000", 2024-09-12T18:36:48.791 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0408999999999996e-05 2024-09-12T18:36:48.791 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.791 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:48.791 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.792 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.792 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.792 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:48.792 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:48.792 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 83.133232136999993, 2024-09-12T18:36:48.792 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.044572443000000003, 2024-09-12T18:36:48.792 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:48.792 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:48.792 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:48.792 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:48.792 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.792 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:48.792 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:48.793 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.793 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.793 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.793 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:48.793 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:48.793 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.793 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.793 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.793 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:48.793 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628807+0000", 2024-09-12T18:36:48.793 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3629999999999999e-06 2024-09-12T18:36:48.793 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.793 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.793 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:48.794 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628814+0000", 2024-09-12T18:36:48.794 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.2099999999999996e-06 2024-09-12T18:36:48.794 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.794 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.794 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:48.794 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628832+0000", 2024-09-12T18:36:48.794 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7972999999999999e-05 2024-09-12T18:36:48.794 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.794 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.794 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.794 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628854+0000", 2024-09-12T18:36:48.794 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1857000000000001e-05 2024-09-12T18:36:48.794 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.795 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.795 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:48.795 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628984+0000", 2024-09-12T18:36:48.795 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013013599999999999 2024-09-12T18:36:48.795 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.795 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.795 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:48.795 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628993+0000", 2024-09-12T18:36:48.795 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:36:48.795 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.795 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.795 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:48.795 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668176+0000", 2024-09-12T18:36:48.796 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.039182211000000002 2024-09-12T18:36:48.796 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.796 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.796 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:48.796 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668481+0000", 2024-09-12T18:36:48.796 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00030499200000000002 2024-09-12T18:36:48.796 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.796 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.796 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:48.796 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668771+0000", 2024-09-12T18:36:48.796 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00029018700000000002 2024-09-12T18:36:48.796 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.796 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.797 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:48.797 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.672674+0000", 2024-09-12T18:36:48.797 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0039031890000000001 2024-09-12T18:36:48.797 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.797 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.797 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:48.797 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673214+0000", 2024-09-12T18:36:48.797 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00053981600000000004 2024-09-12T18:36:48.797 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.797 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.797 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:48.797 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673310+0000", 2024-09-12T18:36:48.797 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.6682999999999996e-05 2024-09-12T18:36:48.798 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.798 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.798 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:48.798 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673378+0000", 2024-09-12T18:36:48.798 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7385999999999995e-05 2024-09-12T18:36:48.798 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.798 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:48.798 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.798 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.798 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.798 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:48.798 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:48.798 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 83.133096111, 2024-09-12T18:36:48.798 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.041480853999999998, 2024-09-12T18:36:48.799 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:48.799 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:48.799 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:48.799 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:48.799 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.799 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:48.799 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:48.799 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.799 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.799 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.799 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:48.799 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:48.799 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.800 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.800 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.800 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:48.800 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628943+0000", 2024-09-12T18:36:48.800 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.403e-06 2024-09-12T18:36:48.800 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.800 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.800 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:48.800 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628953+0000", 2024-09-12T18:36:48.800 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0273e-05 2024-09-12T18:36:48.800 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.800 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.800 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:48.801 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628973+0000", 2024-09-12T18:36:48.801 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9959999999999999e-05 2024-09-12T18:36:48.801 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.801 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.801 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.801 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628989+0000", 2024-09-12T18:36:48.801 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6447e-05 2024-09-12T18:36:48.801 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.801 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.801 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:48.801 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629144+0000", 2024-09-12T18:36:48.801 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015468900000000001 2024-09-12T18:36:48.801 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.802 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.802 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:48.802 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629162+0000", 2024-09-12T18:36:48.802 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7603000000000001e-05 2024-09-12T18:36:48.802 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.802 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.802 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:48.802 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.646927+0000", 2024-09-12T18:36:48.802 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.017765626 2024-09-12T18:36:48.802 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.802 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.802 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:48.802 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.647245+0000", 2024-09-12T18:36:48.802 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00031797699999999999 2024-09-12T18:36:48.803 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.803 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.803 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:48.803 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.647551+0000", 2024-09-12T18:36:48.803 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00030583500000000002 2024-09-12T18:36:48.803 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.803 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.803 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:48.803 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651738+0000", 2024-09-12T18:36:48.803 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0041864980000000003 2024-09-12T18:36:48.803 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.803 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.803 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:48.803 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670207+0000", 2024-09-12T18:36:48.804 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018469299000000002 2024-09-12T18:36:48.804 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.804 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.804 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:48.804 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670330+0000", 2024-09-12T18:36:48.804 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012284500000000001 2024-09-12T18:36:48.804 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.804 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.804 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:48.804 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670422+0000", 2024-09-12T18:36:48.804 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2398999999999994e-05 2024-09-12T18:36:48.804 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.804 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:48.804 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.805 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.805 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.805 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:48.805 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:48.805 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 83.133018858, 2024-09-12T18:36:48.805 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.041623741999999998, 2024-09-12T18:36:48.805 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:48.805 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:48.805 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:48.805 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:48.805 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.805 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:48.805 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:48.805 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.806 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.806 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.806 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:48.806 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:48.806 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.806 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.806 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.806 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:48.806 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629020+0000", 2024-09-12T18:36:48.806 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.15e-06 2024-09-12T18:36:48.806 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.806 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.806 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:48.806 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629023+0000", 2024-09-12T18:36:48.807 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4659999999999999e-06 2024-09-12T18:36:48.807 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.807 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.807 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:48.807 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629037+0000", 2024-09-12T18:36:48.807 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3857e-05 2024-09-12T18:36:48.807 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.807 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.807 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.807 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629062+0000", 2024-09-12T18:36:48.807 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4519999999999999e-05 2024-09-12T18:36:48.807 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.807 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.807 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:48.808 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629253+0000", 2024-09-12T18:36:48.808 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000191335 2024-09-12T18:36:48.808 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.808 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.808 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:48.808 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629266+0000", 2024-09-12T18:36:48.808 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3322999999999999e-05 2024-09-12T18:36:48.808 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.808 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.808 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:48.808 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648331+0000", 2024-09-12T18:36:48.808 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.019065060000000002 2024-09-12T18:36:48.808 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.809 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.809 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:48.809 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.650044+0000", 2024-09-12T18:36:48.809 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017123959999999999 2024-09-12T18:36:48.809 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.809 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.809 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:48.809 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670642+0000", 2024-09-12T18:36:48.809 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.020598635000000001 2024-09-12T18:36:48.809 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.809 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:48.809 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.809 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.810 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.810 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:48.810 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:48.810 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 83.132915526000005, 2024-09-12T18:36:48.810 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.046431252999999999, 2024-09-12T18:36:48.810 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:48.810 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:48.810 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:48.810 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:48.810 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.810 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:48.810 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:48.810 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.810 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.811 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.811 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:48.811 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:48.811 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.811 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.811 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.811 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:48.811 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629123+0000", 2024-09-12T18:36:48.811 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0899999999999999e-06 2024-09-12T18:36:48.811 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.811 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.811 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:48.811 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629138+0000", 2024-09-12T18:36:48.811 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4977000000000001e-05 2024-09-12T18:36:48.812 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.812 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.812 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:48.812 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629149+0000", 2024-09-12T18:36:48.812 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1182999999999999e-05 2024-09-12T18:36:48.812 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.812 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.812 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.812 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629157+0000", 2024-09-12T18:36:48.812 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8129999999999996e-06 2024-09-12T18:36:48.812 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.812 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.812 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:48.813 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629223+0000", 2024-09-12T18:36:48.813 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6463000000000004e-05 2024-09-12T18:36:48.813 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.813 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.813 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:48.813 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629230+0000", 2024-09-12T18:36:48.813 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1360000000000002e-06 2024-09-12T18:36:48.813 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.813 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.813 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:48.813 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669605+0000", 2024-09-12T18:36:48.813 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.040375518999999999 2024-09-12T18:36:48.813 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.814 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.814 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:48.814 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669840+0000", 2024-09-12T18:36:48.814 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00023520099999999999 2024-09-12T18:36:48.814 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.814 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.814 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:48.814 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.675553+0000", 2024-09-12T18:36:48.814 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0057128709999999996 2024-09-12T18:36:48.814 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.814 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:48.814 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.814 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.815 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.815 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:48.815 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:48.815 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 83.132860859000004, 2024-09-12T18:36:48.815 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.037357044999999998, 2024-09-12T18:36:48.815 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:48.815 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:48.815 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:48.815 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:48.815 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.815 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:48.815 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:48.815 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.815 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.816 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.816 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:48.816 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:48.816 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.816 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.816 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.816 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:48.816 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629178+0000", 2024-09-12T18:36:48.816 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.08e-06 2024-09-12T18:36:48.816 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.816 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.816 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:48.816 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629194+0000", 2024-09-12T18:36:48.817 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5899000000000001e-05 2024-09-12T18:36:48.817 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.817 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.817 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:48.817 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629211+0000", 2024-09-12T18:36:48.817 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7363e-05 2024-09-12T18:36:48.817 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.817 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.817 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.817 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629226+0000", 2024-09-12T18:36:48.817 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4567e-05 2024-09-12T18:36:48.817 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.818 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.818 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:48.818 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629299+0000", 2024-09-12T18:36:48.818 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3910000000000002e-05 2024-09-12T18:36:48.818 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.818 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.818 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:48.818 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629307+0000", 2024-09-12T18:36:48.818 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5299999999999999e-06 2024-09-12T18:36:48.818 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.818 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.818 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:48.818 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648185+0000", 2024-09-12T18:36:48.819 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018878533999999999 2024-09-12T18:36:48.819 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.819 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.819 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:48.819 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.649724+0000", 2024-09-12T18:36:48.819 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001538841 2024-09-12T18:36:48.819 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.819 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.819 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:48.819 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.666534+0000", 2024-09-12T18:36:48.819 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.016809320999999999 2024-09-12T18:36:48.819 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.819 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:48.820 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.820 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.820 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.820 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:80967 5.a 5:5f4000f6:::benchmark_data_smithi073_23739_object80966:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T18:36:48.820 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:18.561016+0000", 2024-09-12T18:36:48.820 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 30.201021264000001, 2024-09-12T18:36:48.820 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021780831, 2024-09-12T18:36:48.820 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:48.820 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:48.820 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:48.820 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:48.820 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:48.820 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:48.821 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 80967 2024-09-12T18:36:48.821 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.821 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:48.821 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.821 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:48.821 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561016+0000", 2024-09-12T18:36:48.821 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.821 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.821 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.821 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:48.821 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561016+0000", 2024-09-12T18:36:48.821 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.821 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.821 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.822 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:48.822 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561017+0000", 2024-09-12T18:36:48.822 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7599999999999997e-07 2024-09-12T18:36:48.822 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.822 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.822 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:48.822 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561050+0000", 2024-09-12T18:36:48.822 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3524e-05 2024-09-12T18:36:48.822 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.822 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.822 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:48.822 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561058+0000", 2024-09-12T18:36:48.822 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0679999999999997e-06 2024-09-12T18:36:48.823 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.823 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.823 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.823 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561065+0000", 2024-09-12T18:36:48.823 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1990000000000003e-06 2024-09-12T18:36:48.823 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.823 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.823 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:48.823 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564735+0000", 2024-09-12T18:36:48.823 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0036706740000000001 2024-09-12T18:36:48.823 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.823 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.823 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:48.823 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564868+0000", 2024-09-12T18:36:48.824 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000133003 2024-09-12T18:36:48.824 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.824 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.824 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:48.824 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.565010+0000", 2024-09-12T18:36:48.824 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014224300000000001 2024-09-12T18:36:48.824 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.824 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.824 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:48.824 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.569871+0000", 2024-09-12T18:36:48.824 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0048600759999999996 2024-09-12T18:36:48.824 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.825 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.825 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:48.825 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.582729+0000", 2024-09-12T18:36:48.825 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012858090000000001 2024-09-12T18:36:48.825 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.825 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.825 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:48.825 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.582758+0000", 2024-09-12T18:36:48.825 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.9762999999999999e-05 2024-09-12T18:36:48.825 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.825 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.825 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:48.825 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.582797+0000", 2024-09-12T18:36:48.825 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8615000000000002e-05 2024-09-12T18:36:48.826 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.826 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:48.826 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.826 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.826 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.826 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:108511 5.6 5:608a30a3:::benchmark_data_smithi073_23739_object108510:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:36:48.826 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:31.986730+0000", 2024-09-12T18:36:48.826 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 16.775307390000002, 2024-09-12T18:36:48.826 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021507117999999999, 2024-09-12T18:36:48.827 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:48.827 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:48.827 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:48.827 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:48.827 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:48.827 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:48.827 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 108511 2024-09-12T18:36:48.827 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.827 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:48.827 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.827 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:48.827 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986730+0000", 2024-09-12T18:36:48.827 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.828 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.828 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.828 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:48.828 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986730+0000", 2024-09-12T18:36:48.828 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.828 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.828 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.828 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:48.828 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986731+0000", 2024-09-12T18:36:48.828 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.9100000000000003e-07 2024-09-12T18:36:48.828 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.828 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.828 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:48.828 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986804+0000", 2024-09-12T18:36:48.829 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3647999999999997e-05 2024-09-12T18:36:48.829 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.829 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.829 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:48.829 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986812+0000", 2024-09-12T18:36:48.829 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.34e-06 2024-09-12T18:36:48.829 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.829 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.829 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.829 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986836+0000", 2024-09-12T18:36:48.829 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4213e-05 2024-09-12T18:36:48.829 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.829 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.830 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:48.830 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.997047+0000", 2024-09-12T18:36:48.830 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.010210649 2024-09-12T18:36:48.830 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.830 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.830 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:48.830 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.997169+0000", 2024-09-12T18:36:48.830 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012269700000000001 2024-09-12T18:36:48.830 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.830 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.830 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:48.830 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.997300+0000", 2024-09-12T18:36:48.830 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000130858 2024-09-12T18:36:48.830 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.831 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.831 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:48.831 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.002398+0000", 2024-09-12T18:36:48.831 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0050981580000000002 2024-09-12T18:36:48.831 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.831 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.831 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:48.831 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.008093+0000", 2024-09-12T18:36:48.831 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0056941930000000002 2024-09-12T18:36:48.831 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.831 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.831 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:48.831 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.008151+0000", 2024-09-12T18:36:48.832 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8328999999999997e-05 2024-09-12T18:36:48.832 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.832 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.832 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:48.832 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.008237+0000", 2024-09-12T18:36:48.832 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6341999999999994e-05 2024-09-12T18:36:48.832 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.832 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:48.832 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.832 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.832 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.832 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:108623 5.c 5:33792cd3:::benchmark_data_smithi073_23739_object108622:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:36:48.832 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:32.046609+0000", 2024-09-12T18:36:48.832 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 16.715428614, 2024-09-12T18:36:48.833 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021062860999999999, 2024-09-12T18:36:48.833 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:48.833 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:48.833 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:48.833 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:48.833 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:48.833 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:48.833 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 108623 2024-09-12T18:36:48.833 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.833 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:48.833 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.833 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:48.833 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.046609+0000", 2024-09-12T18:36:48.834 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.834 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.834 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.834 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:48.834 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.046609+0000", 2024-09-12T18:36:48.834 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.834 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.834 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.834 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:48.834 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.046609+0000", 2024-09-12T18:36:48.834 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.37e-07 2024-09-12T18:36:48.834 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.834 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.834 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:48.835 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.046690+0000", 2024-09-12T18:36:48.835 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0212999999999999e-05 2024-09-12T18:36:48.835 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.835 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.835 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:48.835 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.046698+0000", 2024-09-12T18:36:48.835 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6430000000000001e-06 2024-09-12T18:36:48.835 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.835 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.835 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.835 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.046704+0000", 2024-09-12T18:36:48.835 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7699999999999998e-06 2024-09-12T18:36:48.835 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.835 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.836 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:48.836 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.056808+0000", 2024-09-12T18:36:48.836 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.010103562999999999 2024-09-12T18:36:48.836 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.836 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.836 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:48.836 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.056989+0000", 2024-09-12T18:36:48.836 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000181196 2024-09-12T18:36:48.836 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.836 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.836 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:48.836 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.057162+0000", 2024-09-12T18:36:48.836 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000173396 2024-09-12T18:36:48.837 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.837 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.837 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:48.837 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.063269+0000", 2024-09-12T18:36:48.837 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0061066100000000002 2024-09-12T18:36:48.837 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.837 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.837 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:48.837 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.067578+0000", 2024-09-12T18:36:48.837 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0043092570000000004 2024-09-12T18:36:48.837 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.837 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.837 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:48.837 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.067628+0000", 2024-09-12T18:36:48.838 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0136999999999998e-05 2024-09-12T18:36:48.838 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.838 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.838 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:48.838 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.067672+0000", 2024-09-12T18:36:48.838 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3439000000000002e-05 2024-09-12T18:36:48.838 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.838 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:48.838 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.838 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.838 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.838 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:121033 5.0 e50/49 5:0b3817c1:::benchmark_data_smithi073_23739_object121032:head v 50'7620, mlcod=0'0)", 2024-09-12T18:36:48.838 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:40.165057+0000", 2024-09-12T18:36:48.839 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 8.5969808919999995, 2024-09-12T18:36:48.839 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.030641286, 2024-09-12T18:36:48.839 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:48.839 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:48.839 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:48.839 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:48.839 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.839 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:48.839 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.165057+0000", 2024-09-12T18:36:48.839 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.839 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.839 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.839 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:48.839 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.165057+0000", 2024-09-12T18:36:48.840 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.840 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.840 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.840 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:48.840 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.165057+0000", 2024-09-12T18:36:48.840 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8599999999999998e-07 2024-09-12T18:36:48.840 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.840 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.840 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:48.840 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.165109+0000", 2024-09-12T18:36:48.840 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2086000000000002e-05 2024-09-12T18:36:48.840 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.840 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.841 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:48.841 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.165161+0000", 2024-09-12T18:36:48.841 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1415000000000002e-05 2024-09-12T18:36:48.841 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.841 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.841 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.841 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.165178+0000", 2024-09-12T18:36:48.841 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7790000000000001e-05 2024-09-12T18:36:48.841 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.841 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.841 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:48.841 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.168784+0000", 2024-09-12T18:36:48.841 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0036052050000000002 2024-09-12T18:36:48.841 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.842 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.842 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:48.842 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.168854+0000", 2024-09-12T18:36:48.842 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0814000000000003e-05 2024-09-12T18:36:48.842 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.842 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.842 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:48.842 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.195600+0000", 2024-09-12T18:36:48.842 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.026745173000000001 2024-09-12T18:36:48.842 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.842 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.842 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:48.842 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.195698+0000", 2024-09-12T18:36:48.843 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.8317000000000001e-05 2024-09-12T18:36:48.843 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.843 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:48.843 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.843 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.843 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.843 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:121044 5.1 e50/49 5:83bf711a:::benchmark_data_smithi073_23739_object121043:head v 50'7532, mlcod=0'0)", 2024-09-12T18:36:48.843 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:40.200337+0000", 2024-09-12T18:36:48.843 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 8.5617008909999992, 2024-09-12T18:36:48.843 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.023483312999999999, 2024-09-12T18:36:48.843 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:48.843 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:48.843 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:48.843 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:48.844 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.844 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:48.844 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200337+0000", 2024-09-12T18:36:48.844 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.844 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.844 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.844 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:48.844 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200337+0000", 2024-09-12T18:36:48.844 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.844 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.844 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.844 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:48.844 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200338+0000", 2024-09-12T18:36:48.845 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.877e-06 2024-09-12T18:36:48.845 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.845 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.845 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:48.845 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200558+0000", 2024-09-12T18:36:48.845 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00021912799999999999 2024-09-12T18:36:48.845 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.845 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.845 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:48.845 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200584+0000", 2024-09-12T18:36:48.845 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.6333e-05 2024-09-12T18:36:48.845 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.845 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.846 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.846 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200602+0000", 2024-09-12T18:36:48.846 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.853e-05 2024-09-12T18:36:48.846 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.846 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.846 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:48.846 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200753+0000", 2024-09-12T18:36:48.846 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015061299999999999 2024-09-12T18:36:48.846 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.846 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.846 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:48.846 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200790+0000", 2024-09-12T18:36:48.846 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.7398999999999999e-05 2024-09-12T18:36:48.846 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.847 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.847 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:48.847 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.223743+0000", 2024-09-12T18:36:48.847 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.022952455 2024-09-12T18:36:48.847 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.847 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.847 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:48.847 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.223820+0000", 2024-09-12T18:36:48.847 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6977999999999994e-05 2024-09-12T18:36:48.847 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.847 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:48.847 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.847 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.847 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.848 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:121110 5.2 e50/21 5:4dc37b93:::benchmark_data_smithi073_23739_object121109:head v 50'7513, mlcod=48'7511)", 2024-09-12T18:36:48.848 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:40.241103+0000", 2024-09-12T18:36:48.848 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 8.5209348499999997, 2024-09-12T18:36:48.848 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021833894, 2024-09-12T18:36:48.848 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:48.848 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:48.848 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:48.848 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:48.848 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.848 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:48.848 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241103+0000", 2024-09-12T18:36:48.848 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.848 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.849 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.849 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:48.849 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241103+0000", 2024-09-12T18:36:48.849 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.849 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.849 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.849 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:48.849 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241104+0000", 2024-09-12T18:36:48.849 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.7999999999999993e-07 2024-09-12T18:36:48.849 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.849 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.849 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:48.849 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241162+0000", 2024-09-12T18:36:48.849 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8319000000000002e-05 2024-09-12T18:36:48.850 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.850 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.850 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:48.850 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241181+0000", 2024-09-12T18:36:48.850 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9055999999999998e-05 2024-09-12T18:36:48.850 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.850 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.850 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.850 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241191+0000", 2024-09-12T18:36:48.850 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.9359999999999994e-06 2024-09-12T18:36:48.850 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.850 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.850 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:48.850 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241305+0000", 2024-09-12T18:36:48.851 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000114134 2024-09-12T18:36:48.851 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.851 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.851 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:48.851 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241372+0000", 2024-09-12T18:36:48.851 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6521999999999998e-05 2024-09-12T18:36:48.851 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.851 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.851 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:48.851 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.262837+0000", 2024-09-12T18:36:48.851 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021465766000000001 2024-09-12T18:36:48.851 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.851 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.851 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:48.852 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.262937+0000", 2024-09-12T18:36:48.852 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.9180999999999998e-05 2024-09-12T18:36:48.852 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.852 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:48.852 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.852 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.852 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.852 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:121160 5.b e50/21 5:d4730c8e:::benchmark_data_smithi073_23739_object121159:head v 50'7640, mlcod=47'7638)", 2024-09-12T18:36:48.852 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:40.289729+0000", 2024-09-12T18:36:48.852 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 8.4723083040000002, 2024-09-12T18:36:48.852 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021365733000000001, 2024-09-12T18:36:48.852 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:48.852 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:48.853 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:48.853 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:48.853 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.853 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:48.853 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.289729+0000", 2024-09-12T18:36:48.853 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.853 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.853 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.853 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:48.853 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.289729+0000", 2024-09-12T18:36:48.853 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.853 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.853 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.853 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:48.854 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.289730+0000", 2024-09-12T18:36:48.854 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1799999999999995e-07 2024-09-12T18:36:48.854 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.854 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.854 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:48.854 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.289831+0000", 2024-09-12T18:36:48.854 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000101122 2024-09-12T18:36:48.854 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.854 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.854 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:48.855 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.289847+0000", 2024-09-12T18:36:48.855 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5787999999999999e-05 2024-09-12T18:36:48.855 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.855 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.855 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.855 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.289859+0000", 2024-09-12T18:36:48.855 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2439000000000001e-05 2024-09-12T18:36:48.855 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.855 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.855 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:48.855 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.289998+0000", 2024-09-12T18:36:48.855 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000138725 2024-09-12T18:36:48.855 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.856 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.856 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:48.856 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.290055+0000", 2024-09-12T18:36:48.856 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7166000000000001e-05 2024-09-12T18:36:48.856 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.856 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.856 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:48.856 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.311028+0000", 2024-09-12T18:36:48.856 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.020972602 2024-09-12T18:36:48.856 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.856 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.856 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:48.856 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.311095+0000", 2024-09-12T18:36:48.856 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7273000000000005e-05 2024-09-12T18:36:48.857 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.857 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:48.857 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.857 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.857 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.857 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:131544 5.6 5:6ce76cfc:::benchmark_data_smithi073_23739_object131543:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:36:48.857 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:45.497129+0000", 2024-09-12T18:36:48.857 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 3.2649083389999998, 2024-09-12T18:36:48.857 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.02367524, 2024-09-12T18:36:48.857 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:48.857 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:48.857 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:48.857 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:48.858 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:48.858 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:48.858 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 131544 2024-09-12T18:36:48.858 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.858 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:48.858 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.858 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:48.858 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497129+0000", 2024-09-12T18:36:48.858 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.858 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.858 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.858 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:48.858 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497129+0000", 2024-09-12T18:36:48.858 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.859 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.859 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.859 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:48.859 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497130+0000", 2024-09-12T18:36:48.859 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1620000000000001e-06 2024-09-12T18:36:48.859 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.859 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.859 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:48.859 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497205+0000", 2024-09-12T18:36:48.859 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4707000000000001e-05 2024-09-12T18:36:48.859 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.859 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.859 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:48.860 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497216+0000", 2024-09-12T18:36:48.860 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1362999999999999e-05 2024-09-12T18:36:48.860 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.860 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.860 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.860 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497225+0000", 2024-09-12T18:36:48.860 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7050000000000005e-06 2024-09-12T18:36:48.860 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.860 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.860 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:48.860 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.498575+0000", 2024-09-12T18:36:48.860 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0013500319999999999 2024-09-12T18:36:48.860 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.860 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.861 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:48.861 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.498712+0000", 2024-09-12T18:36:48.861 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013682200000000001 2024-09-12T18:36:48.861 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.861 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.861 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:48.861 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.498954+0000", 2024-09-12T18:36:48.861 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00024196499999999999 2024-09-12T18:36:48.861 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.861 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.861 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:48.861 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.503854+0000", 2024-09-12T18:36:48.861 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0049002020000000002 2024-09-12T18:36:48.861 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.862 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.862 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:48.862 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.520739+0000", 2024-09-12T18:36:48.862 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.016884698 2024-09-12T18:36:48.862 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.862 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.862 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:48.862 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.520775+0000", 2024-09-12T18:36:48.862 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.5941e-05 2024-09-12T18:36:48.862 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.862 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.862 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:48.862 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.520804+0000", 2024-09-12T18:36:48.862 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.9643000000000001e-05 2024-09-12T18:36:48.863 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.863 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:48.863 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.863 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.863 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.863 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:131545 5.6 5:6da49e54:::benchmark_data_smithi073_23739_object131544:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:36:48.863 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:45.497399+0000", 2024-09-12T18:36:48.863 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 3.2646387199999998, 2024-09-12T18:36:48.863 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.032319729999999998, 2024-09-12T18:36:48.863 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:48.863 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:48.864 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:48.864 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:48.864 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:48.864 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:48.864 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 131545 2024-09-12T18:36:48.864 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.864 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:48.864 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.864 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:48.864 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497399+0000", 2024-09-12T18:36:48.864 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.864 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.864 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.864 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:48.865 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497399+0000", 2024-09-12T18:36:48.865 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.865 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.865 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.865 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:48.865 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497400+0000", 2024-09-12T18:36:48.865 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.7900000000000007e-07 2024-09-12T18:36:48.865 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.865 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.865 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:48.865 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497500+0000", 2024-09-12T18:36:48.865 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00010021799999999999 2024-09-12T18:36:48.865 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.866 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.866 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:48.866 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497509+0000", 2024-09-12T18:36:48.866 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.9299999999999992e-06 2024-09-12T18:36:48.866 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.866 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.866 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.866 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497513+0000", 2024-09-12T18:36:48.866 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4129999999999999e-06 2024-09-12T18:36:48.866 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.866 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.866 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:48.866 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.501900+0000", 2024-09-12T18:36:48.866 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0043864730000000001 2024-09-12T18:36:48.867 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.867 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.867 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:48.867 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.502054+0000", 2024-09-12T18:36:48.867 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015438299999999999 2024-09-12T18:36:48.867 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.867 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.867 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:48.867 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.502147+0000", 2024-09-12T18:36:48.867 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.3187000000000001e-05 2024-09-12T18:36:48.867 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.867 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.867 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:48.867 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.504510+0000", 2024-09-12T18:36:48.868 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0023626509999999999 2024-09-12T18:36:48.868 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.868 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.868 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:48.868 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.529615+0000", 2024-09-12T18:36:48.868 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.025104688999999999 2024-09-12T18:36:48.868 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.868 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.868 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:48.868 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.529673+0000", 2024-09-12T18:36:48.868 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8451e-05 2024-09-12T18:36:48.868 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.868 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.868 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:48.869 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.529718+0000", 2024-09-12T18:36:48.869 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5355999999999997e-05 2024-09-12T18:36:48.869 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.869 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:48.869 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.869 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.869 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.869 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:131550 5.3 5:c5ee897a:::benchmark_data_smithi073_23739_object131549:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:36:48.869 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:45.499088+0000", 2024-09-12T18:36:48.869 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 3.2629493090000001, 2024-09-12T18:36:48.869 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021584709000000001, 2024-09-12T18:36:48.869 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:48.869 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:48.869 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:48.870 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:48.870 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:48.870 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:48.870 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 131550 2024-09-12T18:36:48.870 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.870 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:48.870 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.870 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:48.870 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499088+0000", 2024-09-12T18:36:48.870 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.870 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.870 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.870 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:48.870 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499088+0000", 2024-09-12T18:36:48.871 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.871 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.871 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.871 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:48.871 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499089+0000", 2024-09-12T18:36:48.871 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.0299999999999997e-07 2024-09-12T18:36:48.871 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.871 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.871 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:48.871 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499166+0000", 2024-09-12T18:36:48.871 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.7257999999999998e-05 2024-09-12T18:36:48.871 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.871 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.871 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:48.872 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499173+0000", 2024-09-12T18:36:48.872 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1509999999999998e-06 2024-09-12T18:36:48.872 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.872 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.872 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.872 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499178+0000", 2024-09-12T18:36:48.872 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.78e-06 2024-09-12T18:36:48.872 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.872 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.872 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:48.872 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499231+0000", 2024-09-12T18:36:48.872 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2621999999999999e-05 2024-09-12T18:36:48.872 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.872 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.873 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:48.873 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499326+0000", 2024-09-12T18:36:48.873 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.5567000000000002e-05 2024-09-12T18:36:48.873 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.873 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.873 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:48.873 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499419+0000", 2024-09-12T18:36:48.873 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2417000000000006e-05 2024-09-12T18:36:48.873 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.873 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.873 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:48.873 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.503781+0000", 2024-09-12T18:36:48.873 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.004362192 2024-09-12T18:36:48.873 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.874 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.874 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:48.874 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.520606+0000", 2024-09-12T18:36:48.874 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.016824784999999998 2024-09-12T18:36:48.874 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.874 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.874 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:48.874 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.520642+0000", 2024-09-12T18:36:48.874 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.6313000000000003e-05 2024-09-12T18:36:48.874 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.874 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.874 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:48.874 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.520673+0000", 2024-09-12T18:36:48.874 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.0720999999999999e-05 2024-09-12T18:36:48.875 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.875 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:48.875 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.875 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.875 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.875 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:131552 5.3 5:cb8dda54:::benchmark_data_smithi073_23739_object131551:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:36:48.875 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:45.499423+0000", 2024-09-12T18:36:48.875 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 3.2626144539999999, 2024-09-12T18:36:48.875 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.024733523, 2024-09-12T18:36:48.875 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:48.875 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:48.875 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:48.875 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:48.875 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:48.876 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:48.876 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 131552 2024-09-12T18:36:48.876 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.876 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:48.876 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.876 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:48.876 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499423+0000", 2024-09-12T18:36:48.876 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.876 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.876 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.876 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:48.876 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499423+0000", 2024-09-12T18:36:48.876 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:48.877 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.877 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.877 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:48.877 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499424+0000", 2024-09-12T18:36:48.877 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.95e-07 2024-09-12T18:36:48.877 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.877 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.877 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:48.877 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499507+0000", 2024-09-12T18:36:48.877 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.3258999999999997e-05 2024-09-12T18:36:48.877 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.877 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.877 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:48.877 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499518+0000", 2024-09-12T18:36:48.878 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.064e-05 2024-09-12T18:36:48.878 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.878 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.878 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:48.878 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499525+0000", 2024-09-12T18:36:48.878 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.9709999999999998e-06 2024-09-12T18:36:48.878 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.878 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.878 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:48.878 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.501699+0000", 2024-09-12T18:36:48.878 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0021738500000000002 2024-09-12T18:36:48.878 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.878 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.878 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:48.878 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.501809+0000", 2024-09-12T18:36:48.879 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000109888 2024-09-12T18:36:48.879 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.879 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.879 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:48.879 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.501960+0000", 2024-09-12T18:36:48.879 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015157899999999999 2024-09-12T18:36:48.879 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.879 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.879 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:48.879 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.504165+0000", 2024-09-12T18:36:48.879 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.002204849 2024-09-12T18:36:48.879 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.879 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.879 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:48.880 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.524053+0000", 2024-09-12T18:36:48.880 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.019887621000000001 2024-09-12T18:36:48.880 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.880 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.880 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:48.880 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.524110+0000", 2024-09-12T18:36:48.880 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7191000000000002e-05 2024-09-12T18:36:48.880 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:48.880 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:48.880 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:48.880 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.524157+0000", 2024-09-12T18:36:48.880 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.668e-05 2024-09-12T18:36:48.880 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.880 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:48.881 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.881 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:48.881 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:48.881 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:48.882 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:36:48.883 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:48.878+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:48.984 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:48.978+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:49.039 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:49.040 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:36:49.040 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.040 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "MOSDPGPush(5.1 54/49 [PushOp(5:831459e5:::benchmark_data_smithi073_23739_object127548:head, version: 51'7929, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(5:831459e5:::benchmark_data_smithi073_23739_object127548:head@51'7929, size: 65536, copy_subset: [(0, 65536)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 65536, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T18:36:49.040 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:49.037820+0000", 2024-09-12T18:36:49.040 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00039196400000000002, 2024-09-12T18:36:49.040 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00043755600000000002, 2024-09-12T18:36:49.040 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:49.040 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:49.041 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:49.041 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:49.041 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.041 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:49.041 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.037820+0000", 2024-09-12T18:36:49.041 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.041 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.041 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.041 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:49.041 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.037820+0000", 2024-09-12T18:36:49.041 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.041 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.041 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.042 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:49.042 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.037821+0000", 2024-09-12T18:36:49.042 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.58e-07 2024-09-12T18:36:49.042 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.042 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.042 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:49.042 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.037891+0000", 2024-09-12T18:36:49.042 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9900999999999994e-05 2024-09-12T18:36:49.042 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.042 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.042 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:49.042 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.037904+0000", 2024-09-12T18:36:49.042 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3145e-05 2024-09-12T18:36:49.042 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.043 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.043 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:49.043 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.037914+0000", 2024-09-12T18:36:49.043 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.7589999999999992e-06 2024-09-12T18:36:49.043 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.043 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.043 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:49.043 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.037986+0000", 2024-09-12T18:36:49.043 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2502999999999993e-05 2024-09-12T18:36:49.043 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.043 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.043 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:49.043 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.037994+0000", 2024-09-12T18:36:49.043 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4039999999999995e-06 2024-09-12T18:36:49.044 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.044 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:49.044 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.044 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.044 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.044 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_backfill(progress 5.1 e 54/54 lb 5:831446fd:::benchmark_data_smithi073_23739_object67609:head)", 2024-09-12T18:36:49.044 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:49.037931+0000", 2024-09-12T18:36:49.044 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00028152, 2024-09-12T18:36:49.044 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00038688200000000001, 2024-09-12T18:36:49.044 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:49.044 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:49.044 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:49.044 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:49.045 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.045 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:49.045 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.037931+0000", 2024-09-12T18:36:49.045 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.045 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.045 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.045 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:49.045 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.037931+0000", 2024-09-12T18:36:49.045 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.045 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.045 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.045 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:49.045 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.037931+0000", 2024-09-12T18:36:49.046 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0800000000000001e-07 2024-09-12T18:36:49.046 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.046 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.046 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:49.046 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.037936+0000", 2024-09-12T18:36:49.046 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8149999999999996e-06 2024-09-12T18:36:49.046 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.046 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.046 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:49.046 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.037941+0000", 2024-09-12T18:36:49.046 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3210000000000004e-06 2024-09-12T18:36:49.046 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.046 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.047 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:49.047 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.037946+0000", 2024-09-12T18:36:49.047 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9819999999999999e-06 2024-09-12T18:36:49.047 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.047 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:49.047 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.047 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.047 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.047 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:137099 5.d 5:bd1e697f:::benchmark_data_smithi073_23739_object4822:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T18:36:49.047 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:49.038196+0000", 2024-09-12T18:36:49.047 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 1.5940999999999999e-05, 2024-09-12T18:36:49.048 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000157128, 2024-09-12T18:36:49.048 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:49.048 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:49.048 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-09-12T18:36:49.048 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:49.048 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:49.048 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:49.048 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 137099 2024-09-12T18:36:49.048 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.048 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:49.048 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.049 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:49.049 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.038196+0000", 2024-09-12T18:36:49.049 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.049 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.049 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.049 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:49.049 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.038196+0000", 2024-09-12T18:36:49.049 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.049 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.049 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.049 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:49.049 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.038197+0000", 2024-09-12T18:36:49.050 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0589999999999999e-06 2024-09-12T18:36:49.050 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.050 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.050 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:49.050 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.038201+0000", 2024-09-12T18:36:49.050 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8720000000000004e-06 2024-09-12T18:36:49.050 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.050 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.050 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:49.050 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.038212+0000", 2024-09-12T18:36:49.051 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1069e-05 2024-09-12T18:36:49.051 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.051 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.051 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:49.051 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.038219+0000", 2024-09-12T18:36:49.051 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4110000000000001e-06 2024-09-12T18:36:49.051 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.051 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.051 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:49.051 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.038268+0000", 2024-09-12T18:36:49.051 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9231999999999999e-05 2024-09-12T18:36:49.051 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.051 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:49.051 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.052 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.052 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.052 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:137100 5.0 5.19954e0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T18:36:49.052 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:49.038233+0000", 2024-09-12T18:36:49.052 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4294967295.999979, 2024-09-12T18:36:49.052 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015247399999999999, 2024-09-12T18:36:49.052 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:49.052 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:49.052 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:49.052 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:49.052 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:49.052 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:49.052 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 137100 2024-09-12T18:36:49.053 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.053 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:49.053 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.053 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:49.053 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.038233+0000", 2024-09-12T18:36:49.053 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.053 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.053 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.053 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:49.053 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.038233+0000", 2024-09-12T18:36:49.053 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.053 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.053 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.053 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:49.054 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.038234+0000", 2024-09-12T18:36:49.054 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7599999999999997e-07 2024-09-12T18:36:49.054 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.054 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.054 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:49.054 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.038236+0000", 2024-09-12T18:36:49.054 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5409999999999999e-06 2024-09-12T18:36:49.054 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.054 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.054 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:49.054 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.038243+0000", 2024-09-12T18:36:49.054 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0759999999999997e-06 2024-09-12T18:36:49.054 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.055 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.055 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:49.055 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.038248+0000", 2024-09-12T18:36:49.055 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1959999999999999e-06 2024-09-12T18:36:49.055 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.055 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:49.055 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.055 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.055 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.055 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:137101 5.d 5.ff01769d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T18:36:49.055 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:49.038257+0000", 2024-09-12T18:36:49.055 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4294967295.9999547, 2024-09-12T18:36:49.056 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000176186, 2024-09-12T18:36:49.056 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:49.056 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:49.056 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:49.056 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:49.056 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:49.056 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:49.056 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 137101 2024-09-12T18:36:49.056 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.056 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:49.056 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.056 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:49.056 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.038257+0000", 2024-09-12T18:36:49.056 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.056 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.057 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.057 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:49.057 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.038257+0000", 2024-09-12T18:36:49.057 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.057 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.057 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.057 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:49.057 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.038258+0000", 2024-09-12T18:36:49.057 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1699999999999998e-07 2024-09-12T18:36:49.057 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.057 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.057 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:49.057 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.038260+0000", 2024-09-12T18:36:49.057 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8929999999999999e-06 2024-09-12T18:36:49.058 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.058 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.058 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:49.058 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.038267+0000", 2024-09-12T18:36:49.058 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.058e-06 2024-09-12T18:36:49.058 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.058 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.058 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:49.058 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.038272+0000", 2024-09-12T18:36:49.058 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2809999999999999e-06 2024-09-12T18:36:49.058 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.058 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:49.058 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.059 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.059 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.059 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:137093 5.1 e54/49)", 2024-09-12T18:36:49.059 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:49.038287+0000", 2024-09-12T18:36:49.059 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4294967295.9999247, 2024-09-12T18:36:49.059 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00018524399999999999, 2024-09-12T18:36:49.059 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:49.059 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:49.059 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:49.060 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:49.060 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.060 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:49.060 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.038287+0000", 2024-09-12T18:36:49.060 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.060 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.060 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.060 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:49.060 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.038287+0000", 2024-09-12T18:36:49.060 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.060 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.060 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.060 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:49.061 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.038288+0000", 2024-09-12T18:36:49.061 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4999999999999998e-07 2024-09-12T18:36:49.061 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.061 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.061 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:49.061 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.038292+0000", 2024-09-12T18:36:49.061 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2420000000000002e-06 2024-09-12T18:36:49.061 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.061 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.061 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:49.062 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.038299+0000", 2024-09-12T18:36:49.062 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8539999999999999e-06 2024-09-12T18:36:49.062 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.062 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.062 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:49.062 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.038304+0000", 2024-09-12T18:36:49.062 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9320000000000004e-06 2024-09-12T18:36:49.062 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.062 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:49.062 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.062 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.062 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.062 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:137097 5.b 5:d8fc22a6:::benchmark_data_smithi073_23739_object4820:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T18:36:49.063 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:49.035608+0000", 2024-09-12T18:36:49.063 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0026042499999999998, 2024-09-12T18:36:49.063 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0028889520000000002, 2024-09-12T18:36:49.063 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:49.063 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:49.063 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:49.063 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:49.063 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:49.063 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:49.063 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 137097 2024-09-12T18:36:49.063 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.063 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:49.063 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.064 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:49.064 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.035608+0000", 2024-09-12T18:36:49.064 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.064 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.064 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.064 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:49.064 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.035608+0000", 2024-09-12T18:36:49.064 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.064 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.064 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.064 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:49.064 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.035609+0000", 2024-09-12T18:36:49.065 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2160000000000001e-06 2024-09-12T18:36:49.065 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.065 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.065 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:49.065 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.035613+0000", 2024-09-12T18:36:49.065 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1119999999999998e-06 2024-09-12T18:36:49.065 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.065 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.065 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:49.065 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.035622+0000", 2024-09-12T18:36:49.065 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9199999999999993e-06 2024-09-12T18:36:49.065 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.065 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.066 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:49.066 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.035629+0000", 2024-09-12T18:36:49.066 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.3230000000000003e-06 2024-09-12T18:36:49.066 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.066 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.066 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:49.066 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.035664+0000", 2024-09-12T18:36:49.066 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5463000000000002e-05 2024-09-12T18:36:49.066 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.066 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.066 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:49.066 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.035750+0000", 2024-09-12T18:36:49.066 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5714e-05 2024-09-12T18:36:49.066 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.067 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.067 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:49.067 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.035822+0000", 2024-09-12T18:36:49.067 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1911999999999999e-05 2024-09-12T18:36:49.067 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.067 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.067 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:49.067 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.038459+0000", 2024-09-12T18:36:49.067 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0026374440000000001 2024-09-12T18:36:49.067 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.067 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:49.067 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.067 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.067 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.068 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:137094 5.a e54/21 5:564b6710:::benchmark_data_smithi073_23739_object4817:head v 54'8686, mlcod=54'8683)", 2024-09-12T18:36:49.068 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:49.035938+0000", 2024-09-12T18:36:49.068 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0022745439999999999, 2024-09-12T18:36:49.068 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002595071, 2024-09-12T18:36:49.068 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:49.068 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:49.068 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:49.068 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:49.068 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.068 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:49.068 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.035938+0000", 2024-09-12T18:36:49.068 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.068 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.069 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.069 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:49.069 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.035938+0000", 2024-09-12T18:36:49.069 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.069 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.069 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.069 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:49.069 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.035938+0000", 2024-09-12T18:36:49.069 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.3099999999999997e-07 2024-09-12T18:36:49.069 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.069 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.070 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:49.070 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.035945+0000", 2024-09-12T18:36:49.070 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1749999999999999e-06 2024-09-12T18:36:49.070 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.070 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.070 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:49.070 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.035952+0000", 2024-09-12T18:36:49.070 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1689999999999997e-06 2024-09-12T18:36:49.070 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.070 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.070 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:49.070 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.035956+0000", 2024-09-12T18:36:49.071 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0049999999999998e-06 2024-09-12T18:36:49.071 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.071 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.071 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:49.071 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.035998+0000", 2024-09-12T18:36:49.071 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2383999999999999e-05 2024-09-12T18:36:49.071 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.071 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.071 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:49.071 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:49.036014+0000", 2024-09-12T18:36:49.072 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6039999999999999e-05 2024-09-12T18:36:49.072 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.072 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:49.072 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.072 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.072 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-09-12T18:36:49.072 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 8 2024-09-12T18:36:49.072 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:49.073 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:36:49.083 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:49.079+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:49.185 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:49.179+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:49.280 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:49.280 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-09-12T18:36:49.280 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-09-12T18:36:49.280 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-09-12T18:36:49.280 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:49.285 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:49.279+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:49.301 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:36:49.387 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:49.383+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:49.461 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:49.461 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-09-12T18:36:49.462 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-09-12T18:36:49.462 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:36:49.462 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.462 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:49.462 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:49.462 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 83.825783504, 2024-09-12T18:36:49.462 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025088781000000001, 2024-09-12T18:36:49.462 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:49.462 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:49.462 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:49.462 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:49.462 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.462 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:49.463 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:49.463 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.463 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.463 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.463 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:49.463 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:49.463 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.463 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.463 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.463 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:49.463 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632518+0000", 2024-09-12T18:36:49.463 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:36:49.463 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.463 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.464 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:49.464 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632533+0000", 2024-09-12T18:36:49.464 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5130000000000001e-05 2024-09-12T18:36:49.464 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.464 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.464 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:49.464 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632564+0000", 2024-09-12T18:36:49.464 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0788999999999999e-05 2024-09-12T18:36:49.464 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.464 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.464 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:49.464 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632590+0000", 2024-09-12T18:36:49.464 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6057000000000001e-05 2024-09-12T18:36:49.465 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.465 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.465 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:49.465 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.635931+0000", 2024-09-12T18:36:49.465 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033411320000000001 2024-09-12T18:36:49.465 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.465 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.465 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:49.465 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636186+0000", 2024-09-12T18:36:49.465 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025452500000000002 2024-09-12T18:36:49.465 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.465 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.465 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:49.466 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636445+0000", 2024-09-12T18:36:49.466 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000259268 2024-09-12T18:36:49.466 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.466 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.466 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:49.466 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639562+0000", 2024-09-12T18:36:49.466 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031167 2024-09-12T18:36:49.466 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.466 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.466 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:49.466 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657314+0000", 2024-09-12T18:36:49.466 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017752562 2024-09-12T18:36:49.466 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.467 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.467 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:49.467 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657445+0000", 2024-09-12T18:36:49.467 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013105899999999999 2024-09-12T18:36:49.467 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.467 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.467 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:49.467 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657598+0000", 2024-09-12T18:36:49.467 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015247899999999999 2024-09-12T18:36:49.467 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.467 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:49.467 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.467 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.467 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.468 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:49.468 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:49.468 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 83.825657301000007, 2024-09-12T18:36:49.468 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025643131999999999, 2024-09-12T18:36:49.468 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:49.468 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:49.468 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:49.468 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:49.468 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.468 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:49.468 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:49.468 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.468 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.468 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.469 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:49.469 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:49.469 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.469 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.469 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.469 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:49.469 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632637+0000", 2024-09-12T18:36:49.469 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5600000000000001e-06 2024-09-12T18:36:49.469 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.470 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.470 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:49.470 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632650+0000", 2024-09-12T18:36:49.470 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3186e-05 2024-09-12T18:36:49.470 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.470 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.470 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:49.470 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632672+0000", 2024-09-12T18:36:49.470 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2013000000000001e-05 2024-09-12T18:36:49.470 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.470 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.470 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:49.470 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632687+0000", 2024-09-12T18:36:49.471 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5109999999999999e-05 2024-09-12T18:36:49.471 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.471 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.471 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:49.471 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636994+0000", 2024-09-12T18:36:49.471 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0043065539999999998 2024-09-12T18:36:49.471 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.471 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.471 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:49.471 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637198+0000", 2024-09-12T18:36:49.471 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020387199999999999 2024-09-12T18:36:49.471 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.471 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.472 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:49.472 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637475+0000", 2024-09-12T18:36:49.472 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027731000000000001 2024-09-12T18:36:49.472 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.472 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.472 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:49.472 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639574+0000", 2024-09-12T18:36:49.472 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020988999999999999 2024-09-12T18:36:49.472 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.472 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.472 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:49.472 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658057+0000", 2024-09-12T18:36:49.472 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018482926 2024-09-12T18:36:49.473 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.473 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.473 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:49.473 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658184+0000", 2024-09-12T18:36:49.473 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012756200000000001 2024-09-12T18:36:49.473 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.473 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.473 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:49.473 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658278+0000", 2024-09-12T18:36:49.473 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4139000000000001e-05 2024-09-12T18:36:49.473 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.473 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:49.473 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.473 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.474 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.474 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:49.474 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:49.474 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 83.825582209000004, 2024-09-12T18:36:49.474 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025238883, 2024-09-12T18:36:49.474 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:49.474 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:49.474 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:49.474 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:49.474 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.474 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:49.474 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:49.474 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.474 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.475 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.475 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:49.475 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:49.475 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.475 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.475 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.475 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:49.475 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632712+0000", 2024-09-12T18:36:49.475 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6869999999999999e-06 2024-09-12T18:36:49.475 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.475 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.475 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:49.476 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632719+0000", 2024-09-12T18:36:49.476 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6059999999999999e-06 2024-09-12T18:36:49.476 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.476 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.476 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:49.476 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632737+0000", 2024-09-12T18:36:49.476 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7983999999999999e-05 2024-09-12T18:36:49.476 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.476 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.476 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:49.476 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632751+0000", 2024-09-12T18:36:49.476 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4473e-05 2024-09-12T18:36:49.476 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.477 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.477 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:49.477 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636961+0000", 2024-09-12T18:36:49.477 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042100840000000002 2024-09-12T18:36:49.477 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.477 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.477 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:49.477 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637211+0000", 2024-09-12T18:36:49.477 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000249738 2024-09-12T18:36:49.478 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.478 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.478 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:49.478 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637504+0000", 2024-09-12T18:36:49.478 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00029271499999999998 2024-09-12T18:36:49.478 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.478 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.478 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:49.478 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639582+0000", 2024-09-12T18:36:49.478 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020783389999999998 2024-09-12T18:36:49.478 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.479 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.479 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:49.479 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657709+0000", 2024-09-12T18:36:49.479 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018126758999999999 2024-09-12T18:36:49.479 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.479 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.479 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:49.479 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657830+0000", 2024-09-12T18:36:49.479 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000121329 2024-09-12T18:36:49.479 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.479 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.479 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:49.479 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657949+0000", 2024-09-12T18:36:49.480 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000119169 2024-09-12T18:36:49.480 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.480 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:49.480 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.480 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.480 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.480 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:49.480 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:49.480 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 83.825518162999998, 2024-09-12T18:36:49.480 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026711823999999999, 2024-09-12T18:36:49.480 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:49.480 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:49.481 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:49.481 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:49.481 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.481 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:49.481 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:49.481 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.481 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.481 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.481 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:49.481 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:49.481 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.481 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.481 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.481 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:49.482 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632775+0000", 2024-09-12T18:36:49.482 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9999999999999995e-07 2024-09-12T18:36:49.482 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.482 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.482 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:49.482 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632788+0000", 2024-09-12T18:36:49.482 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2629999999999999e-05 2024-09-12T18:36:49.482 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.482 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.482 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:49.482 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632806+0000", 2024-09-12T18:36:49.482 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:36:49.482 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.482 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.483 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:49.483 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632820+0000", 2024-09-12T18:36:49.483 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3777e-05 2024-09-12T18:36:49.483 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.483 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.483 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:49.483 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638310+0000", 2024-09-12T18:36:49.483 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054898280000000004 2024-09-12T18:36:49.483 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.483 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.483 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:49.483 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638480+0000", 2024-09-12T18:36:49.484 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016968199999999999 2024-09-12T18:36:49.484 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.484 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.484 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:49.484 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638799+0000", 2024-09-12T18:36:49.484 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031915999999999997 2024-09-12T18:36:49.484 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.484 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.484 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:49.484 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639866+0000", 2024-09-12T18:36:49.484 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001067405 2024-09-12T18:36:49.484 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.484 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.485 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:49.485 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658398+0000", 2024-09-12T18:36:49.485 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018531542000000002 2024-09-12T18:36:49.485 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.485 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.485 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:49.485 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658643+0000", 2024-09-12T18:36:49.485 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00024531500000000002 2024-09-12T18:36:49.485 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.485 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.485 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:49.485 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.659486+0000", 2024-09-12T18:36:49.485 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00084316899999999995 2024-09-12T18:36:49.485 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.486 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:49.486 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.486 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.486 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.486 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:49.486 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:49.486 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 83.825209408999996, 2024-09-12T18:36:49.487 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026938645000000001, 2024-09-12T18:36:49.487 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:49.487 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:49.487 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:49.487 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:49.487 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.487 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:49.487 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:49.487 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.487 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.487 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.488 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:49.488 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:49.488 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.488 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.488 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.488 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:49.488 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633085+0000", 2024-09-12T18:36:49.488 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:49.488 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.488 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.488 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:49.488 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633093+0000", 2024-09-12T18:36:49.488 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3999999999999992e-06 2024-09-12T18:36:49.489 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.489 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.489 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:49.489 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633111+0000", 2024-09-12T18:36:49.489 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8070000000000001e-05 2024-09-12T18:36:49.489 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.489 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.489 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:49.489 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633126+0000", 2024-09-12T18:36:49.489 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4487e-05 2024-09-12T18:36:49.489 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.489 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.489 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:49.490 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638290+0000", 2024-09-12T18:36:49.490 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0051640269999999999 2024-09-12T18:36:49.490 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.490 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.490 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:49.490 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638547+0000", 2024-09-12T18:36:49.490 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025714100000000001 2024-09-12T18:36:49.490 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.490 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.490 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:49.490 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638850+0000", 2024-09-12T18:36:49.490 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030278400000000001 2024-09-12T18:36:49.490 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.490 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.491 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:49.491 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.640706+0000", 2024-09-12T18:36:49.491 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018564580000000001 2024-09-12T18:36:49.491 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.491 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.491 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:49.491 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658420+0000", 2024-09-12T18:36:49.491 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017714395000000001 2024-09-12T18:36:49.491 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.491 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.491 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:49.491 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658635+0000", 2024-09-12T18:36:49.491 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021413500000000001 2024-09-12T18:36:49.492 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.492 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.492 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:49.492 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.660022+0000", 2024-09-12T18:36:49.492 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001387318 2024-09-12T18:36:49.492 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.492 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:49.492 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.492 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.492 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.492 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121096 5.8 5:13503891:::benchmark_data_smithi073_23739_object121095:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:49.492 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:36:49.493 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 9.2797164419999998, 2024-09-12T18:36:49.493 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064025391000000001, 2024-09-12T18:36:49.493 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:49.493 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:49.493 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:49.493 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:49.493 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:49.493 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:49.493 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121096 2024-09-12T18:36:49.493 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.493 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:49.493 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.493 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:49.494 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:36:49.494 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.494 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.494 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.494 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:49.494 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:36:49.494 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.494 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.494 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.494 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:49.494 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178579+0000", 2024-09-12T18:36:49.494 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7369999999999998e-06 2024-09-12T18:36:49.494 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.494 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.495 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:49.495 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178846+0000", 2024-09-12T18:36:49.495 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026752699999999999 2024-09-12T18:36:49.495 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.495 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.495 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:49.495 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178877+0000", 2024-09-12T18:36:49.495 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1081999999999998e-05 2024-09-12T18:36:49.495 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.495 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.495 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:49.495 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178896+0000", 2024-09-12T18:36:49.495 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8522e-05 2024-09-12T18:36:49.496 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.496 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.496 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:49.496 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.192591+0000", 2024-09-12T18:36:49.496 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013695067 2024-09-12T18:36:49.496 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.496 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.496 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:49.496 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.192944+0000", 2024-09-12T18:36:49.496 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00035273699999999999 2024-09-12T18:36:49.496 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.497 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.497 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:49.497 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.193732+0000", 2024-09-12T18:36:49.497 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078849599999999997 2024-09-12T18:36:49.497 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.497 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.497 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:49.497 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.213583+0000", 2024-09-12T18:36:49.497 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.019851164000000001 2024-09-12T18:36:49.497 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.497 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.497 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:49.497 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242386+0000", 2024-09-12T18:36:49.498 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028802924000000001 2024-09-12T18:36:49.498 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.498 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.498 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:49.498 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242501+0000", 2024-09-12T18:36:49.498 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000114932 2024-09-12T18:36:49.498 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.498 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.498 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:49.498 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242602+0000", 2024-09-12T18:36:49.498 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000100203 2024-09-12T18:36:49.498 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.498 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:49.499 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.499 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.499 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.499 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121097 5.8 5:1b31a99e:::benchmark_data_smithi073_23739_object121096:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:49.499 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:36:49.499 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 9.2639881519999996, 2024-09-12T18:36:49.499 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048475917, 2024-09-12T18:36:49.499 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:49.499 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:49.499 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:49.499 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:49.499 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:49.499 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:49.500 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121097 2024-09-12T18:36:49.500 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.500 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:49.500 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.500 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:49.500 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:36:49.500 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.500 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.500 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.500 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:49.500 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:36:49.500 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.501 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.501 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.501 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:49.501 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194308+0000", 2024-09-12T18:36:49.501 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2789999999999999e-06 2024-09-12T18:36:49.501 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.501 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.501 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:49.501 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194396+0000", 2024-09-12T18:36:49.501 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8324000000000003e-05 2024-09-12T18:36:49.501 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.501 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.501 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:49.502 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194424+0000", 2024-09-12T18:36:49.502 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7565000000000001e-05 2024-09-12T18:36:49.502 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.502 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.502 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:49.502 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194444+0000", 2024-09-12T18:36:49.502 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0363000000000001e-05 2024-09-12T18:36:49.502 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.502 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.502 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:49.502 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.206888+0000", 2024-09-12T18:36:49.502 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012443997 2024-09-12T18:36:49.502 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.502 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.503 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:49.503 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.207138+0000", 2024-09-12T18:36:49.503 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025035900000000002 2024-09-12T18:36:49.503 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.503 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.503 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:49.503 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.207365+0000", 2024-09-12T18:36:49.503 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000226407 2024-09-12T18:36:49.503 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.503 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.503 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:49.503 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.215059+0000", 2024-09-12T18:36:49.503 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076946860000000001 2024-09-12T18:36:49.503 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.504 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.504 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:49.504 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242619+0000", 2024-09-12T18:36:49.504 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.027559975 2024-09-12T18:36:49.504 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.504 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.504 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:49.504 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242706+0000", 2024-09-12T18:36:49.504 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6384999999999994e-05 2024-09-12T18:36:49.504 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.504 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.505 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:49.505 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242780+0000", 2024-09-12T18:36:49.505 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4577000000000001e-05 2024-09-12T18:36:49.505 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.505 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:49.505 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.505 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.505 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.505 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:121044 5.1 e50/49 5:83bf711a:::benchmark_data_smithi073_23739_object121043:head v 50'7532, mlcod=0'0)", 2024-09-12T18:36:49.505 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.201054+0000", 2024-09-12T18:36:49.505 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 9.2572389309999998, 2024-09-12T18:36:49.505 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026157387000000001, 2024-09-12T18:36:49.505 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:49.505 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:49.506 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:49.506 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:49.506 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.506 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:49.506 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201054+0000", 2024-09-12T18:36:49.506 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.506 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.506 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.506 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:49.506 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201054+0000", 2024-09-12T18:36:49.506 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.506 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.506 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.506 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:49.507 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201056+0000", 2024-09-12T18:36:49.507 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.99e-06 2024-09-12T18:36:49.507 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.507 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.507 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:49.507 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201068+0000", 2024-09-12T18:36:49.507 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2799000000000001e-05 2024-09-12T18:36:49.507 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.507 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.507 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:49.507 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201093+0000", 2024-09-12T18:36:49.507 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4766e-05 2024-09-12T18:36:49.507 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.507 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.508 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:49.508 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201115+0000", 2024-09-12T18:36:49.508 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1988999999999999e-05 2024-09-12T18:36:49.508 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.508 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.508 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:49.508 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201233+0000", 2024-09-12T18:36:49.508 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000118229 2024-09-12T18:36:49.508 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.508 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.508 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:49.508 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201273+0000", 2024-09-12T18:36:49.508 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9171999999999997e-05 2024-09-12T18:36:49.508 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.509 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.509 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:49.509 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.227080+0000", 2024-09-12T18:36:49.509 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025807611000000001 2024-09-12T18:36:49.509 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.509 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.509 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:49.509 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.227211+0000", 2024-09-12T18:36:49.509 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013083100000000001 2024-09-12T18:36:49.509 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.509 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:49.509 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.509 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.510 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.510 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121101 5.e 5:7e18e9ed:::benchmark_data_smithi073_23739_object121100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:49.510 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.209084+0000", 2024-09-12T18:36:49.510 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 9.2492080970000004, 2024-09-12T18:36:49.510 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028988566, 2024-09-12T18:36:49.510 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:49.510 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:49.510 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:49.510 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:49.510 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:49.510 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:49.510 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121101 2024-09-12T18:36:49.510 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.511 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:49.511 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.511 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:49.511 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209084+0000", 2024-09-12T18:36:49.511 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.511 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.511 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.511 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:49.511 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209084+0000", 2024-09-12T18:36:49.511 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.511 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.512 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.512 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:49.512 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209087+0000", 2024-09-12T18:36:49.512 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6800000000000002e-06 2024-09-12T18:36:49.512 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.512 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.512 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:49.512 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209182+0000", 2024-09-12T18:36:49.512 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5084e-05 2024-09-12T18:36:49.512 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.512 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.513 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:49.513 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209212+0000", 2024-09-12T18:36:49.513 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9825e-05 2024-09-12T18:36:49.513 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.513 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.513 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:49.513 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209234+0000", 2024-09-12T18:36:49.513 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1416e-05 2024-09-12T18:36:49.513 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.513 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.513 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:49.513 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209497+0000", 2024-09-12T18:36:49.514 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026390400000000003 2024-09-12T18:36:49.514 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.514 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.514 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:49.514 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209810+0000", 2024-09-12T18:36:49.514 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000313023 2024-09-12T18:36:49.514 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.514 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.514 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:49.514 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.210468+0000", 2024-09-12T18:36:49.514 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00065779300000000005 2024-09-12T18:36:49.514 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.514 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.515 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:49.515 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.235905+0000", 2024-09-12T18:36:49.515 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025436881000000001 2024-09-12T18:36:49.515 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.515 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.515 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:49.515 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237797+0000", 2024-09-12T18:36:49.515 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001892007 2024-09-12T18:36:49.515 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.515 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.515 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:49.515 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237941+0000", 2024-09-12T18:36:49.515 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000143411 2024-09-12T18:36:49.516 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.516 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.516 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:49.516 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.238073+0000", 2024-09-12T18:36:49.516 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013254200000000001 2024-09-12T18:36:49.516 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.516 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:49.516 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.516 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.516 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.516 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121102 5.8 5:1f118f4b:::benchmark_data_smithi073_23739_object121101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:49.516 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.218682+0000", 2024-09-12T18:36:49.516 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 9.2396107369999996, 2024-09-12T18:36:49.517 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024264885, 2024-09-12T18:36:49.517 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:49.517 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:49.517 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:49.517 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:49.517 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:49.517 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:49.517 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121102 2024-09-12T18:36:49.517 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.517 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:49.517 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.517 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:49.517 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218682+0000", 2024-09-12T18:36:49.518 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.518 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.518 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.518 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:49.518 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218682+0000", 2024-09-12T18:36:49.518 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.518 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.518 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.518 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:49.518 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218685+0000", 2024-09-12T18:36:49.518 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6059999999999999e-06 2024-09-12T18:36:49.518 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.519 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.519 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:49.519 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218743+0000", 2024-09-12T18:36:49.519 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7160999999999997e-05 2024-09-12T18:36:49.519 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.519 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.519 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:49.519 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218768+0000", 2024-09-12T18:36:49.519 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5052e-05 2024-09-12T18:36:49.519 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.519 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.519 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:49.519 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218785+0000", 2024-09-12T18:36:49.519 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7436999999999999e-05 2024-09-12T18:36:49.520 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.520 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.520 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:49.520 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218952+0000", 2024-09-12T18:36:49.520 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016691300000000001 2024-09-12T18:36:49.520 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.520 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.520 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:49.520 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.219437+0000", 2024-09-12T18:36:49.520 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048465900000000002 2024-09-12T18:36:49.520 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.520 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.520 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:49.520 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.219893+0000", 2024-09-12T18:36:49.521 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00045642799999999999 2024-09-12T18:36:49.521 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.521 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.521 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:49.521 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.226416+0000", 2024-09-12T18:36:49.521 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065225630000000003 2024-09-12T18:36:49.521 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.521 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.522 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:49.522 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242796+0000", 2024-09-12T18:36:49.522 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016379857000000001 2024-09-12T18:36:49.522 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.522 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.522 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:49.522 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242879+0000", 2024-09-12T18:36:49.522 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3913999999999997e-05 2024-09-12T18:36:49.522 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.522 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.522 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:49.522 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242947+0000", 2024-09-12T18:36:49.522 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7294999999999999e-05 2024-09-12T18:36:49.523 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.523 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:49.523 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.523 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.523 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.523 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121106 5.d 5:b4a9a221:::benchmark_data_smithi073_23739_object121105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:49.523 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:36:49.523 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 9.2211132159999991, 2024-09-12T18:36:49.523 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.034882274999999997, 2024-09-12T18:36:49.523 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:49.523 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:49.523 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:49.524 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:49.524 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:49.524 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:49.524 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121106 2024-09-12T18:36:49.524 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.524 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:49.524 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.524 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:49.524 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:36:49.525 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.525 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.525 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.525 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:49.525 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:36:49.525 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.525 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.525 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.526 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:49.526 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237182+0000", 2024-09-12T18:36:49.526 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6019999999999998e-06 2024-09-12T18:36:49.526 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.526 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.526 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:49.526 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237257+0000", 2024-09-12T18:36:49.526 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5420999999999995e-05 2024-09-12T18:36:49.526 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.526 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.526 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:49.526 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237305+0000", 2024-09-12T18:36:49.526 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7207999999999999e-05 2024-09-12T18:36:49.526 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.527 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.527 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:49.527 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237325+0000", 2024-09-12T18:36:49.527 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0001e-05 2024-09-12T18:36:49.527 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.527 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.527 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:49.527 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237505+0000", 2024-09-12T18:36:49.527 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000180798 2024-09-12T18:36:49.527 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.527 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.527 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:49.527 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237764+0000", 2024-09-12T18:36:49.528 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025862299999999998 2024-09-12T18:36:49.528 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.528 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.528 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:49.528 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.238264+0000", 2024-09-12T18:36:49.528 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00050016100000000005 2024-09-12T18:36:49.528 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.528 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.528 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:49.528 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256525+0000", 2024-09-12T18:36:49.528 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018260508000000002 2024-09-12T18:36:49.528 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.528 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.528 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:49.529 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.271903+0000", 2024-09-12T18:36:49.529 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015378739000000001 2024-09-12T18:36:49.529 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.529 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.529 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:49.529 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.271999+0000", 2024-09-12T18:36:49.529 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5989000000000005e-05 2024-09-12T18:36:49.529 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.529 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.529 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:49.529 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272062+0000", 2024-09-12T18:36:49.529 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2224999999999995e-05 2024-09-12T18:36:49.530 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.530 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:49.530 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.530 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.530 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.530 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121112 5.d 5:b9a2d671:::benchmark_data_smithi073_23739_object121111:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:49.530 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.243446+0000", 2024-09-12T18:36:49.530 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 9.2148464909999994, 2024-09-12T18:36:49.530 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.02889415, 2024-09-12T18:36:49.530 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:49.530 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:49.530 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:49.530 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:49.530 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:49.531 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:49.531 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121112 2024-09-12T18:36:49.531 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.531 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:49.531 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.531 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:49.531 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243446+0000", 2024-09-12T18:36:49.531 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.531 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.531 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.531 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:49.531 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243446+0000", 2024-09-12T18:36:49.531 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.531 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.532 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.532 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:49.532 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243448+0000", 2024-09-12T18:36:49.532 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0829999999999998e-06 2024-09-12T18:36:49.532 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.532 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.532 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:49.532 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243527+0000", 2024-09-12T18:36:49.532 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9173999999999998e-05 2024-09-12T18:36:49.532 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.532 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.532 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:49.533 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243549+0000", 2024-09-12T18:36:49.533 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1169e-05 2024-09-12T18:36:49.533 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.533 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.533 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:49.533 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243564+0000", 2024-09-12T18:36:49.533 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5866999999999999e-05 2024-09-12T18:36:49.535 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.535 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.536 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:49.536 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.249905+0000", 2024-09-12T18:36:49.536 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063410360000000004 2024-09-12T18:36:49.536 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.536 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.536 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:49.536 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.250166+0000", 2024-09-12T18:36:49.536 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026052999999999997 2024-09-12T18:36:49.536 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.536 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.536 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:49.536 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.250486+0000", 2024-09-12T18:36:49.536 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00032002700000000002 2024-09-12T18:36:49.537 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.537 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.537 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:49.537 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.259263+0000", 2024-09-12T18:36:49.537 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0087774770000000005 2024-09-12T18:36:49.537 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.537 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.537 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:49.537 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272186+0000", 2024-09-12T18:36:49.537 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.01292213 2024-09-12T18:36:49.538 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.538 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.538 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:49.538 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272267+0000", 2024-09-12T18:36:49.538 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1153e-05 2024-09-12T18:36:49.538 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.538 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.538 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:49.538 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272340+0000", 2024-09-12T18:36:49.539 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3504000000000006e-05 2024-09-12T18:36:49.539 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.539 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:49.539 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.539 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.539 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.539 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121114 5.d 5:b8870c11:::benchmark_data_smithi073_23739_object121113:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:49.539 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.243603+0000", 2024-09-12T18:36:49.539 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 9.2146892400000002, 2024-09-12T18:36:49.540 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028945746000000001, 2024-09-12T18:36:49.540 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:49.540 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:49.540 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:49.540 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:49.540 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:49.540 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:49.540 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121114 2024-09-12T18:36:49.540 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.540 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:49.540 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.540 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:49.540 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243603+0000", 2024-09-12T18:36:49.541 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.541 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.541 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.541 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:49.541 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243603+0000", 2024-09-12T18:36:49.541 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.541 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.541 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.541 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:49.541 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243605+0000", 2024-09-12T18:36:49.541 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.268e-06 2024-09-12T18:36:49.541 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.542 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.542 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:49.542 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243674+0000", 2024-09-12T18:36:49.542 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9375000000000006e-05 2024-09-12T18:36:49.542 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.542 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.542 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:49.542 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243691+0000", 2024-09-12T18:36:49.542 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6517000000000001e-05 2024-09-12T18:36:49.542 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.542 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.542 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:49.542 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243702+0000", 2024-09-12T18:36:49.542 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1905999999999999e-05 2024-09-12T18:36:49.543 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.543 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.543 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:49.543 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.253789+0000", 2024-09-12T18:36:49.543 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.010086776 2024-09-12T18:36:49.543 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.543 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.543 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:49.543 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.253959+0000", 2024-09-12T18:36:49.543 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00017000000000000001 2024-09-12T18:36:49.544 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.544 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.544 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:49.544 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.254179+0000", 2024-09-12T18:36:49.544 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022003699999999999 2024-09-12T18:36:49.544 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.544 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.544 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:49.544 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.259330+0000", 2024-09-12T18:36:49.544 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0051511559999999996 2024-09-12T18:36:49.544 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.544 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.544 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:49.545 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272403+0000", 2024-09-12T18:36:49.545 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013072342000000001 2024-09-12T18:36:49.545 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.545 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.545 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:49.545 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272493+0000", 2024-09-12T18:36:49.545 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0595999999999998e-05 2024-09-12T18:36:49.545 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.545 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.545 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:49.545 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272549+0000", 2024-09-12T18:36:49.545 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5773000000000003e-05 2024-09-12T18:36:49.546 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.546 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:49.546 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.546 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.546 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.546 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121115 5.d 5:bd4a51ea:::benchmark_data_smithi073_23739_object121114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:49.546 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.245059+0000", 2024-09-12T18:36:49.546 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 9.2132335659999995, 2024-09-12T18:36:49.546 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.02767406, 2024-09-12T18:36:49.546 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:49.546 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:49.546 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:49.546 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:49.547 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:49.547 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:49.547 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121115 2024-09-12T18:36:49.547 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.547 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:49.547 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.547 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:49.547 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245059+0000", 2024-09-12T18:36:49.547 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.547 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.547 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.547 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:49.547 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245059+0000", 2024-09-12T18:36:49.548 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.548 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.548 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.548 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:49.548 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245061+0000", 2024-09-12T18:36:49.548 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9759999999999998e-06 2024-09-12T18:36:49.548 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.548 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.548 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:49.548 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245111+0000", 2024-09-12T18:36:49.548 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9838e-05 2024-09-12T18:36:49.548 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.548 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.549 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:49.549 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245132+0000", 2024-09-12T18:36:49.549 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1469999999999999e-05 2024-09-12T18:36:49.549 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.549 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.549 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:49.549 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245146+0000", 2024-09-12T18:36:49.549 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3377000000000001e-05 2024-09-12T18:36:49.549 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.550 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.550 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:49.550 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256596+0000", 2024-09-12T18:36:49.550 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011450241999999999 2024-09-12T18:36:49.550 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.550 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.550 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:49.550 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256838+0000", 2024-09-12T18:36:49.550 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000242255 2024-09-12T18:36:49.550 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.550 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.550 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:49.550 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.257095+0000", 2024-09-12T18:36:49.551 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025679300000000001 2024-09-12T18:36:49.551 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.551 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.551 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:49.551 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.259928+0000", 2024-09-12T18:36:49.551 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0028326290000000001 2024-09-12T18:36:49.551 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.551 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.551 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:49.551 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272607+0000", 2024-09-12T18:36:49.551 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012679466 2024-09-12T18:36:49.551 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.551 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.552 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:49.552 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272681+0000", 2024-09-12T18:36:49.552 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3580999999999999e-05 2024-09-12T18:36:49.552 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.552 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.552 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:49.552 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272733+0000", 2024-09-12T18:36:49.552 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2432999999999998e-05 2024-09-12T18:36:49.552 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.552 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:49.552 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.552 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.552 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.552 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121148 5.4 5:2a9bde06:::benchmark_data_smithi073_23739_object121147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:49.553 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.281423+0000", 2024-09-12T18:36:49.553 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 9.176869924, 2024-09-12T18:36:49.553 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025774785000000001, 2024-09-12T18:36:49.553 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:49.553 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:49.553 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:49.553 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:49.553 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:49.553 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:49.553 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121148 2024-09-12T18:36:49.553 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.553 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:49.553 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.554 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:49.554 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281423+0000", 2024-09-12T18:36:49.554 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.554 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.554 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.554 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:49.554 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281423+0000", 2024-09-12T18:36:49.554 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.554 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.555 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.555 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:49.555 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281424+0000", 2024-09-12T18:36:49.555 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.048e-06 2024-09-12T18:36:49.555 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.555 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.555 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:49.555 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281496+0000", 2024-09-12T18:36:49.555 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2099000000000002e-05 2024-09-12T18:36:49.555 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.555 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.555 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:49.555 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281509+0000", 2024-09-12T18:36:49.556 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3379e-05 2024-09-12T18:36:49.556 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.556 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.556 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:49.556 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281515+0000", 2024-09-12T18:36:49.556 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.28e-06 2024-09-12T18:36:49.556 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.556 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.556 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:49.556 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281688+0000", 2024-09-12T18:36:49.556 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00017203100000000001 2024-09-12T18:36:49.556 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.557 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.557 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:49.557 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281834+0000", 2024-09-12T18:36:49.557 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014645899999999999 2024-09-12T18:36:49.557 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.557 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.557 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:49.557 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.282319+0000", 2024-09-12T18:36:49.557 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048535000000000001 2024-09-12T18:36:49.557 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.557 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.557 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:49.557 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307086+0000", 2024-09-12T18:36:49.558 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024766989999999999 2024-09-12T18:36:49.558 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.558 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.558 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:49.558 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307108+0000", 2024-09-12T18:36:49.558 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1795999999999999e-05 2024-09-12T18:36:49.558 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.558 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.558 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:49.558 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307157+0000", 2024-09-12T18:36:49.558 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8729000000000001e-05 2024-09-12T18:36:49.558 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.558 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.558 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:49.559 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307197+0000", 2024-09-12T18:36:49.559 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0624000000000003e-05 2024-09-12T18:36:49.559 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.559 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:49.559 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.559 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.559 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.559 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121155 5.4 5:2af257d1:::benchmark_data_smithi073_23739_object121154:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:49.559 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.283163+0000", 2024-09-12T18:36:49.559 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 9.1751292489999994, 2024-09-12T18:36:49.559 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024186485000000001, 2024-09-12T18:36:49.559 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:49.559 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:49.559 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:49.559 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:49.560 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:49.560 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:49.560 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121155 2024-09-12T18:36:49.560 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.560 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:49.560 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.560 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:49.560 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283163+0000", 2024-09-12T18:36:49.560 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.560 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.560 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.560 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:49.560 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283163+0000", 2024-09-12T18:36:49.560 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.561 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.561 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.561 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:49.561 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283165+0000", 2024-09-12T18:36:49.561 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.748e-06 2024-09-12T18:36:49.561 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.561 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.561 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:49.561 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283218+0000", 2024-09-12T18:36:49.561 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2695000000000003e-05 2024-09-12T18:36:49.561 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.561 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.561 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:49.562 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283244+0000", 2024-09-12T18:36:49.562 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6072e-05 2024-09-12T18:36:49.562 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.562 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.562 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:49.562 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283257+0000", 2024-09-12T18:36:49.562 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3054000000000001e-05 2024-09-12T18:36:49.562 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.562 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.562 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:49.562 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.294509+0000", 2024-09-12T18:36:49.562 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011251677999999999 2024-09-12T18:36:49.562 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.562 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.563 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:49.563 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.294705+0000", 2024-09-12T18:36:49.563 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000196369 2024-09-12T18:36:49.563 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.563 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.563 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:49.563 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.294907+0000", 2024-09-12T18:36:49.563 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020184700000000001 2024-09-12T18:36:49.563 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.563 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.563 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:49.563 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307208+0000", 2024-09-12T18:36:49.563 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012301068 2024-09-12T18:36:49.564 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.564 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.564 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:49.564 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307273+0000", 2024-09-12T18:36:49.564 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5611000000000006e-05 2024-09-12T18:36:49.564 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.564 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.564 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:49.564 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307320+0000", 2024-09-12T18:36:49.565 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6220999999999997e-05 2024-09-12T18:36:49.565 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.565 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.565 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:49.565 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307350+0000", 2024-09-12T18:36:49.565 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0122000000000001e-05 2024-09-12T18:36:49.565 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.565 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:49.565 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.565 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.565 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.565 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121160 5.b 5:d4730c8e:::benchmark_data_smithi073_23739_object121159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:49.565 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.289262+0000", 2024-09-12T18:36:49.566 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 9.1690302330000009, 2024-09-12T18:36:49.566 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024618870000000001, 2024-09-12T18:36:49.566 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:49.566 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:49.566 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:49.566 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:49.566 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:49.566 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:49.566 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121160 2024-09-12T18:36:49.566 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.566 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:49.566 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.566 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:49.566 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289262+0000", 2024-09-12T18:36:49.567 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.567 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.567 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.567 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:49.567 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289262+0000", 2024-09-12T18:36:49.567 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.567 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.567 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.567 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:49.567 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289264+0000", 2024-09-12T18:36:49.567 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.945e-06 2024-09-12T18:36:49.567 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.567 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.568 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:49.568 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289331+0000", 2024-09-12T18:36:49.568 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6594999999999995e-05 2024-09-12T18:36:49.568 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.568 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.568 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:49.568 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289359+0000", 2024-09-12T18:36:49.568 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7988999999999999e-05 2024-09-12T18:36:49.568 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.568 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.568 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:49.569 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289375+0000", 2024-09-12T18:36:49.569 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5639000000000001e-05 2024-09-12T18:36:49.569 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.569 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.569 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:49.569 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289515+0000", 2024-09-12T18:36:49.569 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000140254 2024-09-12T18:36:49.569 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.569 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.569 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:49.569 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289740+0000", 2024-09-12T18:36:49.569 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022513500000000001 2024-09-12T18:36:49.570 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.570 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.570 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:49.570 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.290232+0000", 2024-09-12T18:36:49.570 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00049247500000000003 2024-09-12T18:36:49.570 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.570 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.570 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:49.570 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.312221+0000", 2024-09-12T18:36:49.570 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.021988939999999998 2024-09-12T18:36:49.570 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.571 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.571 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:49.571 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.313807+0000", 2024-09-12T18:36:49.571 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015859100000000001 2024-09-12T18:36:49.571 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.571 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.571 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:49.571 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.313852+0000", 2024-09-12T18:36:49.571 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4305999999999999e-05 2024-09-12T18:36:49.571 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.571 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.572 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:49.572 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.313881+0000", 2024-09-12T18:36:49.572 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9682000000000001e-05 2024-09-12T18:36:49.572 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.572 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:49.572 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.572 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.572 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.572 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:131551 5.d 5:b8f8c77a:::benchmark_data_smithi073_23739_object131550:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:36:49.572 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:45.499878+0000", 2024-09-12T18:36:49.572 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 3.958414302, 2024-09-12T18:36:49.572 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.027478433, 2024-09-12T18:36:49.573 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:49.573 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:49.573 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:49.573 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:49.573 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:49.573 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:49.573 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 131551 2024-09-12T18:36:49.573 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.573 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:49.573 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.573 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:49.573 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499878+0000", 2024-09-12T18:36:49.573 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.574 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.574 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.574 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:49.574 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499878+0000", 2024-09-12T18:36:49.574 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.574 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.574 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.574 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:49.574 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499879+0000", 2024-09-12T18:36:49.574 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.92e-07 2024-09-12T18:36:49.574 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.574 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.575 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:49.575 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499946+0000", 2024-09-12T18:36:49.575 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6712999999999996e-05 2024-09-12T18:36:49.575 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.575 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.575 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:49.575 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499953+0000", 2024-09-12T18:36:49.575 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5519999999999999e-06 2024-09-12T18:36:49.575 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.575 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.575 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:49.576 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499959+0000", 2024-09-12T18:36:49.576 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0430000000000004e-06 2024-09-12T18:36:49.576 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.576 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.576 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:49.576 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.500004+0000", 2024-09-12T18:36:49.576 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5058000000000001e-05 2024-09-12T18:36:49.576 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.576 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.576 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:49.576 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.500121+0000", 2024-09-12T18:36:49.576 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000116747 2024-09-12T18:36:49.576 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.577 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.577 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:49.577 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.500283+0000", 2024-09-12T18:36:49.577 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016190599999999999 2024-09-12T18:36:49.577 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.577 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.577 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:49.577 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.504017+0000", 2024-09-12T18:36:49.577 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003734125 2024-09-12T18:36:49.577 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.577 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.577 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:49.577 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.527224+0000", 2024-09-12T18:36:49.577 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.023206724000000001 2024-09-12T18:36:49.578 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.578 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.578 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:49.578 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.527290+0000", 2024-09-12T18:36:49.578 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5778999999999995e-05 2024-09-12T18:36:49.578 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.578 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.578 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:49.578 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.527357+0000", 2024-09-12T18:36:49.578 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7094000000000005e-05 2024-09-12T18:36:49.578 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.578 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:49.578 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.579 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.579 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.579 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:131556 5.0 5:01fc649a:::benchmark_data_smithi073_23739_object131555:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:36:49.579 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:45.502449+0000", 2024-09-12T18:36:49.579 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 3.9558439290000003, 2024-09-12T18:36:49.579 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.022597466, 2024-09-12T18:36:49.579 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:49.579 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:49.579 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:49.579 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:49.579 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:49.579 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:49.579 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 131556 2024-09-12T18:36:49.580 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.580 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:49.580 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.580 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:49.580 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502449+0000", 2024-09-12T18:36:49.580 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.580 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.580 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.580 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:49.580 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502449+0000", 2024-09-12T18:36:49.580 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.580 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.580 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.580 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:49.581 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502449+0000", 2024-09-12T18:36:49.581 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.15e-07 2024-09-12T18:36:49.581 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.581 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.581 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:49.581 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502481+0000", 2024-09-12T18:36:49.581 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1671999999999998e-05 2024-09-12T18:36:49.581 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.581 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.581 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:49.581 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502487+0000", 2024-09-12T18:36:49.581 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5270000000000004e-06 2024-09-12T18:36:49.582 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.582 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.582 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:49.582 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502492+0000", 2024-09-12T18:36:49.582 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0590000000000002e-06 2024-09-12T18:36:49.582 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.582 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.582 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:49.582 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502957+0000", 2024-09-12T18:36:49.582 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00046515 2024-09-12T18:36:49.582 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.582 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.582 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:49.583 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.503100+0000", 2024-09-12T18:36:49.583 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000142886 2024-09-12T18:36:49.583 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.583 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.583 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0,2", 2024-09-12T18:36:49.583 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.503268+0000", 2024-09-12T18:36:49.583 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016746299999999999 2024-09-12T18:36:49.583 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.583 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.583 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:49.583 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.506821+0000", 2024-09-12T18:36:49.583 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035528640000000002 2024-09-12T18:36:49.583 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.583 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.584 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:49.584 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.507126+0000", 2024-09-12T18:36:49.584 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030543399999999999 2024-09-12T18:36:49.584 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.584 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.584 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:49.584 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.524851+0000", 2024-09-12T18:36:49.584 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017724521999999999 2024-09-12T18:36:49.584 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.584 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.584 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:49.584 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.524920+0000", 2024-09-12T18:36:49.584 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9386000000000003e-05 2024-09-12T18:36:49.585 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.585 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.585 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:49.585 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.525046+0000", 2024-09-12T18:36:49.585 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000126088 2024-09-12T18:36:49.585 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.585 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:49.585 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.585 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.586 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.586 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:131557 5.0 5:0bc216b5:::benchmark_data_smithi073_23739_object131556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:36:49.586 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:45.502523+0000", 2024-09-12T18:36:49.586 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 3.9557696570000003, 2024-09-12T18:36:49.586 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024077715, 2024-09-12T18:36:49.586 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:49.586 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:49.586 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:49.586 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:49.586 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:49.586 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:49.587 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 131557 2024-09-12T18:36:49.587 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.587 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:49.587 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.587 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:49.587 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502523+0000", 2024-09-12T18:36:49.587 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.587 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.587 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.588 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:49.588 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502523+0000", 2024-09-12T18:36:49.588 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:49.588 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.588 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.588 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:49.588 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502523+0000", 2024-09-12T18:36:49.588 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3200000000000005e-07 2024-09-12T18:36:49.588 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.588 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.588 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:49.588 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502601+0000", 2024-09-12T18:36:49.589 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7344999999999999e-05 2024-09-12T18:36:49.589 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.589 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.589 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:49.589 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502611+0000", 2024-09-12T18:36:49.589 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0407999999999999e-05 2024-09-12T18:36:49.589 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.589 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.589 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:49.589 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502615+0000", 2024-09-12T18:36:49.589 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6739999999999999e-06 2024-09-12T18:36:49.589 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.589 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.589 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:49.590 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.505138+0000", 2024-09-12T18:36:49.590 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025231709999999998 2024-09-12T18:36:49.590 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.590 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.590 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:49.590 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.505244+0000", 2024-09-12T18:36:49.590 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000106006 2024-09-12T18:36:49.590 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.590 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.590 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0,2", 2024-09-12T18:36:49.590 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.505357+0000", 2024-09-12T18:36:49.590 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000113038 2024-09-12T18:36:49.590 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.591 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.591 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:49.591 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.507393+0000", 2024-09-12T18:36:49.591 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020356269999999999 2024-09-12T18:36:49.591 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.591 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.591 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:49.591 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.508538+0000", 2024-09-12T18:36:49.591 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001145016 2024-09-12T18:36:49.591 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.591 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.591 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:49.591 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.526436+0000", 2024-09-12T18:36:49.591 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017898121999999999 2024-09-12T18:36:49.592 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.592 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.592 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:49.592 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.526500+0000", 2024-09-12T18:36:49.592 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.3954999999999993e-05 2024-09-12T18:36:49.592 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:49.592 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:49.592 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:49.592 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.526601+0000", 2024-09-12T18:36:49.592 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000100821 2024-09-12T18:36:49.592 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.592 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:49.592 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.593 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:49.593 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:49.593 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:49.594 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:36:49.595 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:49.590+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:49.695 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:49.691+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:49.756 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:36:49.756 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:36:49.757 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.757 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:138724 5.c e54/21 5:362d196b:::benchmark_data_smithi073_23739_object6447:head v 54'8631, mlcod=54'8626)", 2024-09-12T18:36:49.757 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:49.745524+0000", 2024-09-12T18:36:49.757 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0085487029999999995, 2024-09-12T18:36:49.757 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0085698100000000006, 2024-09-12T18:36:49.757 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:49.758 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:49.758 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:49.758 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:49.758 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.758 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:49.758 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.745524+0000", 2024-09-12T18:36:49.759 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:49.759 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.759 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.759 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:49.759 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.745524+0000", 2024-09-12T18:36:49.759 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:49.760 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.760 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.760 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:49.760 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.745525+0000", 2024-09-12T18:36:49.760 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3099999999999997e-07 2024-09-12T18:36:49.760 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.761 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.761 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:49.761 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.745530+0000", 2024-09-12T18:36:49.761 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2399999999999998e-06 2024-09-12T18:36:49.761 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.761 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.762 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:49.762 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.745541+0000", 2024-09-12T18:36:49.762 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0569e-05 2024-09-12T18:36:49.762 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.762 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.762 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:49.763 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.745547+0000", 2024-09-12T18:36:49.763 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.421e-06 2024-09-12T18:36:49.763 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.763 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.763 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:49.763 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.749496+0000", 2024-09-12T18:36:49.764 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0039483579999999999 2024-09-12T18:36:49.764 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.764 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.764 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:49.764 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.749509+0000", 2024-09-12T18:36:49.764 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2826000000000001e-05 2024-09-12T18:36:49.765 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:49.765 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:49.765 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:49.765 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.765 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.765 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:138726 5.c e54/21 5:3533b577:::benchmark_data_smithi073_23739_object6449:head v 54'8632, mlcod=54'8626)", 2024-09-12T18:36:49.766 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:49.747641+0000", 2024-09-12T18:36:49.766 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0064321500000000002, 2024-09-12T18:36:49.766 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.006508542, 2024-09-12T18:36:49.766 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:49.766 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:49.767 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:49.767 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:49.767 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.767 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:49.767 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.747641+0000", 2024-09-12T18:36:49.767 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:49.768 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.768 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.768 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:49.768 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.747641+0000", 2024-09-12T18:36:49.768 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:49.768 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.768 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.769 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:49.769 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.747641+0000", 2024-09-12T18:36:49.769 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5499999999999998e-07 2024-09-12T18:36:49.769 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.769 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.769 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:49.769 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.747646+0000", 2024-09-12T18:36:49.770 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6460000000000001e-06 2024-09-12T18:36:49.770 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.770 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.770 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:49.770 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.747654+0000", 2024-09-12T18:36:49.770 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.303e-06 2024-09-12T18:36:49.771 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.771 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.771 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:49.771 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.747660+0000", 2024-09-12T18:36:49.771 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.6960000000000002e-06 2024-09-12T18:36:49.771 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.772 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.772 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:49.772 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.751613+0000", 2024-09-12T18:36:49.772 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0039528699999999998 2024-09-12T18:36:49.772 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.772 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.772 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:49.772 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.751633+0000", 2024-09-12T18:36:49.772 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9894999999999998e-05 2024-09-12T18:36:49.772 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:49.772 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:49.773 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:49.773 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.773 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.773 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:138732 5.c e54/21 5:3bb11aa7:::benchmark_data_smithi073_23739_object6455:head v 54'8633, mlcod=54'8626)", 2024-09-12T18:36:49.773 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:49.749498+0000", 2024-09-12T18:36:49.773 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.004575506, 2024-09-12T18:36:49.773 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0047006699999999997, 2024-09-12T18:36:49.773 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:49.773 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:49.773 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:49.773 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:49.773 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.773 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:49.774 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.749498+0000", 2024-09-12T18:36:49.774 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:49.774 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.774 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.774 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:49.774 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.749498+0000", 2024-09-12T18:36:49.774 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:49.774 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.774 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.774 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:49.774 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.749498+0000", 2024-09-12T18:36:49.774 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.9400000000000004e-07 2024-09-12T18:36:49.774 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.774 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.774 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:49.775 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.749504+0000", 2024-09-12T18:36:49.775 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.524e-06 2024-09-12T18:36:49.775 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.775 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.775 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:49.775 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.749514+0000", 2024-09-12T18:36:49.775 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0549e-05 2024-09-12T18:36:49.775 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.775 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.775 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:49.775 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.749521+0000", 2024-09-12T18:36:49.775 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4189999999999999e-06 2024-09-12T18:36:49.776 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.776 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.776 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:49.776 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.753835+0000", 2024-09-12T18:36:49.776 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0043137050000000001 2024-09-12T18:36:49.776 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.776 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.776 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:49.776 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.753852+0000", 2024-09-12T18:36:49.776 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7635e-05 2024-09-12T18:36:49.776 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:49.776 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:49.776 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:49.776 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.777 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.777 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:138736 5.2 5:4730810d:::benchmark_data_smithi073_23739_object6459:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T18:36:49.777 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:49.749595+0000", 2024-09-12T18:36:49.777 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0044777849999999998, 2024-09-12T18:36:49.777 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00466717, 2024-09-12T18:36:49.777 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:49.777 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:49.777 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:49.777 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:49.777 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:49.777 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:49.777 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 138736 2024-09-12T18:36:49.777 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.778 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:49.778 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.778 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:49.778 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.749595+0000", 2024-09-12T18:36:49.778 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:49.778 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.778 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.778 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:49.778 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.749595+0000", 2024-09-12T18:36:49.778 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:49.778 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.778 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.778 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:49.778 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.749596+0000", 2024-09-12T18:36:49.779 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1710000000000001e-06 2024-09-12T18:36:49.779 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.779 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.779 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:49.779 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.749602+0000", 2024-09-12T18:36:49.779 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1379999999999998e-06 2024-09-12T18:36:49.779 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.779 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.779 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:49.779 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.749615+0000", 2024-09-12T18:36:49.779 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3104e-05 2024-09-12T18:36:49.779 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.779 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.780 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:49.780 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.749623+0000", 2024-09-12T18:36:49.780 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.9510000000000006e-06 2024-09-12T18:36:49.780 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.780 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.780 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:49.780 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.749674+0000", 2024-09-12T18:36:49.780 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1468000000000003e-05 2024-09-12T18:36:49.780 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.780 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.780 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:49.780 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.749792+0000", 2024-09-12T18:36:49.780 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000117741 2024-09-12T18:36:49.781 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.781 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.781 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:49.781 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.749902+0000", 2024-09-12T18:36:49.781 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010999 2024-09-12T18:36:49.781 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.781 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.781 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:49.781 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.752848+0000", 2024-09-12T18:36:49.781 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.002946213 2024-09-12T18:36:49.781 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:49.781 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:49.781 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:49.781 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.782 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.782 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:138734 5.c e54/21)", 2024-09-12T18:36:49.782 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:49.751325+0000", 2024-09-12T18:36:49.782 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.002748024, 2024-09-12T18:36:49.782 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0030060690000000001, 2024-09-12T18:36:49.782 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:49.782 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:49.782 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:49.782 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:49.783 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.783 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:49.783 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.751325+0000", 2024-09-12T18:36:49.783 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:49.783 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.783 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.783 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:49.783 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.751325+0000", 2024-09-12T18:36:49.783 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:49.783 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.783 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.783 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:49.783 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.751326+0000", 2024-09-12T18:36:49.784 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.9400000000000004e-07 2024-09-12T18:36:49.784 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.784 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.784 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:49.784 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.751332+0000", 2024-09-12T18:36:49.784 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.6910000000000002e-06 2024-09-12T18:36:49.784 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.784 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.784 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:49.784 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.751344+0000", 2024-09-12T18:36:49.784 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2311e-05 2024-09-12T18:36:49.784 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.784 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.784 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:49.785 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.751350+0000", 2024-09-12T18:36:49.785 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4869999999999999e-06 2024-09-12T18:36:49.785 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:49.785 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:49.785 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:49.785 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.785 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.786 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:138735 5.c e54/21)", 2024-09-12T18:36:49.786 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:49.752791+0000", 2024-09-12T18:36:49.786 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.001281887, 2024-09-12T18:36:49.786 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0015753710000000001, 2024-09-12T18:36:49.786 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:49.786 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:49.787 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:49.787 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:49.787 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.787 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:49.787 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.752791+0000", 2024-09-12T18:36:49.787 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:49.787 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.787 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.788 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:49.788 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.752791+0000", 2024-09-12T18:36:49.788 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:49.788 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.788 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.788 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:49.788 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.752792+0000", 2024-09-12T18:36:49.788 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.8899999999999999e-07 2024-09-12T18:36:49.788 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.788 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.789 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:49.789 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.752797+0000", 2024-09-12T18:36:49.789 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8539999999999996e-06 2024-09-12T18:36:49.789 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.789 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.789 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:49.789 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.752825+0000", 2024-09-12T18:36:49.789 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.8163000000000001e-05 2024-09-12T18:36:49.789 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.789 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.789 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:49.789 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.752832+0000", 2024-09-12T18:36:49.789 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.5599999999999996e-06 2024-09-12T18:36:49.789 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:49.790 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:49.790 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:49.790 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.790 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.790 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:138739 5.f 5:fa619545:::benchmark_data_smithi073_23739_object6462:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T18:36:49.790 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:49.753172+0000", 2024-09-12T18:36:49.790 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.00090107499999999999, 2024-09-12T18:36:49.790 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0012530359999999999, 2024-09-12T18:36:49.790 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:49.790 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:49.790 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:49.790 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:49.791 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:49.791 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:49.791 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 138739 2024-09-12T18:36:49.791 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.791 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:49.791 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.791 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:49.791 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.753172+0000", 2024-09-12T18:36:49.791 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:49.791 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.791 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.791 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:49.792 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.753172+0000", 2024-09-12T18:36:49.792 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:49.792 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.792 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.792 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:49.792 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.753173+0000", 2024-09-12T18:36:49.792 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.8100000000000001e-07 2024-09-12T18:36:49.792 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.792 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.792 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:49.793 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.753177+0000", 2024-09-12T18:36:49.793 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.0609999999999997e-06 2024-09-12T18:36:49.793 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.793 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.793 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:49.793 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.753185+0000", 2024-09-12T18:36:49.793 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4230000000000005e-06 2024-09-12T18:36:49.793 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.793 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.793 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:49.793 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.753191+0000", 2024-09-12T18:36:49.793 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4090000000000002e-06 2024-09-12T18:36:49.793 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.793 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.794 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:49.794 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.753233+0000", 2024-09-12T18:36:49.794 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.2355999999999999e-05 2024-09-12T18:36:49.794 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.794 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.794 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:49.794 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.753353+0000", 2024-09-12T18:36:49.794 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000119812 2024-09-12T18:36:49.794 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.794 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.794 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:49.794 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.753463+0000", 2024-09-12T18:36:49.794 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010947599999999999 2024-09-12T18:36:49.794 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:49.795 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:49.795 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:49.795 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.795 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.795 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:138740 5.2 5:41d187f3:::benchmark_data_smithi073_23739_object6463:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T18:36:49.795 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:49.753615+0000", 2024-09-12T18:36:49.795 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.00045853099999999998, 2024-09-12T18:36:49.795 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00088849299999999997, 2024-09-12T18:36:49.795 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:49.795 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:49.795 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:49.795 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:49.795 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:49.795 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:49.796 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 138740 2024-09-12T18:36:49.796 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.796 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:49.796 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.796 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:49.796 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.753615+0000", 2024-09-12T18:36:49.796 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:49.796 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.796 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.796 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:49.796 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.753615+0000", 2024-09-12T18:36:49.797 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:49.797 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.797 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.797 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:49.797 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.753615+0000", 2024-09-12T18:36:49.797 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.6599999999999996e-07 2024-09-12T18:36:49.797 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.798 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.798 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:49.798 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.753618+0000", 2024-09-12T18:36:49.798 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.112e-06 2024-09-12T18:36:49.798 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.798 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.798 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:49.798 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.753626+0000", 2024-09-12T18:36:49.798 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.4909999999999999e-06 2024-09-12T18:36:49.798 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.798 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.798 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:49.798 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.753630+0000", 2024-09-12T18:36:49.799 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.1810000000000003e-06 2024-09-12T18:36:49.799 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.799 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.799 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:49.799 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.753679+0000", 2024-09-12T18:36:49.799 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8677999999999997e-05 2024-09-12T18:36:49.799 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.799 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.799 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:49.799 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.753790+0000", 2024-09-12T18:36:49.799 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000111327 2024-09-12T18:36:49.799 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.799 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.799 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:49.800 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.753891+0000", 2024-09-12T18:36:49.800 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000101208 2024-09-12T18:36:49.800 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:49.800 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:49.800 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:49.800 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.800 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.800 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:138742 5.3 e54/21 5:ce149abe:::benchmark_data_smithi073_23739_object6465:head v 54'8523, mlcod=54'8520)", 2024-09-12T18:36:49.800 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:49.753978+0000", 2024-09-12T18:36:49.800 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 9.5474000000000001e-05, 2024-09-12T18:36:49.800 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00059046299999999995, 2024-09-12T18:36:49.800 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:49.800 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:49.801 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:49.801 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:49.801 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.801 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:49.801 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.753978+0000", 2024-09-12T18:36:49.801 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:49.801 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.801 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.801 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:49.801 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.753978+0000", 2024-09-12T18:36:49.801 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:49.801 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.801 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.802 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:49.802 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.753978+0000", 2024-09-12T18:36:49.802 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.99e-07 2024-09-12T18:36:49.802 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.802 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.802 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:49.802 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.753986+0000", 2024-09-12T18:36:49.802 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.0730000000000005e-06 2024-09-12T18:36:49.802 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.802 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.802 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:49.802 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.753997+0000", 2024-09-12T18:36:49.802 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0688e-05 2024-09-12T18:36:49.803 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.803 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.803 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:49.803 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.754004+0000", 2024-09-12T18:36:49.803 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.652e-06 2024-09-12T18:36:49.803 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.803 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.803 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:49.803 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.754129+0000", 2024-09-12T18:36:49.804 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012543100000000001 2024-09-12T18:36:49.804 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.804 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.804 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:49.804 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.754149+0000", 2024-09-12T18:36:49.804 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9482000000000001e-05 2024-09-12T18:36:49.804 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:49.804 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:49.804 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:49.804 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.804 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.804 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "MOSDPGPush(5.0 54/49 [PushOp(5:03669d9a:::benchmark_data_smithi073_23739_object8711:head, version: 24'566, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(5:03669d9a:::benchmark_data_smithi073_23739_object8711:head@24'566, size: 65536, copy_subset: [(0, 65536)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 65536, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T18:36:49.805 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:49.753925+0000", 2024-09-12T18:36:49.805 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.00014806800000000001, 2024-09-12T18:36:49.805 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00072188600000000003, 2024-09-12T18:36:49.805 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:49.805 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:49.805 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:49.805 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:49.805 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.805 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:49.805 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.753925+0000", 2024-09-12T18:36:49.806 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:49.806 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.806 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.806 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:49.806 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.753925+0000", 2024-09-12T18:36:49.806 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:49.806 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.806 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.806 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:49.806 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.753926+0000", 2024-09-12T18:36:49.806 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.0800000000000004e-07 2024-09-12T18:36:49.806 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.806 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.806 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:49.807 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.754279+0000", 2024-09-12T18:36:49.807 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00035348299999999998 2024-09-12T18:36:49.807 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.807 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.807 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:49.807 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.754298+0000", 2024-09-12T18:36:49.807 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9335999999999999e-05 2024-09-12T18:36:49.807 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.807 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.807 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:49.807 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.754324+0000", 2024-09-12T18:36:49.807 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.5473000000000002e-05 2024-09-12T18:36:49.807 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.807 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.808 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:49.808 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.754433+0000", 2024-09-12T18:36:49.808 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000108891 2024-09-12T18:36:49.808 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.808 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.808 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:49.808 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.754446+0000", 2024-09-12T18:36:49.808 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2826000000000001e-05 2024-09-12T18:36:49.808 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:49.808 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:49.808 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:49.808 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.808 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.809 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "pg_backfill(progress 5.0 e 54/54 lb 5:0364f9e9:::benchmark_data_smithi073_23739_object63222:head)", 2024-09-12T18:36:49.809 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:49.754357+0000", 2024-09-12T18:36:49.809 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 4294967295.9997163, 2024-09-12T18:36:49.809 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000342123, 2024-09-12T18:36:49.809 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:49.809 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:49.809 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:49.809 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:49.809 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.809 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:49.809 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.754357+0000", 2024-09-12T18:36:49.809 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:49.809 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.809 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.810 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:49.810 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.754357+0000", 2024-09-12T18:36:49.810 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:49.810 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.810 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.810 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:49.810 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.754357+0000", 2024-09-12T18:36:49.810 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.1899999999999998e-07 2024-09-12T18:36:49.810 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.810 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.810 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:49.810 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.754369+0000", 2024-09-12T18:36:49.810 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2305e-05 2024-09-12T18:36:49.810 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.811 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.811 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:49.811 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.754377+0000", 2024-09-12T18:36:49.811 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.4379999999999998e-06 2024-09-12T18:36:49.811 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.811 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.811 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:49.811 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.754389+0000", 2024-09-12T18:36:49.811 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.186e-05 2024-09-12T18:36:49.811 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:49.811 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:49.811 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:49.811 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.811 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.812 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:138744 5.5 5:a8215d48:::benchmark_data_smithi073_23739_object6467:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T18:36:49.812 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:49.754431+0000", 2024-09-12T18:36:49.812 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 4294967295.9996424, 2024-09-12T18:36:49.812 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032392100000000002, 2024-09-12T18:36:49.812 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:49.812 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:49.812 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:49.812 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:49.812 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:49.812 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:49.812 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 138744 2024-09-12T18:36:49.813 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.813 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:49.813 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.813 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:49.813 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.754431+0000", 2024-09-12T18:36:49.813 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:49.813 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.814 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.814 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:49.814 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.754431+0000", 2024-09-12T18:36:49.814 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:49.814 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.814 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.814 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:49.815 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.754432+0000", 2024-09-12T18:36:49.815 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0380000000000001e-06 2024-09-12T18:36:49.815 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.815 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.815 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:49.815 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.754437+0000", 2024-09-12T18:36:49.816 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.5600000000000004e-06 2024-09-12T18:36:49.816 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.816 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.816 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:49.816 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.754446+0000", 2024-09-12T18:36:49.816 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9210000000000004e-06 2024-09-12T18:36:49.817 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.817 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.817 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:49.817 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.754453+0000", 2024-09-12T18:36:49.817 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.878e-06 2024-09-12T18:36:49.818 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.818 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.818 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:49.818 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.754512+0000", 2024-09-12T18:36:49.818 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.8964e-05 2024-09-12T18:36:49.818 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.819 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.819 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:49.819 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.754645+0000", 2024-09-12T18:36:49.819 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013310399999999999 2024-09-12T18:36:49.819 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:49.819 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:49.820 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:49.820 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.820 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.820 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:138718 5.c e54/21 5:392bb516:::benchmark_data_smithi073_23739_object6441:head v 54'8630, mlcod=54'8624)", 2024-09-12T18:36:49.820 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:49.743616+0000", 2024-09-12T18:36:49.821 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.010456581, 2024-09-12T18:36:49.821 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011193837999999999, 2024-09-12T18:36:49.821 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:49.821 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:49.821 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:49.821 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:49.822 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.822 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:49.822 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.743616+0000", 2024-09-12T18:36:49.822 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:49.822 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.823 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.823 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:49.823 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.743616+0000", 2024-09-12T18:36:49.823 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:49.823 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.823 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.824 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:49.824 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.743617+0000", 2024-09-12T18:36:49.824 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.0800000000000004e-07 2024-09-12T18:36:49.824 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.824 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.825 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:49.825 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.743622+0000", 2024-09-12T18:36:49.825 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2599999999999996e-06 2024-09-12T18:36:49.825 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.825 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.825 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:49.826 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.743640+0000", 2024-09-12T18:36:49.826 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7717e-05 2024-09-12T18:36:49.826 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.826 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.826 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:49.826 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.743647+0000", 2024-09-12T18:36:49.827 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.5100000000000004e-06 2024-09-12T18:36:49.827 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.827 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.827 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:49.827 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.745660+0000", 2024-09-12T18:36:49.827 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0020134979999999999 2024-09-12T18:36:49.828 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.828 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.828 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:49.828 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.745682+0000", 2024-09-12T18:36:49.828 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.1577e-05 2024-09-12T18:36:49.829 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:49.829 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:49.829 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:49.829 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.829 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.829 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:138745 5.2 5.fe252ea2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T18:36:49.830 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:49.754477+0000", 2024-09-12T18:36:49.830 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 4294967295.9995961, 2024-09-12T18:36:49.830 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00038038600000000003, 2024-09-12T18:36:49.830 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:49.830 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:49.830 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:49.831 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:49.831 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:49.831 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:49.831 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 138745 2024-09-12T18:36:49.831 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.832 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:49.832 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.832 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:49.832 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.754477+0000", 2024-09-12T18:36:49.832 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:49.832 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.833 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.833 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:49.833 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.754477+0000", 2024-09-12T18:36:49.833 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:49.833 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.834 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.834 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:49.834 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.754478+0000", 2024-09-12T18:36:49.834 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.6599999999999996e-07 2024-09-12T18:36:49.834 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.834 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.835 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:49.835 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.754481+0000", 2024-09-12T18:36:49.835 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.275e-06 2024-09-12T18:36:49.835 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.835 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.835 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:49.835 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.754489+0000", 2024-09-12T18:36:49.836 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.422e-06 2024-09-12T18:36:49.836 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:49.836 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:49.836 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:49.836 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:49.754495+0000", 2024-09-12T18:36:49.836 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.8900000000000004e-06 2024-09-12T18:36:49.836 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:49.836 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:49.836 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:49.836 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:49.836 INFO:teuthology.orchestra.run.smithi162.stdout: ], 2024-09-12T18:36:49.836 INFO:teuthology.orchestra.run.smithi162.stdout: "num_ops": 14 2024-09-12T18:36:49.836 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:36:49.838 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:36:49.838 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:49.835+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:49.939 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:49.931+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:49.965 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:36:50.039 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:36:50.039 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [], 2024-09-12T18:36:50.039 INFO:teuthology.orchestra.run.smithi162.stdout: "complaint_time": 30, 2024-09-12T18:36:50.039 INFO:teuthology.orchestra.run.smithi162.stdout: "num_blocked_ops": 0 2024-09-12T18:36:50.039 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:36:50.040 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:50.035+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:50.059 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:36:50.124 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:36:50.124 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:36:50.140 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:50.134+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:50.142 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:36:50.142 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:36:50.160 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T18:36:50.162 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:36:50.162 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:36:50.215 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:50.215 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:50.236 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:36:50.240 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:50.234+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:50.341 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:50.339+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:50.391 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:50.391 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:50.412 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:36:50.455 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:50.451+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:50.543 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:50.538+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:50.567 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:50.567 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:50.587 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:36:50.644 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:50.638+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:50.744 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:50.739+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:50.791 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:50.791 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:50.812 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:36:50.857 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:50.854+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:50.946 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:50.943+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:50.971 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:50.971 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:50.993 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:36:51.081 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:51.078+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:51.135 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:36:51.136 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:36:51.136 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-12T18:36:51.136 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T18:36:51.148 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:51.142+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:51.153 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is unset 2024-09-12T18:36:51.194 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:51.194 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:51.216 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:36:51.249 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:51.243+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:51.351 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:51.343+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:51.419 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:51.419 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:51.441 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:36:51.466 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:36:51.466 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T18:36:51.466 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 55, 2024-09-12T18:36:51.466 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "c08d5a84-711b-44bf-bdf1-e06ecc2c7c00", 2024-09-12T18:36:51.466 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-12T18:35:02.695853+0000", 2024-09-12T18:36:51.466 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-12T18:36:51.143872+0000", 2024-09-12T18:36:51.466 INFO:teuthology.orchestra.run.smithi073.stdout: "last_up_change": "2024-09-12T18:35:12.464628+0000", 2024-09-12T18:36:51.466 INFO:teuthology.orchestra.run.smithi073.stdout: "last_in_change": "2024-09-12T18:35:04.352525+0000", 2024-09-12T18:36:51.466 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T18:36:51.466 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_num": 5799936, 2024-09-12T18:36:51.467 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_set": [ 2024-09-12T18:36:51.467 INFO:teuthology.orchestra.run.smithi073.stdout: "pglog_hardlimit", 2024-09-12T18:36:51.467 INFO:teuthology.orchestra.run.smithi073.stdout: "purged_snapdirs", 2024-09-12T18:36:51.467 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_deletes", 2024-09-12T18:36:51.467 INFO:teuthology.orchestra.run.smithi073.stdout: "sortbitwise" 2024-09-12T18:36:51.467 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T18:36:51.467 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_version": 5, 2024-09-12T18:36:51.467 INFO:teuthology.orchestra.run.smithi073.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T18:36:51.467 INFO:teuthology.orchestra.run.smithi073.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T18:36:51.467 INFO:teuthology.orchestra.run.smithi073.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T18:36:51.467 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_snapshot": "", 2024-09-12T18:36:51.468 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_max": 5, 2024-09-12T18:36:51.468 INFO:teuthology.orchestra.run.smithi073.stdout: "max_osd": 3, 2024-09-12T18:36:51.468 INFO:teuthology.orchestra.run.smithi073.stdout: "require_min_compat_client": "luminous", 2024-09-12T18:36:51.468 INFO:teuthology.orchestra.run.smithi073.stdout: "min_compat_client": "jewel", 2024-09-12T18:36:51.468 INFO:teuthology.orchestra.run.smithi073.stdout: "require_osd_release": "squid", 2024-09-12T18:36:51.468 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_crimson": false, 2024-09-12T18:36:51.468 INFO:teuthology.orchestra.run.smithi073.stdout: "pools": [ 2024-09-12T18:36:51.468 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:51.468 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 1, 2024-09-12T18:36:51.468 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": ".mgr", 2024-09-12T18:36:51.468 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:12.418430+0000", 2024-09-12T18:36:51.469 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-12T18:36:51.469 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-09-12T18:36:51.469 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:36:51.469 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:36:51.469 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:36:51.469 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:36:51.469 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:36:51.469 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:36:51.469 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:36:51.469 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:36:51.469 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:36:51.469 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:36:51.469 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:36:51.470 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 1, 2024-09-12T18:36:51.470 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 1, 2024-09-12T18:36:51.470 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 1, 2024-09-12T18:36:51.470 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 1, 2024-09-12T18:36:51.470 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 1, 2024-09-12T18:36:51.470 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:36:51.470 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:36:51.470 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:36:51.470 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:36:51.470 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:36:51.470 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:36:51.470 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:36:51.470 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.471 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "11", 2024-09-12T18:36:51.471 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:36:51.471 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:36:51.471 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:36:51.471 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:36:51.471 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:36:51.471 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-09-12T18:36:51.471 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-09-12T18:36:51.471 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:36:51.471 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:36:51.471 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:36:51.471 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:36:51.471 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:36:51.472 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:36:51.472 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:36:51.472 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:36:51.472 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:36:51.472 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:36:51.472 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:36:51.472 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:36:51.472 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:36:51.472 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:36:51.472 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:36:51.472 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:36:51.472 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:36:51.473 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:36:51.473 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:36:51.473 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.473 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:36:51.473 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:36:51.473 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:36:51.473 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:36:51.473 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:36:51.473 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:36:51.473 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:36:51.473 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:36:51.473 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:36:51.473 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:36:51.473 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:36:51.474 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-09-12T18:36:51.474 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_max": 32, 2024-09-12T18:36:51.474 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 1 2024-09-12T18:36:51.474 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.474 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:36:51.474 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": {} 2024-09-12T18:36:51.474 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.474 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:36:51.474 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:36:51.474 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 2.9900000095367432, 2024-09-12T18:36:51.474 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 2.9900000095367432, 2024-09-12T18:36:51.474 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 0.67000001668930054, 2024-09-12T18:36:51.475 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 2, 2024-09-12T18:36:51.475 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 2, 2024-09-12T18:36:51.475 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:36:51.475 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:36:51.475 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:36:51.475 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:51.475 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.475 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:51.475 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 2, 2024-09-12T18:36:51.475 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "rbd", 2024-09-12T18:36:51.475 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:18.665309+0000", 2024-09-12T18:36:51.475 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 8193, 2024-09-12T18:36:51.475 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T18:36:51.475 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:36:51.476 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:36:51.476 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:36:51.476 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:36:51.476 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:36:51.477 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:36:51.477 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:36:51.477 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:36:51.477 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:36:51.477 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:36:51.477 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:36:51.477 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 8, 2024-09-12T18:36:51.477 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 8, 2024-09-12T18:36:51.477 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 8, 2024-09-12T18:36:51.477 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 8, 2024-09-12T18:36:51.477 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 8, 2024-09-12T18:36:51.477 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:36:51.477 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:36:51.477 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:36:51.478 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:36:51.478 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:36:51.478 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:36:51.478 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:36:51.478 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.478 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "15", 2024-09-12T18:36:51.478 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:36:51.478 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:36:51.478 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:36:51.478 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:36:51.478 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:36:51.478 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 2, 2024-09-12T18:36:51.478 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 15, 2024-09-12T18:36:51.478 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:36:51.479 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:36:51.479 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:36:51.479 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:36:51.479 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:36:51.479 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:36:51.479 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:36:51.479 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:36:51.479 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:36:51.479 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:36:51.479 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:36:51.479 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:36:51.479 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:36:51.479 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:36:51.480 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:36:51.480 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:36:51.480 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:36:51.480 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:36:51.480 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:36:51.480 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.480 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:36:51.480 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:36:51.480 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:36:51.480 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:36:51.480 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:36:51.480 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:36:51.480 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:36:51.480 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:36:51.481 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:36:51.481 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:36:51.481 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:36:51.481 INFO:teuthology.orchestra.run.smithi073.stdout: "options": {}, 2024-09-12T18:36:51.481 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:36:51.481 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd": {} 2024-09-12T18:36:51.481 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.481 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:36:51.481 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:36:51.481 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.5, 2024-09-12T18:36:51.481 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.5, 2024-09-12T18:36:51.481 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-09-12T18:36:51.481 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.5, 2024-09-12T18:36:51.482 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.5, 2024-09-12T18:36:51.482 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:36:51.482 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:36:51.482 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:36:51.482 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:51.482 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.482 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:51.482 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 3, 2024-09-12T18:36:51.482 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "cephfs_metadata", 2024-09-12T18:36:51.482 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:23.447845+0000", 2024-09-12T18:36:51.482 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-12T18:36:51.482 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-09-12T18:36:51.482 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:36:51.482 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:36:51.483 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:36:51.483 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:36:51.483 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:36:51.483 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:36:51.483 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:36:51.483 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:36:51.483 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:36:51.483 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:36:51.483 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:36:51.483 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 32, 2024-09-12T18:36:51.483 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 32, 2024-09-12T18:36:51.483 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 32, 2024-09-12T18:36:51.483 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 32, 2024-09-12T18:36:51.484 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 32, 2024-09-12T18:36:51.484 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:36:51.484 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:36:51.484 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:36:51.484 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:36:51.484 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:36:51.484 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:36:51.484 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:36:51.484 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.484 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "18", 2024-09-12T18:36:51.484 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:36:51.484 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:36:51.485 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:36:51.485 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:36:51.485 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:36:51.485 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-09-12T18:36:51.485 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-09-12T18:36:51.485 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:36:51.485 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:36:51.485 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:36:51.485 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:36:51.485 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:36:51.485 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:36:51.485 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:36:51.486 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:36:51.486 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:36:51.486 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:36:51.486 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:36:51.486 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:36:51.486 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:36:51.486 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:36:51.486 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:36:51.486 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:36:51.486 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:36:51.486 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:36:51.486 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:36:51.487 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.487 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:36:51.487 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:36:51.487 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:36:51.487 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:36:51.487 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:36:51.487 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:36:51.487 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:36:51.487 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:36:51.487 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:36:51.487 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:36:51.488 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:36:51.488 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-09-12T18:36:51.488 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_bias": 4, 2024-09-12T18:36:51.488 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 16, 2024-09-12T18:36:51.488 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_priority": 5 2024-09-12T18:36:51.488 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.488 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:36:51.488 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs": { 2024-09-12T18:36:51.488 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": "cephfs" 2024-09-12T18:36:51.488 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:51.488 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.488 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:36:51.489 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:36:51.489 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.4099999666213989, 2024-09-12T18:36:51.489 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.4099999666213989, 2024-09-12T18:36:51.489 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-09-12T18:36:51.489 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.4099999666213989, 2024-09-12T18:36:51.489 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.4099999666213989, 2024-09-12T18:36:51.489 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:36:51.489 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:36:51.489 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:36:51.489 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:51.489 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.490 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:51.490 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 4, 2024-09-12T18:36:51.490 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "cephfs_data", 2024-09-12T18:36:51.490 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:23.959973+0000", 2024-09-12T18:36:51.490 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-12T18:36:51.490 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-09-12T18:36:51.490 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:36:51.490 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:36:51.490 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:36:51.490 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:36:51.490 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:36:51.490 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:36:51.490 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:36:51.491 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:36:51.491 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:36:51.491 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:36:51.491 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:36:51.491 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 64, 2024-09-12T18:36:51.491 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 64, 2024-09-12T18:36:51.491 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 64, 2024-09-12T18:36:51.491 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 64, 2024-09-12T18:36:51.491 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 64, 2024-09-12T18:36:51.491 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:36:51.491 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:36:51.491 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:36:51.492 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:36:51.492 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:36:51.492 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:36:51.492 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:36:51.492 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.492 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "19", 2024-09-12T18:36:51.492 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:36:51.492 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:36:51.492 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:36:51.492 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:36:51.492 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:36:51.492 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-09-12T18:36:51.493 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-09-12T18:36:51.493 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:36:51.493 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:36:51.493 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:36:51.493 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:36:51.493 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:36:51.493 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:36:51.493 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:36:51.493 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:36:51.493 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:36:51.493 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:36:51.493 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:36:51.493 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:36:51.494 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:36:51.494 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:36:51.494 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:36:51.494 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:36:51.494 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:36:51.494 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:36:51.494 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:36:51.494 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.494 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:36:51.494 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:36:51.494 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:36:51.494 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:36:51.494 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:36:51.494 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:36:51.494 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:36:51.495 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:36:51.495 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:36:51.495 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:36:51.495 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:36:51.495 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-09-12T18:36:51.495 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 64, 2024-09-12T18:36:51.495 INFO:teuthology.orchestra.run.smithi073.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T18:36:51.495 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.495 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:36:51.495 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs": { 2024-09-12T18:36:51.495 INFO:teuthology.orchestra.run.smithi073.stdout: "data": "cephfs" 2024-09-12T18:36:51.495 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:51.495 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.496 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:36:51.496 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:36:51.496 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.4099999666213989, 2024-09-12T18:36:51.496 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.4099999666213989, 2024-09-12T18:36:51.496 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-09-12T18:36:51.496 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.4099999666213989, 2024-09-12T18:36:51.496 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.4099999666213989, 2024-09-12T18:36:51.496 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:36:51.496 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:36:51.496 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:36:51.496 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:51.496 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.496 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:51.496 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 5, 2024-09-12T18:36:51.497 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "unique_pool_0", 2024-09-12T18:36:51.497 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:43.562347+0000", 2024-09-12T18:36:51.497 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-12T18:36:51.497 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-09-12T18:36:51.497 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:36:51.497 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:36:51.497 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:36:51.497 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:36:51.497 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:36:51.497 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:36:51.497 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:36:51.498 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:36:51.498 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:36:51.498 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:36:51.498 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:36:51.498 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 16, 2024-09-12T18:36:51.498 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 16, 2024-09-12T18:36:51.498 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 16, 2024-09-12T18:36:51.498 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 16, 2024-09-12T18:36:51.498 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 16, 2024-09-12T18:36:51.498 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:36:51.498 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:36:51.498 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:36:51.498 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:36:51.498 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:36:51.499 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:36:51.499 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:36:51.499 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.499 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "23", 2024-09-12T18:36:51.499 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:36:51.499 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:36:51.499 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:36:51.499 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:36:51.499 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:36:51.499 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-09-12T18:36:51.499 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-09-12T18:36:51.499 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:36:51.499 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:36:51.499 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:36:51.499 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:36:51.500 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:36:51.500 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:36:51.500 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:36:51.500 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:36:51.500 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:36:51.500 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:36:51.500 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:36:51.500 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:36:51.500 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:36:51.500 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:36:51.500 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:36:51.500 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:36:51.500 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:36:51.500 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:36:51.501 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:36:51.501 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.501 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:36:51.501 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:36:51.501 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:36:51.501 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:36:51.501 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:36:51.501 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:36:51.501 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:36:51.501 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:36:51.501 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:36:51.501 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:36:51.501 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:36:51.502 INFO:teuthology.orchestra.run.smithi073.stdout: "options": {}, 2024-09-12T18:36:51.502 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:36:51.502 INFO:teuthology.orchestra.run.smithi073.stdout: "rados": {} 2024-09-12T18:36:51.502 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.502 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:36:51.502 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:36:51.502 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.1299999952316284, 2024-09-12T18:36:51.502 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.1299999952316284, 2024-09-12T18:36:51.502 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-09-12T18:36:51.502 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T18:36:51.502 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T18:36:51.502 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:36:51.502 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:36:51.502 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:36:51.503 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:51.503 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:51.503 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T18:36:51.503 INFO:teuthology.orchestra.run.smithi073.stdout: "osds": [ 2024-09-12T18:36:51.503 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:51.503 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-09-12T18:36:51.503 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "f1cf24e8-6179-4666-a444-fa81ef0d7482", 2024-09-12T18:36:51.503 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-09-12T18:36:51.503 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-09-12T18:36:51.503 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0.6371612548828125, 2024-09-12T18:36:51.503 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-09-12T18:36:51.503 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-09-12T18:36:51.503 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-09-12T18:36:51.504 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-09-12T18:36:51.504 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 21, 2024-09-12T18:36:51.504 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-09-12T18:36:51.504 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-09-12T18:36:51.504 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-12T18:36:51.504 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:51.504 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:51.504 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:51.504 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6800", 2024-09-12T18:36:51.504 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:36:51.504 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.504 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:51.504 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:51.505 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6801", 2024-09-12T18:36:51.505 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:36:51.505 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:51.505 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:51.505 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.505 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-09-12T18:36:51.505 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:51.505 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:51.505 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:51.505 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6802", 2024-09-12T18:36:51.505 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:36:51.505 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.505 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:51.506 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:51.506 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6803", 2024-09-12T18:36:51.506 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:36:51.506 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:51.506 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:51.506 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.506 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-09-12T18:36:51.506 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:51.506 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:51.506 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:51.506 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6806", 2024-09-12T18:36:51.506 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:36:51.506 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.507 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:51.507 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:51.507 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6807", 2024-09-12T18:36:51.507 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:36:51.507 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:51.507 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:51.507 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.507 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-09-12T18:36:51.507 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:51.507 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:51.507 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:51.507 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6804", 2024-09-12T18:36:51.507 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:36:51.507 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.508 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:51.508 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:51.508 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6805", 2024-09-12T18:36:51.508 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:36:51.508 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:51.508 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:51.508 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.508 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.114:6801/2710632206", 2024-09-12T18:36:51.508 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.114:6803/2710632206", 2024-09-12T18:36:51.508 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.114:6807/2710632206", 2024-09-12T18:36:51.508 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.114:6805/2710632206", 2024-09-12T18:36:51.509 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-09-12T18:36:51.509 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-09-12T18:36:51.509 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-09-12T18:36:51.509 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:51.509 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.509 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:51.509 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-09-12T18:36:51.509 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "3fdb0044-2820-4411-978b-4b6e94fbf0b1", 2024-09-12T18:36:51.509 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-09-12T18:36:51.509 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-09-12T18:36:51.509 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-09-12T18:36:51.509 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-09-12T18:36:51.510 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-09-12T18:36:51.510 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-09-12T18:36:51.510 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 9, 2024-09-12T18:36:51.510 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 49, 2024-09-12T18:36:51.510 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-09-12T18:36:51.510 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-09-12T18:36:51.510 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-12T18:36:51.510 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:51.510 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:51.510 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:51.510 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6800", 2024-09-12T18:36:51.510 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:36:51.510 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.511 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:51.511 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:51.511 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6801", 2024-09-12T18:36:51.511 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:36:51.511 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:51.511 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:51.511 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.511 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-09-12T18:36:51.511 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:51.511 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:51.511 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:51.511 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6802", 2024-09-12T18:36:51.511 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:36:51.512 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.512 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:51.512 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:51.512 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6803", 2024-09-12T18:36:51.512 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:36:51.512 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:51.512 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:51.512 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.512 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-09-12T18:36:51.512 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:51.512 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:51.512 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:51.512 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6806", 2024-09-12T18:36:51.512 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:36:51.513 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.513 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:51.513 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:51.513 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6807", 2024-09-12T18:36:51.513 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:36:51.513 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:51.513 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:51.513 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.513 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-09-12T18:36:51.513 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:51.513 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:51.513 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:51.513 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6804", 2024-09-12T18:36:51.514 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:36:51.514 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.514 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:51.514 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:51.514 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6805", 2024-09-12T18:36:51.514 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:36:51.514 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:51.514 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:51.514 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.514 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.143:6801/862189968", 2024-09-12T18:36:51.514 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.143:6803/862189968", 2024-09-12T18:36:51.514 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.143:6807/862189968", 2024-09-12T18:36:51.514 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.143:6805/862189968", 2024-09-12T18:36:51.515 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-09-12T18:36:51.515 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-09-12T18:36:51.515 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-09-12T18:36:51.515 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:51.515 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.515 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:51.515 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2024-09-12T18:36:51.515 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "6fb554da-561f-4aa2-b855-0e3adb98b057", 2024-09-12T18:36:51.515 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-09-12T18:36:51.515 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-09-12T18:36:51.515 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-09-12T18:36:51.515 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-09-12T18:36:51.515 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-09-12T18:36:51.516 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-09-12T18:36:51.516 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-09-12T18:36:51.516 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 49, 2024-09-12T18:36:51.516 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-09-12T18:36:51.516 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-09-12T18:36:51.516 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-12T18:36:51.516 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:51.516 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:51.516 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:51.516 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6800", 2024-09-12T18:36:51.516 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:36:51.516 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.516 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:51.516 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:51.517 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6801", 2024-09-12T18:36:51.517 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:36:51.517 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:51.517 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:51.517 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.517 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-09-12T18:36:51.517 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:51.517 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:51.517 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:51.517 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6802", 2024-09-12T18:36:51.517 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:36:51.517 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.518 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:51.518 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:51.518 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6803", 2024-09-12T18:36:51.518 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:36:51.518 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:51.518 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:51.518 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.518 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-09-12T18:36:51.518 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:51.518 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:51.518 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:51.519 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6806", 2024-09-12T18:36:51.519 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:36:51.519 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.519 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:51.519 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:51.519 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6807", 2024-09-12T18:36:51.519 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:36:51.519 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:51.519 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:51.519 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.519 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-09-12T18:36:51.519 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:36:51.520 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:51.520 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:36:51.520 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6804", 2024-09-12T18:36:51.520 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:36:51.520 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.520 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:51.520 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:36:51.520 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6805", 2024-09-12T18:36:51.520 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:36:51.520 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:51.520 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:51.520 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.521 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.162:6801/1397104153", 2024-09-12T18:36:51.521 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.162:6803/1397104153", 2024-09-12T18:36:51.521 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.162:6807/1397104153", 2024-09-12T18:36:51.521 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.162:6805/1397104153", 2024-09-12T18:36:51.521 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-09-12T18:36:51.521 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-09-12T18:36:51.521 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-09-12T18:36:51.521 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:51.521 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:51.521 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T18:36:51.521 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_xinfo": [ 2024-09-12T18:36:51.521 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:51.522 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-09-12T18:36:51.522 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-09-12T18:36:51.522 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-09-12T18:36:51.522 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-09-12T18:36:51.522 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540719139924082687, 2024-09-12T18:36:51.522 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-09-12T18:36:51.522 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-09-12T18:35:10.239320+0000", 2024-09-12T18:36:51.522 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-09-12T18:36:51.522 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.522 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:51.522 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-09-12T18:36:51.522 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-09-12T18:36:51.522 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-09-12T18:36:51.523 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-09-12T18:36:51.523 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540719139924082687, 2024-09-12T18:36:51.523 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-09-12T18:36:51.523 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-09-12T18:35:10.861760+0000", 2024-09-12T18:36:51.523 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-09-12T18:36:51.523 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.523 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:51.523 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2024-09-12T18:36:51.523 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-09-12T18:36:51.523 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-09-12T18:36:51.523 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-09-12T18:36:51.523 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540719139924082687, 2024-09-12T18:36:51.523 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-09-12T18:36:51.524 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-09-12T18:35:10.355997+0000", 2024-09-12T18:36:51.524 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-09-12T18:36:51.524 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:51.524 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T18:36:51.524 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap": [], 2024-09-12T18:36:51.524 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap_items": [], 2024-09-12T18:36:51.524 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap_primaries": [], 2024-09-12T18:36:51.524 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_temp": [ 2024-09-12T18:36:51.524 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:51.524 INFO:teuthology.orchestra.run.smithi073.stdout: "pgid": "5.0", 2024-09-12T18:36:51.524 INFO:teuthology.orchestra.run.smithi073.stdout: "osds": [ 2024-09-12T18:36:51.524 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-12T18:36:51.525 INFO:teuthology.orchestra.run.smithi073.stdout: 0 2024-09-12T18:36:51.525 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:51.525 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.525 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:51.525 INFO:teuthology.orchestra.run.smithi073.stdout: "pgid": "5.1", 2024-09-12T18:36:51.525 INFO:teuthology.orchestra.run.smithi073.stdout: "osds": [ 2024-09-12T18:36:51.525 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-12T18:36:51.525 INFO:teuthology.orchestra.run.smithi073.stdout: 0 2024-09-12T18:36:51.525 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:51.525 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.525 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:36:51.525 INFO:teuthology.orchestra.run.smithi073.stdout: "pgid": "5.5", 2024-09-12T18:36:51.526 INFO:teuthology.orchestra.run.smithi073.stdout: "osds": [ 2024-09-12T18:36:51.526 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-12T18:36:51.526 INFO:teuthology.orchestra.run.smithi073.stdout: 0 2024-09-12T18:36:51.526 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:36:51.526 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:51.526 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T18:36:51.526 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_temp": [], 2024-09-12T18:36:51.526 INFO:teuthology.orchestra.run.smithi073.stdout: "blocklist": {}, 2024-09-12T18:36:51.526 INFO:teuthology.orchestra.run.smithi073.stdout: "range_blocklist": {}, 2024-09-12T18:36:51.526 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profiles": { 2024-09-12T18:36:51.526 INFO:teuthology.orchestra.run.smithi073.stdout: "default": { 2024-09-12T18:36:51.526 INFO:teuthology.orchestra.run.smithi073.stdout: "crush-failure-domain": "osd", 2024-09-12T18:36:51.527 INFO:teuthology.orchestra.run.smithi073.stdout: "k": "2", 2024-09-12T18:36:51.527 INFO:teuthology.orchestra.run.smithi073.stdout: "m": "1", 2024-09-12T18:36:51.527 INFO:teuthology.orchestra.run.smithi073.stdout: "plugin": "jerasure", 2024-09-12T18:36:51.527 INFO:teuthology.orchestra.run.smithi073.stdout: "technique": "reed_sol_van" 2024-09-12T18:36:51.527 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:51.527 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:36:51.527 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps_queue": [], 2024-09-12T18:36:51.527 INFO:teuthology.orchestra.run.smithi073.stdout: "new_removed_snaps": [], 2024-09-12T18:36:51.527 INFO:teuthology.orchestra.run.smithi073.stdout: "new_purged_snaps": [], 2024-09-12T18:36:51.527 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_node_flags": {}, 2024-09-12T18:36:51.528 INFO:teuthology.orchestra.run.smithi073.stdout: "device_class_flags": {}, 2024-09-12T18:36:51.528 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": { 2024-09-12T18:36:51.528 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode_enabled": false, 2024-09-12T18:36:51.528 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_bucket_count": 0, 2024-09-12T18:36:51.528 INFO:teuthology.orchestra.run.smithi073.stdout: "degraded_stretch_mode": 0, 2024-09-12T18:36:51.528 INFO:teuthology.orchestra.run.smithi073.stdout: "recovering_stretch_mode": 0, 2024-09-12T18:36:51.528 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode_bucket": 0 2024-09-12T18:36:51.528 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:36:51.528 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T18:36:51.529 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:51.487+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:51.530 INFO:tasks.thrashosds.thrasher:j is {'epoch': 55, 'fsid': 'c08d5a84-711b-44bf-bdf1-e06ecc2c7c00', 'created': '2024-09-12T18:35:02.695853+0000', 'modified': '2024-09-12T18:36:51.143872+0000', 'last_up_change': '2024-09-12T18:35:12.464628+0000', 'last_in_change': '2024-09-12T18:35:04.352525+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T18:35:12.418430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-12T18:35:18.665309+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 15, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T18:35:23.447845+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.409999966621399, 'score_stable': 1.409999966621399, 'optimal_score': 1, 'raw_score_acting': 1.409999966621399, 'raw_score_stable': 1.409999966621399, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T18:35:23.959973+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.409999966621399, 'score_stable': 1.409999966621399, 'optimal_score': 1, 'raw_score_acting': 1.409999966621399, 'raw_score_stable': 1.409999966621399, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2024-09-12T18:35:43.562347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'f1cf24e8-6179-4666-a444-fa81ef0d7482', 'up': 1, 'in': 1, 'weight': 0.6371612548828125, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6800', 'nonce': 2710632206}, {'type': 'v1', 'addr': '172.21.15.114:6801', 'nonce': 2710632206}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6802', 'nonce': 2710632206}, {'type': 'v1', 'addr': '172.21.15.114:6803', 'nonce': 2710632206}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6806', 'nonce': 2710632206}, {'type': 'v1', 'addr': '172.21.15.114:6807', 'nonce': 2710632206}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6804', 'nonce': 2710632206}, {'type': 'v1', 'addr': '172.21.15.114:6805', 'nonce': 2710632206}]}, 'public_addr': '172.21.15.114:6801/2710632206', 'cluster_addr': '172.21.15.114:6803/2710632206', 'heartbeat_back_addr': '172.21.15.114:6807/2710632206', 'heartbeat_front_addr': '172.21.15.114:6805/2710632206', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '3fdb0044-2820-4411-978b-4b6e94fbf0b1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 9, 'up_thru': 49, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6800', 'nonce': 862189968}, {'type': 'v1', 'addr': '172.21.15.143:6801', 'nonce': 862189968}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6802', 'nonce': 862189968}, {'type': 'v1', 'addr': '172.21.15.143:6803', 'nonce': 862189968}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6806', 'nonce': 862189968}, {'type': 'v1', 'addr': '172.21.15.143:6807', 'nonce': 862189968}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6804', 'nonce': 862189968}, {'type': 'v1', 'addr': '172.21.15.143:6805', 'nonce': 862189968}]}, 'public_addr': '172.21.15.143:6801/862189968', 'cluster_addr': '172.21.15.143:6803/862189968', 'heartbeat_back_addr': '172.21.15.143:6807/862189968', 'heartbeat_front_addr': '172.21.15.143:6805/862189968', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '6fb554da-561f-4aa2-b855-0e3adb98b057', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 49, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6800', 'nonce': 1397104153}, {'type': 'v1', 'addr': '172.21.15.162:6801', 'nonce': 1397104153}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6802', 'nonce': 1397104153}, {'type': 'v1', 'addr': '172.21.15.162:6803', 'nonce': 1397104153}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6806', 'nonce': 1397104153}, {'type': 'v1', 'addr': '172.21.15.162:6807', 'nonce': 1397104153}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6804', 'nonce': 1397104153}, {'type': 'v1', 'addr': '172.21.15.162:6805', 'nonce': 1397104153}]}, 'public_addr': '172.21.15.162:6801/1397104153', 'cluster_addr': '172.21.15.162:6803/1397104153', 'heartbeat_back_addr': '172.21.15.162:6807/1397104153', 'heartbeat_front_addr': '172.21.15.162:6805/1397104153', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:35:10.239320+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:35:10.861760+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:35:10.355997+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [{'pgid': '5.0', 'osds': [1, 0]}, {'pgid': '5.1', 'osds': [2, 0]}, {'pgid': '5.5', 'osds': [2, 0]}], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T18:36:51.530 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-12T18:36:51.552 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:51.547+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:51.599 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:51.599 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:51.621 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:36:51.653 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:51.647+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:51.754 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:51.750+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:51.820 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:51.820 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:51.840 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:36:51.854 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:51.850+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:51.956 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:51.950+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:51.996 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:51.996 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:52.014 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:36:52.057 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:52.051+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:52.158 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:52.151+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:52.167 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:52.167 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:52.181 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:36:52.185 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:36:52.258 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:52.254+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:52.337 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:36:52.337 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:36:52.355 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:36:52.355 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:36:52.359 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:52.355+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:52.372 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:36:52.372 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:36:52.374 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:52.374 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2024-09-12T18:36:52.374 INFO:teuthology.orchestra.run.smithi114.stdout: "complaint_time": 30, 2024-09-12T18:36:52.374 INFO:teuthology.orchestra.run.smithi114.stdout: "num_blocked_ops": 0 2024-09-12T18:36:52.374 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:52.392 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:36:52.460 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:52.454+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:52.547 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:52.547 INFO:teuthology.orchestra.run.smithi114.stdout: "size": 20, 2024-09-12T18:36:52.547 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 600, 2024-09-12T18:36:52.547 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:36:52.547 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.547 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:52.548 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:52.548 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 86.914690324000006, 2024-09-12T18:36:52.548 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.042475618999999999, 2024-09-12T18:36:52.548 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:52.548 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:52.548 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:52.548 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:52.548 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.548 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:52.548 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:52.548 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:52.548 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.548 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.549 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:52.549 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:52.549 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:52.549 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.549 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.549 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:52.549 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628450+0000", 2024-09-12T18:36:52.549 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4212999999999999e-05 2024-09-12T18:36:52.549 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.549 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.549 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:52.549 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628463+0000", 2024-09-12T18:36:52.549 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2497000000000001e-05 2024-09-12T18:36:52.550 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.550 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.550 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:52.550 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628480+0000", 2024-09-12T18:36:52.550 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7232999999999999e-05 2024-09-12T18:36:52.550 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.550 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.550 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:52.550 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628496+0000", 2024-09-12T18:36:52.550 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6217000000000001e-05 2024-09-12T18:36:52.550 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.550 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.551 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:52.551 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628641+0000", 2024-09-12T18:36:52.551 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000144709 2024-09-12T18:36:52.551 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.551 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.551 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:52.551 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628657+0000", 2024-09-12T18:36:52.551 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6266e-05 2024-09-12T18:36:52.551 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.551 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.551 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:52.551 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663103+0000", 2024-09-12T18:36:52.552 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.034445523999999998 2024-09-12T18:36:52.552 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.552 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.552 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:52.552 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663373+0000", 2024-09-12T18:36:52.552 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00027085500000000002 2024-09-12T18:36:52.552 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.552 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.552 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:52.552 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663634+0000", 2024-09-12T18:36:52.552 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000260855 2024-09-12T18:36:52.552 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.552 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.552 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:52.553 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670294+0000", 2024-09-12T18:36:52.553 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0066597599999999998 2024-09-12T18:36:52.553 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.553 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.553 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:52.553 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670705+0000", 2024-09-12T18:36:52.553 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00041057099999999998 2024-09-12T18:36:52.553 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.553 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.553 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:52.553 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670820+0000", 2024-09-12T18:36:52.553 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000115111 2024-09-12T18:36:52.553 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.554 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.554 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:52.554 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670912+0000", 2024-09-12T18:36:52.554 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1807999999999999e-05 2024-09-12T18:36:52.554 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:52.554 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:52.554 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:52.554 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.554 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.554 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:52.554 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:52.554 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 86.914599577999994, 2024-09-12T18:36:52.554 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.044599273000000002, 2024-09-12T18:36:52.554 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:52.555 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:52.555 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:52.555 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:52.555 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.555 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:52.555 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:52.555 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:52.555 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.555 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.555 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:52.555 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:52.555 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:52.555 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.556 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.556 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:52.556 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628528+0000", 2024-09-12T18:36:52.556 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:52.556 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.556 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.556 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:52.556 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628537+0000", 2024-09-12T18:36:52.556 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6969999999999999e-06 2024-09-12T18:36:52.556 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.556 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.556 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:52.556 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628560+0000", 2024-09-12T18:36:52.557 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2889000000000001e-05 2024-09-12T18:36:52.557 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.557 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.557 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:52.557 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628576+0000", 2024-09-12T18:36:52.557 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.649e-05 2024-09-12T18:36:52.557 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.557 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.557 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:52.557 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628846+0000", 2024-09-12T18:36:52.557 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00026952500000000001 2024-09-12T18:36:52.557 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.557 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.558 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:52.558 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628853+0000", 2024-09-12T18:36:52.558 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6559999999999992e-06 2024-09-12T18:36:52.558 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.558 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.558 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:52.558 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665284+0000", 2024-09-12T18:36:52.558 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.036431140000000001 2024-09-12T18:36:52.558 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.558 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.558 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:52.558 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665494+0000", 2024-09-12T18:36:52.558 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000209762 2024-09-12T18:36:52.558 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.559 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.559 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:52.559 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665816+0000", 2024-09-12T18:36:52.559 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00032162299999999999 2024-09-12T18:36:52.559 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.559 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.559 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:52.559 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670382+0000", 2024-09-12T18:36:52.559 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0045656739999999996 2024-09-12T18:36:52.559 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.559 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.559 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:52.559 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.672978+0000", 2024-09-12T18:36:52.560 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.002596068 2024-09-12T18:36:52.560 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.560 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.560 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:52.560 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673058+0000", 2024-09-12T18:36:52.560 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0198999999999996e-05 2024-09-12T18:36:52.560 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.560 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.560 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:52.560 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673126+0000", 2024-09-12T18:36:52.560 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8120000000000005e-05 2024-09-12T18:36:52.560 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:52.560 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:52.561 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:52.561 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.561 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.561 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:23 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:52.561 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:52.561 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 86.914501771999994, 2024-09-12T18:36:52.561 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045539784, 2024-09-12T18:36:52.561 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:52.561 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:52.561 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:52.561 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:52.561 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.561 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:52.561 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:52.562 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:52.562 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.562 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.562 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:52.562 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:52.562 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:52.562 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.562 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.562 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:52.562 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628626+0000", 2024-09-12T18:36:52.562 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.573e-06 2024-09-12T18:36:52.562 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.562 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.563 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:52.563 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628640+0000", 2024-09-12T18:36:52.563 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3817e-05 2024-09-12T18:36:52.563 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.563 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.563 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:52.563 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628659+0000", 2024-09-12T18:36:52.563 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9539999999999999e-05 2024-09-12T18:36:52.564 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.564 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.564 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:52.564 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628675+0000", 2024-09-12T18:36:52.564 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5739e-05 2024-09-12T18:36:52.564 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.564 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.564 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:52.564 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628815+0000", 2024-09-12T18:36:52.564 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014003299999999999 2024-09-12T18:36:52.564 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.564 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.564 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:52.565 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628828+0000", 2024-09-12T18:36:52.565 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2849e-05 2024-09-12T18:36:52.565 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.565 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.565 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:52.565 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651162+0000", 2024-09-12T18:36:52.565 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.022334228000000001 2024-09-12T18:36:52.565 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.565 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.565 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:52.565 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651446+0000", 2024-09-12T18:36:52.565 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00028392800000000002 2024-09-12T18:36:52.565 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.566 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.566 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:52.566 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651746+0000", 2024-09-12T18:36:52.566 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000300091 2024-09-12T18:36:52.566 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.566 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.566 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:52.566 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665113+0000", 2024-09-12T18:36:52.566 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013366678 2024-09-12T18:36:52.566 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.566 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.566 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:52.567 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674010+0000", 2024-09-12T18:36:52.567 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0088970520000000008 2024-09-12T18:36:52.567 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.567 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.567 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:52.567 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674104+0000", 2024-09-12T18:36:52.567 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4124999999999998e-05 2024-09-12T18:36:52.567 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.567 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.567 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:52.567 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674164+0000", 2024-09-12T18:36:52.567 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.0130999999999997e-05 2024-09-12T18:36:52.567 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:52.568 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:52.568 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:52.568 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.568 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.568 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:26 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:52.568 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:52.568 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 86.914428565999998, 2024-09-12T18:36:52.568 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045702136999999997, 2024-09-12T18:36:52.568 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:52.568 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:52.568 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:52.568 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:52.569 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.569 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:52.569 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:52.569 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:52.569 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.569 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.569 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:52.569 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:52.569 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:52.569 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.569 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.569 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:52.569 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628699+0000", 2024-09-12T18:36:52.569 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3859999999999999e-06 2024-09-12T18:36:52.570 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.570 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.570 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:52.570 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628706+0000", 2024-09-12T18:36:52.570 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0169999999999999e-06 2024-09-12T18:36:52.570 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.570 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.570 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:52.570 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628725+0000", 2024-09-12T18:36:52.570 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8683000000000001e-05 2024-09-12T18:36:52.570 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.570 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.570 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:52.571 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628740+0000", 2024-09-12T18:36:52.571 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5413999999999998e-05 2024-09-12T18:36:52.571 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.571 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.571 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:52.571 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628907+0000", 2024-09-12T18:36:52.571 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00016670199999999999 2024-09-12T18:36:52.571 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.571 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.571 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:52.571 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628917+0000", 2024-09-12T18:36:52.571 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.046e-05 2024-09-12T18:36:52.571 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.572 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.572 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:52.572 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.660390+0000", 2024-09-12T18:36:52.572 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.031472364000000003 2024-09-12T18:36:52.572 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.572 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.572 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:52.572 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.661767+0000", 2024-09-12T18:36:52.572 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0013769190000000001 2024-09-12T18:36:52.572 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.572 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.572 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:52.572 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.662408+0000", 2024-09-12T18:36:52.573 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00064091099999999998 2024-09-12T18:36:52.573 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.573 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.573 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:52.573 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669577+0000", 2024-09-12T18:36:52.573 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.007169412 2024-09-12T18:36:52.573 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.573 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.573 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:52.573 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674244+0000", 2024-09-12T18:36:52.573 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0046671839999999996 2024-09-12T18:36:52.573 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.573 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.573 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:52.574 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674329+0000", 2024-09-12T18:36:52.574 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5276000000000001e-05 2024-09-12T18:36:52.574 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.574 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.574 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:52.574 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674400+0000", 2024-09-12T18:36:52.574 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0408999999999996e-05 2024-09-12T18:36:52.574 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:52.574 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:52.574 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:52.574 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.574 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.574 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:52.574 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:52.575 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 86.914320896999996, 2024-09-12T18:36:52.575 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.044572443000000003, 2024-09-12T18:36:52.575 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:52.575 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:52.575 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:52.575 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:52.575 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.575 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:52.575 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:52.575 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:52.575 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.575 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.575 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:52.576 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:52.576 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:52.576 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.576 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.576 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:52.576 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628807+0000", 2024-09-12T18:36:52.576 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3629999999999999e-06 2024-09-12T18:36:52.576 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.576 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.576 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:52.576 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628814+0000", 2024-09-12T18:36:52.576 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.2099999999999996e-06 2024-09-12T18:36:52.576 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.577 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.577 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:52.577 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628832+0000", 2024-09-12T18:36:52.577 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7972999999999999e-05 2024-09-12T18:36:52.577 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.577 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.577 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:52.577 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628854+0000", 2024-09-12T18:36:52.577 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1857000000000001e-05 2024-09-12T18:36:52.577 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.577 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.577 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:52.577 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628984+0000", 2024-09-12T18:36:52.578 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013013599999999999 2024-09-12T18:36:52.578 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.578 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.578 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:52.578 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628993+0000", 2024-09-12T18:36:52.578 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:36:52.578 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.578 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.578 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:52.578 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668176+0000", 2024-09-12T18:36:52.578 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.039182211000000002 2024-09-12T18:36:52.578 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.578 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.579 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:52.579 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668481+0000", 2024-09-12T18:36:52.579 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00030499200000000002 2024-09-12T18:36:52.579 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.579 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.579 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:52.579 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668771+0000", 2024-09-12T18:36:52.579 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00029018700000000002 2024-09-12T18:36:52.579 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.579 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.579 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:52.579 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.672674+0000", 2024-09-12T18:36:52.579 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0039031890000000001 2024-09-12T18:36:52.579 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.580 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.580 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:52.580 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673214+0000", 2024-09-12T18:36:52.580 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00053981600000000004 2024-09-12T18:36:52.580 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.580 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.580 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:52.580 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673310+0000", 2024-09-12T18:36:52.580 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.6682999999999996e-05 2024-09-12T18:36:52.580 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.580 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.580 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:52.580 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673378+0000", 2024-09-12T18:36:52.581 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7385999999999995e-05 2024-09-12T18:36:52.581 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:52.581 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:52.581 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:52.581 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.581 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.581 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:52.581 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:52.581 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 86.914184871000003, 2024-09-12T18:36:52.581 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.041480853999999998, 2024-09-12T18:36:52.581 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:52.581 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:52.581 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:52.581 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:52.582 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.582 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:52.582 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:52.582 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:52.582 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.582 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.582 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:52.582 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:52.582 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:52.582 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.582 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.582 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:52.582 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628943+0000", 2024-09-12T18:36:52.582 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.403e-06 2024-09-12T18:36:52.583 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.583 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.583 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:52.583 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628953+0000", 2024-09-12T18:36:52.583 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0273e-05 2024-09-12T18:36:52.583 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.583 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.583 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:52.583 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628973+0000", 2024-09-12T18:36:52.583 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9959999999999999e-05 2024-09-12T18:36:52.583 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.583 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.583 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:52.584 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628989+0000", 2024-09-12T18:36:52.584 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6447e-05 2024-09-12T18:36:52.584 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.584 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.584 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:52.584 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629144+0000", 2024-09-12T18:36:52.584 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015468900000000001 2024-09-12T18:36:52.584 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.584 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.584 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:52.584 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629162+0000", 2024-09-12T18:36:52.584 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7603000000000001e-05 2024-09-12T18:36:52.584 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.584 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.585 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:52.585 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.646927+0000", 2024-09-12T18:36:52.585 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.017765626 2024-09-12T18:36:52.585 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.585 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.585 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:52.585 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.647245+0000", 2024-09-12T18:36:52.585 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00031797699999999999 2024-09-12T18:36:52.585 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.585 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.585 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:52.585 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.647551+0000", 2024-09-12T18:36:52.585 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00030583500000000002 2024-09-12T18:36:52.586 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.586 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.586 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:52.586 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651738+0000", 2024-09-12T18:36:52.586 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0041864980000000003 2024-09-12T18:36:52.586 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.586 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.586 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:52.586 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670207+0000", 2024-09-12T18:36:52.586 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018469299000000002 2024-09-12T18:36:52.586 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.586 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.586 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:52.586 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670330+0000", 2024-09-12T18:36:52.587 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012284500000000001 2024-09-12T18:36:52.587 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.587 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.587 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:52.587 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670422+0000", 2024-09-12T18:36:52.587 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2398999999999994e-05 2024-09-12T18:36:52.587 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:52.587 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:52.587 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:52.587 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.587 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.587 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:52.587 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:52.587 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 86.914107618000003, 2024-09-12T18:36:52.588 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.041623741999999998, 2024-09-12T18:36:52.588 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:52.588 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:52.588 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:52.588 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:52.588 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.588 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:52.588 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:52.588 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:52.588 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.588 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.588 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:52.588 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:52.589 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:52.589 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.589 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.589 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:52.589 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629020+0000", 2024-09-12T18:36:52.589 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.15e-06 2024-09-12T18:36:52.589 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.589 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.589 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:52.589 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629023+0000", 2024-09-12T18:36:52.589 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4659999999999999e-06 2024-09-12T18:36:52.589 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.589 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.590 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:52.590 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629037+0000", 2024-09-12T18:36:52.590 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3857e-05 2024-09-12T18:36:52.590 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.590 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.590 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:52.590 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629062+0000", 2024-09-12T18:36:52.590 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4519999999999999e-05 2024-09-12T18:36:52.590 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.590 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.590 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:52.590 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629253+0000", 2024-09-12T18:36:52.591 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000191335 2024-09-12T18:36:52.591 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.591 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.591 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:52.591 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629266+0000", 2024-09-12T18:36:52.591 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3322999999999999e-05 2024-09-12T18:36:52.591 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.591 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.591 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:52.591 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648331+0000", 2024-09-12T18:36:52.591 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.019065060000000002 2024-09-12T18:36:52.591 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.592 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.592 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:52.592 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.650044+0000", 2024-09-12T18:36:52.592 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017123959999999999 2024-09-12T18:36:52.592 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.592 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.592 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:52.592 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670642+0000", 2024-09-12T18:36:52.592 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.020598635000000001 2024-09-12T18:36:52.592 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:52.592 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:52.592 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:52.592 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.593 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.593 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:52.593 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:52.593 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 86.914004285999994, 2024-09-12T18:36:52.593 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.046431252999999999, 2024-09-12T18:36:52.593 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:52.593 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:52.593 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:52.593 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:52.593 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.593 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:52.593 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:52.593 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:52.594 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.594 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.594 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:52.594 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:52.594 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:52.594 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.594 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.594 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:52.594 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629123+0000", 2024-09-12T18:36:52.594 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0899999999999999e-06 2024-09-12T18:36:52.594 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.594 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.594 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:52.595 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629138+0000", 2024-09-12T18:36:52.595 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4977000000000001e-05 2024-09-12T18:36:52.595 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.595 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.595 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:52.595 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629149+0000", 2024-09-12T18:36:52.595 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1182999999999999e-05 2024-09-12T18:36:52.595 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.595 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.595 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:52.595 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629157+0000", 2024-09-12T18:36:52.595 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8129999999999996e-06 2024-09-12T18:36:52.595 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.596 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.596 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:52.596 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629223+0000", 2024-09-12T18:36:52.596 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6463000000000004e-05 2024-09-12T18:36:52.596 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.596 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.596 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:52.596 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629230+0000", 2024-09-12T18:36:52.596 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1360000000000002e-06 2024-09-12T18:36:52.596 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.596 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.596 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:52.596 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669605+0000", 2024-09-12T18:36:52.596 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.040375518999999999 2024-09-12T18:36:52.597 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.597 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.597 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:52.597 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669840+0000", 2024-09-12T18:36:52.597 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00023520099999999999 2024-09-12T18:36:52.597 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.597 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.597 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:52.597 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.675553+0000", 2024-09-12T18:36:52.597 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0057128709999999996 2024-09-12T18:36:52.597 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:52.597 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:52.597 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:52.598 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.598 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.598 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:52.598 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:52.598 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 86.913949618999993, 2024-09-12T18:36:52.598 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.037357044999999998, 2024-09-12T18:36:52.598 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:52.598 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:52.598 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:52.598 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:52.598 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.598 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:52.598 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:52.599 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:52.599 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.599 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.599 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:52.599 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:52.599 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:52.599 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.599 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.599 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:52.599 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629178+0000", 2024-09-12T18:36:52.599 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.08e-06 2024-09-12T18:36:52.599 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.599 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.600 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:52.600 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629194+0000", 2024-09-12T18:36:52.600 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5899000000000001e-05 2024-09-12T18:36:52.600 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.600 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.600 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:52.600 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629211+0000", 2024-09-12T18:36:52.600 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7363e-05 2024-09-12T18:36:52.600 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.600 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.600 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:52.600 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629226+0000", 2024-09-12T18:36:52.600 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4567e-05 2024-09-12T18:36:52.601 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.601 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.601 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:52.601 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629299+0000", 2024-09-12T18:36:52.601 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3910000000000002e-05 2024-09-12T18:36:52.601 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.601 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.601 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:52.601 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629307+0000", 2024-09-12T18:36:52.601 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5299999999999999e-06 2024-09-12T18:36:52.601 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.601 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.601 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:52.602 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648185+0000", 2024-09-12T18:36:52.602 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018878533999999999 2024-09-12T18:36:52.602 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.602 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.602 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:52.602 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.649724+0000", 2024-09-12T18:36:52.602 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001538841 2024-09-12T18:36:52.602 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.602 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.602 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:52.602 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.666534+0000", 2024-09-12T18:36:52.602 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.016809320999999999 2024-09-12T18:36:52.602 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:52.603 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:52.603 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:52.603 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.603 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.603 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:80967 5.a 5:5f4000f6:::benchmark_data_smithi073_23739_object80966:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T18:36:52.603 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:18.561016+0000", 2024-09-12T18:36:52.603 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 33.982110024000001, 2024-09-12T18:36:52.603 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021780831, 2024-09-12T18:36:52.603 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:52.603 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:52.603 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:52.604 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:52.604 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:52.604 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:52.604 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 80967 2024-09-12T18:36:52.604 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.604 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:52.604 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.604 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:52.604 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561016+0000", 2024-09-12T18:36:52.604 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:52.604 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.604 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.605 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:52.605 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561016+0000", 2024-09-12T18:36:52.605 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:52.605 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.605 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.605 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:52.605 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561017+0000", 2024-09-12T18:36:52.605 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7599999999999997e-07 2024-09-12T18:36:52.605 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.605 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.605 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:52.605 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561050+0000", 2024-09-12T18:36:52.606 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3524e-05 2024-09-12T18:36:52.606 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.606 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.606 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:52.606 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561058+0000", 2024-09-12T18:36:52.606 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0679999999999997e-06 2024-09-12T18:36:52.606 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.606 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.606 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:52.606 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561065+0000", 2024-09-12T18:36:52.606 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1990000000000003e-06 2024-09-12T18:36:52.606 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.606 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.607 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:52.607 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564735+0000", 2024-09-12T18:36:52.607 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0036706740000000001 2024-09-12T18:36:52.607 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.607 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.607 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:52.607 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564868+0000", 2024-09-12T18:36:52.607 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000133003 2024-09-12T18:36:52.607 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.607 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.607 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:52.607 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.565010+0000", 2024-09-12T18:36:52.607 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014224300000000001 2024-09-12T18:36:52.608 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.608 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.608 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:52.608 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.569871+0000", 2024-09-12T18:36:52.608 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0048600759999999996 2024-09-12T18:36:52.608 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.608 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.608 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:52.608 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.582729+0000", 2024-09-12T18:36:52.608 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012858090000000001 2024-09-12T18:36:52.608 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.608 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.608 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:52.609 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.582758+0000", 2024-09-12T18:36:52.609 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.9762999999999999e-05 2024-09-12T18:36:52.609 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.609 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.609 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:52.609 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.582797+0000", 2024-09-12T18:36:52.609 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8615000000000002e-05 2024-09-12T18:36:52.609 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:52.609 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:52.609 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:52.609 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.609 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.609 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:108511 5.6 5:608a30a3:::benchmark_data_smithi073_23739_object108510:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:36:52.609 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:31.986730+0000", 2024-09-12T18:36:52.610 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 20.556396150000001, 2024-09-12T18:36:52.610 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021507117999999999, 2024-09-12T18:36:52.610 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:52.610 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:52.610 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:52.610 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:52.610 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:52.610 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:52.610 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 108511 2024-09-12T18:36:52.610 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.610 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:52.610 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.610 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:52.610 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986730+0000", 2024-09-12T18:36:52.611 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:52.611 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.611 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.611 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:52.611 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986730+0000", 2024-09-12T18:36:52.611 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:52.611 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.611 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.611 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:52.611 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986731+0000", 2024-09-12T18:36:52.612 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.9100000000000003e-07 2024-09-12T18:36:52.612 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.612 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.612 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:52.612 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986804+0000", 2024-09-12T18:36:52.612 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3647999999999997e-05 2024-09-12T18:36:52.612 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.612 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.612 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:52.612 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986812+0000", 2024-09-12T18:36:52.612 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.34e-06 2024-09-12T18:36:52.612 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.612 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.613 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:52.613 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986836+0000", 2024-09-12T18:36:52.613 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4213e-05 2024-09-12T18:36:52.613 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.613 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.613 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:52.613 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.997047+0000", 2024-09-12T18:36:52.613 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.010210649 2024-09-12T18:36:52.613 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.613 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.613 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:52.613 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.997169+0000", 2024-09-12T18:36:52.613 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012269700000000001 2024-09-12T18:36:52.614 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.614 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.614 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:52.614 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.997300+0000", 2024-09-12T18:36:52.614 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000130858 2024-09-12T18:36:52.614 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.614 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.614 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:52.614 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.002398+0000", 2024-09-12T18:36:52.614 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0050981580000000002 2024-09-12T18:36:52.614 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.614 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.614 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:52.614 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.008093+0000", 2024-09-12T18:36:52.615 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0056941930000000002 2024-09-12T18:36:52.615 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.615 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.615 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:52.615 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.008151+0000", 2024-09-12T18:36:52.615 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8328999999999997e-05 2024-09-12T18:36:52.615 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.615 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.615 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:52.615 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.008237+0000", 2024-09-12T18:36:52.615 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6341999999999994e-05 2024-09-12T18:36:52.615 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:52.615 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:52.616 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:52.616 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.616 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.616 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:108623 5.c 5:33792cd3:::benchmark_data_smithi073_23739_object108622:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:36:52.616 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:32.046609+0000", 2024-09-12T18:36:52.616 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 20.496517374, 2024-09-12T18:36:52.616 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021062860999999999, 2024-09-12T18:36:52.616 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:52.616 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:52.616 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:52.616 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:52.616 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:52.616 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:52.617 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 108623 2024-09-12T18:36:52.617 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.617 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:52.617 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.617 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:52.617 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.046609+0000", 2024-09-12T18:36:52.617 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:52.617 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.617 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.617 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:52.617 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.046609+0000", 2024-09-12T18:36:52.617 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:52.617 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.617 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.618 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:52.618 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.046609+0000", 2024-09-12T18:36:52.618 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.37e-07 2024-09-12T18:36:52.618 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.618 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.618 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:52.618 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.046690+0000", 2024-09-12T18:36:52.618 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0212999999999999e-05 2024-09-12T18:36:52.618 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.618 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.618 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:52.618 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.046698+0000", 2024-09-12T18:36:52.618 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6430000000000001e-06 2024-09-12T18:36:52.619 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.619 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.619 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:52.619 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.046704+0000", 2024-09-12T18:36:52.619 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7699999999999998e-06 2024-09-12T18:36:52.619 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.619 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.619 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:52.619 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.056808+0000", 2024-09-12T18:36:52.619 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.010103562999999999 2024-09-12T18:36:52.619 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.619 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.619 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:52.619 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.056989+0000", 2024-09-12T18:36:52.620 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000181196 2024-09-12T18:36:52.620 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.620 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.620 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:52.620 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.057162+0000", 2024-09-12T18:36:52.620 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000173396 2024-09-12T18:36:52.620 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.620 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.620 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:52.620 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.063269+0000", 2024-09-12T18:36:52.620 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0061066100000000002 2024-09-12T18:36:52.620 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.620 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.621 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:52.621 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.067578+0000", 2024-09-12T18:36:52.621 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0043092570000000004 2024-09-12T18:36:52.621 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.621 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.621 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:52.621 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.067628+0000", 2024-09-12T18:36:52.621 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0136999999999998e-05 2024-09-12T18:36:52.621 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.621 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.621 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:52.621 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.067672+0000", 2024-09-12T18:36:52.621 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3439000000000002e-05 2024-09-12T18:36:52.621 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:52.622 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:52.622 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:52.622 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.622 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.622 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:121033 5.0 e50/49 5:0b3817c1:::benchmark_data_smithi073_23739_object121032:head v 50'7620, mlcod=0'0)", 2024-09-12T18:36:52.622 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:40.165057+0000", 2024-09-12T18:36:52.622 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 12.378069652000001, 2024-09-12T18:36:52.622 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.030641286, 2024-09-12T18:36:52.622 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:52.622 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:52.622 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:52.622 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:52.622 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.623 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:52.623 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.165057+0000", 2024-09-12T18:36:52.623 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:52.623 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.623 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.623 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:52.623 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.165057+0000", 2024-09-12T18:36:52.623 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:52.623 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.623 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.623 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:52.623 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.165057+0000", 2024-09-12T18:36:52.623 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8599999999999998e-07 2024-09-12T18:36:52.623 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.624 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.624 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:52.624 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.165109+0000", 2024-09-12T18:36:52.624 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2086000000000002e-05 2024-09-12T18:36:52.624 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.624 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.624 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:52.624 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.165161+0000", 2024-09-12T18:36:52.624 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1415000000000002e-05 2024-09-12T18:36:52.624 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.624 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.624 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:52.624 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.165178+0000", 2024-09-12T18:36:52.624 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7790000000000001e-05 2024-09-12T18:36:52.625 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.625 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.625 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:52.625 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.168784+0000", 2024-09-12T18:36:52.625 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0036052050000000002 2024-09-12T18:36:52.625 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.625 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.625 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:52.625 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.168854+0000", 2024-09-12T18:36:52.625 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0814000000000003e-05 2024-09-12T18:36:52.625 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.625 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.625 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:52.626 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.195600+0000", 2024-09-12T18:36:52.626 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.026745173000000001 2024-09-12T18:36:52.626 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.626 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.626 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:52.626 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.195698+0000", 2024-09-12T18:36:52.626 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.8317000000000001e-05 2024-09-12T18:36:52.626 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:52.626 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:52.626 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:52.626 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.626 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.626 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:121044 5.1 e50/49 5:83bf711a:::benchmark_data_smithi073_23739_object121043:head v 50'7532, mlcod=0'0)", 2024-09-12T18:36:52.627 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:40.200337+0000", 2024-09-12T18:36:52.627 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 12.342789651, 2024-09-12T18:36:52.627 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.023483312999999999, 2024-09-12T18:36:52.627 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:52.627 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:52.627 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:52.627 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:52.627 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.627 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:52.627 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200337+0000", 2024-09-12T18:36:52.627 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:52.627 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.627 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.628 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:52.628 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200337+0000", 2024-09-12T18:36:52.628 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:52.628 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.628 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.628 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:52.628 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200338+0000", 2024-09-12T18:36:52.628 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.877e-06 2024-09-12T18:36:52.628 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.628 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.628 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:52.628 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200558+0000", 2024-09-12T18:36:52.628 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00021912799999999999 2024-09-12T18:36:52.629 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.629 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.629 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:52.629 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200584+0000", 2024-09-12T18:36:52.629 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.6333e-05 2024-09-12T18:36:52.629 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.629 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.629 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:52.629 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200602+0000", 2024-09-12T18:36:52.629 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.853e-05 2024-09-12T18:36:52.629 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.629 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.629 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:52.630 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200753+0000", 2024-09-12T18:36:52.630 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015061299999999999 2024-09-12T18:36:52.630 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.630 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.630 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:52.630 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200790+0000", 2024-09-12T18:36:52.630 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.7398999999999999e-05 2024-09-12T18:36:52.630 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.630 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.630 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:52.630 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.223743+0000", 2024-09-12T18:36:52.630 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.022952455 2024-09-12T18:36:52.630 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.631 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.631 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:52.631 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.223820+0000", 2024-09-12T18:36:52.631 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6977999999999994e-05 2024-09-12T18:36:52.631 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:52.631 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:52.631 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:52.631 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.631 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.631 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:121110 5.2 e50/21 5:4dc37b93:::benchmark_data_smithi073_23739_object121109:head v 50'7513, mlcod=48'7511)", 2024-09-12T18:36:52.631 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:40.241103+0000", 2024-09-12T18:36:52.631 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 12.302023609999999, 2024-09-12T18:36:52.631 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021833894, 2024-09-12T18:36:52.631 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:52.632 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:52.632 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:52.632 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:52.632 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.632 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:52.632 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241103+0000", 2024-09-12T18:36:52.632 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:52.632 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.632 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.632 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:52.632 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241103+0000", 2024-09-12T18:36:52.632 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:52.632 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.633 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.633 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:52.633 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241104+0000", 2024-09-12T18:36:52.633 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.7999999999999993e-07 2024-09-12T18:36:52.633 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.633 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.633 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:52.633 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241162+0000", 2024-09-12T18:36:52.633 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8319000000000002e-05 2024-09-12T18:36:52.633 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.634 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.634 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:52.634 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241181+0000", 2024-09-12T18:36:52.634 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9055999999999998e-05 2024-09-12T18:36:52.634 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.634 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.634 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:52.634 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241191+0000", 2024-09-12T18:36:52.634 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.9359999999999994e-06 2024-09-12T18:36:52.634 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.634 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.634 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:52.634 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241305+0000", 2024-09-12T18:36:52.634 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000114134 2024-09-12T18:36:52.635 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.635 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.635 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:52.635 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241372+0000", 2024-09-12T18:36:52.635 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6521999999999998e-05 2024-09-12T18:36:52.635 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.635 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.635 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:52.635 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.262837+0000", 2024-09-12T18:36:52.635 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021465766000000001 2024-09-12T18:36:52.635 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.635 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.635 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:52.636 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.262937+0000", 2024-09-12T18:36:52.636 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.9180999999999998e-05 2024-09-12T18:36:52.636 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:52.636 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:52.636 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:52.636 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.636 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.636 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:121160 5.b e50/21 5:d4730c8e:::benchmark_data_smithi073_23739_object121159:head v 50'7640, mlcod=47'7638)", 2024-09-12T18:36:52.636 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:40.289729+0000", 2024-09-12T18:36:52.636 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 12.253397064, 2024-09-12T18:36:52.636 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021365733000000001, 2024-09-12T18:36:52.636 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:52.637 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:52.637 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:52.637 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:52.637 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.637 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:52.637 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.289729+0000", 2024-09-12T18:36:52.637 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:52.637 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.637 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.637 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:52.637 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.289729+0000", 2024-09-12T18:36:52.637 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:52.637 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.637 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.638 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:52.638 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.289730+0000", 2024-09-12T18:36:52.638 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1799999999999995e-07 2024-09-12T18:36:52.638 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.638 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.638 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:52.638 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.289831+0000", 2024-09-12T18:36:52.638 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000101122 2024-09-12T18:36:52.638 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.638 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.638 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:52.638 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.289847+0000", 2024-09-12T18:36:52.638 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5787999999999999e-05 2024-09-12T18:36:52.638 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.639 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.639 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:52.639 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.289859+0000", 2024-09-12T18:36:52.639 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2439000000000001e-05 2024-09-12T18:36:52.639 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.639 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.639 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:52.639 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.289998+0000", 2024-09-12T18:36:52.639 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000138725 2024-09-12T18:36:52.639 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.639 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.639 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:52.639 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.290055+0000", 2024-09-12T18:36:52.640 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7166000000000001e-05 2024-09-12T18:36:52.640 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.640 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.640 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:52.640 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.311028+0000", 2024-09-12T18:36:52.640 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.020972602 2024-09-12T18:36:52.640 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.640 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.640 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:52.640 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.311095+0000", 2024-09-12T18:36:52.640 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7273000000000005e-05 2024-09-12T18:36:52.640 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:52.640 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:52.641 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:52.641 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.641 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.641 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:131544 5.6 5:6ce76cfc:::benchmark_data_smithi073_23739_object131543:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:36:52.641 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:45.497129+0000", 2024-09-12T18:36:52.641 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 7.045997099, 2024-09-12T18:36:52.641 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.02367524, 2024-09-12T18:36:52.641 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:52.641 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:52.641 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:52.641 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:52.641 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:52.641 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:52.642 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 131544 2024-09-12T18:36:52.642 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.642 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:52.642 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.642 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:52.642 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497129+0000", 2024-09-12T18:36:52.642 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:52.642 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.642 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.642 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:52.642 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497129+0000", 2024-09-12T18:36:52.642 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:52.642 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.642 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.643 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:52.643 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497130+0000", 2024-09-12T18:36:52.643 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1620000000000001e-06 2024-09-12T18:36:52.643 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.643 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.643 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:52.643 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497205+0000", 2024-09-12T18:36:52.643 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4707000000000001e-05 2024-09-12T18:36:52.643 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.643 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.643 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:52.643 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497216+0000", 2024-09-12T18:36:52.643 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1362999999999999e-05 2024-09-12T18:36:52.644 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.644 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.644 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:52.644 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497225+0000", 2024-09-12T18:36:52.644 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7050000000000005e-06 2024-09-12T18:36:52.644 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.644 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.644 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:52.644 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.498575+0000", 2024-09-12T18:36:52.644 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0013500319999999999 2024-09-12T18:36:52.644 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.644 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.644 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:52.645 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.498712+0000", 2024-09-12T18:36:52.645 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013682200000000001 2024-09-12T18:36:52.645 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.645 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.645 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:52.645 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.498954+0000", 2024-09-12T18:36:52.645 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00024196499999999999 2024-09-12T18:36:52.645 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.645 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.645 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:52.645 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.503854+0000", 2024-09-12T18:36:52.645 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0049002020000000002 2024-09-12T18:36:52.645 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.646 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.646 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:52.646 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.520739+0000", 2024-09-12T18:36:52.646 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.016884698 2024-09-12T18:36:52.646 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.646 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.646 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:52.646 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.520775+0000", 2024-09-12T18:36:52.646 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.5941e-05 2024-09-12T18:36:52.646 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.646 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.646 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:52.646 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.520804+0000", 2024-09-12T18:36:52.647 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.9643000000000001e-05 2024-09-12T18:36:52.647 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:52.647 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:52.647 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:52.647 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.647 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.647 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:131545 5.6 5:6da49e54:::benchmark_data_smithi073_23739_object131544:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:36:52.647 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:45.497399+0000", 2024-09-12T18:36:52.647 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 7.04572748, 2024-09-12T18:36:52.647 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.032319729999999998, 2024-09-12T18:36:52.647 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:52.647 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:52.647 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:52.648 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:52.648 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:52.648 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:52.648 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 131545 2024-09-12T18:36:52.648 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.648 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:52.648 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.648 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:52.648 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497399+0000", 2024-09-12T18:36:52.648 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:52.648 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.648 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.648 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:52.649 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497399+0000", 2024-09-12T18:36:52.649 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:52.649 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.649 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.649 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:52.649 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497400+0000", 2024-09-12T18:36:52.649 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.7900000000000007e-07 2024-09-12T18:36:52.649 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.649 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.649 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:52.649 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497500+0000", 2024-09-12T18:36:52.649 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00010021799999999999 2024-09-12T18:36:52.649 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.650 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.650 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:52.650 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497509+0000", 2024-09-12T18:36:52.650 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.9299999999999992e-06 2024-09-12T18:36:52.650 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.650 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.650 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:52.650 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497513+0000", 2024-09-12T18:36:52.650 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4129999999999999e-06 2024-09-12T18:36:52.650 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.650 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.650 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:52.650 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.501900+0000", 2024-09-12T18:36:52.651 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0043864730000000001 2024-09-12T18:36:52.651 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.651 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.651 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:52.651 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.502054+0000", 2024-09-12T18:36:52.651 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015438299999999999 2024-09-12T18:36:52.651 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.651 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.651 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:52.651 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.502147+0000", 2024-09-12T18:36:52.651 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.3187000000000001e-05 2024-09-12T18:36:52.651 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.651 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.652 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:52.652 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.504510+0000", 2024-09-12T18:36:52.652 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0023626509999999999 2024-09-12T18:36:52.652 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.652 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.652 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:52.652 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.529615+0000", 2024-09-12T18:36:52.652 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.025104688999999999 2024-09-12T18:36:52.652 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.652 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.652 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:52.652 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.529673+0000", 2024-09-12T18:36:52.652 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8451e-05 2024-09-12T18:36:52.653 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.653 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.653 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:52.653 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.529718+0000", 2024-09-12T18:36:52.653 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5355999999999997e-05 2024-09-12T18:36:52.653 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:52.653 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:52.653 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:52.653 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.653 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.653 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:131550 5.3 5:c5ee897a:::benchmark_data_smithi073_23739_object131549:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:36:52.653 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:45.499088+0000", 2024-09-12T18:36:52.653 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 7.044038069, 2024-09-12T18:36:52.654 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021584709000000001, 2024-09-12T18:36:52.654 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:52.654 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:52.654 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:52.654 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:52.654 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:52.654 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:52.654 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 131550 2024-09-12T18:36:52.654 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.654 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:52.654 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.654 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:52.654 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499088+0000", 2024-09-12T18:36:52.655 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:52.655 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.655 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.655 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:52.655 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499088+0000", 2024-09-12T18:36:52.655 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:52.655 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.655 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.655 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:52.655 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499089+0000", 2024-09-12T18:36:52.655 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.0299999999999997e-07 2024-09-12T18:36:52.655 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.655 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.655 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:52.655 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499166+0000", 2024-09-12T18:36:52.656 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.7257999999999998e-05 2024-09-12T18:36:52.656 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.656 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.656 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:52.656 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499173+0000", 2024-09-12T18:36:52.656 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1509999999999998e-06 2024-09-12T18:36:52.656 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.656 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.656 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:52.656 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499178+0000", 2024-09-12T18:36:52.656 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.78e-06 2024-09-12T18:36:52.656 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.656 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.657 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:52.657 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499231+0000", 2024-09-12T18:36:52.657 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2621999999999999e-05 2024-09-12T18:36:52.657 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.657 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.657 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:52.657 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499326+0000", 2024-09-12T18:36:52.657 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.5567000000000002e-05 2024-09-12T18:36:52.657 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.657 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.657 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:52.657 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499419+0000", 2024-09-12T18:36:52.657 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2417000000000006e-05 2024-09-12T18:36:52.658 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.658 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.658 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:52.658 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.503781+0000", 2024-09-12T18:36:52.658 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.004362192 2024-09-12T18:36:52.658 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.658 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.658 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:52.658 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.520606+0000", 2024-09-12T18:36:52.658 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.016824784999999998 2024-09-12T18:36:52.658 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.658 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.658 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:52.659 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.520642+0000", 2024-09-12T18:36:52.659 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.6313000000000003e-05 2024-09-12T18:36:52.659 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.659 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.659 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:52.659 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.520673+0000", 2024-09-12T18:36:52.659 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.0720999999999999e-05 2024-09-12T18:36:52.659 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:52.659 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:52.659 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:52.659 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.659 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.659 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:131552 5.3 5:cb8dda54:::benchmark_data_smithi073_23739_object131551:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:36:52.659 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:45.499423+0000", 2024-09-12T18:36:52.660 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 7.0437032139999998, 2024-09-12T18:36:52.660 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.024733523, 2024-09-12T18:36:52.660 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:52.660 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:52.660 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:52.660 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:52.660 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:52.660 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:52.660 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 131552 2024-09-12T18:36:52.660 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.660 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:52.660 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.661 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:52.661 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499423+0000", 2024-09-12T18:36:52.661 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:52.661 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.661 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.661 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:52.661 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499423+0000", 2024-09-12T18:36:52.661 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:52.661 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.661 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.661 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:52.661 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499424+0000", 2024-09-12T18:36:52.661 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.95e-07 2024-09-12T18:36:52.661 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.662 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.662 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:52.662 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499507+0000", 2024-09-12T18:36:52.662 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.3258999999999997e-05 2024-09-12T18:36:52.662 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.662 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.662 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:52.662 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499518+0000", 2024-09-12T18:36:52.662 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.064e-05 2024-09-12T18:36:52.662 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.662 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.662 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:52.662 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499525+0000", 2024-09-12T18:36:52.662 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.9709999999999998e-06 2024-09-12T18:36:52.662 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.663 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.663 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:52.663 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.501699+0000", 2024-09-12T18:36:52.663 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0021738500000000002 2024-09-12T18:36:52.663 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.663 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.663 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:52.663 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.501809+0000", 2024-09-12T18:36:52.663 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000109888 2024-09-12T18:36:52.663 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.664 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.664 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:52.664 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.501960+0000", 2024-09-12T18:36:52.664 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015157899999999999 2024-09-12T18:36:52.664 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.664 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.664 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:52.664 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.504165+0000", 2024-09-12T18:36:52.664 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.002204849 2024-09-12T18:36:52.664 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.664 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.664 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:52.664 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.524053+0000", 2024-09-12T18:36:52.665 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.019887621000000001 2024-09-12T18:36:52.665 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.665 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.665 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:52.665 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.524110+0000", 2024-09-12T18:36:52.665 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7191000000000002e-05 2024-09-12T18:36:52.665 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:52.665 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:52.665 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:52.665 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.524157+0000", 2024-09-12T18:36:52.665 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.668e-05 2024-09-12T18:36:52.665 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:52.665 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:52.665 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:52.666 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:52.666 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:52.666 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:52.667 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:36:52.668 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:52.659+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:52.768 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:52.763+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:52.829 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:52.829 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:36:52.829 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.829 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:145665 5.4 5:2c48b174:::benchmark_data_smithi073_23739_object13388:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T18:36:52.829 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:52.817225+0000", 2024-09-12T18:36:52.829 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.010049394999999999, 2024-09-12T18:36:52.829 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.010075628999999999, 2024-09-12T18:36:52.829 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:52.829 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:52.829 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:52.830 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:52.830 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:52.830 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:52.830 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 145665 2024-09-12T18:36:52.830 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.830 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:52.830 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.830 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:52.830 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.817225+0000", 2024-09-12T18:36:52.830 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:52.830 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.830 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.830 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:52.830 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.817225+0000", 2024-09-12T18:36:52.831 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:52.831 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.831 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.831 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:52.831 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.817226+0000", 2024-09-12T18:36:52.831 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2799999999999995e-07 2024-09-12T18:36:52.831 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.831 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.831 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:52.831 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.817229+0000", 2024-09-12T18:36:52.831 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1039999999999998e-06 2024-09-12T18:36:52.831 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.831 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.832 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:52.832 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.817239+0000", 2024-09-12T18:36:52.832 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0066e-05 2024-09-12T18:36:52.832 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.832 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.832 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:52.832 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.817244+0000", 2024-09-12T18:36:52.832 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5929999999999999e-06 2024-09-12T18:36:52.832 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.832 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.832 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:52.832 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.817299+0000", 2024-09-12T18:36:52.832 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4934e-05 2024-09-12T18:36:52.833 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.833 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.833 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:52.833 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.817423+0000", 2024-09-12T18:36:52.833 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000124425 2024-09-12T18:36:52.833 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.833 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.833 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:52.833 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.817507+0000", 2024-09-12T18:36:52.833 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4161999999999998e-05 2024-09-12T18:36:52.833 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.833 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.833 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:52.834 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.819374+0000", 2024-09-12T18:36:52.834 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018667340000000001 2024-09-12T18:36:52.834 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:52.834 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:52.834 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:52.834 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.834 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.834 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:145669 5.b 5:d5c52d6a:::benchmark_data_smithi073_23739_object13392:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T18:36:52.834 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:52.820309+0000", 2024-09-12T18:36:52.834 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0069659040000000002, 2024-09-12T18:36:52.834 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0070736699999999998, 2024-09-12T18:36:52.834 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:52.834 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:52.834 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:52.835 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:52.835 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:52.835 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:52.835 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 145669 2024-09-12T18:36:52.835 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.835 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:52.835 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.835 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:52.835 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.820309+0000", 2024-09-12T18:36:52.835 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:52.835 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.835 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.836 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:52.836 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.820309+0000", 2024-09-12T18:36:52.836 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:52.836 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.836 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.836 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:52.836 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.820309+0000", 2024-09-12T18:36:52.836 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6000000000000003e-07 2024-09-12T18:36:52.836 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.836 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.836 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:52.836 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.820312+0000", 2024-09-12T18:36:52.836 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2510000000000001e-06 2024-09-12T18:36:52.837 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.837 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.837 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:52.837 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.820317+0000", 2024-09-12T18:36:52.837 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.767e-06 2024-09-12T18:36:52.837 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.837 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.837 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:52.837 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.820324+0000", 2024-09-12T18:36:52.837 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0589999999999999e-06 2024-09-12T18:36:52.837 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.837 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.837 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:52.838 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.820368+0000", 2024-09-12T18:36:52.838 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4172000000000003e-05 2024-09-12T18:36:52.838 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.838 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.838 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:52.838 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.820490+0000", 2024-09-12T18:36:52.838 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012268399999999999 2024-09-12T18:36:52.838 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.838 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.838 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:52.838 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.820601+0000", 2024-09-12T18:36:52.838 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000110525 2024-09-12T18:36:52.838 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.838 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.839 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:52.839 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.823447+0000", 2024-09-12T18:36:52.839 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0028460759999999999 2024-09-12T18:36:52.839 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:52.839 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:52.839 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:52.839 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.839 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.839 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:145671 5.d 5:bd791dc1:::benchmark_data_smithi073_23739_object13394:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T18:36:52.839 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:52.820364+0000", 2024-09-12T18:36:52.839 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0069106990000000002, 2024-09-12T18:36:52.839 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0070898710000000002, 2024-09-12T18:36:52.839 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:52.840 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:52.840 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:52.840 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:52.840 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:52.840 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:52.840 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 145671 2024-09-12T18:36:52.840 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.840 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:52.840 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.840 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:52.840 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.820364+0000", 2024-09-12T18:36:52.840 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:52.840 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.841 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.841 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:52.841 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.820364+0000", 2024-09-12T18:36:52.841 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:52.841 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.841 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.841 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:52.841 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.820364+0000", 2024-09-12T18:36:52.841 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0900000000000002e-07 2024-09-12T18:36:52.841 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.841 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.841 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:52.841 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.820366+0000", 2024-09-12T18:36:52.842 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9230000000000001e-06 2024-09-12T18:36:52.842 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.842 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.842 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:52.842 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.820372+0000", 2024-09-12T18:36:52.842 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6529999999999999e-06 2024-09-12T18:36:52.842 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.842 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.842 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:52.842 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.820378+0000", 2024-09-12T18:36:52.842 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.801e-06 2024-09-12T18:36:52.842 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.842 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.843 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:52.843 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.820447+0000", 2024-09-12T18:36:52.843 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9079999999999996e-05 2024-09-12T18:36:52.843 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.843 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.843 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:52.843 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.820533+0000", 2024-09-12T18:36:52.843 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6698000000000002e-05 2024-09-12T18:36:52.843 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.843 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.843 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:52.843 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.820597+0000", 2024-09-12T18:36:52.843 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.3961999999999995e-05 2024-09-12T18:36:52.843 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.844 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.844 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:52.844 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.823412+0000", 2024-09-12T18:36:52.844 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0028143970000000002 2024-09-12T18:36:52.844 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:52.844 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:52.844 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:52.844 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.844 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.844 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:145674 5.4 5:2cca4449:::benchmark_data_smithi073_23739_object13397:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T18:36:52.844 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:52.822234+0000", 2024-09-12T18:36:52.844 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0050401259999999998, 2024-09-12T18:36:52.844 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052915419999999998, 2024-09-12T18:36:52.845 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:52.845 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:52.845 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:52.845 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:52.845 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:52.845 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:52.845 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 145674 2024-09-12T18:36:52.845 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.845 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:52.845 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.845 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:52.845 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.822234+0000", 2024-09-12T18:36:52.845 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:52.845 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.846 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.846 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:52.846 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.822234+0000", 2024-09-12T18:36:52.846 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:52.846 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.846 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.846 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:52.846 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.822236+0000", 2024-09-12T18:36:52.846 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5200000000000001e-06 2024-09-12T18:36:52.846 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.846 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.846 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:52.846 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.822241+0000", 2024-09-12T18:36:52.846 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2809999999999999e-06 2024-09-12T18:36:52.847 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.847 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.847 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:52.847 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.822252+0000", 2024-09-12T18:36:52.847 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0492000000000001e-05 2024-09-12T18:36:52.847 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.847 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.847 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:52.847 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.822260+0000", 2024-09-12T18:36:52.847 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9640000000000003e-06 2024-09-12T18:36:52.847 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.847 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.847 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:52.848 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.822324+0000", 2024-09-12T18:36:52.848 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4358999999999998e-05 2024-09-12T18:36:52.848 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.848 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.848 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:52.848 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.822443+0000", 2024-09-12T18:36:52.848 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000118854 2024-09-12T18:36:52.848 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.848 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.848 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:52.848 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.822510+0000", 2024-09-12T18:36:52.848 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6843999999999999e-05 2024-09-12T18:36:52.848 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.849 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.849 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:52.849 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.825918+0000", 2024-09-12T18:36:52.849 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0034078480000000002 2024-09-12T18:36:52.849 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:52.849 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:52.849 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:52.849 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.849 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.849 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:145679 5.4 5:2bd57bfd:::benchmark_data_smithi073_23739_object13402:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T18:36:52.849 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:52.824318+0000", 2024-09-12T18:36:52.849 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.002956597, 2024-09-12T18:36:52.849 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0032464109999999998, 2024-09-12T18:36:52.850 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:52.850 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:52.850 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:52.850 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:52.850 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:52.850 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:52.850 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 145679 2024-09-12T18:36:52.850 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.850 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:52.850 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.850 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:52.850 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.824318+0000", 2024-09-12T18:36:52.850 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:52.850 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.851 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.851 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:52.851 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.824318+0000", 2024-09-12T18:36:52.851 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:52.851 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.851 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.851 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:52.851 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.824319+0000", 2024-09-12T18:36:52.851 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.237e-06 2024-09-12T18:36:52.851 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.851 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.851 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:52.851 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.824324+0000", 2024-09-12T18:36:52.852 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5569999999999997e-06 2024-09-12T18:36:52.852 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.852 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.852 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:52.852 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.824335+0000", 2024-09-12T18:36:52.852 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.17e-05 2024-09-12T18:36:52.852 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.852 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.852 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:52.852 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.824343+0000", 2024-09-12T18:36:52.852 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7130000000000005e-06 2024-09-12T18:36:52.852 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.852 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.852 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:52.853 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.824396+0000", 2024-09-12T18:36:52.853 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2596999999999998e-05 2024-09-12T18:36:52.853 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.853 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.853 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:52.853 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.824503+0000", 2024-09-12T18:36:52.853 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000106753 2024-09-12T18:36:52.853 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.853 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.853 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:52.853 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.824616+0000", 2024-09-12T18:36:52.853 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000113718 2024-09-12T18:36:52.853 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.854 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.854 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:52.854 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.827101+0000", 2024-09-12T18:36:52.854 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0024843130000000001 2024-09-12T18:36:52.854 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:52.854 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:52.854 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:52.854 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.854 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.854 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:145680 5.4 5:208b1b5c:::benchmark_data_smithi073_23739_object13403:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T18:36:52.854 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:52.824363+0000", 2024-09-12T18:36:52.854 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0029120000000000001, 2024-09-12T18:36:52.854 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003238341, 2024-09-12T18:36:52.854 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:52.855 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:52.855 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:52.855 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:52.855 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:52.855 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:52.855 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 145680 2024-09-12T18:36:52.855 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.855 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:52.855 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.855 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:52.855 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.824363+0000", 2024-09-12T18:36:52.855 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:52.855 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.855 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.856 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:52.856 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.824363+0000", 2024-09-12T18:36:52.856 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:52.856 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.856 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.856 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:52.856 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.824363+0000", 2024-09-12T18:36:52.856 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.68e-07 2024-09-12T18:36:52.856 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.856 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.856 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:52.856 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.824366+0000", 2024-09-12T18:36:52.856 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.627e-06 2024-09-12T18:36:52.857 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.857 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.857 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:52.857 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.824372+0000", 2024-09-12T18:36:52.857 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.3899999999999998e-06 2024-09-12T18:36:52.857 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.857 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.857 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:52.857 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.824377+0000", 2024-09-12T18:36:52.857 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5040000000000004e-06 2024-09-12T18:36:52.857 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.857 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.857 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:52.857 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.825939+0000", 2024-09-12T18:36:52.858 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001562215 2024-09-12T18:36:52.858 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.858 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.858 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:52.858 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.826032+0000", 2024-09-12T18:36:52.858 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.3583000000000002e-05 2024-09-12T18:36:52.858 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.858 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.858 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:52.858 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.826100+0000", 2024-09-12T18:36:52.858 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7026999999999994e-05 2024-09-12T18:36:52.858 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.858 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.859 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:52.859 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.827523+0000", 2024-09-12T18:36:52.859 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014232699999999999 2024-09-12T18:36:52.859 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:52.859 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:52.859 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:52.859 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.859 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.859 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:145682 5.0 5:0b71f5c7:::benchmark_data_smithi073_23739_object13405:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T18:36:52.859 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:52.825539+0000", 2024-09-12T18:36:52.859 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0017354689999999999, 2024-09-12T18:36:52.859 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002099549, 2024-09-12T18:36:52.859 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:52.860 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:52.860 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:52.860 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:52.860 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:52.860 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:52.860 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 145682 2024-09-12T18:36:52.860 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.860 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:52.860 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.860 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:52.860 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.825539+0000", 2024-09-12T18:36:52.860 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:52.860 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.861 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.861 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:52.861 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.825539+0000", 2024-09-12T18:36:52.861 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:52.861 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.861 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.861 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:52.861 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.825540+0000", 2024-09-12T18:36:52.861 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2600000000000001e-07 2024-09-12T18:36:52.861 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.861 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.861 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:52.861 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.825543+0000", 2024-09-12T18:36:52.862 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1130000000000001e-06 2024-09-12T18:36:52.862 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.862 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.862 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:52.862 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.825552+0000", 2024-09-12T18:36:52.862 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.431e-06 2024-09-12T18:36:52.862 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.862 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.862 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:52.862 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.825557+0000", 2024-09-12T18:36:52.862 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.729e-06 2024-09-12T18:36:52.862 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.862 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.863 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:52.863 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.825597+0000", 2024-09-12T18:36:52.863 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9588000000000001e-05 2024-09-12T18:36:52.863 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.863 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.863 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:52.863 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.825686+0000", 2024-09-12T18:36:52.863 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8824000000000002e-05 2024-09-12T18:36:52.863 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.863 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.863 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0,2", 2024-09-12T18:36:52.863 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.825793+0000", 2024-09-12T18:36:52.863 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000107168 2024-09-12T18:36:52.864 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:52.864 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:52.864 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:52.864 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.864 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.864 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:145684 5.a e55/21 5:5ca6c0bc:::benchmark_data_smithi073_23739_object13407:head v 55'9245, mlcod=55'9243)", 2024-09-12T18:36:52.864 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:52.826350+0000", 2024-09-12T18:36:52.864 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00092418700000000003, 2024-09-12T18:36:52.864 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013208390000000001, 2024-09-12T18:36:52.864 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:52.864 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:52.864 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:52.864 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:52.865 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.865 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:52.865 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.826350+0000", 2024-09-12T18:36:52.865 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:52.865 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.865 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.865 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:52.865 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.826350+0000", 2024-09-12T18:36:52.865 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:52.865 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.865 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.865 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:52.865 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.826351+0000", 2024-09-12T18:36:52.865 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.3799999999999997e-07 2024-09-12T18:36:52.866 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.866 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.866 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:52.866 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.826354+0000", 2024-09-12T18:36:52.866 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3019999999999999e-06 2024-09-12T18:36:52.866 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.866 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.866 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:52.866 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.826365+0000", 2024-09-12T18:36:52.866 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0188e-05 2024-09-12T18:36:52.866 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.866 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.866 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:52.866 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.826370+0000", 2024-09-12T18:36:52.867 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1499999999999998e-06 2024-09-12T18:36:52.867 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.867 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.867 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:52.867 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.826415+0000", 2024-09-12T18:36:52.867 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5107e-05 2024-09-12T18:36:52.867 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:52.867 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:52.867 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:52.867 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:52.826434+0000", 2024-09-12T18:36:52.867 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9266000000000002e-05 2024-09-12T18:36:52.867 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:52.867 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:52.868 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:52.868 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:52.868 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-09-12T18:36:52.868 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 8 2024-09-12T18:36:52.868 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:52.869 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:36:52.870 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:52.866+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:52.970 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:52.963+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:53.071 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:53.066+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:53.075 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:53.075 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-09-12T18:36:53.075 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-09-12T18:36:53.075 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-09-12T18:36:53.075 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:53.098 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:36:53.180 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T18:36:53.185 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:53.182+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:53.272 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:53.266+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:53.298 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:53.298 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-09-12T18:36:53.298 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-09-12T18:36:53.298 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:36:53.298 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.299 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:53.299 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:53.299 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 87.662338808000001, 2024-09-12T18:36:53.299 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025088781000000001, 2024-09-12T18:36:53.299 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:53.299 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:53.299 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:53.299 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:53.299 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.299 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:53.299 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:53.299 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:53.299 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.300 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.300 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:53.300 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:53.300 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:53.300 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.300 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.300 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:53.300 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632518+0000", 2024-09-12T18:36:53.300 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:36:53.300 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.300 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.300 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:53.301 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632533+0000", 2024-09-12T18:36:53.301 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5130000000000001e-05 2024-09-12T18:36:53.301 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.301 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.301 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:53.301 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632564+0000", 2024-09-12T18:36:53.301 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0788999999999999e-05 2024-09-12T18:36:53.301 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.301 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.301 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:53.302 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632590+0000", 2024-09-12T18:36:53.302 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6057000000000001e-05 2024-09-12T18:36:53.302 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.302 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.302 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:53.302 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.635931+0000", 2024-09-12T18:36:53.302 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033411320000000001 2024-09-12T18:36:53.302 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.302 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.302 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:53.302 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636186+0000", 2024-09-12T18:36:53.302 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025452500000000002 2024-09-12T18:36:53.302 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.302 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.303 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:53.303 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636445+0000", 2024-09-12T18:36:53.303 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000259268 2024-09-12T18:36:53.303 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.303 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.303 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:53.303 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639562+0000", 2024-09-12T18:36:53.303 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031167 2024-09-12T18:36:53.303 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.303 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.303 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:53.303 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657314+0000", 2024-09-12T18:36:53.303 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017752562 2024-09-12T18:36:53.304 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.304 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.304 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:53.304 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657445+0000", 2024-09-12T18:36:53.304 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013105899999999999 2024-09-12T18:36:53.304 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.304 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.304 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:53.304 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657598+0000", 2024-09-12T18:36:53.304 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015247899999999999 2024-09-12T18:36:53.304 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:53.304 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:53.304 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:53.305 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.305 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.305 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:53.305 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:53.305 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 87.662212604999993, 2024-09-12T18:36:53.305 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025643131999999999, 2024-09-12T18:36:53.305 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:53.305 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:53.305 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:53.305 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:53.305 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.305 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:53.305 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:53.305 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:53.306 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.306 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.306 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:53.306 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:53.306 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:53.306 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.306 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.306 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:53.306 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632637+0000", 2024-09-12T18:36:53.306 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5600000000000001e-06 2024-09-12T18:36:53.306 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.306 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.307 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:53.307 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632650+0000", 2024-09-12T18:36:53.307 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3186e-05 2024-09-12T18:36:53.307 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.307 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.307 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:53.307 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632672+0000", 2024-09-12T18:36:53.307 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2013000000000001e-05 2024-09-12T18:36:53.307 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.307 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.307 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:53.308 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632687+0000", 2024-09-12T18:36:53.308 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5109999999999999e-05 2024-09-12T18:36:53.308 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.308 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.308 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:53.308 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636994+0000", 2024-09-12T18:36:53.308 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0043065539999999998 2024-09-12T18:36:53.308 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.308 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.308 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:53.308 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637198+0000", 2024-09-12T18:36:53.308 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020387199999999999 2024-09-12T18:36:53.309 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.309 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.309 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:53.309 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637475+0000", 2024-09-12T18:36:53.309 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027731000000000001 2024-09-12T18:36:53.309 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.309 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.309 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:53.309 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639574+0000", 2024-09-12T18:36:53.309 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020988999999999999 2024-09-12T18:36:53.309 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.309 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.310 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:53.310 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658057+0000", 2024-09-12T18:36:53.310 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018482926 2024-09-12T18:36:53.310 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.310 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.310 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:53.310 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658184+0000", 2024-09-12T18:36:53.310 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012756200000000001 2024-09-12T18:36:53.310 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.310 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.310 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:53.310 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658278+0000", 2024-09-12T18:36:53.310 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4139000000000001e-05 2024-09-12T18:36:53.311 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:53.311 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:53.311 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:53.311 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.311 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.311 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:53.311 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:53.311 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 87.662137513000005, 2024-09-12T18:36:53.311 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025238883, 2024-09-12T18:36:53.311 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:53.311 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:53.311 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:53.311 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:53.311 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.312 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:53.312 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:53.312 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:53.312 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.312 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.312 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:53.312 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:53.312 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:53.312 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.312 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.312 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:53.312 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632712+0000", 2024-09-12T18:36:53.312 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6869999999999999e-06 2024-09-12T18:36:53.313 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.313 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.313 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:53.313 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632719+0000", 2024-09-12T18:36:53.313 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6059999999999999e-06 2024-09-12T18:36:53.313 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.313 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.313 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:53.313 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632737+0000", 2024-09-12T18:36:53.313 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7983999999999999e-05 2024-09-12T18:36:53.313 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.313 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.314 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:53.314 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632751+0000", 2024-09-12T18:36:53.314 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4473e-05 2024-09-12T18:36:53.314 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.314 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.314 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:53.314 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636961+0000", 2024-09-12T18:36:53.314 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042100840000000002 2024-09-12T18:36:53.314 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.314 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.314 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:53.314 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637211+0000", 2024-09-12T18:36:53.314 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000249738 2024-09-12T18:36:53.315 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.315 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.315 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:53.315 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637504+0000", 2024-09-12T18:36:53.315 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00029271499999999998 2024-09-12T18:36:53.315 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.315 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.315 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:53.315 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639582+0000", 2024-09-12T18:36:53.315 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020783389999999998 2024-09-12T18:36:53.315 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.316 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.316 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:53.316 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657709+0000", 2024-09-12T18:36:53.316 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018126758999999999 2024-09-12T18:36:53.316 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.316 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.316 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:53.316 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657830+0000", 2024-09-12T18:36:53.316 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000121329 2024-09-12T18:36:53.316 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.316 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.316 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:53.316 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657949+0000", 2024-09-12T18:36:53.317 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000119169 2024-09-12T18:36:53.317 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:53.317 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:53.317 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:53.317 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.317 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.317 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:53.317 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:53.317 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 87.662073466999999, 2024-09-12T18:36:53.317 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026711823999999999, 2024-09-12T18:36:53.317 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:53.317 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:53.317 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:53.318 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:53.318 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.318 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:53.318 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:53.318 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:53.318 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.318 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.318 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:53.318 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:53.318 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:53.318 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.318 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.318 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:53.318 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632775+0000", 2024-09-12T18:36:53.319 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9999999999999995e-07 2024-09-12T18:36:53.319 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.319 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.319 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:53.319 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632788+0000", 2024-09-12T18:36:53.319 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2629999999999999e-05 2024-09-12T18:36:53.319 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.319 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.319 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:53.319 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632806+0000", 2024-09-12T18:36:53.320 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:36:53.320 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.320 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.320 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:53.320 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632820+0000", 2024-09-12T18:36:53.320 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3777e-05 2024-09-12T18:36:53.320 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.320 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.320 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:53.320 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638310+0000", 2024-09-12T18:36:53.320 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054898280000000004 2024-09-12T18:36:53.320 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.321 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.321 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:53.321 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638480+0000", 2024-09-12T18:36:53.321 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016968199999999999 2024-09-12T18:36:53.321 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.321 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.321 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:53.321 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638799+0000", 2024-09-12T18:36:53.321 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031915999999999997 2024-09-12T18:36:53.321 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.321 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.321 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:53.321 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639866+0000", 2024-09-12T18:36:53.322 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001067405 2024-09-12T18:36:53.322 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.322 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.322 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:53.322 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658398+0000", 2024-09-12T18:36:53.322 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018531542000000002 2024-09-12T18:36:53.322 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.322 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.322 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:53.322 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658643+0000", 2024-09-12T18:36:53.322 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00024531500000000002 2024-09-12T18:36:53.322 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.322 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.322 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:53.323 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.659486+0000", 2024-09-12T18:36:53.323 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00084316899999999995 2024-09-12T18:36:53.323 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:53.323 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:53.323 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:53.323 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.323 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.323 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:53.323 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:53.323 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 87.661764712999997, 2024-09-12T18:36:53.323 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026938645000000001, 2024-09-12T18:36:53.323 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:53.324 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:53.324 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:53.324 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:53.324 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.324 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:53.324 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:53.324 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:53.324 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.324 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.324 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:53.324 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:53.324 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:53.324 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.325 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.325 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:53.325 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633085+0000", 2024-09-12T18:36:53.325 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:53.325 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.325 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.325 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:53.325 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633093+0000", 2024-09-12T18:36:53.325 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3999999999999992e-06 2024-09-12T18:36:53.325 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.325 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.325 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:53.325 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633111+0000", 2024-09-12T18:36:53.325 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8070000000000001e-05 2024-09-12T18:36:53.326 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.326 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.326 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:53.326 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633126+0000", 2024-09-12T18:36:53.326 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4487e-05 2024-09-12T18:36:53.326 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.326 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.326 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:53.326 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638290+0000", 2024-09-12T18:36:53.326 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0051640269999999999 2024-09-12T18:36:53.326 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.326 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.326 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:53.326 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638547+0000", 2024-09-12T18:36:53.327 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025714100000000001 2024-09-12T18:36:53.327 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.327 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.327 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:53.327 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638850+0000", 2024-09-12T18:36:53.327 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030278400000000001 2024-09-12T18:36:53.327 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.327 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.327 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:53.327 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.640706+0000", 2024-09-12T18:36:53.327 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018564580000000001 2024-09-12T18:36:53.327 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.327 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.327 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:53.327 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658420+0000", 2024-09-12T18:36:53.328 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017714395000000001 2024-09-12T18:36:53.328 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.328 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.328 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:53.328 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658635+0000", 2024-09-12T18:36:53.328 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021413500000000001 2024-09-12T18:36:53.328 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.328 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.328 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:53.328 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.660022+0000", 2024-09-12T18:36:53.328 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001387318 2024-09-12T18:36:53.328 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:53.328 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:53.328 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:53.329 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.329 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.329 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121096 5.8 5:13503891:::benchmark_data_smithi073_23739_object121095:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:53.329 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:36:53.329 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 13.116271746000001, 2024-09-12T18:36:53.329 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064025391000000001, 2024-09-12T18:36:53.329 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:53.329 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:53.329 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:53.329 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:53.330 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:53.330 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:53.330 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121096 2024-09-12T18:36:53.330 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.330 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:53.330 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.330 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:53.330 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:36:53.330 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:53.330 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.330 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.330 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:53.330 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:36:53.331 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:53.331 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.331 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.331 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:53.331 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178579+0000", 2024-09-12T18:36:53.331 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7369999999999998e-06 2024-09-12T18:36:53.331 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.331 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.331 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:53.331 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178846+0000", 2024-09-12T18:36:53.331 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026752699999999999 2024-09-12T18:36:53.331 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.331 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.331 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:53.332 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178877+0000", 2024-09-12T18:36:53.332 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1081999999999998e-05 2024-09-12T18:36:53.332 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.332 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.332 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:53.332 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178896+0000", 2024-09-12T18:36:53.332 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8522e-05 2024-09-12T18:36:53.332 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.332 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.332 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:53.332 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.192591+0000", 2024-09-12T18:36:53.332 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013695067 2024-09-12T18:36:53.333 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.333 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.333 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:53.333 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.192944+0000", 2024-09-12T18:36:53.333 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00035273699999999999 2024-09-12T18:36:53.333 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.333 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.333 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:53.333 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.193732+0000", 2024-09-12T18:36:53.333 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078849599999999997 2024-09-12T18:36:53.333 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.333 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.333 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:53.333 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.213583+0000", 2024-09-12T18:36:53.334 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.019851164000000001 2024-09-12T18:36:53.334 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.334 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.334 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:53.334 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242386+0000", 2024-09-12T18:36:53.334 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028802924000000001 2024-09-12T18:36:53.334 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.334 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.334 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:53.334 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242501+0000", 2024-09-12T18:36:53.334 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000114932 2024-09-12T18:36:53.334 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.334 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.334 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:53.335 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242602+0000", 2024-09-12T18:36:53.335 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000100203 2024-09-12T18:36:53.335 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:53.335 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:53.335 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:53.335 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.335 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.335 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121097 5.8 5:1b31a99e:::benchmark_data_smithi073_23739_object121096:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:53.335 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:36:53.335 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 13.100543456, 2024-09-12T18:36:53.335 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048475917, 2024-09-12T18:36:53.335 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:53.335 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:53.335 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:53.336 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:53.336 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:53.336 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:53.336 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121097 2024-09-12T18:36:53.336 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.336 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:53.336 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.336 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:53.336 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:36:53.336 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:53.336 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.336 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.336 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:53.337 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:36:53.337 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:53.337 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.337 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.337 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:53.337 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194308+0000", 2024-09-12T18:36:53.337 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2789999999999999e-06 2024-09-12T18:36:53.337 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.337 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.337 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:53.338 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194396+0000", 2024-09-12T18:36:53.338 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8324000000000003e-05 2024-09-12T18:36:53.338 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.338 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.338 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:53.338 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194424+0000", 2024-09-12T18:36:53.338 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7565000000000001e-05 2024-09-12T18:36:53.338 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.338 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.338 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:53.338 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194444+0000", 2024-09-12T18:36:53.338 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0363000000000001e-05 2024-09-12T18:36:53.338 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.338 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.339 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:53.339 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.206888+0000", 2024-09-12T18:36:53.339 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012443997 2024-09-12T18:36:53.339 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.339 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.339 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:53.339 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.207138+0000", 2024-09-12T18:36:53.339 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025035900000000002 2024-09-12T18:36:53.339 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.339 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.339 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:53.339 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.207365+0000", 2024-09-12T18:36:53.339 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000226407 2024-09-12T18:36:53.339 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.339 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.340 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:53.340 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.215059+0000", 2024-09-12T18:36:53.340 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076946860000000001 2024-09-12T18:36:53.340 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.340 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.340 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:53.340 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242619+0000", 2024-09-12T18:36:53.340 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.027559975 2024-09-12T18:36:53.340 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.341 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.341 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:53.341 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242706+0000", 2024-09-12T18:36:53.341 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6384999999999994e-05 2024-09-12T18:36:53.341 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.341 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.341 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:53.341 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242780+0000", 2024-09-12T18:36:53.341 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4577000000000001e-05 2024-09-12T18:36:53.341 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:53.341 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:53.341 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:53.341 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.342 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.342 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:121044 5.1 e50/49 5:83bf711a:::benchmark_data_smithi073_23739_object121043:head v 50'7532, mlcod=0'0)", 2024-09-12T18:36:53.342 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.201054+0000", 2024-09-12T18:36:53.342 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 13.093794235000001, 2024-09-12T18:36:53.342 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026157387000000001, 2024-09-12T18:36:53.342 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:53.342 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:53.342 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:53.342 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:53.342 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.342 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:53.342 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201054+0000", 2024-09-12T18:36:53.342 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:53.342 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.343 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.343 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:53.343 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201054+0000", 2024-09-12T18:36:53.343 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:53.343 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.343 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.343 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:53.343 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201056+0000", 2024-09-12T18:36:53.343 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.99e-06 2024-09-12T18:36:53.343 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.343 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.343 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:53.343 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201068+0000", 2024-09-12T18:36:53.343 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2799000000000001e-05 2024-09-12T18:36:53.344 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.344 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.344 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:53.344 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201093+0000", 2024-09-12T18:36:53.344 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4766e-05 2024-09-12T18:36:53.344 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.344 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.344 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:53.344 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201115+0000", 2024-09-12T18:36:53.344 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1988999999999999e-05 2024-09-12T18:36:53.344 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.344 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.344 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:53.344 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201233+0000", 2024-09-12T18:36:53.345 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000118229 2024-09-12T18:36:53.345 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.345 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.345 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:53.345 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201273+0000", 2024-09-12T18:36:53.345 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9171999999999997e-05 2024-09-12T18:36:53.345 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.345 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.345 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:53.345 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.227080+0000", 2024-09-12T18:36:53.345 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025807611000000001 2024-09-12T18:36:53.345 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.345 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.345 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:53.346 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.227211+0000", 2024-09-12T18:36:53.346 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013083100000000001 2024-09-12T18:36:53.346 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:53.346 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:53.346 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:53.346 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.346 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.346 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121101 5.e 5:7e18e9ed:::benchmark_data_smithi073_23739_object121100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:53.346 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.209084+0000", 2024-09-12T18:36:53.346 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 13.085763400999999, 2024-09-12T18:36:53.346 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028988566, 2024-09-12T18:36:53.347 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:53.347 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:53.347 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:53.347 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:53.347 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:53.347 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:53.347 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121101 2024-09-12T18:36:53.347 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.347 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:53.347 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.347 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:53.347 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209084+0000", 2024-09-12T18:36:53.347 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:53.348 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.348 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.348 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:53.348 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209084+0000", 2024-09-12T18:36:53.348 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:53.348 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.349 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.349 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:53.349 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209087+0000", 2024-09-12T18:36:53.349 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6800000000000002e-06 2024-09-12T18:36:53.349 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.349 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.350 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:53.350 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209182+0000", 2024-09-12T18:36:53.350 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5084e-05 2024-09-12T18:36:53.350 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.350 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.350 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:53.351 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209212+0000", 2024-09-12T18:36:53.351 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9825e-05 2024-09-12T18:36:53.351 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.351 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.351 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:53.351 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209234+0000", 2024-09-12T18:36:53.352 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1416e-05 2024-09-12T18:36:53.352 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.352 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.352 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:53.352 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209497+0000", 2024-09-12T18:36:53.352 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026390400000000003 2024-09-12T18:36:53.353 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.353 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.353 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:53.353 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209810+0000", 2024-09-12T18:36:53.353 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000313023 2024-09-12T18:36:53.353 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.354 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.354 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:53.354 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.210468+0000", 2024-09-12T18:36:53.354 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00065779300000000005 2024-09-12T18:36:53.354 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.354 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.355 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:53.355 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.235905+0000", 2024-09-12T18:36:53.355 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025436881000000001 2024-09-12T18:36:53.355 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.355 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.355 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:53.356 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237797+0000", 2024-09-12T18:36:53.356 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001892007 2024-09-12T18:36:53.356 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.356 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.356 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:53.357 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237941+0000", 2024-09-12T18:36:53.357 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000143411 2024-09-12T18:36:53.357 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.357 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.357 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:53.357 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.238073+0000", 2024-09-12T18:36:53.358 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013254200000000001 2024-09-12T18:36:53.358 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:53.358 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:53.358 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:53.358 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.358 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.358 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121102 5.8 5:1f118f4b:::benchmark_data_smithi073_23739_object121101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:53.359 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.218682+0000", 2024-09-12T18:36:53.359 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 13.076166041, 2024-09-12T18:36:53.359 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024264885, 2024-09-12T18:36:53.359 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:53.359 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:53.359 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:53.360 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:53.360 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:53.360 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:53.360 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121102 2024-09-12T18:36:53.360 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.360 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:53.361 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.361 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:53.361 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218682+0000", 2024-09-12T18:36:53.361 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:53.361 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.362 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.362 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:53.362 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218682+0000", 2024-09-12T18:36:53.362 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:53.362 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.362 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.362 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:53.363 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218685+0000", 2024-09-12T18:36:53.363 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6059999999999999e-06 2024-09-12T18:36:53.363 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.363 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.363 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:53.363 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218743+0000", 2024-09-12T18:36:53.364 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7160999999999997e-05 2024-09-12T18:36:53.364 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.364 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.364 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:53.364 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218768+0000", 2024-09-12T18:36:53.364 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5052e-05 2024-09-12T18:36:53.365 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.365 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.365 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:53.365 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218785+0000", 2024-09-12T18:36:53.365 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7436999999999999e-05 2024-09-12T18:36:53.365 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.366 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.366 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:53.366 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218952+0000", 2024-09-12T18:36:53.366 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016691300000000001 2024-09-12T18:36:53.366 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.366 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.367 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:53.367 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.219437+0000", 2024-09-12T18:36:53.367 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048465900000000002 2024-09-12T18:36:53.367 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.367 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.367 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:53.368 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.219893+0000", 2024-09-12T18:36:53.368 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00045642799999999999 2024-09-12T18:36:53.368 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.368 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.368 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:53.368 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.226416+0000", 2024-09-12T18:36:53.369 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065225630000000003 2024-09-12T18:36:53.369 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.369 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.369 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:53.369 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242796+0000", 2024-09-12T18:36:53.370 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016379857000000001 2024-09-12T18:36:53.370 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.370 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.370 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:53.370 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242879+0000", 2024-09-12T18:36:53.370 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3913999999999997e-05 2024-09-12T18:36:53.370 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.371 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.371 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:53.371 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242947+0000", 2024-09-12T18:36:53.371 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7294999999999999e-05 2024-09-12T18:36:53.371 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:53.371 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:53.371 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:53.372 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.372 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.372 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121106 5.d 5:b4a9a221:::benchmark_data_smithi073_23739_object121105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:53.372 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:36:53.372 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 13.05766852, 2024-09-12T18:36:53.372 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.034882274999999997, 2024-09-12T18:36:53.372 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:53.373 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:53.373 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:53.373 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:53.373 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:53.373 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:53.373 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121106 2024-09-12T18:36:53.373 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.373 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:53.373 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.373 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:53.373 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:36:53.374 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:53.374 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.374 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.374 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:53.374 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:36:53.374 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:53.374 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.374 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.374 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:53.374 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237182+0000", 2024-09-12T18:36:53.374 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6019999999999998e-06 2024-09-12T18:36:53.374 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.374 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.374 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:53.375 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237257+0000", 2024-09-12T18:36:53.375 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5420999999999995e-05 2024-09-12T18:36:53.375 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.375 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.375 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:53.375 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237305+0000", 2024-09-12T18:36:53.375 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7207999999999999e-05 2024-09-12T18:36:53.375 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.375 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.375 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:53.375 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237325+0000", 2024-09-12T18:36:53.375 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0001e-05 2024-09-12T18:36:53.375 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.375 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.376 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:53.376 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237505+0000", 2024-09-12T18:36:53.376 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000180798 2024-09-12T18:36:53.376 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.376 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.376 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:53.376 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237764+0000", 2024-09-12T18:36:53.376 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025862299999999998 2024-09-12T18:36:53.376 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.376 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.376 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:53.376 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.238264+0000", 2024-09-12T18:36:53.376 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00050016100000000005 2024-09-12T18:36:53.377 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.377 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.377 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:53.377 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256525+0000", 2024-09-12T18:36:53.377 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018260508000000002 2024-09-12T18:36:53.377 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.377 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.377 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:53.377 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.271903+0000", 2024-09-12T18:36:53.377 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015378739000000001 2024-09-12T18:36:53.377 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.377 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.377 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:53.377 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.271999+0000", 2024-09-12T18:36:53.377 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5989000000000005e-05 2024-09-12T18:36:53.378 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.378 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.378 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:53.378 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272062+0000", 2024-09-12T18:36:53.378 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2224999999999995e-05 2024-09-12T18:36:53.378 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:53.378 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:53.378 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:53.378 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.378 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.378 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121112 5.d 5:b9a2d671:::benchmark_data_smithi073_23739_object121111:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:53.378 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.243446+0000", 2024-09-12T18:36:53.378 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 13.051401795, 2024-09-12T18:36:53.379 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.02889415, 2024-09-12T18:36:53.379 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:53.379 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:53.379 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:53.379 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:53.379 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:53.379 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:53.379 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121112 2024-09-12T18:36:53.379 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.379 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:53.379 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.379 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:53.380 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243446+0000", 2024-09-12T18:36:53.380 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:53.380 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.380 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.380 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:53.380 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243446+0000", 2024-09-12T18:36:53.380 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:53.380 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.380 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.380 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:53.380 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243448+0000", 2024-09-12T18:36:53.380 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0829999999999998e-06 2024-09-12T18:36:53.380 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.380 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.381 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:53.381 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243527+0000", 2024-09-12T18:36:53.381 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9173999999999998e-05 2024-09-12T18:36:53.381 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.381 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.381 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:53.381 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243549+0000", 2024-09-12T18:36:53.381 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1169e-05 2024-09-12T18:36:53.381 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.381 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.381 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:53.381 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243564+0000", 2024-09-12T18:36:53.381 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5866999999999999e-05 2024-09-12T18:36:53.382 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.382 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.382 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:53.382 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.249905+0000", 2024-09-12T18:36:53.382 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063410360000000004 2024-09-12T18:36:53.382 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.382 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.382 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:53.382 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.250166+0000", 2024-09-12T18:36:53.382 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026052999999999997 2024-09-12T18:36:53.382 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.382 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.382 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:53.383 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.250486+0000", 2024-09-12T18:36:53.383 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00032002700000000002 2024-09-12T18:36:53.383 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.383 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.383 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:53.383 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.259263+0000", 2024-09-12T18:36:53.383 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0087774770000000005 2024-09-12T18:36:53.383 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.383 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.383 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:53.383 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272186+0000", 2024-09-12T18:36:53.383 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.01292213 2024-09-12T18:36:53.383 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.383 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.384 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:53.384 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272267+0000", 2024-09-12T18:36:53.384 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1153e-05 2024-09-12T18:36:53.384 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.384 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.384 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:53.384 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272340+0000", 2024-09-12T18:36:53.384 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3504000000000006e-05 2024-09-12T18:36:53.384 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:53.384 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:53.384 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:53.384 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.384 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.384 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121114 5.d 5:b8870c11:::benchmark_data_smithi073_23739_object121113:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:53.385 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.243603+0000", 2024-09-12T18:36:53.385 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 13.051244543999999, 2024-09-12T18:36:53.385 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028945746000000001, 2024-09-12T18:36:53.385 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:53.385 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:53.385 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:53.385 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:53.385 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:53.385 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:53.385 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121114 2024-09-12T18:36:53.385 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.385 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:53.385 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.386 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:53.386 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243603+0000", 2024-09-12T18:36:53.386 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:53.386 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.386 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.386 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:53.386 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243603+0000", 2024-09-12T18:36:53.386 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:53.386 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.386 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.386 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:53.386 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243605+0000", 2024-09-12T18:36:53.386 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.268e-06 2024-09-12T18:36:53.387 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.387 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.387 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:53.387 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243674+0000", 2024-09-12T18:36:53.387 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9375000000000006e-05 2024-09-12T18:36:53.387 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.387 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.387 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:53.387 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243691+0000", 2024-09-12T18:36:53.387 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6517000000000001e-05 2024-09-12T18:36:53.387 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.387 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.387 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:53.387 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243702+0000", 2024-09-12T18:36:53.387 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1905999999999999e-05 2024-09-12T18:36:53.388 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.388 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.388 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:53.388 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.253789+0000", 2024-09-12T18:36:53.388 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.010086776 2024-09-12T18:36:53.388 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.388 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.388 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:53.388 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.253959+0000", 2024-09-12T18:36:53.388 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00017000000000000001 2024-09-12T18:36:53.388 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.388 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.388 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:53.389 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.254179+0000", 2024-09-12T18:36:53.389 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022003699999999999 2024-09-12T18:36:53.389 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.389 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.389 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:53.389 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.259330+0000", 2024-09-12T18:36:53.389 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0051511559999999996 2024-09-12T18:36:53.389 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.389 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.389 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:53.389 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272403+0000", 2024-09-12T18:36:53.389 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013072342000000001 2024-09-12T18:36:53.389 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.389 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.390 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:53.390 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272493+0000", 2024-09-12T18:36:53.390 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0595999999999998e-05 2024-09-12T18:36:53.390 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.390 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.390 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:53.390 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272549+0000", 2024-09-12T18:36:53.390 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5773000000000003e-05 2024-09-12T18:36:53.390 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:53.390 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:53.390 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:53.390 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.390 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.390 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121115 5.d 5:bd4a51ea:::benchmark_data_smithi073_23739_object121114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:53.391 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.245059+0000", 2024-09-12T18:36:53.391 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 13.04978887, 2024-09-12T18:36:53.391 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.02767406, 2024-09-12T18:36:53.391 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:53.391 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:53.391 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:53.391 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:53.391 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:53.391 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:53.391 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121115 2024-09-12T18:36:53.391 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.391 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:53.391 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.391 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:53.392 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245059+0000", 2024-09-12T18:36:53.392 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:53.392 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.392 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.392 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:53.392 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245059+0000", 2024-09-12T18:36:53.392 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:53.392 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.392 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.392 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:53.392 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245061+0000", 2024-09-12T18:36:53.392 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9759999999999998e-06 2024-09-12T18:36:53.392 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.392 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.393 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:53.393 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245111+0000", 2024-09-12T18:36:53.393 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9838e-05 2024-09-12T18:36:53.393 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.393 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.393 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:53.393 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245132+0000", 2024-09-12T18:36:53.393 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1469999999999999e-05 2024-09-12T18:36:53.393 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.393 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.393 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:53.393 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245146+0000", 2024-09-12T18:36:53.393 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3377000000000001e-05 2024-09-12T18:36:53.393 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.394 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.394 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:53.394 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256596+0000", 2024-09-12T18:36:53.394 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011450241999999999 2024-09-12T18:36:53.394 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.394 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.394 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:53.394 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256838+0000", 2024-09-12T18:36:53.394 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000242255 2024-09-12T18:36:53.394 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.394 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.394 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:53.394 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.257095+0000", 2024-09-12T18:36:53.395 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025679300000000001 2024-09-12T18:36:53.395 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.395 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.395 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:53.395 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.259928+0000", 2024-09-12T18:36:53.395 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0028326290000000001 2024-09-12T18:36:53.395 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.395 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.395 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:53.395 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272607+0000", 2024-09-12T18:36:53.395 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012679466 2024-09-12T18:36:53.395 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.395 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.395 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:53.396 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272681+0000", 2024-09-12T18:36:53.396 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3580999999999999e-05 2024-09-12T18:36:53.396 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.396 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.396 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:53.396 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272733+0000", 2024-09-12T18:36:53.396 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2432999999999998e-05 2024-09-12T18:36:53.396 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:53.396 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:53.396 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:53.396 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.396 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.396 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121148 5.4 5:2a9bde06:::benchmark_data_smithi073_23739_object121147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:53.396 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.281423+0000", 2024-09-12T18:36:53.397 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 13.013425227999999, 2024-09-12T18:36:53.397 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025774785000000001, 2024-09-12T18:36:53.397 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:53.397 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:53.397 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:53.397 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:53.397 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:53.397 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:53.397 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121148 2024-09-12T18:36:53.397 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.397 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:53.397 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.398 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:53.398 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281423+0000", 2024-09-12T18:36:53.398 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:53.398 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.398 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.398 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:53.398 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281423+0000", 2024-09-12T18:36:53.398 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:53.398 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.398 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.398 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:53.398 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281424+0000", 2024-09-12T18:36:53.398 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.048e-06 2024-09-12T18:36:53.398 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.399 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.399 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:53.399 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281496+0000", 2024-09-12T18:36:53.399 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2099000000000002e-05 2024-09-12T18:36:53.399 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.399 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.399 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:53.399 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281509+0000", 2024-09-12T18:36:53.399 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3379e-05 2024-09-12T18:36:53.399 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.399 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.399 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:53.399 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281515+0000", 2024-09-12T18:36:53.399 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.28e-06 2024-09-12T18:36:53.400 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.400 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.400 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:53.400 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281688+0000", 2024-09-12T18:36:53.400 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00017203100000000001 2024-09-12T18:36:53.400 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.400 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.400 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:53.400 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281834+0000", 2024-09-12T18:36:53.400 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014645899999999999 2024-09-12T18:36:53.400 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.400 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.400 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:53.400 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.282319+0000", 2024-09-12T18:36:53.401 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048535000000000001 2024-09-12T18:36:53.401 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.401 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.401 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:53.401 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307086+0000", 2024-09-12T18:36:53.401 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024766989999999999 2024-09-12T18:36:53.401 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.401 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.401 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:53.401 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307108+0000", 2024-09-12T18:36:53.402 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1795999999999999e-05 2024-09-12T18:36:53.402 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.402 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.402 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:53.402 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307157+0000", 2024-09-12T18:36:53.402 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8729000000000001e-05 2024-09-12T18:36:53.402 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.402 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.402 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:53.402 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307197+0000", 2024-09-12T18:36:53.402 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0624000000000003e-05 2024-09-12T18:36:53.402 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:53.402 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:53.402 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:53.403 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.403 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.403 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121155 5.4 5:2af257d1:::benchmark_data_smithi073_23739_object121154:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:53.403 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.283163+0000", 2024-09-12T18:36:53.403 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 13.011684553, 2024-09-12T18:36:53.403 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024186485000000001, 2024-09-12T18:36:53.403 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:53.403 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:53.403 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:53.403 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:53.403 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:53.403 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:53.403 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121155 2024-09-12T18:36:53.403 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.404 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:53.404 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.404 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:53.404 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283163+0000", 2024-09-12T18:36:53.404 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:53.404 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.404 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.404 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:53.404 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283163+0000", 2024-09-12T18:36:53.404 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:53.404 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.404 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.404 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:53.405 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283165+0000", 2024-09-12T18:36:53.405 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.748e-06 2024-09-12T18:36:53.405 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.405 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.405 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:53.405 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283218+0000", 2024-09-12T18:36:53.405 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2695000000000003e-05 2024-09-12T18:36:53.405 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.405 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.405 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:53.405 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283244+0000", 2024-09-12T18:36:53.405 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6072e-05 2024-09-12T18:36:53.405 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.406 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.406 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:53.406 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283257+0000", 2024-09-12T18:36:53.406 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3054000000000001e-05 2024-09-12T18:36:53.406 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.406 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.406 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:53.406 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.294509+0000", 2024-09-12T18:36:53.406 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011251677999999999 2024-09-12T18:36:53.406 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.406 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.406 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:53.406 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.294705+0000", 2024-09-12T18:36:53.406 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000196369 2024-09-12T18:36:53.407 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.407 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.407 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:53.407 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.294907+0000", 2024-09-12T18:36:53.407 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020184700000000001 2024-09-12T18:36:53.407 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.407 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.407 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:53.407 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307208+0000", 2024-09-12T18:36:53.407 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012301068 2024-09-12T18:36:53.407 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.407 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.407 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:53.408 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307273+0000", 2024-09-12T18:36:53.408 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5611000000000006e-05 2024-09-12T18:36:53.408 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.408 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.408 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:53.408 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307320+0000", 2024-09-12T18:36:53.408 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6220999999999997e-05 2024-09-12T18:36:53.408 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.408 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.408 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:53.408 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307350+0000", 2024-09-12T18:36:53.408 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0122000000000001e-05 2024-09-12T18:36:53.408 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:53.408 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:53.409 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:53.409 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.409 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.409 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121160 5.b 5:d4730c8e:::benchmark_data_smithi073_23739_object121159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:53.409 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.289262+0000", 2024-09-12T18:36:53.409 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 13.005585537, 2024-09-12T18:36:53.409 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024618870000000001, 2024-09-12T18:36:53.409 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:53.409 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:53.409 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:53.409 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:53.409 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:53.409 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:53.410 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121160 2024-09-12T18:36:53.410 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.410 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:53.410 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.410 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:53.410 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289262+0000", 2024-09-12T18:36:53.410 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:53.410 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.410 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.410 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:53.410 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289262+0000", 2024-09-12T18:36:53.410 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:53.410 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.411 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.411 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:53.411 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289264+0000", 2024-09-12T18:36:53.411 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.945e-06 2024-09-12T18:36:53.411 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.411 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.411 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:53.411 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289331+0000", 2024-09-12T18:36:53.411 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6594999999999995e-05 2024-09-12T18:36:53.411 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.411 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.411 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:53.411 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289359+0000", 2024-09-12T18:36:53.411 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7988999999999999e-05 2024-09-12T18:36:53.412 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.412 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.412 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:53.412 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289375+0000", 2024-09-12T18:36:53.412 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5639000000000001e-05 2024-09-12T18:36:53.412 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.412 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.412 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:53.412 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289515+0000", 2024-09-12T18:36:53.412 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000140254 2024-09-12T18:36:53.412 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.412 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.412 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:53.412 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289740+0000", 2024-09-12T18:36:53.413 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022513500000000001 2024-09-12T18:36:53.413 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.413 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.413 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:53.413 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.290232+0000", 2024-09-12T18:36:53.413 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00049247500000000003 2024-09-12T18:36:53.413 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.413 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.413 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:53.413 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.312221+0000", 2024-09-12T18:36:53.413 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.021988939999999998 2024-09-12T18:36:53.413 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.414 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.414 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:53.414 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.313807+0000", 2024-09-12T18:36:53.414 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015859100000000001 2024-09-12T18:36:53.414 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.414 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.414 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:53.414 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.313852+0000", 2024-09-12T18:36:53.414 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4305999999999999e-05 2024-09-12T18:36:53.414 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.414 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.414 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:53.414 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.313881+0000", 2024-09-12T18:36:53.414 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9682000000000001e-05 2024-09-12T18:36:53.415 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:53.415 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:53.415 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:53.415 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.415 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.415 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:131551 5.d 5:b8f8c77a:::benchmark_data_smithi073_23739_object131550:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:36:53.415 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:45.499878+0000", 2024-09-12T18:36:53.415 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 7.7949696060000004, 2024-09-12T18:36:53.415 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.027478433, 2024-09-12T18:36:53.415 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:53.415 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:53.415 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:53.415 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:53.415 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:53.416 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:53.416 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 131551 2024-09-12T18:36:53.416 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.416 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:53.416 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.416 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:53.416 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499878+0000", 2024-09-12T18:36:53.416 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:53.416 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.416 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.416 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:53.416 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499878+0000", 2024-09-12T18:36:53.417 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:53.417 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.417 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.417 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:53.417 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499879+0000", 2024-09-12T18:36:53.417 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.92e-07 2024-09-12T18:36:53.417 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.417 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.417 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:53.417 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499946+0000", 2024-09-12T18:36:53.417 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6712999999999996e-05 2024-09-12T18:36:53.417 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.417 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.417 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:53.418 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499953+0000", 2024-09-12T18:36:53.418 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5519999999999999e-06 2024-09-12T18:36:53.418 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.418 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.418 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:53.418 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499959+0000", 2024-09-12T18:36:53.418 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0430000000000004e-06 2024-09-12T18:36:53.418 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.418 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.418 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:53.418 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.500004+0000", 2024-09-12T18:36:53.418 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5058000000000001e-05 2024-09-12T18:36:53.418 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.418 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.419 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:53.419 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.500121+0000", 2024-09-12T18:36:53.419 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000116747 2024-09-12T18:36:53.419 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.419 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.419 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:53.419 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.500283+0000", 2024-09-12T18:36:53.419 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016190599999999999 2024-09-12T18:36:53.419 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.419 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.419 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:53.419 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.504017+0000", 2024-09-12T18:36:53.419 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003734125 2024-09-12T18:36:53.419 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.420 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.420 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:53.420 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.527224+0000", 2024-09-12T18:36:53.420 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.023206724000000001 2024-09-12T18:36:53.420 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.420 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.420 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:53.420 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.527290+0000", 2024-09-12T18:36:53.420 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5778999999999995e-05 2024-09-12T18:36:53.420 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.420 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.420 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:53.420 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.527357+0000", 2024-09-12T18:36:53.421 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7094000000000005e-05 2024-09-12T18:36:53.421 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:53.421 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:53.421 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:53.421 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.421 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.421 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:131556 5.0 5:01fc649a:::benchmark_data_smithi073_23739_object131555:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:36:53.421 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:45.502449+0000", 2024-09-12T18:36:53.421 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 7.7923992330000003, 2024-09-12T18:36:53.421 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.022597466, 2024-09-12T18:36:53.421 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:53.421 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:53.421 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:53.422 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:53.422 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:53.422 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:53.422 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 131556 2024-09-12T18:36:53.422 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.422 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:53.422 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.422 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:53.422 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502449+0000", 2024-09-12T18:36:53.422 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:53.422 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.422 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.422 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:53.422 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502449+0000", 2024-09-12T18:36:53.423 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:53.423 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.423 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.423 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:53.423 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502449+0000", 2024-09-12T18:36:53.423 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.15e-07 2024-09-12T18:36:53.423 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.423 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.423 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:53.423 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502481+0000", 2024-09-12T18:36:53.423 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1671999999999998e-05 2024-09-12T18:36:53.423 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.423 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.423 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:53.424 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502487+0000", 2024-09-12T18:36:53.424 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5270000000000004e-06 2024-09-12T18:36:53.424 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.424 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.424 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:53.424 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502492+0000", 2024-09-12T18:36:53.424 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0590000000000002e-06 2024-09-12T18:36:53.424 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.424 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.424 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:53.424 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502957+0000", 2024-09-12T18:36:53.424 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00046515 2024-09-12T18:36:53.424 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.424 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.425 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:53.425 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.503100+0000", 2024-09-12T18:36:53.425 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000142886 2024-09-12T18:36:53.425 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.425 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.425 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0,2", 2024-09-12T18:36:53.425 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.503268+0000", 2024-09-12T18:36:53.425 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016746299999999999 2024-09-12T18:36:53.425 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.425 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.425 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:53.425 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.506821+0000", 2024-09-12T18:36:53.425 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035528640000000002 2024-09-12T18:36:53.425 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.426 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.426 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:53.426 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.507126+0000", 2024-09-12T18:36:53.426 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030543399999999999 2024-09-12T18:36:53.426 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.426 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.426 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:53.426 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.524851+0000", 2024-09-12T18:36:53.426 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017724521999999999 2024-09-12T18:36:53.426 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.426 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.426 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:53.426 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.524920+0000", 2024-09-12T18:36:53.427 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9386000000000003e-05 2024-09-12T18:36:53.427 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.427 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.427 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:53.427 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.525046+0000", 2024-09-12T18:36:53.427 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000126088 2024-09-12T18:36:53.427 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:53.427 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:53.427 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:53.427 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.427 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.427 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:131557 5.0 5:0bc216b5:::benchmark_data_smithi073_23739_object131556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:36:53.427 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:45.502523+0000", 2024-09-12T18:36:53.427 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 7.7923249610000003, 2024-09-12T18:36:53.428 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024077715, 2024-09-12T18:36:53.428 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:53.428 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:53.428 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:53.428 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:53.428 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:53.428 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:53.428 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 131557 2024-09-12T18:36:53.428 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.428 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:53.428 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.428 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:53.428 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502523+0000", 2024-09-12T18:36:53.429 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:53.429 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.429 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.429 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:53.429 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502523+0000", 2024-09-12T18:36:53.429 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:53.429 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.429 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.429 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:53.429 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502523+0000", 2024-09-12T18:36:53.429 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3200000000000005e-07 2024-09-12T18:36:53.429 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.429 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.429 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:53.430 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502601+0000", 2024-09-12T18:36:53.430 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7344999999999999e-05 2024-09-12T18:36:53.430 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.430 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.430 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:53.430 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502611+0000", 2024-09-12T18:36:53.430 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0407999999999999e-05 2024-09-12T18:36:53.431 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.431 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.432 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:53.432 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502615+0000", 2024-09-12T18:36:53.432 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6739999999999999e-06 2024-09-12T18:36:53.432 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.432 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.432 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:53.432 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.505138+0000", 2024-09-12T18:36:53.432 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025231709999999998 2024-09-12T18:36:53.432 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.432 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.432 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:53.432 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.505244+0000", 2024-09-12T18:36:53.432 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000106006 2024-09-12T18:36:53.433 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.433 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.433 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0,2", 2024-09-12T18:36:53.433 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.505357+0000", 2024-09-12T18:36:53.433 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000113038 2024-09-12T18:36:53.433 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.433 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.433 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:53.433 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.507393+0000", 2024-09-12T18:36:53.433 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020356269999999999 2024-09-12T18:36:53.433 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.433 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.433 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:53.433 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.508538+0000", 2024-09-12T18:36:53.434 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001145016 2024-09-12T18:36:53.434 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.434 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.434 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:53.434 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.526436+0000", 2024-09-12T18:36:53.434 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017898121999999999 2024-09-12T18:36:53.434 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.434 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.434 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:53.434 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.526500+0000", 2024-09-12T18:36:53.434 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.3954999999999993e-05 2024-09-12T18:36:53.434 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:53.434 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:53.434 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:53.435 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.526601+0000", 2024-09-12T18:36:53.435 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000100821 2024-09-12T18:36:53.435 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:53.435 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:53.435 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:53.435 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:53.435 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:53.435 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:53.437 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:36:53.437 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:53.430+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:53.537 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:53.531+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:53.600 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:36:53.600 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:36:53.600 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.600 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:147415 5.2 5:4fc71a52:::benchmark_data_smithi073_23739_object15138:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T18:36:53.600 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:53.593432+0000", 2024-09-12T18:36:53.601 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0049661590000000004, 2024-09-12T18:36:53.601 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0049897589999999999, 2024-09-12T18:36:53.601 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:53.601 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:53.601 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:53.601 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:53.601 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:53.601 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:53.601 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 147415 2024-09-12T18:36:53.601 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.601 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:53.602 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.602 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:53.602 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.593432+0000", 2024-09-12T18:36:53.602 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:53.602 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.602 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.602 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:53.602 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.593432+0000", 2024-09-12T18:36:53.602 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:53.602 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.602 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.602 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:53.602 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.593433+0000", 2024-09-12T18:36:53.603 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.353e-06 2024-09-12T18:36:53.603 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.603 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.603 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:53.603 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.593439+0000", 2024-09-12T18:36:53.603 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4349999999999996e-06 2024-09-12T18:36:53.603 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.603 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.603 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:53.603 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.593449+0000", 2024-09-12T18:36:53.603 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.91e-06 2024-09-12T18:36:53.603 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.603 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.603 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:53.604 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.593456+0000", 2024-09-12T18:36:53.604 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.4549999999999998e-06 2024-09-12T18:36:53.604 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.604 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.604 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:53.604 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.593510+0000", 2024-09-12T18:36:53.604 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3767999999999997e-05 2024-09-12T18:36:53.604 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.604 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.604 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:53.604 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.593614+0000", 2024-09-12T18:36:53.604 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000103923 2024-09-12T18:36:53.604 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.605 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.605 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:53.605 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.593700+0000", 2024-09-12T18:36:53.605 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.6044000000000005e-05 2024-09-12T18:36:53.605 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.605 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.605 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:53.605 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.597515+0000", 2024-09-12T18:36:53.605 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0038149439999999998 2024-09-12T18:36:53.605 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:53.605 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:53.605 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:53.605 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.606 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.606 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:147416 5.c e55/21 5:3b5775cc:::benchmark_data_smithi073_23739_object15139:head v 55'9181, mlcod=55'9179)", 2024-09-12T18:36:53.606 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:53.594986+0000", 2024-09-12T18:36:53.606 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0034124680000000001, 2024-09-12T18:36:53.606 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003518387, 2024-09-12T18:36:53.606 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:53.606 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:53.606 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:53.606 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:53.606 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.606 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:53.606 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.594986+0000", 2024-09-12T18:36:53.606 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:53.606 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.607 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.607 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:53.607 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.594986+0000", 2024-09-12T18:36:53.607 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:53.607 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.607 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.607 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:53.607 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.594986+0000", 2024-09-12T18:36:53.607 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2099999999999996e-07 2024-09-12T18:36:53.607 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.607 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.607 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:53.607 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.595001+0000", 2024-09-12T18:36:53.607 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5118e-05 2024-09-12T18:36:53.608 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.608 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.608 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:53.608 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.595011+0000", 2024-09-12T18:36:53.608 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9820000000000003e-06 2024-09-12T18:36:53.608 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.608 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.608 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:53.608 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.595017+0000", 2024-09-12T18:36:53.608 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.1240000000000002e-06 2024-09-12T18:36:53.608 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.608 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.608 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:53.609 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.595090+0000", 2024-09-12T18:36:53.609 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2968999999999999e-05 2024-09-12T18:36:53.609 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.609 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.609 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:53.609 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.595115+0000", 2024-09-12T18:36:53.609 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.4547999999999999e-05 2024-09-12T18:36:53.609 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:53.609 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:53.609 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:53.609 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.609 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.609 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:147419 5.5 5:aae106b7:::benchmark_data_smithi073_23739_object15142:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T18:36:53.609 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:53.595354+0000", 2024-09-12T18:36:53.610 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.003044227, 2024-09-12T18:36:53.610 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0032084190000000001, 2024-09-12T18:36:53.610 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:53.610 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:53.610 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:53.610 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:53.610 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:53.610 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:53.610 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 147419 2024-09-12T18:36:53.610 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.610 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:53.610 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.610 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:53.610 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.595354+0000", 2024-09-12T18:36:53.611 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:53.611 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.611 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.611 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:53.611 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.595354+0000", 2024-09-12T18:36:53.611 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:53.611 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.611 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.611 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:53.611 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.595355+0000", 2024-09-12T18:36:53.611 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.9800000000000003e-07 2024-09-12T18:36:53.611 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.611 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.611 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:53.611 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.595358+0000", 2024-09-12T18:36:53.612 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.8120000000000001e-06 2024-09-12T18:36:53.612 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.612 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.612 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:53.612 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.595377+0000", 2024-09-12T18:36:53.612 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.8734999999999999e-05 2024-09-12T18:36:53.612 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.612 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.612 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:53.612 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.595384+0000", 2024-09-12T18:36:53.612 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.8170000000000001e-06 2024-09-12T18:36:53.612 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.612 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.612 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:53.613 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.596723+0000", 2024-09-12T18:36:53.613 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001338889 2024-09-12T18:36:53.613 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.613 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.613 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:53.613 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.596798+0000", 2024-09-12T18:36:53.613 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.4725e-05 2024-09-12T18:36:53.613 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.613 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.613 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:36:53.613 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.596882+0000", 2024-09-12T18:36:53.613 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4128999999999994e-05 2024-09-12T18:36:53.613 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:53.613 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:53.614 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:53.614 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.614 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.614 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:147420 5.2 5:4c18be8e:::benchmark_data_smithi073_23739_object15143:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T18:36:53.614 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:53.595426+0000", 2024-09-12T18:36:53.614 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0029723029999999999, 2024-09-12T18:36:53.614 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003203802, 2024-09-12T18:36:53.614 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:53.614 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:53.614 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:53.614 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:53.614 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:53.614 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:53.615 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 147420 2024-09-12T18:36:53.615 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.615 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:53.615 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.615 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:53.615 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.595426+0000", 2024-09-12T18:36:53.615 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:53.615 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.615 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.615 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:53.615 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.595426+0000", 2024-09-12T18:36:53.615 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:53.615 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.615 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.616 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:53.616 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.595426+0000", 2024-09-12T18:36:53.616 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.7199999999999998e-07 2024-09-12T18:36:53.616 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.616 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.616 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:53.616 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.595430+0000", 2024-09-12T18:36:53.616 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.377e-06 2024-09-12T18:36:53.616 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.616 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.616 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:53.616 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.595438+0000", 2024-09-12T18:36:53.616 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.3450000000000006e-06 2024-09-12T18:36:53.616 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.617 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.617 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:53.617 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.595444+0000", 2024-09-12T18:36:53.617 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.784e-06 2024-09-12T18:36:53.617 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.617 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.617 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:53.617 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.595505+0000", 2024-09-12T18:36:53.617 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.0838999999999998e-05 2024-09-12T18:36:53.617 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.618 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.618 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:53.618 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.595620+0000", 2024-09-12T18:36:53.618 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000114919 2024-09-12T18:36:53.618 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.618 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.618 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:53.618 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.595725+0000", 2024-09-12T18:36:53.618 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000104928 2024-09-12T18:36:53.618 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.618 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.618 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:53.618 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.598612+0000", 2024-09-12T18:36:53.618 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028874740000000001 2024-09-12T18:36:53.619 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:53.619 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:53.619 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:53.619 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.619 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.619 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop_reply(client.4480.0:147409 5.5 e55/49 ondisk, result = 0)", 2024-09-12T18:36:53.619 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:53.597019+0000", 2024-09-12T18:36:53.619 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0013793740000000001, 2024-09-12T18:36:53.619 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001683026, 2024-09-12T18:36:53.619 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:53.619 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:53.619 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:53.619 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:53.620 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.620 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:53.620 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.597019+0000", 2024-09-12T18:36:53.620 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:53.620 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.620 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.620 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:53.620 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.597019+0000", 2024-09-12T18:36:53.620 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:53.620 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.620 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.620 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:53.620 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.597019+0000", 2024-09-12T18:36:53.621 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.3299999999999998e-07 2024-09-12T18:36:53.621 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.621 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.621 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:53.621 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.597021+0000", 2024-09-12T18:36:53.621 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.367e-06 2024-09-12T18:36:53.621 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.621 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.621 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:53.621 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.597028+0000", 2024-09-12T18:36:53.621 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.861e-06 2024-09-12T18:36:53.622 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.622 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.622 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:53.622 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.597033+0000", 2024-09-12T18:36:53.622 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.7979999999999996e-06 2024-09-12T18:36:53.622 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.622 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.622 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:53.622 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.598685+0000", 2024-09-12T18:36:53.622 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0016517560000000001 2024-09-12T18:36:53.622 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.622 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.622 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:53.623 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.598692+0000", 2024-09-12T18:36:53.623 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.6120000000000001e-06 2024-09-12T18:36:53.623 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:53.623 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:53.623 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:53.623 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.623 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.623 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:147421 5.5 5.41f9f245 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T18:36:53.623 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:53.597535+0000", 2024-09-12T18:36:53.623 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.00086295499999999999, 2024-09-12T18:36:53.623 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0012202789999999999, 2024-09-12T18:36:53.623 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:53.623 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:53.624 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:53.624 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:53.624 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:53.624 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:53.624 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 147421 2024-09-12T18:36:53.624 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.624 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:53.624 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.624 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:53.624 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.597535+0000", 2024-09-12T18:36:53.624 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:53.624 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.624 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.624 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:53.625 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.597535+0000", 2024-09-12T18:36:53.625 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:53.625 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.625 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.625 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:53.625 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.597536+0000", 2024-09-12T18:36:53.625 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0720000000000001e-06 2024-09-12T18:36:53.625 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.625 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.625 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:53.625 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.597541+0000", 2024-09-12T18:36:53.625 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6999999999999999e-06 2024-09-12T18:36:53.625 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.626 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.626 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:53.626 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.597551+0000", 2024-09-12T18:36:53.626 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0539e-05 2024-09-12T18:36:53.626 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.626 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.626 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:53.626 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.597559+0000", 2024-09-12T18:36:53.626 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.4630000000000004e-06 2024-09-12T18:36:53.626 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:53.626 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:53.626 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:53.626 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.626 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.627 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:147423 5.f 5:f4f026c1:::benchmark_data_smithi073_23739_object15146:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T18:36:53.627 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:53.597996+0000", 2024-09-12T18:36:53.627 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.000402092, 2024-09-12T18:36:53.627 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00081010900000000005, 2024-09-12T18:36:53.627 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:53.627 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:53.627 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:53.627 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:53.627 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:53.627 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:53.627 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 147423 2024-09-12T18:36:53.627 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.627 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:53.628 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.628 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:53.628 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.597996+0000", 2024-09-12T18:36:53.628 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:53.628 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.628 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.628 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:53.628 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.597996+0000", 2024-09-12T18:36:53.628 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:53.628 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.628 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.628 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:53.628 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.597997+0000", 2024-09-12T18:36:53.628 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.6000000000000003e-07 2024-09-12T18:36:53.629 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.629 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.629 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:53.629 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.598001+0000", 2024-09-12T18:36:53.629 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.3390000000000003e-06 2024-09-12T18:36:53.629 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.629 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.629 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:53.629 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.598011+0000", 2024-09-12T18:36:53.629 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.8290000000000003e-06 2024-09-12T18:36:53.629 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.629 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.629 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:53.631 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.598017+0000", 2024-09-12T18:36:53.631 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.3790000000000003e-06 2024-09-12T18:36:53.632 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.632 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.632 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:53.632 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.598381+0000", 2024-09-12T18:36:53.632 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00036376600000000001 2024-09-12T18:36:53.632 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.632 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.632 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:53.632 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.598497+0000", 2024-09-12T18:36:53.632 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000116316 2024-09-12T18:36:53.632 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.632 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.632 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:53.633 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.598620+0000", 2024-09-12T18:36:53.633 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012306700000000001 2024-09-12T18:36:53.633 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:53.633 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:53.633 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:53.633 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.633 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.633 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:147424 5.d e55/21 5:b36f13c2:::benchmark_data_smithi073_23739_object15147:head v 55'9341, mlcod=55'9338)", 2024-09-12T18:36:53.633 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:53.598335+0000", 2024-09-12T18:36:53.633 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 6.2922999999999994e-05, 2024-09-12T18:36:53.633 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00053333899999999997, 2024-09-12T18:36:53.633 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:53.633 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:53.633 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:53.634 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:53.634 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.634 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:53.634 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.598335+0000", 2024-09-12T18:36:53.634 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:53.634 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.634 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.634 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:53.634 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.598335+0000", 2024-09-12T18:36:53.634 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:53.634 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.634 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.634 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:53.635 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.598336+0000", 2024-09-12T18:36:53.635 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.92e-07 2024-09-12T18:36:53.635 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.635 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.635 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:53.635 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.598340+0000", 2024-09-12T18:36:53.635 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.3340000000000003e-06 2024-09-12T18:36:53.635 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.635 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.635 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:53.635 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.598349+0000", 2024-09-12T18:36:53.635 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.3620000000000006e-06 2024-09-12T18:36:53.635 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.635 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.636 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:53.636 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.598353+0000", 2024-09-12T18:36:53.636 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8620000000000002e-06 2024-09-12T18:36:53.636 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.636 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.636 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:53.636 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.598668+0000", 2024-09-12T18:36:53.636 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031454600000000002 2024-09-12T18:36:53.636 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.636 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.636 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:53.636 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.598686+0000", 2024-09-12T18:36:53.636 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7822999999999999e-05 2024-09-12T18:36:53.637 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:53.637 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:53.637 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:53.637 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.637 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.637 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:147411 5.d e55/21 5:b9be8d80:::benchmark_data_smithi073_23739_object15134:head v 55'9340, mlcod=55'9336)", 2024-09-12T18:36:53.637 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:53.592619+0000", 2024-09-12T18:36:53.637 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0057786790000000001, 2024-09-12T18:36:53.637 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0062970209999999999, 2024-09-12T18:36:53.637 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:53.637 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:53.637 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:53.637 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:53.637 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.638 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:53.638 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.592619+0000", 2024-09-12T18:36:53.638 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:53.638 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.638 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.638 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:53.638 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.592619+0000", 2024-09-12T18:36:53.638 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:53.638 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.638 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.638 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:53.638 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.592620+0000", 2024-09-12T18:36:53.638 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8400000000000005e-07 2024-09-12T18:36:53.638 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.639 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.639 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:53.639 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.592625+0000", 2024-09-12T18:36:53.639 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.95e-06 2024-09-12T18:36:53.639 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.639 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.639 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:53.639 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.592634+0000", 2024-09-12T18:36:53.639 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.9959999999999999e-06 2024-09-12T18:36:53.639 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.639 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.639 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:53.639 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.592641+0000", 2024-09-12T18:36:53.640 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.153e-06 2024-09-12T18:36:53.640 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.640 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.640 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:53.640 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.595053+0000", 2024-09-12T18:36:53.640 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0024118049999999999 2024-09-12T18:36:53.640 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:53.640 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:53.640 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:53.640 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:53.595073+0000", 2024-09-12T18:36:53.640 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9822000000000001e-05 2024-09-12T18:36:53.640 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:53.640 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:53.640 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:53.641 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:53.641 INFO:teuthology.orchestra.run.smithi162.stdout: ], 2024-09-12T18:36:53.641 INFO:teuthology.orchestra.run.smithi162.stdout: "num_ops": 9 2024-09-12T18:36:53.641 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:36:53.642 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:36:53.643 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:53.639+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:53.743 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:53.739+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:53.843 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:53.838+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:53.845 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:36:53.845 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [], 2024-09-12T18:36:53.845 INFO:teuthology.orchestra.run.smithi162.stdout: "complaint_time": 30, 2024-09-12T18:36:53.846 INFO:teuthology.orchestra.run.smithi162.stdout: "num_blocked_ops": 0 2024-09-12T18:36:53.846 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:36:53.868 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:36:53.944 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:53.938+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:54.034 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:36:54.034 INFO:teuthology.orchestra.run.smithi162.stdout: "size": 20, 2024-09-12T18:36:54.034 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 600, 2024-09-12T18:36:54.034 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:36:54.034 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.034 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4154.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:36:54.034 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:36:54.035 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 100.054223693, 2024-09-12T18:36:54.035 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025950709999999998, 2024-09-12T18:36:54.035 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:54.035 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:54.035 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:54.035 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:54.035 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4154", 2024-09-12T18:36:54.035 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/745129001", 2024-09-12T18:36:54.035 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 124 2024-09-12T18:36:54.035 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.035 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:54.035 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.035 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:54.035 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:36:54.036 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:54.036 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.036 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.036 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:54.036 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:36:54.036 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:54.036 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.036 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.036 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:54.036 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976562+0000", 2024-09-12T18:36:54.036 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.2999999999999999e-07 2024-09-12T18:36:54.036 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.036 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.037 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:54.037 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976567+0000", 2024-09-12T18:36:54.037 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3430000000000003e-06 2024-09-12T18:36:54.037 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.037 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.037 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:54.037 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976576+0000", 2024-09-12T18:36:54.037 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8070000000000006e-06 2024-09-12T18:36:54.037 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.037 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.037 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:54.037 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976583+0000", 2024-09-12T18:36:54.037 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9959999999999996e-06 2024-09-12T18:36:54.037 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.038 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.038 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:54.038 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997107+0000", 2024-09-12T18:36:54.038 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.020524106 2024-09-12T18:36:54.038 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.038 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.038 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:54.038 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997225+0000", 2024-09-12T18:36:54.038 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000117909 2024-09-12T18:36:54.038 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.038 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.038 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:54.038 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997407+0000", 2024-09-12T18:36:54.039 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00018175900000000001 2024-09-12T18:36:54.039 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.039 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.039 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:54.039 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998839+0000", 2024-09-12T18:36:54.039 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001432539 2024-09-12T18:36:54.039 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.039 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.039 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:54.039 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002319+0000", 2024-09-12T18:36:54.039 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0034803529999999998 2024-09-12T18:36:54.039 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.039 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.040 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:54.040 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002405+0000", 2024-09-12T18:36:54.040 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5434999999999998e-05 2024-09-12T18:36:54.040 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.040 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.040 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:54.040 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002512+0000", 2024-09-12T18:36:54.040 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010663299999999999 2024-09-12T18:36:54.040 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:54.040 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:54.040 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:54.040 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.040 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.041 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:54.041 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:36:54.041 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 88.389426185999994, 2024-09-12T18:36:54.041 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025127867000000002, 2024-09-12T18:36:54.041 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:54.041 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:54.041 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:54.041 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:54.041 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.041 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:54.041 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:36:54.041 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:54.041 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.042 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.042 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:54.042 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:36:54.042 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:54.042 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.042 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.042 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:54.042 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641362+0000", 2024-09-12T18:36:54.042 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.2569999999999999e-06 2024-09-12T18:36:54.042 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.042 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.043 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:54.044 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641374+0000", 2024-09-12T18:36:54.044 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2696e-05 2024-09-12T18:36:54.044 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.044 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.044 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:54.044 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641403+0000", 2024-09-12T18:36:54.044 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.8756999999999999e-05 2024-09-12T18:36:54.044 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.044 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.044 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:54.044 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641430+0000", 2024-09-12T18:36:54.044 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.6452999999999999e-05 2024-09-12T18:36:54.044 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.045 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.045 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:54.045 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641585+0000", 2024-09-12T18:36:54.045 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000155799 2024-09-12T18:36:54.045 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.045 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.045 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:54.045 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641753+0000", 2024-09-12T18:36:54.045 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000167868 2024-09-12T18:36:54.045 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.045 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.045 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:54.045 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641916+0000", 2024-09-12T18:36:54.045 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000162903 2024-09-12T18:36:54.046 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.046 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.046 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:54.046 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653655+0000", 2024-09-12T18:36:54.046 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011738879000000001 2024-09-12T18:36:54.046 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.046 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.046 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:54.046 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665515+0000", 2024-09-12T18:36:54.046 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011859915 2024-09-12T18:36:54.046 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.046 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.046 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:54.047 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665646+0000", 2024-09-12T18:36:54.047 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013122599999999999 2024-09-12T18:36:54.047 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.047 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.047 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:54.047 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666486+0000", 2024-09-12T18:36:54.047 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00084011399999999999 2024-09-12T18:36:54.047 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:54.047 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:54.047 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:54.047 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.047 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.048 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:54.048 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:36:54.048 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 88.389311723000006, 2024-09-12T18:36:54.048 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025384584000000002, 2024-09-12T18:36:54.048 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:54.048 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:54.048 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:54.048 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:54.048 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.048 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:54.048 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:36:54.048 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:54.048 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.048 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.049 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:54.049 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:36:54.049 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:54.049 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.049 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.049 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:54.049 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641474+0000", 2024-09-12T18:36:54.049 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.39e-06 2024-09-12T18:36:54.049 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.049 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.049 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:54.049 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641482+0000", 2024-09-12T18:36:54.049 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3499999999999999e-06 2024-09-12T18:36:54.050 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.050 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.050 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:54.050 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641534+0000", 2024-09-12T18:36:54.050 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2533e-05 2024-09-12T18:36:54.050 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.050 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.050 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:54.050 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641551+0000", 2024-09-12T18:36:54.050 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6515999999999999e-05 2024-09-12T18:36:54.050 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.050 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.050 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:54.051 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642630+0000", 2024-09-12T18:36:54.051 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001079705 2024-09-12T18:36:54.051 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.051 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.051 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:54.051 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642909+0000", 2024-09-12T18:36:54.051 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027859800000000002 2024-09-12T18:36:54.051 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.051 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.051 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:54.051 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643137+0000", 2024-09-12T18:36:54.051 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022803799999999999 2024-09-12T18:36:54.051 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.052 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.052 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:54.052 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653669+0000", 2024-09-12T18:36:54.052 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010532032 2024-09-12T18:36:54.052 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.052 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.052 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:54.052 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666624+0000", 2024-09-12T18:36:54.052 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012954940999999999 2024-09-12T18:36:54.052 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.052 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.052 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:54.053 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666762+0000", 2024-09-12T18:36:54.053 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000137668 2024-09-12T18:36:54.053 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.053 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.053 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:54.053 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666857+0000", 2024-09-12T18:36:54.053 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.5812999999999999e-05 2024-09-12T18:36:54.053 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:54.053 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:54.053 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:54.053 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.053 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.054 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:54.054 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:36:54.054 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 88.389183927999994, 2024-09-12T18:36:54.054 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025661562999999998, 2024-09-12T18:36:54.054 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:54.054 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:54.054 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:54.054 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:54.054 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.054 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:54.054 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:36:54.054 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:54.055 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.055 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.055 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:54.055 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:36:54.055 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:54.055 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.055 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.055 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:54.055 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641602+0000", 2024-09-12T18:36:54.055 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3540000000000001e-06 2024-09-12T18:36:54.055 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.055 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.055 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:54.056 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641637+0000", 2024-09-12T18:36:54.056 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5145999999999999e-05 2024-09-12T18:36:54.056 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.056 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.056 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:54.056 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641659+0000", 2024-09-12T18:36:54.056 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2249999999999999e-05 2024-09-12T18:36:54.056 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.056 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.056 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:54.056 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641675+0000", 2024-09-12T18:36:54.056 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6059999999999999e-05 2024-09-12T18:36:54.056 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.057 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.057 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:54.057 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644570+0000", 2024-09-12T18:36:54.057 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028947069999999998 2024-09-12T18:36:54.057 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.057 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.057 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:54.057 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644900+0000", 2024-09-12T18:36:54.057 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000329401 2024-09-12T18:36:54.057 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.057 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.057 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:54.057 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645235+0000", 2024-09-12T18:36:54.058 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000335874 2024-09-12T18:36:54.058 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.058 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.058 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:54.058 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655459+0000", 2024-09-12T18:36:54.058 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010223441999999999 2024-09-12T18:36:54.058 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.058 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.058 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:54.058 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667028+0000", 2024-09-12T18:36:54.058 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011568673999999999 2024-09-12T18:36:54.058 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.059 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.059 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:54.059 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667163+0000", 2024-09-12T18:36:54.059 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013525500000000001 2024-09-12T18:36:54.059 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.059 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.059 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:54.059 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667262+0000", 2024-09-12T18:36:54.059 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9400000000000004e-05 2024-09-12T18:36:54.059 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:54.059 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:54.059 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:54.059 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.059 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.059 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:54.060 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:36:54.060 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 88.389082107999997, 2024-09-12T18:36:54.060 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025971339, 2024-09-12T18:36:54.060 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:54.060 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:54.060 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:54.060 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:54.060 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.060 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:54.060 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:36:54.060 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:54.060 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.060 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.061 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:54.061 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:36:54.061 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:54.061 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.061 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.061 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:54.061 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641704+0000", 2024-09-12T18:36:54.061 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.297e-06 2024-09-12T18:36:54.061 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.061 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.061 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:54.061 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641712+0000", 2024-09-12T18:36:54.061 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.9060000000000002e-06 2024-09-12T18:36:54.062 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.062 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.062 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:54.062 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641731+0000", 2024-09-12T18:36:54.062 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9083e-05 2024-09-12T18:36:54.062 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.062 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.062 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:54.062 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641745+0000", 2024-09-12T18:36:54.062 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4066999999999999e-05 2024-09-12T18:36:54.062 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.062 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.062 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:54.062 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646529+0000", 2024-09-12T18:36:54.063 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.004784033 2024-09-12T18:36:54.063 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.063 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.063 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:54.063 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646727+0000", 2024-09-12T18:36:54.063 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019841800000000001 2024-09-12T18:36:54.063 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.063 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.063 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:54.063 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647057+0000", 2024-09-12T18:36:54.063 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032926800000000002 2024-09-12T18:36:54.063 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.063 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.064 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:54.064 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655475+0000", 2024-09-12T18:36:54.064 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0084186250000000008 2024-09-12T18:36:54.064 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.064 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.064 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:54.064 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667424+0000", 2024-09-12T18:36:54.064 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011949257 2024-09-12T18:36:54.064 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.064 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.064 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:54.064 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667573+0000", 2024-09-12T18:36:54.064 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014851900000000001 2024-09-12T18:36:54.064 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.065 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.065 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:54.065 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667674+0000", 2024-09-12T18:36:54.065 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010086600000000001 2024-09-12T18:36:54.065 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:54.065 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:54.065 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:54.065 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.065 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.065 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:54.065 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:36:54.065 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 88.389019719000004, 2024-09-12T18:36:54.065 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026215008000000001, 2024-09-12T18:36:54.066 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:54.066 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:54.066 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:54.066 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:54.066 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.066 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:54.066 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:36:54.066 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:54.066 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.066 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.066 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:54.066 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:36:54.066 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:54.067 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.067 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.067 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:54.067 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641766+0000", 2024-09-12T18:36:54.067 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1200000000000001e-06 2024-09-12T18:36:54.067 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.067 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.067 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:54.067 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641775+0000", 2024-09-12T18:36:54.067 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.2499999999999995e-06 2024-09-12T18:36:54.067 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.067 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.067 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:54.067 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641793+0000", 2024-09-12T18:36:54.068 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7773000000000001e-05 2024-09-12T18:36:54.068 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.068 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.068 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:54.068 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641807+0000", 2024-09-12T18:36:54.068 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3814e-05 2024-09-12T18:36:54.068 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.068 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.068 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:54.068 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647626+0000", 2024-09-12T18:36:54.068 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0058193050000000003 2024-09-12T18:36:54.068 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.068 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.068 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:54.069 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647937+0000", 2024-09-12T18:36:54.069 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031112400000000003 2024-09-12T18:36:54.069 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.069 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.069 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:54.069 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648239+0000", 2024-09-12T18:36:54.069 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00030227500000000002 2024-09-12T18:36:54.069 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.069 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.069 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:54.069 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655487+0000", 2024-09-12T18:36:54.069 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072479129999999999 2024-09-12T18:36:54.069 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.069 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.070 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:54.070 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667823+0000", 2024-09-12T18:36:54.070 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012335505 2024-09-12T18:36:54.070 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.070 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.070 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:54.070 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667908+0000", 2024-09-12T18:36:54.070 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4843000000000001e-05 2024-09-12T18:36:54.070 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.070 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.070 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:54.070 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667980+0000", 2024-09-12T18:36:54.070 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2086000000000001e-05 2024-09-12T18:36:54.070 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:54.070 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:54.071 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:54.071 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.071 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.071 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:54.071 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:36:54.071 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 88.388959565999997, 2024-09-12T18:36:54.071 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026483236, 2024-09-12T18:36:54.071 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:54.071 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:54.071 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:54.072 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:54.072 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.072 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:54.072 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:36:54.072 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:54.072 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.072 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.072 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:54.072 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:36:54.072 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:54.072 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.072 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.072 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:54.073 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641826+0000", 2024-09-12T18:36:54.073 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:36:54.073 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.073 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.073 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:54.073 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641832+0000", 2024-09-12T18:36:54.073 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4199999999999998e-06 2024-09-12T18:36:54.073 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.073 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.073 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:54.073 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641848+0000", 2024-09-12T18:36:54.074 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6492999999999999e-05 2024-09-12T18:36:54.074 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.074 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.074 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:54.074 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641863+0000", 2024-09-12T18:36:54.074 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5427e-05 2024-09-12T18:36:54.074 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.074 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.074 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:54.074 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648887+0000", 2024-09-12T18:36:54.074 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0070230860000000004 2024-09-12T18:36:54.074 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.074 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.074 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:54.074 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649111+0000", 2024-09-12T18:36:54.075 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022425799999999999 2024-09-12T18:36:54.075 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.075 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.075 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:54.075 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649494+0000", 2024-09-12T18:36:54.075 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00038349400000000001 2024-09-12T18:36:54.075 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.075 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.075 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:54.075 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655499+0000", 2024-09-12T18:36:54.075 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0060047260000000002 2024-09-12T18:36:54.075 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.075 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.075 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:54.076 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668110+0000", 2024-09-12T18:36:54.076 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012610543 2024-09-12T18:36:54.076 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.076 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.076 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:54.076 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668252+0000", 2024-09-12T18:36:54.076 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014265600000000001 2024-09-12T18:36:54.076 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.076 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.076 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:54.076 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668308+0000", 2024-09-12T18:36:54.076 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5992999999999997e-05 2024-09-12T18:36:54.076 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:54.076 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:54.077 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:54.077 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.077 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.077 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:54.077 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:36:54.077 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 88.388904350000004, 2024-09-12T18:36:54.077 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026605302000000001, 2024-09-12T18:36:54.077 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:54.077 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:54.077 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:54.077 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:54.077 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.077 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:54.077 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:36:54.077 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:54.078 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.078 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.078 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:54.078 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:36:54.078 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:54.078 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.078 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.078 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:54.078 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641881+0000", 2024-09-12T18:36:54.078 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.057e-06 2024-09-12T18:36:54.078 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.078 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.078 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:54.078 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641887+0000", 2024-09-12T18:36:54.078 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.6629999999999998e-06 2024-09-12T18:36:54.079 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.079 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.079 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:54.079 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641903+0000", 2024-09-12T18:36:54.079 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6317e-05 2024-09-12T18:36:54.079 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.079 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.079 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:54.079 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641917+0000", 2024-09-12T18:36:54.079 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3339999999999999e-05 2024-09-12T18:36:54.079 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.079 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.079 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:54.079 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650708+0000", 2024-09-12T18:36:54.080 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.008791419 2024-09-12T18:36:54.080 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.080 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.080 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:54.080 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651021+0000", 2024-09-12T18:36:54.080 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031296699999999999 2024-09-12T18:36:54.080 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.080 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.080 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:54.080 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651349+0000", 2024-09-12T18:36:54.080 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032796499999999999 2024-09-12T18:36:54.080 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.080 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.081 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:54.081 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655742+0000", 2024-09-12T18:36:54.081 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0043934680000000002 2024-09-12T18:36:54.081 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.081 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.081 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:54.081 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668377+0000", 2024-09-12T18:36:54.081 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012634312999999999 2024-09-12T18:36:54.081 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.081 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.081 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:54.081 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668441+0000", 2024-09-12T18:36:54.081 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4369999999999995e-05 2024-09-12T18:36:54.082 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.082 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.082 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:54.082 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668485+0000", 2024-09-12T18:36:54.082 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4422999999999998e-05 2024-09-12T18:36:54.082 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:54.082 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:54.082 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:54.082 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.082 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.082 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:54.082 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:36:54.082 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 88.388846947000005, 2024-09-12T18:36:54.082 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026919499, 2024-09-12T18:36:54.083 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:54.083 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:54.083 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:54.083 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:54.083 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.083 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:54.083 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:36:54.083 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:54.083 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.083 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.083 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:54.083 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:36:54.083 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:54.084 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.084 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.084 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:54.084 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641939+0000", 2024-09-12T18:36:54.084 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9399999999999993e-07 2024-09-12T18:36:54.084 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.084 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.084 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:54.084 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641945+0000", 2024-09-12T18:36:54.084 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9200000000000001e-06 2024-09-12T18:36:54.084 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.084 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.085 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:54.085 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641961+0000", 2024-09-12T18:36:54.085 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6520000000000001e-05 2024-09-12T18:36:54.085 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.085 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.085 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:54.085 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641974+0000", 2024-09-12T18:36:54.085 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3413e-05 2024-09-12T18:36:54.085 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.085 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.085 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:54.085 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654560+0000", 2024-09-12T18:36:54.085 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012585308999999999 2024-09-12T18:36:54.085 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.086 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.086 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:54.086 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654822+0000", 2024-09-12T18:36:54.086 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026210099999999999 2024-09-12T18:36:54.086 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.086 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.086 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:54.086 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655059+0000", 2024-09-12T18:36:54.086 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00023747899999999999 2024-09-12T18:36:54.086 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.086 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.086 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:54.086 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.656315+0000", 2024-09-12T18:36:54.086 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0012555000000000001 2024-09-12T18:36:54.087 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.087 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.087 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:54.087 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668590+0000", 2024-09-12T18:36:54.087 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012274851999999999 2024-09-12T18:36:54.087 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.087 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.087 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:54.087 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668725+0000", 2024-09-12T18:36:54.087 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013524199999999999 2024-09-12T18:36:54.087 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.087 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.087 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:54.088 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668857+0000", 2024-09-12T18:36:54.088 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013216899999999999 2024-09-12T18:36:54.088 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:54.088 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:54.088 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:54.088 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.088 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.088 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:54.088 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:36:54.088 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 88.388793426999996, 2024-09-12T18:36:54.088 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023616723999999999, 2024-09-12T18:36:54.088 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:54.088 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:54.088 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:54.089 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:54.089 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.089 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:54.089 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:36:54.089 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:54.089 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.089 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.089 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:54.089 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:36:54.089 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:54.089 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.089 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.089 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:54.089 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641992+0000", 2024-09-12T18:36:54.090 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.08e-06 2024-09-12T18:36:54.090 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.090 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.090 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:54.090 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641998+0000", 2024-09-12T18:36:54.090 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4299999999999997e-06 2024-09-12T18:36:54.090 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.090 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.090 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:54.090 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642014+0000", 2024-09-12T18:36:54.090 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6266e-05 2024-09-12T18:36:54.090 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.090 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.090 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:54.090 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642026+0000", 2024-09-12T18:36:54.091 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2567e-05 2024-09-12T18:36:54.091 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.091 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.091 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:54.091 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642213+0000", 2024-09-12T18:36:54.091 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00018701899999999999 2024-09-12T18:36:54.091 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.091 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.091 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:54.091 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642507+0000", 2024-09-12T18:36:54.091 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00029394700000000002 2024-09-12T18:36:54.091 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.091 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.091 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:54.092 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642686+0000", 2024-09-12T18:36:54.092 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000178152 2024-09-12T18:36:54.092 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.092 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.092 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:54.092 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650952+0000", 2024-09-12T18:36:54.092 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0082663570000000002 2024-09-12T18:36:54.092 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.092 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.092 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:54.092 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665382+0000", 2024-09-12T18:36:54.092 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.014430111000000001 2024-09-12T18:36:54.092 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.093 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.093 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:54.093 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665508+0000", 2024-09-12T18:36:54.093 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000125986 2024-09-12T18:36:54.093 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.093 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.093 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:54.093 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665608+0000", 2024-09-12T18:36:54.093 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9809000000000006e-05 2024-09-12T18:36:54.093 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:54.093 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:54.093 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:54.093 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.094 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.094 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:54.094 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:36:54.094 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 88.388665562, 2024-09-12T18:36:54.094 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024670563, 2024-09-12T18:36:54.094 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:54.094 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:54.094 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:54.094 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:54.094 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.094 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:54.094 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:36:54.094 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:54.094 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.095 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.095 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:54.095 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:36:54.095 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:54.095 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.095 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.095 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:54.095 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642120+0000", 2024-09-12T18:36:54.095 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1769999999999999e-06 2024-09-12T18:36:54.095 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.095 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.095 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:54.095 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642128+0000", 2024-09-12T18:36:54.096 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3429999999999998e-06 2024-09-12T18:36:54.096 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.096 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.096 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:54.096 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642192+0000", 2024-09-12T18:36:54.096 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4406999999999995e-05 2024-09-12T18:36:54.096 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.096 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.096 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:54.096 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642223+0000", 2024-09-12T18:36:54.096 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.1266000000000002e-05 2024-09-12T18:36:54.096 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.096 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.097 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:54.097 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643201+0000", 2024-09-12T18:36:54.097 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0009778390000000001 2024-09-12T18:36:54.097 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.097 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.097 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:54.097 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643410+0000", 2024-09-12T18:36:54.097 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020874199999999999 2024-09-12T18:36:54.097 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.097 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.097 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:54.097 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643685+0000", 2024-09-12T18:36:54.097 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027520700000000002 2024-09-12T18:36:54.098 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.098 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.098 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:54.098 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650966+0000", 2024-09-12T18:36:54.098 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072810710000000001 2024-09-12T18:36:54.098 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.098 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.098 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:54.098 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666560+0000", 2024-09-12T18:36:54.098 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015594143 2024-09-12T18:36:54.098 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.098 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.098 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:54.098 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666691+0000", 2024-09-12T18:36:54.098 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000130359 2024-09-12T18:36:54.099 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.099 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.099 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:54.099 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666790+0000", 2024-09-12T18:36:54.099 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9009e-05 2024-09-12T18:36:54.099 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:54.099 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:54.099 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:54.099 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.099 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.099 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:54.099 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:36:54.099 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 88.387887273999993, 2024-09-12T18:36:54.100 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024891744, 2024-09-12T18:36:54.100 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:54.100 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:54.100 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:54.100 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:54.100 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.100 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:54.100 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:36:54.100 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:54.100 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.100 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.100 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:54.100 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:36:54.101 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:54.101 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.101 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.101 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:54.101 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642899+0000", 2024-09-12T18:36:54.101 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4729999999999999e-06 2024-09-12T18:36:54.101 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.101 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.101 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:54.101 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642912+0000", 2024-09-12T18:36:54.101 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3495999999999999e-05 2024-09-12T18:36:54.101 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.101 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.102 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:54.102 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642934+0000", 2024-09-12T18:36:54.102 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2033999999999999e-05 2024-09-12T18:36:54.102 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.102 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.102 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:54.102 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642949+0000", 2024-09-12T18:36:54.102 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4970000000000001e-05 2024-09-12T18:36:54.102 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.102 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.102 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:54.102 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644400+0000", 2024-09-12T18:36:54.102 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001450305 2024-09-12T18:36:54.102 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.103 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.103 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:54.103 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644617+0000", 2024-09-12T18:36:54.103 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000217302 2024-09-12T18:36:54.103 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.103 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.103 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:54.103 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645052+0000", 2024-09-12T18:36:54.103 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000434797 2024-09-12T18:36:54.103 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.103 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.103 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:54.103 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653860+0000", 2024-09-12T18:36:54.103 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0088082249999999994 2024-09-12T18:36:54.104 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.104 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.104 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:54.104 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667598+0000", 2024-09-12T18:36:54.104 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.013738451 2024-09-12T18:36:54.104 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.104 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.104 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:54.104 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667698+0000", 2024-09-12T18:36:54.104 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9854999999999999e-05 2024-09-12T18:36:54.104 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.104 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.104 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:54.105 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667789+0000", 2024-09-12T18:36:54.105 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0835999999999996e-05 2024-09-12T18:36:54.105 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:54.105 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:54.105 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:54.105 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.105 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.105 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:30 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:54.105 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:36:54.105 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 88.387812457999999, 2024-09-12T18:36:54.105 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023936852000000002, 2024-09-12T18:36:54.105 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:54.105 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:54.105 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:54.106 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:54.106 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.106 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:54.106 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:36:54.106 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:54.106 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.106 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.106 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:54.106 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:36:54.106 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:54.106 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.106 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.106 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:54.106 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642973+0000", 2024-09-12T18:36:54.107 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.11e-06 2024-09-12T18:36:54.107 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.107 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.107 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:54.107 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642994+0000", 2024-09-12T18:36:54.107 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.0699999999999998e-05 2024-09-12T18:36:54.107 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.107 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.107 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:54.107 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643011+0000", 2024-09-12T18:36:54.107 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7229999999999999e-05 2024-09-12T18:36:54.107 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.107 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.107 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:54.107 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643025+0000", 2024-09-12T18:36:54.108 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3803e-05 2024-09-12T18:36:54.108 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.108 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.108 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:54.108 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643143+0000", 2024-09-12T18:36:54.108 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000118225 2024-09-12T18:36:54.108 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.108 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.108 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:54.108 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643426+0000", 2024-09-12T18:36:54.108 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00028250500000000001 2024-09-12T18:36:54.108 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.108 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.109 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:54.109 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643864+0000", 2024-09-12T18:36:54.109 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00043856 2024-09-12T18:36:54.109 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.109 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.109 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:54.109 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651148+0000", 2024-09-12T18:36:54.109 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072836769999999997 2024-09-12T18:36:54.109 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.109 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.109 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:54.109 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666674+0000", 2024-09-12T18:36:54.109 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015525786999999999 2024-09-12T18:36:54.109 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.109 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.110 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:54.110 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666796+0000", 2024-09-12T18:36:54.110 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000122416 2024-09-12T18:36:54.110 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.110 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.110 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:54.110 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666909+0000", 2024-09-12T18:36:54.110 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011283899999999999 2024-09-12T18:36:54.110 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:54.110 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:54.110 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:54.110 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.110 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.110 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:54.111 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:36:54.111 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 88.387729751999998, 2024-09-12T18:36:54.111 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024100234000000002, 2024-09-12T18:36:54.111 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:54.111 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:54.111 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:54.111 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:54.111 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.111 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:54.111 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:36:54.111 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:54.111 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.111 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.111 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:54.112 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:36:54.112 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:54.112 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.112 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.112 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:54.112 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643056+0000", 2024-09-12T18:36:54.112 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.046e-06 2024-09-12T18:36:54.112 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.112 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.112 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:54.112 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643068+0000", 2024-09-12T18:36:54.112 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2106999999999999e-05 2024-09-12T18:36:54.112 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.113 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.113 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:54.113 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643085+0000", 2024-09-12T18:36:54.113 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7479999999999999e-05 2024-09-12T18:36:54.113 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.113 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.113 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:54.113 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643099+0000", 2024-09-12T18:36:54.113 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3730000000000001e-05 2024-09-12T18:36:54.113 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.113 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.113 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:54.113 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644623+0000", 2024-09-12T18:36:54.113 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0015236080000000001 2024-09-12T18:36:54.113 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.114 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.114 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:54.114 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644893+0000", 2024-09-12T18:36:54.114 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026990500000000003 2024-09-12T18:36:54.114 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.114 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.114 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:54.114 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645227+0000", 2024-09-12T18:36:54.114 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00033391300000000003 2024-09-12T18:36:54.114 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.114 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.114 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:54.114 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653926+0000", 2024-09-12T18:36:54.114 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0086993339999999995 2024-09-12T18:36:54.115 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.115 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.115 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:54.115 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666925+0000", 2024-09-12T18:36:54.115 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012998686000000001 2024-09-12T18:36:54.115 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.115 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.115 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:54.115 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667057+0000", 2024-09-12T18:36:54.115 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013255600000000001 2024-09-12T18:36:54.115 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.115 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.115 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:54.116 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667155+0000", 2024-09-12T18:36:54.116 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7868999999999994e-05 2024-09-12T18:36:54.116 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:54.116 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:54.116 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:54.116 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.116 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.116 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:54.116 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:36:54.116 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 88.387533962999996, 2024-09-12T18:36:54.116 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024255982999999998, 2024-09-12T18:36:54.116 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:54.116 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:54.117 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:54.117 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:54.117 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.117 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:54.117 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:36:54.117 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:54.117 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.117 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.117 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:54.117 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:36:54.117 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:54.117 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.117 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.118 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:54.118 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643252+0000", 2024-09-12T18:36:54.118 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:54.118 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.118 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.118 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:54.118 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643287+0000", 2024-09-12T18:36:54.118 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5225999999999998e-05 2024-09-12T18:36:54.118 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.118 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.118 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:54.118 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643323+0000", 2024-09-12T18:36:54.118 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5488999999999999e-05 2024-09-12T18:36:54.118 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.118 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.119 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:54.119 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643357+0000", 2024-09-12T18:36:54.119 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.3853999999999998e-05 2024-09-12T18:36:54.119 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.119 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.119 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:54.119 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646716+0000", 2024-09-12T18:36:54.119 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003359 2024-09-12T18:36:54.119 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.119 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.119 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:54.119 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647037+0000", 2024-09-12T18:36:54.119 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032131800000000002 2024-09-12T18:36:54.119 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.119 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.120 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:54.120 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647337+0000", 2024-09-12T18:36:54.120 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000300208 2024-09-12T18:36:54.120 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.120 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.120 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:54.120 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654291+0000", 2024-09-12T18:36:54.120 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0069543089999999997 2024-09-12T18:36:54.120 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.120 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.120 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:54.120 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667297+0000", 2024-09-12T18:36:54.121 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.013005526 2024-09-12T18:36:54.121 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.121 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.121 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:54.121 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667416+0000", 2024-09-12T18:36:54.121 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000119416 2024-09-12T18:36:54.121 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.121 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.121 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:54.121 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667507+0000", 2024-09-12T18:36:54.121 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0206999999999999e-05 2024-09-12T18:36:54.121 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:54.121 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:54.122 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:54.122 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.122 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.122 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:54.122 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:36:54.122 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 88.387406867999999, 2024-09-12T18:36:54.122 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023888482999999999, 2024-09-12T18:36:54.122 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:54.122 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:54.122 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:54.122 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:54.122 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.122 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:54.122 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:36:54.123 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:54.123 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.123 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.123 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:54.123 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:36:54.123 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:54.123 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.123 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.123 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:54.123 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643379+0000", 2024-09-12T18:36:54.123 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.207e-06 2024-09-12T18:36:54.123 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.123 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.123 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:54.123 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643390+0000", 2024-09-12T18:36:54.124 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0696000000000001e-05 2024-09-12T18:36:54.124 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.124 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.124 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:54.124 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643407+0000", 2024-09-12T18:36:54.124 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7563000000000001e-05 2024-09-12T18:36:54.124 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.124 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.124 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:54.124 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643420+0000", 2024-09-12T18:36:54.124 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3277e-05 2024-09-12T18:36:54.124 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.124 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.125 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:54.125 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644906+0000", 2024-09-12T18:36:54.125 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001485945 2024-09-12T18:36:54.125 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.125 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.125 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:54.125 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645404+0000", 2024-09-12T18:36:54.125 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00049807599999999997 2024-09-12T18:36:54.125 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.125 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.125 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:54.125 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645846+0000", 2024-09-12T18:36:54.126 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00044190400000000002 2024-09-12T18:36:54.126 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.126 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.126 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:54.126 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654223+0000", 2024-09-12T18:36:54.126 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0083767419999999995 2024-09-12T18:36:54.126 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.126 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.126 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:54.126 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667026+0000", 2024-09-12T18:36:54.126 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012802531000000001 2024-09-12T18:36:54.126 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.126 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.126 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:54.127 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667162+0000", 2024-09-12T18:36:54.127 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000136112 2024-09-12T18:36:54.127 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.127 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.127 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:54.127 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667266+0000", 2024-09-12T18:36:54.127 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010443 2024-09-12T18:36:54.127 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:54.127 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:54.127 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:54.127 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.127 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.127 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:54.127 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:36:54.128 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 88.387256148999995, 2024-09-12T18:36:54.128 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024222582999999999, 2024-09-12T18:36:54.128 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:54.128 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:54.128 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:54.128 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:54.128 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.128 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:54.128 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:36:54.128 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:54.128 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.128 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.128 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:54.129 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:36:54.129 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:54.129 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.129 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.129 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:54.129 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643530+0000", 2024-09-12T18:36:54.129 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.393e-06 2024-09-12T18:36:54.129 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.129 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.129 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:54.129 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643536+0000", 2024-09-12T18:36:54.129 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4130000000000003e-06 2024-09-12T18:36:54.129 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.130 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.130 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:54.130 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643554+0000", 2024-09-12T18:36:54.130 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7572999999999999e-05 2024-09-12T18:36:54.130 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.130 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.130 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:54.130 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643567+0000", 2024-09-12T18:36:54.130 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3393999999999999e-05 2024-09-12T18:36:54.130 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.130 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.130 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:54.130 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648198+0000", 2024-09-12T18:36:54.130 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0046304479999999997 2024-09-12T18:36:54.131 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.131 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.131 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:54.131 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648413+0000", 2024-09-12T18:36:54.131 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00021507500000000001 2024-09-12T18:36:54.131 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.131 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.131 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:54.131 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667751+0000", 2024-09-12T18:36:54.131 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.019338286999999999 2024-09-12T18:36:54.131 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:54.131 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:54.131 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:54.131 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.132 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.132 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:121106 5.d e50/21 5:b4a9a221:::benchmark_data_smithi073_23739_object121105:head v 50'7658, mlcod=48'7656)", 2024-09-12T18:36:54.132 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:40.238637+0000", 2024-09-12T18:36:54.132 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 13.792147547999999, 2024-09-12T18:36:54.132 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.033154694999999998, 2024-09-12T18:36:54.132 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:54.132 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:54.132 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:54.132 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:54.132 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.132 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:54.132 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238637+0000", 2024-09-12T18:36:54.132 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:54.132 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.133 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.133 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:54.133 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238637+0000", 2024-09-12T18:36:54.133 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:54.133 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.133 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.133 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:54.133 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238639+0000", 2024-09-12T18:36:54.133 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.8560000000000001e-06 2024-09-12T18:36:54.133 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.133 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.133 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:54.133 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238723+0000", 2024-09-12T18:36:54.134 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4314999999999995e-05 2024-09-12T18:36:54.134 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.134 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.134 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:54.134 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238753+0000", 2024-09-12T18:36:54.134 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.9726e-05 2024-09-12T18:36:54.134 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.134 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.134 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:54.134 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238773+0000", 2024-09-12T18:36:54.134 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9789e-05 2024-09-12T18:36:54.134 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.134 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.135 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:54.135 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.241557+0000", 2024-09-12T18:36:54.135 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0027843910000000002 2024-09-12T18:36:54.135 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.135 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.135 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:54.135 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.241581+0000", 2024-09-12T18:36:54.135 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.4224999999999999e-05 2024-09-12T18:36:54.135 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.135 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.135 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:54.135 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.271722+0000", 2024-09-12T18:36:54.135 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.030141194 2024-09-12T18:36:54.136 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.136 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.136 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:54.136 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.271792+0000", 2024-09-12T18:36:54.136 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9198999999999999e-05 2024-09-12T18:36:54.136 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:54.136 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:54.136 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:54.136 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.136 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.136 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:131553 5.9 5:99f85f54:::benchmark_data_smithi073_23739_object131552:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:36:54.136 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:45.500398+0000", 2024-09-12T18:36:54.136 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 8.5303863880000002, 2024-09-12T18:36:54.136 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024615648, 2024-09-12T18:36:54.137 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:54.137 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:54.137 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:54.137 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:54.137 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:54.137 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:54.137 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 131553 2024-09-12T18:36:54.137 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.137 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:54.137 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.137 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:54.137 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500398+0000", 2024-09-12T18:36:54.137 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:54.138 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.138 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.138 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:54.138 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500398+0000", 2024-09-12T18:36:54.138 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:54.138 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.138 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.138 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:54.138 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500399+0000", 2024-09-12T18:36:54.138 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.54e-07 2024-09-12T18:36:54.138 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.138 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.138 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:54.138 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500521+0000", 2024-09-12T18:36:54.139 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012212599999999999 2024-09-12T18:36:54.139 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.139 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.139 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:54.139 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500528+0000", 2024-09-12T18:36:54.139 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.6619999999999999e-06 2024-09-12T18:36:54.139 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.139 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.139 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:54.139 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500532+0000", 2024-09-12T18:36:54.139 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6110000000000004e-06 2024-09-12T18:36:54.139 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.139 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.139 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:54.140 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500576+0000", 2024-09-12T18:36:54.140 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.3563000000000003e-05 2024-09-12T18:36:54.140 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.140 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.140 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:54.140 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500688+0000", 2024-09-12T18:36:54.140 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011260900000000001 2024-09-12T18:36:54.140 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.140 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.140 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:54.140 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.517383+0000", 2024-09-12T18:36:54.140 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.016694154999999999 2024-09-12T18:36:54.141 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.141 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.141 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:54.141 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.523998+0000", 2024-09-12T18:36:54.141 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0066157919999999997 2024-09-12T18:36:54.141 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.141 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.141 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:54.141 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.524943+0000", 2024-09-12T18:36:54.141 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00094417500000000001 2024-09-12T18:36:54.141 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.141 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.141 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:54.141 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.524981+0000", 2024-09-12T18:36:54.142 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.8179000000000002e-05 2024-09-12T18:36:54.142 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.142 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.142 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:54.142 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.525014+0000", 2024-09-12T18:36:54.142 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.3022000000000003e-05 2024-09-12T18:36:54.142 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:54.142 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:54.142 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:54.142 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.142 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.142 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:131551 5.d e52/21 5:b8f8c77a:::benchmark_data_smithi073_23739_object131550:head v 52'8341, mlcod=52'8338)", 2024-09-12T18:36:54.142 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:45.500609+0000", 2024-09-12T18:36:54.142 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 8.5301753680000001, 2024-09-12T18:36:54.143 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024752877, 2024-09-12T18:36:54.143 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:54.143 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:54.143 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:54.143 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:54.143 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.143 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:54.143 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500609+0000", 2024-09-12T18:36:54.143 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:54.143 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.143 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.143 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:54.143 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500609+0000", 2024-09-12T18:36:54.144 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:54.144 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.144 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.144 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:54.144 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500610+0000", 2024-09-12T18:36:54.144 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5499999999999998e-07 2024-09-12T18:36:54.144 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.144 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.144 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:54.144 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500669+0000", 2024-09-12T18:36:54.144 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9244999999999999e-05 2024-09-12T18:36:54.144 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.144 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.145 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:54.145 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500676+0000", 2024-09-12T18:36:54.145 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3030000000000002e-06 2024-09-12T18:36:54.145 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.145 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.145 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:54.145 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500681+0000", 2024-09-12T18:36:54.145 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8720000000000001e-06 2024-09-12T18:36:54.145 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.145 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.145 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:54.145 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.517128+0000", 2024-09-12T18:36:54.145 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.016446485 2024-09-12T18:36:54.146 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.146 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.146 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:54.146 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.517159+0000", 2024-09-12T18:36:54.146 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.0926000000000002e-05 2024-09-12T18:36:54.146 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.146 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.146 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:54.146 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.525325+0000", 2024-09-12T18:36:54.146 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0081661460000000009 2024-09-12T18:36:54.146 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:54.146 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:54.146 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:54.146 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.525362+0000", 2024-09-12T18:36:54.147 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.7345000000000002e-05 2024-09-12T18:36:54.147 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:54.147 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:54.147 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:54.147 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:54.147 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:54.147 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:36:54.148 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:54.142+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:54.149 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:36:54.181 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is set 2024-09-12T18:36:54.249 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:54.243+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:54.305 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:54.305 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:36:54.305 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.305 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:148925 5.7 e56/21 5:e71609e9:::benchmark_data_smithi073_23739_object16648:head v 56'9333, mlcod=56'9331)", 2024-09-12T18:36:54.305 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:54.299894+0000", 2024-09-12T18:36:54.306 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0030682999999999999, 2024-09-12T18:36:54.306 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0030889419999999999, 2024-09-12T18:36:54.306 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:54.306 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:54.306 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:54.306 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:54.306 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.306 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:54.306 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.299894+0000", 2024-09-12T18:36:54.306 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:54.307 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.307 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.307 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:54.307 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.299894+0000", 2024-09-12T18:36:54.307 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:54.307 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.307 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.307 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:54.307 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.299895+0000", 2024-09-12T18:36:54.307 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.7800000000000002e-07 2024-09-12T18:36:54.307 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.307 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.307 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:54.307 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.299900+0000", 2024-09-12T18:36:54.308 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5960000000000003e-06 2024-09-12T18:36:54.308 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.308 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.308 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:54.308 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.299906+0000", 2024-09-12T18:36:54.308 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2020000000000001e-06 2024-09-12T18:36:54.308 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.308 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.308 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:54.308 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.299912+0000", 2024-09-12T18:36:54.309 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7660000000000004e-06 2024-09-12T18:36:54.309 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.309 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.309 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:54.309 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.299960+0000", 2024-09-12T18:36:54.309 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.7920999999999997e-05 2024-09-12T18:36:54.309 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.309 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.309 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:54.309 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.299977+0000", 2024-09-12T18:36:54.309 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6977999999999999e-05 2024-09-12T18:36:54.309 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:54.309 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:54.310 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:54.310 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.310 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.310 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:148930 5.6 5:65af8ab4:::benchmark_data_smithi073_23739_object16653:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T18:36:54.310 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:54.299995+0000", 2024-09-12T18:36:54.310 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0029670780000000002, 2024-09-12T18:36:54.310 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0030471959999999998, 2024-09-12T18:36:54.310 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:54.310 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:54.310 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:54.310 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:54.310 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:54.311 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:54.311 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 148930 2024-09-12T18:36:54.311 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.311 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:54.311 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.311 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:54.311 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.299995+0000", 2024-09-12T18:36:54.311 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:54.311 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.311 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.311 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:54.311 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.299995+0000", 2024-09-12T18:36:54.311 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:54.312 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.312 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.312 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:54.312 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.299997+0000", 2024-09-12T18:36:54.312 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.269e-06 2024-09-12T18:36:54.312 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.312 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.312 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:54.312 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.300001+0000", 2024-09-12T18:36:54.312 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5650000000000003e-06 2024-09-12T18:36:54.312 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.313 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.313 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:54.313 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.300011+0000", 2024-09-12T18:36:54.313 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0036e-05 2024-09-12T18:36:54.313 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.313 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.313 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:54.313 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.300019+0000", 2024-09-12T18:36:54.313 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3529999999999997e-06 2024-09-12T18:36:54.313 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.314 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.314 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:54.314 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.302294+0000", 2024-09-12T18:36:54.314 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00227575 2024-09-12T18:36:54.314 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.314 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.314 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:54.314 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.302430+0000", 2024-09-12T18:36:54.314 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013571899999999999 2024-09-12T18:36:54.314 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.315 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.315 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:54.315 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.302554+0000", 2024-09-12T18:36:54.315 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012359400000000001 2024-09-12T18:36:54.315 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:54.315 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:54.315 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:54.315 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.315 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.315 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:148931 5.4 e56/21 5:2bb242dc:::benchmark_data_smithi073_23739_object16654:head v 56'9192, mlcod=56'9189)", 2024-09-12T18:36:54.315 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:54.300424+0000", 2024-09-12T18:36:54.315 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0025385199999999998, 2024-09-12T18:36:54.315 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00268769, 2024-09-12T18:36:54.316 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:54.316 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:54.316 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:54.316 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:54.316 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.316 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:54.316 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.300424+0000", 2024-09-12T18:36:54.316 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:54.316 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.316 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.317 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:54.317 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.300424+0000", 2024-09-12T18:36:54.317 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:54.317 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.317 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.317 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:54.317 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.300425+0000", 2024-09-12T18:36:54.317 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4099999999999997e-07 2024-09-12T18:36:54.317 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.318 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.318 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:54.318 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.300434+0000", 2024-09-12T18:36:54.318 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.0100000000000001e-06 2024-09-12T18:36:54.318 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.318 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.318 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:54.318 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.300445+0000", 2024-09-12T18:36:54.319 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1029000000000001e-05 2024-09-12T18:36:54.319 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.319 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.319 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:54.319 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.300452+0000", 2024-09-12T18:36:54.319 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1369999999999996e-06 2024-09-12T18:36:54.319 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.319 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.319 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:54.320 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.301312+0000", 2024-09-12T18:36:54.320 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00085999899999999996 2024-09-12T18:36:54.320 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.320 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.320 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:54.320 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.301331+0000", 2024-09-12T18:36:54.320 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9184000000000001e-05 2024-09-12T18:36:54.320 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:54.320 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:54.320 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:54.320 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.321 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.321 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:148928 5.7 e56/21 5:ea9810c9:::benchmark_data_smithi073_23739_object16651:head v 56'9334, mlcod=56'9331)", 2024-09-12T18:36:54.321 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:54.301848+0000", 2024-09-12T18:36:54.321 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.001114929, 2024-09-12T18:36:54.321 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0012946120000000001, 2024-09-12T18:36:54.321 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:54.321 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:54.321 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:54.321 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:54.321 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.321 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:54.322 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.301848+0000", 2024-09-12T18:36:54.322 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:54.322 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.322 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.322 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:54.322 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.301848+0000", 2024-09-12T18:36:54.322 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:54.322 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.322 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.322 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:54.322 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.301848+0000", 2024-09-12T18:36:54.322 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6499999999999999e-07 2024-09-12T18:36:54.323 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.323 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.323 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:54.323 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.301855+0000", 2024-09-12T18:36:54.323 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5019999999999998e-06 2024-09-12T18:36:54.323 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.323 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.323 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:54.323 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.301863+0000", 2024-09-12T18:36:54.324 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6070000000000008e-06 2024-09-12T18:36:54.324 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.324 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.324 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:54.324 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.301868+0000", 2024-09-12T18:36:54.324 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4959999999999998e-06 2024-09-12T18:36:54.324 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.324 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.324 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:54.324 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.301912+0000", 2024-09-12T18:36:54.324 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4567999999999997e-05 2024-09-12T18:36:54.324 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.325 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.325 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:54.325 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.301932+0000", 2024-09-12T18:36:54.325 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9638000000000001e-05 2024-09-12T18:36:54.325 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:54.325 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:54.325 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:54.325 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.325 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.325 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:148917 5.6 e56/21)", 2024-09-12T18:36:54.325 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:54.302307+0000", 2024-09-12T18:36:54.326 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00065562699999999999, 2024-09-12T18:36:54.326 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00086386799999999995, 2024-09-12T18:36:54.326 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:54.326 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:54.326 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:54.326 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:54.326 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.326 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:54.326 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.302307+0000", 2024-09-12T18:36:54.326 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:54.326 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.326 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.326 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:54.326 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.302307+0000", 2024-09-12T18:36:54.327 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:54.327 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.327 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.327 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:54.327 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.302308+0000", 2024-09-12T18:36:54.327 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0200000000000001e-07 2024-09-12T18:36:54.327 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.327 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.327 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:54.327 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.302310+0000", 2024-09-12T18:36:54.327 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.666e-06 2024-09-12T18:36:54.327 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.327 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.327 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:54.328 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.302318+0000", 2024-09-12T18:36:54.328 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.055e-06 2024-09-12T18:36:54.328 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.328 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.328 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:54.328 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.302323+0000", 2024-09-12T18:36:54.328 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.7489999999999998e-06 2024-09-12T18:36:54.328 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:54.328 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:54.328 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:54.328 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.328 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.329 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:148919 5.6 e56/21)", 2024-09-12T18:36:54.329 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:54.302355+0000", 2024-09-12T18:36:54.329 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00060711599999999999, 2024-09-12T18:36:54.329 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00083486900000000002, 2024-09-12T18:36:54.329 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:54.329 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:54.329 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:54.329 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:54.329 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.329 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:54.329 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.302355+0000", 2024-09-12T18:36:54.329 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:54.329 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.330 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.330 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:54.330 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.302355+0000", 2024-09-12T18:36:54.330 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:54.330 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.330 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.330 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:54.330 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.302356+0000", 2024-09-12T18:36:54.330 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2200000000000004e-07 2024-09-12T18:36:54.330 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.330 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.330 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:54.330 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.302359+0000", 2024-09-12T18:36:54.330 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.8540000000000001e-06 2024-09-12T18:36:54.331 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.331 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.331 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:54.331 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.302365+0000", 2024-09-12T18:36:54.331 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4799999999999998e-06 2024-09-12T18:36:54.331 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.331 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.331 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:54.331 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.302369+0000", 2024-09-12T18:36:54.331 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.7120000000000002e-06 2024-09-12T18:36:54.331 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:54.331 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:54.331 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:54.332 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.332 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.332 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:148932 5.4 e56/21 5:29517aa5:::benchmark_data_smithi073_23739_object16655:head v 56'9193, mlcod=56'9189)", 2024-09-12T18:36:54.332 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:54.302930+0000", 2024-09-12T18:36:54.332 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 3.2060999999999997e-05, 2024-09-12T18:36:54.332 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00028083900000000001, 2024-09-12T18:36:54.332 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:54.332 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:54.332 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:54.332 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:54.332 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.332 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:54.332 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.302930+0000", 2024-09-12T18:36:54.332 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:54.333 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.333 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.333 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:54.333 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.302930+0000", 2024-09-12T18:36:54.333 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:54.333 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.333 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.333 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:54.333 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.302931+0000", 2024-09-12T18:36:54.333 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9800000000000003e-07 2024-09-12T18:36:54.333 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.333 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.333 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:54.333 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.302935+0000", 2024-09-12T18:36:54.334 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.7100000000000001e-06 2024-09-12T18:36:54.334 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.334 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.334 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:54.334 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.302943+0000", 2024-09-12T18:36:54.334 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0770000000000008e-06 2024-09-12T18:36:54.334 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.334 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.334 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:54.334 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.302947+0000", 2024-09-12T18:36:54.335 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.6460000000000001e-06 2024-09-12T18:36:54.335 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.335 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.335 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:54.335 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.303090+0000", 2024-09-12T18:36:54.335 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014258700000000001 2024-09-12T18:36:54.335 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.335 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.335 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:54.335 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.303102+0000", 2024-09-12T18:36:54.335 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1704e-05 2024-09-12T18:36:54.335 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:54.335 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:54.335 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:54.336 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.336 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.336 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:148933 5.6 5.1f068a66 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T18:36:54.336 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:54.303025+0000", 2024-09-12T18:36:54.336 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4294967295.9999371, 2024-09-12T18:36:54.336 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00021240399999999999, 2024-09-12T18:36:54.336 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:54.336 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:54.336 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:54.336 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:54.336 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:54.336 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:54.337 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 148933 2024-09-12T18:36:54.337 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.337 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:54.337 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.337 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:54.337 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.303025+0000", 2024-09-12T18:36:54.337 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:54.337 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.337 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.337 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:54.337 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.303025+0000", 2024-09-12T18:36:54.337 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:54.337 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.337 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.338 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:54.338 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.303026+0000", 2024-09-12T18:36:54.338 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.7900000000000007e-07 2024-09-12T18:36:54.338 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.338 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.338 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:54.338 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.303030+0000", 2024-09-12T18:36:54.338 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.7050000000000001e-06 2024-09-12T18:36:54.338 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.338 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.338 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:54.338 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.303038+0000", 2024-09-12T18:36:54.338 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.7379999999999994e-06 2024-09-12T18:36:54.339 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.339 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.339 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:54.339 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.303043+0000", 2024-09-12T18:36:54.339 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.6709999999999998e-06 2024-09-12T18:36:54.339 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:54.339 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:54.339 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:54.339 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.339 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.339 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:148917 5.6 5:606cd0c2:::benchmark_data_smithi073_23739_object16640:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T18:36:54.339 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:54.293322+0000", 2024-09-12T18:36:54.339 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0096400519999999996, 2024-09-12T18:36:54.340 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00994745, 2024-09-12T18:36:54.340 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:54.340 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:54.340 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:54.340 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:54.340 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:54.340 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:54.340 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 148917 2024-09-12T18:36:54.340 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.340 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:54.340 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.340 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:54.340 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.293322+0000", 2024-09-12T18:36:54.341 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:54.341 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.341 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.341 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:54.341 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.293322+0000", 2024-09-12T18:36:54.341 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:54.341 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.341 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.341 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:54.342 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.293323+0000", 2024-09-12T18:36:54.342 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.7399999999999991e-07 2024-09-12T18:36:54.342 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.342 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.342 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:54.342 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.293331+0000", 2024-09-12T18:36:54.342 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6720000000000004e-06 2024-09-12T18:36:54.342 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.342 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.342 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:54.342 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.293342+0000", 2024-09-12T18:36:54.342 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0539e-05 2024-09-12T18:36:54.342 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.342 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.343 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:54.343 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.293349+0000", 2024-09-12T18:36:54.343 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0180000000000004e-06 2024-09-12T18:36:54.343 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.343 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.343 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:54.343 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.295385+0000", 2024-09-12T18:36:54.343 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0020359670000000001 2024-09-12T18:36:54.343 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.343 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.343 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:54.343 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.295477+0000", 2024-09-12T18:36:54.343 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2417000000000006e-05 2024-09-12T18:36:54.344 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.344 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.344 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:54.344 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.295560+0000", 2024-09-12T18:36:54.344 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.3227999999999997e-05 2024-09-12T18:36:54.344 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.344 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.344 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:54.344 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.302264+0000", 2024-09-12T18:36:54.345 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0067040870000000001 2024-09-12T18:36:54.345 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:54.345 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:54.345 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:54.345 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.345 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.345 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:148919 5.6 5:641b5b0a:::benchmark_data_smithi073_23739_object16642:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T18:36:54.345 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:54.295524+0000", 2024-09-12T18:36:54.345 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0074383449999999999, 2024-09-12T18:36:54.345 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0077812430000000002, 2024-09-12T18:36:54.345 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:54.345 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:54.345 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:54.345 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:54.346 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:54.346 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:54.346 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 148919 2024-09-12T18:36:54.346 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.346 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:54.346 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.346 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:54.346 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.295524+0000", 2024-09-12T18:36:54.346 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:54.346 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.346 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.346 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:54.346 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.295524+0000", 2024-09-12T18:36:54.347 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:54.347 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.347 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.347 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:54.347 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.295525+0000", 2024-09-12T18:36:54.347 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.097e-06 2024-09-12T18:36:54.347 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.347 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.347 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:54.347 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.295530+0000", 2024-09-12T18:36:54.347 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8040000000000001e-06 2024-09-12T18:36:54.347 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.347 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.347 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:54.348 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.295540+0000", 2024-09-12T18:36:54.348 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4669999999999993e-06 2024-09-12T18:36:54.348 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.348 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.348 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:54.348 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.295548+0000", 2024-09-12T18:36:54.348 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1380000000000007e-06 2024-09-12T18:36:54.348 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.348 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.348 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:54.348 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.297415+0000", 2024-09-12T18:36:54.348 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001867336 2024-09-12T18:36:54.349 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.349 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.349 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:54.349 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.297522+0000", 2024-09-12T18:36:54.349 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00010700399999999999 2024-09-12T18:36:54.349 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.349 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.349 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:54.349 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.297626+0000", 2024-09-12T18:36:54.349 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000104023 2024-09-12T18:36:54.349 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:54.349 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:54.349 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:54.349 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.350 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.350 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:148918 5.4 e56/21 5:296f5f09:::benchmark_data_smithi073_23739_object16641:head v 56'9191, mlcod=56'9188)", 2024-09-12T18:36:54.350 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:54.295839+0000", 2024-09-12T18:36:54.350 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0071237899999999996, 2024-09-12T18:36:54.350 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0074990789999999996, 2024-09-12T18:36:54.350 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:54.350 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:54.350 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:54.350 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:54.350 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.350 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:54.350 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.295839+0000", 2024-09-12T18:36:54.350 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:54.350 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.351 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.351 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:54.351 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.295839+0000", 2024-09-12T18:36:54.351 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:54.351 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.351 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.351 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:54.351 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.295839+0000", 2024-09-12T18:36:54.351 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.7899999999999997e-07 2024-09-12T18:36:54.351 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.351 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.351 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:54.351 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.295844+0000", 2024-09-12T18:36:54.352 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3270000000000002e-06 2024-09-12T18:36:54.352 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.352 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.352 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:54.352 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.295854+0000", 2024-09-12T18:36:54.352 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.9769999999999995e-06 2024-09-12T18:36:54.352 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.352 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.352 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:54.352 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.295861+0000", 2024-09-12T18:36:54.352 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8560000000000001e-06 2024-09-12T18:36:54.353 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.353 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.353 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:54.353 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.295915+0000", 2024-09-12T18:36:54.353 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4033999999999998e-05 2024-09-12T18:36:54.353 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.353 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.353 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:54.353 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.295943+0000", 2024-09-12T18:36:54.353 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.813e-05 2024-09-12T18:36:54.353 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:54.353 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:54.354 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:54.354 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.354 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.354 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:148922 5.6 5:69c9fbe5:::benchmark_data_smithi073_23739_object16645:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T18:36:54.354 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:54.296782+0000", 2024-09-12T18:36:54.354 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0061809220000000002, 2024-09-12T18:36:54.354 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0065830239999999998, 2024-09-12T18:36:54.354 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:54.354 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:54.354 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:54.354 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:54.354 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:54.355 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:54.355 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 148922 2024-09-12T18:36:54.355 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.355 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:54.355 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.355 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:54.355 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.296782+0000", 2024-09-12T18:36:54.355 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:54.355 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.355 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.355 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:54.356 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.296782+0000", 2024-09-12T18:36:54.356 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:54.356 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.356 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.356 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:54.356 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.296783+0000", 2024-09-12T18:36:54.356 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.099e-06 2024-09-12T18:36:54.356 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.356 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.356 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:54.356 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.296787+0000", 2024-09-12T18:36:54.356 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5260000000000004e-06 2024-09-12T18:36:54.356 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.356 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.357 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:54.357 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.296800+0000", 2024-09-12T18:36:54.357 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3295999999999999e-05 2024-09-12T18:36:54.357 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.357 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.357 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:54.357 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.296808+0000", 2024-09-12T18:36:54.357 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5140000000000004e-06 2024-09-12T18:36:54.357 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.357 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.357 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:54.357 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.299612+0000", 2024-09-12T18:36:54.357 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0028040769999999999 2024-09-12T18:36:54.357 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.358 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.358 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:54.358 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.299749+0000", 2024-09-12T18:36:54.358 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000136491 2024-09-12T18:36:54.358 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:54.358 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:54.358 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:54.358 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:54.299823+0000", 2024-09-12T18:36:54.358 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4680999999999999e-05 2024-09-12T18:36:54.358 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:54.358 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:54.358 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:54.358 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:54.358 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-12T18:36:54.358 INFO:teuthology.orchestra.run.smithi114.stdout: "num_ops": 12 2024-09-12T18:36:54.359 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:54.360 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:54.354+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:54.360 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:36:54.390 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:36:54.461 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:54.458+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:54.514 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:54.574 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2024-09-12T18:36:54.574 INFO:teuthology.orchestra.run.smithi114.stdout: "complaint_time": 30, 2024-09-12T18:36:54.574 INFO:teuthology.orchestra.run.smithi114.stdout: "num_blocked_ops": 0 2024-09-12T18:36:54.574 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:54.575 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:36:54.576 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:54.571+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:54.576 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:36:54.577 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:36:54.577 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:36:54.577 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:36:54.585 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:36:54.586 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:36:54.678 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:54.671+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:54.732 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:54.733 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:54.751 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:36:54.796 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:54.791+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:54.879 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:54.871+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:54.907 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:54.907 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:54.928 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:36:54.981 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:54.978+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:55.081 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:55.075+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:55.082 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:55.082 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:55.102 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:36:55.182 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:55.179+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:55.283 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:55.279+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:55.303 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:55.304 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:55.323 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:36:55.383 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:55.379+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:55.468 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:55.469 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:55.485 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:55.482+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:55.490 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:36:55.585 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:55.583+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:55.649 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:55.649 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:55.670 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:36:55.687 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:55.682+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:55.788 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:55.782+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:55.868 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:55.868 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:55.888 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:36:55.889 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:55.883+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:55.989 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:55.983+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:56.046 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:56.046 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:56.065 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:36:56.090 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:56.087+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:56.191 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:56.187+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:56.206 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T18:36:56.266 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:56.266 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:56.284 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:36:56.292 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:56.286+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:56.393 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:56.390+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:56.484 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:56.485 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:56.494 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:56.490+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:56.504 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:36:56.531 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:36:56.532 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:36:56.532 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-09-12T18:36:56.532 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-12T18:36:56.532 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-12T18:36:56.532 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-09-12T18:36:56.595 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:56.587+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:56.603 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:36:56.658 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:56.658 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:56.680 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:36:56.691 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:36:56.691 INFO:teuthology.orchestra.run.smithi162.stdout: "success": "" 2024-09-12T18:36:56.691 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:36:56.696 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:56.691+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:56.752 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:36:56.753 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:36:56.770 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:36:56.771 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:36:56.789 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:36:56.789 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:36:56.796 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:56.791+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:56.842 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:56.843 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-09-12T18:36:56.843 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-09-12T18:36:56.843 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-09-12T18:36:56.843 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:56.864 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:36:56.909 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:56.906+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:56.999 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:56.994+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:57.023 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:57.024 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-09-12T18:36:57.024 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-09-12T18:36:57.024 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:36:57.024 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.024 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:57.024 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:57.024 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 91.387736238000002, 2024-09-12T18:36:57.024 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025088781000000001, 2024-09-12T18:36:57.024 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:57.024 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:57.024 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:57.024 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:57.024 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.025 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:57.025 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:57.025 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:57.025 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.025 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.025 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:57.025 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:36:57.025 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:57.025 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.025 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.025 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:57.025 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632518+0000", 2024-09-12T18:36:57.025 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:36:57.026 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.026 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.026 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:57.026 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632533+0000", 2024-09-12T18:36:57.026 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5130000000000001e-05 2024-09-12T18:36:57.026 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.026 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.026 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:57.026 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632564+0000", 2024-09-12T18:36:57.026 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0788999999999999e-05 2024-09-12T18:36:57.026 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.026 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.027 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.027 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632590+0000", 2024-09-12T18:36:57.027 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6057000000000001e-05 2024-09-12T18:36:57.027 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.027 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.027 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:57.027 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.635931+0000", 2024-09-12T18:36:57.027 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033411320000000001 2024-09-12T18:36:57.027 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.027 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.027 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:57.027 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636186+0000", 2024-09-12T18:36:57.028 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025452500000000002 2024-09-12T18:36:57.028 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.028 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.028 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:57.028 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636445+0000", 2024-09-12T18:36:57.028 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000259268 2024-09-12T18:36:57.028 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.028 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.028 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:57.028 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639562+0000", 2024-09-12T18:36:57.028 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031167 2024-09-12T18:36:57.028 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.028 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.029 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:57.029 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657314+0000", 2024-09-12T18:36:57.029 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017752562 2024-09-12T18:36:57.029 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.029 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.029 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:57.029 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657445+0000", 2024-09-12T18:36:57.029 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013105899999999999 2024-09-12T18:36:57.029 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.029 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.029 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:57.029 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657598+0000", 2024-09-12T18:36:57.029 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015247899999999999 2024-09-12T18:36:57.030 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:57.030 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:57.030 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:57.030 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.030 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.030 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:57.030 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:57.030 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 91.387610034999994, 2024-09-12T18:36:57.030 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025643131999999999, 2024-09-12T18:36:57.030 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:57.030 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:57.030 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:57.031 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:57.031 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.031 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:57.031 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:57.031 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:57.031 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.031 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.031 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:57.031 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:36:57.031 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:57.031 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.031 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.031 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:57.031 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632637+0000", 2024-09-12T18:36:57.031 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5600000000000001e-06 2024-09-12T18:36:57.032 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.032 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.032 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:57.032 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632650+0000", 2024-09-12T18:36:57.032 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3186e-05 2024-09-12T18:36:57.032 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.032 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.032 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:57.032 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632672+0000", 2024-09-12T18:36:57.032 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2013000000000001e-05 2024-09-12T18:36:57.033 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.033 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.033 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.033 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632687+0000", 2024-09-12T18:36:57.033 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5109999999999999e-05 2024-09-12T18:36:57.033 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.033 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.033 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:57.033 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636994+0000", 2024-09-12T18:36:57.033 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0043065539999999998 2024-09-12T18:36:57.033 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.033 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.033 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:57.034 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637198+0000", 2024-09-12T18:36:57.034 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020387199999999999 2024-09-12T18:36:57.034 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.034 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.034 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:57.034 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637475+0000", 2024-09-12T18:36:57.034 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027731000000000001 2024-09-12T18:36:57.034 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.034 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.034 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:57.034 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639574+0000", 2024-09-12T18:36:57.034 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020988999999999999 2024-09-12T18:36:57.034 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.034 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.035 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:57.035 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658057+0000", 2024-09-12T18:36:57.035 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018482926 2024-09-12T18:36:57.035 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.035 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.035 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:57.035 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658184+0000", 2024-09-12T18:36:57.035 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012756200000000001 2024-09-12T18:36:57.035 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.035 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.035 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:57.035 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658278+0000", 2024-09-12T18:36:57.035 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4139000000000001e-05 2024-09-12T18:36:57.035 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:57.035 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:57.036 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:57.036 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.036 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.036 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:57.036 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:57.036 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 91.387534943000006, 2024-09-12T18:36:57.036 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025238883, 2024-09-12T18:36:57.036 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:57.036 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:57.036 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:57.036 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:57.036 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.036 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:57.036 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:57.037 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:57.037 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.037 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.037 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:57.037 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:36:57.037 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:57.037 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.037 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.037 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:57.037 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632712+0000", 2024-09-12T18:36:57.037 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6869999999999999e-06 2024-09-12T18:36:57.037 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.037 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.038 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:57.038 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632719+0000", 2024-09-12T18:36:57.038 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6059999999999999e-06 2024-09-12T18:36:57.038 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.038 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.038 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:57.038 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632737+0000", 2024-09-12T18:36:57.038 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7983999999999999e-05 2024-09-12T18:36:57.038 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.038 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.038 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.038 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632751+0000", 2024-09-12T18:36:57.038 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4473e-05 2024-09-12T18:36:57.039 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.039 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.039 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:57.039 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636961+0000", 2024-09-12T18:36:57.039 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042100840000000002 2024-09-12T18:36:57.039 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.039 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.039 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:57.039 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637211+0000", 2024-09-12T18:36:57.039 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000249738 2024-09-12T18:36:57.039 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.039 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.039 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:57.040 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637504+0000", 2024-09-12T18:36:57.040 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00029271499999999998 2024-09-12T18:36:57.040 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.040 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.040 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:57.040 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639582+0000", 2024-09-12T18:36:57.040 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020783389999999998 2024-09-12T18:36:57.040 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.040 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.040 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:57.040 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657709+0000", 2024-09-12T18:36:57.040 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018126758999999999 2024-09-12T18:36:57.041 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.041 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.041 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:57.041 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657830+0000", 2024-09-12T18:36:57.041 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000121329 2024-09-12T18:36:57.041 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.041 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.041 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:57.041 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657949+0000", 2024-09-12T18:36:57.041 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000119169 2024-09-12T18:36:57.041 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:57.041 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:57.041 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:57.042 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.042 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.042 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:57.042 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:57.042 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 91.387470897, 2024-09-12T18:36:57.042 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026711823999999999, 2024-09-12T18:36:57.042 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:57.042 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:57.042 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:57.042 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:57.042 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.042 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:57.042 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:57.043 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:57.043 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.043 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.043 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:57.043 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:36:57.043 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:57.043 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.043 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.043 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:57.043 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632775+0000", 2024-09-12T18:36:57.043 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9999999999999995e-07 2024-09-12T18:36:57.043 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.043 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.044 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:57.044 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632788+0000", 2024-09-12T18:36:57.044 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2629999999999999e-05 2024-09-12T18:36:57.044 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.044 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.044 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:57.044 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632806+0000", 2024-09-12T18:36:57.044 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:36:57.044 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.044 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.044 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.044 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632820+0000", 2024-09-12T18:36:57.044 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3777e-05 2024-09-12T18:36:57.045 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.045 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.045 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:57.045 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638310+0000", 2024-09-12T18:36:57.045 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054898280000000004 2024-09-12T18:36:57.045 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.045 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.045 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:57.045 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638480+0000", 2024-09-12T18:36:57.045 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016968199999999999 2024-09-12T18:36:57.045 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.045 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.045 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:57.046 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638799+0000", 2024-09-12T18:36:57.046 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031915999999999997 2024-09-12T18:36:57.046 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.046 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.046 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:57.046 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639866+0000", 2024-09-12T18:36:57.046 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001067405 2024-09-12T18:36:57.046 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.046 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.046 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:57.046 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658398+0000", 2024-09-12T18:36:57.046 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018531542000000002 2024-09-12T18:36:57.046 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.046 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.047 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:57.047 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658643+0000", 2024-09-12T18:36:57.047 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00024531500000000002 2024-09-12T18:36:57.047 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.047 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.047 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:57.047 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.659486+0000", 2024-09-12T18:36:57.047 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00084316899999999995 2024-09-12T18:36:57.047 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:57.047 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:57.047 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:57.047 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.047 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.048 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:57.048 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:57.048 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 91.387162142999998, 2024-09-12T18:36:57.048 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026938645000000001, 2024-09-12T18:36:57.048 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:57.048 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:57.048 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:57.048 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:57.048 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.048 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:57.048 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:57.048 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:57.048 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.049 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.049 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:57.049 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:36:57.049 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:57.049 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.049 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.049 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:57.049 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633085+0000", 2024-09-12T18:36:57.049 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:57.049 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.049 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.049 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:57.050 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633093+0000", 2024-09-12T18:36:57.050 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3999999999999992e-06 2024-09-12T18:36:57.050 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.050 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.050 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:57.050 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633111+0000", 2024-09-12T18:36:57.050 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8070000000000001e-05 2024-09-12T18:36:57.050 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.050 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.050 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.050 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633126+0000", 2024-09-12T18:36:57.050 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4487e-05 2024-09-12T18:36:57.050 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.050 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.051 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:57.051 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638290+0000", 2024-09-12T18:36:57.051 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0051640269999999999 2024-09-12T18:36:57.051 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.052 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.052 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:57.052 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638547+0000", 2024-09-12T18:36:57.053 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025714100000000001 2024-09-12T18:36:57.053 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.053 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.053 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:57.053 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638850+0000", 2024-09-12T18:36:57.053 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030278400000000001 2024-09-12T18:36:57.053 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.054 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.054 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:57.054 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.640706+0000", 2024-09-12T18:36:57.054 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018564580000000001 2024-09-12T18:36:57.054 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.054 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.055 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:57.055 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658420+0000", 2024-09-12T18:36:57.055 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017714395000000001 2024-09-12T18:36:57.055 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.055 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.055 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:57.056 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658635+0000", 2024-09-12T18:36:57.056 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021413500000000001 2024-09-12T18:36:57.056 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.056 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.056 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:57.056 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.660022+0000", 2024-09-12T18:36:57.057 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001387318 2024-09-12T18:36:57.057 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:57.057 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:57.057 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:57.057 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.058 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.058 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121096 5.8 5:13503891:::benchmark_data_smithi073_23739_object121095:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:57.058 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:36:57.058 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 16.841669176, 2024-09-12T18:36:57.058 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064025391000000001, 2024-09-12T18:36:57.058 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:57.059 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:57.059 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:57.059 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:57.059 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:57.059 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:57.059 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121096 2024-09-12T18:36:57.060 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.060 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:57.060 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.060 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:57.060 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:36:57.060 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:57.061 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.061 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.061 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:57.061 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:36:57.061 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:57.062 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.062 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.062 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:57.062 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178579+0000", 2024-09-12T18:36:57.062 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7369999999999998e-06 2024-09-12T18:36:57.063 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.063 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.063 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:57.063 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178846+0000", 2024-09-12T18:36:57.064 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026752699999999999 2024-09-12T18:36:57.064 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.064 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.064 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:57.064 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178877+0000", 2024-09-12T18:36:57.064 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1081999999999998e-05 2024-09-12T18:36:57.065 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.065 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.065 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.065 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178896+0000", 2024-09-12T18:36:57.065 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8522e-05 2024-09-12T18:36:57.065 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.066 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.066 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:57.066 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.192591+0000", 2024-09-12T18:36:57.066 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013695067 2024-09-12T18:36:57.066 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.066 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.067 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:57.067 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.192944+0000", 2024-09-12T18:36:57.067 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00035273699999999999 2024-09-12T18:36:57.067 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.067 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.067 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:57.068 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.193732+0000", 2024-09-12T18:36:57.068 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078849599999999997 2024-09-12T18:36:57.068 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.068 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.068 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:57.069 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.213583+0000", 2024-09-12T18:36:57.069 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.019851164000000001 2024-09-12T18:36:57.069 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.069 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.069 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:57.069 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242386+0000", 2024-09-12T18:36:57.070 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028802924000000001 2024-09-12T18:36:57.070 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.070 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.070 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:57.070 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242501+0000", 2024-09-12T18:36:57.070 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000114932 2024-09-12T18:36:57.071 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.071 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.071 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:57.071 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242602+0000", 2024-09-12T18:36:57.071 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000100203 2024-09-12T18:36:57.072 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:57.072 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:57.072 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:57.072 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.072 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.072 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121097 5.8 5:1b31a99e:::benchmark_data_smithi073_23739_object121096:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:57.073 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:36:57.073 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 16.825940886000001, 2024-09-12T18:36:57.073 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048475917, 2024-09-12T18:36:57.073 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:57.073 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:57.074 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:57.074 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:57.074 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:57.074 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:57.074 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121097 2024-09-12T18:36:57.074 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.075 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:57.075 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.075 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:57.075 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:36:57.075 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:57.076 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.076 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.076 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:57.076 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:36:57.076 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:57.077 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.077 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.077 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:57.077 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194308+0000", 2024-09-12T18:36:57.077 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2789999999999999e-06 2024-09-12T18:36:57.077 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.077 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.078 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:57.078 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194396+0000", 2024-09-12T18:36:57.078 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8324000000000003e-05 2024-09-12T18:36:57.078 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.078 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.078 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:57.078 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194424+0000", 2024-09-12T18:36:57.079 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7565000000000001e-05 2024-09-12T18:36:57.079 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.079 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.079 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.079 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194444+0000", 2024-09-12T18:36:57.079 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0363000000000001e-05 2024-09-12T18:36:57.079 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.080 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.080 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:57.080 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.206888+0000", 2024-09-12T18:36:57.080 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012443997 2024-09-12T18:36:57.080 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.080 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.080 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:57.080 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.207138+0000", 2024-09-12T18:36:57.080 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025035900000000002 2024-09-12T18:36:57.080 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.080 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.081 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:57.081 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.207365+0000", 2024-09-12T18:36:57.081 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000226407 2024-09-12T18:36:57.081 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.081 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.081 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:57.081 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.215059+0000", 2024-09-12T18:36:57.081 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076946860000000001 2024-09-12T18:36:57.081 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.081 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.081 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:57.081 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242619+0000", 2024-09-12T18:36:57.081 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.027559975 2024-09-12T18:36:57.081 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.082 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.082 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:57.082 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242706+0000", 2024-09-12T18:36:57.082 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6384999999999994e-05 2024-09-12T18:36:57.082 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.082 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.082 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:57.082 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242780+0000", 2024-09-12T18:36:57.082 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4577000000000001e-05 2024-09-12T18:36:57.082 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:57.082 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:57.082 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:57.082 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.082 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.083 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:121044 5.1 e50/49 5:83bf711a:::benchmark_data_smithi073_23739_object121043:head v 50'7532, mlcod=0'0)", 2024-09-12T18:36:57.083 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.201054+0000", 2024-09-12T18:36:57.083 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 16.819191664999998, 2024-09-12T18:36:57.083 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026157387000000001, 2024-09-12T18:36:57.083 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:57.083 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:57.083 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:57.083 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:57.083 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.083 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:57.083 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201054+0000", 2024-09-12T18:36:57.083 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:57.083 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.083 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.084 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:57.084 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201054+0000", 2024-09-12T18:36:57.084 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:57.084 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.084 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.084 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:57.085 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201056+0000", 2024-09-12T18:36:57.085 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.99e-06 2024-09-12T18:36:57.085 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.085 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.085 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:57.085 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201068+0000", 2024-09-12T18:36:57.085 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2799000000000001e-05 2024-09-12T18:36:57.085 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.085 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.085 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:57.086 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201093+0000", 2024-09-12T18:36:57.086 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4766e-05 2024-09-12T18:36:57.086 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.086 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.086 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.086 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201115+0000", 2024-09-12T18:36:57.086 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1988999999999999e-05 2024-09-12T18:36:57.086 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.086 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.086 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:57.086 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201233+0000", 2024-09-12T18:36:57.086 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000118229 2024-09-12T18:36:57.086 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.087 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.087 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:57.087 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201273+0000", 2024-09-12T18:36:57.087 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9171999999999997e-05 2024-09-12T18:36:57.087 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.087 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.087 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:57.087 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.227080+0000", 2024-09-12T18:36:57.087 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025807611000000001 2024-09-12T18:36:57.087 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.087 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.087 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:57.087 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.227211+0000", 2024-09-12T18:36:57.087 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013083100000000001 2024-09-12T18:36:57.088 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:57.088 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:57.088 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:57.088 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.088 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.088 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121101 5.e 5:7e18e9ed:::benchmark_data_smithi073_23739_object121100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:57.088 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.209084+0000", 2024-09-12T18:36:57.088 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 16.811160830999999, 2024-09-12T18:36:57.088 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028988566, 2024-09-12T18:36:57.088 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:57.088 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:57.088 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:57.089 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:57.089 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:57.089 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:57.089 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121101 2024-09-12T18:36:57.089 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.089 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:57.089 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.089 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:57.089 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209084+0000", 2024-09-12T18:36:57.089 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:57.089 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.089 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.089 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:57.090 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209084+0000", 2024-09-12T18:36:57.090 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:57.090 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.090 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.090 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:57.090 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209087+0000", 2024-09-12T18:36:57.090 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6800000000000002e-06 2024-09-12T18:36:57.090 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.090 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.090 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:57.090 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209182+0000", 2024-09-12T18:36:57.090 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5084e-05 2024-09-12T18:36:57.090 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.090 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.091 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:57.091 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209212+0000", 2024-09-12T18:36:57.091 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9825e-05 2024-09-12T18:36:57.091 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.091 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.091 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.091 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209234+0000", 2024-09-12T18:36:57.091 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1416e-05 2024-09-12T18:36:57.091 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.091 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.091 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:57.091 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209497+0000", 2024-09-12T18:36:57.092 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026390400000000003 2024-09-12T18:36:57.092 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.092 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.092 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:57.092 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209810+0000", 2024-09-12T18:36:57.092 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000313023 2024-09-12T18:36:57.092 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.092 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.092 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:57.092 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.210468+0000", 2024-09-12T18:36:57.092 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00065779300000000005 2024-09-12T18:36:57.092 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.092 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.093 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:57.093 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.235905+0000", 2024-09-12T18:36:57.093 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025436881000000001 2024-09-12T18:36:57.093 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.093 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.093 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:57.093 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237797+0000", 2024-09-12T18:36:57.093 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001892007 2024-09-12T18:36:57.093 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.093 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.093 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:57.093 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237941+0000", 2024-09-12T18:36:57.094 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000143411 2024-09-12T18:36:57.094 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.094 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.094 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:57.094 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.238073+0000", 2024-09-12T18:36:57.094 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013254200000000001 2024-09-12T18:36:57.094 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:57.094 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:57.094 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:57.094 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.095 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.095 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121102 5.8 5:1f118f4b:::benchmark_data_smithi073_23739_object121101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:57.095 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.218682+0000", 2024-09-12T18:36:57.095 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 16.801563471000001, 2024-09-12T18:36:57.095 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024264885, 2024-09-12T18:36:57.095 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:57.095 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:57.095 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:57.095 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:57.095 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:57.095 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:57.095 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121102 2024-09-12T18:36:57.095 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.096 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:57.096 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.096 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:57.096 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218682+0000", 2024-09-12T18:36:57.096 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:57.096 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.096 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.096 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:57.096 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218682+0000", 2024-09-12T18:36:57.097 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:57.097 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.097 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.097 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:57.097 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218685+0000", 2024-09-12T18:36:57.097 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6059999999999999e-06 2024-09-12T18:36:57.097 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.097 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.097 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:57.097 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218743+0000", 2024-09-12T18:36:57.097 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7160999999999997e-05 2024-09-12T18:36:57.098 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.098 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.098 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:57.098 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218768+0000", 2024-09-12T18:36:57.098 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5052e-05 2024-09-12T18:36:57.098 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.098 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.098 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.098 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218785+0000", 2024-09-12T18:36:57.098 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7436999999999999e-05 2024-09-12T18:36:57.098 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.098 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.098 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:57.099 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218952+0000", 2024-09-12T18:36:57.099 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016691300000000001 2024-09-12T18:36:57.099 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.099 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.099 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:57.099 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.219437+0000", 2024-09-12T18:36:57.099 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048465900000000002 2024-09-12T18:36:57.099 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.099 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.099 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:57.099 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.219893+0000", 2024-09-12T18:36:57.099 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00045642799999999999 2024-09-12T18:36:57.099 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.100 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.100 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:57.100 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.226416+0000", 2024-09-12T18:36:57.100 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065225630000000003 2024-09-12T18:36:57.100 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.100 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.100 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:57.100 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242796+0000", 2024-09-12T18:36:57.100 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016379857000000001 2024-09-12T18:36:57.101 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.101 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.101 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:57.101 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242879+0000", 2024-09-12T18:36:57.101 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3913999999999997e-05 2024-09-12T18:36:57.101 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.101 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.101 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:57.101 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242947+0000", 2024-09-12T18:36:57.101 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7294999999999999e-05 2024-09-12T18:36:57.101 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:57.101 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:57.101 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:57.101 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.102 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.102 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121106 5.d 5:b4a9a221:::benchmark_data_smithi073_23739_object121105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:57.102 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:36:57.102 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 16.783065950000001, 2024-09-12T18:36:57.102 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.034882274999999997, 2024-09-12T18:36:57.102 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:57.102 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:57.102 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:57.102 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:57.102 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:57.102 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:57.102 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121106 2024-09-12T18:36:57.102 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.103 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:57.103 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.103 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:57.103 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:36:57.103 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:57.103 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.103 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.103 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:57.103 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:36:57.104 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:57.104 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.104 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.104 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:57.104 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237182+0000", 2024-09-12T18:36:57.104 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6019999999999998e-06 2024-09-12T18:36:57.104 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.104 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.104 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:57.105 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237257+0000", 2024-09-12T18:36:57.105 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5420999999999995e-05 2024-09-12T18:36:57.105 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.105 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.105 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:57.105 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237305+0000", 2024-09-12T18:36:57.105 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7207999999999999e-05 2024-09-12T18:36:57.105 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.105 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.105 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.105 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237325+0000", 2024-09-12T18:36:57.105 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0001e-05 2024-09-12T18:36:57.106 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.106 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.106 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:57.106 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237505+0000", 2024-09-12T18:36:57.106 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000180798 2024-09-12T18:36:57.106 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.106 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.106 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:57.106 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237764+0000", 2024-09-12T18:36:57.106 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025862299999999998 2024-09-12T18:36:57.106 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.107 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.107 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:57.107 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.238264+0000", 2024-09-12T18:36:57.107 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00050016100000000005 2024-09-12T18:36:57.107 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.107 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.107 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:57.108 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256525+0000", 2024-09-12T18:36:57.108 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018260508000000002 2024-09-12T18:36:57.108 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.108 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.108 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:57.108 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.271903+0000", 2024-09-12T18:36:57.109 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015378739000000001 2024-09-12T18:36:57.109 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.109 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.109 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:57.109 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.271999+0000", 2024-09-12T18:36:57.109 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5989000000000005e-05 2024-09-12T18:36:57.109 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.109 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.109 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:57.109 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272062+0000", 2024-09-12T18:36:57.109 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2224999999999995e-05 2024-09-12T18:36:57.110 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:57.110 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:57.110 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:57.110 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.110 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.110 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121112 5.d 5:b9a2d671:::benchmark_data_smithi073_23739_object121111:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:57.111 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.243446+0000", 2024-09-12T18:36:57.111 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 16.776799225000001, 2024-09-12T18:36:57.111 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.02889415, 2024-09-12T18:36:57.111 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:57.111 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:57.111 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:57.112 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:57.112 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:57.112 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:57.112 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121112 2024-09-12T18:36:57.112 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.112 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:57.112 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.113 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:57.113 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243446+0000", 2024-09-12T18:36:57.113 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:57.113 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.113 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.113 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:57.113 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243446+0000", 2024-09-12T18:36:57.113 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:57.113 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.113 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.113 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:57.113 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243448+0000", 2024-09-12T18:36:57.113 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0829999999999998e-06 2024-09-12T18:36:57.114 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.114 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.114 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:57.114 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243527+0000", 2024-09-12T18:36:57.114 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9173999999999998e-05 2024-09-12T18:36:57.114 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.114 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.114 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:57.114 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243549+0000", 2024-09-12T18:36:57.114 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1169e-05 2024-09-12T18:36:57.114 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.114 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.114 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.115 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243564+0000", 2024-09-12T18:36:57.116 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5866999999999999e-05 2024-09-12T18:36:57.116 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.116 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.116 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:57.116 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.249905+0000", 2024-09-12T18:36:57.116 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063410360000000004 2024-09-12T18:36:57.116 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.116 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.116 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:57.116 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.250166+0000", 2024-09-12T18:36:57.116 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026052999999999997 2024-09-12T18:36:57.116 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.116 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.117 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:57.117 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.250486+0000", 2024-09-12T18:36:57.117 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00032002700000000002 2024-09-12T18:36:57.117 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.117 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.117 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:57.117 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.259263+0000", 2024-09-12T18:36:57.117 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0087774770000000005 2024-09-12T18:36:57.117 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.117 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.117 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:57.117 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272186+0000", 2024-09-12T18:36:57.117 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.01292213 2024-09-12T18:36:57.118 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.118 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.118 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:57.118 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272267+0000", 2024-09-12T18:36:57.118 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1153e-05 2024-09-12T18:36:57.118 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.118 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.118 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:57.118 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272340+0000", 2024-09-12T18:36:57.118 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3504000000000006e-05 2024-09-12T18:36:57.118 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:57.118 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:57.118 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:57.118 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.118 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.119 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121114 5.d 5:b8870c11:::benchmark_data_smithi073_23739_object121113:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:57.119 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.243603+0000", 2024-09-12T18:36:57.119 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 16.776641974, 2024-09-12T18:36:57.119 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028945746000000001, 2024-09-12T18:36:57.119 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:57.119 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:57.119 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:57.119 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:57.119 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:57.119 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:57.119 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121114 2024-09-12T18:36:57.119 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.120 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:57.120 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.120 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:57.120 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243603+0000", 2024-09-12T18:36:57.120 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:57.120 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.120 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.120 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:57.120 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243603+0000", 2024-09-12T18:36:57.120 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:57.120 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.120 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.120 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:57.121 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243605+0000", 2024-09-12T18:36:57.121 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.268e-06 2024-09-12T18:36:57.121 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.121 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.121 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:57.121 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243674+0000", 2024-09-12T18:36:57.121 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9375000000000006e-05 2024-09-12T18:36:57.121 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.121 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.121 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:57.121 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243691+0000", 2024-09-12T18:36:57.121 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6517000000000001e-05 2024-09-12T18:36:57.122 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.122 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.122 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.122 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243702+0000", 2024-09-12T18:36:57.122 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1905999999999999e-05 2024-09-12T18:36:57.122 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.122 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.123 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:57.123 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.253789+0000", 2024-09-12T18:36:57.123 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.010086776 2024-09-12T18:36:57.123 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.123 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.123 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:57.124 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.253959+0000", 2024-09-12T18:36:57.124 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00017000000000000001 2024-09-12T18:36:57.124 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.124 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.124 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:57.124 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.254179+0000", 2024-09-12T18:36:57.125 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022003699999999999 2024-09-12T18:36:57.125 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.125 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.125 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:57.125 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.259330+0000", 2024-09-12T18:36:57.125 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0051511559999999996 2024-09-12T18:36:57.126 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.126 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.126 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:57.126 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272403+0000", 2024-09-12T18:36:57.126 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013072342000000001 2024-09-12T18:36:57.126 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.127 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.127 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:57.127 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272493+0000", 2024-09-12T18:36:57.127 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0595999999999998e-05 2024-09-12T18:36:57.127 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.127 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.128 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:57.128 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272549+0000", 2024-09-12T18:36:57.128 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5773000000000003e-05 2024-09-12T18:36:57.128 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:57.128 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:57.128 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:57.129 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.129 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.129 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121115 5.d 5:bd4a51ea:::benchmark_data_smithi073_23739_object121114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:57.129 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.245059+0000", 2024-09-12T18:36:57.129 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 16.775186300000001, 2024-09-12T18:36:57.130 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.02767406, 2024-09-12T18:36:57.130 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:57.130 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:57.130 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:57.130 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:57.130 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:57.131 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:57.131 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121115 2024-09-12T18:36:57.131 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.131 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:57.131 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.131 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:57.132 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245059+0000", 2024-09-12T18:36:57.132 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:57.132 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.132 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.132 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:57.133 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245059+0000", 2024-09-12T18:36:57.133 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:57.133 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.133 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.133 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:57.133 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245061+0000", 2024-09-12T18:36:57.134 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9759999999999998e-06 2024-09-12T18:36:57.134 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.134 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.134 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:57.134 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245111+0000", 2024-09-12T18:36:57.135 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9838e-05 2024-09-12T18:36:57.135 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.135 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.135 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:57.135 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245132+0000", 2024-09-12T18:36:57.135 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1469999999999999e-05 2024-09-12T18:36:57.136 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.136 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.136 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.136 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245146+0000", 2024-09-12T18:36:57.136 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3377000000000001e-05 2024-09-12T18:36:57.136 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.137 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.137 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:57.137 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256596+0000", 2024-09-12T18:36:57.137 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011450241999999999 2024-09-12T18:36:57.137 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.138 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.138 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:57.138 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256838+0000", 2024-09-12T18:36:57.138 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000242255 2024-09-12T18:36:57.138 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.138 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.139 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:57.139 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.257095+0000", 2024-09-12T18:36:57.139 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025679300000000001 2024-09-12T18:36:57.139 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.139 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.139 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:57.139 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.259928+0000", 2024-09-12T18:36:57.140 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0028326290000000001 2024-09-12T18:36:57.140 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.140 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.140 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:57.140 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272607+0000", 2024-09-12T18:36:57.141 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012679466 2024-09-12T18:36:57.141 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.141 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.141 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:57.141 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272681+0000", 2024-09-12T18:36:57.141 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3580999999999999e-05 2024-09-12T18:36:57.142 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.142 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.142 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:57.142 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272733+0000", 2024-09-12T18:36:57.142 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2432999999999998e-05 2024-09-12T18:36:57.142 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:57.143 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:57.143 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:57.143 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.143 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.143 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121148 5.4 5:2a9bde06:::benchmark_data_smithi073_23739_object121147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:57.144 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.281423+0000", 2024-09-12T18:36:57.144 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 16.738822658, 2024-09-12T18:36:57.144 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025774785000000001, 2024-09-12T18:36:57.144 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:57.144 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:57.144 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:57.145 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:57.145 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:57.145 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:57.145 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121148 2024-09-12T18:36:57.145 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.145 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:57.146 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.146 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:57.146 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281423+0000", 2024-09-12T18:36:57.146 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:57.146 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.146 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.147 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:57.147 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281423+0000", 2024-09-12T18:36:57.147 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:57.147 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.147 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.147 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:57.147 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281424+0000", 2024-09-12T18:36:57.148 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.048e-06 2024-09-12T18:36:57.148 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.148 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.148 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:57.148 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281496+0000", 2024-09-12T18:36:57.148 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2099000000000002e-05 2024-09-12T18:36:57.149 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.149 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.149 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:57.149 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281509+0000", 2024-09-12T18:36:57.149 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3379e-05 2024-09-12T18:36:57.149 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.149 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.150 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.150 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281515+0000", 2024-09-12T18:36:57.150 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.28e-06 2024-09-12T18:36:57.150 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.150 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.150 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:57.150 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281688+0000", 2024-09-12T18:36:57.150 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00017203100000000001 2024-09-12T18:36:57.150 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.150 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.150 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:57.150 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281834+0000", 2024-09-12T18:36:57.150 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014645899999999999 2024-09-12T18:36:57.151 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.151 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.151 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:57.151 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.282319+0000", 2024-09-12T18:36:57.151 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048535000000000001 2024-09-12T18:36:57.151 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.151 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.151 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:57.151 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307086+0000", 2024-09-12T18:36:57.151 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024766989999999999 2024-09-12T18:36:57.151 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.151 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.152 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:57.152 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307108+0000", 2024-09-12T18:36:57.152 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1795999999999999e-05 2024-09-12T18:36:57.152 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.152 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.152 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:57.153 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307157+0000", 2024-09-12T18:36:57.153 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8729000000000001e-05 2024-09-12T18:36:57.153 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.153 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.153 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:57.153 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307197+0000", 2024-09-12T18:36:57.153 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0624000000000003e-05 2024-09-12T18:36:57.153 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:57.153 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:57.153 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:57.153 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.154 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.154 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121155 5.4 5:2af257d1:::benchmark_data_smithi073_23739_object121154:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:57.154 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.283163+0000", 2024-09-12T18:36:57.154 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 16.737081982999999, 2024-09-12T18:36:57.154 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024186485000000001, 2024-09-12T18:36:57.154 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:57.154 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:57.154 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:57.154 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:57.154 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:57.154 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:57.154 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121155 2024-09-12T18:36:57.154 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.154 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:57.155 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.155 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:57.155 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283163+0000", 2024-09-12T18:36:57.155 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:57.155 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.155 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.155 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:57.155 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283163+0000", 2024-09-12T18:36:57.155 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:57.155 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.155 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.155 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:57.155 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283165+0000", 2024-09-12T18:36:57.155 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.748e-06 2024-09-12T18:36:57.156 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.156 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.156 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:57.156 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283218+0000", 2024-09-12T18:36:57.156 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2695000000000003e-05 2024-09-12T18:36:57.156 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.156 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.156 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:57.156 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283244+0000", 2024-09-12T18:36:57.156 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6072e-05 2024-09-12T18:36:57.156 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.156 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.156 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.157 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283257+0000", 2024-09-12T18:36:57.157 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3054000000000001e-05 2024-09-12T18:36:57.157 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.157 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.157 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:57.157 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.294509+0000", 2024-09-12T18:36:57.157 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011251677999999999 2024-09-12T18:36:57.157 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.157 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.157 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:57.157 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.294705+0000", 2024-09-12T18:36:57.157 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000196369 2024-09-12T18:36:57.157 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.158 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.158 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:57.158 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.294907+0000", 2024-09-12T18:36:57.158 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020184700000000001 2024-09-12T18:36:57.158 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.158 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.158 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:57.158 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307208+0000", 2024-09-12T18:36:57.158 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012301068 2024-09-12T18:36:57.158 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.158 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.158 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:57.158 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307273+0000", 2024-09-12T18:36:57.158 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5611000000000006e-05 2024-09-12T18:36:57.159 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.159 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.159 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:57.159 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307320+0000", 2024-09-12T18:36:57.159 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6220999999999997e-05 2024-09-12T18:36:57.159 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.159 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.159 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:57.159 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307350+0000", 2024-09-12T18:36:57.159 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0122000000000001e-05 2024-09-12T18:36:57.159 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:57.159 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:57.159 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:57.159 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.160 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.160 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121160 5.b 5:d4730c8e:::benchmark_data_smithi073_23739_object121159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:36:57.160 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.289262+0000", 2024-09-12T18:36:57.160 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 16.730982966999999, 2024-09-12T18:36:57.160 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024618870000000001, 2024-09-12T18:36:57.160 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:57.160 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:57.160 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:57.160 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:57.161 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:57.161 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:57.161 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121160 2024-09-12T18:36:57.161 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.161 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:57.161 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.161 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:57.161 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289262+0000", 2024-09-12T18:36:57.161 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:57.161 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.161 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.162 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:57.162 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289262+0000", 2024-09-12T18:36:57.162 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:57.162 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.162 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.162 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:57.162 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289264+0000", 2024-09-12T18:36:57.162 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.945e-06 2024-09-12T18:36:57.162 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.162 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.162 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:57.162 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289331+0000", 2024-09-12T18:36:57.163 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6594999999999995e-05 2024-09-12T18:36:57.163 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.163 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.163 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:57.163 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289359+0000", 2024-09-12T18:36:57.163 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7988999999999999e-05 2024-09-12T18:36:57.163 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.163 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.163 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.163 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289375+0000", 2024-09-12T18:36:57.164 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5639000000000001e-05 2024-09-12T18:36:57.164 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.164 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.164 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:57.164 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289515+0000", 2024-09-12T18:36:57.164 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000140254 2024-09-12T18:36:57.164 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.164 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.164 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:57.164 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289740+0000", 2024-09-12T18:36:57.164 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022513500000000001 2024-09-12T18:36:57.164 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.164 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.165 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:57.165 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.290232+0000", 2024-09-12T18:36:57.165 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00049247500000000003 2024-09-12T18:36:57.165 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.165 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.165 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:57.165 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.312221+0000", 2024-09-12T18:36:57.165 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.021988939999999998 2024-09-12T18:36:57.165 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.166 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.166 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:57.166 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.313807+0000", 2024-09-12T18:36:57.166 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015859100000000001 2024-09-12T18:36:57.166 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.166 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.166 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:57.166 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.313852+0000", 2024-09-12T18:36:57.166 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4305999999999999e-05 2024-09-12T18:36:57.167 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.167 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.167 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:57.167 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.313881+0000", 2024-09-12T18:36:57.167 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9682000000000001e-05 2024-09-12T18:36:57.167 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:57.167 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:57.167 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:57.168 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.168 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.168 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:131551 5.d 5:b8f8c77a:::benchmark_data_smithi073_23739_object131550:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:36:57.168 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:45.499878+0000", 2024-09-12T18:36:57.168 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 11.520367036, 2024-09-12T18:36:57.168 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.027478433, 2024-09-12T18:36:57.168 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:57.168 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:57.169 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:57.169 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:57.169 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:57.169 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:57.169 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 131551 2024-09-12T18:36:57.169 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.169 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:57.169 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.170 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:57.170 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499878+0000", 2024-09-12T18:36:57.170 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:57.170 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.170 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.170 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:57.170 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499878+0000", 2024-09-12T18:36:57.170 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:57.170 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.171 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.171 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:57.171 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499879+0000", 2024-09-12T18:36:57.171 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.92e-07 2024-09-12T18:36:57.171 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.171 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.171 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:57.171 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499946+0000", 2024-09-12T18:36:57.171 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6712999999999996e-05 2024-09-12T18:36:57.172 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.172 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.172 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:57.172 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499953+0000", 2024-09-12T18:36:57.172 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5519999999999999e-06 2024-09-12T18:36:57.173 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.173 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.173 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.173 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499959+0000", 2024-09-12T18:36:57.173 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0430000000000004e-06 2024-09-12T18:36:57.173 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.174 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.174 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:57.174 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.500004+0000", 2024-09-12T18:36:57.174 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5058000000000001e-05 2024-09-12T18:36:57.174 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.174 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.174 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:57.175 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.500121+0000", 2024-09-12T18:36:57.175 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000116747 2024-09-12T18:36:57.175 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.175 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.175 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:57.175 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.500283+0000", 2024-09-12T18:36:57.175 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016190599999999999 2024-09-12T18:36:57.175 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.176 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.176 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:57.176 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.504017+0000", 2024-09-12T18:36:57.176 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003734125 2024-09-12T18:36:57.176 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.176 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.176 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:57.176 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.527224+0000", 2024-09-12T18:36:57.177 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.023206724000000001 2024-09-12T18:36:57.177 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.177 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.177 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:57.177 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.527290+0000", 2024-09-12T18:36:57.177 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5778999999999995e-05 2024-09-12T18:36:57.178 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.178 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.178 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:57.178 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.527357+0000", 2024-09-12T18:36:57.178 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7094000000000005e-05 2024-09-12T18:36:57.178 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:57.179 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:57.179 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:57.179 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.179 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.179 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:131556 5.0 5:01fc649a:::benchmark_data_smithi073_23739_object131555:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:36:57.179 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:45.502449+0000", 2024-09-12T18:36:57.180 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 11.517796663, 2024-09-12T18:36:57.180 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.022597466, 2024-09-12T18:36:57.180 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:57.180 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:57.180 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:57.180 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:57.180 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:57.180 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:57.180 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 131556 2024-09-12T18:36:57.180 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.181 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:57.181 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.181 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:57.181 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502449+0000", 2024-09-12T18:36:57.181 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:57.181 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.181 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.181 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:57.181 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502449+0000", 2024-09-12T18:36:57.181 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:57.181 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.181 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.181 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:57.182 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502449+0000", 2024-09-12T18:36:57.182 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.15e-07 2024-09-12T18:36:57.182 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.182 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.182 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:57.182 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502481+0000", 2024-09-12T18:36:57.182 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1671999999999998e-05 2024-09-12T18:36:57.182 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.182 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.182 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:57.182 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502487+0000", 2024-09-12T18:36:57.182 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5270000000000004e-06 2024-09-12T18:36:57.182 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.183 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.183 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.183 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502492+0000", 2024-09-12T18:36:57.183 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0590000000000002e-06 2024-09-12T18:36:57.183 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.183 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.183 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:57.183 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502957+0000", 2024-09-12T18:36:57.183 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00046515 2024-09-12T18:36:57.183 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.183 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.183 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:57.183 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.503100+0000", 2024-09-12T18:36:57.183 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000142886 2024-09-12T18:36:57.183 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.184 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.184 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0,2", 2024-09-12T18:36:57.184 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.503268+0000", 2024-09-12T18:36:57.184 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016746299999999999 2024-09-12T18:36:57.184 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.184 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.184 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:57.184 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.506821+0000", 2024-09-12T18:36:57.184 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035528640000000002 2024-09-12T18:36:57.184 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.184 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.184 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:57.184 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.507126+0000", 2024-09-12T18:36:57.185 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030543399999999999 2024-09-12T18:36:57.185 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.185 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.185 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:57.185 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.524851+0000", 2024-09-12T18:36:57.185 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017724521999999999 2024-09-12T18:36:57.185 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.185 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.185 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:57.185 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.524920+0000", 2024-09-12T18:36:57.185 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9386000000000003e-05 2024-09-12T18:36:57.185 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.186 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.186 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:57.186 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.525046+0000", 2024-09-12T18:36:57.186 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000126088 2024-09-12T18:36:57.186 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:57.186 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:57.186 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:57.186 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.186 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.186 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:131557 5.0 5:0bc216b5:::benchmark_data_smithi073_23739_object131556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:36:57.187 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:45.502523+0000", 2024-09-12T18:36:57.187 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 11.517722391, 2024-09-12T18:36:57.187 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024077715, 2024-09-12T18:36:57.187 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:57.187 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:57.187 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:57.187 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:57.187 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:57.187 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:57.187 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 131557 2024-09-12T18:36:57.187 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.187 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:57.187 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.188 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:57.188 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502523+0000", 2024-09-12T18:36:57.188 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:57.188 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.188 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.188 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:57.188 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502523+0000", 2024-09-12T18:36:57.188 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:57.188 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.189 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.189 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:57.189 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502523+0000", 2024-09-12T18:36:57.189 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3200000000000005e-07 2024-09-12T18:36:57.189 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.189 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.190 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:57.190 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502601+0000", 2024-09-12T18:36:57.190 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7344999999999999e-05 2024-09-12T18:36:57.190 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.190 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.190 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:57.191 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502611+0000", 2024-09-12T18:36:57.191 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0407999999999999e-05 2024-09-12T18:36:57.191 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.191 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.191 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.191 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502615+0000", 2024-09-12T18:36:57.191 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6739999999999999e-06 2024-09-12T18:36:57.192 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.192 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.192 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:57.192 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.505138+0000", 2024-09-12T18:36:57.192 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025231709999999998 2024-09-12T18:36:57.192 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.192 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.193 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:57.193 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.505244+0000", 2024-09-12T18:36:57.193 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000106006 2024-09-12T18:36:57.193 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.193 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.193 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0,2", 2024-09-12T18:36:57.193 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.505357+0000", 2024-09-12T18:36:57.193 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000113038 2024-09-12T18:36:57.194 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.194 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.194 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:57.194 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.507393+0000", 2024-09-12T18:36:57.194 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020356269999999999 2024-09-12T18:36:57.195 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.195 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.195 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:36:57.195 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.508538+0000", 2024-09-12T18:36:57.195 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001145016 2024-09-12T18:36:57.195 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.195 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.196 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:57.196 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.526436+0000", 2024-09-12T18:36:57.196 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017898121999999999 2024-09-12T18:36:57.196 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.196 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.196 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:36:57.197 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.526500+0000", 2024-09-12T18:36:57.197 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.3954999999999993e-05 2024-09-12T18:36:57.197 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:57.197 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:57.197 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:36:57.197 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.526601+0000", 2024-09-12T18:36:57.197 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000100821 2024-09-12T18:36:57.197 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:57.197 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:57.198 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:57.198 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:57.198 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:57.198 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:57.199 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:36:57.200 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:57.195+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:57.300 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:57.295+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:57.357 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:36:57.358 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:36:57.358 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.358 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:155249 5.7 5:e15ea391:::benchmark_data_smithi073_23739_object22972:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T18:36:57.358 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:57.351405+0000", 2024-09-12T18:36:57.358 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0046907329999999999, 2024-09-12T18:36:57.358 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0047157249999999996, 2024-09-12T18:36:57.358 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:57.358 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:57.358 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:57.358 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:57.358 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:57.358 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:57.358 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 155249 2024-09-12T18:36:57.359 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.359 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:57.359 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.359 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:57.359 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:57.351405+0000", 2024-09-12T18:36:57.359 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.359 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.359 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.359 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:57.359 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:57.351405+0000", 2024-09-12T18:36:57.359 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.359 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.359 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.359 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:57.360 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:57.351406+0000", 2024-09-12T18:36:57.360 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.6700000000000003e-07 2024-09-12T18:36:57.360 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.360 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.360 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:57.360 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:57.351409+0000", 2024-09-12T18:36:57.360 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.0960000000000001e-06 2024-09-12T18:36:57.361 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.361 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.361 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:57.361 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:57.351422+0000", 2024-09-12T18:36:57.361 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2934e-05 2024-09-12T18:36:57.361 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.362 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.362 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.362 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:57.351428+0000", 2024-09-12T18:36:57.362 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9089999999999997e-06 2024-09-12T18:36:57.362 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.362 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.362 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:57.362 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:57.351480+0000", 2024-09-12T18:36:57.362 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2160000000000002e-05 2024-09-12T18:36:57.362 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.363 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.363 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:57.363 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:57.351602+0000", 2024-09-12T18:36:57.363 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012230800000000001 2024-09-12T18:36:57.363 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.363 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.363 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:57.364 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:57.351715+0000", 2024-09-12T18:36:57.364 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000113235 2024-09-12T18:36:57.364 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.364 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.365 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:57.365 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:57.355783+0000", 2024-09-12T18:36:57.365 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0040678010000000002 2024-09-12T18:36:57.365 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.365 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:57.366 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.366 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.366 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.368 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:155245 5.3 e56/21 5:c69e4266:::benchmark_data_smithi073_23739_object22968:head v 56'9561, mlcod=56'9558)", 2024-09-12T18:36:57.368 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:57.351618+0000", 2024-09-12T18:36:57.368 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0044776870000000002, 2024-09-12T18:36:57.368 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0045656230000000004, 2024-09-12T18:36:57.368 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:57.368 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:57.368 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:57.368 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:57.368 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.368 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:57.368 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:57.351618+0000", 2024-09-12T18:36:57.368 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.369 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.369 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.369 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:57.369 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:57.351618+0000", 2024-09-12T18:36:57.369 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.369 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.369 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.369 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:57.370 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:57.351619+0000", 2024-09-12T18:36:57.370 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.0800000000000004e-07 2024-09-12T18:36:57.370 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.370 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.370 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:57.371 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:57.351624+0000", 2024-09-12T18:36:57.371 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6550000000000003e-06 2024-09-12T18:36:57.371 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.371 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.371 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:57.372 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:57.351632+0000", 2024-09-12T18:36:57.372 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.3469999999999999e-06 2024-09-12T18:36:57.372 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.372 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.372 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.372 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:57.351638+0000", 2024-09-12T18:36:57.372 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4119999999999998e-06 2024-09-12T18:36:57.373 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.373 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.373 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:57.373 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:57.351686+0000", 2024-09-12T18:36:57.373 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.7247999999999999e-05 2024-09-12T18:36:57.373 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.374 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.374 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:57.374 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:57.351704+0000", 2024-09-12T18:36:57.374 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.8437e-05 2024-09-12T18:36:57.374 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.374 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:57.374 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.374 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.375 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.375 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:155248 5.c e56/21 5:39c2b552:::benchmark_data_smithi073_23739_object22971:head v 56'9670, mlcod=56'9666)", 2024-09-12T18:36:57.375 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:57.353822+0000", 2024-09-12T18:36:57.375 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0022740880000000001, 2024-09-12T18:36:57.375 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.002403255, 2024-09-12T18:36:57.375 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:57.375 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:57.376 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:57.376 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:57.376 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.376 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:57.376 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:57.353822+0000", 2024-09-12T18:36:57.376 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.377 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.377 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.377 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:57.377 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:57.353822+0000", 2024-09-12T18:36:57.377 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.377 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.378 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.378 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:57.378 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:57.353822+0000", 2024-09-12T18:36:57.378 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.6000000000000004e-07 2024-09-12T18:36:57.378 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.378 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.378 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:57.378 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:57.353827+0000", 2024-09-12T18:36:57.379 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.5369999999999999e-06 2024-09-12T18:36:57.379 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.379 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.379 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:57.379 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:57.353838+0000", 2024-09-12T18:36:57.379 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0589e-05 2024-09-12T18:36:57.379 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.379 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.379 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.379 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:57.353844+0000", 2024-09-12T18:36:57.379 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.1399999999999997e-06 2024-09-12T18:36:57.380 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.380 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.380 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:57.380 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:57.353889+0000", 2024-09-12T18:36:57.380 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.5528999999999997e-05 2024-09-12T18:36:57.380 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.380 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.380 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:57.380 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:57.353901+0000", 2024-09-12T18:36:57.381 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2267e-05 2024-09-12T18:36:57.381 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.381 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:57.381 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.381 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.381 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.381 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:155254 5.3 e56/21 5:c94a8219:::benchmark_data_smithi073_23739_object22977:head v 56'9562, mlcod=56'9558)", 2024-09-12T18:36:57.381 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:57.355693+0000", 2024-09-12T18:36:57.381 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.000402815, 2024-09-12T18:36:57.382 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00056978300000000003, 2024-09-12T18:36:57.382 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:57.382 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:57.382 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:57.382 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:57.382 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.382 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:57.382 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:57.355693+0000", 2024-09-12T18:36:57.383 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.383 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.383 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.383 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:57.383 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:57.355693+0000", 2024-09-12T18:36:57.383 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.383 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.383 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.383 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:57.384 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:57.355694+0000", 2024-09-12T18:36:57.384 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2600000000000002e-07 2024-09-12T18:36:57.384 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.384 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.384 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:57.384 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:57.355699+0000", 2024-09-12T18:36:57.384 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.259e-06 2024-09-12T18:36:57.385 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.385 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.385 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:57.385 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:57.355708+0000", 2024-09-12T18:36:57.385 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.003e-06 2024-09-12T18:36:57.385 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.385 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.385 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.385 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:57.355712+0000", 2024-09-12T18:36:57.386 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.216e-06 2024-09-12T18:36:57.386 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.386 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.386 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:57.386 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:57.355769+0000", 2024-09-12T18:36:57.386 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.6711e-05 2024-09-12T18:36:57.386 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.386 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.387 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:57.387 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:57.355788+0000", 2024-09-12T18:36:57.387 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.8658999999999999e-05 2024-09-12T18:36:57.387 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.387 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:57.387 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.387 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.387 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.388 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:155250 5.c e56/21 5:390a0ae5:::benchmark_data_smithi073_23739_object22973:head v 56'9671, mlcod=56'9666)", 2024-09-12T18:36:57.388 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:57.356172+0000", 2024-09-12T18:36:57.388 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 4294967295.9999242, 2024-09-12T18:36:57.388 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013546000000000001, 2024-09-12T18:36:57.388 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:57.388 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:57.388 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:57.388 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:57.389 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.389 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:57.389 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:57.356172+0000", 2024-09-12T18:36:57.389 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.389 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.389 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.389 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:57.389 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:57.356172+0000", 2024-09-12T18:36:57.390 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.390 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.390 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.390 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:57.390 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:57.356173+0000", 2024-09-12T18:36:57.390 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.6799999999999999e-07 2024-09-12T18:36:57.390 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.390 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.390 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:57.391 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:57.356178+0000", 2024-09-12T18:36:57.391 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.9069999999999998e-06 2024-09-12T18:36:57.391 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.391 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.391 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:57.391 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:57.356184+0000", 2024-09-12T18:36:57.391 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.049e-06 2024-09-12T18:36:57.392 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.392 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.392 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.392 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:57.356190+0000", 2024-09-12T18:36:57.392 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9229999999999999e-06 2024-09-12T18:36:57.392 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.392 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.392 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:57.393 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:57.356234+0000", 2024-09-12T18:36:57.393 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4490999999999998e-05 2024-09-12T18:36:57.393 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.393 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.393 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:57.393 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:57.356252+0000", 2024-09-12T18:36:57.393 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7737e-05 2024-09-12T18:36:57.394 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.394 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:57.394 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.394 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.394 INFO:teuthology.orchestra.run.smithi162.stdout: ], 2024-09-12T18:36:57.394 INFO:teuthology.orchestra.run.smithi162.stdout: "num_ops": 5 2024-09-12T18:36:57.394 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:36:57.396 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:36:57.400 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:57.394+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:57.466 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is set 2024-09-12T18:36:57.504 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:57.499+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:57.554 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:36:57.555 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [], 2024-09-12T18:36:57.555 INFO:teuthology.orchestra.run.smithi162.stdout: "complaint_time": 30, 2024-09-12T18:36:57.555 INFO:teuthology.orchestra.run.smithi162.stdout: "num_blocked_ops": 0 2024-09-12T18:36:57.555 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:36:57.574 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:36:57.603 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:57.595+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:57.706 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:57.699+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:57.783 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:36:57.783 INFO:teuthology.orchestra.run.smithi162.stdout: "size": 20, 2024-09-12T18:36:57.783 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 600, 2024-09-12T18:36:57.783 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:36:57.783 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.783 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4154.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:36:57.783 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:36:57.783 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 103.803468634, 2024-09-12T18:36:57.784 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025950709999999998, 2024-09-12T18:36:57.784 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:57.784 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:57.784 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:57.784 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:57.784 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4154", 2024-09-12T18:36:57.784 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/745129001", 2024-09-12T18:36:57.784 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 124 2024-09-12T18:36:57.784 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.784 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:57.784 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.784 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:57.784 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:36:57.785 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.785 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.785 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.785 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:57.785 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:36:57.785 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.785 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.785 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.785 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:57.785 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976562+0000", 2024-09-12T18:36:57.785 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.2999999999999999e-07 2024-09-12T18:36:57.785 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.785 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.785 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:57.786 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976567+0000", 2024-09-12T18:36:57.786 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3430000000000003e-06 2024-09-12T18:36:57.786 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.786 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.786 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:57.786 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976576+0000", 2024-09-12T18:36:57.786 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8070000000000006e-06 2024-09-12T18:36:57.786 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.786 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.786 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.786 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976583+0000", 2024-09-12T18:36:57.786 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9959999999999996e-06 2024-09-12T18:36:57.786 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.786 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.787 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:57.787 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997107+0000", 2024-09-12T18:36:57.787 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.020524106 2024-09-12T18:36:57.787 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.787 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.787 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:57.787 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997225+0000", 2024-09-12T18:36:57.787 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000117909 2024-09-12T18:36:57.787 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.787 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.787 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:57.787 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997407+0000", 2024-09-12T18:36:57.787 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00018175900000000001 2024-09-12T18:36:57.787 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.788 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.788 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:57.788 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998839+0000", 2024-09-12T18:36:57.788 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001432539 2024-09-12T18:36:57.788 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.788 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.788 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:57.788 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002319+0000", 2024-09-12T18:36:57.788 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0034803529999999998 2024-09-12T18:36:57.788 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.788 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.788 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:57.788 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002405+0000", 2024-09-12T18:36:57.789 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5434999999999998e-05 2024-09-12T18:36:57.789 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.789 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.789 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:57.789 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002512+0000", 2024-09-12T18:36:57.789 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010663299999999999 2024-09-12T18:36:57.789 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.789 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:57.789 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.789 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.790 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.790 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:57.790 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:36:57.790 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 92.138671126999995, 2024-09-12T18:36:57.790 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025127867000000002, 2024-09-12T18:36:57.790 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:57.790 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:57.790 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:57.790 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:57.791 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.791 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:57.791 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:36:57.791 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.791 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.791 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.791 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:57.791 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:36:57.791 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.791 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.791 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.791 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:57.791 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641362+0000", 2024-09-12T18:36:57.792 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.2569999999999999e-06 2024-09-12T18:36:57.792 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.792 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.792 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:57.792 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641374+0000", 2024-09-12T18:36:57.792 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2696e-05 2024-09-12T18:36:57.792 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.792 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.792 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:57.792 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641403+0000", 2024-09-12T18:36:57.792 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.8756999999999999e-05 2024-09-12T18:36:57.792 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.792 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.793 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.793 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641430+0000", 2024-09-12T18:36:57.793 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.6452999999999999e-05 2024-09-12T18:36:57.793 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.793 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.793 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:57.793 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641585+0000", 2024-09-12T18:36:57.793 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000155799 2024-09-12T18:36:57.793 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.793 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.793 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:57.793 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641753+0000", 2024-09-12T18:36:57.793 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000167868 2024-09-12T18:36:57.794 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.794 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.794 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:57.794 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641916+0000", 2024-09-12T18:36:57.794 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000162903 2024-09-12T18:36:57.794 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.794 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.794 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:57.794 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653655+0000", 2024-09-12T18:36:57.794 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011738879000000001 2024-09-12T18:36:57.795 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.795 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.795 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:57.795 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665515+0000", 2024-09-12T18:36:57.795 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011859915 2024-09-12T18:36:57.795 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.795 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.795 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:57.795 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665646+0000", 2024-09-12T18:36:57.795 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013122599999999999 2024-09-12T18:36:57.795 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.795 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.795 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:57.796 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666486+0000", 2024-09-12T18:36:57.796 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00084011399999999999 2024-09-12T18:36:57.796 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.796 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:57.796 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.796 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.796 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.796 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:57.796 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:36:57.796 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 92.138556664000006, 2024-09-12T18:36:57.796 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025384584000000002, 2024-09-12T18:36:57.796 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:57.796 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:57.797 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:57.797 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:57.797 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.797 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:57.797 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:36:57.797 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.797 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.797 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.797 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:57.797 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:36:57.797 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.797 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.797 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.797 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:57.798 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641474+0000", 2024-09-12T18:36:57.798 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.39e-06 2024-09-12T18:36:57.798 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.798 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.798 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:57.798 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641482+0000", 2024-09-12T18:36:57.798 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3499999999999999e-06 2024-09-12T18:36:57.798 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.798 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.798 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:57.798 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641534+0000", 2024-09-12T18:36:57.798 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2533e-05 2024-09-12T18:36:57.798 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.798 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.799 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.799 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641551+0000", 2024-09-12T18:36:57.799 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6515999999999999e-05 2024-09-12T18:36:57.799 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.799 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.799 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:57.799 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642630+0000", 2024-09-12T18:36:57.799 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001079705 2024-09-12T18:36:57.799 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.799 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.799 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:57.800 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642909+0000", 2024-09-12T18:36:57.800 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027859800000000002 2024-09-12T18:36:57.800 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.800 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.800 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:57.800 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643137+0000", 2024-09-12T18:36:57.800 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022803799999999999 2024-09-12T18:36:57.800 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.800 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.800 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:57.800 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653669+0000", 2024-09-12T18:36:57.801 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010532032 2024-09-12T18:36:57.801 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.801 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.801 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:57.801 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666624+0000", 2024-09-12T18:36:57.801 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012954940999999999 2024-09-12T18:36:57.801 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.801 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.801 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:57.801 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666762+0000", 2024-09-12T18:36:57.801 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000137668 2024-09-12T18:36:57.801 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.802 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.802 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:57.802 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666857+0000", 2024-09-12T18:36:57.802 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.5812999999999999e-05 2024-09-12T18:36:57.802 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.802 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:57.802 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.802 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.802 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.802 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:57.802 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:36:57.802 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 92.138428868999995, 2024-09-12T18:36:57.802 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025661562999999998, 2024-09-12T18:36:57.802 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:57.803 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:57.803 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:57.803 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:57.803 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.803 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:57.803 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:36:57.803 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.803 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.803 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.803 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:57.804 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:36:57.804 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.804 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.804 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.804 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:57.804 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641602+0000", 2024-09-12T18:36:57.804 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3540000000000001e-06 2024-09-12T18:36:57.804 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.804 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.804 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:57.804 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641637+0000", 2024-09-12T18:36:57.805 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5145999999999999e-05 2024-09-12T18:36:57.805 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.805 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.805 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:57.805 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641659+0000", 2024-09-12T18:36:57.805 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2249999999999999e-05 2024-09-12T18:36:57.805 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.805 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.805 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.805 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641675+0000", 2024-09-12T18:36:57.805 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6059999999999999e-05 2024-09-12T18:36:57.805 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.805 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.806 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:57.806 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644570+0000", 2024-09-12T18:36:57.806 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028947069999999998 2024-09-12T18:36:57.806 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.806 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.806 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:57.806 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644900+0000", 2024-09-12T18:36:57.806 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000329401 2024-09-12T18:36:57.806 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.806 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.806 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:57.807 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645235+0000", 2024-09-12T18:36:57.807 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000335874 2024-09-12T18:36:57.807 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.807 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.807 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:57.807 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655459+0000", 2024-09-12T18:36:57.807 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010223441999999999 2024-09-12T18:36:57.807 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.807 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.807 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:57.808 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667028+0000", 2024-09-12T18:36:57.808 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011568673999999999 2024-09-12T18:36:57.808 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.808 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.808 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:57.808 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667163+0000", 2024-09-12T18:36:57.808 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013525500000000001 2024-09-12T18:36:57.808 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.808 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.808 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:57.809 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667262+0000", 2024-09-12T18:36:57.809 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9400000000000004e-05 2024-09-12T18:36:57.809 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.809 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:57.809 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.809 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.809 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.809 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:57.809 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:36:57.809 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 92.138327048999997, 2024-09-12T18:36:57.809 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025971339, 2024-09-12T18:36:57.809 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:57.810 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:57.810 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:57.810 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:57.810 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.810 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:57.810 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:36:57.810 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.810 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.810 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.810 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:57.811 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:36:57.811 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.811 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.811 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.811 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:57.811 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641704+0000", 2024-09-12T18:36:57.812 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.297e-06 2024-09-12T18:36:57.812 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.812 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.812 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:57.812 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641712+0000", 2024-09-12T18:36:57.813 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.9060000000000002e-06 2024-09-12T18:36:57.813 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.813 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.813 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:57.813 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641731+0000", 2024-09-12T18:36:57.813 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9083e-05 2024-09-12T18:36:57.814 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.814 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.814 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.814 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641745+0000", 2024-09-12T18:36:57.814 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4066999999999999e-05 2024-09-12T18:36:57.814 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.815 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.815 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:57.815 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646529+0000", 2024-09-12T18:36:57.815 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.004784033 2024-09-12T18:36:57.815 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.815 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.815 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:57.816 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646727+0000", 2024-09-12T18:36:57.816 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019841800000000001 2024-09-12T18:36:57.816 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.816 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.816 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:57.816 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647057+0000", 2024-09-12T18:36:57.817 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032926800000000002 2024-09-12T18:36:57.817 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.817 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.817 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:57.817 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655475+0000", 2024-09-12T18:36:57.817 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0084186250000000008 2024-09-12T18:36:57.817 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.818 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.818 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:57.818 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667424+0000", 2024-09-12T18:36:57.818 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011949257 2024-09-12T18:36:57.818 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.818 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.819 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:57.819 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667573+0000", 2024-09-12T18:36:57.819 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014851900000000001 2024-09-12T18:36:57.819 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.819 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.820 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:57.820 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667674+0000", 2024-09-12T18:36:57.820 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010086600000000001 2024-09-12T18:36:57.820 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.820 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:57.820 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.820 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.821 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.821 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:57.821 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:36:57.821 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 92.138264660000004, 2024-09-12T18:36:57.821 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026215008000000001, 2024-09-12T18:36:57.821 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:57.821 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:57.822 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:57.822 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:57.822 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.822 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:57.822 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:36:57.822 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.822 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.822 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.823 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:57.823 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:36:57.823 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.823 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.823 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.823 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:57.823 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641766+0000", 2024-09-12T18:36:57.824 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1200000000000001e-06 2024-09-12T18:36:57.824 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.824 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.824 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:57.824 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641775+0000", 2024-09-12T18:36:57.824 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.2499999999999995e-06 2024-09-12T18:36:57.825 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.825 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.825 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:57.825 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641793+0000", 2024-09-12T18:36:57.825 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7773000000000001e-05 2024-09-12T18:36:57.826 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.826 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.826 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.826 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641807+0000", 2024-09-12T18:36:57.826 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3814e-05 2024-09-12T18:36:57.826 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.827 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.827 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:57.827 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647626+0000", 2024-09-12T18:36:57.827 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0058193050000000003 2024-09-12T18:36:57.827 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.827 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.828 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:57.828 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647937+0000", 2024-09-12T18:36:57.828 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031112400000000003 2024-09-12T18:36:57.828 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.828 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.828 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:57.828 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648239+0000", 2024-09-12T18:36:57.828 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00030227500000000002 2024-09-12T18:36:57.829 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.829 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.829 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:57.829 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655487+0000", 2024-09-12T18:36:57.829 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072479129999999999 2024-09-12T18:36:57.829 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.829 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.829 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:57.830 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667823+0000", 2024-09-12T18:36:57.830 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012335505 2024-09-12T18:36:57.830 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.830 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.830 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:57.830 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667908+0000", 2024-09-12T18:36:57.830 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4843000000000001e-05 2024-09-12T18:36:57.830 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.831 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.831 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:57.831 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667980+0000", 2024-09-12T18:36:57.831 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2086000000000001e-05 2024-09-12T18:36:57.831 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.831 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:57.831 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.832 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.832 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.832 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:57.832 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:36:57.832 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 92.138204506999998, 2024-09-12T18:36:57.832 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026483236, 2024-09-12T18:36:57.833 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:57.833 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:57.833 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:57.833 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:57.833 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.833 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:57.834 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:36:57.834 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.834 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.834 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.834 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:57.834 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:36:57.834 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.835 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.835 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.835 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:57.835 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641826+0000", 2024-09-12T18:36:57.835 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:36:57.835 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.835 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.835 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:57.835 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641832+0000", 2024-09-12T18:36:57.836 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4199999999999998e-06 2024-09-12T18:36:57.836 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.836 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.836 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:57.836 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641848+0000", 2024-09-12T18:36:57.836 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6492999999999999e-05 2024-09-12T18:36:57.836 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.836 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.836 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.836 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641863+0000", 2024-09-12T18:36:57.836 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5427e-05 2024-09-12T18:36:57.836 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.836 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.837 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:57.837 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648887+0000", 2024-09-12T18:36:57.837 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0070230860000000004 2024-09-12T18:36:57.837 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.837 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.837 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:57.837 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649111+0000", 2024-09-12T18:36:57.837 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022425799999999999 2024-09-12T18:36:57.837 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.837 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.837 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:57.837 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649494+0000", 2024-09-12T18:36:57.837 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00038349400000000001 2024-09-12T18:36:57.838 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.838 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.838 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:57.838 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655499+0000", 2024-09-12T18:36:57.838 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0060047260000000002 2024-09-12T18:36:57.838 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.838 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.838 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:57.838 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668110+0000", 2024-09-12T18:36:57.838 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012610543 2024-09-12T18:36:57.838 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.838 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.838 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:57.838 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668252+0000", 2024-09-12T18:36:57.839 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014265600000000001 2024-09-12T18:36:57.839 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.839 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.839 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:57.839 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668308+0000", 2024-09-12T18:36:57.839 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5992999999999997e-05 2024-09-12T18:36:57.839 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.839 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:57.839 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.839 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.839 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.839 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:57.839 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:36:57.840 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 92.138149291000005, 2024-09-12T18:36:57.840 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026605302000000001, 2024-09-12T18:36:57.840 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:57.840 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:57.840 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:57.840 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:57.840 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.840 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:57.840 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:36:57.840 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.840 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.840 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.840 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:57.840 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:36:57.841 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.841 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.841 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.841 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:57.841 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641881+0000", 2024-09-12T18:36:57.841 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.057e-06 2024-09-12T18:36:57.841 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.841 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.841 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:57.841 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641887+0000", 2024-09-12T18:36:57.841 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.6629999999999998e-06 2024-09-12T18:36:57.841 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.841 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.842 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:57.842 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641903+0000", 2024-09-12T18:36:57.842 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6317e-05 2024-09-12T18:36:57.842 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.842 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.842 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.842 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641917+0000", 2024-09-12T18:36:57.842 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3339999999999999e-05 2024-09-12T18:36:57.842 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.842 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.842 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:57.842 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650708+0000", 2024-09-12T18:36:57.842 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.008791419 2024-09-12T18:36:57.842 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.843 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.843 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:57.843 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651021+0000", 2024-09-12T18:36:57.843 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031296699999999999 2024-09-12T18:36:57.843 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.843 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.843 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:57.843 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651349+0000", 2024-09-12T18:36:57.843 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032796499999999999 2024-09-12T18:36:57.843 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.843 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.843 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:57.843 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655742+0000", 2024-09-12T18:36:57.843 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0043934680000000002 2024-09-12T18:36:57.844 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.844 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.844 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:57.844 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668377+0000", 2024-09-12T18:36:57.844 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012634312999999999 2024-09-12T18:36:57.844 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.844 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.844 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:57.844 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668441+0000", 2024-09-12T18:36:57.844 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4369999999999995e-05 2024-09-12T18:36:57.844 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.844 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.844 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:57.845 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668485+0000", 2024-09-12T18:36:57.845 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4422999999999998e-05 2024-09-12T18:36:57.845 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.845 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:57.845 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.845 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.845 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.845 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:57.845 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:36:57.846 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 92.138091888000005, 2024-09-12T18:36:57.846 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026919499, 2024-09-12T18:36:57.846 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:57.846 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:57.846 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:57.846 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:57.846 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.846 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:57.846 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:36:57.846 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.846 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.846 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.847 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:57.847 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:36:57.847 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.847 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.847 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.847 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:57.847 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641939+0000", 2024-09-12T18:36:57.847 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9399999999999993e-07 2024-09-12T18:36:57.847 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.847 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.847 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:57.847 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641945+0000", 2024-09-12T18:36:57.847 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9200000000000001e-06 2024-09-12T18:36:57.848 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.848 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.848 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:57.848 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641961+0000", 2024-09-12T18:36:57.848 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6520000000000001e-05 2024-09-12T18:36:57.848 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.848 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.848 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.848 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641974+0000", 2024-09-12T18:36:57.848 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3413e-05 2024-09-12T18:36:57.848 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.848 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.849 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:57.849 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654560+0000", 2024-09-12T18:36:57.849 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012585308999999999 2024-09-12T18:36:57.849 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.849 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.849 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:57.849 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654822+0000", 2024-09-12T18:36:57.849 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026210099999999999 2024-09-12T18:36:57.849 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.849 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.849 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:57.849 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655059+0000", 2024-09-12T18:36:57.849 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00023747899999999999 2024-09-12T18:36:57.850 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.850 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.850 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:57.850 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.656315+0000", 2024-09-12T18:36:57.850 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0012555000000000001 2024-09-12T18:36:57.850 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.850 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.850 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:57.850 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668590+0000", 2024-09-12T18:36:57.850 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012274851999999999 2024-09-12T18:36:57.851 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.851 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.851 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:57.851 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668725+0000", 2024-09-12T18:36:57.851 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013524199999999999 2024-09-12T18:36:57.851 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.851 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.851 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:57.851 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668857+0000", 2024-09-12T18:36:57.852 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013216899999999999 2024-09-12T18:36:57.852 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.852 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:57.852 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.852 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.852 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.852 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:57.852 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:36:57.852 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 92.138038367999997, 2024-09-12T18:36:57.852 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023616723999999999, 2024-09-12T18:36:57.852 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:57.852 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:57.852 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:57.853 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:57.853 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.853 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:57.853 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:36:57.853 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.853 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.853 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.853 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:57.853 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:36:57.853 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.853 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.853 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.853 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:57.853 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641992+0000", 2024-09-12T18:36:57.854 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.08e-06 2024-09-12T18:36:57.854 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.854 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.854 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:57.854 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641998+0000", 2024-09-12T18:36:57.854 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4299999999999997e-06 2024-09-12T18:36:57.854 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.854 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.854 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:57.854 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642014+0000", 2024-09-12T18:36:57.854 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6266e-05 2024-09-12T18:36:57.854 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.854 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.854 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.855 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642026+0000", 2024-09-12T18:36:57.855 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2567e-05 2024-09-12T18:36:57.855 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.855 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.855 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:57.855 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642213+0000", 2024-09-12T18:36:57.855 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00018701899999999999 2024-09-12T18:36:57.855 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.855 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.855 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:57.855 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642507+0000", 2024-09-12T18:36:57.855 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00029394700000000002 2024-09-12T18:36:57.855 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.856 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.856 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:57.856 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642686+0000", 2024-09-12T18:36:57.856 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000178152 2024-09-12T18:36:57.856 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.856 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.856 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:57.856 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650952+0000", 2024-09-12T18:36:57.856 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0082663570000000002 2024-09-12T18:36:57.856 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.857 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.857 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:57.857 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665382+0000", 2024-09-12T18:36:57.857 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.014430111000000001 2024-09-12T18:36:57.857 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.857 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.857 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:57.857 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665508+0000", 2024-09-12T18:36:57.857 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000125986 2024-09-12T18:36:57.857 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.857 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.857 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:57.858 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665608+0000", 2024-09-12T18:36:57.858 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9809000000000006e-05 2024-09-12T18:36:57.858 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.858 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:57.858 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.858 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.858 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.858 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:57.858 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:36:57.858 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 92.137910503000001, 2024-09-12T18:36:57.858 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024670563, 2024-09-12T18:36:57.858 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:57.858 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:57.858 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:57.859 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:57.859 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.859 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:57.859 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:36:57.859 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.859 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.859 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.859 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:57.859 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:36:57.859 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.859 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.859 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.859 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:57.859 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642120+0000", 2024-09-12T18:36:57.860 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1769999999999999e-06 2024-09-12T18:36:57.860 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.860 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.860 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:57.860 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642128+0000", 2024-09-12T18:36:57.860 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3429999999999998e-06 2024-09-12T18:36:57.860 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.860 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.860 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:57.860 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642192+0000", 2024-09-12T18:36:57.860 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4406999999999995e-05 2024-09-12T18:36:57.860 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.860 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.861 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.861 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642223+0000", 2024-09-12T18:36:57.861 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.1266000000000002e-05 2024-09-12T18:36:57.861 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.861 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.861 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:57.861 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643201+0000", 2024-09-12T18:36:57.861 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0009778390000000001 2024-09-12T18:36:57.861 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.861 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.861 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:57.861 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643410+0000", 2024-09-12T18:36:57.861 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020874199999999999 2024-09-12T18:36:57.861 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.862 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.862 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:57.862 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643685+0000", 2024-09-12T18:36:57.862 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027520700000000002 2024-09-12T18:36:57.862 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.862 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.862 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:57.862 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650966+0000", 2024-09-12T18:36:57.862 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072810710000000001 2024-09-12T18:36:57.862 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.862 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.862 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:57.862 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666560+0000", 2024-09-12T18:36:57.862 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015594143 2024-09-12T18:36:57.862 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.863 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.863 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:57.863 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666691+0000", 2024-09-12T18:36:57.863 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000130359 2024-09-12T18:36:57.863 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.863 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.863 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:57.863 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666790+0000", 2024-09-12T18:36:57.863 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9009e-05 2024-09-12T18:36:57.863 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.863 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:57.863 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.863 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.863 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.864 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:57.864 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:36:57.864 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 92.137132214999994, 2024-09-12T18:36:57.864 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024891744, 2024-09-12T18:36:57.864 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:57.864 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:57.864 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:57.864 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:57.864 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.864 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:57.865 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:36:57.865 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.865 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.865 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.865 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:57.865 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:36:57.865 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.865 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.865 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.866 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:57.866 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642899+0000", 2024-09-12T18:36:57.866 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4729999999999999e-06 2024-09-12T18:36:57.866 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.866 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.866 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:57.866 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642912+0000", 2024-09-12T18:36:57.866 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3495999999999999e-05 2024-09-12T18:36:57.867 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.867 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.867 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:57.867 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642934+0000", 2024-09-12T18:36:57.867 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2033999999999999e-05 2024-09-12T18:36:57.867 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.868 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.868 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.868 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642949+0000", 2024-09-12T18:36:57.868 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4970000000000001e-05 2024-09-12T18:36:57.868 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.868 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.868 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:57.869 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644400+0000", 2024-09-12T18:36:57.869 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001450305 2024-09-12T18:36:57.869 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.869 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.869 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:57.869 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644617+0000", 2024-09-12T18:36:57.869 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000217302 2024-09-12T18:36:57.870 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.870 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.870 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:57.870 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645052+0000", 2024-09-12T18:36:57.870 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000434797 2024-09-12T18:36:57.870 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.871 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.871 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:57.871 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653860+0000", 2024-09-12T18:36:57.871 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0088082249999999994 2024-09-12T18:36:57.871 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.871 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.871 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:57.871 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667598+0000", 2024-09-12T18:36:57.871 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.013738451 2024-09-12T18:36:57.871 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.872 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.872 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:57.872 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667698+0000", 2024-09-12T18:36:57.872 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9854999999999999e-05 2024-09-12T18:36:57.872 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.872 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.872 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:57.872 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667789+0000", 2024-09-12T18:36:57.872 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0835999999999996e-05 2024-09-12T18:36:57.872 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.872 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:57.872 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.872 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.873 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.873 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:30 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:57.873 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:36:57.873 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 92.137057399, 2024-09-12T18:36:57.873 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023936852000000002, 2024-09-12T18:36:57.873 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:57.873 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:57.873 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:57.873 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:57.873 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.873 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:57.873 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:36:57.874 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.874 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.874 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.874 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:57.874 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:36:57.874 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.874 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.874 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.874 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:57.874 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642973+0000", 2024-09-12T18:36:57.874 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.11e-06 2024-09-12T18:36:57.874 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.874 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.875 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:57.875 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642994+0000", 2024-09-12T18:36:57.875 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.0699999999999998e-05 2024-09-12T18:36:57.875 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.875 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.875 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:57.875 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643011+0000", 2024-09-12T18:36:57.875 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7229999999999999e-05 2024-09-12T18:36:57.875 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.875 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.875 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.875 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643025+0000", 2024-09-12T18:36:57.876 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3803e-05 2024-09-12T18:36:57.876 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.876 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.876 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:57.876 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643143+0000", 2024-09-12T18:36:57.876 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000118225 2024-09-12T18:36:57.876 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.876 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.876 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:57.876 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643426+0000", 2024-09-12T18:36:57.876 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00028250500000000001 2024-09-12T18:36:57.876 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.876 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.877 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:57.877 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643864+0000", 2024-09-12T18:36:57.877 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00043856 2024-09-12T18:36:57.877 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.877 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.877 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:57.877 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651148+0000", 2024-09-12T18:36:57.877 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072836769999999997 2024-09-12T18:36:57.877 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.877 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.878 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:57.878 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666674+0000", 2024-09-12T18:36:57.878 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015525786999999999 2024-09-12T18:36:57.878 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.878 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.878 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:57.878 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666796+0000", 2024-09-12T18:36:57.878 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000122416 2024-09-12T18:36:57.878 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.878 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.878 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:57.878 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666909+0000", 2024-09-12T18:36:57.878 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011283899999999999 2024-09-12T18:36:57.878 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.879 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:57.879 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.879 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.879 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.879 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:57.879 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:36:57.879 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 92.136974692999999, 2024-09-12T18:36:57.879 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024100234000000002, 2024-09-12T18:36:57.879 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:57.879 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:57.879 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:57.879 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:57.879 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.880 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:57.880 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:36:57.880 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.880 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.880 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.880 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:57.880 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:36:57.880 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.880 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.880 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.880 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:57.880 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643056+0000", 2024-09-12T18:36:57.880 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.046e-06 2024-09-12T18:36:57.881 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.881 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.881 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:57.881 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643068+0000", 2024-09-12T18:36:57.881 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2106999999999999e-05 2024-09-12T18:36:57.881 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.882 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.882 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:57.882 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643085+0000", 2024-09-12T18:36:57.882 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7479999999999999e-05 2024-09-12T18:36:57.882 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.882 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.883 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.883 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643099+0000", 2024-09-12T18:36:57.883 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3730000000000001e-05 2024-09-12T18:36:57.883 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.883 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.883 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:57.883 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644623+0000", 2024-09-12T18:36:57.884 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0015236080000000001 2024-09-12T18:36:57.884 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.884 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.884 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:57.884 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644893+0000", 2024-09-12T18:36:57.884 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026990500000000003 2024-09-12T18:36:57.885 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.885 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.885 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:57.885 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645227+0000", 2024-09-12T18:36:57.885 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00033391300000000003 2024-09-12T18:36:57.885 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.885 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.886 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:57.886 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653926+0000", 2024-09-12T18:36:57.886 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0086993339999999995 2024-09-12T18:36:57.886 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.886 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.886 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:57.887 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666925+0000", 2024-09-12T18:36:57.887 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012998686000000001 2024-09-12T18:36:57.887 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.887 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.887 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:57.887 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667057+0000", 2024-09-12T18:36:57.887 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013255600000000001 2024-09-12T18:36:57.888 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.888 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.888 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:57.888 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667155+0000", 2024-09-12T18:36:57.888 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7868999999999994e-05 2024-09-12T18:36:57.888 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.889 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:57.889 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.889 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.889 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.889 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:57.889 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:36:57.889 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 92.136778903999996, 2024-09-12T18:36:57.890 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024255982999999998, 2024-09-12T18:36:57.890 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:57.890 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:57.890 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:57.890 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:57.890 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.890 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:57.890 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:36:57.891 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.891 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.891 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.891 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:57.891 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:36:57.891 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.891 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.892 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.892 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:57.892 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643252+0000", 2024-09-12T18:36:57.892 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:57.892 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.892 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.892 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:57.893 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643287+0000", 2024-09-12T18:36:57.893 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5225999999999998e-05 2024-09-12T18:36:57.893 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.893 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.893 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:57.893 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643323+0000", 2024-09-12T18:36:57.894 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5488999999999999e-05 2024-09-12T18:36:57.894 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.894 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.894 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.894 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643357+0000", 2024-09-12T18:36:57.895 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.3853999999999998e-05 2024-09-12T18:36:57.895 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.895 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.895 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:57.895 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646716+0000", 2024-09-12T18:36:57.895 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003359 2024-09-12T18:36:57.896 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.896 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.896 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:57.896 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647037+0000", 2024-09-12T18:36:57.896 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032131800000000002 2024-09-12T18:36:57.897 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.897 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.897 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:57.897 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647337+0000", 2024-09-12T18:36:57.897 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000300208 2024-09-12T18:36:57.897 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.897 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.898 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:57.898 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654291+0000", 2024-09-12T18:36:57.898 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0069543089999999997 2024-09-12T18:36:57.898 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.898 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.898 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:57.898 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667297+0000", 2024-09-12T18:36:57.898 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.013005526 2024-09-12T18:36:57.898 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.899 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.899 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:57.899 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667416+0000", 2024-09-12T18:36:57.899 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000119416 2024-09-12T18:36:57.899 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.899 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.899 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:57.899 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667507+0000", 2024-09-12T18:36:57.900 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0206999999999999e-05 2024-09-12T18:36:57.900 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.900 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:57.900 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.900 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.900 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.900 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:57.900 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:36:57.901 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 92.136651809, 2024-09-12T18:36:57.901 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023888482999999999, 2024-09-12T18:36:57.901 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:57.901 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:57.901 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:57.901 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:57.902 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.902 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:57.902 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:36:57.902 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.902 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.902 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.903 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:57.903 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:36:57.903 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.903 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.903 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.904 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:57.904 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643379+0000", 2024-09-12T18:36:57.904 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.207e-06 2024-09-12T18:36:57.904 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.904 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.905 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:57.905 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643390+0000", 2024-09-12T18:36:57.905 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0696000000000001e-05 2024-09-12T18:36:57.905 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.905 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.905 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:57.906 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643407+0000", 2024-09-12T18:36:57.906 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7563000000000001e-05 2024-09-12T18:36:57.906 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.906 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.906 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.906 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643420+0000", 2024-09-12T18:36:57.907 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3277e-05 2024-09-12T18:36:57.907 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.907 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.907 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:57.907 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644906+0000", 2024-09-12T18:36:57.908 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001485945 2024-09-12T18:36:57.908 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.908 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.908 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:57.908 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645404+0000", 2024-09-12T18:36:57.908 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00049807599999999997 2024-09-12T18:36:57.909 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.909 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.909 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:57.909 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645846+0000", 2024-09-12T18:36:57.909 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00044190400000000002 2024-09-12T18:36:57.909 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.910 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.910 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:57.910 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654223+0000", 2024-09-12T18:36:57.910 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0083767419999999995 2024-09-12T18:36:57.910 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.911 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.911 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:57.911 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667026+0000", 2024-09-12T18:36:57.911 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012802531000000001 2024-09-12T18:36:57.911 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.911 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.912 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:57.912 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667162+0000", 2024-09-12T18:36:57.912 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000136112 2024-09-12T18:36:57.912 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.912 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.912 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:57.913 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667266+0000", 2024-09-12T18:36:57.913 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010443 2024-09-12T18:36:57.913 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.913 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:57.913 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.913 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.914 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.914 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:57.914 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:36:57.914 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 92.136501089999996, 2024-09-12T18:36:57.914 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024222582999999999, 2024-09-12T18:36:57.914 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:57.915 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:57.915 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:36:57.915 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:57.915 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.915 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:57.915 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:36:57.916 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.916 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.916 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.916 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:57.916 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:36:57.916 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.917 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.917 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.917 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:57.917 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643530+0000", 2024-09-12T18:36:57.917 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.393e-06 2024-09-12T18:36:57.917 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.918 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.918 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:57.918 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643536+0000", 2024-09-12T18:36:57.918 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4130000000000003e-06 2024-09-12T18:36:57.918 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.918 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.918 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:57.919 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643554+0000", 2024-09-12T18:36:57.919 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7572999999999999e-05 2024-09-12T18:36:57.919 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.919 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.919 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.919 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643567+0000", 2024-09-12T18:36:57.920 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3393999999999999e-05 2024-09-12T18:36:57.920 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.920 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.920 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:57.920 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648198+0000", 2024-09-12T18:36:57.920 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0046304479999999997 2024-09-12T18:36:57.920 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.921 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.921 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:57.921 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648413+0000", 2024-09-12T18:36:57.921 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00021507500000000001 2024-09-12T18:36:57.921 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.921 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.922 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:57.922 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667751+0000", 2024-09-12T18:36:57.922 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.019338286999999999 2024-09-12T18:36:57.922 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.922 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:57.922 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.922 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.923 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.923 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:121106 5.d e50/21 5:b4a9a221:::benchmark_data_smithi073_23739_object121105:head v 50'7658, mlcod=48'7656)", 2024-09-12T18:36:57.923 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:40.238637+0000", 2024-09-12T18:36:57.923 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 17.541392489, 2024-09-12T18:36:57.923 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.033154694999999998, 2024-09-12T18:36:57.923 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:57.924 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:57.924 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:57.924 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:57.924 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.924 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:57.925 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238637+0000", 2024-09-12T18:36:57.925 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.925 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.925 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.925 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:57.925 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238637+0000", 2024-09-12T18:36:57.925 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.926 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.926 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.926 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:57.926 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238639+0000", 2024-09-12T18:36:57.926 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.8560000000000001e-06 2024-09-12T18:36:57.926 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.927 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.927 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:57.927 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238723+0000", 2024-09-12T18:36:57.927 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4314999999999995e-05 2024-09-12T18:36:57.927 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.928 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.928 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:57.928 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238753+0000", 2024-09-12T18:36:57.928 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.9726e-05 2024-09-12T18:36:57.928 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.928 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.929 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.929 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238773+0000", 2024-09-12T18:36:57.929 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9789e-05 2024-09-12T18:36:57.929 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.929 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.929 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:57.930 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.241557+0000", 2024-09-12T18:36:57.930 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0027843910000000002 2024-09-12T18:36:57.930 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.930 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.930 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:57.930 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.241581+0000", 2024-09-12T18:36:57.931 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.4224999999999999e-05 2024-09-12T18:36:57.931 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.931 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.931 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:57.931 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.271722+0000", 2024-09-12T18:36:57.931 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.030141194 2024-09-12T18:36:57.932 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.932 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.932 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:57.932 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.271792+0000", 2024-09-12T18:36:57.932 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9198999999999999e-05 2024-09-12T18:36:57.932 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.932 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:57.932 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.933 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.933 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.933 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:131553 5.9 5:99f85f54:::benchmark_data_smithi073_23739_object131552:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:36:57.933 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:45.500398+0000", 2024-09-12T18:36:57.933 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 12.279631329000001, 2024-09-12T18:36:57.933 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024615648, 2024-09-12T18:36:57.933 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:57.934 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:57.934 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:57.934 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:36:57.934 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:36:57.934 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:57.934 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 131553 2024-09-12T18:36:57.934 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.935 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:57.935 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.935 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:57.935 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500398+0000", 2024-09-12T18:36:57.935 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.935 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.935 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.935 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:57.936 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500398+0000", 2024-09-12T18:36:57.936 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.936 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.936 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.936 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:57.937 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500399+0000", 2024-09-12T18:36:57.937 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.54e-07 2024-09-12T18:36:57.937 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.937 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.937 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:57.937 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500521+0000", 2024-09-12T18:36:57.937 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012212599999999999 2024-09-12T18:36:57.938 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.938 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.938 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:57.938 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500528+0000", 2024-09-12T18:36:57.938 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.6619999999999999e-06 2024-09-12T18:36:57.938 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.938 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.940 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.940 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500532+0000", 2024-09-12T18:36:57.940 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6110000000000004e-06 2024-09-12T18:36:57.940 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.940 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.940 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:57.941 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500576+0000", 2024-09-12T18:36:57.941 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.3563000000000003e-05 2024-09-12T18:36:57.941 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.941 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.941 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:57.941 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500688+0000", 2024-09-12T18:36:57.942 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011260900000000001 2024-09-12T18:36:57.942 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.942 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.942 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:57.942 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.517383+0000", 2024-09-12T18:36:57.942 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.016694154999999999 2024-09-12T18:36:57.942 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.942 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.943 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:57.943 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.523998+0000", 2024-09-12T18:36:57.943 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0066157919999999997 2024-09-12T18:36:57.943 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.943 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.943 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:36:57.943 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.524943+0000", 2024-09-12T18:36:57.943 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00094417500000000001 2024-09-12T18:36:57.944 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.944 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.944 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:57.944 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.524981+0000", 2024-09-12T18:36:57.944 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.8179000000000002e-05 2024-09-12T18:36:57.944 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.944 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.944 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:57.945 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.525014+0000", 2024-09-12T18:36:57.945 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.3022000000000003e-05 2024-09-12T18:36:57.945 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.945 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:57.945 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.945 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.945 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.945 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:131551 5.d e52/21 5:b8f8c77a:::benchmark_data_smithi073_23739_object131550:head v 52'8341, mlcod=52'8338)", 2024-09-12T18:36:57.945 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:45.500609+0000", 2024-09-12T18:36:57.945 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 12.279420309000001, 2024-09-12T18:36:57.945 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024752877, 2024-09-12T18:36:57.945 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:36:57.945 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:36:57.945 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:57.946 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:36:57.946 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.946 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:36:57.946 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500609+0000", 2024-09-12T18:36:57.946 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.946 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.946 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.946 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:36:57.946 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500609+0000", 2024-09-12T18:36:57.946 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:36:57.946 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.946 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.946 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:36:57.946 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500610+0000", 2024-09-12T18:36:57.947 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5499999999999998e-07 2024-09-12T18:36:57.947 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.947 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.947 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:36:57.947 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500669+0000", 2024-09-12T18:36:57.947 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9244999999999999e-05 2024-09-12T18:36:57.947 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.947 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.947 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:36:57.947 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500676+0000", 2024-09-12T18:36:57.947 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3030000000000002e-06 2024-09-12T18:36:57.947 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.947 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.947 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:36:57.948 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500681+0000", 2024-09-12T18:36:57.948 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8720000000000001e-06 2024-09-12T18:36:57.948 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.948 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.948 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:36:57.948 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.517128+0000", 2024-09-12T18:36:57.948 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.016446485 2024-09-12T18:36:57.948 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.948 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.948 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:36:57.948 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.517159+0000", 2024-09-12T18:36:57.948 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.0926000000000002e-05 2024-09-12T18:36:57.948 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.949 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.949 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:36:57.949 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.525325+0000", 2024-09-12T18:36:57.949 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0081661460000000009 2024-09-12T18:36:57.949 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:36:57.949 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:36:57.949 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:36:57.949 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.525362+0000", 2024-09-12T18:36:57.949 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.7345000000000002e-05 2024-09-12T18:36:57.949 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.949 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:57.949 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.949 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:36:57.949 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:36:57.949 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:36:57.951 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:57.947+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:57.951 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:36:58.052 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:58.047+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:58.105 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:58.105 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:36:58.106 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.106 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:156844 5.c 5:3e96efab:::benchmark_data_smithi073_23739_object24567:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T18:36:58.106 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:58.095658+0000", 2024-09-12T18:36:58.106 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0073723490000000003, 2024-09-12T18:36:58.106 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0073898430000000001, 2024-09-12T18:36:58.106 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:58.106 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:58.106 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:58.106 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:58.106 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:58.106 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:58.106 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 156844 2024-09-12T18:36:58.106 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.106 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:58.107 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.107 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:58.107 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.095658+0000", 2024-09-12T18:36:58.107 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.107 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.107 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.107 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:58.107 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.095658+0000", 2024-09-12T18:36:58.107 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.107 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.107 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.107 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:58.107 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.095659+0000", 2024-09-12T18:36:58.107 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1689999999999999e-06 2024-09-12T18:36:58.108 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.108 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.108 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:58.108 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.095667+0000", 2024-09-12T18:36:58.108 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4030000000000001e-06 2024-09-12T18:36:58.108 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.108 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.108 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:58.108 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.095681+0000", 2024-09-12T18:36:58.108 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4548e-05 2024-09-12T18:36:58.108 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.108 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.108 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:58.109 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.095689+0000", 2024-09-12T18:36:58.109 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.7170000000000008e-06 2024-09-12T18:36:58.109 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.109 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.109 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:58.109 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.097881+0000", 2024-09-12T18:36:58.109 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.002191952 2024-09-12T18:36:58.109 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.109 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.109 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:58.109 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.097966+0000", 2024-09-12T18:36:58.109 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.4818e-05 2024-09-12T18:36:58.109 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.109 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.110 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:58.110 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.098041+0000", 2024-09-12T18:36:58.110 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4999999999999993e-05 2024-09-12T18:36:58.110 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.110 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.110 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:58.110 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.102386+0000", 2024-09-12T18:36:58.110 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0043453279999999999 2024-09-12T18:36:58.110 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.110 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:58.110 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.110 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.110 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.111 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:156846 5.c 5:3fb55970:::benchmark_data_smithi073_23739_object24569:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T18:36:58.111 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:58.095766+0000", 2024-09-12T18:36:58.111 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0072641040000000004, 2024-09-12T18:36:58.111 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00732733, 2024-09-12T18:36:58.111 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:58.111 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:58.111 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:58.111 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:58.111 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:58.111 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:58.111 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 156846 2024-09-12T18:36:58.111 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.111 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:58.111 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.112 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:58.112 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.095766+0000", 2024-09-12T18:36:58.112 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.112 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.112 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.112 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:58.112 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.095766+0000", 2024-09-12T18:36:58.112 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.112 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.112 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.112 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:58.112 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.095767+0000", 2024-09-12T18:36:58.112 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7000000000000003e-07 2024-09-12T18:36:58.112 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.113 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.113 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:58.113 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.095770+0000", 2024-09-12T18:36:58.113 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.2619999999999999e-06 2024-09-12T18:36:58.113 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.113 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.113 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:58.113 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.095781+0000", 2024-09-12T18:36:58.113 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0589e-05 2024-09-12T18:36:58.113 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.113 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.113 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:58.113 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.095789+0000", 2024-09-12T18:36:58.114 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6340000000000001e-06 2024-09-12T18:36:58.114 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.114 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.114 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:58.114 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.100145+0000", 2024-09-12T18:36:58.114 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0043562449999999999 2024-09-12T18:36:58.114 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.114 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.114 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:58.114 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.100238+0000", 2024-09-12T18:36:58.114 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2847000000000001e-05 2024-09-12T18:36:58.114 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.114 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.114 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:58.115 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.100311+0000", 2024-09-12T18:36:58.115 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3547000000000006e-05 2024-09-12T18:36:58.115 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.115 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:58.115 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.115 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.115 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.115 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:156845 5.e e57/21 5:790e02f9:::benchmark_data_smithi073_23739_object24568:head v 57'9878, mlcod=57'9875)", 2024-09-12T18:36:58.115 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:58.095946+0000", 2024-09-12T18:36:58.115 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0070844549999999999, 2024-09-12T18:36:58.115 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0071844700000000001, 2024-09-12T18:36:58.115 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:58.115 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:58.115 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:58.116 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:58.116 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.116 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:58.116 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.095946+0000", 2024-09-12T18:36:58.116 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.116 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.116 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.116 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:58.116 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.095946+0000", 2024-09-12T18:36:58.116 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.116 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.116 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.116 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:58.117 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.095947+0000", 2024-09-12T18:36:58.117 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.16e-07 2024-09-12T18:36:58.117 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.117 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.117 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:58.117 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.095952+0000", 2024-09-12T18:36:58.117 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4269999999999999e-06 2024-09-12T18:36:58.117 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.117 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.117 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:58.117 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.095961+0000", 2024-09-12T18:36:58.117 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7630000000000006e-06 2024-09-12T18:36:58.117 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.117 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.118 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:58.118 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.095966+0000", 2024-09-12T18:36:58.118 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.797e-06 2024-09-12T18:36:58.118 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.118 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.118 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:58.118 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.096013+0000", 2024-09-12T18:36:58.118 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.7342999999999997e-05 2024-09-12T18:36:58.118 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.118 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.118 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:58.118 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.096031+0000", 2024-09-12T18:36:58.118 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8227999999999999e-05 2024-09-12T18:36:58.118 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.119 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:58.119 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.119 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.119 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.119 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:156849 5.6 5:64590af8:::benchmark_data_smithi073_23739_object24572:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T18:36:58.119 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:58.098377+0000", 2024-09-12T18:36:58.119 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.004653735, 2024-09-12T18:36:58.119 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0047840740000000001, 2024-09-12T18:36:58.119 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:58.119 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:58.119 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:58.119 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:58.119 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:58.120 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:58.120 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 156849 2024-09-12T18:36:58.120 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.120 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:58.120 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.120 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:58.120 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.098377+0000", 2024-09-12T18:36:58.120 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.120 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.120 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.120 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:58.120 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.098377+0000", 2024-09-12T18:36:58.120 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.120 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.121 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.121 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:58.121 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.098378+0000", 2024-09-12T18:36:58.121 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.372e-06 2024-09-12T18:36:58.121 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.121 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.121 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:58.121 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.098388+0000", 2024-09-12T18:36:58.121 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0124e-05 2024-09-12T18:36:58.121 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.121 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.121 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:58.121 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.098406+0000", 2024-09-12T18:36:58.121 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7931000000000002e-05 2024-09-12T18:36:58.122 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.122 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.122 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:58.122 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.098415+0000", 2024-09-12T18:36:58.122 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.098e-06 2024-09-12T18:36:58.122 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.122 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.122 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:58.122 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.098465+0000", 2024-09-12T18:36:58.122 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9641000000000001e-05 2024-09-12T18:36:58.122 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.122 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.122 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:58.122 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.098590+0000", 2024-09-12T18:36:58.123 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000125396 2024-09-12T18:36:58.123 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.123 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.123 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:58.123 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.098699+0000", 2024-09-12T18:36:58.123 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000108702 2024-09-12T18:36:58.123 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.123 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:58.123 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.123 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.123 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.123 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:156851 5.6 5:66f94a54:::benchmark_data_smithi073_23739_object24574:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T18:36:58.123 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:58.098471+0000", 2024-09-12T18:36:58.123 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0045595330000000002, 2024-09-12T18:36:58.124 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0047250349999999998, 2024-09-12T18:36:58.124 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:58.124 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:58.124 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:58.124 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:58.124 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:58.124 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:58.124 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 156851 2024-09-12T18:36:58.124 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.124 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:58.124 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.124 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:58.124 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.098471+0000", 2024-09-12T18:36:58.125 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.125 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.125 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.125 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:58.125 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.098471+0000", 2024-09-12T18:36:58.125 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.125 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.125 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.125 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:58.125 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.098471+0000", 2024-09-12T18:36:58.125 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.0999999999999998e-07 2024-09-12T18:36:58.125 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.125 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.125 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:58.126 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.098474+0000", 2024-09-12T18:36:58.126 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4399999999999999e-06 2024-09-12T18:36:58.126 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.126 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.126 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:58.126 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.098480+0000", 2024-09-12T18:36:58.126 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5719999999999999e-06 2024-09-12T18:36:58.126 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.126 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.126 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:58.126 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.098485+0000", 2024-09-12T18:36:58.126 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9660000000000004e-06 2024-09-12T18:36:58.126 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.126 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.127 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:58.127 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.101762+0000", 2024-09-12T18:36:58.127 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0032766710000000001 2024-09-12T18:36:58.127 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.127 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.127 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:58.127 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.101888+0000", 2024-09-12T18:36:58.127 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012620099999999999 2024-09-12T18:36:58.127 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.127 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.127 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:58.127 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.102020+0000", 2024-09-12T18:36:58.127 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013179199999999999 2024-09-12T18:36:58.128 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.128 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:58.128 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.128 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.128 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.128 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:156852 5.6 5.34b0f756 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T18:36:58.128 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:58.101050+0000", 2024-09-12T18:36:58.128 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0019802790000000002, 2024-09-12T18:36:58.128 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.002192294, 2024-09-12T18:36:58.128 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:58.128 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:58.128 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:58.128 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:58.128 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:58.129 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:58.129 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 156852 2024-09-12T18:36:58.129 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.129 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:58.129 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.129 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:58.129 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.101050+0000", 2024-09-12T18:36:58.129 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.129 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.129 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.129 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:58.129 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.101050+0000", 2024-09-12T18:36:58.129 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.130 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.130 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.130 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:58.130 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.101051+0000", 2024-09-12T18:36:58.130 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2929999999999999e-06 2024-09-12T18:36:58.130 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.130 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.130 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:58.130 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.101055+0000", 2024-09-12T18:36:58.130 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.1799999999999998e-06 2024-09-12T18:36:58.130 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.130 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.130 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:58.130 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.101064+0000", 2024-09-12T18:36:58.131 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.8470000000000002e-06 2024-09-12T18:36:58.131 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.131 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.131 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:58.131 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.101072+0000", 2024-09-12T18:36:58.131 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6739999999999997e-06 2024-09-12T18:36:58.131 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.131 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:58.131 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.131 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.131 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.131 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:156856 5.1 e57/49 5:82010f63:::benchmark_data_smithi073_23739_object24579:head v 57'9746, mlcod=57'9744)", 2024-09-12T18:36:58.131 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:58.102362+0000", 2024-09-12T18:36:58.131 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00066816200000000003, 2024-09-12T18:36:58.132 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00090639599999999996, 2024-09-12T18:36:58.132 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:58.132 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:58.132 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:58.132 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:58.132 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.132 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:58.132 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.102362+0000", 2024-09-12T18:36:58.132 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.132 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.132 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.132 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:58.132 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.102362+0000", 2024-09-12T18:36:58.133 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.133 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.133 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.133 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:58.133 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.102363+0000", 2024-09-12T18:36:58.133 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.09e-07 2024-09-12T18:36:58.133 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.133 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.133 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:58.133 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.102369+0000", 2024-09-12T18:36:58.133 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5969999999999999e-06 2024-09-12T18:36:58.133 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.133 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.133 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:58.133 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.102378+0000", 2024-09-12T18:36:58.134 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.7340000000000003e-06 2024-09-12T18:36:58.134 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.134 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.134 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:58.134 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.102392+0000", 2024-09-12T18:36:58.134 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3977e-05 2024-09-12T18:36:58.134 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.134 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.134 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:58.134 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.102447+0000", 2024-09-12T18:36:58.134 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4755e-05 2024-09-12T18:36:58.134 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.134 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.135 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:58.135 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.102464+0000", 2024-09-12T18:36:58.135 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7465e-05 2024-09-12T18:36:58.135 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.135 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:58.135 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.135 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.135 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.135 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:156857 5.3 5:c08838e2:::benchmark_data_smithi073_23739_object24580:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T18:36:58.135 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:58.102804+0000", 2024-09-12T18:36:58.135 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00022591399999999999, 2024-09-12T18:36:58.135 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00050059599999999996, 2024-09-12T18:36:58.135 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:58.135 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:58.136 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:58.136 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:58.136 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:58.136 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:58.136 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 156857 2024-09-12T18:36:58.136 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.136 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:58.136 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.136 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:58.136 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.102804+0000", 2024-09-12T18:36:58.136 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.136 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.136 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.136 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:58.137 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.102804+0000", 2024-09-12T18:36:58.137 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.137 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.137 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.137 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:58.137 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.102806+0000", 2024-09-12T18:36:58.137 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2330000000000001e-06 2024-09-12T18:36:58.137 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.137 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.137 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:58.137 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.102810+0000", 2024-09-12T18:36:58.137 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8019999999999999e-06 2024-09-12T18:36:58.137 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.137 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.138 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:58.138 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.102823+0000", 2024-09-12T18:36:58.138 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2449000000000001e-05 2024-09-12T18:36:58.138 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.138 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.138 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:58.138 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.102830+0000", 2024-09-12T18:36:58.138 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1350000000000003e-06 2024-09-12T18:36:58.138 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.138 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.138 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:58.140 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.102884+0000", 2024-09-12T18:36:58.140 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.3720000000000001e-05 2024-09-12T18:36:58.140 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.140 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.140 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:58.140 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.103009+0000", 2024-09-12T18:36:58.140 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012479900000000001 2024-09-12T18:36:58.140 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.140 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.140 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:58.140 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.103115+0000", 2024-09-12T18:36:58.140 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00010671900000000001 2024-09-12T18:36:58.141 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.141 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:58.141 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.141 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.141 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.141 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:156859 5.6 5.6a001cb6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T18:36:58.141 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:58.102858+0000", 2024-09-12T18:36:58.141 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00017212799999999999, 2024-09-12T18:36:58.141 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00047871699999999998, 2024-09-12T18:36:58.141 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:58.141 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:58.141 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:58.141 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:58.142 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:58.142 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:58.142 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 156859 2024-09-12T18:36:58.142 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.142 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:58.142 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.142 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:58.142 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.102858+0000", 2024-09-12T18:36:58.142 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.142 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.142 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.142 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:58.142 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.102858+0000", 2024-09-12T18:36:58.142 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.143 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.143 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.143 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:58.143 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.102859+0000", 2024-09-12T18:36:58.143 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4700000000000001e-07 2024-09-12T18:36:58.143 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.143 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.143 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:58.143 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.102862+0000", 2024-09-12T18:36:58.143 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.9500000000000001e-06 2024-09-12T18:36:58.143 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.143 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.143 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:58.143 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.102869+0000", 2024-09-12T18:36:58.144 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.968e-06 2024-09-12T18:36:58.144 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.144 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.144 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:58.144 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.102874+0000", 2024-09-12T18:36:58.144 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1240000000000004e-06 2024-09-12T18:36:58.144 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.144 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:58.144 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.144 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.144 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.144 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:156842 5.e e57/21 5:79832a7f:::benchmark_data_smithi073_23739_object24565:head v 57'9877, mlcod=57'9875)", 2024-09-12T18:36:58.144 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:58.093871+0000", 2024-09-12T18:36:58.144 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0091589250000000001, 2024-09-12T18:36:58.145 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.009491055, 2024-09-12T18:36:58.145 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:58.145 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:58.145 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:58.145 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:58.145 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.145 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:58.145 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.093871+0000", 2024-09-12T18:36:58.145 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.145 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.145 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.145 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:58.145 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.093871+0000", 2024-09-12T18:36:58.145 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.146 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.146 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.146 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:58.146 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.093872+0000", 2024-09-12T18:36:58.146 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.9500000000000002e-07 2024-09-12T18:36:58.146 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.146 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.146 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:58.146 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.093876+0000", 2024-09-12T18:36:58.146 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8460000000000001e-06 2024-09-12T18:36:58.146 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.146 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.146 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:58.146 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.093884+0000", 2024-09-12T18:36:58.147 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.3100000000000001e-06 2024-09-12T18:36:58.147 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.147 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.147 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:58.147 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.093889+0000", 2024-09-12T18:36:58.147 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4170000000000002e-06 2024-09-12T18:36:58.147 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.147 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.147 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:58.147 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.093939+0000", 2024-09-12T18:36:58.147 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0732000000000001e-05 2024-09-12T18:36:58.147 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.147 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.147 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:58.148 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:58.093962+0000", 2024-09-12T18:36:58.148 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2588000000000001e-05 2024-09-12T18:36:58.148 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.148 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:58.148 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.148 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.148 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-12T18:36:58.148 INFO:teuthology.orchestra.run.smithi114.stdout: "num_ops": 10 2024-09-12T18:36:58.148 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:58.149 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:36:58.152 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:58.147+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:58.253 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:58.247+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:58.304 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:58.304 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2024-09-12T18:36:58.304 INFO:teuthology.orchestra.run.smithi114.stdout: "complaint_time": 30, 2024-09-12T18:36:58.304 INFO:teuthology.orchestra.run.smithi114.stdout: "num_blocked_ops": 0 2024-09-12T18:36:58.304 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:58.325 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:36:58.354 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:58.351+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:58.456 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:58.447+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:58.526 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:36:58.526 INFO:teuthology.orchestra.run.smithi114.stdout: "size": 20, 2024-09-12T18:36:58.526 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 600, 2024-09-12T18:36:58.526 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:36:58.526 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.527 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:58.527 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:58.527 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 92.893536694000005, 2024-09-12T18:36:58.527 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.042475618999999999, 2024-09-12T18:36:58.527 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:58.527 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:58.527 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:58.527 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:58.528 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.528 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:58.528 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:58.528 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.528 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.528 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.528 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:58.528 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:36:58.528 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.528 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.528 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.528 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:58.528 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628450+0000", 2024-09-12T18:36:58.529 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4212999999999999e-05 2024-09-12T18:36:58.529 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.529 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.529 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:58.529 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628463+0000", 2024-09-12T18:36:58.529 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2497000000000001e-05 2024-09-12T18:36:58.529 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.529 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.529 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:58.529 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628480+0000", 2024-09-12T18:36:58.529 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7232999999999999e-05 2024-09-12T18:36:58.529 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.529 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.530 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:58.530 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628496+0000", 2024-09-12T18:36:58.530 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6217000000000001e-05 2024-09-12T18:36:58.530 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.530 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.530 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:58.530 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628641+0000", 2024-09-12T18:36:58.530 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000144709 2024-09-12T18:36:58.530 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.530 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.530 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:58.530 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628657+0000", 2024-09-12T18:36:58.530 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6266e-05 2024-09-12T18:36:58.531 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.531 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.531 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:58.531 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663103+0000", 2024-09-12T18:36:58.531 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.034445523999999998 2024-09-12T18:36:58.531 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.531 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.531 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:58.531 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663373+0000", 2024-09-12T18:36:58.531 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00027085500000000002 2024-09-12T18:36:58.531 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.531 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.531 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:58.532 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663634+0000", 2024-09-12T18:36:58.532 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000260855 2024-09-12T18:36:58.532 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.532 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.532 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:58.532 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670294+0000", 2024-09-12T18:36:58.532 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0066597599999999998 2024-09-12T18:36:58.532 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.532 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.532 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:58.532 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670705+0000", 2024-09-12T18:36:58.532 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00041057099999999998 2024-09-12T18:36:58.532 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.533 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.533 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:58.533 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670820+0000", 2024-09-12T18:36:58.533 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000115111 2024-09-12T18:36:58.533 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.533 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.533 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:58.533 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670912+0000", 2024-09-12T18:36:58.533 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1807999999999999e-05 2024-09-12T18:36:58.533 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.533 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:58.533 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.533 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.534 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.534 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:58.534 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:58.534 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 92.893445947999993, 2024-09-12T18:36:58.534 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.044599273000000002, 2024-09-12T18:36:58.534 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:58.534 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:58.534 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:58.534 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:58.534 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.534 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:58.534 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:58.534 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.535 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.535 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.535 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:58.535 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:36:58.535 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.535 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.535 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.535 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:58.535 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628528+0000", 2024-09-12T18:36:58.535 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:36:58.535 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.535 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.535 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:58.535 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628537+0000", 2024-09-12T18:36:58.536 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6969999999999999e-06 2024-09-12T18:36:58.536 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.536 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.536 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:58.536 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628560+0000", 2024-09-12T18:36:58.536 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2889000000000001e-05 2024-09-12T18:36:58.536 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.536 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.536 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:58.536 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628576+0000", 2024-09-12T18:36:58.536 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.649e-05 2024-09-12T18:36:58.536 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.536 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.537 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:58.537 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628846+0000", 2024-09-12T18:36:58.537 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00026952500000000001 2024-09-12T18:36:58.537 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.537 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.537 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:58.537 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628853+0000", 2024-09-12T18:36:58.537 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6559999999999992e-06 2024-09-12T18:36:58.538 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.538 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.538 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:58.538 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665284+0000", 2024-09-12T18:36:58.538 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.036431140000000001 2024-09-12T18:36:58.538 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.538 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.538 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:58.538 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665494+0000", 2024-09-12T18:36:58.538 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000209762 2024-09-12T18:36:58.538 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.538 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.539 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:58.539 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665816+0000", 2024-09-12T18:36:58.539 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00032162299999999999 2024-09-12T18:36:58.539 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.539 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.539 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:58.539 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670382+0000", 2024-09-12T18:36:58.539 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0045656739999999996 2024-09-12T18:36:58.539 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.539 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.539 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:58.539 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.672978+0000", 2024-09-12T18:36:58.539 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.002596068 2024-09-12T18:36:58.539 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.540 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.540 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:58.540 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673058+0000", 2024-09-12T18:36:58.540 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0198999999999996e-05 2024-09-12T18:36:58.540 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.540 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.540 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:58.540 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673126+0000", 2024-09-12T18:36:58.540 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8120000000000005e-05 2024-09-12T18:36:58.540 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.540 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:58.540 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.541 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.541 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.541 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:23 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:58.541 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:58.541 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 92.893348141999994, 2024-09-12T18:36:58.541 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045539784, 2024-09-12T18:36:58.541 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:58.541 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:58.541 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:58.541 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:58.541 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.541 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:58.541 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:58.542 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.542 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.542 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.542 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:58.542 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:36:58.542 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.542 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.542 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.542 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:58.542 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628626+0000", 2024-09-12T18:36:58.542 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.573e-06 2024-09-12T18:36:58.542 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.542 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.543 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:58.543 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628640+0000", 2024-09-12T18:36:58.543 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3817e-05 2024-09-12T18:36:58.543 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.543 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.543 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:58.543 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628659+0000", 2024-09-12T18:36:58.543 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9539999999999999e-05 2024-09-12T18:36:58.543 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.543 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.543 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:58.543 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628675+0000", 2024-09-12T18:36:58.543 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5739e-05 2024-09-12T18:36:58.544 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.544 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.544 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:58.544 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628815+0000", 2024-09-12T18:36:58.544 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014003299999999999 2024-09-12T18:36:58.544 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.544 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.544 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:58.544 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628828+0000", 2024-09-12T18:36:58.544 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2849e-05 2024-09-12T18:36:58.544 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.544 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.544 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:58.545 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651162+0000", 2024-09-12T18:36:58.545 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.022334228000000001 2024-09-12T18:36:58.545 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.545 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.545 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:58.545 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651446+0000", 2024-09-12T18:36:58.545 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00028392800000000002 2024-09-12T18:36:58.545 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.545 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.545 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:58.545 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651746+0000", 2024-09-12T18:36:58.545 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000300091 2024-09-12T18:36:58.546 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.546 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.546 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:58.546 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665113+0000", 2024-09-12T18:36:58.546 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013366678 2024-09-12T18:36:58.546 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.546 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.546 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:58.546 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674010+0000", 2024-09-12T18:36:58.546 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0088970520000000008 2024-09-12T18:36:58.546 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.546 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.546 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:58.547 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674104+0000", 2024-09-12T18:36:58.547 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4124999999999998e-05 2024-09-12T18:36:58.547 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.547 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.547 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:58.547 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674164+0000", 2024-09-12T18:36:58.547 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.0130999999999997e-05 2024-09-12T18:36:58.547 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.547 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:58.547 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.548 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.548 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.548 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:26 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:58.548 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:58.548 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 92.893274935999997, 2024-09-12T18:36:58.549 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045702136999999997, 2024-09-12T18:36:58.549 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:58.549 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:58.549 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:58.549 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:58.549 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.550 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:58.550 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:58.550 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.550 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.550 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.550 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:58.550 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:36:58.551 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.551 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.551 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.551 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:58.551 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628699+0000", 2024-09-12T18:36:58.551 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3859999999999999e-06 2024-09-12T18:36:58.551 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.551 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.551 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:58.551 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628706+0000", 2024-09-12T18:36:58.551 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0169999999999999e-06 2024-09-12T18:36:58.551 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.552 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.552 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:58.552 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628725+0000", 2024-09-12T18:36:58.552 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8683000000000001e-05 2024-09-12T18:36:58.552 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.552 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.552 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:58.552 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628740+0000", 2024-09-12T18:36:58.552 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5413999999999998e-05 2024-09-12T18:36:58.552 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.552 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.552 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:58.553 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628907+0000", 2024-09-12T18:36:58.553 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00016670199999999999 2024-09-12T18:36:58.553 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.553 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.553 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:58.553 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628917+0000", 2024-09-12T18:36:58.553 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.046e-05 2024-09-12T18:36:58.553 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.553 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.553 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:58.553 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.660390+0000", 2024-09-12T18:36:58.553 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.031472364000000003 2024-09-12T18:36:58.554 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.554 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.554 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:58.554 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.661767+0000", 2024-09-12T18:36:58.554 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0013769190000000001 2024-09-12T18:36:58.554 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.554 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.554 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:58.554 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.662408+0000", 2024-09-12T18:36:58.554 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00064091099999999998 2024-09-12T18:36:58.554 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.555 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.555 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:58.555 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669577+0000", 2024-09-12T18:36:58.555 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.007169412 2024-09-12T18:36:58.555 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.555 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.555 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:58.555 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674244+0000", 2024-09-12T18:36:58.555 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0046671839999999996 2024-09-12T18:36:58.555 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.555 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.555 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:58.555 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674329+0000", 2024-09-12T18:36:58.556 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5276000000000001e-05 2024-09-12T18:36:58.556 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.556 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.556 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:58.556 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674400+0000", 2024-09-12T18:36:58.556 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0408999999999996e-05 2024-09-12T18:36:58.556 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.556 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:58.556 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.556 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.556 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.556 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:58.557 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:58.557 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 92.893167266999995, 2024-09-12T18:36:58.557 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.044572443000000003, 2024-09-12T18:36:58.557 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:58.557 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:58.557 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:58.557 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:58.557 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.557 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:58.557 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:58.557 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.557 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.557 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.558 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:58.558 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:36:58.558 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.558 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.558 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.558 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:58.558 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628807+0000", 2024-09-12T18:36:58.558 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3629999999999999e-06 2024-09-12T18:36:58.558 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.558 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.558 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:58.558 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628814+0000", 2024-09-12T18:36:58.559 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.2099999999999996e-06 2024-09-12T18:36:58.559 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.559 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.559 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:58.559 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628832+0000", 2024-09-12T18:36:58.559 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7972999999999999e-05 2024-09-12T18:36:58.559 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.560 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.560 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:58.560 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628854+0000", 2024-09-12T18:36:58.560 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1857000000000001e-05 2024-09-12T18:36:58.560 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.560 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.560 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:58.560 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628984+0000", 2024-09-12T18:36:58.560 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013013599999999999 2024-09-12T18:36:58.560 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.560 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.560 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:58.560 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628993+0000", 2024-09-12T18:36:58.561 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:36:58.561 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.561 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.561 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:58.561 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668176+0000", 2024-09-12T18:36:58.561 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.039182211000000002 2024-09-12T18:36:58.561 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.561 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.561 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:58.561 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668481+0000", 2024-09-12T18:36:58.561 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00030499200000000002 2024-09-12T18:36:58.561 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.562 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.562 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:58.562 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668771+0000", 2024-09-12T18:36:58.562 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00029018700000000002 2024-09-12T18:36:58.562 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.562 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.562 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:58.562 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.672674+0000", 2024-09-12T18:36:58.562 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0039031890000000001 2024-09-12T18:36:58.562 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.562 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.562 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:58.562 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673214+0000", 2024-09-12T18:36:58.563 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00053981600000000004 2024-09-12T18:36:58.563 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.563 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.563 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:58.563 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673310+0000", 2024-09-12T18:36:58.563 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.6682999999999996e-05 2024-09-12T18:36:58.563 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.563 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.563 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:58.563 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673378+0000", 2024-09-12T18:36:58.563 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7385999999999995e-05 2024-09-12T18:36:58.563 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.563 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:58.564 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.564 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.564 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.564 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:58.564 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:58.564 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 92.893031241000003, 2024-09-12T18:36:58.564 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.041480853999999998, 2024-09-12T18:36:58.564 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:58.564 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:58.564 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:58.564 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:58.564 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.565 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:58.565 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:58.565 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.565 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.565 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.565 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:58.565 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:36:58.565 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.565 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.565 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.565 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:58.565 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628943+0000", 2024-09-12T18:36:58.565 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.403e-06 2024-09-12T18:36:58.566 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.566 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.566 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:58.566 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628953+0000", 2024-09-12T18:36:58.566 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0273e-05 2024-09-12T18:36:58.566 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.566 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.566 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:58.567 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628973+0000", 2024-09-12T18:36:58.567 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9959999999999999e-05 2024-09-12T18:36:58.567 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.567 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.567 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:58.567 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628989+0000", 2024-09-12T18:36:58.567 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6447e-05 2024-09-12T18:36:58.567 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.567 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.567 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:58.567 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629144+0000", 2024-09-12T18:36:58.567 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015468900000000001 2024-09-12T18:36:58.567 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.568 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.568 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:58.568 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629162+0000", 2024-09-12T18:36:58.568 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7603000000000001e-05 2024-09-12T18:36:58.568 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.568 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.568 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:58.568 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.646927+0000", 2024-09-12T18:36:58.569 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.017765626 2024-09-12T18:36:58.569 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.569 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.569 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:58.569 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.647245+0000", 2024-09-12T18:36:58.569 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00031797699999999999 2024-09-12T18:36:58.569 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.569 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.570 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:58.570 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.647551+0000", 2024-09-12T18:36:58.570 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00030583500000000002 2024-09-12T18:36:58.570 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.570 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.570 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:58.570 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651738+0000", 2024-09-12T18:36:58.570 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0041864980000000003 2024-09-12T18:36:58.571 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.571 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.571 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:58.571 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670207+0000", 2024-09-12T18:36:58.571 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018469299000000002 2024-09-12T18:36:58.571 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.571 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.571 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:58.571 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670330+0000", 2024-09-12T18:36:58.571 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012284500000000001 2024-09-12T18:36:58.572 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.572 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.572 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:58.572 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670422+0000", 2024-09-12T18:36:58.572 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2398999999999994e-05 2024-09-12T18:36:58.572 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.572 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:58.572 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.572 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.572 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.573 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:58.573 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:58.573 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 92.892953988000002, 2024-09-12T18:36:58.573 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.041623741999999998, 2024-09-12T18:36:58.573 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:58.573 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:58.573 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:58.573 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:58.573 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.573 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:58.573 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:58.573 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.573 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.574 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.574 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:58.574 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:36:58.574 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.574 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.574 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.574 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:58.574 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629020+0000", 2024-09-12T18:36:58.575 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.15e-06 2024-09-12T18:36:58.575 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.575 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.575 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:58.575 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629023+0000", 2024-09-12T18:36:58.575 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4659999999999999e-06 2024-09-12T18:36:58.575 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.575 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.575 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:58.575 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629037+0000", 2024-09-12T18:36:58.575 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3857e-05 2024-09-12T18:36:58.576 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.576 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.576 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:58.576 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629062+0000", 2024-09-12T18:36:58.576 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4519999999999999e-05 2024-09-12T18:36:58.576 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.576 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.576 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:58.576 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629253+0000", 2024-09-12T18:36:58.576 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000191335 2024-09-12T18:36:58.576 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.576 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.577 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:58.577 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629266+0000", 2024-09-12T18:36:58.577 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3322999999999999e-05 2024-09-12T18:36:58.577 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.577 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.577 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:58.577 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648331+0000", 2024-09-12T18:36:58.577 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.019065060000000002 2024-09-12T18:36:58.577 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.577 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.577 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:58.577 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.650044+0000", 2024-09-12T18:36:58.578 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017123959999999999 2024-09-12T18:36:58.578 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.578 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.578 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:58.578 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670642+0000", 2024-09-12T18:36:58.578 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.020598635000000001 2024-09-12T18:36:58.578 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.578 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:58.578 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.578 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.578 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.578 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:58.578 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:58.579 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 92.892850655999993, 2024-09-12T18:36:58.579 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.046431252999999999, 2024-09-12T18:36:58.579 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:58.579 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:58.579 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:58.579 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:58.579 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.579 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:58.579 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:58.579 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.579 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.580 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.580 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:58.580 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:36:58.580 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.580 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.580 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.580 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:58.581 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629123+0000", 2024-09-12T18:36:58.581 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0899999999999999e-06 2024-09-12T18:36:58.581 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.581 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.581 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:58.581 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629138+0000", 2024-09-12T18:36:58.581 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4977000000000001e-05 2024-09-12T18:36:58.581 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.581 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.581 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:58.581 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629149+0000", 2024-09-12T18:36:58.581 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1182999999999999e-05 2024-09-12T18:36:58.581 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.582 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.582 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:58.582 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629157+0000", 2024-09-12T18:36:58.582 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8129999999999996e-06 2024-09-12T18:36:58.582 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.582 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.582 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:58.582 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629223+0000", 2024-09-12T18:36:58.583 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6463000000000004e-05 2024-09-12T18:36:58.583 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.583 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.583 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:36:58.583 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629230+0000", 2024-09-12T18:36:58.583 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1360000000000002e-06 2024-09-12T18:36:58.583 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.583 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.583 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:58.583 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669605+0000", 2024-09-12T18:36:58.583 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.040375518999999999 2024-09-12T18:36:58.584 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.584 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.584 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:58.584 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669840+0000", 2024-09-12T18:36:58.584 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00023520099999999999 2024-09-12T18:36:58.584 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.584 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.584 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:58.584 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.675553+0000", 2024-09-12T18:36:58.584 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0057128709999999996 2024-09-12T18:36:58.584 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.584 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:58.584 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.585 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.585 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.585 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:36:58.585 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:58.585 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 92.892795989000007, 2024-09-12T18:36:58.585 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.037357044999999998, 2024-09-12T18:36:58.585 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:58.585 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:58.585 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:36:58.585 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:58.585 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.585 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:58.585 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:58.586 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.586 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.586 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.586 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:58.586 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:36:58.586 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.586 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.586 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.586 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:58.586 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629178+0000", 2024-09-12T18:36:58.586 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.08e-06 2024-09-12T18:36:58.586 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.586 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.587 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:58.587 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629194+0000", 2024-09-12T18:36:58.587 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5899000000000001e-05 2024-09-12T18:36:58.587 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.587 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.587 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:58.587 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629211+0000", 2024-09-12T18:36:58.587 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7363e-05 2024-09-12T18:36:58.587 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.587 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.588 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:58.588 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629226+0000", 2024-09-12T18:36:58.588 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4567e-05 2024-09-12T18:36:58.588 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.588 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.588 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:58.588 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629299+0000", 2024-09-12T18:36:58.588 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3910000000000002e-05 2024-09-12T18:36:58.588 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.588 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.589 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:36:58.589 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629307+0000", 2024-09-12T18:36:58.589 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5299999999999999e-06 2024-09-12T18:36:58.589 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.589 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.589 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:58.589 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648185+0000", 2024-09-12T18:36:58.589 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018878533999999999 2024-09-12T18:36:58.589 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.589 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.589 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:58.589 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.649724+0000", 2024-09-12T18:36:58.590 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001538841 2024-09-12T18:36:58.590 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.590 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.590 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:58.590 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.666534+0000", 2024-09-12T18:36:58.590 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.016809320999999999 2024-09-12T18:36:58.590 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.591 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:58.591 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.591 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.591 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.591 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:80967 5.a 5:5f4000f6:::benchmark_data_smithi073_23739_object80966:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T18:36:58.591 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:18.561016+0000", 2024-09-12T18:36:58.591 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 39.960956394, 2024-09-12T18:36:58.591 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021780831, 2024-09-12T18:36:58.591 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:58.591 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:58.591 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:58.592 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:58.592 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:58.592 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:58.592 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 80967 2024-09-12T18:36:58.592 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.592 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:58.592 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.592 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:58.592 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561016+0000", 2024-09-12T18:36:58.592 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.592 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.592 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.593 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:58.593 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561016+0000", 2024-09-12T18:36:58.593 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.593 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.593 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.593 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:58.593 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561017+0000", 2024-09-12T18:36:58.593 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7599999999999997e-07 2024-09-12T18:36:58.593 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.593 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.593 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:58.593 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561050+0000", 2024-09-12T18:36:58.593 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3524e-05 2024-09-12T18:36:58.594 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.594 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.594 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:58.594 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561058+0000", 2024-09-12T18:36:58.594 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0679999999999997e-06 2024-09-12T18:36:58.594 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.594 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.594 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:58.594 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561065+0000", 2024-09-12T18:36:58.594 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1990000000000003e-06 2024-09-12T18:36:58.594 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.594 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.595 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:58.595 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564735+0000", 2024-09-12T18:36:58.595 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0036706740000000001 2024-09-12T18:36:58.595 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.595 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.595 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:58.595 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564868+0000", 2024-09-12T18:36:58.595 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000133003 2024-09-12T18:36:58.595 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.595 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.595 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:36:58.595 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.565010+0000", 2024-09-12T18:36:58.595 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014224300000000001 2024-09-12T18:36:58.596 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.596 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.596 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:58.596 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.569871+0000", 2024-09-12T18:36:58.596 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0048600759999999996 2024-09-12T18:36:58.596 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.596 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.596 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:58.596 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.582729+0000", 2024-09-12T18:36:58.596 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012858090000000001 2024-09-12T18:36:58.596 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.596 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.596 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:58.597 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.582758+0000", 2024-09-12T18:36:58.597 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.9762999999999999e-05 2024-09-12T18:36:58.597 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.597 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.597 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:58.597 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.582797+0000", 2024-09-12T18:36:58.597 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8615000000000002e-05 2024-09-12T18:36:58.597 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.597 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:58.597 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.597 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.598 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.598 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:108511 5.6 5:608a30a3:::benchmark_data_smithi073_23739_object108510:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:36:58.598 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:31.986730+0000", 2024-09-12T18:36:58.598 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 26.535242520000001, 2024-09-12T18:36:58.598 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021507117999999999, 2024-09-12T18:36:58.598 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:58.598 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:58.598 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:58.598 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:58.598 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:58.598 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:58.598 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 108511 2024-09-12T18:36:58.598 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.599 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:58.599 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.599 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:58.599 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986730+0000", 2024-09-12T18:36:58.599 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.599 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.599 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.599 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:58.599 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986730+0000", 2024-09-12T18:36:58.599 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.599 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.599 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.600 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:58.600 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986731+0000", 2024-09-12T18:36:58.600 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.9100000000000003e-07 2024-09-12T18:36:58.600 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.600 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.600 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:58.600 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986804+0000", 2024-09-12T18:36:58.600 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3647999999999997e-05 2024-09-12T18:36:58.600 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.600 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.600 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:58.601 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986812+0000", 2024-09-12T18:36:58.601 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.34e-06 2024-09-12T18:36:58.601 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.601 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.601 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:58.601 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986836+0000", 2024-09-12T18:36:58.601 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4213e-05 2024-09-12T18:36:58.601 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.602 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.602 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:58.602 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.997047+0000", 2024-09-12T18:36:58.602 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.010210649 2024-09-12T18:36:58.602 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.602 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.603 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:58.603 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.997169+0000", 2024-09-12T18:36:58.603 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012269700000000001 2024-09-12T18:36:58.603 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.603 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.603 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:58.603 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.997300+0000", 2024-09-12T18:36:58.603 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000130858 2024-09-12T18:36:58.603 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.603 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.603 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:58.604 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.002398+0000", 2024-09-12T18:36:58.604 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0050981580000000002 2024-09-12T18:36:58.604 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.604 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.604 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:58.604 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.008093+0000", 2024-09-12T18:36:58.604 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0056941930000000002 2024-09-12T18:36:58.604 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.604 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.604 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:58.604 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.008151+0000", 2024-09-12T18:36:58.604 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8328999999999997e-05 2024-09-12T18:36:58.605 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.605 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.605 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:58.605 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.008237+0000", 2024-09-12T18:36:58.605 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6341999999999994e-05 2024-09-12T18:36:58.605 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.605 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:58.605 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.605 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.605 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.605 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:108623 5.c 5:33792cd3:::benchmark_data_smithi073_23739_object108622:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:36:58.605 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:32.046609+0000", 2024-09-12T18:36:58.605 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 26.475363743999999, 2024-09-12T18:36:58.606 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021062860999999999, 2024-09-12T18:36:58.606 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:58.606 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:58.606 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:58.606 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:58.606 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:58.606 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:58.606 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 108623 2024-09-12T18:36:58.606 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.606 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:58.606 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.606 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:58.606 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.046609+0000", 2024-09-12T18:36:58.606 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.607 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.607 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.607 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:58.607 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.046609+0000", 2024-09-12T18:36:58.607 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.607 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.607 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.607 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:58.607 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.046609+0000", 2024-09-12T18:36:58.607 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.37e-07 2024-09-12T18:36:58.607 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.607 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.608 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:58.608 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.046690+0000", 2024-09-12T18:36:58.608 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0212999999999999e-05 2024-09-12T18:36:58.608 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.608 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.608 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:58.608 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.046698+0000", 2024-09-12T18:36:58.608 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6430000000000001e-06 2024-09-12T18:36:58.608 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.608 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.608 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:58.608 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.046704+0000", 2024-09-12T18:36:58.609 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7699999999999998e-06 2024-09-12T18:36:58.609 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.609 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.609 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:58.609 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.056808+0000", 2024-09-12T18:36:58.609 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.010103562999999999 2024-09-12T18:36:58.609 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.609 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.609 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:58.609 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.056989+0000", 2024-09-12T18:36:58.609 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000181196 2024-09-12T18:36:58.609 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.609 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.610 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:58.610 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.057162+0000", 2024-09-12T18:36:58.610 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000173396 2024-09-12T18:36:58.610 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.610 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.610 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:58.610 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.063269+0000", 2024-09-12T18:36:58.610 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0061066100000000002 2024-09-12T18:36:58.610 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.610 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.610 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:58.610 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.067578+0000", 2024-09-12T18:36:58.611 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0043092570000000004 2024-09-12T18:36:58.611 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.611 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.611 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:58.611 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.067628+0000", 2024-09-12T18:36:58.611 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0136999999999998e-05 2024-09-12T18:36:58.611 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.612 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.612 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:58.612 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.067672+0000", 2024-09-12T18:36:58.612 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3439000000000002e-05 2024-09-12T18:36:58.612 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.612 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:58.612 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.613 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.613 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.613 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:121033 5.0 e50/49 5:0b3817c1:::benchmark_data_smithi073_23739_object121032:head v 50'7620, mlcod=0'0)", 2024-09-12T18:36:58.613 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:40.165057+0000", 2024-09-12T18:36:58.613 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 18.356916022, 2024-09-12T18:36:58.613 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.030641286, 2024-09-12T18:36:58.613 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:58.613 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:58.613 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:58.613 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:58.613 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.613 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:58.614 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.165057+0000", 2024-09-12T18:36:58.614 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.614 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.614 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.614 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:58.614 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.165057+0000", 2024-09-12T18:36:58.614 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.614 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.614 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.614 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:58.614 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.165057+0000", 2024-09-12T18:36:58.614 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8599999999999998e-07 2024-09-12T18:36:58.614 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.615 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.615 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:58.615 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.165109+0000", 2024-09-12T18:36:58.615 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2086000000000002e-05 2024-09-12T18:36:58.615 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.615 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.615 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:58.615 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.165161+0000", 2024-09-12T18:36:58.615 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1415000000000002e-05 2024-09-12T18:36:58.615 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.616 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.616 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:58.616 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.165178+0000", 2024-09-12T18:36:58.616 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7790000000000001e-05 2024-09-12T18:36:58.616 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.616 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.616 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:58.616 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.168784+0000", 2024-09-12T18:36:58.616 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0036052050000000002 2024-09-12T18:36:58.617 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.617 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.617 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:58.617 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.168854+0000", 2024-09-12T18:36:58.617 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0814000000000003e-05 2024-09-12T18:36:58.617 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.617 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.617 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:58.617 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.195600+0000", 2024-09-12T18:36:58.617 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.026745173000000001 2024-09-12T18:36:58.617 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.617 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.617 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:58.618 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.195698+0000", 2024-09-12T18:36:58.618 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.8317000000000001e-05 2024-09-12T18:36:58.618 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.618 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:58.618 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.618 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.618 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.618 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:121044 5.1 e50/49 5:83bf711a:::benchmark_data_smithi073_23739_object121043:head v 50'7532, mlcod=0'0)", 2024-09-12T18:36:58.618 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:40.200337+0000", 2024-09-12T18:36:58.618 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 18.321636021, 2024-09-12T18:36:58.619 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.023483312999999999, 2024-09-12T18:36:58.619 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:58.619 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:58.619 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:58.619 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:58.619 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.619 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:58.619 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200337+0000", 2024-09-12T18:36:58.620 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.620 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.620 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.620 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:58.620 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200337+0000", 2024-09-12T18:36:58.620 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.620 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.620 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.621 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:58.621 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200338+0000", 2024-09-12T18:36:58.621 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.877e-06 2024-09-12T18:36:58.621 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.621 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.621 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:58.622 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200558+0000", 2024-09-12T18:36:58.622 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00021912799999999999 2024-09-12T18:36:58.622 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.622 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.622 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:58.622 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200584+0000", 2024-09-12T18:36:58.623 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.6333e-05 2024-09-12T18:36:58.623 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.623 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.623 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:58.623 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200602+0000", 2024-09-12T18:36:58.624 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.853e-05 2024-09-12T18:36:58.624 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.624 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.624 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:58.624 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200753+0000", 2024-09-12T18:36:58.624 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015061299999999999 2024-09-12T18:36:58.625 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.625 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.625 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:58.625 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200790+0000", 2024-09-12T18:36:58.625 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.7398999999999999e-05 2024-09-12T18:36:58.626 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.626 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.626 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:58.626 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.223743+0000", 2024-09-12T18:36:58.626 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.022952455 2024-09-12T18:36:58.626 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.627 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.627 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:58.627 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.223820+0000", 2024-09-12T18:36:58.627 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6977999999999994e-05 2024-09-12T18:36:58.627 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.628 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:58.628 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.628 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.628 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.628 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:121110 5.2 e50/21 5:4dc37b93:::benchmark_data_smithi073_23739_object121109:head v 50'7513, mlcod=48'7511)", 2024-09-12T18:36:58.629 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:40.241103+0000", 2024-09-12T18:36:58.629 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 18.280869979999999, 2024-09-12T18:36:58.629 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021833894, 2024-09-12T18:36:58.629 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:58.629 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:58.629 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:58.630 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:58.630 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.630 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:58.630 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241103+0000", 2024-09-12T18:36:58.630 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.630 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.631 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.631 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:58.631 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241103+0000", 2024-09-12T18:36:58.631 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.631 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.632 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.632 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:58.632 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241104+0000", 2024-09-12T18:36:58.632 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.7999999999999993e-07 2024-09-12T18:36:58.632 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.632 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.633 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:58.633 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241162+0000", 2024-09-12T18:36:58.633 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8319000000000002e-05 2024-09-12T18:36:58.633 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.633 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.634 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:58.634 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241181+0000", 2024-09-12T18:36:58.634 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9055999999999998e-05 2024-09-12T18:36:58.634 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.634 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.635 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:58.635 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241191+0000", 2024-09-12T18:36:58.635 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.9359999999999994e-06 2024-09-12T18:36:58.635 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.635 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.635 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:58.636 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241305+0000", 2024-09-12T18:36:58.636 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000114134 2024-09-12T18:36:58.636 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.636 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.636 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:58.637 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241372+0000", 2024-09-12T18:36:58.637 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6521999999999998e-05 2024-09-12T18:36:58.637 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.637 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.637 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:58.638 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.262837+0000", 2024-09-12T18:36:58.638 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021465766000000001 2024-09-12T18:36:58.638 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.638 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.638 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:58.639 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.262937+0000", 2024-09-12T18:36:58.639 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.9180999999999998e-05 2024-09-12T18:36:58.639 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.639 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:58.639 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.639 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.640 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.640 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:121160 5.b e50/21 5:d4730c8e:::benchmark_data_smithi073_23739_object121159:head v 50'7640, mlcod=47'7638)", 2024-09-12T18:36:58.640 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:40.289729+0000", 2024-09-12T18:36:58.640 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 18.232243434000001, 2024-09-12T18:36:58.640 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021365733000000001, 2024-09-12T18:36:58.641 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:58.641 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:58.641 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:58.641 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:58.641 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.641 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:58.642 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.289729+0000", 2024-09-12T18:36:58.642 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.642 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.642 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.642 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:58.643 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.289729+0000", 2024-09-12T18:36:58.643 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.643 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.643 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.643 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:58.644 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.289730+0000", 2024-09-12T18:36:58.644 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1799999999999995e-07 2024-09-12T18:36:58.644 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.644 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.644 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:58.645 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.289831+0000", 2024-09-12T18:36:58.645 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000101122 2024-09-12T18:36:58.645 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.645 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.645 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:58.645 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.289847+0000", 2024-09-12T18:36:58.646 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5787999999999999e-05 2024-09-12T18:36:58.646 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.646 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.646 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:58.646 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.289859+0000", 2024-09-12T18:36:58.647 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2439000000000001e-05 2024-09-12T18:36:58.647 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.647 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.647 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:58.647 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.289998+0000", 2024-09-12T18:36:58.647 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000138725 2024-09-12T18:36:58.648 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.648 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.648 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:58.648 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.290055+0000", 2024-09-12T18:36:58.648 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7166000000000001e-05 2024-09-12T18:36:58.648 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.649 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.649 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:58.649 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.311028+0000", 2024-09-12T18:36:58.649 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.020972602 2024-09-12T18:36:58.649 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.650 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.650 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:58.650 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.311095+0000", 2024-09-12T18:36:58.650 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7273000000000005e-05 2024-09-12T18:36:58.650 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.651 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:58.651 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.651 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.651 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.651 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:131544 5.6 5:6ce76cfc:::benchmark_data_smithi073_23739_object131543:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:36:58.651 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:45.497129+0000", 2024-09-12T18:36:58.652 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 13.024843469, 2024-09-12T18:36:58.652 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.02367524, 2024-09-12T18:36:58.652 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:58.652 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:58.652 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:58.653 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:58.653 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:58.653 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:58.653 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 131544 2024-09-12T18:36:58.653 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.653 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:58.654 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.654 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:58.654 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497129+0000", 2024-09-12T18:36:58.654 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.654 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.655 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.655 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:58.655 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497129+0000", 2024-09-12T18:36:58.655 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.655 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.655 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.655 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:58.655 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497130+0000", 2024-09-12T18:36:58.656 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1620000000000001e-06 2024-09-12T18:36:58.656 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.656 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.656 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:58.656 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497205+0000", 2024-09-12T18:36:58.656 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4707000000000001e-05 2024-09-12T18:36:58.656 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.656 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.656 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:58.656 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497216+0000", 2024-09-12T18:36:58.656 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1362999999999999e-05 2024-09-12T18:36:58.657 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.657 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.657 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:58.657 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497225+0000", 2024-09-12T18:36:58.657 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7050000000000005e-06 2024-09-12T18:36:58.657 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.657 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.657 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:58.658 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.498575+0000", 2024-09-12T18:36:58.658 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0013500319999999999 2024-09-12T18:36:58.658 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.658 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.658 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:58.658 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.498712+0000", 2024-09-12T18:36:58.658 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013682200000000001 2024-09-12T18:36:58.658 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.658 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.658 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:58.658 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.498954+0000", 2024-09-12T18:36:58.658 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00024196499999999999 2024-09-12T18:36:58.658 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.659 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.659 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:58.659 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.503854+0000", 2024-09-12T18:36:58.659 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0049002020000000002 2024-09-12T18:36:58.659 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.659 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.659 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:58.659 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.520739+0000", 2024-09-12T18:36:58.659 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.016884698 2024-09-12T18:36:58.659 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.659 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.659 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:58.659 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.520775+0000", 2024-09-12T18:36:58.659 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.5941e-05 2024-09-12T18:36:58.660 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.660 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.660 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:58.660 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.520804+0000", 2024-09-12T18:36:58.660 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.9643000000000001e-05 2024-09-12T18:36:58.660 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.660 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:58.660 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.660 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.660 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.660 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:131545 5.6 5:6da49e54:::benchmark_data_smithi073_23739_object131544:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:36:58.660 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:45.497399+0000", 2024-09-12T18:36:58.661 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 13.024573849999999, 2024-09-12T18:36:58.661 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.032319729999999998, 2024-09-12T18:36:58.661 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:58.661 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:58.661 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:58.661 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:58.661 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:58.661 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:58.661 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 131545 2024-09-12T18:36:58.661 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.661 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:58.661 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.661 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:58.662 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497399+0000", 2024-09-12T18:36:58.662 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.662 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.662 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.662 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:58.662 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497399+0000", 2024-09-12T18:36:58.662 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.662 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.662 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.662 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:58.662 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497400+0000", 2024-09-12T18:36:58.662 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.7900000000000007e-07 2024-09-12T18:36:58.662 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.663 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.663 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:58.663 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497500+0000", 2024-09-12T18:36:58.663 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00010021799999999999 2024-09-12T18:36:58.663 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.663 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.663 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:58.663 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497509+0000", 2024-09-12T18:36:58.663 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.9299999999999992e-06 2024-09-12T18:36:58.663 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.663 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.663 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:58.664 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497513+0000", 2024-09-12T18:36:58.664 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4129999999999999e-06 2024-09-12T18:36:58.664 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.664 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.664 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:58.664 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.501900+0000", 2024-09-12T18:36:58.664 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0043864730000000001 2024-09-12T18:36:58.664 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.664 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.664 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:58.664 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.502054+0000", 2024-09-12T18:36:58.664 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015438299999999999 2024-09-12T18:36:58.665 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.665 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.665 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:58.665 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.502147+0000", 2024-09-12T18:36:58.665 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.3187000000000001e-05 2024-09-12T18:36:58.665 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.665 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.665 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:58.665 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.504510+0000", 2024-09-12T18:36:58.665 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0023626509999999999 2024-09-12T18:36:58.665 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.665 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.665 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:58.666 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.529615+0000", 2024-09-12T18:36:58.666 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.025104688999999999 2024-09-12T18:36:58.666 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.666 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.666 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:58.666 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.529673+0000", 2024-09-12T18:36:58.666 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8451e-05 2024-09-12T18:36:58.666 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.666 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.666 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:58.666 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.529718+0000", 2024-09-12T18:36:58.667 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5355999999999997e-05 2024-09-12T18:36:58.667 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.667 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:58.667 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.667 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.667 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.667 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:131550 5.3 5:c5ee897a:::benchmark_data_smithi073_23739_object131549:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:36:58.667 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:45.499088+0000", 2024-09-12T18:36:58.667 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 13.022884439, 2024-09-12T18:36:58.667 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021584709000000001, 2024-09-12T18:36:58.667 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:58.667 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:58.667 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:58.667 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:58.668 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:58.668 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:58.668 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 131550 2024-09-12T18:36:58.668 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.668 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:58.668 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.668 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:58.668 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499088+0000", 2024-09-12T18:36:58.668 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.668 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.668 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.668 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:58.669 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499088+0000", 2024-09-12T18:36:58.669 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.669 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.669 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.669 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:58.669 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499089+0000", 2024-09-12T18:36:58.669 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.0299999999999997e-07 2024-09-12T18:36:58.669 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.669 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.669 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:58.670 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499166+0000", 2024-09-12T18:36:58.670 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.7257999999999998e-05 2024-09-12T18:36:58.670 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.670 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.670 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:58.670 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499173+0000", 2024-09-12T18:36:58.670 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1509999999999998e-06 2024-09-12T18:36:58.670 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.670 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.670 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:58.670 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499178+0000", 2024-09-12T18:36:58.671 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.78e-06 2024-09-12T18:36:58.671 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.671 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.671 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:58.671 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499231+0000", 2024-09-12T18:36:58.671 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2621999999999999e-05 2024-09-12T18:36:58.671 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.671 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.671 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:58.672 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499326+0000", 2024-09-12T18:36:58.672 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.5567000000000002e-05 2024-09-12T18:36:58.672 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.672 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.672 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:58.672 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499419+0000", 2024-09-12T18:36:58.672 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2417000000000006e-05 2024-09-12T18:36:58.672 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.672 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.672 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:58.672 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.503781+0000", 2024-09-12T18:36:58.673 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.004362192 2024-09-12T18:36:58.673 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.673 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.673 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:58.673 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.520606+0000", 2024-09-12T18:36:58.673 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.016824784999999998 2024-09-12T18:36:58.673 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.673 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.673 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:58.673 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.520642+0000", 2024-09-12T18:36:58.673 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.6313000000000003e-05 2024-09-12T18:36:58.673 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.673 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.674 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:58.674 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.520673+0000", 2024-09-12T18:36:58.674 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.0720999999999999e-05 2024-09-12T18:36:58.674 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.674 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:58.674 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.674 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.674 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.674 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:131552 5.3 5:cb8dda54:::benchmark_data_smithi073_23739_object131551:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:36:58.674 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:45.499423+0000", 2024-09-12T18:36:58.675 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 13.022549584, 2024-09-12T18:36:58.675 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.024733523, 2024-09-12T18:36:58.675 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:36:58.675 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:36:58.675 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:36:58.675 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:36:58.675 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:36:58.675 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:58.675 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 131552 2024-09-12T18:36:58.676 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.676 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:36:58.676 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.676 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:36:58.676 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499423+0000", 2024-09-12T18:36:58.676 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.676 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.676 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.676 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:36:58.676 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499423+0000", 2024-09-12T18:36:58.676 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:36:58.676 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.676 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.677 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:36:58.677 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499424+0000", 2024-09-12T18:36:58.677 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.95e-07 2024-09-12T18:36:58.677 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.677 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.677 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:36:58.677 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499507+0000", 2024-09-12T18:36:58.677 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.3258999999999997e-05 2024-09-12T18:36:58.677 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.677 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.677 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:36:58.677 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499518+0000", 2024-09-12T18:36:58.677 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.064e-05 2024-09-12T18:36:58.678 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.678 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.678 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:36:58.678 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499525+0000", 2024-09-12T18:36:58.678 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.9709999999999998e-06 2024-09-12T18:36:58.678 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.678 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.678 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:36:58.678 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.501699+0000", 2024-09-12T18:36:58.678 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0021738500000000002 2024-09-12T18:36:58.678 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.678 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.678 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:36:58.678 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.501809+0000", 2024-09-12T18:36:58.679 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000109888 2024-09-12T18:36:58.679 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.679 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.679 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:36:58.679 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.501960+0000", 2024-09-12T18:36:58.679 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015157899999999999 2024-09-12T18:36:58.679 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.679 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.679 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:36:58.679 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.504165+0000", 2024-09-12T18:36:58.679 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.002204849 2024-09-12T18:36:58.679 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.679 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.679 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:58.679 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.524053+0000", 2024-09-12T18:36:58.680 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.019887621000000001 2024-09-12T18:36:58.680 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.680 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.680 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:36:58.680 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.524110+0000", 2024-09-12T18:36:58.680 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7191000000000002e-05 2024-09-12T18:36:58.680 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:36:58.680 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:36:58.680 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:36:58.680 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.524157+0000", 2024-09-12T18:36:58.680 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.668e-05 2024-09-12T18:36:58.680 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.680 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:58.681 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.681 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:36:58.681 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:36:58.681 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:36:58.682 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:36:58.683 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:58.677+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:58.784 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:58.777+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:58.806 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:36:58.850 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:36:58.850 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:36:58.850 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.850 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:158431 5.0 5:016921ef:::benchmark_data_smithi073_23739_object26154:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T18:36:58.850 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:58.846673+0000", 2024-09-12T18:36:58.850 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0011457329999999999, 2024-09-12T18:36:58.850 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011702959999999999, 2024-09-12T18:36:58.850 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:58.851 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:58.851 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:58.851 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:58.851 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:58.851 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:58.851 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 158431 2024-09-12T18:36:58.851 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.851 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:58.851 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.851 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:58.851 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.846673+0000", 2024-09-12T18:36:58.851 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:58.851 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.852 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.852 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:58.852 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.846673+0000", 2024-09-12T18:36:58.852 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:58.852 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.852 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.852 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:58.852 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.846675+0000", 2024-09-12T18:36:58.852 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.547e-06 2024-09-12T18:36:58.852 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.852 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.853 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:58.853 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.846679+0000", 2024-09-12T18:36:58.853 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1910000000000002e-06 2024-09-12T18:36:58.853 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.853 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.853 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:58.853 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.846689+0000", 2024-09-12T18:36:58.853 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5570000000000001e-06 2024-09-12T18:36:58.853 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.853 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.853 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:58.853 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.846695+0000", 2024-09-12T18:36:58.853 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7009999999999999e-06 2024-09-12T18:36:58.854 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.854 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.854 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:58.854 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.847725+0000", 2024-09-12T18:36:58.854 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001029297 2024-09-12T18:36:58.854 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.854 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.854 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:58.854 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.847809+0000", 2024-09-12T18:36:58.854 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3996e-05 2024-09-12T18:36:58.854 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:58.854 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:58.854 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:58.855 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.855 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.855 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:158432 5.0 5.fe645f10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T18:36:58.855 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:58.846771+0000", 2024-09-12T18:36:58.855 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0010483960000000001, 2024-09-12T18:36:58.855 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011371739999999999, 2024-09-12T18:36:58.855 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:58.855 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:58.855 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:58.855 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:58.855 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:58.855 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:58.855 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 158432 2024-09-12T18:36:58.856 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.856 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:58.856 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.856 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:58.856 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.846771+0000", 2024-09-12T18:36:58.856 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:58.856 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.856 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.856 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:58.857 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.846771+0000", 2024-09-12T18:36:58.857 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:58.857 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.857 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.857 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:58.857 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.846772+0000", 2024-09-12T18:36:58.857 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7499999999999999e-07 2024-09-12T18:36:58.857 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.857 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.857 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:58.858 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.846775+0000", 2024-09-12T18:36:58.858 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3969999999999998e-06 2024-09-12T18:36:58.858 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.858 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.858 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:58.858 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.846785+0000", 2024-09-12T18:36:58.858 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.7319999999999993e-06 2024-09-12T18:36:58.858 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.858 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.858 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:58.858 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.846791+0000", 2024-09-12T18:36:58.858 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.3990000000000001e-06 2024-09-12T18:36:58.858 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:58.859 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:58.859 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:58.859 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.859 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.859 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:158434 5.0 5.21b4de0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T18:36:58.859 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:58.846855+0000", 2024-09-12T18:36:58.859 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00096373800000000001, 2024-09-12T18:36:58.859 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011006849999999999, 2024-09-12T18:36:58.859 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:58.859 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:58.859 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-09-12T18:36:58.859 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:58.860 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:58.860 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:58.860 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 158434 2024-09-12T18:36:58.860 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.860 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:58.860 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.860 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:58.860 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.846855+0000", 2024-09-12T18:36:58.860 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:58.860 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.860 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.861 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:58.861 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.846855+0000", 2024-09-12T18:36:58.861 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:58.861 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.861 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.861 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:58.861 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.846856+0000", 2024-09-12T18:36:58.861 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.06e-07 2024-09-12T18:36:58.861 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.861 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.861 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:58.861 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.846859+0000", 2024-09-12T18:36:58.861 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1999999999999999e-06 2024-09-12T18:36:58.862 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.862 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.862 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:58.862 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.846871+0000", 2024-09-12T18:36:58.862 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1698e-05 2024-09-12T18:36:58.862 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.862 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.862 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:58.862 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.846877+0000", 2024-09-12T18:36:58.862 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8939999999999998e-06 2024-09-12T18:36:58.862 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:58.862 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:58.862 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:58.863 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.863 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.863 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:158440 5.b 5:d10bd902:::benchmark_data_smithi073_23739_object26163:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T18:36:58.863 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:58.847139+0000", 2024-09-12T18:36:58.863 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00067971000000000004, 2024-09-12T18:36:58.863 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00086475400000000002, 2024-09-12T18:36:58.863 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:58.863 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:58.863 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:58.863 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:58.863 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:58.863 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:58.863 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 158440 2024-09-12T18:36:58.864 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.864 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:58.864 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.864 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:58.864 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.847139+0000", 2024-09-12T18:36:58.864 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:58.864 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.864 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.864 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:58.864 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.847139+0000", 2024-09-12T18:36:58.864 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:58.864 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.864 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.865 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:58.865 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.847140+0000", 2024-09-12T18:36:58.865 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5300000000000003e-07 2024-09-12T18:36:58.865 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.865 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.865 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:58.865 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.847144+0000", 2024-09-12T18:36:58.865 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3349999999999998e-06 2024-09-12T18:36:58.865 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.865 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.865 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:58.865 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.847152+0000", 2024-09-12T18:36:58.866 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.602e-06 2024-09-12T18:36:58.866 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.866 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.866 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:58.866 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.847157+0000", 2024-09-12T18:36:58.866 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6290000000000001e-06 2024-09-12T18:36:58.866 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.866 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.866 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:58.866 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.847194+0000", 2024-09-12T18:36:58.866 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7592999999999997e-05 2024-09-12T18:36:58.866 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.866 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.867 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:58.867 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.847273+0000", 2024-09-12T18:36:58.867 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.8237000000000003e-05 2024-09-12T18:36:58.867 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.867 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.867 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:36:58.867 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.847340+0000", 2024-09-12T18:36:58.867 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7167000000000003e-05 2024-09-12T18:36:58.867 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:58.867 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:58.867 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:58.867 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.867 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.868 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:158439 5.f e57/21 5:f5f9ab1b:::benchmark_data_smithi073_23739_object26162:head v 57'9837, mlcod=57'9834)", 2024-09-12T18:36:58.868 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:58.847391+0000", 2024-09-12T18:36:58.868 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00042824900000000001, 2024-09-12T18:36:58.868 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00067672700000000001, 2024-09-12T18:36:58.868 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:58.868 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:58.868 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:58.868 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:58.868 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.868 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:58.868 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.847391+0000", 2024-09-12T18:36:58.868 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:58.868 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.868 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.869 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:58.869 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.847391+0000", 2024-09-12T18:36:58.869 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:58.869 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.869 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.869 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:58.869 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.847392+0000", 2024-09-12T18:36:58.869 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5099999999999999e-07 2024-09-12T18:36:58.869 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.870 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.870 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:58.870 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.847397+0000", 2024-09-12T18:36:58.870 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9980000000000003e-06 2024-09-12T18:36:58.870 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.870 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.870 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:58.870 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.847405+0000", 2024-09-12T18:36:58.870 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2470000000000008e-06 2024-09-12T18:36:58.870 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.870 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.870 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:58.870 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.847410+0000", 2024-09-12T18:36:58.871 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0900000000000004e-06 2024-09-12T18:36:58.871 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.871 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.871 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:58.871 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.847461+0000", 2024-09-12T18:36:58.871 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0745999999999998e-05 2024-09-12T18:36:58.871 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.871 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.871 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:58.871 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.847479+0000", 2024-09-12T18:36:58.871 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8349999999999999e-05 2024-09-12T18:36:58.871 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:58.871 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:58.872 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:58.872 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.872 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.872 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:158438 5.1 e57/49 5:8518a406:::benchmark_data_smithi073_23739_object26161:head v 57'9855, mlcod=57'9853)", 2024-09-12T18:36:58.872 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:58.847932+0000", 2024-09-12T18:36:58.872 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4294967295.9998875, 2024-09-12T18:36:58.872 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00018846299999999999, 2024-09-12T18:36:58.872 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:58.872 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:58.872 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:58.872 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:58.872 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.873 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:58.873 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.847932+0000", 2024-09-12T18:36:58.873 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:58.873 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.873 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.873 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:58.873 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.847932+0000", 2024-09-12T18:36:58.873 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:58.873 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.873 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.873 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:58.873 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.847932+0000", 2024-09-12T18:36:58.874 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4199999999999995e-07 2024-09-12T18:36:58.874 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.874 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.874 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:58.874 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.847937+0000", 2024-09-12T18:36:58.874 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7700000000000001e-06 2024-09-12T18:36:58.874 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.874 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.874 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:58.875 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.847947+0000", 2024-09-12T18:36:58.875 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0032e-05 2024-09-12T18:36:58.875 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.875 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.875 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:58.875 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.847957+0000", 2024-09-12T18:36:58.875 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0223e-05 2024-09-12T18:36:58.876 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.876 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.876 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:58.876 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.848005+0000", 2024-09-12T18:36:58.876 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7803000000000003e-05 2024-09-12T18:36:58.876 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.876 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.876 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:58.876 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.848023+0000", 2024-09-12T18:36:58.877 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7581e-05 2024-09-12T18:36:58.877 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:58.877 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:58.877 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:58.877 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.877 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.877 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:158426 5.0 5:0de09cb1:::benchmark_data_smithi073_23739_object26149:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T18:36:58.878 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:58.842874+0000", 2024-09-12T18:36:58.878 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0049446070000000002, 2024-09-12T18:36:58.878 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.005297398, 2024-09-12T18:36:58.878 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:58.878 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:58.878 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:36:58.878 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:36:58.878 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:36:58.879 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:36:58.879 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 158426 2024-09-12T18:36:58.879 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.879 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:58.879 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.879 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:58.879 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.842874+0000", 2024-09-12T18:36:58.879 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:58.880 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.880 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.880 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:58.880 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.842874+0000", 2024-09-12T18:36:58.880 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:58.880 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.880 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.881 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:58.881 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.842876+0000", 2024-09-12T18:36:58.881 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.062e-06 2024-09-12T18:36:58.881 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.881 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.881 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:58.881 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.842880+0000", 2024-09-12T18:36:58.881 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3640000000000001e-06 2024-09-12T18:36:58.882 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.882 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.882 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:58.882 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.842887+0000", 2024-09-12T18:36:58.882 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7900000000000002e-06 2024-09-12T18:36:58.882 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.882 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.882 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:58.883 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.842891+0000", 2024-09-12T18:36:58.883 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.685e-06 2024-09-12T18:36:58.883 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.883 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.883 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:58.883 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.843127+0000", 2024-09-12T18:36:58.883 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00023526499999999999 2024-09-12T18:36:58.884 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.884 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.884 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:58.884 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.843278+0000", 2024-09-12T18:36:58.884 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000151471 2024-09-12T18:36:58.884 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.884 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.884 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0,2", 2024-09-12T18:36:58.885 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.843407+0000", 2024-09-12T18:36:58.885 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012941100000000001 2024-09-12T18:36:58.885 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.885 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.885 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:36:58.885 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.846662+0000", 2024-09-12T18:36:58.885 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0032542980000000001 2024-09-12T18:36:58.886 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:58.886 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:58.886 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:58.886 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.886 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.886 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:158423 5.a e57/21 5:5be5d4d9:::benchmark_data_smithi073_23739_object26146:head v 57'10020, mlcod=57'10016)", 2024-09-12T18:36:58.886 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:58.843088+0000", 2024-09-12T18:36:58.886 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0047306730000000003, 2024-09-12T18:36:58.886 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0051513640000000003, 2024-09-12T18:36:58.886 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:58.886 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:58.887 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:58.887 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:58.887 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.887 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:58.887 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.843088+0000", 2024-09-12T18:36:58.887 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:58.887 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.887 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.887 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:58.887 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.843088+0000", 2024-09-12T18:36:58.887 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:58.887 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.887 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.888 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:58.888 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.843089+0000", 2024-09-12T18:36:58.888 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1699999999999997e-07 2024-09-12T18:36:58.888 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.888 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.888 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:58.888 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.843094+0000", 2024-09-12T18:36:58.888 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.814e-06 2024-09-12T18:36:58.888 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.888 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.888 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:58.888 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.843111+0000", 2024-09-12T18:36:58.888 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7218999999999999e-05 2024-09-12T18:36:58.889 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.889 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.889 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:58.889 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.843116+0000", 2024-09-12T18:36:58.889 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0679999999999996e-06 2024-09-12T18:36:58.889 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.889 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.889 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:58.889 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.843910+0000", 2024-09-12T18:36:58.889 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00079387700000000002 2024-09-12T18:36:58.889 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.889 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.889 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:58.890 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.843931+0000", 2024-09-12T18:36:58.890 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1095999999999999e-05 2024-09-12T18:36:58.890 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:58.890 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:58.890 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:58.890 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.890 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.890 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:158427 5.5 e57/49 5:a125549f:::benchmark_data_smithi073_23739_object26150:head v 57'10021, mlcod=57'10019)", 2024-09-12T18:36:58.890 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:58.844774+0000", 2024-09-12T18:36:58.890 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0030451779999999999, 2024-09-12T18:36:58.890 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035241859999999999, 2024-09-12T18:36:58.890 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:58.890 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:58.890 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:58.891 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:58.891 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.891 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:58.891 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.844774+0000", 2024-09-12T18:36:58.891 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:58.891 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.891 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.891 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:58.891 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.844774+0000", 2024-09-12T18:36:58.891 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:58.891 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.891 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.891 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:58.891 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.844775+0000", 2024-09-12T18:36:58.892 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.37e-07 2024-09-12T18:36:58.892 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.892 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.892 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:58.892 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.844779+0000", 2024-09-12T18:36:58.892 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8420000000000004e-06 2024-09-12T18:36:58.892 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.892 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.892 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:58.892 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.844789+0000", 2024-09-12T18:36:58.892 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0040999999999999e-05 2024-09-12T18:36:58.892 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.892 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.893 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:58.893 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.844796+0000", 2024-09-12T18:36:58.893 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.139e-06 2024-09-12T18:36:58.893 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.893 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.893 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:58.893 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.844852+0000", 2024-09-12T18:36:58.893 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.626e-05 2024-09-12T18:36:58.893 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.893 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.893 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:58.894 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.844873+0000", 2024-09-12T18:36:58.894 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1316000000000001e-05 2024-09-12T18:36:58.894 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:58.894 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:58.894 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:58.894 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.894 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.894 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:158429 5.f e57/21 5:f9b8eeba:::benchmark_data_smithi073_23739_object26152:head v 57'9836, mlcod=57'9833)", 2024-09-12T18:36:58.894 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:58.844869+0000", 2024-09-12T18:36:58.894 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0029495789999999999, 2024-09-12T18:36:58.894 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003476416, 2024-09-12T18:36:58.894 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:36:58.894 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:36:58.894 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:36:58.895 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:36:58.895 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.895 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:36:58.895 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.844869+0000", 2024-09-12T18:36:58.895 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:58.895 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.895 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.895 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:36:58.895 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.844869+0000", 2024-09-12T18:36:58.895 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:36:58.895 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.895 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.895 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:36:58.896 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.844870+0000", 2024-09-12T18:36:58.896 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1699999999999998e-07 2024-09-12T18:36:58.896 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.896 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.896 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:36:58.896 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.844875+0000", 2024-09-12T18:36:58.896 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5469999999999998e-06 2024-09-12T18:36:58.896 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.896 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.896 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:36:58.896 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.844884+0000", 2024-09-12T18:36:58.896 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8209999999999997e-06 2024-09-12T18:36:58.897 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.897 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.897 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:36:58.897 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.844890+0000", 2024-09-12T18:36:58.897 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6280000000000002e-06 2024-09-12T18:36:58.897 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.897 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.897 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:36:58.897 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.844932+0000", 2024-09-12T18:36:58.897 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2233e-05 2024-09-12T18:36:58.897 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:36:58.897 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:36:58.897 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:36:58.898 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:58.844947+0000", 2024-09-12T18:36:58.898 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5183e-05 2024-09-12T18:36:58.898 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:58.898 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:36:58.898 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:58.898 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:36:58.898 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-09-12T18:36:58.898 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 10 2024-09-12T18:36:58.898 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:36:58.899 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:58.895+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:58.900 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:36:58.964 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:36:58.964 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:36:58.982 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:36:58.983 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:36:59.000 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:36:59.000 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:58.995+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:59.000 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:36:59.099 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:59.100 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:59.101 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:59.095+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:59.120 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:36:59.202 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:59.197+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:59.277 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:59.277 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:59.298 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:36:59.303 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:59.295+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:59.404 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:59.397+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:59.446 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:59.446 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:59.466 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:36:59.494 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T18:36:59.504 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:59.499+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:59.605 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:36:59.599+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:36:59.618 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:59.618 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:59.637 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:36:59.706 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:59.703+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:59.771 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:59.771 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:59.790 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:36:59.838 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:36:59.835+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:36:59.908 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:36:59.901+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:36:59.945 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:36:59.945 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:36:59.968 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:37:00.008 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:00.003+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:00.109 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:00.103+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:00.124 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:00.124 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:00.139 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:37:00.210 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:00.207+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:00.296 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:00.296 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:00.311 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:00.307+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:00.317 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:37:00.412 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:00.407+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:00.472 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:00.473 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:00.489 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is unset 2024-09-12T18:37:00.495 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:37:00.513 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:00.507+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:00.614 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:00.611+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:00.646 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:00.646 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:00.670 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:37:00.716 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:00.711+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:00.817 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:00.811+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:00.831 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:00.831 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:00.853 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:37:00.918 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:00.913+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:01.012 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:01.012 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:01.018 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:37:01.019 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:01.013+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:01.031 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:37:01.120 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:01.113+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:01.173 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:37:01.173 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:37:01.191 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:37:01.192 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:37:01.194 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:01.194 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:01.209 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:37:01.210 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:37:01.217 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:37:01.221 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:01.215+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:01.322 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:01.319+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:01.382 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:01.382 INFO:teuthology.orchestra.run.smithi162.stdout: "size": 20, 2024-09-12T18:37:01.382 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 600, 2024-09-12T18:37:01.382 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:37:01.382 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.382 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4154.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:37:01.382 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:37:01.382 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 107.401851001, 2024-09-12T18:37:01.382 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025950709999999998, 2024-09-12T18:37:01.383 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:01.383 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:01.383 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:01.383 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:01.383 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4154", 2024-09-12T18:37:01.383 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/745129001", 2024-09-12T18:37:01.383 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 124 2024-09-12T18:37:01.383 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.383 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:01.383 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.383 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:01.383 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:37:01.383 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:01.384 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.384 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.384 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:01.384 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:37:01.384 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:01.384 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.384 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.384 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:01.384 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976562+0000", 2024-09-12T18:37:01.384 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.2999999999999999e-07 2024-09-12T18:37:01.384 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.384 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.385 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:01.385 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976567+0000", 2024-09-12T18:37:01.385 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3430000000000003e-06 2024-09-12T18:37:01.385 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.385 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.385 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:01.385 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976576+0000", 2024-09-12T18:37:01.385 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8070000000000006e-06 2024-09-12T18:37:01.385 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.385 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.385 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:01.386 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976583+0000", 2024-09-12T18:37:01.386 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9959999999999996e-06 2024-09-12T18:37:01.386 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.386 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.386 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:01.386 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997107+0000", 2024-09-12T18:37:01.386 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.020524106 2024-09-12T18:37:01.386 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.386 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.386 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:01.386 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997225+0000", 2024-09-12T18:37:01.386 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000117909 2024-09-12T18:37:01.386 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.387 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.387 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:01.387 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997407+0000", 2024-09-12T18:37:01.387 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00018175900000000001 2024-09-12T18:37:01.387 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.387 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.387 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:01.387 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998839+0000", 2024-09-12T18:37:01.387 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001432539 2024-09-12T18:37:01.387 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.387 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.387 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:01.387 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002319+0000", 2024-09-12T18:37:01.387 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0034803529999999998 2024-09-12T18:37:01.388 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.388 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.388 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:01.388 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002405+0000", 2024-09-12T18:37:01.388 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5434999999999998e-05 2024-09-12T18:37:01.388 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.388 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.388 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:01.388 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002512+0000", 2024-09-12T18:37:01.388 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010663299999999999 2024-09-12T18:37:01.388 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:01.388 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:01.388 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:01.389 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.389 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.389 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:01.389 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:37:01.389 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 95.737053493999994, 2024-09-12T18:37:01.389 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025127867000000002, 2024-09-12T18:37:01.389 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:01.389 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:01.389 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:01.389 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:01.389 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.389 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:01.389 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:37:01.389 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:01.390 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.390 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.390 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:01.390 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:37:01.390 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:01.390 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.390 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.390 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:01.390 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641362+0000", 2024-09-12T18:37:01.390 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.2569999999999999e-06 2024-09-12T18:37:01.390 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.390 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.390 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:01.391 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641374+0000", 2024-09-12T18:37:01.391 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2696e-05 2024-09-12T18:37:01.391 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.391 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.391 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:01.391 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641403+0000", 2024-09-12T18:37:01.391 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.8756999999999999e-05 2024-09-12T18:37:01.391 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.391 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.391 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:01.391 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641430+0000", 2024-09-12T18:37:01.391 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.6452999999999999e-05 2024-09-12T18:37:01.391 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.391 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.392 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:01.392 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641585+0000", 2024-09-12T18:37:01.392 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000155799 2024-09-12T18:37:01.392 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.392 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.392 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:01.392 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641753+0000", 2024-09-12T18:37:01.392 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000167868 2024-09-12T18:37:01.392 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.392 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.393 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:01.393 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641916+0000", 2024-09-12T18:37:01.393 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000162903 2024-09-12T18:37:01.393 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.393 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.393 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:01.393 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653655+0000", 2024-09-12T18:37:01.393 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011738879000000001 2024-09-12T18:37:01.393 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.393 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.393 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:01.393 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665515+0000", 2024-09-12T18:37:01.393 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011859915 2024-09-12T18:37:01.393 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.394 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.394 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:01.394 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665646+0000", 2024-09-12T18:37:01.394 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013122599999999999 2024-09-12T18:37:01.394 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.394 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.394 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:01.394 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666486+0000", 2024-09-12T18:37:01.394 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00084011399999999999 2024-09-12T18:37:01.394 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:01.394 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:01.394 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:01.394 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.394 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.395 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:01.395 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:37:01.395 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 95.736939031000006, 2024-09-12T18:37:01.395 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025384584000000002, 2024-09-12T18:37:01.395 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:01.395 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:01.395 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:01.395 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:01.395 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.395 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:01.395 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:37:01.395 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:01.395 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.396 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.396 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:01.396 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:37:01.396 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:01.396 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.396 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.396 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:01.396 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641474+0000", 2024-09-12T18:37:01.396 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.39e-06 2024-09-12T18:37:01.396 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.397 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.397 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:01.397 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641482+0000", 2024-09-12T18:37:01.397 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3499999999999999e-06 2024-09-12T18:37:01.397 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.397 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.397 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:01.397 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641534+0000", 2024-09-12T18:37:01.397 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2533e-05 2024-09-12T18:37:01.397 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.397 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.397 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:01.397 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641551+0000", 2024-09-12T18:37:01.397 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6515999999999999e-05 2024-09-12T18:37:01.398 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.398 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.398 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:01.398 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642630+0000", 2024-09-12T18:37:01.398 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001079705 2024-09-12T18:37:01.398 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.398 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.398 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:01.398 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642909+0000", 2024-09-12T18:37:01.398 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027859800000000002 2024-09-12T18:37:01.398 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.398 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.398 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:01.398 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643137+0000", 2024-09-12T18:37:01.399 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022803799999999999 2024-09-12T18:37:01.399 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.399 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.399 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:01.399 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653669+0000", 2024-09-12T18:37:01.399 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010532032 2024-09-12T18:37:01.399 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.399 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.399 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:01.399 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666624+0000", 2024-09-12T18:37:01.399 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012954940999999999 2024-09-12T18:37:01.399 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.399 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.400 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:01.400 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666762+0000", 2024-09-12T18:37:01.400 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000137668 2024-09-12T18:37:01.400 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.400 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.400 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:01.400 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666857+0000", 2024-09-12T18:37:01.400 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.5812999999999999e-05 2024-09-12T18:37:01.400 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:01.400 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:01.400 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:01.400 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.400 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.401 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:01.401 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:37:01.401 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 95.736811235999994, 2024-09-12T18:37:01.401 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025661562999999998, 2024-09-12T18:37:01.401 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:01.401 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:01.401 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:01.401 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:01.401 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.401 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:01.401 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:37:01.401 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:01.401 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.401 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.402 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:01.402 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:37:01.402 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:01.402 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.402 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.402 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:01.402 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641602+0000", 2024-09-12T18:37:01.402 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3540000000000001e-06 2024-09-12T18:37:01.402 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.402 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.402 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:01.402 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641637+0000", 2024-09-12T18:37:01.402 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5145999999999999e-05 2024-09-12T18:37:01.402 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.402 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.403 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:01.403 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641659+0000", 2024-09-12T18:37:01.403 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2249999999999999e-05 2024-09-12T18:37:01.403 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.403 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.403 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:01.403 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641675+0000", 2024-09-12T18:37:01.403 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6059999999999999e-05 2024-09-12T18:37:01.403 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.403 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.403 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:01.403 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644570+0000", 2024-09-12T18:37:01.403 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028947069999999998 2024-09-12T18:37:01.403 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.404 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.404 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:01.404 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644900+0000", 2024-09-12T18:37:01.404 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000329401 2024-09-12T18:37:01.404 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.404 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.404 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:01.404 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645235+0000", 2024-09-12T18:37:01.404 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000335874 2024-09-12T18:37:01.404 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.404 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.404 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:01.404 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655459+0000", 2024-09-12T18:37:01.404 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010223441999999999 2024-09-12T18:37:01.405 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.405 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.405 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:01.405 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667028+0000", 2024-09-12T18:37:01.405 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011568673999999999 2024-09-12T18:37:01.405 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.405 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.405 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:01.405 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667163+0000", 2024-09-12T18:37:01.405 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013525500000000001 2024-09-12T18:37:01.405 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.405 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.405 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:01.406 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667262+0000", 2024-09-12T18:37:01.406 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9400000000000004e-05 2024-09-12T18:37:01.406 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:01.406 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:01.407 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:01.407 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.407 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.407 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:01.407 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:37:01.407 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 95.736709415999997, 2024-09-12T18:37:01.407 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025971339, 2024-09-12T18:37:01.407 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:01.407 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:01.407 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:01.407 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:01.407 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.407 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:01.407 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:37:01.408 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:01.408 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.408 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.408 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:01.408 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:37:01.408 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:01.408 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.408 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.408 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:01.408 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641704+0000", 2024-09-12T18:37:01.408 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.297e-06 2024-09-12T18:37:01.408 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.408 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.408 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:01.409 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641712+0000", 2024-09-12T18:37:01.409 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.9060000000000002e-06 2024-09-12T18:37:01.409 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.409 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.409 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:01.409 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641731+0000", 2024-09-12T18:37:01.409 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9083e-05 2024-09-12T18:37:01.409 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.409 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.409 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:01.409 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641745+0000", 2024-09-12T18:37:01.409 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4066999999999999e-05 2024-09-12T18:37:01.409 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.409 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.410 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:01.410 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646529+0000", 2024-09-12T18:37:01.410 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.004784033 2024-09-12T18:37:01.410 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.410 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.410 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:01.410 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646727+0000", 2024-09-12T18:37:01.410 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019841800000000001 2024-09-12T18:37:01.410 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.410 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.410 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:01.410 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647057+0000", 2024-09-12T18:37:01.410 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032926800000000002 2024-09-12T18:37:01.411 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.411 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.411 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:01.411 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655475+0000", 2024-09-12T18:37:01.411 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0084186250000000008 2024-09-12T18:37:01.411 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.411 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.411 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:01.411 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667424+0000", 2024-09-12T18:37:01.411 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011949257 2024-09-12T18:37:01.411 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.411 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.411 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:01.411 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667573+0000", 2024-09-12T18:37:01.412 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014851900000000001 2024-09-12T18:37:01.412 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.412 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.412 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:01.412 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667674+0000", 2024-09-12T18:37:01.412 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010086600000000001 2024-09-12T18:37:01.412 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:01.412 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:01.412 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:01.412 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.412 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.412 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:01.412 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:37:01.413 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 95.736647027000004, 2024-09-12T18:37:01.413 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026215008000000001, 2024-09-12T18:37:01.413 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:01.413 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:01.413 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:01.413 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:01.413 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.413 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:01.413 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:37:01.413 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:01.413 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.413 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.413 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:01.413 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:37:01.414 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:01.414 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.414 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.414 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:01.414 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641766+0000", 2024-09-12T18:37:01.415 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1200000000000001e-06 2024-09-12T18:37:01.415 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.415 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.415 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:01.416 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641775+0000", 2024-09-12T18:37:01.416 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.2499999999999995e-06 2024-09-12T18:37:01.416 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.416 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.416 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:01.416 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641793+0000", 2024-09-12T18:37:01.416 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7773000000000001e-05 2024-09-12T18:37:01.416 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.416 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.416 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:01.416 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641807+0000", 2024-09-12T18:37:01.416 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3814e-05 2024-09-12T18:37:01.416 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.416 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.417 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:01.417 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647626+0000", 2024-09-12T18:37:01.417 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0058193050000000003 2024-09-12T18:37:01.417 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.417 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.417 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:01.417 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647937+0000", 2024-09-12T18:37:01.417 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031112400000000003 2024-09-12T18:37:01.417 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.417 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.417 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:01.417 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648239+0000", 2024-09-12T18:37:01.417 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00030227500000000002 2024-09-12T18:37:01.418 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.418 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.418 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:01.418 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655487+0000", 2024-09-12T18:37:01.418 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072479129999999999 2024-09-12T18:37:01.418 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.418 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.418 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:01.418 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667823+0000", 2024-09-12T18:37:01.418 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012335505 2024-09-12T18:37:01.418 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.418 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.418 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:01.419 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667908+0000", 2024-09-12T18:37:01.419 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4843000000000001e-05 2024-09-12T18:37:01.419 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.419 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.419 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:01.419 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667980+0000", 2024-09-12T18:37:01.419 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2086000000000001e-05 2024-09-12T18:37:01.419 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:01.419 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:01.419 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:01.419 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.419 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.419 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:01.419 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:37:01.420 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 95.736586873999997, 2024-09-12T18:37:01.420 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026483236, 2024-09-12T18:37:01.420 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:01.420 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:01.420 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:01.420 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:01.420 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.420 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:01.420 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:37:01.420 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:01.420 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.420 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.420 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:01.421 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:37:01.421 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:01.421 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.421 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.421 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:01.421 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641826+0000", 2024-09-12T18:37:01.421 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:37:01.421 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.421 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.421 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:01.421 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641832+0000", 2024-09-12T18:37:01.421 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4199999999999998e-06 2024-09-12T18:37:01.421 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.422 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.422 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:01.422 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641848+0000", 2024-09-12T18:37:01.422 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6492999999999999e-05 2024-09-12T18:37:01.422 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.422 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.422 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:01.423 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641863+0000", 2024-09-12T18:37:01.423 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5427e-05 2024-09-12T18:37:01.423 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.423 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.423 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:01.423 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648887+0000", 2024-09-12T18:37:01.423 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0070230860000000004 2024-09-12T18:37:01.423 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.423 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.423 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:01.423 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649111+0000", 2024-09-12T18:37:01.423 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022425799999999999 2024-09-12T18:37:01.423 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.424 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.424 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:01.424 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649494+0000", 2024-09-12T18:37:01.424 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00038349400000000001 2024-09-12T18:37:01.424 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.424 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.424 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:01.424 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655499+0000", 2024-09-12T18:37:01.424 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0060047260000000002 2024-09-12T18:37:01.424 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.424 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.424 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:01.424 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668110+0000", 2024-09-12T18:37:01.425 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012610543 2024-09-12T18:37:01.425 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.425 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.425 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:01.425 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668252+0000", 2024-09-12T18:37:01.425 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014265600000000001 2024-09-12T18:37:01.425 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.425 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.425 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:01.425 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668308+0000", 2024-09-12T18:37:01.425 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5992999999999997e-05 2024-09-12T18:37:01.425 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:01.426 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:01.426 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:01.426 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.426 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.426 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:01.426 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:37:01.426 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 95.736531658000004, 2024-09-12T18:37:01.426 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026605302000000001, 2024-09-12T18:37:01.426 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:01.426 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:01.426 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:01.426 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:01.426 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.427 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:01.427 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:37:01.427 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:01.427 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.427 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.427 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:01.427 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:37:01.427 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:01.427 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.427 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.427 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:01.427 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641881+0000", 2024-09-12T18:37:01.427 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.057e-06 2024-09-12T18:37:01.428 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.428 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.428 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:01.428 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641887+0000", 2024-09-12T18:37:01.428 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.6629999999999998e-06 2024-09-12T18:37:01.428 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.428 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.428 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:01.428 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641903+0000", 2024-09-12T18:37:01.428 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6317e-05 2024-09-12T18:37:01.428 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.428 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.429 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:01.429 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641917+0000", 2024-09-12T18:37:01.429 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3339999999999999e-05 2024-09-12T18:37:01.429 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.429 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.429 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:01.429 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650708+0000", 2024-09-12T18:37:01.429 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.008791419 2024-09-12T18:37:01.429 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.429 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.429 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:01.429 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651021+0000", 2024-09-12T18:37:01.429 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031296699999999999 2024-09-12T18:37:01.430 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.430 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.430 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:01.430 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651349+0000", 2024-09-12T18:37:01.430 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032796499999999999 2024-09-12T18:37:01.430 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.430 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.430 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:01.430 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655742+0000", 2024-09-12T18:37:01.430 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0043934680000000002 2024-09-12T18:37:01.430 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.430 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.431 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:01.431 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668377+0000", 2024-09-12T18:37:01.431 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012634312999999999 2024-09-12T18:37:01.431 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.431 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.431 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:01.431 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668441+0000", 2024-09-12T18:37:01.431 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4369999999999995e-05 2024-09-12T18:37:01.431 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.431 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.431 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:01.431 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668485+0000", 2024-09-12T18:37:01.431 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4422999999999998e-05 2024-09-12T18:37:01.432 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:01.432 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:01.432 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:01.432 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.432 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.432 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:01.432 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:37:01.432 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 95.736474255000005, 2024-09-12T18:37:01.432 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026919499, 2024-09-12T18:37:01.432 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:01.432 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:01.432 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:01.432 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:01.433 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.433 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:01.433 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:37:01.433 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:01.433 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.433 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.433 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:01.433 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:37:01.433 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:01.433 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.433 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.433 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:01.433 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641939+0000", 2024-09-12T18:37:01.433 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9399999999999993e-07 2024-09-12T18:37:01.434 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.434 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.434 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:01.434 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641945+0000", 2024-09-12T18:37:01.434 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9200000000000001e-06 2024-09-12T18:37:01.434 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.434 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.434 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:01.434 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641961+0000", 2024-09-12T18:37:01.434 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6520000000000001e-05 2024-09-12T18:37:01.434 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.434 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.434 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:01.435 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641974+0000", 2024-09-12T18:37:01.435 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3413e-05 2024-09-12T18:37:01.435 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.435 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.435 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:01.435 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654560+0000", 2024-09-12T18:37:01.435 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012585308999999999 2024-09-12T18:37:01.435 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.435 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.435 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:01.435 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654822+0000", 2024-09-12T18:37:01.435 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026210099999999999 2024-09-12T18:37:01.435 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.435 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.436 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:01.436 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655059+0000", 2024-09-12T18:37:01.436 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00023747899999999999 2024-09-12T18:37:01.436 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.436 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.436 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:01.436 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.656315+0000", 2024-09-12T18:37:01.436 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0012555000000000001 2024-09-12T18:37:01.436 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.436 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.436 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:01.436 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668590+0000", 2024-09-12T18:37:01.436 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012274851999999999 2024-09-12T18:37:01.437 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.437 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.437 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:01.437 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668725+0000", 2024-09-12T18:37:01.437 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013524199999999999 2024-09-12T18:37:01.437 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.437 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.437 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:01.437 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668857+0000", 2024-09-12T18:37:01.437 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013216899999999999 2024-09-12T18:37:01.437 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:01.437 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:01.437 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:01.438 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.438 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.438 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:01.438 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:37:01.438 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 95.736420734999996, 2024-09-12T18:37:01.438 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023616723999999999, 2024-09-12T18:37:01.438 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:01.438 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:01.438 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:01.438 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:01.438 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.438 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:01.438 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:37:01.438 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:01.439 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.439 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.439 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:01.439 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641991+0000", 2024-09-12T18:37:01.439 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:01.439 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.439 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.439 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:01.439 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641992+0000", 2024-09-12T18:37:01.439 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.08e-06 2024-09-12T18:37:01.439 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.439 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.439 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:01.440 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641998+0000", 2024-09-12T18:37:01.440 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4299999999999997e-06 2024-09-12T18:37:01.440 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.440 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.440 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:01.440 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642014+0000", 2024-09-12T18:37:01.440 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6266e-05 2024-09-12T18:37:01.440 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.440 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.440 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:01.440 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642026+0000", 2024-09-12T18:37:01.440 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2567e-05 2024-09-12T18:37:01.440 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.441 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.441 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:01.441 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642213+0000", 2024-09-12T18:37:01.441 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00018701899999999999 2024-09-12T18:37:01.441 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.441 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.441 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:01.441 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642507+0000", 2024-09-12T18:37:01.441 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00029394700000000002 2024-09-12T18:37:01.441 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.441 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.441 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:01.442 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642686+0000", 2024-09-12T18:37:01.442 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000178152 2024-09-12T18:37:01.442 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.442 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.442 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:01.442 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650952+0000", 2024-09-12T18:37:01.442 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0082663570000000002 2024-09-12T18:37:01.442 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.442 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.442 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:01.442 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665382+0000", 2024-09-12T18:37:01.442 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.014430111000000001 2024-09-12T18:37:01.443 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.443 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.443 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:01.443 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665508+0000", 2024-09-12T18:37:01.443 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000125986 2024-09-12T18:37:01.443 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.443 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.443 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:01.443 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665608+0000", 2024-09-12T18:37:01.443 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9809000000000006e-05 2024-09-12T18:37:01.443 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:01.443 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:01.443 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:01.444 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.444 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.444 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:01.444 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:37:01.444 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 95.73629287, 2024-09-12T18:37:01.444 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024670563, 2024-09-12T18:37:01.444 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:01.444 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:01.444 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:01.444 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:01.444 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.444 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:01.444 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:37:01.445 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:01.445 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.445 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.445 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:01.445 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:37:01.445 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:01.445 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.445 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.445 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:01.445 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642120+0000", 2024-09-12T18:37:01.445 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1769999999999999e-06 2024-09-12T18:37:01.445 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.446 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.446 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:01.446 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642128+0000", 2024-09-12T18:37:01.446 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3429999999999998e-06 2024-09-12T18:37:01.446 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.446 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.446 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:01.446 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642192+0000", 2024-09-12T18:37:01.446 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4406999999999995e-05 2024-09-12T18:37:01.446 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.446 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.446 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:01.446 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642223+0000", 2024-09-12T18:37:01.446 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.1266000000000002e-05 2024-09-12T18:37:01.447 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.447 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.447 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:01.447 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643201+0000", 2024-09-12T18:37:01.447 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0009778390000000001 2024-09-12T18:37:01.447 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.447 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.447 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:01.447 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643410+0000", 2024-09-12T18:37:01.447 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020874199999999999 2024-09-12T18:37:01.447 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.447 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.448 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:01.448 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643685+0000", 2024-09-12T18:37:01.448 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027520700000000002 2024-09-12T18:37:01.448 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.448 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.448 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:01.448 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650966+0000", 2024-09-12T18:37:01.448 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072810710000000001 2024-09-12T18:37:01.448 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.448 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.448 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:01.448 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666560+0000", 2024-09-12T18:37:01.448 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015594143 2024-09-12T18:37:01.449 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.449 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.449 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:01.449 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666691+0000", 2024-09-12T18:37:01.449 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000130359 2024-09-12T18:37:01.449 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.449 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.449 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:01.449 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666790+0000", 2024-09-12T18:37:01.449 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9009e-05 2024-09-12T18:37:01.449 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:01.449 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:01.449 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:01.449 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.450 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.450 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:01.450 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:37:01.450 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 95.735514581999993, 2024-09-12T18:37:01.450 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024891744, 2024-09-12T18:37:01.450 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:01.450 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:01.450 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:01.450 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:01.450 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.450 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:01.450 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:37:01.450 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:01.451 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.451 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.451 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:01.451 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:37:01.451 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:01.451 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.451 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.451 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:01.451 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642899+0000", 2024-09-12T18:37:01.451 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4729999999999999e-06 2024-09-12T18:37:01.451 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.451 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.451 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:01.451 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642912+0000", 2024-09-12T18:37:01.452 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3495999999999999e-05 2024-09-12T18:37:01.452 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.452 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.452 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:01.452 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642934+0000", 2024-09-12T18:37:01.452 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2033999999999999e-05 2024-09-12T18:37:01.452 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.452 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.452 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:01.452 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642949+0000", 2024-09-12T18:37:01.452 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4970000000000001e-05 2024-09-12T18:37:01.452 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.452 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.453 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:01.453 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644400+0000", 2024-09-12T18:37:01.453 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001450305 2024-09-12T18:37:01.453 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.453 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.453 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:01.453 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644617+0000", 2024-09-12T18:37:01.453 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000217302 2024-09-12T18:37:01.453 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.453 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.453 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:01.453 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645052+0000", 2024-09-12T18:37:01.453 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000434797 2024-09-12T18:37:01.454 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.454 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.454 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:01.454 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653860+0000", 2024-09-12T18:37:01.454 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0088082249999999994 2024-09-12T18:37:01.454 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.454 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.454 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:01.454 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667598+0000", 2024-09-12T18:37:01.454 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.013738451 2024-09-12T18:37:01.454 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.454 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.454 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:01.454 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667698+0000", 2024-09-12T18:37:01.455 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9854999999999999e-05 2024-09-12T18:37:01.455 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.455 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.455 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:01.455 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667789+0000", 2024-09-12T18:37:01.455 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0835999999999996e-05 2024-09-12T18:37:01.455 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:01.455 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:01.455 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:01.455 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.455 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.455 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:30 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:01.455 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:37:01.456 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 95.735439765999999, 2024-09-12T18:37:01.456 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023936852000000002, 2024-09-12T18:37:01.456 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:01.456 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:01.456 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:01.456 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:01.456 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.456 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:01.456 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:37:01.456 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:01.456 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.456 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.456 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:01.456 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642972+0000", 2024-09-12T18:37:01.457 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:01.457 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.457 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.457 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:01.457 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642973+0000", 2024-09-12T18:37:01.457 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.11e-06 2024-09-12T18:37:01.457 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.457 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.457 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:01.457 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642994+0000", 2024-09-12T18:37:01.457 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.0699999999999998e-05 2024-09-12T18:37:01.457 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.457 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.458 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:01.458 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643011+0000", 2024-09-12T18:37:01.458 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7229999999999999e-05 2024-09-12T18:37:01.458 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.458 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.458 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:01.458 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643025+0000", 2024-09-12T18:37:01.458 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3803e-05 2024-09-12T18:37:01.458 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.458 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.458 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:01.458 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643143+0000", 2024-09-12T18:37:01.458 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000118225 2024-09-12T18:37:01.458 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.459 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.459 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:01.459 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643426+0000", 2024-09-12T18:37:01.459 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00028250500000000001 2024-09-12T18:37:01.459 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.459 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.459 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:01.459 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643864+0000", 2024-09-12T18:37:01.459 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00043856 2024-09-12T18:37:01.459 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.459 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.459 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:01.459 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651148+0000", 2024-09-12T18:37:01.460 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072836769999999997 2024-09-12T18:37:01.460 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.460 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.460 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:01.460 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666674+0000", 2024-09-12T18:37:01.460 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015525786999999999 2024-09-12T18:37:01.460 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.460 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.460 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:01.460 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666796+0000", 2024-09-12T18:37:01.460 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000122416 2024-09-12T18:37:01.460 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.460 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.460 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:01.461 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666909+0000", 2024-09-12T18:37:01.461 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011283899999999999 2024-09-12T18:37:01.461 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:01.461 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:01.461 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:01.461 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.461 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.461 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:01.461 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:37:01.461 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 95.735357059999998, 2024-09-12T18:37:01.461 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024100234000000002, 2024-09-12T18:37:01.461 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:01.461 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:01.462 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:01.462 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:01.462 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.462 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:01.462 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:37:01.462 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:01.462 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.462 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.462 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:01.462 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643055+0000", 2024-09-12T18:37:01.462 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:01.462 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.462 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.463 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:01.463 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643056+0000", 2024-09-12T18:37:01.463 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.046e-06 2024-09-12T18:37:01.463 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.463 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.463 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:01.463 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643068+0000", 2024-09-12T18:37:01.463 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2106999999999999e-05 2024-09-12T18:37:01.463 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.463 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.463 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:01.463 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643085+0000", 2024-09-12T18:37:01.463 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7479999999999999e-05 2024-09-12T18:37:01.464 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.464 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.464 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:01.464 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643099+0000", 2024-09-12T18:37:01.464 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3730000000000001e-05 2024-09-12T18:37:01.464 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.464 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.464 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:01.464 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644623+0000", 2024-09-12T18:37:01.464 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0015236080000000001 2024-09-12T18:37:01.464 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.464 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.464 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:01.465 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644893+0000", 2024-09-12T18:37:01.465 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026990500000000003 2024-09-12T18:37:01.465 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.465 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.465 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:01.465 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645227+0000", 2024-09-12T18:37:01.465 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00033391300000000003 2024-09-12T18:37:01.465 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.465 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.465 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:01.465 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653926+0000", 2024-09-12T18:37:01.465 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0086993339999999995 2024-09-12T18:37:01.465 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.466 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.466 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:01.466 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666925+0000", 2024-09-12T18:37:01.466 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012998686000000001 2024-09-12T18:37:01.466 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.466 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.466 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:01.466 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667057+0000", 2024-09-12T18:37:01.466 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013255600000000001 2024-09-12T18:37:01.466 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.466 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.466 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:01.466 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667155+0000", 2024-09-12T18:37:01.466 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7868999999999994e-05 2024-09-12T18:37:01.467 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:01.467 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:01.467 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:01.467 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.467 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.467 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:01.467 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:37:01.467 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 95.735161270999996, 2024-09-12T18:37:01.467 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024255982999999998, 2024-09-12T18:37:01.467 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:01.467 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:01.467 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:01.467 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:01.467 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.468 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:01.468 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:37:01.468 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:01.468 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.468 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.468 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:01.468 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643251+0000", 2024-09-12T18:37:01.468 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:01.468 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.468 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.468 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:01.468 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643252+0000", 2024-09-12T18:37:01.469 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:37:01.469 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.469 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.469 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:01.469 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643287+0000", 2024-09-12T18:37:01.469 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5225999999999998e-05 2024-09-12T18:37:01.469 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.469 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.469 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:01.469 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643323+0000", 2024-09-12T18:37:01.469 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5488999999999999e-05 2024-09-12T18:37:01.469 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.469 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.469 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:01.470 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643357+0000", 2024-09-12T18:37:01.470 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.3853999999999998e-05 2024-09-12T18:37:01.470 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.470 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.470 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:01.470 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646716+0000", 2024-09-12T18:37:01.470 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003359 2024-09-12T18:37:01.470 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.470 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.470 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:01.470 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647037+0000", 2024-09-12T18:37:01.470 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032131800000000002 2024-09-12T18:37:01.470 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.471 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.471 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:01.471 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647337+0000", 2024-09-12T18:37:01.471 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000300208 2024-09-12T18:37:01.471 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.471 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.471 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:01.471 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654291+0000", 2024-09-12T18:37:01.471 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0069543089999999997 2024-09-12T18:37:01.471 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.471 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.471 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:01.471 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667297+0000", 2024-09-12T18:37:01.472 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.013005526 2024-09-12T18:37:01.472 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.472 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.472 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:01.472 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667416+0000", 2024-09-12T18:37:01.472 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000119416 2024-09-12T18:37:01.472 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.472 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.472 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:01.472 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667507+0000", 2024-09-12T18:37:01.472 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0206999999999999e-05 2024-09-12T18:37:01.472 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:01.472 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:01.472 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:01.473 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.473 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.473 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:01.473 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:37:01.473 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 95.735034175999999, 2024-09-12T18:37:01.473 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.023888482999999999, 2024-09-12T18:37:01.473 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:01.473 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:01.473 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:01.473 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:01.473 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.473 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:01.473 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:37:01.474 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:01.474 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.474 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.474 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:01.474 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643378+0000", 2024-09-12T18:37:01.474 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:01.474 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.474 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.474 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:01.474 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643379+0000", 2024-09-12T18:37:01.474 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.207e-06 2024-09-12T18:37:01.474 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.474 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.475 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:01.475 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643390+0000", 2024-09-12T18:37:01.475 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0696000000000001e-05 2024-09-12T18:37:01.475 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.475 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.475 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:01.475 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643407+0000", 2024-09-12T18:37:01.475 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7563000000000001e-05 2024-09-12T18:37:01.475 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.475 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.475 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:01.475 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643420+0000", 2024-09-12T18:37:01.475 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3277e-05 2024-09-12T18:37:01.476 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.476 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.476 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:01.476 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644906+0000", 2024-09-12T18:37:01.476 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001485945 2024-09-12T18:37:01.476 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.476 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.476 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:01.476 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645404+0000", 2024-09-12T18:37:01.476 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00049807599999999997 2024-09-12T18:37:01.476 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.476 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.476 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:01.477 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645846+0000", 2024-09-12T18:37:01.477 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00044190400000000002 2024-09-12T18:37:01.477 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.477 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.477 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:01.477 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654223+0000", 2024-09-12T18:37:01.477 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0083767419999999995 2024-09-12T18:37:01.477 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.477 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.477 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:01.477 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667026+0000", 2024-09-12T18:37:01.477 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012802531000000001 2024-09-12T18:37:01.477 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.478 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.478 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:01.478 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667162+0000", 2024-09-12T18:37:01.478 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000136112 2024-09-12T18:37:01.478 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.478 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.478 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:01.478 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667266+0000", 2024-09-12T18:37:01.478 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010443 2024-09-12T18:37:01.478 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:01.478 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:01.478 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:01.478 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.478 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.478 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:01.479 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:37:01.479 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 95.734883456999995, 2024-09-12T18:37:01.479 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024222582999999999, 2024-09-12T18:37:01.479 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:01.479 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:01.479 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:37:01.479 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:01.479 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.479 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:01.479 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:37:01.479 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:01.479 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.480 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.480 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:01.480 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643528+0000", 2024-09-12T18:37:01.480 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:01.480 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.480 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.480 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:01.480 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643530+0000", 2024-09-12T18:37:01.480 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.393e-06 2024-09-12T18:37:01.480 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.480 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.480 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:01.480 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643536+0000", 2024-09-12T18:37:01.481 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4130000000000003e-06 2024-09-12T18:37:01.481 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.481 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.481 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:01.481 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643554+0000", 2024-09-12T18:37:01.481 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7572999999999999e-05 2024-09-12T18:37:01.481 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.481 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.481 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:01.481 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643567+0000", 2024-09-12T18:37:01.481 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3393999999999999e-05 2024-09-12T18:37:01.481 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.481 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.481 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:01.482 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648198+0000", 2024-09-12T18:37:01.482 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0046304479999999997 2024-09-12T18:37:01.482 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.482 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.482 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:01.482 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648413+0000", 2024-09-12T18:37:01.482 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00021507500000000001 2024-09-12T18:37:01.482 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.482 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.482 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:01.482 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667751+0000", 2024-09-12T18:37:01.482 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.019338286999999999 2024-09-12T18:37:01.482 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:01.483 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:01.483 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:01.483 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.483 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.483 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:121106 5.d e50/21 5:b4a9a221:::benchmark_data_smithi073_23739_object121105:head v 50'7658, mlcod=48'7656)", 2024-09-12T18:37:01.483 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:40.238637+0000", 2024-09-12T18:37:01.483 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 21.139774855999999, 2024-09-12T18:37:01.483 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.033154694999999998, 2024-09-12T18:37:01.483 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:01.483 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:01.483 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:01.483 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:01.483 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.483 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:01.484 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238637+0000", 2024-09-12T18:37:01.484 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:01.484 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.484 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.484 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:01.484 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238637+0000", 2024-09-12T18:37:01.484 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:01.484 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.484 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.484 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:01.484 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238639+0000", 2024-09-12T18:37:01.484 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.8560000000000001e-06 2024-09-12T18:37:01.484 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.485 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.485 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:01.485 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238723+0000", 2024-09-12T18:37:01.485 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4314999999999995e-05 2024-09-12T18:37:01.485 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.485 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.485 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:01.485 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238753+0000", 2024-09-12T18:37:01.485 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.9726e-05 2024-09-12T18:37:01.485 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.485 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.485 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:01.485 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238773+0000", 2024-09-12T18:37:01.486 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9789e-05 2024-09-12T18:37:01.486 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.486 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.486 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:01.486 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.241557+0000", 2024-09-12T18:37:01.486 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0027843910000000002 2024-09-12T18:37:01.486 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.486 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.486 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:01.486 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.241581+0000", 2024-09-12T18:37:01.486 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.4224999999999999e-05 2024-09-12T18:37:01.486 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.486 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.486 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:01.487 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.271722+0000", 2024-09-12T18:37:01.487 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.030141194 2024-09-12T18:37:01.487 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.487 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.487 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:01.487 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.271792+0000", 2024-09-12T18:37:01.487 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9198999999999999e-05 2024-09-12T18:37:01.487 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:01.487 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:01.487 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:01.487 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.487 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.487 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:131553 5.9 5:99f85f54:::benchmark_data_smithi073_23739_object131552:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:37:01.487 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:45.500398+0000", 2024-09-12T18:37:01.488 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 15.878013696, 2024-09-12T18:37:01.488 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024615648, 2024-09-12T18:37:01.488 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:01.488 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:01.488 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:01.488 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:01.488 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:01.488 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:01.488 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 131553 2024-09-12T18:37:01.488 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.488 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:01.488 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.488 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:01.489 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500398+0000", 2024-09-12T18:37:01.489 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:01.489 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.489 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.489 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:01.489 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500398+0000", 2024-09-12T18:37:01.489 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:01.489 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.489 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.489 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:01.489 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500399+0000", 2024-09-12T18:37:01.489 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.54e-07 2024-09-12T18:37:01.489 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.490 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.490 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:01.490 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500521+0000", 2024-09-12T18:37:01.490 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012212599999999999 2024-09-12T18:37:01.490 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.490 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.490 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:01.490 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500528+0000", 2024-09-12T18:37:01.490 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.6619999999999999e-06 2024-09-12T18:37:01.490 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.490 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.490 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:01.490 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500532+0000", 2024-09-12T18:37:01.490 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6110000000000004e-06 2024-09-12T18:37:01.491 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.491 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.491 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:01.491 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500576+0000", 2024-09-12T18:37:01.491 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.3563000000000003e-05 2024-09-12T18:37:01.491 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.491 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.491 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:01.491 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500688+0000", 2024-09-12T18:37:01.491 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011260900000000001 2024-09-12T18:37:01.491 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.491 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.491 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:01.491 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.517383+0000", 2024-09-12T18:37:01.492 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.016694154999999999 2024-09-12T18:37:01.492 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.492 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.492 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:01.492 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.523998+0000", 2024-09-12T18:37:01.492 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0066157919999999997 2024-09-12T18:37:01.492 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.492 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.492 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:01.492 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.524943+0000", 2024-09-12T18:37:01.492 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00094417500000000001 2024-09-12T18:37:01.492 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.492 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.493 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:01.493 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.524981+0000", 2024-09-12T18:37:01.493 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.8179000000000002e-05 2024-09-12T18:37:01.493 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.493 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.493 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:01.493 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.525014+0000", 2024-09-12T18:37:01.493 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.3022000000000003e-05 2024-09-12T18:37:01.493 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:01.493 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:01.494 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:01.494 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.494 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.494 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:131551 5.d e52/21 5:b8f8c77a:::benchmark_data_smithi073_23739_object131550:head v 52'8341, mlcod=52'8338)", 2024-09-12T18:37:01.494 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:45.500609+0000", 2024-09-12T18:37:01.494 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 15.877802676, 2024-09-12T18:37:01.494 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024752877, 2024-09-12T18:37:01.494 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:01.494 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:01.494 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:01.494 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:01.494 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.494 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:01.494 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500609+0000", 2024-09-12T18:37:01.495 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:01.495 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.495 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.495 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:01.495 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500609+0000", 2024-09-12T18:37:01.495 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:01.495 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.495 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.495 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:01.495 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500610+0000", 2024-09-12T18:37:01.495 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5499999999999998e-07 2024-09-12T18:37:01.495 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.495 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.496 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:01.496 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500669+0000", 2024-09-12T18:37:01.496 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9244999999999999e-05 2024-09-12T18:37:01.496 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.496 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.496 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:01.496 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500676+0000", 2024-09-12T18:37:01.496 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3030000000000002e-06 2024-09-12T18:37:01.496 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.496 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.496 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:01.496 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500681+0000", 2024-09-12T18:37:01.496 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8720000000000001e-06 2024-09-12T18:37:01.496 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.497 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.497 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:01.497 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.517128+0000", 2024-09-12T18:37:01.497 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.016446485 2024-09-12T18:37:01.497 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.497 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.497 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:01.497 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.517159+0000", 2024-09-12T18:37:01.497 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.0926000000000002e-05 2024-09-12T18:37:01.497 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.497 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.497 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:01.497 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.525325+0000", 2024-09-12T18:37:01.498 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0081661460000000009 2024-09-12T18:37:01.498 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:01.498 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:01.498 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:01.498 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.525362+0000", 2024-09-12T18:37:01.498 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.7345000000000002e-05 2024-09-12T18:37:01.498 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:01.498 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:01.498 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:01.498 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:01.498 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:01.498 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:01.500 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:01.495+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:01.500 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:37:01.600 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:01.595+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:01.651 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:01.651 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:37:01.651 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.651 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:164092 5.1 e58/49 5:867c8fa9:::benchmark_data_smithi073_23739_object31815:head v 58'10225, mlcod=58'10222)", 2024-09-12T18:37:01.651 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:01.641822+0000", 2024-09-12T18:37:01.651 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0066934209999999997, 2024-09-12T18:37:01.651 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0067099489999999998, 2024-09-12T18:37:01.651 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:01.651 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:01.651 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:01.652 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:01.652 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.652 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:01.652 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.641822+0000", 2024-09-12T18:37:01.652 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:01.652 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.652 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.652 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:01.652 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.641822+0000", 2024-09-12T18:37:01.652 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:01.652 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.652 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.652 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:01.653 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.641822+0000", 2024-09-12T18:37:01.653 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.3399999999999999e-07 2024-09-12T18:37:01.653 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.653 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.653 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:01.653 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.641826+0000", 2024-09-12T18:37:01.653 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.5370000000000002e-06 2024-09-12T18:37:01.653 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.653 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.653 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:01.653 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.641834+0000", 2024-09-12T18:37:01.653 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.3960000000000006e-06 2024-09-12T18:37:01.653 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.654 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.654 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:01.654 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.641839+0000", 2024-09-12T18:37:01.654 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2140000000000004e-06 2024-09-12T18:37:01.654 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.654 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.654 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:01.654 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.641881+0000", 2024-09-12T18:37:01.654 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.1791e-05 2024-09-12T18:37:01.654 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.654 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.654 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:01.654 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.641895+0000", 2024-09-12T18:37:01.654 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3735e-05 2024-09-12T18:37:01.655 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:01.655 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:01.655 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:01.655 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.655 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.655 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:164096 5.8 e58/21 5:1301bccf:::benchmark_data_smithi073_23739_object31819:head v 58'10043, mlcod=58'10041)", 2024-09-12T18:37:01.655 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:01.642094+0000", 2024-09-12T18:37:01.655 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0064208889999999999, 2024-09-12T18:37:01.655 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0064713430000000001, 2024-09-12T18:37:01.655 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:01.655 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:01.655 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:01.655 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:01.656 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.656 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:01.656 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.642094+0000", 2024-09-12T18:37:01.656 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:01.656 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.656 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.656 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:01.656 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.642094+0000", 2024-09-12T18:37:01.656 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:01.656 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.656 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.656 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:01.656 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.642095+0000", 2024-09-12T18:37:01.657 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6799999999999999e-07 2024-09-12T18:37:01.657 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.657 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.657 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:01.657 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.642100+0000", 2024-09-12T18:37:01.657 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1699999999999996e-06 2024-09-12T18:37:01.657 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.657 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.657 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:01.657 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.642114+0000", 2024-09-12T18:37:01.657 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3285000000000001e-05 2024-09-12T18:37:01.657 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.657 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.657 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:01.658 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.642121+0000", 2024-09-12T18:37:01.658 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1319999999999996e-06 2024-09-12T18:37:01.658 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.658 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.658 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:01.658 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.642163+0000", 2024-09-12T18:37:01.658 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2132999999999998e-05 2024-09-12T18:37:01.658 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.658 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.658 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:01.658 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.642185+0000", 2024-09-12T18:37:01.658 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2132000000000001e-05 2024-09-12T18:37:01.658 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:01.658 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:01.659 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:01.659 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.659 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.659 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:164094 5.0 e58/49 5:04e95419:::benchmark_data_smithi073_23739_object31817:head v 58'10278, mlcod=58'10276)", 2024-09-12T18:37:01.659 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:01.642184+0000", 2024-09-12T18:37:01.659 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0063312239999999999, 2024-09-12T18:37:01.659 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0064097149999999999, 2024-09-12T18:37:01.659 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:01.659 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:01.659 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:01.659 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:01.659 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.659 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:01.660 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.642184+0000", 2024-09-12T18:37:01.660 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:01.660 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.660 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.660 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:01.660 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.642184+0000", 2024-09-12T18:37:01.660 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:01.660 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.660 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.660 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:01.660 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.642184+0000", 2024-09-12T18:37:01.660 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.68e-07 2024-09-12T18:37:01.660 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.661 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.661 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:01.661 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.642189+0000", 2024-09-12T18:37:01.661 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2390000000000004e-06 2024-09-12T18:37:01.661 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.661 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.661 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:01.661 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.642199+0000", 2024-09-12T18:37:01.661 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0813e-05 2024-09-12T18:37:01.661 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.661 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.661 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:01.661 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.642205+0000", 2024-09-12T18:37:01.661 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7100000000000004e-06 2024-09-12T18:37:01.662 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.662 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.662 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:01.662 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.642248+0000", 2024-09-12T18:37:01.662 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.282e-05 2024-09-12T18:37:01.662 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.662 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.662 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:01.662 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.642273+0000", 2024-09-12T18:37:01.662 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4726999999999999e-05 2024-09-12T18:37:01.662 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:01.662 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:01.662 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:01.662 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.663 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.663 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:164097 5.0 e58/49 5:09718eda:::benchmark_data_smithi073_23739_object31820:head v 58'10279, mlcod=58'10276)", 2024-09-12T18:37:01.663 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:01.643896+0000", 2024-09-12T18:37:01.663 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0046194000000000001, 2024-09-12T18:37:01.663 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0047247399999999998, 2024-09-12T18:37:01.663 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:01.663 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:01.663 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:01.663 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:01.663 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.663 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:01.663 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.643896+0000", 2024-09-12T18:37:01.663 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:01.663 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.664 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.664 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:01.664 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.643896+0000", 2024-09-12T18:37:01.664 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:01.664 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.664 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.664 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:01.664 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.643896+0000", 2024-09-12T18:37:01.664 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9800000000000003e-07 2024-09-12T18:37:01.664 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.664 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.664 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:01.664 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.643900+0000", 2024-09-12T18:37:01.665 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4479999999999999e-06 2024-09-12T18:37:01.665 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.665 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.665 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:01.665 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.643909+0000", 2024-09-12T18:37:01.665 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.9169999999999995e-06 2024-09-12T18:37:01.665 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.665 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.665 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:01.665 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.643913+0000", 2024-09-12T18:37:01.665 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.6020000000000002e-06 2024-09-12T18:37:01.665 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.665 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.666 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:01.666 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.643946+0000", 2024-09-12T18:37:01.666 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.2604000000000002e-05 2024-09-12T18:37:01.666 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.666 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.666 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:01.666 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.643962+0000", 2024-09-12T18:37:01.666 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6016e-05 2024-09-12T18:37:01.666 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:01.666 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:01.666 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:01.666 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.666 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.666 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:164103 5.c 5:307501b4:::benchmark_data_smithi073_23739_object31826:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:01.667 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:01.644171+0000", 2024-09-12T18:37:01.667 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0043441579999999999, 2024-09-12T18:37:01.667 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0044795829999999997, 2024-09-12T18:37:01.667 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:01.667 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:01.667 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:01.667 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:01.667 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:01.667 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:01.667 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 164103 2024-09-12T18:37:01.667 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.667 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:01.667 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.667 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:01.668 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.644171+0000", 2024-09-12T18:37:01.668 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:01.668 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.668 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.668 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:01.668 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.644171+0000", 2024-09-12T18:37:01.668 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:01.668 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.668 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.668 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:01.668 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.644172+0000", 2024-09-12T18:37:01.668 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4920000000000001e-06 2024-09-12T18:37:01.668 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.669 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.669 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:01.669 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.644178+0000", 2024-09-12T18:37:01.669 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5280000000000003e-06 2024-09-12T18:37:01.669 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.669 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.669 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:01.669 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.644192+0000", 2024-09-12T18:37:01.669 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4314000000000001e-05 2024-09-12T18:37:01.669 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.669 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.669 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:01.669 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.644202+0000", 2024-09-12T18:37:01.670 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.3060000000000003e-06 2024-09-12T18:37:01.670 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.670 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.670 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:01.670 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.644263+0000", 2024-09-12T18:37:01.670 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1467e-05 2024-09-12T18:37:01.670 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.670 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.670 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:01.670 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.644416+0000", 2024-09-12T18:37:01.670 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015306200000000001 2024-09-12T18:37:01.670 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.670 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.670 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:01.671 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.644546+0000", 2024-09-12T18:37:01.671 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013016899999999999 2024-09-12T18:37:01.671 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:01.671 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:01.671 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:01.671 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.671 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.671 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:164105 5.2 e58/21 5:4939c4d2:::benchmark_data_smithi073_23739_object31828:head v 58'10164, mlcod=58'10162)", 2024-09-12T18:37:01.671 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:01.645118+0000", 2024-09-12T18:37:01.671 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.003397139, 2024-09-12T18:37:01.671 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0035673079999999999, 2024-09-12T18:37:01.671 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:01.671 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:01.672 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:01.672 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:01.672 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.672 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:01.672 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.645118+0000", 2024-09-12T18:37:01.672 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:01.672 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.672 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.672 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:01.672 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.645118+0000", 2024-09-12T18:37:01.672 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:01.672 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.672 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.673 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:01.673 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.645118+0000", 2024-09-12T18:37:01.673 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9599999999999999e-07 2024-09-12T18:37:01.673 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.673 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.673 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:01.673 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.645121+0000", 2024-09-12T18:37:01.673 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.8339999999999999e-06 2024-09-12T18:37:01.673 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.673 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.673 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:01.673 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.645129+0000", 2024-09-12T18:37:01.673 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4370000000000001e-06 2024-09-12T18:37:01.674 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.674 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.674 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:01.674 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.645133+0000", 2024-09-12T18:37:01.674 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.1819999999999999e-06 2024-09-12T18:37:01.674 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.674 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.674 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:01.674 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.645172+0000", 2024-09-12T18:37:01.674 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8844000000000003e-05 2024-09-12T18:37:01.674 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.674 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.674 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:01.675 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.645184+0000", 2024-09-12T18:37:01.675 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2078e-05 2024-09-12T18:37:01.675 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:01.675 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:01.675 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:01.675 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.675 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.675 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:164101 5.1 e58/49 5:85aaabc4:::benchmark_data_smithi073_23739_object31824:head v 58'10226, mlcod=58'10223)", 2024-09-12T18:37:01.675 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:01.645517+0000", 2024-09-12T18:37:01.675 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.002998148, 2024-09-12T18:37:01.675 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0031955260000000002, 2024-09-12T18:37:01.675 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:01.675 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:01.675 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:01.676 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:01.676 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.676 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:01.676 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.645517+0000", 2024-09-12T18:37:01.676 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:01.676 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.676 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.676 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:01.676 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.645517+0000", 2024-09-12T18:37:01.676 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:01.676 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.676 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.676 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:01.677 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.645517+0000", 2024-09-12T18:37:01.677 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.6800000000000001e-07 2024-09-12T18:37:01.677 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.677 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.677 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:01.677 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.645531+0000", 2024-09-12T18:37:01.677 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3196e-05 2024-09-12T18:37:01.677 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.677 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.677 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:01.677 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.645540+0000", 2024-09-12T18:37:01.677 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4560000000000006e-06 2024-09-12T18:37:01.677 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.678 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.678 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:01.678 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.645546+0000", 2024-09-12T18:37:01.678 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6899999999999997e-06 2024-09-12T18:37:01.678 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.678 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.678 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:01.678 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.645603+0000", 2024-09-12T18:37:01.678 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7234000000000001e-05 2024-09-12T18:37:01.678 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.678 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.678 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:01.678 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.645627+0000", 2024-09-12T18:37:01.678 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.3943000000000001e-05 2024-09-12T18:37:01.679 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:01.679 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:01.679 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:01.679 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.679 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.679 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:164102 5.0 e58/49 5:017476f1:::benchmark_data_smithi073_23739_object31825:head v 58'10280, mlcod=58'10276)", 2024-09-12T18:37:01.679 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:01.645540+0000", 2024-09-12T18:37:01.679 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0029749960000000002, 2024-09-12T18:37:01.679 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0032002720000000001, 2024-09-12T18:37:01.679 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:01.679 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:01.679 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:01.679 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:01.680 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.680 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:01.680 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.645540+0000", 2024-09-12T18:37:01.680 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:01.680 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.680 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.680 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:01.680 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.645540+0000", 2024-09-12T18:37:01.680 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:01.680 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.680 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.680 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:01.680 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.645541+0000", 2024-09-12T18:37:01.680 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.58e-07 2024-09-12T18:37:01.681 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.681 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.681 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:01.681 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.645544+0000", 2024-09-12T18:37:01.681 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.5559999999999999e-06 2024-09-12T18:37:01.681 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.681 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.681 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:01.681 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.645550+0000", 2024-09-12T18:37:01.681 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1210000000000003e-06 2024-09-12T18:37:01.681 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.681 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.681 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:01.682 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.645554+0000", 2024-09-12T18:37:01.682 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0550000000000001e-06 2024-09-12T18:37:01.682 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.682 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.682 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:01.682 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.645601+0000", 2024-09-12T18:37:01.682 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.6236000000000003e-05 2024-09-12T18:37:01.682 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.682 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.682 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:01.682 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.645614+0000", 2024-09-12T18:37:01.682 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3811999999999999e-05 2024-09-12T18:37:01.682 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:01.682 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:01.683 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:01.683 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.683 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.683 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:164104 5.1 e58/49 5:85b7db41:::benchmark_data_smithi073_23739_object31827:head v 58'10227, mlcod=58'10223)", 2024-09-12T18:37:01.683 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:01.646999+0000", 2024-09-12T18:37:01.683 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0015162369999999999, 2024-09-12T18:37:01.683 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001795467, 2024-09-12T18:37:01.683 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:01.683 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:01.683 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:01.683 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:01.683 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.683 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:01.684 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.646999+0000", 2024-09-12T18:37:01.684 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:01.684 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.684 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.684 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:01.684 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.646999+0000", 2024-09-12T18:37:01.684 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:01.684 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.684 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.684 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:01.684 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.646999+0000", 2024-09-12T18:37:01.684 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5899999999999996e-07 2024-09-12T18:37:01.684 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.685 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.685 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:01.685 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.647004+0000", 2024-09-12T18:37:01.685 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4270000000000001e-06 2024-09-12T18:37:01.685 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.685 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.685 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:01.685 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.647012+0000", 2024-09-12T18:37:01.685 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1349999999999992e-06 2024-09-12T18:37:01.685 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.685 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.685 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:01.685 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.647017+0000", 2024-09-12T18:37:01.685 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8010000000000003e-06 2024-09-12T18:37:01.686 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.686 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.686 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:01.686 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.647364+0000", 2024-09-12T18:37:01.686 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00034686599999999998 2024-09-12T18:37:01.686 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.686 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.686 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:01.686 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.647388+0000", 2024-09-12T18:37:01.686 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4037e-05 2024-09-12T18:37:01.686 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:01.686 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:01.686 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:01.687 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.687 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.687 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:164106 5.1 e58/49 5:8ac0317d:::benchmark_data_smithi073_23739_object31829:head v 58'10228, mlcod=58'10223)", 2024-09-12T18:37:01.687 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:01.648367+0000", 2024-09-12T18:37:01.687 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00014828500000000001, 2024-09-12T18:37:01.687 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000464926, 2024-09-12T18:37:01.687 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:01.687 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:01.687 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:01.687 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:01.687 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.687 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:01.687 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.648367+0000", 2024-09-12T18:37:01.688 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:01.688 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.688 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.688 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:01.688 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.648367+0000", 2024-09-12T18:37:01.688 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:01.688 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.688 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.688 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:01.688 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.648367+0000", 2024-09-12T18:37:01.688 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.7e-07 2024-09-12T18:37:01.688 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.688 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.689 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:01.689 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.648370+0000", 2024-09-12T18:37:01.689 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.8839999999999998e-06 2024-09-12T18:37:01.689 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.689 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.689 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:01.689 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.648376+0000", 2024-09-12T18:37:01.689 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2219999999999999e-06 2024-09-12T18:37:01.689 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.689 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.689 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:01.689 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.648380+0000", 2024-09-12T18:37:01.689 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.6239999999999999e-06 2024-09-12T18:37:01.690 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.690 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.690 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:01.690 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.648557+0000", 2024-09-12T18:37:01.690 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00017680899999999999 2024-09-12T18:37:01.690 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.690 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.690 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:01.690 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.648572+0000", 2024-09-12T18:37:01.690 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5139e-05 2024-09-12T18:37:01.690 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:01.690 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:01.690 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:01.690 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.691 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.691 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:164107 5.5 e58/49 5:a6215162:::benchmark_data_smithi073_23739_object31830:head v 58'10387, mlcod=58'10385)", 2024-09-12T18:37:01.691 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:01.648754+0000", 2024-09-12T18:37:01.691 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4294967295.9997616, 2024-09-12T18:37:01.691 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000105716, 2024-09-12T18:37:01.691 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:01.691 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:01.691 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:01.691 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:01.691 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.691 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:01.691 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.648754+0000", 2024-09-12T18:37:01.691 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:01.691 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.692 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.692 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:01.692 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.648754+0000", 2024-09-12T18:37:01.692 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:01.692 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.692 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.692 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:01.692 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.648754+0000", 2024-09-12T18:37:01.692 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.0999999999999998e-07 2024-09-12T18:37:01.692 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.692 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.692 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:01.692 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.648759+0000", 2024-09-12T18:37:01.692 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.651e-06 2024-09-12T18:37:01.693 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.693 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.693 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:01.693 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.648769+0000", 2024-09-12T18:37:01.693 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0329999999999999e-05 2024-09-12T18:37:01.693 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.693 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.693 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:01.693 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.648776+0000", 2024-09-12T18:37:01.693 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0090000000000001e-06 2024-09-12T18:37:01.693 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.693 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.693 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:01.694 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.648831+0000", 2024-09-12T18:37:01.694 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4808000000000001e-05 2024-09-12T18:37:01.694 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:01.694 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:01.694 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:01.694 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.648856+0000", 2024-09-12T18:37:01.694 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4990999999999998e-05 2024-09-12T18:37:01.694 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:01.694 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:01.694 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:01.694 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:01.694 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-12T18:37:01.694 INFO:teuthology.orchestra.run.smithi114.stdout: "num_ops": 11 2024-09-12T18:37:01.695 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:01.696 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:37:01.713 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:37:01.713 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:37:01.713 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-12T18:37:01.713 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T18:37:01.739 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:01.735+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:01.802 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:01.799+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:01.894 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:01.894 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2024-09-12T18:37:01.894 INFO:teuthology.orchestra.run.smithi114.stdout: "complaint_time": 30, 2024-09-12T18:37:01.894 INFO:teuthology.orchestra.run.smithi114.stdout: "num_blocked_ops": 0 2024-09-12T18:37:01.894 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:01.902 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:01.897+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:01.916 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:37:02.003 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:01.997+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:02.036 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:37:02.037 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T18:37:02.037 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 58, 2024-09-12T18:37:02.037 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "c08d5a84-711b-44bf-bdf1-e06ecc2c7c00", 2024-09-12T18:37:02.037 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-12T18:35:02.695853+0000", 2024-09-12T18:37:02.037 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-12T18:37:00.479092+0000", 2024-09-12T18:37:02.037 INFO:teuthology.orchestra.run.smithi073.stdout: "last_up_change": "2024-09-12T18:35:12.464628+0000", 2024-09-12T18:37:02.037 INFO:teuthology.orchestra.run.smithi073.stdout: "last_in_change": "2024-09-12T18:35:04.352525+0000", 2024-09-12T18:37:02.037 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T18:37:02.037 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_num": 5804032, 2024-09-12T18:37:02.037 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_set": [ 2024-09-12T18:37:02.037 INFO:teuthology.orchestra.run.smithi073.stdout: "nodeep-scrub", 2024-09-12T18:37:02.037 INFO:teuthology.orchestra.run.smithi073.stdout: "pglog_hardlimit", 2024-09-12T18:37:02.038 INFO:teuthology.orchestra.run.smithi073.stdout: "purged_snapdirs", 2024-09-12T18:37:02.038 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_deletes", 2024-09-12T18:37:02.038 INFO:teuthology.orchestra.run.smithi073.stdout: "sortbitwise" 2024-09-12T18:37:02.038 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T18:37:02.038 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_version": 5, 2024-09-12T18:37:02.038 INFO:teuthology.orchestra.run.smithi073.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T18:37:02.038 INFO:teuthology.orchestra.run.smithi073.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T18:37:02.038 INFO:teuthology.orchestra.run.smithi073.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T18:37:02.038 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_snapshot": "", 2024-09-12T18:37:02.038 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_max": 5, 2024-09-12T18:37:02.038 INFO:teuthology.orchestra.run.smithi073.stdout: "max_osd": 3, 2024-09-12T18:37:02.038 INFO:teuthology.orchestra.run.smithi073.stdout: "require_min_compat_client": "luminous", 2024-09-12T18:37:02.038 INFO:teuthology.orchestra.run.smithi073.stdout: "min_compat_client": "jewel", 2024-09-12T18:37:02.039 INFO:teuthology.orchestra.run.smithi073.stdout: "require_osd_release": "squid", 2024-09-12T18:37:02.039 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_crimson": false, 2024-09-12T18:37:02.039 INFO:teuthology.orchestra.run.smithi073.stdout: "pools": [ 2024-09-12T18:37:02.039 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:02.039 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 1, 2024-09-12T18:37:02.039 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": ".mgr", 2024-09-12T18:37:02.040 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:12.418430+0000", 2024-09-12T18:37:02.040 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-12T18:37:02.040 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-09-12T18:37:02.040 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:37:02.040 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:37:02.040 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:37:02.040 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:37:02.040 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:37:02.040 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:37:02.040 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:37:02.041 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:37:02.041 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:37:02.042 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:37:02.042 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:37:02.042 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 1, 2024-09-12T18:37:02.042 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 1, 2024-09-12T18:37:02.042 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 1, 2024-09-12T18:37:02.042 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 1, 2024-09-12T18:37:02.042 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 1, 2024-09-12T18:37:02.042 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:37:02.042 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:37:02.042 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:37:02.042 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:37:02.042 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:37:02.042 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:37:02.043 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:37:02.043 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.043 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "11", 2024-09-12T18:37:02.043 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:37:02.043 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:37:02.043 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:37:02.043 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:37:02.043 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:37:02.043 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-09-12T18:37:02.043 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-09-12T18:37:02.043 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:37:02.043 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:37:02.043 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:37:02.043 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:37:02.044 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:37:02.044 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:37:02.044 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:37:02.044 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:37:02.044 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:37:02.044 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:37:02.044 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:37:02.044 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:37:02.044 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:37:02.044 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:37:02.044 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:37:02.044 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:37:02.045 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:37:02.045 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:37:02.045 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:37:02.045 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.045 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:37:02.045 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:37:02.045 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:37:02.045 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:37:02.045 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:37:02.045 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:37:02.045 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:37:02.045 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:37:02.045 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:37:02.046 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:37:02.046 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:37:02.046 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-09-12T18:37:02.046 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_max": 32, 2024-09-12T18:37:02.046 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 1 2024-09-12T18:37:02.046 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.046 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:37:02.046 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": {} 2024-09-12T18:37:02.046 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.047 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:37:02.047 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:37:02.047 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 2.9900000095367432, 2024-09-12T18:37:02.047 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 2.9900000095367432, 2024-09-12T18:37:02.047 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 0.67000001668930054, 2024-09-12T18:37:02.047 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 2, 2024-09-12T18:37:02.047 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 2, 2024-09-12T18:37:02.047 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:37:02.047 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:37:02.047 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:37:02.047 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:02.047 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.048 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:02.048 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 2, 2024-09-12T18:37:02.048 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "rbd", 2024-09-12T18:37:02.048 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:18.665309+0000", 2024-09-12T18:37:02.048 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 8193, 2024-09-12T18:37:02.048 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T18:37:02.048 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:37:02.049 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:37:02.049 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:37:02.049 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:37:02.049 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:37:02.049 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:37:02.049 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:37:02.049 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:37:02.049 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:37:02.049 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:37:02.049 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:37:02.049 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 8, 2024-09-12T18:37:02.049 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 8, 2024-09-12T18:37:02.049 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 8, 2024-09-12T18:37:02.050 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 8, 2024-09-12T18:37:02.050 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 8, 2024-09-12T18:37:02.050 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:37:02.050 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:37:02.050 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:37:02.050 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:37:02.050 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:37:02.050 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:37:02.050 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:37:02.050 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.050 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "15", 2024-09-12T18:37:02.050 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:37:02.051 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:37:02.051 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:37:02.051 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:37:02.051 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:37:02.051 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 2, 2024-09-12T18:37:02.051 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 15, 2024-09-12T18:37:02.051 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:37:02.051 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:37:02.051 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:37:02.051 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:37:02.051 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:37:02.051 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:37:02.052 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:37:02.052 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:37:02.052 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:37:02.052 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:37:02.052 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:37:02.052 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:37:02.052 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:37:02.052 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:37:02.052 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:37:02.052 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:37:02.052 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:37:02.052 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:37:02.052 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:37:02.053 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.053 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:37:02.053 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:37:02.053 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:37:02.053 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:37:02.053 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:37:02.053 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:37:02.053 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:37:02.053 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:37:02.053 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:37:02.053 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:37:02.053 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:37:02.054 INFO:teuthology.orchestra.run.smithi073.stdout: "options": {}, 2024-09-12T18:37:02.054 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:37:02.054 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd": {} 2024-09-12T18:37:02.054 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.054 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:37:02.054 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:37:02.054 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.5, 2024-09-12T18:37:02.054 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.5, 2024-09-12T18:37:02.054 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-09-12T18:37:02.054 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.5, 2024-09-12T18:37:02.054 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.5, 2024-09-12T18:37:02.054 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:37:02.054 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:37:02.055 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:37:02.055 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:02.055 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.055 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:02.055 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 3, 2024-09-12T18:37:02.055 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "cephfs_metadata", 2024-09-12T18:37:02.055 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:23.447845+0000", 2024-09-12T18:37:02.055 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-12T18:37:02.055 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-09-12T18:37:02.055 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:37:02.055 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:37:02.055 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:37:02.055 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:37:02.056 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:37:02.056 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:37:02.056 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:37:02.056 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:37:02.056 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:37:02.056 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:37:02.056 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:37:02.056 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 32, 2024-09-12T18:37:02.056 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 32, 2024-09-12T18:37:02.056 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 32, 2024-09-12T18:37:02.056 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 32, 2024-09-12T18:37:02.056 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 32, 2024-09-12T18:37:02.057 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:37:02.057 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:37:02.057 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:37:02.057 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:37:02.057 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:37:02.057 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:37:02.057 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:37:02.057 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.057 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "18", 2024-09-12T18:37:02.057 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:37:02.057 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:37:02.058 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:37:02.058 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:37:02.058 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:37:02.058 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-09-12T18:37:02.058 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-09-12T18:37:02.058 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:37:02.058 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:37:02.058 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:37:02.058 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:37:02.058 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:37:02.058 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:37:02.058 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:37:02.058 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:37:02.059 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:37:02.059 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:37:02.059 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:37:02.059 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:37:02.059 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:37:02.059 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:37:02.059 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:37:02.059 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:37:02.059 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:37:02.059 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:37:02.059 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:37:02.059 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.059 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:37:02.060 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:37:02.060 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:37:02.060 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:37:02.060 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:37:02.060 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:37:02.060 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:37:02.060 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:37:02.060 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:37:02.060 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:37:02.060 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:37:02.060 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-09-12T18:37:02.060 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_bias": 4, 2024-09-12T18:37:02.060 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 16, 2024-09-12T18:37:02.060 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_priority": 5 2024-09-12T18:37:02.061 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.061 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:37:02.061 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs": { 2024-09-12T18:37:02.061 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": "cephfs" 2024-09-12T18:37:02.061 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:02.061 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.061 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:37:02.061 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:37:02.061 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.4099999666213989, 2024-09-12T18:37:02.061 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.4099999666213989, 2024-09-12T18:37:02.061 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-09-12T18:37:02.061 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.4099999666213989, 2024-09-12T18:37:02.061 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.4099999666213989, 2024-09-12T18:37:02.061 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:37:02.062 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:37:02.062 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:37:02.062 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:02.062 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.062 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:02.062 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 4, 2024-09-12T18:37:02.062 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "cephfs_data", 2024-09-12T18:37:02.062 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:23.959973+0000", 2024-09-12T18:37:02.062 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-12T18:37:02.062 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-09-12T18:37:02.062 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:37:02.062 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:37:02.062 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:37:02.063 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:37:02.063 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:37:02.063 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:37:02.063 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:37:02.063 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:37:02.063 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:37:02.063 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:37:02.063 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:37:02.063 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 64, 2024-09-12T18:37:02.063 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 64, 2024-09-12T18:37:02.063 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 64, 2024-09-12T18:37:02.063 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 64, 2024-09-12T18:37:02.063 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 64, 2024-09-12T18:37:02.064 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:37:02.064 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:37:02.064 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:37:02.064 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:37:02.064 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:37:02.064 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:37:02.064 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:37:02.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.064 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "19", 2024-09-12T18:37:02.064 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:37:02.064 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:37:02.064 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:37:02.065 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:37:02.065 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:37:02.065 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-09-12T18:37:02.065 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-09-12T18:37:02.065 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:37:02.065 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:37:02.065 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:37:02.065 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:37:02.065 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:37:02.065 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:37:02.065 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:37:02.065 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:37:02.065 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:37:02.066 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:37:02.066 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:37:02.066 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:37:02.066 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:37:02.066 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:37:02.066 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:37:02.066 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:37:02.066 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:37:02.066 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:37:02.066 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:37:02.066 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.066 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:37:02.066 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:37:02.067 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:37:02.067 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:37:02.067 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:37:02.067 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:37:02.067 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:37:02.067 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:37:02.067 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:37:02.067 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:37:02.067 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:37:02.067 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-09-12T18:37:02.067 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 64, 2024-09-12T18:37:02.067 INFO:teuthology.orchestra.run.smithi073.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T18:37:02.067 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.068 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:37:02.068 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs": { 2024-09-12T18:37:02.069 INFO:teuthology.orchestra.run.smithi073.stdout: "data": "cephfs" 2024-09-12T18:37:02.069 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:02.069 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.069 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:37:02.069 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:37:02.069 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.4099999666213989, 2024-09-12T18:37:02.069 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.4099999666213989, 2024-09-12T18:37:02.069 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-09-12T18:37:02.069 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.4099999666213989, 2024-09-12T18:37:02.069 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.4099999666213989, 2024-09-12T18:37:02.069 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:37:02.070 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:37:02.070 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:37:02.070 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:02.070 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.070 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:02.070 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 5, 2024-09-12T18:37:02.070 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "unique_pool_0", 2024-09-12T18:37:02.070 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:43.562347+0000", 2024-09-12T18:37:02.070 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-12T18:37:02.070 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-09-12T18:37:02.070 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:37:02.070 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:37:02.070 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:37:02.071 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:37:02.071 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:37:02.071 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:37:02.071 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:37:02.071 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:37:02.071 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:37:02.071 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:37:02.071 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:37:02.071 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 16, 2024-09-12T18:37:02.071 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 16, 2024-09-12T18:37:02.072 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 16, 2024-09-12T18:37:02.072 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 16, 2024-09-12T18:37:02.072 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 16, 2024-09-12T18:37:02.072 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:37:02.072 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:37:02.072 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:37:02.072 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:37:02.072 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:37:02.072 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:37:02.072 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:37:02.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.073 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "23", 2024-09-12T18:37:02.073 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:37:02.073 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:37:02.073 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:37:02.073 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:37:02.073 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:37:02.073 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-09-12T18:37:02.073 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-09-12T18:37:02.073 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:37:02.073 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:37:02.073 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:37:02.073 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:37:02.073 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:37:02.073 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:37:02.074 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:37:02.074 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:37:02.074 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:37:02.074 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:37:02.074 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:37:02.074 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:37:02.074 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:37:02.074 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:37:02.074 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:37:02.074 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:37:02.074 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:37:02.074 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:37:02.074 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:37:02.074 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.074 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:37:02.075 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:37:02.075 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:37:02.075 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:37:02.075 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:37:02.075 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:37:02.075 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:37:02.075 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:37:02.075 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:37:02.075 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:37:02.075 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:37:02.075 INFO:teuthology.orchestra.run.smithi073.stdout: "options": {}, 2024-09-12T18:37:02.075 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:37:02.075 INFO:teuthology.orchestra.run.smithi073.stdout: "rados": {} 2024-09-12T18:37:02.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.076 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:37:02.076 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:37:02.076 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.1299999952316284, 2024-09-12T18:37:02.076 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.1299999952316284, 2024-09-12T18:37:02.076 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-09-12T18:37:02.076 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T18:37:02.076 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T18:37:02.076 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:37:02.076 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:37:02.076 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:37:02.076 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:02.077 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:02.077 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T18:37:02.077 INFO:teuthology.orchestra.run.smithi073.stdout: "osds": [ 2024-09-12T18:37:02.077 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:02.077 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-09-12T18:37:02.077 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "f1cf24e8-6179-4666-a444-fa81ef0d7482", 2024-09-12T18:37:02.077 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-09-12T18:37:02.077 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-09-12T18:37:02.077 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0.6371612548828125, 2024-09-12T18:37:02.077 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-09-12T18:37:02.077 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-09-12T18:37:02.077 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-09-12T18:37:02.077 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-09-12T18:37:02.077 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 21, 2024-09-12T18:37:02.078 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-09-12T18:37:02.078 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-09-12T18:37:02.078 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-12T18:37:02.078 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:02.078 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:02.078 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:02.078 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6800", 2024-09-12T18:37:02.078 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:37:02.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.078 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:02.078 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:02.078 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6801", 2024-09-12T18:37:02.078 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:37:02.079 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:02.079 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:02.079 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.079 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-09-12T18:37:02.079 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:02.079 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:02.079 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:02.079 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6802", 2024-09-12T18:37:02.079 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:37:02.079 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.079 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:02.079 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:02.080 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6803", 2024-09-12T18:37:02.080 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:37:02.080 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:02.080 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:02.080 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.080 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-09-12T18:37:02.080 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:02.080 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:02.080 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:02.080 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6806", 2024-09-12T18:37:02.080 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:37:02.080 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.080 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:02.081 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:02.081 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6807", 2024-09-12T18:37:02.081 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:37:02.081 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:02.081 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:02.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.081 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-09-12T18:37:02.081 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:02.081 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:02.081 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:02.081 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6804", 2024-09-12T18:37:02.081 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:37:02.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.082 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:02.082 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:02.082 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6805", 2024-09-12T18:37:02.082 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:37:02.082 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:02.082 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:02.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.082 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.114:6801/2710632206", 2024-09-12T18:37:02.082 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.114:6803/2710632206", 2024-09-12T18:37:02.082 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.114:6807/2710632206", 2024-09-12T18:37:02.082 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.114:6805/2710632206", 2024-09-12T18:37:02.082 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-09-12T18:37:02.083 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-09-12T18:37:02.083 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-09-12T18:37:02.083 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:02.083 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.083 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:02.083 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-09-12T18:37:02.083 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "3fdb0044-2820-4411-978b-4b6e94fbf0b1", 2024-09-12T18:37:02.083 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-09-12T18:37:02.083 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-09-12T18:37:02.083 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-09-12T18:37:02.083 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-09-12T18:37:02.083 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-09-12T18:37:02.083 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-09-12T18:37:02.084 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 9, 2024-09-12T18:37:02.084 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 49, 2024-09-12T18:37:02.084 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-09-12T18:37:02.084 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-09-12T18:37:02.084 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-12T18:37:02.084 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:02.084 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:02.084 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:02.084 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6800", 2024-09-12T18:37:02.084 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:37:02.084 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.085 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:02.085 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:02.085 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6801", 2024-09-12T18:37:02.085 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:37:02.085 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:02.085 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:02.085 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.085 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-09-12T18:37:02.085 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:02.085 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:02.085 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:02.085 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6802", 2024-09-12T18:37:02.085 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:37:02.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:02.086 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:02.086 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6803", 2024-09-12T18:37:02.086 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:37:02.086 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:02.086 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:02.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.086 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-09-12T18:37:02.086 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:02.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:02.086 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:02.087 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6806", 2024-09-12T18:37:02.087 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:37:02.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:02.087 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:02.087 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6807", 2024-09-12T18:37:02.087 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:37:02.087 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:02.087 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:02.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.087 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-09-12T18:37:02.087 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:02.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:02.088 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:02.088 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6804", 2024-09-12T18:37:02.088 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:37:02.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:02.088 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:02.088 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6805", 2024-09-12T18:37:02.088 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:37:02.088 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:02.088 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:02.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.089 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.143:6801/862189968", 2024-09-12T18:37:02.089 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.143:6803/862189968", 2024-09-12T18:37:02.089 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.143:6807/862189968", 2024-09-12T18:37:02.089 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.143:6805/862189968", 2024-09-12T18:37:02.089 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-09-12T18:37:02.089 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-09-12T18:37:02.089 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-09-12T18:37:02.089 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:02.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:02.089 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2024-09-12T18:37:02.089 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "6fb554da-561f-4aa2-b855-0e3adb98b057", 2024-09-12T18:37:02.090 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-09-12T18:37:02.090 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-09-12T18:37:02.090 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-09-12T18:37:02.090 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-09-12T18:37:02.090 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-09-12T18:37:02.090 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-09-12T18:37:02.090 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-09-12T18:37:02.090 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 49, 2024-09-12T18:37:02.090 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-09-12T18:37:02.090 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-09-12T18:37:02.090 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-12T18:37:02.090 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:02.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:02.091 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:02.091 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6800", 2024-09-12T18:37:02.091 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:37:02.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:02.091 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:02.091 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6801", 2024-09-12T18:37:02.091 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:37:02.091 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:02.091 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:02.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.091 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-09-12T18:37:02.091 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:02.092 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:02.092 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:02.092 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6802", 2024-09-12T18:37:02.092 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:37:02.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.092 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:02.092 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:02.092 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6803", 2024-09-12T18:37:02.092 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:37:02.092 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:02.092 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:02.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.092 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-09-12T18:37:02.093 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:02.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:02.093 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:02.093 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6806", 2024-09-12T18:37:02.093 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:37:02.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:02.093 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:02.093 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6807", 2024-09-12T18:37:02.093 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:37:02.093 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:02.093 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:02.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.094 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-09-12T18:37:02.094 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:02.094 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:02.094 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:02.094 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6804", 2024-09-12T18:37:02.094 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:37:02.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.094 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:02.094 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:02.094 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6805", 2024-09-12T18:37:02.094 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:37:02.094 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:02.094 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:02.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.095 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.162:6801/1397104153", 2024-09-12T18:37:02.095 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.162:6803/1397104153", 2024-09-12T18:37:02.095 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.162:6807/1397104153", 2024-09-12T18:37:02.095 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.162:6805/1397104153", 2024-09-12T18:37:02.095 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-09-12T18:37:02.095 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-09-12T18:37:02.095 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-09-12T18:37:02.095 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:02.095 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:02.095 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T18:37:02.095 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_xinfo": [ 2024-09-12T18:37:02.095 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:02.095 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-09-12T18:37:02.096 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-09-12T18:37:02.096 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-09-12T18:37:02.096 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-09-12T18:37:02.096 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540719139924082687, 2024-09-12T18:37:02.096 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-09-12T18:37:02.096 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-09-12T18:35:10.239320+0000", 2024-09-12T18:37:02.096 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-09-12T18:37:02.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:02.096 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-09-12T18:37:02.096 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-09-12T18:37:02.096 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-09-12T18:37:02.097 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-09-12T18:37:02.097 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540719139924082687, 2024-09-12T18:37:02.097 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-09-12T18:37:02.097 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-09-12T18:35:10.861760+0000", 2024-09-12T18:37:02.097 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-09-12T18:37:02.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:02.097 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2024-09-12T18:37:02.097 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-09-12T18:37:02.097 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-09-12T18:37:02.097 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-09-12T18:37:02.097 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540719139924082687, 2024-09-12T18:37:02.097 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-09-12T18:37:02.097 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-09-12T18:35:10.355997+0000", 2024-09-12T18:37:02.098 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-09-12T18:37:02.098 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:02.098 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T18:37:02.098 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap": [], 2024-09-12T18:37:02.098 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap_items": [], 2024-09-12T18:37:02.098 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap_primaries": [], 2024-09-12T18:37:02.098 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_temp": [ 2024-09-12T18:37:02.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:02.098 INFO:teuthology.orchestra.run.smithi073.stdout: "pgid": "5.0", 2024-09-12T18:37:02.098 INFO:teuthology.orchestra.run.smithi073.stdout: "osds": [ 2024-09-12T18:37:02.098 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-12T18:37:02.098 INFO:teuthology.orchestra.run.smithi073.stdout: 0 2024-09-12T18:37:02.098 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:02.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.099 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:02.099 INFO:teuthology.orchestra.run.smithi073.stdout: "pgid": "5.1", 2024-09-12T18:37:02.099 INFO:teuthology.orchestra.run.smithi073.stdout: "osds": [ 2024-09-12T18:37:02.099 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-12T18:37:02.099 INFO:teuthology.orchestra.run.smithi073.stdout: 0 2024-09-12T18:37:02.099 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:02.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.099 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:02.099 INFO:teuthology.orchestra.run.smithi073.stdout: "pgid": "5.5", 2024-09-12T18:37:02.099 INFO:teuthology.orchestra.run.smithi073.stdout: "osds": [ 2024-09-12T18:37:02.099 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-12T18:37:02.099 INFO:teuthology.orchestra.run.smithi073.stdout: 0 2024-09-12T18:37:02.099 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:02.099 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:02.100 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T18:37:02.100 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_temp": [], 2024-09-12T18:37:02.100 INFO:teuthology.orchestra.run.smithi073.stdout: "blocklist": {}, 2024-09-12T18:37:02.100 INFO:teuthology.orchestra.run.smithi073.stdout: "range_blocklist": {}, 2024-09-12T18:37:02.100 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profiles": { 2024-09-12T18:37:02.100 INFO:teuthology.orchestra.run.smithi073.stdout: "default": { 2024-09-12T18:37:02.100 INFO:teuthology.orchestra.run.smithi073.stdout: "crush-failure-domain": "osd", 2024-09-12T18:37:02.100 INFO:teuthology.orchestra.run.smithi073.stdout: "k": "2", 2024-09-12T18:37:02.100 INFO:teuthology.orchestra.run.smithi073.stdout: "m": "1", 2024-09-12T18:37:02.100 INFO:teuthology.orchestra.run.smithi073.stdout: "plugin": "jerasure", 2024-09-12T18:37:02.100 INFO:teuthology.orchestra.run.smithi073.stdout: "technique": "reed_sol_van" 2024-09-12T18:37:02.100 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:02.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:02.100 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps_queue": [], 2024-09-12T18:37:02.101 INFO:teuthology.orchestra.run.smithi073.stdout: "new_removed_snaps": [], 2024-09-12T18:37:02.101 INFO:teuthology.orchestra.run.smithi073.stdout: "new_purged_snaps": [], 2024-09-12T18:37:02.101 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_node_flags": {}, 2024-09-12T18:37:02.101 INFO:teuthology.orchestra.run.smithi073.stdout: "device_class_flags": {}, 2024-09-12T18:37:02.101 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": { 2024-09-12T18:37:02.101 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode_enabled": false, 2024-09-12T18:37:02.101 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_bucket_count": 0, 2024-09-12T18:37:02.101 INFO:teuthology.orchestra.run.smithi073.stdout: "degraded_stretch_mode": 0, 2024-09-12T18:37:02.101 INFO:teuthology.orchestra.run.smithi073.stdout: "recovering_stretch_mode": 0, 2024-09-12T18:37:02.101 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode_bucket": 0 2024-09-12T18:37:02.101 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:02.101 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T18:37:02.103 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:02.103 INFO:teuthology.orchestra.run.smithi114.stdout: "size": 20, 2024-09-12T18:37:02.103 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 600, 2024-09-12T18:37:02.103 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:37:02.103 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.104 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:02.104 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:37:02.104 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 96.451752706999997, 2024-09-12T18:37:02.104 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.042475618999999999, 2024-09-12T18:37:02.104 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:02.104 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:02.104 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:02.104 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:02.104 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.104 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:02.104 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:37:02.105 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:02.105 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.105 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.105 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:02.105 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628436+0000", 2024-09-12T18:37:02.105 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:02.105 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.105 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.105 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:02.105 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628450+0000", 2024-09-12T18:37:02.105 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4212999999999999e-05 2024-09-12T18:37:02.105 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.106 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.106 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:02.106 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628463+0000", 2024-09-12T18:37:02.106 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2497000000000001e-05 2024-09-12T18:37:02.106 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.106 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.106 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:02.106 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628480+0000", 2024-09-12T18:37:02.106 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7232999999999999e-05 2024-09-12T18:37:02.106 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.106 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.106 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.106 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628496+0000", 2024-09-12T18:37:02.106 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6217000000000001e-05 2024-09-12T18:37:02.107 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.107 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.107 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:02.107 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628641+0000", 2024-09-12T18:37:02.107 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000144709 2024-09-12T18:37:02.107 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.107 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.107 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:37:02.107 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628657+0000", 2024-09-12T18:37:02.107 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6266e-05 2024-09-12T18:37:02.107 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.107 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.107 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:02.108 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663103+0000", 2024-09-12T18:37:02.108 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.034445523999999998 2024-09-12T18:37:02.108 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.108 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.108 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:02.108 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663373+0000", 2024-09-12T18:37:02.108 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00027085500000000002 2024-09-12T18:37:02.108 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.108 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.108 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:02.108 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.663634+0000", 2024-09-12T18:37:02.108 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000260855 2024-09-12T18:37:02.109 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.109 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.109 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:02.109 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670294+0000", 2024-09-12T18:37:02.109 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0066597599999999998 2024-09-12T18:37:02.109 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.109 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.109 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:02.109 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670705+0000", 2024-09-12T18:37:02.109 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00041057099999999998 2024-09-12T18:37:02.109 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.109 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.109 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:02.110 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670820+0000", 2024-09-12T18:37:02.110 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000115111 2024-09-12T18:37:02.110 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.110 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.110 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:02.110 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670912+0000", 2024-09-12T18:37:02.110 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1807999999999999e-05 2024-09-12T18:37:02.110 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:02.110 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:02.110 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:02.110 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.110 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.110 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:02.111 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:37:02.111 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 96.451661960999999, 2024-09-12T18:37:02.111 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.044599273000000002, 2024-09-12T18:37:02.111 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:02.111 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:02.111 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:02.111 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:02.111 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.111 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:02.111 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:37:02.111 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:02.111 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.111 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.112 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:02.112 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628527+0000", 2024-09-12T18:37:02.112 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:02.112 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.112 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.112 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:02.112 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628528+0000", 2024-09-12T18:37:02.112 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:37:02.112 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.112 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.112 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:02.112 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628537+0000", 2024-09-12T18:37:02.112 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6969999999999999e-06 2024-09-12T18:37:02.113 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.113 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.113 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:02.113 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628560+0000", 2024-09-12T18:37:02.113 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2889000000000001e-05 2024-09-12T18:37:02.113 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.113 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.113 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.113 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628576+0000", 2024-09-12T18:37:02.113 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.649e-05 2024-09-12T18:37:02.113 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.113 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.113 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:02.114 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628846+0000", 2024-09-12T18:37:02.114 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00026952500000000001 2024-09-12T18:37:02.114 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.114 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.114 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:37:02.114 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628853+0000", 2024-09-12T18:37:02.114 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6559999999999992e-06 2024-09-12T18:37:02.114 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.114 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.114 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:02.114 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665284+0000", 2024-09-12T18:37:02.114 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.036431140000000001 2024-09-12T18:37:02.114 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.115 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.115 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:02.115 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665494+0000", 2024-09-12T18:37:02.115 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000209762 2024-09-12T18:37:02.115 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.115 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.115 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:02.115 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665816+0000", 2024-09-12T18:37:02.115 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00032162299999999999 2024-09-12T18:37:02.115 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.115 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.115 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:02.115 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670382+0000", 2024-09-12T18:37:02.115 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0045656739999999996 2024-09-12T18:37:02.116 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.116 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.116 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:02.116 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.672978+0000", 2024-09-12T18:37:02.116 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.002596068 2024-09-12T18:37:02.116 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.116 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.116 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:02.116 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673058+0000", 2024-09-12T18:37:02.117 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0198999999999996e-05 2024-09-12T18:37:02.117 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.117 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.117 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:02.117 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673126+0000", 2024-09-12T18:37:02.117 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8120000000000005e-05 2024-09-12T18:37:02.117 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:02.117 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:02.117 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:02.117 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.117 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.117 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:23 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:02.117 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:37:02.118 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 96.451564155, 2024-09-12T18:37:02.118 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045539784, 2024-09-12T18:37:02.118 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:02.118 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:02.118 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:02.118 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:02.118 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.118 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:02.118 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:37:02.118 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:02.118 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.118 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.118 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:02.119 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628624+0000", 2024-09-12T18:37:02.119 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:02.119 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.119 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.119 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:02.119 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628626+0000", 2024-09-12T18:37:02.119 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.573e-06 2024-09-12T18:37:02.119 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.119 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.119 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:02.119 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628640+0000", 2024-09-12T18:37:02.119 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3817e-05 2024-09-12T18:37:02.119 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.120 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.120 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:02.120 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628659+0000", 2024-09-12T18:37:02.120 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9539999999999999e-05 2024-09-12T18:37:02.120 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.120 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.120 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.120 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628675+0000", 2024-09-12T18:37:02.120 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5739e-05 2024-09-12T18:37:02.120 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.120 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.120 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:02.120 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628815+0000", 2024-09-12T18:37:02.120 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014003299999999999 2024-09-12T18:37:02.121 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.121 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.121 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:37:02.121 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628828+0000", 2024-09-12T18:37:02.121 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2849e-05 2024-09-12T18:37:02.121 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.121 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.121 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:02.121 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651162+0000", 2024-09-12T18:37:02.121 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.022334228000000001 2024-09-12T18:37:02.121 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.121 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.121 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:02.122 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651446+0000", 2024-09-12T18:37:02.122 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00028392800000000002 2024-09-12T18:37:02.122 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.122 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.122 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:02.122 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651746+0000", 2024-09-12T18:37:02.122 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000300091 2024-09-12T18:37:02.122 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.122 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.122 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:02.122 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.665113+0000", 2024-09-12T18:37:02.122 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013366678 2024-09-12T18:37:02.123 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.123 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.123 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:02.123 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674010+0000", 2024-09-12T18:37:02.123 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0088970520000000008 2024-09-12T18:37:02.123 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.123 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.123 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:02.123 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674104+0000", 2024-09-12T18:37:02.123 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4124999999999998e-05 2024-09-12T18:37:02.123 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.123 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.123 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:02.123 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674164+0000", 2024-09-12T18:37:02.124 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.0130999999999997e-05 2024-09-12T18:37:02.124 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:02.124 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:02.124 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:02.124 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.124 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.124 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:26 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:02.124 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:37:02.124 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 96.451490949000004, 2024-09-12T18:37:02.124 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045702136999999997, 2024-09-12T18:37:02.124 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:02.124 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:02.124 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:02.125 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:02.125 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.125 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:02.125 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:37:02.125 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:02.125 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.125 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.125 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:02.125 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:37:02.125 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:02.125 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.125 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.125 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:02.125 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628699+0000", 2024-09-12T18:37:02.126 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3859999999999999e-06 2024-09-12T18:37:02.126 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.126 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.126 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:02.126 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628706+0000", 2024-09-12T18:37:02.126 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0169999999999999e-06 2024-09-12T18:37:02.126 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.126 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.126 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:02.126 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628725+0000", 2024-09-12T18:37:02.126 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8683000000000001e-05 2024-09-12T18:37:02.126 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.126 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.127 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.127 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628740+0000", 2024-09-12T18:37:02.127 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5413999999999998e-05 2024-09-12T18:37:02.127 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.127 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.127 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:02.127 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628907+0000", 2024-09-12T18:37:02.127 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00016670199999999999 2024-09-12T18:37:02.127 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.127 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.127 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:37:02.127 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628917+0000", 2024-09-12T18:37:02.128 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.046e-05 2024-09-12T18:37:02.128 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.128 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.128 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:02.128 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.660390+0000", 2024-09-12T18:37:02.128 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.031472364000000003 2024-09-12T18:37:02.128 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.128 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.128 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:02.128 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.661767+0000", 2024-09-12T18:37:02.128 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0013769190000000001 2024-09-12T18:37:02.128 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.128 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.129 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:02.129 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.662408+0000", 2024-09-12T18:37:02.129 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00064091099999999998 2024-09-12T18:37:02.129 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.129 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.129 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:02.129 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669577+0000", 2024-09-12T18:37:02.129 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.007169412 2024-09-12T18:37:02.129 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.129 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.129 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:02.129 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674244+0000", 2024-09-12T18:37:02.129 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0046671839999999996 2024-09-12T18:37:02.130 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.130 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.130 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:02.130 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674329+0000", 2024-09-12T18:37:02.130 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5276000000000001e-05 2024-09-12T18:37:02.130 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.130 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.130 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:02.130 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674400+0000", 2024-09-12T18:37:02.130 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0408999999999996e-05 2024-09-12T18:37:02.130 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:02.130 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:02.130 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:02.130 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.130 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.131 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:02.131 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:37:02.131 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 96.451383280000002, 2024-09-12T18:37:02.131 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.044572443000000003, 2024-09-12T18:37:02.131 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:02.131 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:02.131 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:02.131 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:02.131 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.131 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:02.131 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:37:02.131 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:02.131 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.132 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.132 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:02.132 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628805+0000", 2024-09-12T18:37:02.132 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:02.132 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.132 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.132 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:02.132 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628807+0000", 2024-09-12T18:37:02.132 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3629999999999999e-06 2024-09-12T18:37:02.132 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.132 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.132 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:02.132 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628814+0000", 2024-09-12T18:37:02.133 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.2099999999999996e-06 2024-09-12T18:37:02.133 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.133 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.133 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:02.133 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628832+0000", 2024-09-12T18:37:02.133 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7972999999999999e-05 2024-09-12T18:37:02.133 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.133 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.133 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.133 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628854+0000", 2024-09-12T18:37:02.133 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1857000000000001e-05 2024-09-12T18:37:02.133 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.133 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.134 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:02.134 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628984+0000", 2024-09-12T18:37:02.134 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013013599999999999 2024-09-12T18:37:02.134 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.134 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.134 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:37:02.134 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628993+0000", 2024-09-12T18:37:02.134 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:37:02.134 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.134 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.134 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:02.134 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668176+0000", 2024-09-12T18:37:02.134 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.039182211000000002 2024-09-12T18:37:02.134 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.135 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.135 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:02.135 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668481+0000", 2024-09-12T18:37:02.135 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00030499200000000002 2024-09-12T18:37:02.135 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.135 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.135 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:02.135 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.668771+0000", 2024-09-12T18:37:02.135 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00029018700000000002 2024-09-12T18:37:02.135 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.135 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.135 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:02.136 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.672674+0000", 2024-09-12T18:37:02.136 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0039031890000000001 2024-09-12T18:37:02.136 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.136 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.136 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:02.136 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673214+0000", 2024-09-12T18:37:02.136 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00053981600000000004 2024-09-12T18:37:02.136 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.136 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.136 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:02.136 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673310+0000", 2024-09-12T18:37:02.136 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.6682999999999996e-05 2024-09-12T18:37:02.137 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.137 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.137 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:02.137 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.673378+0000", 2024-09-12T18:37:02.137 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7385999999999995e-05 2024-09-12T18:37:02.137 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:02.137 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:02.137 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:02.137 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.137 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.137 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:02.137 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:37:02.137 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 96.451247253999995, 2024-09-12T18:37:02.138 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.041480853999999998, 2024-09-12T18:37:02.138 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:02.138 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:02.138 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:02.138 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:02.138 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.138 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:02.138 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:37:02.138 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:02.138 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.138 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.138 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:02.138 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628941+0000", 2024-09-12T18:37:02.139 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:02.139 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.139 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.139 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:02.139 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628943+0000", 2024-09-12T18:37:02.139 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.403e-06 2024-09-12T18:37:02.139 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.139 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.139 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:02.139 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628953+0000", 2024-09-12T18:37:02.139 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0273e-05 2024-09-12T18:37:02.139 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.139 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.139 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:02.140 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628973+0000", 2024-09-12T18:37:02.140 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9959999999999999e-05 2024-09-12T18:37:02.140 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.140 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.140 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.140 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628989+0000", 2024-09-12T18:37:02.140 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6447e-05 2024-09-12T18:37:02.140 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.140 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.140 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:02.140 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629144+0000", 2024-09-12T18:37:02.140 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015468900000000001 2024-09-12T18:37:02.140 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.141 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.141 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:37:02.141 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629162+0000", 2024-09-12T18:37:02.141 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7603000000000001e-05 2024-09-12T18:37:02.141 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.141 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.141 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:02.141 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.646927+0000", 2024-09-12T18:37:02.141 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.017765626 2024-09-12T18:37:02.141 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.141 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.141 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:02.141 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.647245+0000", 2024-09-12T18:37:02.141 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00031797699999999999 2024-09-12T18:37:02.142 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.142 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.142 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:02.142 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.647551+0000", 2024-09-12T18:37:02.142 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00030583500000000002 2024-09-12T18:37:02.142 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.142 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.142 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:02.142 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.651738+0000", 2024-09-12T18:37:02.142 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0041864980000000003 2024-09-12T18:37:02.142 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.142 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.142 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:02.142 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670207+0000", 2024-09-12T18:37:02.143 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018469299000000002 2024-09-12T18:37:02.143 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.143 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.143 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:02.143 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670330+0000", 2024-09-12T18:37:02.143 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012284500000000001 2024-09-12T18:37:02.143 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.143 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.143 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:02.143 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670422+0000", 2024-09-12T18:37:02.143 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2398999999999994e-05 2024-09-12T18:37:02.143 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:02.143 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:02.143 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:02.144 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.144 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.144 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:02.144 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:37:02.144 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 96.451170000999994, 2024-09-12T18:37:02.144 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.041623741999999998, 2024-09-12T18:37:02.144 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:02.144 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:02.144 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:02.144 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:02.144 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.144 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:02.144 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:37:02.144 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:02.145 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.145 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.145 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:02.145 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629019+0000", 2024-09-12T18:37:02.145 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:02.145 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.145 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.145 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:02.145 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629020+0000", 2024-09-12T18:37:02.145 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.15e-06 2024-09-12T18:37:02.145 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.145 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.145 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:02.145 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629023+0000", 2024-09-12T18:37:02.146 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4659999999999999e-06 2024-09-12T18:37:02.146 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.146 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.146 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:02.146 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629037+0000", 2024-09-12T18:37:02.146 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3857e-05 2024-09-12T18:37:02.146 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.146 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.146 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.146 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629062+0000", 2024-09-12T18:37:02.146 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4519999999999999e-05 2024-09-12T18:37:02.146 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.146 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.146 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:02.147 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629253+0000", 2024-09-12T18:37:02.147 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000191335 2024-09-12T18:37:02.147 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.147 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.147 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:37:02.147 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629266+0000", 2024-09-12T18:37:02.147 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3322999999999999e-05 2024-09-12T18:37:02.147 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.147 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.147 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:02.147 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648331+0000", 2024-09-12T18:37:02.147 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.019065060000000002 2024-09-12T18:37:02.147 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.148 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.148 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:02.148 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.650044+0000", 2024-09-12T18:37:02.148 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017123959999999999 2024-09-12T18:37:02.148 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.148 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.148 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:02.148 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.670642+0000", 2024-09-12T18:37:02.148 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.020598635000000001 2024-09-12T18:37:02.148 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:02.148 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:02.148 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:02.149 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.149 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.149 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:02.149 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:37:02.149 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 96.451066668999999, 2024-09-12T18:37:02.149 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.046431252999999999, 2024-09-12T18:37:02.149 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:02.149 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:02.149 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:02.149 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:02.149 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.149 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:02.149 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:37:02.149 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:02.150 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.150 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.150 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:02.150 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:37:02.150 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:02.150 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.150 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.150 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:02.150 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629123+0000", 2024-09-12T18:37:02.150 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0899999999999999e-06 2024-09-12T18:37:02.150 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.150 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.151 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:02.151 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629138+0000", 2024-09-12T18:37:02.151 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4977000000000001e-05 2024-09-12T18:37:02.151 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.151 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.151 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:02.151 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629149+0000", 2024-09-12T18:37:02.151 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1182999999999999e-05 2024-09-12T18:37:02.151 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.151 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.151 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.151 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629157+0000", 2024-09-12T18:37:02.151 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8129999999999996e-06 2024-09-12T18:37:02.151 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.152 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.152 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:02.152 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629223+0000", 2024-09-12T18:37:02.152 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6463000000000004e-05 2024-09-12T18:37:02.152 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.152 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.152 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:37:02.152 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629230+0000", 2024-09-12T18:37:02.152 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1360000000000002e-06 2024-09-12T18:37:02.152 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.152 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.152 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:02.152 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669605+0000", 2024-09-12T18:37:02.153 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.040375518999999999 2024-09-12T18:37:02.153 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.153 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.153 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:02.153 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669840+0000", 2024-09-12T18:37:02.153 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00023520099999999999 2024-09-12T18:37:02.153 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.153 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.153 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:02.153 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.675553+0000", 2024-09-12T18:37:02.153 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0057128709999999996 2024-09-12T18:37:02.153 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:02.153 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:02.153 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:02.154 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.154 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.154 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:02.154 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:37:02.154 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 96.451012001999999, 2024-09-12T18:37:02.154 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.037357044999999998, 2024-09-12T18:37:02.154 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:02.154 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:02.154 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:02.154 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:02.154 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.154 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:02.154 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:37:02.154 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:02.155 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.155 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.155 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:02.155 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629177+0000", 2024-09-12T18:37:02.155 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:02.155 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.155 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.155 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:02.155 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629178+0000", 2024-09-12T18:37:02.155 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.08e-06 2024-09-12T18:37:02.155 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.155 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.155 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:02.156 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629194+0000", 2024-09-12T18:37:02.156 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5899000000000001e-05 2024-09-12T18:37:02.156 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.156 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.156 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:02.156 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629211+0000", 2024-09-12T18:37:02.156 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7363e-05 2024-09-12T18:37:02.156 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.156 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.156 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.156 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629226+0000", 2024-09-12T18:37:02.156 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4567e-05 2024-09-12T18:37:02.156 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.157 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.157 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:02.157 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629299+0000", 2024-09-12T18:37:02.157 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3910000000000002e-05 2024-09-12T18:37:02.157 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.157 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.157 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op must wait for map", 2024-09-12T18:37:02.157 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629307+0000", 2024-09-12T18:37:02.157 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5299999999999999e-06 2024-09-12T18:37:02.157 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.157 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.157 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:02.157 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.648185+0000", 2024-09-12T18:37:02.157 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.018878533999999999 2024-09-12T18:37:02.158 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.158 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.158 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:02.158 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.649724+0000", 2024-09-12T18:37:02.158 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001538841 2024-09-12T18:37:02.158 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.158 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.158 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:02.158 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.666534+0000", 2024-09-12T18:37:02.158 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.016809320999999999 2024-09-12T18:37:02.158 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:02.158 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:02.158 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:02.158 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.159 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.159 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:80967 5.a 5:5f4000f6:::benchmark_data_smithi073_23739_object80966:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T18:37:02.159 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:18.561016+0000", 2024-09-12T18:37:02.159 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 43.519172406999999, 2024-09-12T18:37:02.159 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021780831, 2024-09-12T18:37:02.159 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:02.159 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:02.159 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:02.159 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:02.159 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:02.159 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:02.159 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 80967 2024-09-12T18:37:02.160 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.160 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:02.160 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.160 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:02.160 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561016+0000", 2024-09-12T18:37:02.160 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:02.160 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.160 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.160 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:02.160 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561016+0000", 2024-09-12T18:37:02.160 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:02.160 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.160 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.160 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:02.161 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561017+0000", 2024-09-12T18:37:02.161 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7599999999999997e-07 2024-09-12T18:37:02.161 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.161 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.161 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:02.161 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561050+0000", 2024-09-12T18:37:02.161 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3524e-05 2024-09-12T18:37:02.161 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.161 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.161 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:02.161 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561058+0000", 2024-09-12T18:37:02.161 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0679999999999997e-06 2024-09-12T18:37:02.162 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.162 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.162 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.162 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.561065+0000", 2024-09-12T18:37:02.162 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1990000000000003e-06 2024-09-12T18:37:02.162 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.162 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.162 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:02.162 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564735+0000", 2024-09-12T18:37:02.162 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0036706740000000001 2024-09-12T18:37:02.162 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.162 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.162 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:02.163 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.564868+0000", 2024-09-12T18:37:02.163 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000133003 2024-09-12T18:37:02.163 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.163 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.163 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:02.163 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.565010+0000", 2024-09-12T18:37:02.163 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014224300000000001 2024-09-12T18:37:02.163 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.163 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.163 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:02.163 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.569871+0000", 2024-09-12T18:37:02.163 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0048600759999999996 2024-09-12T18:37:02.163 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.164 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.164 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:02.164 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.582729+0000", 2024-09-12T18:37:02.164 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012858090000000001 2024-09-12T18:37:02.164 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.164 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.164 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:02.164 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.582758+0000", 2024-09-12T18:37:02.164 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.9762999999999999e-05 2024-09-12T18:37:02.164 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.164 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.164 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:02.164 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:18.582797+0000", 2024-09-12T18:37:02.165 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8615000000000002e-05 2024-09-12T18:37:02.165 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:02.165 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:02.165 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:02.165 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.165 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.165 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:108511 5.6 5:608a30a3:::benchmark_data_smithi073_23739_object108510:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:37:02.165 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:31.986730+0000", 2024-09-12T18:37:02.165 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 30.093458533, 2024-09-12T18:37:02.165 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021507117999999999, 2024-09-12T18:37:02.165 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:02.165 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:02.165 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:02.166 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:02.166 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:02.166 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:02.166 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 108511 2024-09-12T18:37:02.166 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.166 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:02.166 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.166 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:02.166 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986730+0000", 2024-09-12T18:37:02.166 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:02.166 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.166 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.166 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:02.167 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986730+0000", 2024-09-12T18:37:02.167 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:02.167 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.167 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.167 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:02.167 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986731+0000", 2024-09-12T18:37:02.167 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.9100000000000003e-07 2024-09-12T18:37:02.167 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.167 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.167 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:02.167 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986804+0000", 2024-09-12T18:37:02.167 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3647999999999997e-05 2024-09-12T18:37:02.167 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.168 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.168 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:02.168 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986812+0000", 2024-09-12T18:37:02.168 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.34e-06 2024-09-12T18:37:02.168 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.168 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.168 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.168 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.986836+0000", 2024-09-12T18:37:02.168 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4213e-05 2024-09-12T18:37:02.168 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.168 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.168 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:02.168 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.997047+0000", 2024-09-12T18:37:02.169 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.010210649 2024-09-12T18:37:02.169 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.169 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.169 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:02.169 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.997169+0000", 2024-09-12T18:37:02.169 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012269700000000001 2024-09-12T18:37:02.169 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.169 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.169 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:02.169 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:31.997300+0000", 2024-09-12T18:37:02.169 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000130858 2024-09-12T18:37:02.169 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.170 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.170 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:02.170 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.002398+0000", 2024-09-12T18:37:02.170 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0050981580000000002 2024-09-12T18:37:02.170 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.170 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.170 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:02.170 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.008093+0000", 2024-09-12T18:37:02.170 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0056941930000000002 2024-09-12T18:37:02.170 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.170 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.170 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:02.170 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.008151+0000", 2024-09-12T18:37:02.171 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8328999999999997e-05 2024-09-12T18:37:02.171 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.171 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.171 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:02.171 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:32.008237+0000", 2024-09-12T18:37:02.171 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6341999999999994e-05 2024-09-12T18:37:02.171 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:02.171 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:02.171 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:02.171 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.171 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.171 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:121033 5.0 e50/49 5:0b3817c1:::benchmark_data_smithi073_23739_object121032:head v 50'7620, mlcod=0'0)", 2024-09-12T18:37:02.172 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:40.165057+0000", 2024-09-12T18:37:02.172 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 21.915132034999999, 2024-09-12T18:37:02.172 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.030641286, 2024-09-12T18:37:02.172 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:02.172 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:02.172 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:02.172 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:02.172 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.172 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:02.172 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.165057+0000", 2024-09-12T18:37:02.172 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:02.172 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.173 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.173 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:02.173 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.165057+0000", 2024-09-12T18:37:02.173 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:02.173 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.173 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.173 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:02.173 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.165057+0000", 2024-09-12T18:37:02.173 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8599999999999998e-07 2024-09-12T18:37:02.173 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.173 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.173 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:02.174 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.165109+0000", 2024-09-12T18:37:02.174 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2086000000000002e-05 2024-09-12T18:37:02.174 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.174 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.174 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:02.174 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.165161+0000", 2024-09-12T18:37:02.174 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1415000000000002e-05 2024-09-12T18:37:02.174 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.174 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.174 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.174 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.165178+0000", 2024-09-12T18:37:02.175 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7790000000000001e-05 2024-09-12T18:37:02.175 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.175 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.175 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:02.175 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.168784+0000", 2024-09-12T18:37:02.175 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0036052050000000002 2024-09-12T18:37:02.175 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.175 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.175 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:02.175 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.168854+0000", 2024-09-12T18:37:02.175 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0814000000000003e-05 2024-09-12T18:37:02.175 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.175 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.176 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:02.176 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.195600+0000", 2024-09-12T18:37:02.176 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.026745173000000001 2024-09-12T18:37:02.176 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.176 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.176 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:02.176 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.195698+0000", 2024-09-12T18:37:02.176 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.8317000000000001e-05 2024-09-12T18:37:02.176 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:02.176 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:02.176 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:02.176 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.177 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.177 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:121044 5.1 e50/49 5:83bf711a:::benchmark_data_smithi073_23739_object121043:head v 50'7532, mlcod=0'0)", 2024-09-12T18:37:02.177 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:40.200337+0000", 2024-09-12T18:37:02.177 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 21.879852033999999, 2024-09-12T18:37:02.177 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.023483312999999999, 2024-09-12T18:37:02.177 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:02.177 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:02.177 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:02.177 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:02.177 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.177 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:02.178 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200337+0000", 2024-09-12T18:37:02.178 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:02.178 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.178 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.178 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:02.178 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200337+0000", 2024-09-12T18:37:02.178 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:02.178 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.178 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.178 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:02.178 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200338+0000", 2024-09-12T18:37:02.178 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.877e-06 2024-09-12T18:37:02.178 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.179 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.179 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:02.179 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200558+0000", 2024-09-12T18:37:02.179 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00021912799999999999 2024-09-12T18:37:02.179 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.179 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.179 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:02.179 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200584+0000", 2024-09-12T18:37:02.179 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.6333e-05 2024-09-12T18:37:02.179 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.179 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.179 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.179 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200602+0000", 2024-09-12T18:37:02.180 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.853e-05 2024-09-12T18:37:02.180 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.180 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.180 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:02.180 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200753+0000", 2024-09-12T18:37:02.180 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015061299999999999 2024-09-12T18:37:02.180 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.180 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.180 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:02.180 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.200790+0000", 2024-09-12T18:37:02.180 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.7398999999999999e-05 2024-09-12T18:37:02.180 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.180 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.181 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:02.181 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.223743+0000", 2024-09-12T18:37:02.181 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.022952455 2024-09-12T18:37:02.181 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.181 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.181 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:02.181 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.223820+0000", 2024-09-12T18:37:02.181 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6977999999999994e-05 2024-09-12T18:37:02.181 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:02.181 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:02.181 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:02.181 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.181 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.181 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:121110 5.2 e50/21 5:4dc37b93:::benchmark_data_smithi073_23739_object121109:head v 50'7513, mlcod=48'7511)", 2024-09-12T18:37:02.182 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:40.241103+0000", 2024-09-12T18:37:02.182 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 21.839085993000001, 2024-09-12T18:37:02.182 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021833894, 2024-09-12T18:37:02.182 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:02.182 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:02.182 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:02.182 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:02.182 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.182 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:02.182 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241103+0000", 2024-09-12T18:37:02.182 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:02.182 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.183 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.183 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:02.183 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241103+0000", 2024-09-12T18:37:02.183 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:02.183 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.183 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.183 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:02.183 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241104+0000", 2024-09-12T18:37:02.183 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.7999999999999993e-07 2024-09-12T18:37:02.183 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.183 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.183 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:02.183 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241162+0000", 2024-09-12T18:37:02.184 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8319000000000002e-05 2024-09-12T18:37:02.184 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.184 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.184 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:02.184 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241181+0000", 2024-09-12T18:37:02.184 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9055999999999998e-05 2024-09-12T18:37:02.184 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.184 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.184 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.184 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241191+0000", 2024-09-12T18:37:02.184 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.9359999999999994e-06 2024-09-12T18:37:02.184 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.184 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.185 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:02.185 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241305+0000", 2024-09-12T18:37:02.185 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000114134 2024-09-12T18:37:02.185 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.185 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.185 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:02.185 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.241372+0000", 2024-09-12T18:37:02.185 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6521999999999998e-05 2024-09-12T18:37:02.185 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.185 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.185 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:02.185 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.262837+0000", 2024-09-12T18:37:02.185 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021465766000000001 2024-09-12T18:37:02.186 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.186 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.186 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:02.186 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:40.262937+0000", 2024-09-12T18:37:02.186 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.9180999999999998e-05 2024-09-12T18:37:02.186 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:02.186 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:02.186 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:02.186 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.186 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.186 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:131544 5.6 5:6ce76cfc:::benchmark_data_smithi073_23739_object131543:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:37:02.186 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:45.497129+0000", 2024-09-12T18:37:02.186 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 16.583059481999999, 2024-09-12T18:37:02.186 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.02367524, 2024-09-12T18:37:02.187 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:02.187 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:02.187 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:02.187 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:02.187 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:02.187 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:02.187 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 131544 2024-09-12T18:37:02.187 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.187 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:02.187 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.187 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:02.187 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497129+0000", 2024-09-12T18:37:02.187 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:02.187 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.187 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.188 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:02.188 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497129+0000", 2024-09-12T18:37:02.188 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:02.188 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.188 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.188 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:02.188 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497130+0000", 2024-09-12T18:37:02.188 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1620000000000001e-06 2024-09-12T18:37:02.188 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.188 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.188 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:02.188 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497205+0000", 2024-09-12T18:37:02.188 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4707000000000001e-05 2024-09-12T18:37:02.189 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.189 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.189 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:02.189 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497216+0000", 2024-09-12T18:37:02.189 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1362999999999999e-05 2024-09-12T18:37:02.189 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.189 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.189 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.189 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497225+0000", 2024-09-12T18:37:02.189 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7050000000000005e-06 2024-09-12T18:37:02.189 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.189 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.189 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:02.189 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.498575+0000", 2024-09-12T18:37:02.190 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0013500319999999999 2024-09-12T18:37:02.190 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.190 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.190 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:02.190 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.498712+0000", 2024-09-12T18:37:02.190 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013682200000000001 2024-09-12T18:37:02.190 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.190 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.190 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:02.190 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.498954+0000", 2024-09-12T18:37:02.190 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00024196499999999999 2024-09-12T18:37:02.190 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.190 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.191 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:02.191 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.503854+0000", 2024-09-12T18:37:02.191 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0049002020000000002 2024-09-12T18:37:02.191 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.191 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.191 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:02.191 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.520739+0000", 2024-09-12T18:37:02.191 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.016884698 2024-09-12T18:37:02.191 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.191 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.191 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:02.191 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.520775+0000", 2024-09-12T18:37:02.191 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.5941e-05 2024-09-12T18:37:02.191 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.192 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.192 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:02.192 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.520804+0000", 2024-09-12T18:37:02.192 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.9643000000000001e-05 2024-09-12T18:37:02.192 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:02.192 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:02.192 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:02.192 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.192 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.192 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:131545 5.6 5:6da49e54:::benchmark_data_smithi073_23739_object131544:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:37:02.192 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:45.497399+0000", 2024-09-12T18:37:02.192 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 16.582789862999999, 2024-09-12T18:37:02.193 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.032319729999999998, 2024-09-12T18:37:02.193 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:02.193 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:02.193 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:02.193 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:02.193 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:02.193 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:02.193 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 131545 2024-09-12T18:37:02.193 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.193 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:02.193 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.193 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:02.193 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497399+0000", 2024-09-12T18:37:02.194 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:02.194 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.194 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.194 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:02.194 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497399+0000", 2024-09-12T18:37:02.194 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:02.194 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.194 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.194 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:02.194 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497400+0000", 2024-09-12T18:37:02.194 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.7900000000000007e-07 2024-09-12T18:37:02.194 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.194 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.195 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:02.195 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497500+0000", 2024-09-12T18:37:02.195 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00010021799999999999 2024-09-12T18:37:02.195 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.195 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.195 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:02.195 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497509+0000", 2024-09-12T18:37:02.195 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.9299999999999992e-06 2024-09-12T18:37:02.195 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.195 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.195 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.195 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.497513+0000", 2024-09-12T18:37:02.195 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4129999999999999e-06 2024-09-12T18:37:02.195 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.196 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.196 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:02.196 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.501900+0000", 2024-09-12T18:37:02.196 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0043864730000000001 2024-09-12T18:37:02.196 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.196 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.196 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:02.196 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.502054+0000", 2024-09-12T18:37:02.196 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015438299999999999 2024-09-12T18:37:02.196 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.196 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.196 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:02.197 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.502147+0000", 2024-09-12T18:37:02.197 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.3187000000000001e-05 2024-09-12T18:37:02.197 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.197 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.197 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:02.197 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.504510+0000", 2024-09-12T18:37:02.197 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0023626509999999999 2024-09-12T18:37:02.197 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.197 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.197 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:02.197 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.529615+0000", 2024-09-12T18:37:02.197 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.025104688999999999 2024-09-12T18:37:02.197 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.198 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.198 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:02.198 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.529673+0000", 2024-09-12T18:37:02.198 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8451e-05 2024-09-12T18:37:02.198 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.198 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.198 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:02.198 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.529718+0000", 2024-09-12T18:37:02.198 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5355999999999997e-05 2024-09-12T18:37:02.198 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:02.198 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:02.198 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:02.198 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.198 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.198 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:131550 5.3 5:c5ee897a:::benchmark_data_smithi073_23739_object131549:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:37:02.198 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:45.499088+0000", 2024-09-12T18:37:02.199 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 16.581100452000001, 2024-09-12T18:37:02.199 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021584709000000001, 2024-09-12T18:37:02.199 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:02.199 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:02.199 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:02.199 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:02.199 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:02.199 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:02.199 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 131550 2024-09-12T18:37:02.199 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.199 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:02.199 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.199 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:02.199 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499088+0000", 2024-09-12T18:37:02.199 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:02.200 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.200 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.200 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:02.200 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499088+0000", 2024-09-12T18:37:02.200 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:02.200 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.200 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.200 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:02.200 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499089+0000", 2024-09-12T18:37:02.200 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.0299999999999997e-07 2024-09-12T18:37:02.200 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.200 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.200 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:02.201 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499166+0000", 2024-09-12T18:37:02.201 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.7257999999999998e-05 2024-09-12T18:37:02.201 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.201 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.201 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:02.201 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499173+0000", 2024-09-12T18:37:02.201 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1509999999999998e-06 2024-09-12T18:37:02.201 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.201 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.201 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.201 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499178+0000", 2024-09-12T18:37:02.201 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.78e-06 2024-09-12T18:37:02.201 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.201 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.202 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:02.202 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499231+0000", 2024-09-12T18:37:02.202 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2621999999999999e-05 2024-09-12T18:37:02.202 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.202 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.202 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:02.202 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499326+0000", 2024-09-12T18:37:02.202 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.5567000000000002e-05 2024-09-12T18:37:02.202 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.202 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.202 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:02.202 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499419+0000", 2024-09-12T18:37:02.202 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2417000000000006e-05 2024-09-12T18:37:02.202 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.202 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.203 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:02.203 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.503781+0000", 2024-09-12T18:37:02.203 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.004362192 2024-09-12T18:37:02.203 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.203 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.203 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:02.203 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.520606+0000", 2024-09-12T18:37:02.203 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.016824784999999998 2024-09-12T18:37:02.203 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.203 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.203 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:02.203 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.520642+0000", 2024-09-12T18:37:02.203 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.6313000000000003e-05 2024-09-12T18:37:02.203 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.203 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.204 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:02.204 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.520673+0000", 2024-09-12T18:37:02.204 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.0720999999999999e-05 2024-09-12T18:37:02.204 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:02.204 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:02.204 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:02.204 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.204 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.204 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:131552 5.3 5:cb8dda54:::benchmark_data_smithi073_23739_object131551:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:37:02.204 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:36:45.499423+0000", 2024-09-12T18:37:02.204 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 16.580765596999999, 2024-09-12T18:37:02.204 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.024733523, 2024-09-12T18:37:02.204 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:02.204 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:02.205 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:02.205 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:02.205 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:02.205 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:02.205 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 131552 2024-09-12T18:37:02.205 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.205 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:02.205 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.205 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:02.205 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499423+0000", 2024-09-12T18:37:02.205 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:02.205 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.205 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.206 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:02.206 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499423+0000", 2024-09-12T18:37:02.206 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:02.206 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.206 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.206 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:02.206 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499424+0000", 2024-09-12T18:37:02.206 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.95e-07 2024-09-12T18:37:02.206 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.206 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.206 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:02.206 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499507+0000", 2024-09-12T18:37:02.206 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.3258999999999997e-05 2024-09-12T18:37:02.207 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.207 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.207 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:02.207 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499518+0000", 2024-09-12T18:37:02.207 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.064e-05 2024-09-12T18:37:02.207 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.207 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.207 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.207 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.499525+0000", 2024-09-12T18:37:02.207 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.9709999999999998e-06 2024-09-12T18:37:02.207 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.207 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.207 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:02.208 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.501699+0000", 2024-09-12T18:37:02.208 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0021738500000000002 2024-09-12T18:37:02.208 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.208 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.208 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:02.208 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.501809+0000", 2024-09-12T18:37:02.208 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000109888 2024-09-12T18:37:02.208 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.208 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.208 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:02.208 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.501960+0000", 2024-09-12T18:37:02.208 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015157899999999999 2024-09-12T18:37:02.208 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.208 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.209 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:02.209 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.504165+0000", 2024-09-12T18:37:02.209 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.002204849 2024-09-12T18:37:02.209 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.209 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.209 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:02.209 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.524053+0000", 2024-09-12T18:37:02.209 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.019887621000000001 2024-09-12T18:37:02.209 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.209 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.209 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:02.209 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.524110+0000", 2024-09-12T18:37:02.209 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7191000000000002e-05 2024-09-12T18:37:02.210 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.210 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.210 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:02.210 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:36:45.524157+0000", 2024-09-12T18:37:02.210 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.668e-05 2024-09-12T18:37:02.210 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:02.210 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:02.210 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:02.210 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.210 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.210 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:164426 5.3 5:cab9a4bc:::benchmark_data_smithi073_23739_object32149:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:02.210 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:01.795311+0000", 2024-09-12T18:37:02.211 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.28487739099999998, 2024-09-12T18:37:02.211 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.022642068000000001, 2024-09-12T18:37:02.211 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:02.211 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:02.211 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:02.211 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:02.211 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:02.211 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:02.211 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 164426 2024-09-12T18:37:02.211 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.211 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:02.211 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.211 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:02.211 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.795311+0000", 2024-09-12T18:37:02.211 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:02.212 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.212 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.212 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:02.212 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.795311+0000", 2024-09-12T18:37:02.212 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:02.212 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.212 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.212 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:02.212 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.795312+0000", 2024-09-12T18:37:02.212 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2099999999999995e-07 2024-09-12T18:37:02.212 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.212 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.212 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:02.212 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.795316+0000", 2024-09-12T18:37:02.212 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3529999999999997e-06 2024-09-12T18:37:02.213 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.213 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.213 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:02.213 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.795327+0000", 2024-09-12T18:37:02.213 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0283e-05 2024-09-12T18:37:02.213 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.213 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.213 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.213 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.795334+0000", 2024-09-12T18:37:02.213 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.9469999999999997e-06 2024-09-12T18:37:02.213 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.213 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.213 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:02.213 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.795572+0000", 2024-09-12T18:37:02.214 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00023829499999999999 2024-09-12T18:37:02.214 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.214 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.214 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:02.214 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.795699+0000", 2024-09-12T18:37:02.214 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012700100000000001 2024-09-12T18:37:02.214 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.214 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.214 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:02.214 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.795804+0000", 2024-09-12T18:37:02.214 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000105054 2024-09-12T18:37:02.214 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.214 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.215 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:02.215 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.800653+0000", 2024-09-12T18:37:02.215 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0048492839999999997 2024-09-12T18:37:02.215 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.215 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.215 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:02.215 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.817852+0000", 2024-09-12T18:37:02.215 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0171982 2024-09-12T18:37:02.215 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.215 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.215 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:02.215 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.817902+0000", 2024-09-12T18:37:02.215 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0541000000000003e-05 2024-09-12T18:37:02.215 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.216 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.216 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:02.216 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.817953+0000", 2024-09-12T18:37:02.216 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1189000000000001e-05 2024-09-12T18:37:02.216 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:02.216 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:02.216 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:02.216 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.216 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.216 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:164647 5.3 5:c4dc4f1a:::benchmark_data_smithi073_23739_object32370:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:02.216 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:01.906048+0000", 2024-09-12T18:37:02.216 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.174140513, 2024-09-12T18:37:02.216 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.021805660000000001, 2024-09-12T18:37:02.217 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:02.217 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:02.217 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:02.217 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:02.217 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:02.217 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:02.217 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 164647 2024-09-12T18:37:02.217 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.217 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:02.217 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.217 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:02.217 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.906048+0000", 2024-09-12T18:37:02.217 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:02.218 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.218 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.218 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:02.218 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.906048+0000", 2024-09-12T18:37:02.218 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:02.218 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.218 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.218 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:02.218 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.906049+0000", 2024-09-12T18:37:02.218 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3399999999999998e-07 2024-09-12T18:37:02.218 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.218 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.218 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:02.218 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.906052+0000", 2024-09-12T18:37:02.218 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.1599999999999998e-06 2024-09-12T18:37:02.219 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.219 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.219 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:02.219 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.906061+0000", 2024-09-12T18:37:02.219 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5269999999999998e-06 2024-09-12T18:37:02.219 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.219 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.219 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.219 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.906066+0000", 2024-09-12T18:37:02.219 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8150000000000002e-06 2024-09-12T18:37:02.219 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.219 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.219 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:02.220 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.909656+0000", 2024-09-12T18:37:02.220 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0035895440000000001 2024-09-12T18:37:02.220 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.220 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.220 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:02.220 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.909740+0000", 2024-09-12T18:37:02.220 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.3656e-05 2024-09-12T18:37:02.220 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.220 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.220 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:02.220 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.909804+0000", 2024-09-12T18:37:02.220 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4369000000000007e-05 2024-09-12T18:37:02.220 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.221 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.221 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:02.221 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.921970+0000", 2024-09-12T18:37:02.221 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012166401 2024-09-12T18:37:02.221 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.221 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.221 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:02.221 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.927759+0000", 2024-09-12T18:37:02.221 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0057888810000000001 2024-09-12T18:37:02.221 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.221 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.221 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:02.221 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.927810+0000", 2024-09-12T18:37:02.221 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0832999999999999e-05 2024-09-12T18:37:02.222 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:02.222 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:02.222 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:02.222 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:01.927854+0000", 2024-09-12T18:37:02.222 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3739999999999998e-05 2024-09-12T18:37:02.222 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:02.222 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:02.222 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:02.222 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:02.222 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:02.222 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:02.224 INFO:tasks.thrashosds.thrasher:j is {'epoch': 58, 'fsid': 'c08d5a84-711b-44bf-bdf1-e06ecc2c7c00', 'created': '2024-09-12T18:35:02.695853+0000', 'modified': '2024-09-12T18:37:00.479092+0000', 'last_up_change': '2024-09-12T18:35:12.464628+0000', 'last_in_change': '2024-09-12T18:35:04.352525+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T18:35:12.418430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-12T18:35:18.665309+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 15, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T18:35:23.447845+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.409999966621399, 'score_stable': 1.409999966621399, 'optimal_score': 1, 'raw_score_acting': 1.409999966621399, 'raw_score_stable': 1.409999966621399, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T18:35:23.959973+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.409999966621399, 'score_stable': 1.409999966621399, 'optimal_score': 1, 'raw_score_acting': 1.409999966621399, 'raw_score_stable': 1.409999966621399, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2024-09-12T18:35:43.562347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'f1cf24e8-6179-4666-a444-fa81ef0d7482', 'up': 1, 'in': 1, 'weight': 0.6371612548828125, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6800', 'nonce': 2710632206}, {'type': 'v1', 'addr': '172.21.15.114:6801', 'nonce': 2710632206}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6802', 'nonce': 2710632206}, {'type': 'v1', 'addr': '172.21.15.114:6803', 'nonce': 2710632206}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6806', 'nonce': 2710632206}, {'type': 'v1', 'addr': '172.21.15.114:6807', 'nonce': 2710632206}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6804', 'nonce': 2710632206}, {'type': 'v1', 'addr': '172.21.15.114:6805', 'nonce': 2710632206}]}, 'public_addr': '172.21.15.114:6801/2710632206', 'cluster_addr': '172.21.15.114:6803/2710632206', 'heartbeat_back_addr': '172.21.15.114:6807/2710632206', 'heartbeat_front_addr': '172.21.15.114:6805/2710632206', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '3fdb0044-2820-4411-978b-4b6e94fbf0b1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 9, 'up_thru': 49, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6800', 'nonce': 862189968}, {'type': 'v1', 'addr': '172.21.15.143:6801', 'nonce': 862189968}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6802', 'nonce': 862189968}, {'type': 'v1', 'addr': '172.21.15.143:6803', 'nonce': 862189968}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6806', 'nonce': 862189968}, {'type': 'v1', 'addr': '172.21.15.143:6807', 'nonce': 862189968}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6804', 'nonce': 862189968}, {'type': 'v1', 'addr': '172.21.15.143:6805', 'nonce': 862189968}]}, 'public_addr': '172.21.15.143:6801/862189968', 'cluster_addr': '172.21.15.143:6803/862189968', 'heartbeat_back_addr': '172.21.15.143:6807/862189968', 'heartbeat_front_addr': '172.21.15.143:6805/862189968', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '6fb554da-561f-4aa2-b855-0e3adb98b057', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 49, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6800', 'nonce': 1397104153}, {'type': 'v1', 'addr': '172.21.15.162:6801', 'nonce': 1397104153}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6802', 'nonce': 1397104153}, {'type': 'v1', 'addr': '172.21.15.162:6803', 'nonce': 1397104153}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6806', 'nonce': 1397104153}, {'type': 'v1', 'addr': '172.21.15.162:6807', 'nonce': 1397104153}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6804', 'nonce': 1397104153}, {'type': 'v1', 'addr': '172.21.15.162:6805', 'nonce': 1397104153}]}, 'public_addr': '172.21.15.162:6801/1397104153', 'cluster_addr': '172.21.15.162:6803/1397104153', 'heartbeat_back_addr': '172.21.15.162:6807/1397104153', 'heartbeat_front_addr': '172.21.15.162:6805/1397104153', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:35:10.239320+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:35:10.861760+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:35:10.355997+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [{'pgid': '5.0', 'osds': [1, 0]}, {'pgid': '5.1', 'osds': [2, 0]}, {'pgid': '5.5', 'osds': [2, 0]}], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T18:37:02.224 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-12T18:37:02.225 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:37:02.226 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:02.219+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:02.326 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:02.319+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:02.384 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:02.384 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:37:02.384 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.384 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:165658 5.a e58/21 5:5ff14f68:::benchmark_data_smithi073_23739_object33381:head v 58'10494, mlcod=58'10492)", 2024-09-12T18:37:02.384 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:02.378713+0000", 2024-09-12T18:37:02.384 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.002907228, 2024-09-12T18:37:02.385 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002928613, 2024-09-12T18:37:02.385 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:02.385 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:02.385 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:37:02.385 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:02.385 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.385 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:02.385 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.378713+0000", 2024-09-12T18:37:02.385 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.385 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.385 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.385 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:02.385 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.378713+0000", 2024-09-12T18:37:02.386 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.386 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.386 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.386 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:02.386 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.378714+0000", 2024-09-12T18:37:02.386 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.61e-07 2024-09-12T18:37:02.386 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.386 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.386 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:02.386 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.378718+0000", 2024-09-12T18:37:02.386 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2780000000000004e-06 2024-09-12T18:37:02.386 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.386 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.387 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:02.387 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.378726+0000", 2024-09-12T18:37:02.387 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5009999999999998e-06 2024-09-12T18:37:02.387 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.387 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.387 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.387 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.378733+0000", 2024-09-12T18:37:02.387 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9990000000000002e-06 2024-09-12T18:37:02.387 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.387 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.387 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:02.387 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.378800+0000", 2024-09-12T18:37:02.387 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7257999999999999e-05 2024-09-12T18:37:02.388 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.388 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.388 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:02.388 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.378819+0000", 2024-09-12T18:37:02.388 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8691000000000001e-05 2024-09-12T18:37:02.388 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.388 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:02.388 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.388 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.388 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.388 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:165666 5.b 5:df3b44f4:::benchmark_data_smithi073_23739_object33389:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:02.388 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:02.378787+0000", 2024-09-12T18:37:02.389 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.002833229, 2024-09-12T18:37:02.389 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0029121099999999999, 2024-09-12T18:37:02.389 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:02.389 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:02.389 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:02.389 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:02.389 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:02.389 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:02.389 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 165666 2024-09-12T18:37:02.389 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.389 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:02.389 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.389 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:02.389 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.378787+0000", 2024-09-12T18:37:02.390 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.390 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.390 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.390 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:02.390 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.378787+0000", 2024-09-12T18:37:02.390 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.390 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.390 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.390 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:02.390 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.378788+0000", 2024-09-12T18:37:02.390 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.1299999999999998e-07 2024-09-12T18:37:02.390 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.390 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.391 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:02.391 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.378792+0000", 2024-09-12T18:37:02.391 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2939999999999999e-06 2024-09-12T18:37:02.391 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.391 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.391 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:02.391 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.378802+0000", 2024-09-12T18:37:02.391 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.3300000000000005e-06 2024-09-12T18:37:02.391 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.391 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.391 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.391 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.378808+0000", 2024-09-12T18:37:02.391 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.545e-06 2024-09-12T18:37:02.392 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.392 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.392 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:02.392 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.378861+0000", 2024-09-12T18:37:02.392 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2680999999999999e-05 2024-09-12T18:37:02.392 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.392 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.392 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:02.392 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.378975+0000", 2024-09-12T18:37:02.392 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011400000000000001 2024-09-12T18:37:02.392 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.392 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.393 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:02.393 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.379075+0000", 2024-09-12T18:37:02.393 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000100283 2024-09-12T18:37:02.393 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.393 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.393 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:02.393 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.381564+0000", 2024-09-12T18:37:02.393 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0024887849999999999 2024-09-12T18:37:02.393 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.393 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:02.393 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.393 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.393 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.394 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:165660 5.5 e58/49 5:a1d20814:::benchmark_data_smithi073_23739_object33383:head v 58'10489, mlcod=58'10486)", 2024-09-12T18:37:02.394 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:02.378988+0000", 2024-09-12T18:37:02.394 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0026328810000000001, 2024-09-12T18:37:02.394 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0027795659999999998, 2024-09-12T18:37:02.394 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:02.394 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:02.394 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:37:02.394 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:02.394 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.394 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:02.394 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.378988+0000", 2024-09-12T18:37:02.394 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.394 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.395 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.395 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:02.395 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.378988+0000", 2024-09-12T18:37:02.395 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.395 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.395 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.395 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:02.395 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.378988+0000", 2024-09-12T18:37:02.395 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6000000000000003e-07 2024-09-12T18:37:02.395 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.395 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.395 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:02.395 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.378992+0000", 2024-09-12T18:37:02.396 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2390000000000004e-06 2024-09-12T18:37:02.396 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.396 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.396 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:02.396 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.379001+0000", 2024-09-12T18:37:02.396 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7159999999999992e-06 2024-09-12T18:37:02.396 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.396 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.396 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.396 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.379007+0000", 2024-09-12T18:37:02.396 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0100000000000001e-06 2024-09-12T18:37:02.396 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.397 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.397 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:02.397 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.379052+0000", 2024-09-12T18:37:02.397 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4616000000000001e-05 2024-09-12T18:37:02.397 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.397 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.397 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:02.397 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.379070+0000", 2024-09-12T18:37:02.397 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8413000000000001e-05 2024-09-12T18:37:02.397 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.397 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:02.397 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.397 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.398 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.398 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:165643 5.0 5:09eeec33:::benchmark_data_smithi073_23739_object33366:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:02.398 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:02.369447+0000", 2024-09-12T18:37:02.398 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.012173022, 2024-09-12T18:37:02.398 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012370723, 2024-09-12T18:37:02.398 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:02.398 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:02.398 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:02.398 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:02.398 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:02.398 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:02.398 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 165643 2024-09-12T18:37:02.398 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.399 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:02.399 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.399 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:02.399 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.369447+0000", 2024-09-12T18:37:02.399 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.399 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.399 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.399 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:02.399 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.369447+0000", 2024-09-12T18:37:02.399 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.399 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.399 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.399 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:02.400 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.369449+0000", 2024-09-12T18:37:02.400 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2929999999999999e-06 2024-09-12T18:37:02.400 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.400 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.400 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:02.400 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.369454+0000", 2024-09-12T18:37:02.400 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2639999999999999e-06 2024-09-12T18:37:02.400 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.400 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.400 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:02.400 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.369464+0000", 2024-09-12T18:37:02.400 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0189e-05 2024-09-12T18:37:02.400 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.401 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.401 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.401 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.369471+0000", 2024-09-12T18:37:02.401 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2540000000000003e-06 2024-09-12T18:37:02.401 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.401 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.401 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:02.401 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.369591+0000", 2024-09-12T18:37:02.401 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000119807 2024-09-12T18:37:02.401 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.401 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.401 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:02.401 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.369725+0000", 2024-09-12T18:37:02.402 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000133354 2024-09-12T18:37:02.402 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.402 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.402 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0,2", 2024-09-12T18:37:02.402 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.369813+0000", 2024-09-12T18:37:02.402 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8759999999999997e-05 2024-09-12T18:37:02.402 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.402 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.402 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:02.402 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.376149+0000", 2024-09-12T18:37:02.402 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063359949999999996 2024-09-12T18:37:02.402 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.402 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.403 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:02.403 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.376176+0000", 2024-09-12T18:37:02.403 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6597999999999998e-05 2024-09-12T18:37:02.403 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.403 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:02.403 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.403 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.403 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.403 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:165647 5.0 5:0e15cd41:::benchmark_data_smithi073_23739_object33370:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:02.403 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:02.371529+0000", 2024-09-12T18:37:02.403 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.010091095, 2024-09-12T18:37:02.403 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.010363252999999999, 2024-09-12T18:37:02.403 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:02.403 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:02.404 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:02.404 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:02.404 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:02.404 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:02.404 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 165647 2024-09-12T18:37:02.404 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.404 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:02.404 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.404 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:02.404 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.371529+0000", 2024-09-12T18:37:02.404 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.404 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.405 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.405 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:02.405 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.371529+0000", 2024-09-12T18:37:02.405 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.405 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.405 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.405 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:02.405 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.371531+0000", 2024-09-12T18:37:02.405 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4130000000000001e-06 2024-09-12T18:37:02.405 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.405 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.406 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:02.406 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.371535+0000", 2024-09-12T18:37:02.406 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.053e-06 2024-09-12T18:37:02.406 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.406 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.406 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:02.406 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.371544+0000", 2024-09-12T18:37:02.406 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2350000000000005e-06 2024-09-12T18:37:02.406 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.406 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.406 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.406 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.371554+0000", 2024-09-12T18:37:02.406 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8940000000000005e-06 2024-09-12T18:37:02.407 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.407 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.407 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:02.407 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.374178+0000", 2024-09-12T18:37:02.407 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0026245000000000001 2024-09-12T18:37:02.407 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.407 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.407 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:02.407 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.374314+0000", 2024-09-12T18:37:02.407 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000135377 2024-09-12T18:37:02.407 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.407 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.407 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0,2", 2024-09-12T18:37:02.408 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.374417+0000", 2024-09-12T18:37:02.408 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000102952 2024-09-12T18:37:02.408 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.408 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.408 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:02.408 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.379620+0000", 2024-09-12T18:37:02.408 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052031309999999997 2024-09-12T18:37:02.408 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.408 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.408 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:02.408 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.381103+0000", 2024-09-12T18:37:02.408 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014826939999999999 2024-09-12T18:37:02.409 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.409 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:02.409 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.409 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.409 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.409 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(client.4480.0:165655 5.0 e58/49)", 2024-09-12T18:37:02.409 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:02.381253+0000", 2024-09-12T18:37:02.409 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00036750200000000002, 2024-09-12T18:37:02.409 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00070618700000000005, 2024-09-12T18:37:02.409 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:02.409 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:02.409 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:02.409 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:02.409 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.410 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:02.410 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.381253+0000", 2024-09-12T18:37:02.410 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.410 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.410 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.410 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:02.410 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.381253+0000", 2024-09-12T18:37:02.410 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.410 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.410 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.410 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:02.410 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.381254+0000", 2024-09-12T18:37:02.410 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1900000000000002e-07 2024-09-12T18:37:02.411 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.411 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.411 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:02.411 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.381257+0000", 2024-09-12T18:37:02.411 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7799999999999998e-06 2024-09-12T18:37:02.411 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.411 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.411 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:02.411 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.381265+0000", 2024-09-12T18:37:02.411 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9689999999999994e-06 2024-09-12T18:37:02.411 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.411 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.412 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.412 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.381271+0000", 2024-09-12T18:37:02.412 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6550000000000001e-06 2024-09-12T18:37:02.412 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.412 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:02.412 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.412 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.412 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.412 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:165654 5.0 5:0eb7dab2:::benchmark_data_smithi073_23739_object33377:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:02.413 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:02.374079+0000", 2024-09-12T18:37:02.413 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0075410119999999997, 2024-09-12T18:37:02.413 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0079228030000000008, 2024-09-12T18:37:02.413 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:02.413 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:02.413 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:02.413 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:02.413 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:02.413 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:02.413 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 165654 2024-09-12T18:37:02.413 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.413 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:02.413 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.414 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:02.414 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.374079+0000", 2024-09-12T18:37:02.414 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.414 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.414 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.414 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:02.414 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.374079+0000", 2024-09-12T18:37:02.414 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.414 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.414 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.414 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:02.414 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.374080+0000", 2024-09-12T18:37:02.414 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9999999999999995e-07 2024-09-12T18:37:02.414 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.415 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.415 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:02.415 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.374087+0000", 2024-09-12T18:37:02.415 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7950000000000002e-06 2024-09-12T18:37:02.415 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.415 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.415 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:02.415 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.374098+0000", 2024-09-12T18:37:02.415 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1240000000000001e-05 2024-09-12T18:37:02.415 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.415 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.415 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.416 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.374106+0000", 2024-09-12T18:37:02.416 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2869999999999999e-06 2024-09-12T18:37:02.416 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.416 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.416 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:02.416 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.376234+0000", 2024-09-12T18:37:02.416 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002128245 2024-09-12T18:37:02.416 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.416 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.416 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:02.416 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.376333+0000", 2024-09-12T18:37:02.416 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8807000000000005e-05 2024-09-12T18:37:02.416 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.417 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.417 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0,2", 2024-09-12T18:37:02.417 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.376417+0000", 2024-09-12T18:37:02.417 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4202000000000005e-05 2024-09-12T18:37:02.417 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.417 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.417 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:02.417 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.381087+0000", 2024-09-12T18:37:02.417 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0046704820000000001 2024-09-12T18:37:02.417 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.417 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.417 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:02.417 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.381970+0000", 2024-09-12T18:37:02.418 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00088264799999999998 2024-09-12T18:37:02.418 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.418 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:02.418 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.418 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.418 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.418 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:165655 5.0 5:00601432:::benchmark_data_smithi073_23739_object33378:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:02.418 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:02.374447+0000", 2024-09-12T18:37:02.418 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0071730589999999999, 2024-09-12T18:37:02.418 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076322400000000002, 2024-09-12T18:37:02.418 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:02.418 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:02.419 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:02.419 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:02.419 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:02.419 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:02.419 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 165655 2024-09-12T18:37:02.419 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.419 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:02.419 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.419 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:02.419 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.374447+0000", 2024-09-12T18:37:02.419 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.419 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.419 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.420 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:02.420 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.374447+0000", 2024-09-12T18:37:02.420 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.420 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.420 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.420 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:02.420 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.374448+0000", 2024-09-12T18:37:02.420 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.54e-07 2024-09-12T18:37:02.420 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.420 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.420 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:02.420 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.374453+0000", 2024-09-12T18:37:02.420 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4900000000000002e-06 2024-09-12T18:37:02.421 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.421 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.421 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:02.421 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.374463+0000", 2024-09-12T18:37:02.421 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0462000000000001e-05 2024-09-12T18:37:02.421 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.421 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.421 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.421 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.374470+0000", 2024-09-12T18:37:02.421 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2359999999999998e-06 2024-09-12T18:37:02.421 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.421 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.421 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:02.421 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.378026+0000", 2024-09-12T18:37:02.422 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003555346 2024-09-12T18:37:02.422 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.422 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.422 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:02.422 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.378169+0000", 2024-09-12T18:37:02.422 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000143607 2024-09-12T18:37:02.422 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.422 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.422 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0,2", 2024-09-12T18:37:02.422 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.378264+0000", 2024-09-12T18:37:02.422 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4716000000000006e-05 2024-09-12T18:37:02.422 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.422 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.423 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:02.423 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.381987+0000", 2024-09-12T18:37:02.423 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003722955 2024-09-12T18:37:02.423 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.423 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.423 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:02.423 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.382017+0000", 2024-09-12T18:37:02.423 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0145999999999999e-05 2024-09-12T18:37:02.423 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.423 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:02.423 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.423 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.423 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.423 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:165636 5.e 5:7172ef34:::benchmark_data_smithi073_23739_object33359:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:02.424 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:02.367534+0000", 2024-09-12T18:37:02.424 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.014086250999999999, 2024-09-12T18:37:02.424 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.014622875, 2024-09-12T18:37:02.424 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:02.424 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:02.424 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:02.424 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:02.424 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:02.424 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:02.424 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 165636 2024-09-12T18:37:02.424 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.424 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:02.424 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.425 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:02.425 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.367534+0000", 2024-09-12T18:37:02.425 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.425 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.425 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.425 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:02.425 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.367534+0000", 2024-09-12T18:37:02.425 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.425 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.426 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.426 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:02.426 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.367535+0000", 2024-09-12T18:37:02.426 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5300000000000004e-07 2024-09-12T18:37:02.426 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.426 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.426 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:02.426 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.367538+0000", 2024-09-12T18:37:02.426 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9790000000000002e-06 2024-09-12T18:37:02.426 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.426 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.426 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:02.426 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.367547+0000", 2024-09-12T18:37:02.427 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.7100000000000002e-06 2024-09-12T18:37:02.427 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.427 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.427 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.427 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.367553+0000", 2024-09-12T18:37:02.427 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2179999999999998e-06 2024-09-12T18:37:02.427 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.427 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.427 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:02.427 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.369295+0000", 2024-09-12T18:37:02.427 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001742738 2024-09-12T18:37:02.428 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.428 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.428 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:02.428 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.369454+0000", 2024-09-12T18:37:02.428 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015844500000000001 2024-09-12T18:37:02.428 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.428 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.428 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:02.428 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.369566+0000", 2024-09-12T18:37:02.428 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000112138 2024-09-12T18:37:02.429 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.429 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.429 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:02.429 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.371181+0000", 2024-09-12T18:37:02.429 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016152740000000001 2024-09-12T18:37:02.429 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.429 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:02.429 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.429 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.429 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.429 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:165661 5.e 5:773c929a:::benchmark_data_smithi073_23739_object33384:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:02.429 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:02.378511+0000", 2024-09-12T18:37:02.429 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.003109054, 2024-09-12T18:37:02.429 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0037230710000000001, 2024-09-12T18:37:02.430 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:02.430 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:02.430 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:02.430 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:02.430 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:02.430 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:02.430 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 165661 2024-09-12T18:37:02.430 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.430 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:02.430 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.430 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:02.430 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.378511+0000", 2024-09-12T18:37:02.431 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.431 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.431 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.431 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:02.431 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.378511+0000", 2024-09-12T18:37:02.431 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.431 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.431 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.431 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:02.431 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.378513+0000", 2024-09-12T18:37:02.431 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.443e-06 2024-09-12T18:37:02.431 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.432 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.432 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:02.432 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.378517+0000", 2024-09-12T18:37:02.432 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2860000000000001e-06 2024-09-12T18:37:02.432 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.432 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.432 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:02.432 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.378531+0000", 2024-09-12T18:37:02.432 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.377e-05 2024-09-12T18:37:02.432 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.432 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.432 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.433 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.378539+0000", 2024-09-12T18:37:02.433 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9279999999999993e-06 2024-09-12T18:37:02.433 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.433 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.433 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:02.433 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.378598+0000", 2024-09-12T18:37:02.433 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.9389999999999999e-05 2024-09-12T18:37:02.433 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.433 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.433 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:02.433 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.378708+0000", 2024-09-12T18:37:02.433 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011027900000000001 2024-09-12T18:37:02.434 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.434 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.434 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:02.434 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.378829+0000", 2024-09-12T18:37:02.434 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012022400000000001 2024-09-12T18:37:02.434 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.434 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.434 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:02.434 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.382144+0000", 2024-09-12T18:37:02.434 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033157 2024-09-12T18:37:02.434 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.434 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:02.434 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.435 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.435 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.435 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:165662 5.e 5:788430a5:::benchmark_data_smithi073_23739_object33385:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:02.435 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:02.378643+0000", 2024-09-12T18:37:02.435 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0029776830000000001, 2024-09-12T18:37:02.435 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0036440909999999999, 2024-09-12T18:37:02.435 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:02.435 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:02.435 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:02.435 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:02.435 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:02.435 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:02.435 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 165662 2024-09-12T18:37:02.436 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.436 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:02.436 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.436 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:02.436 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.378643+0000", 2024-09-12T18:37:02.436 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.436 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.436 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.436 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:02.436 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.378643+0000", 2024-09-12T18:37:02.436 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.436 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.436 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.437 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:02.437 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.378644+0000", 2024-09-12T18:37:02.437 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5300000000000003e-07 2024-09-12T18:37:02.437 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.437 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.437 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:02.437 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.378647+0000", 2024-09-12T18:37:02.437 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.219e-06 2024-09-12T18:37:02.437 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.437 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.437 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:02.437 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.378656+0000", 2024-09-12T18:37:02.438 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8519999999999993e-06 2024-09-12T18:37:02.438 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.438 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.438 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.438 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.378661+0000", 2024-09-12T18:37:02.438 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7300000000000002e-06 2024-09-12T18:37:02.438 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.438 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.438 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:02.438 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.380634+0000", 2024-09-12T18:37:02.438 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001973177 2024-09-12T18:37:02.438 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.438 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.439 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:02.439 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.380748+0000", 2024-09-12T18:37:02.439 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000113387 2024-09-12T18:37:02.439 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.439 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.439 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:02.439 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:02.380848+0000", 2024-09-12T18:37:02.439 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000100163 2024-09-12T18:37:02.439 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.439 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:02.439 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.439 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.439 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-09-12T18:37:02.440 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 11 2024-09-12T18:37:02.440 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:02.441 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:37:02.444 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:02.433+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:02.517 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T18:37:02.542 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:02.537+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:02.642 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:02.635+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:02.648 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:02.648 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-09-12T18:37:02.648 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-09-12T18:37:02.649 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-09-12T18:37:02.649 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:02.673 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:37:02.743 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:02.739+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:02.844 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:02.837+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:02.871 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:02.872 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-09-12T18:37:02.872 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-09-12T18:37:02.872 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:37:02.872 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.872 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:02.872 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:37:02.872 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 97.235277179999997, 2024-09-12T18:37:02.872 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025088781000000001, 2024-09-12T18:37:02.872 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:02.872 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:02.872 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:02.873 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:02.873 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.873 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:02.873 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:37:02.873 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.873 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.873 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.873 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:02.873 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:37:02.873 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.873 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.873 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.873 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:02.873 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632518+0000", 2024-09-12T18:37:02.874 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:37:02.874 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.874 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.874 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:02.874 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632533+0000", 2024-09-12T18:37:02.874 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5130000000000001e-05 2024-09-12T18:37:02.874 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.874 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.874 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:02.874 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632564+0000", 2024-09-12T18:37:02.874 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0788999999999999e-05 2024-09-12T18:37:02.874 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.874 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.875 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.875 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632590+0000", 2024-09-12T18:37:02.875 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6057000000000001e-05 2024-09-12T18:37:02.875 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.875 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.875 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:02.875 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.635931+0000", 2024-09-12T18:37:02.875 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033411320000000001 2024-09-12T18:37:02.875 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.875 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.875 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:02.875 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636186+0000", 2024-09-12T18:37:02.875 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025452500000000002 2024-09-12T18:37:02.875 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.876 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.876 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:02.876 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636445+0000", 2024-09-12T18:37:02.876 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000259268 2024-09-12T18:37:02.876 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.876 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.876 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:02.876 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639562+0000", 2024-09-12T18:37:02.876 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031167 2024-09-12T18:37:02.876 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.876 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.876 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:02.876 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657314+0000", 2024-09-12T18:37:02.876 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017752562 2024-09-12T18:37:02.877 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.877 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.877 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:02.877 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657445+0000", 2024-09-12T18:37:02.877 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013105899999999999 2024-09-12T18:37:02.877 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.877 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.877 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:02.877 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657598+0000", 2024-09-12T18:37:02.877 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015247899999999999 2024-09-12T18:37:02.877 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.877 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:02.877 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.878 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.878 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.878 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:02.878 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:37:02.878 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 97.235150977000004, 2024-09-12T18:37:02.878 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025643131999999999, 2024-09-12T18:37:02.878 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:02.878 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:02.878 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:02.878 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:02.878 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.879 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:02.879 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:37:02.879 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.879 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.879 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.879 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:02.879 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:37:02.879 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.879 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.879 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.879 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:02.879 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632637+0000", 2024-09-12T18:37:02.879 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5600000000000001e-06 2024-09-12T18:37:02.880 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.880 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.880 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:02.880 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632650+0000", 2024-09-12T18:37:02.880 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3186e-05 2024-09-12T18:37:02.880 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.880 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.880 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:02.880 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632672+0000", 2024-09-12T18:37:02.880 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2013000000000001e-05 2024-09-12T18:37:02.880 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.880 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.880 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.880 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632687+0000", 2024-09-12T18:37:02.881 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5109999999999999e-05 2024-09-12T18:37:02.881 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.881 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.881 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:02.881 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636994+0000", 2024-09-12T18:37:02.881 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0043065539999999998 2024-09-12T18:37:02.881 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.881 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.881 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:02.881 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637198+0000", 2024-09-12T18:37:02.882 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020387199999999999 2024-09-12T18:37:02.882 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.882 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.882 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:02.882 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637475+0000", 2024-09-12T18:37:02.882 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027731000000000001 2024-09-12T18:37:02.882 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.882 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.882 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:02.882 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639574+0000", 2024-09-12T18:37:02.882 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020988999999999999 2024-09-12T18:37:02.882 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.882 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.882 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:02.883 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658057+0000", 2024-09-12T18:37:02.883 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018482926 2024-09-12T18:37:02.883 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.883 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.883 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:02.883 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658184+0000", 2024-09-12T18:37:02.883 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012756200000000001 2024-09-12T18:37:02.883 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.883 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.883 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:02.883 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658278+0000", 2024-09-12T18:37:02.883 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4139000000000001e-05 2024-09-12T18:37:02.883 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.883 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:02.884 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.884 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.884 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.884 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:02.884 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:37:02.884 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 97.235075885000001, 2024-09-12T18:37:02.884 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025238883, 2024-09-12T18:37:02.884 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:02.884 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:02.884 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:02.884 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:02.884 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.884 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:02.885 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:37:02.885 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.885 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.885 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.885 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:02.885 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:37:02.885 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.885 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.885 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.885 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:02.885 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632712+0000", 2024-09-12T18:37:02.885 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6869999999999999e-06 2024-09-12T18:37:02.885 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.885 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.886 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:02.886 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632719+0000", 2024-09-12T18:37:02.886 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6059999999999999e-06 2024-09-12T18:37:02.886 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.886 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.886 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:02.886 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632737+0000", 2024-09-12T18:37:02.886 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7983999999999999e-05 2024-09-12T18:37:02.886 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.886 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.886 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.886 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632751+0000", 2024-09-12T18:37:02.886 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4473e-05 2024-09-12T18:37:02.886 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.887 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.887 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:02.887 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636961+0000", 2024-09-12T18:37:02.887 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042100840000000002 2024-09-12T18:37:02.887 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.887 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.887 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:02.887 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637211+0000", 2024-09-12T18:37:02.887 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000249738 2024-09-12T18:37:02.887 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.887 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.887 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:02.887 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637504+0000", 2024-09-12T18:37:02.887 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00029271499999999998 2024-09-12T18:37:02.888 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.888 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.888 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:02.888 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639582+0000", 2024-09-12T18:37:02.888 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020783389999999998 2024-09-12T18:37:02.888 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.888 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.888 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:02.888 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657709+0000", 2024-09-12T18:37:02.888 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018126758999999999 2024-09-12T18:37:02.888 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.888 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.888 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:02.889 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657830+0000", 2024-09-12T18:37:02.889 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000121329 2024-09-12T18:37:02.889 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.889 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.889 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:02.889 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657949+0000", 2024-09-12T18:37:02.889 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000119169 2024-09-12T18:37:02.889 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.889 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:02.889 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.889 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.889 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.889 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:02.889 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:37:02.890 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 97.235011838999995, 2024-09-12T18:37:02.890 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026711823999999999, 2024-09-12T18:37:02.890 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:02.890 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:02.890 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:02.890 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:02.890 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.890 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:02.890 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:37:02.890 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.890 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.890 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.890 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:02.890 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:37:02.891 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.891 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.891 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.891 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:02.891 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632775+0000", 2024-09-12T18:37:02.891 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9999999999999995e-07 2024-09-12T18:37:02.891 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.891 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.891 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:02.891 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632788+0000", 2024-09-12T18:37:02.891 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2629999999999999e-05 2024-09-12T18:37:02.892 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.892 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.892 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:02.892 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632806+0000", 2024-09-12T18:37:02.892 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:37:02.892 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.892 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.892 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.892 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632820+0000", 2024-09-12T18:37:02.892 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3777e-05 2024-09-12T18:37:02.892 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.892 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.893 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:02.893 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638310+0000", 2024-09-12T18:37:02.893 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054898280000000004 2024-09-12T18:37:02.893 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.893 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.893 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:02.893 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638480+0000", 2024-09-12T18:37:02.893 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016968199999999999 2024-09-12T18:37:02.893 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.893 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.893 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:02.893 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638799+0000", 2024-09-12T18:37:02.893 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031915999999999997 2024-09-12T18:37:02.893 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.894 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.894 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:02.894 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639866+0000", 2024-09-12T18:37:02.894 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001067405 2024-09-12T18:37:02.894 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.894 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.894 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:02.894 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658398+0000", 2024-09-12T18:37:02.894 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018531542000000002 2024-09-12T18:37:02.894 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.894 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.894 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:02.894 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658643+0000", 2024-09-12T18:37:02.894 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00024531500000000002 2024-09-12T18:37:02.895 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.895 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.895 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:02.895 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.659486+0000", 2024-09-12T18:37:02.895 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00084316899999999995 2024-09-12T18:37:02.895 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.895 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:02.895 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.895 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.895 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.895 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:02.895 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:37:02.896 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 97.234703085000007, 2024-09-12T18:37:02.896 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026938645000000001, 2024-09-12T18:37:02.896 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:02.896 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:02.896 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:02.896 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:02.896 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.896 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:02.896 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:37:02.896 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.896 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.896 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.896 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:02.897 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:37:02.897 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.897 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.897 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.897 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:02.897 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633085+0000", 2024-09-12T18:37:02.897 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:37:02.897 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.897 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.897 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:02.898 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633093+0000", 2024-09-12T18:37:02.898 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3999999999999992e-06 2024-09-12T18:37:02.898 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.898 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.898 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:02.898 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633111+0000", 2024-09-12T18:37:02.898 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8070000000000001e-05 2024-09-12T18:37:02.898 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.898 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.898 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.899 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633126+0000", 2024-09-12T18:37:02.899 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4487e-05 2024-09-12T18:37:02.899 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.899 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.899 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:02.899 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638290+0000", 2024-09-12T18:37:02.899 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0051640269999999999 2024-09-12T18:37:02.899 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.899 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.899 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:02.899 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638547+0000", 2024-09-12T18:37:02.900 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025714100000000001 2024-09-12T18:37:02.900 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.900 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.900 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:02.900 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638850+0000", 2024-09-12T18:37:02.900 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030278400000000001 2024-09-12T18:37:02.900 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.900 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.900 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:02.900 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.640706+0000", 2024-09-12T18:37:02.900 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018564580000000001 2024-09-12T18:37:02.900 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.901 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.901 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:02.901 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658420+0000", 2024-09-12T18:37:02.901 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017714395000000001 2024-09-12T18:37:02.901 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.901 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.901 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:02.901 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658635+0000", 2024-09-12T18:37:02.901 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021413500000000001 2024-09-12T18:37:02.901 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.901 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.902 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:02.902 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.660022+0000", 2024-09-12T18:37:02.902 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001387318 2024-09-12T18:37:02.902 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.902 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:02.902 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.902 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.902 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.902 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121096 5.8 5:13503891:::benchmark_data_smithi073_23739_object121095:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:02.903 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:37:02.903 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 22.689210117999998, 2024-09-12T18:37:02.903 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064025391000000001, 2024-09-12T18:37:02.903 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:02.903 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:02.903 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:02.903 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:02.903 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:02.903 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:02.903 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121096 2024-09-12T18:37:02.903 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.903 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:02.904 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.904 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:02.904 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:37:02.904 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.904 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.904 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.904 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:02.904 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:37:02.904 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.904 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.904 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.904 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:02.904 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178579+0000", 2024-09-12T18:37:02.904 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7369999999999998e-06 2024-09-12T18:37:02.905 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.905 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.905 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:02.905 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178846+0000", 2024-09-12T18:37:02.905 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026752699999999999 2024-09-12T18:37:02.905 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.905 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.905 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:02.905 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178877+0000", 2024-09-12T18:37:02.905 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1081999999999998e-05 2024-09-12T18:37:02.905 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.905 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.905 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.905 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178896+0000", 2024-09-12T18:37:02.906 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8522e-05 2024-09-12T18:37:02.906 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.906 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.906 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:02.906 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.192591+0000", 2024-09-12T18:37:02.906 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013695067 2024-09-12T18:37:02.906 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.906 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.906 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:02.907 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.192944+0000", 2024-09-12T18:37:02.907 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00035273699999999999 2024-09-12T18:37:02.907 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.907 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.907 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:02.907 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.193732+0000", 2024-09-12T18:37:02.907 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078849599999999997 2024-09-12T18:37:02.907 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.907 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.907 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:02.907 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.213583+0000", 2024-09-12T18:37:02.907 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.019851164000000001 2024-09-12T18:37:02.907 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.907 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.908 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:02.908 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242386+0000", 2024-09-12T18:37:02.908 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028802924000000001 2024-09-12T18:37:02.908 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.908 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.908 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:02.908 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242501+0000", 2024-09-12T18:37:02.908 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000114932 2024-09-12T18:37:02.908 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.908 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.908 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:02.909 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242602+0000", 2024-09-12T18:37:02.909 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000100203 2024-09-12T18:37:02.909 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.909 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:02.909 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.909 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.909 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.909 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121097 5.8 5:1b31a99e:::benchmark_data_smithi073_23739_object121096:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:02.909 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:37:02.909 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 22.673481828, 2024-09-12T18:37:02.909 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048475917, 2024-09-12T18:37:02.909 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:02.909 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:02.910 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:02.910 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:02.910 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:02.910 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:02.910 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121097 2024-09-12T18:37:02.910 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.910 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:02.910 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.910 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:02.910 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:37:02.910 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.910 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.910 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.910 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:02.911 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:37:02.911 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.911 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.911 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.911 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:02.911 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194308+0000", 2024-09-12T18:37:02.911 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2789999999999999e-06 2024-09-12T18:37:02.911 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.911 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.911 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:02.911 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194396+0000", 2024-09-12T18:37:02.912 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8324000000000003e-05 2024-09-12T18:37:02.912 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.912 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.912 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:02.912 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194424+0000", 2024-09-12T18:37:02.912 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7565000000000001e-05 2024-09-12T18:37:02.912 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.912 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.912 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.912 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194444+0000", 2024-09-12T18:37:02.912 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0363000000000001e-05 2024-09-12T18:37:02.912 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.913 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.913 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:02.913 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.206888+0000", 2024-09-12T18:37:02.913 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012443997 2024-09-12T18:37:02.913 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.913 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.913 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:02.913 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.207138+0000", 2024-09-12T18:37:02.913 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025035900000000002 2024-09-12T18:37:02.913 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.914 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.914 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:02.914 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.207365+0000", 2024-09-12T18:37:02.914 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000226407 2024-09-12T18:37:02.914 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.914 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.914 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:02.914 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.215059+0000", 2024-09-12T18:37:02.914 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076946860000000001 2024-09-12T18:37:02.914 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.914 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.914 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:02.914 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242619+0000", 2024-09-12T18:37:02.915 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.027559975 2024-09-12T18:37:02.915 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.915 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.915 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:02.915 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242706+0000", 2024-09-12T18:37:02.915 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6384999999999994e-05 2024-09-12T18:37:02.915 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.915 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.915 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:02.915 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242780+0000", 2024-09-12T18:37:02.916 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4577000000000001e-05 2024-09-12T18:37:02.916 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.916 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:02.916 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.916 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.916 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.916 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:121044 5.1 e50/49 5:83bf711a:::benchmark_data_smithi073_23739_object121043:head v 50'7532, mlcod=0'0)", 2024-09-12T18:37:02.916 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.201054+0000", 2024-09-12T18:37:02.916 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 22.666732607, 2024-09-12T18:37:02.916 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026157387000000001, 2024-09-12T18:37:02.916 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:02.916 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:02.916 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:02.917 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:02.917 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.917 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:02.917 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201054+0000", 2024-09-12T18:37:02.917 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.917 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.917 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.917 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:02.917 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201054+0000", 2024-09-12T18:37:02.917 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.917 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.917 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.917 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:02.918 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201056+0000", 2024-09-12T18:37:02.918 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.99e-06 2024-09-12T18:37:02.918 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.918 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.918 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:02.918 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201068+0000", 2024-09-12T18:37:02.918 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2799000000000001e-05 2024-09-12T18:37:02.918 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.918 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.918 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:02.918 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201093+0000", 2024-09-12T18:37:02.918 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4766e-05 2024-09-12T18:37:02.918 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.918 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.919 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.919 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201115+0000", 2024-09-12T18:37:02.919 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1988999999999999e-05 2024-09-12T18:37:02.919 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.919 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.919 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:02.919 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201233+0000", 2024-09-12T18:37:02.919 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000118229 2024-09-12T18:37:02.919 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.919 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.919 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:02.919 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201273+0000", 2024-09-12T18:37:02.919 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9171999999999997e-05 2024-09-12T18:37:02.920 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.920 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.920 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:02.920 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.227080+0000", 2024-09-12T18:37:02.920 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025807611000000001 2024-09-12T18:37:02.920 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.920 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.920 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:02.920 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.227211+0000", 2024-09-12T18:37:02.920 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013083100000000001 2024-09-12T18:37:02.920 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.920 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:02.920 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.921 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.921 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.921 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121101 5.e 5:7e18e9ed:::benchmark_data_smithi073_23739_object121100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:02.921 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.209084+0000", 2024-09-12T18:37:02.921 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 22.658701773000001, 2024-09-12T18:37:02.921 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028988566, 2024-09-12T18:37:02.921 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:02.921 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:02.921 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:02.921 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:02.921 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:02.921 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:02.921 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121101 2024-09-12T18:37:02.921 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.922 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:02.922 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.922 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:02.922 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209084+0000", 2024-09-12T18:37:02.922 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.922 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.922 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.922 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:02.922 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209084+0000", 2024-09-12T18:37:02.922 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.922 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.922 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.922 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:02.923 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209087+0000", 2024-09-12T18:37:02.923 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6800000000000002e-06 2024-09-12T18:37:02.923 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.923 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.923 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:02.923 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209182+0000", 2024-09-12T18:37:02.923 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5084e-05 2024-09-12T18:37:02.923 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.923 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.923 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:02.923 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209212+0000", 2024-09-12T18:37:02.923 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9825e-05 2024-09-12T18:37:02.923 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.923 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.924 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.924 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209234+0000", 2024-09-12T18:37:02.924 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1416e-05 2024-09-12T18:37:02.924 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.924 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.924 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:02.924 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209497+0000", 2024-09-12T18:37:02.924 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026390400000000003 2024-09-12T18:37:02.924 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.924 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.924 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:02.924 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209810+0000", 2024-09-12T18:37:02.924 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000313023 2024-09-12T18:37:02.925 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.925 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.925 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:02.925 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.210468+0000", 2024-09-12T18:37:02.925 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00065779300000000005 2024-09-12T18:37:02.925 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.925 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.925 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:02.925 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.235905+0000", 2024-09-12T18:37:02.925 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025436881000000001 2024-09-12T18:37:02.925 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.925 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.925 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:02.926 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237797+0000", 2024-09-12T18:37:02.926 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001892007 2024-09-12T18:37:02.926 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.926 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.926 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:02.926 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237941+0000", 2024-09-12T18:37:02.926 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000143411 2024-09-12T18:37:02.926 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.926 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.926 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:02.926 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.238073+0000", 2024-09-12T18:37:02.926 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013254200000000001 2024-09-12T18:37:02.926 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.926 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:02.927 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.927 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.927 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.927 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121102 5.8 5:1f118f4b:::benchmark_data_smithi073_23739_object121101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:02.927 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.218682+0000", 2024-09-12T18:37:02.927 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 22.649104413, 2024-09-12T18:37:02.927 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024264885, 2024-09-12T18:37:02.927 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:02.927 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:02.927 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:02.927 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:02.927 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:02.927 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:02.928 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121102 2024-09-12T18:37:02.928 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.928 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:02.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.928 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:02.928 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218682+0000", 2024-09-12T18:37:02.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.928 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.928 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:02.928 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218682+0000", 2024-09-12T18:37:02.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.928 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.929 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.929 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:02.929 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218685+0000", 2024-09-12T18:37:02.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6059999999999999e-06 2024-09-12T18:37:02.929 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.929 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.929 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:02.929 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218743+0000", 2024-09-12T18:37:02.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7160999999999997e-05 2024-09-12T18:37:02.929 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.929 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.929 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:02.929 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218768+0000", 2024-09-12T18:37:02.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5052e-05 2024-09-12T18:37:02.930 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.930 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.930 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218785+0000", 2024-09-12T18:37:02.930 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7436999999999999e-05 2024-09-12T18:37:02.930 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.930 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:02.930 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218952+0000", 2024-09-12T18:37:02.930 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016691300000000001 2024-09-12T18:37:02.930 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.930 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:02.931 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.219437+0000", 2024-09-12T18:37:02.931 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048465900000000002 2024-09-12T18:37:02.931 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.931 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.931 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:02.931 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.219893+0000", 2024-09-12T18:37:02.931 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00045642799999999999 2024-09-12T18:37:02.931 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.931 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.931 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:02.931 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.226416+0000", 2024-09-12T18:37:02.931 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065225630000000003 2024-09-12T18:37:02.931 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.931 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.932 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:02.932 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242796+0000", 2024-09-12T18:37:02.932 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016379857000000001 2024-09-12T18:37:02.932 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.932 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.932 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:02.932 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242879+0000", 2024-09-12T18:37:02.932 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3913999999999997e-05 2024-09-12T18:37:02.932 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.932 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.932 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:02.932 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242947+0000", 2024-09-12T18:37:02.932 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7294999999999999e-05 2024-09-12T18:37:02.933 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.933 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:02.933 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.933 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.933 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.933 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121106 5.d 5:b4a9a221:::benchmark_data_smithi073_23739_object121105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:02.933 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:37:02.933 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 22.630606891999999, 2024-09-12T18:37:02.933 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.034882274999999997, 2024-09-12T18:37:02.933 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:02.933 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:02.933 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:02.933 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:02.933 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:02.934 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:02.934 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121106 2024-09-12T18:37:02.934 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.934 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:02.934 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.934 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:02.934 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:37:02.934 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.934 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.934 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.934 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:02.934 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:37:02.934 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.935 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.935 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:02.935 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237182+0000", 2024-09-12T18:37:02.935 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6019999999999998e-06 2024-09-12T18:37:02.935 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.935 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:02.935 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237257+0000", 2024-09-12T18:37:02.935 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5420999999999995e-05 2024-09-12T18:37:02.935 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.935 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:02.935 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237305+0000", 2024-09-12T18:37:02.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7207999999999999e-05 2024-09-12T18:37:02.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.936 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.936 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.936 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237325+0000", 2024-09-12T18:37:02.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0001e-05 2024-09-12T18:37:02.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.936 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.936 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:02.936 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237505+0000", 2024-09-12T18:37:02.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000180798 2024-09-12T18:37:02.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.936 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.937 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:02.937 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237764+0000", 2024-09-12T18:37:02.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025862299999999998 2024-09-12T18:37:02.937 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.937 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.937 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:02.937 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.238264+0000", 2024-09-12T18:37:02.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00050016100000000005 2024-09-12T18:37:02.937 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.937 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.937 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:02.937 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256525+0000", 2024-09-12T18:37:02.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018260508000000002 2024-09-12T18:37:02.937 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.938 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.938 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:02.938 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.271903+0000", 2024-09-12T18:37:02.938 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015378739000000001 2024-09-12T18:37:02.938 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.938 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.938 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:02.938 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.271999+0000", 2024-09-12T18:37:02.938 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5989000000000005e-05 2024-09-12T18:37:02.938 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.938 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.938 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:02.938 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272062+0000", 2024-09-12T18:37:02.939 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2224999999999995e-05 2024-09-12T18:37:02.939 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.939 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:02.939 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.939 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.939 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.939 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121112 5.d 5:b9a2d671:::benchmark_data_smithi073_23739_object121111:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:02.939 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.243446+0000", 2024-09-12T18:37:02.939 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 22.624340167, 2024-09-12T18:37:02.939 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.02889415, 2024-09-12T18:37:02.939 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:02.939 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:02.939 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:02.939 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:02.940 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:02.940 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:02.940 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121112 2024-09-12T18:37:02.940 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.940 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:02.940 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.940 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:02.940 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243446+0000", 2024-09-12T18:37:02.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.940 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.940 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.940 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:02.940 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243446+0000", 2024-09-12T18:37:02.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.941 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.941 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.941 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:02.941 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243448+0000", 2024-09-12T18:37:02.941 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0829999999999998e-06 2024-09-12T18:37:02.941 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.941 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.941 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:02.941 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243527+0000", 2024-09-12T18:37:02.941 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9173999999999998e-05 2024-09-12T18:37:02.941 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.941 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.941 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:02.941 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243549+0000", 2024-09-12T18:37:02.942 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1169e-05 2024-09-12T18:37:02.942 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.942 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.942 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243564+0000", 2024-09-12T18:37:02.942 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5866999999999999e-05 2024-09-12T18:37:02.942 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.942 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:02.942 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.249905+0000", 2024-09-12T18:37:02.942 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063410360000000004 2024-09-12T18:37:02.942 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.942 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:02.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.250166+0000", 2024-09-12T18:37:02.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026052999999999997 2024-09-12T18:37:02.943 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:02.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.250486+0000", 2024-09-12T18:37:02.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00032002700000000002 2024-09-12T18:37:02.943 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:02.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.259263+0000", 2024-09-12T18:37:02.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0087774770000000005 2024-09-12T18:37:02.943 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.944 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:02.944 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272186+0000", 2024-09-12T18:37:02.944 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.01292213 2024-09-12T18:37:02.944 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.944 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.944 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:02.944 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272267+0000", 2024-09-12T18:37:02.944 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1153e-05 2024-09-12T18:37:02.944 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.944 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.944 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:02.944 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272340+0000", 2024-09-12T18:37:02.944 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3504000000000006e-05 2024-09-12T18:37:02.945 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.945 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:02.945 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.945 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.945 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.945 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121114 5.d 5:b8870c11:::benchmark_data_smithi073_23739_object121113:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:02.945 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.243603+0000", 2024-09-12T18:37:02.945 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 22.624182915999999, 2024-09-12T18:37:02.945 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028945746000000001, 2024-09-12T18:37:02.945 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:02.945 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:02.945 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:02.945 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:02.945 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:02.946 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:02.946 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121114 2024-09-12T18:37:02.946 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.946 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:02.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.946 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:02.946 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243603+0000", 2024-09-12T18:37:02.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.946 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.946 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:02.946 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243603+0000", 2024-09-12T18:37:02.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.946 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.947 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.947 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:02.947 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243605+0000", 2024-09-12T18:37:02.947 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.268e-06 2024-09-12T18:37:02.947 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.947 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.947 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:02.947 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243674+0000", 2024-09-12T18:37:02.947 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9375000000000006e-05 2024-09-12T18:37:02.947 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.947 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.947 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:02.947 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243691+0000", 2024-09-12T18:37:02.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6517000000000001e-05 2024-09-12T18:37:02.948 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.948 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243702+0000", 2024-09-12T18:37:02.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1905999999999999e-05 2024-09-12T18:37:02.948 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:02.948 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.253789+0000", 2024-09-12T18:37:02.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.010086776 2024-09-12T18:37:02.948 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:02.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.253959+0000", 2024-09-12T18:37:02.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00017000000000000001 2024-09-12T18:37:02.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:02.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.254179+0000", 2024-09-12T18:37:02.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022003699999999999 2024-09-12T18:37:02.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:02.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.259330+0000", 2024-09-12T18:37:02.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0051511559999999996 2024-09-12T18:37:02.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.950 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:02.950 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272403+0000", 2024-09-12T18:37:02.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013072342000000001 2024-09-12T18:37:02.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.950 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:02.950 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272493+0000", 2024-09-12T18:37:02.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0595999999999998e-05 2024-09-12T18:37:02.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.950 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:02.950 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272549+0000", 2024-09-12T18:37:02.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5773000000000003e-05 2024-09-12T18:37:02.951 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.951 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:02.951 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.951 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.951 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121115 5.d 5:bd4a51ea:::benchmark_data_smithi073_23739_object121114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:02.951 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.245059+0000", 2024-09-12T18:37:02.951 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 22.622727242, 2024-09-12T18:37:02.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.02767406, 2024-09-12T18:37:02.951 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:02.951 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:02.951 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:02.952 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:02.952 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:02.952 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:02.952 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121115 2024-09-12T18:37:02.952 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.952 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:02.952 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.952 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:02.952 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245059+0000", 2024-09-12T18:37:02.952 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.952 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.952 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.952 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:02.952 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245059+0000", 2024-09-12T18:37:02.953 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.953 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.953 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.953 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:02.953 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245061+0000", 2024-09-12T18:37:02.953 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9759999999999998e-06 2024-09-12T18:37:02.953 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.953 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.953 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:02.953 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245111+0000", 2024-09-12T18:37:02.953 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9838e-05 2024-09-12T18:37:02.953 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.953 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.954 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:02.954 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245132+0000", 2024-09-12T18:37:02.954 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1469999999999999e-05 2024-09-12T18:37:02.954 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.954 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.954 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.954 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245146+0000", 2024-09-12T18:37:02.954 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3377000000000001e-05 2024-09-12T18:37:02.954 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.954 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.954 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:02.954 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256596+0000", 2024-09-12T18:37:02.954 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011450241999999999 2024-09-12T18:37:02.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:02.955 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256838+0000", 2024-09-12T18:37:02.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000242255 2024-09-12T18:37:02.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:02.955 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.257095+0000", 2024-09-12T18:37:02.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025679300000000001 2024-09-12T18:37:02.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.956 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:02.956 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.259928+0000", 2024-09-12T18:37:02.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0028326290000000001 2024-09-12T18:37:02.956 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.956 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.956 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:02.956 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272607+0000", 2024-09-12T18:37:02.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012679466 2024-09-12T18:37:02.956 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.956 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.956 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:02.956 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272681+0000", 2024-09-12T18:37:02.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3580999999999999e-05 2024-09-12T18:37:02.957 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.957 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.957 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:02.957 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272733+0000", 2024-09-12T18:37:02.957 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2432999999999998e-05 2024-09-12T18:37:02.957 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.957 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:02.957 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.957 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.957 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.957 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121148 5.4 5:2a9bde06:::benchmark_data_smithi073_23739_object121147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:02.957 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.281423+0000", 2024-09-12T18:37:02.957 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 22.586363599999999, 2024-09-12T18:37:02.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025774785000000001, 2024-09-12T18:37:02.958 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:02.958 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:02.958 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:02.958 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:02.958 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:02.958 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:02.958 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121148 2024-09-12T18:37:02.958 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.958 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:02.958 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.958 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:02.958 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281423+0000", 2024-09-12T18:37:02.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.959 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.959 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:02.959 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281423+0000", 2024-09-12T18:37:02.959 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.959 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.959 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:02.959 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281424+0000", 2024-09-12T18:37:02.959 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.048e-06 2024-09-12T18:37:02.959 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.959 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:02.959 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281496+0000", 2024-09-12T18:37:02.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2099000000000002e-05 2024-09-12T18:37:02.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.960 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:02.960 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281509+0000", 2024-09-12T18:37:02.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3379e-05 2024-09-12T18:37:02.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.960 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.960 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281515+0000", 2024-09-12T18:37:02.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.28e-06 2024-09-12T18:37:02.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:02.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281688+0000", 2024-09-12T18:37:02.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00017203100000000001 2024-09-12T18:37:02.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:02.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281834+0000", 2024-09-12T18:37:02.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014645899999999999 2024-09-12T18:37:02.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:02.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.282319+0000", 2024-09-12T18:37:02.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048535000000000001 2024-09-12T18:37:02.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:02.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307086+0000", 2024-09-12T18:37:02.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024766989999999999 2024-09-12T18:37:02.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:02.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307108+0000", 2024-09-12T18:37:02.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1795999999999999e-05 2024-09-12T18:37:02.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:02.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307157+0000", 2024-09-12T18:37:02.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8729000000000001e-05 2024-09-12T18:37:02.963 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.963 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.963 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:02.963 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307197+0000", 2024-09-12T18:37:02.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0624000000000003e-05 2024-09-12T18:37:02.963 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.963 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:02.963 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.963 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.963 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.963 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121155 5.4 5:2af257d1:::benchmark_data_smithi073_23739_object121154:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:02.963 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.283163+0000", 2024-09-12T18:37:02.964 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 22.584622925000001, 2024-09-12T18:37:02.964 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024186485000000001, 2024-09-12T18:37:02.964 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:02.964 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:02.964 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:02.964 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:02.964 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:02.964 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:02.964 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121155 2024-09-12T18:37:02.964 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.964 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:02.964 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.964 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:02.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283163+0000", 2024-09-12T18:37:02.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:02.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283163+0000", 2024-09-12T18:37:02.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:02.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283165+0000", 2024-09-12T18:37:02.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.748e-06 2024-09-12T18:37:02.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:02.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283218+0000", 2024-09-12T18:37:02.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2695000000000003e-05 2024-09-12T18:37:02.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:02.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283244+0000", 2024-09-12T18:37:02.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6072e-05 2024-09-12T18:37:02.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283257+0000", 2024-09-12T18:37:02.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3054000000000001e-05 2024-09-12T18:37:02.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:02.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.294509+0000", 2024-09-12T18:37:02.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011251677999999999 2024-09-12T18:37:02.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:02.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.294705+0000", 2024-09-12T18:37:02.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000196369 2024-09-12T18:37:02.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:02.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.294907+0000", 2024-09-12T18:37:02.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020184700000000001 2024-09-12T18:37:02.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.968 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:02.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307208+0000", 2024-09-12T18:37:02.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012301068 2024-09-12T18:37:02.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.968 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:02.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307273+0000", 2024-09-12T18:37:02.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5611000000000006e-05 2024-09-12T18:37:02.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:02.969 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307320+0000", 2024-09-12T18:37:02.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6220999999999997e-05 2024-09-12T18:37:02.969 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:02.969 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307350+0000", 2024-09-12T18:37:02.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0122000000000001e-05 2024-09-12T18:37:02.969 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.969 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:02.969 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.969 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.970 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121160 5.b 5:d4730c8e:::benchmark_data_smithi073_23739_object121159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:02.970 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.289262+0000", 2024-09-12T18:37:02.970 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 22.578523909000001, 2024-09-12T18:37:02.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024618870000000001, 2024-09-12T18:37:02.970 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:02.970 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:02.970 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:02.970 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:02.970 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:02.970 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:02.970 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121160 2024-09-12T18:37:02.970 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.970 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:02.970 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:02.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289262+0000", 2024-09-12T18:37:02.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:02.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289262+0000", 2024-09-12T18:37:02.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:02.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289264+0000", 2024-09-12T18:37:02.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.945e-06 2024-09-12T18:37:02.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:02.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289331+0000", 2024-09-12T18:37:02.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6594999999999995e-05 2024-09-12T18:37:02.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:02.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289359+0000", 2024-09-12T18:37:02.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7988999999999999e-05 2024-09-12T18:37:02.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289375+0000", 2024-09-12T18:37:02.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5639000000000001e-05 2024-09-12T18:37:02.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:02.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289515+0000", 2024-09-12T18:37:02.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000140254 2024-09-12T18:37:02.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:02.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289740+0000", 2024-09-12T18:37:02.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022513500000000001 2024-09-12T18:37:02.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.974 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:02.974 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.290232+0000", 2024-09-12T18:37:02.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00049247500000000003 2024-09-12T18:37:02.974 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.974 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:02.974 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.312221+0000", 2024-09-12T18:37:02.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.021988939999999998 2024-09-12T18:37:02.974 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.974 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:02.974 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.313807+0000", 2024-09-12T18:37:02.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015859100000000001 2024-09-12T18:37:02.974 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.975 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.975 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:02.975 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.313852+0000", 2024-09-12T18:37:02.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4305999999999999e-05 2024-09-12T18:37:02.975 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.975 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.975 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:02.975 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.313881+0000", 2024-09-12T18:37:02.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9682000000000001e-05 2024-09-12T18:37:02.975 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.975 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:02.975 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.975 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.976 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:131551 5.d 5:b8f8c77a:::benchmark_data_smithi073_23739_object131550:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:37:02.976 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:45.499878+0000", 2024-09-12T18:37:02.976 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 17.367907978000002, 2024-09-12T18:37:02.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.027478433, 2024-09-12T18:37:02.976 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:02.976 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:02.976 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:02.976 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:02.976 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:02.976 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:02.976 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 131551 2024-09-12T18:37:02.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.977 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:02.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:02.977 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499878+0000", 2024-09-12T18:37:02.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.977 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:02.977 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499878+0000", 2024-09-12T18:37:02.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.977 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:02.977 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499879+0000", 2024-09-12T18:37:02.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.92e-07 2024-09-12T18:37:02.978 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.978 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:02.978 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499946+0000", 2024-09-12T18:37:02.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6712999999999996e-05 2024-09-12T18:37:02.978 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.978 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:02.978 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499953+0000", 2024-09-12T18:37:02.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5519999999999999e-06 2024-09-12T18:37:02.978 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.979 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499959+0000", 2024-09-12T18:37:02.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0430000000000004e-06 2024-09-12T18:37:02.979 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.979 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:02.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.500004+0000", 2024-09-12T18:37:02.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5058000000000001e-05 2024-09-12T18:37:02.979 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.979 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:02.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.500121+0000", 2024-09-12T18:37:02.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000116747 2024-09-12T18:37:02.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.980 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:02.980 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.500283+0000", 2024-09-12T18:37:02.980 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016190599999999999 2024-09-12T18:37:02.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.980 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:02.980 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.504017+0000", 2024-09-12T18:37:02.980 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003734125 2024-09-12T18:37:02.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.980 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:02.980 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.527224+0000", 2024-09-12T18:37:02.981 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.023206724000000001 2024-09-12T18:37:02.981 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.981 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.981 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:02.981 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.527290+0000", 2024-09-12T18:37:02.981 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5778999999999995e-05 2024-09-12T18:37:02.981 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.981 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.981 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:02.981 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.527357+0000", 2024-09-12T18:37:02.981 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7094000000000005e-05 2024-09-12T18:37:02.981 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.981 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:02.982 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.982 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.982 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.982 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:131556 5.0 5:01fc649a:::benchmark_data_smithi073_23739_object131555:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:37:02.982 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:45.502449+0000", 2024-09-12T18:37:02.982 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 17.365337605000001, 2024-09-12T18:37:02.982 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.022597466, 2024-09-12T18:37:02.982 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:02.982 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:02.982 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:02.982 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:02.982 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:02.982 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:02.982 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 131556 2024-09-12T18:37:02.983 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.983 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:02.983 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.983 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:02.983 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502449+0000", 2024-09-12T18:37:02.983 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.983 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.983 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.983 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:02.983 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502449+0000", 2024-09-12T18:37:02.983 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.983 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.983 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.983 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:02.984 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502449+0000", 2024-09-12T18:37:02.984 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.15e-07 2024-09-12T18:37:02.984 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.984 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:02.984 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502481+0000", 2024-09-12T18:37:02.984 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1671999999999998e-05 2024-09-12T18:37:02.984 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.984 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:02.984 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502487+0000", 2024-09-12T18:37:02.984 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5270000000000004e-06 2024-09-12T18:37:02.984 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.985 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.985 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.985 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502492+0000", 2024-09-12T18:37:02.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0590000000000002e-06 2024-09-12T18:37:02.985 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.985 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.985 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:02.985 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502957+0000", 2024-09-12T18:37:02.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00046515 2024-09-12T18:37:02.985 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.985 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.985 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:02.985 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.503100+0000", 2024-09-12T18:37:02.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000142886 2024-09-12T18:37:02.986 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.986 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.986 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0,2", 2024-09-12T18:37:02.986 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.503268+0000", 2024-09-12T18:37:02.986 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016746299999999999 2024-09-12T18:37:02.986 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.986 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.986 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:02.986 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.506821+0000", 2024-09-12T18:37:02.986 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035528640000000002 2024-09-12T18:37:02.986 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.986 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.986 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:02.986 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.507126+0000", 2024-09-12T18:37:02.987 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030543399999999999 2024-09-12T18:37:02.987 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.987 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.987 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:02.987 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.524851+0000", 2024-09-12T18:37:02.987 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017724521999999999 2024-09-12T18:37:02.987 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.987 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.987 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:02.987 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.524920+0000", 2024-09-12T18:37:02.987 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9386000000000003e-05 2024-09-12T18:37:02.987 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.987 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.988 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:02.988 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.525046+0000", 2024-09-12T18:37:02.988 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000126088 2024-09-12T18:37:02.988 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.988 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:02.988 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.988 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.988 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.988 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:131557 5.0 5:0bc216b5:::benchmark_data_smithi073_23739_object131556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:37:02.988 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:45.502523+0000", 2024-09-12T18:37:02.988 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 17.365263333000001, 2024-09-12T18:37:02.988 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024077715, 2024-09-12T18:37:02.988 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:02.989 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:02.989 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:02.989 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:02.989 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:02.989 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:02.989 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 131557 2024-09-12T18:37:02.989 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.989 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:02.989 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.989 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:02.989 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502523+0000", 2024-09-12T18:37:02.989 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.989 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.990 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.990 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:02.990 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502523+0000", 2024-09-12T18:37:02.990 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:02.990 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.990 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.990 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:02.990 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502523+0000", 2024-09-12T18:37:02.990 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3200000000000005e-07 2024-09-12T18:37:02.990 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.990 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.990 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:02.990 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502601+0000", 2024-09-12T18:37:02.990 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7344999999999999e-05 2024-09-12T18:37:02.991 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.991 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.991 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:02.991 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502611+0000", 2024-09-12T18:37:02.991 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0407999999999999e-05 2024-09-12T18:37:02.991 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.991 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.991 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:02.991 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.502615+0000", 2024-09-12T18:37:02.991 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6739999999999999e-06 2024-09-12T18:37:02.991 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.991 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.991 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:02.991 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.505138+0000", 2024-09-12T18:37:02.992 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0025231709999999998 2024-09-12T18:37:02.992 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.992 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.992 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:02.992 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.505244+0000", 2024-09-12T18:37:02.992 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000106006 2024-09-12T18:37:02.992 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.992 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.992 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0,2", 2024-09-12T18:37:02.992 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.505357+0000", 2024-09-12T18:37:02.992 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000113038 2024-09-12T18:37:02.992 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.992 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.993 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:02.993 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.507393+0000", 2024-09-12T18:37:02.993 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020356269999999999 2024-09-12T18:37:02.993 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.993 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.993 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:02.993 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.508538+0000", 2024-09-12T18:37:02.993 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001145016 2024-09-12T18:37:02.993 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.993 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.993 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:02.993 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.526436+0000", 2024-09-12T18:37:02.993 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017898121999999999 2024-09-12T18:37:02.993 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.994 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.994 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:02.994 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.526500+0000", 2024-09-12T18:37:02.994 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.3954999999999993e-05 2024-09-12T18:37:02.994 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:02.994 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:02.994 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:02.994 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.526601+0000", 2024-09-12T18:37:02.994 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000100821 2024-09-12T18:37:02.994 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.994 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:02.994 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.994 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:02.994 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:02.995 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:02.996 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:37:02.997 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:02.991+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:03.096 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:03.091+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:03.161 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:03.161 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:37:03.161 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.161 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:167334 5.c e58/21 5:3bba6f72:::benchmark_data_smithi073_23739_object35057:head v 58'10396, mlcod=58'10394)", 2024-09-12T18:37:03.161 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.155965+0000", 2024-09-12T18:37:03.162 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0032190109999999999, 2024-09-12T18:37:03.162 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0032399320000000001, 2024-09-12T18:37:03.162 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:03.162 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:03.162 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:37:03.162 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:03.162 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.162 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:03.162 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.155965+0000", 2024-09-12T18:37:03.162 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:03.162 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.162 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.162 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:03.162 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.155965+0000", 2024-09-12T18:37:03.163 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:03.163 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.163 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.163 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:03.163 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.155965+0000", 2024-09-12T18:37:03.163 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.6600000000000003e-07 2024-09-12T18:37:03.163 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.163 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.163 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:03.163 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.155969+0000", 2024-09-12T18:37:03.163 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.517e-06 2024-09-12T18:37:03.163 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.163 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.164 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:03.164 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.155977+0000", 2024-09-12T18:37:03.164 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8809999999999996e-06 2024-09-12T18:37:03.164 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.164 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.164 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:03.164 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.155981+0000", 2024-09-12T18:37:03.164 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4440000000000001e-06 2024-09-12T18:37:03.164 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.164 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.164 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:03.164 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.156031+0000", 2024-09-12T18:37:03.165 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.9787999999999998e-05 2024-09-12T18:37:03.165 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.165 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.165 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:03.165 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.156051+0000", 2024-09-12T18:37:03.165 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.0307999999999999e-05 2024-09-12T18:37:03.165 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:03.165 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:03.165 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:03.165 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.165 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.165 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167337 5.f 5.c676b1cf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:03.165 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.157787+0000", 2024-09-12T18:37:03.165 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0013974199999999999, 2024-09-12T18:37:03.166 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0014721999999999999, 2024-09-12T18:37:03.166 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:03.166 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:03.166 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:03.166 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:03.166 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:03.166 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:03.166 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167337 2024-09-12T18:37:03.166 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.166 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:03.166 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.166 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:03.166 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.157787+0000", 2024-09-12T18:37:03.166 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:03.167 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.167 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.167 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:03.167 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.157787+0000", 2024-09-12T18:37:03.167 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:03.167 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.167 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.167 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:03.167 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.157788+0000", 2024-09-12T18:37:03.167 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1000000000000001e-06 2024-09-12T18:37:03.167 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.167 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.167 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:03.167 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.157793+0000", 2024-09-12T18:37:03.168 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3279999999999996e-06 2024-09-12T18:37:03.168 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.168 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.168 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:03.168 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.157803+0000", 2024-09-12T18:37:03.168 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.8169999999999994e-06 2024-09-12T18:37:03.168 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.168 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.168 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:03.168 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.157810+0000", 2024-09-12T18:37:03.168 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.1949999999999997e-06 2024-09-12T18:37:03.168 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:03.168 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:03.169 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:03.169 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.169 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.169 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop_reply(client.4480.0:167327 5.f e58/21)", 2024-09-12T18:37:03.169 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.158185+0000", 2024-09-12T18:37:03.169 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.00099934900000000007, 2024-09-12T18:37:03.169 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0011177349999999999, 2024-09-12T18:37:03.169 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:03.169 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:03.169 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:03.169 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:03.169 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.169 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:03.170 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.158185+0000", 2024-09-12T18:37:03.170 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:03.170 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.170 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.170 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:03.170 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.158185+0000", 2024-09-12T18:37:03.170 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:03.170 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.170 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.170 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:03.170 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.158185+0000", 2024-09-12T18:37:03.170 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2200000000000004e-07 2024-09-12T18:37:03.170 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.171 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.171 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:03.171 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.158189+0000", 2024-09-12T18:37:03.171 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.9330000000000003e-06 2024-09-12T18:37:03.171 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.171 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.171 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:03.171 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.158196+0000", 2024-09-12T18:37:03.171 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.99e-06 2024-09-12T18:37:03.171 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.171 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.171 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:03.171 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.158201+0000", 2024-09-12T18:37:03.171 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4920000000000004e-06 2024-09-12T18:37:03.172 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:03.172 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:03.172 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:03.172 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.172 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.172 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop_reply(client.4480.0:167332 5.f e58/21)", 2024-09-12T18:37:03.172 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.158242+0000", 2024-09-12T18:37:03.172 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.00094204800000000002, 2024-09-12T18:37:03.172 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001095672, 2024-09-12T18:37:03.172 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:03.172 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:03.172 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:03.172 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:03.173 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.173 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:03.173 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.158242+0000", 2024-09-12T18:37:03.173 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:03.173 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.173 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.173 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:03.173 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.158242+0000", 2024-09-12T18:37:03.173 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:03.173 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.173 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.173 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:03.173 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.158242+0000", 2024-09-12T18:37:03.173 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.7700000000000001e-07 2024-09-12T18:37:03.174 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.174 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.174 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:03.174 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.158245+0000", 2024-09-12T18:37:03.174 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2900000000000001e-06 2024-09-12T18:37:03.174 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.174 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.174 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:03.174 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.158251+0000", 2024-09-12T18:37:03.174 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9009999999999999e-06 2024-09-12T18:37:03.174 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.174 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.174 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:03.174 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.158255+0000", 2024-09-12T18:37:03.175 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8720000000000001e-06 2024-09-12T18:37:03.175 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:03.175 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:03.175 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:03.175 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.175 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.175 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167340 5.5 5:a6958457:::benchmark_data_smithi073_23739_object35063:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:03.175 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.158457+0000", 2024-09-12T18:37:03.175 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.000726883, 2024-09-12T18:37:03.175 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00092149500000000004, 2024-09-12T18:37:03.175 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:03.175 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:03.175 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:03.175 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:03.176 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:03.176 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:03.176 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167340 2024-09-12T18:37:03.176 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.176 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:03.176 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.176 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:03.176 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.158457+0000", 2024-09-12T18:37:03.176 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:03.176 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.176 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.176 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:03.177 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.158457+0000", 2024-09-12T18:37:03.177 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:03.177 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.177 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.177 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:03.177 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.158458+0000", 2024-09-12T18:37:03.177 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.023e-06 2024-09-12T18:37:03.177 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.177 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.177 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:03.177 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.158463+0000", 2024-09-12T18:37:03.177 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.3329999999999998e-06 2024-09-12T18:37:03.177 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.178 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.178 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:03.178 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.158472+0000", 2024-09-12T18:37:03.178 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.4190000000000008e-06 2024-09-12T18:37:03.178 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.178 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.178 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:03.178 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.158479+0000", 2024-09-12T18:37:03.178 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0570000000000004e-06 2024-09-12T18:37:03.178 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.178 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.178 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:03.178 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.158545+0000", 2024-09-12T18:37:03.178 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.5443000000000003e-05 2024-09-12T18:37:03.179 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.179 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.179 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:03.179 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.158664+0000", 2024-09-12T18:37:03.179 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000119023 2024-09-12T18:37:03.179 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.179 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.179 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:03.179 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.158758+0000", 2024-09-12T18:37:03.179 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.4053000000000002e-05 2024-09-12T18:37:03.179 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:03.179 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:03.179 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:03.179 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.180 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.180 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167323 5.7 5:eb89d7ac:::benchmark_data_smithi073_23739_object35046:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:03.180 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.151028+0000", 2024-09-12T18:37:03.180 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0081563880000000005, 2024-09-12T18:37:03.180 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0084147349999999996, 2024-09-12T18:37:03.180 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:03.180 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:03.180 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:03.180 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:03.180 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:03.180 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:03.180 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167323 2024-09-12T18:37:03.180 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.181 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:03.181 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.181 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:03.181 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.151028+0000", 2024-09-12T18:37:03.181 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:03.181 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.181 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.181 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:03.181 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.151028+0000", 2024-09-12T18:37:03.181 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:03.181 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.181 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.181 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:03.181 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.151029+0000", 2024-09-12T18:37:03.182 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.547e-06 2024-09-12T18:37:03.182 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.182 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.182 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:03.182 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.151034+0000", 2024-09-12T18:37:03.182 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6349999999999997e-06 2024-09-12T18:37:03.182 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.182 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.182 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:03.182 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.151048+0000", 2024-09-12T18:37:03.182 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4229e-05 2024-09-12T18:37:03.182 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.182 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.183 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:03.183 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.151057+0000", 2024-09-12T18:37:03.183 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.2080000000000006e-06 2024-09-12T18:37:03.183 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.183 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.183 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:03.183 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.151120+0000", 2024-09-12T18:37:03.183 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2160000000000001e-05 2024-09-12T18:37:03.183 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.183 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.183 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:03.183 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.151257+0000", 2024-09-12T18:37:03.183 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013782200000000001 2024-09-12T18:37:03.183 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.184 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.184 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:03.184 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.151527+0000", 2024-09-12T18:37:03.184 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026937599999999999 2024-09-12T18:37:03.184 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:03.184 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:03.184 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:03.184 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.184 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.184 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167327 5.f 5:ffeaf2d3:::benchmark_data_smithi073_23739_object35050:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:03.184 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.152552+0000", 2024-09-12T18:37:03.184 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0066319530000000003, 2024-09-12T18:37:03.184 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0069516090000000001, 2024-09-12T18:37:03.185 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:03.185 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:03.185 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:03.185 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:03.185 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:03.185 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:03.185 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167327 2024-09-12T18:37:03.185 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.185 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:03.185 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.185 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:03.185 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.152552+0000", 2024-09-12T18:37:03.185 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:03.185 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.186 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.186 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:03.186 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.152552+0000", 2024-09-12T18:37:03.186 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:03.186 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.186 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.186 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:03.186 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.152553+0000", 2024-09-12T18:37:03.186 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.6700000000000003e-07 2024-09-12T18:37:03.186 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.186 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.186 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:03.186 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.152555+0000", 2024-09-12T18:37:03.186 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.6479999999999999e-06 2024-09-12T18:37:03.187 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.187 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.187 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:03.187 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.152563+0000", 2024-09-12T18:37:03.187 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.4139999999999997e-06 2024-09-12T18:37:03.187 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.187 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.187 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:03.187 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.152569+0000", 2024-09-12T18:37:03.187 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4640000000000003e-06 2024-09-12T18:37:03.187 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.187 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.187 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:03.187 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.152641+0000", 2024-09-12T18:37:03.188 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.1680999999999994e-05 2024-09-12T18:37:03.188 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.188 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.188 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:03.188 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.152787+0000", 2024-09-12T18:37:03.188 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000146465 2024-09-12T18:37:03.188 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.188 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.188 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:03.188 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.152899+0000", 2024-09-12T18:37:03.188 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011196600000000001 2024-09-12T18:37:03.188 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:03.188 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:03.188 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:03.189 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.189 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.189 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167328 5.7 5:e11c5a50:::benchmark_data_smithi073_23739_object35051:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:03.189 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.152583+0000", 2024-09-12T18:37:03.189 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0066014899999999998, 2024-09-12T18:37:03.189 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0069799730000000004, 2024-09-12T18:37:03.189 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:03.189 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:03.189 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:03.189 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:03.189 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:03.189 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:03.189 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167328 2024-09-12T18:37:03.189 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.190 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:03.190 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.190 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:03.190 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.152583+0000", 2024-09-12T18:37:03.190 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:03.190 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.190 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.190 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:03.190 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.152583+0000", 2024-09-12T18:37:03.190 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:03.190 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.190 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.190 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:03.190 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.152583+0000", 2024-09-12T18:37:03.191 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6600000000000002e-07 2024-09-12T18:37:03.191 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.191 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.191 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:03.191 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.152586+0000", 2024-09-12T18:37:03.191 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.4439999999999998e-06 2024-09-12T18:37:03.191 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.191 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.191 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:03.191 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.152592+0000", 2024-09-12T18:37:03.191 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.5699999999999998e-06 2024-09-12T18:37:03.191 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.191 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.191 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:03.192 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.152597+0000", 2024-09-12T18:37:03.192 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1619999999999999e-06 2024-09-12T18:37:03.192 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.192 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.192 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:03.192 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.154022+0000", 2024-09-12T18:37:03.192 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0014247190000000001 2024-09-12T18:37:03.192 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.192 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.192 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:03.192 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.154143+0000", 2024-09-12T18:37:03.192 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000121085 2024-09-12T18:37:03.192 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.193 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.193 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:03.193 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.154262+0000", 2024-09-12T18:37:03.193 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000119042 2024-09-12T18:37:03.193 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:03.193 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:03.193 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:03.193 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.193 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.193 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167332 5.f 5:f5b77332:::benchmark_data_smithi073_23739_object35055:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:03.193 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.154890+0000", 2024-09-12T18:37:03.193 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0042945630000000004, 2024-09-12T18:37:03.193 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0047351650000000004, 2024-09-12T18:37:03.193 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:03.194 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:03.194 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:03.194 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:03.194 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:03.194 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:03.194 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167332 2024-09-12T18:37:03.194 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.194 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:03.194 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.194 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:03.194 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.154890+0000", 2024-09-12T18:37:03.194 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:03.194 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.194 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.195 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:03.195 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.154890+0000", 2024-09-12T18:37:03.195 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:03.195 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.195 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.195 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:03.195 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.154891+0000", 2024-09-12T18:37:03.195 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2869999999999999e-06 2024-09-12T18:37:03.195 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.195 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.195 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:03.195 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.154894+0000", 2024-09-12T18:37:03.195 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.2179999999999999e-06 2024-09-12T18:37:03.195 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.196 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.196 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:03.196 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.154902+0000", 2024-09-12T18:37:03.196 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.6569999999999997e-06 2024-09-12T18:37:03.196 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.196 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.196 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:03.196 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.154906+0000", 2024-09-12T18:37:03.196 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4800000000000003e-06 2024-09-12T18:37:03.196 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.196 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.196 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:03.197 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.155612+0000", 2024-09-12T18:37:03.197 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000705468 2024-09-12T18:37:03.197 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.197 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.197 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:03.197 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.155750+0000", 2024-09-12T18:37:03.197 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000138248 2024-09-12T18:37:03.197 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.197 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.197 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:03.197 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.155815+0000", 2024-09-12T18:37:03.197 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4595000000000001e-05 2024-09-12T18:37:03.197 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:03.198 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:03.198 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:03.198 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.198 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.198 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167335 5.7 5:effabb55:::benchmark_data_smithi073_23739_object35058:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:03.198 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.155609+0000", 2024-09-12T18:37:03.198 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.003575323, 2024-09-12T18:37:03.198 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0040784710000000002, 2024-09-12T18:37:03.198 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:03.198 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:03.198 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:03.198 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:03.198 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:03.198 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:03.198 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167335 2024-09-12T18:37:03.199 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.199 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:03.199 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.199 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:03.199 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.155609+0000", 2024-09-12T18:37:03.199 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:03.199 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.199 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.199 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:03.199 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.155609+0000", 2024-09-12T18:37:03.199 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:03.199 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.199 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.200 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:03.200 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.155610+0000", 2024-09-12T18:37:03.200 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.051e-06 2024-09-12T18:37:03.200 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.200 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.200 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:03.200 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.155615+0000", 2024-09-12T18:37:03.200 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8890000000000001e-06 2024-09-12T18:37:03.200 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.200 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.200 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:03.200 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.155626+0000", 2024-09-12T18:37:03.200 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1206000000000001e-05 2024-09-12T18:37:03.200 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.201 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.201 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:03.201 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.155634+0000", 2024-09-12T18:37:03.201 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.9149999999999996e-06 2024-09-12T18:37:03.201 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.201 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.201 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:03.201 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.157855+0000", 2024-09-12T18:37:03.201 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0022212590000000002 2024-09-12T18:37:03.201 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.201 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.201 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:03.201 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.157971+0000", 2024-09-12T18:37:03.202 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011582300000000001 2024-09-12T18:37:03.202 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:03.202 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:03.202 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:03.202 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.158076+0000", 2024-09-12T18:37:03.202 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000104724 2024-09-12T18:37:03.202 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:03.202 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:03.202 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:03.202 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:03.202 INFO:teuthology.orchestra.run.smithi162.stdout: ], 2024-09-12T18:37:03.202 INFO:teuthology.orchestra.run.smithi162.stdout: "num_ops": 10 2024-09-12T18:37:03.202 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:03.204 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:37:03.204 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:03.197+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:03.227 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:37:03.304 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:03.299+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:03.386 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:37:03.387 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:37:03.405 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:37:03.405 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:37:03.405 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:03.397+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:03.411 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:03.411 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [], 2024-09-12T18:37:03.411 INFO:teuthology.orchestra.run.smithi162.stdout: "complaint_time": 30, 2024-09-12T18:37:03.411 INFO:teuthology.orchestra.run.smithi162.stdout: "num_blocked_ops": 0 2024-09-12T18:37:03.411 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:03.424 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:37:03.424 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:37:03.432 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:37:03.505 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:03.499+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:03.509 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is unset 2024-09-12T18:37:03.607 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:03.599+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:03.633 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:03.634 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:03.656 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:37:03.708 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:03.703+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:03.808 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:03.808 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:03.808 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:03.801+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:03.828 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:37:03.909 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:03.901+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:04.010 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:04.005+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:04.025 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:04.025 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:04.044 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:37:04.111 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:04.106+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:04.203 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:04.203 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:04.212 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:04.207+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:04.226 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:37:04.314 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:04.309+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:04.385 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:04.385 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:04.407 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:37:04.414 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:04.406+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:04.515 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:04.506+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:04.603 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:04.603 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:04.618 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:04.615+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:04.626 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:37:04.717 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:04.709+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:04.787 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:04.787 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:04.809 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:37:04.854 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:04.849+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:04.918 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:04.910+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:04.973 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:04.973 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:04.997 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:37:05.019 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:05.013+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:05.119 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:05.114+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:05.161 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:05.161 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:05.181 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:37:05.221 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:05.213+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:05.322 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:05.314+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:05.338 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:05.338 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:05.356 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:37:05.423 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:05.414+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:05.441 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:37:05.513 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:05.513 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:05.523 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:05.517+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:05.531 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T18:37:05.532 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:37:05.595 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:37:05.596 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:37:05.614 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:37:05.614 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:37:05.624 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:05.617+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:05.633 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:37:05.634 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:37:05.725 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:05.717+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:05.731 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:05.731 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2024-09-12T18:37:05.731 INFO:teuthology.orchestra.run.smithi114.stdout: "complaint_time": 30, 2024-09-12T18:37:05.731 INFO:teuthology.orchestra.run.smithi114.stdout: "num_blocked_ops": 0 2024-09-12T18:37:05.731 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:05.752 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:37:05.828 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:05.823+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:05.905 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:05.905 INFO:teuthology.orchestra.run.smithi114.stdout: "size": 20, 2024-09-12T18:37:05.905 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 600, 2024-09-12T18:37:05.905 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:37:05.905 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.906 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:26 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:05.906 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:37:05.906 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 100.27298351500001, 2024-09-12T18:37:05.906 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045702136999999997, 2024-09-12T18:37:05.906 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:05.906 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:05.906 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:05.906 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:05.906 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.906 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:05.906 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:37:05.906 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:05.907 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.907 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.907 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:05.907 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:37:05.907 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:05.907 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.907 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.907 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:05.907 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628699+0000", 2024-09-12T18:37:05.907 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3859999999999999e-06 2024-09-12T18:37:05.907 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.907 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.907 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:05.908 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628706+0000", 2024-09-12T18:37:05.908 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0169999999999999e-06 2024-09-12T18:37:05.908 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.908 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.908 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:05.908 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628725+0000", 2024-09-12T18:37:05.908 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8683000000000001e-05 2024-09-12T18:37:05.908 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.908 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.908 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:05.908 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628740+0000", 2024-09-12T18:37:05.908 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5413999999999998e-05 2024-09-12T18:37:05.909 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.909 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.909 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:05.909 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628907+0000", 2024-09-12T18:37:05.909 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00016670199999999999 2024-09-12T18:37:05.909 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.909 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.909 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:37:05.909 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628917+0000", 2024-09-12T18:37:05.909 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.046e-05 2024-09-12T18:37:05.910 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.910 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.910 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:05.910 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.660390+0000", 2024-09-12T18:37:05.910 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.031472364000000003 2024-09-12T18:37:05.910 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.910 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.910 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:05.910 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.661767+0000", 2024-09-12T18:37:05.910 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0013769190000000001 2024-09-12T18:37:05.910 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.910 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.910 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:05.911 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.662408+0000", 2024-09-12T18:37:05.911 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00064091099999999998 2024-09-12T18:37:05.911 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.911 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.911 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:05.911 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669577+0000", 2024-09-12T18:37:05.911 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.007169412 2024-09-12T18:37:05.911 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.911 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.911 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:05.911 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674244+0000", 2024-09-12T18:37:05.911 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0046671839999999996 2024-09-12T18:37:05.911 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.912 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.912 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:05.912 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674329+0000", 2024-09-12T18:37:05.912 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5276000000000001e-05 2024-09-12T18:37:05.912 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.912 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.912 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:05.912 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674400+0000", 2024-09-12T18:37:05.912 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0408999999999996e-05 2024-09-12T18:37:05.912 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:05.912 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:05.912 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:05.912 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.913 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.913 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:05.913 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:37:05.913 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 100.272559235, 2024-09-12T18:37:05.913 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.046431252999999999, 2024-09-12T18:37:05.913 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:05.913 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:05.913 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:05.913 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:05.913 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.913 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:05.913 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:37:05.914 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:05.914 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.914 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.914 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:05.914 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:37:05.914 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:05.914 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.914 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.914 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:05.914 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629123+0000", 2024-09-12T18:37:05.914 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0899999999999999e-06 2024-09-12T18:37:05.914 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.914 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.915 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:05.915 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629138+0000", 2024-09-12T18:37:05.915 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4977000000000001e-05 2024-09-12T18:37:05.915 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.915 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.915 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:05.915 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629149+0000", 2024-09-12T18:37:05.915 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1182999999999999e-05 2024-09-12T18:37:05.915 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.915 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.915 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:05.915 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629157+0000", 2024-09-12T18:37:05.915 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8129999999999996e-06 2024-09-12T18:37:05.916 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.916 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.916 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:05.916 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629223+0000", 2024-09-12T18:37:05.916 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6463000000000004e-05 2024-09-12T18:37:05.916 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.916 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.916 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:37:05.916 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629230+0000", 2024-09-12T18:37:05.916 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1360000000000002e-06 2024-09-12T18:37:05.916 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.917 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.917 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:05.917 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669605+0000", 2024-09-12T18:37:05.917 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.040375518999999999 2024-09-12T18:37:05.917 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.917 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.917 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:05.917 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669840+0000", 2024-09-12T18:37:05.917 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00023520099999999999 2024-09-12T18:37:05.917 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.917 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.917 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:05.918 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.675553+0000", 2024-09-12T18:37:05.918 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0057128709999999996 2024-09-12T18:37:05.918 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:05.918 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:05.918 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:05.918 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.918 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.918 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167352 5.a 5:5fc472d2:::benchmark_data_smithi073_23739_object35075:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:05.918 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.163066+0000", 2024-09-12T18:37:05.918 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 2.738615539, 2024-09-12T18:37:05.918 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.077708377999999995, 2024-09-12T18:37:05.918 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:05.918 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:05.919 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:05.919 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:05.919 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:05.919 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:05.919 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167352 2024-09-12T18:37:05.919 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.919 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:05.919 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.919 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:05.919 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163066+0000", 2024-09-12T18:37:05.919 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:05.919 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.919 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.920 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:05.920 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163066+0000", 2024-09-12T18:37:05.920 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:05.920 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.920 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.920 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:05.920 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163067+0000", 2024-09-12T18:37:05.920 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0499999999999999e-06 2024-09-12T18:37:05.920 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.920 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.920 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:05.920 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163071+0000", 2024-09-12T18:37:05.920 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4340000000000002e-06 2024-09-12T18:37:05.920 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.921 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.921 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:05.921 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163081+0000", 2024-09-12T18:37:05.921 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0304e-05 2024-09-12T18:37:05.921 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.921 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.921 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:05.921 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163090+0000", 2024-09-12T18:37:05.921 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7309999999999999e-06 2024-09-12T18:37:05.921 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.921 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.921 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:05.922 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163143+0000", 2024-09-12T18:37:05.922 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2942000000000002e-05 2024-09-12T18:37:05.922 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.922 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.922 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:05.922 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163270+0000", 2024-09-12T18:37:05.922 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012664100000000001 2024-09-12T18:37:05.922 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.922 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.922 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:05.922 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163378+0000", 2024-09-12T18:37:05.922 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000107995 2024-09-12T18:37:05.922 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.923 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.923 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:05.923 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234552+0000", 2024-09-12T18:37:05.923 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.071173831000000007 2024-09-12T18:37:05.923 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.923 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.923 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:05.923 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240640+0000", 2024-09-12T18:37:05.923 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.006088909 2024-09-12T18:37:05.923 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.923 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.923 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:05.923 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240709+0000", 2024-09-12T18:37:05.924 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8393999999999996e-05 2024-09-12T18:37:05.924 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.924 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.924 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:05.924 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240774+0000", 2024-09-12T18:37:05.924 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5147000000000005e-05 2024-09-12T18:37:05.924 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:05.924 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:05.924 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:05.924 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.924 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.924 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167358 5.a 5:533f6738:::benchmark_data_smithi073_23739_object35081:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:05.924 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.165639+0000", 2024-09-12T18:37:05.925 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 2.7360422619999998, 2024-09-12T18:37:05.925 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.075287509000000002, 2024-09-12T18:37:05.925 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:05.925 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:05.925 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:05.925 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:05.925 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:05.925 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:05.925 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167358 2024-09-12T18:37:05.925 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.925 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:05.925 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.925 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:05.926 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165639+0000", 2024-09-12T18:37:05.926 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:05.926 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.926 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.926 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:05.926 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165639+0000", 2024-09-12T18:37:05.926 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:05.926 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.926 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.926 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:05.926 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165640+0000", 2024-09-12T18:37:05.926 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1999999999999999e-06 2024-09-12T18:37:05.926 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.926 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.927 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:05.927 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165646+0000", 2024-09-12T18:37:05.927 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4550000000000003e-06 2024-09-12T18:37:05.927 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.927 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.927 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:05.927 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165658+0000", 2024-09-12T18:37:05.927 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2721999999999999e-05 2024-09-12T18:37:05.927 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.927 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.927 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:05.927 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165668+0000", 2024-09-12T18:37:05.927 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4229999999999994e-06 2024-09-12T18:37:05.928 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.928 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.928 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:05.928 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165711+0000", 2024-09-12T18:37:05.928 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3785999999999997e-05 2024-09-12T18:37:05.928 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.928 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.928 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:05.928 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165788+0000", 2024-09-12T18:37:05.928 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6506000000000002e-05 2024-09-12T18:37:05.928 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.928 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.929 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:05.929 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165862+0000", 2024-09-12T18:37:05.929 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4012999999999998e-05 2024-09-12T18:37:05.929 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.929 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.929 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:05.929 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234718+0000", 2024-09-12T18:37:05.929 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.068856420000000002 2024-09-12T18:37:05.929 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.929 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.929 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:05.929 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240785+0000", 2024-09-12T18:37:05.929 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0060661489999999998 2024-09-12T18:37:05.929 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.930 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.930 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:05.930 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240844+0000", 2024-09-12T18:37:05.930 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9487000000000002e-05 2024-09-12T18:37:05.930 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.930 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.930 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:05.930 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240926+0000", 2024-09-12T18:37:05.930 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2348000000000005e-05 2024-09-12T18:37:05.930 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:05.930 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:05.930 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:05.930 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.931 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.931 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167361 5.a 5:56730f28:::benchmark_data_smithi073_23739_object35084:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:05.931 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.165979+0000", 2024-09-12T18:37:05.931 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 2.7357022820000001, 2024-09-12T18:37:05.931 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.075128337000000003, 2024-09-12T18:37:05.931 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:05.931 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:05.931 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:05.931 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:05.931 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:05.931 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:05.931 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167361 2024-09-12T18:37:05.931 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.932 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:05.932 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.932 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:05.932 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165979+0000", 2024-09-12T18:37:05.932 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:05.932 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.932 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.932 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:05.932 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165979+0000", 2024-09-12T18:37:05.932 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:05.932 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.932 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.933 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:05.933 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165980+0000", 2024-09-12T18:37:05.933 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4499999999999997e-07 2024-09-12T18:37:05.933 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.933 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.933 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:05.933 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165985+0000", 2024-09-12T18:37:05.933 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.186e-06 2024-09-12T18:37:05.933 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.933 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.933 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:05.933 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165995+0000", 2024-09-12T18:37:05.933 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0378e-05 2024-09-12T18:37:05.934 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.934 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.934 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:05.934 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.166016+0000", 2024-09-12T18:37:05.934 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1316999999999999e-05 2024-09-12T18:37:05.934 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.934 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.934 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:05.934 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.167783+0000", 2024-09-12T18:37:05.934 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017662209999999999 2024-09-12T18:37:05.934 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.934 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.934 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:05.935 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.167851+0000", 2024-09-12T18:37:05.935 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7990000000000005e-05 2024-09-12T18:37:05.935 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.935 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.935 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:05.935 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.167929+0000", 2024-09-12T18:37:05.935 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8829e-05 2024-09-12T18:37:05.935 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.935 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.935 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:05.935 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234832+0000", 2024-09-12T18:37:05.935 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066902378999999998 2024-09-12T18:37:05.935 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.936 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.936 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:05.936 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240941+0000", 2024-09-12T18:37:05.936 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0061087470000000003 2024-09-12T18:37:05.936 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.936 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.936 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:05.936 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241053+0000", 2024-09-12T18:37:05.936 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00011197299999999999 2024-09-12T18:37:05.936 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.936 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.936 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:05.937 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241107+0000", 2024-09-12T18:37:05.937 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4672000000000001e-05 2024-09-12T18:37:05.937 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:05.937 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:05.937 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:05.937 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.937 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.937 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167362 5.3 5:cbd73b47:::benchmark_data_smithi073_23739_object35085:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:05.937 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:05.937 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 2.7336055670000001, 2024-09-12T18:37:05.937 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.067202411000000004, 2024-09-12T18:37:05.937 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:05.937 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:05.937 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:05.938 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:05.938 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:05.938 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:05.938 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167362 2024-09-12T18:37:05.938 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.938 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:05.938 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.938 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:05.938 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:05.938 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:05.938 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.938 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.939 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:05.939 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:05.939 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:05.939 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.939 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.939 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:05.939 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:05.939 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3600000000000003e-07 2024-09-12T18:37:05.939 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.939 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.939 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:05.939 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168079+0000", 2024-09-12T18:37:05.940 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7949999999999999e-06 2024-09-12T18:37:05.940 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.940 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.940 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:05.940 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168085+0000", 2024-09-12T18:37:05.940 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2110000000000003e-06 2024-09-12T18:37:05.940 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.940 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.940 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:05.940 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168089+0000", 2024-09-12T18:37:05.940 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0840000000000002e-06 2024-09-12T18:37:05.940 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.941 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.941 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:05.941 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168121+0000", 2024-09-12T18:37:05.941 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.1489000000000003e-05 2024-09-12T18:37:05.941 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.941 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.941 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:05.941 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168186+0000", 2024-09-12T18:37:05.941 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5313000000000003e-05 2024-09-12T18:37:05.941 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.941 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.941 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:05.942 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168242+0000", 2024-09-12T18:37:05.942 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5560999999999999e-05 2024-09-12T18:37:05.942 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.942 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.942 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:05.942 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234467+0000", 2024-09-12T18:37:05.942 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066225424000000005 2024-09-12T18:37:05.942 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.942 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.942 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:05.942 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235088+0000", 2024-09-12T18:37:05.942 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00062118999999999998 2024-09-12T18:37:05.942 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.942 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.943 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:05.943 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235197+0000", 2024-09-12T18:37:05.943 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00010825899999999999 2024-09-12T18:37:05.943 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.943 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.943 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:05.943 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235278+0000", 2024-09-12T18:37:05.943 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1448999999999999e-05 2024-09-12T18:37:05.943 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:05.943 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:05.943 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:05.943 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.943 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.944 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167366 5.a 5:58e6a467:::benchmark_data_smithi073_23739_object35089:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:05.944 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168263+0000", 2024-09-12T18:37:05.944 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 2.7334180300000002, 2024-09-12T18:37:05.944 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.078184744, 2024-09-12T18:37:05.944 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:05.944 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:05.944 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:05.944 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:05.944 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:05.944 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:05.944 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167366 2024-09-12T18:37:05.944 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.945 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:05.945 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.945 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:05.945 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168263+0000", 2024-09-12T18:37:05.945 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:05.945 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.945 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.945 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:05.945 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168263+0000", 2024-09-12T18:37:05.945 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:05.945 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.945 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.945 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:05.945 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168264+0000", 2024-09-12T18:37:05.946 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5700000000000002e-07 2024-09-12T18:37:05.946 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.946 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.946 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:05.946 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168266+0000", 2024-09-12T18:37:05.946 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1789999999999998e-06 2024-09-12T18:37:05.946 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.946 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.946 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:05.946 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168271+0000", 2024-09-12T18:37:05.946 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8160000000000001e-06 2024-09-12T18:37:05.946 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.946 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.946 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:05.947 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168275+0000", 2024-09-12T18:37:05.947 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4440000000000001e-06 2024-09-12T18:37:05.947 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.947 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.947 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:05.947 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170082+0000", 2024-09-12T18:37:05.947 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0018068800000000001 2024-09-12T18:37:05.947 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.947 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.947 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:05.947 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170154+0000", 2024-09-12T18:37:05.947 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1575000000000005e-05 2024-09-12T18:37:05.947 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.948 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.948 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:05.948 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170216+0000", 2024-09-12T18:37:05.948 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1989999999999994e-05 2024-09-12T18:37:05.948 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.948 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.948 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:05.948 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234933+0000", 2024-09-12T18:37:05.948 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064717514000000004 2024-09-12T18:37:05.948 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.948 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.948 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:05.948 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246226+0000", 2024-09-12T18:37:05.949 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011293151 2024-09-12T18:37:05.949 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.949 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.949 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:05.949 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246338+0000", 2024-09-12T18:37:05.949 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00011225 2024-09-12T18:37:05.949 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.949 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.949 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:05.949 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246448+0000", 2024-09-12T18:37:05.949 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000109388 2024-09-12T18:37:05.949 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:05.949 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:05.950 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:05.950 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.950 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.950 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167367 5.a 5:51778d97:::benchmark_data_smithi073_23739_object35090:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:05.950 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168388+0000", 2024-09-12T18:37:05.950 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 2.7332927859999998, 2024-09-12T18:37:05.950 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.082583860999999995, 2024-09-12T18:37:05.950 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:05.950 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:05.950 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:05.950 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:05.950 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:05.950 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:05.951 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167367 2024-09-12T18:37:05.951 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.951 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:05.951 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.951 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:05.951 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168388+0000", 2024-09-12T18:37:05.951 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:05.951 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.951 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.951 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:05.951 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168388+0000", 2024-09-12T18:37:05.951 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:05.951 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.951 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.952 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:05.952 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168389+0000", 2024-09-12T18:37:05.952 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1099999999999996e-07 2024-09-12T18:37:05.952 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.952 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.952 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:05.952 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168391+0000", 2024-09-12T18:37:05.952 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.39e-06 2024-09-12T18:37:05.952 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.952 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.952 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:05.952 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168396+0000", 2024-09-12T18:37:05.952 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3460000000000004e-06 2024-09-12T18:37:05.953 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.953 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.953 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:05.953 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168399+0000", 2024-09-12T18:37:05.953 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.613e-06 2024-09-12T18:37:05.953 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.953 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.953 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:05.953 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235003+0000", 2024-09-12T18:37:05.953 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066603851000000006 2024-09-12T18:37:05.953 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.953 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.953 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:05.954 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235266+0000", 2024-09-12T18:37:05.954 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00026270999999999998 2024-09-12T18:37:05.954 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.954 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.954 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:05.954 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235510+0000", 2024-09-12T18:37:05.954 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00024394 2024-09-12T18:37:05.954 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.954 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.954 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:05.954 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246546+0000", 2024-09-12T18:37:05.954 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011035774 2024-09-12T18:37:05.954 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.955 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.955 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:05.955 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.250808+0000", 2024-09-12T18:37:05.955 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0042622700000000003 2024-09-12T18:37:05.955 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.955 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.955 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:05.955 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.250890+0000", 2024-09-12T18:37:05.955 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1874999999999998e-05 2024-09-12T18:37:05.955 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.955 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.955 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:05.955 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.250972+0000", 2024-09-12T18:37:05.955 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2581000000000001e-05 2024-09-12T18:37:05.956 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:05.956 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:05.956 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:05.956 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.956 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.956 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167370 5.a 5:5aab9477:::benchmark_data_smithi073_23739_object35093:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:05.956 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168603+0000", 2024-09-12T18:37:05.956 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 2.733077851, 2024-09-12T18:37:05.956 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.086603794999999997, 2024-09-12T18:37:05.956 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:05.956 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:05.956 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:05.956 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:05.956 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:05.957 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:05.957 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167370 2024-09-12T18:37:05.957 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.957 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:05.957 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.957 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:05.957 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168603+0000", 2024-09-12T18:37:05.957 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:05.957 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.957 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.957 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:05.957 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168603+0000", 2024-09-12T18:37:05.957 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:05.957 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.958 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.958 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:05.958 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168604+0000", 2024-09-12T18:37:05.958 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.1899999999999998e-07 2024-09-12T18:37:05.958 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.958 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.958 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:05.958 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168606+0000", 2024-09-12T18:37:05.958 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8309999999999999e-06 2024-09-12T18:37:05.958 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.958 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.958 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:05.958 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168610+0000", 2024-09-12T18:37:05.958 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8069999999999999e-06 2024-09-12T18:37:05.959 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.959 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.959 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:05.959 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168613+0000", 2024-09-12T18:37:05.959 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.118e-06 2024-09-12T18:37:05.959 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.959 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.959 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:05.959 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241145+0000", 2024-09-12T18:37:05.959 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.072531678000000002 2024-09-12T18:37:05.959 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.959 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.959 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:05.960 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241342+0000", 2024-09-12T18:37:05.960 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00019635900000000001 2024-09-12T18:37:05.960 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.960 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.960 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:05.960 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241483+0000", 2024-09-12T18:37:05.960 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014161100000000001 2024-09-12T18:37:05.960 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.960 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.960 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:05.960 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255039+0000", 2024-09-12T18:37:05.960 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013555724 2024-09-12T18:37:05.960 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.961 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.961 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:05.961 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255062+0000", 2024-09-12T18:37:05.961 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.3042000000000001e-05 2024-09-12T18:37:05.961 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.961 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.961 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:05.961 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255143+0000", 2024-09-12T18:37:05.961 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0999000000000002e-05 2024-09-12T18:37:05.961 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.961 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.961 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:05.961 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255207+0000", 2024-09-12T18:37:05.961 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4207000000000004e-05 2024-09-12T18:37:05.962 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:05.962 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:05.962 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:05.962 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.962 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.962 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167352 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:05.962 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:05.962 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 2.7329531970000001, 2024-09-12T18:37:05.962 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065859953999999998, 2024-09-12T18:37:05.962 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:05.962 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:05.962 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:05.962 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:05.963 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.963 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:05.963 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:05.963 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:05.963 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.963 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.963 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:05.963 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:05.963 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:05.963 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.963 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.963 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:05.963 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:05.964 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.0800000000000001e-07 2024-09-12T18:37:05.964 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.964 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.964 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:05.964 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168730+0000", 2024-09-12T18:37:05.964 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6530000000000001e-06 2024-09-12T18:37:05.964 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.964 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.964 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:05.964 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168734+0000", 2024-09-12T18:37:05.964 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.721e-06 2024-09-12T18:37:05.964 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.964 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.964 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:05.964 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168736+0000", 2024-09-12T18:37:05.965 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.508e-06 2024-09-12T18:37:05.965 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.965 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.965 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:05.965 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171951+0000", 2024-09-12T18:37:05.965 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.003215281 2024-09-12T18:37:05.965 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.965 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.965 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:05.965 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234520+0000", 2024-09-12T18:37:05.965 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062568676000000004 2024-09-12T18:37:05.965 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.965 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.966 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:05.966 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234588+0000", 2024-09-12T18:37:05.966 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7806999999999996e-05 2024-09-12T18:37:05.966 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:05.966 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:05.966 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:05.966 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.966 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.966 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167368 5.4 e58/21 5:29a1ec58:::benchmark_data_smithi073_23739_object35091:head v 58'10399, mlcod=58'10396)", 2024-09-12T18:37:05.966 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:05.966 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 2.7328301800000001, 2024-09-12T18:37:05.966 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066008885000000003, 2024-09-12T18:37:05.966 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:05.966 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:05.966 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:05.967 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:05.967 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.967 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:05.967 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:05.967 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:05.967 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.967 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.967 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:05.967 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:05.967 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:05.967 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.967 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.967 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:05.967 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:05.967 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4699999999999998e-07 2024-09-12T18:37:05.968 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.968 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.968 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:05.968 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168854+0000", 2024-09-12T18:37:05.968 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.3180000000000001e-06 2024-09-12T18:37:05.968 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.968 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.968 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:05.968 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168858+0000", 2024-09-12T18:37:05.968 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2799999999999997e-06 2024-09-12T18:37:05.968 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.968 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.968 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:05.969 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168861+0000", 2024-09-12T18:37:05.969 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7650000000000002e-06 2024-09-12T18:37:05.969 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.969 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.969 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:05.969 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168895+0000", 2024-09-12T18:37:05.969 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4533999999999998e-05 2024-09-12T18:37:05.969 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.969 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.969 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:05.969 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168906+0000", 2024-09-12T18:37:05.969 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0910000000000001e-05 2024-09-12T18:37:05.969 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.970 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.970 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:05.970 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234784+0000", 2024-09-12T18:37:05.970 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065877656000000007 2024-09-12T18:37:05.970 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.970 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.970 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:05.970 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234860+0000", 2024-09-12T18:37:05.970 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6174999999999995e-05 2024-09-12T18:37:05.970 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:05.970 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:05.970 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:05.970 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.970 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.970 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167358 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:05.971 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.170373+0000", 2024-09-12T18:37:05.971 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 2.7313078989999999, 2024-09-12T18:37:05.971 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064370201000000002, 2024-09-12T18:37:05.971 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:05.971 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:05.971 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:05.971 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:05.971 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.971 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:05.971 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170373+0000", 2024-09-12T18:37:05.971 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:05.971 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.971 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.971 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:05.972 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170373+0000", 2024-09-12T18:37:05.972 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:05.972 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.972 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.972 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:05.972 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170374+0000", 2024-09-12T18:37:05.972 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5799999999999998e-07 2024-09-12T18:37:05.972 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.972 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.972 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:05.972 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170378+0000", 2024-09-12T18:37:05.972 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.732e-06 2024-09-12T18:37:05.972 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.973 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.973 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:05.973 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170388+0000", 2024-09-12T18:37:05.973 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0212e-05 2024-09-12T18:37:05.973 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.973 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.973 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:05.973 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170397+0000", 2024-09-12T18:37:05.973 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7090000000000008e-06 2024-09-12T18:37:05.973 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.973 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.973 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:05.973 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234682+0000", 2024-09-12T18:37:05.973 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064285518999999999 2024-09-12T18:37:05.974 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.974 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.974 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:05.974 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234703+0000", 2024-09-12T18:37:05.974 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.0199000000000001e-05 2024-09-12T18:37:05.974 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.974 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.974 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:05.974 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234743+0000", 2024-09-12T18:37:05.974 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0972e-05 2024-09-12T18:37:05.974 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:05.974 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:05.974 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:05.975 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.975 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.975 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167372 5.c 5:398d36a7:::benchmark_data_smithi073_23739_object35095:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:05.975 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171066+0000", 2024-09-12T18:37:05.975 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 2.7306146870000001, 2024-09-12T18:37:05.975 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065889534999999999, 2024-09-12T18:37:05.975 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:05.975 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:05.975 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:05.975 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:05.975 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:05.975 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:05.975 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167372 2024-09-12T18:37:05.975 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.976 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:05.976 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.976 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:05.976 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171066+0000", 2024-09-12T18:37:05.976 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:05.976 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.976 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.976 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:05.976 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171066+0000", 2024-09-12T18:37:05.976 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:05.976 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.976 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.976 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:05.977 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171068+0000", 2024-09-12T18:37:05.977 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.186e-06 2024-09-12T18:37:05.977 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.977 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.977 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:05.977 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171072+0000", 2024-09-12T18:37:05.977 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3560000000000003e-06 2024-09-12T18:37:05.977 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.977 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.977 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:05.977 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171082+0000", 2024-09-12T18:37:05.977 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.9739999999999997e-06 2024-09-12T18:37:05.977 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.978 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.978 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:05.978 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171089+0000", 2024-09-12T18:37:05.978 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7159999999999997e-06 2024-09-12T18:37:05.978 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.978 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.978 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:05.978 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171133+0000", 2024-09-12T18:37:05.978 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4091999999999997e-05 2024-09-12T18:37:05.978 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.978 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.978 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:05.978 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171221+0000", 2024-09-12T18:37:05.978 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.8108000000000004e-05 2024-09-12T18:37:05.979 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.979 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.979 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:05.979 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171279+0000", 2024-09-12T18:37:05.979 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8062000000000001e-05 2024-09-12T18:37:05.979 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.979 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.979 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:05.979 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235007+0000", 2024-09-12T18:37:05.979 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.063727849000000003 2024-09-12T18:37:05.979 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.979 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.980 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:05.980 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236790+0000", 2024-09-12T18:37:05.980 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017829269999999999 2024-09-12T18:37:05.980 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.980 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.980 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:05.980 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236881+0000", 2024-09-12T18:37:05.980 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1347999999999993e-05 2024-09-12T18:37:05.980 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.980 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.980 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:05.980 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236956+0000", 2024-09-12T18:37:05.980 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4917000000000001e-05 2024-09-12T18:37:05.981 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:05.981 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:05.981 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:05.981 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.981 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.981 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167371 5.4 e58/21 5:24fea27c:::benchmark_data_smithi073_23739_object35094:head v 58'10400, mlcod=58'10397)", 2024-09-12T18:37:05.981 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171273+0000", 2024-09-12T18:37:05.981 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 2.7304081130000002, 2024-09-12T18:37:05.981 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065500368000000003, 2024-09-12T18:37:05.981 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:05.981 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:05.981 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:05.981 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:05.982 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.982 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:05.982 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171273+0000", 2024-09-12T18:37:05.982 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:05.982 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.982 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.982 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:05.982 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171273+0000", 2024-09-12T18:37:05.982 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:05.982 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.982 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.982 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:05.982 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171274+0000", 2024-09-12T18:37:05.982 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0399999999999996e-07 2024-09-12T18:37:05.983 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.983 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.983 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:05.983 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171277+0000", 2024-09-12T18:37:05.983 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8689999999999997e-06 2024-09-12T18:37:05.983 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.983 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.983 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:05.983 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171284+0000", 2024-09-12T18:37:05.983 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2879999999999998e-06 2024-09-12T18:37:05.983 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.984 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.984 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:05.984 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171289+0000", 2024-09-12T18:37:05.984 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9049999999999996e-06 2024-09-12T18:37:05.984 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.984 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.984 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:05.984 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171322+0000", 2024-09-12T18:37:05.984 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3781000000000001e-05 2024-09-12T18:37:05.984 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.984 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.985 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:05.985 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171335+0000", 2024-09-12T18:37:05.985 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2639999999999999e-05 2024-09-12T18:37:05.985 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.985 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.985 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:05.985 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236691+0000", 2024-09-12T18:37:05.985 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065355835000000001 2024-09-12T18:37:05.985 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.985 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.985 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:05.985 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236773+0000", 2024-09-12T18:37:05.985 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2546000000000006e-05 2024-09-12T18:37:05.986 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:05.986 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:05.986 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:05.986 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.986 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.986 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167364 5.7 e58/21 5:ee50096a:::benchmark_data_smithi073_23739_object35087:head v 58'10504, mlcod=58'10502)", 2024-09-12T18:37:05.986 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171598+0000", 2024-09-12T18:37:05.986 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 2.730082994, 2024-09-12T18:37:05.986 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065149069000000004, 2024-09-12T18:37:05.986 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:05.986 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:05.986 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:05.986 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:05.987 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.987 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:05.987 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171598+0000", 2024-09-12T18:37:05.987 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:05.987 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.987 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.987 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:05.987 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171598+0000", 2024-09-12T18:37:05.987 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:05.987 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.987 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.987 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:05.988 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171599+0000", 2024-09-12T18:37:05.988 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6700000000000003e-07 2024-09-12T18:37:05.988 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.988 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.988 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:05.988 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171602+0000", 2024-09-12T18:37:05.988 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.841e-06 2024-09-12T18:37:05.988 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.988 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.988 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:05.988 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171608+0000", 2024-09-12T18:37:05.988 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9259999999999997e-06 2024-09-12T18:37:05.988 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.988 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.989 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:05.989 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171611+0000", 2024-09-12T18:37:05.989 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.9450000000000003e-06 2024-09-12T18:37:05.989 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.989 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.989 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:05.989 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171650+0000", 2024-09-12T18:37:05.989 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8464000000000003e-05 2024-09-12T18:37:05.989 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.989 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.989 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:05.989 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171662+0000", 2024-09-12T18:37:05.989 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1603999999999999e-05 2024-09-12T18:37:05.989 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.990 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.990 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:05.990 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236663+0000", 2024-09-12T18:37:05.990 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065001330999999996 2024-09-12T18:37:05.990 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.990 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.990 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:05.990 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236747+0000", 2024-09-12T18:37:05.990 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.4390999999999999e-05 2024-09-12T18:37:05.990 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:05.990 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:05.990 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:05.990 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.991 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.991 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167365 5.2 e58/21 5:4107875c:::benchmark_data_smithi073_23739_object35088:head v 58'10351, mlcod=58'10349)", 2024-09-12T18:37:05.991 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171733+0000", 2024-09-12T18:37:05.991 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 2.729947949, 2024-09-12T18:37:05.991 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.074804168000000004, 2024-09-12T18:37:05.991 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:05.991 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:05.991 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:05.991 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:05.991 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.991 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:05.991 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171733+0000", 2024-09-12T18:37:05.991 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:05.992 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.992 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.992 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:05.992 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171733+0000", 2024-09-12T18:37:05.992 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:05.992 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.992 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.992 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:05.992 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171734+0000", 2024-09-12T18:37:05.992 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9299999999999998e-07 2024-09-12T18:37:05.992 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.992 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.992 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:05.993 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171738+0000", 2024-09-12T18:37:05.993 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.301e-06 2024-09-12T18:37:05.993 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.993 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.993 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:05.993 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171746+0000", 2024-09-12T18:37:05.993 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.554e-06 2024-09-12T18:37:05.993 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.993 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.993 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:05.993 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171751+0000", 2024-09-12T18:37:05.993 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1880000000000001e-06 2024-09-12T18:37:05.993 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.993 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.994 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:05.994 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234659+0000", 2024-09-12T18:37:05.994 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062907807999999996 2024-09-12T18:37:05.994 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.994 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.994 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:05.994 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234708+0000", 2024-09-12T18:37:05.994 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8992000000000001e-05 2024-09-12T18:37:05.994 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.994 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.994 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:05.994 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246457+0000", 2024-09-12T18:37:05.995 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.01174974 2024-09-12T18:37:05.995 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.995 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.995 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:05.995 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246537+0000", 2024-09-12T18:37:05.995 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.9992000000000003e-05 2024-09-12T18:37:05.995 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:05.995 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:05.995 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:05.995 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.995 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.995 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167373 5.5 e58/49 5:ad283029:::benchmark_data_smithi073_23739_object35096:head v 58'10600, mlcod=58'10598)", 2024-09-12T18:37:05.995 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:05.996 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 2.7299204650000002, 2024-09-12T18:37:05.996 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065058240000000003, 2024-09-12T18:37:05.996 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:05.996 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:05.996 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:05.996 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:05.996 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.996 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:05.996 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:05.996 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:05.996 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.997 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.997 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:05.997 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:05.997 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:05.997 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.997 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.997 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:05.997 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:05.997 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.2899999999999999e-07 2024-09-12T18:37:05.997 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.997 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.997 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:05.997 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171764+0000", 2024-09-12T18:37:05.998 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7310000000000002e-06 2024-09-12T18:37:05.998 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.998 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.998 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:05.998 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171769+0000", 2024-09-12T18:37:05.998 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.079e-06 2024-09-12T18:37:05.998 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.998 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.998 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:05.998 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171774+0000", 2024-09-12T18:37:05.998 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.48e-06 2024-09-12T18:37:05.998 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.998 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.999 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:05.999 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171819+0000", 2024-09-12T18:37:05.999 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4391999999999998e-05 2024-09-12T18:37:05.999 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.999 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.999 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:05.999 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171841+0000", 2024-09-12T18:37:05.999 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2245000000000001e-05 2024-09-12T18:37:05.999 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:05.999 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:05.999 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:05.999 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236750+0000", 2024-09-12T18:37:06.000 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064909123999999999 2024-09-12T18:37:06.000 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:06.000 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:06.000 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:06.000 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236819+0000", 2024-09-12T18:37:06.000 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8860000000000001e-05 2024-09-12T18:37:06.000 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:06.000 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:06.000 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:06.000 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:06.000 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:06.000 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167361 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:06.000 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:06.001 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 2.7298645590000001, 2024-09-12T18:37:06.001 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.063049426000000006, 2024-09-12T18:37:06.001 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:06.001 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:06.001 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:06.001 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:06.001 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:06.001 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:06.001 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:06.002 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:06.002 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:06.002 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:06.002 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:06.002 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:06.002 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:06.002 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:06.002 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:06.002 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:06.002 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:06.002 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.9099999999999999e-07 2024-09-12T18:37:06.002 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:06.003 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:06.003 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:06.003 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171820+0000", 2024-09-12T18:37:06.003 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.5900000000000002e-06 2024-09-12T18:37:06.003 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:06.003 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:06.003 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:06.003 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171826+0000", 2024-09-12T18:37:06.003 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.64e-06 2024-09-12T18:37:06.003 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:06.003 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:06.003 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:06.004 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171831+0000", 2024-09-12T18:37:06.004 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.578e-06 2024-09-12T18:37:06.004 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:06.004 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:06.004 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:06.004 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234808+0000", 2024-09-12T18:37:06.004 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062976780999999996 2024-09-12T18:37:06.004 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:06.004 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:06.004 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:06.004 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234821+0000", 2024-09-12T18:37:06.005 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3002e-05 2024-09-12T18:37:06.005 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:06.005 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:06.005 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:06.005 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234866+0000", 2024-09-12T18:37:06.005 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5444000000000001e-05 2024-09-12T18:37:06.005 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:06.005 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:06.005 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:06.005 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:06.005 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:06.005 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167366 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:06.006 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.172133+0000", 2024-09-12T18:37:06.006 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 2.7295477310000003, 2024-09-12T18:37:06.006 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062815840999999997, 2024-09-12T18:37:06.006 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:06.006 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:06.006 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:06.006 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:06.006 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:06.006 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:06.006 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172133+0000", 2024-09-12T18:37:06.007 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:06.007 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:06.007 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:06.007 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:06.007 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172133+0000", 2024-09-12T18:37:06.007 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:06.007 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:06.007 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:06.007 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:06.007 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172134+0000", 2024-09-12T18:37:06.007 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5000000000000003e-07 2024-09-12T18:37:06.007 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:06.008 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:06.008 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:06.008 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172137+0000", 2024-09-12T18:37:06.008 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.6460000000000002e-06 2024-09-12T18:37:06.008 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:06.008 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:06.008 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:06.008 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234511+0000", 2024-09-12T18:37:06.008 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062374603000000001 2024-09-12T18:37:06.008 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:06.008 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:06.008 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:06.008 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234525+0000", 2024-09-12T18:37:06.008 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3396e-05 2024-09-12T18:37:06.009 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:06.009 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:06.009 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:06.009 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234909+0000", 2024-09-12T18:37:06.009 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00038405299999999998 2024-09-12T18:37:06.009 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:06.009 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:06.009 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:06.009 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234922+0000", 2024-09-12T18:37:06.010 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3274e-05 2024-09-12T18:37:06.010 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:06.010 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:06.010 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:06.010 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234949+0000", 2024-09-12T18:37:06.010 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7319000000000001e-05 2024-09-12T18:37:06.010 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:06.010 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:06.010 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:06.010 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:06.010 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:06.010 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167369 5.7 e58/21 5:e64ecabd:::benchmark_data_smithi073_23739_object35092:head v 58'10505, mlcod=58'10502)", 2024-09-12T18:37:06.010 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:06.010 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 2.728017339, 2024-09-12T18:37:06.011 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.063873773999999994, 2024-09-12T18:37:06.011 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:06.011 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:06.011 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:06.011 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:06.011 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:06.011 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:06.011 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:06.011 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:06.011 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:06.011 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:06.011 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:06.012 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:06.012 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:06.012 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:06.012 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:06.012 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:06.012 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:06.012 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3500000000000002e-07 2024-09-12T18:37:06.012 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:06.012 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:06.012 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:06.012 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173668+0000", 2024-09-12T18:37:06.012 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4000000000000001e-06 2024-09-12T18:37:06.012 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:06.013 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:06.013 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:06.013 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234583+0000", 2024-09-12T18:37:06.013 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.060914889 2024-09-12T18:37:06.013 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:06.013 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:06.013 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:06.013 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234600+0000", 2024-09-12T18:37:06.013 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7192000000000001e-05 2024-09-12T18:37:06.013 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:06.013 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:06.013 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:06.013 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234791+0000", 2024-09-12T18:37:06.014 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00019115000000000001 2024-09-12T18:37:06.014 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:06.014 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:06.014 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:06.014 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234834+0000", 2024-09-12T18:37:06.014 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3296e-05 2024-09-12T18:37:06.014 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:06.014 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:06.014 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:06.014 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.237481+0000", 2024-09-12T18:37:06.014 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0026472050000000001 2024-09-12T18:37:06.014 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:06.015 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:06.015 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:06.015 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.237538+0000", 2024-09-12T18:37:06.015 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6206999999999999e-05 2024-09-12T18:37:06.015 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:06.015 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:06.015 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:06.015 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:06.015 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:06.015 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:06.017 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:37:06.018 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:06.009+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:06.118 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:06.110+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:06.175 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:06.175 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:37:06.176 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.176 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:173449 5.d 5:b6b99e8f:::benchmark_data_smithi073_23739_object41172:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T18:37:06.176 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:06.164708+0000", 2024-09-12T18:37:06.176 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0082892590000000002, 2024-09-12T18:37:06.176 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0083158869999999992, 2024-09-12T18:37:06.176 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:06.176 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:06.176 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:06.176 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:06.176 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:06.176 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:06.176 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 173449 2024-09-12T18:37:06.176 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.177 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:06.177 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.177 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:06.177 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.164708+0000", 2024-09-12T18:37:06.177 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.177 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.177 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.177 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:06.177 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.164708+0000", 2024-09-12T18:37:06.177 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.177 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.177 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.177 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:06.178 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.164708+0000", 2024-09-12T18:37:06.178 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6899999999999998e-07 2024-09-12T18:37:06.178 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.178 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.178 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:06.178 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.164711+0000", 2024-09-12T18:37:06.178 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4880000000000001e-06 2024-09-12T18:37:06.178 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.178 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.178 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:06.178 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.164718+0000", 2024-09-12T18:37:06.178 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0790000000000003e-06 2024-09-12T18:37:06.178 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.179 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.179 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:06.179 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.164723+0000", 2024-09-12T18:37:06.179 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1889999999999998e-06 2024-09-12T18:37:06.179 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.179 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.179 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:06.179 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.164767+0000", 2024-09-12T18:37:06.179 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4159000000000002e-05 2024-09-12T18:37:06.179 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.179 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.179 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:06.179 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.164882+0000", 2024-09-12T18:37:06.180 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000114574 2024-09-12T18:37:06.180 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.180 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.180 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:06.180 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.165005+0000", 2024-09-12T18:37:06.180 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000123709 2024-09-12T18:37:06.180 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.180 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.180 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:06.180 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.169785+0000", 2024-09-12T18:37:06.180 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0047800439999999998 2024-09-12T18:37:06.180 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.180 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:06.181 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.181 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.181 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.181 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:173446 5.5 e59/49 5:a3752cab:::benchmark_data_smithi073_23739_object41169:head v 59'11009, mlcod=59'11005)", 2024-09-12T18:37:06.181 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:06.165941+0000", 2024-09-12T18:37:06.181 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0070555260000000003, 2024-09-12T18:37:06.181 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0071666710000000003, 2024-09-12T18:37:06.181 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:06.181 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:06.181 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:37:06.181 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:06.181 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.181 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:06.182 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.165941+0000", 2024-09-12T18:37:06.182 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.182 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.182 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.182 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:06.182 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.165941+0000", 2024-09-12T18:37:06.182 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.182 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.182 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.182 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:06.182 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.165942+0000", 2024-09-12T18:37:06.182 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0100000000000004e-07 2024-09-12T18:37:06.182 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.182 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.183 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:06.183 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.165947+0000", 2024-09-12T18:37:06.183 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9760000000000003e-06 2024-09-12T18:37:06.183 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.183 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.183 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:06.183 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.165956+0000", 2024-09-12T18:37:06.183 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6279999999999994e-06 2024-09-12T18:37:06.183 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.183 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.183 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:06.183 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.165962+0000", 2024-09-12T18:37:06.183 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7290000000000003e-06 2024-09-12T18:37:06.184 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.184 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.184 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:06.184 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.166008+0000", 2024-09-12T18:37:06.184 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5849000000000001e-05 2024-09-12T18:37:06.184 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.184 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.184 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:06.184 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.166028+0000", 2024-09-12T18:37:06.184 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0259999999999999e-05 2024-09-12T18:37:06.184 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.184 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:06.185 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.185 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.185 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.185 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:173459 5.d 5:bfaf387d:::benchmark_data_smithi073_23739_object41182:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T18:37:06.185 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:06.170893+0000", 2024-09-12T18:37:06.185 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0021035910000000001, 2024-09-12T18:37:06.185 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022759680000000002, 2024-09-12T18:37:06.185 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:06.185 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:06.185 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:06.185 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:06.185 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:06.185 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:06.186 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 173459 2024-09-12T18:37:06.186 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.186 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:06.186 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.186 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:06.186 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.170893+0000", 2024-09-12T18:37:06.186 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.186 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.186 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.186 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:06.186 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.170893+0000", 2024-09-12T18:37:06.186 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.186 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.187 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.187 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:06.187 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.170894+0000", 2024-09-12T18:37:06.187 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.124e-06 2024-09-12T18:37:06.187 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.187 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.187 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:06.187 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.170899+0000", 2024-09-12T18:37:06.187 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6290000000000001e-06 2024-09-12T18:37:06.187 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.187 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.187 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:06.187 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.170909+0000", 2024-09-12T18:37:06.187 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5270000000000004e-06 2024-09-12T18:37:06.188 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.188 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.188 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:06.188 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.170915+0000", 2024-09-12T18:37:06.188 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5599999999999999e-06 2024-09-12T18:37:06.188 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.188 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.188 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:06.188 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.171111+0000", 2024-09-12T18:37:06.188 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00019543100000000001 2024-09-12T18:37:06.188 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.188 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.188 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:06.189 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.171257+0000", 2024-09-12T18:37:06.189 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014632800000000001 2024-09-12T18:37:06.189 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.189 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.189 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:06.189 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.171371+0000", 2024-09-12T18:37:06.189 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011461800000000001 2024-09-12T18:37:06.189 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.189 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:06.189 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.189 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.189 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.189 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:173456 5.f e59/21 5:f4c3af33:::benchmark_data_smithi073_23739_object41179:head v 59'10778, mlcod=59'10776)", 2024-09-12T18:37:06.190 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:06.171150+0000", 2024-09-12T18:37:06.190 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.001847266, 2024-09-12T18:37:06.190 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020903990000000002, 2024-09-12T18:37:06.190 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:06.190 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:06.190 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:37:06.190 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:06.190 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.190 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:06.190 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.171150+0000", 2024-09-12T18:37:06.190 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.190 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.190 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.190 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:06.191 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.171150+0000", 2024-09-12T18:37:06.191 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.191 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.191 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.191 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:06.191 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.171150+0000", 2024-09-12T18:37:06.191 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2399999999999998e-07 2024-09-12T18:37:06.191 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.191 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.191 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:06.191 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.171155+0000", 2024-09-12T18:37:06.191 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.87e-06 2024-09-12T18:37:06.191 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.191 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.192 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:06.192 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.171163+0000", 2024-09-12T18:37:06.192 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.8380000000000002e-06 2024-09-12T18:37:06.192 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.192 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.192 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:06.192 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.171169+0000", 2024-09-12T18:37:06.192 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0800000000000002e-06 2024-09-12T18:37:06.192 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.192 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.192 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:06.192 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.171236+0000", 2024-09-12T18:37:06.192 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6885999999999996e-05 2024-09-12T18:37:06.193 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.193 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.193 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:06.193 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.171258+0000", 2024-09-12T18:37:06.193 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2531000000000002e-05 2024-09-12T18:37:06.193 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.193 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:06.193 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.193 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.193 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.193 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:173462 5.0 5:08883256:::benchmark_data_smithi073_23739_object41185:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T18:37:06.193 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:06.171299+0000", 2024-09-12T18:37:06.194 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.001697341, 2024-09-12T18:37:06.194 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020001559999999999, 2024-09-12T18:37:06.194 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:06.194 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:06.194 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:06.194 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:06.194 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:06.194 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:06.194 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 173462 2024-09-12T18:37:06.194 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.194 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:06.194 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.194 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:06.194 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.171299+0000", 2024-09-12T18:37:06.195 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.195 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.195 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.195 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:06.195 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.171299+0000", 2024-09-12T18:37:06.195 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.195 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.195 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.195 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:06.195 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.171300+0000", 2024-09-12T18:37:06.195 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1699999999999997e-07 2024-09-12T18:37:06.195 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.195 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.195 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:06.196 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.171305+0000", 2024-09-12T18:37:06.196 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2930000000000002e-06 2024-09-12T18:37:06.196 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.196 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.196 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:06.196 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.171314+0000", 2024-09-12T18:37:06.196 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.7019999999999996e-06 2024-09-12T18:37:06.196 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.196 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.196 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:06.196 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.171322+0000", 2024-09-12T18:37:06.196 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4939999999999997e-06 2024-09-12T18:37:06.196 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.197 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.197 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:06.197 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.171377+0000", 2024-09-12T18:37:06.197 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4722999999999998e-05 2024-09-12T18:37:06.197 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.197 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.197 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:06.197 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.171505+0000", 2024-09-12T18:37:06.197 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000128379 2024-09-12T18:37:06.197 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.197 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.197 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0,2", 2024-09-12T18:37:06.197 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.171637+0000", 2024-09-12T18:37:06.197 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013210699999999999 2024-09-12T18:37:06.198 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.198 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:06.198 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.198 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.198 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.198 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:173461 5.1 e59/49 5:8a089568:::benchmark_data_smithi073_23739_object41184:head v 59'10817, mlcod=59'10813)", 2024-09-12T18:37:06.198 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:06.172376+0000", 2024-09-12T18:37:06.198 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00062050699999999996, 2024-09-12T18:37:06.198 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00098849900000000011, 2024-09-12T18:37:06.198 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:06.198 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:06.198 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:37:06.199 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:06.199 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.199 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:06.199 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.172376+0000", 2024-09-12T18:37:06.199 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.199 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.199 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.199 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:06.199 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.172376+0000", 2024-09-12T18:37:06.199 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.199 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.199 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.199 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:06.199 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.172377+0000", 2024-09-12T18:37:06.200 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1999999999999998e-07 2024-09-12T18:37:06.200 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.200 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.200 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:06.200 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.172381+0000", 2024-09-12T18:37:06.200 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0069999999999999e-06 2024-09-12T18:37:06.200 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.200 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.200 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:06.200 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.172390+0000", 2024-09-12T18:37:06.200 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.285e-06 2024-09-12T18:37:06.200 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.201 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.201 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:06.201 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.172397+0000", 2024-09-12T18:37:06.201 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1510000000000001e-06 2024-09-12T18:37:06.201 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.201 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.201 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:06.201 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.172445+0000", 2024-09-12T18:37:06.201 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8037000000000001e-05 2024-09-12T18:37:06.201 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.201 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.201 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:06.201 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.172464+0000", 2024-09-12T18:37:06.202 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9745000000000002e-05 2024-09-12T18:37:06.202 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.202 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:06.202 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.202 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.202 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.202 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "MOSDPGPushReply(5.0 59/49 [PushReplyOp(5:0a58a184:::benchmark_data_smithi073_23739_object103172:head)])", 2024-09-12T18:37:06.202 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:06.172435+0000", 2024-09-12T18:37:06.202 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00056212899999999997, 2024-09-12T18:37:06.202 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00098305399999999992, 2024-09-12T18:37:06.202 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:06.202 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:06.203 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:06.203 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:06.203 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.203 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:06.203 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.172435+0000", 2024-09-12T18:37:06.203 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.203 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.203 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.203 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:06.203 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.172435+0000", 2024-09-12T18:37:06.203 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.203 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.203 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.204 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:06.204 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.172435+0000", 2024-09-12T18:37:06.204 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1e-07 2024-09-12T18:37:06.204 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.204 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.204 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:06.204 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.172438+0000", 2024-09-12T18:37:06.204 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7319999999999998e-06 2024-09-12T18:37:06.204 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.204 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.204 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:06.205 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.172445+0000", 2024-09-12T18:37:06.205 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1350000000000003e-06 2024-09-12T18:37:06.205 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.205 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.205 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:06.205 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.172452+0000", 2024-09-12T18:37:06.205 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9020000000000002e-06 2024-09-12T18:37:06.205 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.205 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:06.205 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.205 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.206 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.206 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:173463 5.e 5:73350805:::benchmark_data_smithi073_23739_object41186:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T18:37:06.206 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:06.172475+0000", 2024-09-12T18:37:06.206 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00052141799999999995, 2024-09-12T18:37:06.206 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00099278600000000006, 2024-09-12T18:37:06.206 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:06.206 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:06.206 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:06.206 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:06.206 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:06.206 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:06.206 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 173463 2024-09-12T18:37:06.206 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.207 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:06.207 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.207 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:06.207 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.172475+0000", 2024-09-12T18:37:06.207 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.207 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.207 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.207 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:06.207 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.172475+0000", 2024-09-12T18:37:06.207 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.207 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.207 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.207 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:06.208 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.172476+0000", 2024-09-12T18:37:06.208 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4799999999999998e-07 2024-09-12T18:37:06.208 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.208 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.208 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:06.208 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.172479+0000", 2024-09-12T18:37:06.208 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8729999999999999e-06 2024-09-12T18:37:06.208 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.208 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.208 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:06.208 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.172503+0000", 2024-09-12T18:37:06.208 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3901e-05 2024-09-12T18:37:06.208 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.208 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.209 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:06.209 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.172519+0000", 2024-09-12T18:37:06.209 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6093999999999999e-05 2024-09-12T18:37:06.209 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.209 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.209 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:06.209 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.172577+0000", 2024-09-12T18:37:06.209 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8313999999999998e-05 2024-09-12T18:37:06.209 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.209 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.209 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:06.209 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.172693+0000", 2024-09-12T18:37:06.209 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000116085 2024-09-12T18:37:06.210 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.210 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.210 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:06.210 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.172804+0000", 2024-09-12T18:37:06.210 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000111172 2024-09-12T18:37:06.210 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.210 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:06.210 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.210 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.210 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.211 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:173464 5.d 5:bc3443d2:::benchmark_data_smithi073_23739_object41187:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T18:37:06.211 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:06.172543+0000", 2024-09-12T18:37:06.211 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00045396599999999998, 2024-09-12T18:37:06.211 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00099564199999999992, 2024-09-12T18:37:06.211 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:06.211 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:06.211 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:06.211 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:06.211 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:06.211 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:06.211 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 173464 2024-09-12T18:37:06.211 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.212 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:06.212 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.212 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:06.212 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.172543+0000", 2024-09-12T18:37:06.212 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.212 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.212 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.212 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:06.212 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.172543+0000", 2024-09-12T18:37:06.212 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.212 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.212 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.212 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:06.213 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.172544+0000", 2024-09-12T18:37:06.213 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.105e-06 2024-09-12T18:37:06.213 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.213 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.213 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:06.213 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.172548+0000", 2024-09-12T18:37:06.213 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0210000000000001e-06 2024-09-12T18:37:06.213 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.213 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.213 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:06.213 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.172557+0000", 2024-09-12T18:37:06.213 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8480000000000007e-06 2024-09-12T18:37:06.214 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.214 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.214 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:06.214 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.172563+0000", 2024-09-12T18:37:06.214 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.071e-06 2024-09-12T18:37:06.214 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.214 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.214 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:06.214 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.172978+0000", 2024-09-12T18:37:06.214 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00041515600000000002 2024-09-12T18:37:06.214 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.214 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.214 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:06.215 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.173084+0000", 2024-09-12T18:37:06.215 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010546400000000001 2024-09-12T18:37:06.215 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.215 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.215 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:06.215 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:06.173183+0000", 2024-09-12T18:37:06.215 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9417e-05 2024-09-12T18:37:06.215 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.215 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:06.215 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.215 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.215 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-09-12T18:37:06.215 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 9 2024-09-12T18:37:06.215 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:06.216 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:37:06.218 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:06.210+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:06.319 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:06.310+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:06.377 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:06.377 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-09-12T18:37:06.377 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-09-12T18:37:06.377 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-09-12T18:37:06.377 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:06.401 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:37:06.446 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:06.441+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:06.520 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:06.514+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:06.562 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:06.562 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-09-12T18:37:06.562 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-09-12T18:37:06.562 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:37:06.562 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.562 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:06.562 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:37:06.563 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 100.925113259, 2024-09-12T18:37:06.563 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025088781000000001, 2024-09-12T18:37:06.563 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:06.563 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:06.563 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:06.563 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:06.563 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.563 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:06.563 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:37:06.563 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.563 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.563 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.563 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:06.564 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:37:06.564 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.564 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.564 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.564 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:06.564 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632518+0000", 2024-09-12T18:37:06.564 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:37:06.564 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.564 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.564 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:06.564 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632533+0000", 2024-09-12T18:37:06.564 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5130000000000001e-05 2024-09-12T18:37:06.565 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.565 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.565 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:06.565 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632564+0000", 2024-09-12T18:37:06.565 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0788999999999999e-05 2024-09-12T18:37:06.565 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.565 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.565 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:06.565 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632590+0000", 2024-09-12T18:37:06.565 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6057000000000001e-05 2024-09-12T18:37:06.566 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.566 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.566 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:06.566 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.635931+0000", 2024-09-12T18:37:06.566 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033411320000000001 2024-09-12T18:37:06.566 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.566 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.566 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:06.566 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636186+0000", 2024-09-12T18:37:06.567 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025452500000000002 2024-09-12T18:37:06.567 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.567 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.567 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:06.567 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636445+0000", 2024-09-12T18:37:06.567 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000259268 2024-09-12T18:37:06.567 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.567 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.567 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:06.567 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639562+0000", 2024-09-12T18:37:06.567 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031167 2024-09-12T18:37:06.568 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.568 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.568 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:06.568 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657314+0000", 2024-09-12T18:37:06.568 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017752562 2024-09-12T18:37:06.568 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.568 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.568 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:06.568 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657445+0000", 2024-09-12T18:37:06.568 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013105899999999999 2024-09-12T18:37:06.568 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.568 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.568 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:06.569 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657598+0000", 2024-09-12T18:37:06.569 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015247899999999999 2024-09-12T18:37:06.569 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.569 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:06.569 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.569 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.569 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.569 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:06.569 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:37:06.569 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 100.92498705600001, 2024-09-12T18:37:06.569 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025643131999999999, 2024-09-12T18:37:06.569 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:06.569 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:06.569 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:06.570 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:06.570 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.570 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:06.570 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:37:06.570 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.570 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.570 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.570 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:06.570 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:37:06.570 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.570 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.570 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.571 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:06.571 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632637+0000", 2024-09-12T18:37:06.571 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5600000000000001e-06 2024-09-12T18:37:06.571 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.571 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.571 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:06.571 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632650+0000", 2024-09-12T18:37:06.571 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3186e-05 2024-09-12T18:37:06.571 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.571 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.571 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:06.571 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632672+0000", 2024-09-12T18:37:06.571 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2013000000000001e-05 2024-09-12T18:37:06.572 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.572 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.572 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:06.572 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632687+0000", 2024-09-12T18:37:06.572 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5109999999999999e-05 2024-09-12T18:37:06.572 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.572 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.572 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:06.572 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636994+0000", 2024-09-12T18:37:06.572 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0043065539999999998 2024-09-12T18:37:06.572 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.572 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.573 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:06.573 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637198+0000", 2024-09-12T18:37:06.573 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020387199999999999 2024-09-12T18:37:06.573 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.573 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.573 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:06.573 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637475+0000", 2024-09-12T18:37:06.573 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027731000000000001 2024-09-12T18:37:06.573 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.573 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.573 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:06.573 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639574+0000", 2024-09-12T18:37:06.573 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020988999999999999 2024-09-12T18:37:06.573 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.574 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.574 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:06.574 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658057+0000", 2024-09-12T18:37:06.574 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018482926 2024-09-12T18:37:06.574 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.574 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.574 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:06.574 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658184+0000", 2024-09-12T18:37:06.574 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012756200000000001 2024-09-12T18:37:06.574 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.574 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.574 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:06.574 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658278+0000", 2024-09-12T18:37:06.574 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4139000000000001e-05 2024-09-12T18:37:06.574 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.575 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:06.575 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.575 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.575 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.575 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:06.575 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:37:06.575 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 100.924911964, 2024-09-12T18:37:06.575 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025238883, 2024-09-12T18:37:06.575 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:06.575 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:06.575 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:06.575 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:06.575 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.576 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:06.576 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:37:06.576 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.576 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.576 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.576 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:06.576 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:37:06.576 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.576 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.576 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.576 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:06.576 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632712+0000", 2024-09-12T18:37:06.576 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6869999999999999e-06 2024-09-12T18:37:06.576 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.576 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.577 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:06.577 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632719+0000", 2024-09-12T18:37:06.577 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6059999999999999e-06 2024-09-12T18:37:06.577 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.577 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.577 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:06.577 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632737+0000", 2024-09-12T18:37:06.577 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7983999999999999e-05 2024-09-12T18:37:06.577 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.577 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.578 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:06.578 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632751+0000", 2024-09-12T18:37:06.578 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4473e-05 2024-09-12T18:37:06.578 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.578 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.578 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:06.578 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636961+0000", 2024-09-12T18:37:06.578 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042100840000000002 2024-09-12T18:37:06.578 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.578 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.578 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:06.578 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637211+0000", 2024-09-12T18:37:06.578 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000249738 2024-09-12T18:37:06.578 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.579 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.579 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:06.579 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637504+0000", 2024-09-12T18:37:06.579 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00029271499999999998 2024-09-12T18:37:06.579 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.579 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.579 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:06.579 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639582+0000", 2024-09-12T18:37:06.579 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020783389999999998 2024-09-12T18:37:06.579 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.579 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.579 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:06.579 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657709+0000", 2024-09-12T18:37:06.579 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018126758999999999 2024-09-12T18:37:06.580 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.580 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.580 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:06.580 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657830+0000", 2024-09-12T18:37:06.580 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000121329 2024-09-12T18:37:06.580 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.580 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.580 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:06.580 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657949+0000", 2024-09-12T18:37:06.580 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000119169 2024-09-12T18:37:06.580 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.580 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:06.580 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.580 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.581 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.581 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:06.581 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:37:06.581 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 100.924847918, 2024-09-12T18:37:06.581 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026711823999999999, 2024-09-12T18:37:06.581 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:06.581 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:06.581 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:06.581 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:06.581 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.581 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:06.581 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:37:06.582 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.582 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.582 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.582 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:06.582 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:37:06.582 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.582 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.582 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.582 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:06.582 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632775+0000", 2024-09-12T18:37:06.582 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9999999999999995e-07 2024-09-12T18:37:06.582 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.582 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.582 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:06.583 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632788+0000", 2024-09-12T18:37:06.583 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2629999999999999e-05 2024-09-12T18:37:06.583 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.583 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.583 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:06.583 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632806+0000", 2024-09-12T18:37:06.583 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:37:06.583 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.583 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.583 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:06.583 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632820+0000", 2024-09-12T18:37:06.583 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3777e-05 2024-09-12T18:37:06.583 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.584 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.584 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:06.584 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638310+0000", 2024-09-12T18:37:06.584 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054898280000000004 2024-09-12T18:37:06.584 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.584 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.584 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:06.584 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638480+0000", 2024-09-12T18:37:06.584 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016968199999999999 2024-09-12T18:37:06.584 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.584 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.584 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:06.585 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638799+0000", 2024-09-12T18:37:06.585 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031915999999999997 2024-09-12T18:37:06.585 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.585 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.585 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:06.585 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639866+0000", 2024-09-12T18:37:06.585 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001067405 2024-09-12T18:37:06.585 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.585 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.585 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:06.585 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658398+0000", 2024-09-12T18:37:06.585 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018531542000000002 2024-09-12T18:37:06.585 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.586 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.586 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:06.586 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658643+0000", 2024-09-12T18:37:06.586 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00024531500000000002 2024-09-12T18:37:06.586 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.586 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.586 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:06.586 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.659486+0000", 2024-09-12T18:37:06.586 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00084316899999999995 2024-09-12T18:37:06.586 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.586 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:06.586 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.586 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.587 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.587 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:06.587 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:37:06.587 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 100.924539164, 2024-09-12T18:37:06.587 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026938645000000001, 2024-09-12T18:37:06.587 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:06.587 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:06.587 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:06.587 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:06.587 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.587 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:06.587 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:37:06.587 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.588 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.588 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.588 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:06.588 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:37:06.588 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.588 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.588 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.588 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:06.588 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633085+0000", 2024-09-12T18:37:06.588 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:37:06.588 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.588 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.588 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:06.589 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633093+0000", 2024-09-12T18:37:06.589 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3999999999999992e-06 2024-09-12T18:37:06.589 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.589 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.589 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:06.589 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633111+0000", 2024-09-12T18:37:06.589 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8070000000000001e-05 2024-09-12T18:37:06.589 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.589 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.589 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:06.589 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633126+0000", 2024-09-12T18:37:06.589 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4487e-05 2024-09-12T18:37:06.589 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.590 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.590 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:06.590 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638290+0000", 2024-09-12T18:37:06.590 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0051640269999999999 2024-09-12T18:37:06.590 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.590 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.590 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:06.590 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638547+0000", 2024-09-12T18:37:06.590 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025714100000000001 2024-09-12T18:37:06.590 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.590 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.590 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:06.590 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638850+0000", 2024-09-12T18:37:06.590 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030278400000000001 2024-09-12T18:37:06.590 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.591 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.591 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:06.591 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.640706+0000", 2024-09-12T18:37:06.591 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018564580000000001 2024-09-12T18:37:06.591 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.591 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.591 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:06.591 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658420+0000", 2024-09-12T18:37:06.591 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017714395000000001 2024-09-12T18:37:06.591 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.591 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.591 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:06.591 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658635+0000", 2024-09-12T18:37:06.591 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021413500000000001 2024-09-12T18:37:06.592 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.592 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.592 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:06.592 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.660022+0000", 2024-09-12T18:37:06.592 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001387318 2024-09-12T18:37:06.592 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.592 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:06.592 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.592 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.592 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.592 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121096 5.8 5:13503891:::benchmark_data_smithi073_23739_object121095:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:06.592 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:37:06.592 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 26.379046197000001, 2024-09-12T18:37:06.592 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064025391000000001, 2024-09-12T18:37:06.592 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:06.593 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:06.593 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:06.593 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:06.593 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:06.593 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:06.593 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121096 2024-09-12T18:37:06.593 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.593 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:06.593 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.593 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:06.593 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:37:06.593 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.593 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.593 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.594 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:06.594 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:37:06.594 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.594 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.594 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.594 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:06.594 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178579+0000", 2024-09-12T18:37:06.594 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7369999999999998e-06 2024-09-12T18:37:06.594 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.594 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.594 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:06.594 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178846+0000", 2024-09-12T18:37:06.594 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026752699999999999 2024-09-12T18:37:06.594 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.594 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.595 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:06.595 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178877+0000", 2024-09-12T18:37:06.595 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1081999999999998e-05 2024-09-12T18:37:06.595 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.595 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.595 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:06.595 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178896+0000", 2024-09-12T18:37:06.595 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8522e-05 2024-09-12T18:37:06.595 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.595 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.595 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:06.595 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.192591+0000", 2024-09-12T18:37:06.595 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013695067 2024-09-12T18:37:06.596 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.596 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.596 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:06.596 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.192944+0000", 2024-09-12T18:37:06.596 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00035273699999999999 2024-09-12T18:37:06.596 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.596 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.596 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:06.596 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.193732+0000", 2024-09-12T18:37:06.596 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078849599999999997 2024-09-12T18:37:06.596 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.596 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.596 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:06.597 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.213583+0000", 2024-09-12T18:37:06.597 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.019851164000000001 2024-09-12T18:37:06.597 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.597 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.597 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:06.597 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242386+0000", 2024-09-12T18:37:06.597 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028802924000000001 2024-09-12T18:37:06.597 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.597 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.597 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:06.597 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242501+0000", 2024-09-12T18:37:06.597 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000114932 2024-09-12T18:37:06.598 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.598 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.598 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:06.598 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242602+0000", 2024-09-12T18:37:06.598 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000100203 2024-09-12T18:37:06.598 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.598 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:06.598 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.598 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.598 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.598 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121097 5.8 5:1b31a99e:::benchmark_data_smithi073_23739_object121096:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:06.598 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:37:06.598 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 26.363317906999999, 2024-09-12T18:37:06.598 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048475917, 2024-09-12T18:37:06.599 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:06.599 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:06.599 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:06.599 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:06.599 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:06.599 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:06.599 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121097 2024-09-12T18:37:06.599 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.599 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:06.599 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.599 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:06.599 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:37:06.599 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.599 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.599 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.600 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:06.600 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:37:06.600 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.600 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.600 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.600 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:06.600 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194308+0000", 2024-09-12T18:37:06.600 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2789999999999999e-06 2024-09-12T18:37:06.600 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.600 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.600 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:06.600 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194396+0000", 2024-09-12T18:37:06.600 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8324000000000003e-05 2024-09-12T18:37:06.600 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.601 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.601 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:06.601 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194424+0000", 2024-09-12T18:37:06.601 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7565000000000001e-05 2024-09-12T18:37:06.601 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.601 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.601 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:06.601 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194444+0000", 2024-09-12T18:37:06.601 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0363000000000001e-05 2024-09-12T18:37:06.601 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.601 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.601 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:06.601 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.206888+0000", 2024-09-12T18:37:06.601 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012443997 2024-09-12T18:37:06.602 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.602 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.602 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:06.602 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.207138+0000", 2024-09-12T18:37:06.602 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025035900000000002 2024-09-12T18:37:06.602 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.602 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.602 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:06.602 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.207365+0000", 2024-09-12T18:37:06.602 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000226407 2024-09-12T18:37:06.602 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.602 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.602 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:06.602 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.215059+0000", 2024-09-12T18:37:06.602 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076946860000000001 2024-09-12T18:37:06.603 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.603 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.603 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:06.603 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242619+0000", 2024-09-12T18:37:06.603 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.027559975 2024-09-12T18:37:06.603 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.603 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.603 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:06.603 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242706+0000", 2024-09-12T18:37:06.603 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6384999999999994e-05 2024-09-12T18:37:06.603 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.603 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.603 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:06.604 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242780+0000", 2024-09-12T18:37:06.604 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4577000000000001e-05 2024-09-12T18:37:06.604 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.604 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:06.604 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.604 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.604 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.604 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:121044 5.1 e50/49 5:83bf711a:::benchmark_data_smithi073_23739_object121043:head v 50'7532, mlcod=0'0)", 2024-09-12T18:37:06.604 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.201054+0000", 2024-09-12T18:37:06.604 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 26.356568685999999, 2024-09-12T18:37:06.604 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026157387000000001, 2024-09-12T18:37:06.604 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:06.604 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:06.605 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:06.605 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:06.605 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.605 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:06.605 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201054+0000", 2024-09-12T18:37:06.605 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.605 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.605 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.605 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:06.605 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201054+0000", 2024-09-12T18:37:06.605 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.605 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.605 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.606 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:06.606 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201056+0000", 2024-09-12T18:37:06.606 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.99e-06 2024-09-12T18:37:06.606 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.606 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.606 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:06.606 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201068+0000", 2024-09-12T18:37:06.606 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2799000000000001e-05 2024-09-12T18:37:06.606 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.606 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.606 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:06.606 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201093+0000", 2024-09-12T18:37:06.606 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4766e-05 2024-09-12T18:37:06.606 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.607 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.607 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:06.607 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201115+0000", 2024-09-12T18:37:06.607 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1988999999999999e-05 2024-09-12T18:37:06.607 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.607 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.607 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:06.607 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201233+0000", 2024-09-12T18:37:06.607 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000118229 2024-09-12T18:37:06.607 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.608 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.608 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:06.608 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201273+0000", 2024-09-12T18:37:06.608 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9171999999999997e-05 2024-09-12T18:37:06.608 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.608 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.608 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:06.608 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.227080+0000", 2024-09-12T18:37:06.608 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025807611000000001 2024-09-12T18:37:06.608 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.608 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.608 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:06.608 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.227211+0000", 2024-09-12T18:37:06.609 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013083100000000001 2024-09-12T18:37:06.609 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.609 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:06.609 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.609 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.609 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.609 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121101 5.e 5:7e18e9ed:::benchmark_data_smithi073_23739_object121100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:06.609 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.209084+0000", 2024-09-12T18:37:06.609 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 26.348537852, 2024-09-12T18:37:06.609 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028988566, 2024-09-12T18:37:06.609 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:06.609 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:06.609 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:06.610 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:06.610 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:06.610 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:06.610 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121101 2024-09-12T18:37:06.610 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.610 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:06.610 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.610 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:06.610 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209084+0000", 2024-09-12T18:37:06.610 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.610 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.610 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.610 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:06.611 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209084+0000", 2024-09-12T18:37:06.611 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.611 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.611 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.611 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:06.611 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209087+0000", 2024-09-12T18:37:06.611 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6800000000000002e-06 2024-09-12T18:37:06.611 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.611 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.611 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:06.611 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209182+0000", 2024-09-12T18:37:06.611 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5084e-05 2024-09-12T18:37:06.611 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.612 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.612 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:06.612 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209212+0000", 2024-09-12T18:37:06.612 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9825e-05 2024-09-12T18:37:06.612 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.612 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.612 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:06.612 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209234+0000", 2024-09-12T18:37:06.612 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1416e-05 2024-09-12T18:37:06.612 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.612 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.612 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:06.612 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209497+0000", 2024-09-12T18:37:06.613 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026390400000000003 2024-09-12T18:37:06.613 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.613 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.613 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:06.613 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209810+0000", 2024-09-12T18:37:06.613 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000313023 2024-09-12T18:37:06.613 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.613 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.613 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:06.613 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.210468+0000", 2024-09-12T18:37:06.613 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00065779300000000005 2024-09-12T18:37:06.613 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.613 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.614 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:06.614 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.235905+0000", 2024-09-12T18:37:06.614 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025436881000000001 2024-09-12T18:37:06.614 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.614 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.614 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:06.614 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237797+0000", 2024-09-12T18:37:06.614 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001892007 2024-09-12T18:37:06.614 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.614 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.614 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:06.614 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237941+0000", 2024-09-12T18:37:06.614 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000143411 2024-09-12T18:37:06.615 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.615 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.615 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:06.615 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.238073+0000", 2024-09-12T18:37:06.615 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013254200000000001 2024-09-12T18:37:06.615 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.615 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:06.615 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.615 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.615 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.615 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121102 5.8 5:1f118f4b:::benchmark_data_smithi073_23739_object121101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:06.615 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.218682+0000", 2024-09-12T18:37:06.615 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 26.338940491999999, 2024-09-12T18:37:06.616 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024264885, 2024-09-12T18:37:06.616 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:06.616 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:06.616 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:06.616 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:06.616 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:06.616 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:06.616 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121102 2024-09-12T18:37:06.616 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.616 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:06.616 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.616 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:06.616 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218682+0000", 2024-09-12T18:37:06.616 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.617 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.617 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.617 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:06.617 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218682+0000", 2024-09-12T18:37:06.617 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.617 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.617 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.617 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:06.617 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218685+0000", 2024-09-12T18:37:06.617 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6059999999999999e-06 2024-09-12T18:37:06.617 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.617 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.617 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:06.618 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218743+0000", 2024-09-12T18:37:06.618 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7160999999999997e-05 2024-09-12T18:37:06.618 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.618 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.618 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:06.618 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218768+0000", 2024-09-12T18:37:06.618 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5052e-05 2024-09-12T18:37:06.618 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.618 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.618 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:06.618 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218785+0000", 2024-09-12T18:37:06.618 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7436999999999999e-05 2024-09-12T18:37:06.618 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.618 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.619 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:06.619 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218952+0000", 2024-09-12T18:37:06.619 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016691300000000001 2024-09-12T18:37:06.619 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.619 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.619 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:06.619 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.219437+0000", 2024-09-12T18:37:06.619 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048465900000000002 2024-09-12T18:37:06.619 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.619 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.619 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:06.619 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.219893+0000", 2024-09-12T18:37:06.619 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00045642799999999999 2024-09-12T18:37:06.620 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.620 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.620 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:06.620 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.226416+0000", 2024-09-12T18:37:06.620 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065225630000000003 2024-09-12T18:37:06.620 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.620 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.620 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:06.620 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242796+0000", 2024-09-12T18:37:06.620 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016379857000000001 2024-09-12T18:37:06.620 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.620 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.620 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:06.621 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242879+0000", 2024-09-12T18:37:06.621 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3913999999999997e-05 2024-09-12T18:37:06.621 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.621 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.621 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:06.621 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242947+0000", 2024-09-12T18:37:06.621 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7294999999999999e-05 2024-09-12T18:37:06.621 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.621 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:06.621 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.621 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.621 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.621 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121106 5.d 5:b4a9a221:::benchmark_data_smithi073_23739_object121105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:06.621 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:37:06.621 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 26.320442970999999, 2024-09-12T18:37:06.622 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.034882274999999997, 2024-09-12T18:37:06.622 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:06.622 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:06.622 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:06.622 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:06.622 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:06.622 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:06.622 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121106 2024-09-12T18:37:06.622 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.622 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:06.622 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.622 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:06.622 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:37:06.623 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.623 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.623 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.623 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:06.623 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:37:06.623 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.623 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.623 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.623 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:06.623 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237182+0000", 2024-09-12T18:37:06.623 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6019999999999998e-06 2024-09-12T18:37:06.623 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.623 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.623 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:06.623 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237257+0000", 2024-09-12T18:37:06.624 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5420999999999995e-05 2024-09-12T18:37:06.624 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.624 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.624 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:06.624 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237305+0000", 2024-09-12T18:37:06.624 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7207999999999999e-05 2024-09-12T18:37:06.624 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.624 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.624 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:06.624 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237325+0000", 2024-09-12T18:37:06.624 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0001e-05 2024-09-12T18:37:06.624 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.624 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.625 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:06.625 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237505+0000", 2024-09-12T18:37:06.625 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000180798 2024-09-12T18:37:06.625 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.625 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.625 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:06.625 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237764+0000", 2024-09-12T18:37:06.625 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025862299999999998 2024-09-12T18:37:06.625 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.625 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.625 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:06.625 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.238264+0000", 2024-09-12T18:37:06.625 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00050016100000000005 2024-09-12T18:37:06.626 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.626 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.626 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:06.626 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256525+0000", 2024-09-12T18:37:06.626 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018260508000000002 2024-09-12T18:37:06.626 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.626 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.626 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:06.626 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.271903+0000", 2024-09-12T18:37:06.626 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015378739000000001 2024-09-12T18:37:06.626 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.626 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.626 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:06.626 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.271999+0000", 2024-09-12T18:37:06.627 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5989000000000005e-05 2024-09-12T18:37:06.627 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.627 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.627 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:06.627 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272062+0000", 2024-09-12T18:37:06.627 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2224999999999995e-05 2024-09-12T18:37:06.627 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.627 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:06.627 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.627 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.627 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.627 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121112 5.d 5:b9a2d671:::benchmark_data_smithi073_23739_object121111:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:06.627 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.243446+0000", 2024-09-12T18:37:06.627 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 26.314176245999999, 2024-09-12T18:37:06.628 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.02889415, 2024-09-12T18:37:06.628 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:06.628 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:06.628 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:06.628 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:06.628 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:06.628 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:06.628 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121112 2024-09-12T18:37:06.628 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.628 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:06.628 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.628 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:06.628 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243446+0000", 2024-09-12T18:37:06.628 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.628 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.629 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.629 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:06.629 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243446+0000", 2024-09-12T18:37:06.629 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.629 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.629 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.629 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:06.629 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243448+0000", 2024-09-12T18:37:06.629 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0829999999999998e-06 2024-09-12T18:37:06.629 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.629 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.629 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:06.629 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243527+0000", 2024-09-12T18:37:06.629 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9173999999999998e-05 2024-09-12T18:37:06.630 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.630 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.630 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:06.630 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243549+0000", 2024-09-12T18:37:06.630 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1169e-05 2024-09-12T18:37:06.630 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.630 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.630 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:06.630 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243564+0000", 2024-09-12T18:37:06.630 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5866999999999999e-05 2024-09-12T18:37:06.630 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.630 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.630 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:06.630 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.249905+0000", 2024-09-12T18:37:06.630 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063410360000000004 2024-09-12T18:37:06.631 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.631 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.631 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:06.631 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.250166+0000", 2024-09-12T18:37:06.631 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026052999999999997 2024-09-12T18:37:06.631 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.631 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.631 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:06.631 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.250486+0000", 2024-09-12T18:37:06.631 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00032002700000000002 2024-09-12T18:37:06.631 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.631 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.631 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:06.631 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.259263+0000", 2024-09-12T18:37:06.631 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0087774770000000005 2024-09-12T18:37:06.632 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.632 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.632 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:06.632 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272186+0000", 2024-09-12T18:37:06.632 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.01292213 2024-09-12T18:37:06.632 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.632 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.632 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:06.632 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272267+0000", 2024-09-12T18:37:06.632 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1153e-05 2024-09-12T18:37:06.632 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.632 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.632 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:06.632 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272340+0000", 2024-09-12T18:37:06.633 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3504000000000006e-05 2024-09-12T18:37:06.633 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.633 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:06.633 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.633 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.633 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.633 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121114 5.d 5:b8870c11:::benchmark_data_smithi073_23739_object121113:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:06.633 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.243603+0000", 2024-09-12T18:37:06.633 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 26.314018995000001, 2024-09-12T18:37:06.633 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028945746000000001, 2024-09-12T18:37:06.633 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:06.633 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:06.633 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:06.633 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:06.634 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:06.634 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:06.634 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121114 2024-09-12T18:37:06.634 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.634 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:06.634 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.634 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:06.634 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243603+0000", 2024-09-12T18:37:06.634 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.634 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.634 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.634 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:06.634 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243603+0000", 2024-09-12T18:37:06.635 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.635 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.635 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.635 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:06.635 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243605+0000", 2024-09-12T18:37:06.635 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.268e-06 2024-09-12T18:37:06.635 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.635 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.635 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:06.635 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243674+0000", 2024-09-12T18:37:06.635 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9375000000000006e-05 2024-09-12T18:37:06.635 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.635 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.636 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:06.636 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243691+0000", 2024-09-12T18:37:06.636 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6517000000000001e-05 2024-09-12T18:37:06.636 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.636 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.636 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:06.636 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243702+0000", 2024-09-12T18:37:06.636 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1905999999999999e-05 2024-09-12T18:37:06.636 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.636 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.636 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:06.636 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.253789+0000", 2024-09-12T18:37:06.637 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.010086776 2024-09-12T18:37:06.637 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.637 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.637 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:06.637 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.253959+0000", 2024-09-12T18:37:06.637 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00017000000000000001 2024-09-12T18:37:06.637 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.637 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.637 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:06.637 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.254179+0000", 2024-09-12T18:37:06.637 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022003699999999999 2024-09-12T18:37:06.637 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.637 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.638 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:06.638 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.259330+0000", 2024-09-12T18:37:06.638 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0051511559999999996 2024-09-12T18:37:06.638 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.638 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.638 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:06.638 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272403+0000", 2024-09-12T18:37:06.638 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013072342000000001 2024-09-12T18:37:06.638 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.638 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.638 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:06.638 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272493+0000", 2024-09-12T18:37:06.639 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0595999999999998e-05 2024-09-12T18:37:06.639 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.639 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.639 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:06.639 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272549+0000", 2024-09-12T18:37:06.639 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5773000000000003e-05 2024-09-12T18:37:06.639 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.639 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:06.639 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.639 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.640 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.640 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121115 5.d 5:bd4a51ea:::benchmark_data_smithi073_23739_object121114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:06.640 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.245059+0000", 2024-09-12T18:37:06.640 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 26.312563320999999, 2024-09-12T18:37:06.640 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.02767406, 2024-09-12T18:37:06.640 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:06.640 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:06.640 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:06.640 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:06.640 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:06.640 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:06.640 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121115 2024-09-12T18:37:06.640 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.641 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:06.641 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.641 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:06.641 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245059+0000", 2024-09-12T18:37:06.641 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.641 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.641 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.641 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:06.641 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245059+0000", 2024-09-12T18:37:06.641 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.641 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.641 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.642 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:06.642 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245061+0000", 2024-09-12T18:37:06.642 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9759999999999998e-06 2024-09-12T18:37:06.642 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.642 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.642 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:06.642 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245111+0000", 2024-09-12T18:37:06.642 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9838e-05 2024-09-12T18:37:06.642 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.642 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.642 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:06.642 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245132+0000", 2024-09-12T18:37:06.642 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1469999999999999e-05 2024-09-12T18:37:06.643 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.643 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.643 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:06.643 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245146+0000", 2024-09-12T18:37:06.643 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3377000000000001e-05 2024-09-12T18:37:06.643 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.643 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.643 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:06.643 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256596+0000", 2024-09-12T18:37:06.643 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011450241999999999 2024-09-12T18:37:06.643 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.643 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.643 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:06.644 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256838+0000", 2024-09-12T18:37:06.644 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000242255 2024-09-12T18:37:06.644 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.644 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.644 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:06.644 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.257095+0000", 2024-09-12T18:37:06.644 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025679300000000001 2024-09-12T18:37:06.644 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.644 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.644 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:06.644 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.259928+0000", 2024-09-12T18:37:06.644 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0028326290000000001 2024-09-12T18:37:06.644 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.645 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.645 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:06.645 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272607+0000", 2024-09-12T18:37:06.645 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012679466 2024-09-12T18:37:06.645 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.645 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.645 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:06.645 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272681+0000", 2024-09-12T18:37:06.645 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3580999999999999e-05 2024-09-12T18:37:06.645 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.645 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.645 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:06.645 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272733+0000", 2024-09-12T18:37:06.646 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2432999999999998e-05 2024-09-12T18:37:06.646 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.646 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:06.646 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.646 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.646 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.646 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121148 5.4 5:2a9bde06:::benchmark_data_smithi073_23739_object121147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:06.646 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.281423+0000", 2024-09-12T18:37:06.646 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 26.276199679000001, 2024-09-12T18:37:06.646 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025774785000000001, 2024-09-12T18:37:06.646 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:06.646 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:06.646 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:06.646 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:06.646 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:06.647 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:06.647 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121148 2024-09-12T18:37:06.647 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.647 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:06.647 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.647 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:06.647 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281423+0000", 2024-09-12T18:37:06.647 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.647 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.647 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.647 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:06.647 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281423+0000", 2024-09-12T18:37:06.647 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.648 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.648 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.648 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:06.648 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281424+0000", 2024-09-12T18:37:06.648 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.048e-06 2024-09-12T18:37:06.648 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.648 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.648 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:06.648 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281496+0000", 2024-09-12T18:37:06.648 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2099000000000002e-05 2024-09-12T18:37:06.648 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.648 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.648 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:06.649 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281509+0000", 2024-09-12T18:37:06.649 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3379e-05 2024-09-12T18:37:06.649 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.649 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.649 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:06.649 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281515+0000", 2024-09-12T18:37:06.649 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.28e-06 2024-09-12T18:37:06.649 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.649 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.649 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:06.649 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281688+0000", 2024-09-12T18:37:06.649 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00017203100000000001 2024-09-12T18:37:06.649 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.649 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.650 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:06.650 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281834+0000", 2024-09-12T18:37:06.650 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014645899999999999 2024-09-12T18:37:06.650 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.650 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.650 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:06.650 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.282319+0000", 2024-09-12T18:37:06.650 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048535000000000001 2024-09-12T18:37:06.650 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.650 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.650 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:06.650 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307086+0000", 2024-09-12T18:37:06.650 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024766989999999999 2024-09-12T18:37:06.650 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.651 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.651 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:06.651 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307108+0000", 2024-09-12T18:37:06.651 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1795999999999999e-05 2024-09-12T18:37:06.651 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.651 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.651 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:06.651 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307157+0000", 2024-09-12T18:37:06.651 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8729000000000001e-05 2024-09-12T18:37:06.651 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.651 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.651 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:06.651 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307197+0000", 2024-09-12T18:37:06.652 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0624000000000003e-05 2024-09-12T18:37:06.652 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.652 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:06.652 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.652 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.652 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.652 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121155 5.4 5:2af257d1:::benchmark_data_smithi073_23739_object121154:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:06.652 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.283163+0000", 2024-09-12T18:37:06.652 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 26.274459004000001, 2024-09-12T18:37:06.652 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024186485000000001, 2024-09-12T18:37:06.652 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:06.652 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:06.652 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:06.652 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:06.652 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:06.653 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:06.653 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121155 2024-09-12T18:37:06.653 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.653 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:06.653 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.653 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:06.653 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283163+0000", 2024-09-12T18:37:06.653 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.653 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.653 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.653 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:06.653 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283163+0000", 2024-09-12T18:37:06.653 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.654 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.654 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.654 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:06.654 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283165+0000", 2024-09-12T18:37:06.654 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.748e-06 2024-09-12T18:37:06.654 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.654 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.654 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:06.654 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283218+0000", 2024-09-12T18:37:06.654 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2695000000000003e-05 2024-09-12T18:37:06.654 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.654 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.654 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:06.655 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283244+0000", 2024-09-12T18:37:06.655 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6072e-05 2024-09-12T18:37:06.655 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.655 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.655 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:06.655 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283257+0000", 2024-09-12T18:37:06.655 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3054000000000001e-05 2024-09-12T18:37:06.655 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.655 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.655 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:06.655 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.294509+0000", 2024-09-12T18:37:06.655 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011251677999999999 2024-09-12T18:37:06.656 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.656 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.656 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:06.656 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.294705+0000", 2024-09-12T18:37:06.656 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000196369 2024-09-12T18:37:06.656 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.656 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.656 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:06.656 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.294907+0000", 2024-09-12T18:37:06.656 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020184700000000001 2024-09-12T18:37:06.656 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.656 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.656 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:06.656 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307208+0000", 2024-09-12T18:37:06.656 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012301068 2024-09-12T18:37:06.657 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.657 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.657 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:06.657 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307273+0000", 2024-09-12T18:37:06.657 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5611000000000006e-05 2024-09-12T18:37:06.657 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.657 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.657 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:06.657 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307320+0000", 2024-09-12T18:37:06.657 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6220999999999997e-05 2024-09-12T18:37:06.657 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.657 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.657 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:06.658 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307350+0000", 2024-09-12T18:37:06.658 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0122000000000001e-05 2024-09-12T18:37:06.658 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.658 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:06.658 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.658 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.658 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.658 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121160 5.b 5:d4730c8e:::benchmark_data_smithi073_23739_object121159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:06.658 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.289262+0000", 2024-09-12T18:37:06.658 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 26.268359988, 2024-09-12T18:37:06.658 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024618870000000001, 2024-09-12T18:37:06.658 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:06.658 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:06.658 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:06.658 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:06.659 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:06.659 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:06.659 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121160 2024-09-12T18:37:06.659 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.659 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:06.659 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.659 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:06.659 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289262+0000", 2024-09-12T18:37:06.659 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.659 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.659 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.659 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:06.659 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289262+0000", 2024-09-12T18:37:06.660 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.660 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.660 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.660 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:06.660 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289264+0000", 2024-09-12T18:37:06.660 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.945e-06 2024-09-12T18:37:06.660 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.660 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.660 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:06.660 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289331+0000", 2024-09-12T18:37:06.660 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6594999999999995e-05 2024-09-12T18:37:06.660 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.660 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.660 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:06.661 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289359+0000", 2024-09-12T18:37:06.661 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7988999999999999e-05 2024-09-12T18:37:06.661 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.661 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.661 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:06.661 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289375+0000", 2024-09-12T18:37:06.661 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5639000000000001e-05 2024-09-12T18:37:06.661 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.661 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.661 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:06.661 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289515+0000", 2024-09-12T18:37:06.661 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000140254 2024-09-12T18:37:06.661 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.661 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.662 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:06.662 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289740+0000", 2024-09-12T18:37:06.662 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022513500000000001 2024-09-12T18:37:06.662 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.662 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.662 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:06.662 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.290232+0000", 2024-09-12T18:37:06.662 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00049247500000000003 2024-09-12T18:37:06.662 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.662 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.662 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:06.662 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.312221+0000", 2024-09-12T18:37:06.662 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.021988939999999998 2024-09-12T18:37:06.662 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.663 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.663 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:06.663 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.313807+0000", 2024-09-12T18:37:06.663 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015859100000000001 2024-09-12T18:37:06.663 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.663 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.663 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:06.663 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.313852+0000", 2024-09-12T18:37:06.663 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4305999999999999e-05 2024-09-12T18:37:06.663 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.663 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.663 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:06.663 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.313881+0000", 2024-09-12T18:37:06.664 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9682000000000001e-05 2024-09-12T18:37:06.664 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.664 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:06.664 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.664 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.664 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.664 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:131551 5.d 5:b8f8c77a:::benchmark_data_smithi073_23739_object131550:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:37:06.664 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:45.499878+0000", 2024-09-12T18:37:06.664 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 21.057744057000001, 2024-09-12T18:37:06.664 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.027478433, 2024-09-12T18:37:06.664 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:06.664 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:06.664 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:06.664 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:06.665 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:06.665 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:06.665 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 131551 2024-09-12T18:37:06.665 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.665 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:06.665 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.665 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:06.665 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499878+0000", 2024-09-12T18:37:06.665 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.665 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.665 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.665 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:06.665 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499878+0000", 2024-09-12T18:37:06.666 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.666 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.666 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.666 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:06.666 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499879+0000", 2024-09-12T18:37:06.666 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.92e-07 2024-09-12T18:37:06.666 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.666 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.666 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:06.666 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499946+0000", 2024-09-12T18:37:06.666 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6712999999999996e-05 2024-09-12T18:37:06.666 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.666 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.666 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:06.667 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499953+0000", 2024-09-12T18:37:06.667 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5519999999999999e-06 2024-09-12T18:37:06.667 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.667 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.667 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:06.667 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499959+0000", 2024-09-12T18:37:06.667 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0430000000000004e-06 2024-09-12T18:37:06.667 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.667 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.667 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:06.667 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.500004+0000", 2024-09-12T18:37:06.667 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5058000000000001e-05 2024-09-12T18:37:06.667 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.667 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.667 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:06.668 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.500121+0000", 2024-09-12T18:37:06.668 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000116747 2024-09-12T18:37:06.668 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.668 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.668 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:06.668 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.500283+0000", 2024-09-12T18:37:06.668 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016190599999999999 2024-09-12T18:37:06.668 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.668 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.668 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:06.668 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.504017+0000", 2024-09-12T18:37:06.668 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003734125 2024-09-12T18:37:06.668 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.669 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.669 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:06.669 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.527224+0000", 2024-09-12T18:37:06.669 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.023206724000000001 2024-09-12T18:37:06.669 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.669 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.669 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:06.669 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.527290+0000", 2024-09-12T18:37:06.669 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5778999999999995e-05 2024-09-12T18:37:06.669 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.669 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.669 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:06.669 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.527357+0000", 2024-09-12T18:37:06.669 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7094000000000005e-05 2024-09-12T18:37:06.670 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.670 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:06.670 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.670 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.670 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.670 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:167368 5.4 5:29a1ec58:::benchmark_data_smithi073_23739_object35091:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:06.670 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:03.168773+0000", 2024-09-12T18:37:06.670 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 3.3888491040000002, 2024-09-12T18:37:06.670 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.066578597000000003, 2024-09-12T18:37:06.670 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:06.670 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:06.670 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:06.670 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:06.670 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:06.671 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:06.671 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 167368 2024-09-12T18:37:06.671 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.671 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:06.671 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.671 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:06.671 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168773+0000", 2024-09-12T18:37:06.671 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.671 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.671 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.671 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:06.671 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168773+0000", 2024-09-12T18:37:06.671 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.671 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.671 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.672 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:06.672 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168774+0000", 2024-09-12T18:37:06.672 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.023e-06 2024-09-12T18:37:06.672 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.672 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.672 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:06.672 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168779+0000", 2024-09-12T18:37:06.672 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5800000000000002e-06 2024-09-12T18:37:06.672 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.672 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.672 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:06.672 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168789+0000", 2024-09-12T18:37:06.672 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0346999999999999e-05 2024-09-12T18:37:06.672 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.672 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.673 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:06.673 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168808+0000", 2024-09-12T18:37:06.673 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8423e-05 2024-09-12T18:37:06.673 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.673 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.673 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:06.673 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168864+0000", 2024-09-12T18:37:06.673 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-09-12T18:37:06.673 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.673 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.673 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:06.673 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168947+0000", 2024-09-12T18:37:06.673 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3274000000000003e-05 2024-09-12T18:37:06.673 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.673 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.674 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:06.674 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.169014+0000", 2024-09-12T18:37:06.674 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6284000000000004e-05 2024-09-12T18:37:06.674 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.674 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.674 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:06.674 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.170653+0000", 2024-09-12T18:37:06.674 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016389779999999999 2024-09-12T18:37:06.674 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.674 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.674 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:06.674 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.235279+0000", 2024-09-12T18:37:06.674 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064626464999999994 2024-09-12T18:37:06.674 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.675 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.675 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:06.675 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.235320+0000", 2024-09-12T18:37:06.675 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0377000000000003e-05 2024-09-12T18:37:06.675 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.675 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.675 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:06.675 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.235352+0000", 2024-09-12T18:37:06.675 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2322e-05 2024-09-12T18:37:06.675 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.675 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:06.675 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.675 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.675 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.676 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:167371 5.4 5:24fea27c:::benchmark_data_smithi073_23739_object35094:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:06.676 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:03.171234+0000", 2024-09-12T18:37:06.676 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 3.3863880790000001, 2024-09-12T18:37:06.676 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.066048171000000003, 2024-09-12T18:37:06.676 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:06.676 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:06.676 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:06.676 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:06.676 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:06.676 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:06.676 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 167371 2024-09-12T18:37:06.676 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.676 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:06.677 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.677 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:06.677 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171234+0000", 2024-09-12T18:37:06.677 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.677 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.677 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.677 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:06.677 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171234+0000", 2024-09-12T18:37:06.677 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:06.677 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.677 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.677 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:06.677 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171235+0000", 2024-09-12T18:37:06.678 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8599999999999997e-07 2024-09-12T18:37:06.678 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.678 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.678 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:06.678 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171238+0000", 2024-09-12T18:37:06.678 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9739999999999998e-06 2024-09-12T18:37:06.678 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.678 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.678 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:06.678 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171245+0000", 2024-09-12T18:37:06.678 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6000000000000003e-06 2024-09-12T18:37:06.678 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.678 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.678 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:06.678 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171249+0000", 2024-09-12T18:37:06.678 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9960000000000004e-06 2024-09-12T18:37:06.679 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.679 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.679 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:06.679 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171288+0000", 2024-09-12T18:37:06.679 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9119999999999998e-05 2024-09-12T18:37:06.679 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.679 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.679 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:06.679 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171359+0000", 2024-09-12T18:37:06.679 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0951000000000006e-05 2024-09-12T18:37:06.679 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.679 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.679 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:06.679 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171425+0000", 2024-09-12T18:37:06.679 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.58e-05 2024-09-12T18:37:06.680 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.680 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.680 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:06.680 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.173093+0000", 2024-09-12T18:37:06.680 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016683939999999999 2024-09-12T18:37:06.680 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.680 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.680 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:06.680 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.237202+0000", 2024-09-12T18:37:06.680 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064109437000000005 2024-09-12T18:37:06.680 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.680 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.680 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:06.681 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.237249+0000", 2024-09-12T18:37:06.681 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6751e-05 2024-09-12T18:37:06.681 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:06.681 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:06.681 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:06.681 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.237282+0000", 2024-09-12T18:37:06.681 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3262000000000001e-05 2024-09-12T18:37:06.681 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.681 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:06.681 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.681 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:06.681 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:06.681 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:06.683 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:06.679+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:06.683 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is set 2024-09-12T18:37:06.684 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:37:06.783 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:06.774+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:06.836 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:06.836 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:37:06.836 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.836 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:174872 5.d e60/21 5:b08b4c92:::benchmark_data_smithi073_23739_object42595:head v 60'11086, mlcod=60'11083)", 2024-09-12T18:37:06.836 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:06.829701+0000", 2024-09-12T18:37:06.836 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.004153154, 2024-09-12T18:37:06.836 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0041738449999999998, 2024-09-12T18:37:06.836 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:06.836 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:06.836 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:37:06.836 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:06.837 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.837 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:06.837 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.829701+0000", 2024-09-12T18:37:06.837 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:06.837 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.837 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.837 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:06.837 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.829701+0000", 2024-09-12T18:37:06.837 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:06.837 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.837 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.837 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:06.837 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.829701+0000", 2024-09-12T18:37:06.838 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.0100000000000005e-07 2024-09-12T18:37:06.838 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.838 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.838 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:06.838 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.829706+0000", 2024-09-12T18:37:06.838 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.3429999999999998e-06 2024-09-12T18:37:06.838 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.838 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.838 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:06.838 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.829715+0000", 2024-09-12T18:37:06.838 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0180000000000007e-06 2024-09-12T18:37:06.838 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.838 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.839 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:06.839 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.829721+0000", 2024-09-12T18:37:06.839 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.3289999999999999e-06 2024-09-12T18:37:06.839 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.839 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.839 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:06.839 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.829760+0000", 2024-09-12T18:37:06.839 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.8556000000000002e-05 2024-09-12T18:37:06.839 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.839 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.839 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:06.839 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.829779+0000", 2024-09-12T18:37:06.839 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9259e-05 2024-09-12T18:37:06.839 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:06.840 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:06.840 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:06.840 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.840 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.840 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:174875 5.3 e60/21 5:ca375038:::benchmark_data_smithi073_23739_object42598:head v 60'10795, mlcod=60'10793)", 2024-09-12T18:37:06.840 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:06.830732+0000", 2024-09-12T18:37:06.840 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0031215890000000001, 2024-09-12T18:37:06.840 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0032030140000000001, 2024-09-12T18:37:06.840 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:06.840 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:06.840 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:37:06.840 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:06.840 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.841 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:06.841 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.830732+0000", 2024-09-12T18:37:06.841 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:06.841 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.841 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.841 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:06.841 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.830732+0000", 2024-09-12T18:37:06.841 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:06.841 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.841 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.841 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:06.841 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.830733+0000", 2024-09-12T18:37:06.841 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.2999999999999999e-07 2024-09-12T18:37:06.842 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.842 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.842 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:06.842 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.830738+0000", 2024-09-12T18:37:06.842 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.9130000000000002e-06 2024-09-12T18:37:06.842 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.842 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.842 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:06.842 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.830749+0000", 2024-09-12T18:37:06.842 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0658e-05 2024-09-12T18:37:06.842 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.842 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.842 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:06.842 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.830756+0000", 2024-09-12T18:37:06.843 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.7290000000000003e-06 2024-09-12T18:37:06.843 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.843 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.843 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:06.843 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.830803+0000", 2024-09-12T18:37:06.843 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.7647e-05 2024-09-12T18:37:06.843 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.843 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.843 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:06.843 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.830821+0000", 2024-09-12T18:37:06.843 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7552999999999999e-05 2024-09-12T18:37:06.843 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:06.843 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:06.843 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:06.844 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.844 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.844 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:174874 5.0 e60/49 5:0656438b:::benchmark_data_smithi073_23739_object42597:head v 60'10984, mlcod=60'10980)", 2024-09-12T18:37:06.844 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:06.831254+0000", 2024-09-12T18:37:06.844 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0026001079999999998, 2024-09-12T18:37:06.844 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0027311549999999999, 2024-09-12T18:37:06.844 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:06.844 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:06.844 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:37:06.844 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:06.844 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.844 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:06.844 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.831254+0000", 2024-09-12T18:37:06.845 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:06.845 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.845 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.845 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:06.845 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.831254+0000", 2024-09-12T18:37:06.845 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:06.845 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.845 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.845 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:06.845 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.831255+0000", 2024-09-12T18:37:06.845 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8700000000000005e-07 2024-09-12T18:37:06.845 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.845 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.845 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:06.846 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.831260+0000", 2024-09-12T18:37:06.846 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1189999999999996e-06 2024-09-12T18:37:06.846 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.846 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.846 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:06.846 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.831273+0000", 2024-09-12T18:37:06.846 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3190000000000001e-05 2024-09-12T18:37:06.846 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.846 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.846 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:06.846 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.831282+0000", 2024-09-12T18:37:06.846 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.9760000000000001e-06 2024-09-12T18:37:06.847 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.847 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.847 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:06.847 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.831344+0000", 2024-09-12T18:37:06.847 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2114999999999997e-05 2024-09-12T18:37:06.847 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.847 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.847 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:06.847 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.831357+0000", 2024-09-12T18:37:06.847 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2852e-05 2024-09-12T18:37:06.847 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:06.847 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:06.848 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:06.848 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.848 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.848 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:174881 5.1 5.ded082a1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:37:06.848 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:06.833047+0000", 2024-09-12T18:37:06.848 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.00080749999999999995, 2024-09-12T18:37:06.848 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00098324000000000003, 2024-09-12T18:37:06.848 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:06.848 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:06.848 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:06.848 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:06.848 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:06.848 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:06.849 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 174881 2024-09-12T18:37:06.849 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.849 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:06.849 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.849 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:06.849 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.833047+0000", 2024-09-12T18:37:06.849 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:06.849 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.849 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.849 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:06.849 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.833047+0000", 2024-09-12T18:37:06.849 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:06.849 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.850 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.850 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:06.850 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.833047+0000", 2024-09-12T18:37:06.850 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.2999999999999999e-07 2024-09-12T18:37:06.850 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.850 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.850 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:06.850 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.833051+0000", 2024-09-12T18:37:06.850 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.8809999999999998e-06 2024-09-12T18:37:06.850 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.850 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.850 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:06.851 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.833058+0000", 2024-09-12T18:37:06.851 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9709999999999998e-06 2024-09-12T18:37:06.851 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.851 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.851 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:06.851 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.833063+0000", 2024-09-12T18:37:06.851 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.729e-06 2024-09-12T18:37:06.851 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:06.851 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:06.851 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:06.851 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.851 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.852 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:174885 5.2 5:45aa1bd3:::benchmark_data_smithi073_23739_object42608:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:37:06.852 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:06.833304+0000", 2024-09-12T18:37:06.852 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.00054987000000000005, 2024-09-12T18:37:06.852 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00077318099999999996, 2024-09-12T18:37:06.852 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:06.852 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:06.852 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:06.852 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:06.852 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:06.852 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:06.852 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 174885 2024-09-12T18:37:06.852 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.853 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:06.853 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.853 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:06.853 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.833304+0000", 2024-09-12T18:37:06.853 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:06.853 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.853 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.853 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:06.853 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.833304+0000", 2024-09-12T18:37:06.853 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:06.853 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.853 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.853 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:06.854 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.833305+0000", 2024-09-12T18:37:06.854 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.3000000000000001e-07 2024-09-12T18:37:06.854 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.854 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.854 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:06.854 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.833307+0000", 2024-09-12T18:37:06.854 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.052e-06 2024-09-12T18:37:06.854 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.854 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.854 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:06.854 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.833315+0000", 2024-09-12T18:37:06.854 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.2260000000000005e-06 2024-09-12T18:37:06.854 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.855 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.855 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:06.855 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.833319+0000", 2024-09-12T18:37:06.855 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.6550000000000002e-06 2024-09-12T18:37:06.855 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.855 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.855 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:06.855 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.833353+0000", 2024-09-12T18:37:06.855 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.4777999999999998e-05 2024-09-12T18:37:06.855 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.855 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.855 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:06.855 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.833435+0000", 2024-09-12T18:37:06.856 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.2200999999999994e-05 2024-09-12T18:37:06.856 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.856 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.856 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:06.856 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.833556+0000", 2024-09-12T18:37:06.856 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012022 2024-09-12T18:37:06.856 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:06.856 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:06.856 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:06.856 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.856 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.856 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:174880 5.6 e60/21 5:66de6fb3:::benchmark_data_smithi073_23739_object42603:head v 60'10913, mlcod=60'10911)", 2024-09-12T18:37:06.856 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:06.833432+0000", 2024-09-12T18:37:06.857 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.00042249200000000001, 2024-09-12T18:37:06.857 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00069990700000000005, 2024-09-12T18:37:06.857 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:06.857 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:06.857 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:37:06.857 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:06.857 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.857 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:06.857 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.833432+0000", 2024-09-12T18:37:06.857 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:06.857 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.857 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.857 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:06.858 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.833432+0000", 2024-09-12T18:37:06.858 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:06.858 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.858 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.858 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:06.858 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.833432+0000", 2024-09-12T18:37:06.858 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.0999999999999999e-07 2024-09-12T18:37:06.858 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.858 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.858 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:06.858 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.833439+0000", 2024-09-12T18:37:06.858 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.5780000000000004e-06 2024-09-12T18:37:06.858 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.859 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.859 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:06.859 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.833445+0000", 2024-09-12T18:37:06.859 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.1890000000000004e-06 2024-09-12T18:37:06.859 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.859 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.859 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:06.859 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.833454+0000", 2024-09-12T18:37:06.859 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.397e-06 2024-09-12T18:37:06.859 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.859 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.859 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:06.859 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.833497+0000", 2024-09-12T18:37:06.860 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.3174999999999999e-05 2024-09-12T18:37:06.860 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.860 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.860 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:06.860 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.833520+0000", 2024-09-12T18:37:06.860 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2558999999999999e-05 2024-09-12T18:37:06.860 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:06.860 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:06.860 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:06.860 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.860 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.860 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:174884 5.3 e60/21 5:c74e0544:::benchmark_data_smithi073_23739_object42607:head v 60'10796, mlcod=60'10793)", 2024-09-12T18:37:06.860 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:06.833750+0000", 2024-09-12T18:37:06.860 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.000104467, 2024-09-12T18:37:06.861 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00042574699999999997, 2024-09-12T18:37:06.861 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:06.861 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:06.861 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:37:06.861 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:06.861 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.861 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:06.861 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.833750+0000", 2024-09-12T18:37:06.861 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:06.861 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.861 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.861 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:06.861 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.833750+0000", 2024-09-12T18:37:06.861 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:06.862 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.862 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.862 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:06.862 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.833750+0000", 2024-09-12T18:37:06.862 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.0800000000000005e-07 2024-09-12T18:37:06.862 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.862 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.862 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:06.862 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.833753+0000", 2024-09-12T18:37:06.862 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.6129999999999998e-06 2024-09-12T18:37:06.862 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.862 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.862 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:06.862 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.833759+0000", 2024-09-12T18:37:06.863 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.5989999999999998e-06 2024-09-12T18:37:06.863 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.863 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.863 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:06.863 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.833763+0000", 2024-09-12T18:37:06.863 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.67e-06 2024-09-12T18:37:06.863 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.863 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.863 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:06.863 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.833806+0000", 2024-09-12T18:37:06.863 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.3185000000000001e-05 2024-09-12T18:37:06.863 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.863 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.863 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:06.863 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.833827+0000", 2024-09-12T18:37:06.864 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.0449e-05 2024-09-12T18:37:06.864 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:06.864 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:06.864 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:06.864 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.864 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.864 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:174886 5.0 e60/49 5:0ad6f1b2:::benchmark_data_smithi073_23739_object42609:head v 60'10985, mlcod=60'10982)", 2024-09-12T18:37:06.864 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:06.833786+0000", 2024-09-12T18:37:06.864 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 6.8306000000000006e-05, 2024-09-12T18:37:06.864 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00043377800000000001, 2024-09-12T18:37:06.864 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:06.864 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:06.864 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:37:06.865 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:06.865 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.865 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:06.865 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.833786+0000", 2024-09-12T18:37:06.865 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:06.865 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.865 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.865 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:06.865 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.833786+0000", 2024-09-12T18:37:06.865 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:06.865 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.865 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.865 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:06.866 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.833786+0000", 2024-09-12T18:37:06.866 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4799999999999998e-07 2024-09-12T18:37:06.866 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.866 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.866 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:06.866 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.833790+0000", 2024-09-12T18:37:06.866 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.1110000000000001e-06 2024-09-12T18:37:06.866 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.866 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.866 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:06.866 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.833800+0000", 2024-09-12T18:37:06.866 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.6250000000000002e-06 2024-09-12T18:37:06.867 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.867 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.867 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:06.867 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.833805+0000", 2024-09-12T18:37:06.867 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.9339999999999997e-06 2024-09-12T18:37:06.867 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.867 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.867 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:06.867 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.833850+0000", 2024-09-12T18:37:06.867 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4487000000000003e-05 2024-09-12T18:37:06.867 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:06.867 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:06.867 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:06.867 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:06.833868+0000", 2024-09-12T18:37:06.868 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.8139999999999999e-05 2024-09-12T18:37:06.868 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:06.868 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:06.868 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:06.868 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:06.868 INFO:teuthology.orchestra.run.smithi162.stdout: ], 2024-09-12T18:37:06.868 INFO:teuthology.orchestra.run.smithi162.stdout: "num_ops": 8 2024-09-12T18:37:06.868 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:06.869 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:37:06.884 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:06.878+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:06.985 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:06.981+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:07.014 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:07.015 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [], 2024-09-12T18:37:07.015 INFO:teuthology.orchestra.run.smithi162.stdout: "complaint_time": 30, 2024-09-12T18:37:07.015 INFO:teuthology.orchestra.run.smithi162.stdout: "num_blocked_ops": 0 2024-09-12T18:37:07.015 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:07.032 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:37:07.087 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:07.081+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:07.187 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:07.181+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:07.189 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:07.189 INFO:teuthology.orchestra.run.smithi162.stdout: "size": 20, 2024-09-12T18:37:07.189 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 600, 2024-09-12T18:37:07.189 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:37:07.190 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.190 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4154.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:37:07.190 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:37:07.190 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 113.209790742, 2024-09-12T18:37:07.190 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025950709999999998, 2024-09-12T18:37:07.190 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:07.190 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:07.190 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:07.190 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:07.190 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4154", 2024-09-12T18:37:07.190 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/745129001", 2024-09-12T18:37:07.190 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 124 2024-09-12T18:37:07.191 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.191 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:07.191 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.191 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:07.191 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:37:07.191 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:07.191 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.191 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.191 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:07.191 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:37:07.191 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:07.191 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.192 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.192 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:07.192 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976562+0000", 2024-09-12T18:37:07.192 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.2999999999999999e-07 2024-09-12T18:37:07.192 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.192 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.192 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:07.192 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976567+0000", 2024-09-12T18:37:07.192 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3430000000000003e-06 2024-09-12T18:37:07.192 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.192 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.192 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:07.192 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976576+0000", 2024-09-12T18:37:07.192 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8070000000000006e-06 2024-09-12T18:37:07.193 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.193 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.193 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:07.193 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976583+0000", 2024-09-12T18:37:07.193 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9959999999999996e-06 2024-09-12T18:37:07.193 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.193 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.193 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:07.193 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997107+0000", 2024-09-12T18:37:07.193 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.020524106 2024-09-12T18:37:07.193 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.193 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.194 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:07.194 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997225+0000", 2024-09-12T18:37:07.194 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000117909 2024-09-12T18:37:07.194 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.194 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.194 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:07.194 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997407+0000", 2024-09-12T18:37:07.194 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00018175900000000001 2024-09-12T18:37:07.194 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.194 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.194 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:07.194 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998839+0000", 2024-09-12T18:37:07.195 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001432539 2024-09-12T18:37:07.195 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.195 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.195 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:07.195 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002319+0000", 2024-09-12T18:37:07.195 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0034803529999999998 2024-09-12T18:37:07.195 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.195 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.195 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:07.195 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002405+0000", 2024-09-12T18:37:07.195 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5434999999999998e-05 2024-09-12T18:37:07.195 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.195 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.196 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:07.196 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002512+0000", 2024-09-12T18:37:07.196 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010663299999999999 2024-09-12T18:37:07.196 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:07.196 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:07.196 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:07.196 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.196 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.196 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:07.196 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:37:07.196 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 101.54499323500001, 2024-09-12T18:37:07.196 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025127867000000002, 2024-09-12T18:37:07.196 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:07.196 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:07.197 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:07.197 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:07.197 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.197 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:07.197 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:37:07.197 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:07.197 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.197 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.197 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:07.197 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:37:07.197 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:07.197 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.197 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.198 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:07.198 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641362+0000", 2024-09-12T18:37:07.198 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.2569999999999999e-06 2024-09-12T18:37:07.198 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.198 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.198 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:07.198 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641374+0000", 2024-09-12T18:37:07.198 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2696e-05 2024-09-12T18:37:07.198 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.198 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.198 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:07.198 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641403+0000", 2024-09-12T18:37:07.198 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.8756999999999999e-05 2024-09-12T18:37:07.199 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.199 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.199 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:07.199 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641430+0000", 2024-09-12T18:37:07.199 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.6452999999999999e-05 2024-09-12T18:37:07.199 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.199 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.199 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:07.199 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641585+0000", 2024-09-12T18:37:07.199 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000155799 2024-09-12T18:37:07.199 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.199 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.199 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:07.200 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641753+0000", 2024-09-12T18:37:07.200 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000167868 2024-09-12T18:37:07.200 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.200 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.200 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:07.200 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641916+0000", 2024-09-12T18:37:07.200 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000162903 2024-09-12T18:37:07.200 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.200 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.200 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:07.200 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653655+0000", 2024-09-12T18:37:07.200 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011738879000000001 2024-09-12T18:37:07.200 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.201 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.201 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:07.201 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665515+0000", 2024-09-12T18:37:07.201 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011859915 2024-09-12T18:37:07.201 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.201 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.201 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:07.201 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665646+0000", 2024-09-12T18:37:07.201 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013122599999999999 2024-09-12T18:37:07.201 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.201 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.201 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:07.202 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666486+0000", 2024-09-12T18:37:07.202 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00084011399999999999 2024-09-12T18:37:07.202 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:07.202 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:07.202 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:07.202 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.202 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.202 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:07.202 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:37:07.202 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 101.544878772, 2024-09-12T18:37:07.202 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025384584000000002, 2024-09-12T18:37:07.202 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:07.202 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:07.203 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:07.203 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:07.203 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.203 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:07.203 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:37:07.203 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:07.203 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.203 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.203 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:07.203 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:37:07.203 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:07.203 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.203 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.204 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:07.204 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641474+0000", 2024-09-12T18:37:07.204 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.39e-06 2024-09-12T18:37:07.204 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.204 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.204 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:07.204 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641482+0000", 2024-09-12T18:37:07.204 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3499999999999999e-06 2024-09-12T18:37:07.204 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.204 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.204 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:07.204 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641534+0000", 2024-09-12T18:37:07.204 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2533e-05 2024-09-12T18:37:07.205 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.205 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.205 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:07.205 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641551+0000", 2024-09-12T18:37:07.205 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6515999999999999e-05 2024-09-12T18:37:07.205 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.205 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.205 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:07.205 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642630+0000", 2024-09-12T18:37:07.205 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001079705 2024-09-12T18:37:07.205 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.205 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.205 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:07.205 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642909+0000", 2024-09-12T18:37:07.206 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027859800000000002 2024-09-12T18:37:07.206 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.206 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.206 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:07.206 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643137+0000", 2024-09-12T18:37:07.206 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022803799999999999 2024-09-12T18:37:07.206 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.206 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.206 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:07.206 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653669+0000", 2024-09-12T18:37:07.206 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010532032 2024-09-12T18:37:07.206 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.206 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.207 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:07.207 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666624+0000", 2024-09-12T18:37:07.207 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012954940999999999 2024-09-12T18:37:07.207 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.207 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.207 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:07.207 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666762+0000", 2024-09-12T18:37:07.207 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000137668 2024-09-12T18:37:07.207 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.207 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.207 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:07.207 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666857+0000", 2024-09-12T18:37:07.207 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.5812999999999999e-05 2024-09-12T18:37:07.208 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:07.208 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:07.208 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:07.208 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.208 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.208 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:07.208 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:37:07.208 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 101.54475097700001, 2024-09-12T18:37:07.208 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025661562999999998, 2024-09-12T18:37:07.208 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:07.208 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:07.208 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:07.208 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:07.208 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.209 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:07.209 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:37:07.209 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:07.209 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.209 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.209 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:07.209 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:37:07.209 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:07.209 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.209 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.209 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:07.209 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641602+0000", 2024-09-12T18:37:07.209 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3540000000000001e-06 2024-09-12T18:37:07.210 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.210 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.210 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:07.210 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641637+0000", 2024-09-12T18:37:07.210 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5145999999999999e-05 2024-09-12T18:37:07.210 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.210 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.210 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:07.210 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641659+0000", 2024-09-12T18:37:07.210 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2249999999999999e-05 2024-09-12T18:37:07.210 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.210 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.210 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:07.210 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641675+0000", 2024-09-12T18:37:07.211 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6059999999999999e-05 2024-09-12T18:37:07.211 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.211 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.211 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:07.211 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644570+0000", 2024-09-12T18:37:07.211 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028947069999999998 2024-09-12T18:37:07.211 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.211 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.211 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:07.211 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644900+0000", 2024-09-12T18:37:07.211 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000329401 2024-09-12T18:37:07.211 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.211 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.212 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:07.212 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645235+0000", 2024-09-12T18:37:07.212 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000335874 2024-09-12T18:37:07.212 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.212 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.212 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:07.212 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655459+0000", 2024-09-12T18:37:07.212 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010223441999999999 2024-09-12T18:37:07.212 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.212 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.212 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:07.212 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667028+0000", 2024-09-12T18:37:07.212 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011568673999999999 2024-09-12T18:37:07.213 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.213 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.213 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:07.213 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667163+0000", 2024-09-12T18:37:07.213 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013525500000000001 2024-09-12T18:37:07.213 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.213 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.213 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:07.213 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667262+0000", 2024-09-12T18:37:07.213 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9400000000000004e-05 2024-09-12T18:37:07.213 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:07.214 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:07.214 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:07.214 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.214 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.214 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:07.214 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:37:07.214 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 101.54464915699999, 2024-09-12T18:37:07.214 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025971339, 2024-09-12T18:37:07.214 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:07.214 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:07.214 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:07.215 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:07.215 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.215 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:07.215 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:37:07.215 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:07.215 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.215 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.215 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:07.215 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:37:07.215 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:07.215 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.215 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.216 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:07.216 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641704+0000", 2024-09-12T18:37:07.216 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.297e-06 2024-09-12T18:37:07.216 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.216 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.216 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:07.216 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641712+0000", 2024-09-12T18:37:07.216 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.9060000000000002e-06 2024-09-12T18:37:07.216 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.216 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.216 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:07.216 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641731+0000", 2024-09-12T18:37:07.216 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9083e-05 2024-09-12T18:37:07.217 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.217 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.217 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:07.217 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641745+0000", 2024-09-12T18:37:07.217 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4066999999999999e-05 2024-09-12T18:37:07.217 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.217 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.217 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:07.217 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646529+0000", 2024-09-12T18:37:07.217 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.004784033 2024-09-12T18:37:07.217 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.217 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.217 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:07.217 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646727+0000", 2024-09-12T18:37:07.217 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019841800000000001 2024-09-12T18:37:07.218 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.218 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.218 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:07.218 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647057+0000", 2024-09-12T18:37:07.218 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032926800000000002 2024-09-12T18:37:07.218 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.218 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.218 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:07.218 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655475+0000", 2024-09-12T18:37:07.218 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0084186250000000008 2024-09-12T18:37:07.218 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.218 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.218 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:07.218 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667424+0000", 2024-09-12T18:37:07.219 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011949257 2024-09-12T18:37:07.219 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.219 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.219 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:07.219 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667573+0000", 2024-09-12T18:37:07.219 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014851900000000001 2024-09-12T18:37:07.219 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.219 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.219 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:07.219 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667674+0000", 2024-09-12T18:37:07.219 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010086600000000001 2024-09-12T18:37:07.219 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:07.219 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:07.219 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:07.220 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.220 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.220 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:07.220 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:37:07.220 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 101.544586768, 2024-09-12T18:37:07.220 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026215008000000001, 2024-09-12T18:37:07.220 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:07.220 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:07.220 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:07.220 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:07.220 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.220 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:07.220 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:37:07.221 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:07.221 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.221 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.221 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:07.221 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:37:07.221 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:07.221 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.221 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.221 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:07.221 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641766+0000", 2024-09-12T18:37:07.221 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1200000000000001e-06 2024-09-12T18:37:07.221 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.221 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.221 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:07.222 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641775+0000", 2024-09-12T18:37:07.222 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.2499999999999995e-06 2024-09-12T18:37:07.222 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.222 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.222 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:07.222 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641793+0000", 2024-09-12T18:37:07.222 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7773000000000001e-05 2024-09-12T18:37:07.222 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.222 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.222 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:07.222 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641807+0000", 2024-09-12T18:37:07.222 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3814e-05 2024-09-12T18:37:07.222 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.223 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.223 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:07.223 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647626+0000", 2024-09-12T18:37:07.223 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0058193050000000003 2024-09-12T18:37:07.223 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.223 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.223 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:07.223 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647937+0000", 2024-09-12T18:37:07.223 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031112400000000003 2024-09-12T18:37:07.223 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.223 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.223 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:07.223 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648239+0000", 2024-09-12T18:37:07.224 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00030227500000000002 2024-09-12T18:37:07.224 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.224 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.224 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:07.224 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655487+0000", 2024-09-12T18:37:07.224 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072479129999999999 2024-09-12T18:37:07.224 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.224 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.224 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:07.224 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667823+0000", 2024-09-12T18:37:07.224 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012335505 2024-09-12T18:37:07.224 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.225 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.225 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:07.225 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667908+0000", 2024-09-12T18:37:07.225 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4843000000000001e-05 2024-09-12T18:37:07.225 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.225 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.225 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:07.225 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667980+0000", 2024-09-12T18:37:07.225 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2086000000000001e-05 2024-09-12T18:37:07.225 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:07.225 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:07.225 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:07.226 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.226 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.226 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:07.226 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:37:07.226 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 101.544526615, 2024-09-12T18:37:07.226 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026483236, 2024-09-12T18:37:07.226 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:07.226 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:07.226 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:07.226 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:07.226 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.226 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:07.226 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:37:07.227 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:07.227 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.227 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.227 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:07.227 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:37:07.227 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:07.227 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.227 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.227 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:07.227 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641826+0000", 2024-09-12T18:37:07.227 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:37:07.228 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.228 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.228 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:07.228 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641832+0000", 2024-09-12T18:37:07.228 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4199999999999998e-06 2024-09-12T18:37:07.228 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.228 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.228 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:07.228 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641848+0000", 2024-09-12T18:37:07.228 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6492999999999999e-05 2024-09-12T18:37:07.228 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.228 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.228 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:07.229 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641863+0000", 2024-09-12T18:37:07.229 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5427e-05 2024-09-12T18:37:07.229 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.229 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.229 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:07.229 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648887+0000", 2024-09-12T18:37:07.229 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0070230860000000004 2024-09-12T18:37:07.229 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.229 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.229 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:07.229 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649111+0000", 2024-09-12T18:37:07.229 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022425799999999999 2024-09-12T18:37:07.229 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.230 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.230 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:07.230 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649494+0000", 2024-09-12T18:37:07.230 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00038349400000000001 2024-09-12T18:37:07.230 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.230 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.230 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:07.230 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655499+0000", 2024-09-12T18:37:07.230 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0060047260000000002 2024-09-12T18:37:07.230 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.230 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.230 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:07.231 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668110+0000", 2024-09-12T18:37:07.231 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012610543 2024-09-12T18:37:07.231 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.231 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.231 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:07.231 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668252+0000", 2024-09-12T18:37:07.231 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014265600000000001 2024-09-12T18:37:07.231 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.231 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.231 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:07.231 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668308+0000", 2024-09-12T18:37:07.231 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5992999999999997e-05 2024-09-12T18:37:07.231 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:07.232 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:07.232 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:07.232 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.232 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.232 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:07.232 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:37:07.232 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 101.544471399, 2024-09-12T18:37:07.232 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026605302000000001, 2024-09-12T18:37:07.232 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:07.232 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:07.232 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:07.232 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:07.233 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.233 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:07.233 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:37:07.233 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:07.233 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.233 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.233 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:07.233 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:37:07.233 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:07.233 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.233 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.233 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:07.233 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641881+0000", 2024-09-12T18:37:07.234 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.057e-06 2024-09-12T18:37:07.234 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.234 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.234 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:07.234 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641887+0000", 2024-09-12T18:37:07.234 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.6629999999999998e-06 2024-09-12T18:37:07.234 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.234 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.234 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:07.234 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641903+0000", 2024-09-12T18:37:07.234 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6317e-05 2024-09-12T18:37:07.234 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.234 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.235 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:07.235 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641917+0000", 2024-09-12T18:37:07.235 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3339999999999999e-05 2024-09-12T18:37:07.235 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.235 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.235 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:07.235 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650708+0000", 2024-09-12T18:37:07.235 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.008791419 2024-09-12T18:37:07.235 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.235 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.235 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:07.235 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651021+0000", 2024-09-12T18:37:07.235 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031296699999999999 2024-09-12T18:37:07.236 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.236 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.236 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:07.236 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651349+0000", 2024-09-12T18:37:07.236 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032796499999999999 2024-09-12T18:37:07.236 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.236 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.236 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:07.236 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655742+0000", 2024-09-12T18:37:07.236 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0043934680000000002 2024-09-12T18:37:07.236 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.236 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.237 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:07.237 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668377+0000", 2024-09-12T18:37:07.237 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012634312999999999 2024-09-12T18:37:07.237 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.237 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.237 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:07.237 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668441+0000", 2024-09-12T18:37:07.237 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4369999999999995e-05 2024-09-12T18:37:07.237 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.237 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.237 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:07.237 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668485+0000", 2024-09-12T18:37:07.237 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4422999999999998e-05 2024-09-12T18:37:07.238 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:07.238 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:07.238 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:07.238 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.238 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.238 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:07.238 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:37:07.238 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 101.544413996, 2024-09-12T18:37:07.238 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026919499, 2024-09-12T18:37:07.238 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:07.238 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:07.238 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:07.238 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:07.238 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.239 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:07.239 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:37:07.239 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:07.239 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.239 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.239 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:07.239 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:37:07.239 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:07.239 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.239 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.239 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:07.239 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641939+0000", 2024-09-12T18:37:07.239 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9399999999999993e-07 2024-09-12T18:37:07.239 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.240 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.240 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:07.240 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641945+0000", 2024-09-12T18:37:07.240 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9200000000000001e-06 2024-09-12T18:37:07.240 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.240 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.240 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:07.240 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641961+0000", 2024-09-12T18:37:07.240 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6520000000000001e-05 2024-09-12T18:37:07.240 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.240 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.240 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:07.240 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641974+0000", 2024-09-12T18:37:07.240 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3413e-05 2024-09-12T18:37:07.241 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.241 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.241 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:07.241 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654560+0000", 2024-09-12T18:37:07.241 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012585308999999999 2024-09-12T18:37:07.241 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.241 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.241 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:07.241 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654822+0000", 2024-09-12T18:37:07.241 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026210099999999999 2024-09-12T18:37:07.241 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.241 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.241 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:07.241 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655059+0000", 2024-09-12T18:37:07.241 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00023747899999999999 2024-09-12T18:37:07.242 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.242 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.242 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:07.242 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.656315+0000", 2024-09-12T18:37:07.242 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0012555000000000001 2024-09-12T18:37:07.242 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.242 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.242 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:07.242 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668590+0000", 2024-09-12T18:37:07.242 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012274851999999999 2024-09-12T18:37:07.242 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.242 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.242 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:07.243 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668725+0000", 2024-09-12T18:37:07.243 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013524199999999999 2024-09-12T18:37:07.243 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.243 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.243 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:07.243 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668857+0000", 2024-09-12T18:37:07.243 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013216899999999999 2024-09-12T18:37:07.243 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:07.243 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:07.243 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:07.243 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.243 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.244 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:07.244 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:37:07.244 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 101.544232611, 2024-09-12T18:37:07.244 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024670563, 2024-09-12T18:37:07.244 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:07.244 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:07.244 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:07.244 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:07.244 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.244 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:07.244 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:37:07.244 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:07.244 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.244 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.245 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:07.245 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:37:07.245 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:07.245 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.245 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.245 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:07.245 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642120+0000", 2024-09-12T18:37:07.245 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1769999999999999e-06 2024-09-12T18:37:07.245 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.245 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.245 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:07.245 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642128+0000", 2024-09-12T18:37:07.245 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3429999999999998e-06 2024-09-12T18:37:07.246 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.246 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.246 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:07.246 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642192+0000", 2024-09-12T18:37:07.246 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4406999999999995e-05 2024-09-12T18:37:07.246 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.246 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.246 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:07.246 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642223+0000", 2024-09-12T18:37:07.246 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.1266000000000002e-05 2024-09-12T18:37:07.246 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.246 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.246 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:07.247 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643201+0000", 2024-09-12T18:37:07.247 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0009778390000000001 2024-09-12T18:37:07.247 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.247 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.247 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:07.247 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643410+0000", 2024-09-12T18:37:07.247 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020874199999999999 2024-09-12T18:37:07.247 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.247 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.247 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:07.247 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643685+0000", 2024-09-12T18:37:07.247 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027520700000000002 2024-09-12T18:37:07.247 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.247 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.247 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:07.248 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650966+0000", 2024-09-12T18:37:07.248 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072810710000000001 2024-09-12T18:37:07.248 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.248 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.248 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:07.248 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666560+0000", 2024-09-12T18:37:07.248 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015594143 2024-09-12T18:37:07.248 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.248 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.248 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:07.248 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666691+0000", 2024-09-12T18:37:07.248 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000130359 2024-09-12T18:37:07.248 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.249 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.249 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:07.249 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666790+0000", 2024-09-12T18:37:07.249 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9009e-05 2024-09-12T18:37:07.249 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:07.249 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:07.249 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:07.249 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.249 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.249 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:07.249 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:37:07.249 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 101.54345432300001, 2024-09-12T18:37:07.249 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024891744, 2024-09-12T18:37:07.249 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:07.250 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:07.250 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:07.250 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:07.250 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.250 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:07.250 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:37:07.250 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:07.250 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.250 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.250 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:07.250 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:37:07.250 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:07.250 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.250 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.251 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:07.251 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642899+0000", 2024-09-12T18:37:07.251 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4729999999999999e-06 2024-09-12T18:37:07.251 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.251 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.251 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:07.251 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642912+0000", 2024-09-12T18:37:07.251 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3495999999999999e-05 2024-09-12T18:37:07.251 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.251 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.251 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:07.251 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642934+0000", 2024-09-12T18:37:07.251 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2033999999999999e-05 2024-09-12T18:37:07.251 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.252 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.252 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:07.252 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642949+0000", 2024-09-12T18:37:07.252 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4970000000000001e-05 2024-09-12T18:37:07.252 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.252 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.252 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:07.252 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644400+0000", 2024-09-12T18:37:07.252 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001450305 2024-09-12T18:37:07.252 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.252 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.252 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:07.252 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644617+0000", 2024-09-12T18:37:07.252 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000217302 2024-09-12T18:37:07.253 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.253 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.253 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:07.253 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645052+0000", 2024-09-12T18:37:07.253 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000434797 2024-09-12T18:37:07.253 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.253 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.253 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:07.253 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653860+0000", 2024-09-12T18:37:07.253 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0088082249999999994 2024-09-12T18:37:07.253 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.253 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.253 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:07.253 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667598+0000", 2024-09-12T18:37:07.253 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.013738451 2024-09-12T18:37:07.254 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.254 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.254 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:07.254 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667698+0000", 2024-09-12T18:37:07.254 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9854999999999999e-05 2024-09-12T18:37:07.254 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.254 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.254 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:07.254 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667789+0000", 2024-09-12T18:37:07.254 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0835999999999996e-05 2024-09-12T18:37:07.254 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:07.254 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:07.254 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:07.254 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.255 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.255 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:121106 5.d e50/21 5:b4a9a221:::benchmark_data_smithi073_23739_object121105:head v 50'7658, mlcod=48'7656)", 2024-09-12T18:37:07.255 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:40.238637+0000", 2024-09-12T18:37:07.255 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 26.947714597000001, 2024-09-12T18:37:07.255 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.033154694999999998, 2024-09-12T18:37:07.255 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:07.255 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:07.255 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:07.255 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:07.255 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.255 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:07.255 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238637+0000", 2024-09-12T18:37:07.255 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:07.255 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.256 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.256 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:07.256 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238637+0000", 2024-09-12T18:37:07.256 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:07.256 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.256 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.256 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:07.256 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238639+0000", 2024-09-12T18:37:07.256 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.8560000000000001e-06 2024-09-12T18:37:07.256 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.256 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.256 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:07.256 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238723+0000", 2024-09-12T18:37:07.257 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4314999999999995e-05 2024-09-12T18:37:07.257 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.257 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.257 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:07.257 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238753+0000", 2024-09-12T18:37:07.257 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.9726e-05 2024-09-12T18:37:07.257 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.257 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.257 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:07.257 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238773+0000", 2024-09-12T18:37:07.257 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9789e-05 2024-09-12T18:37:07.257 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.257 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.258 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:07.258 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.241557+0000", 2024-09-12T18:37:07.258 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0027843910000000002 2024-09-12T18:37:07.258 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.258 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.258 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:07.258 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.241581+0000", 2024-09-12T18:37:07.258 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.4224999999999999e-05 2024-09-12T18:37:07.258 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.258 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.258 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:07.258 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.271722+0000", 2024-09-12T18:37:07.258 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.030141194 2024-09-12T18:37:07.259 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.259 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.259 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:07.259 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.271792+0000", 2024-09-12T18:37:07.259 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9198999999999999e-05 2024-09-12T18:37:07.259 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:07.259 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:07.259 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:07.259 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.259 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.259 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:131553 5.9 5:99f85f54:::benchmark_data_smithi073_23739_object131552:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:37:07.259 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:45.500398+0000", 2024-09-12T18:37:07.259 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 21.685953436999998, 2024-09-12T18:37:07.259 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024615648, 2024-09-12T18:37:07.260 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:07.260 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:07.260 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:07.260 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:07.260 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:07.260 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:07.260 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 131553 2024-09-12T18:37:07.260 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.260 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:07.260 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.260 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:07.260 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500398+0000", 2024-09-12T18:37:07.260 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:07.261 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.261 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.261 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:07.261 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500398+0000", 2024-09-12T18:37:07.261 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:07.261 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.261 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.261 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:07.261 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500399+0000", 2024-09-12T18:37:07.261 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.54e-07 2024-09-12T18:37:07.261 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.261 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.261 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:07.261 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500521+0000", 2024-09-12T18:37:07.261 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012212599999999999 2024-09-12T18:37:07.262 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.262 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.262 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:07.262 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500528+0000", 2024-09-12T18:37:07.262 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.6619999999999999e-06 2024-09-12T18:37:07.262 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.262 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.262 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:07.262 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500532+0000", 2024-09-12T18:37:07.262 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6110000000000004e-06 2024-09-12T18:37:07.262 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.264 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.264 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:07.264 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500576+0000", 2024-09-12T18:37:07.264 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.3563000000000003e-05 2024-09-12T18:37:07.264 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.264 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.264 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:07.264 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500688+0000", 2024-09-12T18:37:07.264 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011260900000000001 2024-09-12T18:37:07.264 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.264 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.264 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:07.264 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.517383+0000", 2024-09-12T18:37:07.265 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.016694154999999999 2024-09-12T18:37:07.265 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.265 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.265 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:07.265 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.523998+0000", 2024-09-12T18:37:07.265 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0066157919999999997 2024-09-12T18:37:07.265 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.265 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.265 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:07.265 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.524943+0000", 2024-09-12T18:37:07.265 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00094417500000000001 2024-09-12T18:37:07.265 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.265 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.266 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:07.266 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.524981+0000", 2024-09-12T18:37:07.266 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.8179000000000002e-05 2024-09-12T18:37:07.266 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.266 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.266 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:07.266 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.525014+0000", 2024-09-12T18:37:07.266 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.3022000000000003e-05 2024-09-12T18:37:07.266 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:07.266 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:07.266 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:07.266 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.266 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.267 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:131551 5.d e52/21 5:b8f8c77a:::benchmark_data_smithi073_23739_object131550:head v 52'8341, mlcod=52'8338)", 2024-09-12T18:37:07.267 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:45.500609+0000", 2024-09-12T18:37:07.267 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 21.685742417, 2024-09-12T18:37:07.267 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024752877, 2024-09-12T18:37:07.267 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:07.267 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:07.267 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:07.267 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:07.267 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.267 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:07.267 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500609+0000", 2024-09-12T18:37:07.267 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:07.267 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.267 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.268 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:07.268 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500609+0000", 2024-09-12T18:37:07.268 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:07.268 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.268 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.268 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:07.268 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500610+0000", 2024-09-12T18:37:07.268 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5499999999999998e-07 2024-09-12T18:37:07.268 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.268 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.268 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:07.268 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500669+0000", 2024-09-12T18:37:07.268 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9244999999999999e-05 2024-09-12T18:37:07.268 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.269 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.269 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:07.269 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500676+0000", 2024-09-12T18:37:07.269 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3030000000000002e-06 2024-09-12T18:37:07.269 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.269 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.269 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:07.269 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500681+0000", 2024-09-12T18:37:07.269 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8720000000000001e-06 2024-09-12T18:37:07.269 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.269 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.269 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:07.269 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.517128+0000", 2024-09-12T18:37:07.269 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.016446485 2024-09-12T18:37:07.269 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.270 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.270 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:07.270 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.517159+0000", 2024-09-12T18:37:07.270 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.0926000000000002e-05 2024-09-12T18:37:07.270 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.270 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.270 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:07.270 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.525325+0000", 2024-09-12T18:37:07.270 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0081661460000000009 2024-09-12T18:37:07.270 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.270 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.270 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:07.270 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.525362+0000", 2024-09-12T18:37:07.270 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.7345000000000002e-05 2024-09-12T18:37:07.271 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:07.271 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:07.271 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:07.271 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.271 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.271 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167364 5.7 5:ee50096a:::benchmark_data_smithi073_23739_object35087:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:07.271 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.168715+0000", 2024-09-12T18:37:07.271 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 4.01763651, 2024-09-12T18:37:07.271 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.068831153000000006, 2024-09-12T18:37:07.271 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:07.271 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:07.271 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:07.271 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:07.271 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:07.271 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:07.272 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167364 2024-09-12T18:37:07.272 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.272 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:07.272 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.272 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:07.272 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168715+0000", 2024-09-12T18:37:07.272 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:07.272 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.272 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.272 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:07.272 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168715+0000", 2024-09-12T18:37:07.272 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:07.272 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.272 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.272 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:07.272 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168716+0000", 2024-09-12T18:37:07.273 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0559999999999999e-06 2024-09-12T18:37:07.273 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.273 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.273 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:07.273 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168721+0000", 2024-09-12T18:37:07.273 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8019999999999999e-06 2024-09-12T18:37:07.273 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.273 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.273 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:07.273 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168731+0000", 2024-09-12T18:37:07.273 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0315e-05 2024-09-12T18:37:07.273 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.273 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.273 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:07.274 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168738+0000", 2024-09-12T18:37:07.274 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.126e-06 2024-09-12T18:37:07.274 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.274 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.274 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:07.274 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168782+0000", 2024-09-12T18:37:07.274 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.3924000000000002e-05 2024-09-12T18:37:07.274 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.274 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.274 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:07.274 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168913+0000", 2024-09-12T18:37:07.274 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000131154 2024-09-12T18:37:07.274 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.274 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.274 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:07.275 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169026+0000", 2024-09-12T18:37:07.275 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011223299999999999 2024-09-12T18:37:07.275 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.275 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.275 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:07.275 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.175404+0000", 2024-09-12T18:37:07.275 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0063780319999999996 2024-09-12T18:37:07.275 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.275 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.275 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:07.275 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237446+0000", 2024-09-12T18:37:07.275 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.062042238 2024-09-12T18:37:07.275 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.275 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.275 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:07.275 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237501+0000", 2024-09-12T18:37:07.276 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4913000000000001e-05 2024-09-12T18:37:07.276 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.276 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.276 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:07.276 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237546+0000", 2024-09-12T18:37:07.276 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.5359999999999999e-05 2024-09-12T18:37:07.276 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:07.276 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:07.276 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:07.276 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.276 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.276 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167365 5.2 5:4107875c:::benchmark_data_smithi073_23739_object35088:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:07.276 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:07.276 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 4.0175869359999998, 2024-09-12T18:37:07.277 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.078544438999999994, 2024-09-12T18:37:07.277 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:07.277 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:07.277 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:07.277 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:07.277 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:07.277 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:07.277 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167365 2024-09-12T18:37:07.277 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.277 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:07.277 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.277 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:07.277 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:07.277 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:07.277 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.278 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.278 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:07.278 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:07.278 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:07.278 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.278 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.278 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:07.278 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:07.278 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.4700000000000001e-07 2024-09-12T18:37:07.278 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.278 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.278 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:07.278 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168769+0000", 2024-09-12T18:37:07.278 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.4170000000000001e-06 2024-09-12T18:37:07.278 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.278 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.279 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:07.279 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168777+0000", 2024-09-12T18:37:07.279 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1499999999999999e-06 2024-09-12T18:37:07.279 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.279 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.279 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:07.279 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168783+0000", 2024-09-12T18:37:07.279 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.0460000000000002e-06 2024-09-12T18:37:07.279 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.279 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.279 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:07.279 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168865+0000", 2024-09-12T18:37:07.279 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1953999999999995e-05 2024-09-12T18:37:07.279 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.279 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.279 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:07.280 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169003+0000", 2024-09-12T18:37:07.280 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013798200000000001 2024-09-12T18:37:07.280 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.280 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.280 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:07.280 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169065+0000", 2024-09-12T18:37:07.280 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2218000000000006e-05 2024-09-12T18:37:07.280 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.280 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.280 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:07.280 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174771+0000", 2024-09-12T18:37:07.280 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0057054819999999996 2024-09-12T18:37:07.280 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.281 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.281 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:07.281 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.247234+0000", 2024-09-12T18:37:07.281 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.072463391000000002 2024-09-12T18:37:07.281 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.281 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.281 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:07.281 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.247273+0000", 2024-09-12T18:37:07.281 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.9069000000000002e-05 2024-09-12T18:37:07.281 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.281 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.281 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:07.281 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.247309+0000", 2024-09-12T18:37:07.281 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5982999999999998e-05 2024-09-12T18:37:07.282 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:07.282 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:07.282 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:07.282 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.282 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.282 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167369 5.7 5:e64ecabd:::benchmark_data_smithi073_23739_object35092:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:07.282 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.169042+0000", 2024-09-12T18:37:07.282 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 4.0173098249999999, 2024-09-12T18:37:07.282 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.069229188999999997, 2024-09-12T18:37:07.282 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:07.282 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:07.282 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:07.282 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:07.282 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:07.283 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:07.283 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167369 2024-09-12T18:37:07.283 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.283 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:07.283 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.283 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:07.283 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169042+0000", 2024-09-12T18:37:07.283 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:07.283 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.283 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.283 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:07.283 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169042+0000", 2024-09-12T18:37:07.283 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:07.283 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.283 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.284 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:07.284 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169043+0000", 2024-09-12T18:37:07.284 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.9400000000000004e-07 2024-09-12T18:37:07.284 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.284 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.284 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:07.284 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169048+0000", 2024-09-12T18:37:07.284 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8420000000000004e-06 2024-09-12T18:37:07.284 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.284 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.284 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:07.284 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169055+0000", 2024-09-12T18:37:07.284 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.7989999999999994e-06 2024-09-12T18:37:07.284 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.284 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.285 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:07.285 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169062+0000", 2024-09-12T18:37:07.285 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.5950000000000004e-06 2024-09-12T18:37:07.285 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.285 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.285 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:07.285 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173858+0000", 2024-09-12T18:37:07.285 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0047959259999999998 2024-09-12T18:37:07.285 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.285 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.285 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:07.285 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173966+0000", 2024-09-12T18:37:07.285 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000107941 2024-09-12T18:37:07.286 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.286 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.286 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:07.286 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174043+0000", 2024-09-12T18:37:07.286 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.7360000000000005e-05 2024-09-12T18:37:07.286 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.286 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.286 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:07.286 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.175711+0000", 2024-09-12T18:37:07.286 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0016680810000000001 2024-09-12T18:37:07.286 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.286 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.286 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:07.286 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.238163+0000", 2024-09-12T18:37:07.286 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.062451523000000002 2024-09-12T18:37:07.286 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.287 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.287 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:07.287 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.238222+0000", 2024-09-12T18:37:07.287 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9723999999999999e-05 2024-09-12T18:37:07.287 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.287 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.287 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:07.287 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.238271+0000", 2024-09-12T18:37:07.287 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8504000000000002e-05 2024-09-12T18:37:07.287 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:07.287 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:07.287 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:07.287 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.288 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.288 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167373 5.5 5:ad283029:::benchmark_data_smithi073_23739_object35096:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:07.288 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:07.288 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 4.0148049940000003, 2024-09-12T18:37:07.288 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.066200976999999994, 2024-09-12T18:37:07.288 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:07.288 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:07.288 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:07.288 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:07.288 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:07.288 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:07.288 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167373 2024-09-12T18:37:07.288 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.288 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:07.288 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.289 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:07.289 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:07.289 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:07.289 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.289 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.289 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:07.289 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:07.289 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:07.289 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.289 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.289 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:07.289 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:07.289 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4900000000000005e-07 2024-09-12T18:37:07.289 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.289 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.289 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:07.290 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171551+0000", 2024-09-12T18:37:07.290 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.7519999999999998e-06 2024-09-12T18:37:07.290 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.290 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.290 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:07.290 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171562+0000", 2024-09-12T18:37:07.290 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0353000000000001e-05 2024-09-12T18:37:07.290 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.290 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.290 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:07.290 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171566+0000", 2024-09-12T18:37:07.290 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8269999999999997e-06 2024-09-12T18:37:07.290 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.290 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.290 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:07.290 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171622+0000", 2024-09-12T18:37:07.291 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5220999999999999e-05 2024-09-12T18:37:07.291 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.291 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.291 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:07.291 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171719+0000", 2024-09-12T18:37:07.291 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7238999999999995e-05 2024-09-12T18:37:07.291 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.291 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.291 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:07.291 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171802+0000", 2024-09-12T18:37:07.291 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.3285e-05 2024-09-12T18:37:07.291 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.291 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.291 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:07.291 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174608+0000", 2024-09-12T18:37:07.292 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028054590000000002 2024-09-12T18:37:07.292 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.292 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.292 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:07.292 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174762+0000", 2024-09-12T18:37:07.292 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015465100000000001 2024-09-12T18:37:07.292 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.292 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.292 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:07.292 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237474+0000", 2024-09-12T18:37:07.292 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.062711683000000004 2024-09-12T18:37:07.292 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.292 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.292 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:07.292 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237540+0000", 2024-09-12T18:37:07.293 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.6132999999999999e-05 2024-09-12T18:37:07.293 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.293 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.293 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:07.293 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237748+0000", 2024-09-12T18:37:07.293 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020752499999999999 2024-09-12T18:37:07.293 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:07.293 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:07.293 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:07.293 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.293 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.293 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167374 5.1 5:81e25826:::benchmark_data_smithi073_23739_object35097:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:07.293 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.173748+0000", 2024-09-12T18:37:07.293 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 4.0126035460000002, 2024-09-12T18:37:07.294 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.069225245000000005, 2024-09-12T18:37:07.294 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:07.294 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:07.294 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:07.294 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:07.294 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:07.294 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:07.294 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167374 2024-09-12T18:37:07.294 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.294 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:07.294 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.294 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:07.294 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173748+0000", 2024-09-12T18:37:07.294 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:07.294 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.294 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.295 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:07.295 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173748+0000", 2024-09-12T18:37:07.295 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:07.295 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.295 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.295 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:07.295 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173749+0000", 2024-09-12T18:37:07.295 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.418e-06 2024-09-12T18:37:07.295 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.295 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.295 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:07.295 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173755+0000", 2024-09-12T18:37:07.295 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.0730000000000004e-06 2024-09-12T18:37:07.295 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.295 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.296 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:07.296 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173768+0000", 2024-09-12T18:37:07.296 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3644e-05 2024-09-12T18:37:07.296 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.296 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.296 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:07.296 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173777+0000", 2024-09-12T18:37:07.296 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4160000000000004e-06 2024-09-12T18:37:07.296 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.296 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.296 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:07.296 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173927+0000", 2024-09-12T18:37:07.296 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015065900000000001 2024-09-12T18:37:07.296 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.296 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.297 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:07.297 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174052+0000", 2024-09-12T18:37:07.297 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012460699999999999 2024-09-12T18:37:07.297 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.297 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.297 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:07.297 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174181+0000", 2024-09-12T18:37:07.297 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012919299999999999 2024-09-12T18:37:07.297 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.297 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.297 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:07.297 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.178108+0000", 2024-09-12T18:37:07.297 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0039273210000000001 2024-09-12T18:37:07.297 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.297 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.297 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:07.298 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.178118+0000", 2024-09-12T18:37:07.298 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7550000000000006e-06 2024-09-12T18:37:07.298 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.298 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.298 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:07.298 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.242865+0000", 2024-09-12T18:37:07.298 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.064746597000000003 2024-09-12T18:37:07.298 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.298 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.298 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:07.298 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.242903+0000", 2024-09-12T18:37:07.298 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.8268e-05 2024-09-12T18:37:07.298 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.298 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.298 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:07.298 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.242973+0000", 2024-09-12T18:37:07.299 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0294000000000002e-05 2024-09-12T18:37:07.299 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:07.299 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:07.299 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:07.299 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.299 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.299 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167375 5.1 5:83a09102:::benchmark_data_smithi073_23739_object35098:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:07.299 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:07.299 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 4.0125519990000003, 2024-09-12T18:37:07.299 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.069437463000000005, 2024-09-12T18:37:07.299 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:07.299 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:07.299 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:07.299 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:07.299 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:07.299 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:07.300 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167375 2024-09-12T18:37:07.300 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.300 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:07.300 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.300 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:07.300 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:07.300 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:07.300 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.300 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.300 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:07.300 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:07.300 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:07.300 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.300 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.301 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:07.301 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:07.301 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1399999999999997e-07 2024-09-12T18:37:07.301 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.301 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.301 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:07.301 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173803+0000", 2024-09-12T18:37:07.301 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.7860000000000001e-06 2024-09-12T18:37:07.301 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.301 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.301 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:07.301 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173811+0000", 2024-09-12T18:37:07.301 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4610000000000008e-06 2024-09-12T18:37:07.301 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.301 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.301 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:07.302 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173817+0000", 2024-09-12T18:37:07.302 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3569999999999997e-06 2024-09-12T18:37:07.302 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.302 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.302 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:07.302 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.176070+0000", 2024-09-12T18:37:07.302 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.002253405 2024-09-12T18:37:07.302 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.302 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.302 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:07.302 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.176263+0000", 2024-09-12T18:37:07.302 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000192583 2024-09-12T18:37:07.302 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.302 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.303 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:07.303 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.176429+0000", 2024-09-12T18:37:07.303 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00016626 2024-09-12T18:37:07.303 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.303 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.303 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:07.303 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.178154+0000", 2024-09-12T18:37:07.303 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0017247009999999999 2024-09-12T18:37:07.303 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.303 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.303 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:07.303 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.182110+0000", 2024-09-12T18:37:07.303 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0039568229999999999 2024-09-12T18:37:07.303 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.303 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.303 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:07.304 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.243024+0000", 2024-09-12T18:37:07.304 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.060913249000000003 2024-09-12T18:37:07.304 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.304 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.304 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:07.304 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.243107+0000", 2024-09-12T18:37:07.304 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.3090000000000006e-05 2024-09-12T18:37:07.304 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:07.304 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:07.304 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:07.304 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.243237+0000", 2024-09-12T18:37:07.304 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013023399999999999 2024-09-12T18:37:07.304 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:07.304 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:07.304 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:07.305 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:07.305 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:07.305 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:07.305 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:37:07.305 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:37:07.305 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-09-12T18:37:07.305 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-12T18:37:07.305 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-12T18:37:07.306 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-09-12T18:37:07.307 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:37:07.308 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:07.298+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:07.408 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:07.403+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:07.476 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:07.476 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-12T18:37:07.476 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:07.478 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:07.478 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:37:07.478 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.478 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:176192 5.a e60/21)", 2024-09-12T18:37:07.478 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:07.474119+0000", 2024-09-12T18:37:07.478 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00066443600000000002, 2024-09-12T18:37:07.478 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00068144199999999999, 2024-09-12T18:37:07.478 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:07.478 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:07.478 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:07.478 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:07.478 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.479 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:07.479 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.474119+0000", 2024-09-12T18:37:07.479 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:07.479 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.479 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.479 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:07.479 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.474119+0000", 2024-09-12T18:37:07.479 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:07.479 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.479 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.479 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:07.479 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.474120+0000", 2024-09-12T18:37:07.479 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.68e-07 2024-09-12T18:37:07.480 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.480 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.480 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:07.480 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.474124+0000", 2024-09-12T18:37:07.480 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.7270000000000001e-06 2024-09-12T18:37:07.480 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.480 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.480 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:07.480 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.474132+0000", 2024-09-12T18:37:07.480 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.3259999999999996e-06 2024-09-12T18:37:07.480 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.481 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.481 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:07.481 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.474138+0000", 2024-09-12T18:37:07.481 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.139e-06 2024-09-12T18:37:07.481 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:07.481 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:07.481 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:07.482 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.482 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.482 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:176209 5.4 e60/21 5:234cfb11:::benchmark_data_smithi073_23739_object43932:head v 60'10912, mlcod=60'10908)", 2024-09-12T18:37:07.482 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:07.474159+0000", 2024-09-12T18:37:07.482 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.000624579, 2024-09-12T18:37:07.482 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000687048, 2024-09-12T18:37:07.482 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:07.482 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:07.482 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:07.482 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:07.482 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.482 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:07.482 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.474159+0000", 2024-09-12T18:37:07.483 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:07.483 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.483 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.483 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:07.483 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.474159+0000", 2024-09-12T18:37:07.483 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:07.483 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.483 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.483 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:07.483 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.474160+0000", 2024-09-12T18:37:07.483 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4999999999999998e-07 2024-09-12T18:37:07.483 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.483 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.483 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:07.484 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.474164+0000", 2024-09-12T18:37:07.484 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0899999999999998e-06 2024-09-12T18:37:07.484 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.484 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.484 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:07.484 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.474172+0000", 2024-09-12T18:37:07.484 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0260000000000007e-06 2024-09-12T18:37:07.484 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.484 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.484 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:07.484 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.474177+0000", 2024-09-12T18:37:07.485 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2249999999999999e-06 2024-09-12T18:37:07.485 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.485 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.485 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:07.485 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.474456+0000", 2024-09-12T18:37:07.485 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000279461 2024-09-12T18:37:07.485 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.485 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.485 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:07.485 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.474477+0000", 2024-09-12T18:37:07.485 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.0795e-05 2024-09-12T18:37:07.485 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:07.485 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:07.486 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:07.486 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.486 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.486 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:176212 5.2 e60/21)", 2024-09-12T18:37:07.486 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:07.474182+0000", 2024-09-12T18:37:07.486 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00060204200000000001, 2024-09-12T18:37:07.486 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00070912099999999995, 2024-09-12T18:37:07.486 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:07.486 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:07.486 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:07.487 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:07.487 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.487 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:07.487 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.474182+0000", 2024-09-12T18:37:07.487 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:07.487 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.487 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.487 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:07.487 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.474182+0000", 2024-09-12T18:37:07.487 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:07.487 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.487 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.487 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:07.488 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.474183+0000", 2024-09-12T18:37:07.488 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.3699999999999999e-07 2024-09-12T18:37:07.488 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.488 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.488 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:07.488 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.474190+0000", 2024-09-12T18:37:07.488 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5469999999999999e-06 2024-09-12T18:37:07.488 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.488 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.488 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:07.488 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.474205+0000", 2024-09-12T18:37:07.489 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4861999999999999e-05 2024-09-12T18:37:07.489 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.489 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.489 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:07.489 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.474211+0000", 2024-09-12T18:37:07.489 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.122e-06 2024-09-12T18:37:07.489 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:07.489 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:07.489 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:07.489 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.489 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.489 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:176192 5.a 5:523df10c:::benchmark_data_smithi073_23739_object43915:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:37:07.489 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:07.464657+0000", 2024-09-12T18:37:07.489 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.010126929, 2024-09-12T18:37:07.490 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.010278051, 2024-09-12T18:37:07.490 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:07.490 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:07.490 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:07.490 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:07.490 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:07.490 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:07.490 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 176192 2024-09-12T18:37:07.490 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.490 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:07.490 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.490 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:07.490 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.464657+0000", 2024-09-12T18:37:07.490 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:07.491 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.491 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.491 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:07.491 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.464657+0000", 2024-09-12T18:37:07.491 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:07.491 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.492 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.492 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:07.492 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.464658+0000", 2024-09-12T18:37:07.492 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.051e-06 2024-09-12T18:37:07.492 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.492 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.492 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:07.492 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.464663+0000", 2024-09-12T18:37:07.493 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.549e-06 2024-09-12T18:37:07.493 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.493 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.493 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:07.493 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.464673+0000", 2024-09-12T18:37:07.493 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0475000000000001e-05 2024-09-12T18:37:07.493 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.493 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.493 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:07.493 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.464680+0000", 2024-09-12T18:37:07.493 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1770000000000001e-06 2024-09-12T18:37:07.493 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.494 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.494 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:07.494 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.464895+0000", 2024-09-12T18:37:07.494 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00021463799999999999 2024-09-12T18:37:07.494 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.494 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.494 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:07.494 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.465013+0000", 2024-09-12T18:37:07.494 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000118282 2024-09-12T18:37:07.494 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.494 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.494 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:07.494 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.467071+0000", 2024-09-12T18:37:07.495 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0020579280000000001 2024-09-12T18:37:07.495 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:07.495 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:07.495 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:07.495 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.495 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.495 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:176198 5.e e60/21 5:716d67a0:::benchmark_data_smithi073_23739_object43921:head v 60'11105, mlcod=60'11101)", 2024-09-12T18:37:07.495 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:07.468778+0000", 2024-09-12T18:37:07.495 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0060055860000000003, 2024-09-12T18:37:07.495 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0062197830000000004, 2024-09-12T18:37:07.495 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:07.495 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:07.495 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:07.495 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:07.496 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.496 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:07.496 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.468778+0000", 2024-09-12T18:37:07.496 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:07.496 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.496 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.496 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:07.496 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.468778+0000", 2024-09-12T18:37:07.496 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:07.496 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.496 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.496 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:07.496 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.468779+0000", 2024-09-12T18:37:07.497 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4799999999999997e-07 2024-09-12T18:37:07.497 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.497 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.497 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:07.497 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.468783+0000", 2024-09-12T18:37:07.497 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.1099999999999996e-06 2024-09-12T18:37:07.497 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.497 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.498 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:07.498 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.468790+0000", 2024-09-12T18:37:07.498 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4760000000000003e-06 2024-09-12T18:37:07.498 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.498 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.498 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:07.498 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.468795+0000", 2024-09-12T18:37:07.498 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0669999999999999e-06 2024-09-12T18:37:07.498 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.498 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.498 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:07.498 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.469271+0000", 2024-09-12T18:37:07.499 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00047669599999999998 2024-09-12T18:37:07.499 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.499 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.499 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:07.499 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.469288+0000", 2024-09-12T18:37:07.499 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6362e-05 2024-09-12T18:37:07.499 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:07.499 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:07.499 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:07.499 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.499 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.499 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:176202 5.a 5:5ae008e8:::benchmark_data_smithi073_23739_object43925:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:37:07.500 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:07.469487+0000", 2024-09-12T18:37:07.500 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0052966530000000001, 2024-09-12T18:37:07.500 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0055602660000000003, 2024-09-12T18:37:07.500 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:07.500 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:07.500 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:07.500 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:07.500 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:07.500 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:07.500 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 176202 2024-09-12T18:37:07.500 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.500 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:07.501 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.501 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:07.501 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.469487+0000", 2024-09-12T18:37:07.501 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:07.501 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.501 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.501 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:07.501 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.469487+0000", 2024-09-12T18:37:07.501 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:07.501 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.502 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.502 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:07.502 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.469488+0000", 2024-09-12T18:37:07.502 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6000000000000002e-07 2024-09-12T18:37:07.502 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.502 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.502 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:07.502 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.469492+0000", 2024-09-12T18:37:07.502 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.9589999999999997e-06 2024-09-12T18:37:07.502 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.503 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.503 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:07.503 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.469498+0000", 2024-09-12T18:37:07.503 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3749999999999999e-06 2024-09-12T18:37:07.503 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.503 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.503 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:07.503 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.469503+0000", 2024-09-12T18:37:07.503 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2520000000000001e-06 2024-09-12T18:37:07.503 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.504 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.504 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:07.504 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.470981+0000", 2024-09-12T18:37:07.504 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0014787999999999999 2024-09-12T18:37:07.504 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.504 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.504 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:07.504 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.471120+0000", 2024-09-12T18:37:07.504 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013844199999999999 2024-09-12T18:37:07.505 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.505 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.505 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:07.505 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.471193+0000", 2024-09-12T18:37:07.505 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3206000000000003e-05 2024-09-12T18:37:07.505 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:07.505 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:07.505 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:07.505 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.505 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.505 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:176201 5.0 e60/49 5:03dd9f25:::benchmark_data_smithi073_23739_object43924:head v 60'11048, mlcod=60'11046)", 2024-09-12T18:37:07.506 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:07.469796+0000", 2024-09-12T18:37:07.506 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0049883310000000004, 2024-09-12T18:37:07.506 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0053107010000000001, 2024-09-12T18:37:07.506 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:07.506 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:07.506 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:07.506 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:07.506 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.506 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:07.506 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.469796+0000", 2024-09-12T18:37:07.507 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:07.507 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.507 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.507 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:07.507 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.469796+0000", 2024-09-12T18:37:07.507 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:07.507 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.507 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.507 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:07.507 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.469796+0000", 2024-09-12T18:37:07.508 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4499999999999997e-07 2024-09-12T18:37:07.508 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.508 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.508 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:07.508 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.469804+0000", 2024-09-12T18:37:07.508 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0180000000000001e-06 2024-09-12T18:37:07.508 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.508 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.508 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:07.508 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.469811+0000", 2024-09-12T18:37:07.509 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.029e-06 2024-09-12T18:37:07.509 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.509 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.509 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:07.509 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.469817+0000", 2024-09-12T18:37:07.509 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.229e-06 2024-09-12T18:37:07.509 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.509 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.509 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:07.509 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.469870+0000", 2024-09-12T18:37:07.509 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2814e-05 2024-09-12T18:37:07.509 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.510 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.510 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:07.510 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.469891+0000", 2024-09-12T18:37:07.510 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.0356e-05 2024-09-12T18:37:07.510 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:07.510 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:07.510 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:07.510 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.510 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.510 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:176200 5.1 e60/49 5:871c8ce7:::benchmark_data_smithi073_23739_object43923:head v 60'10985, mlcod=60'10981)", 2024-09-12T18:37:07.510 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:07.469825+0000", 2024-09-12T18:37:07.510 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0049590140000000003, 2024-09-12T18:37:07.511 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.005328742, 2024-09-12T18:37:07.511 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:07.511 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:07.511 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:07.511 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:07.511 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.511 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:07.511 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.469825+0000", 2024-09-12T18:37:07.511 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:07.511 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.511 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.511 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:07.512 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.469825+0000", 2024-09-12T18:37:07.512 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:07.512 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.512 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.512 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:07.512 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.469825+0000", 2024-09-12T18:37:07.512 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6199999999999998e-07 2024-09-12T18:37:07.512 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.512 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.512 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:07.512 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.469830+0000", 2024-09-12T18:37:07.513 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5730000000000001e-06 2024-09-12T18:37:07.513 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.513 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.513 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:07.513 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.469838+0000", 2024-09-12T18:37:07.513 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.9729999999999997e-06 2024-09-12T18:37:07.513 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.513 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.513 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:07.513 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.469844+0000", 2024-09-12T18:37:07.513 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.575e-06 2024-09-12T18:37:07.514 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.514 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.514 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:07.514 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.470671+0000", 2024-09-12T18:37:07.514 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00082793799999999996 2024-09-12T18:37:07.514 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.514 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.514 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:07.514 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.470691+0000", 2024-09-12T18:37:07.514 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9066e-05 2024-09-12T18:37:07.515 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:07.515 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:07.515 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:07.515 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.515 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.515 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:176203 5.4 e60/21 5:2f6815ab:::benchmark_data_smithi073_23739_object43926:head v 60'10910, mlcod=60'10908)", 2024-09-12T18:37:07.515 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:07.470608+0000", 2024-09-12T18:37:07.515 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0041758519999999999, 2024-09-12T18:37:07.515 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0045958300000000004, 2024-09-12T18:37:07.515 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:07.515 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:07.515 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:07.516 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:07.516 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.516 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:07.516 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.470608+0000", 2024-09-12T18:37:07.516 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:07.516 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.516 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.516 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:07.516 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.470608+0000", 2024-09-12T18:37:07.516 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:07.516 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.516 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.516 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:07.517 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.470609+0000", 2024-09-12T18:37:07.517 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3e-07 2024-09-12T18:37:07.517 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.517 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.517 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:07.517 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.470617+0000", 2024-09-12T18:37:07.517 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6419999999999996e-06 2024-09-12T18:37:07.517 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.517 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.517 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:07.517 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.470626+0000", 2024-09-12T18:37:07.518 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.0589999999999992e-06 2024-09-12T18:37:07.518 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.518 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.518 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:07.518 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.470632+0000", 2024-09-12T18:37:07.518 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9560000000000002e-06 2024-09-12T18:37:07.518 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.518 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.518 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:07.518 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.470736+0000", 2024-09-12T18:37:07.518 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000103523 2024-09-12T18:37:07.519 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.519 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.519 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:07.519 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.470756+0000", 2024-09-12T18:37:07.519 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9709999999999999e-05 2024-09-12T18:37:07.519 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:07.519 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:07.519 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:07.519 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.519 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.519 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:176205 5.e e60/21 5:71b6083e:::benchmark_data_smithi073_23739_object43928:head v 60'11106, mlcod=60'11101)", 2024-09-12T18:37:07.519 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:07.470859+0000", 2024-09-12T18:37:07.520 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0039250839999999997, 2024-09-12T18:37:07.520 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0043926110000000003, 2024-09-12T18:37:07.520 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:07.520 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:07.520 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:07.520 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:07.520 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.520 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:07.520 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.470859+0000", 2024-09-12T18:37:07.520 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:07.520 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.521 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.521 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:07.521 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.470859+0000", 2024-09-12T18:37:07.521 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:07.521 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.521 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.521 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:07.521 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.470859+0000", 2024-09-12T18:37:07.521 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.9100000000000003e-07 2024-09-12T18:37:07.521 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.521 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.521 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:07.522 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.470865+0000", 2024-09-12T18:37:07.522 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0780000000000003e-06 2024-09-12T18:37:07.522 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.522 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.522 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:07.522 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.470873+0000", 2024-09-12T18:37:07.522 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7979999999999995e-06 2024-09-12T18:37:07.522 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.522 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.522 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:07.522 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.470879+0000", 2024-09-12T18:37:07.522 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9499999999999998e-06 2024-09-12T18:37:07.523 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.523 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.523 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:07.523 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.471004+0000", 2024-09-12T18:37:07.523 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000124253 2024-09-12T18:37:07.523 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.523 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.523 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:07.523 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.471020+0000", 2024-09-12T18:37:07.523 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.658e-05 2024-09-12T18:37:07.523 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:07.523 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:07.524 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:07.524 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.524 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.524 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:176206 5.2 e60/21 5:4894cd93:::benchmark_data_smithi073_23739_object43929:head v 60'10915, mlcod=60'10913)", 2024-09-12T18:37:07.524 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:07.471842+0000", 2024-09-12T18:37:07.524 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0029415999999999999, 2024-09-12T18:37:07.524 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0034561599999999998, 2024-09-12T18:37:07.524 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:07.524 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:07.524 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:07.525 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:07.525 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.525 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:07.525 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.471842+0000", 2024-09-12T18:37:07.525 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:07.525 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.525 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.525 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:07.525 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.471842+0000", 2024-09-12T18:37:07.525 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:07.526 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.526 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.526 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:07.526 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.471843+0000", 2024-09-12T18:37:07.526 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4499999999999996e-07 2024-09-12T18:37:07.526 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.526 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.526 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:07.526 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.471849+0000", 2024-09-12T18:37:07.526 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5620000000000003e-06 2024-09-12T18:37:07.526 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.527 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.527 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:07.527 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.471865+0000", 2024-09-12T18:37:07.527 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6028999999999998e-05 2024-09-12T18:37:07.527 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.527 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.527 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:07.527 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.471871+0000", 2024-09-12T18:37:07.527 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1469999999999998e-06 2024-09-12T18:37:07.527 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.527 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.528 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:07.528 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.471929+0000", 2024-09-12T18:37:07.528 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8598999999999999e-05 2024-09-12T18:37:07.528 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.528 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.528 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:07.528 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.471950+0000", 2024-09-12T18:37:07.528 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.0931e-05 2024-09-12T18:37:07.528 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:07.528 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:07.529 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:07.529 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.529 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.529 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:176207 5.a 5:51ab77da:::benchmark_data_smithi073_23739_object43930:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:37:07.529 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:07.472226+0000", 2024-09-12T18:37:07.529 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0025575620000000002, 2024-09-12T18:37:07.529 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0031204819999999999, 2024-09-12T18:37:07.529 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:07.529 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:07.529 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:07.530 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:07.530 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:07.530 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:07.530 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 176207 2024-09-12T18:37:07.530 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.530 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:07.530 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.530 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:07.530 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.472226+0000", 2024-09-12T18:37:07.530 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:07.530 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.531 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.531 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:07.531 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.472226+0000", 2024-09-12T18:37:07.531 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:07.531 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.531 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.531 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:07.531 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.472227+0000", 2024-09-12T18:37:07.531 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.048e-06 2024-09-12T18:37:07.531 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.531 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.531 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:07.532 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.472233+0000", 2024-09-12T18:37:07.532 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2249999999999999e-06 2024-09-12T18:37:07.532 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.532 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.532 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:07.532 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.472243+0000", 2024-09-12T18:37:07.532 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0703999999999999e-05 2024-09-12T18:37:07.532 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.532 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.532 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:07.533 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.472248+0000", 2024-09-12T18:37:07.533 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0200000000000002e-06 2024-09-12T18:37:07.533 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.533 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.533 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:07.533 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.474344+0000", 2024-09-12T18:37:07.533 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0020958539999999999 2024-09-12T18:37:07.533 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.533 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.533 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:07.534 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.474432+0000", 2024-09-12T18:37:07.534 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.8007e-05 2024-09-12T18:37:07.534 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.534 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.534 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:07.534 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.474494+0000", 2024-09-12T18:37:07.534 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1376000000000003e-05 2024-09-12T18:37:07.534 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:07.534 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:07.534 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:07.534 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.535 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.535 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:176204 5.4 e60/21 5:231fefda:::benchmark_data_smithi073_23739_object43927:head v 60'10911, mlcod=60'10908)", 2024-09-12T18:37:07.535 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:07.472617+0000", 2024-09-12T18:37:07.535 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0021666160000000001, 2024-09-12T18:37:07.535 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0027878310000000002, 2024-09-12T18:37:07.535 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:07.535 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:07.535 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:07.535 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:07.535 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.536 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:07.536 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.472617+0000", 2024-09-12T18:37:07.536 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:07.536 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.536 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.536 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:07.536 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.472617+0000", 2024-09-12T18:37:07.536 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:07.536 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.537 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.537 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:07.537 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.472618+0000", 2024-09-12T18:37:07.537 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3900000000000004e-07 2024-09-12T18:37:07.537 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.537 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.537 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:07.537 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.472623+0000", 2024-09-12T18:37:07.537 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.028e-06 2024-09-12T18:37:07.537 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.537 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.538 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:07.538 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.472632+0000", 2024-09-12T18:37:07.538 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.3230000000000004e-06 2024-09-12T18:37:07.538 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.538 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.538 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:07.538 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.472639+0000", 2024-09-12T18:37:07.538 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8190000000000003e-06 2024-09-12T18:37:07.538 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.538 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.539 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:07.539 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.472684+0000", 2024-09-12T18:37:07.539 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4709999999999997e-05 2024-09-12T18:37:07.539 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.539 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.539 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:07.539 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.472701+0000", 2024-09-12T18:37:07.539 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7431999999999998e-05 2024-09-12T18:37:07.539 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:07.539 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:07.539 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:07.539 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.540 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.540 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:176208 5.3 5:c0147ec1:::benchmark_data_smithi073_23739_object43931:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:37:07.540 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:07.472841+0000", 2024-09-12T18:37:07.540 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0019429569999999999, 2024-09-12T18:37:07.540 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0026140429999999999, 2024-09-12T18:37:07.540 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:07.540 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:07.540 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:07.540 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:07.541 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:07.541 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:07.541 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 176208 2024-09-12T18:37:07.541 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.541 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:07.541 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.541 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:07.541 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.472841+0000", 2024-09-12T18:37:07.541 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:07.541 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.541 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.541 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:07.542 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.472841+0000", 2024-09-12T18:37:07.542 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:07.542 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.542 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.542 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:07.542 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.472842+0000", 2024-09-12T18:37:07.542 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.8999999999999995e-07 2024-09-12T18:37:07.542 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.542 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.542 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:07.542 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.472846+0000", 2024-09-12T18:37:07.543 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.7969999999999998e-06 2024-09-12T18:37:07.543 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.543 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.543 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:07.543 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.472857+0000", 2024-09-12T18:37:07.543 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1191e-05 2024-09-12T18:37:07.543 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.543 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.543 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:07.543 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.472863+0000", 2024-09-12T18:37:07.543 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3199999999999996e-06 2024-09-12T18:37:07.544 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.544 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.544 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:07.544 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.472912+0000", 2024-09-12T18:37:07.544 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9002000000000003e-05 2024-09-12T18:37:07.544 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.544 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.544 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:07.544 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.473008+0000", 2024-09-12T18:37:07.544 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.5656999999999996e-05 2024-09-12T18:37:07.545 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.545 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.545 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:07.545 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.473079+0000", 2024-09-12T18:37:07.545 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0772000000000006e-05 2024-09-12T18:37:07.545 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:07.545 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:07.545 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:07.545 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.545 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.545 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:176210 5.b e60/21 5:db60ce74:::benchmark_data_smithi073_23739_object43933:head v 60'11146, mlcod=60'11144)", 2024-09-12T18:37:07.546 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:07.473545+0000", 2024-09-12T18:37:07.546 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.001239223, 2024-09-12T18:37:07.546 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0019700329999999999, 2024-09-12T18:37:07.546 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:07.546 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:07.546 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:07.546 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:07.546 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.546 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:07.546 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.473545+0000", 2024-09-12T18:37:07.546 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:07.546 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.547 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.547 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:07.547 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.473545+0000", 2024-09-12T18:37:07.547 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:07.547 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.547 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.547 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:07.547 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.473545+0000", 2024-09-12T18:37:07.547 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2300000000000002e-07 2024-09-12T18:37:07.547 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.547 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.547 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:07.548 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.473549+0000", 2024-09-12T18:37:07.548 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4680000000000001e-06 2024-09-12T18:37:07.548 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.548 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.548 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:07.548 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.473556+0000", 2024-09-12T18:37:07.548 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3300000000000001e-06 2024-09-12T18:37:07.548 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.548 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.548 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:07.548 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.473562+0000", 2024-09-12T18:37:07.549 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.874e-06 2024-09-12T18:37:07.549 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.549 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.549 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:07.549 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.474054+0000", 2024-09-12T18:37:07.549 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00049263599999999996 2024-09-12T18:37:07.549 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:07.549 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:07.549 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:07.549 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:07.474074+0000", 2024-09-12T18:37:07.549 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9375999999999999e-05 2024-09-12T18:37:07.549 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:07.550 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:07.550 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:07.550 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:07.550 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-12T18:37:07.550 INFO:teuthology.orchestra.run.smithi114.stdout: "num_ops": 15 2024-09-12T18:37:07.550 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:07.553 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:37:07.553 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:07.546+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:07.652 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:37:07.654 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:07.646+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:07.751 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:07.751 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2024-09-12T18:37:07.751 INFO:teuthology.orchestra.run.smithi114.stdout: "complaint_time": 30, 2024-09-12T18:37:07.751 INFO:teuthology.orchestra.run.smithi114.stdout: "num_blocked_ops": 0 2024-09-12T18:37:07.752 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:07.754 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:07.751+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:07.771 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:37:07.808 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:37:07.808 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:37:07.826 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:37:07.827 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:37:07.846 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:37:07.846 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:37:07.855 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:07.849+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:07.955 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:07.949+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:07.963 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:07.963 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:07.983 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:37:08.057 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:08.050+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:08.138 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:08.138 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:08.158 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:08.155+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:08.160 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:37:08.259 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:08.255+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:08.317 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:08.317 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:08.338 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:37:08.360 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:08.354+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:08.461 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:08.455+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:08.493 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:08.494 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:08.516 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:37:08.562 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:08.554+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:08.663 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:08.658+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:08.677 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:08.677 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:08.685 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T18:37:08.698 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:37:08.764 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:08.757+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:08.865 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:08.857+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:08.901 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:08.902 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:08.922 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:37:08.965 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:08.957+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:09.065 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:09.058+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:09.083 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:09.083 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:09.104 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:37:09.167 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:09.158+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:09.261 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:09.261 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:09.267 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:09.261+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:09.283 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:37:09.368 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:09.362+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:09.470 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:09.462+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:09.482 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:09.482 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:09.504 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:37:09.592 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:09.586+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:09.667 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is set 2024-09-12T18:37:09.671 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:09.662+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:09.708 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:09.708 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:09.730 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:37:09.772 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:09.766+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:09.863 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:37:09.873 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:09.866+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:09.893 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:09.893 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:09.914 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:37:09.974 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:09.970+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:10.017 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:37:10.017 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:37:10.035 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:37:10.035 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:37:10.053 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:37:10.053 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:37:10.071 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:10.071 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-09-12T18:37:10.071 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-09-12T18:37:10.071 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-09-12T18:37:10.071 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:10.075 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:10.069+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:10.092 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:37:10.178 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:10.173+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:10.277 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:10.269+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:10.294 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:10.294 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-09-12T18:37:10.294 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-09-12T18:37:10.294 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:37:10.294 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.294 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:10.294 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:37:10.295 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 104.657599572, 2024-09-12T18:37:10.295 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025088781000000001, 2024-09-12T18:37:10.295 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:10.295 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:10.295 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:10.295 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:10.295 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.295 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:10.296 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:37:10.296 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:10.296 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.296 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.296 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:10.296 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:37:10.296 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:10.296 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.296 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.296 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:10.296 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632518+0000", 2024-09-12T18:37:10.296 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:37:10.296 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.296 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.297 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:10.297 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632533+0000", 2024-09-12T18:37:10.297 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5130000000000001e-05 2024-09-12T18:37:10.297 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.297 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.297 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:10.297 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632564+0000", 2024-09-12T18:37:10.297 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0788999999999999e-05 2024-09-12T18:37:10.297 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.298 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.298 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:10.298 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632590+0000", 2024-09-12T18:37:10.298 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6057000000000001e-05 2024-09-12T18:37:10.298 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.298 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.298 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:10.298 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.635931+0000", 2024-09-12T18:37:10.298 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033411320000000001 2024-09-12T18:37:10.298 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.298 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.298 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:10.298 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636186+0000", 2024-09-12T18:37:10.299 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025452500000000002 2024-09-12T18:37:10.299 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.299 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.299 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:10.299 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636445+0000", 2024-09-12T18:37:10.299 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000259268 2024-09-12T18:37:10.299 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.299 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.299 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:10.299 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639562+0000", 2024-09-12T18:37:10.299 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031167 2024-09-12T18:37:10.299 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.299 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.300 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:10.300 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657314+0000", 2024-09-12T18:37:10.300 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017752562 2024-09-12T18:37:10.300 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.300 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.300 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:10.300 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657445+0000", 2024-09-12T18:37:10.300 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013105899999999999 2024-09-12T18:37:10.300 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.300 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.301 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:10.301 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657598+0000", 2024-09-12T18:37:10.301 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015247899999999999 2024-09-12T18:37:10.301 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:10.301 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:10.301 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:10.301 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.301 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.301 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:10.301 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:37:10.301 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 104.657473369, 2024-09-12T18:37:10.301 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025643131999999999, 2024-09-12T18:37:10.301 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:10.302 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:10.302 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:10.302 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:10.302 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.302 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:10.302 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:37:10.302 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:10.302 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.302 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.302 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:10.302 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:37:10.302 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:10.302 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.303 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.303 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:10.303 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632637+0000", 2024-09-12T18:37:10.303 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5600000000000001e-06 2024-09-12T18:37:10.303 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.303 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.303 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:10.303 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632650+0000", 2024-09-12T18:37:10.303 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3186e-05 2024-09-12T18:37:10.303 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.304 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.304 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:10.304 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632672+0000", 2024-09-12T18:37:10.304 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2013000000000001e-05 2024-09-12T18:37:10.304 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.304 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.304 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:10.304 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632687+0000", 2024-09-12T18:37:10.304 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5109999999999999e-05 2024-09-12T18:37:10.305 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.305 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.305 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:10.305 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636994+0000", 2024-09-12T18:37:10.305 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0043065539999999998 2024-09-12T18:37:10.305 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.305 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.305 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:10.305 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637198+0000", 2024-09-12T18:37:10.306 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020387199999999999 2024-09-12T18:37:10.306 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.306 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.306 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:10.306 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637475+0000", 2024-09-12T18:37:10.306 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027731000000000001 2024-09-12T18:37:10.306 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.306 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.306 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:10.306 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639574+0000", 2024-09-12T18:37:10.306 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020988999999999999 2024-09-12T18:37:10.306 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.306 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.306 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:10.307 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658057+0000", 2024-09-12T18:37:10.307 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018482926 2024-09-12T18:37:10.307 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.307 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.307 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:10.307 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658184+0000", 2024-09-12T18:37:10.307 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012756200000000001 2024-09-12T18:37:10.307 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.307 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.307 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:10.307 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658278+0000", 2024-09-12T18:37:10.307 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4139000000000001e-05 2024-09-12T18:37:10.307 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:10.307 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:10.307 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:10.307 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.308 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.308 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:10.308 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:37:10.308 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 104.657398277, 2024-09-12T18:37:10.308 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025238883, 2024-09-12T18:37:10.308 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:10.308 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:10.308 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:10.308 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:10.308 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.308 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:10.308 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:37:10.308 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:10.308 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.309 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.309 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:10.309 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:37:10.309 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:10.309 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.309 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.309 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:10.309 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632712+0000", 2024-09-12T18:37:10.309 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6869999999999999e-06 2024-09-12T18:37:10.309 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.309 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.309 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:10.309 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632719+0000", 2024-09-12T18:37:10.310 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6059999999999999e-06 2024-09-12T18:37:10.310 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.310 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.310 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:10.310 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632737+0000", 2024-09-12T18:37:10.310 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7983999999999999e-05 2024-09-12T18:37:10.310 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.310 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.310 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:10.310 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632751+0000", 2024-09-12T18:37:10.310 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4473e-05 2024-09-12T18:37:10.310 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.310 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.311 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:10.311 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636961+0000", 2024-09-12T18:37:10.311 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042100840000000002 2024-09-12T18:37:10.311 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.311 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.311 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:10.311 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637211+0000", 2024-09-12T18:37:10.311 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000249738 2024-09-12T18:37:10.311 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.311 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.311 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:10.311 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637504+0000", 2024-09-12T18:37:10.311 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00029271499999999998 2024-09-12T18:37:10.311 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.312 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.312 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:10.312 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639582+0000", 2024-09-12T18:37:10.312 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020783389999999998 2024-09-12T18:37:10.312 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.312 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.312 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:10.312 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657709+0000", 2024-09-12T18:37:10.312 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018126758999999999 2024-09-12T18:37:10.312 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.312 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.313 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:10.313 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657830+0000", 2024-09-12T18:37:10.313 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000121329 2024-09-12T18:37:10.313 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.313 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.313 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:10.313 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657949+0000", 2024-09-12T18:37:10.313 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000119169 2024-09-12T18:37:10.313 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:10.313 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:10.313 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:10.313 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.313 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.314 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:10.314 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:37:10.314 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 104.65733423099999, 2024-09-12T18:37:10.314 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026711823999999999, 2024-09-12T18:37:10.314 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:10.314 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:10.314 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:10.314 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:10.314 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.314 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:10.315 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:37:10.315 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:10.315 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.315 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.315 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:10.315 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:37:10.315 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:10.315 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.315 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.315 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:10.315 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632775+0000", 2024-09-12T18:37:10.315 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9999999999999995e-07 2024-09-12T18:37:10.315 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.316 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.316 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:10.316 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632788+0000", 2024-09-12T18:37:10.316 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2629999999999999e-05 2024-09-12T18:37:10.316 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.316 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.316 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:10.316 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632806+0000", 2024-09-12T18:37:10.316 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:37:10.316 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.316 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.317 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:10.317 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632820+0000", 2024-09-12T18:37:10.317 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3777e-05 2024-09-12T18:37:10.317 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.317 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.317 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:10.317 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638310+0000", 2024-09-12T18:37:10.317 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054898280000000004 2024-09-12T18:37:10.317 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.317 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.317 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:10.318 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638480+0000", 2024-09-12T18:37:10.318 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016968199999999999 2024-09-12T18:37:10.318 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.318 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.318 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:10.318 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638799+0000", 2024-09-12T18:37:10.318 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031915999999999997 2024-09-12T18:37:10.318 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.318 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.318 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:10.318 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639866+0000", 2024-09-12T18:37:10.319 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001067405 2024-09-12T18:37:10.319 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.319 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.319 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:10.319 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658398+0000", 2024-09-12T18:37:10.319 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018531542000000002 2024-09-12T18:37:10.319 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.319 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.319 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:10.319 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658643+0000", 2024-09-12T18:37:10.319 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00024531500000000002 2024-09-12T18:37:10.319 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.319 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.320 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:10.320 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.659486+0000", 2024-09-12T18:37:10.320 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00084316899999999995 2024-09-12T18:37:10.320 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:10.320 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:10.320 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:10.320 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.320 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.320 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:10.320 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:37:10.320 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 104.657025477, 2024-09-12T18:37:10.320 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026938645000000001, 2024-09-12T18:37:10.320 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:10.320 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:10.321 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:10.321 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:10.321 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.321 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:10.321 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:37:10.321 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:10.321 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.321 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.321 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:10.321 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:37:10.321 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:10.321 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.321 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.321 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:10.322 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633085+0000", 2024-09-12T18:37:10.322 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:37:10.322 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.322 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.322 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:10.322 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633093+0000", 2024-09-12T18:37:10.322 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3999999999999992e-06 2024-09-12T18:37:10.322 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.322 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.322 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:10.322 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633111+0000", 2024-09-12T18:37:10.322 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8070000000000001e-05 2024-09-12T18:37:10.322 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.322 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.323 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:10.323 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633126+0000", 2024-09-12T18:37:10.323 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4487e-05 2024-09-12T18:37:10.323 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.323 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.323 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:10.323 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638290+0000", 2024-09-12T18:37:10.323 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0051640269999999999 2024-09-12T18:37:10.323 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.323 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.323 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:10.323 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638547+0000", 2024-09-12T18:37:10.323 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025714100000000001 2024-09-12T18:37:10.324 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.324 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.324 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:10.324 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638850+0000", 2024-09-12T18:37:10.324 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030278400000000001 2024-09-12T18:37:10.324 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.324 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.324 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:10.324 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.640706+0000", 2024-09-12T18:37:10.324 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018564580000000001 2024-09-12T18:37:10.325 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.325 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.325 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:10.325 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658420+0000", 2024-09-12T18:37:10.325 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017714395000000001 2024-09-12T18:37:10.325 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.325 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.326 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:10.326 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658635+0000", 2024-09-12T18:37:10.326 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021413500000000001 2024-09-12T18:37:10.326 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.326 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.326 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:10.326 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.660022+0000", 2024-09-12T18:37:10.326 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001387318 2024-09-12T18:37:10.326 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:10.326 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:10.327 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:10.327 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.327 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.327 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121096 5.8 5:13503891:::benchmark_data_smithi073_23739_object121095:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:10.327 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:37:10.327 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 30.11153251, 2024-09-12T18:37:10.327 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064025391000000001, 2024-09-12T18:37:10.327 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:10.327 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:10.327 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:10.327 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:10.327 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:10.327 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:10.327 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121096 2024-09-12T18:37:10.328 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.328 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:10.328 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.328 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:10.328 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:37:10.328 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:10.328 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.328 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.328 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:10.328 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:37:10.328 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:10.328 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.328 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.329 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:10.329 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178579+0000", 2024-09-12T18:37:10.329 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7369999999999998e-06 2024-09-12T18:37:10.329 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.329 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.329 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:10.329 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178846+0000", 2024-09-12T18:37:10.329 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026752699999999999 2024-09-12T18:37:10.329 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.329 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.329 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:10.329 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178877+0000", 2024-09-12T18:37:10.329 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1081999999999998e-05 2024-09-12T18:37:10.330 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.330 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.330 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:10.330 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178896+0000", 2024-09-12T18:37:10.330 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8522e-05 2024-09-12T18:37:10.330 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.330 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.330 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:10.330 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.192591+0000", 2024-09-12T18:37:10.330 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013695067 2024-09-12T18:37:10.330 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.330 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.330 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:10.331 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.192944+0000", 2024-09-12T18:37:10.331 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00035273699999999999 2024-09-12T18:37:10.331 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.331 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.331 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:10.331 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.193732+0000", 2024-09-12T18:37:10.331 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078849599999999997 2024-09-12T18:37:10.331 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.331 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.331 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:10.331 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.213583+0000", 2024-09-12T18:37:10.331 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.019851164000000001 2024-09-12T18:37:10.332 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.332 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.332 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:10.332 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242386+0000", 2024-09-12T18:37:10.332 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028802924000000001 2024-09-12T18:37:10.332 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.332 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.332 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:10.332 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242501+0000", 2024-09-12T18:37:10.332 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000114932 2024-09-12T18:37:10.332 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.332 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.332 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:10.333 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242602+0000", 2024-09-12T18:37:10.333 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000100203 2024-09-12T18:37:10.333 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:10.333 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:10.333 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:10.333 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.333 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.333 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121097 5.8 5:1b31a99e:::benchmark_data_smithi073_23739_object121096:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:10.333 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:37:10.333 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 30.095804220000002, 2024-09-12T18:37:10.333 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048475917, 2024-09-12T18:37:10.333 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:10.333 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:10.333 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:10.334 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:10.334 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:10.334 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:10.334 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121097 2024-09-12T18:37:10.334 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.334 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:10.334 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.334 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:10.334 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:37:10.334 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:10.334 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.334 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.335 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:10.335 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:37:10.335 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:10.335 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.335 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.335 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:10.335 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194308+0000", 2024-09-12T18:37:10.335 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2789999999999999e-06 2024-09-12T18:37:10.336 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.336 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.336 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:10.336 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194396+0000", 2024-09-12T18:37:10.336 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8324000000000003e-05 2024-09-12T18:37:10.336 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.337 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.337 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:10.337 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194424+0000", 2024-09-12T18:37:10.337 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7565000000000001e-05 2024-09-12T18:37:10.337 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.337 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.337 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:10.338 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194444+0000", 2024-09-12T18:37:10.338 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0363000000000001e-05 2024-09-12T18:37:10.338 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.338 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.338 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:10.338 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.206888+0000", 2024-09-12T18:37:10.338 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012443997 2024-09-12T18:37:10.339 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.339 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.339 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:10.339 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.207138+0000", 2024-09-12T18:37:10.339 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025035900000000002 2024-09-12T18:37:10.339 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.340 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.340 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:10.340 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.207365+0000", 2024-09-12T18:37:10.340 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000226407 2024-09-12T18:37:10.340 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.340 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.341 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:10.341 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.215059+0000", 2024-09-12T18:37:10.341 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076946860000000001 2024-09-12T18:37:10.341 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.341 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.341 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:10.342 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242619+0000", 2024-09-12T18:37:10.342 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.027559975 2024-09-12T18:37:10.342 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.342 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.342 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:10.342 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242706+0000", 2024-09-12T18:37:10.343 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6384999999999994e-05 2024-09-12T18:37:10.343 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.343 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.343 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:10.343 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242780+0000", 2024-09-12T18:37:10.343 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4577000000000001e-05 2024-09-12T18:37:10.343 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:10.344 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:10.344 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:10.344 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.344 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.344 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:121044 5.1 e50/49 5:83bf711a:::benchmark_data_smithi073_23739_object121043:head v 50'7532, mlcod=0'0)", 2024-09-12T18:37:10.344 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.201054+0000", 2024-09-12T18:37:10.345 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 30.089054998999998, 2024-09-12T18:37:10.345 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026157387000000001, 2024-09-12T18:37:10.345 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:10.345 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:10.345 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:10.345 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:10.346 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.346 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:10.346 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201054+0000", 2024-09-12T18:37:10.346 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:10.346 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.346 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.347 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:10.347 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201054+0000", 2024-09-12T18:37:10.347 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:10.347 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.347 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.347 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:10.348 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201056+0000", 2024-09-12T18:37:10.348 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.99e-06 2024-09-12T18:37:10.348 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.348 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.348 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:10.348 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201068+0000", 2024-09-12T18:37:10.349 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2799000000000001e-05 2024-09-12T18:37:10.349 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.349 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.350 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:10.350 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201093+0000", 2024-09-12T18:37:10.350 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4766e-05 2024-09-12T18:37:10.350 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.351 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.351 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:10.351 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201115+0000", 2024-09-12T18:37:10.351 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1988999999999999e-05 2024-09-12T18:37:10.351 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.351 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.352 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:10.352 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201233+0000", 2024-09-12T18:37:10.352 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000118229 2024-09-12T18:37:10.352 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.352 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.352 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:10.352 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201273+0000", 2024-09-12T18:37:10.353 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9171999999999997e-05 2024-09-12T18:37:10.353 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.353 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.353 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:10.353 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.227080+0000", 2024-09-12T18:37:10.353 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025807611000000001 2024-09-12T18:37:10.353 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.354 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.354 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:10.354 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.227211+0000", 2024-09-12T18:37:10.354 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013083100000000001 2024-09-12T18:37:10.354 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:10.354 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:10.354 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:10.354 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.354 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.354 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121101 5.e 5:7e18e9ed:::benchmark_data_smithi073_23739_object121100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:10.354 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.209084+0000", 2024-09-12T18:37:10.355 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 30.081024164999999, 2024-09-12T18:37:10.355 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028988566, 2024-09-12T18:37:10.355 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:10.355 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:10.355 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:10.355 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:10.355 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:10.355 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:10.355 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121101 2024-09-12T18:37:10.355 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.355 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:10.355 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.355 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:10.355 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209084+0000", 2024-09-12T18:37:10.356 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:10.356 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.356 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.356 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:10.356 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209084+0000", 2024-09-12T18:37:10.356 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:10.356 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.356 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.356 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:10.356 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209087+0000", 2024-09-12T18:37:10.356 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6800000000000002e-06 2024-09-12T18:37:10.356 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.356 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.357 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:10.357 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209182+0000", 2024-09-12T18:37:10.357 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5084e-05 2024-09-12T18:37:10.357 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.357 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.357 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:10.357 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209212+0000", 2024-09-12T18:37:10.357 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9825e-05 2024-09-12T18:37:10.357 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.357 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.357 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:10.357 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209234+0000", 2024-09-12T18:37:10.357 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1416e-05 2024-09-12T18:37:10.358 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.358 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.358 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:10.358 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209497+0000", 2024-09-12T18:37:10.358 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026390400000000003 2024-09-12T18:37:10.358 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.358 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.358 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:10.358 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209810+0000", 2024-09-12T18:37:10.359 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000313023 2024-09-12T18:37:10.359 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.359 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.359 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:10.359 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.210468+0000", 2024-09-12T18:37:10.359 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00065779300000000005 2024-09-12T18:37:10.359 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.359 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.359 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:10.359 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.235905+0000", 2024-09-12T18:37:10.359 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025436881000000001 2024-09-12T18:37:10.359 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.360 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.360 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:10.360 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237797+0000", 2024-09-12T18:37:10.360 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001892007 2024-09-12T18:37:10.360 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.360 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.360 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:10.360 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237941+0000", 2024-09-12T18:37:10.360 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000143411 2024-09-12T18:37:10.360 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.360 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.360 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:10.360 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.238073+0000", 2024-09-12T18:37:10.360 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013254200000000001 2024-09-12T18:37:10.361 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:10.361 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:10.361 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:10.361 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.361 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.361 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121102 5.8 5:1f118f4b:::benchmark_data_smithi073_23739_object121101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:10.361 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.218682+0000", 2024-09-12T18:37:10.361 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 30.071426805000002, 2024-09-12T18:37:10.361 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024264885, 2024-09-12T18:37:10.361 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:10.361 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:10.361 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:10.361 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:10.361 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:10.362 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:10.362 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121102 2024-09-12T18:37:10.362 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.362 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:10.362 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.362 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:10.362 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218682+0000", 2024-09-12T18:37:10.362 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:10.362 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.362 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.362 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:10.362 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218682+0000", 2024-09-12T18:37:10.363 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:10.363 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.363 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.363 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:10.363 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218685+0000", 2024-09-12T18:37:10.363 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6059999999999999e-06 2024-09-12T18:37:10.363 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.363 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.363 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:10.363 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218743+0000", 2024-09-12T18:37:10.363 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7160999999999997e-05 2024-09-12T18:37:10.363 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.363 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.363 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:10.364 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218768+0000", 2024-09-12T18:37:10.364 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5052e-05 2024-09-12T18:37:10.364 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.364 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.364 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:10.364 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218785+0000", 2024-09-12T18:37:10.364 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7436999999999999e-05 2024-09-12T18:37:10.364 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.364 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.364 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:10.364 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218952+0000", 2024-09-12T18:37:10.364 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016691300000000001 2024-09-12T18:37:10.365 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.365 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.365 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:10.365 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.219437+0000", 2024-09-12T18:37:10.365 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048465900000000002 2024-09-12T18:37:10.365 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.365 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.365 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:10.365 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.219893+0000", 2024-09-12T18:37:10.365 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00045642799999999999 2024-09-12T18:37:10.365 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.365 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.365 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:10.366 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.226416+0000", 2024-09-12T18:37:10.366 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065225630000000003 2024-09-12T18:37:10.366 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.366 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.366 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:10.366 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242796+0000", 2024-09-12T18:37:10.366 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016379857000000001 2024-09-12T18:37:10.366 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.366 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.366 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:10.366 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242879+0000", 2024-09-12T18:37:10.366 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3913999999999997e-05 2024-09-12T18:37:10.367 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.367 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.367 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:10.367 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242947+0000", 2024-09-12T18:37:10.367 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7294999999999999e-05 2024-09-12T18:37:10.367 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:10.367 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:10.367 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:10.367 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.367 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.367 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121106 5.d 5:b4a9a221:::benchmark_data_smithi073_23739_object121105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:10.367 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:37:10.367 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 30.052929284000001, 2024-09-12T18:37:10.367 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.034882274999999997, 2024-09-12T18:37:10.368 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:10.368 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:10.368 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:10.368 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:10.368 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:10.368 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:10.368 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121106 2024-09-12T18:37:10.368 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.368 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:10.368 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.368 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:10.368 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:37:10.368 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:10.369 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.369 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.369 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:10.369 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:37:10.369 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:10.369 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.369 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.369 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:10.369 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237182+0000", 2024-09-12T18:37:10.369 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6019999999999998e-06 2024-09-12T18:37:10.369 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.369 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.370 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:10.370 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237257+0000", 2024-09-12T18:37:10.370 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5420999999999995e-05 2024-09-12T18:37:10.370 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.370 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.370 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:10.370 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237305+0000", 2024-09-12T18:37:10.370 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7207999999999999e-05 2024-09-12T18:37:10.370 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.370 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.370 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:10.371 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237325+0000", 2024-09-12T18:37:10.371 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0001e-05 2024-09-12T18:37:10.371 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.371 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.371 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:10.371 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237505+0000", 2024-09-12T18:37:10.372 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000180798 2024-09-12T18:37:10.372 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.372 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.372 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:10.372 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237764+0000", 2024-09-12T18:37:10.372 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025862299999999998 2024-09-12T18:37:10.372 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.372 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.372 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:10.373 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.238264+0000", 2024-09-12T18:37:10.373 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00050016100000000005 2024-09-12T18:37:10.373 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.373 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.373 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:10.373 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256525+0000", 2024-09-12T18:37:10.373 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018260508000000002 2024-09-12T18:37:10.373 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.374 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.374 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:10.374 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.271903+0000", 2024-09-12T18:37:10.374 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015378739000000001 2024-09-12T18:37:10.374 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.374 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.374 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:10.374 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.271999+0000", 2024-09-12T18:37:10.374 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5989000000000005e-05 2024-09-12T18:37:10.375 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.375 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.375 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:10.375 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272062+0000", 2024-09-12T18:37:10.375 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2224999999999995e-05 2024-09-12T18:37:10.375 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:10.375 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:10.375 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:10.375 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.376 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.376 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121112 5.d 5:b9a2d671:::benchmark_data_smithi073_23739_object121111:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:10.376 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.243446+0000", 2024-09-12T18:37:10.376 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 30.046662559000001, 2024-09-12T18:37:10.376 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.02889415, 2024-09-12T18:37:10.376 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:10.376 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:10.376 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:10.377 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:10.377 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:10.377 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:10.377 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121112 2024-09-12T18:37:10.377 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.377 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:10.377 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.377 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:10.377 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243446+0000", 2024-09-12T18:37:10.378 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:10.378 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.378 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.378 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:10.378 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243446+0000", 2024-09-12T18:37:10.378 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:10.378 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.378 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.378 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:10.379 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243448+0000", 2024-09-12T18:37:10.379 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0829999999999998e-06 2024-09-12T18:37:10.379 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.379 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.379 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:10.379 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243527+0000", 2024-09-12T18:37:10.379 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9173999999999998e-05 2024-09-12T18:37:10.379 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.380 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.380 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:10.380 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243549+0000", 2024-09-12T18:37:10.380 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1169e-05 2024-09-12T18:37:10.380 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.380 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.380 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:10.380 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243564+0000", 2024-09-12T18:37:10.381 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5866999999999999e-05 2024-09-12T18:37:10.381 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.381 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.381 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:10.381 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.249905+0000", 2024-09-12T18:37:10.381 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063410360000000004 2024-09-12T18:37:10.381 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.381 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.381 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:10.382 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.250166+0000", 2024-09-12T18:37:10.382 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026052999999999997 2024-09-12T18:37:10.382 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.382 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.382 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:10.382 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.250486+0000", 2024-09-12T18:37:10.382 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00032002700000000002 2024-09-12T18:37:10.382 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.383 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.383 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:10.383 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.259263+0000", 2024-09-12T18:37:10.383 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0087774770000000005 2024-09-12T18:37:10.383 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.384 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.384 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:10.384 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272186+0000", 2024-09-12T18:37:10.384 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.01292213 2024-09-12T18:37:10.384 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.384 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.384 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:10.384 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272267+0000", 2024-09-12T18:37:10.384 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1153e-05 2024-09-12T18:37:10.384 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.384 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.385 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:10.385 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272340+0000", 2024-09-12T18:37:10.385 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3504000000000006e-05 2024-09-12T18:37:10.385 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:10.385 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:10.385 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:10.385 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.385 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.385 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121114 5.d 5:b8870c11:::benchmark_data_smithi073_23739_object121113:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:10.385 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.243603+0000", 2024-09-12T18:37:10.385 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 30.046505308, 2024-09-12T18:37:10.385 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028945746000000001, 2024-09-12T18:37:10.385 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:10.386 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:10.386 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:10.386 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:10.386 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:10.386 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:10.386 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121114 2024-09-12T18:37:10.386 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.386 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:10.386 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.386 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:10.386 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243603+0000", 2024-09-12T18:37:10.386 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:10.386 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.387 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.387 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:10.387 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243603+0000", 2024-09-12T18:37:10.387 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:10.387 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.387 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.387 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:10.387 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243605+0000", 2024-09-12T18:37:10.387 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.268e-06 2024-09-12T18:37:10.387 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.388 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.388 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:10.388 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243674+0000", 2024-09-12T18:37:10.388 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9375000000000006e-05 2024-09-12T18:37:10.388 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.389 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.389 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:10.389 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243691+0000", 2024-09-12T18:37:10.389 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6517000000000001e-05 2024-09-12T18:37:10.389 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.389 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.389 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:10.389 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243702+0000", 2024-09-12T18:37:10.389 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1905999999999999e-05 2024-09-12T18:37:10.389 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.389 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.390 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:10.390 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.253789+0000", 2024-09-12T18:37:10.390 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.010086776 2024-09-12T18:37:10.390 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.390 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.390 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:10.390 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.253959+0000", 2024-09-12T18:37:10.390 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00017000000000000001 2024-09-12T18:37:10.390 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.390 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.390 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:10.390 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.254179+0000", 2024-09-12T18:37:10.390 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022003699999999999 2024-09-12T18:37:10.391 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.391 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.391 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:10.391 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.259330+0000", 2024-09-12T18:37:10.391 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0051511559999999996 2024-09-12T18:37:10.391 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.391 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.391 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:10.391 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272403+0000", 2024-09-12T18:37:10.391 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013072342000000001 2024-09-12T18:37:10.391 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.391 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.391 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:10.391 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272493+0000", 2024-09-12T18:37:10.392 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0595999999999998e-05 2024-09-12T18:37:10.392 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.392 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.392 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:10.392 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272549+0000", 2024-09-12T18:37:10.392 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5773000000000003e-05 2024-09-12T18:37:10.392 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:10.392 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:10.392 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:10.392 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.392 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.393 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121115 5.d 5:bd4a51ea:::benchmark_data_smithi073_23739_object121114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:10.393 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.245059+0000", 2024-09-12T18:37:10.393 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 30.045049634000002, 2024-09-12T18:37:10.393 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.02767406, 2024-09-12T18:37:10.393 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:10.393 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:10.393 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:10.393 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:10.393 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:10.393 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:10.393 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121115 2024-09-12T18:37:10.393 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.393 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:10.394 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.394 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:10.394 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245059+0000", 2024-09-12T18:37:10.394 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:10.394 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.394 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.394 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:10.394 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245059+0000", 2024-09-12T18:37:10.394 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:10.394 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.394 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.394 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:10.394 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245061+0000", 2024-09-12T18:37:10.394 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9759999999999998e-06 2024-09-12T18:37:10.395 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.395 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.395 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:10.395 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245111+0000", 2024-09-12T18:37:10.395 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9838e-05 2024-09-12T18:37:10.395 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.395 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.395 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:10.395 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245132+0000", 2024-09-12T18:37:10.395 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1469999999999999e-05 2024-09-12T18:37:10.395 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.396 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.396 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:10.396 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245146+0000", 2024-09-12T18:37:10.396 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3377000000000001e-05 2024-09-12T18:37:10.396 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.396 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.396 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:10.396 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256596+0000", 2024-09-12T18:37:10.396 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011450241999999999 2024-09-12T18:37:10.396 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.396 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.396 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:10.396 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256838+0000", 2024-09-12T18:37:10.396 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000242255 2024-09-12T18:37:10.397 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.397 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.397 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:10.397 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.257095+0000", 2024-09-12T18:37:10.397 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025679300000000001 2024-09-12T18:37:10.397 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.397 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.397 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:10.397 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.259928+0000", 2024-09-12T18:37:10.398 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0028326290000000001 2024-09-12T18:37:10.398 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.398 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.398 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:10.398 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272607+0000", 2024-09-12T18:37:10.398 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012679466 2024-09-12T18:37:10.398 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.398 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.398 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:10.398 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272681+0000", 2024-09-12T18:37:10.398 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3580999999999999e-05 2024-09-12T18:37:10.398 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.399 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.399 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:10.399 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272733+0000", 2024-09-12T18:37:10.399 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2432999999999998e-05 2024-09-12T18:37:10.399 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:10.399 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:10.399 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:10.399 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.399 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.399 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121148 5.4 5:2a9bde06:::benchmark_data_smithi073_23739_object121147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:10.399 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.281423+0000", 2024-09-12T18:37:10.399 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 30.008685992, 2024-09-12T18:37:10.399 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025774785000000001, 2024-09-12T18:37:10.399 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:10.400 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:10.400 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:10.400 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:10.400 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:10.400 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:10.400 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121148 2024-09-12T18:37:10.400 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.400 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:10.400 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.400 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:10.400 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281423+0000", 2024-09-12T18:37:10.400 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:10.401 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.401 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.401 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:10.401 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281423+0000", 2024-09-12T18:37:10.401 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:10.401 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.401 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.401 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:10.401 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281424+0000", 2024-09-12T18:37:10.401 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.048e-06 2024-09-12T18:37:10.401 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.401 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.401 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:10.402 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281496+0000", 2024-09-12T18:37:10.402 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2099000000000002e-05 2024-09-12T18:37:10.402 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.402 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.402 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:10.402 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281509+0000", 2024-09-12T18:37:10.402 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3379e-05 2024-09-12T18:37:10.402 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.402 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.402 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:10.402 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281515+0000", 2024-09-12T18:37:10.402 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.28e-06 2024-09-12T18:37:10.402 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.403 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.403 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:10.403 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281688+0000", 2024-09-12T18:37:10.403 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00017203100000000001 2024-09-12T18:37:10.403 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.403 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.403 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:10.403 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281834+0000", 2024-09-12T18:37:10.403 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014645899999999999 2024-09-12T18:37:10.403 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.403 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.403 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:10.404 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.282319+0000", 2024-09-12T18:37:10.404 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048535000000000001 2024-09-12T18:37:10.404 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.404 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.404 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:10.404 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307086+0000", 2024-09-12T18:37:10.404 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024766989999999999 2024-09-12T18:37:10.404 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.404 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.404 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:10.404 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307108+0000", 2024-09-12T18:37:10.404 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1795999999999999e-05 2024-09-12T18:37:10.405 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.405 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.405 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:10.405 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307157+0000", 2024-09-12T18:37:10.405 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8729000000000001e-05 2024-09-12T18:37:10.405 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.405 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.405 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:10.405 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307197+0000", 2024-09-12T18:37:10.405 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0624000000000003e-05 2024-09-12T18:37:10.405 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:10.405 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:10.405 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:10.406 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.406 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.406 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121155 5.4 5:2af257d1:::benchmark_data_smithi073_23739_object121154:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:10.406 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.283163+0000", 2024-09-12T18:37:10.406 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 30.006945317, 2024-09-12T18:37:10.406 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024186485000000001, 2024-09-12T18:37:10.406 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:10.406 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:10.406 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:10.406 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:10.406 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:10.406 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:10.406 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121155 2024-09-12T18:37:10.407 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.407 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:10.407 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.407 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:10.407 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283163+0000", 2024-09-12T18:37:10.407 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:10.407 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.407 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.407 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:10.407 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283163+0000", 2024-09-12T18:37:10.407 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:10.407 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.407 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.407 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:10.408 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283165+0000", 2024-09-12T18:37:10.408 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.748e-06 2024-09-12T18:37:10.408 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.408 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.408 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:10.408 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283218+0000", 2024-09-12T18:37:10.408 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2695000000000003e-05 2024-09-12T18:37:10.408 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.408 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.408 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:10.408 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283244+0000", 2024-09-12T18:37:10.408 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6072e-05 2024-09-12T18:37:10.408 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.408 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.409 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:10.409 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283257+0000", 2024-09-12T18:37:10.409 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3054000000000001e-05 2024-09-12T18:37:10.409 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.409 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.409 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:10.409 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.294509+0000", 2024-09-12T18:37:10.409 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011251677999999999 2024-09-12T18:37:10.409 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.409 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.409 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:10.409 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.294705+0000", 2024-09-12T18:37:10.410 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000196369 2024-09-12T18:37:10.410 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.410 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.410 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:10.410 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.294907+0000", 2024-09-12T18:37:10.410 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020184700000000001 2024-09-12T18:37:10.410 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.410 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.410 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:10.410 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307208+0000", 2024-09-12T18:37:10.410 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012301068 2024-09-12T18:37:10.410 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.410 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.410 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:10.410 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307273+0000", 2024-09-12T18:37:10.411 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5611000000000006e-05 2024-09-12T18:37:10.411 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.411 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.411 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:10.411 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307320+0000", 2024-09-12T18:37:10.411 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6220999999999997e-05 2024-09-12T18:37:10.411 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.411 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.411 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:10.411 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307350+0000", 2024-09-12T18:37:10.411 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0122000000000001e-05 2024-09-12T18:37:10.411 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:10.411 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:10.412 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:10.412 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.412 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.412 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121160 5.b 5:d4730c8e:::benchmark_data_smithi073_23739_object121159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:10.412 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.289262+0000", 2024-09-12T18:37:10.412 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 30.000846300999999, 2024-09-12T18:37:10.412 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024618870000000001, 2024-09-12T18:37:10.412 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:10.412 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:10.412 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:10.412 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:10.412 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:10.412 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:10.412 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121160 2024-09-12T18:37:10.413 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.413 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:10.413 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.413 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:10.414 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289262+0000", 2024-09-12T18:37:10.414 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:10.414 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.414 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.414 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:10.414 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289262+0000", 2024-09-12T18:37:10.414 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:10.414 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.414 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.414 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:10.414 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289264+0000", 2024-09-12T18:37:10.414 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.945e-06 2024-09-12T18:37:10.414 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.415 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.415 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:10.415 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289331+0000", 2024-09-12T18:37:10.415 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6594999999999995e-05 2024-09-12T18:37:10.415 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.415 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.415 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:10.415 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289359+0000", 2024-09-12T18:37:10.415 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7988999999999999e-05 2024-09-12T18:37:10.415 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.415 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.415 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:10.415 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289375+0000", 2024-09-12T18:37:10.416 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5639000000000001e-05 2024-09-12T18:37:10.416 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.416 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.416 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:10.416 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289515+0000", 2024-09-12T18:37:10.416 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000140254 2024-09-12T18:37:10.416 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.416 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.416 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:10.416 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289740+0000", 2024-09-12T18:37:10.416 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022513500000000001 2024-09-12T18:37:10.416 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.417 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.417 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:10.417 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.290232+0000", 2024-09-12T18:37:10.417 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00049247500000000003 2024-09-12T18:37:10.417 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.417 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.417 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:10.417 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.312221+0000", 2024-09-12T18:37:10.417 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.021988939999999998 2024-09-12T18:37:10.417 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.417 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.417 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:10.417 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.313807+0000", 2024-09-12T18:37:10.418 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015859100000000001 2024-09-12T18:37:10.418 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.418 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.418 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:10.418 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.313852+0000", 2024-09-12T18:37:10.418 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4305999999999999e-05 2024-09-12T18:37:10.418 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.418 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.418 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:10.418 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.313881+0000", 2024-09-12T18:37:10.418 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9682000000000001e-05 2024-09-12T18:37:10.418 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:10.419 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:10.419 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:10.419 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.419 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.419 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:131551 5.d 5:b8f8c77a:::benchmark_data_smithi073_23739_object131550:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:37:10.419 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:45.499878+0000", 2024-09-12T18:37:10.419 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 24.79023037, 2024-09-12T18:37:10.419 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.027478433, 2024-09-12T18:37:10.419 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:10.419 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:10.419 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:10.419 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:10.420 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:10.420 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:10.420 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 131551 2024-09-12T18:37:10.420 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.420 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:10.420 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.420 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:10.420 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499878+0000", 2024-09-12T18:37:10.420 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:10.420 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.420 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.420 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:10.420 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499878+0000", 2024-09-12T18:37:10.421 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:10.421 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.421 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.421 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:10.421 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499879+0000", 2024-09-12T18:37:10.421 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.92e-07 2024-09-12T18:37:10.421 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.421 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.421 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:10.421 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499946+0000", 2024-09-12T18:37:10.421 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6712999999999996e-05 2024-09-12T18:37:10.421 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.421 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.421 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:10.422 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499953+0000", 2024-09-12T18:37:10.422 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5519999999999999e-06 2024-09-12T18:37:10.422 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.422 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.422 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:10.422 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499959+0000", 2024-09-12T18:37:10.422 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0430000000000004e-06 2024-09-12T18:37:10.422 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.422 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.422 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:10.422 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.500004+0000", 2024-09-12T18:37:10.422 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5058000000000001e-05 2024-09-12T18:37:10.422 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.422 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.423 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:10.423 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.500121+0000", 2024-09-12T18:37:10.423 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000116747 2024-09-12T18:37:10.423 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.423 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.423 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:10.423 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.500283+0000", 2024-09-12T18:37:10.423 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016190599999999999 2024-09-12T18:37:10.423 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.423 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.423 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:10.423 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.504017+0000", 2024-09-12T18:37:10.423 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003734125 2024-09-12T18:37:10.423 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.423 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.424 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:10.424 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.527224+0000", 2024-09-12T18:37:10.424 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.023206724000000001 2024-09-12T18:37:10.424 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.424 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.424 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:10.424 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.527290+0000", 2024-09-12T18:37:10.424 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5778999999999995e-05 2024-09-12T18:37:10.424 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.424 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.424 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:10.425 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.527357+0000", 2024-09-12T18:37:10.425 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7094000000000005e-05 2024-09-12T18:37:10.425 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:10.425 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:10.425 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:10.425 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.425 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.425 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:167368 5.4 5:29a1ec58:::benchmark_data_smithi073_23739_object35091:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:10.425 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:03.168773+0000", 2024-09-12T18:37:10.425 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 7.1213354170000001, 2024-09-12T18:37:10.425 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.066578597000000003, 2024-09-12T18:37:10.425 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:10.426 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:10.426 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:10.426 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:10.426 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:10.426 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:10.426 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 167368 2024-09-12T18:37:10.426 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.426 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:10.426 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.426 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:10.426 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168773+0000", 2024-09-12T18:37:10.426 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:10.427 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.427 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.427 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:10.427 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168773+0000", 2024-09-12T18:37:10.427 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:10.427 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.427 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.427 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:10.427 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168774+0000", 2024-09-12T18:37:10.427 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.023e-06 2024-09-12T18:37:10.427 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.427 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.427 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:10.428 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168779+0000", 2024-09-12T18:37:10.428 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5800000000000002e-06 2024-09-12T18:37:10.428 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.428 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.428 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:10.428 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168789+0000", 2024-09-12T18:37:10.428 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0346999999999999e-05 2024-09-12T18:37:10.428 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.428 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.428 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:10.428 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168808+0000", 2024-09-12T18:37:10.428 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8423e-05 2024-09-12T18:37:10.428 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.429 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.429 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:10.429 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168864+0000", 2024-09-12T18:37:10.429 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-09-12T18:37:10.429 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.429 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.429 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:10.429 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168947+0000", 2024-09-12T18:37:10.429 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3274000000000003e-05 2024-09-12T18:37:10.429 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.429 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.430 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:10.430 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.169014+0000", 2024-09-12T18:37:10.430 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6284000000000004e-05 2024-09-12T18:37:10.430 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.430 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.430 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:10.430 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.170653+0000", 2024-09-12T18:37:10.430 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016389779999999999 2024-09-12T18:37:10.430 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.430 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.430 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:10.430 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.235279+0000", 2024-09-12T18:37:10.431 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064626464999999994 2024-09-12T18:37:10.431 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.431 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.431 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:10.431 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.235320+0000", 2024-09-12T18:37:10.431 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0377000000000003e-05 2024-09-12T18:37:10.431 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.431 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.431 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:10.431 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.235352+0000", 2024-09-12T18:37:10.431 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2322e-05 2024-09-12T18:37:10.432 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:10.432 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:10.432 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:10.432 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.432 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.432 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:167371 5.4 5:24fea27c:::benchmark_data_smithi073_23739_object35094:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:10.432 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:03.171234+0000", 2024-09-12T18:37:10.432 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 7.1188743920000004, 2024-09-12T18:37:10.432 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.066048171000000003, 2024-09-12T18:37:10.432 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:10.432 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:10.432 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:10.433 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:10.433 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:10.433 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:10.433 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 167371 2024-09-12T18:37:10.433 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.433 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:10.433 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.434 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:10.434 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171234+0000", 2024-09-12T18:37:10.434 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:10.434 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.434 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.434 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:10.434 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171234+0000", 2024-09-12T18:37:10.434 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:10.435 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.435 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.435 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:10.435 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171235+0000", 2024-09-12T18:37:10.435 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8599999999999997e-07 2024-09-12T18:37:10.435 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.435 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.435 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:10.435 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171238+0000", 2024-09-12T18:37:10.435 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9739999999999998e-06 2024-09-12T18:37:10.435 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.435 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.436 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:10.436 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171245+0000", 2024-09-12T18:37:10.436 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6000000000000003e-06 2024-09-12T18:37:10.436 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.436 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.436 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:10.436 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171249+0000", 2024-09-12T18:37:10.436 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9960000000000004e-06 2024-09-12T18:37:10.436 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.436 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.436 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:10.436 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171288+0000", 2024-09-12T18:37:10.436 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9119999999999998e-05 2024-09-12T18:37:10.437 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.437 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.437 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:10.437 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171359+0000", 2024-09-12T18:37:10.437 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0951000000000006e-05 2024-09-12T18:37:10.437 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.437 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.437 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:10.437 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171425+0000", 2024-09-12T18:37:10.437 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.58e-05 2024-09-12T18:37:10.437 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.437 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.438 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:10.438 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.173093+0000", 2024-09-12T18:37:10.438 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016683939999999999 2024-09-12T18:37:10.438 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.438 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.438 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:10.438 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.237202+0000", 2024-09-12T18:37:10.438 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064109437000000005 2024-09-12T18:37:10.438 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.438 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.438 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:10.438 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.237249+0000", 2024-09-12T18:37:10.439 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6751e-05 2024-09-12T18:37:10.439 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:10.439 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:10.439 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:10.439 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.237282+0000", 2024-09-12T18:37:10.439 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3262000000000001e-05 2024-09-12T18:37:10.439 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:10.439 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:10.439 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:10.439 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:10.439 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:10.439 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:10.441 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:37:10.441 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:10.433+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:10.541 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:10.534+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:10.602 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:10.602 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:37:10.602 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.602 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:182743 5.5 5:a429409c:::benchmark_data_smithi073_23739_object50466:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T18:37:10.602 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:10.592087+0000", 2024-09-12T18:37:10.602 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0073263039999999996, 2024-09-12T18:37:10.602 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0073606499999999998, 2024-09-12T18:37:10.602 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:10.602 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:10.603 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:10.603 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:10.603 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:10.603 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:10.603 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 182743 2024-09-12T18:37:10.603 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.603 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:10.603 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.603 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:10.603 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.592087+0000", 2024-09-12T18:37:10.603 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:10.603 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.603 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.604 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:10.604 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.592087+0000", 2024-09-12T18:37:10.604 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:10.604 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.604 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.604 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:10.604 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.592087+0000", 2024-09-12T18:37:10.604 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4499999999999997e-07 2024-09-12T18:37:10.604 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.604 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.604 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:10.604 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.592090+0000", 2024-09-12T18:37:10.605 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.7489999999999999e-06 2024-09-12T18:37:10.605 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.605 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.605 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:10.605 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.592097+0000", 2024-09-12T18:37:10.605 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0110000000000003e-06 2024-09-12T18:37:10.605 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.605 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.605 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:10.605 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.592102+0000", 2024-09-12T18:37:10.605 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4639999999999997e-06 2024-09-12T18:37:10.605 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.605 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.605 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:10.606 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.592145+0000", 2024-09-12T18:37:10.606 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.3059999999999998e-05 2024-09-12T18:37:10.606 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.606 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.606 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:10.606 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.592286+0000", 2024-09-12T18:37:10.606 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014107599999999999 2024-09-12T18:37:10.606 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.606 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.606 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:10.606 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.592413+0000", 2024-09-12T18:37:10.606 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000127016 2024-09-12T18:37:10.607 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.607 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.607 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:10.607 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.597703+0000", 2024-09-12T18:37:10.607 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0052891639999999998 2024-09-12T18:37:10.607 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:10.607 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:10.607 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:10.607 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.607 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.607 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:182746 5.7 5:ec55e9df:::benchmark_data_smithi073_23739_object50469:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T18:37:10.607 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:10.592214+0000", 2024-09-12T18:37:10.607 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.007198416, 2024-09-12T18:37:10.607 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072926420000000002, 2024-09-12T18:37:10.608 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:10.608 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:10.608 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:10.608 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:10.608 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:10.608 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:10.608 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 182746 2024-09-12T18:37:10.608 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.608 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:10.608 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.608 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:10.608 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.592214+0000", 2024-09-12T18:37:10.609 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:10.609 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.609 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.609 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:10.609 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.592214+0000", 2024-09-12T18:37:10.609 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:10.609 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.609 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.609 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:10.609 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.592215+0000", 2024-09-12T18:37:10.609 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.5499999999999997e-07 2024-09-12T18:37:10.609 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.610 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.610 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:10.610 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.592219+0000", 2024-09-12T18:37:10.610 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.0890000000000002e-06 2024-09-12T18:37:10.610 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.610 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.610 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:10.610 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.592228+0000", 2024-09-12T18:37:10.610 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.371e-06 2024-09-12T18:37:10.610 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.610 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.610 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:10.610 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.592235+0000", 2024-09-12T18:37:10.611 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.6939999999999995e-06 2024-09-12T18:37:10.611 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.611 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.611 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:10.611 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.593694+0000", 2024-09-12T18:37:10.611 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001458797 2024-09-12T18:37:10.611 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.611 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.611 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:10.611 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.593827+0000", 2024-09-12T18:37:10.611 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013324499999999999 2024-09-12T18:37:10.611 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.612 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.612 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:10.612 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.593944+0000", 2024-09-12T18:37:10.612 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000116983 2024-09-12T18:37:10.612 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.612 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.612 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:10.612 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.598280+0000", 2024-09-12T18:37:10.612 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.004335106 2024-09-12T18:37:10.612 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:10.612 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:10.613 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:10.613 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.613 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.613 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:182745 5.c e61/21 5:3db3b056:::benchmark_data_smithi073_23739_object50468:head v 61'11322, mlcod=61'11318)", 2024-09-12T18:37:10.613 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:10.592634+0000", 2024-09-12T18:37:10.613 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0067790319999999999, 2024-09-12T18:37:10.613 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0069247290000000001, 2024-09-12T18:37:10.613 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:10.613 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:10.613 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:37:10.613 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:10.613 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.613 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:10.613 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.592634+0000", 2024-09-12T18:37:10.614 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:10.614 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.614 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.614 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:10.614 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.592634+0000", 2024-09-12T18:37:10.614 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:10.614 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.614 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.614 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:10.614 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.592635+0000", 2024-09-12T18:37:10.614 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.7300000000000005e-07 2024-09-12T18:37:10.614 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.614 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.615 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:10.615 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.592639+0000", 2024-09-12T18:37:10.615 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6099999999999999e-06 2024-09-12T18:37:10.615 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.615 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.615 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:10.615 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.592649+0000", 2024-09-12T18:37:10.615 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.3209999999999994e-06 2024-09-12T18:37:10.615 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.615 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.615 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:10.615 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.592655+0000", 2024-09-12T18:37:10.615 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.3090000000000001e-06 2024-09-12T18:37:10.615 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.616 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.616 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:10.616 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.592779+0000", 2024-09-12T18:37:10.616 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000124184 2024-09-12T18:37:10.616 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.616 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.616 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:10.616 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.592798+0000", 2024-09-12T18:37:10.616 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.8952000000000001e-05 2024-09-12T18:37:10.616 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:10.616 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:10.616 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:10.616 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.616 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.617 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:182747 5.f 5:f21d38ca:::benchmark_data_smithi073_23739_object50470:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T18:37:10.617 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:10.593055+0000", 2024-09-12T18:37:10.617 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0063578769999999996, 2024-09-12T18:37:10.617 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0065518520000000004, 2024-09-12T18:37:10.617 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:10.617 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:10.617 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:10.617 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:10.617 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:10.617 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:10.618 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 182747 2024-09-12T18:37:10.618 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.618 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:10.618 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.618 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:10.618 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.593055+0000", 2024-09-12T18:37:10.618 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:10.618 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.619 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.619 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:10.619 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.593055+0000", 2024-09-12T18:37:10.619 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:10.619 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.619 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.619 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:10.619 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.593056+0000", 2024-09-12T18:37:10.619 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.4399999999999999e-07 2024-09-12T18:37:10.619 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.619 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.620 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:10.620 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.593059+0000", 2024-09-12T18:37:10.620 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.1200000000000002e-06 2024-09-12T18:37:10.620 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.620 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.620 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:10.620 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.593068+0000", 2024-09-12T18:37:10.620 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.9379999999999998e-06 2024-09-12T18:37:10.620 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.620 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.620 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:10.620 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.593073+0000", 2024-09-12T18:37:10.620 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3340000000000001e-06 2024-09-12T18:37:10.620 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.621 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.621 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:10.621 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.593682+0000", 2024-09-12T18:37:10.621 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00060893099999999995 2024-09-12T18:37:10.621 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.621 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.621 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:10.621 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.593830+0000", 2024-09-12T18:37:10.621 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014768100000000001 2024-09-12T18:37:10.621 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.621 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.621 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:10.622 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.594211+0000", 2024-09-12T18:37:10.622 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00038167700000000003 2024-09-12T18:37:10.622 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.622 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.622 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:10.622 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.598339+0000", 2024-09-12T18:37:10.622 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0041272679999999999 2024-09-12T18:37:10.622 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:10.622 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:10.622 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:10.622 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.622 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.622 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:182750 5.9 5:9e0cc99b:::benchmark_data_smithi073_23739_object50473:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T18:37:10.623 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:10.593636+0000", 2024-09-12T18:37:10.623 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0057766129999999999, 2024-09-12T18:37:10.623 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0060260499999999998, 2024-09-12T18:37:10.623 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:10.623 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:10.623 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:10.623 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:10.623 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:10.623 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:10.623 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 182750 2024-09-12T18:37:10.623 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.623 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:10.623 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.624 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:10.624 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.593636+0000", 2024-09-12T18:37:10.624 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:10.624 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.624 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.624 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:10.624 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.593636+0000", 2024-09-12T18:37:10.624 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:10.624 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.624 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.624 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:10.624 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.593637+0000", 2024-09-12T18:37:10.624 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2500000000000005e-07 2024-09-12T18:37:10.625 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.625 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.625 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:10.625 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.593640+0000", 2024-09-12T18:37:10.625 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.0130000000000002e-06 2024-09-12T18:37:10.625 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.625 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.625 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:10.625 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.593648+0000", 2024-09-12T18:37:10.626 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.61e-06 2024-09-12T18:37:10.626 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.626 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.626 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:10.626 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.593653+0000", 2024-09-12T18:37:10.626 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.276e-06 2024-09-12T18:37:10.626 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.626 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.626 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:10.626 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.593698+0000", 2024-09-12T18:37:10.627 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.5272999999999998e-05 2024-09-12T18:37:10.627 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.627 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.627 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:10.627 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.593827+0000", 2024-09-12T18:37:10.627 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012886500000000001 2024-09-12T18:37:10.628 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.628 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.628 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:10.628 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.593944+0000", 2024-09-12T18:37:10.628 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000117371 2024-09-12T18:37:10.628 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:10.628 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:10.629 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:10.629 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.629 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.629 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:182751 5.1 5:8989cc05:::benchmark_data_smithi073_23739_object50474:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T18:37:10.629 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:10.594341+0000", 2024-09-12T18:37:10.629 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.005071529, 2024-09-12T18:37:10.629 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0053720319999999997, 2024-09-12T18:37:10.629 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:10.629 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:10.629 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:10.629 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:10.629 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:10.629 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:10.629 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 182751 2024-09-12T18:37:10.630 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.630 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:10.630 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.630 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:10.630 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.594341+0000", 2024-09-12T18:37:10.630 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:10.630 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.630 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.630 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:10.630 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.594341+0000", 2024-09-12T18:37:10.630 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:10.630 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.630 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.631 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:10.631 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.594342+0000", 2024-09-12T18:37:10.631 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.4900000000000004e-07 2024-09-12T18:37:10.631 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.631 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.631 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:10.631 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.594347+0000", 2024-09-12T18:37:10.631 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6149999999999999e-06 2024-09-12T18:37:10.631 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.631 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.631 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:10.631 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.594357+0000", 2024-09-12T18:37:10.631 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0169e-05 2024-09-12T18:37:10.632 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.632 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.632 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:10.632 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.594364+0000", 2024-09-12T18:37:10.632 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.8249999999999999e-06 2024-09-12T18:37:10.632 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.632 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.632 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:10.632 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.594565+0000", 2024-09-12T18:37:10.632 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000201442 2024-09-12T18:37:10.632 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.632 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.632 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:10.633 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.594649+0000", 2024-09-12T18:37:10.633 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.3659999999999995e-05 2024-09-12T18:37:10.633 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.633 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.633 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:10.633 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.594735+0000", 2024-09-12T18:37:10.633 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.6168999999999994e-05 2024-09-12T18:37:10.633 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:10.633 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:10.633 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:10.633 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.633 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.634 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:182752 5.5 5:aad0f80a:::benchmark_data_smithi073_23739_object50475:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T18:37:10.634 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:10.594721+0000", 2024-09-12T18:37:10.634 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0046916909999999996, 2024-09-12T18:37:10.634 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.005040152, 2024-09-12T18:37:10.634 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:10.634 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:10.634 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:10.634 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:10.634 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:10.634 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:10.634 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 182752 2024-09-12T18:37:10.635 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.635 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:10.635 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.635 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:10.635 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.594721+0000", 2024-09-12T18:37:10.635 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:10.635 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.635 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.635 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:10.635 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.594721+0000", 2024-09-12T18:37:10.635 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:10.636 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.636 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.636 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:10.636 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.594722+0000", 2024-09-12T18:37:10.636 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8100000000000001e-07 2024-09-12T18:37:10.636 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.636 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.636 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:10.636 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.594726+0000", 2024-09-12T18:37:10.636 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.1659999999999996e-06 2024-09-12T18:37:10.636 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.636 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.636 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:10.637 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.594736+0000", 2024-09-12T18:37:10.637 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.5859999999999994e-06 2024-09-12T18:37:10.637 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.637 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.637 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:10.637 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.594743+0000", 2024-09-12T18:37:10.637 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9020000000000002e-06 2024-09-12T18:37:10.637 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.637 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.637 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:10.637 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.594834+0000", 2024-09-12T18:37:10.637 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0792999999999996e-05 2024-09-12T18:37:10.637 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.638 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.638 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:10.638 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.594957+0000", 2024-09-12T18:37:10.638 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012361199999999999 2024-09-12T18:37:10.638 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.638 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.638 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:10.638 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.595073+0000", 2024-09-12T18:37:10.638 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000116035 2024-09-12T18:37:10.638 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:10.638 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:10.638 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:10.638 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.639 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.639 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:182753 5.1 5:87d6d2be:::benchmark_data_smithi073_23739_object50476:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T18:37:10.639 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:10.595392+0000", 2024-09-12T18:37:10.639 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0040212319999999996, 2024-09-12T18:37:10.639 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0044148410000000001, 2024-09-12T18:37:10.639 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:10.639 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:10.639 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:10.639 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:10.639 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:10.639 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:10.639 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 182753 2024-09-12T18:37:10.639 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.640 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:10.640 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.640 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:10.640 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.595392+0000", 2024-09-12T18:37:10.640 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:10.640 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.640 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.640 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:10.640 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.595392+0000", 2024-09-12T18:37:10.640 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:10.640 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.640 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.640 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:10.640 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.595393+0000", 2024-09-12T18:37:10.641 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.9400000000000004e-07 2024-09-12T18:37:10.641 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.641 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.641 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:10.641 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.595397+0000", 2024-09-12T18:37:10.641 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.3290000000000004e-06 2024-09-12T18:37:10.641 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.641 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.641 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:10.641 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.595407+0000", 2024-09-12T18:37:10.641 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0195e-05 2024-09-12T18:37:10.641 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.641 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.642 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:10.642 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.595414+0000", 2024-09-12T18:37:10.642 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.7299999999999999e-06 2024-09-12T18:37:10.642 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.642 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.642 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:10.642 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.596493+0000", 2024-09-12T18:37:10.642 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0010792099999999999 2024-09-12T18:37:10.642 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.642 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.642 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:10.642 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.596574+0000", 2024-09-12T18:37:10.642 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1462e-05 2024-09-12T18:37:10.642 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.643 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.643 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:10.643 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.596653+0000", 2024-09-12T18:37:10.643 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8114999999999993e-05 2024-09-12T18:37:10.643 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:10.643 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:10.643 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:10.643 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.643 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.643 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:182755 5.c e61/21 5:3bd5aac8:::benchmark_data_smithi073_23739_object50478:head v 61'11323, mlcod=61'11320)", 2024-09-12T18:37:10.643 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:10.597124+0000", 2024-09-12T18:37:10.643 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0022889630000000002, 2024-09-12T18:37:10.643 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0027269490000000002, 2024-09-12T18:37:10.644 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:10.644 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:10.644 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:37:10.644 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:10.644 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.644 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:10.644 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.597124+0000", 2024-09-12T18:37:10.644 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:10.644 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.644 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.644 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:10.644 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.597124+0000", 2024-09-12T18:37:10.644 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:10.645 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.645 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.645 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:10.645 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.597125+0000", 2024-09-12T18:37:10.645 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.7400000000000002e-07 2024-09-12T18:37:10.645 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.645 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.645 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:10.645 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.597134+0000", 2024-09-12T18:37:10.645 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8519999999999993e-06 2024-09-12T18:37:10.645 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.645 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.645 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:10.646 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.597145+0000", 2024-09-12T18:37:10.646 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1768e-05 2024-09-12T18:37:10.646 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.646 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.646 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:10.646 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.597152+0000", 2024-09-12T18:37:10.646 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9179999999999997e-06 2024-09-12T18:37:10.646 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.646 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.646 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:10.646 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.597195+0000", 2024-09-12T18:37:10.646 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.2404999999999998e-05 2024-09-12T18:37:10.646 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.646 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.647 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:10.647 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.597209+0000", 2024-09-12T18:37:10.647 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4819e-05 2024-09-12T18:37:10.647 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:10.647 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:10.647 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:10.647 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.647 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.647 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:182757 5.6 e61/21 5:6839db05:::benchmark_data_smithi073_23739_object50480:head v 61'11455, mlcod=61'11453)", 2024-09-12T18:37:10.647 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:10.597463+0000", 2024-09-12T18:37:10.647 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0019495059999999999, 2024-09-12T18:37:10.647 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0024336660000000001, 2024-09-12T18:37:10.648 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:10.648 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:10.648 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:37:10.648 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:10.648 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.648 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:10.648 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.597463+0000", 2024-09-12T18:37:10.648 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:10.648 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.648 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.648 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:10.648 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.597463+0000", 2024-09-12T18:37:10.648 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:10.649 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.649 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.649 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:10.649 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.597464+0000", 2024-09-12T18:37:10.649 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1099999999999996e-07 2024-09-12T18:37:10.649 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.649 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.649 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:10.649 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.597471+0000", 2024-09-12T18:37:10.649 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.7649999999999996e-06 2024-09-12T18:37:10.649 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.649 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.649 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:10.650 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.597481+0000", 2024-09-12T18:37:10.650 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0083e-05 2024-09-12T18:37:10.650 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.650 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.650 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:10.650 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.597486+0000", 2024-09-12T18:37:10.650 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3669999999999996e-06 2024-09-12T18:37:10.650 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.650 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.650 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:10.650 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.597536+0000", 2024-09-12T18:37:10.650 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.9484999999999998e-05 2024-09-12T18:37:10.650 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.651 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.651 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:10.651 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.597555+0000", 2024-09-12T18:37:10.651 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9840999999999999e-05 2024-09-12T18:37:10.651 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:10.651 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:10.651 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:10.651 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.651 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.651 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop_reply(client.4480.0:182743 5.5 e61/49)", 2024-09-12T18:37:10.651 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:10.598313+0000", 2024-09-12T18:37:10.651 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0010994100000000001, 2024-09-12T18:37:10.651 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0016231150000000001, 2024-09-12T18:37:10.651 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:10.652 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:10.652 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:10.652 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:10.652 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.652 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:10.652 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.598313+0000", 2024-09-12T18:37:10.652 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:10.652 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.652 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.652 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:10.652 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.598313+0000", 2024-09-12T18:37:10.652 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:10.653 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.653 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.653 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:10.653 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.598314+0000", 2024-09-12T18:37:10.653 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.9999999999999998e-07 2024-09-12T18:37:10.653 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.653 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.653 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:10.653 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.598316+0000", 2024-09-12T18:37:10.653 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.424e-06 2024-09-12T18:37:10.653 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.653 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.654 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:10.654 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.598323+0000", 2024-09-12T18:37:10.654 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9789999999999996e-06 2024-09-12T18:37:10.654 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.654 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.654 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:10.654 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.598329+0000", 2024-09-12T18:37:10.654 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2769999999999996e-06 2024-09-12T18:37:10.654 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:10.654 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:10.654 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:10.654 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.655 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.655 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:182758 5.5 5.f7fa39a5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T18:37:10.655 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:10.598437+0000", 2024-09-12T18:37:10.655 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.00097605000000000001, 2024-09-12T18:37:10.655 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001532271, 2024-09-12T18:37:10.655 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:10.655 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:10.655 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:10.655 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:10.655 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:10.655 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:10.655 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 182758 2024-09-12T18:37:10.655 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.656 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:10.656 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.656 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:10.656 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.598437+0000", 2024-09-12T18:37:10.656 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:10.656 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.656 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.656 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:10.656 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.598437+0000", 2024-09-12T18:37:10.656 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:10.656 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.656 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.656 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:10.657 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.598438+0000", 2024-09-12T18:37:10.657 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.114e-06 2024-09-12T18:37:10.657 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.657 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.657 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:10.657 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.598442+0000", 2024-09-12T18:37:10.658 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.7239999999999998e-06 2024-09-12T18:37:10.658 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.658 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.658 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:10.658 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.598449+0000", 2024-09-12T18:37:10.658 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.1919999999999999e-06 2024-09-12T18:37:10.658 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.658 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.658 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:10.659 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.598453+0000", 2024-09-12T18:37:10.659 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6190000000000002e-06 2024-09-12T18:37:10.659 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:10.659 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:10.659 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:10.659 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.659 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.659 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop_reply(client.4480.0:182751 5.1 e61/49)", 2024-09-12T18:37:10.659 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:10.599939+0000", 2024-09-12T18:37:10.659 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 4294967295.999474, 2024-09-12T18:37:10.659 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.6051999999999997e-05, 2024-09-12T18:37:10.659 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:10.659 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:10.659 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:37:10.660 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:10.660 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.660 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:10.660 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.599939+0000", 2024-09-12T18:37:10.660 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:10.660 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.660 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.660 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:10.660 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.599939+0000", 2024-09-12T18:37:10.660 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:10.660 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.661 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.661 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:10.661 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.599939+0000", 2024-09-12T18:37:10.661 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.0999999999999998e-07 2024-09-12T18:37:10.661 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.661 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.661 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:10.661 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.599942+0000", 2024-09-12T18:37:10.661 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.8329999999999998e-06 2024-09-12T18:37:10.661 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.661 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.662 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:10.662 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.599950+0000", 2024-09-12T18:37:10.662 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.3329999999999997e-06 2024-09-12T18:37:10.662 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.662 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.662 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:10.662 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.599954+0000", 2024-09-12T18:37:10.662 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.9659999999999998e-06 2024-09-12T18:37:10.662 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.662 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.662 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:10.663 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.599995+0000", 2024-09-12T18:37:10.663 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.0176000000000003e-05 2024-09-12T18:37:10.663 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.663 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.663 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:10.663 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.600000+0000", 2024-09-12T18:37:10.663 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.8810000000000001e-06 2024-09-12T18:37:10.663 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:10.663 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:10.663 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:10.664 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.664 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.664 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop_reply(client.4480.0:182752 5.5 e61/49)", 2024-09-12T18:37:10.664 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:10.599966+0000", 2024-09-12T18:37:10.664 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 4294967295.9994464, 2024-09-12T18:37:10.664 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.6682999999999997e-05, 2024-09-12T18:37:10.664 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:10.664 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:10.665 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:10.665 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:10.665 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.665 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:10.665 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.599966+0000", 2024-09-12T18:37:10.665 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:10.665 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.665 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.665 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:10.665 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.599966+0000", 2024-09-12T18:37:10.665 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:10.665 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.666 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.666 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:10.666 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.599967+0000", 2024-09-12T18:37:10.666 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.6600000000000003e-07 2024-09-12T18:37:10.666 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.666 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.666 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:10.666 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.599969+0000", 2024-09-12T18:37:10.666 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.0379999999999998e-06 2024-09-12T18:37:10.666 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.666 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.666 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:10.666 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.599974+0000", 2024-09-12T18:37:10.666 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.755e-06 2024-09-12T18:37:10.667 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:10.667 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:10.667 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:10.667 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.599979+0000", 2024-09-12T18:37:10.667 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6580000000000001e-06 2024-09-12T18:37:10.667 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:10.667 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:10.667 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:10.667 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:10.667 INFO:teuthology.orchestra.run.smithi162.stdout: ], 2024-09-12T18:37:10.667 INFO:teuthology.orchestra.run.smithi162.stdout: "num_ops": 14 2024-09-12T18:37:10.667 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:10.669 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:37:10.670 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:10.662+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:10.770 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:10.762+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:10.863 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:10.863 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [], 2024-09-12T18:37:10.863 INFO:teuthology.orchestra.run.smithi162.stdout: "complaint_time": 30, 2024-09-12T18:37:10.863 INFO:teuthology.orchestra.run.smithi162.stdout: "num_blocked_ops": 0 2024-09-12T18:37:10.863 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:10.870 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:10.862+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:10.883 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:37:10.971 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:10.965+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:11.036 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:11.036 INFO:teuthology.orchestra.run.smithi162.stdout: "size": 20, 2024-09-12T18:37:11.036 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 600, 2024-09-12T18:37:11.036 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:37:11.036 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.036 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4154.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:37:11.036 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:37:11.036 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 117.051780734, 2024-09-12T18:37:11.036 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025950709999999998, 2024-09-12T18:37:11.037 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:11.037 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:11.037 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:11.037 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:11.037 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4154", 2024-09-12T18:37:11.037 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/745129001", 2024-09-12T18:37:11.037 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 124 2024-09-12T18:37:11.037 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.037 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:11.037 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.037 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:11.037 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:37:11.037 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:11.038 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.038 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.038 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:11.038 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:37:11.038 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:11.038 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.038 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.038 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:11.038 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976562+0000", 2024-09-12T18:37:11.038 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.2999999999999999e-07 2024-09-12T18:37:11.038 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.038 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.038 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:11.039 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976567+0000", 2024-09-12T18:37:11.039 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3430000000000003e-06 2024-09-12T18:37:11.039 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.039 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.039 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:11.039 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976576+0000", 2024-09-12T18:37:11.039 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8070000000000006e-06 2024-09-12T18:37:11.039 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.039 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.039 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.040 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976583+0000", 2024-09-12T18:37:11.040 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9959999999999996e-06 2024-09-12T18:37:11.040 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.040 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.040 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:11.040 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997107+0000", 2024-09-12T18:37:11.040 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.020524106 2024-09-12T18:37:11.040 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.041 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.041 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:11.041 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997225+0000", 2024-09-12T18:37:11.041 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000117909 2024-09-12T18:37:11.041 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.041 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.041 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:11.041 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997407+0000", 2024-09-12T18:37:11.041 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00018175900000000001 2024-09-12T18:37:11.041 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.041 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.041 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:11.041 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998839+0000", 2024-09-12T18:37:11.041 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001432539 2024-09-12T18:37:11.042 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.042 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.042 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:11.042 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002319+0000", 2024-09-12T18:37:11.042 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0034803529999999998 2024-09-12T18:37:11.042 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.042 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.042 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:11.042 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002405+0000", 2024-09-12T18:37:11.042 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5434999999999998e-05 2024-09-12T18:37:11.042 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.043 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.043 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:11.043 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002512+0000", 2024-09-12T18:37:11.043 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010663299999999999 2024-09-12T18:37:11.043 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:11.043 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:11.043 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:11.043 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.043 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.043 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:11.043 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:37:11.044 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 105.386983227, 2024-09-12T18:37:11.044 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025127867000000002, 2024-09-12T18:37:11.044 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:11.044 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:11.044 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:11.044 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:11.044 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.044 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:11.044 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:37:11.044 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:11.044 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.044 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.044 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:11.045 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:37:11.045 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:11.045 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.045 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.045 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:11.045 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641362+0000", 2024-09-12T18:37:11.045 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.2569999999999999e-06 2024-09-12T18:37:11.045 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.045 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.045 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:11.045 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641374+0000", 2024-09-12T18:37:11.045 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2696e-05 2024-09-12T18:37:11.045 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.046 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.046 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:11.046 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641403+0000", 2024-09-12T18:37:11.046 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.8756999999999999e-05 2024-09-12T18:37:11.046 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.046 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.046 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.046 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641430+0000", 2024-09-12T18:37:11.046 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.6452999999999999e-05 2024-09-12T18:37:11.046 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.046 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.046 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:11.046 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641585+0000", 2024-09-12T18:37:11.046 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000155799 2024-09-12T18:37:11.047 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.047 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.047 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:11.047 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641753+0000", 2024-09-12T18:37:11.047 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000167868 2024-09-12T18:37:11.047 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.047 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.047 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:11.047 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641916+0000", 2024-09-12T18:37:11.047 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000162903 2024-09-12T18:37:11.047 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.047 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.047 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:11.048 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653655+0000", 2024-09-12T18:37:11.048 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011738879000000001 2024-09-12T18:37:11.048 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.048 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.048 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:11.048 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665515+0000", 2024-09-12T18:37:11.048 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011859915 2024-09-12T18:37:11.048 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.049 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.049 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:11.049 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665646+0000", 2024-09-12T18:37:11.049 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013122599999999999 2024-09-12T18:37:11.049 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.049 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.049 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:11.049 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666486+0000", 2024-09-12T18:37:11.049 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00084011399999999999 2024-09-12T18:37:11.049 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:11.049 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:11.049 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:11.049 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.050 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.050 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:11.050 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:37:11.050 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 105.386868764, 2024-09-12T18:37:11.050 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025384584000000002, 2024-09-12T18:37:11.050 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:11.050 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:11.050 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:11.050 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:11.050 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.050 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:11.050 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:37:11.050 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:11.051 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.051 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.051 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:11.051 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:37:11.051 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:11.051 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.051 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.051 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:11.051 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641474+0000", 2024-09-12T18:37:11.051 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.39e-06 2024-09-12T18:37:11.051 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.051 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.051 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:11.051 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641482+0000", 2024-09-12T18:37:11.052 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3499999999999999e-06 2024-09-12T18:37:11.052 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.052 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.052 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:11.052 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641534+0000", 2024-09-12T18:37:11.052 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2533e-05 2024-09-12T18:37:11.052 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.052 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.052 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.052 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641551+0000", 2024-09-12T18:37:11.052 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6515999999999999e-05 2024-09-12T18:37:11.052 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.053 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.053 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:11.053 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642630+0000", 2024-09-12T18:37:11.053 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001079705 2024-09-12T18:37:11.053 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.053 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.053 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:11.053 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642909+0000", 2024-09-12T18:37:11.053 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027859800000000002 2024-09-12T18:37:11.053 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.053 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.053 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:11.053 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643137+0000", 2024-09-12T18:37:11.054 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022803799999999999 2024-09-12T18:37:11.054 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.054 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.054 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:11.054 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653669+0000", 2024-09-12T18:37:11.054 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010532032 2024-09-12T18:37:11.054 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.054 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.054 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:11.054 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666624+0000", 2024-09-12T18:37:11.054 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012954940999999999 2024-09-12T18:37:11.054 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.055 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.055 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:11.055 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666762+0000", 2024-09-12T18:37:11.055 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000137668 2024-09-12T18:37:11.055 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.055 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.055 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:11.055 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666857+0000", 2024-09-12T18:37:11.055 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.5812999999999999e-05 2024-09-12T18:37:11.055 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:11.055 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:11.055 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:11.055 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.055 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.056 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:11.056 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:37:11.056 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 105.386740969, 2024-09-12T18:37:11.056 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025661562999999998, 2024-09-12T18:37:11.056 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:11.056 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:11.056 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:11.056 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:11.056 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.056 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:11.056 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:37:11.056 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:11.056 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.057 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.057 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:11.057 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:37:11.057 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:11.057 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.057 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.057 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:11.057 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641602+0000", 2024-09-12T18:37:11.057 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3540000000000001e-06 2024-09-12T18:37:11.057 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.057 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.057 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:11.057 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641637+0000", 2024-09-12T18:37:11.058 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5145999999999999e-05 2024-09-12T18:37:11.058 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.058 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.058 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:11.058 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641659+0000", 2024-09-12T18:37:11.058 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2249999999999999e-05 2024-09-12T18:37:11.058 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.058 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.058 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.058 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641675+0000", 2024-09-12T18:37:11.058 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6059999999999999e-05 2024-09-12T18:37:11.058 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.058 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.058 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:11.059 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644570+0000", 2024-09-12T18:37:11.059 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028947069999999998 2024-09-12T18:37:11.059 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.059 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.059 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:11.059 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644900+0000", 2024-09-12T18:37:11.059 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000329401 2024-09-12T18:37:11.059 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.059 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.059 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:11.059 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645235+0000", 2024-09-12T18:37:11.059 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000335874 2024-09-12T18:37:11.059 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.059 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.060 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:11.060 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655459+0000", 2024-09-12T18:37:11.060 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010223441999999999 2024-09-12T18:37:11.060 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.060 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.060 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:11.060 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667028+0000", 2024-09-12T18:37:11.060 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011568673999999999 2024-09-12T18:37:11.060 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.060 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.060 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:11.060 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667163+0000", 2024-09-12T18:37:11.060 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013525500000000001 2024-09-12T18:37:11.061 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.061 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.061 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:11.061 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667262+0000", 2024-09-12T18:37:11.061 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9400000000000004e-05 2024-09-12T18:37:11.061 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:11.061 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:11.061 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:11.061 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.061 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.061 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:11.061 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:37:11.061 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 105.386639149, 2024-09-12T18:37:11.061 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025971339, 2024-09-12T18:37:11.062 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:11.062 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:11.062 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:11.062 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:11.062 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.062 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:11.062 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:37:11.062 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:11.062 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.062 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.062 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:11.062 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:37:11.062 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:11.063 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.063 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.063 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:11.063 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641704+0000", 2024-09-12T18:37:11.063 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.297e-06 2024-09-12T18:37:11.063 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.063 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.063 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:11.063 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641712+0000", 2024-09-12T18:37:11.063 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.9060000000000002e-06 2024-09-12T18:37:11.063 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.063 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.063 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:11.064 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641731+0000", 2024-09-12T18:37:11.064 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9083e-05 2024-09-12T18:37:11.064 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.064 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.064 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.064 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641745+0000", 2024-09-12T18:37:11.064 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4066999999999999e-05 2024-09-12T18:37:11.064 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.064 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.064 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:11.064 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646529+0000", 2024-09-12T18:37:11.064 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.004784033 2024-09-12T18:37:11.064 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.065 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.065 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:11.065 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646727+0000", 2024-09-12T18:37:11.065 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019841800000000001 2024-09-12T18:37:11.065 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.065 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.065 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:11.065 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647057+0000", 2024-09-12T18:37:11.065 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032926800000000002 2024-09-12T18:37:11.065 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.065 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.065 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:11.065 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655475+0000", 2024-09-12T18:37:11.066 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0084186250000000008 2024-09-12T18:37:11.066 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.066 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.066 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:11.066 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667424+0000", 2024-09-12T18:37:11.066 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011949257 2024-09-12T18:37:11.066 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.066 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.066 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:11.067 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667573+0000", 2024-09-12T18:37:11.067 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014851900000000001 2024-09-12T18:37:11.067 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.067 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.067 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:11.067 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667674+0000", 2024-09-12T18:37:11.067 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010086600000000001 2024-09-12T18:37:11.067 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:11.067 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:11.068 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:11.068 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.068 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.068 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:11.068 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:37:11.068 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 105.38657676, 2024-09-12T18:37:11.068 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026215008000000001, 2024-09-12T18:37:11.068 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:11.068 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:11.068 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:11.068 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:11.068 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.068 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:11.069 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:37:11.069 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:11.069 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.069 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.069 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:11.069 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:37:11.069 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:11.069 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.069 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.069 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:11.069 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641766+0000", 2024-09-12T18:37:11.069 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1200000000000001e-06 2024-09-12T18:37:11.069 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.070 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.070 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:11.070 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641775+0000", 2024-09-12T18:37:11.070 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.2499999999999995e-06 2024-09-12T18:37:11.070 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.070 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.070 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:11.070 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641793+0000", 2024-09-12T18:37:11.070 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7773000000000001e-05 2024-09-12T18:37:11.070 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.070 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.070 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.070 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641807+0000", 2024-09-12T18:37:11.070 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3814e-05 2024-09-12T18:37:11.071 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.071 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.071 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:11.071 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647626+0000", 2024-09-12T18:37:11.071 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0058193050000000003 2024-09-12T18:37:11.071 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.071 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.071 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:11.071 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647937+0000", 2024-09-12T18:37:11.071 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031112400000000003 2024-09-12T18:37:11.071 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.071 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.072 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:11.072 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648239+0000", 2024-09-12T18:37:11.072 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00030227500000000002 2024-09-12T18:37:11.072 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.072 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.072 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:11.072 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655487+0000", 2024-09-12T18:37:11.072 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072479129999999999 2024-09-12T18:37:11.072 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.072 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.072 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:11.072 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667823+0000", 2024-09-12T18:37:11.072 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012335505 2024-09-12T18:37:11.073 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.073 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.073 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:11.073 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667908+0000", 2024-09-12T18:37:11.073 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4843000000000001e-05 2024-09-12T18:37:11.073 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.073 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.073 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:11.073 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667980+0000", 2024-09-12T18:37:11.073 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2086000000000001e-05 2024-09-12T18:37:11.073 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:11.073 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:11.073 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:11.073 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.074 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.074 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:11.074 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:37:11.074 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 105.386516607, 2024-09-12T18:37:11.074 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026483236, 2024-09-12T18:37:11.074 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:11.074 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:11.074 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:11.074 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:11.074 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.074 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:11.074 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:37:11.075 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:11.075 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.075 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.075 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:11.075 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:37:11.075 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:11.075 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.075 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.075 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:11.075 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641826+0000", 2024-09-12T18:37:11.075 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:37:11.075 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.075 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.075 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:11.076 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641832+0000", 2024-09-12T18:37:11.076 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4199999999999998e-06 2024-09-12T18:37:11.076 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.076 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.076 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:11.076 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641848+0000", 2024-09-12T18:37:11.076 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6492999999999999e-05 2024-09-12T18:37:11.076 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.076 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.076 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.076 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641863+0000", 2024-09-12T18:37:11.076 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5427e-05 2024-09-12T18:37:11.077 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.077 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.077 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:11.077 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648887+0000", 2024-09-12T18:37:11.077 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0070230860000000004 2024-09-12T18:37:11.077 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.077 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.077 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:11.077 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649111+0000", 2024-09-12T18:37:11.077 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022425799999999999 2024-09-12T18:37:11.077 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.077 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.077 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:11.077 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649494+0000", 2024-09-12T18:37:11.078 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00038349400000000001 2024-09-12T18:37:11.078 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.078 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.078 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:11.078 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655499+0000", 2024-09-12T18:37:11.078 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0060047260000000002 2024-09-12T18:37:11.078 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.078 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.078 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:11.078 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668110+0000", 2024-09-12T18:37:11.078 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012610543 2024-09-12T18:37:11.078 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.078 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.078 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:11.079 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668252+0000", 2024-09-12T18:37:11.079 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014265600000000001 2024-09-12T18:37:11.079 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.079 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.079 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:11.079 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668308+0000", 2024-09-12T18:37:11.079 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5992999999999997e-05 2024-09-12T18:37:11.079 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:11.079 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:11.079 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:11.079 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.079 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.079 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:11.079 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:37:11.080 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 105.386461391, 2024-09-12T18:37:11.080 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026605302000000001, 2024-09-12T18:37:11.080 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:11.080 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:11.080 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:11.080 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:11.080 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.080 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:11.080 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:37:11.080 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:11.080 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.080 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.080 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:11.080 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:37:11.081 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:11.081 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.081 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.081 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:11.081 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641881+0000", 2024-09-12T18:37:11.081 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.057e-06 2024-09-12T18:37:11.081 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.081 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.081 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:11.081 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641887+0000", 2024-09-12T18:37:11.081 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.6629999999999998e-06 2024-09-12T18:37:11.081 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.081 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.082 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:11.082 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641903+0000", 2024-09-12T18:37:11.082 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6317e-05 2024-09-12T18:37:11.082 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.082 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.082 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.082 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641917+0000", 2024-09-12T18:37:11.082 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3339999999999999e-05 2024-09-12T18:37:11.082 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.082 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.082 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:11.082 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650708+0000", 2024-09-12T18:37:11.082 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.008791419 2024-09-12T18:37:11.083 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.083 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.083 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:11.083 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651021+0000", 2024-09-12T18:37:11.083 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031296699999999999 2024-09-12T18:37:11.083 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.083 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.083 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:11.083 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651349+0000", 2024-09-12T18:37:11.083 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032796499999999999 2024-09-12T18:37:11.083 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.083 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.083 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:11.083 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655742+0000", 2024-09-12T18:37:11.084 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0043934680000000002 2024-09-12T18:37:11.084 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.084 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.084 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:11.084 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668377+0000", 2024-09-12T18:37:11.084 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012634312999999999 2024-09-12T18:37:11.084 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.084 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.084 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:11.084 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668441+0000", 2024-09-12T18:37:11.084 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4369999999999995e-05 2024-09-12T18:37:11.084 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.084 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.085 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:11.085 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668485+0000", 2024-09-12T18:37:11.085 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4422999999999998e-05 2024-09-12T18:37:11.085 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:11.085 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:11.085 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:11.085 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.085 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.085 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:11.085 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:37:11.085 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 105.386403988, 2024-09-12T18:37:11.085 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026919499, 2024-09-12T18:37:11.085 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:11.085 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:11.086 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:11.086 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:11.086 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.086 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:11.086 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:37:11.086 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:11.086 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.086 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.086 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:11.086 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:37:11.086 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:11.086 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.086 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.087 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:11.087 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641939+0000", 2024-09-12T18:37:11.087 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9399999999999993e-07 2024-09-12T18:37:11.087 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.087 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.087 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:11.087 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641945+0000", 2024-09-12T18:37:11.087 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9200000000000001e-06 2024-09-12T18:37:11.087 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.087 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.087 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:11.087 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641961+0000", 2024-09-12T18:37:11.087 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6520000000000001e-05 2024-09-12T18:37:11.087 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.088 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.088 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.088 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641974+0000", 2024-09-12T18:37:11.088 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3413e-05 2024-09-12T18:37:11.088 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.088 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.088 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:11.088 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654560+0000", 2024-09-12T18:37:11.088 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012585308999999999 2024-09-12T18:37:11.088 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.088 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.088 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:11.088 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654822+0000", 2024-09-12T18:37:11.089 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026210099999999999 2024-09-12T18:37:11.089 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.089 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.089 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:11.089 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655059+0000", 2024-09-12T18:37:11.089 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00023747899999999999 2024-09-12T18:37:11.089 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.089 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.089 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:11.089 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.656315+0000", 2024-09-12T18:37:11.090 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0012555000000000001 2024-09-12T18:37:11.090 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.090 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.090 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:11.090 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668590+0000", 2024-09-12T18:37:11.090 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012274851999999999 2024-09-12T18:37:11.090 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.090 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.090 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:11.090 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668725+0000", 2024-09-12T18:37:11.090 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013524199999999999 2024-09-12T18:37:11.090 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.090 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.091 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:11.091 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668857+0000", 2024-09-12T18:37:11.091 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013216899999999999 2024-09-12T18:37:11.091 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:11.091 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:11.091 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:11.091 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.091 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.091 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:11.091 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:37:11.091 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 105.38622260299999, 2024-09-12T18:37:11.091 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024670563, 2024-09-12T18:37:11.091 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:11.091 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:11.092 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:11.092 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:11.092 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.092 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:11.092 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:37:11.092 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:11.092 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.092 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.092 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:11.092 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:37:11.092 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:11.092 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.092 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.092 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:11.093 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642120+0000", 2024-09-12T18:37:11.093 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1769999999999999e-06 2024-09-12T18:37:11.093 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.093 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.093 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:11.093 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642128+0000", 2024-09-12T18:37:11.093 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3429999999999998e-06 2024-09-12T18:37:11.093 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.093 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.093 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:11.093 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642192+0000", 2024-09-12T18:37:11.093 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4406999999999995e-05 2024-09-12T18:37:11.093 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.093 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.094 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.094 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642223+0000", 2024-09-12T18:37:11.094 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.1266000000000002e-05 2024-09-12T18:37:11.094 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.094 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.094 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:11.094 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643201+0000", 2024-09-12T18:37:11.094 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0009778390000000001 2024-09-12T18:37:11.094 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.094 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.094 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:11.094 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643410+0000", 2024-09-12T18:37:11.094 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020874199999999999 2024-09-12T18:37:11.094 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.095 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.095 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:11.095 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643685+0000", 2024-09-12T18:37:11.095 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027520700000000002 2024-09-12T18:37:11.095 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.095 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.095 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:11.095 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650966+0000", 2024-09-12T18:37:11.095 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072810710000000001 2024-09-12T18:37:11.095 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.095 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.095 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:11.095 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666560+0000", 2024-09-12T18:37:11.096 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015594143 2024-09-12T18:37:11.096 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.096 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.096 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:11.096 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666691+0000", 2024-09-12T18:37:11.096 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000130359 2024-09-12T18:37:11.096 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.096 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.096 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:11.096 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666790+0000", 2024-09-12T18:37:11.096 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9009e-05 2024-09-12T18:37:11.096 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:11.097 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:11.097 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:11.097 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.097 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.097 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:11.097 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:37:11.097 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 105.385444315, 2024-09-12T18:37:11.097 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024891744, 2024-09-12T18:37:11.097 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:11.097 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:11.097 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:11.097 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:11.097 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.098 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:11.098 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:37:11.098 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:11.098 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.098 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.098 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:11.098 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:37:11.098 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:11.098 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.098 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.098 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:11.098 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642899+0000", 2024-09-12T18:37:11.098 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4729999999999999e-06 2024-09-12T18:37:11.098 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.099 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.099 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:11.099 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642912+0000", 2024-09-12T18:37:11.099 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3495999999999999e-05 2024-09-12T18:37:11.099 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.099 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.099 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:11.099 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642934+0000", 2024-09-12T18:37:11.099 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2033999999999999e-05 2024-09-12T18:37:11.099 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.099 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.099 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.099 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642949+0000", 2024-09-12T18:37:11.099 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4970000000000001e-05 2024-09-12T18:37:11.100 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.100 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.100 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:11.100 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644400+0000", 2024-09-12T18:37:11.100 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001450305 2024-09-12T18:37:11.100 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.100 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.100 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:11.100 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644617+0000", 2024-09-12T18:37:11.100 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000217302 2024-09-12T18:37:11.100 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.100 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.100 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:11.101 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645052+0000", 2024-09-12T18:37:11.101 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000434797 2024-09-12T18:37:11.101 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.101 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.101 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:11.101 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653860+0000", 2024-09-12T18:37:11.101 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0088082249999999994 2024-09-12T18:37:11.101 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.101 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.101 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:11.101 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667598+0000", 2024-09-12T18:37:11.101 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.013738451 2024-09-12T18:37:11.101 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.101 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.102 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:11.102 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667698+0000", 2024-09-12T18:37:11.102 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9854999999999999e-05 2024-09-12T18:37:11.102 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.102 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.102 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:11.102 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667789+0000", 2024-09-12T18:37:11.102 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0835999999999996e-05 2024-09-12T18:37:11.102 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:11.102 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:11.102 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:11.102 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.102 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.103 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:121106 5.d e50/21 5:b4a9a221:::benchmark_data_smithi073_23739_object121105:head v 50'7658, mlcod=48'7656)", 2024-09-12T18:37:11.103 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:40.238637+0000", 2024-09-12T18:37:11.103 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 30.789704588999999, 2024-09-12T18:37:11.103 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.033154694999999998, 2024-09-12T18:37:11.103 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:11.103 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:11.103 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:11.103 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:11.103 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.103 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:11.103 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238637+0000", 2024-09-12T18:37:11.103 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:11.103 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.103 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.104 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:11.104 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238637+0000", 2024-09-12T18:37:11.104 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:11.104 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.104 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.104 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:11.104 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238639+0000", 2024-09-12T18:37:11.104 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.8560000000000001e-06 2024-09-12T18:37:11.104 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.104 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.104 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:11.104 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238723+0000", 2024-09-12T18:37:11.104 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4314999999999995e-05 2024-09-12T18:37:11.105 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.105 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.105 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:11.105 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238753+0000", 2024-09-12T18:37:11.105 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.9726e-05 2024-09-12T18:37:11.105 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.105 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.105 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.105 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238773+0000", 2024-09-12T18:37:11.105 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9789e-05 2024-09-12T18:37:11.105 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.105 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.105 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:11.105 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.241557+0000", 2024-09-12T18:37:11.106 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0027843910000000002 2024-09-12T18:37:11.106 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.106 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.106 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:11.106 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.241581+0000", 2024-09-12T18:37:11.106 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.4224999999999999e-05 2024-09-12T18:37:11.106 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.106 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.106 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:11.106 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.271722+0000", 2024-09-12T18:37:11.106 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.030141194 2024-09-12T18:37:11.106 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.106 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.106 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:11.107 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.271792+0000", 2024-09-12T18:37:11.107 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9198999999999999e-05 2024-09-12T18:37:11.107 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:11.107 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:11.107 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:11.107 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.107 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.107 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:131551 5.d e52/21 5:b8f8c77a:::benchmark_data_smithi073_23739_object131550:head v 52'8341, mlcod=52'8338)", 2024-09-12T18:37:11.107 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:45.500609+0000", 2024-09-12T18:37:11.107 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 25.527732408999999, 2024-09-12T18:37:11.107 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024752877, 2024-09-12T18:37:11.107 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:11.107 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:11.107 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:11.107 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:11.108 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.108 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:11.108 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500609+0000", 2024-09-12T18:37:11.108 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:11.108 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.108 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.108 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:11.108 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500609+0000", 2024-09-12T18:37:11.108 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:11.108 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.108 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.108 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:11.108 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500610+0000", 2024-09-12T18:37:11.108 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5499999999999998e-07 2024-09-12T18:37:11.109 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.109 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.109 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:11.109 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500669+0000", 2024-09-12T18:37:11.109 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9244999999999999e-05 2024-09-12T18:37:11.109 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.109 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.109 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:11.109 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500676+0000", 2024-09-12T18:37:11.109 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3030000000000002e-06 2024-09-12T18:37:11.109 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.109 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.109 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.109 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500681+0000", 2024-09-12T18:37:11.110 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8720000000000001e-06 2024-09-12T18:37:11.110 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.110 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.110 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:11.110 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.517128+0000", 2024-09-12T18:37:11.110 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.016446485 2024-09-12T18:37:11.110 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.110 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.110 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:11.110 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.517159+0000", 2024-09-12T18:37:11.110 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.0926000000000002e-05 2024-09-12T18:37:11.110 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.110 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.110 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:11.111 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.525325+0000", 2024-09-12T18:37:11.111 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0081661460000000009 2024-09-12T18:37:11.111 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.111 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.111 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:11.111 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.525362+0000", 2024-09-12T18:37:11.111 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.7345000000000002e-05 2024-09-12T18:37:11.111 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:11.111 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:11.111 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:11.111 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.111 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.111 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167364 5.7 5:ee50096a:::benchmark_data_smithi073_23739_object35087:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:11.111 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.168715+0000", 2024-09-12T18:37:11.112 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 7.8596265020000002, 2024-09-12T18:37:11.112 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.068831153000000006, 2024-09-12T18:37:11.112 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:11.112 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:11.112 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:11.112 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:11.112 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:11.112 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:11.112 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167364 2024-09-12T18:37:11.112 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.112 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:11.112 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.112 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:11.113 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168715+0000", 2024-09-12T18:37:11.113 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:11.113 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.113 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.113 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:11.113 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168715+0000", 2024-09-12T18:37:11.113 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:11.113 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.113 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.113 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:11.113 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168716+0000", 2024-09-12T18:37:11.113 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0559999999999999e-06 2024-09-12T18:37:11.113 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.113 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.114 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:11.114 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168721+0000", 2024-09-12T18:37:11.114 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8019999999999999e-06 2024-09-12T18:37:11.114 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.114 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.114 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:11.114 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168731+0000", 2024-09-12T18:37:11.114 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0315e-05 2024-09-12T18:37:11.114 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.115 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.115 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.115 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168738+0000", 2024-09-12T18:37:11.115 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.126e-06 2024-09-12T18:37:11.115 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.115 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.115 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:11.115 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168782+0000", 2024-09-12T18:37:11.115 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.3924000000000002e-05 2024-09-12T18:37:11.115 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.115 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.115 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:11.115 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168913+0000", 2024-09-12T18:37:11.115 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000131154 2024-09-12T18:37:11.116 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.116 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.116 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:11.116 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169026+0000", 2024-09-12T18:37:11.116 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011223299999999999 2024-09-12T18:37:11.116 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.116 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.116 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:11.116 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.175404+0000", 2024-09-12T18:37:11.116 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0063780319999999996 2024-09-12T18:37:11.116 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.116 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.116 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:11.116 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237446+0000", 2024-09-12T18:37:11.117 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.062042238 2024-09-12T18:37:11.117 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.117 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.117 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:11.117 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237501+0000", 2024-09-12T18:37:11.117 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4913000000000001e-05 2024-09-12T18:37:11.117 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.117 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.117 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:11.117 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237546+0000", 2024-09-12T18:37:11.117 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.5359999999999999e-05 2024-09-12T18:37:11.117 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:11.117 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:11.118 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:11.118 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.118 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.118 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167365 5.2 5:4107875c:::benchmark_data_smithi073_23739_object35088:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:11.118 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:11.118 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 7.8595769280000001, 2024-09-12T18:37:11.118 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.078544438999999994, 2024-09-12T18:37:11.118 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:11.118 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:11.118 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:11.118 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:11.118 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:11.118 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:11.119 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167365 2024-09-12T18:37:11.119 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.119 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:11.119 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.119 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:11.119 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:11.119 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:11.119 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.119 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.119 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:11.119 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:11.119 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:11.119 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.119 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.120 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:11.120 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:11.120 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.4700000000000001e-07 2024-09-12T18:37:11.120 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.120 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.120 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:11.120 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168769+0000", 2024-09-12T18:37:11.120 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.4170000000000001e-06 2024-09-12T18:37:11.120 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.120 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.120 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:11.120 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168777+0000", 2024-09-12T18:37:11.120 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1499999999999999e-06 2024-09-12T18:37:11.121 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.121 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.121 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.121 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168783+0000", 2024-09-12T18:37:11.121 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.0460000000000002e-06 2024-09-12T18:37:11.121 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.121 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.121 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:11.121 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168865+0000", 2024-09-12T18:37:11.121 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1953999999999995e-05 2024-09-12T18:37:11.121 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.121 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.121 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:11.121 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169003+0000", 2024-09-12T18:37:11.122 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013798200000000001 2024-09-12T18:37:11.122 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.122 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.122 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:11.122 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169065+0000", 2024-09-12T18:37:11.122 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2218000000000006e-05 2024-09-12T18:37:11.122 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.122 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.122 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:11.122 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174771+0000", 2024-09-12T18:37:11.122 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0057054819999999996 2024-09-12T18:37:11.122 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.122 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.123 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:11.123 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.247234+0000", 2024-09-12T18:37:11.123 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.072463391000000002 2024-09-12T18:37:11.123 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.123 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.123 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:11.123 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.247273+0000", 2024-09-12T18:37:11.123 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.9069000000000002e-05 2024-09-12T18:37:11.123 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.123 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.123 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:11.123 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.247309+0000", 2024-09-12T18:37:11.123 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5982999999999998e-05 2024-09-12T18:37:11.123 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:11.123 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:11.124 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:11.124 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.124 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.124 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167369 5.7 5:e64ecabd:::benchmark_data_smithi073_23739_object35092:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:11.124 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.169042+0000", 2024-09-12T18:37:11.124 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 7.8592998170000001, 2024-09-12T18:37:11.124 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.069229188999999997, 2024-09-12T18:37:11.124 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:11.124 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:11.124 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:11.125 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:11.125 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:11.125 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:11.125 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167369 2024-09-12T18:37:11.125 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.125 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:11.125 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.125 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:11.125 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169042+0000", 2024-09-12T18:37:11.125 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:11.125 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.125 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.125 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:11.126 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169042+0000", 2024-09-12T18:37:11.126 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:11.126 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.126 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.126 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:11.126 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169043+0000", 2024-09-12T18:37:11.126 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.9400000000000004e-07 2024-09-12T18:37:11.126 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.126 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.126 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:11.126 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169048+0000", 2024-09-12T18:37:11.126 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8420000000000004e-06 2024-09-12T18:37:11.126 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.127 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.127 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:11.127 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169055+0000", 2024-09-12T18:37:11.127 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.7989999999999994e-06 2024-09-12T18:37:11.127 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.127 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.127 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.127 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169062+0000", 2024-09-12T18:37:11.127 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.5950000000000004e-06 2024-09-12T18:37:11.127 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.127 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.127 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:11.127 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173858+0000", 2024-09-12T18:37:11.127 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0047959259999999998 2024-09-12T18:37:11.127 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.128 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.128 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:11.128 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173966+0000", 2024-09-12T18:37:11.128 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000107941 2024-09-12T18:37:11.128 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.128 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.128 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:11.128 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174043+0000", 2024-09-12T18:37:11.128 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.7360000000000005e-05 2024-09-12T18:37:11.128 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.128 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.128 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:11.128 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.175711+0000", 2024-09-12T18:37:11.129 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0016680810000000001 2024-09-12T18:37:11.129 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.129 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.129 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:11.129 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.238163+0000", 2024-09-12T18:37:11.129 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.062451523000000002 2024-09-12T18:37:11.129 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.129 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.129 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:11.129 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.238222+0000", 2024-09-12T18:37:11.129 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9723999999999999e-05 2024-09-12T18:37:11.129 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.129 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.129 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:11.130 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.238271+0000", 2024-09-12T18:37:11.130 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8504000000000002e-05 2024-09-12T18:37:11.130 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:11.130 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:11.130 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:11.130 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.130 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.130 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167373 5.5 5:ad283029:::benchmark_data_smithi073_23739_object35096:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:11.130 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:11.130 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 7.8567949859999997, 2024-09-12T18:37:11.130 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.066200976999999994, 2024-09-12T18:37:11.130 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:11.130 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:11.130 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:11.131 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:11.131 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:11.131 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:11.131 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167373 2024-09-12T18:37:11.131 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.131 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:11.131 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.131 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:11.131 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:11.131 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:11.131 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.131 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.131 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:11.131 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:11.132 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:11.132 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.132 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.132 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:11.132 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:11.132 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4900000000000005e-07 2024-09-12T18:37:11.132 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.132 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.132 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:11.132 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171551+0000", 2024-09-12T18:37:11.132 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.7519999999999998e-06 2024-09-12T18:37:11.132 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.132 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.133 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:11.133 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171562+0000", 2024-09-12T18:37:11.133 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0353000000000001e-05 2024-09-12T18:37:11.133 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.133 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.133 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.133 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171566+0000", 2024-09-12T18:37:11.133 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8269999999999997e-06 2024-09-12T18:37:11.133 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.133 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.133 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:11.133 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171622+0000", 2024-09-12T18:37:11.133 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5220999999999999e-05 2024-09-12T18:37:11.134 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.134 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.134 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:11.134 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171719+0000", 2024-09-12T18:37:11.134 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7238999999999995e-05 2024-09-12T18:37:11.134 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.134 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.134 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:11.134 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171802+0000", 2024-09-12T18:37:11.134 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.3285e-05 2024-09-12T18:37:11.134 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.134 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.134 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:11.134 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174608+0000", 2024-09-12T18:37:11.135 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028054590000000002 2024-09-12T18:37:11.135 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.135 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.135 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:11.135 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174762+0000", 2024-09-12T18:37:11.135 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015465100000000001 2024-09-12T18:37:11.135 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.135 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.135 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:11.135 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237474+0000", 2024-09-12T18:37:11.135 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.062711683000000004 2024-09-12T18:37:11.135 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.135 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.135 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:11.135 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237540+0000", 2024-09-12T18:37:11.136 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.6132999999999999e-05 2024-09-12T18:37:11.136 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.136 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.136 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:11.136 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237748+0000", 2024-09-12T18:37:11.136 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020752499999999999 2024-09-12T18:37:11.136 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:11.136 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:11.136 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:11.136 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.137 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.137 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167374 5.1 5:81e25826:::benchmark_data_smithi073_23739_object35097:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:11.137 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.173748+0000", 2024-09-12T18:37:11.137 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 7.8545935379999996, 2024-09-12T18:37:11.137 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.069225245000000005, 2024-09-12T18:37:11.137 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:11.137 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:11.137 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:11.137 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:11.137 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:11.137 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:11.137 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167374 2024-09-12T18:37:11.137 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.137 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:11.138 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.138 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:11.138 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173748+0000", 2024-09-12T18:37:11.138 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:11.138 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.138 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.138 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:11.138 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173748+0000", 2024-09-12T18:37:11.138 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:11.138 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.138 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.138 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:11.138 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173749+0000", 2024-09-12T18:37:11.138 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.418e-06 2024-09-12T18:37:11.139 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.139 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.139 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:11.139 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173755+0000", 2024-09-12T18:37:11.139 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.0730000000000004e-06 2024-09-12T18:37:11.139 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.139 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.139 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:11.139 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173768+0000", 2024-09-12T18:37:11.139 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3644e-05 2024-09-12T18:37:11.139 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.139 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.139 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.139 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173777+0000", 2024-09-12T18:37:11.140 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4160000000000004e-06 2024-09-12T18:37:11.140 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.140 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.140 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:11.140 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173927+0000", 2024-09-12T18:37:11.140 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015065900000000001 2024-09-12T18:37:11.140 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.140 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.140 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:11.140 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174052+0000", 2024-09-12T18:37:11.140 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012460699999999999 2024-09-12T18:37:11.140 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.140 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.141 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:11.141 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174181+0000", 2024-09-12T18:37:11.141 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012919299999999999 2024-09-12T18:37:11.141 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.141 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.141 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:11.141 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.178108+0000", 2024-09-12T18:37:11.141 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0039273210000000001 2024-09-12T18:37:11.141 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.141 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.141 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:11.141 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.178118+0000", 2024-09-12T18:37:11.141 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7550000000000006e-06 2024-09-12T18:37:11.141 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.141 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.142 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:11.142 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.242865+0000", 2024-09-12T18:37:11.142 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.064746597000000003 2024-09-12T18:37:11.142 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.142 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.142 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:11.142 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.242903+0000", 2024-09-12T18:37:11.142 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.8268e-05 2024-09-12T18:37:11.142 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.142 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.142 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:11.142 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.242973+0000", 2024-09-12T18:37:11.142 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0294000000000002e-05 2024-09-12T18:37:11.142 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:11.143 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:11.143 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:11.143 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.143 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.143 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167375 5.1 5:83a09102:::benchmark_data_smithi073_23739_object35098:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:11.143 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:11.143 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 7.8545419909999996, 2024-09-12T18:37:11.143 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.069437463000000005, 2024-09-12T18:37:11.143 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:11.143 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:11.143 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:11.143 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:11.143 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:11.143 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:11.144 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167375 2024-09-12T18:37:11.144 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.144 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:11.144 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.144 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:11.144 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:11.144 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:11.144 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.144 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.144 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:11.144 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:11.144 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:11.144 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.145 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.145 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:11.145 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:11.145 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1399999999999997e-07 2024-09-12T18:37:11.145 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.145 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.145 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:11.145 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173803+0000", 2024-09-12T18:37:11.145 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.7860000000000001e-06 2024-09-12T18:37:11.145 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.145 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.145 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:11.145 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173811+0000", 2024-09-12T18:37:11.145 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4610000000000008e-06 2024-09-12T18:37:11.146 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.146 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.146 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.146 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173817+0000", 2024-09-12T18:37:11.146 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3569999999999997e-06 2024-09-12T18:37:11.146 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.146 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.146 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:11.146 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.176070+0000", 2024-09-12T18:37:11.146 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.002253405 2024-09-12T18:37:11.146 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.146 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.146 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:11.146 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.176263+0000", 2024-09-12T18:37:11.147 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000192583 2024-09-12T18:37:11.147 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.147 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.147 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:11.147 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.176429+0000", 2024-09-12T18:37:11.147 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00016626 2024-09-12T18:37:11.147 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.147 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.147 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:11.147 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.178154+0000", 2024-09-12T18:37:11.147 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0017247009999999999 2024-09-12T18:37:11.147 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.147 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.147 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:11.148 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.182110+0000", 2024-09-12T18:37:11.148 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0039568229999999999 2024-09-12T18:37:11.148 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.148 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.148 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:11.148 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.243024+0000", 2024-09-12T18:37:11.148 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.060913249000000003 2024-09-12T18:37:11.148 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.148 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.148 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:11.148 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.243107+0000", 2024-09-12T18:37:11.148 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.3090000000000006e-05 2024-09-12T18:37:11.148 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.148 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.149 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:11.149 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.243237+0000", 2024-09-12T18:37:11.149 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013023399999999999 2024-09-12T18:37:11.149 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:11.149 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:11.149 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:11.149 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.149 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.149 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:182796 5.2 5:4d2ea0ae:::benchmark_data_smithi073_23739_object50519:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T18:37:11.149 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:10.616684+0000", 2024-09-12T18:37:11.149 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.41165768699999999, 2024-09-12T18:37:11.149 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026244475999999999, 2024-09-12T18:37:11.149 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:11.149 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:11.150 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:11.150 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:11.150 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:11.150 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:11.150 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 182796 2024-09-12T18:37:11.150 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.150 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:11.150 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.150 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:11.150 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.616684+0000", 2024-09-12T18:37:11.150 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:11.150 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.150 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.150 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:11.150 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.616684+0000", 2024-09-12T18:37:11.151 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:11.151 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.151 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.151 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:11.151 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.616686+0000", 2024-09-12T18:37:11.151 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7519999999999999e-06 2024-09-12T18:37:11.151 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.151 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.151 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:11.151 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.616691+0000", 2024-09-12T18:37:11.151 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.6200000000000004e-06 2024-09-12T18:37:11.151 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.151 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.151 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:11.152 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.616703+0000", 2024-09-12T18:37:11.152 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1955e-05 2024-09-12T18:37:11.152 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.152 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.152 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.152 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.616710+0000", 2024-09-12T18:37:11.152 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.1029999999999996e-06 2024-09-12T18:37:11.152 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.152 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.152 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:11.152 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.616762+0000", 2024-09-12T18:37:11.152 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1706999999999998e-05 2024-09-12T18:37:11.152 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.153 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.153 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:11.153 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.616899+0000", 2024-09-12T18:37:11.153 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000136816 2024-09-12T18:37:11.153 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.153 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.153 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:11.153 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.617025+0000", 2024-09-12T18:37:11.153 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012590799999999999 2024-09-12T18:37:11.153 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.153 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.153 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:11.153 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.622400+0000", 2024-09-12T18:37:11.153 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0053749069999999999 2024-09-12T18:37:11.154 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.154 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.154 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:11.154 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.642822+0000", 2024-09-12T18:37:11.154 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.020422484000000001 2024-09-12T18:37:11.154 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.154 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.154 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:11.154 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.642882+0000", 2024-09-12T18:37:11.154 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9917000000000002e-05 2024-09-12T18:37:11.154 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:11.154 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:11.154 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:11.154 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.642928+0000", 2024-09-12T18:37:11.155 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6307000000000002e-05 2024-09-12T18:37:11.155 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:11.155 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:11.155 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:11.155 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:11.155 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:11.155 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:11.157 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:11.150+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:11.157 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:37:11.257 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:11.250+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:11.306 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:11.306 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:37:11.306 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.306 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:184271 5.6 5:6be54b45:::benchmark_data_smithi073_23739_object51994:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T18:37:11.306 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:11.295194+0000", 2024-09-12T18:37:11.307 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0085091650000000008, 2024-09-12T18:37:11.307 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0085255720000000004, 2024-09-12T18:37:11.307 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:11.307 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:11.307 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:11.307 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:11.307 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:11.307 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:11.307 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 184271 2024-09-12T18:37:11.307 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.307 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:11.307 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.308 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:11.308 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.295194+0000", 2024-09-12T18:37:11.308 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.308 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.308 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.308 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:11.308 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.295194+0000", 2024-09-12T18:37:11.308 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.308 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.308 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.308 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:11.308 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.295195+0000", 2024-09-12T18:37:11.308 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.6800000000000009e-07 2024-09-12T18:37:11.309 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.309 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.309 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:11.309 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.295200+0000", 2024-09-12T18:37:11.309 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3610000000000003e-06 2024-09-12T18:37:11.309 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.309 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.309 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:11.309 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.295216+0000", 2024-09-12T18:37:11.309 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5832e-05 2024-09-12T18:37:11.309 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.309 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.309 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.310 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.295223+0000", 2024-09-12T18:37:11.310 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1289999999999998e-06 2024-09-12T18:37:11.310 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.310 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.310 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:11.310 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.299690+0000", 2024-09-12T18:37:11.310 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0044672610000000001 2024-09-12T18:37:11.310 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.310 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.310 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:11.310 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.299766+0000", 2024-09-12T18:37:11.310 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5990999999999998e-05 2024-09-12T18:37:11.310 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.311 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.311 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:11.311 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.299849+0000", 2024-09-12T18:37:11.311 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.3479999999999994e-05 2024-09-12T18:37:11.311 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.311 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:11.311 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.311 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.311 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.311 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:184279 5.c 5:33029f9e:::benchmark_data_smithi073_23739_object52002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T18:37:11.311 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:11.298564+0000", 2024-09-12T18:37:11.311 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0051394090000000002, 2024-09-12T18:37:11.311 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0051968300000000004, 2024-09-12T18:37:11.311 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:11.312 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:11.312 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:11.312 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:11.312 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:11.312 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:11.312 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 184279 2024-09-12T18:37:11.312 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.312 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:11.312 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.312 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:11.312 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.298564+0000", 2024-09-12T18:37:11.312 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.312 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.313 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.313 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:11.313 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.298564+0000", 2024-09-12T18:37:11.313 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.313 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.313 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.313 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:11.313 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.298565+0000", 2024-09-12T18:37:11.313 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.029e-06 2024-09-12T18:37:11.313 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.313 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.313 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:11.313 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.298571+0000", 2024-09-12T18:37:11.314 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9630000000000003e-06 2024-09-12T18:37:11.314 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.314 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.314 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:11.314 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.298582+0000", 2024-09-12T18:37:11.314 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0652999999999999e-05 2024-09-12T18:37:11.314 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.314 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.314 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.314 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.298587+0000", 2024-09-12T18:37:11.314 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6160000000000001e-06 2024-09-12T18:37:11.314 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.314 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.314 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:11.315 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.299388+0000", 2024-09-12T18:37:11.315 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00080099100000000003 2024-09-12T18:37:11.315 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.315 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.315 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:11.315 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.299512+0000", 2024-09-12T18:37:11.315 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012317200000000001 2024-09-12T18:37:11.315 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.315 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.315 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:11.315 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.299640+0000", 2024-09-12T18:37:11.315 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012844000000000001 2024-09-12T18:37:11.315 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.316 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:11.316 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.316 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.316 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.316 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:184276 5.0 e61/49 5:046339f2:::benchmark_data_smithi073_23739_object51999:head v 61'11562, mlcod=61'11560)", 2024-09-12T18:37:11.316 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:11.299129+0000", 2024-09-12T18:37:11.316 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0045746509999999999, 2024-09-12T18:37:11.316 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0046664860000000001, 2024-09-12T18:37:11.316 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:11.316 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:11.316 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:11.316 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:11.316 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.317 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:11.317 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.299129+0000", 2024-09-12T18:37:11.317 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.317 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.317 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.317 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:11.317 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.299129+0000", 2024-09-12T18:37:11.317 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.317 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.317 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.317 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:11.317 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.299130+0000", 2024-09-12T18:37:11.317 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.06e-07 2024-09-12T18:37:11.317 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.318 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.318 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:11.318 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.299136+0000", 2024-09-12T18:37:11.318 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8079999999999999e-06 2024-09-12T18:37:11.318 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.318 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.318 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:11.318 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.299148+0000", 2024-09-12T18:37:11.318 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1387e-05 2024-09-12T18:37:11.318 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.318 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.318 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.318 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.299154+0000", 2024-09-12T18:37:11.319 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4509999999999997e-06 2024-09-12T18:37:11.319 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.319 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.319 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:11.319 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.299194+0000", 2024-09-12T18:37:11.319 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.9663999999999998e-05 2024-09-12T18:37:11.319 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.319 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.319 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:11.319 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.299219+0000", 2024-09-12T18:37:11.319 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4661e-05 2024-09-12T18:37:11.319 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.319 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:11.319 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.320 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.320 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.320 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:184280 5.4 e61/21 5:2376d45b:::benchmark_data_smithi073_23739_object52003:head v 61'11410, mlcod=61'11407)", 2024-09-12T18:37:11.320 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:11.300153+0000", 2024-09-12T18:37:11.320 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0035500900000000001, 2024-09-12T18:37:11.320 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.003668714, 2024-09-12T18:37:11.320 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:11.320 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:11.320 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:11.320 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:11.320 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.320 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:11.320 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.300153+0000", 2024-09-12T18:37:11.321 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.321 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.321 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.321 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:11.321 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.300153+0000", 2024-09-12T18:37:11.321 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.321 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.321 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.321 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:11.321 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.300154+0000", 2024-09-12T18:37:11.321 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.3099999999999998e-07 2024-09-12T18:37:11.321 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.321 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.321 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:11.322 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.300162+0000", 2024-09-12T18:37:11.322 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8979999999999996e-06 2024-09-12T18:37:11.322 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.322 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.322 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:11.322 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.300170+0000", 2024-09-12T18:37:11.322 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0339999999999997e-06 2024-09-12T18:37:11.322 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.322 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.322 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.322 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.300176+0000", 2024-09-12T18:37:11.322 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.618e-06 2024-09-12T18:37:11.322 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.323 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.323 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:11.323 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.300222+0000", 2024-09-12T18:37:11.323 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5989999999999998e-05 2024-09-12T18:37:11.323 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.323 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.323 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:11.323 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.300242+0000", 2024-09-12T18:37:11.323 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.0001e-05 2024-09-12T18:37:11.323 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.323 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:11.323 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.323 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.323 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.324 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:184281 5.b e61/21 5:dfa50378:::benchmark_data_smithi073_23739_object52004:head v 61'11677, mlcod=61'11675)", 2024-09-12T18:37:11.324 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:11.300193+0000", 2024-09-12T18:37:11.324 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0035105190000000001, 2024-09-12T18:37:11.324 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0036563479999999998, 2024-09-12T18:37:11.324 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:11.324 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:11.324 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:11.324 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:11.324 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.324 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:11.324 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.300193+0000", 2024-09-12T18:37:11.324 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.324 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.325 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.325 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:11.325 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.300193+0000", 2024-09-12T18:37:11.325 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.325 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.325 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.325 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:11.325 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.300193+0000", 2024-09-12T18:37:11.325 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.1600000000000002e-07 2024-09-12T18:37:11.325 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.325 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.325 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:11.325 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.300197+0000", 2024-09-12T18:37:11.325 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3560000000000001e-06 2024-09-12T18:37:11.326 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.326 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.326 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:11.326 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.300203+0000", 2024-09-12T18:37:11.326 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4579999999999998e-06 2024-09-12T18:37:11.326 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.326 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.326 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.326 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.300208+0000", 2024-09-12T18:37:11.326 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.7249999999999997e-06 2024-09-12T18:37:11.326 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.326 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.326 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:11.327 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.300266+0000", 2024-09-12T18:37:11.327 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8301999999999998e-05 2024-09-12T18:37:11.327 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.327 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.327 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:11.327 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.300278+0000", 2024-09-12T18:37:11.327 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1508999999999999e-05 2024-09-12T18:37:11.327 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.327 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:11.327 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.327 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.327 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.327 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:184284 5.6 5:6fdf4f5f:::benchmark_data_smithi073_23739_object52007:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T18:37:11.327 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:11.302662+0000", 2024-09-12T18:37:11.328 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0010419139999999999, 2024-09-12T18:37:11.328 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001214536, 2024-09-12T18:37:11.328 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:11.328 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:11.328 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:11.328 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:11.328 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:11.328 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:11.328 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 184284 2024-09-12T18:37:11.328 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.328 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:11.329 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.329 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:11.329 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.302662+0000", 2024-09-12T18:37:11.329 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.329 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.329 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.329 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:11.329 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.302662+0000", 2024-09-12T18:37:11.329 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.329 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.329 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.329 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:11.330 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.302663+0000", 2024-09-12T18:37:11.330 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1599999999999999e-06 2024-09-12T18:37:11.330 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.330 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.330 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:11.330 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.302667+0000", 2024-09-12T18:37:11.330 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.1980000000000003e-06 2024-09-12T18:37:11.330 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.330 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.330 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:11.330 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.302676+0000", 2024-09-12T18:37:11.330 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6289999999999999e-06 2024-09-12T18:37:11.331 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.331 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.331 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.331 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.302681+0000", 2024-09-12T18:37:11.331 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0209999999999999e-06 2024-09-12T18:37:11.331 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.331 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.331 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:11.331 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.302735+0000", 2024-09-12T18:37:11.331 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4129000000000003e-05 2024-09-12T18:37:11.331 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.331 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.331 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:11.331 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.302837+0000", 2024-09-12T18:37:11.332 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000102297 2024-09-12T18:37:11.332 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.332 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.332 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:11.332 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.302900+0000", 2024-09-12T18:37:11.332 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2899999999999997e-05 2024-09-12T18:37:11.332 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.332 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:11.332 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.332 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.332 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.332 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:184271 5.6 e61/21)", 2024-09-12T18:37:11.332 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:11.302692+0000", 2024-09-12T18:37:11.333 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0010118149999999999, 2024-09-12T18:37:11.333 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001215002, 2024-09-12T18:37:11.333 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:11.333 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:11.333 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:11.333 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:11.333 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.333 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:11.333 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.302692+0000", 2024-09-12T18:37:11.333 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.333 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.333 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.333 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:11.334 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.302692+0000", 2024-09-12T18:37:11.334 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.334 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.334 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.334 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:11.334 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.302692+0000", 2024-09-12T18:37:11.334 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4600000000000005e-07 2024-09-12T18:37:11.334 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.334 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.334 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:11.334 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.302697+0000", 2024-09-12T18:37:11.334 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4279999999999998e-06 2024-09-12T18:37:11.334 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.335 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.335 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:11.335 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.302710+0000", 2024-09-12T18:37:11.335 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3518e-05 2024-09-12T18:37:11.335 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.335 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.335 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.335 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.302718+0000", 2024-09-12T18:37:11.335 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4440000000000002e-06 2024-09-12T18:37:11.335 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.335 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:11.335 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.335 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.335 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.336 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:184286 5.c 5:3b98e01a:::benchmark_data_smithi073_23739_object52009:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T18:37:11.336 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:11.302707+0000", 2024-09-12T18:37:11.336 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00099684300000000008, 2024-09-12T18:37:11.336 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001224139, 2024-09-12T18:37:11.336 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:11.336 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:11.336 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:11.336 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:11.336 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:11.336 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:11.336 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 184286 2024-09-12T18:37:11.336 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.336 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:11.337 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.337 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:11.337 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.302707+0000", 2024-09-12T18:37:11.337 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.337 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.337 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.337 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:11.337 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.302707+0000", 2024-09-12T18:37:11.337 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.337 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.337 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.337 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:11.337 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.302707+0000", 2024-09-12T18:37:11.338 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.96e-07 2024-09-12T18:37:11.338 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.338 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.338 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:11.338 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.302709+0000", 2024-09-12T18:37:11.338 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1040000000000001e-06 2024-09-12T18:37:11.338 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.338 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.338 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:11.338 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.302718+0000", 2024-09-12T18:37:11.338 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7460000000000006e-06 2024-09-12T18:37:11.338 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.338 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.338 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.339 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.302723+0000", 2024-09-12T18:37:11.339 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.096e-06 2024-09-12T18:37:11.339 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.339 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.339 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:11.339 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.302780+0000", 2024-09-12T18:37:11.339 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6866000000000001e-05 2024-09-12T18:37:11.339 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.339 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.340 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:11.340 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.302908+0000", 2024-09-12T18:37:11.340 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000127935 2024-09-12T18:37:11.340 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.340 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.340 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:11.340 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.303042+0000", 2024-09-12T18:37:11.340 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013452700000000001 2024-09-12T18:37:11.340 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.340 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:11.340 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.340 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.341 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.341 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:184279 5.c e61/21)", 2024-09-12T18:37:11.341 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:11.302733+0000", 2024-09-12T18:37:11.341 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00097022600000000003, 2024-09-12T18:37:11.341 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0012278980000000001, 2024-09-12T18:37:11.341 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:11.341 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:11.341 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:11.341 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:11.341 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.341 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:11.341 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.302733+0000", 2024-09-12T18:37:11.341 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.342 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.342 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.342 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:11.342 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.302733+0000", 2024-09-12T18:37:11.342 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.342 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.342 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.342 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:11.342 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.302734+0000", 2024-09-12T18:37:11.342 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3099999999999999e-07 2024-09-12T18:37:11.342 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.342 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.342 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:11.342 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.302736+0000", 2024-09-12T18:37:11.343 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.0889999999999998e-06 2024-09-12T18:37:11.343 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.343 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.343 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:11.343 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.302742+0000", 2024-09-12T18:37:11.343 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9819999999999996e-06 2024-09-12T18:37:11.343 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.343 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.343 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.343 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.302746+0000", 2024-09-12T18:37:11.343 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3000000000000003e-06 2024-09-12T18:37:11.343 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.343 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:11.344 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.344 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.344 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.344 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:184283 5.7 e61/21 5:e0f0b710:::benchmark_data_smithi073_23739_object52006:head v 61'11525, mlcod=61'11523)", 2024-09-12T18:37:11.344 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:11.302976+0000", 2024-09-12T18:37:11.344 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00072765199999999996, 2024-09-12T18:37:11.344 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0010067279999999999, 2024-09-12T18:37:11.344 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:11.344 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:11.344 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:11.344 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:11.344 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.344 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:11.345 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.302976+0000", 2024-09-12T18:37:11.345 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.345 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.345 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.345 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:11.345 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.302976+0000", 2024-09-12T18:37:11.345 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.345 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.345 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.345 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:11.345 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.302976+0000", 2024-09-12T18:37:11.345 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3099999999999997e-07 2024-09-12T18:37:11.345 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.346 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.346 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:11.346 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.302981+0000", 2024-09-12T18:37:11.346 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.7029999999999997e-06 2024-09-12T18:37:11.346 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.346 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.346 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:11.346 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.302989+0000", 2024-09-12T18:37:11.346 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.7970000000000001e-06 2024-09-12T18:37:11.346 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.346 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.347 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.347 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.302996+0000", 2024-09-12T18:37:11.347 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.9020000000000002e-06 2024-09-12T18:37:11.347 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.347 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.347 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:11.347 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.303041+0000", 2024-09-12T18:37:11.347 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5457999999999997e-05 2024-09-12T18:37:11.347 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.347 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.347 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:11.347 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.303059+0000", 2024-09-12T18:37:11.347 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7317e-05 2024-09-12T18:37:11.347 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.348 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:11.348 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.348 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.348 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.348 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:184285 5.e e61/21)", 2024-09-12T18:37:11.348 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:11.303041+0000", 2024-09-12T18:37:11.348 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00066262700000000005, 2024-09-12T18:37:11.348 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000965273, 2024-09-12T18:37:11.348 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:11.348 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:11.348 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:11.348 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:11.348 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.349 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:11.349 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.303041+0000", 2024-09-12T18:37:11.349 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.349 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.349 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.349 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:11.349 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.303041+0000", 2024-09-12T18:37:11.349 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.349 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.349 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.349 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:11.349 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.303042+0000", 2024-09-12T18:37:11.349 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5300000000000004e-07 2024-09-12T18:37:11.349 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.350 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.350 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:11.350 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.303047+0000", 2024-09-12T18:37:11.350 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0719999999999999e-06 2024-09-12T18:37:11.350 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.350 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.350 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:11.350 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.303054+0000", 2024-09-12T18:37:11.350 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1380000000000001e-06 2024-09-12T18:37:11.351 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.351 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.351 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.351 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.303059+0000", 2024-09-12T18:37:11.351 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6729999999999997e-06 2024-09-12T18:37:11.351 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.351 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:11.351 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.351 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.351 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.351 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:184289 5.2 e61/21 5:48aa23e4:::benchmark_data_smithi073_23739_object52012:head v 61'11457, mlcod=61'11455)", 2024-09-12T18:37:11.351 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:11.303098+0000", 2024-09-12T18:37:11.351 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00060521499999999998, 2024-09-12T18:37:11.352 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00092886100000000001, 2024-09-12T18:37:11.352 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:11.352 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:11.352 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:11.352 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:11.352 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.352 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:11.352 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.303098+0000", 2024-09-12T18:37:11.352 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.352 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.352 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.352 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:11.352 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.303098+0000", 2024-09-12T18:37:11.353 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.353 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.353 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.353 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:11.353 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.303099+0000", 2024-09-12T18:37:11.353 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2e-07 2024-09-12T18:37:11.353 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.353 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.353 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:11.353 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.303103+0000", 2024-09-12T18:37:11.353 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.7570000000000002e-06 2024-09-12T18:37:11.353 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.353 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.353 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:11.354 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.303111+0000", 2024-09-12T18:37:11.354 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6549999999999993e-06 2024-09-12T18:37:11.354 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.354 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.354 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.354 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.303116+0000", 2024-09-12T18:37:11.354 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1490000000000002e-06 2024-09-12T18:37:11.354 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.354 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.354 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:11.354 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.303159+0000", 2024-09-12T18:37:11.354 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2483e-05 2024-09-12T18:37:11.354 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.355 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.355 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:11.355 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.303175+0000", 2024-09-12T18:37:11.355 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6019e-05 2024-09-12T18:37:11.355 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.355 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:11.355 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.355 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.355 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.355 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:184290 5.4 e61/21)", 2024-09-12T18:37:11.355 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:11.303185+0000", 2024-09-12T18:37:11.355 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00051881099999999999, 2024-09-12T18:37:11.355 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00086624499999999997, 2024-09-12T18:37:11.355 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:11.356 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:11.356 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:11.356 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:11.356 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.356 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:11.356 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.303185+0000", 2024-09-12T18:37:11.356 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.356 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.356 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.356 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:11.356 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.303185+0000", 2024-09-12T18:37:11.356 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.356 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.357 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.357 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:11.357 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.303185+0000", 2024-09-12T18:37:11.357 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4199999999999995e-07 2024-09-12T18:37:11.357 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.357 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.357 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:11.357 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.303191+0000", 2024-09-12T18:37:11.357 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6860000000000003e-06 2024-09-12T18:37:11.357 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.357 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.357 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:11.357 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.303201+0000", 2024-09-12T18:37:11.357 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.5119999999999997e-06 2024-09-12T18:37:11.358 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.358 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.358 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.358 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:11.303207+0000", 2024-09-12T18:37:11.358 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5069999999999997e-06 2024-09-12T18:37:11.358 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.358 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:11.358 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.358 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.358 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-12T18:37:11.358 INFO:teuthology.orchestra.run.smithi114.stdout: "num_ops": 13 2024-09-12T18:37:11.358 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:11.360 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:37:11.361 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:11.353+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:11.460 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:11.454+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:11.511 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:11.512 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2024-09-12T18:37:11.512 INFO:teuthology.orchestra.run.smithi114.stdout: "complaint_time": 30, 2024-09-12T18:37:11.512 INFO:teuthology.orchestra.run.smithi114.stdout: "num_blocked_ops": 0 2024-09-12T18:37:11.512 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:11.530 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:37:11.576 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:11.570+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:11.662 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:11.654+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:11.680 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:11.680 INFO:teuthology.orchestra.run.smithi114.stdout: "size": 20, 2024-09-12T18:37:11.680 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 600, 2024-09-12T18:37:11.681 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:37:11.681 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.681 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:26 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:11.681 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:37:11.681 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 106.04819709900001, 2024-09-12T18:37:11.681 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045702136999999997, 2024-09-12T18:37:11.681 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:11.681 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:11.681 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:11.681 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:11.681 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.681 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:11.681 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:37:11.681 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.682 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.682 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.682 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:11.682 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:37:11.682 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.682 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.682 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.682 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:11.682 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628699+0000", 2024-09-12T18:37:11.682 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3859999999999999e-06 2024-09-12T18:37:11.682 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.682 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.682 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:11.682 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628706+0000", 2024-09-12T18:37:11.683 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0169999999999999e-06 2024-09-12T18:37:11.683 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.683 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.683 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:11.683 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628725+0000", 2024-09-12T18:37:11.683 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8683000000000001e-05 2024-09-12T18:37:11.683 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.683 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.683 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.683 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628740+0000", 2024-09-12T18:37:11.683 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5413999999999998e-05 2024-09-12T18:37:11.683 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.683 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.683 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:11.684 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628907+0000", 2024-09-12T18:37:11.684 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00016670199999999999 2024-09-12T18:37:11.684 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.684 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.684 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:37:11.684 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628917+0000", 2024-09-12T18:37:11.684 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.046e-05 2024-09-12T18:37:11.684 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.684 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.684 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:11.684 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.660390+0000", 2024-09-12T18:37:11.684 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.031472364000000003 2024-09-12T18:37:11.684 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.685 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.685 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:11.685 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.661767+0000", 2024-09-12T18:37:11.685 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0013769190000000001 2024-09-12T18:37:11.685 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.685 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.685 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:11.685 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.662408+0000", 2024-09-12T18:37:11.685 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00064091099999999998 2024-09-12T18:37:11.685 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.685 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.685 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:11.685 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669577+0000", 2024-09-12T18:37:11.685 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.007169412 2024-09-12T18:37:11.686 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.686 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.686 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:11.686 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674244+0000", 2024-09-12T18:37:11.686 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0046671839999999996 2024-09-12T18:37:11.686 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.686 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.686 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:11.686 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674329+0000", 2024-09-12T18:37:11.686 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5276000000000001e-05 2024-09-12T18:37:11.686 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.686 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.686 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:11.687 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674400+0000", 2024-09-12T18:37:11.687 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0408999999999996e-05 2024-09-12T18:37:11.687 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.687 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:11.687 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.687 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.687 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.687 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:11.687 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:37:11.687 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 106.047772819, 2024-09-12T18:37:11.687 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.046431252999999999, 2024-09-12T18:37:11.687 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:11.687 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:11.687 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:11.688 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:11.688 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.688 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:11.688 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:37:11.688 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.688 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.688 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.688 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:11.688 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:37:11.688 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.688 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.688 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.688 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:11.689 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629123+0000", 2024-09-12T18:37:11.689 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0899999999999999e-06 2024-09-12T18:37:11.689 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.689 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.689 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:11.689 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629138+0000", 2024-09-12T18:37:11.689 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4977000000000001e-05 2024-09-12T18:37:11.689 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.689 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.689 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:11.689 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629149+0000", 2024-09-12T18:37:11.689 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1182999999999999e-05 2024-09-12T18:37:11.689 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.690 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.690 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.690 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629157+0000", 2024-09-12T18:37:11.690 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8129999999999996e-06 2024-09-12T18:37:11.690 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.690 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.690 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:11.690 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629223+0000", 2024-09-12T18:37:11.690 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6463000000000004e-05 2024-09-12T18:37:11.690 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.690 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.690 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:37:11.690 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629230+0000", 2024-09-12T18:37:11.691 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1360000000000002e-06 2024-09-12T18:37:11.691 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.691 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.691 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:11.691 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669605+0000", 2024-09-12T18:37:11.691 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.040375518999999999 2024-09-12T18:37:11.691 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.691 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.691 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:11.691 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669840+0000", 2024-09-12T18:37:11.691 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00023520099999999999 2024-09-12T18:37:11.691 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.691 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.691 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:11.691 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.675553+0000", 2024-09-12T18:37:11.692 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0057128709999999996 2024-09-12T18:37:11.692 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.692 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:11.692 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.692 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.692 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.692 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167352 5.a 5:5fc472d2:::benchmark_data_smithi073_23739_object35075:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:11.692 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.163066+0000", 2024-09-12T18:37:11.692 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 8.5138291230000007, 2024-09-12T18:37:11.692 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.077708377999999995, 2024-09-12T18:37:11.692 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:11.692 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:11.693 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:11.693 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:11.693 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:11.693 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:11.693 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167352 2024-09-12T18:37:11.693 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.693 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:11.693 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.693 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:11.693 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163066+0000", 2024-09-12T18:37:11.693 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.693 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.693 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.693 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:11.693 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163066+0000", 2024-09-12T18:37:11.694 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.694 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.694 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.694 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:11.694 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163067+0000", 2024-09-12T18:37:11.694 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0499999999999999e-06 2024-09-12T18:37:11.694 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.694 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.694 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:11.694 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163071+0000", 2024-09-12T18:37:11.694 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4340000000000002e-06 2024-09-12T18:37:11.694 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.695 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.695 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:11.695 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163081+0000", 2024-09-12T18:37:11.695 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0304e-05 2024-09-12T18:37:11.695 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.695 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.695 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.695 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163090+0000", 2024-09-12T18:37:11.695 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7309999999999999e-06 2024-09-12T18:37:11.695 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.695 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.695 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:11.695 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163143+0000", 2024-09-12T18:37:11.695 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2942000000000002e-05 2024-09-12T18:37:11.696 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.696 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.696 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:11.696 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163270+0000", 2024-09-12T18:37:11.696 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012664100000000001 2024-09-12T18:37:11.696 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.696 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.696 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:11.696 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163378+0000", 2024-09-12T18:37:11.696 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000107995 2024-09-12T18:37:11.696 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.696 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.696 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:11.696 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234552+0000", 2024-09-12T18:37:11.697 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.071173831000000007 2024-09-12T18:37:11.697 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.697 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.697 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:11.697 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240640+0000", 2024-09-12T18:37:11.697 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.006088909 2024-09-12T18:37:11.697 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.697 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.697 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:11.697 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240709+0000", 2024-09-12T18:37:11.697 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8393999999999996e-05 2024-09-12T18:37:11.697 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.697 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.698 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:11.698 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240774+0000", 2024-09-12T18:37:11.698 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5147000000000005e-05 2024-09-12T18:37:11.698 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.698 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:11.698 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.698 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.698 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.698 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167358 5.a 5:533f6738:::benchmark_data_smithi073_23739_object35081:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:11.698 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.165639+0000", 2024-09-12T18:37:11.698 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 8.5112558459999992, 2024-09-12T18:37:11.698 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.075287509000000002, 2024-09-12T18:37:11.698 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:11.698 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:11.699 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:11.699 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:11.699 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:11.699 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:11.699 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167358 2024-09-12T18:37:11.699 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.699 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:11.699 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.699 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:11.699 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165639+0000", 2024-09-12T18:37:11.699 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.699 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.699 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.699 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:11.700 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165639+0000", 2024-09-12T18:37:11.700 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.700 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.700 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.700 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:11.700 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165640+0000", 2024-09-12T18:37:11.700 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1999999999999999e-06 2024-09-12T18:37:11.700 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.700 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.700 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:11.700 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165646+0000", 2024-09-12T18:37:11.700 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4550000000000003e-06 2024-09-12T18:37:11.700 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.701 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.701 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:11.701 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165658+0000", 2024-09-12T18:37:11.701 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2721999999999999e-05 2024-09-12T18:37:11.701 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.701 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.701 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.701 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165668+0000", 2024-09-12T18:37:11.701 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4229999999999994e-06 2024-09-12T18:37:11.701 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.701 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.701 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:11.701 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165711+0000", 2024-09-12T18:37:11.701 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3785999999999997e-05 2024-09-12T18:37:11.702 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.702 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.702 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:11.702 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165788+0000", 2024-09-12T18:37:11.702 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6506000000000002e-05 2024-09-12T18:37:11.702 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.702 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.702 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:11.702 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165862+0000", 2024-09-12T18:37:11.702 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4012999999999998e-05 2024-09-12T18:37:11.702 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.702 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.702 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:11.702 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234718+0000", 2024-09-12T18:37:11.703 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.068856420000000002 2024-09-12T18:37:11.703 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.703 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.703 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:11.703 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240785+0000", 2024-09-12T18:37:11.703 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0060661489999999998 2024-09-12T18:37:11.703 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.703 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.703 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:11.703 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240844+0000", 2024-09-12T18:37:11.703 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9487000000000002e-05 2024-09-12T18:37:11.703 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.703 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.703 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:11.704 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240926+0000", 2024-09-12T18:37:11.704 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2348000000000005e-05 2024-09-12T18:37:11.704 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.704 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:11.704 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.704 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.704 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.704 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167361 5.a 5:56730f28:::benchmark_data_smithi073_23739_object35084:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:11.704 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.165979+0000", 2024-09-12T18:37:11.704 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 8.5109158659999995, 2024-09-12T18:37:11.704 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.075128337000000003, 2024-09-12T18:37:11.704 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:11.704 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:11.704 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:11.705 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:11.705 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:11.705 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:11.705 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167361 2024-09-12T18:37:11.705 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.705 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:11.705 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.705 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:11.705 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165979+0000", 2024-09-12T18:37:11.705 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.705 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.705 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.705 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:11.705 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165979+0000", 2024-09-12T18:37:11.706 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.706 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.706 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.706 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:11.706 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165980+0000", 2024-09-12T18:37:11.706 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4499999999999997e-07 2024-09-12T18:37:11.706 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.706 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.706 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:11.706 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165985+0000", 2024-09-12T18:37:11.706 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.186e-06 2024-09-12T18:37:11.706 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.706 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.706 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:11.707 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165995+0000", 2024-09-12T18:37:11.707 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0378e-05 2024-09-12T18:37:11.707 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.707 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.707 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.707 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.166016+0000", 2024-09-12T18:37:11.707 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1316999999999999e-05 2024-09-12T18:37:11.707 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.707 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.707 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:11.707 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.167783+0000", 2024-09-12T18:37:11.707 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017662209999999999 2024-09-12T18:37:11.707 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.707 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.708 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:11.708 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.167851+0000", 2024-09-12T18:37:11.708 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7990000000000005e-05 2024-09-12T18:37:11.708 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.708 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.708 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:11.708 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.167929+0000", 2024-09-12T18:37:11.708 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8829e-05 2024-09-12T18:37:11.708 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.708 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.708 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:11.708 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234832+0000", 2024-09-12T18:37:11.708 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066902378999999998 2024-09-12T18:37:11.709 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.709 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.709 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:11.709 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240941+0000", 2024-09-12T18:37:11.709 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0061087470000000003 2024-09-12T18:37:11.709 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.709 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.709 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:11.709 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241053+0000", 2024-09-12T18:37:11.709 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00011197299999999999 2024-09-12T18:37:11.709 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.709 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.709 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:11.709 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241107+0000", 2024-09-12T18:37:11.710 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4672000000000001e-05 2024-09-12T18:37:11.710 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.710 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:11.710 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.710 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.710 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.710 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167362 5.3 5:cbd73b47:::benchmark_data_smithi073_23739_object35085:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:11.710 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:11.710 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 8.5088191510000009, 2024-09-12T18:37:11.710 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.067202411000000004, 2024-09-12T18:37:11.710 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:11.710 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:11.710 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:11.710 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:11.711 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:11.711 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:11.711 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167362 2024-09-12T18:37:11.711 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.711 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:11.711 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.711 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:11.711 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:11.711 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.711 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.711 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.711 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:11.711 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:11.711 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.712 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.712 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.712 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:11.712 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:11.712 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3600000000000003e-07 2024-09-12T18:37:11.712 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.712 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.712 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:11.712 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168079+0000", 2024-09-12T18:37:11.712 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7949999999999999e-06 2024-09-12T18:37:11.712 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.712 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.712 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:11.713 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168085+0000", 2024-09-12T18:37:11.713 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2110000000000003e-06 2024-09-12T18:37:11.713 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.713 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.713 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.713 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168089+0000", 2024-09-12T18:37:11.713 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0840000000000002e-06 2024-09-12T18:37:11.713 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.713 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.713 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:11.713 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168121+0000", 2024-09-12T18:37:11.713 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.1489000000000003e-05 2024-09-12T18:37:11.713 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.713 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.714 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:11.714 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168186+0000", 2024-09-12T18:37:11.714 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5313000000000003e-05 2024-09-12T18:37:11.714 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.714 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.714 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:11.714 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168242+0000", 2024-09-12T18:37:11.714 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5560999999999999e-05 2024-09-12T18:37:11.714 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.714 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.714 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:11.714 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234467+0000", 2024-09-12T18:37:11.714 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066225424000000005 2024-09-12T18:37:11.714 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.715 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.715 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:11.715 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235088+0000", 2024-09-12T18:37:11.715 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00062118999999999998 2024-09-12T18:37:11.715 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.715 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.715 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:11.715 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235197+0000", 2024-09-12T18:37:11.715 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00010825899999999999 2024-09-12T18:37:11.715 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.715 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.715 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:11.715 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235278+0000", 2024-09-12T18:37:11.715 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1448999999999999e-05 2024-09-12T18:37:11.716 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.716 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:11.716 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.716 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.716 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.716 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167366 5.a 5:58e6a467:::benchmark_data_smithi073_23739_object35089:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:11.716 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168263+0000", 2024-09-12T18:37:11.716 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 8.5086316140000005, 2024-09-12T18:37:11.716 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.078184744, 2024-09-12T18:37:11.716 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:11.716 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:11.716 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:11.716 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:11.717 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:11.717 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:11.717 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167366 2024-09-12T18:37:11.717 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.717 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:11.717 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.717 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:11.717 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168263+0000", 2024-09-12T18:37:11.717 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.717 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.717 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.717 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:11.717 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168263+0000", 2024-09-12T18:37:11.717 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.718 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.718 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.718 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:11.718 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168264+0000", 2024-09-12T18:37:11.718 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5700000000000002e-07 2024-09-12T18:37:11.718 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.718 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.718 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:11.718 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168266+0000", 2024-09-12T18:37:11.718 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1789999999999998e-06 2024-09-12T18:37:11.718 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.718 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.718 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:11.718 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168271+0000", 2024-09-12T18:37:11.719 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8160000000000001e-06 2024-09-12T18:37:11.719 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.719 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.719 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.719 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168275+0000", 2024-09-12T18:37:11.719 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4440000000000001e-06 2024-09-12T18:37:11.719 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.719 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.719 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:11.719 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170082+0000", 2024-09-12T18:37:11.719 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0018068800000000001 2024-09-12T18:37:11.719 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.719 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.719 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:11.720 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170154+0000", 2024-09-12T18:37:11.720 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1575000000000005e-05 2024-09-12T18:37:11.720 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.720 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.720 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:11.720 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170216+0000", 2024-09-12T18:37:11.720 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1989999999999994e-05 2024-09-12T18:37:11.720 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.720 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.720 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:11.720 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234933+0000", 2024-09-12T18:37:11.720 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064717514000000004 2024-09-12T18:37:11.720 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.721 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.721 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:11.721 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246226+0000", 2024-09-12T18:37:11.721 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011293151 2024-09-12T18:37:11.721 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.721 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.721 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:11.721 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246338+0000", 2024-09-12T18:37:11.721 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00011225 2024-09-12T18:37:11.721 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.721 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.721 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:11.721 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246448+0000", 2024-09-12T18:37:11.721 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000109388 2024-09-12T18:37:11.722 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.722 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:11.722 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.722 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.722 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.722 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167367 5.a 5:51778d97:::benchmark_data_smithi073_23739_object35090:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:11.722 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168388+0000", 2024-09-12T18:37:11.722 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 8.5085063699999992, 2024-09-12T18:37:11.722 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.082583860999999995, 2024-09-12T18:37:11.722 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:11.722 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:11.722 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:11.722 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:11.722 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:11.723 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:11.723 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167367 2024-09-12T18:37:11.723 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.723 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:11.723 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.723 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:11.723 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168388+0000", 2024-09-12T18:37:11.723 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.723 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.723 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.723 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:11.723 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168388+0000", 2024-09-12T18:37:11.723 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.723 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.724 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.724 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:11.724 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168389+0000", 2024-09-12T18:37:11.724 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1099999999999996e-07 2024-09-12T18:37:11.724 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.724 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.724 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:11.724 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168391+0000", 2024-09-12T18:37:11.724 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.39e-06 2024-09-12T18:37:11.724 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.724 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.724 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:11.724 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168396+0000", 2024-09-12T18:37:11.725 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3460000000000004e-06 2024-09-12T18:37:11.725 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.725 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.725 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.725 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168399+0000", 2024-09-12T18:37:11.725 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.613e-06 2024-09-12T18:37:11.725 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.725 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.725 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:11.725 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235003+0000", 2024-09-12T18:37:11.725 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066603851000000006 2024-09-12T18:37:11.725 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.725 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.725 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:11.726 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235266+0000", 2024-09-12T18:37:11.726 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00026270999999999998 2024-09-12T18:37:11.726 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.726 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.726 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:11.726 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235510+0000", 2024-09-12T18:37:11.726 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00024394 2024-09-12T18:37:11.726 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.726 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.726 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:11.726 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246546+0000", 2024-09-12T18:37:11.726 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011035774 2024-09-12T18:37:11.726 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.726 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.727 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:11.727 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.250808+0000", 2024-09-12T18:37:11.727 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0042622700000000003 2024-09-12T18:37:11.727 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.727 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.727 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:11.727 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.250890+0000", 2024-09-12T18:37:11.727 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1874999999999998e-05 2024-09-12T18:37:11.727 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.727 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.727 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:11.727 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.250972+0000", 2024-09-12T18:37:11.727 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2581000000000001e-05 2024-09-12T18:37:11.727 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.728 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:11.728 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.728 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.728 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.728 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167370 5.a 5:5aab9477:::benchmark_data_smithi073_23739_object35093:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:11.728 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168603+0000", 2024-09-12T18:37:11.728 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 8.5082914350000003, 2024-09-12T18:37:11.728 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.086603794999999997, 2024-09-12T18:37:11.728 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:11.728 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:11.728 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:11.728 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:11.728 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:11.729 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:11.729 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167370 2024-09-12T18:37:11.729 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.729 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:11.729 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.729 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:11.729 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168603+0000", 2024-09-12T18:37:11.729 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.729 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.729 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.729 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:11.729 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168603+0000", 2024-09-12T18:37:11.729 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.729 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.730 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.730 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:11.730 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168604+0000", 2024-09-12T18:37:11.730 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.1899999999999998e-07 2024-09-12T18:37:11.730 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.730 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.730 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:11.730 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168606+0000", 2024-09-12T18:37:11.730 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8309999999999999e-06 2024-09-12T18:37:11.730 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.730 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.730 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:11.730 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168610+0000", 2024-09-12T18:37:11.731 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8069999999999999e-06 2024-09-12T18:37:11.731 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.731 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.731 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.731 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168613+0000", 2024-09-12T18:37:11.731 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.118e-06 2024-09-12T18:37:11.731 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.731 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.731 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:11.731 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241145+0000", 2024-09-12T18:37:11.731 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.072531678000000002 2024-09-12T18:37:11.731 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.731 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.731 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:11.732 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241342+0000", 2024-09-12T18:37:11.732 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00019635900000000001 2024-09-12T18:37:11.732 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.732 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.732 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:11.732 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241483+0000", 2024-09-12T18:37:11.732 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014161100000000001 2024-09-12T18:37:11.732 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.732 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.732 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:11.732 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255039+0000", 2024-09-12T18:37:11.732 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013555724 2024-09-12T18:37:11.732 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.732 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.733 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:11.733 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255062+0000", 2024-09-12T18:37:11.733 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.3042000000000001e-05 2024-09-12T18:37:11.733 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.733 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.733 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:11.733 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255143+0000", 2024-09-12T18:37:11.733 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0999000000000002e-05 2024-09-12T18:37:11.733 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.733 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.733 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:11.733 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255207+0000", 2024-09-12T18:37:11.733 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4207000000000004e-05 2024-09-12T18:37:11.734 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.734 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:11.734 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.734 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.734 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.734 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167352 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:11.734 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:11.734 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 8.5081667809999999, 2024-09-12T18:37:11.734 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065859953999999998, 2024-09-12T18:37:11.734 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:11.734 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:11.734 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:11.734 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:11.734 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.735 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:11.735 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:11.735 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.735 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.735 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.735 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:11.735 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:11.735 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.735 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.735 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.735 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:11.735 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:11.735 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.0800000000000001e-07 2024-09-12T18:37:11.735 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.736 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.736 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:11.736 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168730+0000", 2024-09-12T18:37:11.736 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6530000000000001e-06 2024-09-12T18:37:11.736 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.736 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.736 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:11.736 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168734+0000", 2024-09-12T18:37:11.736 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.721e-06 2024-09-12T18:37:11.736 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.736 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.736 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.736 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168736+0000", 2024-09-12T18:37:11.737 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.508e-06 2024-09-12T18:37:11.737 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.737 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.737 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:11.737 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171951+0000", 2024-09-12T18:37:11.737 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.003215281 2024-09-12T18:37:11.737 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.737 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.737 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:11.737 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234520+0000", 2024-09-12T18:37:11.737 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062568676000000004 2024-09-12T18:37:11.737 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.737 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.737 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:11.738 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234588+0000", 2024-09-12T18:37:11.738 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7806999999999996e-05 2024-09-12T18:37:11.738 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.738 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:11.738 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.738 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.738 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.738 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167368 5.4 e58/21 5:29a1ec58:::benchmark_data_smithi073_23739_object35091:head v 58'10399, mlcod=58'10396)", 2024-09-12T18:37:11.738 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:11.738 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 8.508043764, 2024-09-12T18:37:11.738 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066008885000000003, 2024-09-12T18:37:11.738 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:11.738 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:11.738 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:11.739 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:11.739 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.739 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:11.739 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:11.739 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.739 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.739 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.739 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:11.739 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:11.739 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.739 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.739 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.739 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:11.739 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:11.740 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4699999999999998e-07 2024-09-12T18:37:11.740 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.740 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.740 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:11.740 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168854+0000", 2024-09-12T18:37:11.740 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.3180000000000001e-06 2024-09-12T18:37:11.740 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.740 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.740 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:11.740 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168858+0000", 2024-09-12T18:37:11.740 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2799999999999997e-06 2024-09-12T18:37:11.740 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.740 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.740 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.741 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168861+0000", 2024-09-12T18:37:11.741 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7650000000000002e-06 2024-09-12T18:37:11.741 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.741 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.741 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:11.741 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168895+0000", 2024-09-12T18:37:11.741 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4533999999999998e-05 2024-09-12T18:37:11.741 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.741 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.741 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:11.741 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168906+0000", 2024-09-12T18:37:11.741 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0910000000000001e-05 2024-09-12T18:37:11.741 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.741 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.742 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:11.742 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234784+0000", 2024-09-12T18:37:11.742 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065877656000000007 2024-09-12T18:37:11.742 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.742 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.742 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:11.742 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234860+0000", 2024-09-12T18:37:11.742 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6174999999999995e-05 2024-09-12T18:37:11.742 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.742 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:11.742 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.742 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.742 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.743 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167358 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:11.743 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.170373+0000", 2024-09-12T18:37:11.743 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 8.5065214830000002, 2024-09-12T18:37:11.743 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064370201000000002, 2024-09-12T18:37:11.743 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:11.743 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:11.743 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:11.743 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:11.743 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.743 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:11.743 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170373+0000", 2024-09-12T18:37:11.743 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.743 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.743 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.744 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:11.744 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170373+0000", 2024-09-12T18:37:11.744 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.744 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.744 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.744 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:11.744 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170374+0000", 2024-09-12T18:37:11.744 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5799999999999998e-07 2024-09-12T18:37:11.744 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.744 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.744 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:11.744 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170378+0000", 2024-09-12T18:37:11.744 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.732e-06 2024-09-12T18:37:11.745 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.745 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.745 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:11.745 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170388+0000", 2024-09-12T18:37:11.745 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0212e-05 2024-09-12T18:37:11.745 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.745 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.745 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.745 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170397+0000", 2024-09-12T18:37:11.745 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7090000000000008e-06 2024-09-12T18:37:11.745 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.745 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.745 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:11.746 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234682+0000", 2024-09-12T18:37:11.746 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064285518999999999 2024-09-12T18:37:11.746 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.746 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.746 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:11.746 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234703+0000", 2024-09-12T18:37:11.746 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.0199000000000001e-05 2024-09-12T18:37:11.746 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.746 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.746 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:11.746 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234743+0000", 2024-09-12T18:37:11.746 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0972e-05 2024-09-12T18:37:11.746 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.747 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:11.747 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.747 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.747 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.747 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167372 5.c 5:398d36a7:::benchmark_data_smithi073_23739_object35095:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:11.747 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171066+0000", 2024-09-12T18:37:11.747 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 8.5058282710000004, 2024-09-12T18:37:11.747 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065889534999999999, 2024-09-12T18:37:11.747 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:11.747 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:11.747 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:11.747 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:11.747 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:11.747 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:11.748 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167372 2024-09-12T18:37:11.748 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.748 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:11.748 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.748 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:11.748 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171066+0000", 2024-09-12T18:37:11.748 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.748 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.748 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.748 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:11.748 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171066+0000", 2024-09-12T18:37:11.748 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.748 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.748 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.749 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:11.749 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171068+0000", 2024-09-12T18:37:11.749 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.186e-06 2024-09-12T18:37:11.749 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.749 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.749 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:11.749 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171072+0000", 2024-09-12T18:37:11.749 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3560000000000003e-06 2024-09-12T18:37:11.749 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.749 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.749 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:11.749 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171082+0000", 2024-09-12T18:37:11.749 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.9739999999999997e-06 2024-09-12T18:37:11.749 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.750 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.750 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.750 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171089+0000", 2024-09-12T18:37:11.750 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7159999999999997e-06 2024-09-12T18:37:11.750 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.750 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.750 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:11.750 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171133+0000", 2024-09-12T18:37:11.750 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4091999999999997e-05 2024-09-12T18:37:11.750 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.750 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.750 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:11.750 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171221+0000", 2024-09-12T18:37:11.750 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.8108000000000004e-05 2024-09-12T18:37:11.751 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.751 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.751 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:11.751 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171279+0000", 2024-09-12T18:37:11.751 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8062000000000001e-05 2024-09-12T18:37:11.751 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.751 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.751 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:11.751 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235007+0000", 2024-09-12T18:37:11.751 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.063727849000000003 2024-09-12T18:37:11.751 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.751 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.751 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:11.752 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236790+0000", 2024-09-12T18:37:11.752 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017829269999999999 2024-09-12T18:37:11.752 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.752 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.752 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:11.752 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236881+0000", 2024-09-12T18:37:11.752 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1347999999999993e-05 2024-09-12T18:37:11.752 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.752 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.752 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:11.752 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236956+0000", 2024-09-12T18:37:11.752 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4917000000000001e-05 2024-09-12T18:37:11.752 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.752 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:11.753 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.753 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.753 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.753 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167371 5.4 e58/21 5:24fea27c:::benchmark_data_smithi073_23739_object35094:head v 58'10400, mlcod=58'10397)", 2024-09-12T18:37:11.753 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171273+0000", 2024-09-12T18:37:11.753 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 8.5056216970000005, 2024-09-12T18:37:11.753 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065500368000000003, 2024-09-12T18:37:11.753 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:11.753 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:11.753 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:11.753 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:11.753 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.753 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:11.753 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171273+0000", 2024-09-12T18:37:11.754 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.754 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.754 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.754 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:11.754 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171273+0000", 2024-09-12T18:37:11.754 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.754 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.754 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.754 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:11.754 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171274+0000", 2024-09-12T18:37:11.754 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0399999999999996e-07 2024-09-12T18:37:11.754 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.754 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.754 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:11.755 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171277+0000", 2024-09-12T18:37:11.755 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8689999999999997e-06 2024-09-12T18:37:11.755 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.755 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.755 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:11.755 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171284+0000", 2024-09-12T18:37:11.755 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2879999999999998e-06 2024-09-12T18:37:11.755 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.755 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.755 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.755 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171289+0000", 2024-09-12T18:37:11.755 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9049999999999996e-06 2024-09-12T18:37:11.755 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.755 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.756 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:11.756 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171322+0000", 2024-09-12T18:37:11.756 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3781000000000001e-05 2024-09-12T18:37:11.756 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.756 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.756 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:11.756 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171335+0000", 2024-09-12T18:37:11.756 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2639999999999999e-05 2024-09-12T18:37:11.756 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.756 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.756 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:11.756 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236691+0000", 2024-09-12T18:37:11.756 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065355835000000001 2024-09-12T18:37:11.757 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.757 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.757 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:11.757 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236773+0000", 2024-09-12T18:37:11.757 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2546000000000006e-05 2024-09-12T18:37:11.757 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.757 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:11.757 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.757 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.757 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.757 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167364 5.7 e58/21 5:ee50096a:::benchmark_data_smithi073_23739_object35087:head v 58'10504, mlcod=58'10502)", 2024-09-12T18:37:11.757 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171598+0000", 2024-09-12T18:37:11.757 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 8.5052965779999994, 2024-09-12T18:37:11.757 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065149069000000004, 2024-09-12T18:37:11.758 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:11.758 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:11.758 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:11.758 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:11.758 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.758 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:11.758 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171598+0000", 2024-09-12T18:37:11.758 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.758 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.758 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.758 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:11.758 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171598+0000", 2024-09-12T18:37:11.758 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.759 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.759 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.759 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:11.759 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171599+0000", 2024-09-12T18:37:11.759 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6700000000000003e-07 2024-09-12T18:37:11.759 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.759 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.759 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:11.759 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171602+0000", 2024-09-12T18:37:11.759 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.841e-06 2024-09-12T18:37:11.759 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.759 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.759 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:11.759 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171608+0000", 2024-09-12T18:37:11.760 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9259999999999997e-06 2024-09-12T18:37:11.760 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.760 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.760 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.760 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171611+0000", 2024-09-12T18:37:11.760 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.9450000000000003e-06 2024-09-12T18:37:11.760 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.760 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.760 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:11.760 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171650+0000", 2024-09-12T18:37:11.760 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8464000000000003e-05 2024-09-12T18:37:11.760 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.760 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.761 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:11.761 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171662+0000", 2024-09-12T18:37:11.761 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1603999999999999e-05 2024-09-12T18:37:11.761 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.761 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.761 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:11.761 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236663+0000", 2024-09-12T18:37:11.761 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065001330999999996 2024-09-12T18:37:11.761 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.761 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.761 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:11.761 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236747+0000", 2024-09-12T18:37:11.761 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.4390999999999999e-05 2024-09-12T18:37:11.761 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.762 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:11.762 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.762 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.762 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.762 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167365 5.2 e58/21 5:4107875c:::benchmark_data_smithi073_23739_object35088:head v 58'10351, mlcod=58'10349)", 2024-09-12T18:37:11.762 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171733+0000", 2024-09-12T18:37:11.762 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 8.5051615330000008, 2024-09-12T18:37:11.762 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.074804168000000004, 2024-09-12T18:37:11.762 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:11.762 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:11.762 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:11.762 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:11.762 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.762 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:11.763 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171733+0000", 2024-09-12T18:37:11.763 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.763 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.763 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.763 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:11.763 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171733+0000", 2024-09-12T18:37:11.763 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.763 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.763 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.763 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:11.763 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171734+0000", 2024-09-12T18:37:11.763 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9299999999999998e-07 2024-09-12T18:37:11.763 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.763 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.764 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:11.764 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171738+0000", 2024-09-12T18:37:11.764 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.301e-06 2024-09-12T18:37:11.764 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.764 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.764 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:11.764 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171746+0000", 2024-09-12T18:37:11.764 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.554e-06 2024-09-12T18:37:11.764 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.764 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.764 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.764 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171751+0000", 2024-09-12T18:37:11.764 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1880000000000001e-06 2024-09-12T18:37:11.764 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.765 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.765 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:11.765 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234659+0000", 2024-09-12T18:37:11.765 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062907807999999996 2024-09-12T18:37:11.765 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.765 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.765 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:11.765 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234708+0000", 2024-09-12T18:37:11.765 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8992000000000001e-05 2024-09-12T18:37:11.765 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.765 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.765 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:11.765 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246457+0000", 2024-09-12T18:37:11.765 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.01174974 2024-09-12T18:37:11.766 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.766 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.766 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:11.766 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246537+0000", 2024-09-12T18:37:11.766 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.9992000000000003e-05 2024-09-12T18:37:11.766 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.766 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:11.766 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.766 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.766 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.766 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167373 5.5 e58/49 5:ad283029:::benchmark_data_smithi073_23739_object35096:head v 58'10600, mlcod=58'10598)", 2024-09-12T18:37:11.766 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:11.766 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 8.5051340490000005, 2024-09-12T18:37:11.767 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065058240000000003, 2024-09-12T18:37:11.767 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:11.767 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:11.767 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:11.767 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:11.767 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.767 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:11.768 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:11.768 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.768 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.768 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.769 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:11.769 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:11.769 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.769 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.769 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.769 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:11.769 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:11.770 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.2899999999999999e-07 2024-09-12T18:37:11.770 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.770 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.770 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:11.770 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171764+0000", 2024-09-12T18:37:11.770 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7310000000000002e-06 2024-09-12T18:37:11.770 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.770 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.770 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:11.770 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171769+0000", 2024-09-12T18:37:11.770 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.079e-06 2024-09-12T18:37:11.770 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.770 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.770 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.771 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171774+0000", 2024-09-12T18:37:11.771 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.48e-06 2024-09-12T18:37:11.771 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.771 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.771 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:11.771 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171819+0000", 2024-09-12T18:37:11.771 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4391999999999998e-05 2024-09-12T18:37:11.771 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.771 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.771 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:11.771 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171841+0000", 2024-09-12T18:37:11.771 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2245000000000001e-05 2024-09-12T18:37:11.771 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.771 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.772 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:11.772 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236750+0000", 2024-09-12T18:37:11.772 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064909123999999999 2024-09-12T18:37:11.772 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.772 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.772 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:11.772 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236819+0000", 2024-09-12T18:37:11.772 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8860000000000001e-05 2024-09-12T18:37:11.772 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.772 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:11.772 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.772 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.772 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.773 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167361 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:11.773 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:11.773 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 8.5050781430000004, 2024-09-12T18:37:11.773 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.063049426000000006, 2024-09-12T18:37:11.773 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:11.773 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:11.773 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:11.773 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:11.773 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.773 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:11.773 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:11.773 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.773 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.773 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.774 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:11.774 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:11.774 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.774 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.774 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.774 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:11.774 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:11.774 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.9099999999999999e-07 2024-09-12T18:37:11.774 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.774 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.774 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:11.774 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171820+0000", 2024-09-12T18:37:11.774 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.5900000000000002e-06 2024-09-12T18:37:11.775 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.775 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.775 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:11.775 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171826+0000", 2024-09-12T18:37:11.775 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.64e-06 2024-09-12T18:37:11.775 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.775 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.775 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.775 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171831+0000", 2024-09-12T18:37:11.775 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.578e-06 2024-09-12T18:37:11.775 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.775 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.775 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:11.775 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234808+0000", 2024-09-12T18:37:11.776 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062976780999999996 2024-09-12T18:37:11.776 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.776 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.776 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:11.776 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234821+0000", 2024-09-12T18:37:11.776 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3002e-05 2024-09-12T18:37:11.776 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.776 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.776 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:11.776 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234866+0000", 2024-09-12T18:37:11.776 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5444000000000001e-05 2024-09-12T18:37:11.776 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.776 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:11.777 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.777 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.777 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.777 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167366 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:11.777 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.172133+0000", 2024-09-12T18:37:11.777 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 8.5047613149999997, 2024-09-12T18:37:11.777 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062815840999999997, 2024-09-12T18:37:11.777 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:11.777 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:11.777 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:11.777 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:11.777 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.777 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:11.778 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172133+0000", 2024-09-12T18:37:11.778 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.778 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.778 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.778 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:11.778 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172133+0000", 2024-09-12T18:37:11.778 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.778 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.778 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.778 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:11.778 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172134+0000", 2024-09-12T18:37:11.778 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5000000000000003e-07 2024-09-12T18:37:11.778 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.778 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.779 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:11.779 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172137+0000", 2024-09-12T18:37:11.779 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.6460000000000002e-06 2024-09-12T18:37:11.779 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.779 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.779 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:11.779 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234511+0000", 2024-09-12T18:37:11.779 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062374603000000001 2024-09-12T18:37:11.779 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.779 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.779 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.779 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234525+0000", 2024-09-12T18:37:11.779 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3396e-05 2024-09-12T18:37:11.779 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.780 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.780 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:11.780 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234909+0000", 2024-09-12T18:37:11.780 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00038405299999999998 2024-09-12T18:37:11.780 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.780 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.780 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:11.780 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234922+0000", 2024-09-12T18:37:11.780 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3274e-05 2024-09-12T18:37:11.780 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.780 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.780 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:11.780 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234949+0000", 2024-09-12T18:37:11.781 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7319000000000001e-05 2024-09-12T18:37:11.781 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.781 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:11.781 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.781 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.781 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.781 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167369 5.7 e58/21 5:e64ecabd:::benchmark_data_smithi073_23739_object35092:head v 58'10505, mlcod=58'10502)", 2024-09-12T18:37:11.781 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:11.781 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 8.5032309230000003, 2024-09-12T18:37:11.781 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.063873773999999994, 2024-09-12T18:37:11.781 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:11.781 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:11.781 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:11.781 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:11.782 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.782 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:11.782 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:11.782 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.782 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.782 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.782 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:11.782 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:11.782 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:11.782 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.782 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.782 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:11.782 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:11.782 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3500000000000002e-07 2024-09-12T18:37:11.783 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.783 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.783 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:11.783 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173668+0000", 2024-09-12T18:37:11.783 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4000000000000001e-06 2024-09-12T18:37:11.783 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.783 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.783 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:11.783 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234583+0000", 2024-09-12T18:37:11.783 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.060914889 2024-09-12T18:37:11.783 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.783 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.783 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.783 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234600+0000", 2024-09-12T18:37:11.784 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7192000000000001e-05 2024-09-12T18:37:11.784 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.784 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.784 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:11.784 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234791+0000", 2024-09-12T18:37:11.784 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00019115000000000001 2024-09-12T18:37:11.784 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.784 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.784 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:11.784 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234834+0000", 2024-09-12T18:37:11.784 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3296e-05 2024-09-12T18:37:11.784 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.784 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.784 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:11.785 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.237481+0000", 2024-09-12T18:37:11.785 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0026472050000000001 2024-09-12T18:37:11.785 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:11.785 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:11.785 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:11.785 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.237538+0000", 2024-09-12T18:37:11.785 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6206999999999999e-05 2024-09-12T18:37:11.785 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.785 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:11.785 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.785 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:11.785 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:11.785 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:11.786 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T18:37:11.787 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:11.782+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:11.788 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:37:11.888 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:11.881+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:11.948 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:11.948 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:37:11.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.948 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:185641 5.4 5:2279e5b5:::benchmark_data_smithi073_23739_object53364:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T18:37:11.948 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:11.938185+0000", 2024-09-12T18:37:11.948 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0074764920000000004, 2024-09-12T18:37:11.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0074950930000000004, 2024-09-12T18:37:11.949 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:11.949 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:11.949 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:11.949 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:11.949 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:11.949 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:11.949 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 185641 2024-09-12T18:37:11.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.949 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:11.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:11.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.938185+0000", 2024-09-12T18:37:11.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:11.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.950 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:11.950 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.938185+0000", 2024-09-12T18:37:11.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:11.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.950 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:11.950 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.938186+0000", 2024-09-12T18:37:11.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.017e-06 2024-09-12T18:37:11.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.951 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:11.951 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.938192+0000", 2024-09-12T18:37:11.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0140000000000004e-06 2024-09-12T18:37:11.951 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.951 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:11.951 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.938202+0000", 2024-09-12T18:37:11.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0045e-05 2024-09-12T18:37:11.951 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.951 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.951 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.938208+0000", 2024-09-12T18:37:11.952 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.9440000000000002e-06 2024-09-12T18:37:11.952 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.952 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.952 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:11.952 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.938724+0000", 2024-09-12T18:37:11.952 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00051631599999999995 2024-09-12T18:37:11.952 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.952 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.952 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:11.952 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.938810+0000", 2024-09-12T18:37:11.952 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6069000000000006e-05 2024-09-12T18:37:11.952 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.953 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.953 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:11.953 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.938886+0000", 2024-09-12T18:37:11.953 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6056999999999994e-05 2024-09-12T18:37:11.953 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.953 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.953 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:11.953 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.942796+0000", 2024-09-12T18:37:11.953 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003909259 2024-09-12T18:37:11.953 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:11.953 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:11.953 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:11.953 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.954 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.954 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:185645 5.d 5:b9294873:::benchmark_data_smithi073_23739_object53368:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T18:37:11.954 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:11.939321+0000", 2024-09-12T18:37:11.954 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0063405199999999997, 2024-09-12T18:37:11.954 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0064041699999999998, 2024-09-12T18:37:11.954 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:11.954 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:11.954 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:11.954 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:11.954 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:11.954 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:11.954 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 185645 2024-09-12T18:37:11.954 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.954 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:11.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:11.955 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.939321+0000", 2024-09-12T18:37:11.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:11.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:11.955 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.939321+0000", 2024-09-12T18:37:11.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:11.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:11.955 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.939322+0000", 2024-09-12T18:37:11.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.124e-06 2024-09-12T18:37:11.956 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.956 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.956 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:11.956 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.939326+0000", 2024-09-12T18:37:11.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9310000000000001e-06 2024-09-12T18:37:11.956 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.956 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.956 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:11.956 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.939337+0000", 2024-09-12T18:37:11.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0864e-05 2024-09-12T18:37:11.956 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.956 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.957 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.957 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.939344+0000", 2024-09-12T18:37:11.957 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4499999999999998e-06 2024-09-12T18:37:11.957 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.957 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.957 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:11.957 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.939955+0000", 2024-09-12T18:37:11.957 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00061090600000000004 2024-09-12T18:37:11.957 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.957 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.957 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:11.957 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.940091+0000", 2024-09-12T18:37:11.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000136196 2024-09-12T18:37:11.958 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.958 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.958 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:11.958 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.940205+0000", 2024-09-12T18:37:11.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011415499999999999 2024-09-12T18:37:11.958 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.958 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.958 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:11.958 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.943336+0000", 2024-09-12T18:37:11.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031304599999999998 2024-09-12T18:37:11.958 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:11.958 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:11.958 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:11.959 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.959 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:185648 5.4 5:216dc379:::benchmark_data_smithi073_23739_object53371:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T18:37:11.959 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:11.941125+0000", 2024-09-12T18:37:11.959 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0045359959999999996, 2024-09-12T18:37:11.959 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0046376580000000002, 2024-09-12T18:37:11.959 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:11.959 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:11.959 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:11.959 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:11.959 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:11.959 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:11.959 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 185648 2024-09-12T18:37:11.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.960 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:11.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.960 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:11.960 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.941125+0000", 2024-09-12T18:37:11.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:11.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.960 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:11.960 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.941125+0000", 2024-09-12T18:37:11.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:11.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:11.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.941126+0000", 2024-09-12T18:37:11.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.1399999999999995e-07 2024-09-12T18:37:11.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:11.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.941129+0000", 2024-09-12T18:37:11.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2339999999999999e-06 2024-09-12T18:37:11.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:11.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.941136+0000", 2024-09-12T18:37:11.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.3810000000000004e-06 2024-09-12T18:37:11.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.941140+0000", 2024-09-12T18:37:11.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3950000000000003e-06 2024-09-12T18:37:11.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:11.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.941193+0000", 2024-09-12T18:37:11.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2482000000000003e-05 2024-09-12T18:37:11.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:11.963 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.941315+0000", 2024-09-12T18:37:11.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000122321 2024-09-12T18:37:11.963 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.963 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.963 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:11.963 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.941425+0000", 2024-09-12T18:37:11.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000109585 2024-09-12T18:37:11.963 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.963 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.963 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:11.963 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.944229+0000", 2024-09-12T18:37:11.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0028043 2024-09-12T18:37:11.963 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:11.963 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:11.963 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:11.964 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.964 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.964 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:185649 5.0 5:05285669:::benchmark_data_smithi073_23739_object53372:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T18:37:11.964 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:11.941154+0000", 2024-09-12T18:37:11.964 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.004507395, 2024-09-12T18:37:11.964 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0046468359999999997, 2024-09-12T18:37:11.964 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:11.964 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:11.964 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:11.964 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:11.964 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:11.964 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:11.964 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 185649 2024-09-12T18:37:11.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.965 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:11.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:11.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.941154+0000", 2024-09-12T18:37:11.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:11.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:11.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.941154+0000", 2024-09-12T18:37:11.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:11.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:11.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.941154+0000", 2024-09-12T18:37:11.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2000000000000001e-07 2024-09-12T18:37:11.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:11.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.941156+0000", 2024-09-12T18:37:11.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.517e-06 2024-09-12T18:37:11.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:11.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.941161+0000", 2024-09-12T18:37:11.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2449999999999998e-06 2024-09-12T18:37:11.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.941164+0000", 2024-09-12T18:37:11.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9859999999999999e-06 2024-09-12T18:37:11.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:11.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.943118+0000", 2024-09-12T18:37:11.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0019541670000000001 2024-09-12T18:37:11.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:11.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.943269+0000", 2024-09-12T18:37:11.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015130699999999999 2024-09-12T18:37:11.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.968 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0,2", 2024-09-12T18:37:11.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.943414+0000", 2024-09-12T18:37:11.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014426700000000001 2024-09-12T18:37:11.968 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:11.968 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:11.968 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:11.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.969 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:185651 5.b 5:d63ab4dc:::benchmark_data_smithi073_23739_object53374:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T18:37:11.969 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:11.941176+0000", 2024-09-12T18:37:11.969 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.004485213, 2024-09-12T18:37:11.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0046570880000000002, 2024-09-12T18:37:11.969 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:11.969 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:11.969 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:11.969 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:11.969 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:11.969 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:11.969 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 185651 2024-09-12T18:37:11.969 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.969 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:11.970 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.970 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:11.970 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.941176+0000", 2024-09-12T18:37:11.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:11.970 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.970 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.970 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:11.970 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.941176+0000", 2024-09-12T18:37:11.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:11.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:11.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.941177+0000", 2024-09-12T18:37:11.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0900000000000002e-07 2024-09-12T18:37:11.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:11.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.941178+0000", 2024-09-12T18:37:11.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6020000000000001e-06 2024-09-12T18:37:11.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:11.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.941182+0000", 2024-09-12T18:37:11.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2069999999999997e-06 2024-09-12T18:37:11.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.941185+0000", 2024-09-12T18:37:11.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0910000000000001e-06 2024-09-12T18:37:11.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.972 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:11.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.941239+0000", 2024-09-12T18:37:11.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3131999999999999e-05 2024-09-12T18:37:11.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:11.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.941349+0000", 2024-09-12T18:37:11.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011083500000000001 2024-09-12T18:37:11.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:11.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.941451+0000", 2024-09-12T18:37:11.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010128600000000001 2024-09-12T18:37:11.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:11.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.945443+0000", 2024-09-12T18:37:11.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0039928089999999999 2024-09-12T18:37:11.974 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:11.974 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:11.974 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:11.974 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.974 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:185653 5.5 e61/49 5:a86dce51:::benchmark_data_smithi073_23739_object53376:head v 61'11757, mlcod=61'11755)", 2024-09-12T18:37:11.974 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:11.943710+0000", 2024-09-12T18:37:11.974 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.001951272, 2024-09-12T18:37:11.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0021583230000000002, 2024-09-12T18:37:11.974 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:11.974 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:11.974 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:37:11.975 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:11.975 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.975 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:11.975 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.943710+0000", 2024-09-12T18:37:11.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:11.975 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.975 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.975 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:11.975 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.943710+0000", 2024-09-12T18:37:11.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:11.975 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.976 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:11.976 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.943711+0000", 2024-09-12T18:37:11.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9299999999999997e-07 2024-09-12T18:37:11.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.976 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:11.976 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.943720+0000", 2024-09-12T18:37:11.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.3570000000000004e-06 2024-09-12T18:37:11.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.976 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:11.976 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.943729+0000", 2024-09-12T18:37:11.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8370000000000003e-06 2024-09-12T18:37:11.977 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.977 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.943734+0000", 2024-09-12T18:37:11.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6140000000000002e-06 2024-09-12T18:37:11.977 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:11.977 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.943776+0000", 2024-09-12T18:37:11.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2917999999999998e-05 2024-09-12T18:37:11.977 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:11.978 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.943802+0000", 2024-09-12T18:37:11.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5113000000000002e-05 2024-09-12T18:37:11.978 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:11.978 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:11.978 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:11.978 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.978 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:185656 5.b 5:d7b12db2:::benchmark_data_smithi073_23739_object53379:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T18:37:11.978 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:11.943762+0000", 2024-09-12T18:37:11.978 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0018990739999999999, 2024-09-12T18:37:11.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0021349350000000001, 2024-09-12T18:37:11.978 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:11.978 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:11.979 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:11.979 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:11.979 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:11.979 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:11.979 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 185656 2024-09-12T18:37:11.979 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.979 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:11.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.979 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:11.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.943762+0000", 2024-09-12T18:37:11.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:11.979 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.980 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:11.980 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.943762+0000", 2024-09-12T18:37:11.980 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:11.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.980 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:11.980 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.943763+0000", 2024-09-12T18:37:11.980 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1299999999999999e-07 2024-09-12T18:37:11.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.980 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:11.980 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.943766+0000", 2024-09-12T18:37:11.980 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.151e-06 2024-09-12T18:37:11.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.981 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.981 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:11.981 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.943772+0000", 2024-09-12T18:37:11.981 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.9739999999999999e-06 2024-09-12T18:37:11.981 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.981 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.981 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.981 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.943776+0000", 2024-09-12T18:37:11.981 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7450000000000001e-06 2024-09-12T18:37:11.981 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.981 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.981 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:11.982 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.943822+0000", 2024-09-12T18:37:11.982 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5797000000000002e-05 2024-09-12T18:37:11.982 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.982 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.982 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:11.982 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.943937+0000", 2024-09-12T18:37:11.982 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011564499999999999 2024-09-12T18:37:11.982 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.982 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.982 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:11.982 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.944046+0000", 2024-09-12T18:37:11.982 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000108232 2024-09-12T18:37:11.982 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:11.983 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:11.983 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:11.983 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.983 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.983 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:185658 5.0 5.9ba8e620 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T18:37:11.983 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:11.944825+0000", 2024-09-12T18:37:11.983 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00083624800000000005, 2024-09-12T18:37:11.983 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001103286, 2024-09-12T18:37:11.983 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:11.983 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:11.983 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:11.983 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:11.983 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:11.984 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:11.984 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 185658 2024-09-12T18:37:11.984 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.984 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:11.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.984 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:11.984 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.944825+0000", 2024-09-12T18:37:11.984 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:11.984 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.984 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:11.984 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.944825+0000", 2024-09-12T18:37:11.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:11.985 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.985 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.985 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:11.985 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.944826+0000", 2024-09-12T18:37:11.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9599999999999998e-07 2024-09-12T18:37:11.985 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.985 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.985 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:11.985 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.944831+0000", 2024-09-12T18:37:11.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6619999999999996e-06 2024-09-12T18:37:11.985 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.985 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.985 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:11.986 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.944842+0000", 2024-09-12T18:37:11.986 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.116e-05 2024-09-12T18:37:11.986 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.986 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.986 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.986 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.944850+0000", 2024-09-12T18:37:11.986 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2940000000000006e-06 2024-09-12T18:37:11.986 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:11.986 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:11.986 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:11.986 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.986 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.986 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:185654 5.5 e61/49 5:aef5aa04:::benchmark_data_smithi073_23739_object53377:head v 61'11758, mlcod=61'11755)", 2024-09-12T18:37:11.987 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:11.945629+0000", 2024-09-12T18:37:11.987 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 3.2410999999999999e-05, 2024-09-12T18:37:11.987 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00032409700000000002, 2024-09-12T18:37:11.987 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:11.987 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:11.987 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:37:11.987 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:11.987 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.987 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:11.987 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.945629+0000", 2024-09-12T18:37:11.987 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:11.987 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.987 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.987 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:11.988 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.945629+0000", 2024-09-12T18:37:11.988 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:11.988 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.988 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.988 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:11.988 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.945630+0000", 2024-09-12T18:37:11.988 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1200000000000002e-07 2024-09-12T18:37:11.988 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.988 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.988 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:11.988 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.945635+0000", 2024-09-12T18:37:11.988 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1970000000000004e-06 2024-09-12T18:37:11.988 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.989 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.989 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:11.989 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.945646+0000", 2024-09-12T18:37:11.989 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1236999999999999e-05 2024-09-12T18:37:11.989 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.989 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.989 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:11.989 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.945653+0000", 2024-09-12T18:37:11.989 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7329999999999997e-06 2024-09-12T18:37:11.989 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.989 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.989 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:11.989 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.945699+0000", 2024-09-12T18:37:11.989 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5787000000000001e-05 2024-09-12T18:37:11.990 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:11.990 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:11.990 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:11.990 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:11.945713+0000", 2024-09-12T18:37:11.990 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4266e-05 2024-09-12T18:37:11.990 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:11.990 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:11.990 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:11.990 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:11.990 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-09-12T18:37:11.990 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 9 2024-09-12T18:37:11.990 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:11.992 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:37:11.992 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:11.986+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:12.070 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:37:12.092 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:12.086+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:12.176 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is unset 2024-09-12T18:37:12.194 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:12.186+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:12.194 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:12.194 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-09-12T18:37:12.194 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-09-12T18:37:12.194 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-09-12T18:37:12.194 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:12.216 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:37:12.222 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:37:12.222 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:37:12.240 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:37:12.241 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:37:12.257 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:37:12.260 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:37:12.294 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:12.288+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:12.373 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:12.373 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:12.393 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:37:12.435 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:12.428+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:12.495 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:12.488+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:12.548 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:12.548 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:12.552 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:37:12.552 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:37:12.552 INFO:tasks.thrashosds.thrasher:Setting full ratio to .001 2024-09-12T18:37:12.553 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set-full-ratio .001 2024-09-12T18:37:12.568 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:37:12.596 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:12.590+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:12.697 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:12.690+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:12.715 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:12.716 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:12.739 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:37:12.799 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:12.792+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:12.896 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:12.896 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:12.900 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:12.894+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:12.915 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:37:13.000 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:12.992+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:13.061 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:13.061 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:13.079 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:37:13.101 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:13.094+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:13.177 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-12T18:37:13.173+0000 7f095e1b3640 -1 log_channel(cluster) log [ERR] : Health check failed: full ratio(s) out of order (OSD_OUT_OF_ORDER_FULL) 2024-09-12T18:37:13.186 INFO:teuthology.orchestra.run.smithi073.stderr:osd set-full-ratio 0.001 2024-09-12T18:37:13.201 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:13.196+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:13.226 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:13.226 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:13.245 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:37:13.303 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:13.296+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:13.398 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:13.398 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:13.404 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:13.396+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:13.416 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:37:13.505 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:13.498+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:13.572 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:13.572 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:13.594 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:37:13.606 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:13.598+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:13.707 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:13.700+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:13.749 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:13.749 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:13.771 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:37:13.814 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:13.808+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:13.909 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:13.902+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:13.964 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:13.965 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:13.985 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:37:14.010 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:14.004+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:14.111 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:14.104+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:14.132 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:14.132 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:14.150 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:37:14.197 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T18:37:14.211 INFO:tasks.thrashosds.thrasher:Setting full ratio back to .95 2024-09-12T18:37:14.211 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set-full-ratio .95 2024-09-12T18:37:14.212 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:14.204+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:14.273 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:37:14.295 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:14.296 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:14.314 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:14.308+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:14.317 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:37:14.416 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:14.406+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:14.447 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:37:14.448 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:37:14.462 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:14.462 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:14.473 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:37:14.473 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:37:14.481 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:37:14.506 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:37:14.506 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:37:14.515 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:14.508+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:14.616 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:14.610+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:14.628 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:14.628 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:37:14.628 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.628 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:191335 5.8 e63/21 5:12739689:::benchmark_data_smithi073_23739_object59058:head v 63'11650, mlcod=63'11648)", 2024-09-12T18:37:14.628 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:14.625030+0000", 2024-09-12T18:37:14.628 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00084027699999999995, 2024-09-12T18:37:14.628 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00086003900000000005, 2024-09-12T18:37:14.628 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:14.628 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:14.629 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:14.629 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:14.629 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.629 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:14.629 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:14.625030+0000", 2024-09-12T18:37:14.629 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:14.629 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.629 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.629 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:14.629 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:14.625030+0000", 2024-09-12T18:37:14.629 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:14.629 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.629 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.629 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:14.630 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:14.625031+0000", 2024-09-12T18:37:14.630 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5499999999999998e-07 2024-09-12T18:37:14.630 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.630 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.630 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:14.630 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:14.625036+0000", 2024-09-12T18:37:14.630 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1540000000000001e-06 2024-09-12T18:37:14.630 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.630 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.630 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:14.630 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:14.625052+0000", 2024-09-12T18:37:14.630 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6449000000000001e-05 2024-09-12T18:37:14.630 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.630 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.630 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:14.631 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:14.625059+0000", 2024-09-12T18:37:14.631 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.392e-06 2024-09-12T18:37:14.631 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.631 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.631 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:14.631 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:14.625097+0000", 2024-09-12T18:37:14.631 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8593000000000001e-05 2024-09-12T18:37:14.631 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.631 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.631 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:14.631 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:14.625109+0000", 2024-09-12T18:37:14.631 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1168999999999999e-05 2024-09-12T18:37:14.631 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:14.631 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:14.631 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:14.632 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.632 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.632 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:191336 5.2 e63/21 5:4e9ac92f:::benchmark_data_smithi073_23739_object59059:head v 63'11875, mlcod=63'11873)", 2024-09-12T18:37:14.632 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:14.625206+0000", 2024-09-12T18:37:14.632 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00066457899999999999, 2024-09-12T18:37:14.632 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00073820099999999996, 2024-09-12T18:37:14.632 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:14.632 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:14.632 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:14.632 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:14.632 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.632 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:14.633 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:14.625206+0000", 2024-09-12T18:37:14.633 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:14.633 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.633 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.633 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:14.633 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:14.625206+0000", 2024-09-12T18:37:14.633 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:14.633 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.633 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.633 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:14.633 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:14.625207+0000", 2024-09-12T18:37:14.633 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.3600000000000002e-07 2024-09-12T18:37:14.633 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.634 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.634 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:14.634 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:14.625212+0000", 2024-09-12T18:37:14.634 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2299999999999999e-06 2024-09-12T18:37:14.634 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.634 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.634 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:14.634 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:14.625220+0000", 2024-09-12T18:37:14.634 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.9289999999999998e-06 2024-09-12T18:37:14.634 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.634 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.634 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:14.634 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:14.625226+0000", 2024-09-12T18:37:14.635 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1789999999999996e-06 2024-09-12T18:37:14.635 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.635 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.635 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:14.635 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:14.625381+0000", 2024-09-12T18:37:14.635 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015442 2024-09-12T18:37:14.635 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.635 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.635 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:14.635 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:14.625397+0000", 2024-09-12T18:37:14.635 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6489000000000001e-05 2024-09-12T18:37:14.635 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:14.635 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:14.635 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:14.636 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.636 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.636 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:191337 5.0 e63/49 5:0804de9f:::benchmark_data_smithi073_23739_object59060:head v 63'12013, mlcod=63'12010)", 2024-09-12T18:37:14.636 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:14.625278+0000", 2024-09-12T18:37:14.636 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00059298399999999996, 2024-09-12T18:37:14.636 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00071482800000000003, 2024-09-12T18:37:14.636 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:14.636 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:14.636 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:14.636 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:14.636 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.637 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:14.637 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:14.625278+0000", 2024-09-12T18:37:14.637 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:14.637 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.637 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.637 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:14.637 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:14.625278+0000", 2024-09-12T18:37:14.637 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:14.637 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.637 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.637 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:14.637 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:14.625278+0000", 2024-09-12T18:37:14.637 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7599999999999997e-07 2024-09-12T18:37:14.638 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.638 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.638 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:14.638 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:14.625282+0000", 2024-09-12T18:37:14.638 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0149999999999997e-06 2024-09-12T18:37:14.638 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.638 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.638 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:14.638 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:14.625292+0000", 2024-09-12T18:37:14.638 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.6730000000000004e-06 2024-09-12T18:37:14.638 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.638 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.638 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:14.638 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:14.625298+0000", 2024-09-12T18:37:14.638 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7960000000000001e-06 2024-09-12T18:37:14.639 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.639 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.639 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:14.639 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:14.625368+0000", 2024-09-12T18:37:14.639 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.9924000000000003e-05 2024-09-12T18:37:14.639 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.639 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.639 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:14.639 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:14.625390+0000", 2024-09-12T18:37:14.639 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2336000000000001e-05 2024-09-12T18:37:14.639 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:14.639 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:14.639 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:14.640 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.640 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.640 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:191323 5.3 5:cb1f4254:::benchmark_data_smithi073_23739_object59046:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T18:37:14.640 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:14.619315+0000", 2024-09-12T18:37:14.640 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0065553579999999998, 2024-09-12T18:37:14.640 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0067364260000000002, 2024-09-12T18:37:14.640 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:14.640 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:14.640 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:14.640 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:14.640 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:14.640 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:14.640 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 191323 2024-09-12T18:37:14.641 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.641 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:14.641 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.641 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:14.641 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:14.619315+0000", 2024-09-12T18:37:14.641 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:14.641 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.641 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.641 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:14.641 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:14.619315+0000", 2024-09-12T18:37:14.641 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:14.641 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.641 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.641 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:14.642 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:14.619316+0000", 2024-09-12T18:37:14.642 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.6299999999999993e-07 2024-09-12T18:37:14.642 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.642 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.642 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:14.642 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:14.619320+0000", 2024-09-12T18:37:14.642 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4659999999999999e-06 2024-09-12T18:37:14.642 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.642 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.642 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:14.642 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:14.619328+0000", 2024-09-12T18:37:14.642 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.3049999999999993e-06 2024-09-12T18:37:14.642 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.643 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.643 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:14.643 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:14.619332+0000", 2024-09-12T18:37:14.643 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4240000000000003e-06 2024-09-12T18:37:14.643 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.643 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.643 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:14.643 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:14.619369+0000", 2024-09-12T18:37:14.643 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.6285000000000002e-05 2024-09-12T18:37:14.643 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.643 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.643 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:14.643 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:14.619453+0000", 2024-09-12T18:37:14.644 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.4228999999999996e-05 2024-09-12T18:37:14.644 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.644 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.644 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:14.644 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:14.619517+0000", 2024-09-12T18:37:14.644 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4622999999999994e-05 2024-09-12T18:37:14.644 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.644 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.644 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:14.644 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:14.623300+0000", 2024-09-12T18:37:14.644 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.003782344 2024-09-12T18:37:14.644 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:14.644 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:14.645 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:14.645 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.645 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.645 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:191330 5.6 5:691eb474:::benchmark_data_smithi073_23739_object59053:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T18:37:14.645 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:14.623218+0000", 2024-09-12T18:37:14.645 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0026527310000000002, 2024-09-12T18:37:14.645 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0029022060000000001, 2024-09-12T18:37:14.645 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:14.645 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:14.645 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:14.645 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:14.645 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:14.645 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:14.646 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 191330 2024-09-12T18:37:14.646 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.646 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:14.646 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.646 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:14.646 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:14.623218+0000", 2024-09-12T18:37:14.646 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:14.646 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.646 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.646 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:14.646 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:14.623218+0000", 2024-09-12T18:37:14.646 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:14.647 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.647 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.647 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:14.647 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:14.623219+0000", 2024-09-12T18:37:14.647 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.3799999999999996e-07 2024-09-12T18:37:14.647 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.647 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.647 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:14.647 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:14.623222+0000", 2024-09-12T18:37:14.647 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.0489999999999999e-06 2024-09-12T18:37:14.647 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.647 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.647 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:14.647 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:14.623231+0000", 2024-09-12T18:37:14.648 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.8999999999999995e-06 2024-09-12T18:37:14.648 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.648 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.648 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:14.648 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:14.623239+0000", 2024-09-12T18:37:14.648 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0180000000000001e-06 2024-09-12T18:37:14.648 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.648 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.648 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:14.648 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:14.623286+0000", 2024-09-12T18:37:14.648 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.7163999999999998e-05 2024-09-12T18:37:14.648 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.648 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.649 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:14.649 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:14.623370+0000", 2024-09-12T18:37:14.649 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.4048000000000006e-05 2024-09-12T18:37:14.649 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:14.649 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:14.649 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:14.649 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:14.623443+0000", 2024-09-12T18:37:14.649 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3052999999999993e-05 2024-09-12T18:37:14.649 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:14.649 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:14.649 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:14.649 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:14.649 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-12T18:37:14.649 INFO:teuthology.orchestra.run.smithi114.stdout: "num_ops": 5 2024-09-12T18:37:14.650 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:14.651 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:37:14.716 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:14.708+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:14.817 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:14.808+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:14.838 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:14.838 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2024-09-12T18:37:14.839 INFO:teuthology.orchestra.run.smithi114.stdout: "complaint_time": 30, 2024-09-12T18:37:14.839 INFO:teuthology.orchestra.run.smithi114.stdout: "num_blocked_ops": 0 2024-09-12T18:37:14.839 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:14.858 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:37:14.919 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:14.910+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:15.014 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:15.014 INFO:teuthology.orchestra.run.smithi114.stdout: "size": 20, 2024-09-12T18:37:15.014 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 600, 2024-09-12T18:37:15.015 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:37:15.015 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.015 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:26 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:15.015 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:37:15.015 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 109.38163602500001, 2024-09-12T18:37:15.015 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045702136999999997, 2024-09-12T18:37:15.015 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:15.015 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:15.015 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:15.015 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:15.016 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.016 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:15.016 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:37:15.016 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:15.016 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.016 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.016 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:15.016 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:37:15.016 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:15.016 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.017 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.017 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:15.017 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628699+0000", 2024-09-12T18:37:15.017 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3859999999999999e-06 2024-09-12T18:37:15.017 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.017 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.017 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:15.017 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628706+0000", 2024-09-12T18:37:15.017 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0169999999999999e-06 2024-09-12T18:37:15.018 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.018 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.018 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:15.018 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628725+0000", 2024-09-12T18:37:15.018 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8683000000000001e-05 2024-09-12T18:37:15.018 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.018 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.018 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.018 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628740+0000", 2024-09-12T18:37:15.019 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5413999999999998e-05 2024-09-12T18:37:15.019 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.019 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.019 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:15.019 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628907+0000", 2024-09-12T18:37:15.019 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00016670199999999999 2024-09-12T18:37:15.019 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.019 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.019 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:37:15.019 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628917+0000", 2024-09-12T18:37:15.020 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.046e-05 2024-09-12T18:37:15.020 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.020 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.020 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:15.020 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.660390+0000", 2024-09-12T18:37:15.020 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.031472364000000003 2024-09-12T18:37:15.020 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.020 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.020 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:15.020 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.661767+0000", 2024-09-12T18:37:15.020 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0013769190000000001 2024-09-12T18:37:15.020 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.021 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.021 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:15.021 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.662408+0000", 2024-09-12T18:37:15.021 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00064091099999999998 2024-09-12T18:37:15.021 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.021 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.021 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:15.021 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669577+0000", 2024-09-12T18:37:15.022 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.007169412 2024-09-12T18:37:15.022 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.022 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.022 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:15.022 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674244+0000", 2024-09-12T18:37:15.022 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0046671839999999996 2024-09-12T18:37:15.022 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.022 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.022 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:15.022 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674329+0000", 2024-09-12T18:37:15.022 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5276000000000001e-05 2024-09-12T18:37:15.023 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.023 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.023 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:15.023 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674400+0000", 2024-09-12T18:37:15.023 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0408999999999996e-05 2024-09-12T18:37:15.023 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:15.023 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:15.023 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:15.023 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.023 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.023 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:15.024 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:37:15.024 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 109.381211745, 2024-09-12T18:37:15.024 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.046431252999999999, 2024-09-12T18:37:15.024 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:15.024 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:15.024 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:15.024 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:15.024 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.025 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:15.025 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:37:15.025 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:15.025 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.025 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.025 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:15.025 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:37:15.025 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:15.025 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.025 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.025 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:15.026 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629123+0000", 2024-09-12T18:37:15.026 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0899999999999999e-06 2024-09-12T18:37:15.026 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.026 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.026 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:15.026 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629138+0000", 2024-09-12T18:37:15.026 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4977000000000001e-05 2024-09-12T18:37:15.026 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.026 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.026 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:15.026 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629149+0000", 2024-09-12T18:37:15.027 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1182999999999999e-05 2024-09-12T18:37:15.027 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.027 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.027 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.027 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629157+0000", 2024-09-12T18:37:15.027 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8129999999999996e-06 2024-09-12T18:37:15.027 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.027 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.027 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:15.027 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629223+0000", 2024-09-12T18:37:15.027 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6463000000000004e-05 2024-09-12T18:37:15.028 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.028 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.028 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:37:15.028 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629230+0000", 2024-09-12T18:37:15.028 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1360000000000002e-06 2024-09-12T18:37:15.028 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.028 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.028 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:15.028 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669605+0000", 2024-09-12T18:37:15.028 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.040375518999999999 2024-09-12T18:37:15.028 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.028 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.029 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:15.029 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669840+0000", 2024-09-12T18:37:15.029 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00023520099999999999 2024-09-12T18:37:15.029 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.029 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.029 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:15.029 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.675553+0000", 2024-09-12T18:37:15.029 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0057128709999999996 2024-09-12T18:37:15.029 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:15.029 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:15.029 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:15.029 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.030 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.030 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167352 5.a 5:5fc472d2:::benchmark_data_smithi073_23739_object35075:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:15.030 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.163066+0000", 2024-09-12T18:37:15.030 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 11.847268049, 2024-09-12T18:37:15.030 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.077708377999999995, 2024-09-12T18:37:15.030 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:15.030 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:15.030 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:15.031 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:15.031 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:15.031 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:15.031 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167352 2024-09-12T18:37:15.031 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.031 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:15.031 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.031 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:15.031 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163066+0000", 2024-09-12T18:37:15.031 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:15.031 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.031 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.032 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:15.032 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163066+0000", 2024-09-12T18:37:15.032 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:15.032 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.032 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.032 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:15.032 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163067+0000", 2024-09-12T18:37:15.032 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0499999999999999e-06 2024-09-12T18:37:15.032 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.032 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.032 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:15.032 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163071+0000", 2024-09-12T18:37:15.033 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4340000000000002e-06 2024-09-12T18:37:15.033 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.033 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.033 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:15.033 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163081+0000", 2024-09-12T18:37:15.033 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0304e-05 2024-09-12T18:37:15.033 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.033 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.033 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.033 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163090+0000", 2024-09-12T18:37:15.033 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7309999999999999e-06 2024-09-12T18:37:15.034 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.034 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.034 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:15.034 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163143+0000", 2024-09-12T18:37:15.034 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2942000000000002e-05 2024-09-12T18:37:15.034 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.034 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.034 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:15.034 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163270+0000", 2024-09-12T18:37:15.034 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012664100000000001 2024-09-12T18:37:15.034 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.035 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.035 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:15.035 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163378+0000", 2024-09-12T18:37:15.035 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000107995 2024-09-12T18:37:15.035 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.035 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.035 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:15.035 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234552+0000", 2024-09-12T18:37:15.035 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.071173831000000007 2024-09-12T18:37:15.035 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.036 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.036 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:15.036 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240640+0000", 2024-09-12T18:37:15.036 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.006088909 2024-09-12T18:37:15.036 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.036 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.036 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:15.036 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240709+0000", 2024-09-12T18:37:15.036 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8393999999999996e-05 2024-09-12T18:37:15.036 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.037 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.037 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:15.037 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240774+0000", 2024-09-12T18:37:15.037 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5147000000000005e-05 2024-09-12T18:37:15.037 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:15.037 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:15.037 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:15.037 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.037 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.037 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167358 5.a 5:533f6738:::benchmark_data_smithi073_23739_object35081:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:15.038 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.165639+0000", 2024-09-12T18:37:15.038 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 11.844694772, 2024-09-12T18:37:15.038 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.075287509000000002, 2024-09-12T18:37:15.038 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:15.038 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:15.038 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:15.038 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:15.038 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:15.038 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:15.038 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167358 2024-09-12T18:37:15.039 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.039 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:15.039 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.039 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:15.039 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165639+0000", 2024-09-12T18:37:15.039 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:15.039 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.039 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.039 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:15.039 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165639+0000", 2024-09-12T18:37:15.039 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:15.040 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.040 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.040 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:15.040 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165640+0000", 2024-09-12T18:37:15.040 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1999999999999999e-06 2024-09-12T18:37:15.040 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.040 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.040 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:15.040 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165646+0000", 2024-09-12T18:37:15.040 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4550000000000003e-06 2024-09-12T18:37:15.040 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.040 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.041 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:15.041 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165658+0000", 2024-09-12T18:37:15.041 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2721999999999999e-05 2024-09-12T18:37:15.041 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.041 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.041 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.041 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165668+0000", 2024-09-12T18:37:15.041 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4229999999999994e-06 2024-09-12T18:37:15.041 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.041 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.042 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:15.042 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165711+0000", 2024-09-12T18:37:15.042 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3785999999999997e-05 2024-09-12T18:37:15.042 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.042 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.042 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:15.042 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165788+0000", 2024-09-12T18:37:15.042 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6506000000000002e-05 2024-09-12T18:37:15.042 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.042 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.043 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:15.043 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165862+0000", 2024-09-12T18:37:15.043 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4012999999999998e-05 2024-09-12T18:37:15.043 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.043 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.043 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:15.043 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234718+0000", 2024-09-12T18:37:15.043 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.068856420000000002 2024-09-12T18:37:15.043 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.043 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.043 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:15.044 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240785+0000", 2024-09-12T18:37:15.044 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0060661489999999998 2024-09-12T18:37:15.044 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.044 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.044 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:15.044 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240844+0000", 2024-09-12T18:37:15.044 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9487000000000002e-05 2024-09-12T18:37:15.044 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.044 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.044 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:15.044 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240926+0000", 2024-09-12T18:37:15.045 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2348000000000005e-05 2024-09-12T18:37:15.045 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:15.045 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:15.045 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:15.045 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.045 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.045 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167361 5.a 5:56730f28:::benchmark_data_smithi073_23739_object35084:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:15.045 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.165979+0000", 2024-09-12T18:37:15.045 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 11.844354792000001, 2024-09-12T18:37:15.046 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.075128337000000003, 2024-09-12T18:37:15.046 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:15.046 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:15.046 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:15.046 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:15.046 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:15.046 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:15.046 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167361 2024-09-12T18:37:15.046 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.046 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:15.046 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.047 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:15.047 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165979+0000", 2024-09-12T18:37:15.047 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:15.047 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.047 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.047 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:15.047 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165979+0000", 2024-09-12T18:37:15.047 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:15.047 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.047 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.047 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:15.047 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165980+0000", 2024-09-12T18:37:15.048 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4499999999999997e-07 2024-09-12T18:37:15.048 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.048 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.048 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:15.048 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165985+0000", 2024-09-12T18:37:15.048 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.186e-06 2024-09-12T18:37:15.048 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.048 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.048 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:15.048 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165995+0000", 2024-09-12T18:37:15.048 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0378e-05 2024-09-12T18:37:15.049 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.049 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.049 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.049 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.166016+0000", 2024-09-12T18:37:15.049 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1316999999999999e-05 2024-09-12T18:37:15.049 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.049 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.049 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:15.049 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.167783+0000", 2024-09-12T18:37:15.049 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017662209999999999 2024-09-12T18:37:15.050 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.050 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.050 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:15.050 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.167851+0000", 2024-09-12T18:37:15.050 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7990000000000005e-05 2024-09-12T18:37:15.050 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.050 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.050 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:15.050 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.167929+0000", 2024-09-12T18:37:15.050 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8829e-05 2024-09-12T18:37:15.050 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.050 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.051 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:15.051 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234832+0000", 2024-09-12T18:37:15.051 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066902378999999998 2024-09-12T18:37:15.051 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.051 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.051 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:15.051 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240941+0000", 2024-09-12T18:37:15.051 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0061087470000000003 2024-09-12T18:37:15.051 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.051 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.051 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:15.052 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241053+0000", 2024-09-12T18:37:15.052 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00011197299999999999 2024-09-12T18:37:15.052 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.052 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.052 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:15.052 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241107+0000", 2024-09-12T18:37:15.052 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4672000000000001e-05 2024-09-12T18:37:15.052 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:15.052 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:15.052 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:15.053 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.053 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.053 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167362 5.3 5:cbd73b47:::benchmark_data_smithi073_23739_object35085:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:15.053 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:15.053 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 11.842258077, 2024-09-12T18:37:15.053 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.067202411000000004, 2024-09-12T18:37:15.053 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:15.053 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:15.053 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:15.053 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:15.053 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:15.054 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:15.054 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167362 2024-09-12T18:37:15.054 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.054 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:15.054 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.054 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:15.054 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:15.054 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:15.054 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.054 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.055 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:15.055 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:15.055 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:15.055 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.055 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.055 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:15.055 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:15.055 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3600000000000003e-07 2024-09-12T18:37:15.055 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.055 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.055 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:15.056 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168079+0000", 2024-09-12T18:37:15.056 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7949999999999999e-06 2024-09-12T18:37:15.056 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.056 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.056 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:15.056 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168085+0000", 2024-09-12T18:37:15.056 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2110000000000003e-06 2024-09-12T18:37:15.056 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.056 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.056 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.057 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168089+0000", 2024-09-12T18:37:15.057 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0840000000000002e-06 2024-09-12T18:37:15.057 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.057 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.057 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:15.057 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168121+0000", 2024-09-12T18:37:15.057 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.1489000000000003e-05 2024-09-12T18:37:15.057 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.058 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.058 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:15.058 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168186+0000", 2024-09-12T18:37:15.058 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5313000000000003e-05 2024-09-12T18:37:15.058 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.058 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.058 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:15.058 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168242+0000", 2024-09-12T18:37:15.058 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5560999999999999e-05 2024-09-12T18:37:15.058 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.059 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.059 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:15.059 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234467+0000", 2024-09-12T18:37:15.059 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066225424000000005 2024-09-12T18:37:15.059 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.059 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.059 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:15.059 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235088+0000", 2024-09-12T18:37:15.059 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00062118999999999998 2024-09-12T18:37:15.060 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.060 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.060 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:15.060 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235197+0000", 2024-09-12T18:37:15.060 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00010825899999999999 2024-09-12T18:37:15.060 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.060 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.060 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:15.060 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235278+0000", 2024-09-12T18:37:15.060 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1448999999999999e-05 2024-09-12T18:37:15.060 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:15.061 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:15.061 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:15.061 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.061 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.061 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167366 5.a 5:58e6a467:::benchmark_data_smithi073_23739_object35089:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:15.061 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168263+0000", 2024-09-12T18:37:15.061 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 11.84207054, 2024-09-12T18:37:15.061 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.078184744, 2024-09-12T18:37:15.061 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:15.062 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:15.062 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:15.062 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:15.062 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:15.062 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:15.062 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167366 2024-09-12T18:37:15.062 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.062 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:15.062 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.062 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:15.063 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168263+0000", 2024-09-12T18:37:15.063 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:15.063 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.063 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.063 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:15.063 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168263+0000", 2024-09-12T18:37:15.063 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:15.063 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.063 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.063 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:15.063 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168264+0000", 2024-09-12T18:37:15.064 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5700000000000002e-07 2024-09-12T18:37:15.064 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.064 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.064 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:15.064 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168266+0000", 2024-09-12T18:37:15.064 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1789999999999998e-06 2024-09-12T18:37:15.064 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.064 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.064 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:15.064 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168271+0000", 2024-09-12T18:37:15.065 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8160000000000001e-06 2024-09-12T18:37:15.065 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.065 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.065 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.065 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168275+0000", 2024-09-12T18:37:15.065 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4440000000000001e-06 2024-09-12T18:37:15.065 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.065 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.065 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:15.065 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170082+0000", 2024-09-12T18:37:15.065 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0018068800000000001 2024-09-12T18:37:15.066 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.066 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.066 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:15.066 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170154+0000", 2024-09-12T18:37:15.066 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1575000000000005e-05 2024-09-12T18:37:15.066 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.066 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.066 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:15.066 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170216+0000", 2024-09-12T18:37:15.066 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1989999999999994e-05 2024-09-12T18:37:15.066 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.066 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.067 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:15.067 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234933+0000", 2024-09-12T18:37:15.067 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064717514000000004 2024-09-12T18:37:15.067 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.067 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.067 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:15.067 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246226+0000", 2024-09-12T18:37:15.067 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011293151 2024-09-12T18:37:15.067 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.067 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.067 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:15.067 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246338+0000", 2024-09-12T18:37:15.068 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00011225 2024-09-12T18:37:15.068 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.068 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.068 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:15.068 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246448+0000", 2024-09-12T18:37:15.068 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000109388 2024-09-12T18:37:15.068 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:15.068 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:15.068 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:15.068 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.068 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.068 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167367 5.a 5:51778d97:::benchmark_data_smithi073_23739_object35090:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:15.069 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168388+0000", 2024-09-12T18:37:15.069 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 11.841945296, 2024-09-12T18:37:15.069 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.082583860999999995, 2024-09-12T18:37:15.069 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:15.069 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:15.069 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:15.069 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:15.069 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:15.069 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:15.069 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167367 2024-09-12T18:37:15.069 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.070 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:15.070 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.070 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:15.070 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168388+0000", 2024-09-12T18:37:15.070 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:15.070 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.070 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.070 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:15.070 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168388+0000", 2024-09-12T18:37:15.070 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:15.070 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.071 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.071 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:15.071 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168389+0000", 2024-09-12T18:37:15.071 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1099999999999996e-07 2024-09-12T18:37:15.071 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.071 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.071 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:15.071 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168391+0000", 2024-09-12T18:37:15.071 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.39e-06 2024-09-12T18:37:15.071 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.071 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.072 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:15.072 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168396+0000", 2024-09-12T18:37:15.072 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3460000000000004e-06 2024-09-12T18:37:15.072 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.072 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.072 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.072 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168399+0000", 2024-09-12T18:37:15.072 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.613e-06 2024-09-12T18:37:15.072 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.072 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.072 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:15.073 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235003+0000", 2024-09-12T18:37:15.073 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066603851000000006 2024-09-12T18:37:15.073 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.073 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.073 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:15.073 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235266+0000", 2024-09-12T18:37:15.073 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00026270999999999998 2024-09-12T18:37:15.073 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.073 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.074 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:15.074 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235510+0000", 2024-09-12T18:37:15.074 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00024394 2024-09-12T18:37:15.074 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.074 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.074 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:15.074 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246546+0000", 2024-09-12T18:37:15.074 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011035774 2024-09-12T18:37:15.074 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.074 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.075 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:15.075 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.250808+0000", 2024-09-12T18:37:15.075 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0042622700000000003 2024-09-12T18:37:15.075 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.075 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.075 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:15.075 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.250890+0000", 2024-09-12T18:37:15.075 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1874999999999998e-05 2024-09-12T18:37:15.075 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.075 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.075 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:15.076 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.250972+0000", 2024-09-12T18:37:15.076 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2581000000000001e-05 2024-09-12T18:37:15.076 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:15.076 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:15.076 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:15.076 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.076 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.077 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167370 5.a 5:5aab9477:::benchmark_data_smithi073_23739_object35093:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:15.077 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168603+0000", 2024-09-12T18:37:15.077 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 11.841730361, 2024-09-12T18:37:15.077 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.086603794999999997, 2024-09-12T18:37:15.077 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:15.077 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:15.077 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:15.077 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:15.077 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:15.077 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:15.078 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167370 2024-09-12T18:37:15.078 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.078 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:15.078 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.078 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:15.078 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168603+0000", 2024-09-12T18:37:15.078 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:15.078 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.078 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.079 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:15.079 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168603+0000", 2024-09-12T18:37:15.079 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:15.079 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.079 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.079 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:15.079 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168604+0000", 2024-09-12T18:37:15.079 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.1899999999999998e-07 2024-09-12T18:37:15.079 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.079 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.079 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:15.080 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168606+0000", 2024-09-12T18:37:15.080 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8309999999999999e-06 2024-09-12T18:37:15.080 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.080 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.080 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:15.080 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168610+0000", 2024-09-12T18:37:15.080 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8069999999999999e-06 2024-09-12T18:37:15.080 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.080 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.081 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.081 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168613+0000", 2024-09-12T18:37:15.081 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.118e-06 2024-09-12T18:37:15.081 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.081 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.081 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:15.081 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241145+0000", 2024-09-12T18:37:15.081 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.072531678000000002 2024-09-12T18:37:15.081 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.081 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.082 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:15.082 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241342+0000", 2024-09-12T18:37:15.082 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00019635900000000001 2024-09-12T18:37:15.082 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.082 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.082 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:15.082 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241483+0000", 2024-09-12T18:37:15.082 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014161100000000001 2024-09-12T18:37:15.082 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.082 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.082 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:15.082 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255039+0000", 2024-09-12T18:37:15.083 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013555724 2024-09-12T18:37:15.083 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.083 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.083 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:15.083 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255062+0000", 2024-09-12T18:37:15.083 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.3042000000000001e-05 2024-09-12T18:37:15.083 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.083 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.083 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:15.083 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255143+0000", 2024-09-12T18:37:15.083 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0999000000000002e-05 2024-09-12T18:37:15.084 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.084 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.084 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:15.084 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255207+0000", 2024-09-12T18:37:15.084 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4207000000000004e-05 2024-09-12T18:37:15.084 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:15.084 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:15.085 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:15.085 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.085 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.085 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167352 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:15.085 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:15.085 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 11.841605706999999, 2024-09-12T18:37:15.085 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065859953999999998, 2024-09-12T18:37:15.085 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:15.085 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:15.085 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:15.085 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:15.086 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.086 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:15.086 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:15.086 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:15.086 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.086 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.086 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:15.086 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:15.086 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:15.086 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.086 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.087 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:15.087 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:15.087 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.0800000000000001e-07 2024-09-12T18:37:15.087 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.087 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.087 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:15.087 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168730+0000", 2024-09-12T18:37:15.087 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6530000000000001e-06 2024-09-12T18:37:15.087 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.087 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.087 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:15.087 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168734+0000", 2024-09-12T18:37:15.088 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.721e-06 2024-09-12T18:37:15.088 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.088 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.088 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.088 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168736+0000", 2024-09-12T18:37:15.088 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.508e-06 2024-09-12T18:37:15.088 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.088 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.088 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:15.088 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171951+0000", 2024-09-12T18:37:15.089 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.003215281 2024-09-12T18:37:15.089 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.089 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.089 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:15.089 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234520+0000", 2024-09-12T18:37:15.089 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062568676000000004 2024-09-12T18:37:15.089 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.089 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.089 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:15.089 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234588+0000", 2024-09-12T18:37:15.089 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7806999999999996e-05 2024-09-12T18:37:15.089 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:15.090 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:15.090 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:15.090 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.090 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.090 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167368 5.4 e58/21 5:29a1ec58:::benchmark_data_smithi073_23739_object35091:head v 58'10399, mlcod=58'10396)", 2024-09-12T18:37:15.090 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:15.090 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 11.841482689999999, 2024-09-12T18:37:15.090 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066008885000000003, 2024-09-12T18:37:15.090 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:15.090 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:15.090 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:15.091 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:15.091 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.091 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:15.091 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:15.091 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:15.091 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.091 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.091 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:15.091 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:15.091 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:15.091 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.092 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.092 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:15.092 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:15.092 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4699999999999998e-07 2024-09-12T18:37:15.092 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.092 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.092 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:15.092 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168854+0000", 2024-09-12T18:37:15.092 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.3180000000000001e-06 2024-09-12T18:37:15.092 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.092 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.092 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:15.093 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168858+0000", 2024-09-12T18:37:15.093 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2799999999999997e-06 2024-09-12T18:37:15.093 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.093 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.093 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.093 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168861+0000", 2024-09-12T18:37:15.093 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7650000000000002e-06 2024-09-12T18:37:15.093 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.093 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.093 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:15.094 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168895+0000", 2024-09-12T18:37:15.094 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4533999999999998e-05 2024-09-12T18:37:15.094 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.094 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.094 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:15.094 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168906+0000", 2024-09-12T18:37:15.094 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0910000000000001e-05 2024-09-12T18:37:15.094 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.094 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.094 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:15.094 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234784+0000", 2024-09-12T18:37:15.095 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065877656000000007 2024-09-12T18:37:15.095 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.095 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.095 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:15.095 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234860+0000", 2024-09-12T18:37:15.095 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6174999999999995e-05 2024-09-12T18:37:15.095 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:15.095 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:15.095 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:15.095 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.095 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.096 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167358 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:15.096 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.170373+0000", 2024-09-12T18:37:15.096 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 11.839960409, 2024-09-12T18:37:15.096 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064370201000000002, 2024-09-12T18:37:15.096 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:15.096 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:15.096 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:15.096 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:15.096 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.096 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:15.096 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170373+0000", 2024-09-12T18:37:15.096 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:15.096 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.097 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.097 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:15.097 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170373+0000", 2024-09-12T18:37:15.097 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:15.097 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.097 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.097 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:15.097 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170374+0000", 2024-09-12T18:37:15.097 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5799999999999998e-07 2024-09-12T18:37:15.097 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.098 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.098 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:15.098 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170378+0000", 2024-09-12T18:37:15.098 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.732e-06 2024-09-12T18:37:15.098 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.098 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.098 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:15.098 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170388+0000", 2024-09-12T18:37:15.098 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0212e-05 2024-09-12T18:37:15.098 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.098 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.098 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.099 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170397+0000", 2024-09-12T18:37:15.099 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7090000000000008e-06 2024-09-12T18:37:15.099 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.099 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.099 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:15.099 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234682+0000", 2024-09-12T18:37:15.099 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064285518999999999 2024-09-12T18:37:15.099 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.099 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.099 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:15.099 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234703+0000", 2024-09-12T18:37:15.099 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.0199000000000001e-05 2024-09-12T18:37:15.100 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.100 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.100 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:15.100 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234743+0000", 2024-09-12T18:37:15.100 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0972e-05 2024-09-12T18:37:15.100 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:15.100 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:15.100 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:15.100 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.100 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.100 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167372 5.c 5:398d36a7:::benchmark_data_smithi073_23739_object35095:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:15.101 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171066+0000", 2024-09-12T18:37:15.101 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 11.839267197, 2024-09-12T18:37:15.101 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065889534999999999, 2024-09-12T18:37:15.101 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:15.101 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:15.101 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:15.101 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:15.101 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:15.101 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:15.101 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167372 2024-09-12T18:37:15.101 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.102 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:15.102 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.102 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:15.102 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171066+0000", 2024-09-12T18:37:15.102 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:15.102 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.102 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.102 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:15.102 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171066+0000", 2024-09-12T18:37:15.102 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:15.102 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.102 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.102 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:15.103 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171068+0000", 2024-09-12T18:37:15.103 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.186e-06 2024-09-12T18:37:15.103 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.103 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.103 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:15.103 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171072+0000", 2024-09-12T18:37:15.103 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3560000000000003e-06 2024-09-12T18:37:15.103 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.103 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.103 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:15.104 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171082+0000", 2024-09-12T18:37:15.104 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.9739999999999997e-06 2024-09-12T18:37:15.104 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.104 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.104 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.104 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171089+0000", 2024-09-12T18:37:15.104 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7159999999999997e-06 2024-09-12T18:37:15.104 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.104 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.104 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:15.104 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171133+0000", 2024-09-12T18:37:15.104 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4091999999999997e-05 2024-09-12T18:37:15.105 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.105 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.105 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:15.105 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171221+0000", 2024-09-12T18:37:15.105 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.8108000000000004e-05 2024-09-12T18:37:15.105 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.105 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.105 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:15.105 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171279+0000", 2024-09-12T18:37:15.105 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8062000000000001e-05 2024-09-12T18:37:15.105 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.106 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.106 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:15.106 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235007+0000", 2024-09-12T18:37:15.106 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.063727849000000003 2024-09-12T18:37:15.106 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.106 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.106 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:15.106 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236790+0000", 2024-09-12T18:37:15.106 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017829269999999999 2024-09-12T18:37:15.106 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.106 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.106 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:15.107 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236881+0000", 2024-09-12T18:37:15.107 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1347999999999993e-05 2024-09-12T18:37:15.107 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.107 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.107 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:15.107 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236956+0000", 2024-09-12T18:37:15.107 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4917000000000001e-05 2024-09-12T18:37:15.107 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:15.107 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:15.107 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:15.107 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.108 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.108 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167371 5.4 e58/21 5:24fea27c:::benchmark_data_smithi073_23739_object35094:head v 58'10400, mlcod=58'10397)", 2024-09-12T18:37:15.108 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171273+0000", 2024-09-12T18:37:15.108 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 11.839060623, 2024-09-12T18:37:15.108 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065500368000000003, 2024-09-12T18:37:15.108 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:15.108 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:15.108 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:15.108 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:15.108 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.108 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:15.108 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171273+0000", 2024-09-12T18:37:15.109 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:15.109 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.109 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.109 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:15.109 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171273+0000", 2024-09-12T18:37:15.109 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:15.109 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.109 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.109 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:15.109 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171274+0000", 2024-09-12T18:37:15.109 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0399999999999996e-07 2024-09-12T18:37:15.110 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.110 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.110 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:15.110 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171277+0000", 2024-09-12T18:37:15.110 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8689999999999997e-06 2024-09-12T18:37:15.110 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.110 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.110 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:15.110 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171284+0000", 2024-09-12T18:37:15.110 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2879999999999998e-06 2024-09-12T18:37:15.110 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.110 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.111 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.111 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171289+0000", 2024-09-12T18:37:15.111 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9049999999999996e-06 2024-09-12T18:37:15.111 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.111 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.111 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:15.111 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171322+0000", 2024-09-12T18:37:15.111 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3781000000000001e-05 2024-09-12T18:37:15.111 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.111 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.111 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:15.111 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171335+0000", 2024-09-12T18:37:15.112 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2639999999999999e-05 2024-09-12T18:37:15.112 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.112 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.112 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:15.112 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236691+0000", 2024-09-12T18:37:15.112 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065355835000000001 2024-09-12T18:37:15.112 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.112 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.113 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:15.113 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236773+0000", 2024-09-12T18:37:15.113 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2546000000000006e-05 2024-09-12T18:37:15.113 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:15.113 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:15.113 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:15.113 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.113 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.113 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167364 5.7 e58/21 5:ee50096a:::benchmark_data_smithi073_23739_object35087:head v 58'10504, mlcod=58'10502)", 2024-09-12T18:37:15.114 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171598+0000", 2024-09-12T18:37:15.114 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 11.838735504000001, 2024-09-12T18:37:15.114 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065149069000000004, 2024-09-12T18:37:15.114 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:15.114 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:15.114 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:15.114 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:15.114 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.114 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:15.114 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171598+0000", 2024-09-12T18:37:15.114 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:15.115 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.115 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.115 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:15.115 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171598+0000", 2024-09-12T18:37:15.115 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:15.115 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.115 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.115 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:15.115 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171599+0000", 2024-09-12T18:37:15.115 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6700000000000003e-07 2024-09-12T18:37:15.115 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.116 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.116 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:15.116 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171602+0000", 2024-09-12T18:37:15.116 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.841e-06 2024-09-12T18:37:15.116 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.116 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.116 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:15.116 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171608+0000", 2024-09-12T18:37:15.116 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9259999999999997e-06 2024-09-12T18:37:15.116 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.116 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.117 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.117 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171611+0000", 2024-09-12T18:37:15.117 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.9450000000000003e-06 2024-09-12T18:37:15.117 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.117 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.117 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:15.117 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171650+0000", 2024-09-12T18:37:15.117 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8464000000000003e-05 2024-09-12T18:37:15.117 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.117 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.117 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:15.118 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171662+0000", 2024-09-12T18:37:15.118 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1603999999999999e-05 2024-09-12T18:37:15.118 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.118 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.118 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:15.118 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236663+0000", 2024-09-12T18:37:15.118 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065001330999999996 2024-09-12T18:37:15.118 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.118 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.118 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:15.118 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236747+0000", 2024-09-12T18:37:15.118 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.4390999999999999e-05 2024-09-12T18:37:15.118 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:15.119 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:15.119 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:15.119 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.119 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.119 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167365 5.2 e58/21 5:4107875c:::benchmark_data_smithi073_23739_object35088:head v 58'10351, mlcod=58'10349)", 2024-09-12T18:37:15.119 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171733+0000", 2024-09-12T18:37:15.119 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 11.838600459, 2024-09-12T18:37:15.119 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.074804168000000004, 2024-09-12T18:37:15.119 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:15.119 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:15.119 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:15.119 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:15.120 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.120 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:15.120 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171733+0000", 2024-09-12T18:37:15.120 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:15.120 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.120 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.120 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:15.120 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171733+0000", 2024-09-12T18:37:15.120 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:15.120 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.120 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.120 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:15.121 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171734+0000", 2024-09-12T18:37:15.121 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9299999999999998e-07 2024-09-12T18:37:15.121 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.121 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.121 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:15.121 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171738+0000", 2024-09-12T18:37:15.121 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.301e-06 2024-09-12T18:37:15.121 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.121 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.121 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:15.121 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171746+0000", 2024-09-12T18:37:15.121 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.554e-06 2024-09-12T18:37:15.122 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.122 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.122 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.122 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171751+0000", 2024-09-12T18:37:15.122 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1880000000000001e-06 2024-09-12T18:37:15.122 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.122 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.122 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:15.122 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234659+0000", 2024-09-12T18:37:15.122 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062907807999999996 2024-09-12T18:37:15.123 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.123 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.123 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:15.123 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234708+0000", 2024-09-12T18:37:15.123 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8992000000000001e-05 2024-09-12T18:37:15.123 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.123 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.123 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:15.123 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246457+0000", 2024-09-12T18:37:15.124 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.01174974 2024-09-12T18:37:15.124 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.124 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.124 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:15.124 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246537+0000", 2024-09-12T18:37:15.124 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.9992000000000003e-05 2024-09-12T18:37:15.124 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:15.124 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:15.124 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:15.124 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.124 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.125 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167373 5.5 e58/49 5:ad283029:::benchmark_data_smithi073_23739_object35096:head v 58'10600, mlcod=58'10598)", 2024-09-12T18:37:15.125 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:15.125 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 11.838572975, 2024-09-12T18:37:15.125 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065058240000000003, 2024-09-12T18:37:15.125 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:15.125 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:15.125 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:15.125 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:15.125 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.125 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:15.125 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:15.125 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:15.126 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.126 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.126 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:15.126 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:15.126 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:15.126 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.126 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.126 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:15.126 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:15.126 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.2899999999999999e-07 2024-09-12T18:37:15.127 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.127 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.127 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:15.127 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171764+0000", 2024-09-12T18:37:15.127 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7310000000000002e-06 2024-09-12T18:37:15.127 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.127 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.127 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:15.127 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171769+0000", 2024-09-12T18:37:15.127 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.079e-06 2024-09-12T18:37:15.127 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.127 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.128 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.128 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171774+0000", 2024-09-12T18:37:15.128 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.48e-06 2024-09-12T18:37:15.128 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.128 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.128 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:15.128 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171819+0000", 2024-09-12T18:37:15.128 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4391999999999998e-05 2024-09-12T18:37:15.128 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.128 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.129 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:15.129 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171841+0000", 2024-09-12T18:37:15.129 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2245000000000001e-05 2024-09-12T18:37:15.129 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.129 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.129 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:15.129 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236750+0000", 2024-09-12T18:37:15.129 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064909123999999999 2024-09-12T18:37:15.129 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.129 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.129 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:15.130 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236819+0000", 2024-09-12T18:37:15.130 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8860000000000001e-05 2024-09-12T18:37:15.130 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:15.130 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:15.130 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:15.130 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.130 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.130 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167361 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:15.130 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:15.130 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 11.838517069, 2024-09-12T18:37:15.130 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.063049426000000006, 2024-09-12T18:37:15.131 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:15.131 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:15.131 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:15.131 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:15.131 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.131 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:15.131 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:15.131 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:15.131 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.131 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.131 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:15.132 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:15.132 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:15.132 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.132 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.132 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:15.132 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:15.132 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.9099999999999999e-07 2024-09-12T18:37:15.132 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.132 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.132 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:15.132 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171820+0000", 2024-09-12T18:37:15.133 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.5900000000000002e-06 2024-09-12T18:37:15.133 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.133 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.133 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:15.133 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171826+0000", 2024-09-12T18:37:15.133 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.64e-06 2024-09-12T18:37:15.133 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.133 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.133 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.133 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171831+0000", 2024-09-12T18:37:15.133 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.578e-06 2024-09-12T18:37:15.134 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.134 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.134 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:15.134 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234808+0000", 2024-09-12T18:37:15.134 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062976780999999996 2024-09-12T18:37:15.134 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.134 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.134 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:15.134 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234821+0000", 2024-09-12T18:37:15.134 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3002e-05 2024-09-12T18:37:15.135 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.135 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.135 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:15.135 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234866+0000", 2024-09-12T18:37:15.135 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5444000000000001e-05 2024-09-12T18:37:15.135 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:15.135 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:15.135 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:15.135 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.135 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.136 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167366 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:15.136 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.172133+0000", 2024-09-12T18:37:15.136 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 11.838200240999999, 2024-09-12T18:37:15.136 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062815840999999997, 2024-09-12T18:37:15.136 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:15.136 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:15.136 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:15.136 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:15.136 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.136 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:15.137 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172133+0000", 2024-09-12T18:37:15.137 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:15.137 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.137 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.137 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:15.137 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172133+0000", 2024-09-12T18:37:15.137 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:15.137 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.137 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.137 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:15.137 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172134+0000", 2024-09-12T18:37:15.137 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5000000000000003e-07 2024-09-12T18:37:15.138 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.138 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.138 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:15.138 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172137+0000", 2024-09-12T18:37:15.138 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.6460000000000002e-06 2024-09-12T18:37:15.138 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.138 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.138 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:15.138 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234511+0000", 2024-09-12T18:37:15.138 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062374603000000001 2024-09-12T18:37:15.138 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.139 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.139 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.139 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234525+0000", 2024-09-12T18:37:15.139 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3396e-05 2024-09-12T18:37:15.139 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.139 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.139 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:15.139 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234909+0000", 2024-09-12T18:37:15.139 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00038405299999999998 2024-09-12T18:37:15.139 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.139 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.140 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:15.140 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234922+0000", 2024-09-12T18:37:15.140 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3274e-05 2024-09-12T18:37:15.140 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.140 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.140 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:15.140 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234949+0000", 2024-09-12T18:37:15.140 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7319000000000001e-05 2024-09-12T18:37:15.140 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:15.140 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:15.140 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:15.140 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.141 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.141 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167369 5.7 e58/21 5:e64ecabd:::benchmark_data_smithi073_23739_object35092:head v 58'10505, mlcod=58'10502)", 2024-09-12T18:37:15.141 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:15.141 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 11.836669849, 2024-09-12T18:37:15.141 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.063873773999999994, 2024-09-12T18:37:15.141 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:15.141 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:15.141 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:15.141 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:15.141 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.141 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:15.142 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:15.142 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:15.142 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.142 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.142 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:15.142 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:15.142 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:15.142 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.142 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.142 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:15.143 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:15.143 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3500000000000002e-07 2024-09-12T18:37:15.143 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.143 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.143 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:15.143 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173668+0000", 2024-09-12T18:37:15.143 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4000000000000001e-06 2024-09-12T18:37:15.143 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.143 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.143 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:15.144 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234583+0000", 2024-09-12T18:37:15.144 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.060914889 2024-09-12T18:37:15.144 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.144 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.144 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.144 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234600+0000", 2024-09-12T18:37:15.144 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7192000000000001e-05 2024-09-12T18:37:15.144 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.144 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.145 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:15.145 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234791+0000", 2024-09-12T18:37:15.145 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00019115000000000001 2024-09-12T18:37:15.145 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.145 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.145 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:15.145 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234834+0000", 2024-09-12T18:37:15.145 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3296e-05 2024-09-12T18:37:15.145 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.145 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.145 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:15.146 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.237481+0000", 2024-09-12T18:37:15.146 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0026472050000000001 2024-09-12T18:37:15.146 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:15.146 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:15.146 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:15.146 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.237538+0000", 2024-09-12T18:37:15.146 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6206999999999999e-05 2024-09-12T18:37:15.146 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:15.146 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:15.146 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:15.147 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:15.147 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:15.147 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:15.148 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:15.142+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:15.149 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:37:15.199 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is unset 2024-09-12T18:37:15.209 INFO:teuthology.orchestra.run.smithi073.stderr:osd set-full-ratio 0.95 2024-09-12T18:37:15.248 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:15.242+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:15.309 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:15.310 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:37:15.310 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.310 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:192797 5.d 5:bdf021c4:::benchmark_data_smithi073_23739_object60520:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T18:37:15.310 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:15.302965+0000", 2024-09-12T18:37:15.310 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.003911192, 2024-09-12T18:37:15.310 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003928707, 2024-09-12T18:37:15.310 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:15.310 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:15.310 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:15.310 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:15.310 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:15.310 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:15.310 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 192797 2024-09-12T18:37:15.310 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.311 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:15.311 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.311 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:15.311 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.302965+0000", 2024-09-12T18:37:15.311 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.311 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.311 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.311 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:15.311 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.302965+0000", 2024-09-12T18:37:15.311 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.311 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.311 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.311 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:15.311 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.302966+0000", 2024-09-12T18:37:15.312 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2550000000000001e-06 2024-09-12T18:37:15.312 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.312 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.312 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:15.312 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.302970+0000", 2024-09-12T18:37:15.312 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.242e-06 2024-09-12T18:37:15.312 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.312 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.312 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:15.312 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.302977+0000", 2024-09-12T18:37:15.312 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.498e-06 2024-09-12T18:37:15.312 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.312 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.312 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.313 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.302982+0000", 2024-09-12T18:37:15.313 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8840000000000002e-06 2024-09-12T18:37:15.313 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.313 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.313 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:15.313 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.303020+0000", 2024-09-12T18:37:15.313 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7892000000000002e-05 2024-09-12T18:37:15.313 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.313 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.313 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:15.313 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.303093+0000", 2024-09-12T18:37:15.313 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3485000000000005e-05 2024-09-12T18:37:15.313 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.313 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.313 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:15.314 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.303173+0000", 2024-09-12T18:37:15.314 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9831000000000002e-05 2024-09-12T18:37:15.314 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.314 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:15.314 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.314 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.314 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.314 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:192795 5.a e64/21 5:5b6f0286:::benchmark_data_smithi073_23739_object60518:head v 64'12230, mlcod=64'12228)", 2024-09-12T18:37:15.314 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:15.303006+0000", 2024-09-12T18:37:15.314 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0038703190000000001, 2024-09-12T18:37:15.314 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0039466919999999999, 2024-09-12T18:37:15.314 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:15.314 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:15.314 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:37:15.315 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:15.315 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.315 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:15.315 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.303006+0000", 2024-09-12T18:37:15.315 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.315 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.315 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.315 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:15.315 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.303006+0000", 2024-09-12T18:37:15.315 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.315 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.315 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.315 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:15.316 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.303007+0000", 2024-09-12T18:37:15.316 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.3799999999999997e-07 2024-09-12T18:37:15.316 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.316 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.316 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:15.316 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.303012+0000", 2024-09-12T18:37:15.316 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3970000000000002e-06 2024-09-12T18:37:15.316 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.316 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.316 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:15.316 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.303022+0000", 2024-09-12T18:37:15.316 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0186e-05 2024-09-12T18:37:15.317 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.317 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.317 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.317 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.303029+0000", 2024-09-12T18:37:15.317 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.3860000000000004e-06 2024-09-12T18:37:15.317 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.317 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.317 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:15.317 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.303082+0000", 2024-09-12T18:37:15.317 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3322999999999998e-05 2024-09-12T18:37:15.317 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.318 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.318 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:15.318 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.303102+0000", 2024-09-12T18:37:15.318 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0228e-05 2024-09-12T18:37:15.318 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.318 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:15.318 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.318 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.318 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.318 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:192794 5.f e64/21 5:fe5ae53b:::benchmark_data_smithi073_23739_object60517:head v 64'11958, mlcod=64'11955)", 2024-09-12T18:37:15.318 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:15.303053+0000", 2024-09-12T18:37:15.318 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0038235309999999998, 2024-09-12T18:37:15.319 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0039436499999999999, 2024-09-12T18:37:15.319 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:15.319 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:15.319 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:37:15.319 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:15.319 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.319 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:15.319 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.303053+0000", 2024-09-12T18:37:15.319 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.319 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.319 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.319 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:15.319 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.303053+0000", 2024-09-12T18:37:15.320 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.320 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.320 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.320 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:15.320 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.303053+0000", 2024-09-12T18:37:15.320 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3000000000000001e-07 2024-09-12T18:37:15.320 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.320 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.320 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:15.320 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.303058+0000", 2024-09-12T18:37:15.320 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3710000000000002e-06 2024-09-12T18:37:15.320 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.320 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.320 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:15.320 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.303065+0000", 2024-09-12T18:37:15.321 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.413e-06 2024-09-12T18:37:15.321 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.321 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.321 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.321 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.303070+0000", 2024-09-12T18:37:15.321 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3639999999999998e-06 2024-09-12T18:37:15.321 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.321 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.321 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:15.321 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.303114+0000", 2024-09-12T18:37:15.321 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3622999999999999e-05 2024-09-12T18:37:15.321 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.322 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.322 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:15.322 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.303135+0000", 2024-09-12T18:37:15.322 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1013999999999999e-05 2024-09-12T18:37:15.322 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.322 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:15.322 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.322 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.322 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.322 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:192800 5.e 5:72337dcf:::benchmark_data_smithi073_23739_object60523:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T18:37:15.322 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:15.303470+0000", 2024-09-12T18:37:15.322 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.003406475, 2024-09-12T18:37:15.322 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0035563140000000001, 2024-09-12T18:37:15.322 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:15.323 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:15.323 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:15.323 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:15.323 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:15.323 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:15.323 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 192800 2024-09-12T18:37:15.323 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.323 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:15.323 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.323 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:15.323 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.303470+0000", 2024-09-12T18:37:15.323 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.323 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.323 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.324 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:15.324 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.303470+0000", 2024-09-12T18:37:15.324 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.324 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.324 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.324 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:15.324 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.303470+0000", 2024-09-12T18:37:15.324 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7700000000000004e-07 2024-09-12T18:37:15.324 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.324 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.324 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:15.324 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.303474+0000", 2024-09-12T18:37:15.324 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2600000000000001e-06 2024-09-12T18:37:15.325 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.325 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.325 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:15.325 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.303483+0000", 2024-09-12T18:37:15.325 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5119999999999997e-06 2024-09-12T18:37:15.325 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.325 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.325 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.325 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.303489+0000", 2024-09-12T18:37:15.325 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0220000000000001e-06 2024-09-12T18:37:15.325 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.325 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.325 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:15.326 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.303544+0000", 2024-09-12T18:37:15.326 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4472999999999998e-05 2024-09-12T18:37:15.326 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.326 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.326 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:15.326 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.303665+0000", 2024-09-12T18:37:15.326 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000121463 2024-09-12T18:37:15.326 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.326 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.326 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:15.326 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.303769+0000", 2024-09-12T18:37:15.326 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000103379 2024-09-12T18:37:15.326 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.326 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.327 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:15.327 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.306958+0000", 2024-09-12T18:37:15.327 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031896239999999998 2024-09-12T18:37:15.327 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.327 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:15.327 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.327 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.327 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.327 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:192801 5.e 5:71281568:::benchmark_data_smithi073_23739_object60524:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T18:37:15.327 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:15.305427+0000", 2024-09-12T18:37:15.327 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.001448911, 2024-09-12T18:37:15.327 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016397060000000001, 2024-09-12T18:37:15.327 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:15.327 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:15.327 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:15.328 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:15.328 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:15.328 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:15.328 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 192801 2024-09-12T18:37:15.328 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.328 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:15.328 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.328 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:15.328 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305427+0000", 2024-09-12T18:37:15.328 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.328 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.328 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.329 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:15.329 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305427+0000", 2024-09-12T18:37:15.329 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.329 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.329 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.329 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:15.329 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305428+0000", 2024-09-12T18:37:15.329 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0079999999999999e-06 2024-09-12T18:37:15.329 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.329 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.329 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:15.329 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305435+0000", 2024-09-12T18:37:15.329 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7479999999999996e-06 2024-09-12T18:37:15.329 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.330 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.330 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:15.330 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305444+0000", 2024-09-12T18:37:15.330 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5820000000000002e-06 2024-09-12T18:37:15.330 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.330 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.330 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.330 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305449+0000", 2024-09-12T18:37:15.330 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6729999999999997e-06 2024-09-12T18:37:15.330 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.330 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.330 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:15.330 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305516+0000", 2024-09-12T18:37:15.331 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6322000000000006e-05 2024-09-12T18:37:15.332 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.332 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.332 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:15.332 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305637+0000", 2024-09-12T18:37:15.332 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000121298 2024-09-12T18:37:15.332 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.332 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.332 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:15.332 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305745+0000", 2024-09-12T18:37:15.333 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000107958 2024-09-12T18:37:15.333 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.333 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:15.333 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.333 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.333 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.333 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:192802 5.4 5:23cd8788:::benchmark_data_smithi073_23739_object60525:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T18:37:15.333 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:15.305463+0000", 2024-09-12T18:37:15.333 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.001412845, 2024-09-12T18:37:15.333 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016361800000000001, 2024-09-12T18:37:15.333 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:15.333 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:15.333 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:15.333 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:15.334 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:15.334 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:15.334 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 192802 2024-09-12T18:37:15.334 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.334 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:15.334 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.334 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:15.334 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305463+0000", 2024-09-12T18:37:15.334 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.334 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.334 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.334 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:15.334 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305463+0000", 2024-09-12T18:37:15.334 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.334 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.335 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.335 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:15.335 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305464+0000", 2024-09-12T18:37:15.335 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.77e-07 2024-09-12T18:37:15.335 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.335 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.335 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:15.335 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305465+0000", 2024-09-12T18:37:15.335 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6589999999999999e-06 2024-09-12T18:37:15.335 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.335 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.335 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:15.335 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305471+0000", 2024-09-12T18:37:15.335 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3210000000000004e-06 2024-09-12T18:37:15.336 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.336 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.336 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.336 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305474+0000", 2024-09-12T18:37:15.336 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9280000000000002e-06 2024-09-12T18:37:15.336 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.336 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.336 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:15.336 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305520+0000", 2024-09-12T18:37:15.336 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6610000000000003e-05 2024-09-12T18:37:15.336 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.336 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.336 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:15.336 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305647+0000", 2024-09-12T18:37:15.337 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012676899999999999 2024-09-12T18:37:15.337 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.337 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.337 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:15.337 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305763+0000", 2024-09-12T18:37:15.337 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011561999999999999 2024-09-12T18:37:15.337 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.337 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:15.337 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.337 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.337 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.337 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:192804 5.d 5:b9d6a4bb:::benchmark_data_smithi073_23739_object60527:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T18:37:15.337 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:15.305482+0000", 2024-09-12T18:37:15.338 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0013947149999999999, 2024-09-12T18:37:15.338 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001651165, 2024-09-12T18:37:15.338 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:15.338 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:15.338 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:15.338 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:15.338 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:15.338 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:15.338 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 192804 2024-09-12T18:37:15.338 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.338 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:15.338 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.338 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:15.338 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305482+0000", 2024-09-12T18:37:15.339 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.339 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.339 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.339 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:15.339 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305482+0000", 2024-09-12T18:37:15.339 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.339 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.339 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.339 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:15.339 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305482+0000", 2024-09-12T18:37:15.339 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8599999999999999e-07 2024-09-12T18:37:15.339 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.339 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.340 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:15.340 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305483+0000", 2024-09-12T18:37:15.340 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4330000000000001e-06 2024-09-12T18:37:15.340 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.340 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.340 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:15.340 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305492+0000", 2024-09-12T18:37:15.340 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5879999999999998e-06 2024-09-12T18:37:15.340 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.340 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.340 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.340 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305497+0000", 2024-09-12T18:37:15.340 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0760000000000002e-06 2024-09-12T18:37:15.341 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.341 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.341 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:15.341 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305591+0000", 2024-09-12T18:37:15.341 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.3671999999999994e-05 2024-09-12T18:37:15.341 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.341 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.341 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:15.341 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305718+0000", 2024-09-12T18:37:15.341 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012711100000000001 2024-09-12T18:37:15.341 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.341 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.341 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:15.342 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305964+0000", 2024-09-12T18:37:15.342 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00024644800000000002 2024-09-12T18:37:15.342 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.342 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:15.342 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.342 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.342 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.342 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "MOSDPGPush(5.1 64/49 [PushOp(5:8f6dc384:::benchmark_data_smithi073_23739_object98768:head, version: 41'6148, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(5:8f6dc384:::benchmark_data_smithi073_23739_object98768:head@41'6148, size: 65536, copy_subset: [(0, 65536)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 65536, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T18:37:15.342 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:15.305567+0000", 2024-09-12T18:37:15.342 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.001309614, 2024-09-12T18:37:15.342 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016234050000000001, 2024-09-12T18:37:15.342 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:15.342 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:15.342 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:37:15.343 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:15.343 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.343 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:15.343 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305567+0000", 2024-09-12T18:37:15.343 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.343 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.343 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.343 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:15.343 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305567+0000", 2024-09-12T18:37:15.343 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.343 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.343 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.344 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:15.344 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305567+0000", 2024-09-12T18:37:15.344 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2799999999999995e-07 2024-09-12T18:37:15.344 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.344 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.344 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:15.344 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305614+0000", 2024-09-12T18:37:15.344 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7052000000000003e-05 2024-09-12T18:37:15.344 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.344 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.344 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:15.344 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305632+0000", 2024-09-12T18:37:15.344 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7827999999999999e-05 2024-09-12T18:37:15.345 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.345 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.345 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.345 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305649+0000", 2024-09-12T18:37:15.345 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7252e-05 2024-09-12T18:37:15.345 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.345 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.345 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:15.345 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.307043+0000", 2024-09-12T18:37:15.345 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0013938609999999999 2024-09-12T18:37:15.345 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.345 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.345 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:15.346 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.307051+0000", 2024-09-12T18:37:15.346 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5079999999999999e-06 2024-09-12T18:37:15.346 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.346 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:15.346 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.346 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.346 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.346 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_backfill(progress 5.1 e 64/64 lb 5:8f6d5840:::benchmark_data_smithi073_23739_object65535:head)", 2024-09-12T18:37:15.346 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:15.305677+0000", 2024-09-12T18:37:15.346 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.001198827, 2024-09-12T18:37:15.346 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015383599999999999, 2024-09-12T18:37:15.346 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:15.346 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:15.347 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:15.347 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:15.347 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.347 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:15.347 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305677+0000", 2024-09-12T18:37:15.347 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.347 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.347 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.347 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:15.347 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305677+0000", 2024-09-12T18:37:15.347 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.347 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.348 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.348 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:15.348 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305678+0000", 2024-09-12T18:37:15.348 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2199999999999999e-07 2024-09-12T18:37:15.348 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.348 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.348 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:15.348 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305686+0000", 2024-09-12T18:37:15.348 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6909999999999997e-06 2024-09-12T18:37:15.348 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.348 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.348 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:15.348 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305694+0000", 2024-09-12T18:37:15.349 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2810000000000008e-06 2024-09-12T18:37:15.349 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.349 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.349 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.349 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305701+0000", 2024-09-12T18:37:15.349 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.418e-06 2024-09-12T18:37:15.349 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.349 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:15.349 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.349 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.349 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.349 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(client.4480.0:192797 5.d e64/21)", 2024-09-12T18:37:15.349 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:15.305739+0000", 2024-09-12T18:37:15.350 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.001136747, 2024-09-12T18:37:15.350 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014961779999999999, 2024-09-12T18:37:15.350 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:15.350 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:15.350 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:15.350 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:15.350 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.350 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:15.350 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305739+0000", 2024-09-12T18:37:15.350 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.350 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.350 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.350 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:15.350 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305739+0000", 2024-09-12T18:37:15.351 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.351 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.351 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.351 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:15.351 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305740+0000", 2024-09-12T18:37:15.351 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2499999999999999e-07 2024-09-12T18:37:15.351 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.351 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.351 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:15.351 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305742+0000", 2024-09-12T18:37:15.351 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2180000000000002e-06 2024-09-12T18:37:15.351 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.351 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.351 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:15.351 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305748+0000", 2024-09-12T18:37:15.352 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.9569999999999999e-06 2024-09-12T18:37:15.352 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.352 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.352 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.352 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.305752+0000", 2024-09-12T18:37:15.352 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8709999999999999e-06 2024-09-12T18:37:15.352 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.352 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:15.352 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.352 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.352 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.352 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:192789 5.4 5:201e1392:::benchmark_data_smithi073_23739_object60512:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T18:37:15.352 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:15.299716+0000", 2024-09-12T18:37:15.353 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0071604199999999998, 2024-09-12T18:37:15.353 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0075433649999999998, 2024-09-12T18:37:15.353 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:15.353 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:15.353 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:15.353 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:15.353 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:15.353 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:15.353 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 192789 2024-09-12T18:37:15.353 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.353 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:15.353 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.353 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:15.353 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.299716+0000", 2024-09-12T18:37:15.354 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.354 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.354 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.354 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:15.354 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.299716+0000", 2024-09-12T18:37:15.354 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.354 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.354 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.354 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:15.354 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.299716+0000", 2024-09-12T18:37:15.354 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2699999999999999e-07 2024-09-12T18:37:15.354 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.354 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.354 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:15.355 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.299720+0000", 2024-09-12T18:37:15.355 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0600000000000001e-06 2024-09-12T18:37:15.355 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.355 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.355 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:15.355 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.299731+0000", 2024-09-12T18:37:15.355 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0016e-05 2024-09-12T18:37:15.355 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.355 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.355 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.355 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.299737+0000", 2024-09-12T18:37:15.355 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8310000000000003e-06 2024-09-12T18:37:15.355 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.356 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.356 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:15.356 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.299783+0000", 2024-09-12T18:37:15.356 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5593999999999997e-05 2024-09-12T18:37:15.356 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.356 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.356 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:15.356 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.299857+0000", 2024-09-12T18:37:15.356 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3579999999999997e-05 2024-09-12T18:37:15.356 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.356 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.356 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:15.356 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.299916+0000", 2024-09-12T18:37:15.356 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.9743e-05 2024-09-12T18:37:15.357 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.357 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.357 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:15.357 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.301923+0000", 2024-09-12T18:37:15.357 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002006945 2024-09-12T18:37:15.357 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.357 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:15.357 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.357 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.357 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.357 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:192792 5.9 e64/21 5:9dae3048:::benchmark_data_smithi073_23739_object60515:head v 64'12029, mlcod=64'12026)", 2024-09-12T18:37:15.357 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:15.300863+0000", 2024-09-12T18:37:15.357 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00601273, 2024-09-12T18:37:15.357 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0064374899999999997, 2024-09-12T18:37:15.358 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:15.358 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:15.358 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:37:15.358 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:15.358 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.358 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:15.358 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.300863+0000", 2024-09-12T18:37:15.358 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.358 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.358 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.358 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:15.358 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.300863+0000", 2024-09-12T18:37:15.358 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.358 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.358 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.358 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:15.359 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.300864+0000", 2024-09-12T18:37:15.359 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4899999999999995e-07 2024-09-12T18:37:15.359 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.359 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.359 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:15.359 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.300872+0000", 2024-09-12T18:37:15.359 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2840000000000006e-06 2024-09-12T18:37:15.359 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.359 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.359 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:15.359 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.300881+0000", 2024-09-12T18:37:15.359 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.2479999999999996e-06 2024-09-12T18:37:15.359 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.359 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.359 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.360 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.300887+0000", 2024-09-12T18:37:15.360 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5239999999999997e-06 2024-09-12T18:37:15.360 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.360 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.360 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:15.360 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.300940+0000", 2024-09-12T18:37:15.360 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2908000000000002e-05 2024-09-12T18:37:15.360 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.360 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.360 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:15.360 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:15.300960+0000", 2024-09-12T18:37:15.360 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9521000000000002e-05 2024-09-12T18:37:15.360 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.360 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:15.360 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.361 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.361 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-09-12T18:37:15.361 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 12 2024-09-12T18:37:15.361 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:15.362 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:37:15.363 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:15.356+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:15.463 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:15.454+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:15.562 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:15.562 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-09-12T18:37:15.562 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-09-12T18:37:15.562 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-09-12T18:37:15.563 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:15.563 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:15.558+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:15.582 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:37:15.664 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:15.656+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:15.743 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:15.744 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-09-12T18:37:15.744 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-09-12T18:37:15.744 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:37:15.744 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.744 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:15.744 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:37:15.744 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 110.106228769, 2024-09-12T18:37:15.744 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025088781000000001, 2024-09-12T18:37:15.744 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:15.744 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:15.744 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:15.744 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:15.744 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.745 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:15.745 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:37:15.745 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.745 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.745 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.745 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:15.745 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:37:15.745 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.745 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.745 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.745 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:15.745 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632518+0000", 2024-09-12T18:37:15.745 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:37:15.746 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.746 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.746 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:15.746 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632533+0000", 2024-09-12T18:37:15.746 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5130000000000001e-05 2024-09-12T18:37:15.746 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.746 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.746 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:15.746 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632564+0000", 2024-09-12T18:37:15.746 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0788999999999999e-05 2024-09-12T18:37:15.746 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.746 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.746 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.746 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632590+0000", 2024-09-12T18:37:15.747 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6057000000000001e-05 2024-09-12T18:37:15.747 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.747 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.747 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:15.747 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.635931+0000", 2024-09-12T18:37:15.747 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033411320000000001 2024-09-12T18:37:15.747 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.747 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.747 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:15.747 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636186+0000", 2024-09-12T18:37:15.747 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025452500000000002 2024-09-12T18:37:15.748 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.748 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.748 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:15.748 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636445+0000", 2024-09-12T18:37:15.748 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000259268 2024-09-12T18:37:15.748 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.748 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.748 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:15.748 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639562+0000", 2024-09-12T18:37:15.748 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031167 2024-09-12T18:37:15.748 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.748 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.748 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:15.749 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657314+0000", 2024-09-12T18:37:15.749 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017752562 2024-09-12T18:37:15.749 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.749 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.749 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:15.749 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657445+0000", 2024-09-12T18:37:15.749 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013105899999999999 2024-09-12T18:37:15.749 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.749 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.749 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:15.749 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657598+0000", 2024-09-12T18:37:15.749 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015247899999999999 2024-09-12T18:37:15.749 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.750 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:15.750 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.750 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.750 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.750 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:15.750 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:37:15.750 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 110.106102566, 2024-09-12T18:37:15.750 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025643131999999999, 2024-09-12T18:37:15.750 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:15.750 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:15.750 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:15.750 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:15.751 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.751 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:15.751 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:37:15.751 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.751 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.751 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.751 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:15.751 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:37:15.751 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.751 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.751 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.751 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:15.751 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632637+0000", 2024-09-12T18:37:15.751 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5600000000000001e-06 2024-09-12T18:37:15.752 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.752 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.752 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:15.752 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632650+0000", 2024-09-12T18:37:15.752 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3186e-05 2024-09-12T18:37:15.752 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.752 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.752 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:15.752 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632672+0000", 2024-09-12T18:37:15.752 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2013000000000001e-05 2024-09-12T18:37:15.752 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.752 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.752 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.753 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632687+0000", 2024-09-12T18:37:15.753 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5109999999999999e-05 2024-09-12T18:37:15.753 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.753 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.753 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:15.753 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636994+0000", 2024-09-12T18:37:15.753 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0043065539999999998 2024-09-12T18:37:15.753 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.753 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.753 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:15.753 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637198+0000", 2024-09-12T18:37:15.753 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020387199999999999 2024-09-12T18:37:15.753 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.754 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.754 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:15.754 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637475+0000", 2024-09-12T18:37:15.754 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027731000000000001 2024-09-12T18:37:15.754 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.754 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.754 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:15.754 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639574+0000", 2024-09-12T18:37:15.754 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020988999999999999 2024-09-12T18:37:15.754 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.754 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.754 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:15.754 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658057+0000", 2024-09-12T18:37:15.754 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018482926 2024-09-12T18:37:15.755 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.755 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.755 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:15.755 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658184+0000", 2024-09-12T18:37:15.755 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012756200000000001 2024-09-12T18:37:15.755 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.755 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.755 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:15.755 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658278+0000", 2024-09-12T18:37:15.755 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4139000000000001e-05 2024-09-12T18:37:15.755 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.755 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:15.755 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.755 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.756 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.756 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:15.756 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:37:15.756 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 110.106027474, 2024-09-12T18:37:15.756 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025238883, 2024-09-12T18:37:15.756 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:15.756 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:15.756 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:15.756 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:15.756 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.756 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:15.756 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:37:15.756 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.757 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.757 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.757 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:15.757 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:37:15.757 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.757 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.757 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.757 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:15.757 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632712+0000", 2024-09-12T18:37:15.757 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6869999999999999e-06 2024-09-12T18:37:15.757 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.757 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.757 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:15.757 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632719+0000", 2024-09-12T18:37:15.757 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6059999999999999e-06 2024-09-12T18:37:15.758 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.758 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.758 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:15.758 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632737+0000", 2024-09-12T18:37:15.758 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7983999999999999e-05 2024-09-12T18:37:15.758 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.758 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.758 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.758 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632751+0000", 2024-09-12T18:37:15.758 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4473e-05 2024-09-12T18:37:15.758 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.758 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.759 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:15.759 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636961+0000", 2024-09-12T18:37:15.759 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042100840000000002 2024-09-12T18:37:15.759 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.759 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.759 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:15.759 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637211+0000", 2024-09-12T18:37:15.759 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000249738 2024-09-12T18:37:15.759 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.759 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.759 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:15.759 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637504+0000", 2024-09-12T18:37:15.759 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00029271499999999998 2024-09-12T18:37:15.760 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.760 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.760 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:15.760 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639582+0000", 2024-09-12T18:37:15.760 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020783389999999998 2024-09-12T18:37:15.760 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.760 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.760 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:15.760 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657709+0000", 2024-09-12T18:37:15.760 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018126758999999999 2024-09-12T18:37:15.760 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.760 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.760 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:15.760 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657830+0000", 2024-09-12T18:37:15.760 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000121329 2024-09-12T18:37:15.761 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.761 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.761 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:15.761 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657949+0000", 2024-09-12T18:37:15.761 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000119169 2024-09-12T18:37:15.761 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.761 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:15.761 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.761 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.761 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.761 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:15.761 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:37:15.761 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 110.105963428, 2024-09-12T18:37:15.762 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026711823999999999, 2024-09-12T18:37:15.762 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:15.762 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:15.762 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:15.762 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:15.762 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.762 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:15.762 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:37:15.762 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.762 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.762 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.762 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:15.762 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:37:15.762 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.763 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.763 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.763 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:15.763 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632775+0000", 2024-09-12T18:37:15.763 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9999999999999995e-07 2024-09-12T18:37:15.763 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.763 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.763 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:15.763 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632788+0000", 2024-09-12T18:37:15.763 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2629999999999999e-05 2024-09-12T18:37:15.763 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.763 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.763 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:15.763 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632806+0000", 2024-09-12T18:37:15.763 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:37:15.764 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.764 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.764 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.764 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632820+0000", 2024-09-12T18:37:15.764 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3777e-05 2024-09-12T18:37:15.764 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.764 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.764 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:15.764 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638310+0000", 2024-09-12T18:37:15.764 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054898280000000004 2024-09-12T18:37:15.764 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.764 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.764 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:15.765 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638480+0000", 2024-09-12T18:37:15.765 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016968199999999999 2024-09-12T18:37:15.765 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.765 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.765 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:15.765 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638799+0000", 2024-09-12T18:37:15.765 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031915999999999997 2024-09-12T18:37:15.765 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.765 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.766 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:15.766 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639866+0000", 2024-09-12T18:37:15.766 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001067405 2024-09-12T18:37:15.766 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.766 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.766 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:15.766 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658398+0000", 2024-09-12T18:37:15.766 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018531542000000002 2024-09-12T18:37:15.766 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.766 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.766 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:15.766 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658643+0000", 2024-09-12T18:37:15.766 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00024531500000000002 2024-09-12T18:37:15.767 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.767 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.767 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:15.767 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.659486+0000", 2024-09-12T18:37:15.767 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00084316899999999995 2024-09-12T18:37:15.767 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.767 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:15.767 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.767 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.767 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.767 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:15.767 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:37:15.767 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 110.10565467399999, 2024-09-12T18:37:15.768 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026938645000000001, 2024-09-12T18:37:15.768 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:15.768 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:15.768 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:15.768 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:15.768 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.768 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:15.768 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:37:15.768 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.768 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.768 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.768 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:15.768 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:37:15.769 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.769 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.769 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.769 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:15.769 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633085+0000", 2024-09-12T18:37:15.769 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:37:15.769 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.769 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.769 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:15.769 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633093+0000", 2024-09-12T18:37:15.769 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3999999999999992e-06 2024-09-12T18:37:15.769 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.769 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.770 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:15.770 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633111+0000", 2024-09-12T18:37:15.770 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8070000000000001e-05 2024-09-12T18:37:15.770 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.770 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.770 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.770 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633126+0000", 2024-09-12T18:37:15.770 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4487e-05 2024-09-12T18:37:15.770 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.770 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.770 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:15.770 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638290+0000", 2024-09-12T18:37:15.770 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0051640269999999999 2024-09-12T18:37:15.770 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.771 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.771 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:15.771 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638547+0000", 2024-09-12T18:37:15.771 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025714100000000001 2024-09-12T18:37:15.771 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.771 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.771 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:15.771 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638850+0000", 2024-09-12T18:37:15.771 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030278400000000001 2024-09-12T18:37:15.771 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.771 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.771 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:15.771 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.640706+0000", 2024-09-12T18:37:15.771 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018564580000000001 2024-09-12T18:37:15.772 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.772 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.772 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:15.772 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658420+0000", 2024-09-12T18:37:15.772 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017714395000000001 2024-09-12T18:37:15.772 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.772 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.772 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:15.772 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658635+0000", 2024-09-12T18:37:15.772 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021413500000000001 2024-09-12T18:37:15.772 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.772 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.772 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:15.773 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.660022+0000", 2024-09-12T18:37:15.773 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001387318 2024-09-12T18:37:15.773 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.773 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:15.773 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.773 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.773 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.773 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121096 5.8 5:13503891:::benchmark_data_smithi073_23739_object121095:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:15.773 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:37:15.773 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 35.560161706999999, 2024-09-12T18:37:15.773 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064025391000000001, 2024-09-12T18:37:15.773 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:15.773 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:15.774 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:15.774 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:15.774 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:15.774 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:15.774 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121096 2024-09-12T18:37:15.774 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.774 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:15.774 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.774 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:15.774 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:37:15.774 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.774 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.774 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.774 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:15.774 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:37:15.775 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.775 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.775 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.775 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:15.775 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178579+0000", 2024-09-12T18:37:15.775 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7369999999999998e-06 2024-09-12T18:37:15.775 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.775 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.775 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:15.775 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178846+0000", 2024-09-12T18:37:15.775 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026752699999999999 2024-09-12T18:37:15.775 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.775 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.775 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:15.776 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178877+0000", 2024-09-12T18:37:15.776 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1081999999999998e-05 2024-09-12T18:37:15.776 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.776 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.776 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.776 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178896+0000", 2024-09-12T18:37:15.776 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8522e-05 2024-09-12T18:37:15.776 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.776 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.776 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:15.777 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.192591+0000", 2024-09-12T18:37:15.777 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013695067 2024-09-12T18:37:15.777 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.777 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.777 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:15.777 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.192944+0000", 2024-09-12T18:37:15.777 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00035273699999999999 2024-09-12T18:37:15.777 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.777 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.777 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:15.777 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.193732+0000", 2024-09-12T18:37:15.777 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078849599999999997 2024-09-12T18:37:15.777 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.778 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.778 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:15.778 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.213583+0000", 2024-09-12T18:37:15.778 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.019851164000000001 2024-09-12T18:37:15.778 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.778 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.778 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:15.778 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242386+0000", 2024-09-12T18:37:15.778 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028802924000000001 2024-09-12T18:37:15.778 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.778 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.778 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:15.778 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242501+0000", 2024-09-12T18:37:15.778 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000114932 2024-09-12T18:37:15.779 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.779 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.779 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:15.779 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242602+0000", 2024-09-12T18:37:15.779 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000100203 2024-09-12T18:37:15.779 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.779 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:15.779 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.779 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.779 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.779 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121097 5.8 5:1b31a99e:::benchmark_data_smithi073_23739_object121096:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:15.779 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:37:15.779 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 35.544433417, 2024-09-12T18:37:15.779 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048475917, 2024-09-12T18:37:15.780 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:15.780 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:15.780 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:15.780 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:15.780 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:15.780 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:15.780 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121097 2024-09-12T18:37:15.780 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.780 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:15.780 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.780 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:15.781 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:37:15.781 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.781 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.781 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.781 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:15.781 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:37:15.781 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.781 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.781 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.781 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:15.781 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194308+0000", 2024-09-12T18:37:15.781 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2789999999999999e-06 2024-09-12T18:37:15.781 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.781 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.782 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:15.782 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194396+0000", 2024-09-12T18:37:15.782 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8324000000000003e-05 2024-09-12T18:37:15.782 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.782 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.782 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:15.782 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194424+0000", 2024-09-12T18:37:15.782 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7565000000000001e-05 2024-09-12T18:37:15.782 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.782 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.782 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.782 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194444+0000", 2024-09-12T18:37:15.782 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0363000000000001e-05 2024-09-12T18:37:15.782 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.783 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.783 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:15.783 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.206888+0000", 2024-09-12T18:37:15.783 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012443997 2024-09-12T18:37:15.783 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.783 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.783 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:15.783 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.207138+0000", 2024-09-12T18:37:15.783 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025035900000000002 2024-09-12T18:37:15.783 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.783 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.783 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:15.783 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.207365+0000", 2024-09-12T18:37:15.784 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000226407 2024-09-12T18:37:15.784 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.784 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.784 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:15.784 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.215059+0000", 2024-09-12T18:37:15.784 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076946860000000001 2024-09-12T18:37:15.784 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.784 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.784 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:15.784 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242619+0000", 2024-09-12T18:37:15.784 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.027559975 2024-09-12T18:37:15.784 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.784 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.784 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:15.785 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242706+0000", 2024-09-12T18:37:15.785 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6384999999999994e-05 2024-09-12T18:37:15.785 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.785 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.785 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:15.785 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242780+0000", 2024-09-12T18:37:15.785 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4577000000000001e-05 2024-09-12T18:37:15.785 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.785 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:15.785 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.785 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.785 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.785 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:121044 5.1 e50/49 5:83bf711a:::benchmark_data_smithi073_23739_object121043:head v 50'7532, mlcod=0'0)", 2024-09-12T18:37:15.785 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.201054+0000", 2024-09-12T18:37:15.786 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 35.537684196000001, 2024-09-12T18:37:15.786 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026157387000000001, 2024-09-12T18:37:15.786 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:15.786 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:15.786 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:15.786 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:15.786 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.786 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:15.786 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201054+0000", 2024-09-12T18:37:15.786 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.786 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.786 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.786 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:15.786 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201054+0000", 2024-09-12T18:37:15.787 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.787 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.787 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.787 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:15.787 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201056+0000", 2024-09-12T18:37:15.787 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.99e-06 2024-09-12T18:37:15.787 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.787 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.787 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:15.787 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201068+0000", 2024-09-12T18:37:15.787 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2799000000000001e-05 2024-09-12T18:37:15.787 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.787 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.788 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:15.788 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201093+0000", 2024-09-12T18:37:15.788 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4766e-05 2024-09-12T18:37:15.788 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.788 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.788 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.788 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201115+0000", 2024-09-12T18:37:15.788 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1988999999999999e-05 2024-09-12T18:37:15.788 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.789 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.789 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:15.789 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201233+0000", 2024-09-12T18:37:15.789 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000118229 2024-09-12T18:37:15.789 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.789 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.789 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:15.789 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201273+0000", 2024-09-12T18:37:15.789 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9171999999999997e-05 2024-09-12T18:37:15.789 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.789 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.789 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:15.789 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.227080+0000", 2024-09-12T18:37:15.789 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025807611000000001 2024-09-12T18:37:15.790 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.790 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.790 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:15.790 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.227211+0000", 2024-09-12T18:37:15.790 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013083100000000001 2024-09-12T18:37:15.790 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.790 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:15.790 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.790 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.790 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.790 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121101 5.e 5:7e18e9ed:::benchmark_data_smithi073_23739_object121100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:15.790 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.209084+0000", 2024-09-12T18:37:15.791 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 35.529653361999998, 2024-09-12T18:37:15.791 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028988566, 2024-09-12T18:37:15.791 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:15.791 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:15.791 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:15.791 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:15.791 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:15.791 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:15.791 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121101 2024-09-12T18:37:15.791 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.791 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:15.791 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.791 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:15.792 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209084+0000", 2024-09-12T18:37:15.792 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.792 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.792 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.792 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:15.792 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209084+0000", 2024-09-12T18:37:15.792 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.792 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.792 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.792 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:15.792 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209087+0000", 2024-09-12T18:37:15.792 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6800000000000002e-06 2024-09-12T18:37:15.793 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.793 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.793 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:15.793 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209182+0000", 2024-09-12T18:37:15.793 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5084e-05 2024-09-12T18:37:15.793 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.793 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.793 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:15.793 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209212+0000", 2024-09-12T18:37:15.793 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9825e-05 2024-09-12T18:37:15.793 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.793 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.794 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.794 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209234+0000", 2024-09-12T18:37:15.794 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1416e-05 2024-09-12T18:37:15.794 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.794 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.794 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:15.794 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209497+0000", 2024-09-12T18:37:15.794 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026390400000000003 2024-09-12T18:37:15.794 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.794 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.794 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:15.794 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209810+0000", 2024-09-12T18:37:15.794 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000313023 2024-09-12T18:37:15.795 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.795 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.795 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:15.795 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.210468+0000", 2024-09-12T18:37:15.795 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00065779300000000005 2024-09-12T18:37:15.795 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.795 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.795 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:15.795 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.235905+0000", 2024-09-12T18:37:15.795 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025436881000000001 2024-09-12T18:37:15.795 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.795 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.795 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:15.796 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237797+0000", 2024-09-12T18:37:15.796 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001892007 2024-09-12T18:37:15.796 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.796 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.796 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:15.796 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237941+0000", 2024-09-12T18:37:15.796 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000143411 2024-09-12T18:37:15.796 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.796 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.796 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:15.796 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.238073+0000", 2024-09-12T18:37:15.796 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013254200000000001 2024-09-12T18:37:15.796 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.797 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:15.797 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.797 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.797 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.797 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121102 5.8 5:1f118f4b:::benchmark_data_smithi073_23739_object121101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:15.797 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.218682+0000", 2024-09-12T18:37:15.797 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 35.520056001999997, 2024-09-12T18:37:15.797 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024264885, 2024-09-12T18:37:15.797 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:15.797 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:15.797 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:15.797 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:15.797 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:15.798 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:15.798 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121102 2024-09-12T18:37:15.798 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.798 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:15.798 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.798 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:15.798 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218682+0000", 2024-09-12T18:37:15.798 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.798 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.798 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.798 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:15.798 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218682+0000", 2024-09-12T18:37:15.798 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.799 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.799 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.799 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:15.799 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218685+0000", 2024-09-12T18:37:15.799 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6059999999999999e-06 2024-09-12T18:37:15.799 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.799 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.799 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:15.799 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218743+0000", 2024-09-12T18:37:15.799 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7160999999999997e-05 2024-09-12T18:37:15.799 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.799 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.799 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:15.800 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218768+0000", 2024-09-12T18:37:15.800 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5052e-05 2024-09-12T18:37:15.800 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.800 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.800 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.800 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218785+0000", 2024-09-12T18:37:15.800 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7436999999999999e-05 2024-09-12T18:37:15.800 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.800 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.800 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:15.800 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218952+0000", 2024-09-12T18:37:15.800 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016691300000000001 2024-09-12T18:37:15.800 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.800 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.801 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:15.801 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.219437+0000", 2024-09-12T18:37:15.801 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048465900000000002 2024-09-12T18:37:15.801 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.801 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.801 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:15.801 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.219893+0000", 2024-09-12T18:37:15.801 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00045642799999999999 2024-09-12T18:37:15.801 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.801 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.801 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:15.801 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.226416+0000", 2024-09-12T18:37:15.801 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065225630000000003 2024-09-12T18:37:15.802 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.802 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.802 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:15.802 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242796+0000", 2024-09-12T18:37:15.802 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016379857000000001 2024-09-12T18:37:15.802 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.802 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.802 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:15.802 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242879+0000", 2024-09-12T18:37:15.802 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3913999999999997e-05 2024-09-12T18:37:15.802 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.802 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.802 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:15.802 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242947+0000", 2024-09-12T18:37:15.803 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7294999999999999e-05 2024-09-12T18:37:15.803 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.803 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:15.803 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.803 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.803 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.803 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121106 5.d 5:b4a9a221:::benchmark_data_smithi073_23739_object121105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:15.803 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:37:15.803 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 35.501558481000004, 2024-09-12T18:37:15.803 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.034882274999999997, 2024-09-12T18:37:15.803 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:15.803 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:15.804 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:15.804 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:15.804 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:15.804 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:15.804 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121106 2024-09-12T18:37:15.804 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.804 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:15.804 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.804 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:15.804 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:37:15.804 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.804 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.805 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.805 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:15.805 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:37:15.805 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.805 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.805 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.805 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:15.805 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237182+0000", 2024-09-12T18:37:15.805 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6019999999999998e-06 2024-09-12T18:37:15.805 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.805 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.805 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:15.805 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237257+0000", 2024-09-12T18:37:15.805 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5420999999999995e-05 2024-09-12T18:37:15.806 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.806 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.806 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:15.806 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237305+0000", 2024-09-12T18:37:15.806 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7207999999999999e-05 2024-09-12T18:37:15.806 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.806 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.806 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.806 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237325+0000", 2024-09-12T18:37:15.806 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0001e-05 2024-09-12T18:37:15.806 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.806 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.806 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:15.806 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237505+0000", 2024-09-12T18:37:15.807 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000180798 2024-09-12T18:37:15.807 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.807 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.807 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:15.807 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237764+0000", 2024-09-12T18:37:15.807 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025862299999999998 2024-09-12T18:37:15.807 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.807 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.807 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:15.807 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.238264+0000", 2024-09-12T18:37:15.807 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00050016100000000005 2024-09-12T18:37:15.807 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.807 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.807 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:15.808 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256525+0000", 2024-09-12T18:37:15.808 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018260508000000002 2024-09-12T18:37:15.808 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.808 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.808 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:15.808 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.271903+0000", 2024-09-12T18:37:15.808 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015378739000000001 2024-09-12T18:37:15.808 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.808 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.808 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:15.808 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.271999+0000", 2024-09-12T18:37:15.808 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5989000000000005e-05 2024-09-12T18:37:15.808 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.808 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.809 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:15.809 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272062+0000", 2024-09-12T18:37:15.809 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2224999999999995e-05 2024-09-12T18:37:15.809 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.809 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:15.809 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.809 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.809 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.809 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121112 5.d 5:b9a2d671:::benchmark_data_smithi073_23739_object121111:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:15.809 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.243446+0000", 2024-09-12T18:37:15.809 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 35.495291756, 2024-09-12T18:37:15.809 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.02889415, 2024-09-12T18:37:15.809 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:15.810 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:15.810 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:15.810 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:15.810 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:15.810 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:15.810 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121112 2024-09-12T18:37:15.810 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.810 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:15.810 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.810 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:15.810 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243446+0000", 2024-09-12T18:37:15.810 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.810 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.811 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.811 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:15.811 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243446+0000", 2024-09-12T18:37:15.811 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.811 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.811 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.811 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:15.811 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243448+0000", 2024-09-12T18:37:15.811 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0829999999999998e-06 2024-09-12T18:37:15.811 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.811 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.811 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:15.811 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243527+0000", 2024-09-12T18:37:15.812 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9173999999999998e-05 2024-09-12T18:37:15.812 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.812 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.812 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:15.812 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243549+0000", 2024-09-12T18:37:15.812 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1169e-05 2024-09-12T18:37:15.812 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.812 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.812 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.812 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243564+0000", 2024-09-12T18:37:15.812 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5866999999999999e-05 2024-09-12T18:37:15.812 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.812 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.813 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:15.813 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.249905+0000", 2024-09-12T18:37:15.813 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063410360000000004 2024-09-12T18:37:15.813 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.813 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.813 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:15.813 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.250166+0000", 2024-09-12T18:37:15.813 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026052999999999997 2024-09-12T18:37:15.813 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.813 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.813 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:15.813 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.250486+0000", 2024-09-12T18:37:15.813 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00032002700000000002 2024-09-12T18:37:15.813 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.814 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.814 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:15.814 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.259263+0000", 2024-09-12T18:37:15.814 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0087774770000000005 2024-09-12T18:37:15.814 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.814 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.814 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:15.814 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272186+0000", 2024-09-12T18:37:15.814 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.01292213 2024-09-12T18:37:15.814 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.814 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.814 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:15.814 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272267+0000", 2024-09-12T18:37:15.814 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1153e-05 2024-09-12T18:37:15.814 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.815 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.815 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:15.815 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272340+0000", 2024-09-12T18:37:15.815 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3504000000000006e-05 2024-09-12T18:37:15.815 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.815 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:15.815 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.815 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.815 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.815 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121114 5.d 5:b8870c11:::benchmark_data_smithi073_23739_object121113:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:15.815 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.243603+0000", 2024-09-12T18:37:15.815 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 35.495134505000003, 2024-09-12T18:37:15.815 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028945746000000001, 2024-09-12T18:37:15.815 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:15.816 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:15.816 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:15.816 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:15.816 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:15.816 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:15.816 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121114 2024-09-12T18:37:15.816 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.816 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:15.816 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.816 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:15.816 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243603+0000", 2024-09-12T18:37:15.816 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.816 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.816 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.817 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:15.817 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243603+0000", 2024-09-12T18:37:15.817 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.817 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.817 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.817 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:15.817 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243605+0000", 2024-09-12T18:37:15.817 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.268e-06 2024-09-12T18:37:15.817 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.817 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.817 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:15.817 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243674+0000", 2024-09-12T18:37:15.817 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9375000000000006e-05 2024-09-12T18:37:15.818 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.818 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.818 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:15.818 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243691+0000", 2024-09-12T18:37:15.818 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6517000000000001e-05 2024-09-12T18:37:15.818 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.818 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.818 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.818 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243702+0000", 2024-09-12T18:37:15.818 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1905999999999999e-05 2024-09-12T18:37:15.818 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.818 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.818 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:15.819 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.253789+0000", 2024-09-12T18:37:15.819 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.010086776 2024-09-12T18:37:15.819 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.819 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.819 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:15.819 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.253959+0000", 2024-09-12T18:37:15.819 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00017000000000000001 2024-09-12T18:37:15.819 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.819 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.819 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:15.819 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.254179+0000", 2024-09-12T18:37:15.819 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022003699999999999 2024-09-12T18:37:15.819 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.820 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.820 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:15.820 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.259330+0000", 2024-09-12T18:37:15.820 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0051511559999999996 2024-09-12T18:37:15.820 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.820 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.820 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:15.820 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272403+0000", 2024-09-12T18:37:15.820 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013072342000000001 2024-09-12T18:37:15.820 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.820 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.820 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:15.820 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272493+0000", 2024-09-12T18:37:15.820 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0595999999999998e-05 2024-09-12T18:37:15.821 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.821 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.821 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:15.821 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272549+0000", 2024-09-12T18:37:15.821 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5773000000000003e-05 2024-09-12T18:37:15.821 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.821 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:15.821 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.821 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.821 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.821 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121115 5.d 5:bd4a51ea:::benchmark_data_smithi073_23739_object121114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:15.821 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.245059+0000", 2024-09-12T18:37:15.821 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 35.493678830999997, 2024-09-12T18:37:15.821 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.02767406, 2024-09-12T18:37:15.822 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:15.822 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:15.822 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:15.822 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:15.822 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:15.822 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:15.822 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121115 2024-09-12T18:37:15.822 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.822 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:15.822 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.822 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:15.822 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245059+0000", 2024-09-12T18:37:15.822 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.822 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.823 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.823 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:15.823 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245059+0000", 2024-09-12T18:37:15.823 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.823 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.823 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.823 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:15.823 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245061+0000", 2024-09-12T18:37:15.823 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9759999999999998e-06 2024-09-12T18:37:15.823 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.823 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.823 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:15.823 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245111+0000", 2024-09-12T18:37:15.823 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9838e-05 2024-09-12T18:37:15.824 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.824 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.824 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:15.824 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245132+0000", 2024-09-12T18:37:15.824 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1469999999999999e-05 2024-09-12T18:37:15.824 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.824 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.824 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.824 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245146+0000", 2024-09-12T18:37:15.824 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3377000000000001e-05 2024-09-12T18:37:15.824 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.824 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.824 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:15.824 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256596+0000", 2024-09-12T18:37:15.825 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011450241999999999 2024-09-12T18:37:15.825 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.825 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.825 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:15.825 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256838+0000", 2024-09-12T18:37:15.825 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000242255 2024-09-12T18:37:15.825 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.825 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.825 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:15.825 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.257095+0000", 2024-09-12T18:37:15.825 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025679300000000001 2024-09-12T18:37:15.825 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.825 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.826 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:15.826 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.259928+0000", 2024-09-12T18:37:15.826 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0028326290000000001 2024-09-12T18:37:15.826 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.826 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.826 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:15.826 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272607+0000", 2024-09-12T18:37:15.826 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012679466 2024-09-12T18:37:15.826 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.826 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.826 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:15.826 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272681+0000", 2024-09-12T18:37:15.826 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3580999999999999e-05 2024-09-12T18:37:15.827 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.827 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.827 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:15.827 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272733+0000", 2024-09-12T18:37:15.827 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2432999999999998e-05 2024-09-12T18:37:15.827 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.827 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:15.827 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.827 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.827 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.827 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121148 5.4 5:2a9bde06:::benchmark_data_smithi073_23739_object121147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:15.827 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.281423+0000", 2024-09-12T18:37:15.827 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 35.457315188999999, 2024-09-12T18:37:15.827 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025774785000000001, 2024-09-12T18:37:15.828 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:15.828 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:15.828 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:15.828 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:15.828 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:15.828 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:15.828 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121148 2024-09-12T18:37:15.828 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.828 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:15.828 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.828 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:15.828 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281423+0000", 2024-09-12T18:37:15.828 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.829 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.829 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.829 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:15.829 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281423+0000", 2024-09-12T18:37:15.829 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.829 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.829 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.829 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:15.829 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281424+0000", 2024-09-12T18:37:15.829 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.048e-06 2024-09-12T18:37:15.829 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.829 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.829 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:15.829 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281496+0000", 2024-09-12T18:37:15.830 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2099000000000002e-05 2024-09-12T18:37:15.830 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.830 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.830 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:15.830 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281509+0000", 2024-09-12T18:37:15.830 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3379e-05 2024-09-12T18:37:15.830 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.830 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.830 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.830 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281515+0000", 2024-09-12T18:37:15.830 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.28e-06 2024-09-12T18:37:15.830 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.830 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.830 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:15.831 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281688+0000", 2024-09-12T18:37:15.831 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00017203100000000001 2024-09-12T18:37:15.831 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.831 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.831 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:15.831 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281834+0000", 2024-09-12T18:37:15.831 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014645899999999999 2024-09-12T18:37:15.831 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.831 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.831 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:15.831 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.282319+0000", 2024-09-12T18:37:15.831 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048535000000000001 2024-09-12T18:37:15.831 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.832 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.832 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:15.832 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307086+0000", 2024-09-12T18:37:15.832 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024766989999999999 2024-09-12T18:37:15.832 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.832 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.832 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:15.832 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307108+0000", 2024-09-12T18:37:15.832 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1795999999999999e-05 2024-09-12T18:37:15.832 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.832 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.832 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:15.832 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307157+0000", 2024-09-12T18:37:15.833 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8729000000000001e-05 2024-09-12T18:37:15.833 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.833 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.833 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:15.833 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307197+0000", 2024-09-12T18:37:15.833 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0624000000000003e-05 2024-09-12T18:37:15.833 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.833 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:15.833 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.833 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.833 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.833 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121155 5.4 5:2af257d1:::benchmark_data_smithi073_23739_object121154:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:15.834 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.283163+0000", 2024-09-12T18:37:15.834 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 35.455574513999998, 2024-09-12T18:37:15.834 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024186485000000001, 2024-09-12T18:37:15.834 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:15.834 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:15.834 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:15.834 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:15.834 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:15.834 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:15.834 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121155 2024-09-12T18:37:15.834 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.834 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:15.834 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.834 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:15.835 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283163+0000", 2024-09-12T18:37:15.835 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.835 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.835 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.835 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:15.835 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283163+0000", 2024-09-12T18:37:15.835 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.835 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.835 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.835 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:15.835 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283165+0000", 2024-09-12T18:37:15.835 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.748e-06 2024-09-12T18:37:15.835 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.836 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.836 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:15.836 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283218+0000", 2024-09-12T18:37:15.836 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2695000000000003e-05 2024-09-12T18:37:15.836 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.836 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.836 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:15.836 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283244+0000", 2024-09-12T18:37:15.836 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6072e-05 2024-09-12T18:37:15.836 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.836 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.836 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.836 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283257+0000", 2024-09-12T18:37:15.837 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3054000000000001e-05 2024-09-12T18:37:15.837 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.837 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.837 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:15.837 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.294509+0000", 2024-09-12T18:37:15.837 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011251677999999999 2024-09-12T18:37:15.837 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.837 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.837 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:15.837 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.294705+0000", 2024-09-12T18:37:15.837 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000196369 2024-09-12T18:37:15.837 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.837 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.838 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:15.838 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.294907+0000", 2024-09-12T18:37:15.838 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020184700000000001 2024-09-12T18:37:15.838 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.838 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.838 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:15.838 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307208+0000", 2024-09-12T18:37:15.838 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012301068 2024-09-12T18:37:15.838 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.838 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.838 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:15.838 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307273+0000", 2024-09-12T18:37:15.838 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5611000000000006e-05 2024-09-12T18:37:15.838 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.839 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.839 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:15.839 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307320+0000", 2024-09-12T18:37:15.839 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6220999999999997e-05 2024-09-12T18:37:15.839 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.839 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.839 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:15.839 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307350+0000", 2024-09-12T18:37:15.839 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0122000000000001e-05 2024-09-12T18:37:15.839 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.839 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:15.839 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.839 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.839 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.840 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121160 5.b 5:d4730c8e:::benchmark_data_smithi073_23739_object121159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:15.840 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.289262+0000", 2024-09-12T18:37:15.840 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 35.449475497999998, 2024-09-12T18:37:15.840 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024618870000000001, 2024-09-12T18:37:15.840 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:15.840 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:15.840 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:15.840 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:15.840 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:15.840 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:15.840 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121160 2024-09-12T18:37:15.840 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.840 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:15.841 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.841 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:15.841 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289262+0000", 2024-09-12T18:37:15.841 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.841 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.841 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.841 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:15.841 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289262+0000", 2024-09-12T18:37:15.841 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.841 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.841 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.841 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:15.841 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289264+0000", 2024-09-12T18:37:15.841 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.945e-06 2024-09-12T18:37:15.842 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.842 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.842 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:15.842 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289331+0000", 2024-09-12T18:37:15.842 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6594999999999995e-05 2024-09-12T18:37:15.842 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.842 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.842 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:15.842 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289359+0000", 2024-09-12T18:37:15.842 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7988999999999999e-05 2024-09-12T18:37:15.842 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.842 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.842 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.843 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289375+0000", 2024-09-12T18:37:15.843 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5639000000000001e-05 2024-09-12T18:37:15.843 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.843 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.843 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:15.843 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289515+0000", 2024-09-12T18:37:15.843 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000140254 2024-09-12T18:37:15.843 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.843 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.843 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:15.843 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289740+0000", 2024-09-12T18:37:15.843 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022513500000000001 2024-09-12T18:37:15.843 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.844 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.844 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:15.844 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.290232+0000", 2024-09-12T18:37:15.844 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00049247500000000003 2024-09-12T18:37:15.844 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.844 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.844 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:15.844 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.312221+0000", 2024-09-12T18:37:15.844 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.021988939999999998 2024-09-12T18:37:15.844 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.844 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.844 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:15.845 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.313807+0000", 2024-09-12T18:37:15.845 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015859100000000001 2024-09-12T18:37:15.845 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.845 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.845 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:15.845 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.313852+0000", 2024-09-12T18:37:15.845 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4305999999999999e-05 2024-09-12T18:37:15.845 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.845 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.845 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:15.845 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.313881+0000", 2024-09-12T18:37:15.845 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9682000000000001e-05 2024-09-12T18:37:15.845 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.846 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:15.846 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.846 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.846 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.846 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:131551 5.d 5:b8f8c77a:::benchmark_data_smithi073_23739_object131550:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:37:15.846 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:45.499878+0000", 2024-09-12T18:37:15.846 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 30.238859566999999, 2024-09-12T18:37:15.846 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.027478433, 2024-09-12T18:37:15.846 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:15.846 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:15.846 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:15.846 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:15.846 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:15.847 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:15.847 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 131551 2024-09-12T18:37:15.847 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.847 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:15.847 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.847 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:15.847 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499878+0000", 2024-09-12T18:37:15.847 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.847 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.847 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.847 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:15.847 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499878+0000", 2024-09-12T18:37:15.848 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.848 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.848 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.848 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:15.848 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499879+0000", 2024-09-12T18:37:15.848 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.92e-07 2024-09-12T18:37:15.848 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.848 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.848 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:15.848 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499946+0000", 2024-09-12T18:37:15.848 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6712999999999996e-05 2024-09-12T18:37:15.848 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.848 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.849 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:15.849 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499953+0000", 2024-09-12T18:37:15.849 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5519999999999999e-06 2024-09-12T18:37:15.849 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.849 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.849 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.849 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499959+0000", 2024-09-12T18:37:15.849 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0430000000000004e-06 2024-09-12T18:37:15.849 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.849 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.849 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:15.849 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.500004+0000", 2024-09-12T18:37:15.849 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5058000000000001e-05 2024-09-12T18:37:15.850 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.850 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.850 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:15.850 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.500121+0000", 2024-09-12T18:37:15.850 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000116747 2024-09-12T18:37:15.850 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.850 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.850 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:15.850 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.500283+0000", 2024-09-12T18:37:15.850 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016190599999999999 2024-09-12T18:37:15.850 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.850 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.850 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:15.851 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.504017+0000", 2024-09-12T18:37:15.851 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003734125 2024-09-12T18:37:15.851 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.851 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.851 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:15.851 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.527224+0000", 2024-09-12T18:37:15.851 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.023206724000000001 2024-09-12T18:37:15.851 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.851 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.851 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:15.851 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.527290+0000", 2024-09-12T18:37:15.851 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5778999999999995e-05 2024-09-12T18:37:15.851 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.851 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.852 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:15.852 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.527357+0000", 2024-09-12T18:37:15.852 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7094000000000005e-05 2024-09-12T18:37:15.852 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.852 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:15.852 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.852 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.852 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.852 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:167368 5.4 5:29a1ec58:::benchmark_data_smithi073_23739_object35091:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:15.852 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:03.168773+0000", 2024-09-12T18:37:15.852 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 12.569964614, 2024-09-12T18:37:15.852 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.066578597000000003, 2024-09-12T18:37:15.852 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:15.852 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:15.853 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:15.853 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:15.853 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:15.853 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:15.853 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 167368 2024-09-12T18:37:15.853 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.853 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:15.853 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.853 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:15.853 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168773+0000", 2024-09-12T18:37:15.853 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.853 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.853 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.854 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:15.854 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168773+0000", 2024-09-12T18:37:15.854 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.854 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.854 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.854 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:15.854 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168774+0000", 2024-09-12T18:37:15.854 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.023e-06 2024-09-12T18:37:15.854 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.854 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.854 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:15.854 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168779+0000", 2024-09-12T18:37:15.854 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5800000000000002e-06 2024-09-12T18:37:15.854 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.854 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.855 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:15.855 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168789+0000", 2024-09-12T18:37:15.855 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0346999999999999e-05 2024-09-12T18:37:15.855 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.855 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.855 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.855 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168808+0000", 2024-09-12T18:37:15.855 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8423e-05 2024-09-12T18:37:15.855 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.855 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.855 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:15.855 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168864+0000", 2024-09-12T18:37:15.855 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-09-12T18:37:15.855 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.855 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.855 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:15.856 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168947+0000", 2024-09-12T18:37:15.856 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3274000000000003e-05 2024-09-12T18:37:15.856 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.856 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.856 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:15.856 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.169014+0000", 2024-09-12T18:37:15.856 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6284000000000004e-05 2024-09-12T18:37:15.856 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.856 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.856 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:15.856 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.170653+0000", 2024-09-12T18:37:15.856 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016389779999999999 2024-09-12T18:37:15.856 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.857 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.857 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:15.857 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.235279+0000", 2024-09-12T18:37:15.857 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064626464999999994 2024-09-12T18:37:15.857 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.857 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.857 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:15.857 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.235320+0000", 2024-09-12T18:37:15.857 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0377000000000003e-05 2024-09-12T18:37:15.857 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.857 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.857 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:15.857 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.235352+0000", 2024-09-12T18:37:15.857 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2322e-05 2024-09-12T18:37:15.858 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.858 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:15.858 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.858 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.858 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.858 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:167371 5.4 5:24fea27c:::benchmark_data_smithi073_23739_object35094:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:15.858 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:03.171234+0000", 2024-09-12T18:37:15.858 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 12.567503588999999, 2024-09-12T18:37:15.858 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.066048171000000003, 2024-09-12T18:37:15.858 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:15.858 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:15.858 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:15.858 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:15.859 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:15.859 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:15.859 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 167371 2024-09-12T18:37:15.859 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.859 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:15.859 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.859 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:15.859 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171234+0000", 2024-09-12T18:37:15.859 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.859 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.859 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.859 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:15.859 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171234+0000", 2024-09-12T18:37:15.859 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:15.859 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.860 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.860 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:15.860 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171235+0000", 2024-09-12T18:37:15.860 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8599999999999997e-07 2024-09-12T18:37:15.860 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.860 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.860 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:15.860 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171238+0000", 2024-09-12T18:37:15.860 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9739999999999998e-06 2024-09-12T18:37:15.860 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.860 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.860 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:15.860 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171245+0000", 2024-09-12T18:37:15.860 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6000000000000003e-06 2024-09-12T18:37:15.861 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.861 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.861 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:15.861 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171249+0000", 2024-09-12T18:37:15.861 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9960000000000004e-06 2024-09-12T18:37:15.861 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.861 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.861 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:15.861 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171288+0000", 2024-09-12T18:37:15.861 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9119999999999998e-05 2024-09-12T18:37:15.861 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.861 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.861 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:15.861 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171359+0000", 2024-09-12T18:37:15.862 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0951000000000006e-05 2024-09-12T18:37:15.862 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.862 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.862 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:15.862 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171425+0000", 2024-09-12T18:37:15.862 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.58e-05 2024-09-12T18:37:15.862 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.862 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.862 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:15.862 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.173093+0000", 2024-09-12T18:37:15.862 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016683939999999999 2024-09-12T18:37:15.862 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.863 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.863 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:15.863 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.237202+0000", 2024-09-12T18:37:15.863 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064109437000000005 2024-09-12T18:37:15.863 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.863 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.863 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:15.863 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.237249+0000", 2024-09-12T18:37:15.863 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6751e-05 2024-09-12T18:37:15.863 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:15.863 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:15.863 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:15.863 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.237282+0000", 2024-09-12T18:37:15.863 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3262000000000001e-05 2024-09-12T18:37:15.863 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.864 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:15.864 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.864 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:15.864 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:15.864 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:15.865 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:15.858+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:15.866 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:37:15.966 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:15.962+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:16.017 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:16.018 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:37:16.018 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.018 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:194387 5.c e64/21 5:34d920bf:::benchmark_data_smithi073_23739_object62110:head v 64'12062, mlcod=64'12060)", 2024-09-12T18:37:16.018 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:16.010831+0000", 2024-09-12T18:37:16.018 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0041237820000000003, 2024-09-12T18:37:16.018 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0041434189999999997, 2024-09-12T18:37:16.018 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:16.018 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:16.018 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:37:16.018 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:16.018 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.019 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:16.019 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.010831+0000", 2024-09-12T18:37:16.019 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.019 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.019 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.019 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:16.019 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.010831+0000", 2024-09-12T18:37:16.019 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.019 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.019 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.019 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:16.019 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.010831+0000", 2024-09-12T18:37:16.019 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.3999999999999997e-07 2024-09-12T18:37:16.019 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.020 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.020 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:16.020 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.010835+0000", 2024-09-12T18:37:16.020 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5090000000000002e-06 2024-09-12T18:37:16.020 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.020 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.020 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:16.020 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.010845+0000", 2024-09-12T18:37:16.020 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0298e-05 2024-09-12T18:37:16.020 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.020 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.020 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:16.020 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.010860+0000", 2024-09-12T18:37:16.021 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4936999999999999e-05 2024-09-12T18:37:16.021 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.021 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.021 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:16.021 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.010905+0000", 2024-09-12T18:37:16.021 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4752000000000001e-05 2024-09-12T18:37:16.021 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.021 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.021 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:16.021 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.010923+0000", 2024-09-12T18:37:16.021 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.8026e-05 2024-09-12T18:37:16.021 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.021 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:16.021 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.022 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.022 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.022 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:194390 5.1 5:831fb870:::benchmark_data_smithi073_23739_object62113:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T18:37:16.022 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:16.011503+0000", 2024-09-12T18:37:16.022 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0034513959999999998, 2024-09-12T18:37:16.022 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003526089, 2024-09-12T18:37:16.022 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:16.022 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:16.022 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:16.022 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:16.022 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:16.022 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:16.022 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 194390 2024-09-12T18:37:16.023 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.023 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:16.023 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.023 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:16.023 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.011503+0000", 2024-09-12T18:37:16.023 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.023 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.023 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.023 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:16.023 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.011503+0000", 2024-09-12T18:37:16.024 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.024 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.024 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.024 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:16.024 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.011504+0000", 2024-09-12T18:37:16.024 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1179999999999999e-06 2024-09-12T18:37:16.024 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.024 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.024 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:16.024 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.011508+0000", 2024-09-12T18:37:16.024 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.0289999999999999e-06 2024-09-12T18:37:16.025 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.025 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.025 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:16.025 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.011518+0000", 2024-09-12T18:37:16.025 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.516e-06 2024-09-12T18:37:16.025 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.025 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.025 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:16.025 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.011524+0000", 2024-09-12T18:37:16.025 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9359999999999996e-06 2024-09-12T18:37:16.025 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.025 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.025 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:16.026 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.012087+0000", 2024-09-12T18:37:16.026 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00056304900000000004 2024-09-12T18:37:16.026 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.026 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.026 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:16.026 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.012202+0000", 2024-09-12T18:37:16.026 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000115225 2024-09-12T18:37:16.026 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.026 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.026 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:16.026 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.012318+0000", 2024-09-12T18:37:16.026 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000115815 2024-09-12T18:37:16.026 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.027 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.027 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:16.027 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.014473+0000", 2024-09-12T18:37:16.027 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0021554679999999998 2024-09-12T18:37:16.027 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.027 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.027 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:16.027 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.014502+0000", 2024-09-12T18:37:16.027 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.8992999999999998e-05 2024-09-12T18:37:16.027 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.027 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:16.027 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.027 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.028 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.028 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:194391 5.7 5:e06f7402:::benchmark_data_smithi073_23739_object62114:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T18:37:16.028 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:16.011538+0000", 2024-09-12T18:37:16.028 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.003417008, 2024-09-12T18:37:16.028 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0035630900000000001, 2024-09-12T18:37:16.028 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:16.028 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:16.028 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:16.028 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:16.028 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:16.028 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:16.028 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 194391 2024-09-12T18:37:16.029 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.029 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:16.029 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.029 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:16.029 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.011538+0000", 2024-09-12T18:37:16.029 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.029 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.029 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.029 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:16.029 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.011538+0000", 2024-09-12T18:37:16.029 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.029 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.029 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.029 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:16.030 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.011538+0000", 2024-09-12T18:37:16.030 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.2500000000000001e-07 2024-09-12T18:37:16.030 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.030 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.030 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:16.030 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.011540+0000", 2024-09-12T18:37:16.030 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.21e-06 2024-09-12T18:37:16.030 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.030 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.030 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:16.030 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.011546+0000", 2024-09-12T18:37:16.030 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.6690000000000003e-06 2024-09-12T18:37:16.030 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.031 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.031 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:16.031 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.011550+0000", 2024-09-12T18:37:16.031 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4959999999999998e-06 2024-09-12T18:37:16.031 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.031 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.031 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:16.031 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.011591+0000", 2024-09-12T18:37:16.031 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.0707000000000002e-05 2024-09-12T18:37:16.031 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.031 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.031 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:16.031 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.011693+0000", 2024-09-12T18:37:16.032 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010177 2024-09-12T18:37:16.032 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.032 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.032 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:16.032 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.011787+0000", 2024-09-12T18:37:16.032 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.4339999999999995e-05 2024-09-12T18:37:16.032 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.032 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.032 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:16.032 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.013626+0000", 2024-09-12T18:37:16.032 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0018389179999999999 2024-09-12T18:37:16.032 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.032 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:16.033 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.033 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.033 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.033 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:194374 5.9 5:9e95eecb:::benchmark_data_smithi073_23739_object62097:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T18:37:16.033 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:16.004555+0000", 2024-09-12T18:37:16.033 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.010399113999999999, 2024-09-12T18:37:16.033 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010610382999999999, 2024-09-12T18:37:16.033 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:16.033 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:16.033 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:16.033 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:16.033 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:16.033 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:16.034 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 194374 2024-09-12T18:37:16.034 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.034 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:16.034 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.034 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:16.034 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.004555+0000", 2024-09-12T18:37:16.034 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.034 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.034 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.034 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:16.034 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.004555+0000", 2024-09-12T18:37:16.034 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.034 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.035 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.035 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:16.035 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.004557+0000", 2024-09-12T18:37:16.035 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4720000000000001e-06 2024-09-12T18:37:16.035 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.035 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.035 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:16.035 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.004561+0000", 2024-09-12T18:37:16.035 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4719999999999997e-06 2024-09-12T18:37:16.035 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.035 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.035 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:16.035 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.004571+0000", 2024-09-12T18:37:16.036 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.3170000000000008e-06 2024-09-12T18:37:16.036 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.036 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.036 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:16.036 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.004579+0000", 2024-09-12T18:37:16.036 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.3119999999999994e-06 2024-09-12T18:37:16.036 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.036 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.036 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:16.036 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.004629+0000", 2024-09-12T18:37:16.036 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.0260000000000003e-05 2024-09-12T18:37:16.036 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.036 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.037 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:16.037 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.004746+0000", 2024-09-12T18:37:16.037 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000116261 2024-09-12T18:37:16.037 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.037 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.037 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:16.037 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.004888+0000", 2024-09-12T18:37:16.037 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014226899999999999 2024-09-12T18:37:16.037 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.037 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.037 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:16.037 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.007059+0000", 2024-09-12T18:37:16.037 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0021706859999999998 2024-09-12T18:37:16.038 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.038 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:16.038 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.038 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.038 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.038 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:194396 5.6 e64/21 5:67b7180b:::benchmark_data_smithi073_23739_object62119:head v 64'12222, mlcod=64'12219)", 2024-09-12T18:37:16.038 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:16.012993+0000", 2024-09-12T18:37:16.038 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0019611310000000001, 2024-09-12T18:37:16.038 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0022346409999999999, 2024-09-12T18:37:16.038 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:16.038 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:16.038 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:37:16.038 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:16.038 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.039 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:16.039 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.012993+0000", 2024-09-12T18:37:16.039 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.039 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.039 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.039 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:16.039 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.012993+0000", 2024-09-12T18:37:16.039 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.039 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.039 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.039 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:16.039 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.012994+0000", 2024-09-12T18:37:16.039 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.9699999999999996e-07 2024-09-12T18:37:16.039 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.040 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.040 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:16.040 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.012998+0000", 2024-09-12T18:37:16.040 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.9400000000000004e-06 2024-09-12T18:37:16.040 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.040 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.040 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:16.040 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.013004+0000", 2024-09-12T18:37:16.040 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4749999999999998e-06 2024-09-12T18:37:16.040 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.040 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.040 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:16.040 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.013009+0000", 2024-09-12T18:37:16.041 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6260000000000003e-06 2024-09-12T18:37:16.041 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.041 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.041 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:16.041 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.013048+0000", 2024-09-12T18:37:16.041 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.8933000000000001e-05 2024-09-12T18:37:16.041 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.041 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.041 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:16.041 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.013060+0000", 2024-09-12T18:37:16.041 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2490000000000001e-05 2024-09-12T18:37:16.041 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.041 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:16.041 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.042 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.042 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.042 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:194377 5.5 5:ae71957f:::benchmark_data_smithi073_23739_object62100:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T18:37:16.042 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:16.004935+0000", 2024-09-12T18:37:16.042 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.010019494, 2024-09-12T18:37:16.042 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010341652999999999, 2024-09-12T18:37:16.042 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:16.042 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:16.042 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:16.042 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:16.042 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:16.042 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:16.042 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 194377 2024-09-12T18:37:16.042 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.043 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:16.043 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.043 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:16.043 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.004935+0000", 2024-09-12T18:37:16.043 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.043 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.043 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.043 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:16.043 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.004935+0000", 2024-09-12T18:37:16.043 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.043 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.043 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.043 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:16.043 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.004936+0000", 2024-09-12T18:37:16.044 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9800000000000002e-07 2024-09-12T18:37:16.044 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.044 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.044 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:16.044 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.004941+0000", 2024-09-12T18:37:16.044 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.5549999999999996e-06 2024-09-12T18:37:16.044 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.044 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.044 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:16.044 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.004950+0000", 2024-09-12T18:37:16.044 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0250000000000008e-06 2024-09-12T18:37:16.044 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.044 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.045 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:16.045 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.004974+0000", 2024-09-12T18:37:16.045 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.3910999999999999e-05 2024-09-12T18:37:16.045 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.045 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.045 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:16.045 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.005021+0000", 2024-09-12T18:37:16.045 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.7098000000000002e-05 2024-09-12T18:37:16.045 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.045 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.045 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:16.045 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.005145+0000", 2024-09-12T18:37:16.045 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012436700000000001 2024-09-12T18:37:16.045 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.046 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.046 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:16.046 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.005261+0000", 2024-09-12T18:37:16.046 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000116175 2024-09-12T18:37:16.046 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.046 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.046 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:16.046 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.007085+0000", 2024-09-12T18:37:16.046 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0018238449999999999 2024-09-12T18:37:16.046 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.046 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.046 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:16.046 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.009045+0000", 2024-09-12T18:37:16.046 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0019596869999999999 2024-09-12T18:37:16.046 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.047 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.047 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:16.047 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015175+0000", 2024-09-12T18:37:16.047 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0061301949999999997 2024-09-12T18:37:16.047 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.047 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.047 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:16.047 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015235+0000", 2024-09-12T18:37:16.047 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9830999999999997e-05 2024-09-12T18:37:16.047 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.047 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:16.047 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.047 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.048 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.048 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:194393 5.c e64/21 5:3f9d40dd:::benchmark_data_smithi073_23739_object62116:head v 64'12063, mlcod=64'12060)", 2024-09-12T18:37:16.048 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:16.013855+0000", 2024-09-12T18:37:16.048 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0011000789999999999, 2024-09-12T18:37:16.048 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0015009419999999999, 2024-09-12T18:37:16.048 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:16.048 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:16.048 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:37:16.048 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:16.048 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.048 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:16.048 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.013855+0000", 2024-09-12T18:37:16.048 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.048 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.049 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.049 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:16.049 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.013855+0000", 2024-09-12T18:37:16.049 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.049 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.049 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.049 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:16.049 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.013855+0000", 2024-09-12T18:37:16.049 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4799999999999999e-07 2024-09-12T18:37:16.049 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.049 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.049 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:16.049 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.013859+0000", 2024-09-12T18:37:16.050 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.7960000000000002e-06 2024-09-12T18:37:16.050 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.050 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.050 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:16.050 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.013866+0000", 2024-09-12T18:37:16.050 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3250000000000002e-06 2024-09-12T18:37:16.050 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.050 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.050 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:16.050 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.013871+0000", 2024-09-12T18:37:16.050 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1429999999999997e-06 2024-09-12T18:37:16.050 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.050 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.051 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:16.051 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.013924+0000", 2024-09-12T18:37:16.051 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3059999999999997e-05 2024-09-12T18:37:16.051 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.051 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.051 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:16.051 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.013940+0000", 2024-09-12T18:37:16.051 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5999999999999999e-05 2024-09-12T18:37:16.051 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.051 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:16.051 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.051 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.051 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.052 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:194399 5.2 5:450fee3b:::benchmark_data_smithi073_23739_object62122:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T18:37:16.052 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:16.015022+0000", 2024-09-12T18:37:16.052 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 4294967295.9999328, 2024-09-12T18:37:16.052 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00038477200000000002, 2024-09-12T18:37:16.052 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:16.052 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:16.052 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:16.052 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:16.052 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:16.052 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:16.052 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 194399 2024-09-12T18:37:16.052 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.052 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:16.053 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.053 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:16.053 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015022+0000", 2024-09-12T18:37:16.053 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.053 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.053 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.053 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:16.053 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015022+0000", 2024-09-12T18:37:16.053 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.053 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.053 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.053 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:16.053 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015023+0000", 2024-09-12T18:37:16.054 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2729999999999999e-06 2024-09-12T18:37:16.054 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.054 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.054 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:16.054 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015028+0000", 2024-09-12T18:37:16.054 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.9370000000000003e-06 2024-09-12T18:37:16.054 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.054 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.054 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:16.054 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015037+0000", 2024-09-12T18:37:16.054 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.2110000000000004e-06 2024-09-12T18:37:16.054 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.054 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.055 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:16.055 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015042+0000", 2024-09-12T18:37:16.055 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.0579999999999997e-06 2024-09-12T18:37:16.055 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.055 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.055 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:16.055 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015103+0000", 2024-09-12T18:37:16.055 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.0195999999999998e-05 2024-09-12T18:37:16.055 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.055 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.055 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:16.055 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015220+0000", 2024-09-12T18:37:16.055 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000117113 2024-09-12T18:37:16.056 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.056 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.056 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:16.056 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015339+0000", 2024-09-12T18:37:16.056 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000119294 2024-09-12T18:37:16.056 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.056 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:16.056 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.056 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.056 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.056 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop_reply(client.4480.0:194380 5.1 e64/49 ondisk, result = 0)", 2024-09-12T18:37:16.056 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:16.015130+0000", 2024-09-12T18:37:16.057 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 4294967295.9998245, 2024-09-12T18:37:16.057 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00033247099999999998, 2024-09-12T18:37:16.057 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:16.057 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:16.057 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:37:16.057 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:16.057 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.057 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:16.057 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015130+0000", 2024-09-12T18:37:16.057 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.057 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.057 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.057 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:16.057 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015130+0000", 2024-09-12T18:37:16.058 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.058 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.058 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.058 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:16.058 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015130+0000", 2024-09-12T18:37:16.058 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.2000000000000001e-07 2024-09-12T18:37:16.058 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.058 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.058 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:16.058 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015133+0000", 2024-09-12T18:37:16.058 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.232e-06 2024-09-12T18:37:16.058 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.058 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.059 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:16.059 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015138+0000", 2024-09-12T18:37:16.059 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5929999999999996e-06 2024-09-12T18:37:16.059 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.059 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.059 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:16.059 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015143+0000", 2024-09-12T18:37:16.059 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4680000000000003e-06 2024-09-12T18:37:16.059 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.059 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.059 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:16.059 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015278+0000", 2024-09-12T18:37:16.059 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013530000000000001 2024-09-12T18:37:16.059 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.060 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.060 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:16.060 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015286+0000", 2024-09-12T18:37:16.060 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.0960000000000001e-06 2024-09-12T18:37:16.060 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.060 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:16.060 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.060 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.060 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.060 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "MOSDPGPushReply(5.1 64/49 [PushReplyOp(5:8fea1c7d:::benchmark_data_smithi073_23739_object67817:head)])", 2024-09-12T18:37:16.060 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:16.015172+0000", 2024-09-12T18:37:16.060 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 4294967295.9997821, 2024-09-12T18:37:16.060 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00033934200000000002, 2024-09-12T18:37:16.061 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:16.061 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:16.061 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "reached pg", 2024-09-12T18:37:16.061 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:16.061 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.061 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:16.061 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015172+0000", 2024-09-12T18:37:16.061 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.061 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.061 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.061 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:16.061 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015172+0000", 2024-09-12T18:37:16.061 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.061 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.062 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.062 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:16.062 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015173+0000", 2024-09-12T18:37:16.062 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.3699999999999999e-07 2024-09-12T18:37:16.062 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.062 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.062 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:16.062 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015176+0000", 2024-09-12T18:37:16.062 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.1540000000000002e-06 2024-09-12T18:37:16.062 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.062 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.062 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:16.062 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015182+0000", 2024-09-12T18:37:16.063 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.1750000000000002e-06 2024-09-12T18:37:16.063 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.063 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.063 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:16.063 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015189+0000", 2024-09-12T18:37:16.063 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4810000000000003e-06 2024-09-12T18:37:16.063 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.063 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.063 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:16.063 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015503+0000", 2024-09-12T18:37:16.063 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031481199999999998 2024-09-12T18:37:16.063 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.063 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:16.063 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.064 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.064 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.064 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop_reply(client.4480.0:194390 5.1 e64/49)", 2024-09-12T18:37:16.064 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:16.015421+0000", 2024-09-12T18:37:16.064 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 4294967295.9995337, 2024-09-12T18:37:16.064 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013073499999999999, 2024-09-12T18:37:16.064 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:16.064 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:16.064 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:16.064 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:16.064 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.064 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:16.064 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015421+0000", 2024-09-12T18:37:16.065 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.065 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.065 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.065 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:16.065 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015421+0000", 2024-09-12T18:37:16.065 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.065 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.065 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.065 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:16.065 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015422+0000", 2024-09-12T18:37:16.065 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.3399999999999999e-07 2024-09-12T18:37:16.065 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.065 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.065 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:16.066 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015426+0000", 2024-09-12T18:37:16.066 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.912e-06 2024-09-12T18:37:16.066 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.066 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.066 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:16.066 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015434+0000", 2024-09-12T18:37:16.066 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.0010000000000001e-06 2024-09-12T18:37:16.066 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.066 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.066 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:16.066 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015440+0000", 2024-09-12T18:37:16.066 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.6359999999999997e-06 2024-09-12T18:37:16.066 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.066 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:16.067 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.067 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.067 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.067 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:194402 5.9 5.5c637b69 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T18:37:16.067 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:16.015535+0000", 2024-09-12T18:37:16.067 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 4294967295.9994197, 2024-09-12T18:37:16.067 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.8770000000000001e-05, 2024-09-12T18:37:16.067 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:16.067 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:16.067 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:16.067 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:16.067 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:16.067 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:16.068 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 194402 2024-09-12T18:37:16.068 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.068 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:16.068 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.068 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:16.068 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015535+0000", 2024-09-12T18:37:16.068 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.068 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.068 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.068 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:16.068 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015535+0000", 2024-09-12T18:37:16.068 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.068 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.069 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.069 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:16.069 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015535+0000", 2024-09-12T18:37:16.069 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.6100000000000001e-07 2024-09-12T18:37:16.069 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.069 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.069 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:16.069 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015538+0000", 2024-09-12T18:37:16.069 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.0680000000000001e-06 2024-09-12T18:37:16.069 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.069 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.069 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:16.069 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015544+0000", 2024-09-12T18:37:16.070 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.305e-06 2024-09-12T18:37:16.070 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.070 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.070 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:16.070 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015548+0000", 2024-09-12T18:37:16.070 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4100000000000001e-06 2024-09-12T18:37:16.070 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.070 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:16.070 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.070 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.070 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.070 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:194403 5.5 5.1fb348b5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T18:37:16.071 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:16.015587+0000", 2024-09-12T18:37:16.071 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 4294967295.9993677, 2024-09-12T18:37:16.071 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1088999999999998e-05, 2024-09-12T18:37:16.071 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:16.071 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:16.071 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:16.071 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:16.071 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:16.071 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:16.071 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 194403 2024-09-12T18:37:16.071 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.071 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:16.072 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.072 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:16.072 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015587+0000", 2024-09-12T18:37:16.072 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.072 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.072 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.072 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:16.072 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015587+0000", 2024-09-12T18:37:16.072 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.072 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.072 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.072 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:16.072 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015588+0000", 2024-09-12T18:37:16.072 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.2999999999999999e-07 2024-09-12T18:37:16.073 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.073 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.073 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:16.073 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015591+0000", 2024-09-12T18:37:16.073 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.7629999999999998e-06 2024-09-12T18:37:16.073 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.073 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.073 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:16.073 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015600+0000", 2024-09-12T18:37:16.073 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1699999999999997e-06 2024-09-12T18:37:16.073 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.073 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.073 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:16.074 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.015605+0000", 2024-09-12T18:37:16.074 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.9520000000000002e-06 2024-09-12T18:37:16.074 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.074 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:16.074 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.074 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.074 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.074 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:194388 5.7 5:ec9c4814:::benchmark_data_smithi073_23739_object62111:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T18:37:16.074 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:16.009442+0000", 2024-09-12T18:37:16.074 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0055128349999999998, 2024-09-12T18:37:16.074 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0062437630000000003, 2024-09-12T18:37:16.074 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:16.074 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:16.074 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:16.075 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:16.075 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:16.075 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:16.075 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 194388 2024-09-12T18:37:16.075 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.075 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:16.075 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.075 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:16.075 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.009442+0000", 2024-09-12T18:37:16.075 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.075 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.075 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.075 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:16.076 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.009442+0000", 2024-09-12T18:37:16.076 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.076 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.076 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.076 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:16.076 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.009443+0000", 2024-09-12T18:37:16.076 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.094e-06 2024-09-12T18:37:16.076 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.076 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.076 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:16.076 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.009447+0000", 2024-09-12T18:37:16.076 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4000000000000002e-06 2024-09-12T18:37:16.076 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.076 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.077 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:16.077 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.009456+0000", 2024-09-12T18:37:16.077 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4400000000000005e-06 2024-09-12T18:37:16.077 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.077 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.077 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:16.077 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.009462+0000", 2024-09-12T18:37:16.077 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.6599999999999998e-06 2024-09-12T18:37:16.077 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.077 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.077 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:16.077 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.009514+0000", 2024-09-12T18:37:16.078 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1595999999999999e-05 2024-09-12T18:37:16.078 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.078 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.078 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:16.078 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.009623+0000", 2024-09-12T18:37:16.078 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000109137 2024-09-12T18:37:16.078 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.078 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.078 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:16.078 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.009728+0000", 2024-09-12T18:37:16.078 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010454300000000001 2024-09-12T18:37:16.078 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.078 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.079 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:16.079 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:16.013150+0000", 2024-09-12T18:37:16.079 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0034223880000000002 2024-09-12T18:37:16.079 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.079 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:16.079 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.079 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.079 INFO:teuthology.orchestra.run.smithi162.stdout: ], 2024-09-12T18:37:16.079 INFO:teuthology.orchestra.run.smithi162.stdout: "num_ops": 14 2024-09-12T18:37:16.079 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:16.080 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:16.072+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:16.081 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:37:16.181 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:16.174+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:16.259 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:16.259 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [], 2024-09-12T18:37:16.259 INFO:teuthology.orchestra.run.smithi162.stdout: "complaint_time": 30, 2024-09-12T18:37:16.259 INFO:teuthology.orchestra.run.smithi162.stdout: "num_blocked_ops": 0 2024-09-12T18:37:16.259 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:16.273 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:37:16.318 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:16.314+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:16.382 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:16.378+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:16.396 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:16.396 INFO:teuthology.orchestra.run.smithi162.stdout: "size": 20, 2024-09-12T18:37:16.396 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 600, 2024-09-12T18:37:16.396 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:37:16.396 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.396 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4154.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:37:16.396 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:37:16.396 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 122.414591128, 2024-09-12T18:37:16.396 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025950709999999998, 2024-09-12T18:37:16.397 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:16.397 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:16.397 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:16.397 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:16.397 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4154", 2024-09-12T18:37:16.397 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/745129001", 2024-09-12T18:37:16.397 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 124 2024-09-12T18:37:16.397 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.397 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:16.397 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.397 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:16.397 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:37:16.397 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.397 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.398 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.398 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:16.398 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:37:16.398 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.398 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.398 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.398 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:16.398 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976562+0000", 2024-09-12T18:37:16.398 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.2999999999999999e-07 2024-09-12T18:37:16.398 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.399 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.399 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:16.399 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976567+0000", 2024-09-12T18:37:16.399 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3430000000000003e-06 2024-09-12T18:37:16.399 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.399 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.399 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:16.399 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976576+0000", 2024-09-12T18:37:16.399 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8070000000000006e-06 2024-09-12T18:37:16.399 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.399 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.399 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:16.399 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976583+0000", 2024-09-12T18:37:16.400 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9959999999999996e-06 2024-09-12T18:37:16.400 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.400 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.400 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:16.400 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997107+0000", 2024-09-12T18:37:16.400 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.020524106 2024-09-12T18:37:16.400 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.400 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.400 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:16.400 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997225+0000", 2024-09-12T18:37:16.400 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000117909 2024-09-12T18:37:16.400 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.400 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.400 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:16.401 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997407+0000", 2024-09-12T18:37:16.401 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00018175900000000001 2024-09-12T18:37:16.401 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.401 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.401 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:16.401 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998839+0000", 2024-09-12T18:37:16.401 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001432539 2024-09-12T18:37:16.401 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.401 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.401 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:16.401 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002319+0000", 2024-09-12T18:37:16.401 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0034803529999999998 2024-09-12T18:37:16.401 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.401 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.402 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:16.402 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002405+0000", 2024-09-12T18:37:16.402 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5434999999999998e-05 2024-09-12T18:37:16.402 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.402 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.402 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:16.402 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002512+0000", 2024-09-12T18:37:16.402 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010663299999999999 2024-09-12T18:37:16.402 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.402 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:16.402 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.402 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.402 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.402 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:16.403 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:37:16.403 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 110.74979362099999, 2024-09-12T18:37:16.403 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025127867000000002, 2024-09-12T18:37:16.403 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:16.403 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:16.403 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:16.403 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:16.403 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.403 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:16.403 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:37:16.404 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.404 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.404 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.404 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:16.404 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:37:16.404 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.404 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.404 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.404 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:16.404 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641362+0000", 2024-09-12T18:37:16.404 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.2569999999999999e-06 2024-09-12T18:37:16.404 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.404 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.405 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:16.405 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641374+0000", 2024-09-12T18:37:16.405 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2696e-05 2024-09-12T18:37:16.405 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.405 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.405 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:16.405 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641403+0000", 2024-09-12T18:37:16.405 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.8756999999999999e-05 2024-09-12T18:37:16.405 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.405 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.405 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:16.405 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641430+0000", 2024-09-12T18:37:16.405 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.6452999999999999e-05 2024-09-12T18:37:16.405 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.406 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.406 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:16.406 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641585+0000", 2024-09-12T18:37:16.406 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000155799 2024-09-12T18:37:16.406 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.406 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.406 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:16.406 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641753+0000", 2024-09-12T18:37:16.406 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000167868 2024-09-12T18:37:16.406 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.406 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.406 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:16.406 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641916+0000", 2024-09-12T18:37:16.407 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000162903 2024-09-12T18:37:16.407 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.407 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.407 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:16.407 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653655+0000", 2024-09-12T18:37:16.407 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011738879000000001 2024-09-12T18:37:16.407 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.407 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.407 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:16.407 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665515+0000", 2024-09-12T18:37:16.407 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011859915 2024-09-12T18:37:16.407 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.407 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.407 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:16.408 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665646+0000", 2024-09-12T18:37:16.408 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013122599999999999 2024-09-12T18:37:16.408 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.408 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.408 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:16.408 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666486+0000", 2024-09-12T18:37:16.408 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00084011399999999999 2024-09-12T18:37:16.408 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.408 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:16.408 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.408 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.408 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.408 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:16.408 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:37:16.409 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 110.74967915800001, 2024-09-12T18:37:16.409 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025384584000000002, 2024-09-12T18:37:16.409 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:16.409 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:16.409 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:16.409 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:16.409 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.409 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:16.409 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:37:16.409 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.409 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.409 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.409 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:16.409 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:37:16.410 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.410 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.410 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.410 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:16.410 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641474+0000", 2024-09-12T18:37:16.410 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.39e-06 2024-09-12T18:37:16.410 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.410 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.410 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:16.410 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641482+0000", 2024-09-12T18:37:16.410 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3499999999999999e-06 2024-09-12T18:37:16.410 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.410 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.410 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:16.411 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641534+0000", 2024-09-12T18:37:16.411 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2533e-05 2024-09-12T18:37:16.411 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.411 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.411 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:16.411 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641551+0000", 2024-09-12T18:37:16.411 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6515999999999999e-05 2024-09-12T18:37:16.411 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.411 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.411 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:16.411 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642630+0000", 2024-09-12T18:37:16.411 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001079705 2024-09-12T18:37:16.411 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.411 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.412 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:16.412 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642909+0000", 2024-09-12T18:37:16.412 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027859800000000002 2024-09-12T18:37:16.412 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.412 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.412 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:16.412 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643137+0000", 2024-09-12T18:37:16.412 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022803799999999999 2024-09-12T18:37:16.412 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.412 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.412 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:16.412 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653669+0000", 2024-09-12T18:37:16.412 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010532032 2024-09-12T18:37:16.413 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.413 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.413 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:16.413 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666624+0000", 2024-09-12T18:37:16.413 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012954940999999999 2024-09-12T18:37:16.413 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.413 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.413 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:16.413 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666762+0000", 2024-09-12T18:37:16.413 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000137668 2024-09-12T18:37:16.413 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.413 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.413 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:16.413 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666857+0000", 2024-09-12T18:37:16.414 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.5812999999999999e-05 2024-09-12T18:37:16.414 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.414 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:16.414 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.414 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.414 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.414 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:16.414 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:37:16.414 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 110.74955136299999, 2024-09-12T18:37:16.414 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025661562999999998, 2024-09-12T18:37:16.414 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:16.414 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:16.414 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:16.414 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:16.415 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.415 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:16.415 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:37:16.415 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.415 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.415 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.415 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:16.415 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:37:16.415 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.415 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.415 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.415 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:16.415 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641602+0000", 2024-09-12T18:37:16.415 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3540000000000001e-06 2024-09-12T18:37:16.416 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.416 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.416 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:16.416 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641637+0000", 2024-09-12T18:37:16.416 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5145999999999999e-05 2024-09-12T18:37:16.416 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.416 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.416 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:16.416 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641659+0000", 2024-09-12T18:37:16.416 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2249999999999999e-05 2024-09-12T18:37:16.416 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.416 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.416 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:16.417 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641675+0000", 2024-09-12T18:37:16.417 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6059999999999999e-05 2024-09-12T18:37:16.417 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.417 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.417 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:16.417 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644570+0000", 2024-09-12T18:37:16.417 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028947069999999998 2024-09-12T18:37:16.417 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.417 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.417 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:16.417 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644900+0000", 2024-09-12T18:37:16.417 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000329401 2024-09-12T18:37:16.417 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.418 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.418 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:16.418 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645235+0000", 2024-09-12T18:37:16.418 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000335874 2024-09-12T18:37:16.418 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.418 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.418 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:16.418 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655459+0000", 2024-09-12T18:37:16.418 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010223441999999999 2024-09-12T18:37:16.418 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.418 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.418 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:16.418 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667028+0000", 2024-09-12T18:37:16.419 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011568673999999999 2024-09-12T18:37:16.419 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.419 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.419 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:16.419 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667163+0000", 2024-09-12T18:37:16.419 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013525500000000001 2024-09-12T18:37:16.419 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.419 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.419 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:16.419 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667262+0000", 2024-09-12T18:37:16.419 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9400000000000004e-05 2024-09-12T18:37:16.419 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.419 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:16.419 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.420 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.420 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.420 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:16.420 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:37:16.420 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 110.749449543, 2024-09-12T18:37:16.420 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025971339, 2024-09-12T18:37:16.420 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:16.420 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:16.420 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:16.420 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:16.420 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.420 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:16.420 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:37:16.421 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.421 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.421 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.421 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:16.421 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:37:16.421 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.421 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.421 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.421 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:16.421 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641704+0000", 2024-09-12T18:37:16.421 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.297e-06 2024-09-12T18:37:16.421 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.421 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.421 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:16.422 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641712+0000", 2024-09-12T18:37:16.422 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.9060000000000002e-06 2024-09-12T18:37:16.422 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.422 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.422 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:16.422 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641731+0000", 2024-09-12T18:37:16.422 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9083e-05 2024-09-12T18:37:16.422 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.422 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.422 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:16.422 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641745+0000", 2024-09-12T18:37:16.422 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4066999999999999e-05 2024-09-12T18:37:16.422 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.422 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.423 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:16.423 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646529+0000", 2024-09-12T18:37:16.423 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.004784033 2024-09-12T18:37:16.423 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.423 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.423 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:16.423 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646727+0000", 2024-09-12T18:37:16.423 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019841800000000001 2024-09-12T18:37:16.423 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.423 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.423 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:16.423 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647057+0000", 2024-09-12T18:37:16.423 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032926800000000002 2024-09-12T18:37:16.423 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.424 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.424 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:16.424 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655475+0000", 2024-09-12T18:37:16.424 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0084186250000000008 2024-09-12T18:37:16.424 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.424 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.424 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:16.424 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667424+0000", 2024-09-12T18:37:16.424 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011949257 2024-09-12T18:37:16.424 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.424 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.424 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:16.424 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667573+0000", 2024-09-12T18:37:16.424 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014851900000000001 2024-09-12T18:37:16.425 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.425 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.425 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:16.425 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667674+0000", 2024-09-12T18:37:16.425 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010086600000000001 2024-09-12T18:37:16.425 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.425 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:16.425 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.425 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.425 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.425 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:16.425 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:37:16.425 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 110.749387154, 2024-09-12T18:37:16.426 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026215008000000001, 2024-09-12T18:37:16.426 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:16.426 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:16.426 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:16.426 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:16.426 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.426 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:16.426 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:37:16.426 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.426 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.426 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.426 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:16.427 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:37:16.427 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.427 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.427 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.427 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:16.427 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641766+0000", 2024-09-12T18:37:16.427 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1200000000000001e-06 2024-09-12T18:37:16.427 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.427 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.427 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:16.427 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641775+0000", 2024-09-12T18:37:16.427 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.2499999999999995e-06 2024-09-12T18:37:16.427 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.427 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.428 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:16.428 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641793+0000", 2024-09-12T18:37:16.428 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7773000000000001e-05 2024-09-12T18:37:16.428 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.428 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.428 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:16.428 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641807+0000", 2024-09-12T18:37:16.428 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3814e-05 2024-09-12T18:37:16.428 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.428 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.428 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:16.428 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647626+0000", 2024-09-12T18:37:16.428 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0058193050000000003 2024-09-12T18:37:16.429 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.429 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.429 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:16.429 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647937+0000", 2024-09-12T18:37:16.429 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031112400000000003 2024-09-12T18:37:16.429 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.429 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.429 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:16.429 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648239+0000", 2024-09-12T18:37:16.429 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00030227500000000002 2024-09-12T18:37:16.429 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.429 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.429 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:16.430 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655487+0000", 2024-09-12T18:37:16.430 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072479129999999999 2024-09-12T18:37:16.430 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.430 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.430 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:16.430 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667823+0000", 2024-09-12T18:37:16.430 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012335505 2024-09-12T18:37:16.430 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.430 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.430 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:16.430 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667908+0000", 2024-09-12T18:37:16.430 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4843000000000001e-05 2024-09-12T18:37:16.431 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.431 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.431 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:16.431 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667980+0000", 2024-09-12T18:37:16.431 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2086000000000001e-05 2024-09-12T18:37:16.431 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.431 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:16.431 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.431 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.431 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.431 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:16.431 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:37:16.431 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 110.749327001, 2024-09-12T18:37:16.432 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026483236, 2024-09-12T18:37:16.432 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:16.432 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:16.432 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:16.432 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:16.432 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.432 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:16.432 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:37:16.432 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.432 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.432 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.432 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:16.432 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:37:16.433 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.433 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.433 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.433 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:16.433 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641826+0000", 2024-09-12T18:37:16.433 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:37:16.433 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.433 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.433 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:16.433 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641832+0000", 2024-09-12T18:37:16.433 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4199999999999998e-06 2024-09-12T18:37:16.433 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.433 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.434 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:16.434 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641848+0000", 2024-09-12T18:37:16.434 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6492999999999999e-05 2024-09-12T18:37:16.434 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.434 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.434 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:16.434 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641863+0000", 2024-09-12T18:37:16.434 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5427e-05 2024-09-12T18:37:16.434 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.434 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.434 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:16.434 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648887+0000", 2024-09-12T18:37:16.434 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0070230860000000004 2024-09-12T18:37:16.434 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.435 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.435 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:16.435 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649111+0000", 2024-09-12T18:37:16.435 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022425799999999999 2024-09-12T18:37:16.435 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.435 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.435 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:16.435 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649494+0000", 2024-09-12T18:37:16.435 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00038349400000000001 2024-09-12T18:37:16.435 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.435 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.435 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:16.435 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655499+0000", 2024-09-12T18:37:16.436 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0060047260000000002 2024-09-12T18:37:16.436 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.436 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.436 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:16.436 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668110+0000", 2024-09-12T18:37:16.436 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012610543 2024-09-12T18:37:16.436 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.436 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.436 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:16.436 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668252+0000", 2024-09-12T18:37:16.436 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014265600000000001 2024-09-12T18:37:16.436 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.436 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.437 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:16.437 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668308+0000", 2024-09-12T18:37:16.437 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5992999999999997e-05 2024-09-12T18:37:16.437 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.437 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:16.437 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.437 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.437 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.437 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:16.437 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:37:16.437 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 110.749271785, 2024-09-12T18:37:16.437 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026605302000000001, 2024-09-12T18:37:16.437 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:16.437 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:16.438 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:16.438 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:16.438 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.438 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:16.438 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:37:16.438 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.438 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.438 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.438 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:16.438 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:37:16.438 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.438 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.438 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.438 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:16.438 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641881+0000", 2024-09-12T18:37:16.439 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.057e-06 2024-09-12T18:37:16.439 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.439 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.439 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:16.439 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641887+0000", 2024-09-12T18:37:16.439 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.6629999999999998e-06 2024-09-12T18:37:16.439 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.439 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.439 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:16.439 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641903+0000", 2024-09-12T18:37:16.439 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6317e-05 2024-09-12T18:37:16.439 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.439 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.440 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:16.440 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641917+0000", 2024-09-12T18:37:16.440 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3339999999999999e-05 2024-09-12T18:37:16.440 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.440 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.440 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:16.440 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650708+0000", 2024-09-12T18:37:16.440 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.008791419 2024-09-12T18:37:16.440 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.440 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.440 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:16.440 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651021+0000", 2024-09-12T18:37:16.440 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031296699999999999 2024-09-12T18:37:16.440 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.441 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.441 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:16.441 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651349+0000", 2024-09-12T18:37:16.441 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032796499999999999 2024-09-12T18:37:16.441 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.441 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.441 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:16.441 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655742+0000", 2024-09-12T18:37:16.441 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0043934680000000002 2024-09-12T18:37:16.441 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.441 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.441 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:16.441 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668377+0000", 2024-09-12T18:37:16.442 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012634312999999999 2024-09-12T18:37:16.442 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.442 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.442 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:16.442 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668441+0000", 2024-09-12T18:37:16.442 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4369999999999995e-05 2024-09-12T18:37:16.442 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.442 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.442 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:16.442 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668485+0000", 2024-09-12T18:37:16.442 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4422999999999998e-05 2024-09-12T18:37:16.442 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.442 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:16.443 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.443 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.443 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.443 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:16.443 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:37:16.443 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 110.74921438200001, 2024-09-12T18:37:16.443 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026919499, 2024-09-12T18:37:16.443 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:16.443 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:16.443 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:16.443 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:16.443 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.443 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:16.443 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:37:16.444 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.444 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.444 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.444 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:16.444 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:37:16.444 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.444 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.444 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.444 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:16.444 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641939+0000", 2024-09-12T18:37:16.444 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9399999999999993e-07 2024-09-12T18:37:16.444 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.444 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.444 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:16.445 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641945+0000", 2024-09-12T18:37:16.445 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9200000000000001e-06 2024-09-12T18:37:16.445 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.445 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.445 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:16.445 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641961+0000", 2024-09-12T18:37:16.445 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6520000000000001e-05 2024-09-12T18:37:16.445 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.445 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.445 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:16.445 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641974+0000", 2024-09-12T18:37:16.445 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3413e-05 2024-09-12T18:37:16.445 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.446 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.446 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:16.446 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654560+0000", 2024-09-12T18:37:16.446 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012585308999999999 2024-09-12T18:37:16.446 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.446 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.446 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:16.446 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654822+0000", 2024-09-12T18:37:16.446 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026210099999999999 2024-09-12T18:37:16.446 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.446 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.446 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:16.446 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655059+0000", 2024-09-12T18:37:16.447 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00023747899999999999 2024-09-12T18:37:16.447 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.447 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.447 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:16.447 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.656315+0000", 2024-09-12T18:37:16.447 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0012555000000000001 2024-09-12T18:37:16.447 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.447 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.447 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:16.447 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668590+0000", 2024-09-12T18:37:16.447 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012274851999999999 2024-09-12T18:37:16.447 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.447 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.447 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:16.448 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668725+0000", 2024-09-12T18:37:16.448 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013524199999999999 2024-09-12T18:37:16.448 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.448 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.448 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:16.448 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668857+0000", 2024-09-12T18:37:16.448 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013216899999999999 2024-09-12T18:37:16.448 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.448 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:16.448 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.448 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.448 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.448 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:16.449 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:37:16.449 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 110.749032997, 2024-09-12T18:37:16.449 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024670563, 2024-09-12T18:37:16.449 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:16.449 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:16.449 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:16.449 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:16.449 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.449 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:16.449 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:37:16.449 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.449 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.449 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.450 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:16.450 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:37:16.450 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.450 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.450 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.450 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:16.450 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642120+0000", 2024-09-12T18:37:16.450 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1769999999999999e-06 2024-09-12T18:37:16.450 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.450 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.450 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:16.450 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642128+0000", 2024-09-12T18:37:16.451 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3429999999999998e-06 2024-09-12T18:37:16.451 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.451 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.451 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:16.451 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642192+0000", 2024-09-12T18:37:16.451 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4406999999999995e-05 2024-09-12T18:37:16.451 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.451 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.451 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:16.451 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642223+0000", 2024-09-12T18:37:16.451 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.1266000000000002e-05 2024-09-12T18:37:16.451 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.451 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.451 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:16.452 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643201+0000", 2024-09-12T18:37:16.452 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0009778390000000001 2024-09-12T18:37:16.452 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.452 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.452 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:16.452 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643410+0000", 2024-09-12T18:37:16.452 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020874199999999999 2024-09-12T18:37:16.452 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.452 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.452 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:16.452 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643685+0000", 2024-09-12T18:37:16.452 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027520700000000002 2024-09-12T18:37:16.452 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.452 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.453 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:16.453 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650966+0000", 2024-09-12T18:37:16.453 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072810710000000001 2024-09-12T18:37:16.453 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.453 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.453 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:16.453 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666560+0000", 2024-09-12T18:37:16.453 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015594143 2024-09-12T18:37:16.453 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.453 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.453 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:16.453 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666691+0000", 2024-09-12T18:37:16.453 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000130359 2024-09-12T18:37:16.454 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.454 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.454 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:16.454 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666790+0000", 2024-09-12T18:37:16.454 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9009e-05 2024-09-12T18:37:16.454 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.454 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:16.454 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.454 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.454 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.454 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:16.454 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:37:16.454 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 110.74825470899999, 2024-09-12T18:37:16.455 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024891744, 2024-09-12T18:37:16.455 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:16.455 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:16.455 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:16.455 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:16.455 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.455 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:16.455 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:37:16.455 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.455 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.455 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.455 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:16.455 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:37:16.455 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.456 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.456 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.456 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:16.456 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642899+0000", 2024-09-12T18:37:16.456 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4729999999999999e-06 2024-09-12T18:37:16.456 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.456 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.456 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:16.456 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642912+0000", 2024-09-12T18:37:16.456 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3495999999999999e-05 2024-09-12T18:37:16.456 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.456 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.456 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:16.456 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642934+0000", 2024-09-12T18:37:16.457 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2033999999999999e-05 2024-09-12T18:37:16.457 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.457 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.457 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:16.457 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642949+0000", 2024-09-12T18:37:16.457 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4970000000000001e-05 2024-09-12T18:37:16.457 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.457 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.457 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:16.457 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644400+0000", 2024-09-12T18:37:16.457 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001450305 2024-09-12T18:37:16.457 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.457 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.458 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:16.458 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644617+0000", 2024-09-12T18:37:16.458 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000217302 2024-09-12T18:37:16.458 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.458 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.458 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:16.458 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645052+0000", 2024-09-12T18:37:16.458 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000434797 2024-09-12T18:37:16.458 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.458 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.458 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:16.458 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653860+0000", 2024-09-12T18:37:16.458 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0088082249999999994 2024-09-12T18:37:16.459 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.459 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.459 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:16.459 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667598+0000", 2024-09-12T18:37:16.459 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.013738451 2024-09-12T18:37:16.459 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.459 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.459 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:16.459 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667698+0000", 2024-09-12T18:37:16.459 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9854999999999999e-05 2024-09-12T18:37:16.459 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.459 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.459 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:16.459 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667789+0000", 2024-09-12T18:37:16.460 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0835999999999996e-05 2024-09-12T18:37:16.460 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.460 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:16.460 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.460 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.460 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.460 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:121106 5.d e50/21 5:b4a9a221:::benchmark_data_smithi073_23739_object121105:head v 50'7658, mlcod=48'7656)", 2024-09-12T18:37:16.460 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:40.238637+0000", 2024-09-12T18:37:16.460 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 36.152514983000003, 2024-09-12T18:37:16.460 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.033154694999999998, 2024-09-12T18:37:16.460 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:16.460 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:16.460 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:16.461 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:16.461 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.461 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:16.461 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238637+0000", 2024-09-12T18:37:16.461 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.461 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.461 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.461 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:16.461 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238637+0000", 2024-09-12T18:37:16.461 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.461 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.461 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.461 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:16.462 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238639+0000", 2024-09-12T18:37:16.462 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.8560000000000001e-06 2024-09-12T18:37:16.462 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.462 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.462 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:16.462 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238723+0000", 2024-09-12T18:37:16.462 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4314999999999995e-05 2024-09-12T18:37:16.462 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.462 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.462 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:16.462 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238753+0000", 2024-09-12T18:37:16.462 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.9726e-05 2024-09-12T18:37:16.462 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.462 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.462 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:16.463 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238773+0000", 2024-09-12T18:37:16.463 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9789e-05 2024-09-12T18:37:16.463 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.463 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.463 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:16.463 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.241557+0000", 2024-09-12T18:37:16.463 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0027843910000000002 2024-09-12T18:37:16.463 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.463 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.463 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:16.463 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.241581+0000", 2024-09-12T18:37:16.463 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.4224999999999999e-05 2024-09-12T18:37:16.463 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.464 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.464 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:16.464 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.271722+0000", 2024-09-12T18:37:16.464 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.030141194 2024-09-12T18:37:16.464 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.464 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.464 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:16.464 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.271792+0000", 2024-09-12T18:37:16.464 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9198999999999999e-05 2024-09-12T18:37:16.464 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.464 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:16.464 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.464 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.464 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.465 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:131551 5.d e52/21 5:b8f8c77a:::benchmark_data_smithi073_23739_object131550:head v 52'8341, mlcod=52'8338)", 2024-09-12T18:37:16.465 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:45.500609+0000", 2024-09-12T18:37:16.465 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 30.890542802999999, 2024-09-12T18:37:16.465 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024752877, 2024-09-12T18:37:16.465 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:16.465 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:16.465 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:16.465 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:16.465 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.465 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:16.465 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500609+0000", 2024-09-12T18:37:16.465 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.465 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.465 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.466 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:16.466 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500609+0000", 2024-09-12T18:37:16.466 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.466 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.466 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.466 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:16.466 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500610+0000", 2024-09-12T18:37:16.466 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5499999999999998e-07 2024-09-12T18:37:16.466 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.466 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.466 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:16.466 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500669+0000", 2024-09-12T18:37:16.466 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9244999999999999e-05 2024-09-12T18:37:16.467 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.467 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.467 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:16.467 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500676+0000", 2024-09-12T18:37:16.467 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3030000000000002e-06 2024-09-12T18:37:16.467 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.467 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.467 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:16.467 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500681+0000", 2024-09-12T18:37:16.467 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8720000000000001e-06 2024-09-12T18:37:16.467 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.467 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.467 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:16.467 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.517128+0000", 2024-09-12T18:37:16.468 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.016446485 2024-09-12T18:37:16.468 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.468 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.468 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:16.468 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.517159+0000", 2024-09-12T18:37:16.468 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.0926000000000002e-05 2024-09-12T18:37:16.468 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.468 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.468 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:16.468 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.525325+0000", 2024-09-12T18:37:16.468 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0081661460000000009 2024-09-12T18:37:16.468 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.469 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.469 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:16.469 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.525362+0000", 2024-09-12T18:37:16.469 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.7345000000000002e-05 2024-09-12T18:37:16.469 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.469 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:16.469 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.469 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.469 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.469 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167364 5.7 5:ee50096a:::benchmark_data_smithi073_23739_object35087:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:16.469 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.168715+0000", 2024-09-12T18:37:16.469 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 13.222436896, 2024-09-12T18:37:16.469 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.068831153000000006, 2024-09-12T18:37:16.469 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:16.470 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:16.470 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:16.470 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:16.470 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:16.470 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:16.470 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167364 2024-09-12T18:37:16.470 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.470 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:16.470 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.470 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:16.470 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168715+0000", 2024-09-12T18:37:16.470 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.470 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.470 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.471 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:16.471 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168715+0000", 2024-09-12T18:37:16.471 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.471 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.471 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.471 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:16.471 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168716+0000", 2024-09-12T18:37:16.471 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0559999999999999e-06 2024-09-12T18:37:16.471 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.471 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.471 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:16.471 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168721+0000", 2024-09-12T18:37:16.471 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8019999999999999e-06 2024-09-12T18:37:16.472 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.472 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.472 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:16.472 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168731+0000", 2024-09-12T18:37:16.472 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0315e-05 2024-09-12T18:37:16.472 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.472 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.472 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:16.472 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168738+0000", 2024-09-12T18:37:16.472 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.126e-06 2024-09-12T18:37:16.472 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.472 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.472 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:16.473 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168782+0000", 2024-09-12T18:37:16.473 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.3924000000000002e-05 2024-09-12T18:37:16.473 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.473 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.473 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:16.473 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168913+0000", 2024-09-12T18:37:16.473 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000131154 2024-09-12T18:37:16.473 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.473 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.473 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:16.473 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169026+0000", 2024-09-12T18:37:16.473 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011223299999999999 2024-09-12T18:37:16.473 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.473 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.474 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:16.474 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.175404+0000", 2024-09-12T18:37:16.474 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0063780319999999996 2024-09-12T18:37:16.474 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.474 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.474 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:16.474 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237446+0000", 2024-09-12T18:37:16.474 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.062042238 2024-09-12T18:37:16.474 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.474 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.474 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:16.474 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237501+0000", 2024-09-12T18:37:16.474 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4913000000000001e-05 2024-09-12T18:37:16.475 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.475 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.475 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:16.475 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237546+0000", 2024-09-12T18:37:16.475 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.5359999999999999e-05 2024-09-12T18:37:16.475 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.475 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:16.475 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.475 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.475 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.475 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167365 5.2 5:4107875c:::benchmark_data_smithi073_23739_object35088:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:16.475 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:16.475 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 13.222387321999999, 2024-09-12T18:37:16.476 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.078544438999999994, 2024-09-12T18:37:16.476 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:16.476 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:16.476 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:16.476 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:16.476 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:16.476 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:16.476 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167365 2024-09-12T18:37:16.476 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.476 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:16.476 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.476 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:16.476 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:16.477 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.477 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.477 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.477 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:16.477 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:16.477 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.477 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.477 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.477 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:16.477 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:16.477 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.4700000000000001e-07 2024-09-12T18:37:16.477 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.477 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.477 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:16.478 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168769+0000", 2024-09-12T18:37:16.478 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.4170000000000001e-06 2024-09-12T18:37:16.478 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.478 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.478 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:16.478 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168777+0000", 2024-09-12T18:37:16.478 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1499999999999999e-06 2024-09-12T18:37:16.479 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.479 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.479 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:16.479 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168783+0000", 2024-09-12T18:37:16.479 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.0460000000000002e-06 2024-09-12T18:37:16.479 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.479 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.479 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:16.479 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168865+0000", 2024-09-12T18:37:16.479 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1953999999999995e-05 2024-09-12T18:37:16.479 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.479 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.479 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:16.480 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169003+0000", 2024-09-12T18:37:16.480 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013798200000000001 2024-09-12T18:37:16.480 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.480 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.480 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:16.480 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169065+0000", 2024-09-12T18:37:16.480 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2218000000000006e-05 2024-09-12T18:37:16.480 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.480 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.480 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:16.480 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174771+0000", 2024-09-12T18:37:16.480 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0057054819999999996 2024-09-12T18:37:16.481 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.481 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.481 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:16.481 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.247234+0000", 2024-09-12T18:37:16.481 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.072463391000000002 2024-09-12T18:37:16.481 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.481 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.481 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:16.481 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.247273+0000", 2024-09-12T18:37:16.481 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.9069000000000002e-05 2024-09-12T18:37:16.481 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.481 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.481 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:16.482 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.247309+0000", 2024-09-12T18:37:16.482 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5982999999999998e-05 2024-09-12T18:37:16.482 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.482 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:16.482 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.482 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.482 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.482 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167369 5.7 5:e64ecabd:::benchmark_data_smithi073_23739_object35092:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:16.482 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.169042+0000", 2024-09-12T18:37:16.482 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 13.222110211, 2024-09-12T18:37:16.482 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.069229188999999997, 2024-09-12T18:37:16.482 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:16.482 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:16.483 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:16.483 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:16.483 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:16.483 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:16.483 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167369 2024-09-12T18:37:16.483 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.483 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:16.483 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.483 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:16.483 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169042+0000", 2024-09-12T18:37:16.483 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.483 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.483 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.483 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:16.484 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169042+0000", 2024-09-12T18:37:16.484 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.484 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.484 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.484 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:16.484 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169043+0000", 2024-09-12T18:37:16.484 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.9400000000000004e-07 2024-09-12T18:37:16.484 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.484 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.484 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:16.484 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169048+0000", 2024-09-12T18:37:16.484 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8420000000000004e-06 2024-09-12T18:37:16.484 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.485 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.485 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:16.485 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169055+0000", 2024-09-12T18:37:16.485 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.7989999999999994e-06 2024-09-12T18:37:16.485 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.485 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.485 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:16.485 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169062+0000", 2024-09-12T18:37:16.485 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.5950000000000004e-06 2024-09-12T18:37:16.485 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.485 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.485 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:16.485 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173858+0000", 2024-09-12T18:37:16.485 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0047959259999999998 2024-09-12T18:37:16.486 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.486 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.486 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:16.486 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173966+0000", 2024-09-12T18:37:16.486 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000107941 2024-09-12T18:37:16.486 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.486 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.486 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:16.486 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174043+0000", 2024-09-12T18:37:16.486 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.7360000000000005e-05 2024-09-12T18:37:16.486 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.486 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.486 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:16.486 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.175711+0000", 2024-09-12T18:37:16.487 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0016680810000000001 2024-09-12T18:37:16.487 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.487 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.487 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:16.487 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.238163+0000", 2024-09-12T18:37:16.487 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.062451523000000002 2024-09-12T18:37:16.487 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.487 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.487 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:16.487 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.238222+0000", 2024-09-12T18:37:16.487 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9723999999999999e-05 2024-09-12T18:37:16.487 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.487 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.488 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:16.488 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.238271+0000", 2024-09-12T18:37:16.488 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8504000000000002e-05 2024-09-12T18:37:16.488 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.488 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:16.488 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.488 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.488 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.488 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167373 5.5 5:ad283029:::benchmark_data_smithi073_23739_object35096:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:16.488 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:16.488 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 13.219605380000001, 2024-09-12T18:37:16.488 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.066200976999999994, 2024-09-12T18:37:16.488 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:16.488 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:16.489 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:16.489 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:16.489 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:16.489 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:16.489 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167373 2024-09-12T18:37:16.489 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.489 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:16.489 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.489 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:16.489 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:16.489 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.489 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.489 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.490 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:16.490 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:16.490 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.490 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.490 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.490 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:16.490 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:16.490 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4900000000000005e-07 2024-09-12T18:37:16.490 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.490 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.490 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:16.490 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171551+0000", 2024-09-12T18:37:16.491 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.7519999999999998e-06 2024-09-12T18:37:16.491 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.491 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.491 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:16.491 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171562+0000", 2024-09-12T18:37:16.491 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0353000000000001e-05 2024-09-12T18:37:16.491 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.491 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.491 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:16.491 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171566+0000", 2024-09-12T18:37:16.491 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8269999999999997e-06 2024-09-12T18:37:16.491 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.491 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.491 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:16.492 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171622+0000", 2024-09-12T18:37:16.492 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5220999999999999e-05 2024-09-12T18:37:16.492 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.492 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.492 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:16.492 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171719+0000", 2024-09-12T18:37:16.492 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7238999999999995e-05 2024-09-12T18:37:16.492 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.492 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.492 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:16.492 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171802+0000", 2024-09-12T18:37:16.492 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.3285e-05 2024-09-12T18:37:16.492 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.493 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.493 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:16.493 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174608+0000", 2024-09-12T18:37:16.493 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028054590000000002 2024-09-12T18:37:16.493 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.493 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.493 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:16.493 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174762+0000", 2024-09-12T18:37:16.493 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015465100000000001 2024-09-12T18:37:16.493 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.493 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.493 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:16.493 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237474+0000", 2024-09-12T18:37:16.494 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.062711683000000004 2024-09-12T18:37:16.494 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.494 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.494 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:16.494 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237540+0000", 2024-09-12T18:37:16.494 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.6132999999999999e-05 2024-09-12T18:37:16.494 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.494 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.494 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:16.494 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237748+0000", 2024-09-12T18:37:16.494 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020752499999999999 2024-09-12T18:37:16.494 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.494 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:16.494 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.494 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.495 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.495 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167374 5.1 5:81e25826:::benchmark_data_smithi073_23739_object35097:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:16.495 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.173748+0000", 2024-09-12T18:37:16.495 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 13.217403932, 2024-09-12T18:37:16.495 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.069225245000000005, 2024-09-12T18:37:16.495 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:16.495 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:16.495 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:16.495 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:16.495 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:16.495 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:16.495 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167374 2024-09-12T18:37:16.495 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.496 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:16.496 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.496 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:16.496 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173748+0000", 2024-09-12T18:37:16.496 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.496 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.496 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.496 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:16.496 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173748+0000", 2024-09-12T18:37:16.496 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.496 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.496 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.496 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:16.497 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173749+0000", 2024-09-12T18:37:16.497 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.418e-06 2024-09-12T18:37:16.497 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.497 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.497 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:16.497 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173755+0000", 2024-09-12T18:37:16.497 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.0730000000000004e-06 2024-09-12T18:37:16.497 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.497 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.497 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:16.497 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173768+0000", 2024-09-12T18:37:16.497 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3644e-05 2024-09-12T18:37:16.497 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.498 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.498 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:16.498 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173777+0000", 2024-09-12T18:37:16.498 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4160000000000004e-06 2024-09-12T18:37:16.498 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.498 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.498 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:16.498 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173927+0000", 2024-09-12T18:37:16.498 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015065900000000001 2024-09-12T18:37:16.498 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.498 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.498 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:16.498 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174052+0000", 2024-09-12T18:37:16.498 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012460699999999999 2024-09-12T18:37:16.499 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.499 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.499 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:16.499 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174181+0000", 2024-09-12T18:37:16.499 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012919299999999999 2024-09-12T18:37:16.499 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.499 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.499 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:16.499 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.178108+0000", 2024-09-12T18:37:16.499 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0039273210000000001 2024-09-12T18:37:16.499 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.499 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.499 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:16.500 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.178118+0000", 2024-09-12T18:37:16.500 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7550000000000006e-06 2024-09-12T18:37:16.500 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.500 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.500 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:16.500 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.242865+0000", 2024-09-12T18:37:16.500 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.064746597000000003 2024-09-12T18:37:16.500 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.500 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.500 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:16.500 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.242903+0000", 2024-09-12T18:37:16.500 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.8268e-05 2024-09-12T18:37:16.500 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.501 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.501 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:16.501 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.242973+0000", 2024-09-12T18:37:16.501 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0294000000000002e-05 2024-09-12T18:37:16.501 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.501 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:16.501 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.501 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.501 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.501 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167375 5.1 5:83a09102:::benchmark_data_smithi073_23739_object35098:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:16.501 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:16.501 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 13.217352385, 2024-09-12T18:37:16.501 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.069437463000000005, 2024-09-12T18:37:16.502 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:16.502 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:16.502 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:16.502 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:16.502 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:16.502 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:16.502 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167375 2024-09-12T18:37:16.502 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.502 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:16.502 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.502 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:16.502 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:16.502 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.503 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.503 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.503 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:16.503 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:16.503 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.503 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.503 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.503 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:16.503 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:16.503 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1399999999999997e-07 2024-09-12T18:37:16.503 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.503 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.503 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:16.504 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173803+0000", 2024-09-12T18:37:16.504 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.7860000000000001e-06 2024-09-12T18:37:16.504 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.504 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.504 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:16.504 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173811+0000", 2024-09-12T18:37:16.504 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4610000000000008e-06 2024-09-12T18:37:16.504 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.504 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.504 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:16.504 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173817+0000", 2024-09-12T18:37:16.504 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3569999999999997e-06 2024-09-12T18:37:16.504 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.504 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.505 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:16.505 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.176070+0000", 2024-09-12T18:37:16.505 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.002253405 2024-09-12T18:37:16.505 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.505 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.505 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:16.505 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.176263+0000", 2024-09-12T18:37:16.505 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000192583 2024-09-12T18:37:16.505 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.505 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.505 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:16.505 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.176429+0000", 2024-09-12T18:37:16.505 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00016626 2024-09-12T18:37:16.505 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.506 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.506 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:16.506 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.178154+0000", 2024-09-12T18:37:16.506 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0017247009999999999 2024-09-12T18:37:16.506 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.506 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.506 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:16.506 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.182110+0000", 2024-09-12T18:37:16.506 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0039568229999999999 2024-09-12T18:37:16.506 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.506 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.506 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:16.506 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.243024+0000", 2024-09-12T18:37:16.506 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.060913249000000003 2024-09-12T18:37:16.506 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.507 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.507 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:16.507 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.243107+0000", 2024-09-12T18:37:16.507 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.3090000000000006e-05 2024-09-12T18:37:16.507 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.507 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.507 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:16.507 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.243237+0000", 2024-09-12T18:37:16.507 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013023399999999999 2024-09-12T18:37:16.507 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.507 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:16.507 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.507 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.507 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.507 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:182796 5.2 5:4d2ea0ae:::benchmark_data_smithi073_23739_object50519:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T18:37:16.507 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:10.616684+0000", 2024-09-12T18:37:16.508 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 5.7744680810000002, 2024-09-12T18:37:16.508 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026244475999999999, 2024-09-12T18:37:16.508 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:16.508 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:16.508 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:16.508 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:16.508 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:16.508 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:16.508 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 182796 2024-09-12T18:37:16.508 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.508 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:16.508 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.508 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:16.508 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.616684+0000", 2024-09-12T18:37:16.509 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.509 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.509 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.509 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:16.509 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.616684+0000", 2024-09-12T18:37:16.509 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:16.509 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.509 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.509 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:16.509 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.616686+0000", 2024-09-12T18:37:16.509 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7519999999999999e-06 2024-09-12T18:37:16.509 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.509 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.509 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:16.509 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.616691+0000", 2024-09-12T18:37:16.510 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.6200000000000004e-06 2024-09-12T18:37:16.510 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.510 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.510 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:16.510 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.616703+0000", 2024-09-12T18:37:16.510 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1955e-05 2024-09-12T18:37:16.510 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.510 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.510 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:16.510 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.616710+0000", 2024-09-12T18:37:16.510 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.1029999999999996e-06 2024-09-12T18:37:16.510 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.510 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.511 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:16.511 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.616762+0000", 2024-09-12T18:37:16.511 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1706999999999998e-05 2024-09-12T18:37:16.511 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.511 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.511 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:16.511 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.616899+0000", 2024-09-12T18:37:16.511 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000136816 2024-09-12T18:37:16.511 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.511 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.511 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:16.511 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.617025+0000", 2024-09-12T18:37:16.511 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012590799999999999 2024-09-12T18:37:16.511 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.511 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.512 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:16.512 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.622400+0000", 2024-09-12T18:37:16.512 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0053749069999999999 2024-09-12T18:37:16.512 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.512 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.512 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:16.512 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.642822+0000", 2024-09-12T18:37:16.512 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.020422484000000001 2024-09-12T18:37:16.512 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.512 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.512 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:16.512 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.642882+0000", 2024-09-12T18:37:16.512 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9917000000000002e-05 2024-09-12T18:37:16.512 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:16.512 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:16.513 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:16.513 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.642928+0000", 2024-09-12T18:37:16.513 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6307000000000002e-05 2024-09-12T18:37:16.513 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.513 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:16.513 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.513 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:16.513 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:16.513 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:16.514 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:16.510+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:16.515 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:37:16.531 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:37:16.616 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:16.610+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:16.640 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:16.640 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2024-09-12T18:37:16.640 INFO:teuthology.orchestra.run.smithi114.stdout: "num_ops": 0 2024-09-12T18:37:16.640 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:16.653 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:37:16.690 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:37:16.690 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:37:16.711 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:37:16.711 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:37:16.717 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:16.710+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:16.732 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:37:16.732 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:37:16.804 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:16.804 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:16.816 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:37:16.818 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:16.810+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:16.918 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:16.910+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:16.937 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:16.937 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:16.950 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:37:17.019 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:17.014+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:17.096 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:17.096 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:17.111 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:37:17.120 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:17.118+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:17.221 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:17.218+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:17.229 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T18:37:17.242 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:17.242 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:17.258 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:37:17.322 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:17.316+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:17.406 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:17.406 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:17.423 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:17.418+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:17.428 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:37:17.523 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:17.516+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:17.590 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:17.590 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:17.611 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:37:17.624 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:17.616+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:17.725 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:17.716+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:17.764 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:17.764 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:17.789 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:37:17.834 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:17.830+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:17.927 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:17.920+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:17.937 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:17.937 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:17.953 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:37:18.028 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:18.020+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:18.096 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:18.096 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:18.118 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:37:18.128 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:18.122+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:18.221 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is set 2024-09-12T18:37:18.229 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:18.220+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:18.266 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:18.266 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:18.284 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:37:18.330 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:18.324+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:18.432 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:18.426+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:18.435 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:18.436 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:18.456 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:37:18.531 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:18.524+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:18.614 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:18.614 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:18.632 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:18.624+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:18.634 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:37:18.733 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:18.726+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:18.751 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:37:18.834 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:18.834 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:18.834 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:18.830+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:18.852 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:37:18.908 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:37:18.908 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:37:18.927 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:37:18.927 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:37:18.935 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:18.926+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:18.945 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:37:18.946 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:37:19.013 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:19.014 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-09-12T18:37:19.014 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-09-12T18:37:19.014 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:37:19.014 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.014 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:19.014 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:37:19.014 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 113.376371357, 2024-09-12T18:37:19.014 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025088781000000001, 2024-09-12T18:37:19.014 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:19.014 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:19.014 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:19.014 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:19.014 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.015 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:19.015 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:37:19.015 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:19.015 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.015 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.015 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:19.015 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632509+0000", 2024-09-12T18:37:19.015 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:19.015 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.015 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.015 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:19.015 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632518+0000", 2024-09-12T18:37:19.015 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:37:19.016 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.016 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.016 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:19.016 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632533+0000", 2024-09-12T18:37:19.016 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5130000000000001e-05 2024-09-12T18:37:19.016 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.016 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.016 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:19.016 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632564+0000", 2024-09-12T18:37:19.017 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0788999999999999e-05 2024-09-12T18:37:19.017 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.017 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.017 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.017 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632590+0000", 2024-09-12T18:37:19.017 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6057000000000001e-05 2024-09-12T18:37:19.017 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.017 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.017 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:19.017 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.635931+0000", 2024-09-12T18:37:19.017 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0033411320000000001 2024-09-12T18:37:19.017 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.018 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.018 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:19.018 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636186+0000", 2024-09-12T18:37:19.018 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025452500000000002 2024-09-12T18:37:19.018 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.019 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.019 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:19.019 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636445+0000", 2024-09-12T18:37:19.019 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000259268 2024-09-12T18:37:19.019 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.019 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.019 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:19.019 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639562+0000", 2024-09-12T18:37:19.019 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031167 2024-09-12T18:37:19.019 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.019 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.019 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:19.020 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657314+0000", 2024-09-12T18:37:19.020 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017752562 2024-09-12T18:37:19.020 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.020 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.020 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:19.020 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657445+0000", 2024-09-12T18:37:19.020 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013105899999999999 2024-09-12T18:37:19.020 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.020 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.020 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:19.021 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657598+0000", 2024-09-12T18:37:19.021 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015247899999999999 2024-09-12T18:37:19.021 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:19.021 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:19.021 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:19.021 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.021 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.021 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:19.021 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:37:19.021 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 113.376245154, 2024-09-12T18:37:19.021 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025643131999999999, 2024-09-12T18:37:19.021 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:19.021 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:19.022 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:19.022 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:19.022 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.022 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:19.022 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:37:19.022 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:19.022 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.022 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.022 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:19.022 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632635+0000", 2024-09-12T18:37:19.023 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:19.023 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.023 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.023 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:19.023 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632637+0000", 2024-09-12T18:37:19.023 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5600000000000001e-06 2024-09-12T18:37:19.023 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.023 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.023 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:19.023 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632650+0000", 2024-09-12T18:37:19.023 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3186e-05 2024-09-12T18:37:19.024 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.024 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.024 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:19.024 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632672+0000", 2024-09-12T18:37:19.024 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2013000000000001e-05 2024-09-12T18:37:19.024 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.024 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.024 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.024 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632687+0000", 2024-09-12T18:37:19.024 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5109999999999999e-05 2024-09-12T18:37:19.024 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.024 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.025 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:19.025 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636994+0000", 2024-09-12T18:37:19.025 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0043065539999999998 2024-09-12T18:37:19.025 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.025 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.025 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:19.025 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637198+0000", 2024-09-12T18:37:19.025 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020387199999999999 2024-09-12T18:37:19.025 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.025 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.025 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:19.025 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637475+0000", 2024-09-12T18:37:19.025 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00027731000000000001 2024-09-12T18:37:19.026 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.026 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.026 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:19.026 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639574+0000", 2024-09-12T18:37:19.026 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020988999999999999 2024-09-12T18:37:19.026 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.026 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.026 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:19.026 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658057+0000", 2024-09-12T18:37:19.026 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018482926 2024-09-12T18:37:19.027 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.027 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.027 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:19.027 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658184+0000", 2024-09-12T18:37:19.027 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012756200000000001 2024-09-12T18:37:19.027 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.027 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.027 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:19.027 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658278+0000", 2024-09-12T18:37:19.027 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4139000000000001e-05 2024-09-12T18:37:19.027 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:19.027 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:19.028 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:19.028 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.028 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.028 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:19.028 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:37:19.028 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 113.376170062, 2024-09-12T18:37:19.028 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025238883, 2024-09-12T18:37:19.028 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:19.028 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:19.028 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:19.028 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:19.028 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.028 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:19.029 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:37:19.029 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:19.029 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.029 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.029 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:19.029 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632710+0000", 2024-09-12T18:37:19.029 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:19.029 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.029 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.029 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:19.029 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632712+0000", 2024-09-12T18:37:19.029 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6869999999999999e-06 2024-09-12T18:37:19.029 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.030 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.030 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:19.030 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632719+0000", 2024-09-12T18:37:19.030 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6059999999999999e-06 2024-09-12T18:37:19.030 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.030 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.030 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:19.030 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632737+0000", 2024-09-12T18:37:19.030 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7983999999999999e-05 2024-09-12T18:37:19.030 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.030 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.030 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.031 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632751+0000", 2024-09-12T18:37:19.031 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4473e-05 2024-09-12T18:37:19.031 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.031 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.031 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:19.031 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.636961+0000", 2024-09-12T18:37:19.031 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0042100840000000002 2024-09-12T18:37:19.031 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.031 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.031 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:19.031 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637211+0000", 2024-09-12T18:37:19.032 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000249738 2024-09-12T18:37:19.032 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.032 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.032 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:19.032 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.637504+0000", 2024-09-12T18:37:19.032 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00029271499999999998 2024-09-12T18:37:19.032 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.032 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.032 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:19.032 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639582+0000", 2024-09-12T18:37:19.033 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020783389999999998 2024-09-12T18:37:19.033 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.033 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.033 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:19.033 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657709+0000", 2024-09-12T18:37:19.033 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018126758999999999 2024-09-12T18:37:19.033 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.033 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.033 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:19.034 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657830+0000", 2024-09-12T18:37:19.034 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000121329 2024-09-12T18:37:19.034 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.034 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.034 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:19.034 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.657949+0000", 2024-09-12T18:37:19.034 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000119169 2024-09-12T18:37:19.034 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:19.035 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:19.035 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:19.035 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.035 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.035 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:19.035 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:37:19.035 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 113.37610601599999, 2024-09-12T18:37:19.035 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026711823999999999, 2024-09-12T18:37:19.035 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:19.035 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:19.035 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:19.035 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:19.035 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.036 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:19.036 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:37:19.036 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:19.036 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.036 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.036 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:19.036 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632774+0000", 2024-09-12T18:37:19.036 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:19.036 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.036 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.036 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:19.036 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632775+0000", 2024-09-12T18:37:19.037 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9999999999999995e-07 2024-09-12T18:37:19.037 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.037 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.037 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:19.037 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632788+0000", 2024-09-12T18:37:19.037 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2629999999999999e-05 2024-09-12T18:37:19.037 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.037 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.037 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:19.038 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632806+0000", 2024-09-12T18:37:19.038 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:37:19.038 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.038 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.038 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.038 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.632820+0000", 2024-09-12T18:37:19.038 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3777e-05 2024-09-12T18:37:19.038 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.038 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.038 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:19.038 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638310+0000", 2024-09-12T18:37:19.038 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054898280000000004 2024-09-12T18:37:19.038 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.039 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.039 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:19.039 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638480+0000", 2024-09-12T18:37:19.039 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016968199999999999 2024-09-12T18:37:19.039 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.039 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.039 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:19.039 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638799+0000", 2024-09-12T18:37:19.039 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00031915999999999997 2024-09-12T18:37:19.039 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.039 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.040 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:19.040 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.639866+0000", 2024-09-12T18:37:19.040 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001067405 2024-09-12T18:37:19.040 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.040 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.041 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:19.041 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658398+0000", 2024-09-12T18:37:19.041 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018531542000000002 2024-09-12T18:37:19.041 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.041 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.042 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:19.042 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658643+0000", 2024-09-12T18:37:19.042 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00024531500000000002 2024-09-12T18:37:19.042 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.043 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.043 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:19.043 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.659486+0000", 2024-09-12T18:37:19.043 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00084316899999999995 2024-09-12T18:37:19.043 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:19.043 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:19.043 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:19.044 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.044 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.044 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:19.044 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:37:19.044 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 113.37579726200001, 2024-09-12T18:37:19.044 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026938645000000001, 2024-09-12T18:37:19.044 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:19.044 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:19.045 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:19.045 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:19.045 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.045 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:19.045 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:37:19.045 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:19.045 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.045 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.045 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:19.045 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633083+0000", 2024-09-12T18:37:19.045 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:19.045 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.045 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.045 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:19.046 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633085+0000", 2024-09-12T18:37:19.046 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:37:19.046 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.046 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.046 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:19.046 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633093+0000", 2024-09-12T18:37:19.046 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3999999999999992e-06 2024-09-12T18:37:19.046 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.046 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.046 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:19.046 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633111+0000", 2024-09-12T18:37:19.047 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8070000000000001e-05 2024-09-12T18:37:19.047 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.047 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.047 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.047 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.633126+0000", 2024-09-12T18:37:19.047 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4487e-05 2024-09-12T18:37:19.047 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.047 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.047 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:19.047 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638290+0000", 2024-09-12T18:37:19.048 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0051640269999999999 2024-09-12T18:37:19.048 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.048 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.048 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:19.048 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638547+0000", 2024-09-12T18:37:19.048 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025714100000000001 2024-09-12T18:37:19.048 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.048 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.048 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:19.048 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.638850+0000", 2024-09-12T18:37:19.048 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030278400000000001 2024-09-12T18:37:19.048 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.048 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.049 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:19.049 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.640706+0000", 2024-09-12T18:37:19.049 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018564580000000001 2024-09-12T18:37:19.049 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.049 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.049 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:19.049 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658420+0000", 2024-09-12T18:37:19.049 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.017714395000000001 2024-09-12T18:37:19.049 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.049 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.049 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:19.049 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.658635+0000", 2024-09-12T18:37:19.049 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021413500000000001 2024-09-12T18:37:19.050 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.050 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.050 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:19.050 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:35:25.660022+0000", 2024-09-12T18:37:19.050 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001387318 2024-09-12T18:37:19.050 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:19.050 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:19.050 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:19.050 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.050 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.050 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121096 5.8 5:13503891:::benchmark_data_smithi073_23739_object121095:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:19.050 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:37:19.050 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 38.830304294999998, 2024-09-12T18:37:19.051 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064025391000000001, 2024-09-12T18:37:19.051 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:19.051 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:19.051 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:19.051 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:19.051 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:19.051 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:19.051 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121096 2024-09-12T18:37:19.051 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.051 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:19.051 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.051 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:19.051 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:37:19.051 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:19.052 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.052 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.052 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:19.052 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:37:19.052 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:19.052 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.052 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.052 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:19.052 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178579+0000", 2024-09-12T18:37:19.052 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7369999999999998e-06 2024-09-12T18:37:19.052 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.052 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.052 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:19.052 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178846+0000", 2024-09-12T18:37:19.053 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026752699999999999 2024-09-12T18:37:19.053 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.053 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.053 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:19.053 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178877+0000", 2024-09-12T18:37:19.053 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1081999999999998e-05 2024-09-12T18:37:19.053 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.053 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.053 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.053 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178896+0000", 2024-09-12T18:37:19.053 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8522e-05 2024-09-12T18:37:19.053 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.053 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.054 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:19.054 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.192591+0000", 2024-09-12T18:37:19.054 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013695067 2024-09-12T18:37:19.054 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.054 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.054 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:19.054 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.192944+0000", 2024-09-12T18:37:19.054 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00035273699999999999 2024-09-12T18:37:19.054 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.054 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.054 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:19.055 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.193732+0000", 2024-09-12T18:37:19.055 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078849599999999997 2024-09-12T18:37:19.055 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.055 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.055 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:19.055 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.213583+0000", 2024-09-12T18:37:19.055 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.019851164000000001 2024-09-12T18:37:19.055 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.055 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.055 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:19.055 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242386+0000", 2024-09-12T18:37:19.055 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028802924000000001 2024-09-12T18:37:19.055 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.055 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.056 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:19.056 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242501+0000", 2024-09-12T18:37:19.056 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000114932 2024-09-12T18:37:19.056 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.056 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.056 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:19.056 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242602+0000", 2024-09-12T18:37:19.056 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000100203 2024-09-12T18:37:19.056 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:19.056 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:19.056 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:19.057 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.057 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.057 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121097 5.8 5:1b31a99e:::benchmark_data_smithi073_23739_object121096:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:19.057 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:37:19.057 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 38.814576004999999, 2024-09-12T18:37:19.057 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048475917, 2024-09-12T18:37:19.057 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:19.057 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:19.057 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:19.057 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:19.057 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:19.057 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:19.057 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121097 2024-09-12T18:37:19.058 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.058 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:19.058 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.058 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:19.058 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:37:19.058 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:19.058 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.058 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.058 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:19.058 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:37:19.059 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:19.059 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.059 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.059 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:19.059 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194308+0000", 2024-09-12T18:37:19.059 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2789999999999999e-06 2024-09-12T18:37:19.059 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.059 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.059 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:19.059 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194396+0000", 2024-09-12T18:37:19.059 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8324000000000003e-05 2024-09-12T18:37:19.059 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.059 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.059 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:19.060 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194424+0000", 2024-09-12T18:37:19.060 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7565000000000001e-05 2024-09-12T18:37:19.060 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.060 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.060 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.060 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194444+0000", 2024-09-12T18:37:19.060 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0363000000000001e-05 2024-09-12T18:37:19.060 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.060 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.060 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:19.060 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.206888+0000", 2024-09-12T18:37:19.060 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012443997 2024-09-12T18:37:19.060 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.061 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.061 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:19.061 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.207138+0000", 2024-09-12T18:37:19.061 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025035900000000002 2024-09-12T18:37:19.061 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.061 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.061 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:19.061 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.207365+0000", 2024-09-12T18:37:19.061 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000226407 2024-09-12T18:37:19.061 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.061 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.062 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:19.062 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.215059+0000", 2024-09-12T18:37:19.062 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076946860000000001 2024-09-12T18:37:19.062 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.062 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.062 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:19.062 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242619+0000", 2024-09-12T18:37:19.063 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.027559975 2024-09-12T18:37:19.063 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.063 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.063 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:19.063 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242706+0000", 2024-09-12T18:37:19.064 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6384999999999994e-05 2024-09-12T18:37:19.064 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.064 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.064 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:19.064 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242780+0000", 2024-09-12T18:37:19.064 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4577000000000001e-05 2024-09-12T18:37:19.065 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:19.065 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:19.065 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:19.065 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.065 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.065 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:121044 5.1 e50/49 5:83bf711a:::benchmark_data_smithi073_23739_object121043:head v 50'7532, mlcod=0'0)", 2024-09-12T18:37:19.066 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.201054+0000", 2024-09-12T18:37:19.066 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 38.807826784, 2024-09-12T18:37:19.066 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.026157387000000001, 2024-09-12T18:37:19.066 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:19.066 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:19.066 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:19.066 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:19.067 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.067 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:19.067 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201054+0000", 2024-09-12T18:37:19.067 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:19.067 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.067 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.068 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:19.068 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201054+0000", 2024-09-12T18:37:19.068 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:19.068 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.068 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.069 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:19.069 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201056+0000", 2024-09-12T18:37:19.069 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.99e-06 2024-09-12T18:37:19.069 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.069 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.069 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:19.070 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201068+0000", 2024-09-12T18:37:19.070 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2799000000000001e-05 2024-09-12T18:37:19.070 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.070 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.070 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:19.071 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201093+0000", 2024-09-12T18:37:19.071 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4766e-05 2024-09-12T18:37:19.071 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.071 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.071 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.071 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201115+0000", 2024-09-12T18:37:19.072 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1988999999999999e-05 2024-09-12T18:37:19.072 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.072 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.072 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:19.072 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201233+0000", 2024-09-12T18:37:19.072 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000118229 2024-09-12T18:37:19.073 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.073 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.073 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:19.073 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.201273+0000", 2024-09-12T18:37:19.073 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9171999999999997e-05 2024-09-12T18:37:19.073 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.074 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.074 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:19.074 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.227080+0000", 2024-09-12T18:37:19.074 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025807611000000001 2024-09-12T18:37:19.074 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.075 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.075 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:19.075 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.227211+0000", 2024-09-12T18:37:19.075 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013083100000000001 2024-09-12T18:37:19.075 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:19.075 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:19.075 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:19.076 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.076 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.076 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121101 5.e 5:7e18e9ed:::benchmark_data_smithi073_23739_object121100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:19.076 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.209084+0000", 2024-09-12T18:37:19.076 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 38.799795950000004, 2024-09-12T18:37:19.077 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028988566, 2024-09-12T18:37:19.077 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:19.077 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:19.077 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:19.077 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:19.077 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:19.077 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:19.078 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121101 2024-09-12T18:37:19.078 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.078 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:19.078 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.078 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:19.078 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209084+0000", 2024-09-12T18:37:19.078 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:19.079 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.079 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.079 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:19.079 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209084+0000", 2024-09-12T18:37:19.079 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:19.079 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.080 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.080 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:19.080 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209087+0000", 2024-09-12T18:37:19.080 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6800000000000002e-06 2024-09-12T18:37:19.080 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.080 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.080 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:19.080 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209182+0000", 2024-09-12T18:37:19.080 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5084e-05 2024-09-12T18:37:19.080 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.081 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.081 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:19.081 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209212+0000", 2024-09-12T18:37:19.081 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9825e-05 2024-09-12T18:37:19.081 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.081 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.081 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.081 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209234+0000", 2024-09-12T18:37:19.081 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1416e-05 2024-09-12T18:37:19.081 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.082 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.082 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:19.082 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209497+0000", 2024-09-12T18:37:19.082 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026390400000000003 2024-09-12T18:37:19.082 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.082 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.082 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:19.082 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209810+0000", 2024-09-12T18:37:19.082 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000313023 2024-09-12T18:37:19.082 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.082 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.082 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:19.082 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.210468+0000", 2024-09-12T18:37:19.083 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00065779300000000005 2024-09-12T18:37:19.083 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.083 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.083 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:19.083 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.235905+0000", 2024-09-12T18:37:19.083 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025436881000000001 2024-09-12T18:37:19.083 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.083 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.083 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:19.083 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237797+0000", 2024-09-12T18:37:19.083 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001892007 2024-09-12T18:37:19.084 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.084 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.084 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:19.084 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237941+0000", 2024-09-12T18:37:19.084 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000143411 2024-09-12T18:37:19.084 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.084 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.084 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:19.084 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.238073+0000", 2024-09-12T18:37:19.084 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013254200000000001 2024-09-12T18:37:19.084 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:19.084 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:19.084 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:19.085 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.085 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.085 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121102 5.8 5:1f118f4b:::benchmark_data_smithi073_23739_object121101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:19.085 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.218682+0000", 2024-09-12T18:37:19.085 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 38.790198590000003, 2024-09-12T18:37:19.085 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024264885, 2024-09-12T18:37:19.085 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:19.085 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:19.085 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:19.085 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:19.085 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:19.085 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:19.085 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121102 2024-09-12T18:37:19.086 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.086 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:19.086 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.086 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:19.086 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218682+0000", 2024-09-12T18:37:19.086 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:19.086 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.086 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.086 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:19.086 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218682+0000", 2024-09-12T18:37:19.087 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:19.087 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.087 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.087 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:19.087 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218685+0000", 2024-09-12T18:37:19.087 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6059999999999999e-06 2024-09-12T18:37:19.087 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.088 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.088 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:19.088 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218743+0000", 2024-09-12T18:37:19.088 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7160999999999997e-05 2024-09-12T18:37:19.088 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.088 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.088 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:19.088 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218768+0000", 2024-09-12T18:37:19.088 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5052e-05 2024-09-12T18:37:19.088 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.089 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.089 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.089 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218785+0000", 2024-09-12T18:37:19.089 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7436999999999999e-05 2024-09-12T18:37:19.089 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.089 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.089 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:19.089 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.218952+0000", 2024-09-12T18:37:19.089 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016691300000000001 2024-09-12T18:37:19.089 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.089 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.089 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:19.089 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.219437+0000", 2024-09-12T18:37:19.090 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048465900000000002 2024-09-12T18:37:19.090 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.090 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.090 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:19.090 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.219893+0000", 2024-09-12T18:37:19.090 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00045642799999999999 2024-09-12T18:37:19.090 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.090 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.090 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:19.090 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.226416+0000", 2024-09-12T18:37:19.090 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0065225630000000003 2024-09-12T18:37:19.091 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.091 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.091 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:19.091 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242796+0000", 2024-09-12T18:37:19.091 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.016379857000000001 2024-09-12T18:37:19.091 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.091 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.091 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:19.091 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242879+0000", 2024-09-12T18:37:19.091 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3913999999999997e-05 2024-09-12T18:37:19.091 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.091 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.091 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:19.092 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242947+0000", 2024-09-12T18:37:19.092 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7294999999999999e-05 2024-09-12T18:37:19.092 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:19.092 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:19.092 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:19.092 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.092 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.092 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121106 5.d 5:b4a9a221:::benchmark_data_smithi073_23739_object121105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:19.092 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:37:19.092 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 38.771701069000002, 2024-09-12T18:37:19.092 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.034882274999999997, 2024-09-12T18:37:19.092 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:19.092 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:19.093 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:19.093 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:19.093 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:19.093 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:19.093 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121106 2024-09-12T18:37:19.093 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.093 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:19.093 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.093 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:19.093 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:37:19.093 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:19.093 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.093 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.094 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:19.094 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:37:19.094 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:19.094 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.094 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.094 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:19.094 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237182+0000", 2024-09-12T18:37:19.094 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6019999999999998e-06 2024-09-12T18:37:19.094 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.094 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.094 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:19.094 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237257+0000", 2024-09-12T18:37:19.094 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5420999999999995e-05 2024-09-12T18:37:19.095 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.095 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.095 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:19.095 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237305+0000", 2024-09-12T18:37:19.095 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7207999999999999e-05 2024-09-12T18:37:19.095 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.095 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.095 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.095 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237325+0000", 2024-09-12T18:37:19.095 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0001e-05 2024-09-12T18:37:19.095 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.096 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.096 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:19.096 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237505+0000", 2024-09-12T18:37:19.096 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000180798 2024-09-12T18:37:19.096 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.097 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.097 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:19.097 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237764+0000", 2024-09-12T18:37:19.097 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025862299999999998 2024-09-12T18:37:19.097 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.097 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.097 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:19.097 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.238264+0000", 2024-09-12T18:37:19.098 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00050016100000000005 2024-09-12T18:37:19.098 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.098 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.098 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:19.098 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256525+0000", 2024-09-12T18:37:19.098 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018260508000000002 2024-09-12T18:37:19.098 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.098 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.098 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:19.099 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.271903+0000", 2024-09-12T18:37:19.099 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015378739000000001 2024-09-12T18:37:19.099 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.099 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.099 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:19.099 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.271999+0000", 2024-09-12T18:37:19.099 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5989000000000005e-05 2024-09-12T18:37:19.100 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.100 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.100 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:19.100 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272062+0000", 2024-09-12T18:37:19.100 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2224999999999995e-05 2024-09-12T18:37:19.101 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:19.101 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:19.101 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:19.101 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.101 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.101 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121112 5.d 5:b9a2d671:::benchmark_data_smithi073_23739_object121111:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:19.101 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.243446+0000", 2024-09-12T18:37:19.101 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 38.765434343999999, 2024-09-12T18:37:19.102 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.02889415, 2024-09-12T18:37:19.102 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:19.102 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:19.102 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:19.102 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:19.102 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:19.102 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:19.102 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121112 2024-09-12T18:37:19.103 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.103 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:19.103 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.103 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:19.103 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243446+0000", 2024-09-12T18:37:19.103 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:19.103 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.103 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.104 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:19.104 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243446+0000", 2024-09-12T18:37:19.104 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:19.104 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.104 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.104 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:19.104 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243448+0000", 2024-09-12T18:37:19.104 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0829999999999998e-06 2024-09-12T18:37:19.104 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.105 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.105 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:19.105 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243527+0000", 2024-09-12T18:37:19.105 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9173999999999998e-05 2024-09-12T18:37:19.105 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.105 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.105 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:19.105 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243549+0000", 2024-09-12T18:37:19.106 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1169e-05 2024-09-12T18:37:19.106 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.106 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.106 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.106 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243564+0000", 2024-09-12T18:37:19.106 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5866999999999999e-05 2024-09-12T18:37:19.106 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.106 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.107 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:19.107 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.249905+0000", 2024-09-12T18:37:19.107 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063410360000000004 2024-09-12T18:37:19.107 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.107 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.107 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:19.107 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.250166+0000", 2024-09-12T18:37:19.107 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026052999999999997 2024-09-12T18:37:19.108 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.108 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.108 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:19.108 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.250486+0000", 2024-09-12T18:37:19.108 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00032002700000000002 2024-09-12T18:37:19.108 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.108 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.108 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:19.108 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.259263+0000", 2024-09-12T18:37:19.109 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0087774770000000005 2024-09-12T18:37:19.109 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.109 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.109 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:19.109 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272186+0000", 2024-09-12T18:37:19.109 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.01292213 2024-09-12T18:37:19.109 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.109 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.109 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:19.110 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272267+0000", 2024-09-12T18:37:19.110 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1153e-05 2024-09-12T18:37:19.110 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.110 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.110 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:19.110 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272340+0000", 2024-09-12T18:37:19.110 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3504000000000006e-05 2024-09-12T18:37:19.110 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:19.110 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:19.110 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:19.110 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.111 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.111 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121114 5.d 5:b8870c11:::benchmark_data_smithi073_23739_object121113:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:19.111 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.243603+0000", 2024-09-12T18:37:19.111 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 38.765277093000002, 2024-09-12T18:37:19.111 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028945746000000001, 2024-09-12T18:37:19.111 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:19.111 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:19.111 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:19.111 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:19.111 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:19.111 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:19.111 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121114 2024-09-12T18:37:19.111 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.111 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:19.112 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.112 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:19.112 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243603+0000", 2024-09-12T18:37:19.112 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:19.112 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.112 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.112 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:19.112 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243603+0000", 2024-09-12T18:37:19.112 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:19.112 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.112 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.112 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:19.112 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243605+0000", 2024-09-12T18:37:19.113 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.268e-06 2024-09-12T18:37:19.113 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.113 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.113 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:19.113 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243674+0000", 2024-09-12T18:37:19.113 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9375000000000006e-05 2024-09-12T18:37:19.113 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.113 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.113 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:19.113 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243691+0000", 2024-09-12T18:37:19.113 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6517000000000001e-05 2024-09-12T18:37:19.114 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.114 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.114 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.114 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243702+0000", 2024-09-12T18:37:19.114 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1905999999999999e-05 2024-09-12T18:37:19.114 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.114 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.114 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:19.114 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.253789+0000", 2024-09-12T18:37:19.114 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.010086776 2024-09-12T18:37:19.114 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.114 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.114 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:19.114 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.253959+0000", 2024-09-12T18:37:19.115 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00017000000000000001 2024-09-12T18:37:19.115 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.115 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.115 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:19.115 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.254179+0000", 2024-09-12T18:37:19.115 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022003699999999999 2024-09-12T18:37:19.115 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.116 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.116 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:19.116 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.259330+0000", 2024-09-12T18:37:19.116 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0051511559999999996 2024-09-12T18:37:19.116 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.116 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.116 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:19.116 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272403+0000", 2024-09-12T18:37:19.116 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013072342000000001 2024-09-12T18:37:19.116 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.116 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.116 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:19.116 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272493+0000", 2024-09-12T18:37:19.117 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0595999999999998e-05 2024-09-12T18:37:19.117 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.117 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.117 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:19.117 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272549+0000", 2024-09-12T18:37:19.117 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5773000000000003e-05 2024-09-12T18:37:19.117 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:19.117 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:19.117 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:19.117 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.117 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.117 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121115 5.d 5:bd4a51ea:::benchmark_data_smithi073_23739_object121114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:19.117 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.245059+0000", 2024-09-12T18:37:19.118 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 38.763821419000003, 2024-09-12T18:37:19.118 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.02767406, 2024-09-12T18:37:19.118 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:19.118 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:19.118 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:19.118 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:19.118 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:19.118 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:19.118 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121115 2024-09-12T18:37:19.118 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.118 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:19.118 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.118 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:19.119 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245059+0000", 2024-09-12T18:37:19.119 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:19.119 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.119 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.119 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:19.119 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245059+0000", 2024-09-12T18:37:19.119 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:19.119 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.119 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.119 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:19.119 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245061+0000", 2024-09-12T18:37:19.119 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9759999999999998e-06 2024-09-12T18:37:19.119 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.119 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.120 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:19.120 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245111+0000", 2024-09-12T18:37:19.120 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9838e-05 2024-09-12T18:37:19.120 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.120 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.120 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:19.120 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245132+0000", 2024-09-12T18:37:19.120 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1469999999999999e-05 2024-09-12T18:37:19.120 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.120 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.120 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.120 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245146+0000", 2024-09-12T18:37:19.120 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3377000000000001e-05 2024-09-12T18:37:19.120 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.120 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.121 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:19.121 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256596+0000", 2024-09-12T18:37:19.121 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011450241999999999 2024-09-12T18:37:19.121 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.121 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.121 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:19.121 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256838+0000", 2024-09-12T18:37:19.121 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000242255 2024-09-12T18:37:19.121 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.121 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.121 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:19.121 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.257095+0000", 2024-09-12T18:37:19.121 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025679300000000001 2024-09-12T18:37:19.121 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.122 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.122 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:19.122 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.259928+0000", 2024-09-12T18:37:19.122 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0028326290000000001 2024-09-12T18:37:19.122 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.122 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.122 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:19.122 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272607+0000", 2024-09-12T18:37:19.122 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012679466 2024-09-12T18:37:19.122 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.122 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.122 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:19.122 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272681+0000", 2024-09-12T18:37:19.122 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3580999999999999e-05 2024-09-12T18:37:19.123 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.123 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.123 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:19.123 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272733+0000", 2024-09-12T18:37:19.123 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2432999999999998e-05 2024-09-12T18:37:19.123 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:19.123 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:19.123 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:19.123 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.123 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.123 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121148 5.4 5:2a9bde06:::benchmark_data_smithi073_23739_object121147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:19.123 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.281423+0000", 2024-09-12T18:37:19.123 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 38.727457776999998, 2024-09-12T18:37:19.123 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025774785000000001, 2024-09-12T18:37:19.124 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:19.124 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:19.124 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:19.124 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:19.124 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:19.124 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:19.124 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121148 2024-09-12T18:37:19.124 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.124 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:19.124 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.124 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:19.124 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281423+0000", 2024-09-12T18:37:19.125 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:19.125 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.125 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.125 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:19.125 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281423+0000", 2024-09-12T18:37:19.125 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:19.125 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.125 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.125 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:19.125 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281424+0000", 2024-09-12T18:37:19.125 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.048e-06 2024-09-12T18:37:19.125 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.125 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.126 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:19.126 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281496+0000", 2024-09-12T18:37:19.126 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2099000000000002e-05 2024-09-12T18:37:19.126 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.126 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.126 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:19.126 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281509+0000", 2024-09-12T18:37:19.126 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3379e-05 2024-09-12T18:37:19.126 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.126 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.126 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.126 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281515+0000", 2024-09-12T18:37:19.126 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.28e-06 2024-09-12T18:37:19.127 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.127 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.127 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:19.127 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281688+0000", 2024-09-12T18:37:19.127 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00017203100000000001 2024-09-12T18:37:19.127 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.127 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.127 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:19.127 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.281834+0000", 2024-09-12T18:37:19.127 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014645899999999999 2024-09-12T18:37:19.127 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.127 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.127 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:19.128 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.282319+0000", 2024-09-12T18:37:19.128 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048535000000000001 2024-09-12T18:37:19.128 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.128 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.128 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:19.128 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307086+0000", 2024-09-12T18:37:19.128 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024766989999999999 2024-09-12T18:37:19.128 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.128 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.128 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:19.128 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307108+0000", 2024-09-12T18:37:19.128 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1795999999999999e-05 2024-09-12T18:37:19.128 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.128 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.128 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:19.129 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307157+0000", 2024-09-12T18:37:19.129 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8729000000000001e-05 2024-09-12T18:37:19.129 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.129 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.129 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:19.129 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307197+0000", 2024-09-12T18:37:19.129 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0624000000000003e-05 2024-09-12T18:37:19.129 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:19.129 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:19.129 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:19.129 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.129 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.129 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121155 5.4 5:2af257d1:::benchmark_data_smithi073_23739_object121154:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:19.130 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.283163+0000", 2024-09-12T18:37:19.130 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 38.725717101999997, 2024-09-12T18:37:19.130 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024186485000000001, 2024-09-12T18:37:19.130 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:19.130 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:19.130 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:19.130 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:19.130 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:19.130 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:19.130 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121155 2024-09-12T18:37:19.130 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.130 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:19.130 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.131 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:19.131 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283163+0000", 2024-09-12T18:37:19.131 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:19.131 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.131 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.131 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:19.131 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283163+0000", 2024-09-12T18:37:19.131 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:19.131 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.131 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.131 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:19.131 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283165+0000", 2024-09-12T18:37:19.131 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.748e-06 2024-09-12T18:37:19.132 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.132 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.132 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:19.132 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283218+0000", 2024-09-12T18:37:19.132 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2695000000000003e-05 2024-09-12T18:37:19.132 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.132 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.132 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:19.132 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283244+0000", 2024-09-12T18:37:19.132 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6072e-05 2024-09-12T18:37:19.133 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.133 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.133 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.133 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.283257+0000", 2024-09-12T18:37:19.133 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3054000000000001e-05 2024-09-12T18:37:19.133 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.133 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.133 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:19.133 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.294509+0000", 2024-09-12T18:37:19.133 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011251677999999999 2024-09-12T18:37:19.133 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.133 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.134 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:19.134 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.294705+0000", 2024-09-12T18:37:19.134 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000196369 2024-09-12T18:37:19.134 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.134 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.134 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:19.134 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.294907+0000", 2024-09-12T18:37:19.134 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020184700000000001 2024-09-12T18:37:19.134 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.134 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.134 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:19.134 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307208+0000", 2024-09-12T18:37:19.134 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012301068 2024-09-12T18:37:19.135 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.135 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.135 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:19.135 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307273+0000", 2024-09-12T18:37:19.135 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5611000000000006e-05 2024-09-12T18:37:19.135 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.135 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.135 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:19.135 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307320+0000", 2024-09-12T18:37:19.136 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6220999999999997e-05 2024-09-12T18:37:19.136 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.136 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.136 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:19.136 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.307350+0000", 2024-09-12T18:37:19.136 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.0122000000000001e-05 2024-09-12T18:37:19.136 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:19.136 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:19.136 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:19.136 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.136 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.136 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121160 5.b 5:d4730c8e:::benchmark_data_smithi073_23739_object121159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:19.136 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.289262+0000", 2024-09-12T18:37:19.136 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 38.719618085999997, 2024-09-12T18:37:19.137 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024618870000000001, 2024-09-12T18:37:19.137 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:19.137 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:19.137 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:19.137 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:19.137 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:19.137 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:19.137 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121160 2024-09-12T18:37:19.137 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.137 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:19.137 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.137 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:19.137 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289262+0000", 2024-09-12T18:37:19.138 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:19.138 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.138 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.138 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:19.138 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289262+0000", 2024-09-12T18:37:19.138 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:19.138 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.138 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.138 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:19.138 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289264+0000", 2024-09-12T18:37:19.138 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.945e-06 2024-09-12T18:37:19.138 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.138 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.139 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:19.139 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289331+0000", 2024-09-12T18:37:19.139 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6594999999999995e-05 2024-09-12T18:37:19.139 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.139 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.139 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:19.139 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289359+0000", 2024-09-12T18:37:19.139 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7988999999999999e-05 2024-09-12T18:37:19.139 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.139 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.139 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.139 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289375+0000", 2024-09-12T18:37:19.139 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5639000000000001e-05 2024-09-12T18:37:19.139 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.140 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.140 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:19.140 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289515+0000", 2024-09-12T18:37:19.140 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000140254 2024-09-12T18:37:19.140 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.140 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.140 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:19.140 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.289740+0000", 2024-09-12T18:37:19.140 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022513500000000001 2024-09-12T18:37:19.140 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.140 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.140 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:19.141 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.290232+0000", 2024-09-12T18:37:19.141 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00049247500000000003 2024-09-12T18:37:19.141 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.141 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.141 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:19.141 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.312221+0000", 2024-09-12T18:37:19.141 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.021988939999999998 2024-09-12T18:37:19.141 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.141 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.141 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:19.141 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.313807+0000", 2024-09-12T18:37:19.142 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0015859100000000001 2024-09-12T18:37:19.142 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.142 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.142 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:19.142 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.313852+0000", 2024-09-12T18:37:19.142 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4305999999999999e-05 2024-09-12T18:37:19.142 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.142 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.142 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:19.142 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.313881+0000", 2024-09-12T18:37:19.142 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9682000000000001e-05 2024-09-12T18:37:19.142 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:19.142 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:19.142 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:19.142 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.143 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.143 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:131551 5.d 5:b8f8c77a:::benchmark_data_smithi073_23739_object131550:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:37:19.143 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:45.499878+0000", 2024-09-12T18:37:19.143 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 33.509002154999997, 2024-09-12T18:37:19.143 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.027478433, 2024-09-12T18:37:19.143 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:19.143 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:19.143 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:19.143 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:19.143 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:19.144 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:19.144 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 131551 2024-09-12T18:37:19.144 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.144 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:19.144 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.144 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:19.144 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499878+0000", 2024-09-12T18:37:19.144 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:19.144 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.144 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.144 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:19.144 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499878+0000", 2024-09-12T18:37:19.145 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:19.145 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.145 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.145 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:19.145 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499879+0000", 2024-09-12T18:37:19.145 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.92e-07 2024-09-12T18:37:19.145 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.145 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.145 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:19.145 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499946+0000", 2024-09-12T18:37:19.145 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6712999999999996e-05 2024-09-12T18:37:19.145 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.145 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.145 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:19.146 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499953+0000", 2024-09-12T18:37:19.146 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5519999999999999e-06 2024-09-12T18:37:19.146 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.146 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.146 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.146 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499959+0000", 2024-09-12T18:37:19.146 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0430000000000004e-06 2024-09-12T18:37:19.146 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.146 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.146 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:19.146 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.500004+0000", 2024-09-12T18:37:19.147 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5058000000000001e-05 2024-09-12T18:37:19.147 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.147 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.147 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:19.147 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.500121+0000", 2024-09-12T18:37:19.147 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000116747 2024-09-12T18:37:19.147 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.147 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.147 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:19.147 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.500283+0000", 2024-09-12T18:37:19.147 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016190599999999999 2024-09-12T18:37:19.147 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.147 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.148 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:19.148 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.504017+0000", 2024-09-12T18:37:19.148 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003734125 2024-09-12T18:37:19.148 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.148 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.148 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:19.148 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.527224+0000", 2024-09-12T18:37:19.148 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.023206724000000001 2024-09-12T18:37:19.148 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.148 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.148 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:19.148 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.527290+0000", 2024-09-12T18:37:19.149 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5778999999999995e-05 2024-09-12T18:37:19.149 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.149 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.149 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:19.149 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.527357+0000", 2024-09-12T18:37:19.149 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7094000000000005e-05 2024-09-12T18:37:19.149 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:19.149 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:19.149 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:19.149 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.149 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.149 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:167368 5.4 5:29a1ec58:::benchmark_data_smithi073_23739_object35091:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:19.150 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:03.168773+0000", 2024-09-12T18:37:19.150 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 15.840107202, 2024-09-12T18:37:19.150 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.066578597000000003, 2024-09-12T18:37:19.150 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:19.150 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:19.150 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:19.150 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:19.150 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:19.150 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:19.150 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 167368 2024-09-12T18:37:19.150 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.150 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:19.150 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.150 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:19.151 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168773+0000", 2024-09-12T18:37:19.151 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:19.151 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.151 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.151 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:19.151 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168773+0000", 2024-09-12T18:37:19.151 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:19.151 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.151 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.151 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:19.151 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168774+0000", 2024-09-12T18:37:19.151 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.023e-06 2024-09-12T18:37:19.151 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.151 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.152 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:19.152 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168779+0000", 2024-09-12T18:37:19.152 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5800000000000002e-06 2024-09-12T18:37:19.152 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.152 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.152 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:19.152 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168789+0000", 2024-09-12T18:37:19.152 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0346999999999999e-05 2024-09-12T18:37:19.152 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.152 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.152 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.152 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168808+0000", 2024-09-12T18:37:19.152 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8423e-05 2024-09-12T18:37:19.153 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.153 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.153 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:19.153 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168864+0000", 2024-09-12T18:37:19.153 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-09-12T18:37:19.153 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.153 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.153 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:19.153 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168947+0000", 2024-09-12T18:37:19.153 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3274000000000003e-05 2024-09-12T18:37:19.153 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.153 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.154 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:19.154 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.169014+0000", 2024-09-12T18:37:19.154 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6284000000000004e-05 2024-09-12T18:37:19.154 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.154 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.154 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:19.154 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.170653+0000", 2024-09-12T18:37:19.154 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016389779999999999 2024-09-12T18:37:19.154 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.154 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.154 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:19.155 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.235279+0000", 2024-09-12T18:37:19.155 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064626464999999994 2024-09-12T18:37:19.155 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.155 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.155 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:19.155 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.235320+0000", 2024-09-12T18:37:19.155 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0377000000000003e-05 2024-09-12T18:37:19.155 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.155 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.155 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:19.155 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.235352+0000", 2024-09-12T18:37:19.155 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2322e-05 2024-09-12T18:37:19.155 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:19.155 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:19.156 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:19.156 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.156 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.156 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:167371 5.4 5:24fea27c:::benchmark_data_smithi073_23739_object35094:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:19.156 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:03.171234+0000", 2024-09-12T18:37:19.156 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 15.837646177, 2024-09-12T18:37:19.156 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.066048171000000003, 2024-09-12T18:37:19.156 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:19.156 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:19.156 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:19.156 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:19.157 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:19.157 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:19.157 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 167371 2024-09-12T18:37:19.157 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.157 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:19.157 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.157 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:19.157 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171234+0000", 2024-09-12T18:37:19.157 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:19.157 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.157 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.157 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:19.157 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171234+0000", 2024-09-12T18:37:19.158 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:19.158 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.158 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.158 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:19.158 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171235+0000", 2024-09-12T18:37:19.158 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8599999999999997e-07 2024-09-12T18:37:19.158 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.158 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.158 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:19.158 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171238+0000", 2024-09-12T18:37:19.158 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9739999999999998e-06 2024-09-12T18:37:19.158 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.158 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.159 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:19.159 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171245+0000", 2024-09-12T18:37:19.159 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6000000000000003e-06 2024-09-12T18:37:19.159 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.159 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.159 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.159 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171249+0000", 2024-09-12T18:37:19.159 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9960000000000004e-06 2024-09-12T18:37:19.159 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.159 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.159 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:19.159 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171288+0000", 2024-09-12T18:37:19.159 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9119999999999998e-05 2024-09-12T18:37:19.159 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.160 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.160 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:19.160 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171359+0000", 2024-09-12T18:37:19.160 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0951000000000006e-05 2024-09-12T18:37:19.160 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.160 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.160 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:19.160 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171425+0000", 2024-09-12T18:37:19.160 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.58e-05 2024-09-12T18:37:19.160 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.160 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.160 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:19.160 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.173093+0000", 2024-09-12T18:37:19.161 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016683939999999999 2024-09-12T18:37:19.161 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.161 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.161 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:19.161 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.237202+0000", 2024-09-12T18:37:19.161 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064109437000000005 2024-09-12T18:37:19.161 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.161 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.161 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:19.161 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.237249+0000", 2024-09-12T18:37:19.161 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6751e-05 2024-09-12T18:37:19.161 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:19.161 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:19.162 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:19.162 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.237282+0000", 2024-09-12T18:37:19.162 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3262000000000001e-05 2024-09-12T18:37:19.162 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:19.162 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:19.162 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:19.162 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:19.162 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:19.162 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:19.164 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:37:19.164 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:19.156+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:19.264 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:19.258+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:19.326 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:19.326 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:37:19.326 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.326 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:199129 5.1 5.7fd7b511 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:19.326 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:19.320372+0000", 2024-09-12T18:37:19.327 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.002857825, 2024-09-12T18:37:19.327 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.002877194, 2024-09-12T18:37:19.327 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:19.327 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:19.327 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:19.327 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:19.327 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:19.327 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:19.327 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 199129 2024-09-12T18:37:19.327 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.327 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:19.327 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.327 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:19.327 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320372+0000", 2024-09-12T18:37:19.328 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.328 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.328 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.328 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:19.328 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320372+0000", 2024-09-12T18:37:19.328 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.328 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.328 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.328 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:19.328 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320373+0000", 2024-09-12T18:37:19.328 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2200000000000004e-07 2024-09-12T18:37:19.328 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.328 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.329 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:19.329 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320376+0000", 2024-09-12T18:37:19.329 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.9119999999999998e-06 2024-09-12T18:37:19.329 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.329 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.329 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:19.329 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320385+0000", 2024-09-12T18:37:19.329 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.8060000000000006e-06 2024-09-12T18:37:19.329 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.329 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.329 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.329 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320390+0000", 2024-09-12T18:37:19.329 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.7990000000000001e-06 2024-09-12T18:37:19.330 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.330 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:19.330 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.330 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.330 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.330 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:199130 5.2 5:48625153:::benchmark_data_smithi073_23739_object66853:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:19.330 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:19.320430+0000", 2024-09-12T18:37:19.330 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0028003899999999998, 2024-09-12T18:37:19.330 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028996400000000002, 2024-09-12T18:37:19.330 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:19.330 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:19.330 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:19.330 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:19.331 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:19.331 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:19.331 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 199130 2024-09-12T18:37:19.331 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.331 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:19.331 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.331 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:19.331 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320430+0000", 2024-09-12T18:37:19.331 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.331 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.331 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.331 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:19.331 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320430+0000", 2024-09-12T18:37:19.332 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.332 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.332 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.332 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:19.332 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320431+0000", 2024-09-12T18:37:19.332 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.065e-06 2024-09-12T18:37:19.332 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.332 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.332 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:19.332 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320435+0000", 2024-09-12T18:37:19.332 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.9770000000000002e-06 2024-09-12T18:37:19.332 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.332 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.332 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:19.333 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320443+0000", 2024-09-12T18:37:19.333 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.0469999999999994e-06 2024-09-12T18:37:19.333 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.333 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.333 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.333 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320448+0000", 2024-09-12T18:37:19.333 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.9250000000000003e-06 2024-09-12T18:37:19.333 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.333 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.333 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:19.333 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320513+0000", 2024-09-12T18:37:19.333 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.5732e-05 2024-09-12T18:37:19.333 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.334 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.334 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:19.334 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320636+0000", 2024-09-12T18:37:19.334 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000122929 2024-09-12T18:37:19.334 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.334 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.334 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:19.334 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320743+0000", 2024-09-12T18:37:19.334 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000106752 2024-09-12T18:37:19.335 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.335 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.335 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:19.335 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.322889+0000", 2024-09-12T18:37:19.335 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0021463630000000001 2024-09-12T18:37:19.335 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.335 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:19.335 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.335 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.335 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.335 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:199131 5.9 5.17f9f829 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:19.335 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:19.320620+0000", 2024-09-12T18:37:19.335 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0026095929999999999, 2024-09-12T18:37:19.336 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.002775451, 2024-09-12T18:37:19.336 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:19.336 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:19.336 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:19.336 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:19.336 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:19.336 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:19.336 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 199131 2024-09-12T18:37:19.336 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.337 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:19.337 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.337 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:19.337 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320620+0000", 2024-09-12T18:37:19.337 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.337 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.337 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.337 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:19.337 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320620+0000", 2024-09-12T18:37:19.337 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.337 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.337 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.337 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:19.338 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320621+0000", 2024-09-12T18:37:19.338 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.8599999999999996e-07 2024-09-12T18:37:19.338 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.338 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.338 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:19.338 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320627+0000", 2024-09-12T18:37:19.338 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.7049999999999996e-06 2024-09-12T18:37:19.338 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.338 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.338 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:19.338 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320635+0000", 2024-09-12T18:37:19.338 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.3359999999999995e-06 2024-09-12T18:37:19.338 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.338 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.339 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.339 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320642+0000", 2024-09-12T18:37:19.339 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.1140000000000002e-06 2024-09-12T18:37:19.339 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.339 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:19.339 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.339 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.339 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.339 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:199126 5.6 e67/21 5:694996e6:::benchmark_data_smithi073_23739_object66849:head v 67'12483, mlcod=67'12481)", 2024-09-12T18:37:19.339 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:19.320673+0000", 2024-09-12T18:37:19.339 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.002557045, 2024-09-12T18:37:19.339 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0027689709999999998, 2024-09-12T18:37:19.340 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:19.340 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:19.340 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:37:19.340 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:19.340 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.340 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:19.340 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320673+0000", 2024-09-12T18:37:19.340 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.340 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.340 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.340 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:19.340 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320673+0000", 2024-09-12T18:37:19.340 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.341 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.341 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.341 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:19.341 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320674+0000", 2024-09-12T18:37:19.341 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.1999999999999999e-07 2024-09-12T18:37:19.341 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.341 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.341 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:19.341 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320679+0000", 2024-09-12T18:37:19.341 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.609e-06 2024-09-12T18:37:19.341 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.342 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.342 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:19.342 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320685+0000", 2024-09-12T18:37:19.342 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.0039999999999996e-06 2024-09-12T18:37:19.342 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.342 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.342 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.342 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320690+0000", 2024-09-12T18:37:19.342 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.245e-06 2024-09-12T18:37:19.342 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.342 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.342 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:19.342 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320758+0000", 2024-09-12T18:37:19.343 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.8607000000000002e-05 2024-09-12T18:37:19.343 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.343 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.343 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:19.343 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320778+0000", 2024-09-12T18:37:19.343 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9834e-05 2024-09-12T18:37:19.343 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.343 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:19.343 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.343 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.343 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.343 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:199125 5.3 e67/21 5:c5c00577:::benchmark_data_smithi073_23739_object66848:head v 67'12211, mlcod=67'12209)", 2024-09-12T18:37:19.344 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:19.320800+0000", 2024-09-12T18:37:19.344 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0024300319999999999, 2024-09-12T18:37:19.344 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0026970290000000001, 2024-09-12T18:37:19.344 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:19.344 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:19.344 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:37:19.344 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:19.344 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.344 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:19.344 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320800+0000", 2024-09-12T18:37:19.344 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.345 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.345 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.345 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:19.345 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320800+0000", 2024-09-12T18:37:19.345 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.345 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.345 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.345 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:19.345 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320800+0000", 2024-09-12T18:37:19.345 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.51e-07 2024-09-12T18:37:19.345 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.345 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.345 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:19.346 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320805+0000", 2024-09-12T18:37:19.346 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.0709999999999996e-06 2024-09-12T18:37:19.346 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.346 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.346 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:19.346 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320812+0000", 2024-09-12T18:37:19.346 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.9880000000000004e-06 2024-09-12T18:37:19.346 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.346 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.346 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.346 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320818+0000", 2024-09-12T18:37:19.346 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5639999999999996e-06 2024-09-12T18:37:19.346 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.347 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.347 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:19.347 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320870+0000", 2024-09-12T18:37:19.347 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1520999999999997e-05 2024-09-12T18:37:19.347 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.347 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.347 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:19.347 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320886+0000", 2024-09-12T18:37:19.347 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6427e-05 2024-09-12T18:37:19.347 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.348 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:19.348 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.348 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.348 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.348 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:199124 5.d e67/21 5:b086f6dc:::benchmark_data_smithi073_23739_object66847:head v 67'12605, mlcod=67'12602)", 2024-09-12T18:37:19.348 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:19.322066+0000", 2024-09-12T18:37:19.348 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0011640520000000001, 2024-09-12T18:37:19.348 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0014772920000000001, 2024-09-12T18:37:19.348 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:19.348 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:19.348 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:37:19.348 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:19.349 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.349 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:19.349 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.322066+0000", 2024-09-12T18:37:19.349 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.349 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.349 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.349 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:19.349 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.322066+0000", 2024-09-12T18:37:19.349 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.349 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.349 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.349 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:19.349 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.322067+0000", 2024-09-12T18:37:19.349 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.1800000000000005e-07 2024-09-12T18:37:19.350 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.350 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.350 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:19.350 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.322075+0000", 2024-09-12T18:37:19.350 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.2840000000000006e-06 2024-09-12T18:37:19.350 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.350 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.350 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:19.350 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.322089+0000", 2024-09-12T18:37:19.350 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4110999999999999e-05 2024-09-12T18:37:19.350 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.350 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.350 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.351 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.322103+0000", 2024-09-12T18:37:19.351 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4319e-05 2024-09-12T18:37:19.351 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.351 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.351 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:19.351 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.322255+0000", 2024-09-12T18:37:19.351 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000151683 2024-09-12T18:37:19.351 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.351 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.351 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:19.351 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.322272+0000", 2024-09-12T18:37:19.351 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7299000000000002e-05 2024-09-12T18:37:19.351 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.352 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:19.352 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.352 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.352 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.352 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop_reply(client.4480.0:199120 5.1 e67/65 ondisk, result = 0)", 2024-09-12T18:37:19.352 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:19.322708+0000", 2024-09-12T18:37:19.352 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.00052216700000000003, 2024-09-12T18:37:19.352 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00087922200000000003, 2024-09-12T18:37:19.352 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:19.352 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:19.352 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:37:19.352 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:19.352 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.353 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:19.353 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.322708+0000", 2024-09-12T18:37:19.353 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.353 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.353 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.353 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:19.353 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.322708+0000", 2024-09-12T18:37:19.353 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.353 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.353 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.353 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:19.353 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.322709+0000", 2024-09-12T18:37:19.353 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4399999999999999e-07 2024-09-12T18:37:19.354 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.354 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.354 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:19.354 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.322712+0000", 2024-09-12T18:37:19.354 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5370000000000002e-06 2024-09-12T18:37:19.354 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.354 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.354 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:19.354 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.322724+0000", 2024-09-12T18:37:19.354 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1951e-05 2024-09-12T18:37:19.354 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.354 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.354 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.355 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.322730+0000", 2024-09-12T18:37:19.355 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.1340000000000001e-06 2024-09-12T18:37:19.355 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.355 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.355 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:19.355 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.322928+0000", 2024-09-12T18:37:19.355 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000197729 2024-09-12T18:37:19.355 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.355 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.355 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:19.356 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.322934+0000", 2024-09-12T18:37:19.356 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.1249999999999998e-06 2024-09-12T18:37:19.356 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.356 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:19.356 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.356 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.356 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.356 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:199132 5.c e67/21 5:322b8c79:::benchmark_data_smithi073_23739_object66855:head v 67'12335, mlcod=67'12333)", 2024-09-12T18:37:19.357 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:19.322974+0000", 2024-09-12T18:37:19.357 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.00025595899999999999, 2024-09-12T18:37:19.357 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00065843300000000004, 2024-09-12T18:37:19.357 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:19.357 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:19.357 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:37:19.357 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:19.357 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.357 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:19.358 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.322974+0000", 2024-09-12T18:37:19.358 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.358 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.358 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.358 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:19.358 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.322974+0000", 2024-09-12T18:37:19.358 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.358 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.358 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.358 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:19.359 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.322975+0000", 2024-09-12T18:37:19.359 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.6499999999999998e-07 2024-09-12T18:37:19.359 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.359 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.359 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:19.359 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.322981+0000", 2024-09-12T18:37:19.359 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.7780000000000004e-06 2024-09-12T18:37:19.359 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.360 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.360 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:19.360 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.322990+0000", 2024-09-12T18:37:19.360 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.8030000000000008e-06 2024-09-12T18:37:19.360 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.360 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.360 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.361 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.322998+0000", 2024-09-12T18:37:19.361 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.1350000000000003e-06 2024-09-12T18:37:19.361 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.361 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.361 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:19.361 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.323041+0000", 2024-09-12T18:37:19.361 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.3578000000000002e-05 2024-09-12T18:37:19.361 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.361 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.361 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:19.361 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.323057+0000", 2024-09-12T18:37:19.361 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5654999999999998e-05 2024-09-12T18:37:19.361 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.362 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:19.362 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.362 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.362 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.362 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop_reply(client.4480.0:199122 5.1 e67/65)", 2024-09-12T18:37:19.362 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:19.323002+0000", 2024-09-12T18:37:19.362 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.00022774000000000001, 2024-09-12T18:37:19.362 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00067502399999999998, 2024-09-12T18:37:19.362 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:19.362 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:19.362 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:19.362 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:19.362 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.362 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:19.363 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.323002+0000", 2024-09-12T18:37:19.363 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.363 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.363 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.363 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:19.363 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.323002+0000", 2024-09-12T18:37:19.363 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.363 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.363 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.363 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:19.363 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.323003+0000", 2024-09-12T18:37:19.363 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9999999999999997e-07 2024-09-12T18:37:19.363 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.364 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.364 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:19.364 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.323007+0000", 2024-09-12T18:37:19.364 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.7759999999999999e-06 2024-09-12T18:37:19.364 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.364 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.364 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:19.364 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.323015+0000", 2024-09-12T18:37:19.364 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5599999999999994e-06 2024-09-12T18:37:19.364 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.365 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.365 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.365 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.323023+0000", 2024-09-12T18:37:19.365 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.6569999999999997e-06 2024-09-12T18:37:19.365 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.365 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:19.365 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.365 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.365 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.365 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "MOSDPGPushReply(5.5 67/49 [PushReplyOp(5:a24423df:::benchmark_data_smithi073_23739_object73203:head)])", 2024-09-12T18:37:19.365 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:19.323078+0000", 2024-09-12T18:37:19.365 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.00015171999999999999, 2024-09-12T18:37:19.365 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00063545599999999995, 2024-09-12T18:37:19.366 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:19.366 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:19.366 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:19.366 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:19.366 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.366 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:19.366 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.323078+0000", 2024-09-12T18:37:19.366 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.366 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.366 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.366 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:19.366 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.323078+0000", 2024-09-12T18:37:19.366 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.366 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.367 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.367 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:19.367 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.323079+0000", 2024-09-12T18:37:19.367 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.9999999999999999e-07 2024-09-12T18:37:19.367 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.367 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.367 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:19.367 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.323082+0000", 2024-09-12T18:37:19.367 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.1489999999999998e-06 2024-09-12T18:37:19.367 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.367 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.367 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:19.367 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.323100+0000", 2024-09-12T18:37:19.368 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.8459000000000001e-05 2024-09-12T18:37:19.368 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.368 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.368 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.368 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.323107+0000", 2024-09-12T18:37:19.368 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.165e-06 2024-09-12T18:37:19.368 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.368 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:19.368 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.368 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.368 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.368 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:199135 5.5 5.eb293225 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:19.368 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:19.323445+0000", 2024-09-12T18:37:19.369 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 4294967295.9997845, 2024-09-12T18:37:19.369 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00030602199999999998, 2024-09-12T18:37:19.369 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:19.369 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:19.369 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:19.369 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:19.369 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:19.369 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:19.369 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 199135 2024-09-12T18:37:19.369 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.369 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:19.369 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.369 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:19.370 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.323445+0000", 2024-09-12T18:37:19.370 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.370 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.370 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.370 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:19.370 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.323445+0000", 2024-09-12T18:37:19.370 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.370 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.370 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.370 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:19.370 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.323447+0000", 2024-09-12T18:37:19.370 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2810000000000001e-06 2024-09-12T18:37:19.370 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.370 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.371 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:19.371 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.323451+0000", 2024-09-12T18:37:19.371 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.9089999999999999e-06 2024-09-12T18:37:19.371 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.371 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.371 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:19.371 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.323463+0000", 2024-09-12T18:37:19.371 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1471000000000001e-05 2024-09-12T18:37:19.371 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.371 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.371 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.371 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.323470+0000", 2024-09-12T18:37:19.372 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.4209999999999998e-06 2024-09-12T18:37:19.372 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.372 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:19.372 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.372 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.372 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.372 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:199118 5.1 5:863324e9:::benchmark_data_smithi073_23739_object66841:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:19.372 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:19.316852+0000", 2024-09-12T18:37:19.372 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0063782079999999998, 2024-09-12T18:37:19.372 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0069476649999999996, 2024-09-12T18:37:19.372 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:19.372 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:19.372 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:19.373 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:19.373 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:19.373 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:19.373 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 199118 2024-09-12T18:37:19.373 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.373 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:19.373 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.373 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:19.373 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.316852+0000", 2024-09-12T18:37:19.373 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.373 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.373 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.373 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:19.373 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.316852+0000", 2024-09-12T18:37:19.374 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.374 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.374 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.374 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:19.374 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.316853+0000", 2024-09-12T18:37:19.374 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.5499999999999996e-07 2024-09-12T18:37:19.374 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.374 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.374 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:19.374 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.316857+0000", 2024-09-12T18:37:19.374 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.1139999999999999e-06 2024-09-12T18:37:19.374 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.374 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.374 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:19.375 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.316867+0000", 2024-09-12T18:37:19.375 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.6609999999999995e-06 2024-09-12T18:37:19.375 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.375 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.375 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.375 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.316873+0000", 2024-09-12T18:37:19.375 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.8889999999999996e-06 2024-09-12T18:37:19.375 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.375 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.375 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:19.375 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.316935+0000", 2024-09-12T18:37:19.375 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.1517000000000001e-05 2024-09-12T18:37:19.376 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.376 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.376 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:19.376 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.317068+0000", 2024-09-12T18:37:19.376 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000132621 2024-09-12T18:37:19.376 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.376 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.376 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:19.376 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.317167+0000", 2024-09-12T18:37:19.377 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.8979000000000002e-05 2024-09-12T18:37:19.377 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.377 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.377 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:19.377 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.322876+0000", 2024-09-12T18:37:19.377 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0057093819999999998 2024-09-12T18:37:19.378 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.378 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.378 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:19.378 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.322950+0000", 2024-09-12T18:37:19.378 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.4244000000000003e-05 2024-09-12T18:37:19.378 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.379 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.379 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:19.379 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.322996+0000", 2024-09-12T18:37:19.379 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6264000000000003e-05 2024-09-12T18:37:19.379 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.379 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:19.379 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.379 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.380 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.380 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:199120 5.1 5:852def46:::benchmark_data_smithi073_23739_object66843:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:19.380 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:19.316908+0000", 2024-09-12T18:37:19.380 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0063218279999999998, 2024-09-12T18:37:19.380 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.006977759, 2024-09-12T18:37:19.380 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:19.380 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:19.381 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:19.381 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:19.381 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:19.381 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:19.381 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 199120 2024-09-12T18:37:19.382 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.382 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:19.382 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.382 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:19.382 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.316908+0000", 2024-09-12T18:37:19.382 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.382 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.382 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.382 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:19.383 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.316908+0000", 2024-09-12T18:37:19.383 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.383 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.383 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.383 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:19.383 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.316909+0000", 2024-09-12T18:37:19.383 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.6000000000000004e-07 2024-09-12T18:37:19.383 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.383 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.383 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:19.383 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.316912+0000", 2024-09-12T18:37:19.383 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.9739999999999998e-06 2024-09-12T18:37:19.383 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.383 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.384 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:19.384 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.316921+0000", 2024-09-12T18:37:19.384 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7620000000000007e-06 2024-09-12T18:37:19.384 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.384 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.384 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.384 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.316928+0000", 2024-09-12T18:37:19.384 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.3709999999999996e-06 2024-09-12T18:37:19.384 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.384 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.384 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:19.384 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.318986+0000", 2024-09-12T18:37:19.384 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0020581850000000001 2024-09-12T18:37:19.385 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.385 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.385 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:19.385 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.319127+0000", 2024-09-12T18:37:19.385 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014068699999999999 2024-09-12T18:37:19.385 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.385 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.385 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:19.386 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.319270+0000", 2024-09-12T18:37:19.386 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014305899999999999 2024-09-12T18:37:19.386 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.386 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.386 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:19.386 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.322939+0000", 2024-09-12T18:37:19.386 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0036695130000000001 2024-09-12T18:37:19.386 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.386 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:19.386 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.386 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.386 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.386 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:199122 5.1 5:88dfa519:::benchmark_data_smithi073_23739_object66845:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:19.387 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:19.318536+0000", 2024-09-12T18:37:19.387 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.004694279, 2024-09-12T18:37:19.387 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0053958629999999999, 2024-09-12T18:37:19.387 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:19.387 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:19.387 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:19.387 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:19.387 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:19.387 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:19.387 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 199122 2024-09-12T18:37:19.387 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.387 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:19.387 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.388 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:19.388 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.318536+0000", 2024-09-12T18:37:19.388 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.388 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.388 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.388 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:19.388 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.318536+0000", 2024-09-12T18:37:19.388 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.388 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.388 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.388 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:19.388 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.318537+0000", 2024-09-12T18:37:19.388 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.122e-06 2024-09-12T18:37:19.389 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.389 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.389 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:19.389 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.318541+0000", 2024-09-12T18:37:19.389 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.0409999999999999e-06 2024-09-12T18:37:19.389 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.389 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.389 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:19.389 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.318552+0000", 2024-09-12T18:37:19.389 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1296e-05 2024-09-12T18:37:19.389 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.389 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.389 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.390 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.318559+0000", 2024-09-12T18:37:19.390 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.6259999999999997e-06 2024-09-12T18:37:19.390 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.390 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.390 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:19.391 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.321048+0000", 2024-09-12T18:37:19.391 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0024890419999999999 2024-09-12T18:37:19.391 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.391 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.391 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:19.391 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.321161+0000", 2024-09-12T18:37:19.391 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000113331 2024-09-12T18:37:19.391 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.392 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.392 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:19.392 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.321266+0000", 2024-09-12T18:37:19.392 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010497000000000001 2024-09-12T18:37:19.392 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.392 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:19.392 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.392 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.392 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.392 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:199123 5.d e67/21 5:bf6b1c04:::benchmark_data_smithi073_23739_object66846:head v 67'12604, mlcod=67'12602)", 2024-09-12T18:37:19.392 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:19.320149+0000", 2024-09-12T18:37:19.392 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.003081496, 2024-09-12T18:37:19.393 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0038156840000000002, 2024-09-12T18:37:19.393 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:19.393 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:19.393 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:37:19.393 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:19.393 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.393 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:19.393 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320149+0000", 2024-09-12T18:37:19.393 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.393 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.393 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.393 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:19.393 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320149+0000", 2024-09-12T18:37:19.394 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.394 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.394 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.394 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:19.394 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320149+0000", 2024-09-12T18:37:19.394 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2399999999999998e-07 2024-09-12T18:37:19.394 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.394 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.394 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:19.394 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320155+0000", 2024-09-12T18:37:19.394 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9159999999999998e-06 2024-09-12T18:37:19.394 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.394 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.394 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:19.395 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320162+0000", 2024-09-12T18:37:19.395 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.5130000000000002e-06 2024-09-12T18:37:19.395 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.395 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.395 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.395 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320168+0000", 2024-09-12T18:37:19.395 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9950000000000002e-06 2024-09-12T18:37:19.395 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.395 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.395 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:19.395 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320212+0000", 2024-09-12T18:37:19.395 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.3977999999999998e-05 2024-09-12T18:37:19.395 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.395 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.396 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:19.396 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320233+0000", 2024-09-12T18:37:19.396 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.0973999999999999e-05 2024-09-12T18:37:19.396 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.396 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:19.396 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.396 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.396 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.396 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:199127 5.9 5:9bbd32c0:::benchmark_data_smithi073_23739_object66850:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:19.396 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:19.320289+0000", 2024-09-12T18:37:19.396 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0029414509999999999, 2024-09-12T18:37:19.396 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0037066999999999998, 2024-09-12T18:37:19.396 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:19.397 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:19.397 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:19.397 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:19.397 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:19.397 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:19.397 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 199127 2024-09-12T18:37:19.397 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.397 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:19.397 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.397 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:19.397 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320289+0000", 2024-09-12T18:37:19.398 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.398 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.398 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.398 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:19.398 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320289+0000", 2024-09-12T18:37:19.398 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.398 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.398 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.398 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:19.398 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320290+0000", 2024-09-12T18:37:19.398 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.012e-06 2024-09-12T18:37:19.398 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.398 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.398 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:19.399 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320294+0000", 2024-09-12T18:37:19.399 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6299999999999997e-06 2024-09-12T18:37:19.399 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.399 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.399 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:19.399 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320304+0000", 2024-09-12T18:37:19.399 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.01e-05 2024-09-12T18:37:19.399 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.399 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.399 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.399 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.320312+0000", 2024-09-12T18:37:19.399 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2799999999999998e-06 2024-09-12T18:37:19.399 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.399 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.400 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:19.400 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.322918+0000", 2024-09-12T18:37:19.400 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0026067339999999999 2024-09-12T18:37:19.400 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.400 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.400 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:19.400 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.323180+0000", 2024-09-12T18:37:19.400 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026119000000000001 2024-09-12T18:37:19.400 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.400 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.400 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:19.401 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:19.323247+0000", 2024-09-12T18:37:19.401 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.7772000000000001e-05 2024-09-12T18:37:19.401 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.401 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:19.401 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.401 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.401 INFO:teuthology.orchestra.run.smithi162.stdout: ], 2024-09-12T18:37:19.402 INFO:teuthology.orchestra.run.smithi162.stdout: "num_ops": 16 2024-09-12T18:37:19.402 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:19.403 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:37:19.404 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:19.398+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:19.504 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:19.496+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:19.602 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:19.602 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [], 2024-09-12T18:37:19.602 INFO:teuthology.orchestra.run.smithi162.stdout: "complaint_time": 30, 2024-09-12T18:37:19.603 INFO:teuthology.orchestra.run.smithi162.stdout: "num_blocked_ops": 0 2024-09-12T18:37:19.603 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:19.605 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:19.598+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:19.622 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:37:19.707 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:19.698+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:19.781 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:19.781 INFO:teuthology.orchestra.run.smithi162.stdout: "size": 20, 2024-09-12T18:37:19.781 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 600, 2024-09-12T18:37:19.781 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:37:19.781 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.781 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4154.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:37:19.782 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:37:19.782 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 125.800484654, 2024-09-12T18:37:19.782 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025950709999999998, 2024-09-12T18:37:19.782 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:19.782 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:19.782 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:19.782 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:19.782 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4154", 2024-09-12T18:37:19.782 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/745129001", 2024-09-12T18:37:19.782 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 124 2024-09-12T18:37:19.782 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.782 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:19.783 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.783 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:19.783 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:37:19.783 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.783 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.783 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.783 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:19.783 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976561+0000", 2024-09-12T18:37:19.783 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.783 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.783 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.783 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:19.783 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976562+0000", 2024-09-12T18:37:19.784 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.2999999999999999e-07 2024-09-12T18:37:19.784 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.784 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.784 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:19.784 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976567+0000", 2024-09-12T18:37:19.784 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3430000000000003e-06 2024-09-12T18:37:19.784 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.784 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.784 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:19.784 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976576+0000", 2024-09-12T18:37:19.784 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8070000000000006e-06 2024-09-12T18:37:19.784 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.785 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.785 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.785 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.976583+0000", 2024-09-12T18:37:19.785 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9959999999999996e-06 2024-09-12T18:37:19.785 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.785 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.785 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:19.785 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997107+0000", 2024-09-12T18:37:19.785 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.020524106 2024-09-12T18:37:19.786 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.786 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.786 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:19.786 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997225+0000", 2024-09-12T18:37:19.786 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000117909 2024-09-12T18:37:19.786 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.786 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.786 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:19.786 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.997407+0000", 2024-09-12T18:37:19.786 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00018175900000000001 2024-09-12T18:37:19.787 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.787 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.787 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:19.787 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:13.998839+0000", 2024-09-12T18:37:19.787 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001432539 2024-09-12T18:37:19.787 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.787 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.787 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:19.787 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002319+0000", 2024-09-12T18:37:19.787 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0034803529999999998 2024-09-12T18:37:19.787 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.787 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.787 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:19.788 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002405+0000", 2024-09-12T18:37:19.788 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5434999999999998e-05 2024-09-12T18:37:19.788 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.788 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.788 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:19.788 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:14.002512+0000", 2024-09-12T18:37:19.788 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010663299999999999 2024-09-12T18:37:19.788 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.788 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:19.788 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.788 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.788 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.788 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:19.788 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:37:19.789 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 114.135687147, 2024-09-12T18:37:19.789 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025127867000000002, 2024-09-12T18:37:19.789 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:19.789 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:19.789 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:19.789 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:19.789 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.789 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:19.789 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:37:19.789 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.789 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.789 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.789 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:19.789 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641358+0000", 2024-09-12T18:37:19.790 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.790 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.790 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.790 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:19.790 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641362+0000", 2024-09-12T18:37:19.790 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.2569999999999999e-06 2024-09-12T18:37:19.790 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.790 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.790 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:19.790 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641374+0000", 2024-09-12T18:37:19.790 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2696e-05 2024-09-12T18:37:19.790 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.790 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.791 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:19.791 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641403+0000", 2024-09-12T18:37:19.791 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.8756999999999999e-05 2024-09-12T18:37:19.791 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.791 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.791 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.791 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641430+0000", 2024-09-12T18:37:19.791 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.6452999999999999e-05 2024-09-12T18:37:19.791 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.791 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.791 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:19.791 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641585+0000", 2024-09-12T18:37:19.791 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000155799 2024-09-12T18:37:19.791 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.792 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.792 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:19.792 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641753+0000", 2024-09-12T18:37:19.792 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000167868 2024-09-12T18:37:19.792 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.792 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.792 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:19.792 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641916+0000", 2024-09-12T18:37:19.792 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000162903 2024-09-12T18:37:19.792 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.792 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.792 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:19.793 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653655+0000", 2024-09-12T18:37:19.793 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011738879000000001 2024-09-12T18:37:19.793 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.793 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.793 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:19.793 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665515+0000", 2024-09-12T18:37:19.793 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011859915 2024-09-12T18:37:19.793 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.793 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.793 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:19.793 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.665646+0000", 2024-09-12T18:37:19.793 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013122599999999999 2024-09-12T18:37:19.793 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.793 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.794 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:19.794 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666486+0000", 2024-09-12T18:37:19.794 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00084011399999999999 2024-09-12T18:37:19.794 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.794 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:19.794 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.794 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.794 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.794 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:19.794 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:37:19.794 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 114.135572684, 2024-09-12T18:37:19.794 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025384584000000002, 2024-09-12T18:37:19.794 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:19.794 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:19.795 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:19.795 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:19.795 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.795 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:19.795 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:37:19.795 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.795 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.795 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.795 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:19.795 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641473+0000", 2024-09-12T18:37:19.795 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.795 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.795 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.796 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:19.796 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641474+0000", 2024-09-12T18:37:19.796 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.39e-06 2024-09-12T18:37:19.796 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.796 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.796 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:19.796 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641482+0000", 2024-09-12T18:37:19.796 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3499999999999999e-06 2024-09-12T18:37:19.796 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.796 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.796 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:19.796 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641534+0000", 2024-09-12T18:37:19.796 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2533e-05 2024-09-12T18:37:19.797 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.797 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.797 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.797 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641551+0000", 2024-09-12T18:37:19.797 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6515999999999999e-05 2024-09-12T18:37:19.797 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.797 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.797 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:19.797 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642630+0000", 2024-09-12T18:37:19.797 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001079705 2024-09-12T18:37:19.797 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.797 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.797 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:19.798 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642909+0000", 2024-09-12T18:37:19.798 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027859800000000002 2024-09-12T18:37:19.798 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.798 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.798 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:19.798 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643137+0000", 2024-09-12T18:37:19.798 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022803799999999999 2024-09-12T18:37:19.798 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.798 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.798 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:19.798 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653669+0000", 2024-09-12T18:37:19.798 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010532032 2024-09-12T18:37:19.798 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.799 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.799 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:19.799 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666624+0000", 2024-09-12T18:37:19.799 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012954940999999999 2024-09-12T18:37:19.799 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.799 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.799 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:19.799 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666762+0000", 2024-09-12T18:37:19.799 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000137668 2024-09-12T18:37:19.799 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.800 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.800 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:19.800 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666857+0000", 2024-09-12T18:37:19.800 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.5812999999999999e-05 2024-09-12T18:37:19.800 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.800 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:19.800 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.800 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.800 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.800 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:19.800 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:37:19.800 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 114.135444889, 2024-09-12T18:37:19.800 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025661562999999998, 2024-09-12T18:37:19.801 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:19.801 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:19.801 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:19.801 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:19.801 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.801 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:19.801 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:37:19.801 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.801 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.801 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.801 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:19.801 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641601+0000", 2024-09-12T18:37:19.801 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.801 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.802 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.802 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:19.802 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641602+0000", 2024-09-12T18:37:19.802 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3540000000000001e-06 2024-09-12T18:37:19.802 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.802 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.802 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:19.802 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641637+0000", 2024-09-12T18:37:19.802 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5145999999999999e-05 2024-09-12T18:37:19.802 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.802 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.802 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:19.802 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641659+0000", 2024-09-12T18:37:19.803 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2249999999999999e-05 2024-09-12T18:37:19.803 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.803 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.803 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.803 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641675+0000", 2024-09-12T18:37:19.803 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6059999999999999e-05 2024-09-12T18:37:19.803 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.803 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.803 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:19.803 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644570+0000", 2024-09-12T18:37:19.803 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028947069999999998 2024-09-12T18:37:19.803 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.803 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.803 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:19.804 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644900+0000", 2024-09-12T18:37:19.804 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000329401 2024-09-12T18:37:19.804 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.804 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.804 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:19.804 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645235+0000", 2024-09-12T18:37:19.804 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000335874 2024-09-12T18:37:19.804 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.804 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.804 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:19.804 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655459+0000", 2024-09-12T18:37:19.804 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.010223441999999999 2024-09-12T18:37:19.804 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.805 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.805 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:19.805 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667028+0000", 2024-09-12T18:37:19.805 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011568673999999999 2024-09-12T18:37:19.805 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.805 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.805 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:19.805 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667163+0000", 2024-09-12T18:37:19.805 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013525500000000001 2024-09-12T18:37:19.805 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.805 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.805 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:19.805 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667262+0000", 2024-09-12T18:37:19.806 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9400000000000004e-05 2024-09-12T18:37:19.806 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.806 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:19.806 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.806 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.806 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.806 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:19.806 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:37:19.806 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 114.135343069, 2024-09-12T18:37:19.806 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.025971339, 2024-09-12T18:37:19.806 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:19.806 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:19.806 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:19.806 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:19.807 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.807 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:19.807 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:37:19.807 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.807 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.807 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.807 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:19.807 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641702+0000", 2024-09-12T18:37:19.807 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.807 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.807 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.807 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:19.807 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641704+0000", 2024-09-12T18:37:19.808 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.297e-06 2024-09-12T18:37:19.808 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.808 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.808 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:19.808 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641712+0000", 2024-09-12T18:37:19.808 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.9060000000000002e-06 2024-09-12T18:37:19.808 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.808 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.808 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:19.808 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641731+0000", 2024-09-12T18:37:19.808 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9083e-05 2024-09-12T18:37:19.808 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.808 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.808 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.809 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641745+0000", 2024-09-12T18:37:19.809 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4066999999999999e-05 2024-09-12T18:37:19.809 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.809 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.809 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:19.809 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646529+0000", 2024-09-12T18:37:19.809 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.004784033 2024-09-12T18:37:19.809 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.809 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.809 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:19.809 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.646727+0000", 2024-09-12T18:37:19.809 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019841800000000001 2024-09-12T18:37:19.809 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.810 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.810 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:19.810 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647057+0000", 2024-09-12T18:37:19.810 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032926800000000002 2024-09-12T18:37:19.810 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.810 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.810 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:19.810 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655475+0000", 2024-09-12T18:37:19.810 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0084186250000000008 2024-09-12T18:37:19.810 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.810 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.810 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:19.810 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667424+0000", 2024-09-12T18:37:19.811 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.011949257 2024-09-12T18:37:19.811 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.811 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.811 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:19.811 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667573+0000", 2024-09-12T18:37:19.811 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014851900000000001 2024-09-12T18:37:19.811 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.811 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.811 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:19.811 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667674+0000", 2024-09-12T18:37:19.811 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010086600000000001 2024-09-12T18:37:19.811 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.811 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:19.812 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.812 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.812 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.812 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:19.812 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:37:19.812 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 114.13528067999999, 2024-09-12T18:37:19.812 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026215008000000001, 2024-09-12T18:37:19.812 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:19.812 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:19.812 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:19.812 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:19.812 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.813 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:19.813 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:37:19.813 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.813 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.813 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.813 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:19.813 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641765+0000", 2024-09-12T18:37:19.813 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.813 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.813 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.813 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:19.813 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641766+0000", 2024-09-12T18:37:19.813 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1200000000000001e-06 2024-09-12T18:37:19.814 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.814 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.814 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:19.814 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641775+0000", 2024-09-12T18:37:19.814 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.2499999999999995e-06 2024-09-12T18:37:19.814 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.814 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.814 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:19.814 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641793+0000", 2024-09-12T18:37:19.814 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7773000000000001e-05 2024-09-12T18:37:19.814 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.814 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.814 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.814 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641807+0000", 2024-09-12T18:37:19.815 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3814e-05 2024-09-12T18:37:19.815 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.815 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.815 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:19.815 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647626+0000", 2024-09-12T18:37:19.815 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0058193050000000003 2024-09-12T18:37:19.815 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.815 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.815 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:19.815 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.647937+0000", 2024-09-12T18:37:19.815 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031112400000000003 2024-09-12T18:37:19.815 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.815 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.816 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:19.816 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648239+0000", 2024-09-12T18:37:19.816 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00030227500000000002 2024-09-12T18:37:19.816 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.816 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.816 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:19.816 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655487+0000", 2024-09-12T18:37:19.816 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072479129999999999 2024-09-12T18:37:19.816 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.816 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.816 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:19.816 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667823+0000", 2024-09-12T18:37:19.816 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012335505 2024-09-12T18:37:19.817 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.817 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.817 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:19.817 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667908+0000", 2024-09-12T18:37:19.817 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4843000000000001e-05 2024-09-12T18:37:19.817 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.817 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.817 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:19.817 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667980+0000", 2024-09-12T18:37:19.817 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2086000000000001e-05 2024-09-12T18:37:19.817 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.817 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:19.817 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.817 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.818 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.818 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:19.818 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:37:19.818 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 114.135220527, 2024-09-12T18:37:19.818 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026483236, 2024-09-12T18:37:19.818 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:19.818 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:19.818 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:19.818 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:19.818 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.818 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:19.818 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:37:19.818 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.819 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.819 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.819 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:19.819 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641825+0000", 2024-09-12T18:37:19.819 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.819 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.819 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.819 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:19.819 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641826+0000", 2024-09-12T18:37:19.819 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:37:19.819 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.819 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.820 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:19.820 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641832+0000", 2024-09-12T18:37:19.820 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4199999999999998e-06 2024-09-12T18:37:19.820 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.820 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.820 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:19.820 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641848+0000", 2024-09-12T18:37:19.820 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6492999999999999e-05 2024-09-12T18:37:19.820 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.820 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.820 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.820 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641863+0000", 2024-09-12T18:37:19.821 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5427e-05 2024-09-12T18:37:19.821 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.821 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.821 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:19.821 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.648887+0000", 2024-09-12T18:37:19.821 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0070230860000000004 2024-09-12T18:37:19.821 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.821 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.821 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:19.821 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649111+0000", 2024-09-12T18:37:19.821 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00022425799999999999 2024-09-12T18:37:19.821 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.821 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.821 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:19.822 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.649494+0000", 2024-09-12T18:37:19.822 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00038349400000000001 2024-09-12T18:37:19.822 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.822 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.822 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:19.822 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655499+0000", 2024-09-12T18:37:19.822 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0060047260000000002 2024-09-12T18:37:19.822 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.822 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.822 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:19.822 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668110+0000", 2024-09-12T18:37:19.822 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012610543 2024-09-12T18:37:19.822 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.823 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.823 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:19.823 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668252+0000", 2024-09-12T18:37:19.823 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014265600000000001 2024-09-12T18:37:19.823 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.823 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.823 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:19.823 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668308+0000", 2024-09-12T18:37:19.823 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5992999999999997e-05 2024-09-12T18:37:19.823 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.823 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:19.823 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.823 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.823 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.824 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:19.824 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:37:19.824 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 114.13516531099999, 2024-09-12T18:37:19.824 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026605302000000001, 2024-09-12T18:37:19.824 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:19.824 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:19.824 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:19.824 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:19.824 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.824 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:19.824 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:37:19.824 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.824 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.824 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.825 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:19.825 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641880+0000", 2024-09-12T18:37:19.825 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.825 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.825 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.825 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:19.825 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641881+0000", 2024-09-12T18:37:19.825 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.057e-06 2024-09-12T18:37:19.825 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.825 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.825 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:19.825 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641887+0000", 2024-09-12T18:37:19.826 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.6629999999999998e-06 2024-09-12T18:37:19.826 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.826 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.826 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:19.826 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641903+0000", 2024-09-12T18:37:19.826 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6317e-05 2024-09-12T18:37:19.826 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.826 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.826 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.826 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641917+0000", 2024-09-12T18:37:19.826 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3339999999999999e-05 2024-09-12T18:37:19.826 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.826 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.826 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:19.827 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650708+0000", 2024-09-12T18:37:19.827 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.008791419 2024-09-12T18:37:19.827 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.827 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.827 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:19.827 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651021+0000", 2024-09-12T18:37:19.827 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031296699999999999 2024-09-12T18:37:19.827 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.827 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.827 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:19.827 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.651349+0000", 2024-09-12T18:37:19.827 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00032796499999999999 2024-09-12T18:37:19.827 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.827 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.828 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:19.828 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655742+0000", 2024-09-12T18:37:19.828 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0043934680000000002 2024-09-12T18:37:19.828 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.828 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.828 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:19.828 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668377+0000", 2024-09-12T18:37:19.828 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012634312999999999 2024-09-12T18:37:19.828 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.828 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.828 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:19.828 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668441+0000", 2024-09-12T18:37:19.828 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4369999999999995e-05 2024-09-12T18:37:19.829 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.829 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.829 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:19.829 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668485+0000", 2024-09-12T18:37:19.829 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4422999999999998e-05 2024-09-12T18:37:19.829 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.829 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:19.829 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.829 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.829 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.829 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:19.829 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:37:19.829 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 114.13510790799999, 2024-09-12T18:37:19.829 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026919499, 2024-09-12T18:37:19.830 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:19.830 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:19.830 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:19.830 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:19.830 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.832 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:19.832 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:37:19.832 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.832 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.832 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.832 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:19.832 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641938+0000", 2024-09-12T18:37:19.833 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.833 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.833 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.833 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:19.833 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641939+0000", 2024-09-12T18:37:19.833 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9399999999999993e-07 2024-09-12T18:37:19.833 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.833 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.833 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:19.833 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641945+0000", 2024-09-12T18:37:19.833 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9200000000000001e-06 2024-09-12T18:37:19.833 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.833 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.833 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:19.834 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641961+0000", 2024-09-12T18:37:19.834 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6520000000000001e-05 2024-09-12T18:37:19.834 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.834 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.834 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.834 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.641974+0000", 2024-09-12T18:37:19.834 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3413e-05 2024-09-12T18:37:19.834 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.834 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.834 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:19.834 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654560+0000", 2024-09-12T18:37:19.834 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012585308999999999 2024-09-12T18:37:19.834 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.835 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.835 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:19.835 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.654822+0000", 2024-09-12T18:37:19.835 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00026210099999999999 2024-09-12T18:37:19.835 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.835 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.835 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:19.835 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.655059+0000", 2024-09-12T18:37:19.835 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00023747899999999999 2024-09-12T18:37:19.835 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.835 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.835 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:19.835 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.656315+0000", 2024-09-12T18:37:19.836 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0012555000000000001 2024-09-12T18:37:19.836 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.836 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.836 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:19.836 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668590+0000", 2024-09-12T18:37:19.836 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.012274851999999999 2024-09-12T18:37:19.836 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.836 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.836 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:19.836 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668725+0000", 2024-09-12T18:37:19.836 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013524199999999999 2024-09-12T18:37:19.836 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.836 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.837 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:19.837 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.668857+0000", 2024-09-12T18:37:19.837 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013216899999999999 2024-09-12T18:37:19.837 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.837 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:19.837 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.837 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.837 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.837 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:19.837 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:37:19.837 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 114.134926523, 2024-09-12T18:37:19.837 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024670563, 2024-09-12T18:37:19.837 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:19.838 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:19.838 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:19.838 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:19.838 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.838 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:19.838 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:37:19.838 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.838 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.838 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.838 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:19.838 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642119+0000", 2024-09-12T18:37:19.838 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.839 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.839 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.839 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:19.839 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642120+0000", 2024-09-12T18:37:19.839 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1769999999999999e-06 2024-09-12T18:37:19.839 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.839 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.839 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:19.839 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642128+0000", 2024-09-12T18:37:19.839 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3429999999999998e-06 2024-09-12T18:37:19.839 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.839 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.839 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:19.839 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642192+0000", 2024-09-12T18:37:19.840 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4406999999999995e-05 2024-09-12T18:37:19.840 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.840 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.840 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.840 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642223+0000", 2024-09-12T18:37:19.840 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.1266000000000002e-05 2024-09-12T18:37:19.840 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.840 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.840 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:19.840 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643201+0000", 2024-09-12T18:37:19.840 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0009778390000000001 2024-09-12T18:37:19.840 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.840 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.840 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:19.841 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643410+0000", 2024-09-12T18:37:19.841 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020874199999999999 2024-09-12T18:37:19.841 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.841 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.841 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:19.841 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.643685+0000", 2024-09-12T18:37:19.841 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027520700000000002 2024-09-12T18:37:19.841 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.841 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.841 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:19.841 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.650966+0000", 2024-09-12T18:37:19.841 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0072810710000000001 2024-09-12T18:37:19.841 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.842 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.842 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:19.842 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666560+0000", 2024-09-12T18:37:19.842 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.015594143 2024-09-12T18:37:19.842 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.842 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.842 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:19.842 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666691+0000", 2024-09-12T18:37:19.842 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000130359 2024-09-12T18:37:19.842 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.842 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.842 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:19.842 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.666790+0000", 2024-09-12T18:37:19.843 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9009e-05 2024-09-12T18:37:19.843 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.843 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:19.843 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.843 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.843 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.843 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:19.843 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:37:19.843 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 114.134148235, 2024-09-12T18:37:19.843 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024891744, 2024-09-12T18:37:19.843 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:19.843 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:19.844 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:19.844 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:19.844 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.844 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:19.844 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:37:19.844 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.844 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.844 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.844 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:19.844 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642897+0000", 2024-09-12T18:37:19.844 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.844 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.844 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.845 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:19.845 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642899+0000", 2024-09-12T18:37:19.845 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4729999999999999e-06 2024-09-12T18:37:19.845 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.845 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.845 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:19.845 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642912+0000", 2024-09-12T18:37:19.845 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3495999999999999e-05 2024-09-12T18:37:19.845 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.845 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.845 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:19.845 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642934+0000", 2024-09-12T18:37:19.845 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2033999999999999e-05 2024-09-12T18:37:19.846 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.846 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.846 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.846 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.642949+0000", 2024-09-12T18:37:19.846 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4970000000000001e-05 2024-09-12T18:37:19.846 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.846 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.846 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:19.846 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644400+0000", 2024-09-12T18:37:19.846 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001450305 2024-09-12T18:37:19.846 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.846 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.846 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:19.846 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.644617+0000", 2024-09-12T18:37:19.847 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000217302 2024-09-12T18:37:19.847 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.847 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.847 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:19.847 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.645052+0000", 2024-09-12T18:37:19.847 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000434797 2024-09-12T18:37:19.847 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.847 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.847 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:19.847 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.653860+0000", 2024-09-12T18:37:19.847 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0088082249999999994 2024-09-12T18:37:19.847 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.847 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.847 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:19.848 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667598+0000", 2024-09-12T18:37:19.848 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.013738451 2024-09-12T18:37:19.848 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.848 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.848 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:19.848 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667698+0000", 2024-09-12T18:37:19.848 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9854999999999999e-05 2024-09-12T18:37:19.848 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.848 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.848 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:19.848 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:35:25.667789+0000", 2024-09-12T18:37:19.848 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0835999999999996e-05 2024-09-12T18:37:19.848 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.849 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:19.849 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.849 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.849 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.849 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:121106 5.d e50/21 5:b4a9a221:::benchmark_data_smithi073_23739_object121105:head v 50'7658, mlcod=48'7656)", 2024-09-12T18:37:19.849 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:40.238637+0000", 2024-09-12T18:37:19.849 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 39.538408509, 2024-09-12T18:37:19.849 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.033154694999999998, 2024-09-12T18:37:19.849 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:19.849 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:19.849 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:19.850 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:19.850 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.850 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:19.850 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238637+0000", 2024-09-12T18:37:19.850 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.850 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.850 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.850 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:19.850 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238637+0000", 2024-09-12T18:37:19.850 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.850 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.850 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.850 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:19.850 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238639+0000", 2024-09-12T18:37:19.851 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.8560000000000001e-06 2024-09-12T18:37:19.851 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.851 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.851 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:19.851 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238723+0000", 2024-09-12T18:37:19.851 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4314999999999995e-05 2024-09-12T18:37:19.851 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.851 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.851 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:19.851 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238753+0000", 2024-09-12T18:37:19.851 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.9726e-05 2024-09-12T18:37:19.851 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.851 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.852 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.852 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.238773+0000", 2024-09-12T18:37:19.852 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9789e-05 2024-09-12T18:37:19.852 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.852 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.852 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:19.852 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.241557+0000", 2024-09-12T18:37:19.852 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0027843910000000002 2024-09-12T18:37:19.852 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.852 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.852 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:19.852 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.241581+0000", 2024-09-12T18:37:19.852 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.4224999999999999e-05 2024-09-12T18:37:19.853 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.853 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.853 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:19.853 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.271722+0000", 2024-09-12T18:37:19.853 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.030141194 2024-09-12T18:37:19.853 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.853 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.853 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:19.853 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:40.271792+0000", 2024-09-12T18:37:19.853 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9198999999999999e-05 2024-09-12T18:37:19.853 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.853 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:19.853 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.854 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.854 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.854 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:131551 5.d e52/21 5:b8f8c77a:::benchmark_data_smithi073_23739_object131550:head v 52'8341, mlcod=52'8338)", 2024-09-12T18:37:19.854 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:36:45.500609+0000", 2024-09-12T18:37:19.854 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 34.276436328999999, 2024-09-12T18:37:19.854 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.024752877, 2024-09-12T18:37:19.854 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:19.854 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:19.854 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:19.854 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:19.854 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.855 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:19.855 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500609+0000", 2024-09-12T18:37:19.855 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.855 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.855 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.855 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:19.855 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500609+0000", 2024-09-12T18:37:19.855 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.855 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.855 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.856 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:19.856 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500610+0000", 2024-09-12T18:37:19.856 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5499999999999998e-07 2024-09-12T18:37:19.856 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.856 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.856 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:19.856 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500669+0000", 2024-09-12T18:37:19.856 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9244999999999999e-05 2024-09-12T18:37:19.856 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.856 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.856 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:19.856 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500676+0000", 2024-09-12T18:37:19.856 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3030000000000002e-06 2024-09-12T18:37:19.857 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.857 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.857 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.857 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.500681+0000", 2024-09-12T18:37:19.857 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8720000000000001e-06 2024-09-12T18:37:19.857 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.857 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.857 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:19.857 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.517128+0000", 2024-09-12T18:37:19.857 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.016446485 2024-09-12T18:37:19.857 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.857 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.858 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:19.858 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.517159+0000", 2024-09-12T18:37:19.858 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.0926000000000002e-05 2024-09-12T18:37:19.858 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.858 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.858 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:19.858 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.525325+0000", 2024-09-12T18:37:19.858 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0081661460000000009 2024-09-12T18:37:19.858 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.858 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.858 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:19.858 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:36:45.525362+0000", 2024-09-12T18:37:19.858 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.7345000000000002e-05 2024-09-12T18:37:19.858 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.859 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:19.859 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.859 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.859 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.859 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167364 5.7 5:ee50096a:::benchmark_data_smithi073_23739_object35087:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:19.859 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.168715+0000", 2024-09-12T18:37:19.859 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 16.608330422000002, 2024-09-12T18:37:19.859 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.068831153000000006, 2024-09-12T18:37:19.859 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:19.859 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:19.859 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:19.859 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:19.859 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:19.860 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:19.860 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167364 2024-09-12T18:37:19.860 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.860 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:19.860 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.860 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:19.860 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168715+0000", 2024-09-12T18:37:19.860 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.860 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.860 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.860 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:19.860 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168715+0000", 2024-09-12T18:37:19.860 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.861 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.861 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.861 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:19.861 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168716+0000", 2024-09-12T18:37:19.861 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0559999999999999e-06 2024-09-12T18:37:19.861 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.861 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.861 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:19.861 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168721+0000", 2024-09-12T18:37:19.861 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8019999999999999e-06 2024-09-12T18:37:19.861 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.861 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.861 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:19.862 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168731+0000", 2024-09-12T18:37:19.862 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0315e-05 2024-09-12T18:37:19.862 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.862 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.862 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.862 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168738+0000", 2024-09-12T18:37:19.862 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.126e-06 2024-09-12T18:37:19.862 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.862 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.862 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:19.862 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168782+0000", 2024-09-12T18:37:19.862 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.3924000000000002e-05 2024-09-12T18:37:19.862 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.862 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.863 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:19.863 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168913+0000", 2024-09-12T18:37:19.863 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000131154 2024-09-12T18:37:19.863 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.863 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.863 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:19.863 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169026+0000", 2024-09-12T18:37:19.863 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011223299999999999 2024-09-12T18:37:19.863 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.863 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.863 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:19.863 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.175404+0000", 2024-09-12T18:37:19.864 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0063780319999999996 2024-09-12T18:37:19.864 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.864 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.864 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:19.864 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237446+0000", 2024-09-12T18:37:19.864 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.062042238 2024-09-12T18:37:19.864 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.864 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.864 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:19.864 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237501+0000", 2024-09-12T18:37:19.864 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4913000000000001e-05 2024-09-12T18:37:19.864 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.864 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.865 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:19.865 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237546+0000", 2024-09-12T18:37:19.865 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.5359999999999999e-05 2024-09-12T18:37:19.865 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.865 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:19.865 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.865 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.865 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.865 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167365 5.2 5:4107875c:::benchmark_data_smithi073_23739_object35088:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:19.865 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:19.865 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 16.608280848, 2024-09-12T18:37:19.865 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.078544438999999994, 2024-09-12T18:37:19.865 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:19.866 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:19.866 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:19.866 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:19.866 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:19.866 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:19.866 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167365 2024-09-12T18:37:19.866 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.866 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:19.866 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.866 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:19.866 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:19.866 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.866 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.866 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.867 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:19.867 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:19.867 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.867 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.867 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.867 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:19.867 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:19.867 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.4700000000000001e-07 2024-09-12T18:37:19.867 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.867 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.867 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:19.867 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168769+0000", 2024-09-12T18:37:19.867 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.4170000000000001e-06 2024-09-12T18:37:19.868 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.868 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.868 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:19.868 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168777+0000", 2024-09-12T18:37:19.868 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1499999999999999e-06 2024-09-12T18:37:19.868 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.868 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.868 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.868 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168783+0000", 2024-09-12T18:37:19.868 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.0460000000000002e-06 2024-09-12T18:37:19.868 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.868 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.868 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:19.869 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168865+0000", 2024-09-12T18:37:19.869 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1953999999999995e-05 2024-09-12T18:37:19.869 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.869 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.869 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:19.869 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169003+0000", 2024-09-12T18:37:19.869 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013798200000000001 2024-09-12T18:37:19.869 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.869 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.869 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:19.869 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169065+0000", 2024-09-12T18:37:19.869 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2218000000000006e-05 2024-09-12T18:37:19.869 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.869 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.870 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:19.870 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174771+0000", 2024-09-12T18:37:19.870 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0057054819999999996 2024-09-12T18:37:19.870 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.870 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.870 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:19.870 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.247234+0000", 2024-09-12T18:37:19.870 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.072463391000000002 2024-09-12T18:37:19.870 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.870 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.870 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:19.870 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.247273+0000", 2024-09-12T18:37:19.870 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.9069000000000002e-05 2024-09-12T18:37:19.871 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.871 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.871 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:19.871 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.247309+0000", 2024-09-12T18:37:19.871 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5982999999999998e-05 2024-09-12T18:37:19.871 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.871 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:19.871 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.871 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.871 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.871 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167369 5.7 5:e64ecabd:::benchmark_data_smithi073_23739_object35092:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:19.871 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.169042+0000", 2024-09-12T18:37:19.871 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 16.608003737000001, 2024-09-12T18:37:19.872 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.069229188999999997, 2024-09-12T18:37:19.872 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:19.872 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:19.872 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:19.872 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:19.872 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:19.872 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:19.872 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167369 2024-09-12T18:37:19.872 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.872 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:19.872 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.872 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:19.873 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169042+0000", 2024-09-12T18:37:19.873 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.873 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.873 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.873 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:19.873 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169042+0000", 2024-09-12T18:37:19.873 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.873 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.873 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.873 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:19.873 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169043+0000", 2024-09-12T18:37:19.873 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.9400000000000004e-07 2024-09-12T18:37:19.873 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.874 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.874 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:19.874 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169048+0000", 2024-09-12T18:37:19.874 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8420000000000004e-06 2024-09-12T18:37:19.874 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.874 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.874 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:19.874 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169055+0000", 2024-09-12T18:37:19.874 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.7989999999999994e-06 2024-09-12T18:37:19.874 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.874 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.874 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.874 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169062+0000", 2024-09-12T18:37:19.875 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.5950000000000004e-06 2024-09-12T18:37:19.875 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.875 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.875 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:19.875 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173858+0000", 2024-09-12T18:37:19.875 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0047959259999999998 2024-09-12T18:37:19.875 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.875 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.875 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:19.875 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173966+0000", 2024-09-12T18:37:19.875 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000107941 2024-09-12T18:37:19.875 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.875 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.875 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:19.876 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174043+0000", 2024-09-12T18:37:19.876 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.7360000000000005e-05 2024-09-12T18:37:19.876 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.876 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.876 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:19.876 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.175711+0000", 2024-09-12T18:37:19.876 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0016680810000000001 2024-09-12T18:37:19.876 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.876 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.876 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:19.876 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.238163+0000", 2024-09-12T18:37:19.876 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.062451523000000002 2024-09-12T18:37:19.877 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.877 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.877 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:19.877 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.238222+0000", 2024-09-12T18:37:19.877 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9723999999999999e-05 2024-09-12T18:37:19.877 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.877 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.877 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:19.877 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.238271+0000", 2024-09-12T18:37:19.877 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8504000000000002e-05 2024-09-12T18:37:19.877 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.877 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:19.877 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.877 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.878 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.878 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167373 5.5 5:ad283029:::benchmark_data_smithi073_23739_object35096:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:19.878 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:19.878 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 16.605498906000001, 2024-09-12T18:37:19.878 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.066200976999999994, 2024-09-12T18:37:19.878 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:19.878 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:19.878 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:19.878 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:19.878 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:19.878 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:19.878 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167373 2024-09-12T18:37:19.878 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.879 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:19.879 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.879 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:19.879 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:19.879 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.879 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.879 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.879 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:19.879 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:19.879 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.879 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.879 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.880 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:19.880 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:19.880 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4900000000000005e-07 2024-09-12T18:37:19.880 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.880 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.880 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:19.880 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171551+0000", 2024-09-12T18:37:19.880 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.7519999999999998e-06 2024-09-12T18:37:19.880 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.880 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.880 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:19.880 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171562+0000", 2024-09-12T18:37:19.881 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0353000000000001e-05 2024-09-12T18:37:19.881 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.881 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.881 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.881 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171566+0000", 2024-09-12T18:37:19.881 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8269999999999997e-06 2024-09-12T18:37:19.881 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.881 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.881 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:19.881 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171622+0000", 2024-09-12T18:37:19.881 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5220999999999999e-05 2024-09-12T18:37:19.881 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.881 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.882 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:19.882 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171719+0000", 2024-09-12T18:37:19.882 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7238999999999995e-05 2024-09-12T18:37:19.882 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.882 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.882 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:19.882 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171802+0000", 2024-09-12T18:37:19.882 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.3285e-05 2024-09-12T18:37:19.882 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.882 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.882 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:19.882 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174608+0000", 2024-09-12T18:37:19.883 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028054590000000002 2024-09-12T18:37:19.883 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.883 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.883 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:19.883 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174762+0000", 2024-09-12T18:37:19.883 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015465100000000001 2024-09-12T18:37:19.883 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.883 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.883 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:19.883 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237474+0000", 2024-09-12T18:37:19.883 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.062711683000000004 2024-09-12T18:37:19.883 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.883 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.884 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:19.884 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237540+0000", 2024-09-12T18:37:19.884 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.6132999999999999e-05 2024-09-12T18:37:19.884 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.884 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.884 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:19.884 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237748+0000", 2024-09-12T18:37:19.884 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020752499999999999 2024-09-12T18:37:19.884 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.884 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:19.884 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.884 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.885 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.885 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167374 5.1 5:81e25826:::benchmark_data_smithi073_23739_object35097:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:19.885 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.173748+0000", 2024-09-12T18:37:19.885 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 16.603297458, 2024-09-12T18:37:19.885 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.069225245000000005, 2024-09-12T18:37:19.885 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:19.885 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:19.885 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:19.885 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:19.885 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:19.885 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:19.885 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167374 2024-09-12T18:37:19.885 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.886 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:19.886 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.886 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:19.886 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173748+0000", 2024-09-12T18:37:19.886 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.886 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.886 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.886 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:19.886 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173748+0000", 2024-09-12T18:37:19.886 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.886 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.886 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.886 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:19.887 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173749+0000", 2024-09-12T18:37:19.887 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.418e-06 2024-09-12T18:37:19.887 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.887 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.887 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:19.887 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173755+0000", 2024-09-12T18:37:19.887 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.0730000000000004e-06 2024-09-12T18:37:19.887 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.887 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.887 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:19.887 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173768+0000", 2024-09-12T18:37:19.887 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3644e-05 2024-09-12T18:37:19.887 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.888 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.888 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.888 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173777+0000", 2024-09-12T18:37:19.888 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4160000000000004e-06 2024-09-12T18:37:19.888 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.888 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.888 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:19.888 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173927+0000", 2024-09-12T18:37:19.888 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015065900000000001 2024-09-12T18:37:19.888 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.888 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.888 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:19.888 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174052+0000", 2024-09-12T18:37:19.889 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012460699999999999 2024-09-12T18:37:19.889 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.889 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.889 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:19.889 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174181+0000", 2024-09-12T18:37:19.889 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012919299999999999 2024-09-12T18:37:19.889 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.889 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.889 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:19.889 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.178108+0000", 2024-09-12T18:37:19.889 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0039273210000000001 2024-09-12T18:37:19.889 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.889 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.890 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:19.890 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.178118+0000", 2024-09-12T18:37:19.890 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7550000000000006e-06 2024-09-12T18:37:19.890 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.890 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.890 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:19.890 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.242865+0000", 2024-09-12T18:37:19.890 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.064746597000000003 2024-09-12T18:37:19.890 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.890 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.890 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:19.890 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.242903+0000", 2024-09-12T18:37:19.891 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.8268e-05 2024-09-12T18:37:19.891 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.891 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.891 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:19.891 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.242973+0000", 2024-09-12T18:37:19.891 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0294000000000002e-05 2024-09-12T18:37:19.891 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.891 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:19.891 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.891 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.891 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.891 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167375 5.1 5:83a09102:::benchmark_data_smithi073_23739_object35098:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:19.891 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:19.892 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 16.603245910999998, 2024-09-12T18:37:19.892 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.069437463000000005, 2024-09-12T18:37:19.892 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:19.892 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:19.892 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:19.892 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:19.892 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:19.892 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:19.892 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167375 2024-09-12T18:37:19.892 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.892 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:19.892 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.892 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:19.893 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:19.893 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.893 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.893 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.893 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:19.893 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:19.893 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.893 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.893 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.893 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:19.893 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:19.893 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1399999999999997e-07 2024-09-12T18:37:19.893 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.894 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.894 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:19.894 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173803+0000", 2024-09-12T18:37:19.894 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.7860000000000001e-06 2024-09-12T18:37:19.894 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.894 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.894 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:19.894 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173811+0000", 2024-09-12T18:37:19.894 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4610000000000008e-06 2024-09-12T18:37:19.894 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.894 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.894 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.895 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173817+0000", 2024-09-12T18:37:19.895 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3569999999999997e-06 2024-09-12T18:37:19.895 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.895 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.895 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:19.895 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.176070+0000", 2024-09-12T18:37:19.895 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.002253405 2024-09-12T18:37:19.895 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.895 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.895 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:19.895 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.176263+0000", 2024-09-12T18:37:19.895 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000192583 2024-09-12T18:37:19.895 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.896 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.896 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:19.896 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.176429+0000", 2024-09-12T18:37:19.896 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00016626 2024-09-12T18:37:19.896 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.896 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.896 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:19.896 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.178154+0000", 2024-09-12T18:37:19.896 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0017247009999999999 2024-09-12T18:37:19.896 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.896 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.896 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:19.896 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.182110+0000", 2024-09-12T18:37:19.897 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0039568229999999999 2024-09-12T18:37:19.897 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.897 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.897 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:19.897 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.243024+0000", 2024-09-12T18:37:19.897 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.060913249000000003 2024-09-12T18:37:19.897 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.897 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.897 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:19.897 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.243107+0000", 2024-09-12T18:37:19.897 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.3090000000000006e-05 2024-09-12T18:37:19.897 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.897 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.898 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:19.898 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.243237+0000", 2024-09-12T18:37:19.898 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013023399999999999 2024-09-12T18:37:19.898 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.898 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:19.898 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.898 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.898 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.898 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:182796 5.2 5:4d2ea0ae:::benchmark_data_smithi073_23739_object50519:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T18:37:19.898 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:10.616684+0000", 2024-09-12T18:37:19.898 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 9.1603616070000005, 2024-09-12T18:37:19.898 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.026244475999999999, 2024-09-12T18:37:19.898 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:19.899 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:19.899 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:19.899 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:19.899 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:19.899 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:19.899 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 182796 2024-09-12T18:37:19.899 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.899 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:19.899 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.899 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:19.899 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.616684+0000", 2024-09-12T18:37:19.899 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.899 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.900 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.900 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:19.900 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.616684+0000", 2024-09-12T18:37:19.900 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:19.900 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.900 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.900 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:19.900 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.616686+0000", 2024-09-12T18:37:19.900 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7519999999999999e-06 2024-09-12T18:37:19.900 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.900 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.900 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:19.900 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.616691+0000", 2024-09-12T18:37:19.901 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.6200000000000004e-06 2024-09-12T18:37:19.901 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.901 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.901 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:19.901 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.616703+0000", 2024-09-12T18:37:19.901 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1955e-05 2024-09-12T18:37:19.901 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.901 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.901 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:19.901 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.616710+0000", 2024-09-12T18:37:19.901 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.1029999999999996e-06 2024-09-12T18:37:19.901 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.901 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.902 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:19.902 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.616762+0000", 2024-09-12T18:37:19.902 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1706999999999998e-05 2024-09-12T18:37:19.902 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.902 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.902 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:19.902 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.616899+0000", 2024-09-12T18:37:19.902 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000136816 2024-09-12T18:37:19.902 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.902 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.902 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:19.902 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.617025+0000", 2024-09-12T18:37:19.902 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012590799999999999 2024-09-12T18:37:19.903 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.903 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.903 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:19.903 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.622400+0000", 2024-09-12T18:37:19.903 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0053749069999999999 2024-09-12T18:37:19.903 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.903 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.903 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:19.903 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.642822+0000", 2024-09-12T18:37:19.903 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.020422484000000001 2024-09-12T18:37:19.903 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.903 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.904 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:19.904 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.642882+0000", 2024-09-12T18:37:19.904 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9917000000000002e-05 2024-09-12T18:37:19.904 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:19.904 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:19.904 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:19.904 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:10.642928+0000", 2024-09-12T18:37:19.904 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6307000000000002e-05 2024-09-12T18:37:19.904 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.904 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:19.904 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.904 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:19.904 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:19.905 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:19.906 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:37:19.907 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:19.896+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:20.008 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:20.002+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:20.060 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:20.060 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:37:20.060 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.061 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:200674 5.6 5:6bd6d7c2:::benchmark_data_smithi073_23739_object68397:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:20.061 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:20.051692+0000", 2024-09-12T18:37:20.061 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0052266079999999998, 2024-09-12T18:37:20.061 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0052493349999999999, 2024-09-12T18:37:20.061 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:20.061 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:20.062 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:20.062 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:20.062 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:20.062 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:20.062 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 200674 2024-09-12T18:37:20.063 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.063 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:20.063 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.063 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:20.063 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.051692+0000", 2024-09-12T18:37:20.064 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.064 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.064 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.064 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:20.064 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.051692+0000", 2024-09-12T18:37:20.065 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.065 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.065 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.065 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:20.065 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.051694+0000", 2024-09-12T18:37:20.066 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5799999999999999e-06 2024-09-12T18:37:20.066 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.066 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.066 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:20.066 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.051699+0000", 2024-09-12T18:37:20.066 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.702e-06 2024-09-12T18:37:20.067 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.067 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.067 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:20.067 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.051709+0000", 2024-09-12T18:37:20.067 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0301e-05 2024-09-12T18:37:20.068 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.068 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.068 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:20.068 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.051716+0000", 2024-09-12T18:37:20.068 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0720000000000002e-06 2024-09-12T18:37:20.068 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.068 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.068 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:20.069 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.052402+0000", 2024-09-12T18:37:20.069 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00068611300000000002 2024-09-12T18:37:20.069 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.069 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.069 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:20.069 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.052522+0000", 2024-09-12T18:37:20.069 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000120034 2024-09-12T18:37:20.069 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.069 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.070 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:20.070 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.052627+0000", 2024-09-12T18:37:20.070 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000104866 2024-09-12T18:37:20.070 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.070 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.070 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:20.070 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.056611+0000", 2024-09-12T18:37:20.070 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0039840149999999996 2024-09-12T18:37:20.070 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.070 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:20.070 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.070 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.070 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.071 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:200676 5.a 5:570ef4c1:::benchmark_data_smithi073_23739_object68399:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:20.071 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:20.051873+0000", 2024-09-12T18:37:20.071 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0050463160000000003, 2024-09-12T18:37:20.071 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0051424959999999999, 2024-09-12T18:37:20.071 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:20.071 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:20.071 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:20.071 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:20.071 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:20.071 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:20.071 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 200676 2024-09-12T18:37:20.071 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.071 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:20.072 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.072 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:20.072 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.051873+0000", 2024-09-12T18:37:20.072 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.072 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.072 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.072 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:20.072 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.051873+0000", 2024-09-12T18:37:20.072 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.072 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.072 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.072 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:20.073 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.051874+0000", 2024-09-12T18:37:20.073 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.5300000000000002e-07 2024-09-12T18:37:20.073 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.073 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.073 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:20.073 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.051878+0000", 2024-09-12T18:37:20.074 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5129999999999998e-06 2024-09-12T18:37:20.074 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.074 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.074 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:20.074 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.051887+0000", 2024-09-12T18:37:20.075 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1570000000000006e-06 2024-09-12T18:37:20.075 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.075 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.075 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:20.075 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.051894+0000", 2024-09-12T18:37:20.075 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.878e-06 2024-09-12T18:37:20.075 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.075 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.075 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:20.075 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.051947+0000", 2024-09-12T18:37:20.076 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2352000000000003e-05 2024-09-12T18:37:20.076 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.076 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.076 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:20.076 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.052072+0000", 2024-09-12T18:37:20.076 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012568099999999999 2024-09-12T18:37:20.076 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.076 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.076 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:20.076 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.052180+0000", 2024-09-12T18:37:20.077 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000107397 2024-09-12T18:37:20.077 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.077 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:20.077 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.077 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.077 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.077 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:200675 5.b e67/21 5:d238e925:::benchmark_data_smithi073_23739_object68398:head v 67'12716, mlcod=67'12714)", 2024-09-12T18:37:20.077 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:20.052182+0000", 2024-09-12T18:37:20.077 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0047368480000000001, 2024-09-12T18:37:20.077 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0048937879999999996, 2024-09-12T18:37:20.077 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:20.077 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:20.077 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:20.078 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:20.078 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.078 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:20.078 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.052182+0000", 2024-09-12T18:37:20.078 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.078 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.078 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.078 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:20.078 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.052182+0000", 2024-09-12T18:37:20.078 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.078 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.078 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.078 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:20.079 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.052183+0000", 2024-09-12T18:37:20.079 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9400000000000005e-07 2024-09-12T18:37:20.079 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.079 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.079 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:20.079 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.052188+0000", 2024-09-12T18:37:20.079 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.933e-06 2024-09-12T18:37:20.079 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.079 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.079 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:20.079 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.052197+0000", 2024-09-12T18:37:20.079 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.0659999999999993e-06 2024-09-12T18:37:20.080 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.080 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.080 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:20.080 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.052203+0000", 2024-09-12T18:37:20.080 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1680000000000001e-06 2024-09-12T18:37:20.080 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.080 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.081 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:20.081 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.052249+0000", 2024-09-12T18:37:20.081 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5664999999999997e-05 2024-09-12T18:37:20.081 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.081 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.081 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:20.081 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.052267+0000", 2024-09-12T18:37:20.081 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8754999999999999e-05 2024-09-12T18:37:20.081 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.081 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:20.081 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.082 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.082 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.082 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:200678 5.2 e67/21 5:471eb491:::benchmark_data_smithi073_23739_object68401:head v 67'12480, mlcod=67'12478)", 2024-09-12T18:37:20.082 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:20.055167+0000", 2024-09-12T18:37:20.082 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0017523700000000001, 2024-09-12T18:37:20.082 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0019563580000000001, 2024-09-12T18:37:20.082 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:20.082 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:20.083 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:20.083 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:20.083 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.083 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:20.083 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.055167+0000", 2024-09-12T18:37:20.083 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.083 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.083 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.083 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:20.083 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.055167+0000", 2024-09-12T18:37:20.084 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.084 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.084 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.084 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:20.084 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.055167+0000", 2024-09-12T18:37:20.084 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1399999999999997e-07 2024-09-12T18:37:20.084 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.084 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.084 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:20.084 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.055170+0000", 2024-09-12T18:37:20.085 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.112e-06 2024-09-12T18:37:20.085 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.085 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.085 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:20.085 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.055180+0000", 2024-09-12T18:37:20.085 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2259999999999994e-06 2024-09-12T18:37:20.085 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.085 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.085 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:20.085 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.055184+0000", 2024-09-12T18:37:20.085 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.065e-06 2024-09-12T18:37:20.085 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.086 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.086 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:20.086 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.055231+0000", 2024-09-12T18:37:20.086 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.7030999999999997e-05 2024-09-12T18:37:20.086 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.086 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.086 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:20.086 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.055252+0000", 2024-09-12T18:37:20.086 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1254999999999999e-05 2024-09-12T18:37:20.086 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.086 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:20.086 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.087 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.087 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.087 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:200679 5.a 5:5fbc7737:::benchmark_data_smithi073_23739_object68402:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:20.087 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:20.056014+0000", 2024-09-12T18:37:20.087 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.000904787, 2024-09-12T18:37:20.087 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001157623, 2024-09-12T18:37:20.087 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:20.087 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:20.087 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:20.087 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:20.087 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:20.087 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:20.088 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 200679 2024-09-12T18:37:20.088 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.088 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:20.088 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.088 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:20.088 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.056014+0000", 2024-09-12T18:37:20.088 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.088 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.088 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.088 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:20.089 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.056014+0000", 2024-09-12T18:37:20.089 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.089 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.089 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.089 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:20.089 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.056016+0000", 2024-09-12T18:37:20.089 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4300000000000001e-06 2024-09-12T18:37:20.089 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.089 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.089 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:20.089 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.056021+0000", 2024-09-12T18:37:20.090 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.3539999999999999e-06 2024-09-12T18:37:20.090 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.090 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.090 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:20.090 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.056031+0000", 2024-09-12T18:37:20.090 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.9539999999999999e-06 2024-09-12T18:37:20.090 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.090 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.090 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:20.091 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.056039+0000", 2024-09-12T18:37:20.091 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6790000000000005e-06 2024-09-12T18:37:20.091 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.091 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.091 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:20.091 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.056080+0000", 2024-09-12T18:37:20.091 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.1560999999999997e-05 2024-09-12T18:37:20.091 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.091 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.091 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:20.091 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.056285+0000", 2024-09-12T18:37:20.091 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000204794 2024-09-12T18:37:20.091 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.092 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.092 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:20.092 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.056396+0000", 2024-09-12T18:37:20.092 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000110659 2024-09-12T18:37:20.092 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.092 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:20.092 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.092 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.092 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.092 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:200680 5.3 5:c3244424:::benchmark_data_smithi073_23739_object68403:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:20.093 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:20.056057+0000", 2024-09-12T18:37:20.093 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00086196999999999999, 2024-09-12T18:37:20.093 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0011737, 2024-09-12T18:37:20.093 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:20.093 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:20.093 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:20.093 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:20.093 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:20.093 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:20.093 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 200680 2024-09-12T18:37:20.093 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.093 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:20.094 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.094 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:20.094 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.056057+0000", 2024-09-12T18:37:20.094 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.094 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.094 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.094 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:20.094 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.056057+0000", 2024-09-12T18:37:20.094 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.094 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.094 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.094 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:20.094 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.056058+0000", 2024-09-12T18:37:20.094 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5699999999999998e-07 2024-09-12T18:37:20.095 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.095 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.095 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:20.095 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.056060+0000", 2024-09-12T18:37:20.095 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.8770000000000002e-06 2024-09-12T18:37:20.095 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.095 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.095 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:20.095 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.056066+0000", 2024-09-12T18:37:20.095 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8119999999999996e-06 2024-09-12T18:37:20.095 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.095 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.095 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:20.095 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.056072+0000", 2024-09-12T18:37:20.096 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.0769999999999996e-06 2024-09-12T18:37:20.096 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.096 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.096 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:20.096 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.056131+0000", 2024-09-12T18:37:20.096 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8502999999999999e-05 2024-09-12T18:37:20.096 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.096 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.096 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:20.096 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.056270+0000", 2024-09-12T18:37:20.096 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000138992 2024-09-12T18:37:20.096 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.096 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.097 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:20.097 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.056419+0000", 2024-09-12T18:37:20.097 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014948500000000001 2024-09-12T18:37:20.097 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.097 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:20.097 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.097 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.097 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.097 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:200681 5.b e67/21 5:d4af2a62:::benchmark_data_smithi073_23739_object68404:head v 67'12717, mlcod=67'12714)", 2024-09-12T18:37:20.098 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:20.056383+0000", 2024-09-12T18:37:20.098 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00053625799999999996, 2024-09-12T18:37:20.098 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00091127000000000005, 2024-09-12T18:37:20.098 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:20.098 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:20.098 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:20.098 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:20.098 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.098 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:20.098 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.056383+0000", 2024-09-12T18:37:20.098 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.098 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.099 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.099 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:20.099 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.056383+0000", 2024-09-12T18:37:20.099 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.099 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.099 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.099 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:20.099 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.056384+0000", 2024-09-12T18:37:20.099 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6799999999999999e-07 2024-09-12T18:37:20.099 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.099 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.100 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:20.100 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.056389+0000", 2024-09-12T18:37:20.100 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0000000000000004e-06 2024-09-12T18:37:20.100 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.100 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.101 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:20.101 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.056398+0000", 2024-09-12T18:37:20.101 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.628e-06 2024-09-12T18:37:20.101 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.101 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.101 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:20.101 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.056405+0000", 2024-09-12T18:37:20.101 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7070000000000003e-06 2024-09-12T18:37:20.101 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.101 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.101 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:20.101 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.056688+0000", 2024-09-12T18:37:20.101 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00028322900000000002 2024-09-12T18:37:20.102 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.102 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.102 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:20.102 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.056710+0000", 2024-09-12T18:37:20.102 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1464e-05 2024-09-12T18:37:20.102 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.102 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:20.102 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.102 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.102 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.102 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:200676 5.a e67/21)", 2024-09-12T18:37:20.102 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:20.056601+0000", 2024-09-12T18:37:20.102 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00031778699999999998, 2024-09-12T18:37:20.102 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00073895199999999997, 2024-09-12T18:37:20.103 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:20.103 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:20.103 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:20.103 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:20.103 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.103 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:20.103 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.056601+0000", 2024-09-12T18:37:20.103 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.103 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.103 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.103 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:20.103 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.056601+0000", 2024-09-12T18:37:20.103 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.103 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.104 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.104 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:20.104 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.056602+0000", 2024-09-12T18:37:20.104 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.68e-07 2024-09-12T18:37:20.104 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.104 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.104 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:20.104 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.056605+0000", 2024-09-12T18:37:20.104 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.5190000000000001e-06 2024-09-12T18:37:20.105 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.105 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.105 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:20.105 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.056613+0000", 2024-09-12T18:37:20.105 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5109999999999997e-06 2024-09-12T18:37:20.105 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.105 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.105 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:20.105 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.056619+0000", 2024-09-12T18:37:20.105 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2829999999999998e-06 2024-09-12T18:37:20.105 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.105 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:20.106 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.106 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.106 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.106 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:200683 5.a 5.71cbe0ca (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:20.106 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:20.056676+0000", 2024-09-12T18:37:20.106 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00024358600000000001, 2024-09-12T18:37:20.106 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00070213299999999997, 2024-09-12T18:37:20.106 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:20.106 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:20.106 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:20.106 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:20.107 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:20.107 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:20.107 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 200683 2024-09-12T18:37:20.107 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.107 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:20.107 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.107 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:20.107 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.056676+0000", 2024-09-12T18:37:20.107 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.107 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.108 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.108 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:20.108 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.056676+0000", 2024-09-12T18:37:20.108 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.108 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.108 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.108 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:20.108 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.056676+0000", 2024-09-12T18:37:20.109 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.5900000000000005e-07 2024-09-12T18:37:20.109 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.109 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.109 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:20.109 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.056682+0000", 2024-09-12T18:37:20.109 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0479999999999998e-06 2024-09-12T18:37:20.109 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.109 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.110 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:20.110 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.056691+0000", 2024-09-12T18:37:20.110 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2040000000000003e-06 2024-09-12T18:37:20.110 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.110 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.110 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:20.110 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.056698+0000", 2024-09-12T18:37:20.110 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8920000000000003e-06 2024-09-12T18:37:20.110 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.110 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:20.110 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.110 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.110 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.111 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:200685 5.2 e67/21)", 2024-09-12T18:37:20.111 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:20.057010+0000", 2024-09-12T18:37:20.111 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4294967295.9999094, 2024-09-12T18:37:20.111 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00040989899999999997, 2024-09-12T18:37:20.111 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:20.111 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:20.111 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:20.111 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:20.111 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.111 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:20.111 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.057010+0000", 2024-09-12T18:37:20.111 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.112 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.112 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.112 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:20.112 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.057010+0000", 2024-09-12T18:37:20.112 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.112 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.112 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.112 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:20.112 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.057011+0000", 2024-09-12T18:37:20.112 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6499999999999998e-07 2024-09-12T18:37:20.112 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.112 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.113 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:20.113 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.057016+0000", 2024-09-12T18:37:20.113 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.3070000000000002e-06 2024-09-12T18:37:20.113 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.113 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.113 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:20.113 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.057026+0000", 2024-09-12T18:37:20.113 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.9660000000000008e-06 2024-09-12T18:37:20.113 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.114 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.114 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:20.114 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.057032+0000", 2024-09-12T18:37:20.114 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4500000000000001e-06 2024-09-12T18:37:20.114 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.114 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:20.114 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.114 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.114 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.114 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:200663 5.3 5:c349f4c7:::benchmark_data_smithi073_23739_object68386:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:20.114 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:20.048238+0000", 2024-09-12T18:37:20.114 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0086810150000000003, 2024-09-12T18:37:20.114 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0092221379999999995, 2024-09-12T18:37:20.115 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:20.115 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:20.115 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:20.115 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:20.115 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:20.115 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:20.115 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 200663 2024-09-12T18:37:20.115 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.115 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:20.115 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.115 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:20.115 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.048238+0000", 2024-09-12T18:37:20.115 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.115 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.116 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.116 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:20.116 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.048238+0000", 2024-09-12T18:37:20.116 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.116 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.116 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.116 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:20.116 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.048239+0000", 2024-09-12T18:37:20.116 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0160000000000001e-06 2024-09-12T18:37:20.116 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.116 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.116 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:20.117 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.048243+0000", 2024-09-12T18:37:20.117 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4089999999999996e-06 2024-09-12T18:37:20.117 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.117 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.117 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:20.117 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.048257+0000", 2024-09-12T18:37:20.117 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3959e-05 2024-09-12T18:37:20.117 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.117 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.117 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:20.117 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.048263+0000", 2024-09-12T18:37:20.117 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6749999999999999e-06 2024-09-12T18:37:20.117 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.118 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.118 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:20.118 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.048476+0000", 2024-09-12T18:37:20.118 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00021303899999999999 2024-09-12T18:37:20.118 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.118 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.118 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:20.118 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.048595+0000", 2024-09-12T18:37:20.118 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000118725 2024-09-12T18:37:20.118 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.118 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.118 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:20.118 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.048663+0000", 2024-09-12T18:37:20.119 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8324999999999994e-05 2024-09-12T18:37:20.119 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.119 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.119 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:20.119 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:20.051834+0000", 2024-09-12T18:37:20.119 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.003170857 2024-09-12T18:37:20.119 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.119 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:20.119 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.119 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.119 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-12T18:37:20.119 INFO:teuthology.orchestra.run.smithi114.stdout: "num_ops": 11 2024-09-12T18:37:20.119 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:20.121 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:37:20.122 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:20.114+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:20.221 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:20.212+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:20.233 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:37:20.233 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:37:20.233 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-12T18:37:20.233 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-12T18:37:20.247 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T18:37:20.314 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:20.314 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2024-09-12T18:37:20.314 INFO:teuthology.orchestra.run.smithi114.stdout: "complaint_time": 30, 2024-09-12T18:37:20.314 INFO:teuthology.orchestra.run.smithi114.stdout: "num_blocked_ops": 0 2024-09-12T18:37:20.315 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:20.322 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:20.318+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:20.334 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:37:20.404 INFO:teuthology.orchestra.run.smithi073.stderr:no valid command found; 10 closest matches: 2024-09-12T18:37:20.404 INFO:teuthology.orchestra.run.smithi073.stderr:0 2024-09-12T18:37:20.404 INFO:teuthology.orchestra.run.smithi073.stderr:1 2024-09-12T18:37:20.404 INFO:teuthology.orchestra.run.smithi073.stderr:2 2024-09-12T18:37:20.405 INFO:teuthology.orchestra.run.smithi073.stderr:abort 2024-09-12T18:37:20.405 INFO:teuthology.orchestra.run.smithi073.stderr:assert 2024-09-12T18:37:20.405 INFO:teuthology.orchestra.run.smithi073.stderr:bench [] [] [] [] 2024-09-12T18:37:20.405 INFO:teuthology.orchestra.run.smithi073.stderr:bluefs debug_inject_read_zeros 2024-09-12T18:37:20.405 INFO:teuthology.orchestra.run.smithi073.stderr:bluefs files list 2024-09-12T18:37:20.405 INFO:teuthology.orchestra.run.smithi073.stderr:bluefs stats 2024-09-12T18:37:20.405 INFO:teuthology.orchestra.run.smithi073.stderr:bluestore allocator dump block 2024-09-12T18:37:20.405 INFO:teuthology.orchestra.run.smithi073.stderr:Error EINVAL: invalid command 2024-09-12T18:37:20.407 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T18:37:20.408 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-12T18:37:20.408 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-12T18:37:20.423 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:20.414+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:20.481 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:20.481 INFO:teuthology.orchestra.run.smithi114.stdout: "size": 20, 2024-09-12T18:37:20.481 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 600, 2024-09-12T18:37:20.481 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:37:20.481 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.481 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:26 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:20.481 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:37:20.481 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 114.84852038299999, 2024-09-12T18:37:20.482 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045702136999999997, 2024-09-12T18:37:20.482 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:20.482 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:20.482 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:20.482 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:20.482 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.482 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:20.482 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:37:20.482 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.482 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.482 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.482 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:20.483 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:37:20.483 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.483 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.483 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.483 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:20.483 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628699+0000", 2024-09-12T18:37:20.483 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3859999999999999e-06 2024-09-12T18:37:20.483 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.483 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.483 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:20.483 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628706+0000", 2024-09-12T18:37:20.483 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0169999999999999e-06 2024-09-12T18:37:20.483 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.484 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.484 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:20.484 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628725+0000", 2024-09-12T18:37:20.484 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8683000000000001e-05 2024-09-12T18:37:20.484 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.484 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.484 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:20.484 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628740+0000", 2024-09-12T18:37:20.484 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5413999999999998e-05 2024-09-12T18:37:20.485 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.485 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.485 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:20.485 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628907+0000", 2024-09-12T18:37:20.485 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00016670199999999999 2024-09-12T18:37:20.485 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.485 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.485 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:37:20.485 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628917+0000", 2024-09-12T18:37:20.485 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.046e-05 2024-09-12T18:37:20.485 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.485 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.486 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:20.486 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.660390+0000", 2024-09-12T18:37:20.486 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.031472364000000003 2024-09-12T18:37:20.486 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.486 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.486 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:20.486 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.661767+0000", 2024-09-12T18:37:20.486 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0013769190000000001 2024-09-12T18:37:20.486 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.486 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.487 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:20.487 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.662408+0000", 2024-09-12T18:37:20.487 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00064091099999999998 2024-09-12T18:37:20.487 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.487 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.487 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:20.487 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669577+0000", 2024-09-12T18:37:20.487 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.007169412 2024-09-12T18:37:20.487 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.487 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.487 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:20.487 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674244+0000", 2024-09-12T18:37:20.487 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0046671839999999996 2024-09-12T18:37:20.488 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.488 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.488 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:20.488 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674329+0000", 2024-09-12T18:37:20.488 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5276000000000001e-05 2024-09-12T18:37:20.488 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.488 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.488 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:20.488 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674400+0000", 2024-09-12T18:37:20.488 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0408999999999996e-05 2024-09-12T18:37:20.488 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.488 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:20.489 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.489 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.489 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.489 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:20.489 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:37:20.489 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 114.848096103, 2024-09-12T18:37:20.489 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.046431252999999999, 2024-09-12T18:37:20.489 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:20.489 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:20.489 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:20.489 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:20.489 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.490 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:20.490 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:37:20.490 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.490 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.490 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.490 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:20.490 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:37:20.490 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.490 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.490 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.490 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:20.491 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629123+0000", 2024-09-12T18:37:20.491 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0899999999999999e-06 2024-09-12T18:37:20.491 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.491 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.491 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:20.491 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629138+0000", 2024-09-12T18:37:20.491 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4977000000000001e-05 2024-09-12T18:37:20.491 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.491 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.491 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:20.492 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629149+0000", 2024-09-12T18:37:20.492 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1182999999999999e-05 2024-09-12T18:37:20.492 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.492 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.492 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:20.492 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629157+0000", 2024-09-12T18:37:20.492 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8129999999999996e-06 2024-09-12T18:37:20.492 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.492 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.493 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:20.493 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629223+0000", 2024-09-12T18:37:20.493 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6463000000000004e-05 2024-09-12T18:37:20.493 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.493 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.493 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:37:20.493 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629230+0000", 2024-09-12T18:37:20.493 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1360000000000002e-06 2024-09-12T18:37:20.493 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.493 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.493 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:20.493 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669605+0000", 2024-09-12T18:37:20.493 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.040375518999999999 2024-09-12T18:37:20.494 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.494 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.494 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:20.494 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669840+0000", 2024-09-12T18:37:20.494 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00023520099999999999 2024-09-12T18:37:20.494 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.494 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.494 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:20.494 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.675553+0000", 2024-09-12T18:37:20.494 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0057128709999999996 2024-09-12T18:37:20.494 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.494 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:20.494 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.495 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.495 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.495 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167352 5.a 5:5fc472d2:::benchmark_data_smithi073_23739_object35075:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:20.495 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.163066+0000", 2024-09-12T18:37:20.495 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 17.314152407000002, 2024-09-12T18:37:20.495 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.077708377999999995, 2024-09-12T18:37:20.495 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:20.495 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:20.495 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:20.496 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:20.496 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:20.496 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:20.496 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167352 2024-09-12T18:37:20.496 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.496 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:20.496 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.496 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:20.496 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163066+0000", 2024-09-12T18:37:20.496 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.496 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.496 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.496 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:20.496 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163066+0000", 2024-09-12T18:37:20.497 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.497 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.497 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.497 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:20.497 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163067+0000", 2024-09-12T18:37:20.497 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0499999999999999e-06 2024-09-12T18:37:20.497 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.497 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.497 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:20.497 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163071+0000", 2024-09-12T18:37:20.497 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4340000000000002e-06 2024-09-12T18:37:20.497 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.498 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.498 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:20.498 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163081+0000", 2024-09-12T18:37:20.498 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0304e-05 2024-09-12T18:37:20.498 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.498 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.498 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:20.498 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163090+0000", 2024-09-12T18:37:20.498 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7309999999999999e-06 2024-09-12T18:37:20.498 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.498 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.498 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:20.498 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163143+0000", 2024-09-12T18:37:20.498 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2942000000000002e-05 2024-09-12T18:37:20.499 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.499 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.499 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:20.499 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163270+0000", 2024-09-12T18:37:20.499 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012664100000000001 2024-09-12T18:37:20.499 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.499 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.499 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:20.499 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163378+0000", 2024-09-12T18:37:20.499 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000107995 2024-09-12T18:37:20.499 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.499 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.499 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:20.500 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234552+0000", 2024-09-12T18:37:20.500 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.071173831000000007 2024-09-12T18:37:20.500 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.500 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.500 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:20.500 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240640+0000", 2024-09-12T18:37:20.500 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.006088909 2024-09-12T18:37:20.500 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.500 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.500 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:20.500 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240709+0000", 2024-09-12T18:37:20.500 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8393999999999996e-05 2024-09-12T18:37:20.500 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.501 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.501 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:20.501 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240774+0000", 2024-09-12T18:37:20.501 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5147000000000005e-05 2024-09-12T18:37:20.501 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.501 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:20.501 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.501 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.501 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.501 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167358 5.a 5:533f6738:::benchmark_data_smithi073_23739_object35081:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:20.502 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.165639+0000", 2024-09-12T18:37:20.502 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 17.311579129999998, 2024-09-12T18:37:20.502 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.075287509000000002, 2024-09-12T18:37:20.502 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:20.502 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:20.502 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:20.502 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:20.502 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:20.502 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:20.502 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167358 2024-09-12T18:37:20.502 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.502 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:20.503 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.503 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:20.503 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165639+0000", 2024-09-12T18:37:20.503 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.503 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.503 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.503 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:20.503 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165639+0000", 2024-09-12T18:37:20.503 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.503 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.503 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.503 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:20.504 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165640+0000", 2024-09-12T18:37:20.504 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1999999999999999e-06 2024-09-12T18:37:20.504 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.504 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.504 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:20.504 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165646+0000", 2024-09-12T18:37:20.504 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4550000000000003e-06 2024-09-12T18:37:20.504 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.504 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.504 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:20.504 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165658+0000", 2024-09-12T18:37:20.504 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2721999999999999e-05 2024-09-12T18:37:20.505 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.505 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.505 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:20.505 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165668+0000", 2024-09-12T18:37:20.505 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4229999999999994e-06 2024-09-12T18:37:20.505 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.505 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.505 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:20.505 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165711+0000", 2024-09-12T18:37:20.505 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3785999999999997e-05 2024-09-12T18:37:20.505 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.505 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.506 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:20.506 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165788+0000", 2024-09-12T18:37:20.506 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6506000000000002e-05 2024-09-12T18:37:20.506 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.506 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.506 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:20.506 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165862+0000", 2024-09-12T18:37:20.506 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4012999999999998e-05 2024-09-12T18:37:20.506 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.506 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.506 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:20.506 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234718+0000", 2024-09-12T18:37:20.506 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.068856420000000002 2024-09-12T18:37:20.507 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.507 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.507 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:20.507 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240785+0000", 2024-09-12T18:37:20.507 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0060661489999999998 2024-09-12T18:37:20.507 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.507 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.507 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:20.507 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240844+0000", 2024-09-12T18:37:20.507 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9487000000000002e-05 2024-09-12T18:37:20.507 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.507 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.507 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:20.508 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240926+0000", 2024-09-12T18:37:20.508 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2348000000000005e-05 2024-09-12T18:37:20.508 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.508 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:20.508 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.508 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.508 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.508 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167361 5.a 5:56730f28:::benchmark_data_smithi073_23739_object35084:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:20.508 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.165979+0000", 2024-09-12T18:37:20.508 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 17.311239149999999, 2024-09-12T18:37:20.508 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.075128337000000003, 2024-09-12T18:37:20.508 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:20.509 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:20.509 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:20.509 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:20.509 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:20.509 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:20.509 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167361 2024-09-12T18:37:20.509 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.509 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:20.509 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.509 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:20.509 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165979+0000", 2024-09-12T18:37:20.510 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.510 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.510 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.510 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:20.510 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165979+0000", 2024-09-12T18:37:20.510 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.510 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.510 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.510 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:20.510 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165980+0000", 2024-09-12T18:37:20.510 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4499999999999997e-07 2024-09-12T18:37:20.511 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.511 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.511 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:20.511 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165985+0000", 2024-09-12T18:37:20.511 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.186e-06 2024-09-12T18:37:20.511 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.511 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.511 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:20.511 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165995+0000", 2024-09-12T18:37:20.511 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0378e-05 2024-09-12T18:37:20.511 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.511 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.511 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:20.511 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.166016+0000", 2024-09-12T18:37:20.512 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1316999999999999e-05 2024-09-12T18:37:20.512 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.512 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.512 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:20.512 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.167783+0000", 2024-09-12T18:37:20.512 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017662209999999999 2024-09-12T18:37:20.512 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.512 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.513 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:20.513 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.167851+0000", 2024-09-12T18:37:20.513 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7990000000000005e-05 2024-09-12T18:37:20.513 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.513 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.513 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:20.513 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.167929+0000", 2024-09-12T18:37:20.513 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8829e-05 2024-09-12T18:37:20.513 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.513 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.513 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:20.513 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234832+0000", 2024-09-12T18:37:20.514 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066902378999999998 2024-09-12T18:37:20.514 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.514 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.514 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:20.514 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240941+0000", 2024-09-12T18:37:20.514 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0061087470000000003 2024-09-12T18:37:20.514 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.514 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.514 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:20.514 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241053+0000", 2024-09-12T18:37:20.515 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00011197299999999999 2024-09-12T18:37:20.515 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.515 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.515 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:20.515 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241107+0000", 2024-09-12T18:37:20.515 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4672000000000001e-05 2024-09-12T18:37:20.515 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.515 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:20.515 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.515 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.515 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.516 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167362 5.3 5:cbd73b47:::benchmark_data_smithi073_23739_object35085:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:20.516 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:20.516 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 17.309142434999998, 2024-09-12T18:37:20.516 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.067202411000000004, 2024-09-12T18:37:20.516 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:20.516 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:20.516 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:20.516 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:20.516 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:20.516 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:20.516 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167362 2024-09-12T18:37:20.516 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.517 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:20.517 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.517 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:20.517 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:20.517 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.517 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.517 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.517 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:20.517 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:20.517 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.517 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.518 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.518 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:20.518 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:20.518 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3600000000000003e-07 2024-09-12T18:37:20.518 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.518 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.518 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:20.518 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168079+0000", 2024-09-12T18:37:20.518 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7949999999999999e-06 2024-09-12T18:37:20.518 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.519 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.519 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:20.519 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168085+0000", 2024-09-12T18:37:20.519 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2110000000000003e-06 2024-09-12T18:37:20.519 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.519 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.519 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:20.519 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168089+0000", 2024-09-12T18:37:20.519 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0840000000000002e-06 2024-09-12T18:37:20.519 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.519 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.519 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:20.519 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168121+0000", 2024-09-12T18:37:20.520 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.1489000000000003e-05 2024-09-12T18:37:20.520 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.520 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.520 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:20.520 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168186+0000", 2024-09-12T18:37:20.520 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5313000000000003e-05 2024-09-12T18:37:20.520 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.520 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.520 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:20.521 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168242+0000", 2024-09-12T18:37:20.521 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5560999999999999e-05 2024-09-12T18:37:20.521 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.521 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.521 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:20.522 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234467+0000", 2024-09-12T18:37:20.522 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066225424000000005 2024-09-12T18:37:20.522 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.522 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.522 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:20.522 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235088+0000", 2024-09-12T18:37:20.523 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00062118999999999998 2024-09-12T18:37:20.523 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.523 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.523 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:20.523 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235197+0000", 2024-09-12T18:37:20.523 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00010825899999999999 2024-09-12T18:37:20.523 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.523 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.523 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:20.523 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235278+0000", 2024-09-12T18:37:20.524 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1448999999999999e-05 2024-09-12T18:37:20.524 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.524 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:20.524 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.524 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.524 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.524 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167366 5.a 5:58e6a467:::benchmark_data_smithi073_23739_object35089:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:20.524 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168263+0000", 2024-09-12T18:37:20.524 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 17.308954898, 2024-09-12T18:37:20.524 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.078184744, 2024-09-12T18:37:20.525 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:20.525 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:20.525 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:20.525 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:20.525 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:20.525 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:20.525 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167366 2024-09-12T18:37:20.525 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.525 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:20.525 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.525 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:20.525 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168263+0000", 2024-09-12T18:37:20.525 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.526 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.526 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.526 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:20.526 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168263+0000", 2024-09-12T18:37:20.526 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.526 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.526 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.526 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:20.526 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168264+0000", 2024-09-12T18:37:20.526 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5700000000000002e-07 2024-09-12T18:37:20.526 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.526 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.526 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:20.527 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168266+0000", 2024-09-12T18:37:20.527 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1789999999999998e-06 2024-09-12T18:37:20.527 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.527 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.527 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:20.527 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168271+0000", 2024-09-12T18:37:20.527 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8160000000000001e-06 2024-09-12T18:37:20.527 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.527 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.527 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:20.527 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168275+0000", 2024-09-12T18:37:20.527 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4440000000000001e-06 2024-09-12T18:37:20.527 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.528 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.528 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:20.528 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170082+0000", 2024-09-12T18:37:20.528 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0018068800000000001 2024-09-12T18:37:20.528 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.528 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.528 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:20.528 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170154+0000", 2024-09-12T18:37:20.528 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1575000000000005e-05 2024-09-12T18:37:20.528 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.528 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.528 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:20.528 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170216+0000", 2024-09-12T18:37:20.528 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1989999999999994e-05 2024-09-12T18:37:20.529 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.529 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.529 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:20.529 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234933+0000", 2024-09-12T18:37:20.529 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064717514000000004 2024-09-12T18:37:20.529 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.529 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.529 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:20.529 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246226+0000", 2024-09-12T18:37:20.529 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011293151 2024-09-12T18:37:20.529 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.529 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.529 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:20.529 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246338+0000", 2024-09-12T18:37:20.530 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00011225 2024-09-12T18:37:20.530 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.530 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.530 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:20.530 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246448+0000", 2024-09-12T18:37:20.530 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000109388 2024-09-12T18:37:20.530 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.530 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:20.530 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.530 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.530 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.530 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167367 5.a 5:51778d97:::benchmark_data_smithi073_23739_object35090:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:20.530 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168388+0000", 2024-09-12T18:37:20.530 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 17.308829654, 2024-09-12T18:37:20.531 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.082583860999999995, 2024-09-12T18:37:20.531 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:20.531 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:20.531 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:20.531 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:20.531 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:20.531 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:20.531 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167367 2024-09-12T18:37:20.531 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.531 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:20.531 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.531 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:20.532 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168388+0000", 2024-09-12T18:37:20.532 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.532 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.532 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.532 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:20.532 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168388+0000", 2024-09-12T18:37:20.532 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.532 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.532 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.532 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:20.532 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168389+0000", 2024-09-12T18:37:20.532 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1099999999999996e-07 2024-09-12T18:37:20.532 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.532 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.533 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:20.533 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168391+0000", 2024-09-12T18:37:20.533 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.39e-06 2024-09-12T18:37:20.533 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.533 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.533 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:20.533 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168396+0000", 2024-09-12T18:37:20.533 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3460000000000004e-06 2024-09-12T18:37:20.533 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.533 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.533 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:20.533 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168399+0000", 2024-09-12T18:37:20.533 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.613e-06 2024-09-12T18:37:20.534 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.534 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.534 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:20.534 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235003+0000", 2024-09-12T18:37:20.534 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066603851000000006 2024-09-12T18:37:20.534 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.534 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.534 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:20.534 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235266+0000", 2024-09-12T18:37:20.534 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00026270999999999998 2024-09-12T18:37:20.534 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.534 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.534 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:20.534 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235510+0000", 2024-09-12T18:37:20.535 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00024394 2024-09-12T18:37:20.535 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.535 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.535 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:20.535 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246546+0000", 2024-09-12T18:37:20.535 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011035774 2024-09-12T18:37:20.535 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.535 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.535 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:20.535 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.250808+0000", 2024-09-12T18:37:20.535 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0042622700000000003 2024-09-12T18:37:20.535 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.535 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.536 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:20.536 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.250890+0000", 2024-09-12T18:37:20.536 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1874999999999998e-05 2024-09-12T18:37:20.536 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.536 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.536 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:20.536 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.250972+0000", 2024-09-12T18:37:20.536 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2581000000000001e-05 2024-09-12T18:37:20.536 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.536 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:20.536 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.536 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.536 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.537 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167370 5.a 5:5aab9477:::benchmark_data_smithi073_23739_object35093:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:20.537 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168603+0000", 2024-09-12T18:37:20.537 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 17.308614719000001, 2024-09-12T18:37:20.537 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.086603794999999997, 2024-09-12T18:37:20.537 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:20.537 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:20.537 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:20.537 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:20.537 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:20.537 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:20.537 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167370 2024-09-12T18:37:20.537 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.537 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:20.538 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.538 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:20.538 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168603+0000", 2024-09-12T18:37:20.538 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.538 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.538 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.538 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:20.538 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168603+0000", 2024-09-12T18:37:20.538 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.538 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.538 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.538 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:20.539 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168604+0000", 2024-09-12T18:37:20.539 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.1899999999999998e-07 2024-09-12T18:37:20.539 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.539 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.539 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:20.539 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168606+0000", 2024-09-12T18:37:20.539 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8309999999999999e-06 2024-09-12T18:37:20.539 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.539 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.539 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:20.539 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168610+0000", 2024-09-12T18:37:20.539 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8069999999999999e-06 2024-09-12T18:37:20.539 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.540 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.540 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:20.540 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168613+0000", 2024-09-12T18:37:20.540 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.118e-06 2024-09-12T18:37:20.540 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.540 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.540 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:20.540 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241145+0000", 2024-09-12T18:37:20.540 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.072531678000000002 2024-09-12T18:37:20.540 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.540 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.540 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:20.540 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241342+0000", 2024-09-12T18:37:20.541 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00019635900000000001 2024-09-12T18:37:20.541 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.541 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.541 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:20.541 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241483+0000", 2024-09-12T18:37:20.541 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014161100000000001 2024-09-12T18:37:20.541 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.541 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.541 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:20.541 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255039+0000", 2024-09-12T18:37:20.541 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013555724 2024-09-12T18:37:20.541 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.541 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.542 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:20.542 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255062+0000", 2024-09-12T18:37:20.542 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.3042000000000001e-05 2024-09-12T18:37:20.542 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.542 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.542 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:20.542 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255143+0000", 2024-09-12T18:37:20.542 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0999000000000002e-05 2024-09-12T18:37:20.542 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.542 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.542 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:20.542 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255207+0000", 2024-09-12T18:37:20.543 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4207000000000004e-05 2024-09-12T18:37:20.543 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.543 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:20.543 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.543 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.543 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.544 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167352 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:20.544 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:20.544 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 17.308490065000001, 2024-09-12T18:37:20.544 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065859953999999998, 2024-09-12T18:37:20.544 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:20.545 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:20.545 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:20.545 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:20.545 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.545 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:20.545 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:20.546 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.546 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.546 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.546 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:20.546 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:20.547 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.547 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.547 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.547 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:20.547 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:20.547 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.0800000000000001e-07 2024-09-12T18:37:20.548 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.548 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.548 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:20.548 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168730+0000", 2024-09-12T18:37:20.548 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6530000000000001e-06 2024-09-12T18:37:20.548 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.549 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.549 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:20.549 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168734+0000", 2024-09-12T18:37:20.549 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.721e-06 2024-09-12T18:37:20.549 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.549 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.550 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:20.550 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168736+0000", 2024-09-12T18:37:20.550 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.508e-06 2024-09-12T18:37:20.550 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.550 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.551 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:20.551 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171951+0000", 2024-09-12T18:37:20.551 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.003215281 2024-09-12T18:37:20.551 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.551 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.552 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:20.552 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234520+0000", 2024-09-12T18:37:20.552 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062568676000000004 2024-09-12T18:37:20.552 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.552 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.552 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:20.553 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234588+0000", 2024-09-12T18:37:20.553 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7806999999999996e-05 2024-09-12T18:37:20.553 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.553 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:20.553 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.554 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.554 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.554 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167368 5.4 e58/21 5:29a1ec58:::benchmark_data_smithi073_23739_object35091:head v 58'10399, mlcod=58'10396)", 2024-09-12T18:37:20.554 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:20.554 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 17.308367048000001, 2024-09-12T18:37:20.554 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066008885000000003, 2024-09-12T18:37:20.555 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:20.555 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:20.555 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:20.555 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:20.555 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.555 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:20.556 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:20.556 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.556 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.556 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.556 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:20.557 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:20.557 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.557 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.557 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.557 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:20.558 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:20.558 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4699999999999998e-07 2024-09-12T18:37:20.558 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.558 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.558 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:20.558 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168854+0000", 2024-09-12T18:37:20.559 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.3180000000000001e-06 2024-09-12T18:37:20.559 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.559 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.559 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:20.559 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168858+0000", 2024-09-12T18:37:20.560 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2799999999999997e-06 2024-09-12T18:37:20.560 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.560 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.560 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:20.560 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168861+0000", 2024-09-12T18:37:20.560 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7650000000000002e-06 2024-09-12T18:37:20.561 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.561 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.561 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:20.561 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168895+0000", 2024-09-12T18:37:20.561 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4533999999999998e-05 2024-09-12T18:37:20.562 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.562 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.562 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:20.562 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168906+0000", 2024-09-12T18:37:20.562 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0910000000000001e-05 2024-09-12T18:37:20.562 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.563 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.563 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:20.563 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234784+0000", 2024-09-12T18:37:20.563 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065877656000000007 2024-09-12T18:37:20.563 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.564 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.564 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:20.564 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234860+0000", 2024-09-12T18:37:20.564 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6174999999999995e-05 2024-09-12T18:37:20.564 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.565 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:20.565 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.565 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.565 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.565 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167358 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:20.565 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.170373+0000", 2024-09-12T18:37:20.566 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 17.306844767000001, 2024-09-12T18:37:20.566 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064370201000000002, 2024-09-12T18:37:20.566 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:20.566 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:20.566 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:20.567 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:20.567 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.567 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:20.567 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170373+0000", 2024-09-12T18:37:20.567 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.567 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.568 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.568 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:20.568 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170373+0000", 2024-09-12T18:37:20.568 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.568 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.569 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.569 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:20.569 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170374+0000", 2024-09-12T18:37:20.569 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5799999999999998e-07 2024-09-12T18:37:20.569 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.569 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.570 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:20.570 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170378+0000", 2024-09-12T18:37:20.570 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.732e-06 2024-09-12T18:37:20.570 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.570 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.571 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:20.571 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170388+0000", 2024-09-12T18:37:20.571 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0212e-05 2024-09-12T18:37:20.571 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.571 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.572 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:20.572 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170397+0000", 2024-09-12T18:37:20.572 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7090000000000008e-06 2024-09-12T18:37:20.572 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.572 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.573 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:20.573 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234682+0000", 2024-09-12T18:37:20.573 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064285518999999999 2024-09-12T18:37:20.573 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.573 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.574 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:20.574 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234703+0000", 2024-09-12T18:37:20.574 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.0199000000000001e-05 2024-09-12T18:37:20.574 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.574 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.574 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:20.575 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234743+0000", 2024-09-12T18:37:20.575 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0972e-05 2024-09-12T18:37:20.575 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.575 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:20.575 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.576 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.576 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.576 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167372 5.c 5:398d36a7:::benchmark_data_smithi073_23739_object35095:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:20.576 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171066+0000", 2024-09-12T18:37:20.576 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 17.306151555, 2024-09-12T18:37:20.576 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065889534999999999, 2024-09-12T18:37:20.577 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:20.577 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:20.577 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:20.577 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:20.577 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:20.578 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:20.578 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167372 2024-09-12T18:37:20.578 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.578 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:20.578 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.578 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:20.579 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171066+0000", 2024-09-12T18:37:20.579 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.579 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.579 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.579 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:20.579 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171066+0000", 2024-09-12T18:37:20.580 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.580 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.580 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.580 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:20.580 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171068+0000", 2024-09-12T18:37:20.581 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.186e-06 2024-09-12T18:37:20.581 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.581 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.581 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:20.581 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171072+0000", 2024-09-12T18:37:20.582 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3560000000000003e-06 2024-09-12T18:37:20.582 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.582 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.582 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:20.582 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171082+0000", 2024-09-12T18:37:20.583 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.9739999999999997e-06 2024-09-12T18:37:20.583 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.583 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.583 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:20.583 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171089+0000", 2024-09-12T18:37:20.583 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7159999999999997e-06 2024-09-12T18:37:20.584 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.584 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.584 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:20.584 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171133+0000", 2024-09-12T18:37:20.584 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4091999999999997e-05 2024-09-12T18:37:20.585 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.585 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.585 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:20.585 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171221+0000", 2024-09-12T18:37:20.585 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.8108000000000004e-05 2024-09-12T18:37:20.585 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.586 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.586 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:20.586 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171279+0000", 2024-09-12T18:37:20.586 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8062000000000001e-05 2024-09-12T18:37:20.586 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.587 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.587 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:20.587 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235007+0000", 2024-09-12T18:37:20.587 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.063727849000000003 2024-09-12T18:37:20.587 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.587 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.588 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:20.588 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236790+0000", 2024-09-12T18:37:20.588 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017829269999999999 2024-09-12T18:37:20.588 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.588 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.589 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:20.589 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236881+0000", 2024-09-12T18:37:20.589 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1347999999999993e-05 2024-09-12T18:37:20.589 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.589 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.589 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:20.590 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236956+0000", 2024-09-12T18:37:20.590 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4917000000000001e-05 2024-09-12T18:37:20.590 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.590 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:20.590 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.590 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.591 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.591 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167371 5.4 e58/21 5:24fea27c:::benchmark_data_smithi073_23739_object35094:head v 58'10400, mlcod=58'10397)", 2024-09-12T18:37:20.591 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171273+0000", 2024-09-12T18:37:20.591 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 17.305944981, 2024-09-12T18:37:20.591 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065500368000000003, 2024-09-12T18:37:20.592 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:20.592 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:20.592 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:20.592 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:20.592 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.593 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:20.593 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171273+0000", 2024-09-12T18:37:20.593 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.593 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.593 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.593 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:20.594 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171273+0000", 2024-09-12T18:37:20.594 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.594 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.594 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.594 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:20.594 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171274+0000", 2024-09-12T18:37:20.594 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0399999999999996e-07 2024-09-12T18:37:20.594 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.594 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.595 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:20.595 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171277+0000", 2024-09-12T18:37:20.595 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8689999999999997e-06 2024-09-12T18:37:20.595 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.595 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.595 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:20.595 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171284+0000", 2024-09-12T18:37:20.596 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2879999999999998e-06 2024-09-12T18:37:20.596 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.596 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.596 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:20.596 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171289+0000", 2024-09-12T18:37:20.596 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9049999999999996e-06 2024-09-12T18:37:20.597 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.597 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.597 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:20.597 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171322+0000", 2024-09-12T18:37:20.597 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3781000000000001e-05 2024-09-12T18:37:20.597 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.597 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.597 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:20.597 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171335+0000", 2024-09-12T18:37:20.597 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2639999999999999e-05 2024-09-12T18:37:20.597 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.597 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.597 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:20.598 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236691+0000", 2024-09-12T18:37:20.598 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065355835000000001 2024-09-12T18:37:20.598 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.598 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.598 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:20.598 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236773+0000", 2024-09-12T18:37:20.598 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2546000000000006e-05 2024-09-12T18:37:20.598 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.598 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:20.598 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.598 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.598 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.598 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167364 5.7 e58/21 5:ee50096a:::benchmark_data_smithi073_23739_object35087:head v 58'10504, mlcod=58'10502)", 2024-09-12T18:37:20.598 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171598+0000", 2024-09-12T18:37:20.599 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 17.305619862, 2024-09-12T18:37:20.599 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065149069000000004, 2024-09-12T18:37:20.599 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:20.599 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:20.599 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:20.599 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:20.599 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.599 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:20.599 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171598+0000", 2024-09-12T18:37:20.599 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.599 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.599 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.599 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:20.599 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171598+0000", 2024-09-12T18:37:20.600 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.600 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.600 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.600 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:20.600 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171599+0000", 2024-09-12T18:37:20.600 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6700000000000003e-07 2024-09-12T18:37:20.600 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.600 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.600 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:20.600 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171602+0000", 2024-09-12T18:37:20.600 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.841e-06 2024-09-12T18:37:20.600 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.600 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.601 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:20.601 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171608+0000", 2024-09-12T18:37:20.601 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9259999999999997e-06 2024-09-12T18:37:20.601 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.601 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.601 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:20.601 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171611+0000", 2024-09-12T18:37:20.601 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.9450000000000003e-06 2024-09-12T18:37:20.601 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.601 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.601 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:20.601 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171650+0000", 2024-09-12T18:37:20.601 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8464000000000003e-05 2024-09-12T18:37:20.602 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.602 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.602 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:20.602 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171662+0000", 2024-09-12T18:37:20.602 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1603999999999999e-05 2024-09-12T18:37:20.602 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.602 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.602 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:20.602 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236663+0000", 2024-09-12T18:37:20.602 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065001330999999996 2024-09-12T18:37:20.602 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.602 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.602 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:20.603 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236747+0000", 2024-09-12T18:37:20.603 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.4390999999999999e-05 2024-09-12T18:37:20.603 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.603 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:20.603 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.603 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.603 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.603 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167365 5.2 e58/21 5:4107875c:::benchmark_data_smithi073_23739_object35088:head v 58'10351, mlcod=58'10349)", 2024-09-12T18:37:20.603 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171733+0000", 2024-09-12T18:37:20.603 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 17.305484817, 2024-09-12T18:37:20.603 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.074804168000000004, 2024-09-12T18:37:20.603 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:20.603 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:20.604 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:20.604 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:20.604 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.604 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:20.604 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171733+0000", 2024-09-12T18:37:20.604 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.604 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.604 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.604 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:20.604 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171733+0000", 2024-09-12T18:37:20.604 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.604 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.604 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.604 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:20.605 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171734+0000", 2024-09-12T18:37:20.605 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9299999999999998e-07 2024-09-12T18:37:20.605 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.605 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.605 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:20.605 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171738+0000", 2024-09-12T18:37:20.605 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.301e-06 2024-09-12T18:37:20.605 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.605 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.605 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:20.606 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171746+0000", 2024-09-12T18:37:20.606 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.554e-06 2024-09-12T18:37:20.606 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.606 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.606 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:20.606 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171751+0000", 2024-09-12T18:37:20.606 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1880000000000001e-06 2024-09-12T18:37:20.606 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.606 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.606 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:20.606 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234659+0000", 2024-09-12T18:37:20.606 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062907807999999996 2024-09-12T18:37:20.606 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.606 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.607 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:20.607 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234708+0000", 2024-09-12T18:37:20.607 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8992000000000001e-05 2024-09-12T18:37:20.607 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.607 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.607 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:20.607 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246457+0000", 2024-09-12T18:37:20.607 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.01174974 2024-09-12T18:37:20.607 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.607 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.607 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:20.607 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246537+0000", 2024-09-12T18:37:20.607 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.9992000000000003e-05 2024-09-12T18:37:20.608 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.608 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:20.608 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.608 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.608 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.608 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167373 5.5 e58/49 5:ad283029:::benchmark_data_smithi073_23739_object35096:head v 58'10600, mlcod=58'10598)", 2024-09-12T18:37:20.608 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:20.608 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 17.305457333, 2024-09-12T18:37:20.608 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065058240000000003, 2024-09-12T18:37:20.608 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:20.608 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:20.608 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:20.609 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:20.609 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.609 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:20.609 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:20.609 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.609 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.609 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.609 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:20.609 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:20.610 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.610 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.610 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.610 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:20.610 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:20.610 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.2899999999999999e-07 2024-09-12T18:37:20.610 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.610 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.610 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:20.610 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171764+0000", 2024-09-12T18:37:20.610 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7310000000000002e-06 2024-09-12T18:37:20.610 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.610 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.611 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:20.611 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171769+0000", 2024-09-12T18:37:20.611 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.079e-06 2024-09-12T18:37:20.611 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.611 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.611 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:20.611 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171774+0000", 2024-09-12T18:37:20.611 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.48e-06 2024-09-12T18:37:20.611 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.611 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.611 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:20.611 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171819+0000", 2024-09-12T18:37:20.611 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4391999999999998e-05 2024-09-12T18:37:20.612 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.612 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.612 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:20.612 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171841+0000", 2024-09-12T18:37:20.612 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2245000000000001e-05 2024-09-12T18:37:20.612 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.612 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.612 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:20.612 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236750+0000", 2024-09-12T18:37:20.612 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064909123999999999 2024-09-12T18:37:20.612 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.612 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.613 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:20.613 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236819+0000", 2024-09-12T18:37:20.613 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8860000000000001e-05 2024-09-12T18:37:20.613 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.613 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:20.613 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.613 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.613 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.613 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167361 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:20.613 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:20.613 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 17.305401427, 2024-09-12T18:37:20.613 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.063049426000000006, 2024-09-12T18:37:20.613 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:20.613 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:20.614 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:20.614 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:20.614 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.614 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:20.614 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:20.614 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.614 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.614 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.614 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:20.614 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:20.614 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.614 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.615 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.615 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:20.615 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:20.615 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.9099999999999999e-07 2024-09-12T18:37:20.615 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.615 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.615 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:20.615 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171820+0000", 2024-09-12T18:37:20.615 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.5900000000000002e-06 2024-09-12T18:37:20.615 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.615 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.615 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:20.616 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171826+0000", 2024-09-12T18:37:20.616 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.64e-06 2024-09-12T18:37:20.616 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.616 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.616 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:20.616 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171831+0000", 2024-09-12T18:37:20.616 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.578e-06 2024-09-12T18:37:20.616 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.616 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.616 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:20.616 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234808+0000", 2024-09-12T18:37:20.616 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062976780999999996 2024-09-12T18:37:20.616 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.616 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.617 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:20.617 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234821+0000", 2024-09-12T18:37:20.617 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3002e-05 2024-09-12T18:37:20.617 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.617 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.617 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:20.617 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234866+0000", 2024-09-12T18:37:20.617 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5444000000000001e-05 2024-09-12T18:37:20.617 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.617 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:20.617 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.617 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.617 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.618 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167366 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:20.618 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.172133+0000", 2024-09-12T18:37:20.618 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 17.305084599000001, 2024-09-12T18:37:20.618 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062815840999999997, 2024-09-12T18:37:20.618 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:20.618 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:20.618 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:20.618 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:20.618 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.618 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:20.618 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172133+0000", 2024-09-12T18:37:20.618 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.618 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.618 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.619 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:20.619 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172133+0000", 2024-09-12T18:37:20.619 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.619 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.619 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.619 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:20.619 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172134+0000", 2024-09-12T18:37:20.619 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5000000000000003e-07 2024-09-12T18:37:20.619 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.619 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.619 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:20.620 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172137+0000", 2024-09-12T18:37:20.620 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.6460000000000002e-06 2024-09-12T18:37:20.620 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.620 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.620 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:20.620 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234511+0000", 2024-09-12T18:37:20.620 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062374603000000001 2024-09-12T18:37:20.620 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.620 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.620 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:20.620 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234525+0000", 2024-09-12T18:37:20.620 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3396e-05 2024-09-12T18:37:20.620 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.620 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.621 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:20.621 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234909+0000", 2024-09-12T18:37:20.621 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00038405299999999998 2024-09-12T18:37:20.621 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.621 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.621 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:20.621 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234922+0000", 2024-09-12T18:37:20.621 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3274e-05 2024-09-12T18:37:20.621 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.621 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.621 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:20.622 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234949+0000", 2024-09-12T18:37:20.622 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7319000000000001e-05 2024-09-12T18:37:20.622 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.622 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:20.622 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.622 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.622 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.623 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167369 5.7 e58/21 5:e64ecabd:::benchmark_data_smithi073_23739_object35092:head v 58'10505, mlcod=58'10502)", 2024-09-12T18:37:20.623 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:20.623 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 17.303554207000001, 2024-09-12T18:37:20.623 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.063873773999999994, 2024-09-12T18:37:20.623 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:20.623 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:20.624 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:20.624 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:20.624 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.624 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:20.624 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:20.625 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.625 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.625 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.625 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:20.625 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:20.625 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:20.626 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.626 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.626 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:20.626 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:20.626 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3500000000000002e-07 2024-09-12T18:37:20.626 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.626 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.626 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:20.627 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173668+0000", 2024-09-12T18:37:20.627 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4000000000000001e-06 2024-09-12T18:37:20.627 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.627 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.627 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:20.627 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234583+0000", 2024-09-12T18:37:20.627 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.060914889 2024-09-12T18:37:20.627 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.628 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.628 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:20.628 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234600+0000", 2024-09-12T18:37:20.628 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7192000000000001e-05 2024-09-12T18:37:20.628 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.628 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.628 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:20.629 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234791+0000", 2024-09-12T18:37:20.629 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00019115000000000001 2024-09-12T18:37:20.629 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.629 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.629 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:20.629 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234834+0000", 2024-09-12T18:37:20.629 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3296e-05 2024-09-12T18:37:20.629 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.629 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.629 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:20.630 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.237481+0000", 2024-09-12T18:37:20.630 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0026472050000000001 2024-09-12T18:37:20.630 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:20.630 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:20.630 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:20.630 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.237538+0000", 2024-09-12T18:37:20.630 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6206999999999999e-05 2024-09-12T18:37:20.630 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.630 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:20.630 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.630 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:20.631 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:20.631 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:20.632 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T18:37:20.633 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:37:20.633 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:20.626+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:20.634 INFO:teuthology.orchestra.run.smithi073.stderr:no valid command found; 10 closest matches: 2024-09-12T18:37:20.634 INFO:teuthology.orchestra.run.smithi073.stderr:0 2024-09-12T18:37:20.634 INFO:teuthology.orchestra.run.smithi073.stderr:1 2024-09-12T18:37:20.634 INFO:teuthology.orchestra.run.smithi073.stderr:2 2024-09-12T18:37:20.634 INFO:teuthology.orchestra.run.smithi073.stderr:abort 2024-09-12T18:37:20.634 INFO:teuthology.orchestra.run.smithi073.stderr:assert 2024-09-12T18:37:20.634 INFO:teuthology.orchestra.run.smithi073.stderr:bench [] [] [] [] 2024-09-12T18:37:20.634 INFO:teuthology.orchestra.run.smithi073.stderr:bluefs debug_inject_read_zeros 2024-09-12T18:37:20.634 INFO:teuthology.orchestra.run.smithi073.stderr:bluefs files list 2024-09-12T18:37:20.634 INFO:teuthology.orchestra.run.smithi073.stderr:bluefs stats 2024-09-12T18:37:20.634 INFO:teuthology.orchestra.run.smithi073.stderr:bluestore allocator dump block 2024-09-12T18:37:20.634 INFO:teuthology.orchestra.run.smithi073.stderr:Error EINVAL: invalid command 2024-09-12T18:37:20.635 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-12T18:37:20.635 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-12T18:37:20.732 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:20.726+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:20.788 INFO:teuthology.orchestra.run.smithi073.stderr:no valid command found; 10 closest matches: 2024-09-12T18:37:20.788 INFO:teuthology.orchestra.run.smithi073.stderr:0 2024-09-12T18:37:20.788 INFO:teuthology.orchestra.run.smithi073.stderr:1 2024-09-12T18:37:20.789 INFO:teuthology.orchestra.run.smithi073.stderr:2 2024-09-12T18:37:20.789 INFO:teuthology.orchestra.run.smithi073.stderr:abort 2024-09-12T18:37:20.789 INFO:teuthology.orchestra.run.smithi073.stderr:assert 2024-09-12T18:37:20.789 INFO:teuthology.orchestra.run.smithi073.stderr:bench [] [] [] [] 2024-09-12T18:37:20.789 INFO:teuthology.orchestra.run.smithi073.stderr:bluefs debug_inject_read_zeros 2024-09-12T18:37:20.789 INFO:teuthology.orchestra.run.smithi073.stderr:bluefs files list 2024-09-12T18:37:20.789 INFO:teuthology.orchestra.run.smithi073.stderr:bluefs stats 2024-09-12T18:37:20.789 INFO:teuthology.orchestra.run.smithi073.stderr:bluestore allocator dump block 2024-09-12T18:37:20.789 INFO:teuthology.orchestra.run.smithi073.stderr:Error EINVAL: invalid command 2024-09-12T18:37:20.790 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T18:37:20.791 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-12T18:37:20.799 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:20.799 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:37:20.799 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:20.799 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:202134 5.a e67/21 5:5744023a:::benchmark_data_smithi073_23739_object69857:head v 67'12842, mlcod=67'12839)", 2024-09-12T18:37:20.800 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.797277+0000", 2024-09-12T18:37:20.800 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00016964599999999999, 2024-09-12T18:37:20.800 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00018421, 2024-09-12T18:37:20.800 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:20.800 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:20.800 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:37:20.800 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:20.800 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:20.800 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:20.800 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.797277+0000", 2024-09-12T18:37:20.800 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:20.800 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:20.800 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:20.801 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:20.801 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.797277+0000", 2024-09-12T18:37:20.801 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:20.801 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:20.801 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:20.801 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:20.801 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.797277+0000", 2024-09-12T18:37:20.801 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6100000000000001e-07 2024-09-12T18:37:20.801 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:20.801 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:20.801 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:20.801 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.797281+0000", 2024-09-12T18:37:20.801 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8720000000000004e-06 2024-09-12T18:37:20.802 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:20.802 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:20.802 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:20.802 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.797288+0000", 2024-09-12T18:37:20.803 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.3049999999999998e-06 2024-09-12T18:37:20.803 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:20.803 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:20.803 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:20.803 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.797292+0000", 2024-09-12T18:37:20.803 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.929e-06 2024-09-12T18:37:20.803 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:20.803 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:20.803 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:20.803 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.797329+0000", 2024-09-12T18:37:20.803 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7048999999999997e-05 2024-09-12T18:37:20.803 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:20.803 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:20.804 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:20.804 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.797341+0000", 2024-09-12T18:37:20.804 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2746e-05 2024-09-12T18:37:20.804 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:20.804 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:20.804 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:20.804 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:20.804 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:20.804 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:202125 5.4 5:2b5eb110:::benchmark_data_smithi073_23739_object69848:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:20.804 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.793342+0000", 2024-09-12T18:37:20.804 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0041042309999999999, 2024-09-12T18:37:20.804 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0041548990000000001, 2024-09-12T18:37:20.804 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:20.805 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:20.805 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:20.805 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:20.805 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:20.805 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:20.805 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 202125 2024-09-12T18:37:20.805 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:20.805 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:20.805 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:20.805 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:20.805 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.793342+0000", 2024-09-12T18:37:20.805 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:20.806 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:20.806 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:20.806 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:20.806 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.793342+0000", 2024-09-12T18:37:20.806 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:20.806 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:20.806 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:20.806 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:20.806 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.793344+0000", 2024-09-12T18:37:20.806 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2240000000000001e-06 2024-09-12T18:37:20.806 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:20.806 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:20.806 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:20.807 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.793348+0000", 2024-09-12T18:37:20.807 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6399999999999996e-06 2024-09-12T18:37:20.807 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:20.807 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:20.807 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:20.807 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.793360+0000", 2024-09-12T18:37:20.807 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1953999999999999e-05 2024-09-12T18:37:20.807 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:20.807 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:20.807 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:20.807 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.793367+0000", 2024-09-12T18:37:20.807 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6510000000000004e-06 2024-09-12T18:37:20.807 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:20.807 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:20.808 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:20.808 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.793424+0000", 2024-09-12T18:37:20.808 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7195999999999999e-05 2024-09-12T18:37:20.808 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:20.808 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:20.808 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:20.808 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.793527+0000", 2024-09-12T18:37:20.808 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000103223 2024-09-12T18:37:20.808 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:20.808 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:20.808 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:20.808 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.793600+0000", 2024-09-12T18:37:20.808 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3119000000000002e-05 2024-09-12T18:37:20.809 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:20.809 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:20.809 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:20.809 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.795934+0000", 2024-09-12T18:37:20.809 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0023336160000000002 2024-09-12T18:37:20.809 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:20.809 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:20.809 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:20.809 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:20.809 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:20.809 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:202128 5.d 5:b9bf5216:::benchmark_data_smithi073_23739_object69851:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:20.809 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.793600+0000", 2024-09-12T18:37:20.810 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0038461150000000002, 2024-09-12T18:37:20.810 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0039395690000000004, 2024-09-12T18:37:20.810 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:20.810 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:20.810 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:20.810 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:20.810 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:20.810 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:20.810 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 202128 2024-09-12T18:37:20.810 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:20.810 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:20.810 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:20.810 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:20.811 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.793600+0000", 2024-09-12T18:37:20.811 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:20.811 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:20.811 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:20.811 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:20.811 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.793600+0000", 2024-09-12T18:37:20.811 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:20.811 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:20.811 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:20.811 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:20.811 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.793601+0000", 2024-09-12T18:37:20.811 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2900000000000002e-07 2024-09-12T18:37:20.811 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:20.811 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:20.812 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:20.812 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.793609+0000", 2024-09-12T18:37:20.812 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5299999999999999e-06 2024-09-12T18:37:20.812 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:20.812 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:20.812 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:20.812 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.793619+0000", 2024-09-12T18:37:20.812 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.764e-06 2024-09-12T18:37:20.812 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:20.812 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:20.812 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:20.812 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.793626+0000", 2024-09-12T18:37:20.812 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5000000000000002e-06 2024-09-12T18:37:20.813 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:20.813 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:20.813 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:20.813 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.793678+0000", 2024-09-12T18:37:20.813 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1793999999999999e-05 2024-09-12T18:37:20.813 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:20.813 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:20.813 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:20.813 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.793792+0000", 2024-09-12T18:37:20.813 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000113881 2024-09-12T18:37:20.813 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:20.813 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:20.813 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:20.813 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.793891+0000", 2024-09-12T18:37:20.814 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9566000000000002e-05 2024-09-12T18:37:20.814 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:20.814 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:20.814 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:20.814 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.796001+0000", 2024-09-12T18:37:20.814 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0021097809999999998 2024-09-12T18:37:20.814 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:20.814 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:20.814 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:20.814 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:20.814 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-09-12T18:37:20.814 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 3 2024-09-12T18:37:20.814 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:20.819 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:37:20.833 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:20.826+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:20.933 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:20.924+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:20.963 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:37:20.977 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:20.977 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-09-12T18:37:20.977 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-09-12T18:37:20.977 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-09-12T18:37:20.977 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:20.997 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:37:21.035 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:21.026+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:21.124 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:37:21.125 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:37:21.136 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:21.130+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:21.143 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:37:21.143 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:37:21.161 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:37:21.161 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:37:21.186 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:21.186 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:21.210 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:37:21.237 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:21.230+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:21.339 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:21.330+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:21.356 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:21.357 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:21.377 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:37:21.441 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:21.434+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:21.474 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is set 2024-09-12T18:37:21.527 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:21.527 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:21.542 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:21.536+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:21.546 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:37:21.643 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:21.638+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:21.737 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:21.737 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:21.744 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:21.736+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:21.757 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:37:21.845 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:21.838+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:21.912 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:21.912 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:21.932 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:37:21.947 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:21.942+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:22.047 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:22.040+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:22.126 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:22.127 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:22.148 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:37:22.149 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:22.142+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:22.249 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:22.240+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:22.302 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:22.302 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:22.322 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:37:22.350 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:22.346+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:22.451 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:22.446+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:22.478 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:22.479 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:22.497 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:37:22.554 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:22.546+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:22.653 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:22.646+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:22.658 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:22.658 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:22.676 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:37:22.754 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:22.746+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:22.825 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:22.826 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:22.846 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:37:22.896 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:22.890+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:22.956 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:22.950+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:23.008 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:23.009 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:23.031 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:37:23.057 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:23.048+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:23.158 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:23.154+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:23.178 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:37:23.247 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:23.247 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:23.258 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:23.252+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:23.269 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:37:23.337 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:37:23.337 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:37:23.355 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:37:23.356 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:37:23.359 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:23.350+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:23.374 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:37:23.375 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:37:23.459 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:23.454+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:23.474 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:23.474 INFO:teuthology.orchestra.run.smithi162.stdout: "size": 20, 2024-09-12T18:37:23.474 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 600, 2024-09-12T18:37:23.475 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:37:23.475 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.475 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167364 5.7 5:ee50096a:::benchmark_data_smithi073_23739_object35087:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:23.475 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.168715+0000", 2024-09-12T18:37:23.475 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 20.302315910000001, 2024-09-12T18:37:23.475 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.068831153000000006, 2024-09-12T18:37:23.475 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:23.475 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:23.475 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:23.475 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:23.475 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:23.475 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:23.475 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167364 2024-09-12T18:37:23.476 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.476 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:23.476 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.476 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:23.476 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168715+0000", 2024-09-12T18:37:23.476 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:23.476 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.476 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.476 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:23.476 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168715+0000", 2024-09-12T18:37:23.476 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:23.476 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.476 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.477 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:23.477 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168716+0000", 2024-09-12T18:37:23.477 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0559999999999999e-06 2024-09-12T18:37:23.477 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.477 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.477 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:23.477 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168721+0000", 2024-09-12T18:37:23.477 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8019999999999999e-06 2024-09-12T18:37:23.477 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.477 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.477 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:23.477 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168731+0000", 2024-09-12T18:37:23.477 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0315e-05 2024-09-12T18:37:23.477 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.478 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.478 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:23.478 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168738+0000", 2024-09-12T18:37:23.478 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.126e-06 2024-09-12T18:37:23.478 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.478 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.478 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:23.478 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168782+0000", 2024-09-12T18:37:23.478 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.3924000000000002e-05 2024-09-12T18:37:23.478 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.478 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.478 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:23.479 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168913+0000", 2024-09-12T18:37:23.479 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000131154 2024-09-12T18:37:23.479 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.479 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.479 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:23.479 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169026+0000", 2024-09-12T18:37:23.479 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011223299999999999 2024-09-12T18:37:23.479 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.479 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.479 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:23.479 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.175404+0000", 2024-09-12T18:37:23.479 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0063780319999999996 2024-09-12T18:37:23.479 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.480 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.480 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:23.480 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237446+0000", 2024-09-12T18:37:23.480 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.062042238 2024-09-12T18:37:23.480 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.480 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.480 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:23.480 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237501+0000", 2024-09-12T18:37:23.480 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4913000000000001e-05 2024-09-12T18:37:23.480 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.480 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.480 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:23.480 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237546+0000", 2024-09-12T18:37:23.481 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.5359999999999999e-05 2024-09-12T18:37:23.481 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:23.481 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:23.481 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:23.481 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.481 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.481 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167365 5.2 5:4107875c:::benchmark_data_smithi073_23739_object35088:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:23.481 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:23.481 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 20.302266335999999, 2024-09-12T18:37:23.481 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.078544438999999994, 2024-09-12T18:37:23.481 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:23.481 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:23.481 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:23.482 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:23.482 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:23.482 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:23.482 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167365 2024-09-12T18:37:23.482 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.482 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:23.482 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.482 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:23.482 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:23.482 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:23.482 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.482 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.482 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:23.483 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:23.483 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:23.483 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.483 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.483 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:23.483 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:23.483 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.4700000000000001e-07 2024-09-12T18:37:23.483 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.483 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.483 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:23.483 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168769+0000", 2024-09-12T18:37:23.483 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.4170000000000001e-06 2024-09-12T18:37:23.484 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.484 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.484 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:23.484 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168777+0000", 2024-09-12T18:37:23.484 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1499999999999999e-06 2024-09-12T18:37:23.484 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.484 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.484 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:23.484 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168783+0000", 2024-09-12T18:37:23.484 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.0460000000000002e-06 2024-09-12T18:37:23.484 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.484 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.485 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:23.485 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168865+0000", 2024-09-12T18:37:23.485 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1953999999999995e-05 2024-09-12T18:37:23.485 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.485 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.485 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:23.485 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169003+0000", 2024-09-12T18:37:23.485 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013798200000000001 2024-09-12T18:37:23.485 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.485 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.485 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:23.485 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169065+0000", 2024-09-12T18:37:23.485 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2218000000000006e-05 2024-09-12T18:37:23.485 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.486 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.486 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:23.486 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174771+0000", 2024-09-12T18:37:23.486 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0057054819999999996 2024-09-12T18:37:23.486 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.486 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.486 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:23.486 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.247234+0000", 2024-09-12T18:37:23.486 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.072463391000000002 2024-09-12T18:37:23.486 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.486 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.486 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:23.486 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.247273+0000", 2024-09-12T18:37:23.486 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.9069000000000002e-05 2024-09-12T18:37:23.487 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.487 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.487 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:23.487 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.247309+0000", 2024-09-12T18:37:23.487 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5982999999999998e-05 2024-09-12T18:37:23.487 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:23.487 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:23.487 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:23.487 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.487 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.487 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167369 5.7 5:e64ecabd:::benchmark_data_smithi073_23739_object35092:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:23.487 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.169042+0000", 2024-09-12T18:37:23.488 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 20.301989225, 2024-09-12T18:37:23.488 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.069229188999999997, 2024-09-12T18:37:23.488 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:23.488 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:23.488 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:23.488 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:23.488 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:23.488 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:23.488 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167369 2024-09-12T18:37:23.488 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.488 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:23.488 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.488 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:23.488 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169042+0000", 2024-09-12T18:37:23.489 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:23.489 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.489 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.489 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:23.489 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169042+0000", 2024-09-12T18:37:23.489 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:23.489 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.489 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.489 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:23.489 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169043+0000", 2024-09-12T18:37:23.489 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.9400000000000004e-07 2024-09-12T18:37:23.489 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.489 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.489 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:23.490 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169048+0000", 2024-09-12T18:37:23.490 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8420000000000004e-06 2024-09-12T18:37:23.490 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.490 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.490 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:23.490 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169055+0000", 2024-09-12T18:37:23.490 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.7989999999999994e-06 2024-09-12T18:37:23.490 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.490 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.490 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:23.490 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169062+0000", 2024-09-12T18:37:23.490 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.5950000000000004e-06 2024-09-12T18:37:23.490 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.491 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.491 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:23.491 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173858+0000", 2024-09-12T18:37:23.491 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0047959259999999998 2024-09-12T18:37:23.491 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.491 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.491 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:23.491 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173966+0000", 2024-09-12T18:37:23.491 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000107941 2024-09-12T18:37:23.491 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.491 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.491 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:23.491 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174043+0000", 2024-09-12T18:37:23.491 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.7360000000000005e-05 2024-09-12T18:37:23.492 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.492 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.492 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:23.492 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.175711+0000", 2024-09-12T18:37:23.492 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0016680810000000001 2024-09-12T18:37:23.492 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.492 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.492 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:23.492 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.238163+0000", 2024-09-12T18:37:23.492 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.062451523000000002 2024-09-12T18:37:23.493 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.493 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.493 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:23.493 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.238222+0000", 2024-09-12T18:37:23.493 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9723999999999999e-05 2024-09-12T18:37:23.493 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.493 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.493 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:23.493 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.238271+0000", 2024-09-12T18:37:23.493 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8504000000000002e-05 2024-09-12T18:37:23.493 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:23.493 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:23.493 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:23.494 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.494 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.494 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167373 5.5 5:ad283029:::benchmark_data_smithi073_23739_object35096:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:23.494 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:23.494 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 20.299484394, 2024-09-12T18:37:23.494 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.066200976999999994, 2024-09-12T18:37:23.494 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:23.494 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:23.494 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:23.494 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:23.494 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:23.494 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:23.494 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167373 2024-09-12T18:37:23.495 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.495 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:23.495 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.495 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:23.495 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:23.495 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:23.495 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.495 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.495 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:23.495 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:23.495 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:23.495 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.495 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.496 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:23.496 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:23.496 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4900000000000005e-07 2024-09-12T18:37:23.496 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.496 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.496 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:23.496 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171551+0000", 2024-09-12T18:37:23.496 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.7519999999999998e-06 2024-09-12T18:37:23.496 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.496 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.496 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:23.496 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171562+0000", 2024-09-12T18:37:23.496 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0353000000000001e-05 2024-09-12T18:37:23.497 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.497 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.497 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:23.497 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171566+0000", 2024-09-12T18:37:23.497 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8269999999999997e-06 2024-09-12T18:37:23.497 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.497 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.497 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:23.497 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171622+0000", 2024-09-12T18:37:23.497 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5220999999999999e-05 2024-09-12T18:37:23.497 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.497 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.497 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:23.498 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171719+0000", 2024-09-12T18:37:23.498 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7238999999999995e-05 2024-09-12T18:37:23.498 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.498 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.498 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:23.498 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171802+0000", 2024-09-12T18:37:23.498 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.3285e-05 2024-09-12T18:37:23.498 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.498 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.498 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:23.498 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174608+0000", 2024-09-12T18:37:23.498 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028054590000000002 2024-09-12T18:37:23.498 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.498 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.499 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:23.499 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174762+0000", 2024-09-12T18:37:23.499 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015465100000000001 2024-09-12T18:37:23.499 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.499 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.499 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:23.499 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237474+0000", 2024-09-12T18:37:23.499 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.062711683000000004 2024-09-12T18:37:23.499 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.499 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.499 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:23.499 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237540+0000", 2024-09-12T18:37:23.499 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.6132999999999999e-05 2024-09-12T18:37:23.499 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.500 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.500 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:23.500 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237748+0000", 2024-09-12T18:37:23.500 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020752499999999999 2024-09-12T18:37:23.500 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:23.500 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:23.500 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:23.500 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.500 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.500 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167374 5.1 5:81e25826:::benchmark_data_smithi073_23739_object35097:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:23.500 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.173748+0000", 2024-09-12T18:37:23.500 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 20.297282945999999, 2024-09-12T18:37:23.500 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.069225245000000005, 2024-09-12T18:37:23.501 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:23.501 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:23.501 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:23.501 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:23.501 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:23.501 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:23.501 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167374 2024-09-12T18:37:23.501 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.501 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:23.501 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.501 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:23.501 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173748+0000", 2024-09-12T18:37:23.501 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:23.501 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.502 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.502 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:23.502 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173748+0000", 2024-09-12T18:37:23.502 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:23.502 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.502 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.502 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:23.502 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173749+0000", 2024-09-12T18:37:23.502 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.418e-06 2024-09-12T18:37:23.502 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.502 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.502 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:23.502 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173755+0000", 2024-09-12T18:37:23.502 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.0730000000000004e-06 2024-09-12T18:37:23.503 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.503 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.503 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:23.503 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173768+0000", 2024-09-12T18:37:23.503 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3644e-05 2024-09-12T18:37:23.503 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.503 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.503 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:23.503 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173777+0000", 2024-09-12T18:37:23.503 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4160000000000004e-06 2024-09-12T18:37:23.503 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.503 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.503 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:23.503 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173927+0000", 2024-09-12T18:37:23.504 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015065900000000001 2024-09-12T18:37:23.504 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.504 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.504 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:23.504 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174052+0000", 2024-09-12T18:37:23.504 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012460699999999999 2024-09-12T18:37:23.504 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.504 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.504 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:23.504 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174181+0000", 2024-09-12T18:37:23.504 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012919299999999999 2024-09-12T18:37:23.504 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.505 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.505 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:23.505 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.178108+0000", 2024-09-12T18:37:23.505 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0039273210000000001 2024-09-12T18:37:23.505 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.505 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.505 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:23.505 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.178118+0000", 2024-09-12T18:37:23.505 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7550000000000006e-06 2024-09-12T18:37:23.505 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.505 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.505 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:23.505 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.242865+0000", 2024-09-12T18:37:23.505 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.064746597000000003 2024-09-12T18:37:23.506 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.506 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.506 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:23.506 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.242903+0000", 2024-09-12T18:37:23.506 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.8268e-05 2024-09-12T18:37:23.506 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.506 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.506 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:23.506 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.242973+0000", 2024-09-12T18:37:23.506 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0294000000000002e-05 2024-09-12T18:37:23.506 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:23.506 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:23.506 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:23.506 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.507 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.507 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167375 5.1 5:83a09102:::benchmark_data_smithi073_23739_object35098:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:23.507 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:23.507 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 20.297231399000001, 2024-09-12T18:37:23.507 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.069437463000000005, 2024-09-12T18:37:23.507 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:23.507 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:23.507 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:23.507 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:23.507 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:23.507 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:23.507 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167375 2024-09-12T18:37:23.507 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.507 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:23.507 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.508 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:23.508 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:23.508 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:23.508 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.508 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.508 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:23.508 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:23.508 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:23.508 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.508 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.508 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:23.508 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:23.509 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1399999999999997e-07 2024-09-12T18:37:23.509 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.509 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.509 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:23.509 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173803+0000", 2024-09-12T18:37:23.509 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.7860000000000001e-06 2024-09-12T18:37:23.509 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.509 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.509 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:23.509 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173811+0000", 2024-09-12T18:37:23.509 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4610000000000008e-06 2024-09-12T18:37:23.509 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.509 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.510 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:23.510 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173817+0000", 2024-09-12T18:37:23.510 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3569999999999997e-06 2024-09-12T18:37:23.510 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.510 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.510 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:23.510 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.176070+0000", 2024-09-12T18:37:23.510 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.002253405 2024-09-12T18:37:23.510 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.510 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.510 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:23.510 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.176263+0000", 2024-09-12T18:37:23.510 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000192583 2024-09-12T18:37:23.510 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.511 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.511 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:23.511 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.176429+0000", 2024-09-12T18:37:23.511 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00016626 2024-09-12T18:37:23.511 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.511 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.511 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:23.511 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.178154+0000", 2024-09-12T18:37:23.511 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0017247009999999999 2024-09-12T18:37:23.511 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.511 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.511 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:23.511 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.182110+0000", 2024-09-12T18:37:23.511 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0039568229999999999 2024-09-12T18:37:23.511 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.512 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.512 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:23.512 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.243024+0000", 2024-09-12T18:37:23.512 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.060913249000000003 2024-09-12T18:37:23.512 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.512 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.512 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:23.512 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.243107+0000", 2024-09-12T18:37:23.512 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.3090000000000006e-05 2024-09-12T18:37:23.512 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.512 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.512 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:23.512 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.243237+0000", 2024-09-12T18:37:23.513 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013023399999999999 2024-09-12T18:37:23.513 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:23.513 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:23.513 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:23.513 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.513 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.513 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201515 5.5 5:a25bd8bb:::benchmark_data_smithi073_23739_object69238:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:23.513 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.437024+0000", 2024-09-12T18:37:23.513 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 3.0340071669999999, 2024-09-12T18:37:23.513 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.040476102, 2024-09-12T18:37:23.514 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:23.514 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:23.514 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:23.514 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:23.514 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:23.514 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:23.514 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201515 2024-09-12T18:37:23.514 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.514 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:23.514 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.514 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:23.514 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437024+0000", 2024-09-12T18:37:23.514 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:23.514 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.515 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.515 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:23.515 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437024+0000", 2024-09-12T18:37:23.515 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:23.515 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.515 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.515 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:23.515 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437025+0000", 2024-09-12T18:37:23.515 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2240000000000001e-06 2024-09-12T18:37:23.515 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.515 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.515 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:23.515 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437030+0000", 2024-09-12T18:37:23.516 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.7049999999999998e-06 2024-09-12T18:37:23.516 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.516 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.516 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:23.516 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437040+0000", 2024-09-12T18:37:23.516 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0351e-05 2024-09-12T18:37:23.516 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.516 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.516 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:23.516 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437049+0000", 2024-09-12T18:37:23.516 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5750000000000001e-06 2024-09-12T18:37:23.516 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.517 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.517 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:23.517 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437574+0000", 2024-09-12T18:37:23.517 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00052566400000000001 2024-09-12T18:37:23.517 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.517 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.517 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:23.517 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437673+0000", 2024-09-12T18:37:23.517 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.8672000000000007e-05 2024-09-12T18:37:23.517 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.517 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.517 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:23.517 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437755+0000", 2024-09-12T18:37:23.517 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1705000000000005e-05 2024-09-12T18:37:23.518 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.518 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.518 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:23.518 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.439556+0000", 2024-09-12T18:37:23.518 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0018009020000000001 2024-09-12T18:37:23.518 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.518 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.518 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:23.518 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.439955+0000", 2024-09-12T18:37:23.518 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00039966900000000001 2024-09-12T18:37:23.518 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.518 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.518 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:23.519 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.477267+0000", 2024-09-12T18:37:23.519 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.037311614 2024-09-12T18:37:23.519 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.519 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.519 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:23.519 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.477368+0000", 2024-09-12T18:37:23.519 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000101495 2024-09-12T18:37:23.519 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.519 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.519 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:23.519 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.477500+0000", 2024-09-12T18:37:23.519 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000131526 2024-09-12T18:37:23.519 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:23.520 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:23.520 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:23.520 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.520 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.520 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201566 5.9 5:9ea8bdd3:::benchmark_data_smithi073_23739_object69289:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:23.520 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.487311+0000", 2024-09-12T18:37:23.520 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 2.98371962, 2024-09-12T18:37:23.520 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.044734547, 2024-09-12T18:37:23.520 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:23.520 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:23.520 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:23.520 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:23.521 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:23.521 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:23.521 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201566 2024-09-12T18:37:23.521 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.521 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:23.521 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.521 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:23.521 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487311+0000", 2024-09-12T18:37:23.521 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:23.521 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.521 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.521 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:23.522 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487311+0000", 2024-09-12T18:37:23.522 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:23.522 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.522 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.522 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:23.522 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487313+0000", 2024-09-12T18:37:23.522 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3060000000000001e-06 2024-09-12T18:37:23.522 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.522 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.522 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:23.522 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487318+0000", 2024-09-12T18:37:23.522 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.181e-06 2024-09-12T18:37:23.522 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.523 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.523 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:23.523 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487333+0000", 2024-09-12T18:37:23.523 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5012e-05 2024-09-12T18:37:23.523 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.523 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.523 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:23.523 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487344+0000", 2024-09-12T18:37:23.523 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0733999999999999e-05 2024-09-12T18:37:23.523 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.523 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.523 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:23.523 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487403+0000", 2024-09-12T18:37:23.524 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9858999999999997e-05 2024-09-12T18:37:23.524 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.524 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.524 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:23.524 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487600+0000", 2024-09-12T18:37:23.524 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019617899999999999 2024-09-12T18:37:23.524 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.524 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.524 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:23.524 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487769+0000", 2024-09-12T18:37:23.524 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00016919299999999999 2024-09-12T18:37:23.524 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.524 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.525 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:23.525 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492984+0000", 2024-09-12T18:37:23.525 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0052155309999999998 2024-09-12T18:37:23.525 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.525 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.525 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:23.525 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531791+0000", 2024-09-12T18:37:23.525 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.038806861999999998 2024-09-12T18:37:23.525 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.525 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.525 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:23.525 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531946+0000", 2024-09-12T18:37:23.525 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015445300000000001 2024-09-12T18:37:23.526 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.526 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.526 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:23.526 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532046+0000", 2024-09-12T18:37:23.526 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000100237 2024-09-12T18:37:23.526 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:23.526 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:23.526 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:23.526 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.526 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.526 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201569 5.9 5:9719244e:::benchmark_data_smithi073_23739_object69292:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:23.526 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.487551+0000", 2024-09-12T18:37:23.526 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 2.9834802599999999, 2024-09-12T18:37:23.527 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.045212927, 2024-09-12T18:37:23.527 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:23.527 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:23.527 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:23.527 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:23.527 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:23.527 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:23.527 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201569 2024-09-12T18:37:23.527 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.527 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:23.527 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.527 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:23.528 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487551+0000", 2024-09-12T18:37:23.528 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:23.528 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.528 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.528 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:23.528 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487551+0000", 2024-09-12T18:37:23.528 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:23.528 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.528 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.528 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:23.528 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487552+0000", 2024-09-12T18:37:23.528 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6160000000000001e-06 2024-09-12T18:37:23.528 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.529 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.529 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:23.529 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487566+0000", 2024-09-12T18:37:23.529 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.344e-05 2024-09-12T18:37:23.529 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.529 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.529 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:23.529 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487581+0000", 2024-09-12T18:37:23.529 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5526e-05 2024-09-12T18:37:23.529 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.529 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.529 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:23.529 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487593+0000", 2024-09-12T18:37:23.529 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1443e-05 2024-09-12T18:37:23.529 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.530 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.530 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:23.530 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.489599+0000", 2024-09-12T18:37:23.530 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0020058960000000001 2024-09-12T18:37:23.530 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.530 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.530 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:23.530 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.489710+0000", 2024-09-12T18:37:23.530 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000111634 2024-09-12T18:37:23.530 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.530 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.530 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:23.530 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.489796+0000", 2024-09-12T18:37:23.530 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5235999999999995e-05 2024-09-12T18:37:23.531 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.531 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.531 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:23.531 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532140+0000", 2024-09-12T18:37:23.531 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.042344524000000001 2024-09-12T18:37:23.531 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.531 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.531 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:23.531 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532559+0000", 2024-09-12T18:37:23.531 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00041908800000000002 2024-09-12T18:37:23.531 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.531 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.531 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:23.531 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532676+0000", 2024-09-12T18:37:23.532 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011649100000000001 2024-09-12T18:37:23.532 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.532 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.532 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:23.532 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532764+0000", 2024-09-12T18:37:23.532 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8033000000000002e-05 2024-09-12T18:37:23.532 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:23.532 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:23.532 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:23.532 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.532 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.532 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201570 5.5 5:a97bff67:::benchmark_data_smithi073_23739_object69293:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:23.532 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.487618+0000", 2024-09-12T18:37:23.533 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 2.9834126749999998, 2024-09-12T18:37:23.533 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.049152553000000002, 2024-09-12T18:37:23.533 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:23.533 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:23.533 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:23.533 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:23.533 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:23.533 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:23.533 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201570 2024-09-12T18:37:23.533 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.533 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:23.533 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.533 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:23.533 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487618+0000", 2024-09-12T18:37:23.534 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:23.534 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.534 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.534 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:23.534 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487618+0000", 2024-09-12T18:37:23.534 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:23.534 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.534 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.534 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:23.534 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487619+0000", 2024-09-12T18:37:23.534 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.6099999999999999e-07 2024-09-12T18:37:23.534 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.534 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.535 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:23.535 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487623+0000", 2024-09-12T18:37:23.535 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.0940000000000001e-06 2024-09-12T18:37:23.535 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.535 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.535 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:23.535 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487635+0000", 2024-09-12T18:37:23.535 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1348e-05 2024-09-12T18:37:23.535 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.535 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.535 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:23.535 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487657+0000", 2024-09-12T18:37:23.536 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2246999999999999e-05 2024-09-12T18:37:23.536 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.536 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.536 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:23.536 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490684+0000", 2024-09-12T18:37:23.536 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0030268339999999999 2024-09-12T18:37:23.536 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.536 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.536 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:23.536 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490797+0000", 2024-09-12T18:37:23.536 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011372200000000001 2024-09-12T18:37:23.536 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.536 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.536 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:23.537 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490909+0000", 2024-09-12T18:37:23.537 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000111239 2024-09-12T18:37:23.537 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.537 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.537 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:23.537 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534345+0000", 2024-09-12T18:37:23.537 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.043436648000000001 2024-09-12T18:37:23.537 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.537 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.537 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:23.537 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534711+0000", 2024-09-12T18:37:23.537 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00036576399999999998 2024-09-12T18:37:23.537 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.537 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.538 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:23.538 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536225+0000", 2024-09-12T18:37:23.538 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001513983 2024-09-12T18:37:23.538 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.538 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.538 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:23.538 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536331+0000", 2024-09-12T18:37:23.538 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010603300000000001 2024-09-12T18:37:23.538 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.538 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.538 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:23.538 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536771+0000", 2024-09-12T18:37:23.538 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00043978000000000002 2024-09-12T18:37:23.538 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:23.539 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:23.539 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:23.539 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.539 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.539 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:201572 5.3 e67/21 5:caf692c5:::benchmark_data_smithi073_23739_object69295:head v 67'12362, mlcod=67'12360)", 2024-09-12T18:37:23.539 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.490255+0000", 2024-09-12T18:37:23.539 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 2.9807761749999999, 2024-09-12T18:37:23.539 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.044189501999999999, 2024-09-12T18:37:23.539 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:23.539 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:23.539 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:23.539 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:23.539 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.539 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:23.540 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490255+0000", 2024-09-12T18:37:23.540 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:23.540 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.540 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.540 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:23.540 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490255+0000", 2024-09-12T18:37:23.540 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:23.540 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.540 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.540 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:23.540 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490256+0000", 2024-09-12T18:37:23.540 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0500000000000003e-07 2024-09-12T18:37:23.540 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.541 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.541 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:23.541 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490260+0000", 2024-09-12T18:37:23.541 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8269999999999997e-06 2024-09-12T18:37:23.541 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.541 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.541 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:23.541 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490269+0000", 2024-09-12T18:37:23.541 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.6549999999999993e-06 2024-09-12T18:37:23.541 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.541 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.541 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:23.541 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490275+0000", 2024-09-12T18:37:23.541 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.46e-06 2024-09-12T18:37:23.542 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.542 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.542 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:23.542 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490328+0000", 2024-09-12T18:37:23.542 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2101999999999997e-05 2024-09-12T18:37:23.542 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.542 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.542 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:23.542 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490347+0000", 2024-09-12T18:37:23.542 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9457999999999999e-05 2024-09-12T18:37:23.542 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.542 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.542 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:23.542 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534382+0000", 2024-09-12T18:37:23.542 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.044034968000000001 2024-09-12T18:37:23.542 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.543 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.543 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:23.543 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534444+0000", 2024-09-12T18:37:23.543 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2327000000000001e-05 2024-09-12T18:37:23.543 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:23.543 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:23.543 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:23.543 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.543 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.543 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201574 5.5 5:a963f378:::benchmark_data_smithi073_23739_object69297:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:23.543 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.490449+0000", 2024-09-12T18:37:23.543 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 2.9805821999999997, 2024-09-12T18:37:23.543 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.046749974, 2024-09-12T18:37:23.543 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:23.543 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:23.544 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:23.544 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:23.544 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:23.544 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:23.544 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201574 2024-09-12T18:37:23.544 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.544 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:23.544 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.544 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:23.544 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490449+0000", 2024-09-12T18:37:23.544 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:23.544 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.544 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.544 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:23.545 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490449+0000", 2024-09-12T18:37:23.545 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:23.545 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.545 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.545 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:23.545 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490450+0000", 2024-09-12T18:37:23.545 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.17e-06 2024-09-12T18:37:23.545 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.545 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.545 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:23.545 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490455+0000", 2024-09-12T18:37:23.545 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.7319999999999998e-06 2024-09-12T18:37:23.545 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.545 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.546 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:23.546 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490464+0000", 2024-09-12T18:37:23.546 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.4760000000000004e-06 2024-09-12T18:37:23.546 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.546 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.546 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:23.546 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490471+0000", 2024-09-12T18:37:23.546 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.5400000000000001e-06 2024-09-12T18:37:23.546 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.546 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.546 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:23.546 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492695+0000", 2024-09-12T18:37:23.546 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0022245910000000002 2024-09-12T18:37:23.546 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.547 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.547 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:23.547 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492847+0000", 2024-09-12T18:37:23.547 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015127399999999999 2024-09-12T18:37:23.547 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.547 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.547 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:23.547 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492936+0000", 2024-09-12T18:37:23.547 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8953e-05 2024-09-12T18:37:23.547 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.547 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.547 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:23.547 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534614+0000", 2024-09-12T18:37:23.547 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.041678422999999999 2024-09-12T18:37:23.547 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.548 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.548 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:23.548 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534755+0000", 2024-09-12T18:37:23.548 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000140696 2024-09-12T18:37:23.548 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.548 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.548 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:23.548 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536891+0000", 2024-09-12T18:37:23.548 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0021365799999999999 2024-09-12T18:37:23.548 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.548 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.548 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:23.548 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537001+0000", 2024-09-12T18:37:23.549 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000109459 2024-09-12T18:37:23.549 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.549 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.549 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:23.549 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537199+0000", 2024-09-12T18:37:23.549 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019808 2024-09-12T18:37:23.549 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:23.549 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:23.549 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:23.549 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.549 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.549 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201576 5.2 5:42a132e0:::benchmark_data_smithi073_23739_object69299:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:23.549 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.490661+0000", 2024-09-12T18:37:23.549 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 2.980370153, 2024-09-12T18:37:23.550 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.041905530000000003, 2024-09-12T18:37:23.550 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:23.550 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:23.550 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:23.550 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:23.550 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:23.550 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:23.550 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201576 2024-09-12T18:37:23.550 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.550 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:23.550 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.550 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:23.550 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490661+0000", 2024-09-12T18:37:23.550 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:23.550 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.550 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.551 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:23.551 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490661+0000", 2024-09-12T18:37:23.551 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:23.551 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.551 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.551 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:23.551 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490662+0000", 2024-09-12T18:37:23.551 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5030000000000001e-06 2024-09-12T18:37:23.551 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.551 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.551 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:23.551 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490667+0000", 2024-09-12T18:37:23.551 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4479999999999996e-06 2024-09-12T18:37:23.551 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.552 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.552 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:23.552 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490675+0000", 2024-09-12T18:37:23.552 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8529999999999992e-06 2024-09-12T18:37:23.552 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.552 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.552 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:23.552 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490680+0000", 2024-09-12T18:37:23.552 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1919999999999996e-06 2024-09-12T18:37:23.552 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.552 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.552 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:23.553 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490730+0000", 2024-09-12T18:37:23.553 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.9738999999999999e-05 2024-09-12T18:37:23.553 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.553 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.553 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:23.553 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490833+0000", 2024-09-12T18:37:23.553 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010333 2024-09-12T18:37:23.553 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.553 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.553 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:23.553 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490930+0000", 2024-09-12T18:37:23.553 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7355999999999994e-05 2024-09-12T18:37:23.553 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.553 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.554 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:23.554 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493735+0000", 2024-09-12T18:37:23.554 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028049329999999999 2024-09-12T18:37:23.554 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.554 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.554 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:23.554 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532451+0000", 2024-09-12T18:37:23.554 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.038715554999999999 2024-09-12T18:37:23.554 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.554 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.554 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:23.554 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532514+0000", 2024-09-12T18:37:23.554 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2885000000000005e-05 2024-09-12T18:37:23.554 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.555 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.555 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:23.555 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532566+0000", 2024-09-12T18:37:23.555 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2735999999999998e-05 2024-09-12T18:37:23.555 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:23.555 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:23.555 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:23.555 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.555 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.555 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201577 5.7 5:e93d4852:::benchmark_data_smithi073_23739_object69300:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:23.555 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.490721+0000", 2024-09-12T18:37:23.555 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 2.980310142, 2024-09-12T18:37:23.555 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.042097930999999998, 2024-09-12T18:37:23.556 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:23.556 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:23.556 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:23.556 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:23.556 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:23.556 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:23.556 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201577 2024-09-12T18:37:23.556 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.556 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:23.556 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.556 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:23.556 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490721+0000", 2024-09-12T18:37:23.556 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:23.557 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.557 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.557 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:23.557 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490721+0000", 2024-09-12T18:37:23.557 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:23.557 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.557 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.557 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:23.557 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490721+0000", 2024-09-12T18:37:23.557 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.1900000000000002e-07 2024-09-12T18:37:23.557 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.557 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.557 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:23.557 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490724+0000", 2024-09-12T18:37:23.558 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.6189999999999998e-06 2024-09-12T18:37:23.558 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.558 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.558 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:23.558 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490731+0000", 2024-09-12T18:37:23.558 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0129999999999996e-06 2024-09-12T18:37:23.558 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.558 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.558 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:23.558 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490736+0000", 2024-09-12T18:37:23.558 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6929999999999998e-06 2024-09-12T18:37:23.558 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.558 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.558 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:23.559 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490788+0000", 2024-09-12T18:37:23.559 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2104000000000001e-05 2024-09-12T18:37:23.559 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.559 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.559 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:23.559 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490926+0000", 2024-09-12T18:37:23.559 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013852800000000001 2024-09-12T18:37:23.559 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.559 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.559 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:23.559 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491061+0000", 2024-09-12T18:37:23.559 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013499700000000001 2024-09-12T18:37:23.559 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.560 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.560 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:23.560 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531660+0000", 2024-09-12T18:37:23.560 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.040599046999999999 2024-09-12T18:37:23.560 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.560 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.560 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:23.560 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532630+0000", 2024-09-12T18:37:23.560 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00096974300000000002 2024-09-12T18:37:23.560 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.560 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.560 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:23.560 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532708+0000", 2024-09-12T18:37:23.561 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8108000000000005e-05 2024-09-12T18:37:23.561 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.561 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.561 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:23.561 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532819+0000", 2024-09-12T18:37:23.561 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011046 2024-09-12T18:37:23.561 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:23.561 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:23.561 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:23.561 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.561 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.561 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201578 5.f 5:f19e206c:::benchmark_data_smithi073_23739_object69301:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:23.561 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.491951+0000", 2024-09-12T18:37:23.562 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 2.9790797690000002, 2024-09-12T18:37:23.562 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.043303686000000001, 2024-09-12T18:37:23.562 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:23.562 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:23.562 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:23.562 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:23.562 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:23.562 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:23.562 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201578 2024-09-12T18:37:23.562 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.562 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:23.562 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.562 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:23.563 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491951+0000", 2024-09-12T18:37:23.563 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:23.563 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.563 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.563 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:23.563 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491951+0000", 2024-09-12T18:37:23.563 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:23.563 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.563 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.563 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:23.563 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491952+0000", 2024-09-12T18:37:23.563 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.221e-06 2024-09-12T18:37:23.563 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.564 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.564 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:23.564 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491957+0000", 2024-09-12T18:37:23.564 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.0529999999999997e-06 2024-09-12T18:37:23.564 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.564 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.564 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:23.564 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491970+0000", 2024-09-12T18:37:23.564 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2731000000000001e-05 2024-09-12T18:37:23.564 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.564 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.564 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:23.564 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491977+0000", 2024-09-12T18:37:23.565 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.1380000000000001e-06 2024-09-12T18:37:23.565 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.565 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.565 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:23.565 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492031+0000", 2024-09-12T18:37:23.565 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3857999999999998e-05 2024-09-12T18:37:23.565 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.565 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.565 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:23.565 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492125+0000", 2024-09-12T18:37:23.565 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.3275000000000004e-05 2024-09-12T18:37:23.565 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.565 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.566 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:23.566 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492205+0000", 2024-09-12T18:37:23.566 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.0793999999999999e-05 2024-09-12T18:37:23.566 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.566 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.566 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:23.566 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531712+0000", 2024-09-12T18:37:23.566 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.039506708000000001 2024-09-12T18:37:23.566 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.566 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.566 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:23.566 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535161+0000", 2024-09-12T18:37:23.566 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003448586 2024-09-12T18:37:23.567 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.567 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.567 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:23.567 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535202+0000", 2024-09-12T18:37:23.567 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.0945999999999997e-05 2024-09-12T18:37:23.567 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.567 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.567 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:23.567 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535255+0000", 2024-09-12T18:37:23.567 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3375999999999999e-05 2024-09-12T18:37:23.567 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:23.567 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:23.567 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:23.567 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.568 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.568 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201579 5.5 5:ac64e9fd:::benchmark_data_smithi073_23739_object69302:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:23.568 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.492711+0000", 2024-09-12T18:37:23.568 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 2.9783195980000001, 2024-09-12T18:37:23.568 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.04478994, 2024-09-12T18:37:23.568 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:23.568 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:23.568 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:23.568 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:23.568 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:23.568 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:23.568 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201579 2024-09-12T18:37:23.568 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.569 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:23.569 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.569 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:23.569 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492711+0000", 2024-09-12T18:37:23.569 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:23.569 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.569 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.569 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:23.569 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492711+0000", 2024-09-12T18:37:23.569 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:23.569 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.569 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.569 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:23.569 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492713+0000", 2024-09-12T18:37:23.570 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.105e-06 2024-09-12T18:37:23.570 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.570 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.570 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:23.570 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492720+0000", 2024-09-12T18:37:23.570 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.109e-06 2024-09-12T18:37:23.570 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.570 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.570 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:23.570 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492730+0000", 2024-09-12T18:37:23.570 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.049e-05 2024-09-12T18:37:23.570 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.570 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.570 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:23.571 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492737+0000", 2024-09-12T18:37:23.571 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0960000000000003e-06 2024-09-12T18:37:23.571 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.571 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.571 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:23.571 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.494541+0000", 2024-09-12T18:37:23.571 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0018034139999999999 2024-09-12T18:37:23.571 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.571 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.571 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:23.571 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.494692+0000", 2024-09-12T18:37:23.571 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000150956 2024-09-12T18:37:23.571 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.572 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.572 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:23.572 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.494843+0000", 2024-09-12T18:37:23.572 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000151896 2024-09-12T18:37:23.572 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.572 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.572 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:23.572 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534665+0000", 2024-09-12T18:37:23.572 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.039821829000000003 2024-09-12T18:37:23.572 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.572 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.572 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:23.572 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536866+0000", 2024-09-12T18:37:23.573 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0022007839999999999 2024-09-12T18:37:23.573 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.573 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.573 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:23.573 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537212+0000", 2024-09-12T18:37:23.573 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00034636299999999998 2024-09-12T18:37:23.573 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.573 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.573 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:23.573 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537298+0000", 2024-09-12T18:37:23.573 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5970999999999994e-05 2024-09-12T18:37:23.573 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.573 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.574 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:23.574 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537501+0000", 2024-09-12T18:37:23.574 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020292699999999999 2024-09-12T18:37:23.574 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:23.574 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:23.574 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:23.574 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.574 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.574 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201581 5.7 5:e819369d:::benchmark_data_smithi073_23739_object69304:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:23.574 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.493262+0000", 2024-09-12T18:37:23.574 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 2.977769248, 2024-09-12T18:37:23.574 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.042091362, 2024-09-12T18:37:23.574 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:23.575 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:23.575 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:23.575 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:23.575 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:23.575 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:23.575 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201581 2024-09-12T18:37:23.575 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.575 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:23.575 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.575 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:23.575 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493262+0000", 2024-09-12T18:37:23.575 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:23.576 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.576 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.576 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:23.576 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493262+0000", 2024-09-12T18:37:23.576 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:23.576 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.576 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.576 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:23.576 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493263+0000", 2024-09-12T18:37:23.576 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.6700000000000003e-07 2024-09-12T18:37:23.576 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.576 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.577 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:23.577 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493266+0000", 2024-09-12T18:37:23.577 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.4850000000000001e-06 2024-09-12T18:37:23.577 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.577 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.577 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:23.577 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493273+0000", 2024-09-12T18:37:23.577 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2019999999999998e-06 2024-09-12T18:37:23.577 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.577 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.577 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:23.577 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493278+0000", 2024-09-12T18:37:23.577 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6210000000000003e-06 2024-09-12T18:37:23.577 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.578 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.578 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:23.578 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493330+0000", 2024-09-12T18:37:23.578 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2587000000000003e-05 2024-09-12T18:37:23.578 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.578 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.578 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:23.578 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493469+0000", 2024-09-12T18:37:23.578 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013901199999999999 2024-09-12T18:37:23.578 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.578 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.578 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:23.578 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493612+0000", 2024-09-12T18:37:23.578 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014237599999999999 2024-09-12T18:37:23.579 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.579 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.579 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:23.579 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531835+0000", 2024-09-12T18:37:23.579 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.038222735000000001 2024-09-12T18:37:23.579 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.579 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.579 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:23.579 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535265+0000", 2024-09-12T18:37:23.579 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003430064 2024-09-12T18:37:23.579 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.579 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.580 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:23.580 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535319+0000", 2024-09-12T18:37:23.580 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4375e-05 2024-09-12T18:37:23.580 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.580 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.580 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:23.580 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535353+0000", 2024-09-12T18:37:23.580 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.4137999999999997e-05 2024-09-12T18:37:23.580 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:23.580 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:23.580 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:23.580 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.580 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.581 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:201573 5.3 e67/21 5:cf4becdf:::benchmark_data_smithi073_23739_object69296:head v 67'12363, mlcod=67'12360)", 2024-09-12T18:37:23.581 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.493437+0000", 2024-09-12T18:37:23.581 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 2.977594313, 2024-09-12T18:37:23.581 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.041109664999999997, 2024-09-12T18:37:23.581 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:23.581 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:23.581 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:23.581 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:23.581 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.581 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:23.581 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493437+0000", 2024-09-12T18:37:23.581 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:23.581 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.582 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.582 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:23.582 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493437+0000", 2024-09-12T18:37:23.582 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:23.582 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.582 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.582 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:23.582 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493438+0000", 2024-09-12T18:37:23.582 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.125e-06 2024-09-12T18:37:23.582 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.582 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.582 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:23.582 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493444+0000", 2024-09-12T18:37:23.583 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2269999999999998e-06 2024-09-12T18:37:23.583 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.583 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.583 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:23.583 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493457+0000", 2024-09-12T18:37:23.583 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.312e-05 2024-09-12T18:37:23.583 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.583 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.583 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:23.583 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493466+0000", 2024-09-12T18:37:23.583 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.6309999999999992e-06 2024-09-12T18:37:23.583 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.584 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.584 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:23.584 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493526+0000", 2024-09-12T18:37:23.584 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.0316000000000003e-05 2024-09-12T18:37:23.584 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.584 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.584 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:23.584 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493541+0000", 2024-09-12T18:37:23.584 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4459e-05 2024-09-12T18:37:23.584 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.584 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.584 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:23.584 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534501+0000", 2024-09-12T18:37:23.585 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.040960215000000001 2024-09-12T18:37:23.585 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.585 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.585 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:23.585 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534546+0000", 2024-09-12T18:37:23.585 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.5571999999999997e-05 2024-09-12T18:37:23.585 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:23.585 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:23.585 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:23.585 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.585 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.585 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201582 5.f 5:f90f147f:::benchmark_data_smithi073_23739_object69305:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:23.585 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.493597+0000", 2024-09-12T18:37:23.586 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 2.9774337819999999, 2024-09-12T18:37:23.586 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.045457567999999997, 2024-09-12T18:37:23.586 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:23.586 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:23.586 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:23.586 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:23.586 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:23.586 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:23.586 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201582 2024-09-12T18:37:23.586 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.586 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:23.586 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.586 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:23.587 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493597+0000", 2024-09-12T18:37:23.587 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:23.587 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.587 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.587 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:23.587 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493597+0000", 2024-09-12T18:37:23.587 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:23.587 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.587 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.587 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:23.587 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493598+0000", 2024-09-12T18:37:23.587 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7699999999999992e-07 2024-09-12T18:37:23.587 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.588 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.588 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:23.588 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493609+0000", 2024-09-12T18:37:23.588 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1297e-05 2024-09-12T18:37:23.588 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.588 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.588 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:23.588 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493620+0000", 2024-09-12T18:37:23.588 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0930999999999999e-05 2024-09-12T18:37:23.588 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.588 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.588 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:23.589 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493640+0000", 2024-09-12T18:37:23.589 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.0072e-05 2024-09-12T18:37:23.589 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.589 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.589 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:23.589 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531770+0000", 2024-09-12T18:37:23.589 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.038129652999999999 2024-09-12T18:37:23.589 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.589 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.589 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:23.589 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532046+0000", 2024-09-12T18:37:23.589 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027561600000000001 2024-09-12T18:37:23.589 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.590 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.590 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:23.590 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532337+0000", 2024-09-12T18:37:23.590 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00029169200000000003 2024-09-12T18:37:23.590 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.590 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.590 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:23.590 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536640+0000", 2024-09-12T18:37:23.590 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0043023499999999999 2024-09-12T18:37:23.590 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.590 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.590 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:23.591 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.538943+0000", 2024-09-12T18:37:23.591 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0023032740000000001 2024-09-12T18:37:23.591 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.591 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.591 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:23.591 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.539013+0000", 2024-09-12T18:37:23.591 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9944000000000007e-05 2024-09-12T18:37:23.591 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.591 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.591 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:23.591 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.539055+0000", 2024-09-12T18:37:23.591 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.1761999999999998e-05 2024-09-12T18:37:23.591 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:23.591 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:23.592 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:23.592 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.592 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.592 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:201583 5.d e67/21 5:b91eedec:::benchmark_data_smithi073_23739_object69306:head v 67'12761, mlcod=67'12759)", 2024-09-12T18:37:23.592 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.495034+0000", 2024-09-12T18:37:23.592 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 2.9759974069999999, 2024-09-12T18:37:23.592 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.047966852999999997, 2024-09-12T18:37:23.592 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:23.592 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:23.592 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:23.592 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:23.592 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.592 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:23.593 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.495034+0000", 2024-09-12T18:37:23.593 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:23.593 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.593 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.593 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:23.593 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.495034+0000", 2024-09-12T18:37:23.593 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:23.593 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.593 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.593 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:23.593 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.495035+0000", 2024-09-12T18:37:23.593 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.023e-06 2024-09-12T18:37:23.594 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.594 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.594 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:23.594 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.495040+0000", 2024-09-12T18:37:23.594 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.9300000000000002e-06 2024-09-12T18:37:23.594 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.594 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.594 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:23.594 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531510+0000", 2024-09-12T18:37:23.594 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.036470250000000003 2024-09-12T18:37:23.594 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.594 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.594 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:23.595 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531518+0000", 2024-09-12T18:37:23.595 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8490000000000006e-06 2024-09-12T18:37:23.595 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.595 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.595 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:23.595 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534395+0000", 2024-09-12T18:37:23.595 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.002877246 2024-09-12T18:37:23.595 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.595 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.595 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:23.595 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534418+0000", 2024-09-12T18:37:23.595 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.3119e-05 2024-09-12T18:37:23.595 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.595 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.596 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:23.596 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.542930+0000", 2024-09-12T18:37:23.596 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0085121929999999995 2024-09-12T18:37:23.596 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:23.596 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:23.596 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:23.596 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.543000+0000", 2024-09-12T18:37:23.596 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0242999999999998e-05 2024-09-12T18:37:23.596 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:23.596 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:23.596 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:23.596 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:23.596 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:23.596 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:23.597 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T18:37:23.598 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:23.590+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:23.599 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:37:23.699 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:23.690+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:23.755 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:23.755 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:37:23.755 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.755 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:208570 5.6 5:6ffd3b76:::benchmark_data_smithi073_23739_object76293:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T18:37:23.755 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:23.744505+0000", 2024-09-12T18:37:23.755 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0068787689999999999, 2024-09-12T18:37:23.755 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.006900855, 2024-09-12T18:37:23.755 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:23.755 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:23.755 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:23.756 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:23.756 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:23.756 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:23.756 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 208570 2024-09-12T18:37:23.756 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.756 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:23.756 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.756 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:23.756 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.744505+0000", 2024-09-12T18:37:23.756 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:23.756 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.756 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.756 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:23.757 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.744505+0000", 2024-09-12T18:37:23.757 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:23.757 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.757 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.757 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:23.757 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.744506+0000", 2024-09-12T18:37:23.757 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.6800000000000009e-07 2024-09-12T18:37:23.757 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.757 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.757 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:23.757 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.744510+0000", 2024-09-12T18:37:23.757 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.6770000000000001e-06 2024-09-12T18:37:23.757 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.757 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.758 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:23.758 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.744517+0000", 2024-09-12T18:37:23.758 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.956e-06 2024-09-12T18:37:23.758 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.758 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.758 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:23.758 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.744521+0000", 2024-09-12T18:37:23.758 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5059999999999997e-06 2024-09-12T18:37:23.758 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.758 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.758 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:23.758 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.747908+0000", 2024-09-12T18:37:23.758 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.003386647 2024-09-12T18:37:23.758 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.759 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.759 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:23.759 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.748049+0000", 2024-09-12T18:37:23.759 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014096000000000001 2024-09-12T18:37:23.759 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.759 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.759 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:23.759 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.748168+0000", 2024-09-12T18:37:23.759 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000119084 2024-09-12T18:37:23.759 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:23.759 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:23.759 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:23.759 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.760 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.760 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:208572 5.a 5:5d97ae01:::benchmark_data_smithi073_23739_object76295:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T18:37:23.760 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:23.745227+0000", 2024-09-12T18:37:23.760 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0061566320000000004, 2024-09-12T18:37:23.760 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0062489859999999998, 2024-09-12T18:37:23.760 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:23.760 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:23.760 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:23.760 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:23.760 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:23.760 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:23.760 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 208572 2024-09-12T18:37:23.760 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.761 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:23.761 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.761 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:23.761 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.745227+0000", 2024-09-12T18:37:23.761 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:23.761 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.761 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.761 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:23.761 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.745227+0000", 2024-09-12T18:37:23.761 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:23.761 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.761 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.761 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:23.761 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.745228+0000", 2024-09-12T18:37:23.762 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3700000000000001e-07 2024-09-12T18:37:23.762 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.762 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.762 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:23.762 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.745230+0000", 2024-09-12T18:37:23.762 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.0590000000000001e-06 2024-09-12T18:37:23.762 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.762 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.762 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:23.762 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.745239+0000", 2024-09-12T18:37:23.762 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2059999999999996e-06 2024-09-12T18:37:23.762 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.762 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.762 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:23.763 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.745243+0000", 2024-09-12T18:37:23.763 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.687e-06 2024-09-12T18:37:23.763 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.763 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.763 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:23.763 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.745293+0000", 2024-09-12T18:37:23.763 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0411000000000002e-05 2024-09-12T18:37:23.763 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.763 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.763 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:23.763 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.745420+0000", 2024-09-12T18:37:23.763 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012700400000000001 2024-09-12T18:37:23.763 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.763 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.764 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:23.764 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.745540+0000", 2024-09-12T18:37:23.764 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000119838 2024-09-12T18:37:23.764 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.764 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.764 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:23.764 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.749225+0000", 2024-09-12T18:37:23.764 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0036850339999999998 2024-09-12T18:37:23.764 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:23.764 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:23.764 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:23.764 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.764 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.765 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:208576 5.6 5:651a32e4:::benchmark_data_smithi073_23739_object76299:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T18:37:23.765 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:23.747967+0000", 2024-09-12T18:37:23.765 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0034167889999999999, 2024-09-12T18:37:23.765 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.003574855, 2024-09-12T18:37:23.765 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:23.765 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:23.765 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:23.765 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:23.765 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:23.765 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:23.765 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 208576 2024-09-12T18:37:23.765 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.765 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:23.766 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.766 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:23.766 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.747967+0000", 2024-09-12T18:37:23.766 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:23.766 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.766 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.766 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:23.766 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.747967+0000", 2024-09-12T18:37:23.766 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:23.766 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.766 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.766 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:23.766 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.747968+0000", 2024-09-12T18:37:23.766 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.012e-06 2024-09-12T18:37:23.766 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.767 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.767 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:23.767 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.747972+0000", 2024-09-12T18:37:23.767 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.1289999999999998e-06 2024-09-12T18:37:23.767 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.767 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.767 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:23.767 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.747980+0000", 2024-09-12T18:37:23.767 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.7409999999999992e-06 2024-09-12T18:37:23.767 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.767 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.767 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:23.767 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.747985+0000", 2024-09-12T18:37:23.767 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1399999999999999e-06 2024-09-12T18:37:23.768 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.768 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.768 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:23.768 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.751250+0000", 2024-09-12T18:37:23.768 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0032651989999999999 2024-09-12T18:37:23.768 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.768 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.768 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:23.768 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.751339+0000", 2024-09-12T18:37:23.768 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.8920999999999998e-05 2024-09-12T18:37:23.768 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.768 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.768 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:23.768 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.751404+0000", 2024-09-12T18:37:23.769 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4203999999999997e-05 2024-09-12T18:37:23.769 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:23.769 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:23.769 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:23.769 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.769 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.769 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:208548 5.6 e68/21)", 2024-09-12T18:37:23.769 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:23.748085+0000", 2024-09-12T18:37:23.769 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0032988100000000001, 2024-09-12T18:37:23.769 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0035155160000000002, 2024-09-12T18:37:23.769 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:23.769 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:23.769 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:23.769 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:23.770 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.770 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:23.770 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.748085+0000", 2024-09-12T18:37:23.770 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:23.770 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.770 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.770 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:23.770 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.748085+0000", 2024-09-12T18:37:23.770 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:23.770 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.770 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.770 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:23.770 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.748086+0000", 2024-09-12T18:37:23.770 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7599999999999997e-07 2024-09-12T18:37:23.771 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.771 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.771 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:23.771 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.748089+0000", 2024-09-12T18:37:23.771 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.123e-06 2024-09-12T18:37:23.771 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.771 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.771 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:23.771 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.748095+0000", 2024-09-12T18:37:23.771 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8579999999999996e-06 2024-09-12T18:37:23.771 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.771 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.771 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:23.771 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.748099+0000", 2024-09-12T18:37:23.772 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.1459999999999998e-06 2024-09-12T18:37:23.772 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:23.772 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:23.772 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:23.772 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.772 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.772 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:208557 5.6 e68/21)", 2024-09-12T18:37:23.772 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:23.748278+0000", 2024-09-12T18:37:23.772 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0031058739999999998, 2024-09-12T18:37:23.772 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.003360455, 2024-09-12T18:37:23.772 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:23.772 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:23.772 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:23.772 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:23.773 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.773 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:23.773 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.748278+0000", 2024-09-12T18:37:23.773 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:23.773 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.773 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.773 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:23.773 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.748278+0000", 2024-09-12T18:37:23.773 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:23.773 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.773 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.773 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:23.773 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.748279+0000", 2024-09-12T18:37:23.773 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5299999999999999e-07 2024-09-12T18:37:23.774 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.774 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.774 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:23.774 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.748281+0000", 2024-09-12T18:37:23.774 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.295e-06 2024-09-12T18:37:23.774 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.774 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.774 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:23.774 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.748287+0000", 2024-09-12T18:37:23.774 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5849999999999996e-06 2024-09-12T18:37:23.774 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.774 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.774 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:23.775 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.748292+0000", 2024-09-12T18:37:23.775 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.6890000000000003e-06 2024-09-12T18:37:23.775 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:23.775 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:23.775 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:23.775 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.775 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.775 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:208560 5.6 e68/21)", 2024-09-12T18:37:23.775 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:23.748341+0000", 2024-09-12T18:37:23.775 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0030427850000000001, 2024-09-12T18:37:23.775 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.003333328, 2024-09-12T18:37:23.775 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:23.775 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:23.776 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:23.776 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:23.776 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.776 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:23.776 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.748341+0000", 2024-09-12T18:37:23.776 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:23.776 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.776 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.776 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:23.776 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.748341+0000", 2024-09-12T18:37:23.776 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:23.776 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.776 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.776 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:23.777 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.748342+0000", 2024-09-12T18:37:23.777 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.6199999999999998e-07 2024-09-12T18:37:23.777 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.777 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.777 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:23.777 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.748344+0000", 2024-09-12T18:37:23.777 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.6029999999999999e-06 2024-09-12T18:37:23.777 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.777 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.777 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:23.777 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.748352+0000", 2024-09-12T18:37:23.777 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5340000000000002e-06 2024-09-12T18:37:23.777 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.778 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.778 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:23.778 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.748356+0000", 2024-09-12T18:37:23.778 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5460000000000002e-06 2024-09-12T18:37:23.778 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:23.778 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:23.778 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:23.778 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.778 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.778 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:208548 5.6 5:6b08c837:::benchmark_data_smithi073_23739_object76271:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T18:37:23.778 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:23.735077+0000", 2024-09-12T18:37:23.778 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.016307406999999999, 2024-09-12T18:37:23.778 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.016640874, 2024-09-12T18:37:23.778 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:23.779 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:23.779 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:23.779 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:23.779 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:23.779 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:23.779 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 208548 2024-09-12T18:37:23.779 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.779 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:23.779 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.779 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:23.779 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.735077+0000", 2024-09-12T18:37:23.779 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:23.779 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.779 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.780 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:23.780 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.735077+0000", 2024-09-12T18:37:23.780 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:23.780 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.780 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.780 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:23.780 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.735078+0000", 2024-09-12T18:37:23.780 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.8100000000000001e-07 2024-09-12T18:37:23.780 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.780 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.780 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:23.780 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.735082+0000", 2024-09-12T18:37:23.780 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.1350000000000002e-06 2024-09-12T18:37:23.781 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.781 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.781 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:23.781 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.735092+0000", 2024-09-12T18:37:23.781 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0071999999999999e-05 2024-09-12T18:37:23.781 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.781 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.781 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:23.781 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.735098+0000", 2024-09-12T18:37:23.781 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7100000000000001e-06 2024-09-12T18:37:23.781 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.781 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.781 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:23.782 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.739352+0000", 2024-09-12T18:37:23.782 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0042539850000000001 2024-09-12T18:37:23.782 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.782 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.782 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:23.782 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.739476+0000", 2024-09-12T18:37:23.782 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012379099999999999 2024-09-12T18:37:23.782 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.782 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.782 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:23.782 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.739550+0000", 2024-09-12T18:37:23.782 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3453000000000003e-05 2024-09-12T18:37:23.782 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.782 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.783 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:23.783 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.751216+0000", 2024-09-12T18:37:23.783 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011666582 2024-09-12T18:37:23.783 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:23.783 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:23.783 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:23.783 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.783 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.783 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:208578 5.3 5:c700c127:::benchmark_data_smithi073_23739_object76301:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T18:37:23.783 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:23.749217+0000", 2024-09-12T18:37:23.783 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0021673840000000001, 2024-09-12T18:37:23.783 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0025677260000000002, 2024-09-12T18:37:23.783 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:23.783 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:23.784 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:23.784 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:23.784 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:23.784 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:23.784 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 208578 2024-09-12T18:37:23.784 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.784 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:23.784 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.784 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:23.784 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.749217+0000", 2024-09-12T18:37:23.784 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:23.784 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.784 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.785 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:23.785 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.749217+0000", 2024-09-12T18:37:23.785 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:23.785 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.785 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.785 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:23.785 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.749217+0000", 2024-09-12T18:37:23.785 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:37:23.785 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.785 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.785 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:23.785 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.749220+0000", 2024-09-12T18:37:23.785 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.1930000000000002e-06 2024-09-12T18:37:23.786 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.786 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.786 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:23.786 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.749227+0000", 2024-09-12T18:37:23.786 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5150000000000003e-06 2024-09-12T18:37:23.786 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.786 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.786 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:23.786 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.749232+0000", 2024-09-12T18:37:23.786 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.7990000000000001e-06 2024-09-12T18:37:23.786 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.786 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.787 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:23.787 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.749267+0000", 2024-09-12T18:37:23.787 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.5151000000000003e-05 2024-09-12T18:37:23.787 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.787 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.787 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:23.787 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.749334+0000", 2024-09-12T18:37:23.787 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6839000000000002e-05 2024-09-12T18:37:23.787 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.787 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.787 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:23.787 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.749395+0000", 2024-09-12T18:37:23.787 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1002000000000003e-05 2024-09-12T18:37:23.788 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:23.788 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:23.788 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:23.788 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.788 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.788 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:208577 5.b e68/21 5:d3382b70:::benchmark_data_smithi073_23739_object76300:head v 68'13221, mlcod=68'13219)", 2024-09-12T18:37:23.788 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:23.749501+0000", 2024-09-12T18:37:23.788 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0018828639999999999, 2024-09-12T18:37:23.788 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0023444049999999999, 2024-09-12T18:37:23.788 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:23.788 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:23.788 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:23.788 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:23.789 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.789 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:23.789 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.749501+0000", 2024-09-12T18:37:23.789 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:23.789 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.789 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.789 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:23.789 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.749501+0000", 2024-09-12T18:37:23.789 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:23.789 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.789 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.789 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:23.789 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.749502+0000", 2024-09-12T18:37:23.789 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.44e-07 2024-09-12T18:37:23.790 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.790 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.790 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:23.790 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.749506+0000", 2024-09-12T18:37:23.790 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4320000000000001e-06 2024-09-12T18:37:23.790 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.790 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.790 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:23.790 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.749513+0000", 2024-09-12T18:37:23.790 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3520000000000003e-06 2024-09-12T18:37:23.790 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.790 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.790 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:23.790 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.749517+0000", 2024-09-12T18:37:23.791 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5460000000000002e-06 2024-09-12T18:37:23.791 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.791 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.791 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:23.791 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.751554+0000", 2024-09-12T18:37:23.791 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0020370649999999998 2024-09-12T18:37:23.791 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.791 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.791 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:23.791 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.751566+0000", 2024-09-12T18:37:23.791 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2001000000000001e-05 2024-09-12T18:37:23.791 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:23.791 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:23.792 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:23.792 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.792 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.792 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:208579 5.a 5:563ddaa3:::benchmark_data_smithi073_23739_object76302:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T18:37:23.792 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:23.750502+0000", 2024-09-12T18:37:23.792 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00088168999999999997, 2024-09-12T18:37:23.792 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0013922330000000001, 2024-09-12T18:37:23.792 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:23.792 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:23.792 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:23.792 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:23.792 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:23.792 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:23.792 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 208579 2024-09-12T18:37:23.793 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.793 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:23.793 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.793 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:23.793 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.750502+0000", 2024-09-12T18:37:23.793 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:23.793 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.793 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.793 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:23.793 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.750502+0000", 2024-09-12T18:37:23.793 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:23.793 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.793 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.794 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:23.794 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.750503+0000", 2024-09-12T18:37:23.794 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2200000000000002e-07 2024-09-12T18:37:23.794 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.794 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.794 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:23.794 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.750507+0000", 2024-09-12T18:37:23.794 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.777e-06 2024-09-12T18:37:23.794 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.794 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.794 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:23.794 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.750518+0000", 2024-09-12T18:37:23.794 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0550000000000001e-05 2024-09-12T18:37:23.795 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.795 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.795 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:23.795 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.750524+0000", 2024-09-12T18:37:23.795 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.579e-06 2024-09-12T18:37:23.795 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.795 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.795 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:23.795 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.750570+0000", 2024-09-12T18:37:23.795 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5513999999999998e-05 2024-09-12T18:37:23.795 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.795 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.795 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:23.795 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.750645+0000", 2024-09-12T18:37:23.796 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5051999999999999e-05 2024-09-12T18:37:23.796 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.796 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.796 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:23.796 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.750709+0000", 2024-09-12T18:37:23.796 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4354000000000001e-05 2024-09-12T18:37:23.796 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:23.796 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:23.796 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:23.796 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.796 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.796 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:208580 5.2 e68/21 5:420b8472:::benchmark_data_smithi073_23739_object76303:head v 68'12957, mlcod=68'12955)", 2024-09-12T18:37:23.796 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:23.751162+0000", 2024-09-12T18:37:23.796 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.000221642, 2024-09-12T18:37:23.797 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00079068300000000003, 2024-09-12T18:37:23.797 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:23.797 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:23.797 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:23.797 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:23.797 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.797 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:23.797 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.751162+0000", 2024-09-12T18:37:23.797 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:23.797 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.797 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.797 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:23.797 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.751162+0000", 2024-09-12T18:37:23.798 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:23.798 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.798 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.798 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:23.798 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.751163+0000", 2024-09-12T18:37:23.798 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5600000000000005e-07 2024-09-12T18:37:23.798 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.798 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.798 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:23.798 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.751171+0000", 2024-09-12T18:37:23.798 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.7510000000000008e-06 2024-09-12T18:37:23.798 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.798 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.799 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:23.799 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.751181+0000", 2024-09-12T18:37:23.799 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0477e-05 2024-09-12T18:37:23.799 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.799 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.799 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:23.799 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.751188+0000", 2024-09-12T18:37:23.799 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3280000000000002e-06 2024-09-12T18:37:23.799 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.799 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.799 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:23.799 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.751237+0000", 2024-09-12T18:37:23.799 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9611999999999999e-05 2024-09-12T18:37:23.799 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.800 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.800 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:23.800 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.751255+0000", 2024-09-12T18:37:23.800 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8023e-05 2024-09-12T18:37:23.800 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:23.800 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:23.800 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:23.800 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.800 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.800 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:208570 5.6 e68/21)", 2024-09-12T18:37:23.800 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:23.751308+0000", 2024-09-12T18:37:23.800 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 7.6267999999999996e-05, 2024-09-12T18:37:23.801 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00068975600000000003, 2024-09-12T18:37:23.801 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:23.801 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:23.801 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:23.801 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:23.801 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.801 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:23.801 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.751308+0000", 2024-09-12T18:37:23.801 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:23.801 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.801 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.801 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:23.801 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.751308+0000", 2024-09-12T18:37:23.801 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:23.802 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.802 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.802 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:23.802 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.751308+0000", 2024-09-12T18:37:23.802 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5799999999999999e-07 2024-09-12T18:37:23.802 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.802 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.802 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:23.802 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.751312+0000", 2024-09-12T18:37:23.802 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.518e-06 2024-09-12T18:37:23.802 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.802 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.802 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:23.803 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.751330+0000", 2024-09-12T18:37:23.803 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8318999999999999e-05 2024-09-12T18:37:23.803 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.803 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.803 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:23.803 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.751339+0000", 2024-09-12T18:37:23.803 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6549999999999993e-06 2024-09-12T18:37:23.803 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:23.803 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:23.803 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:23.803 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.803 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.803 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:208582 5.3 5:c595039e:::benchmark_data_smithi073_23739_object76305:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T18:37:23.804 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:23.751706+0000", 2024-09-12T18:37:23.804 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4294967295.9996781, 2024-09-12T18:37:23.804 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000333436, 2024-09-12T18:37:23.804 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:23.804 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:23.804 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:23.804 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:23.804 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:23.804 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:23.804 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 208582 2024-09-12T18:37:23.804 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.804 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:23.804 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.805 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:23.805 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.751706+0000", 2024-09-12T18:37:23.805 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:23.805 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.805 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.805 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:23.805 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.751706+0000", 2024-09-12T18:37:23.805 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:23.805 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.805 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.805 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:23.805 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.751707+0000", 2024-09-12T18:37:23.805 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4399999999999998e-07 2024-09-12T18:37:23.805 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.806 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.806 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:23.806 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.751710+0000", 2024-09-12T18:37:23.806 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4649999999999999e-06 2024-09-12T18:37:23.806 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.806 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.806 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:23.806 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.751721+0000", 2024-09-12T18:37:23.806 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0910999999999999e-05 2024-09-12T18:37:23.806 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.806 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.806 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:23.806 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.751727+0000", 2024-09-12T18:37:23.807 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5649999999999998e-06 2024-09-12T18:37:23.807 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.807 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.807 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:23.807 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.751772+0000", 2024-09-12T18:37:23.807 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4566e-05 2024-09-12T18:37:23.807 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.807 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.807 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:23.807 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.751893+0000", 2024-09-12T18:37:23.807 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012046599999999999 2024-09-12T18:37:23.807 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.807 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.807 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:23.808 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.751994+0000", 2024-09-12T18:37:23.808 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000101724 2024-09-12T18:37:23.808 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:23.808 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:23.808 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:23.808 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.808 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.808 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:208557 5.6 5:65aa3e8c:::benchmark_data_smithi073_23739_object76280:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T18:37:23.808 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:23.739557+0000", 2024-09-12T18:37:23.808 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.011827448000000001, 2024-09-12T18:37:23.808 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012545782, 2024-09-12T18:37:23.808 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:23.808 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:23.808 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:23.809 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:23.809 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:23.809 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:23.809 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 208557 2024-09-12T18:37:23.809 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.809 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:23.809 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.809 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:23.809 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.739557+0000", 2024-09-12T18:37:23.809 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:23.809 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.809 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.809 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:23.809 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.739557+0000", 2024-09-12T18:37:23.810 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:23.810 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.810 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.810 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:23.810 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.739557+0000", 2024-09-12T18:37:23.810 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2900000000000002e-07 2024-09-12T18:37:23.810 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.810 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.810 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:23.810 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.739562+0000", 2024-09-12T18:37:23.810 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2649999999999998e-06 2024-09-12T18:37:23.810 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.810 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.810 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:23.811 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.739570+0000", 2024-09-12T18:37:23.811 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2979999999999992e-06 2024-09-12T18:37:23.811 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.811 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.811 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:23.811 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.739577+0000", 2024-09-12T18:37:23.811 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.9879999999999998e-06 2024-09-12T18:37:23.811 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.811 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.811 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:23.811 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.742200+0000", 2024-09-12T18:37:23.811 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0026228269999999999 2024-09-12T18:37:23.811 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.811 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.812 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:23.812 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.742301+0000", 2024-09-12T18:37:23.812 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000101136 2024-09-12T18:37:23.812 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.812 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.812 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:23.812 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.742361+0000", 2024-09-12T18:37:23.812 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9630000000000003e-05 2024-09-12T18:37:23.812 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.812 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.812 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:23.812 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.751223+0000", 2024-09-12T18:37:23.812 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0088621389999999998 2024-09-12T18:37:23.812 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:23.813 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:23.813 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:23.813 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.813 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.813 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:208581 5.b e68/21)", 2024-09-12T18:37:23.813 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:23.751768+0000", 2024-09-12T18:37:23.813 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4294967295.9996161, 2024-09-12T18:37:23.813 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00039723100000000001, 2024-09-12T18:37:23.813 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:23.813 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:23.813 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:23.813 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:23.813 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.814 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:23.814 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.751768+0000", 2024-09-12T18:37:23.814 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:23.814 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.814 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.814 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:23.814 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.751768+0000", 2024-09-12T18:37:23.814 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:23.814 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.814 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.815 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:23.815 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.751768+0000", 2024-09-12T18:37:23.815 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2500000000000001e-07 2024-09-12T18:37:23.815 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.815 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.815 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:23.815 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.751775+0000", 2024-09-12T18:37:23.815 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.635e-06 2024-09-12T18:37:23.815 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.815 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.815 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:23.815 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.751783+0000", 2024-09-12T18:37:23.815 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.525e-06 2024-09-12T18:37:23.815 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.816 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.816 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:23.816 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.751788+0000", 2024-09-12T18:37:23.816 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1950000000000002e-06 2024-09-12T18:37:23.816 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:23.816 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:23.816 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:23.816 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.816 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.816 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:208560 5.6 5:67ddb70e:::benchmark_data_smithi073_23739_object76283:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T18:37:23.816 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:23.739816+0000", 2024-09-12T18:37:23.816 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.011567712000000001, 2024-09-12T18:37:23.816 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012389885, 2024-09-12T18:37:23.817 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:23.817 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:23.817 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:23.817 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:23.817 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:23.817 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:23.817 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 208560 2024-09-12T18:37:23.817 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.817 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:23.817 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.817 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:23.817 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.739816+0000", 2024-09-12T18:37:23.817 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:23.817 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.818 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.818 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:23.818 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.739816+0000", 2024-09-12T18:37:23.818 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:23.818 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.818 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.818 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:23.818 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.739817+0000", 2024-09-12T18:37:23.818 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.47e-07 2024-09-12T18:37:23.818 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.818 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.818 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:23.818 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.739821+0000", 2024-09-12T18:37:23.818 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.535e-06 2024-09-12T18:37:23.819 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.819 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.819 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:23.819 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.739831+0000", 2024-09-12T18:37:23.819 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0244999999999999e-05 2024-09-12T18:37:23.819 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.819 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.819 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:23.819 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.739837+0000", 2024-09-12T18:37:23.819 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1190000000000002e-06 2024-09-12T18:37:23.819 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.819 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.819 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:23.819 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.744491+0000", 2024-09-12T18:37:23.820 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0046535609999999996 2024-09-12T18:37:23.820 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.820 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.820 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:23.820 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.744631+0000", 2024-09-12T18:37:23.820 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014039 2024-09-12T18:37:23.820 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:23.820 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:23.820 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:23.820 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:23.744781+0000", 2024-09-12T18:37:23.820 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00015032199999999999 2024-09-12T18:37:23.820 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:23.820 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:23.820 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:23.821 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:23.821 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-12T18:37:23.821 INFO:teuthology.orchestra.run.smithi114.stdout: "num_ops": 16 2024-09-12T18:37:23.821 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:23.822 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:37:23.823 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:23.816+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:23.923 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:23.918+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:24.003 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:24.003 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2024-09-12T18:37:24.003 INFO:teuthology.orchestra.run.smithi114.stdout: "complaint_time": 30, 2024-09-12T18:37:24.003 INFO:teuthology.orchestra.run.smithi114.stdout: "num_blocked_ops": 0 2024-09-12T18:37:24.003 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:24.018 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:37:24.024 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:24.016+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:24.125 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:24.118+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:24.164 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:24.165 INFO:teuthology.orchestra.run.smithi114.stdout: "size": 20, 2024-09-12T18:37:24.165 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 600, 2024-09-12T18:37:24.165 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:37:24.165 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.165 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:26 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:24.165 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:37:24.165 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 118.53220034899999, 2024-09-12T18:37:24.165 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045702136999999997, 2024-09-12T18:37:24.165 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:24.165 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:24.165 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:24.165 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:24.165 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.166 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:24.166 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:37:24.166 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:24.166 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.166 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.166 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:24.166 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:37:24.166 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:24.166 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.166 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.166 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:24.166 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628699+0000", 2024-09-12T18:37:24.167 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3859999999999999e-06 2024-09-12T18:37:24.167 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.167 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.167 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:24.167 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628706+0000", 2024-09-12T18:37:24.167 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0169999999999999e-06 2024-09-12T18:37:24.167 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.167 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.167 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:24.167 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628725+0000", 2024-09-12T18:37:24.167 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8683000000000001e-05 2024-09-12T18:37:24.167 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.168 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.168 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:24.168 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628740+0000", 2024-09-12T18:37:24.168 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5413999999999998e-05 2024-09-12T18:37:24.168 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.168 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.168 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:24.168 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628907+0000", 2024-09-12T18:37:24.168 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00016670199999999999 2024-09-12T18:37:24.168 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.168 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.168 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:37:24.169 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628917+0000", 2024-09-12T18:37:24.169 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.046e-05 2024-09-12T18:37:24.169 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.169 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.169 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:24.169 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.660390+0000", 2024-09-12T18:37:24.169 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.031472364000000003 2024-09-12T18:37:24.169 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.169 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.169 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:24.169 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.661767+0000", 2024-09-12T18:37:24.169 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0013769190000000001 2024-09-12T18:37:24.170 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.170 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.170 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:24.170 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.662408+0000", 2024-09-12T18:37:24.170 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00064091099999999998 2024-09-12T18:37:24.170 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.170 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.170 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:24.170 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669577+0000", 2024-09-12T18:37:24.170 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.007169412 2024-09-12T18:37:24.170 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.170 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.171 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:24.171 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674244+0000", 2024-09-12T18:37:24.171 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0046671839999999996 2024-09-12T18:37:24.171 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.171 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.171 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:24.171 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674329+0000", 2024-09-12T18:37:24.171 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5276000000000001e-05 2024-09-12T18:37:24.172 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.172 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.172 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:24.172 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674400+0000", 2024-09-12T18:37:24.172 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0408999999999996e-05 2024-09-12T18:37:24.172 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:24.172 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:24.172 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:24.172 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.172 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.172 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:24.173 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:37:24.173 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 118.531776069, 2024-09-12T18:37:24.173 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.046431252999999999, 2024-09-12T18:37:24.173 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:24.173 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:24.173 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:24.173 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:24.173 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.173 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:24.173 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:37:24.173 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:24.173 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.173 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.173 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:24.174 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:37:24.174 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:24.174 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.174 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.174 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:24.174 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629123+0000", 2024-09-12T18:37:24.174 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0899999999999999e-06 2024-09-12T18:37:24.174 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.174 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.174 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:24.174 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629138+0000", 2024-09-12T18:37:24.174 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4977000000000001e-05 2024-09-12T18:37:24.174 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.175 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.175 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:24.175 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629149+0000", 2024-09-12T18:37:24.175 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1182999999999999e-05 2024-09-12T18:37:24.175 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.175 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.175 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:24.175 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629157+0000", 2024-09-12T18:37:24.175 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8129999999999996e-06 2024-09-12T18:37:24.175 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.175 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.175 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:24.175 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629223+0000", 2024-09-12T18:37:24.176 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6463000000000004e-05 2024-09-12T18:37:24.176 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.176 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.176 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:37:24.176 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629230+0000", 2024-09-12T18:37:24.176 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1360000000000002e-06 2024-09-12T18:37:24.176 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.176 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.176 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:24.176 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669605+0000", 2024-09-12T18:37:24.176 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.040375518999999999 2024-09-12T18:37:24.176 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.176 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.177 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:24.177 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669840+0000", 2024-09-12T18:37:24.177 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00023520099999999999 2024-09-12T18:37:24.177 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.177 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.177 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:24.177 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.675553+0000", 2024-09-12T18:37:24.177 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0057128709999999996 2024-09-12T18:37:24.177 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:24.177 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:24.177 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:24.177 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.177 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.178 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167352 5.a 5:5fc472d2:::benchmark_data_smithi073_23739_object35075:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:24.178 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.163066+0000", 2024-09-12T18:37:24.178 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 20.997832373000001, 2024-09-12T18:37:24.178 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.077708377999999995, 2024-09-12T18:37:24.178 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:24.178 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:24.178 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:24.178 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:24.178 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:24.178 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:24.178 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167352 2024-09-12T18:37:24.178 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.178 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:24.179 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.179 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:24.179 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163066+0000", 2024-09-12T18:37:24.179 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:24.179 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.179 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.179 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:24.179 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163066+0000", 2024-09-12T18:37:24.179 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:24.179 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.179 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.179 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:24.179 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163067+0000", 2024-09-12T18:37:24.180 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0499999999999999e-06 2024-09-12T18:37:24.180 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.180 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.180 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:24.180 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163071+0000", 2024-09-12T18:37:24.180 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4340000000000002e-06 2024-09-12T18:37:24.180 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.180 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.180 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:24.180 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163081+0000", 2024-09-12T18:37:24.180 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0304e-05 2024-09-12T18:37:24.180 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.180 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.180 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:24.181 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163090+0000", 2024-09-12T18:37:24.181 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7309999999999999e-06 2024-09-12T18:37:24.181 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.181 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.181 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:24.181 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163143+0000", 2024-09-12T18:37:24.181 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2942000000000002e-05 2024-09-12T18:37:24.181 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.181 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.181 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:24.181 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163270+0000", 2024-09-12T18:37:24.181 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012664100000000001 2024-09-12T18:37:24.182 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.182 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.182 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:24.182 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163378+0000", 2024-09-12T18:37:24.182 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000107995 2024-09-12T18:37:24.182 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.182 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.182 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:24.182 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234552+0000", 2024-09-12T18:37:24.182 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.071173831000000007 2024-09-12T18:37:24.182 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.183 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.183 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:24.183 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240640+0000", 2024-09-12T18:37:24.183 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.006088909 2024-09-12T18:37:24.183 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.183 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.183 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:24.183 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240709+0000", 2024-09-12T18:37:24.183 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8393999999999996e-05 2024-09-12T18:37:24.183 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.183 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.183 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:24.183 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240774+0000", 2024-09-12T18:37:24.184 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5147000000000005e-05 2024-09-12T18:37:24.184 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:24.184 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:24.184 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:24.184 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.184 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.184 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167358 5.a 5:533f6738:::benchmark_data_smithi073_23739_object35081:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:24.184 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.165639+0000", 2024-09-12T18:37:24.184 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 20.995259096000002, 2024-09-12T18:37:24.184 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.075287509000000002, 2024-09-12T18:37:24.184 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:24.184 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:24.184 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:24.185 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:24.185 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:24.185 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:24.185 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167358 2024-09-12T18:37:24.185 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.185 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:24.185 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.185 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:24.185 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165639+0000", 2024-09-12T18:37:24.185 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:24.185 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.185 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.185 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:24.185 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165639+0000", 2024-09-12T18:37:24.186 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:24.186 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.186 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.186 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:24.186 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165640+0000", 2024-09-12T18:37:24.186 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1999999999999999e-06 2024-09-12T18:37:24.186 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.186 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.186 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:24.186 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165646+0000", 2024-09-12T18:37:24.186 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4550000000000003e-06 2024-09-12T18:37:24.186 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.186 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.186 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:24.187 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165658+0000", 2024-09-12T18:37:24.187 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2721999999999999e-05 2024-09-12T18:37:24.187 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.187 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.187 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:24.187 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165668+0000", 2024-09-12T18:37:24.187 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4229999999999994e-06 2024-09-12T18:37:24.187 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.187 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.187 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:24.187 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165711+0000", 2024-09-12T18:37:24.187 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3785999999999997e-05 2024-09-12T18:37:24.187 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.187 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.188 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:24.188 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165788+0000", 2024-09-12T18:37:24.188 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6506000000000002e-05 2024-09-12T18:37:24.188 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.188 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.188 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:24.188 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165862+0000", 2024-09-12T18:37:24.188 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4012999999999998e-05 2024-09-12T18:37:24.188 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.188 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.188 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:24.188 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234718+0000", 2024-09-12T18:37:24.188 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.068856420000000002 2024-09-12T18:37:24.189 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.189 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.189 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:24.189 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240785+0000", 2024-09-12T18:37:24.189 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0060661489999999998 2024-09-12T18:37:24.189 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.189 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.189 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:24.189 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240844+0000", 2024-09-12T18:37:24.189 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9487000000000002e-05 2024-09-12T18:37:24.189 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.189 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.189 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:24.190 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240926+0000", 2024-09-12T18:37:24.190 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2348000000000005e-05 2024-09-12T18:37:24.190 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:24.190 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:24.190 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:24.190 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.190 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.190 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167361 5.a 5:56730f28:::benchmark_data_smithi073_23739_object35084:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:24.190 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.165979+0000", 2024-09-12T18:37:24.190 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 20.994919115999998, 2024-09-12T18:37:24.190 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.075128337000000003, 2024-09-12T18:37:24.190 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:24.190 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:24.190 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:24.191 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:24.191 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:24.191 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:24.191 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167361 2024-09-12T18:37:24.191 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.191 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:24.191 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.191 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:24.191 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165979+0000", 2024-09-12T18:37:24.191 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:24.191 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.191 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.191 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:24.191 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165979+0000", 2024-09-12T18:37:24.191 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:24.192 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.192 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.192 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:24.192 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165980+0000", 2024-09-12T18:37:24.192 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4499999999999997e-07 2024-09-12T18:37:24.192 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.192 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.192 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:24.192 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165985+0000", 2024-09-12T18:37:24.192 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.186e-06 2024-09-12T18:37:24.193 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.193 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.193 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:24.193 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165995+0000", 2024-09-12T18:37:24.193 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0378e-05 2024-09-12T18:37:24.193 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.193 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.193 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:24.193 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.166016+0000", 2024-09-12T18:37:24.193 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1316999999999999e-05 2024-09-12T18:37:24.193 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.193 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.193 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:24.193 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.167783+0000", 2024-09-12T18:37:24.194 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017662209999999999 2024-09-12T18:37:24.194 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.194 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.194 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:24.194 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.167851+0000", 2024-09-12T18:37:24.194 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7990000000000005e-05 2024-09-12T18:37:24.194 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.194 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.194 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:24.194 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.167929+0000", 2024-09-12T18:37:24.194 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8829e-05 2024-09-12T18:37:24.194 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.194 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.195 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:24.195 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234832+0000", 2024-09-12T18:37:24.195 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066902378999999998 2024-09-12T18:37:24.195 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.195 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.195 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:24.195 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240941+0000", 2024-09-12T18:37:24.195 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0061087470000000003 2024-09-12T18:37:24.195 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.195 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.195 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:24.195 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241053+0000", 2024-09-12T18:37:24.196 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00011197299999999999 2024-09-12T18:37:24.196 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.196 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.196 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:24.196 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241107+0000", 2024-09-12T18:37:24.196 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4672000000000001e-05 2024-09-12T18:37:24.196 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:24.196 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:24.196 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:24.196 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.197 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.197 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167362 5.3 5:cbd73b47:::benchmark_data_smithi073_23739_object35085:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:24.197 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:24.197 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 20.992822401000002, 2024-09-12T18:37:24.197 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.067202411000000004, 2024-09-12T18:37:24.197 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:24.197 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:24.197 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:24.197 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:24.197 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:24.197 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:24.197 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167362 2024-09-12T18:37:24.197 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.198 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:24.198 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.198 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:24.198 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:24.198 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:24.198 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.198 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.198 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:24.198 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:24.198 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:24.198 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.198 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.198 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:24.198 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:24.199 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3600000000000003e-07 2024-09-12T18:37:24.199 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.199 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.199 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:24.199 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168079+0000", 2024-09-12T18:37:24.199 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7949999999999999e-06 2024-09-12T18:37:24.199 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.199 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.199 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:24.199 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168085+0000", 2024-09-12T18:37:24.199 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2110000000000003e-06 2024-09-12T18:37:24.199 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.199 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.199 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:24.200 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168089+0000", 2024-09-12T18:37:24.200 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0840000000000002e-06 2024-09-12T18:37:24.200 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.200 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.200 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:24.200 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168121+0000", 2024-09-12T18:37:24.200 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.1489000000000003e-05 2024-09-12T18:37:24.200 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.200 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.200 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:24.200 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168186+0000", 2024-09-12T18:37:24.200 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5313000000000003e-05 2024-09-12T18:37:24.200 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.200 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.201 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:24.201 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168242+0000", 2024-09-12T18:37:24.201 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5560999999999999e-05 2024-09-12T18:37:24.201 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.201 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.201 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:24.201 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234467+0000", 2024-09-12T18:37:24.201 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066225424000000005 2024-09-12T18:37:24.201 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.201 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.201 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:24.201 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235088+0000", 2024-09-12T18:37:24.201 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00062118999999999998 2024-09-12T18:37:24.202 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.202 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.202 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:24.202 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235197+0000", 2024-09-12T18:37:24.202 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00010825899999999999 2024-09-12T18:37:24.202 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.202 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.202 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:24.202 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235278+0000", 2024-09-12T18:37:24.202 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1448999999999999e-05 2024-09-12T18:37:24.203 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:24.203 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:24.203 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:24.203 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.203 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.203 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167366 5.a 5:58e6a467:::benchmark_data_smithi073_23739_object35089:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:24.203 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168263+0000", 2024-09-12T18:37:24.203 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 20.992634863999999, 2024-09-12T18:37:24.203 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.078184744, 2024-09-12T18:37:24.203 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:24.203 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:24.203 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:24.204 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:24.204 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:24.204 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:24.204 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167366 2024-09-12T18:37:24.204 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.204 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:24.204 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.204 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:24.204 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168263+0000", 2024-09-12T18:37:24.204 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:24.204 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.204 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.204 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:24.204 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168263+0000", 2024-09-12T18:37:24.205 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:24.205 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.205 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.205 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:24.205 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168264+0000", 2024-09-12T18:37:24.205 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5700000000000002e-07 2024-09-12T18:37:24.205 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.205 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.205 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:24.205 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168266+0000", 2024-09-12T18:37:24.205 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1789999999999998e-06 2024-09-12T18:37:24.205 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.205 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.205 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:24.206 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168271+0000", 2024-09-12T18:37:24.206 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8160000000000001e-06 2024-09-12T18:37:24.206 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.206 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.206 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:24.206 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168275+0000", 2024-09-12T18:37:24.206 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4440000000000001e-06 2024-09-12T18:37:24.206 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.206 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.206 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:24.206 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170082+0000", 2024-09-12T18:37:24.206 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0018068800000000001 2024-09-12T18:37:24.206 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.207 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.207 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:24.207 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170154+0000", 2024-09-12T18:37:24.207 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1575000000000005e-05 2024-09-12T18:37:24.207 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.207 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.207 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:24.207 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170216+0000", 2024-09-12T18:37:24.207 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1989999999999994e-05 2024-09-12T18:37:24.207 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.207 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.207 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:24.207 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234933+0000", 2024-09-12T18:37:24.208 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064717514000000004 2024-09-12T18:37:24.208 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.208 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.208 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:24.208 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246226+0000", 2024-09-12T18:37:24.208 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011293151 2024-09-12T18:37:24.208 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.208 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.208 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:24.208 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246338+0000", 2024-09-12T18:37:24.208 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00011225 2024-09-12T18:37:24.208 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.208 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.208 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:24.209 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246448+0000", 2024-09-12T18:37:24.209 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000109388 2024-09-12T18:37:24.209 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:24.209 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:24.209 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:24.209 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.209 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.209 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167367 5.a 5:51778d97:::benchmark_data_smithi073_23739_object35090:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:24.209 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168388+0000", 2024-09-12T18:37:24.209 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 20.99250962, 2024-09-12T18:37:24.209 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.082583860999999995, 2024-09-12T18:37:24.209 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:24.210 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:24.210 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:24.210 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:24.210 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:24.210 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:24.210 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167367 2024-09-12T18:37:24.210 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.210 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:24.210 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.210 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:24.210 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168388+0000", 2024-09-12T18:37:24.210 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:24.210 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.211 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.211 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:24.211 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168388+0000", 2024-09-12T18:37:24.211 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:24.211 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.211 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.211 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:24.211 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168389+0000", 2024-09-12T18:37:24.211 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1099999999999996e-07 2024-09-12T18:37:24.211 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.211 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.211 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:24.211 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168391+0000", 2024-09-12T18:37:24.211 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.39e-06 2024-09-12T18:37:24.212 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.212 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.212 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:24.212 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168396+0000", 2024-09-12T18:37:24.212 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3460000000000004e-06 2024-09-12T18:37:24.212 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.212 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.212 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:24.212 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168399+0000", 2024-09-12T18:37:24.213 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.613e-06 2024-09-12T18:37:24.213 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.213 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.213 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:24.213 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235003+0000", 2024-09-12T18:37:24.213 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066603851000000006 2024-09-12T18:37:24.213 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.213 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.213 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:24.213 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235266+0000", 2024-09-12T18:37:24.213 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00026270999999999998 2024-09-12T18:37:24.213 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.213 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.213 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:24.214 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235510+0000", 2024-09-12T18:37:24.214 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00024394 2024-09-12T18:37:24.214 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.214 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.214 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:24.214 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246546+0000", 2024-09-12T18:37:24.214 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011035774 2024-09-12T18:37:24.214 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.214 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.214 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:24.214 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.250808+0000", 2024-09-12T18:37:24.214 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0042622700000000003 2024-09-12T18:37:24.214 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.215 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.215 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:24.215 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.250890+0000", 2024-09-12T18:37:24.215 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1874999999999998e-05 2024-09-12T18:37:24.215 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.215 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.215 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:24.215 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.250972+0000", 2024-09-12T18:37:24.215 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2581000000000001e-05 2024-09-12T18:37:24.216 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:24.216 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:24.216 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:24.216 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.216 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.216 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167370 5.a 5:5aab9477:::benchmark_data_smithi073_23739_object35093:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:24.216 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168603+0000", 2024-09-12T18:37:24.216 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 20.992294685000001, 2024-09-12T18:37:24.216 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.086603794999999997, 2024-09-12T18:37:24.216 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:24.216 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:24.216 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:24.216 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:24.217 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:24.217 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:24.217 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167370 2024-09-12T18:37:24.217 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.217 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:24.217 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.217 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:24.217 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168603+0000", 2024-09-12T18:37:24.217 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:24.217 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.217 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.217 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:24.217 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168603+0000", 2024-09-12T18:37:24.218 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:24.218 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.218 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.218 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:24.218 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168604+0000", 2024-09-12T18:37:24.218 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.1899999999999998e-07 2024-09-12T18:37:24.218 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.218 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.218 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:24.218 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168606+0000", 2024-09-12T18:37:24.218 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8309999999999999e-06 2024-09-12T18:37:24.218 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.219 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.219 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:24.219 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168610+0000", 2024-09-12T18:37:24.219 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8069999999999999e-06 2024-09-12T18:37:24.219 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.219 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.219 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:24.219 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168613+0000", 2024-09-12T18:37:24.219 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.118e-06 2024-09-12T18:37:24.219 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.219 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.219 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:24.219 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241145+0000", 2024-09-12T18:37:24.220 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.072531678000000002 2024-09-12T18:37:24.220 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.220 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.220 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:24.220 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241342+0000", 2024-09-12T18:37:24.220 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00019635900000000001 2024-09-12T18:37:24.220 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.220 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.220 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:24.220 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241483+0000", 2024-09-12T18:37:24.220 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014161100000000001 2024-09-12T18:37:24.220 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.221 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.221 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:24.221 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255039+0000", 2024-09-12T18:37:24.221 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013555724 2024-09-12T18:37:24.221 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.221 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.221 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:24.221 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255062+0000", 2024-09-12T18:37:24.221 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.3042000000000001e-05 2024-09-12T18:37:24.221 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.221 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.221 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:24.222 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255143+0000", 2024-09-12T18:37:24.222 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0999000000000002e-05 2024-09-12T18:37:24.222 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.222 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.222 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:24.222 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255207+0000", 2024-09-12T18:37:24.222 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4207000000000004e-05 2024-09-12T18:37:24.222 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:24.222 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:24.222 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:24.222 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.222 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.223 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167352 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:24.223 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:24.223 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 20.992170031000001, 2024-09-12T18:37:24.223 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065859953999999998, 2024-09-12T18:37:24.223 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:24.223 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:24.223 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:24.223 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:24.223 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.223 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:24.223 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:24.224 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:24.224 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.224 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.224 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:24.224 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:24.224 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:24.224 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.224 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.224 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:24.224 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:24.224 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.0800000000000001e-07 2024-09-12T18:37:24.224 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.224 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.225 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:24.225 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168730+0000", 2024-09-12T18:37:24.225 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6530000000000001e-06 2024-09-12T18:37:24.225 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.225 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.225 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:24.225 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168734+0000", 2024-09-12T18:37:24.225 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.721e-06 2024-09-12T18:37:24.225 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.225 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.225 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:24.225 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168736+0000", 2024-09-12T18:37:24.225 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.508e-06 2024-09-12T18:37:24.226 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.226 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.226 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:24.226 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171951+0000", 2024-09-12T18:37:24.226 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.003215281 2024-09-12T18:37:24.226 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.226 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.226 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:24.226 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234520+0000", 2024-09-12T18:37:24.226 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062568676000000004 2024-09-12T18:37:24.226 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.226 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.226 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:24.226 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234588+0000", 2024-09-12T18:37:24.227 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7806999999999996e-05 2024-09-12T18:37:24.227 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:24.227 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:24.227 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:24.227 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.227 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.227 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167368 5.4 e58/21 5:29a1ec58:::benchmark_data_smithi073_23739_object35091:head v 58'10399, mlcod=58'10396)", 2024-09-12T18:37:24.227 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:24.227 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 20.992047014000001, 2024-09-12T18:37:24.227 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066008885000000003, 2024-09-12T18:37:24.227 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:24.227 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:24.227 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:24.228 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:24.228 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.228 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:24.228 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:24.228 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:24.228 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.228 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.228 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:24.228 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:24.228 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:24.228 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.228 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.228 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:24.228 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:24.229 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4699999999999998e-07 2024-09-12T18:37:24.229 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.229 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.229 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:24.229 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168854+0000", 2024-09-12T18:37:24.229 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.3180000000000001e-06 2024-09-12T18:37:24.229 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.229 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.229 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:24.229 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168858+0000", 2024-09-12T18:37:24.229 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2799999999999997e-06 2024-09-12T18:37:24.229 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.229 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.229 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:24.229 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168861+0000", 2024-09-12T18:37:24.230 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7650000000000002e-06 2024-09-12T18:37:24.230 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.230 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.230 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:24.230 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168895+0000", 2024-09-12T18:37:24.230 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4533999999999998e-05 2024-09-12T18:37:24.230 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.230 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.230 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:24.230 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168906+0000", 2024-09-12T18:37:24.230 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0910000000000001e-05 2024-09-12T18:37:24.230 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.230 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.230 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:24.230 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234784+0000", 2024-09-12T18:37:24.231 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065877656000000007 2024-09-12T18:37:24.231 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.231 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.231 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:24.231 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234860+0000", 2024-09-12T18:37:24.231 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6174999999999995e-05 2024-09-12T18:37:24.231 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:24.231 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:24.231 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:24.231 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.231 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.231 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167358 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:24.231 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.170373+0000", 2024-09-12T18:37:24.231 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 20.990524733000001, 2024-09-12T18:37:24.231 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064370201000000002, 2024-09-12T18:37:24.232 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:24.232 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:24.232 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:24.232 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:24.232 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.232 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:24.232 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170373+0000", 2024-09-12T18:37:24.232 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:24.232 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.232 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.232 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:24.232 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170373+0000", 2024-09-12T18:37:24.232 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:24.232 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.233 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.233 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:24.233 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170374+0000", 2024-09-12T18:37:24.233 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5799999999999998e-07 2024-09-12T18:37:24.233 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.233 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.233 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:24.233 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170378+0000", 2024-09-12T18:37:24.233 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.732e-06 2024-09-12T18:37:24.233 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.234 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.234 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:24.234 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170388+0000", 2024-09-12T18:37:24.234 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0212e-05 2024-09-12T18:37:24.234 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.234 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.234 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:24.234 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170397+0000", 2024-09-12T18:37:24.234 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7090000000000008e-06 2024-09-12T18:37:24.234 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.234 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.234 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:24.235 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234682+0000", 2024-09-12T18:37:24.235 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064285518999999999 2024-09-12T18:37:24.235 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.235 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.235 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:24.235 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234703+0000", 2024-09-12T18:37:24.235 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.0199000000000001e-05 2024-09-12T18:37:24.235 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.235 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.235 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:24.235 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234743+0000", 2024-09-12T18:37:24.235 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0972e-05 2024-09-12T18:37:24.235 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:24.235 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:24.236 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:24.236 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.236 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.236 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167372 5.c 5:398d36a7:::benchmark_data_smithi073_23739_object35095:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:24.236 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171066+0000", 2024-09-12T18:37:24.236 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 20.989831520999999, 2024-09-12T18:37:24.236 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065889534999999999, 2024-09-12T18:37:24.236 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:24.236 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:24.236 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:24.236 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:24.236 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:24.236 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:24.237 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167372 2024-09-12T18:37:24.237 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.237 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:24.237 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.237 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:24.237 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171066+0000", 2024-09-12T18:37:24.237 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:24.237 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.237 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.237 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:24.237 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171066+0000", 2024-09-12T18:37:24.237 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:24.237 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.237 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.238 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:24.238 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171068+0000", 2024-09-12T18:37:24.238 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.186e-06 2024-09-12T18:37:24.238 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.238 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.238 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:24.238 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171072+0000", 2024-09-12T18:37:24.238 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3560000000000003e-06 2024-09-12T18:37:24.238 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.238 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.238 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:24.238 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171082+0000", 2024-09-12T18:37:24.238 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.9739999999999997e-06 2024-09-12T18:37:24.238 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.239 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.239 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:24.239 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171089+0000", 2024-09-12T18:37:24.239 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7159999999999997e-06 2024-09-12T18:37:24.239 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.239 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.239 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:24.239 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171133+0000", 2024-09-12T18:37:24.239 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4091999999999997e-05 2024-09-12T18:37:24.239 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.239 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.239 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:24.239 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171221+0000", 2024-09-12T18:37:24.239 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.8108000000000004e-05 2024-09-12T18:37:24.240 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.240 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.240 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:24.240 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171279+0000", 2024-09-12T18:37:24.240 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8062000000000001e-05 2024-09-12T18:37:24.240 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.240 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.240 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:24.240 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235007+0000", 2024-09-12T18:37:24.240 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.063727849000000003 2024-09-12T18:37:24.240 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.240 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.240 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:24.241 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236790+0000", 2024-09-12T18:37:24.241 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017829269999999999 2024-09-12T18:37:24.241 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.241 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.241 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:24.241 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236881+0000", 2024-09-12T18:37:24.241 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1347999999999993e-05 2024-09-12T18:37:24.241 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.241 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.241 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:24.241 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236956+0000", 2024-09-12T18:37:24.241 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4917000000000001e-05 2024-09-12T18:37:24.241 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:24.241 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:24.242 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:24.242 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.242 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.242 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167371 5.4 e58/21 5:24fea27c:::benchmark_data_smithi073_23739_object35094:head v 58'10400, mlcod=58'10397)", 2024-09-12T18:37:24.242 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171273+0000", 2024-09-12T18:37:24.242 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 20.989624946999999, 2024-09-12T18:37:24.242 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065500368000000003, 2024-09-12T18:37:24.242 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:24.242 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:24.242 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:24.242 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:24.242 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.243 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:24.243 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171273+0000", 2024-09-12T18:37:24.243 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:24.243 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.243 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.243 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:24.243 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171273+0000", 2024-09-12T18:37:24.243 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:24.243 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.244 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.244 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:24.244 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171274+0000", 2024-09-12T18:37:24.244 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0399999999999996e-07 2024-09-12T18:37:24.244 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.244 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.244 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:24.244 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171277+0000", 2024-09-12T18:37:24.244 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8689999999999997e-06 2024-09-12T18:37:24.244 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.244 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.244 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:24.245 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171284+0000", 2024-09-12T18:37:24.245 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2879999999999998e-06 2024-09-12T18:37:24.245 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.245 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.245 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:24.245 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171289+0000", 2024-09-12T18:37:24.245 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9049999999999996e-06 2024-09-12T18:37:24.245 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.245 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.245 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:24.245 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171322+0000", 2024-09-12T18:37:24.245 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3781000000000001e-05 2024-09-12T18:37:24.245 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.246 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.246 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:24.246 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171335+0000", 2024-09-12T18:37:24.246 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2639999999999999e-05 2024-09-12T18:37:24.246 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.246 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.246 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:24.246 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236691+0000", 2024-09-12T18:37:24.246 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065355835000000001 2024-09-12T18:37:24.246 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.246 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.246 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:24.246 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236773+0000", 2024-09-12T18:37:24.247 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2546000000000006e-05 2024-09-12T18:37:24.247 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:24.247 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:24.247 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:24.247 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.247 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.247 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167364 5.7 e58/21 5:ee50096a:::benchmark_data_smithi073_23739_object35087:head v 58'10504, mlcod=58'10502)", 2024-09-12T18:37:24.247 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171598+0000", 2024-09-12T18:37:24.247 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 20.989299828, 2024-09-12T18:37:24.247 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065149069000000004, 2024-09-12T18:37:24.247 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:24.247 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:24.247 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:24.248 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:24.248 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.248 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:24.248 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171598+0000", 2024-09-12T18:37:24.248 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:24.248 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.248 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.248 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:24.248 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171598+0000", 2024-09-12T18:37:24.248 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:24.248 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.248 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.248 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:24.249 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171599+0000", 2024-09-12T18:37:24.249 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6700000000000003e-07 2024-09-12T18:37:24.249 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.249 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.249 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:24.249 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171602+0000", 2024-09-12T18:37:24.249 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.841e-06 2024-09-12T18:37:24.249 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.249 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.249 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:24.249 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171608+0000", 2024-09-12T18:37:24.249 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9259999999999997e-06 2024-09-12T18:37:24.249 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.249 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.250 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:24.250 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171611+0000", 2024-09-12T18:37:24.250 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.9450000000000003e-06 2024-09-12T18:37:24.250 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.250 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.250 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:24.250 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171650+0000", 2024-09-12T18:37:24.250 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8464000000000003e-05 2024-09-12T18:37:24.250 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.250 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.250 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:24.250 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171662+0000", 2024-09-12T18:37:24.250 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1603999999999999e-05 2024-09-12T18:37:24.250 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.251 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.251 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:24.251 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236663+0000", 2024-09-12T18:37:24.251 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065001330999999996 2024-09-12T18:37:24.251 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.251 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.251 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:24.251 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236747+0000", 2024-09-12T18:37:24.251 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.4390999999999999e-05 2024-09-12T18:37:24.251 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:24.251 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:24.251 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:24.251 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.251 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.251 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167365 5.2 e58/21 5:4107875c:::benchmark_data_smithi073_23739_object35088:head v 58'10351, mlcod=58'10349)", 2024-09-12T18:37:24.252 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171733+0000", 2024-09-12T18:37:24.252 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 20.989164783, 2024-09-12T18:37:24.252 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.074804168000000004, 2024-09-12T18:37:24.252 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:24.252 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:24.252 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:24.252 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:24.252 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.252 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:24.252 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171733+0000", 2024-09-12T18:37:24.252 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:24.252 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.252 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.252 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:24.253 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171733+0000", 2024-09-12T18:37:24.253 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:24.253 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.253 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.253 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:24.253 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171734+0000", 2024-09-12T18:37:24.253 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9299999999999998e-07 2024-09-12T18:37:24.253 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.253 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.253 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:24.253 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171738+0000", 2024-09-12T18:37:24.254 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.301e-06 2024-09-12T18:37:24.254 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.254 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.254 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:24.254 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171746+0000", 2024-09-12T18:37:24.254 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.554e-06 2024-09-12T18:37:24.254 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.254 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.254 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:24.254 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171751+0000", 2024-09-12T18:37:24.254 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1880000000000001e-06 2024-09-12T18:37:24.254 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.254 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.255 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:24.255 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234659+0000", 2024-09-12T18:37:24.255 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062907807999999996 2024-09-12T18:37:24.255 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.255 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.255 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:24.255 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234708+0000", 2024-09-12T18:37:24.255 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8992000000000001e-05 2024-09-12T18:37:24.255 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.255 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.255 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:24.255 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246457+0000", 2024-09-12T18:37:24.255 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.01174974 2024-09-12T18:37:24.256 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.256 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.256 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:24.256 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246537+0000", 2024-09-12T18:37:24.256 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.9992000000000003e-05 2024-09-12T18:37:24.256 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:24.256 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:24.256 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:24.256 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.256 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.256 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167373 5.5 e58/49 5:ad283029:::benchmark_data_smithi073_23739_object35096:head v 58'10600, mlcod=58'10598)", 2024-09-12T18:37:24.256 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:24.256 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 20.989137298999999, 2024-09-12T18:37:24.257 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065058240000000003, 2024-09-12T18:37:24.257 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:24.257 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:24.257 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:24.257 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:24.257 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.257 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:24.257 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:24.257 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:24.257 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.257 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.257 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:24.257 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:24.257 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:24.258 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.258 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.258 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:24.258 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:24.258 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.2899999999999999e-07 2024-09-12T18:37:24.258 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.258 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.258 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:24.258 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171764+0000", 2024-09-12T18:37:24.258 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7310000000000002e-06 2024-09-12T18:37:24.258 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.258 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.258 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:24.258 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171769+0000", 2024-09-12T18:37:24.259 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.079e-06 2024-09-12T18:37:24.259 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.259 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.259 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:24.259 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171774+0000", 2024-09-12T18:37:24.259 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.48e-06 2024-09-12T18:37:24.259 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.259 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.259 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:24.259 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171819+0000", 2024-09-12T18:37:24.259 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4391999999999998e-05 2024-09-12T18:37:24.259 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.259 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.259 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:24.260 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171841+0000", 2024-09-12T18:37:24.260 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2245000000000001e-05 2024-09-12T18:37:24.260 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.260 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.260 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:24.260 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236750+0000", 2024-09-12T18:37:24.260 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064909123999999999 2024-09-12T18:37:24.260 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.260 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.260 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:24.260 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236819+0000", 2024-09-12T18:37:24.260 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8860000000000001e-05 2024-09-12T18:37:24.260 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:24.261 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:24.261 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:24.261 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.261 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.261 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167361 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:24.261 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:24.261 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 20.989081392999999, 2024-09-12T18:37:24.261 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.063049426000000006, 2024-09-12T18:37:24.261 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:24.261 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:24.261 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:24.261 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:24.261 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.262 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:24.262 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:24.262 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:24.262 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.262 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.262 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:24.262 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:24.262 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:24.262 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.262 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.262 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:24.262 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:24.262 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.9099999999999999e-07 2024-09-12T18:37:24.262 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.263 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.263 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:24.263 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171820+0000", 2024-09-12T18:37:24.263 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.5900000000000002e-06 2024-09-12T18:37:24.263 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.263 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.263 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:24.263 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171826+0000", 2024-09-12T18:37:24.263 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.64e-06 2024-09-12T18:37:24.263 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.263 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.263 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:24.264 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171831+0000", 2024-09-12T18:37:24.264 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.578e-06 2024-09-12T18:37:24.264 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.264 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.264 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:24.264 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234808+0000", 2024-09-12T18:37:24.264 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062976780999999996 2024-09-12T18:37:24.264 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.264 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.265 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:24.265 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234821+0000", 2024-09-12T18:37:24.265 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3002e-05 2024-09-12T18:37:24.265 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.265 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.265 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:24.265 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234866+0000", 2024-09-12T18:37:24.265 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5444000000000001e-05 2024-09-12T18:37:24.265 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:24.265 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:24.265 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:24.265 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.265 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.265 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167366 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:24.266 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.172133+0000", 2024-09-12T18:37:24.266 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 20.988764565, 2024-09-12T18:37:24.266 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062815840999999997, 2024-09-12T18:37:24.266 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:24.266 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:24.266 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:24.266 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:24.266 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.266 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:24.266 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172133+0000", 2024-09-12T18:37:24.266 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:24.266 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.266 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.267 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:24.267 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172133+0000", 2024-09-12T18:37:24.267 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:24.267 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.267 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.267 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:24.267 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172134+0000", 2024-09-12T18:37:24.267 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5000000000000003e-07 2024-09-12T18:37:24.267 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.267 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.267 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:24.267 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172137+0000", 2024-09-12T18:37:24.267 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.6460000000000002e-06 2024-09-12T18:37:24.267 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.268 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.268 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:24.268 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234511+0000", 2024-09-12T18:37:24.268 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062374603000000001 2024-09-12T18:37:24.268 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.268 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.268 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:24.268 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234525+0000", 2024-09-12T18:37:24.268 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3396e-05 2024-09-12T18:37:24.268 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.268 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.268 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:24.268 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234909+0000", 2024-09-12T18:37:24.269 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00038405299999999998 2024-09-12T18:37:24.269 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.269 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.269 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:24.269 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234922+0000", 2024-09-12T18:37:24.269 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3274e-05 2024-09-12T18:37:24.269 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.269 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.269 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:24.269 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234949+0000", 2024-09-12T18:37:24.269 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7319000000000001e-05 2024-09-12T18:37:24.269 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:24.269 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:24.269 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:24.270 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.270 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.270 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167369 5.7 e58/21 5:e64ecabd:::benchmark_data_smithi073_23739_object35092:head v 58'10505, mlcod=58'10502)", 2024-09-12T18:37:24.270 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:24.270 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 20.987234173000001, 2024-09-12T18:37:24.270 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.063873773999999994, 2024-09-12T18:37:24.270 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:24.270 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:24.270 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:24.270 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:24.270 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.270 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:24.270 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:24.271 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:24.271 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.271 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.271 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:24.271 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:24.271 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:24.271 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.271 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.271 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:24.271 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:24.271 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3500000000000002e-07 2024-09-12T18:37:24.271 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.271 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.272 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:24.272 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173668+0000", 2024-09-12T18:37:24.272 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4000000000000001e-06 2024-09-12T18:37:24.272 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.272 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.272 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:24.272 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234583+0000", 2024-09-12T18:37:24.272 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.060914889 2024-09-12T18:37:24.272 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.272 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.272 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:24.272 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234600+0000", 2024-09-12T18:37:24.272 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7192000000000001e-05 2024-09-12T18:37:24.273 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.273 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.273 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:24.273 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234791+0000", 2024-09-12T18:37:24.273 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00019115000000000001 2024-09-12T18:37:24.273 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.273 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.273 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:24.273 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234834+0000", 2024-09-12T18:37:24.273 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3296e-05 2024-09-12T18:37:24.273 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.273 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.273 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:24.274 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.237481+0000", 2024-09-12T18:37:24.274 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0026472050000000001 2024-09-12T18:37:24.274 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:24.274 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:24.274 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:24.274 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.237538+0000", 2024-09-12T18:37:24.274 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6206999999999999e-05 2024-09-12T18:37:24.274 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:24.274 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:24.274 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:24.275 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:24.275 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:24.275 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:24.276 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:24.270+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:24.277 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:37:24.377 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:24.368+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:24.436 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:24.436 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:37:24.436 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.436 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:210073 5.d 5:b03e3069:::benchmark_data_smithi073_23739_object77796:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T18:37:24.437 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:24.430937+0000", 2024-09-12T18:37:24.437 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0027783130000000001, 2024-09-12T18:37:24.437 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0028040880000000002, 2024-09-12T18:37:24.437 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:24.437 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:24.437 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:24.437 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:24.437 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:24.437 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:24.437 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 210073 2024-09-12T18:37:24.437 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.437 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:24.437 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.438 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:24.438 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.430937+0000", 2024-09-12T18:37:24.438 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.438 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.438 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.438 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:24.438 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.430937+0000", 2024-09-12T18:37:24.438 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.438 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.438 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.438 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:24.438 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.430938+0000", 2024-09-12T18:37:24.438 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.108e-06 2024-09-12T18:37:24.439 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.439 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.439 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:24.439 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.430942+0000", 2024-09-12T18:37:24.439 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2980000000000002e-06 2024-09-12T18:37:24.439 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.439 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.439 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:24.439 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.430952+0000", 2024-09-12T18:37:24.439 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.3130000000000004e-06 2024-09-12T18:37:24.439 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.439 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.439 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:24.440 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.430960+0000", 2024-09-12T18:37:24.440 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.8949999999999998e-06 2024-09-12T18:37:24.440 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.440 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.440 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:24.440 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.431107+0000", 2024-09-12T18:37:24.440 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014707500000000001 2024-09-12T18:37:24.440 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.440 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.440 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:24.440 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.431240+0000", 2024-09-12T18:37:24.440 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013358000000000001 2024-09-12T18:37:24.441 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.441 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.441 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:24.441 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.431370+0000", 2024-09-12T18:37:24.441 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000129691 2024-09-12T18:37:24.441 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.441 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:24.441 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.441 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.441 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.441 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:210074 5.a e68/21 5:57772699:::benchmark_data_smithi073_23739_object77797:head v 68'13345, mlcod=68'13342)", 2024-09-12T18:37:24.441 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:24.431399+0000", 2024-09-12T18:37:24.441 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0023166969999999999, 2024-09-12T18:37:24.442 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0024164289999999999, 2024-09-12T18:37:24.442 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:24.442 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:24.442 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:37:24.442 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:24.442 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.442 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:24.442 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.431399+0000", 2024-09-12T18:37:24.442 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.442 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.442 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.442 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:24.443 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.431399+0000", 2024-09-12T18:37:24.443 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.443 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.443 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.443 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:24.443 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.431399+0000", 2024-09-12T18:37:24.443 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.64e-07 2024-09-12T18:37:24.443 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.443 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.443 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:24.443 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.431405+0000", 2024-09-12T18:37:24.443 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5949999999999998e-06 2024-09-12T18:37:24.444 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.444 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.444 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:24.444 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.431415+0000", 2024-09-12T18:37:24.444 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5510000000000005e-06 2024-09-12T18:37:24.444 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.444 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.444 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:24.444 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.431421+0000", 2024-09-12T18:37:24.444 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.477e-06 2024-09-12T18:37:24.444 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.444 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.445 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:24.445 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.431474+0000", 2024-09-12T18:37:24.445 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2602000000000002e-05 2024-09-12T18:37:24.445 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.445 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.445 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:24.445 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.431493+0000", 2024-09-12T18:37:24.445 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9293999999999999e-05 2024-09-12T18:37:24.445 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.445 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:24.445 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.446 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.446 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.446 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:210077 5.b 5:de6c3b7a:::benchmark_data_smithi073_23739_object77800:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T18:37:24.446 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:24.431467+0000", 2024-09-12T18:37:24.446 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0022486619999999998, 2024-09-12T18:37:24.446 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.002403259, 2024-09-12T18:37:24.446 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:24.446 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:24.446 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:24.446 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:24.446 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:24.446 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:24.447 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 210077 2024-09-12T18:37:24.447 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.447 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:24.447 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.447 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:24.447 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.431467+0000", 2024-09-12T18:37:24.447 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.447 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.447 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.447 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:24.447 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.431467+0000", 2024-09-12T18:37:24.447 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.447 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.447 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.448 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:24.448 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.431468+0000", 2024-09-12T18:37:24.448 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.052e-06 2024-09-12T18:37:24.448 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.448 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.448 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:24.448 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.431472+0000", 2024-09-12T18:37:24.448 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1479999999999999e-06 2024-09-12T18:37:24.448 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.448 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.448 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:24.448 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.431483+0000", 2024-09-12T18:37:24.448 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0902e-05 2024-09-12T18:37:24.449 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.449 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.449 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:24.449 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.431490+0000", 2024-09-12T18:37:24.449 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1459999999999999e-06 2024-09-12T18:37:24.449 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.449 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.449 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:24.449 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.431588+0000", 2024-09-12T18:37:24.449 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8281000000000003e-05 2024-09-12T18:37:24.449 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.449 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.450 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:24.450 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.431708+0000", 2024-09-12T18:37:24.450 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000120289 2024-09-12T18:37:24.450 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.450 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.450 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:24.450 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.431808+0000", 2024-09-12T18:37:24.450 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.993e-05 2024-09-12T18:37:24.450 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.450 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:24.450 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.450 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.450 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.450 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:210079 5.4 5:26a0dc8d:::benchmark_data_smithi073_23739_object77802:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T18:37:24.451 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:24.431700+0000", 2024-09-12T18:37:24.451 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0020154700000000001, 2024-09-12T18:37:24.451 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0022333700000000001, 2024-09-12T18:37:24.451 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:24.451 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:24.451 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:24.451 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:24.451 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:24.451 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:24.451 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 210079 2024-09-12T18:37:24.451 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.451 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:24.452 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.452 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:24.452 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.431700+0000", 2024-09-12T18:37:24.452 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.452 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.452 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.452 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:24.452 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.431700+0000", 2024-09-12T18:37:24.452 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.452 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.452 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.452 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:24.453 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.431701+0000", 2024-09-12T18:37:24.453 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5900000000000005e-07 2024-09-12T18:37:24.453 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.453 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.453 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:24.453 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.431705+0000", 2024-09-12T18:37:24.453 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5510000000000001e-06 2024-09-12T18:37:24.453 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.453 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.453 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:24.453 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.431717+0000", 2024-09-12T18:37:24.453 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1637000000000001e-05 2024-09-12T18:37:24.453 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.453 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.454 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:24.454 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.431724+0000", 2024-09-12T18:37:24.454 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4610000000000002e-06 2024-09-12T18:37:24.454 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.454 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.454 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:24.454 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.431773+0000", 2024-09-12T18:37:24.454 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9081e-05 2024-09-12T18:37:24.454 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.454 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.454 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:24.454 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.431889+0000", 2024-09-12T18:37:24.455 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011544600000000001 2024-09-12T18:37:24.455 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.455 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.455 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:24.455 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.431996+0000", 2024-09-12T18:37:24.455 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000106896 2024-09-12T18:37:24.455 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.455 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:24.455 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.455 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.455 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.455 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(client.4480.0:210065 5.4 e68/21 ondisk, result = 0)", 2024-09-12T18:37:24.455 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:24.433829+0000", 2024-09-12T18:37:24.455 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4294967295.9998865, 2024-09-12T18:37:24.456 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015603700000000001, 2024-09-12T18:37:24.456 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:24.456 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:24.456 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:37:24.456 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:24.456 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.456 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:24.456 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.433829+0000", 2024-09-12T18:37:24.456 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.456 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.456 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.456 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:24.457 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.433829+0000", 2024-09-12T18:37:24.457 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.457 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.457 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.457 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:24.457 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.433830+0000", 2024-09-12T18:37:24.457 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0800000000000004e-07 2024-09-12T18:37:24.457 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.457 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.457 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:24.457 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.433835+0000", 2024-09-12T18:37:24.457 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9350000000000002e-06 2024-09-12T18:37:24.457 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.457 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.458 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:24.458 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.433846+0000", 2024-09-12T18:37:24.458 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1630999999999999e-05 2024-09-12T18:37:24.458 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.458 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.458 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:24.458 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.433855+0000", 2024-09-12T18:37:24.458 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.1279999999999997e-06 2024-09-12T18:37:24.458 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.458 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.458 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:24.458 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.433909+0000", 2024-09-12T18:37:24.458 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4069e-05 2024-09-12T18:37:24.459 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.459 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.459 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:24.459 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.433918+0000", 2024-09-12T18:37:24.459 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0319999999999992e-06 2024-09-12T18:37:24.459 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.459 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:24.459 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.459 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.459 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.459 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(client.4480.0:210077 5.b e68/21)", 2024-09-12T18:37:24.459 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:24.433896+0000", 2024-09-12T18:37:24.459 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4294967295.9998193, 2024-09-12T18:37:24.459 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013765899999999999, 2024-09-12T18:37:24.460 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:24.460 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:24.460 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:24.460 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:24.460 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.460 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:24.460 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.433896+0000", 2024-09-12T18:37:24.460 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.460 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.460 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.460 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:24.460 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.433896+0000", 2024-09-12T18:37:24.460 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.461 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.461 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.461 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:24.461 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.433896+0000", 2024-09-12T18:37:24.462 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4799999999999999e-07 2024-09-12T18:37:24.462 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.462 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.462 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:24.462 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.433899+0000", 2024-09-12T18:37:24.462 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8629999999999999e-06 2024-09-12T18:37:24.462 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.462 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.462 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:24.462 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.433908+0000", 2024-09-12T18:37:24.462 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4319999999999999e-06 2024-09-12T18:37:24.462 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.463 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.463 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:24.463 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:24.433913+0000", 2024-09-12T18:37:24.463 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7039999999999999e-06 2024-09-12T18:37:24.463 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.463 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:24.463 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.463 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.463 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-09-12T18:37:24.463 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 6 2024-09-12T18:37:24.463 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:24.464 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:37:24.506 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is unset 2024-09-12T18:37:24.510 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:24.504+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:24.579 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:24.570+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:24.673 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:24.674 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-09-12T18:37:24.674 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-09-12T18:37:24.674 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-09-12T18:37:24.674 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:24.681 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:24.672+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:24.695 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:37:24.781 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:24.774+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:24.882 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:24.874+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:24.896 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:24.896 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-09-12T18:37:24.897 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-09-12T18:37:24.897 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:37:24.897 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.897 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121096 5.8 5:13503891:::benchmark_data_smithi073_23739_object121095:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:24.897 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:37:24.897 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 44.713445327000002, 2024-09-12T18:37:24.897 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064025391000000001, 2024-09-12T18:37:24.897 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:24.897 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:24.897 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:24.897 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:24.897 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:24.897 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:24.898 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121096 2024-09-12T18:37:24.898 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.898 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:24.898 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.898 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:24.898 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:37:24.898 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.898 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.898 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.898 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:24.898 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:37:24.898 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.898 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.899 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.899 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:24.899 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178579+0000", 2024-09-12T18:37:24.899 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7369999999999998e-06 2024-09-12T18:37:24.899 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.899 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.899 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:24.899 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178846+0000", 2024-09-12T18:37:24.899 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026752699999999999 2024-09-12T18:37:24.899 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.899 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.899 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:24.899 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178877+0000", 2024-09-12T18:37:24.900 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1081999999999998e-05 2024-09-12T18:37:24.900 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.900 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.900 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:24.900 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178896+0000", 2024-09-12T18:37:24.900 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8522e-05 2024-09-12T18:37:24.900 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.900 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.900 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:24.900 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.192591+0000", 2024-09-12T18:37:24.900 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013695067 2024-09-12T18:37:24.900 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.900 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.900 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:24.901 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.192944+0000", 2024-09-12T18:37:24.901 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00035273699999999999 2024-09-12T18:37:24.901 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.901 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.901 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:24.901 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.193732+0000", 2024-09-12T18:37:24.901 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078849599999999997 2024-09-12T18:37:24.901 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.901 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.901 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:24.901 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.213583+0000", 2024-09-12T18:37:24.901 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.019851164000000001 2024-09-12T18:37:24.901 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.902 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.902 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:24.902 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242386+0000", 2024-09-12T18:37:24.902 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028802924000000001 2024-09-12T18:37:24.902 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.902 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.902 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:24.902 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242501+0000", 2024-09-12T18:37:24.902 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000114932 2024-09-12T18:37:24.902 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.902 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.902 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:24.902 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242602+0000", 2024-09-12T18:37:24.902 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000100203 2024-09-12T18:37:24.903 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.903 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:24.903 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.903 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.903 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.903 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121097 5.8 5:1b31a99e:::benchmark_data_smithi073_23739_object121096:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:24.903 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:37:24.903 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 44.697717036999997, 2024-09-12T18:37:24.903 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048475917, 2024-09-12T18:37:24.903 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:24.903 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:24.903 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:24.903 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:24.904 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:24.904 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:24.904 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121097 2024-09-12T18:37:24.904 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.904 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:24.904 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.904 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:24.904 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:37:24.904 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.904 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.904 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.904 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:24.904 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:37:24.905 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.905 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.905 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.905 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:24.905 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194308+0000", 2024-09-12T18:37:24.905 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2789999999999999e-06 2024-09-12T18:37:24.905 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.905 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.905 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:24.905 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194396+0000", 2024-09-12T18:37:24.905 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8324000000000003e-05 2024-09-12T18:37:24.905 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.905 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.905 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:24.906 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194424+0000", 2024-09-12T18:37:24.906 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7565000000000001e-05 2024-09-12T18:37:24.906 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.906 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.906 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:24.906 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194444+0000", 2024-09-12T18:37:24.906 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0363000000000001e-05 2024-09-12T18:37:24.906 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.906 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.906 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:24.906 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.206888+0000", 2024-09-12T18:37:24.906 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012443997 2024-09-12T18:37:24.906 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.906 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.906 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:24.907 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.207138+0000", 2024-09-12T18:37:24.907 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025035900000000002 2024-09-12T18:37:24.907 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.907 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.907 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:24.907 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.207365+0000", 2024-09-12T18:37:24.907 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000226407 2024-09-12T18:37:24.907 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.907 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.907 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:24.907 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.215059+0000", 2024-09-12T18:37:24.907 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076946860000000001 2024-09-12T18:37:24.907 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.907 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.908 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:24.908 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242619+0000", 2024-09-12T18:37:24.908 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.027559975 2024-09-12T18:37:24.908 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.908 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.908 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:24.908 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242706+0000", 2024-09-12T18:37:24.908 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6384999999999994e-05 2024-09-12T18:37:24.908 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.908 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.908 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:24.908 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242780+0000", 2024-09-12T18:37:24.908 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4577000000000001e-05 2024-09-12T18:37:24.909 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.909 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:24.909 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.909 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.909 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.909 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121101 5.e 5:7e18e9ed:::benchmark_data_smithi073_23739_object121100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:24.909 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.209084+0000", 2024-09-12T18:37:24.909 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 44.682936982000001, 2024-09-12T18:37:24.909 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028988566, 2024-09-12T18:37:24.909 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:24.909 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:24.909 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:24.909 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:24.909 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:24.910 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:24.910 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121101 2024-09-12T18:37:24.910 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.910 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:24.910 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.910 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:24.910 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209084+0000", 2024-09-12T18:37:24.910 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.910 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.910 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.910 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:24.910 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209084+0000", 2024-09-12T18:37:24.910 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.910 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.911 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.911 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:24.911 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209087+0000", 2024-09-12T18:37:24.911 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6800000000000002e-06 2024-09-12T18:37:24.911 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.911 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.911 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:24.911 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209182+0000", 2024-09-12T18:37:24.911 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5084e-05 2024-09-12T18:37:24.911 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.911 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.911 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:24.911 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209212+0000", 2024-09-12T18:37:24.912 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9825e-05 2024-09-12T18:37:24.912 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.912 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.912 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:24.912 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209234+0000", 2024-09-12T18:37:24.912 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1416e-05 2024-09-12T18:37:24.912 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.912 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.912 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:24.912 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209497+0000", 2024-09-12T18:37:24.912 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026390400000000003 2024-09-12T18:37:24.912 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.912 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.913 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:24.913 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209810+0000", 2024-09-12T18:37:24.913 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000313023 2024-09-12T18:37:24.913 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.913 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.913 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:24.913 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.210468+0000", 2024-09-12T18:37:24.913 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00065779300000000005 2024-09-12T18:37:24.913 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.913 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.913 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:24.913 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.235905+0000", 2024-09-12T18:37:24.913 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025436881000000001 2024-09-12T18:37:24.914 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.914 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.914 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:24.914 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237797+0000", 2024-09-12T18:37:24.914 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001892007 2024-09-12T18:37:24.914 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.914 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.914 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:24.914 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237941+0000", 2024-09-12T18:37:24.914 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000143411 2024-09-12T18:37:24.914 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.914 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.914 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:24.914 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.238073+0000", 2024-09-12T18:37:24.915 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013254200000000001 2024-09-12T18:37:24.915 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.915 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:24.915 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.915 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.915 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.915 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121106 5.d 5:b4a9a221:::benchmark_data_smithi073_23739_object121105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:24.915 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:37:24.915 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 44.654842101, 2024-09-12T18:37:24.915 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.034882274999999997, 2024-09-12T18:37:24.915 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:24.915 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:24.915 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:24.915 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:24.916 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:24.916 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:24.916 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121106 2024-09-12T18:37:24.916 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.916 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:24.916 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.916 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:24.916 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:37:24.916 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.916 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.916 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.916 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:24.916 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:37:24.916 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.917 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.917 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.917 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:24.917 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237182+0000", 2024-09-12T18:37:24.917 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6019999999999998e-06 2024-09-12T18:37:24.917 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.917 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.917 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:24.917 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237257+0000", 2024-09-12T18:37:24.917 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5420999999999995e-05 2024-09-12T18:37:24.917 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.917 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.917 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:24.918 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237305+0000", 2024-09-12T18:37:24.918 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7207999999999999e-05 2024-09-12T18:37:24.918 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.918 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.918 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:24.918 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237325+0000", 2024-09-12T18:37:24.918 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0001e-05 2024-09-12T18:37:24.918 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.918 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.918 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:24.918 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237505+0000", 2024-09-12T18:37:24.918 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000180798 2024-09-12T18:37:24.918 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.918 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.919 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:24.919 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237764+0000", 2024-09-12T18:37:24.919 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025862299999999998 2024-09-12T18:37:24.919 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.919 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.919 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:24.919 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.238264+0000", 2024-09-12T18:37:24.919 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00050016100000000005 2024-09-12T18:37:24.919 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.919 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.919 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:24.919 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256525+0000", 2024-09-12T18:37:24.919 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018260508000000002 2024-09-12T18:37:24.919 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.920 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.920 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:24.920 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.271903+0000", 2024-09-12T18:37:24.920 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015378739000000001 2024-09-12T18:37:24.920 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.920 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.920 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:24.920 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.271999+0000", 2024-09-12T18:37:24.920 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5989000000000005e-05 2024-09-12T18:37:24.920 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.920 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.920 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:24.920 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272062+0000", 2024-09-12T18:37:24.921 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2224999999999995e-05 2024-09-12T18:37:24.921 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.921 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:24.921 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.921 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.921 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.921 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121112 5.d 5:b9a2d671:::benchmark_data_smithi073_23739_object121111:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:24.921 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.243446+0000", 2024-09-12T18:37:24.921 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 44.648575375999997, 2024-09-12T18:37:24.921 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.02889415, 2024-09-12T18:37:24.921 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:24.921 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:24.921 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:24.921 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:24.922 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:24.922 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:24.922 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121112 2024-09-12T18:37:24.922 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.922 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:24.922 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.922 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:24.922 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243446+0000", 2024-09-12T18:37:24.922 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.922 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.922 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.922 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:24.922 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243446+0000", 2024-09-12T18:37:24.922 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.923 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.923 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.923 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:24.923 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243448+0000", 2024-09-12T18:37:24.923 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0829999999999998e-06 2024-09-12T18:37:24.923 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.923 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.923 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:24.923 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243527+0000", 2024-09-12T18:37:24.923 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9173999999999998e-05 2024-09-12T18:37:24.923 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.923 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.923 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:24.923 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243549+0000", 2024-09-12T18:37:24.924 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1169e-05 2024-09-12T18:37:24.924 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.924 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.924 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:24.924 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243564+0000", 2024-09-12T18:37:24.924 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5866999999999999e-05 2024-09-12T18:37:24.924 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.924 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.924 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:24.924 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.249905+0000", 2024-09-12T18:37:24.924 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063410360000000004 2024-09-12T18:37:24.924 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.924 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.924 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:24.925 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.250166+0000", 2024-09-12T18:37:24.925 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026052999999999997 2024-09-12T18:37:24.925 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.925 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.925 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:24.925 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.250486+0000", 2024-09-12T18:37:24.926 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00032002700000000002 2024-09-12T18:37:24.926 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.926 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.926 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:24.926 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.259263+0000", 2024-09-12T18:37:24.926 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0087774770000000005 2024-09-12T18:37:24.926 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.926 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.926 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:24.926 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272186+0000", 2024-09-12T18:37:24.926 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.01292213 2024-09-12T18:37:24.926 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.926 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.926 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:24.927 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272267+0000", 2024-09-12T18:37:24.927 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1153e-05 2024-09-12T18:37:24.927 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.927 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.927 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:24.927 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272340+0000", 2024-09-12T18:37:24.927 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3504000000000006e-05 2024-09-12T18:37:24.927 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.927 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:24.927 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.927 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.927 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.927 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121114 5.d 5:b8870c11:::benchmark_data_smithi073_23739_object121113:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:24.927 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.243603+0000", 2024-09-12T18:37:24.927 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 44.648418124999999, 2024-09-12T18:37:24.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028945746000000001, 2024-09-12T18:37:24.928 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:24.928 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:24.928 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:24.928 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:24.928 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:24.928 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:24.928 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121114 2024-09-12T18:37:24.928 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.928 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:24.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.928 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:24.928 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243603+0000", 2024-09-12T18:37:24.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.929 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.929 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.929 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:24.929 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243603+0000", 2024-09-12T18:37:24.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.929 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.929 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.929 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:24.929 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243605+0000", 2024-09-12T18:37:24.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.268e-06 2024-09-12T18:37:24.929 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.929 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.929 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:24.930 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243674+0000", 2024-09-12T18:37:24.930 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9375000000000006e-05 2024-09-12T18:37:24.930 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.930 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:24.930 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243691+0000", 2024-09-12T18:37:24.930 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6517000000000001e-05 2024-09-12T18:37:24.930 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.930 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:24.930 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243702+0000", 2024-09-12T18:37:24.930 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1905999999999999e-05 2024-09-12T18:37:24.930 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.931 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.931 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:24.931 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.253789+0000", 2024-09-12T18:37:24.931 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.010086776 2024-09-12T18:37:24.931 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.931 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.931 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:24.931 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.253959+0000", 2024-09-12T18:37:24.931 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00017000000000000001 2024-09-12T18:37:24.931 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.931 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.931 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:24.931 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.254179+0000", 2024-09-12T18:37:24.931 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022003699999999999 2024-09-12T18:37:24.932 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.932 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.932 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:24.932 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.259330+0000", 2024-09-12T18:37:24.932 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0051511559999999996 2024-09-12T18:37:24.932 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.932 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.932 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:24.932 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272403+0000", 2024-09-12T18:37:24.932 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013072342000000001 2024-09-12T18:37:24.932 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.932 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.932 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:24.932 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272493+0000", 2024-09-12T18:37:24.933 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0595999999999998e-05 2024-09-12T18:37:24.933 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.933 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.933 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:24.933 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272549+0000", 2024-09-12T18:37:24.933 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5773000000000003e-05 2024-09-12T18:37:24.933 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.933 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:24.933 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.933 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.933 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.933 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121115 5.d 5:bd4a51ea:::benchmark_data_smithi073_23739_object121114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:24.933 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.245059+0000", 2024-09-12T18:37:24.934 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 44.646962451, 2024-09-12T18:37:24.934 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.02767406, 2024-09-12T18:37:24.934 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:24.934 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:24.934 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:24.934 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:24.934 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:24.935 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:24.936 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121115 2024-09-12T18:37:24.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.936 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:24.936 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.936 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:24.936 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245059+0000", 2024-09-12T18:37:24.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.936 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.936 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:24.936 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245059+0000", 2024-09-12T18:37:24.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.937 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.937 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:24.937 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245061+0000", 2024-09-12T18:37:24.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9759999999999998e-06 2024-09-12T18:37:24.937 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.937 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.937 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:24.937 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245111+0000", 2024-09-12T18:37:24.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9838e-05 2024-09-12T18:37:24.937 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.937 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.937 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:24.937 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245132+0000", 2024-09-12T18:37:24.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1469999999999999e-05 2024-09-12T18:37:24.938 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.938 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.938 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:24.938 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245146+0000", 2024-09-12T18:37:24.938 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3377000000000001e-05 2024-09-12T18:37:24.938 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.938 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.938 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:24.938 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256596+0000", 2024-09-12T18:37:24.938 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011450241999999999 2024-09-12T18:37:24.938 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.938 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.938 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:24.938 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256838+0000", 2024-09-12T18:37:24.938 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000242255 2024-09-12T18:37:24.939 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.939 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.939 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:24.939 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.257095+0000", 2024-09-12T18:37:24.939 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025679300000000001 2024-09-12T18:37:24.939 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.939 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.939 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:24.939 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.259928+0000", 2024-09-12T18:37:24.939 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0028326290000000001 2024-09-12T18:37:24.939 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.939 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.939 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:24.940 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272607+0000", 2024-09-12T18:37:24.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012679466 2024-09-12T18:37:24.940 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.940 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.940 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:24.940 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272681+0000", 2024-09-12T18:37:24.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3580999999999999e-05 2024-09-12T18:37:24.940 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.940 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.940 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:24.940 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272733+0000", 2024-09-12T18:37:24.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2432999999999998e-05 2024-09-12T18:37:24.940 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.941 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:24.941 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.941 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.941 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.941 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:131551 5.d 5:b8f8c77a:::benchmark_data_smithi073_23739_object131550:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:37:24.941 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:45.499878+0000", 2024-09-12T18:37:24.941 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 39.392143187000002, 2024-09-12T18:37:24.941 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.027478433, 2024-09-12T18:37:24.941 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:24.941 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:24.941 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:24.941 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:24.941 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:24.941 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:24.942 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 131551 2024-09-12T18:37:24.942 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.942 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:24.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.942 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:24.942 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499878+0000", 2024-09-12T18:37:24.942 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.942 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.942 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:24.942 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499878+0000", 2024-09-12T18:37:24.942 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.942 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:24.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499879+0000", 2024-09-12T18:37:24.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.92e-07 2024-09-12T18:37:24.943 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:24.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499946+0000", 2024-09-12T18:37:24.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6712999999999996e-05 2024-09-12T18:37:24.943 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:24.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499953+0000", 2024-09-12T18:37:24.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5519999999999999e-06 2024-09-12T18:37:24.944 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.944 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.944 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:24.944 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499959+0000", 2024-09-12T18:37:24.944 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0430000000000004e-06 2024-09-12T18:37:24.944 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.944 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.944 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:24.944 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.500004+0000", 2024-09-12T18:37:24.944 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5058000000000001e-05 2024-09-12T18:37:24.944 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.944 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.944 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:24.945 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.500121+0000", 2024-09-12T18:37:24.945 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000116747 2024-09-12T18:37:24.945 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.945 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.945 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:24.945 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.500283+0000", 2024-09-12T18:37:24.945 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016190599999999999 2024-09-12T18:37:24.945 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.945 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.945 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:24.945 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.504017+0000", 2024-09-12T18:37:24.945 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003734125 2024-09-12T18:37:24.945 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.945 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.946 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:24.946 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.527224+0000", 2024-09-12T18:37:24.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.023206724000000001 2024-09-12T18:37:24.946 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.946 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:24.946 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.527290+0000", 2024-09-12T18:37:24.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5778999999999995e-05 2024-09-12T18:37:24.946 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.946 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:24.946 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.527357+0000", 2024-09-12T18:37:24.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7094000000000005e-05 2024-09-12T18:37:24.946 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.947 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:24.947 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.947 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.947 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.947 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:167368 5.4 5:29a1ec58:::benchmark_data_smithi073_23739_object35091:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:24.947 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:03.168773+0000", 2024-09-12T18:37:24.947 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 21.723248234, 2024-09-12T18:37:24.947 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.066578597000000003, 2024-09-12T18:37:24.947 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:24.947 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:24.947 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:24.947 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:24.947 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:24.947 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:24.948 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 167368 2024-09-12T18:37:24.948 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.948 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:24.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:24.948 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168773+0000", 2024-09-12T18:37:24.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.948 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:24.948 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168773+0000", 2024-09-12T18:37:24.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.948 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:24.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168774+0000", 2024-09-12T18:37:24.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.023e-06 2024-09-12T18:37:24.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:24.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168779+0000", 2024-09-12T18:37:24.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5800000000000002e-06 2024-09-12T18:37:24.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:24.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168789+0000", 2024-09-12T18:37:24.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0346999999999999e-05 2024-09-12T18:37:24.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.950 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:24.950 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168808+0000", 2024-09-12T18:37:24.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8423e-05 2024-09-12T18:37:24.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.950 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:24.950 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168864+0000", 2024-09-12T18:37:24.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-09-12T18:37:24.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.950 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:24.951 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168947+0000", 2024-09-12T18:37:24.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3274000000000003e-05 2024-09-12T18:37:24.951 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.951 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:24.951 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.169014+0000", 2024-09-12T18:37:24.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6284000000000004e-05 2024-09-12T18:37:24.951 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.951 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:24.951 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.170653+0000", 2024-09-12T18:37:24.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016389779999999999 2024-09-12T18:37:24.951 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.952 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:24.952 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.235279+0000", 2024-09-12T18:37:24.952 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064626464999999994 2024-09-12T18:37:24.952 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.952 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.952 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:24.952 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.235320+0000", 2024-09-12T18:37:24.952 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0377000000000003e-05 2024-09-12T18:37:24.952 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.952 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.952 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:24.952 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.235352+0000", 2024-09-12T18:37:24.952 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2322e-05 2024-09-12T18:37:24.952 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.953 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:24.953 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.953 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.953 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.953 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:167371 5.4 5:24fea27c:::benchmark_data_smithi073_23739_object35094:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:24.953 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:03.171234+0000", 2024-09-12T18:37:24.953 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 21.720787209000001, 2024-09-12T18:37:24.953 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.066048171000000003, 2024-09-12T18:37:24.953 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:24.953 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:24.953 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:24.953 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:24.953 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:24.954 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:24.954 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 167371 2024-09-12T18:37:24.954 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.954 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:24.954 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.954 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:24.954 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171234+0000", 2024-09-12T18:37:24.954 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.954 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.954 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.954 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:24.954 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171234+0000", 2024-09-12T18:37:24.954 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.954 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:24.955 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171235+0000", 2024-09-12T18:37:24.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8599999999999997e-07 2024-09-12T18:37:24.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:24.955 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171238+0000", 2024-09-12T18:37:24.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9739999999999998e-06 2024-09-12T18:37:24.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:24.955 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171245+0000", 2024-09-12T18:37:24.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6000000000000003e-06 2024-09-12T18:37:24.956 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.956 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.956 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:24.956 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171249+0000", 2024-09-12T18:37:24.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9960000000000004e-06 2024-09-12T18:37:24.956 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.956 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.956 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:24.956 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171288+0000", 2024-09-12T18:37:24.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9119999999999998e-05 2024-09-12T18:37:24.956 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.956 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.957 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:24.957 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171359+0000", 2024-09-12T18:37:24.957 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0951000000000006e-05 2024-09-12T18:37:24.957 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.957 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.957 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:24.957 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171425+0000", 2024-09-12T18:37:24.957 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.58e-05 2024-09-12T18:37:24.957 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.957 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.957 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:24.957 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.173093+0000", 2024-09-12T18:37:24.957 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016683939999999999 2024-09-12T18:37:24.957 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.958 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.958 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:24.958 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.237202+0000", 2024-09-12T18:37:24.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064109437000000005 2024-09-12T18:37:24.958 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.958 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.958 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:24.958 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.237249+0000", 2024-09-12T18:37:24.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6751e-05 2024-09-12T18:37:24.958 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.958 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.958 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:24.958 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.237282+0000", 2024-09-12T18:37:24.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3262000000000001e-05 2024-09-12T18:37:24.959 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.959 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:24.959 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.959 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.959 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:201498 5.a e67/21 5:5815d848:::benchmark_data_smithi073_23739_object69221:head v 67'12793, mlcod=67'12791)", 2024-09-12T18:37:24.959 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.430872+0000", 2024-09-12T18:37:24.959 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.4611492310000003, 2024-09-12T18:37:24.959 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.038775280000000002, 2024-09-12T18:37:24.959 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:24.959 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:24.959 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:24.959 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:24.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.960 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:24.960 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430872+0000", 2024-09-12T18:37:24.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.960 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:24.960 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430872+0000", 2024-09-12T18:37:24.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.960 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:24.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430873+0000", 2024-09-12T18:37:24.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6600000000000003e-07 2024-09-12T18:37:24.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:24.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430875+0000", 2024-09-12T18:37:24.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5399999999999998e-06 2024-09-12T18:37:24.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:24.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430879+0000", 2024-09-12T18:37:24.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7239999999999998e-06 2024-09-12T18:37:24.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:24.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430882+0000", 2024-09-12T18:37:24.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8679999999999999e-06 2024-09-12T18:37:24.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:24.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430909+0000", 2024-09-12T18:37:24.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7832999999999999e-05 2024-09-12T18:37:24.963 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.963 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.963 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:24.963 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430922+0000", 2024-09-12T18:37:24.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2164000000000001e-05 2024-09-12T18:37:24.963 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.963 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.963 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:24.963 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469578+0000", 2024-09-12T18:37:24.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.038656469999999998 2024-09-12T18:37:24.963 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.963 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.964 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:24.964 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469648+0000", 2024-09-12T18:37:24.964 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9414999999999999e-05 2024-09-12T18:37:24.964 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.964 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:24.964 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.964 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.964 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.964 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201513 5.e 5:7be2f597:::benchmark_data_smithi073_23739_object69236:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:24.964 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.435121+0000", 2024-09-12T18:37:24.964 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.4569004779999997, 2024-09-12T18:37:24.964 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.034945021999999999, 2024-09-12T18:37:24.965 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:24.965 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:24.965 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:24.965 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:24.965 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:24.965 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:24.965 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201513 2024-09-12T18:37:24.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.965 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:24.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:24.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.435121+0000", 2024-09-12T18:37:24.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:24.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.435121+0000", 2024-09-12T18:37:24.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:24.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.435122+0000", 2024-09-12T18:37:24.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2440000000000001e-06 2024-09-12T18:37:24.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:24.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.435126+0000", 2024-09-12T18:37:24.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1559999999999997e-06 2024-09-12T18:37:24.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:24.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445086+0000", 2024-09-12T18:37:24.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0099592389999999999 2024-09-12T18:37:24.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.968 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:24.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445095+0000", 2024-09-12T18:37:24.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2620000000000004e-06 2024-09-12T18:37:24.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.968 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:24.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445165+0000", 2024-09-12T18:37:24.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0257000000000002e-05 2024-09-12T18:37:24.969 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:24.969 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445311+0000", 2024-09-12T18:37:24.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014603899999999999 2024-09-12T18:37:24.969 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:24.969 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445445+0000", 2024-09-12T18:37:24.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000133654 2024-09-12T18:37:24.969 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:24.970 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469853+0000", 2024-09-12T18:37:24.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024407893999999999 2024-09-12T18:37:24.970 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.970 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.970 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:24.970 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469873+0000", 2024-09-12T18:37:24.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0622e-05 2024-09-12T18:37:24.970 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.970 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.970 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:24.970 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469949+0000", 2024-09-12T18:37:24.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5918000000000001e-05 2024-09-12T18:37:24.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:24.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470066+0000", 2024-09-12T18:37:24.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000116737 2024-09-12T18:37:24.971 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.971 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:24.971 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.972 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201521 5.d 5:b911ab6f:::benchmark_data_smithi073_23739_object69244:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:24.972 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445173+0000", 2024-09-12T18:37:24.972 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.4468480350000004, 2024-09-12T18:37:24.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.031483274999999998, 2024-09-12T18:37:24.972 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:24.972 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:24.972 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:24.972 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:24.973 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:24.973 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:24.973 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201521 2024-09-12T18:37:24.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.973 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:24.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:24.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445173+0000", 2024-09-12T18:37:24.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:24.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445173+0000", 2024-09-12T18:37:24.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.974 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.974 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:24.974 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445174+0000", 2024-09-12T18:37:24.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4299999999999998e-07 2024-09-12T18:37:24.974 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.974 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:24.974 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445176+0000", 2024-09-12T18:37:24.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.469e-06 2024-09-12T18:37:24.974 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.975 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:24.975 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445183+0000", 2024-09-12T18:37:24.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8719999999999996e-06 2024-09-12T18:37:24.975 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.975 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.975 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:24.975 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445188+0000", 2024-09-12T18:37:24.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7079999999999996e-06 2024-09-12T18:37:24.975 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.975 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.975 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:24.975 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445314+0000", 2024-09-12T18:37:24.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012627800000000001 2024-09-12T18:37:24.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.976 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:24.976 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445436+0000", 2024-09-12T18:37:24.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000122007 2024-09-12T18:37:24.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.976 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:24.976 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445541+0000", 2024-09-12T18:37:24.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000105068 2024-09-12T18:37:24.977 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:24.977 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470655+0000", 2024-09-12T18:37:24.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025114035 2024-09-12T18:37:24.977 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:24.977 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476570+0000", 2024-09-12T18:37:24.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0059143269999999996 2024-09-12T18:37:24.977 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.978 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:24.978 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476624+0000", 2024-09-12T18:37:24.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4261000000000001e-05 2024-09-12T18:37:24.978 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.978 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:24.978 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476657+0000", 2024-09-12T18:37:24.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2806999999999999e-05 2024-09-12T18:37:24.978 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.978 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:24.978 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.978 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.979 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201524 5.d 5:b330b18b:::benchmark_data_smithi073_23739_object69247:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:24.979 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445202+0000", 2024-09-12T18:37:24.979 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.4468197749999998, 2024-09-12T18:37:24.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.034036482, 2024-09-12T18:37:24.979 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:24.979 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:24.979 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:24.979 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:24.979 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:24.979 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:24.980 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201524 2024-09-12T18:37:24.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.980 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:24.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.980 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:24.980 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445202+0000", 2024-09-12T18:37:24.980 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.980 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:24.980 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445202+0000", 2024-09-12T18:37:24.980 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.981 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.981 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:24.981 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445202+0000", 2024-09-12T18:37:24.981 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2e-07 2024-09-12T18:37:24.981 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.981 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.981 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:24.981 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445204+0000", 2024-09-12T18:37:24.981 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0490000000000002e-06 2024-09-12T18:37:24.981 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.981 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.981 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:24.981 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445210+0000", 2024-09-12T18:37:24.982 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.959e-06 2024-09-12T18:37:24.982 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.982 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.982 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:24.982 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445215+0000", 2024-09-12T18:37:24.982 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.668e-06 2024-09-12T18:37:24.982 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.982 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.982 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:24.982 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470703+0000", 2024-09-12T18:37:24.982 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025488182000000002 2024-09-12T18:37:24.982 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.982 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.982 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:24.983 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470911+0000", 2024-09-12T18:37:24.983 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020755400000000001 2024-09-12T18:37:24.983 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.983 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.983 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:24.983 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.471309+0000", 2024-09-12T18:37:24.983 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00039868199999999998 2024-09-12T18:37:24.983 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.983 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.983 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:24.983 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476724+0000", 2024-09-12T18:37:24.983 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054150589999999998 2024-09-12T18:37:24.983 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.984 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:24.984 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.479050+0000", 2024-09-12T18:37:24.984 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0023259309999999998 2024-09-12T18:37:24.984 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.984 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:24.984 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.479164+0000", 2024-09-12T18:37:24.984 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000114127 2024-09-12T18:37:24.984 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.984 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:24.984 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.479238+0000", 2024-09-12T18:37:24.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3751000000000006e-05 2024-09-12T18:37:24.985 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.985 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:24.985 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.985 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.985 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.985 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_backfill(progress 5.5 e 67/67 lb 5:a30f9be2:::benchmark_data_smithi073_23739_object118666:head)", 2024-09-12T18:37:24.985 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445433+0000", 2024-09-12T18:37:24.985 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.446588889, 2024-09-12T18:37:24.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.029511351000000002, 2024-09-12T18:37:24.985 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:24.985 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:24.985 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:37:24.985 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:24.986 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.986 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:24.986 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445433+0000", 2024-09-12T18:37:24.986 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.986 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.986 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.986 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:24.986 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445433+0000", 2024-09-12T18:37:24.986 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.986 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.986 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.986 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:24.987 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445433+0000", 2024-09-12T18:37:24.987 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0699999999999998e-07 2024-09-12T18:37:24.987 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.987 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.987 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:24.987 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445440+0000", 2024-09-12T18:37:24.987 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6630000000000004e-06 2024-09-12T18:37:24.987 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.987 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.987 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:24.987 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445447+0000", 2024-09-12T18:37:24.987 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5159999999999997e-06 2024-09-12T18:37:24.987 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.988 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.988 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:24.988 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445454+0000", 2024-09-12T18:37:24.988 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.267e-06 2024-09-12T18:37:24.988 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.988 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.988 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:24.988 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.474780+0000", 2024-09-12T18:37:24.988 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.029325496999999999 2024-09-12T18:37:24.988 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.988 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.988 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:24.988 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.474802+0000", 2024-09-12T18:37:24.989 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2348999999999999e-05 2024-09-12T18:37:24.989 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.989 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.989 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:24.989 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.474944+0000", 2024-09-12T18:37:24.989 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014165200000000001 2024-09-12T18:37:24.989 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.989 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:24.989 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.989 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.989 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.990 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:201515 5.5 e67/49 5:a25bd8bb:::benchmark_data_smithi073_23739_object69238:head v 67'12752, mlcod=67'12750)", 2024-09-12T18:37:24.990 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445471+0000", 2024-09-12T18:37:24.990 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.446550974, 2024-09-12T18:37:24.990 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.031081396000000001, 2024-09-12T18:37:24.990 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:24.990 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:24.990 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:24.991 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:24.991 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.991 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:24.991 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445471+0000", 2024-09-12T18:37:24.991 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.991 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.991 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.991 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:24.991 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445471+0000", 2024-09-12T18:37:24.991 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.991 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.991 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.992 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:24.992 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445471+0000", 2024-09-12T18:37:24.992 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5400000000000002e-07 2024-09-12T18:37:24.992 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.992 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.992 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:24.992 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445475+0000", 2024-09-12T18:37:24.992 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2379999999999999e-06 2024-09-12T18:37:24.992 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.992 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.992 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:24.992 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445481+0000", 2024-09-12T18:37:24.993 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0229999999999998e-06 2024-09-12T18:37:24.993 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.993 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.993 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:24.993 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445486+0000", 2024-09-12T18:37:24.993 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5040000000000004e-06 2024-09-12T18:37:24.993 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.993 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.993 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:24.993 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445970+0000", 2024-09-12T18:37:24.993 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048416699999999997 2024-09-12T18:37:24.993 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.993 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.993 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:24.994 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445991+0000", 2024-09-12T18:37:24.994 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1067999999999999e-05 2024-09-12T18:37:24.994 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.994 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.994 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:24.994 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476511+0000", 2024-09-12T18:37:24.994 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.030520629000000001 2024-09-12T18:37:24.994 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.994 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.994 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:24.994 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476552+0000", 2024-09-12T18:37:24.994 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0413000000000001e-05 2024-09-12T18:37:24.994 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.995 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:24.995 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:24.995 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.995 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.995 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:201526 5.5 e67/49 5:a3549698:::benchmark_data_smithi073_23739_object69249:head v 67'12753, mlcod=67'12750)", 2024-09-12T18:37:24.995 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445957+0000", 2024-09-12T18:37:24.995 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.4460640419999997, 2024-09-12T18:37:24.995 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.030732494999999999, 2024-09-12T18:37:24.995 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:24.995 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:24.995 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:24.995 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:24.995 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.996 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:24.996 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445957+0000", 2024-09-12T18:37:24.996 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.996 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.996 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.996 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:24.996 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445957+0000", 2024-09-12T18:37:24.996 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:24.996 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.996 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.996 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:24.996 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445958+0000", 2024-09-12T18:37:24.996 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7800000000000001e-07 2024-09-12T18:37:24.997 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.997 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.997 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:24.997 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445963+0000", 2024-09-12T18:37:24.997 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5419999999999999e-06 2024-09-12T18:37:24.997 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.997 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.997 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:24.997 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445972+0000", 2024-09-12T18:37:24.997 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4169999999999998e-06 2024-09-12T18:37:24.997 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.997 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.998 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:24.998 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445979+0000", 2024-09-12T18:37:24.998 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2949999999999996e-06 2024-09-12T18:37:24.998 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.998 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.998 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:24.998 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.447710+0000", 2024-09-12T18:37:24.998 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001731067 2024-09-12T18:37:24.998 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.999 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.999 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:24.999 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.447734+0000", 2024-09-12T18:37:24.999 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4094e-05 2024-09-12T18:37:24.999 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.999 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.999 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:24.999 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476659+0000", 2024-09-12T18:37:24.999 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028924268999999999 2024-09-12T18:37:24.999 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:24.999 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:24.999 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:24.999 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476690+0000", 2024-09-12T18:37:25.000 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1232999999999997e-05 2024-09-12T18:37:25.000 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:25.000 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:25.000 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:25.000 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:25.000 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:25.000 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:201528 5.5 e67/49 5:a971b633:::benchmark_data_smithi073_23739_object69251:head v 67'12754, mlcod=67'12750)", 2024-09-12T18:37:25.000 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.449001+0000", 2024-09-12T18:37:25.000 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.4430205679999997, 2024-09-12T18:37:25.000 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.027719695999999999, 2024-09-12T18:37:25.000 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:25.000 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:25.000 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:25.001 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:25.001 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:25.001 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:25.001 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.449001+0000", 2024-09-12T18:37:25.001 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:25.001 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:25.001 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:25.001 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:25.001 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.449001+0000", 2024-09-12T18:37:25.001 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:25.001 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:25.001 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:25.001 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:25.001 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.449002+0000", 2024-09-12T18:37:25.002 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.16e-07 2024-09-12T18:37:25.002 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:25.002 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:25.002 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:25.002 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.449008+0000", 2024-09-12T18:37:25.002 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.9390000000000002e-06 2024-09-12T18:37:25.002 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:25.002 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:25.002 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:25.002 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469460+0000", 2024-09-12T18:37:25.002 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.020452060000000001 2024-09-12T18:37:25.002 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:25.002 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:25.003 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:25.003 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469476+0000", 2024-09-12T18:37:25.003 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6308e-05 2024-09-12T18:37:25.003 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:25.003 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:25.003 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:25.003 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470649+0000", 2024-09-12T18:37:25.003 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011725749999999999 2024-09-12T18:37:25.003 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:25.003 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:25.003 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:25.003 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470676+0000", 2024-09-12T18:37:25.003 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6806000000000001e-05 2024-09-12T18:37:25.004 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:25.004 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:25.004 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:25.004 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476703+0000", 2024-09-12T18:37:25.004 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0060279720000000004 2024-09-12T18:37:25.004 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:25.004 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:25.004 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:25.004 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476721+0000", 2024-09-12T18:37:25.004 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7119999999999999e-05 2024-09-12T18:37:25.004 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:25.004 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:25.004 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:25.004 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:25.005 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:25.005 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201583 5.d 5:b91eedec:::benchmark_data_smithi073_23739_object69306:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:25.005 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.494097+0000", 2024-09-12T18:37:25.005 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.3979241800000004, 2024-09-12T18:37:25.005 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049293508, 2024-09-12T18:37:25.005 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:25.005 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:25.005 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:25.005 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:25.005 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:25.005 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:25.005 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201583 2024-09-12T18:37:25.005 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:25.006 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:25.006 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:25.006 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:25.006 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494097+0000", 2024-09-12T18:37:25.006 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:25.006 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:25.006 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:25.006 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:25.006 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494097+0000", 2024-09-12T18:37:25.006 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:25.006 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:25.006 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:25.006 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:25.007 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494098+0000", 2024-09-12T18:37:25.007 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0699999999999996e-07 2024-09-12T18:37:25.007 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:25.007 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:25.007 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:25.007 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494102+0000", 2024-09-12T18:37:25.007 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.664e-06 2024-09-12T18:37:25.007 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:25.007 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:25.007 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:25.007 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494108+0000", 2024-09-12T18:37:25.007 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.3149999999999997e-06 2024-09-12T18:37:25.007 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:25.008 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:25.008 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:25.008 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494112+0000", 2024-09-12T18:37:25.008 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0659999999999997e-06 2024-09-12T18:37:25.008 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:25.008 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:25.008 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:25.008 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494200+0000", 2024-09-12T18:37:25.008 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7770999999999997e-05 2024-09-12T18:37:25.008 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:25.008 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:25.008 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:25.008 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494315+0000", 2024-09-12T18:37:25.009 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000115048 2024-09-12T18:37:25.009 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:25.009 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:25.009 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:25.009 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494414+0000", 2024-09-12T18:37:25.009 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8820999999999995e-05 2024-09-12T18:37:25.009 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:25.009 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:25.009 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:25.009 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.497199+0000", 2024-09-12T18:37:25.009 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0027854279999999999 2024-09-12T18:37:25.009 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:25.010 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:25.010 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:25.010 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543193+0000", 2024-09-12T18:37:25.010 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.045993500999999999 2024-09-12T18:37:25.010 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:25.010 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:25.010 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:25.010 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543315+0000", 2024-09-12T18:37:25.010 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012246800000000001 2024-09-12T18:37:25.010 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:25.010 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:25.010 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:25.010 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543391+0000", 2024-09-12T18:37:25.011 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5618999999999995e-05 2024-09-12T18:37:25.011 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:25.011 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:25.011 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:25.011 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:25.011 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:25.011 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201585 5.d 5:bb6c167f:::benchmark_data_smithi073_23739_object69308:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:25.011 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.495295+0000", 2024-09-12T18:37:25.011 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4.3967260130000003, 2024-09-12T18:37:25.011 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048312129000000002, 2024-09-12T18:37:25.011 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:25.011 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:25.011 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:25.012 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:25.012 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:25.012 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:25.012 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201585 2024-09-12T18:37:25.012 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:25.012 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:25.012 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:25.012 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:25.012 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495295+0000", 2024-09-12T18:37:25.012 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:25.012 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:25.012 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:25.013 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:25.013 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495295+0000", 2024-09-12T18:37:25.013 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:25.013 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:25.013 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:25.013 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:25.013 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495296+0000", 2024-09-12T18:37:25.013 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0330000000000001e-06 2024-09-12T18:37:25.013 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:25.013 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:25.013 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:25.013 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495301+0000", 2024-09-12T18:37:25.013 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7049999999999998e-06 2024-09-12T18:37:25.014 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:25.014 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:25.014 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:25.014 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495312+0000", 2024-09-12T18:37:25.014 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0791000000000001e-05 2024-09-12T18:37:25.014 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:25.014 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:25.014 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:25.014 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495319+0000", 2024-09-12T18:37:25.014 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8240000000000002e-06 2024-09-12T18:37:25.014 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:25.014 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:25.014 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:25.015 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.496088+0000", 2024-09-12T18:37:25.015 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00076901200000000002 2024-09-12T18:37:25.015 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:25.015 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:25.015 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:25.015 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.496166+0000", 2024-09-12T18:37:25.015 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.8491000000000005e-05 2024-09-12T18:37:25.015 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:25.015 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:25.015 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:25.015 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.496232+0000", 2024-09-12T18:37:25.015 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5400000000000004e-05 2024-09-12T18:37:25.015 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:25.016 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:25.016 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:25.016 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.497467+0000", 2024-09-12T18:37:25.016 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001235049 2024-09-12T18:37:25.016 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:25.016 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:25.016 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:25.016 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543463+0000", 2024-09-12T18:37:25.016 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.045995743999999998 2024-09-12T18:37:25.016 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:25.016 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:25.016 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:25.017 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543546+0000", 2024-09-12T18:37:25.017 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3434000000000001e-05 2024-09-12T18:37:25.017 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:25.017 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:25.017 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:25.017 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543608+0000", 2024-09-12T18:37:25.017 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1645999999999999e-05 2024-09-12T18:37:25.017 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:25.017 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:25.017 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:25.017 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:25.017 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:25.017 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:25.019 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:37:25.020 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:25.014+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:25.119 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:25.114+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:25.184 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:25.285 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:37:25.285 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.286 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:211792 5.5 5:a73709c8:::benchmark_data_smithi073_23739_object79515:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:37:25.286 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:25.172575+0000", 2024-09-12T18:37:25.286 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0086757529999999996, 2024-09-12T18:37:25.286 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0087000670000000006, 2024-09-12T18:37:25.286 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:25.286 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:25.286 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:25.286 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:25.286 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:25.286 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:25.286 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 211792 2024-09-12T18:37:25.286 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.286 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:25.287 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.287 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:25.287 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.172575+0000", 2024-09-12T18:37:25.287 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:25.287 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.287 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.287 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:25.287 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.172575+0000", 2024-09-12T18:37:25.287 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:25.287 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.287 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.287 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:25.287 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.172576+0000", 2024-09-12T18:37:25.288 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0800000000000004e-07 2024-09-12T18:37:25.288 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.288 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.288 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:25.288 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.172578+0000", 2024-09-12T18:37:25.288 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.7549999999999999e-06 2024-09-12T18:37:25.288 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.288 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.288 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:25.288 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.172586+0000", 2024-09-12T18:37:25.288 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.233e-06 2024-09-12T18:37:25.288 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.288 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.289 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:25.289 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.172610+0000", 2024-09-12T18:37:25.289 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.4411999999999999e-05 2024-09-12T18:37:25.289 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.289 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.289 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:25.289 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.174185+0000", 2024-09-12T18:37:25.289 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001574516 2024-09-12T18:37:25.289 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.289 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.289 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:25.289 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.174325+0000", 2024-09-12T18:37:25.289 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014079500000000001 2024-09-12T18:37:25.289 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.290 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.290 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:25.290 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.174464+0000", 2024-09-12T18:37:25.290 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013819099999999999 2024-09-12T18:37:25.290 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.290 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.290 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:25.290 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.178672+0000", 2024-09-12T18:37:25.290 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0042080959999999997 2024-09-12T18:37:25.290 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.290 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.290 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:25.290 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.180028+0000", 2024-09-12T18:37:25.291 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001355942 2024-09-12T18:37:25.291 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:25.291 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:25.291 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:25.291 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.291 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.291 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:211795 5.2 5:4b6d6990:::benchmark_data_smithi073_23739_object79518:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:37:25.292 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:25.173224+0000", 2024-09-12T18:37:25.292 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.008026788, 2024-09-12T18:37:25.292 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0081326130000000003, 2024-09-12T18:37:25.292 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:25.292 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:25.292 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:25.293 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:25.293 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:25.293 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:25.293 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 211795 2024-09-12T18:37:25.293 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.293 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:25.294 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.294 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:25.294 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.173224+0000", 2024-09-12T18:37:25.294 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:25.294 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.294 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.295 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:25.295 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.173224+0000", 2024-09-12T18:37:25.295 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:25.295 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.295 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.295 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:25.296 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.173225+0000", 2024-09-12T18:37:25.296 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.2200000000000002e-07 2024-09-12T18:37:25.296 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.296 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.296 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:25.296 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.173229+0000", 2024-09-12T18:37:25.297 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.1479999999999999e-06 2024-09-12T18:37:25.297 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.297 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.297 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:25.298 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.173240+0000", 2024-09-12T18:37:25.298 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0861e-05 2024-09-12T18:37:25.298 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.298 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.298 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:25.298 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.173247+0000", 2024-09-12T18:37:25.299 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0489999999999998e-06 2024-09-12T18:37:25.300 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.300 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.300 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:25.300 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.173301+0000", 2024-09-12T18:37:25.300 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4188999999999999e-05 2024-09-12T18:37:25.300 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.300 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.300 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:25.300 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.173432+0000", 2024-09-12T18:37:25.300 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000130612 2024-09-12T18:37:25.300 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.301 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.301 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:25.301 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.173563+0000", 2024-09-12T18:37:25.301 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013146300000000001 2024-09-12T18:37:25.301 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.301 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.301 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:25.301 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.178616+0000", 2024-09-12T18:37:25.301 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.005052516 2024-09-12T18:37:25.301 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:25.301 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:25.301 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:25.301 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.302 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.302 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:211797 5.2 5:48d1a9a4:::benchmark_data_smithi073_23739_object79520:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:37:25.302 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:25.174263+0000", 2024-09-12T18:37:25.302 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0069877050000000003, 2024-09-12T18:37:25.302 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0071604670000000002, 2024-09-12T18:37:25.302 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:25.302 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:25.302 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:25.302 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:25.302 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:25.302 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:25.302 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 211797 2024-09-12T18:37:25.302 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.303 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:25.303 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.303 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:25.303 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.174263+0000", 2024-09-12T18:37:25.303 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:25.303 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.303 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.303 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:25.303 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.174263+0000", 2024-09-12T18:37:25.303 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:25.303 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.303 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.303 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:25.303 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.174264+0000", 2024-09-12T18:37:25.304 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2139999999999999e-06 2024-09-12T18:37:25.304 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.304 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.304 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:25.304 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.174269+0000", 2024-09-12T18:37:25.304 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4649999999999996e-06 2024-09-12T18:37:25.304 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.304 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.304 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:25.304 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.174279+0000", 2024-09-12T18:37:25.304 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0274e-05 2024-09-12T18:37:25.304 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.304 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.305 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:25.305 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.174286+0000", 2024-09-12T18:37:25.305 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.4320000000000002e-06 2024-09-12T18:37:25.305 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.305 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.305 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:25.305 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.175443+0000", 2024-09-12T18:37:25.305 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001156614 2024-09-12T18:37:25.305 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.305 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.305 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:25.305 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.175574+0000", 2024-09-12T18:37:25.305 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000130887 2024-09-12T18:37:25.306 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.306 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.306 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:25.306 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.175726+0000", 2024-09-12T18:37:25.306 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015206200000000001 2024-09-12T18:37:25.306 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.306 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.306 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:25.306 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.178622+0000", 2024-09-12T18:37:25.306 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028957039999999998 2024-09-12T18:37:25.306 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:25.306 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:25.306 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:25.307 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.307 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.307 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:211798 5.2 5:4005dfe7:::benchmark_data_smithi073_23739_object79521:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:37:25.307 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:25.174375+0000", 2024-09-12T18:37:25.307 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0068761339999999999, 2024-09-12T18:37:25.307 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0071147579999999997, 2024-09-12T18:37:25.307 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:25.307 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:25.307 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:25.307 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:25.307 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:25.307 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:25.307 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 211798 2024-09-12T18:37:25.308 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.308 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:25.308 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.308 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:25.308 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.174375+0000", 2024-09-12T18:37:25.308 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:25.308 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.308 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.308 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:25.308 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.174375+0000", 2024-09-12T18:37:25.308 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:25.308 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.308 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.309 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:25.309 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.174375+0000", 2024-09-12T18:37:25.309 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.8699999999999995e-07 2024-09-12T18:37:25.309 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.309 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.309 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:25.309 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.174378+0000", 2024-09-12T18:37:25.309 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.0900000000000001e-06 2024-09-12T18:37:25.309 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.309 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.309 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:25.309 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.174389+0000", 2024-09-12T18:37:25.309 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0995000000000001e-05 2024-09-12T18:37:25.310 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.310 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.310 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:25.310 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.174394+0000", 2024-09-12T18:37:25.310 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6580000000000001e-06 2024-09-12T18:37:25.310 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.310 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.310 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:25.310 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.177076+0000", 2024-09-12T18:37:25.310 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.002681742 2024-09-12T18:37:25.310 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.310 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.310 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:25.311 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.177348+0000", 2024-09-12T18:37:25.311 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000272234 2024-09-12T18:37:25.311 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.311 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.311 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:25.311 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.177483+0000", 2024-09-12T18:37:25.311 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013555199999999999 2024-09-12T18:37:25.311 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.311 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.311 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:25.311 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.178870+0000", 2024-09-12T18:37:25.311 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0013866569999999999 2024-09-12T18:37:25.311 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:25.311 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:25.312 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:25.312 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.312 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.312 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:211799 5.9 5:90c2ea13:::benchmark_data_smithi073_23739_object79522:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:37:25.312 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:25.174407+0000", 2024-09-12T18:37:25.312 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0068439520000000004, 2024-09-12T18:37:25.312 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.007145546, 2024-09-12T18:37:25.312 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:25.312 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:25.312 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "reached pg", 2024-09-12T18:37:25.312 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:25.312 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:25.313 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:25.313 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 211799 2024-09-12T18:37:25.313 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.313 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:25.313 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.313 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:25.313 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.174407+0000", 2024-09-12T18:37:25.313 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:25.313 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.313 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.313 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:25.313 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.174407+0000", 2024-09-12T18:37:25.313 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:25.313 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.314 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.314 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:25.314 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.174407+0000", 2024-09-12T18:37:25.314 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5499999999999999e-07 2024-09-12T18:37:25.314 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.314 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.314 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:25.314 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.174409+0000", 2024-09-12T18:37:25.314 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6029999999999999e-06 2024-09-12T18:37:25.314 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.314 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.314 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:25.314 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.174413+0000", 2024-09-12T18:37:25.315 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.0999999999999997e-06 2024-09-12T18:37:25.315 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.315 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.315 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:25.315 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.174416+0000", 2024-09-12T18:37:25.315 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.909e-06 2024-09-12T18:37:25.315 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.315 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.315 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:25.315 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.181487+0000", 2024-09-12T18:37:25.315 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.007071084 2024-09-12T18:37:25.315 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:25.315 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:25.316 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:25.316 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.316 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.316 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:211803 5.d e69/21 5:b152a0d3:::benchmark_data_smithi073_23739_object79526:head v 69'13374, mlcod=69'13372)", 2024-09-12T18:37:25.316 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:25.177925+0000", 2024-09-12T18:37:25.316 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0033254550000000002, 2024-09-12T18:37:25.316 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0036756039999999999, 2024-09-12T18:37:25.316 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:25.316 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:25.316 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:37:25.316 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:25.316 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.316 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:25.316 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.177925+0000", 2024-09-12T18:37:25.317 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:25.317 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.317 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.317 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:25.317 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.177925+0000", 2024-09-12T18:37:25.317 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:25.317 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.317 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.317 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:25.317 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.177926+0000", 2024-09-12T18:37:25.317 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1399999999999997e-07 2024-09-12T18:37:25.317 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.317 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.318 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:25.318 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.177929+0000", 2024-09-12T18:37:25.318 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.4659999999999999e-06 2024-09-12T18:37:25.318 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.318 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.318 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:25.318 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.177939+0000", 2024-09-12T18:37:25.318 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.5480000000000007e-06 2024-09-12T18:37:25.318 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.318 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.318 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:25.318 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.177947+0000", 2024-09-12T18:37:25.318 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.2679999999999994e-06 2024-09-12T18:37:25.318 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.319 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.319 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:25.319 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.178649+0000", 2024-09-12T18:37:25.319 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00070167299999999999 2024-09-12T18:37:25.319 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.319 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.319 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:25.319 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.178667+0000", 2024-09-12T18:37:25.319 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.8513e-05 2024-09-12T18:37:25.319 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:25.320 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:25.320 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:25.320 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.320 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.320 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:211806 5.2 5:4bced3b7:::benchmark_data_smithi073_23739_object79529:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:37:25.320 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:25.180287+0000", 2024-09-12T18:37:25.320 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.00096412099999999997, 2024-09-12T18:37:25.320 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0013635450000000001, 2024-09-12T18:37:25.320 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:25.320 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:25.320 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:25.320 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:25.321 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:25.321 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:25.321 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 211806 2024-09-12T18:37:25.321 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.321 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:25.321 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.321 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:25.321 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.180287+0000", 2024-09-12T18:37:25.321 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:25.321 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.321 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.321 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:25.321 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.180287+0000", 2024-09-12T18:37:25.322 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:25.322 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.322 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.322 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:25.322 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.180288+0000", 2024-09-12T18:37:25.322 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.9600000000000008e-07 2024-09-12T18:37:25.322 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.322 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.322 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:25.322 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.180292+0000", 2024-09-12T18:37:25.322 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.2409999999999997e-06 2024-09-12T18:37:25.322 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.322 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.322 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:25.323 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.180301+0000", 2024-09-12T18:37:25.323 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.2650000000000002e-06 2024-09-12T18:37:25.323 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.323 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.323 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:25.323 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.180306+0000", 2024-09-12T18:37:25.323 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1109999999999999e-06 2024-09-12T18:37:25.323 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.323 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.323 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:25.323 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.180359+0000", 2024-09-12T18:37:25.323 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2747999999999997e-05 2024-09-12T18:37:25.323 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.324 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.324 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:25.324 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.180502+0000", 2024-09-12T18:37:25.324 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000142896 2024-09-12T18:37:25.324 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.324 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.324 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:25.324 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.180596+0000", 2024-09-12T18:37:25.324 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.3826999999999995e-05 2024-09-12T18:37:25.324 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:25.324 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:25.324 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:25.324 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.325 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.325 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:211804 5.6 e69/21 5:6a48fefa:::benchmark_data_smithi073_23739_object79527:head v 69'13277, mlcod=69'13275)", 2024-09-12T18:37:25.325 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:25.180514+0000", 2024-09-12T18:37:25.325 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.000736909, 2024-09-12T18:37:25.325 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0011959939999999999, 2024-09-12T18:37:25.325 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:25.325 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:25.325 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:37:25.325 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:25.325 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.325 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:25.325 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.180514+0000", 2024-09-12T18:37:25.325 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:25.326 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.326 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.326 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:25.326 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.180514+0000", 2024-09-12T18:37:25.326 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:25.326 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.326 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.326 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:25.326 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.180514+0000", 2024-09-12T18:37:25.326 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.0699999999999997e-07 2024-09-12T18:37:25.326 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.326 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.326 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:25.327 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.180519+0000", 2024-09-12T18:37:25.327 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.0289999999999996e-06 2024-09-12T18:37:25.327 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.327 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.327 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:25.327 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.180529+0000", 2024-09-12T18:37:25.327 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.2159999999999995e-06 2024-09-12T18:37:25.327 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.327 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.327 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:25.327 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.180535+0000", 2024-09-12T18:37:25.327 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2430000000000002e-06 2024-09-12T18:37:25.327 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.327 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.328 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:25.328 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.180592+0000", 2024-09-12T18:37:25.328 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.7312000000000003e-05 2024-09-12T18:37:25.328 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.328 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.328 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:25.328 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.180618+0000", 2024-09-12T18:37:25.328 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.5698e-05 2024-09-12T18:37:25.328 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:25.328 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:25.328 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:25.328 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.328 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.329 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:211789 5.1 5:86b6cb7a:::benchmark_data_smithi073_23739_object79512:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:37:25.329 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:25.171952+0000", 2024-09-12T18:37:25.329 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0092989879999999994, 2024-09-12T18:37:25.329 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0098073489999999999, 2024-09-12T18:37:25.329 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:25.329 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:25.329 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:25.329 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:25.329 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:25.329 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:25.329 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 211789 2024-09-12T18:37:25.329 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.329 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:25.330 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.330 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:25.330 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.171952+0000", 2024-09-12T18:37:25.330 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:25.330 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.330 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.330 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:25.330 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.171952+0000", 2024-09-12T18:37:25.330 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:25.330 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.330 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.330 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:25.330 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.171953+0000", 2024-09-12T18:37:25.330 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4499999999999996e-07 2024-09-12T18:37:25.331 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.331 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.331 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:25.331 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.171956+0000", 2024-09-12T18:37:25.331 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.0400000000000001e-06 2024-09-12T18:37:25.331 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.331 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.331 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:25.331 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.171965+0000", 2024-09-12T18:37:25.331 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.3540000000000006e-06 2024-09-12T18:37:25.331 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.331 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.331 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:25.331 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.171970+0000", 2024-09-12T18:37:25.332 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1869999999999996e-06 2024-09-12T18:37:25.332 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.332 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.332 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:25.332 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.179404+0000", 2024-09-12T18:37:25.332 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0074336439999999997 2024-09-12T18:37:25.332 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.332 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.332 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:25.332 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.179531+0000", 2024-09-12T18:37:25.333 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012709900000000001 2024-09-12T18:37:25.333 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.333 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.333 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:25.333 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.179638+0000", 2024-09-12T18:37:25.333 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000107383 2024-09-12T18:37:25.333 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.333 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.333 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:25.333 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.181615+0000", 2024-09-12T18:37:25.333 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0019761800000000001 2024-09-12T18:37:25.333 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:25.333 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:25.333 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:25.334 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.334 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.334 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:211791 5.9 5:95205da3:::benchmark_data_smithi073_23739_object79514:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:37:25.334 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:25.172536+0000", 2024-09-12T18:37:25.334 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0087146140000000007, 2024-09-12T18:37:25.334 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0092882339999999994, 2024-09-12T18:37:25.334 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:25.334 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:25.334 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:25.334 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:25.334 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:25.334 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:25.334 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 211791 2024-09-12T18:37:25.334 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.335 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:25.335 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.335 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:25.335 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.172536+0000", 2024-09-12T18:37:25.335 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:25.335 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.335 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.335 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:25.335 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.172536+0000", 2024-09-12T18:37:25.335 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:25.335 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.335 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.336 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:25.336 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.172537+0000", 2024-09-12T18:37:25.336 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.1299999999999999e-07 2024-09-12T18:37:25.336 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.336 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.336 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:25.336 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.172544+0000", 2024-09-12T18:37:25.336 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.5059999999999998e-06 2024-09-12T18:37:25.336 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.336 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.336 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:25.336 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.172554+0000", 2024-09-12T18:37:25.336 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.5889999999999992e-06 2024-09-12T18:37:25.336 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.337 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.337 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:25.337 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.172561+0000", 2024-09-12T18:37:25.337 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.63e-06 2024-09-12T18:37:25.337 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.337 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.337 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:25.337 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.179396+0000", 2024-09-12T18:37:25.337 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0068356240000000002 2024-09-12T18:37:25.337 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.337 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.337 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:25.337 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.179523+0000", 2024-09-12T18:37:25.337 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012679600000000001 2024-09-12T18:37:25.338 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:25.338 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:25.338 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:25.338 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:25.179638+0000", 2024-09-12T18:37:25.338 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000115318 2024-09-12T18:37:25.338 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:25.338 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:25.338 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:25.338 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:25.338 INFO:teuthology.orchestra.run.smithi162.stdout: ], 2024-09-12T18:37:25.338 INFO:teuthology.orchestra.run.smithi162.stdout: "num_ops": 10 2024-09-12T18:37:25.338 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:25.340 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:37:25.341 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:25.334+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:25.394 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:37:25.441 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:25.434+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:25.534 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:25.534 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [], 2024-09-12T18:37:25.534 INFO:teuthology.orchestra.run.smithi162.stdout: "complaint_time": 30, 2024-09-12T18:37:25.534 INFO:teuthology.orchestra.run.smithi162.stdout: "num_blocked_ops": 0 2024-09-12T18:37:25.534 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:25.541 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:25.534+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:25.553 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:37:25.553 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:37:25.554 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:37:25.571 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:37:25.571 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:37:25.588 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:37:25.589 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:37:25.647 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:25.642+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:25.743 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:25.736+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:25.757 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:25.757 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:25.778 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:37:25.791 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:37:25.791 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:37:25.792 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-12T18:37:25.792 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T18:37:25.845 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:25.836+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:25.932 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:25.932 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:25.946 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:25.938+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:25.955 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:37:26.046 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:26.042+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:26.117 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:37:26.117 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T18:37:26.117 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 69, 2024-09-12T18:37:26.117 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "c08d5a84-711b-44bf-bdf1-e06ecc2c7c00", 2024-09-12T18:37:26.117 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-12T18:35:02.695853+0000", 2024-09-12T18:37:26.117 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-12T18:37:24.490422+0000", 2024-09-12T18:37:26.117 INFO:teuthology.orchestra.run.smithi073.stdout: "last_up_change": "2024-09-12T18:35:12.464628+0000", 2024-09-12T18:37:26.117 INFO:teuthology.orchestra.run.smithi073.stdout: "last_in_change": "2024-09-12T18:35:04.352525+0000", 2024-09-12T18:37:26.117 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T18:37:26.117 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_num": 5804032, 2024-09-12T18:37:26.118 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_set": [ 2024-09-12T18:37:26.118 INFO:teuthology.orchestra.run.smithi073.stdout: "nodeep-scrub", 2024-09-12T18:37:26.118 INFO:teuthology.orchestra.run.smithi073.stdout: "pglog_hardlimit", 2024-09-12T18:37:26.118 INFO:teuthology.orchestra.run.smithi073.stdout: "purged_snapdirs", 2024-09-12T18:37:26.118 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_deletes", 2024-09-12T18:37:26.118 INFO:teuthology.orchestra.run.smithi073.stdout: "sortbitwise" 2024-09-12T18:37:26.118 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T18:37:26.118 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_version": 5, 2024-09-12T18:37:26.118 INFO:teuthology.orchestra.run.smithi073.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T18:37:26.118 INFO:teuthology.orchestra.run.smithi073.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T18:37:26.118 INFO:teuthology.orchestra.run.smithi073.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T18:37:26.118 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_snapshot": "", 2024-09-12T18:37:26.118 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_max": 5, 2024-09-12T18:37:26.119 INFO:teuthology.orchestra.run.smithi073.stdout: "max_osd": 3, 2024-09-12T18:37:26.119 INFO:teuthology.orchestra.run.smithi073.stdout: "require_min_compat_client": "luminous", 2024-09-12T18:37:26.119 INFO:teuthology.orchestra.run.smithi073.stdout: "min_compat_client": "jewel", 2024-09-12T18:37:26.119 INFO:teuthology.orchestra.run.smithi073.stdout: "require_osd_release": "squid", 2024-09-12T18:37:26.119 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_crimson": false, 2024-09-12T18:37:26.119 INFO:teuthology.orchestra.run.smithi073.stdout: "pools": [ 2024-09-12T18:37:26.119 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:26.119 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 1, 2024-09-12T18:37:26.119 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": ".mgr", 2024-09-12T18:37:26.119 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:12.418430+0000", 2024-09-12T18:37:26.119 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-12T18:37:26.119 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-09-12T18:37:26.119 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:37:26.120 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:37:26.120 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:37:26.120 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:37:26.120 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:37:26.120 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:37:26.120 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:37:26.120 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:37:26.120 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:37:26.120 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:37:26.120 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:37:26.120 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 1, 2024-09-12T18:37:26.121 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 1, 2024-09-12T18:37:26.121 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 1, 2024-09-12T18:37:26.121 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 1, 2024-09-12T18:37:26.121 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 1, 2024-09-12T18:37:26.121 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:37:26.121 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:37:26.121 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:37:26.121 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:37:26.121 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:37:26.121 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:37:26.121 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:37:26.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.122 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "11", 2024-09-12T18:37:26.122 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:37:26.122 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:37:26.122 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:37:26.122 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:37:26.122 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:37:26.122 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-09-12T18:37:26.122 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-09-12T18:37:26.123 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:37:26.123 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:37:26.123 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:37:26.123 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:37:26.123 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:37:26.123 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:37:26.123 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:37:26.123 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:37:26.123 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:37:26.123 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:37:26.123 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:37:26.123 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:37:26.123 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:37:26.124 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:37:26.124 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:37:26.124 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:37:26.124 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:37:26.124 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:37:26.124 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:37:26.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.124 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:37:26.124 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:37:26.124 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:37:26.124 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:37:26.124 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:37:26.124 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:37:26.125 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:37:26.125 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:37:26.125 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:37:26.125 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:37:26.125 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:37:26.125 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-09-12T18:37:26.125 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_max": 32, 2024-09-12T18:37:26.125 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 1 2024-09-12T18:37:26.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.125 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:37:26.125 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": {} 2024-09-12T18:37:26.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.125 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:37:26.126 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:37:26.126 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 2.9900000095367432, 2024-09-12T18:37:26.126 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 2.9900000095367432, 2024-09-12T18:37:26.126 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 0.67000001668930054, 2024-09-12T18:37:26.126 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 2, 2024-09-12T18:37:26.126 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 2, 2024-09-12T18:37:26.126 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:37:26.126 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:37:26.126 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:37:26.126 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:26.127 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.127 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:26.127 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 2, 2024-09-12T18:37:26.127 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "rbd", 2024-09-12T18:37:26.127 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:18.665309+0000", 2024-09-12T18:37:26.127 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 8193, 2024-09-12T18:37:26.127 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T18:37:26.127 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:37:26.127 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:37:26.127 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:37:26.127 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:37:26.127 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:37:26.128 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:37:26.128 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:37:26.128 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:37:26.128 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:37:26.128 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:37:26.128 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:37:26.128 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 8, 2024-09-12T18:37:26.128 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 8, 2024-09-12T18:37:26.128 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 8, 2024-09-12T18:37:26.128 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 8, 2024-09-12T18:37:26.128 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 8, 2024-09-12T18:37:26.128 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:37:26.128 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:37:26.129 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:37:26.129 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:37:26.129 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:37:26.129 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:37:26.129 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:37:26.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.129 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "15", 2024-09-12T18:37:26.129 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:37:26.129 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:37:26.129 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:37:26.129 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:37:26.129 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:37:26.129 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 2, 2024-09-12T18:37:26.130 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 15, 2024-09-12T18:37:26.130 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:37:26.130 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:37:26.130 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:37:26.130 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:37:26.130 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:37:26.130 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:37:26.130 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:37:26.130 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:37:26.130 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:37:26.130 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:37:26.130 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:37:26.131 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:37:26.131 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:37:26.131 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:37:26.131 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:37:26.131 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:37:26.131 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:37:26.131 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:37:26.131 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:37:26.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.131 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:37:26.131 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:37:26.131 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:37:26.131 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:37:26.131 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:37:26.132 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:37:26.132 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:37:26.132 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:37:26.132 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:37:26.132 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:37:26.132 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:37:26.132 INFO:teuthology.orchestra.run.smithi073.stdout: "options": {}, 2024-09-12T18:37:26.132 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:37:26.132 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd": {} 2024-09-12T18:37:26.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.132 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:37:26.132 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:37:26.132 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.5, 2024-09-12T18:37:26.133 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.5, 2024-09-12T18:37:26.133 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-09-12T18:37:26.133 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.5, 2024-09-12T18:37:26.133 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.5, 2024-09-12T18:37:26.133 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:37:26.133 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:37:26.133 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:37:26.133 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:26.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:26.134 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 3, 2024-09-12T18:37:26.134 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "cephfs_metadata", 2024-09-12T18:37:26.134 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:23.447845+0000", 2024-09-12T18:37:26.134 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-12T18:37:26.134 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-09-12T18:37:26.134 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:37:26.134 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:37:26.134 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:37:26.134 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:37:26.134 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:37:26.134 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:37:26.134 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:37:26.134 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:37:26.135 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:37:26.135 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:37:26.135 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:37:26.135 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 32, 2024-09-12T18:37:26.135 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 32, 2024-09-12T18:37:26.135 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 32, 2024-09-12T18:37:26.135 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 32, 2024-09-12T18:37:26.135 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 32, 2024-09-12T18:37:26.135 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:37:26.135 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:37:26.135 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:37:26.135 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:37:26.135 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:37:26.135 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:37:26.136 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:37:26.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.136 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "18", 2024-09-12T18:37:26.136 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:37:26.136 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:37:26.136 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:37:26.136 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:37:26.136 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:37:26.136 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-09-12T18:37:26.136 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-09-12T18:37:26.136 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:37:26.136 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:37:26.137 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:37:26.137 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:37:26.137 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:37:26.137 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:37:26.137 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:37:26.137 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:37:26.137 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:37:26.137 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:37:26.137 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:37:26.137 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:37:26.137 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:37:26.137 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:37:26.137 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:37:26.138 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:37:26.138 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:37:26.138 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:37:26.138 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:37:26.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.138 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:37:26.138 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:37:26.138 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:37:26.138 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:37:26.138 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:37:26.138 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:37:26.138 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:37:26.138 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:37:26.138 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:37:26.139 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:37:26.139 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:37:26.139 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-09-12T18:37:26.139 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_bias": 4, 2024-09-12T18:37:26.139 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 16, 2024-09-12T18:37:26.139 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_priority": 5 2024-09-12T18:37:26.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.139 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:37:26.139 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs": { 2024-09-12T18:37:26.139 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": "cephfs" 2024-09-12T18:37:26.139 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:26.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.139 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:37:26.140 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:37:26.140 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.4099999666213989, 2024-09-12T18:37:26.140 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.4099999666213989, 2024-09-12T18:37:26.140 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-09-12T18:37:26.140 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.4099999666213989, 2024-09-12T18:37:26.140 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.4099999666213989, 2024-09-12T18:37:26.140 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:37:26.140 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:37:26.140 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:37:26.140 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:26.140 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.140 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:26.140 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 4, 2024-09-12T18:37:26.140 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "cephfs_data", 2024-09-12T18:37:26.141 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:23.959973+0000", 2024-09-12T18:37:26.141 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-12T18:37:26.141 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-09-12T18:37:26.141 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:37:26.141 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:37:26.141 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:37:26.141 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:37:26.141 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:37:26.141 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:37:26.141 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:37:26.141 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:37:26.141 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:37:26.141 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:37:26.142 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:37:26.142 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 64, 2024-09-12T18:37:26.142 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 64, 2024-09-12T18:37:26.142 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 64, 2024-09-12T18:37:26.142 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 64, 2024-09-12T18:37:26.142 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 64, 2024-09-12T18:37:26.142 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:37:26.142 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:37:26.142 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:37:26.142 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:37:26.142 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:37:26.142 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:37:26.142 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:37:26.142 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.143 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "19", 2024-09-12T18:37:26.143 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:37:26.143 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:37:26.143 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:37:26.143 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:37:26.143 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:37:26.143 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-09-12T18:37:26.143 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-09-12T18:37:26.143 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:37:26.143 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:37:26.143 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:37:26.143 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:37:26.143 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:37:26.144 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:37:26.144 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:37:26.144 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:37:26.144 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:37:26.144 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:37:26.144 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:37:26.144 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:37:26.144 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:37:26.144 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:37:26.144 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:37:26.144 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:37:26.144 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:37:26.144 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:37:26.144 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:37:26.145 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.145 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:37:26.145 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:37:26.145 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:37:26.145 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:37:26.145 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:37:26.145 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:37:26.145 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:37:26.145 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:37:26.145 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:37:26.145 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:37:26.145 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:37:26.145 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-09-12T18:37:26.146 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 64, 2024-09-12T18:37:26.146 INFO:teuthology.orchestra.run.smithi073.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T18:37:26.146 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.146 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:37:26.146 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs": { 2024-09-12T18:37:26.146 INFO:teuthology.orchestra.run.smithi073.stdout: "data": "cephfs" 2024-09-12T18:37:26.146 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:26.146 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.146 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:37:26.146 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:37:26.147 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.4099999666213989, 2024-09-12T18:37:26.147 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.4099999666213989, 2024-09-12T18:37:26.147 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-09-12T18:37:26.147 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.4099999666213989, 2024-09-12T18:37:26.147 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.4099999666213989, 2024-09-12T18:37:26.147 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:37:26.147 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:37:26.147 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:37:26.147 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:26.147 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.147 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:26.147 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 5, 2024-09-12T18:37:26.147 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "unique_pool_0", 2024-09-12T18:37:26.148 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:43.562347+0000", 2024-09-12T18:37:26.148 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-12T18:37:26.148 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-09-12T18:37:26.148 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:37:26.148 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:37:26.148 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:37:26.148 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:37:26.148 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:37:26.148 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:37:26.148 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:37:26.148 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:37:26.148 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:37:26.148 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:37:26.148 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:37:26.149 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 16, 2024-09-12T18:37:26.149 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 16, 2024-09-12T18:37:26.149 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 16, 2024-09-12T18:37:26.149 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 16, 2024-09-12T18:37:26.149 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 16, 2024-09-12T18:37:26.149 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:37:26.149 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:37:26.149 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:37:26.149 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:37:26.149 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:37:26.149 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:37:26.149 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:37:26.149 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.150 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "23", 2024-09-12T18:37:26.150 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:37:26.150 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:37:26.150 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:37:26.150 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:37:26.150 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:37:26.150 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-09-12T18:37:26.150 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-09-12T18:37:26.150 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:37:26.150 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:37:26.150 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:37:26.150 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:37:26.150 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:37:26.151 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:37:26.151 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:37:26.151 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:37:26.151 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:37:26.151 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:37:26.151 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:37:26.151 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:37:26.151 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:37:26.151 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:37:26.151 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:37:26.151 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:37:26.151 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:37:26.151 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:37:26.151 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:37:26.152 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.152 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:37:26.152 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:37:26.152 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:37:26.152 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:37:26.152 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:37:26.152 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:37:26.152 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:37:26.152 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:37:26.152 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:37:26.153 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:37:26.153 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:37:26.153 INFO:teuthology.orchestra.run.smithi073.stdout: "options": {}, 2024-09-12T18:37:26.153 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:37:26.153 INFO:teuthology.orchestra.run.smithi073.stdout: "rados": {} 2024-09-12T18:37:26.153 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.153 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:37:26.153 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:37:26.153 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.1299999952316284, 2024-09-12T18:37:26.153 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.1299999952316284, 2024-09-12T18:37:26.153 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-09-12T18:37:26.153 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T18:37:26.154 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T18:37:26.154 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:37:26.154 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:37:26.154 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:37:26.154 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:26.154 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:26.154 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T18:37:26.154 INFO:teuthology.orchestra.run.smithi073.stdout: "osds": [ 2024-09-12T18:37:26.154 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:26.154 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-09-12T18:37:26.154 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "f1cf24e8-6179-4666-a444-fa81ef0d7482", 2024-09-12T18:37:26.154 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-09-12T18:37:26.154 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-09-12T18:37:26.155 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0.6371612548828125, 2024-09-12T18:37:26.155 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-09-12T18:37:26.155 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-09-12T18:37:26.155 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-09-12T18:37:26.155 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-09-12T18:37:26.155 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 21, 2024-09-12T18:37:26.155 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-09-12T18:37:26.155 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-09-12T18:37:26.155 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-12T18:37:26.155 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:26.155 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:26.155 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:26.155 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6800", 2024-09-12T18:37:26.155 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:37:26.156 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.156 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:26.156 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:26.156 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6801", 2024-09-12T18:37:26.156 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:37:26.156 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:26.156 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:26.156 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.156 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-09-12T18:37:26.156 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:26.156 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:26.156 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:26.157 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6802", 2024-09-12T18:37:26.157 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:37:26.157 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.157 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:26.157 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:26.157 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6803", 2024-09-12T18:37:26.157 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:37:26.157 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:26.157 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:26.157 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.157 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-09-12T18:37:26.157 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:26.157 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:26.158 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:26.158 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6806", 2024-09-12T18:37:26.158 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:37:26.158 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.158 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:26.158 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:26.159 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6807", 2024-09-12T18:37:26.159 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:37:26.159 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:26.159 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:26.159 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.159 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-09-12T18:37:26.159 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:26.159 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:26.159 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:26.159 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6804", 2024-09-12T18:37:26.159 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:37:26.159 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.160 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:26.160 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:26.160 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6805", 2024-09-12T18:37:26.160 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:37:26.160 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:26.160 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:26.160 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.160 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.114:6801/2710632206", 2024-09-12T18:37:26.160 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.114:6803/2710632206", 2024-09-12T18:37:26.160 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.114:6807/2710632206", 2024-09-12T18:37:26.160 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.114:6805/2710632206", 2024-09-12T18:37:26.160 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-09-12T18:37:26.160 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-09-12T18:37:26.160 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-09-12T18:37:26.161 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:26.161 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.161 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:26.161 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-09-12T18:37:26.161 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "3fdb0044-2820-4411-978b-4b6e94fbf0b1", 2024-09-12T18:37:26.161 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-09-12T18:37:26.161 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-09-12T18:37:26.161 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-09-12T18:37:26.161 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-09-12T18:37:26.161 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-09-12T18:37:26.161 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-09-12T18:37:26.161 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 9, 2024-09-12T18:37:26.161 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 65, 2024-09-12T18:37:26.162 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-09-12T18:37:26.162 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-09-12T18:37:26.162 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-12T18:37:26.162 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:26.162 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:26.162 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:26.162 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6800", 2024-09-12T18:37:26.162 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:37:26.162 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.162 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:26.162 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:26.162 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6801", 2024-09-12T18:37:26.162 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:37:26.162 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:26.163 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:26.163 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.163 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-09-12T18:37:26.163 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:26.163 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:26.163 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:26.163 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6802", 2024-09-12T18:37:26.163 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:37:26.163 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.163 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:26.163 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:26.163 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6803", 2024-09-12T18:37:26.163 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:37:26.164 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:26.164 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:26.164 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.164 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-09-12T18:37:26.164 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:26.164 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:26.164 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:26.164 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6806", 2024-09-12T18:37:26.164 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:37:26.164 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.164 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:26.164 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:26.165 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6807", 2024-09-12T18:37:26.165 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:37:26.165 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:26.165 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:26.165 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.165 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-09-12T18:37:26.165 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:26.165 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:26.165 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:26.165 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6804", 2024-09-12T18:37:26.165 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:37:26.165 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.165 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:26.166 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:26.166 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6805", 2024-09-12T18:37:26.166 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:37:26.166 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:26.166 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:26.166 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.166 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.143:6801/862189968", 2024-09-12T18:37:26.166 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.143:6803/862189968", 2024-09-12T18:37:26.166 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.143:6807/862189968", 2024-09-12T18:37:26.166 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.143:6805/862189968", 2024-09-12T18:37:26.166 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-09-12T18:37:26.166 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-09-12T18:37:26.166 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-09-12T18:37:26.167 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:26.167 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.167 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:26.167 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2024-09-12T18:37:26.167 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "6fb554da-561f-4aa2-b855-0e3adb98b057", 2024-09-12T18:37:26.167 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-09-12T18:37:26.167 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-09-12T18:37:26.167 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-09-12T18:37:26.167 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-09-12T18:37:26.167 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-09-12T18:37:26.167 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-09-12T18:37:26.167 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-09-12T18:37:26.167 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 65, 2024-09-12T18:37:26.167 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-09-12T18:37:26.167 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-09-12T18:37:26.168 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-12T18:37:26.168 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:26.168 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:26.168 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:26.168 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6800", 2024-09-12T18:37:26.168 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:37:26.168 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.168 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:26.168 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:26.168 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6801", 2024-09-12T18:37:26.168 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:37:26.168 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:26.168 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:26.169 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.169 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-09-12T18:37:26.169 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:26.169 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:26.169 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:26.169 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6802", 2024-09-12T18:37:26.169 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:37:26.169 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.169 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:26.169 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:26.169 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6803", 2024-09-12T18:37:26.169 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:37:26.169 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:26.170 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:26.170 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.170 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-09-12T18:37:26.170 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:26.170 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:26.170 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:26.170 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6806", 2024-09-12T18:37:26.170 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:37:26.170 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.170 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:26.170 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:26.170 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6807", 2024-09-12T18:37:26.170 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:37:26.171 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:26.171 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:26.171 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.171 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-09-12T18:37:26.171 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:26.171 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:26.171 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:26.171 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6804", 2024-09-12T18:37:26.171 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:37:26.171 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.171 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:26.171 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:26.171 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6805", 2024-09-12T18:37:26.172 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:37:26.172 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:26.172 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:26.172 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.172 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.162:6801/1397104153", 2024-09-12T18:37:26.172 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.162:6803/1397104153", 2024-09-12T18:37:26.172 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.162:6807/1397104153", 2024-09-12T18:37:26.172 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.162:6805/1397104153", 2024-09-12T18:37:26.173 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-09-12T18:37:26.173 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-09-12T18:37:26.173 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-09-12T18:37:26.173 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:26.173 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:26.173 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T18:37:26.173 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_xinfo": [ 2024-09-12T18:37:26.173 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:26.173 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-09-12T18:37:26.173 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-09-12T18:37:26.173 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-09-12T18:37:26.173 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-09-12T18:37:26.174 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540719139924082687, 2024-09-12T18:37:26.174 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-09-12T18:37:26.174 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-09-12T18:35:10.239320+0000", 2024-09-12T18:37:26.174 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-09-12T18:37:26.174 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.174 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:26.174 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-09-12T18:37:26.174 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-09-12T18:37:26.174 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-09-12T18:37:26.174 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-09-12T18:37:26.174 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540719139924082687, 2024-09-12T18:37:26.174 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-09-12T18:37:26.174 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-09-12T18:35:10.861760+0000", 2024-09-12T18:37:26.175 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-09-12T18:37:26.175 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.175 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:26.175 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2024-09-12T18:37:26.175 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-09-12T18:37:26.175 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-09-12T18:37:26.175 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-09-12T18:37:26.175 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540719139924082687, 2024-09-12T18:37:26.175 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-09-12T18:37:26.175 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-09-12T18:35:10.355997+0000", 2024-09-12T18:37:26.176 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-09-12T18:37:26.176 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:26.176 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T18:37:26.176 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap": [], 2024-09-12T18:37:26.176 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap_items": [], 2024-09-12T18:37:26.176 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap_primaries": [], 2024-09-12T18:37:26.176 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_temp": [ 2024-09-12T18:37:26.176 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:26.176 INFO:teuthology.orchestra.run.smithi073.stdout: "pgid": "5.5", 2024-09-12T18:37:26.176 INFO:teuthology.orchestra.run.smithi073.stdout: "osds": [ 2024-09-12T18:37:26.176 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-12T18:37:26.176 INFO:teuthology.orchestra.run.smithi073.stdout: 0 2024-09-12T18:37:26.176 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:26.177 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:26.177 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T18:37:26.177 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_temp": [], 2024-09-12T18:37:26.177 INFO:teuthology.orchestra.run.smithi073.stdout: "blocklist": {}, 2024-09-12T18:37:26.177 INFO:teuthology.orchestra.run.smithi073.stdout: "range_blocklist": {}, 2024-09-12T18:37:26.177 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profiles": { 2024-09-12T18:37:26.177 INFO:teuthology.orchestra.run.smithi073.stdout: "default": { 2024-09-12T18:37:26.177 INFO:teuthology.orchestra.run.smithi073.stdout: "crush-failure-domain": "osd", 2024-09-12T18:37:26.177 INFO:teuthology.orchestra.run.smithi073.stdout: "k": "2", 2024-09-12T18:37:26.177 INFO:teuthology.orchestra.run.smithi073.stdout: "m": "1", 2024-09-12T18:37:26.177 INFO:teuthology.orchestra.run.smithi073.stdout: "plugin": "jerasure", 2024-09-12T18:37:26.177 INFO:teuthology.orchestra.run.smithi073.stdout: "technique": "reed_sol_van" 2024-09-12T18:37:26.177 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:26.177 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:26.178 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps_queue": [], 2024-09-12T18:37:26.178 INFO:teuthology.orchestra.run.smithi073.stdout: "new_removed_snaps": [], 2024-09-12T18:37:26.178 INFO:teuthology.orchestra.run.smithi073.stdout: "new_purged_snaps": [], 2024-09-12T18:37:26.178 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_node_flags": {}, 2024-09-12T18:37:26.178 INFO:teuthology.orchestra.run.smithi073.stdout: "device_class_flags": {}, 2024-09-12T18:37:26.178 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": { 2024-09-12T18:37:26.178 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode_enabled": false, 2024-09-12T18:37:26.178 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_bucket_count": 0, 2024-09-12T18:37:26.178 INFO:teuthology.orchestra.run.smithi073.stdout: "degraded_stretch_mode": 0, 2024-09-12T18:37:26.178 INFO:teuthology.orchestra.run.smithi073.stdout: "recovering_stretch_mode": 0, 2024-09-12T18:37:26.178 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode_bucket": 0 2024-09-12T18:37:26.178 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:26.178 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T18:37:26.180 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:26.180 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:26.181 INFO:tasks.thrashosds.thrasher:j is {'epoch': 69, 'fsid': 'c08d5a84-711b-44bf-bdf1-e06ecc2c7c00', 'created': '2024-09-12T18:35:02.695853+0000', 'modified': '2024-09-12T18:37:24.490422+0000', 'last_up_change': '2024-09-12T18:35:12.464628+0000', 'last_in_change': '2024-09-12T18:35:04.352525+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T18:35:12.418430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-12T18:35:18.665309+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 15, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T18:35:23.447845+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.409999966621399, 'score_stable': 1.409999966621399, 'optimal_score': 1, 'raw_score_acting': 1.409999966621399, 'raw_score_stable': 1.409999966621399, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T18:35:23.959973+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.409999966621399, 'score_stable': 1.409999966621399, 'optimal_score': 1, 'raw_score_acting': 1.409999966621399, 'raw_score_stable': 1.409999966621399, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2024-09-12T18:35:43.562347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'f1cf24e8-6179-4666-a444-fa81ef0d7482', 'up': 1, 'in': 1, 'weight': 0.6371612548828125, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6800', 'nonce': 2710632206}, {'type': 'v1', 'addr': '172.21.15.114:6801', 'nonce': 2710632206}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6802', 'nonce': 2710632206}, {'type': 'v1', 'addr': '172.21.15.114:6803', 'nonce': 2710632206}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6806', 'nonce': 2710632206}, {'type': 'v1', 'addr': '172.21.15.114:6807', 'nonce': 2710632206}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6804', 'nonce': 2710632206}, {'type': 'v1', 'addr': '172.21.15.114:6805', 'nonce': 2710632206}]}, 'public_addr': '172.21.15.114:6801/2710632206', 'cluster_addr': '172.21.15.114:6803/2710632206', 'heartbeat_back_addr': '172.21.15.114:6807/2710632206', 'heartbeat_front_addr': '172.21.15.114:6805/2710632206', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '3fdb0044-2820-4411-978b-4b6e94fbf0b1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 9, 'up_thru': 65, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6800', 'nonce': 862189968}, {'type': 'v1', 'addr': '172.21.15.143:6801', 'nonce': 862189968}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6802', 'nonce': 862189968}, {'type': 'v1', 'addr': '172.21.15.143:6803', 'nonce': 862189968}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6806', 'nonce': 862189968}, {'type': 'v1', 'addr': '172.21.15.143:6807', 'nonce': 862189968}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6804', 'nonce': 862189968}, {'type': 'v1', 'addr': '172.21.15.143:6805', 'nonce': 862189968}]}, 'public_addr': '172.21.15.143:6801/862189968', 'cluster_addr': '172.21.15.143:6803/862189968', 'heartbeat_back_addr': '172.21.15.143:6807/862189968', 'heartbeat_front_addr': '172.21.15.143:6805/862189968', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '6fb554da-561f-4aa2-b855-0e3adb98b057', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 65, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6800', 'nonce': 1397104153}, {'type': 'v1', 'addr': '172.21.15.162:6801', 'nonce': 1397104153}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6802', 'nonce': 1397104153}, {'type': 'v1', 'addr': '172.21.15.162:6803', 'nonce': 1397104153}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6806', 'nonce': 1397104153}, {'type': 'v1', 'addr': '172.21.15.162:6807', 'nonce': 1397104153}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6804', 'nonce': 1397104153}, {'type': 'v1', 'addr': '172.21.15.162:6805', 'nonce': 1397104153}]}, 'public_addr': '172.21.15.162:6801/1397104153', 'cluster_addr': '172.21.15.162:6803/1397104153', 'heartbeat_back_addr': '172.21.15.162:6807/1397104153', 'heartbeat_front_addr': '172.21.15.162:6805/1397104153', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:35:10.239320+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:35:10.861760+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:35:10.355997+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [{'pgid': '5.5', 'osds': [2, 0]}], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T18:37:26.182 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:37:26.182 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:37:26.182 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:26.174+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:26.280 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:26.274+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:26.375 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:26.375 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:26.381 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:26.374+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:26.393 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:37:26.482 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:26.480+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:26.498 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:37:26.500 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T18:37:26.520 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2024-09-12T18:37:26.413955+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3877833653,"num_objects":59189,"num_object_clones":0,"num_object_copies":118378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2952,"num_objects_unfound":0,"num_objects_dirty":59189,"num_whiteouts":0,"num_read":87,"num_read_kb":74,"num_write":205579,"num_write_kb":8468225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13965,"num_bytes_recovered":914883142,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62289,"ondisk_log_size":62289,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":243,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1282028,"kb_used_data":485980,"kb_used_omap":4,"kb_used_meta":795963,"kb_avail":281833492,"statfs":{"total":289910292480,"available":288597495808,"internally_reserved":0,"allocated":497643520,"data_stored":7924749610,"data_compressed":376347447,"data_compressed_allocated":495259648,"data_compressed_original":7923859456,"omap_allocated":4783,"internal_metadata":815066449},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,5,5,0,0,0,0,0,0,9],"upper_bound":2048},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-830144512,"num_objects":-12667,"num_object_clones":0,"num_object_copies":-25334,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-1809,"num_objects_unfound":0,"num_objects_dirty":-12667,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12667,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1343,"num_bytes_recovered":88014848,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002671"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":117,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.469674+0000","last_change":"2024-09-12T18:36:40.076316+0000","last_active":"2024-09-12T18:37:21.469674+0000","last_peered":"2024-09-12T18:37:21.469674+0000","last_clean":"2024-09-12T18:37:21.469674+0000","last_became_active":"2024-09-12T18:36:40.074014+0000","last_became_peered":"2024-09-12T18:36:40.074014+0000","last_unstale":"2024-09-12T18:37:21.469674+0000","last_undegraded":"2024-09-12T18:37:21.469674+0000","last_fullsized":"2024-09-12T18:37:21.469674+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:20.167564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.469588+0000","last_change":"2024-09-12T18:35:25.659760+0000","last_active":"2024-09-12T18:37:21.469588+0000","last_peered":"2024-09-12T18:37:21.469588+0000","last_clean":"2024-09-12T18:37:21.469588+0000","last_became_active":"2024-09-12T18:35:25.654920+0000","last_became_peered":"2024-09-12T18:35:25.654920+0000","last_unstale":"2024-09-12T18:37:21.469588+0000","last_undegraded":"2024-09-12T18:37:21.469588+0000","last_fullsized":"2024-09-12T18:37:21.469588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:21.519881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.479446+0000","last_change":"2024-09-12T18:35:25.659460+0000","last_active":"2024-09-12T18:37:21.479446+0000","last_peered":"2024-09-12T18:37:21.479446+0000","last_clean":"2024-09-12T18:37:21.479446+0000","last_became_active":"2024-09-12T18:35:25.657782+0000","last_became_peered":"2024-09-12T18:35:25.657782+0000","last_unstale":"2024-09-12T18:37:21.479446+0000","last_undegraded":"2024-09-12T18:37:21.479446+0000","last_fullsized":"2024-09-12T18:37:21.479446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:38.544284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.475968+0000","last_change":"2024-09-12T18:35:25.663617+0000","last_active":"2024-09-12T18:37:21.475968+0000","last_peered":"2024-09-12T18:37:21.475968+0000","last_clean":"2024-09-12T18:37:21.475968+0000","last_became_active":"2024-09-12T18:35:25.661977+0000","last_became_peered":"2024-09-12T18:35:25.661977+0000","last_unstale":"2024-09-12T18:37:21.475968+0000","last_undegraded":"2024-09-12T18:37:21.475968+0000","last_fullsized":"2024-09-12T18:37:21.475968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:14.748234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.468893+0000","last_change":"2024-09-12T18:35:25.656566+0000","last_active":"2024-09-12T18:37:21.468893+0000","last_peered":"2024-09-12T18:37:21.468893+0000","last_clean":"2024-09-12T18:37:21.468893+0000","last_became_active":"2024-09-12T18:35:25.654898+0000","last_became_peered":"2024-09-12T18:35:25.654898+0000","last_unstale":"2024-09-12T18:37:21.468893+0000","last_undegraded":"2024-09-12T18:37:21.468893+0000","last_fullsized":"2024-09-12T18:37:21.468893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:36.113250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":117,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.475362+0000","last_change":"2024-09-12T18:36:40.067812+0000","last_active":"2024-09-12T18:37:21.475362+0000","last_peered":"2024-09-12T18:37:21.475362+0000","last_clean":"2024-09-12T18:37:21.475362+0000","last_became_active":"2024-09-12T18:36:40.067396+0000","last_became_peered":"2024-09-12T18:36:40.067396+0000","last_unstale":"2024-09-12T18:37:21.475362+0000","last_undegraded":"2024-09-12T18:37:21.475362+0000","last_fullsized":"2024-09-12T18:37:21.475362+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:46.485518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.475330+0000","last_change":"2024-09-12T18:35:25.659811+0000","last_active":"2024-09-12T18:37:21.475330+0000","last_peered":"2024-09-12T18:37:21.475330+0000","last_clean":"2024-09-12T18:37:21.475330+0000","last_became_active":"2024-09-12T18:35:25.658998+0000","last_became_peered":"2024-09-12T18:35:25.658998+0000","last_unstale":"2024-09-12T18:37:21.475330+0000","last_undegraded":"2024-09-12T18:37:21.475330+0000","last_fullsized":"2024-09-12T18:37:21.475330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":117,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.474688+0000","last_change":"2024-09-12T18:36:40.154635+0000","last_active":"2024-09-12T18:37:21.474688+0000","last_peered":"2024-09-12T18:37:21.474688+0000","last_clean":"2024-09-12T18:37:21.474688+0000","last_became_active":"2024-09-12T18:36:40.153818+0000","last_became_peered":"2024-09-12T18:36:40.153818+0000","last_unstale":"2024-09-12T18:37:21.474688+0000","last_undegraded":"2024-09-12T18:37:21.474688+0000","last_fullsized":"2024-09-12T18:37:21.474688+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:54.571879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.472594+0000","last_change":"2024-09-12T18:35:25.668339+0000","last_active":"2024-09-12T18:37:21.472594+0000","last_peered":"2024-09-12T18:37:21.472594+0000","last_clean":"2024-09-12T18:37:21.472594+0000","last_became_active":"2024-09-12T18:35:25.667608+0000","last_became_peered":"2024-09-12T18:35:25.667608+0000","last_unstale":"2024-09-12T18:37:21.472594+0000","last_undegraded":"2024-09-12T18:37:21.472594+0000","last_fullsized":"2024-09-12T18:37:21.472594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:15.699745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":117,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.469776+0000","last_change":"2024-09-12T18:36:40.075686+0000","last_active":"2024-09-12T18:37:21.469776+0000","last_peered":"2024-09-12T18:37:21.469776+0000","last_clean":"2024-09-12T18:37:21.469776+0000","last_became_active":"2024-09-12T18:36:40.072911+0000","last_became_peered":"2024-09-12T18:36:40.072911+0000","last_unstale":"2024-09-12T18:37:21.469776+0000","last_undegraded":"2024-09-12T18:37:21.469776+0000","last_fullsized":"2024-09-12T18:37:21.469776+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:24.687842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":117,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.479374+0000","last_change":"2024-09-12T18:36:39.072342+0000","last_active":"2024-09-12T18:37:21.479374+0000","last_peered":"2024-09-12T18:37:21.479374+0000","last_clean":"2024-09-12T18:37:21.479374+0000","last_became_active":"2024-09-12T18:36:39.071488+0000","last_became_peered":"2024-09-12T18:36:39.071488+0000","last_unstale":"2024-09-12T18:37:21.479374+0000","last_undegraded":"2024-09-12T18:37:21.479374+0000","last_fullsized":"2024-09-12T18:37:21.479374+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:27.845874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.469098+0000","last_change":"2024-09-12T18:35:25.649885+0000","last_active":"2024-09-12T18:37:21.469098+0000","last_peered":"2024-09-12T18:37:21.469098+0000","last_clean":"2024-09-12T18:37:21.469098+0000","last_became_active":"2024-09-12T18:35:25.649111+0000","last_became_peered":"2024-09-12T18:35:25.649111+0000","last_unstale":"2024-09-12T18:37:21.469098+0000","last_undegraded":"2024-09-12T18:37:21.469098+0000","last_fullsized":"2024-09-12T18:37:21.469098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:17.162410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":117,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.468783+0000","last_change":"2024-09-12T18:36:39.074873+0000","last_active":"2024-09-12T18:37:21.468783+0000","last_peered":"2024-09-12T18:37:21.468783+0000","last_clean":"2024-09-12T18:37:21.468783+0000","last_became_active":"2024-09-12T18:36:39.074049+0000","last_became_peered":"2024-09-12T18:36:39.074049+0000","last_unstale":"2024-09-12T18:37:21.468783+0000","last_undegraded":"2024-09-12T18:37:21.468783+0000","last_fullsized":"2024-09-12T18:37:21.468783+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:14.773044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.475533+0000","last_change":"2024-09-12T18:35:25.657913+0000","last_active":"2024-09-12T18:37:21.475533+0000","last_peered":"2024-09-12T18:37:21.475533+0000","last_clean":"2024-09-12T18:37:21.475533+0000","last_became_active":"2024-09-12T18:35:25.657082+0000","last_became_peered":"2024-09-12T18:35:25.657082+0000","last_unstale":"2024-09-12T18:37:21.475533+0000","last_undegraded":"2024-09-12T18:37:21.475533+0000","last_fullsized":"2024-09-12T18:37:21.475533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:21.538633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.475426+0000","last_change":"2024-09-12T18:35:25.658763+0000","last_active":"2024-09-12T18:37:21.475426+0000","last_peered":"2024-09-12T18:37:21.475426+0000","last_clean":"2024-09-12T18:37:21.475426+0000","last_became_active":"2024-09-12T18:35:25.657508+0000","last_became_peered":"2024-09-12T18:35:25.657508+0000","last_unstale":"2024-09-12T18:37:21.475426+0000","last_undegraded":"2024-09-12T18:37:21.475426+0000","last_fullsized":"2024-09-12T18:37:21.475426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:13.170519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.474714+0000","last_change":"2024-09-12T18:35:25.653730+0000","last_active":"2024-09-12T18:37:21.474714+0000","last_peered":"2024-09-12T18:37:21.474714+0000","last_clean":"2024-09-12T18:37:21.474714+0000","last_became_active":"2024-09-12T18:35:25.651535+0000","last_became_peered":"2024-09-12T18:35:25.651535+0000","last_unstale":"2024-09-12T18:37:21.474714+0000","last_undegraded":"2024-09-12T18:37:21.474714+0000","last_fullsized":"2024-09-12T18:37:21.474714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.472801+0000","last_change":"2024-09-12T18:35:25.656513+0000","last_active":"2024-09-12T18:37:21.472801+0000","last_peered":"2024-09-12T18:37:21.472801+0000","last_clean":"2024-09-12T18:37:21.472801+0000","last_became_active":"2024-09-12T18:35:25.653440+0000","last_became_peered":"2024-09-12T18:35:25.653440+0000","last_unstale":"2024-09-12T18:37:21.472801+0000","last_undegraded":"2024-09-12T18:37:21.472801+0000","last_fullsized":"2024-09-12T18:37:21.472801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:18.693161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.469943+0000","last_change":"2024-09-12T18:35:25.657991+0000","last_active":"2024-09-12T18:37:21.469943+0000","last_peered":"2024-09-12T18:37:21.469943+0000","last_clean":"2024-09-12T18:37:21.469943+0000","last_became_active":"2024-09-12T18:35:25.653934+0000","last_became_peered":"2024-09-12T18:35:25.653934+0000","last_unstale":"2024-09-12T18:37:21.469943+0000","last_undegraded":"2024-09-12T18:37:21.469943+0000","last_fullsized":"2024-09-12T18:37:21.469943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:05.418901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":50,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.471258+0000","last_change":"2024-09-12T18:36:39.075412+0000","last_active":"2024-09-12T18:37:21.471258+0000","last_peered":"2024-09-12T18:37:21.471258+0000","last_clean":"2024-09-12T18:37:21.471258+0000","last_became_active":"2024-09-12T18:36:39.074539+0000","last_became_peered":"2024-09-12T18:36:39.074539+0000","last_unstale":"2024-09-12T18:37:21.471258+0000","last_undegraded":"2024-09-12T18:37:21.471258+0000","last_fullsized":"2024-09-12T18:37:21.471258+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:34.322250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.476087+0000","last_change":"2024-09-12T18:35:25.661176+0000","last_active":"2024-09-12T18:37:21.476087+0000","last_peered":"2024-09-12T18:37:21.476087+0000","last_clean":"2024-09-12T18:37:21.476087+0000","last_became_active":"2024-09-12T18:35:25.659534+0000","last_became_peered":"2024-09-12T18:35:25.659534+0000","last_unstale":"2024-09-12T18:37:21.476087+0000","last_undegraded":"2024-09-12T18:37:21.476087+0000","last_fullsized":"2024-09-12T18:37:21.476087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:40.145442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.475502+0000","last_change":"2024-09-12T18:35:25.650632+0000","last_active":"2024-09-12T18:37:21.475502+0000","last_peered":"2024-09-12T18:37:21.475502+0000","last_clean":"2024-09-12T18:37:21.475502+0000","last_became_active":"2024-09-12T18:35:25.649333+0000","last_became_peered":"2024-09-12T18:35:25.649333+0000","last_unstale":"2024-09-12T18:37:21.475502+0000","last_undegraded":"2024-09-12T18:37:21.475502+0000","last_fullsized":"2024-09-12T18:37:21.475502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:30.537572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.472329+0000","last_change":"2024-09-12T18:35:25.648245+0000","last_active":"2024-09-12T18:37:21.472329+0000","last_peered":"2024-09-12T18:37:21.472329+0000","last_clean":"2024-09-12T18:37:21.472329+0000","last_became_active":"2024-09-12T18:35:25.646357+0000","last_became_peered":"2024-09-12T18:35:25.646357+0000","last_unstale":"2024-09-12T18:37:21.472329+0000","last_undegraded":"2024-09-12T18:37:21.472329+0000","last_fullsized":"2024-09-12T18:37:21.472329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:05.662140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.472169+0000","last_change":"2024-09-12T18:35:25.661613+0000","last_active":"2024-09-12T18:37:21.472169+0000","last_peered":"2024-09-12T18:37:21.472169+0000","last_clean":"2024-09-12T18:37:21.472169+0000","last_became_active":"2024-09-12T18:35:25.658833+0000","last_became_peered":"2024-09-12T18:35:25.658833+0000","last_unstale":"2024-09-12T18:37:21.472169+0000","last_undegraded":"2024-09-12T18:37:21.472169+0000","last_fullsized":"2024-09-12T18:37:21.472169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:51.064080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.470438+0000","last_change":"2024-09-12T18:35:25.657782+0000","last_active":"2024-09-12T18:37:21.470438+0000","last_peered":"2024-09-12T18:37:21.470438+0000","last_clean":"2024-09-12T18:37:21.470438+0000","last_became_active":"2024-09-12T18:35:25.655295+0000","last_became_peered":"2024-09-12T18:35:25.655295+0000","last_unstale":"2024-09-12T18:37:21.470438+0000","last_undegraded":"2024-09-12T18:37:21.470438+0000","last_fullsized":"2024-09-12T18:37:21.470438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:37.744175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.469775+0000","last_change":"2024-09-12T18:35:25.654863+0000","last_active":"2024-09-12T18:37:21.469775+0000","last_peered":"2024-09-12T18:37:21.469775+0000","last_clean":"2024-09-12T18:37:21.469775+0000","last_became_active":"2024-09-12T18:35:25.650407+0000","last_became_peered":"2024-09-12T18:35:25.650407+0000","last_unstale":"2024-09-12T18:37:21.469775+0000","last_undegraded":"2024-09-12T18:37:21.469775+0000","last_fullsized":"2024-09-12T18:37:21.469775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:38.395666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.472643+0000","last_change":"2024-09-12T18:35:25.662414+0000","last_active":"2024-09-12T18:37:21.472643+0000","last_peered":"2024-09-12T18:37:21.472643+0000","last_clean":"2024-09-12T18:37:21.472643+0000","last_became_active":"2024-09-12T18:35:25.660126+0000","last_became_peered":"2024-09-12T18:35:25.660126+0000","last_unstale":"2024-09-12T18:37:21.472643+0000","last_undegraded":"2024-09-12T18:37:21.472643+0000","last_fullsized":"2024-09-12T18:37:21.472643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:48.437139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.479295+0000","last_change":"2024-09-12T18:35:25.661523+0000","last_active":"2024-09-12T18:37:21.479295+0000","last_peered":"2024-09-12T18:37:21.479295+0000","last_clean":"2024-09-12T18:37:21.479295+0000","last_became_active":"2024-09-12T18:35:25.659338+0000","last_became_peered":"2024-09-12T18:35:25.659338+0000","last_unstale":"2024-09-12T18:37:21.479295+0000","last_undegraded":"2024-09-12T18:37:21.479295+0000","last_fullsized":"2024-09-12T18:37:21.479295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:37.083820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.469267+0000","last_change":"2024-09-12T18:35:25.662445+0000","last_active":"2024-09-12T18:37:21.469267+0000","last_peered":"2024-09-12T18:37:21.469267+0000","last_clean":"2024-09-12T18:37:21.469267+0000","last_became_active":"2024-09-12T18:35:25.659496+0000","last_became_peered":"2024-09-12T18:35:25.659496+0000","last_unstale":"2024-09-12T18:37:21.469267+0000","last_undegraded":"2024-09-12T18:37:21.469267+0000","last_fullsized":"2024-09-12T18:37:21.469267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:03.270420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":50,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.468743+0000","last_change":"2024-09-12T18:36:39.074532+0000","last_active":"2024-09-12T18:37:21.468743+0000","last_peered":"2024-09-12T18:37:21.468743+0000","last_clean":"2024-09-12T18:37:21.468743+0000","last_became_active":"2024-09-12T18:36:39.073676+0000","last_became_peered":"2024-09-12T18:36:39.073676+0000","last_unstale":"2024-09-12T18:37:21.468743+0000","last_undegraded":"2024-09-12T18:37:21.468743+0000","last_fullsized":"2024-09-12T18:37:21.468743+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:53.080797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.472440+0000","last_change":"2024-09-12T18:35:25.650507+0000","last_active":"2024-09-12T18:37:21.472440+0000","last_peered":"2024-09-12T18:37:21.472440+0000","last_clean":"2024-09-12T18:37:21.472440+0000","last_became_active":"2024-09-12T18:35:25.649415+0000","last_became_peered":"2024-09-12T18:35:25.649415+0000","last_unstale":"2024-09-12T18:37:21.472440+0000","last_undegraded":"2024-09-12T18:37:21.472440+0000","last_fullsized":"2024-09-12T18:37:21.472440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:23.081416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.472205+0000","last_change":"2024-09-12T18:35:25.653949+0000","last_active":"2024-09-12T18:37:21.472205+0000","last_peered":"2024-09-12T18:37:21.472205+0000","last_clean":"2024-09-12T18:37:21.472205+0000","last_became_active":"2024-09-12T18:35:25.652992+0000","last_became_peered":"2024-09-12T18:35:25.652992+0000","last_unstale":"2024-09-12T18:37:21.472205+0000","last_undegraded":"2024-09-12T18:37:21.472205+0000","last_fullsized":"2024-09-12T18:37:21.472205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:47.687372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":117,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.474778+0000","last_change":"2024-09-12T18:36:40.154958+0000","last_active":"2024-09-12T18:37:21.474778+0000","last_peered":"2024-09-12T18:37:21.474778+0000","last_clean":"2024-09-12T18:37:21.474778+0000","last_became_active":"2024-09-12T18:36:40.154422+0000","last_became_peered":"2024-09-12T18:36:40.154422+0000","last_unstale":"2024-09-12T18:37:21.474778+0000","last_undegraded":"2024-09-12T18:37:21.474778+0000","last_fullsized":"2024-09-12T18:37:21.474778+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:33.288844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":117,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.469227+0000","last_change":"2024-09-12T18:36:40.079440+0000","last_active":"2024-09-12T18:37:21.469227+0000","last_peered":"2024-09-12T18:37:21.469227+0000","last_clean":"2024-09-12T18:37:21.469227+0000","last_became_active":"2024-09-12T18:36:40.076955+0000","last_became_peered":"2024-09-12T18:36:40.076955+0000","last_unstale":"2024-09-12T18:37:21.469227+0000","last_undegraded":"2024-09-12T18:37:21.469227+0000","last_fullsized":"2024-09-12T18:37:21.469227+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:18.565373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":115,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.475858+0000","last_change":"2024-09-12T18:35:24.657739+0000","last_active":"2024-09-12T18:37:21.475858+0000","last_peered":"2024-09-12T18:37:21.475858+0000","last_clean":"2024-09-12T18:37:21.475858+0000","last_became_active":"2024-09-12T18:35:24.656208+0000","last_became_peered":"2024-09-12T18:35:24.656208+0000","last_unstale":"2024-09-12T18:37:21.475858+0000","last_undegraded":"2024-09-12T18:37:21.475858+0000","last_fullsized":"2024-09-12T18:37:21.475858+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:50.073716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.470883+0000","last_change":"2024-09-12T18:35:25.651651+0000","last_active":"2024-09-12T18:37:21.470883+0000","last_peered":"2024-09-12T18:37:21.470883+0000","last_clean":"2024-09-12T18:37:21.470883+0000","last_became_active":"2024-09-12T18:35:25.650849+0000","last_became_peered":"2024-09-12T18:35:25.650849+0000","last_unstale":"2024-09-12T18:37:21.470883+0000","last_undegraded":"2024-09-12T18:37:21.470883+0000","last_fullsized":"2024-09-12T18:37:21.470883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:18.555827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":113,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.473386+0000","last_change":"2024-09-12T18:35:24.656119+0000","last_active":"2024-09-12T18:37:21.473386+0000","last_peered":"2024-09-12T18:37:21.473386+0000","last_clean":"2024-09-12T18:37:21.473386+0000","last_became_active":"2024-09-12T18:35:24.653175+0000","last_became_peered":"2024-09-12T18:35:24.653175+0000","last_unstale":"2024-09-12T18:37:21.473386+0000","last_undegraded":"2024-09-12T18:37:21.473386+0000","last_fullsized":"2024-09-12T18:37:21.473386+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:00.551165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":48,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.475879+0000","last_change":"2024-09-12T18:36:40.090805+0000","last_active":"2024-09-12T18:37:21.475879+0000","last_peered":"2024-09-12T18:37:21.475879+0000","last_clean":"2024-09-12T18:37:21.475879+0000","last_became_active":"2024-09-12T18:36:40.090318+0000","last_became_peered":"2024-09-12T18:36:40.090318+0000","last_unstale":"2024-09-12T18:37:21.475879+0000","last_undegraded":"2024-09-12T18:37:21.475879+0000","last_fullsized":"2024-09-12T18:37:21.475879+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:15.103437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":113,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.470030+0000","last_change":"2024-09-12T18:35:24.640096+0000","last_active":"2024-09-12T18:37:21.470030+0000","last_peered":"2024-09-12T18:37:21.470030+0000","last_clean":"2024-09-12T18:37:21.470030+0000","last_became_active":"2024-09-12T18:35:24.638230+0000","last_became_peered":"2024-09-12T18:35:24.638230+0000","last_unstale":"2024-09-12T18:37:21.470030+0000","last_undegraded":"2024-09-12T18:37:21.470030+0000","last_fullsized":"2024-09-12T18:37:21.470030+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:38.435296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":48,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.475991+0000","last_change":"2024-09-12T18:36:40.075962+0000","last_active":"2024-09-12T18:37:21.475991+0000","last_peered":"2024-09-12T18:37:21.475991+0000","last_clean":"2024-09-12T18:37:21.475991+0000","last_became_active":"2024-09-12T18:36:40.075081+0000","last_became_peered":"2024-09-12T18:36:40.075081+0000","last_unstale":"2024-09-12T18:37:21.475991+0000","last_undegraded":"2024-09-12T18:37:21.475991+0000","last_fullsized":"2024-09-12T18:37:21.475991+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:00.410639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":121,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.474861+0000","last_change":"2024-09-12T18:35:24.653610+0000","last_active":"2024-09-12T18:37:21.474861+0000","last_peered":"2024-09-12T18:37:21.474861+0000","last_clean":"2024-09-12T18:37:21.474861+0000","last_became_active":"2024-09-12T18:35:24.652880+0000","last_became_peered":"2024-09-12T18:35:24.652880+0000","last_unstale":"2024-09-12T18:37:21.474861+0000","last_undegraded":"2024-09-12T18:37:21.474861+0000","last_fullsized":"2024-09-12T18:37:21.474861+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:57.636251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"68'12684","reported_seq":12787,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.523729+0000","last_change":"2024-09-12T18:35:44.771794+0000","last_active":"2024-09-12T18:37:21.523729+0000","last_peered":"2024-09-12T18:37:21.523729+0000","last_clean":"2024-09-12T18:37:21.523729+0000","last_became_active":"2024-09-12T18:35:44.771286+0000","last_became_peered":"2024-09-12T18:35:44.771286+0000","last_unstale":"2024-09-12T18:37:21.523729+0000","last_undegraded":"2024-09-12T18:37:21.523729+0000","last_fullsized":"2024-09-12T18:37:21.523729+0000","mapping_epoch":21,"log_start":"56'9653","ondisk_log_start":"56'9653","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3031,"log_dups_size":0,"ondisk_log_size":3031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:10.094729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254017536,"num_objects":3876,"num_object_clones":0,"num_object_copies":7752,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3876,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12684,"num_write_kb":529920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":114,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.476465+0000","last_change":"2024-09-12T18:35:24.653465+0000","last_active":"2024-09-12T18:37:21.476465+0000","last_peered":"2024-09-12T18:37:21.476465+0000","last_clean":"2024-09-12T18:37:21.476465+0000","last_became_active":"2024-09-12T18:35:24.652792+0000","last_became_peered":"2024-09-12T18:35:24.652792+0000","last_unstale":"2024-09-12T18:37:21.476465+0000","last_undegraded":"2024-09-12T18:37:21.476465+0000","last_fullsized":"2024-09-12T18:37:21.476465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:14.588993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.470386+0000","last_change":"2024-09-12T18:35:25.655426+0000","last_active":"2024-09-12T18:37:21.470386+0000","last_peered":"2024-09-12T18:37:21.470386+0000","last_clean":"2024-09-12T18:37:21.470386+0000","last_became_active":"2024-09-12T18:35:25.648186+0000","last_became_peered":"2024-09-12T18:35:25.648186+0000","last_unstale":"2024-09-12T18:37:21.470386+0000","last_undegraded":"2024-09-12T18:37:21.470386+0000","last_fullsized":"2024-09-12T18:37:21.470386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:48.802815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"68'12696","reported_seq":12799,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:23.526142+0000","last_change":"2024-09-12T18:35:44.767860+0000","last_active":"2024-09-12T18:37:23.526142+0000","last_peered":"2024-09-12T18:37:23.526142+0000","last_clean":"2024-09-12T18:37:23.526142+0000","last_became_active":"2024-09-12T18:35:44.766986+0000","last_became_peered":"2024-09-12T18:35:44.766986+0000","last_unstale":"2024-09-12T18:37:23.526142+0000","last_undegraded":"2024-09-12T18:37:23.526142+0000","last_fullsized":"2024-09-12T18:37:23.526142+0000","mapping_epoch":21,"log_start":"56'9435","ondisk_log_start":"56'9435","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3261,"log_dups_size":0,"ondisk_log_size":3261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:49.109157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":230948864,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12696,"num_write_kb":519040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":115,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.470129+0000","last_change":"2024-09-12T18:35:24.648439+0000","last_active":"2024-09-12T18:37:21.470129+0000","last_peered":"2024-09-12T18:37:21.470129+0000","last_clean":"2024-09-12T18:37:21.470129+0000","last_became_active":"2024-09-12T18:35:24.647629+0000","last_became_peered":"2024-09-12T18:35:24.647629+0000","last_unstale":"2024-09-12T18:37:21.470129+0000","last_undegraded":"2024-09-12T18:37:21.470129+0000","last_fullsized":"2024-09-12T18:37:21.470129+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:45.428223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.469861+0000","last_change":"2024-09-12T18:35:25.652496+0000","last_active":"2024-09-12T18:37:21.469861+0000","last_peered":"2024-09-12T18:37:21.469861+0000","last_clean":"2024-09-12T18:37:21.469861+0000","last_became_active":"2024-09-12T18:35:25.651628+0000","last_became_peered":"2024-09-12T18:35:25.651628+0000","last_unstale":"2024-09-12T18:37:21.469861+0000","last_undegraded":"2024-09-12T18:37:21.469861+0000","last_fullsized":"2024-09-12T18:37:21.469861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:44.920448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"68'13190","reported_seq":13293,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:23.550905+0000","last_change":"2024-09-12T18:35:44.767175+0000","last_active":"2024-09-12T18:37:23.550905+0000","last_peered":"2024-09-12T18:37:23.550905+0000","last_clean":"2024-09-12T18:37:23.550905+0000","last_became_active":"2024-09-12T18:35:44.766592+0000","last_became_peered":"2024-09-12T18:35:44.766592+0000","last_unstale":"2024-09-12T18:37:23.550905+0000","last_undegraded":"2024-09-12T18:37:23.550905+0000","last_fullsized":"2024-09-12T18:37:23.550905+0000","mapping_epoch":21,"log_start":"57'9948","ondisk_log_start":"57'9948","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3242,"log_dups_size":0,"ondisk_log_size":3242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:44.678279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":230162432,"num_objects":3512,"num_object_clones":0,"num_object_copies":7024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3512,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13190,"num_write_kb":534464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":114,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.478942+0000","last_change":"2024-09-12T18:35:24.654976+0000","last_active":"2024-09-12T18:37:21.478942+0000","last_peered":"2024-09-12T18:37:21.478942+0000","last_clean":"2024-09-12T18:37:21.478942+0000","last_became_active":"2024-09-12T18:35:24.654264+0000","last_became_peered":"2024-09-12T18:35:24.654264+0000","last_unstale":"2024-09-12T18:37:21.478942+0000","last_undegraded":"2024-09-12T18:37:21.478942+0000","last_fullsized":"2024-09-12T18:37:21.478942+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:00.115408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":117,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.475694+0000","last_change":"2024-09-12T18:36:40.070910+0000","last_active":"2024-09-12T18:37:21.475694+0000","last_peered":"2024-09-12T18:37:21.475694+0000","last_clean":"2024-09-12T18:37:21.475694+0000","last_became_active":"2024-09-12T18:36:40.070516+0000","last_became_peered":"2024-09-12T18:36:40.070516+0000","last_unstale":"2024-09-12T18:37:21.475694+0000","last_undegraded":"2024-09-12T18:37:21.475694+0000","last_fullsized":"2024-09-12T18:37:21.475694+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:23.962788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"68'12945","reported_seq":13048,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.515057+0000","last_change":"2024-09-12T18:35:44.763067+0000","last_active":"2024-09-12T18:37:21.515057+0000","last_peered":"2024-09-12T18:37:21.515057+0000","last_clean":"2024-09-12T18:37:21.515057+0000","last_became_active":"2024-09-12T18:35:44.762584+0000","last_became_peered":"2024-09-12T18:35:44.762584+0000","last_unstale":"2024-09-12T18:37:21.515057+0000","last_undegraded":"2024-09-12T18:37:21.515057+0000","last_fullsized":"2024-09-12T18:37:21.515057+0000","mapping_epoch":21,"log_start":"45'6900","ondisk_log_start":"45'6900","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":6045,"log_dups_size":0,"ondisk_log_size":6045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:47.847399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252379136,"num_objects":3851,"num_object_clones":0,"num_object_copies":7702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3851,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12945,"num_write_kb":537472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":113,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.476333+0000","last_change":"2024-09-12T18:35:24.657665+0000","last_active":"2024-09-12T18:37:21.476333+0000","last_peered":"2024-09-12T18:37:21.476333+0000","last_clean":"2024-09-12T18:37:21.476333+0000","last_became_active":"2024-09-12T18:35:24.657015+0000","last_became_peered":"2024-09-12T18:35:24.657015+0000","last_unstale":"2024-09-12T18:37:21.476333+0000","last_undegraded":"2024-09-12T18:37:21.476333+0000","last_fullsized":"2024-09-12T18:37:21.476333+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:03.171326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.473054+0000","last_change":"2024-09-12T18:35:25.665275+0000","last_active":"2024-09-12T18:37:21.473054+0000","last_peered":"2024-09-12T18:37:21.473054+0000","last_clean":"2024-09-12T18:37:21.473054+0000","last_became_active":"2024-09-12T18:35:25.659511+0000","last_became_peered":"2024-09-12T18:35:25.659511+0000","last_unstale":"2024-09-12T18:37:21.473054+0000","last_undegraded":"2024-09-12T18:37:21.473054+0000","last_fullsized":"2024-09-12T18:37:21.473054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"68'13160","reported_seq":13264,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:23.542432+0000","last_change":"2024-09-12T18:35:44.773526+0000","last_active":"2024-09-12T18:37:23.542432+0000","last_peered":"2024-09-12T18:37:23.542432+0000","last_clean":"2024-09-12T18:37:23.542432+0000","last_became_active":"2024-09-12T18:35:44.772974+0000","last_became_peered":"2024-09-12T18:35:44.772974+0000","last_unstale":"2024-09-12T18:37:23.542432+0000","last_undegraded":"2024-09-12T18:37:23.542432+0000","last_fullsized":"2024-09-12T18:37:23.542432+0000","mapping_epoch":21,"log_start":"57'9966","ondisk_log_start":"57'9966","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3194,"log_dups_size":0,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:23.676840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":236519448,"num_objects":3610,"num_object_clones":0,"num_object_copies":7220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3610,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13160,"num_write_kb":536577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":63,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.475472+0000","last_change":"2024-09-12T18:36:40.115783+0000","last_active":"2024-09-12T18:37:21.475472+0000","last_peered":"2024-09-12T18:37:21.475472+0000","last_clean":"2024-09-12T18:37:21.475472+0000","last_became_active":"2024-09-12T18:36:40.068020+0000","last_became_peered":"2024-09-12T18:36:40.068020+0000","last_unstale":"2024-09-12T18:37:21.475472+0000","last_undegraded":"2024-09-12T18:37:21.475472+0000","last_fullsized":"2024-09-12T18:37:21.475472+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:02.999068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":117,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.476125+0000","last_change":"2024-09-12T18:36:39.071809+0000","last_active":"2024-09-12T18:37:21.476125+0000","last_peered":"2024-09-12T18:37:21.476125+0000","last_clean":"2024-09-12T18:37:21.476125+0000","last_became_active":"2024-09-12T18:36:39.070888+0000","last_became_peered":"2024-09-12T18:36:39.070888+0000","last_unstale":"2024-09-12T18:37:21.476125+0000","last_undegraded":"2024-09-12T18:37:21.476125+0000","last_fullsized":"2024-09-12T18:37:21.476125+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:19.740732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"68'12633","reported_seq":12734,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.535409+0000","last_change":"2024-09-12T18:35:44.767970+0000","last_active":"2024-09-12T18:37:21.535409+0000","last_peered":"2024-09-12T18:37:21.535409+0000","last_clean":"2024-09-12T18:37:21.535409+0000","last_became_active":"2024-09-12T18:35:44.767348+0000","last_became_peered":"2024-09-12T18:35:44.767348+0000","last_unstale":"2024-09-12T18:37:21.535409+0000","last_undegraded":"2024-09-12T18:37:21.535409+0000","last_fullsized":"2024-09-12T18:37:21.535409+0000","mapping_epoch":21,"log_start":"45'6600","ondisk_log_start":"45'6600","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":6033,"log_dups_size":0,"ondisk_log_size":6033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:48.745907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246874112,"num_objects":3767,"num_object_clones":0,"num_object_copies":7534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3767,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12633,"num_write_kb":524800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":113,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.476021+0000","last_change":"2024-09-12T18:35:24.659019+0000","last_active":"2024-09-12T18:37:21.476021+0000","last_peered":"2024-09-12T18:37:21.476021+0000","last_clean":"2024-09-12T18:37:21.476021+0000","last_became_active":"2024-09-12T18:35:24.658423+0000","last_became_peered":"2024-09-12T18:35:24.658423+0000","last_unstale":"2024-09-12T18:37:21.476021+0000","last_undegraded":"2024-09-12T18:37:21.476021+0000","last_fullsized":"2024-09-12T18:37:21.476021+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:37.668417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.479090+0000","last_change":"2024-09-12T18:35:25.662287+0000","last_active":"2024-09-12T18:37:21.479090+0000","last_peered":"2024-09-12T18:37:21.479090+0000","last_clean":"2024-09-12T18:37:21.479090+0000","last_became_active":"2024-09-12T18:35:25.660372+0000","last_became_peered":"2024-09-12T18:35:25.660372+0000","last_unstale":"2024-09-12T18:37:21.479090+0000","last_undegraded":"2024-09-12T18:37:21.479090+0000","last_fullsized":"2024-09-12T18:37:21.479090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:08.729541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.f","version":"68'12630","reported_seq":12733,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.525871+0000","last_change":"2024-09-12T18:35:44.774817+0000","last_active":"2024-09-12T18:37:21.525871+0000","last_peered":"2024-09-12T18:37:21.525871+0000","last_clean":"2024-09-12T18:37:21.525871+0000","last_became_active":"2024-09-12T18:35:44.774429+0000","last_became_peered":"2024-09-12T18:35:44.774429+0000","last_unstale":"2024-09-12T18:37:21.525871+0000","last_undegraded":"2024-09-12T18:37:21.525871+0000","last_fullsized":"2024-09-12T18:37:21.525871+0000","mapping_epoch":21,"log_start":"56'9524","ondisk_log_start":"56'9524","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3106,"log_dups_size":0,"ondisk_log_size":3106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:21.579103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":241565696,"num_objects":3686,"num_object_clones":0,"num_object_copies":7372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3686,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12630,"num_write_kb":522112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":113,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.470110+0000","last_change":"2024-09-12T18:35:24.648330+0000","last_active":"2024-09-12T18:37:21.470110+0000","last_peered":"2024-09-12T18:37:21.470110+0000","last_clean":"2024-09-12T18:37:21.470110+0000","last_became_active":"2024-09-12T18:35:24.647520+0000","last_became_peered":"2024-09-12T18:35:24.647520+0000","last_unstale":"2024-09-12T18:37:21.470110+0000","last_undegraded":"2024-09-12T18:37:21.470110+0000","last_fullsized":"2024-09-12T18:37:21.470110+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:25.552055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.476086+0000","last_change":"2024-09-12T18:35:25.658674+0000","last_active":"2024-09-12T18:37:21.476086+0000","last_peered":"2024-09-12T18:37:21.476086+0000","last_clean":"2024-09-12T18:37:21.476086+0000","last_became_active":"2024-09-12T18:35:25.657386+0000","last_became_peered":"2024-09-12T18:35:25.657386+0000","last_unstale":"2024-09-12T18:37:21.476086+0000","last_undegraded":"2024-09-12T18:37:21.476086+0000","last_fullsized":"2024-09-12T18:37:21.476086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:48.037086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"68'13166","reported_seq":13269,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:23.548170+0000","last_change":"2024-09-12T18:35:44.771738+0000","last_active":"2024-09-12T18:37:23.548170+0000","last_peered":"2024-09-12T18:37:23.548170+0000","last_clean":"2024-09-12T18:37:23.548170+0000","last_became_active":"2024-09-12T18:35:44.771227+0000","last_became_peered":"2024-09-12T18:35:44.771227+0000","last_unstale":"2024-09-12T18:37:23.548170+0000","last_undegraded":"2024-09-12T18:37:23.548170+0000","last_fullsized":"2024-09-12T18:37:23.548170+0000","mapping_epoch":21,"log_start":"57'9893","ondisk_log_start":"57'9893","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3273,"log_dups_size":0,"ondisk_log_size":3273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:27.329732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":231735296,"num_objects":3536,"num_object_clones":0,"num_object_copies":7072,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3536,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13166,"num_write_kb":534464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":113,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.470349+0000","last_change":"2024-09-12T18:35:24.646810+0000","last_active":"2024-09-12T18:37:21.470349+0000","last_peered":"2024-09-12T18:37:21.470349+0000","last_clean":"2024-09-12T18:37:21.470349+0000","last_became_active":"2024-09-12T18:35:24.646008+0000","last_became_peered":"2024-09-12T18:35:24.646008+0000","last_unstale":"2024-09-12T18:37:21.470349+0000","last_undegraded":"2024-09-12T18:37:21.470349+0000","last_fullsized":"2024-09-12T18:37:21.470349+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:43.888776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.472626+0000","last_change":"2024-09-12T18:35:25.667710+0000","last_active":"2024-09-12T18:37:21.472626+0000","last_peered":"2024-09-12T18:37:21.472626+0000","last_clean":"2024-09-12T18:37:21.472626+0000","last_became_active":"2024-09-12T18:35:25.666940+0000","last_became_peered":"2024-09-12T18:35:25.666940+0000","last_unstale":"2024-09-12T18:37:21.472626+0000","last_undegraded":"2024-09-12T18:37:21.472626+0000","last_fullsized":"2024-09-12T18:37:21.472626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:09.823085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"68'12866","reported_seq":12969,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:23.539882+0000","last_change":"2024-09-12T18:35:44.769127+0000","last_active":"2024-09-12T18:37:23.539882+0000","last_peered":"2024-09-12T18:37:23.539882+0000","last_clean":"2024-09-12T18:37:23.539882+0000","last_became_active":"2024-09-12T18:35:44.768382+0000","last_became_peered":"2024-09-12T18:35:44.768382+0000","last_unstale":"2024-09-12T18:37:23.539882+0000","last_undegraded":"2024-09-12T18:37:23.539882+0000","last_fullsized":"2024-09-12T18:37:23.539882+0000","mapping_epoch":21,"log_start":"57'9629","ondisk_log_start":"57'9629","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3237,"log_dups_size":0,"ondisk_log_size":3237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:33.385476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":230686720,"num_objects":3520,"num_object_clones":0,"num_object_copies":7040,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3520,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12866,"num_write_kb":524352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":264,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.475008+0000","last_change":"2024-09-12T18:35:13.489018+0000","last_active":"2024-09-12T18:37:21.475008+0000","last_peered":"2024-09-12T18:37:21.475008+0000","last_clean":"2024-09-12T18:37:21.475008+0000","last_became_active":"2024-09-12T18:35:13.488346+0000","last_became_peered":"2024-09-12T18:35:13.488346+0000","last_unstale":"2024-09-12T18:37:21.475008+0000","last_undegraded":"2024-09-12T18:37:21.475008+0000","last_fullsized":"2024-09-12T18:37:21.475008+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_clean_scrub_stamp":"2024-09-12T18:35:12.464628+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:54.864640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":127,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.475979+0000","last_change":"2024-09-12T18:35:22.459694+0000","last_active":"2024-09-12T18:37:21.475979+0000","last_peered":"2024-09-12T18:37:21.475979+0000","last_clean":"2024-09-12T18:37:21.475979+0000","last_became_active":"2024-09-12T18:35:20.446796+0000","last_became_peered":"2024-09-12T18:35:20.446796+0000","last_unstale":"2024-09-12T18:37:21.475979+0000","last_undegraded":"2024-09-12T18:37:21.475979+0000","last_fullsized":"2024-09-12T18:37:21.475979+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:21.506024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016291610000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":50,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.472207+0000","last_change":"2024-09-12T18:36:39.072775+0000","last_active":"2024-09-12T18:37:21.472207+0000","last_peered":"2024-09-12T18:37:21.472207+0000","last_clean":"2024-09-12T18:37:21.472207+0000","last_became_active":"2024-09-12T18:36:39.072247+0000","last_became_peered":"2024-09-12T18:36:39.072247+0000","last_unstale":"2024-09-12T18:37:21.472207+0000","last_undegraded":"2024-09-12T18:37:21.472207+0000","last_fullsized":"2024-09-12T18:37:21.472207+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:07.105080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.479166+0000","last_change":"2024-09-12T18:35:25.662424+0000","last_active":"2024-09-12T18:37:21.479166+0000","last_peered":"2024-09-12T18:37:21.479166+0000","last_clean":"2024-09-12T18:37:21.479166+0000","last_became_active":"2024-09-12T18:35:25.661043+0000","last_became_peered":"2024-09-12T18:35:25.661043+0000","last_unstale":"2024-09-12T18:37:21.479166+0000","last_undegraded":"2024-09-12T18:37:21.479166+0000","last_fullsized":"2024-09-12T18:37:21.479166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:52.551802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.7","version":"68'12784","reported_seq":12887,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.521064+0000","last_change":"2024-09-12T18:35:44.774505+0000","last_active":"2024-09-12T18:37:21.521064+0000","last_peered":"2024-09-12T18:37:21.521064+0000","last_clean":"2024-09-12T18:37:21.521064+0000","last_became_active":"2024-09-12T18:35:44.774259+0000","last_became_peered":"2024-09-12T18:35:44.774259+0000","last_unstale":"2024-09-12T18:37:21.521064+0000","last_undegraded":"2024-09-12T18:37:21.521064+0000","last_fullsized":"2024-09-12T18:37:21.521064+0000","mapping_epoch":21,"log_start":"56'9669","ondisk_log_start":"56'9669","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3115,"log_dups_size":0,"ondisk_log_size":3115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:21.731670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251920384,"num_objects":3844,"num_object_clones":0,"num_object_copies":7688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3844,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12784,"num_write_kb":532096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":127,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.474990+0000","last_change":"2024-09-12T18:35:22.459090+0000","last_active":"2024-09-12T18:37:21.474990+0000","last_peered":"2024-09-12T18:37:21.474990+0000","last_clean":"2024-09-12T18:37:21.474990+0000","last_became_active":"2024-09-12T18:35:20.448553+0000","last_became_peered":"2024-09-12T18:35:20.448553+0000","last_unstale":"2024-09-12T18:37:21.474990+0000","last_undegraded":"2024-09-12T18:37:21.474990+0000","last_fullsized":"2024-09-12T18:37:21.474990+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:56.834808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001030836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":113,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.472356+0000","last_change":"2024-09-12T18:35:24.651597+0000","last_active":"2024-09-12T18:37:21.472356+0000","last_peered":"2024-09-12T18:37:21.472356+0000","last_clean":"2024-09-12T18:37:21.472356+0000","last_became_active":"2024-09-12T18:35:24.649940+0000","last_became_peered":"2024-09-12T18:35:24.649940+0000","last_unstale":"2024-09-12T18:37:21.472356+0000","last_undegraded":"2024-09-12T18:37:21.472356+0000","last_fullsized":"2024-09-12T18:37:21.472356+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:36.822432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":117,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.470046+0000","last_change":"2024-09-12T18:36:39.076901+0000","last_active":"2024-09-12T18:37:21.470046+0000","last_peered":"2024-09-12T18:37:21.470046+0000","last_clean":"2024-09-12T18:37:21.470046+0000","last_became_active":"2024-09-12T18:36:39.076178+0000","last_became_peered":"2024-09-12T18:36:39.076178+0000","last_unstale":"2024-09-12T18:37:21.470046+0000","last_undegraded":"2024-09-12T18:37:21.470046+0000","last_fullsized":"2024-09-12T18:37:21.470046+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:42.901643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"68'12763","reported_seq":12866,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.501434+0000","last_change":"2024-09-12T18:35:44.770379+0000","last_active":"2024-09-12T18:37:21.501434+0000","last_peered":"2024-09-12T18:37:21.501434+0000","last_clean":"2024-09-12T18:37:21.501434+0000","last_became_active":"2024-09-12T18:35:44.769739+0000","last_became_peered":"2024-09-12T18:35:44.769739+0000","last_unstale":"2024-09-12T18:37:21.501434+0000","last_undegraded":"2024-09-12T18:37:21.501434+0000","last_fullsized":"2024-09-12T18:37:21.501434+0000","mapping_epoch":21,"log_start":"45'6700","ondisk_log_start":"45'6700","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":6063,"log_dups_size":0,"ondisk_log_size":6063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:02:23.077263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247136256,"num_objects":3771,"num_object_clones":0,"num_object_copies":7542,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3771,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12763,"num_write_kb":529088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":126,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.472409+0000","last_change":"2024-09-12T18:35:22.464179+0000","last_active":"2024-09-12T18:37:21.472409+0000","last_peered":"2024-09-12T18:37:21.472409+0000","last_clean":"2024-09-12T18:37:21.472409+0000","last_became_active":"2024-09-12T18:35:20.442613+0000","last_became_peered":"2024-09-12T18:35:20.442613+0000","last_unstale":"2024-09-12T18:37:21.472409+0000","last_undegraded":"2024-09-12T18:37:21.472409+0000","last_fullsized":"2024-09-12T18:37:21.472409+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:17.636537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014134620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":113,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.470265+0000","last_change":"2024-09-12T18:35:24.641297+0000","last_active":"2024-09-12T18:37:21.470265+0000","last_peered":"2024-09-12T18:37:21.470265+0000","last_clean":"2024-09-12T18:37:21.470265+0000","last_became_active":"2024-09-12T18:35:24.637334+0000","last_became_peered":"2024-09-12T18:35:24.637334+0000","last_unstale":"2024-09-12T18:37:21.470265+0000","last_undegraded":"2024-09-12T18:37:21.470265+0000","last_fullsized":"2024-09-12T18:37:21.470265+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:50.772074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":48,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.469315+0000","last_change":"2024-09-12T18:36:40.073534+0000","last_active":"2024-09-12T18:37:21.469315+0000","last_peered":"2024-09-12T18:37:21.469315+0000","last_clean":"2024-09-12T18:37:21.469315+0000","last_became_active":"2024-09-12T18:36:40.071694+0000","last_became_peered":"2024-09-12T18:36:40.071694+0000","last_unstale":"2024-09-12T18:37:21.469315+0000","last_undegraded":"2024-09-12T18:37:21.469315+0000","last_fullsized":"2024-09-12T18:37:21.469315+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:16.018454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"68'12891","reported_seq":15008,"reported_epoch":68,"state":"active+remapped+backfilling","last_fresh":"2024-09-12T18:37:21.532225+0000","last_change":"2024-09-12T18:37:16.138383+0000","last_active":"2024-09-12T18:37:21.532225+0000","last_peered":"2024-09-12T18:37:21.532225+0000","last_clean":"2024-09-12T18:36:38.032256+0000","last_became_active":"2024-09-12T18:36:40.219923+0000","last_became_peered":"2024-09-12T18:36:40.219923+0000","last_unstale":"2024-09-12T18:37:21.532225+0000","last_undegraded":"2024-09-12T18:37:21.532225+0000","last_fullsized":"2024-09-12T18:37:21.532225+0000","mapping_epoch":49,"log_start":"56'9824","ondisk_log_start":"56'9824","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3067,"log_dups_size":0,"ondisk_log_size":3067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":253034496,"num_objects":3861,"num_object_clones":0,"num_object_copies":7722,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2952,"num_objects_unfound":0,"num_objects_dirty":3861,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12891,"num_write_kb":536064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1006,"num_bytes_recovered":65929216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[{"shards":"0,2","objects":3861}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":128,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.476063+0000","last_change":"2024-09-12T18:35:22.459049+0000","last_active":"2024-09-12T18:37:21.476063+0000","last_peered":"2024-09-12T18:37:21.476063+0000","last_clean":"2024-09-12T18:37:21.476063+0000","last_became_active":"2024-09-12T18:35:20.446814+0000","last_became_peered":"2024-09-12T18:35:20.446814+0000","last_unstale":"2024-09-12T18:37:21.476063+0000","last_undegraded":"2024-09-12T18:37:21.476063+0000","last_fullsized":"2024-09-12T18:37:21.476063+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:18.033595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010716149999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":113,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.475980+0000","last_change":"2024-09-12T18:35:24.658273+0000","last_active":"2024-09-12T18:37:21.475980+0000","last_peered":"2024-09-12T18:37:21.475980+0000","last_clean":"2024-09-12T18:37:21.475980+0000","last_became_active":"2024-09-12T18:35:24.657433+0000","last_became_peered":"2024-09-12T18:35:24.657433+0000","last_unstale":"2024-09-12T18:37:21.475980+0000","last_undegraded":"2024-09-12T18:37:21.475980+0000","last_fullsized":"2024-09-12T18:37:21.475980+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:48.497218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":48,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.468937+0000","last_change":"2024-09-12T18:36:40.076054+0000","last_active":"2024-09-12T18:37:21.468937+0000","last_peered":"2024-09-12T18:37:21.468937+0000","last_clean":"2024-09-12T18:37:21.468937+0000","last_became_active":"2024-09-12T18:36:40.073803+0000","last_became_peered":"2024-09-12T18:36:40.073803+0000","last_unstale":"2024-09-12T18:37:21.468937+0000","last_undegraded":"2024-09-12T18:37:21.468937+0000","last_fullsized":"2024-09-12T18:37:21.468937+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:49.085420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"68'12506","reported_seq":12609,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.523660+0000","last_change":"2024-09-12T18:35:44.770799+0000","last_active":"2024-09-12T18:37:21.523660+0000","last_peered":"2024-09-12T18:37:21.523660+0000","last_clean":"2024-09-12T18:37:21.523660+0000","last_became_active":"2024-09-12T18:35:44.770030+0000","last_became_peered":"2024-09-12T18:35:44.770030+0000","last_unstale":"2024-09-12T18:37:21.523660+0000","last_undegraded":"2024-09-12T18:37:21.523660+0000","last_fullsized":"2024-09-12T18:37:21.523660+0000","mapping_epoch":21,"log_start":"45'6500","ondisk_log_start":"45'6500","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":6006,"log_dups_size":0,"ondisk_log_size":6006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:24.786452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":244973568,"num_objects":3738,"num_object_clones":0,"num_object_copies":7476,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3738,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12506,"num_write_kb":519808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":113,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.478856+0000","last_change":"2024-09-12T18:35:24.657618+0000","last_active":"2024-09-12T18:37:21.478856+0000","last_peered":"2024-09-12T18:37:21.478856+0000","last_clean":"2024-09-12T18:37:21.478856+0000","last_became_active":"2024-09-12T18:35:24.656741+0000","last_became_peered":"2024-09-12T18:35:24.656741+0000","last_unstale":"2024-09-12T18:37:21.478856+0000","last_undegraded":"2024-09-12T18:37:21.478856+0000","last_fullsized":"2024-09-12T18:37:21.478856+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:43.113104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":126,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.473641+0000","last_change":"2024-09-12T18:35:22.464180+0000","last_active":"2024-09-12T18:37:21.473641+0000","last_peered":"2024-09-12T18:37:21.473641+0000","last_clean":"2024-09-12T18:37:21.473641+0000","last_became_active":"2024-09-12T18:35:20.442566+0000","last_became_peered":"2024-09-12T18:35:20.442566+0000","last_unstale":"2024-09-12T18:37:21.473641+0000","last_undegraded":"2024-09-12T18:37:21.473641+0000","last_fullsized":"2024-09-12T18:37:21.473641+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:29.021710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001325786,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.472332+0000","last_change":"2024-09-12T18:35:25.650458+0000","last_active":"2024-09-12T18:37:21.472332+0000","last_peered":"2024-09-12T18:37:21.472332+0000","last_clean":"2024-09-12T18:37:21.472332+0000","last_became_active":"2024-09-12T18:35:25.648761+0000","last_became_peered":"2024-09-12T18:35:25.648761+0000","last_unstale":"2024-09-12T18:37:21.472332+0000","last_undegraded":"2024-09-12T18:37:21.472332+0000","last_fullsized":"2024-09-12T18:37:21.472332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:53.026950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"68'12649","reported_seq":12752,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.515106+0000","last_change":"2024-09-12T18:35:44.773801+0000","last_active":"2024-09-12T18:37:21.515106+0000","last_peered":"2024-09-12T18:37:21.515106+0000","last_clean":"2024-09-12T18:37:21.515106+0000","last_became_active":"2024-09-12T18:35:44.772787+0000","last_became_peered":"2024-09-12T18:35:44.772787+0000","last_unstale":"2024-09-12T18:37:21.515106+0000","last_undegraded":"2024-09-12T18:37:21.515106+0000","last_fullsized":"2024-09-12T18:37:21.515106+0000","mapping_epoch":21,"log_start":"56'9582","ondisk_log_start":"56'9582","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3067,"log_dups_size":0,"ondisk_log_size":3067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:13.758208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":245825536,"num_objects":3751,"num_object_clones":0,"num_object_copies":7502,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3751,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12649,"num_write_kb":524800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.469138+0000","last_change":"2024-09-12T18:36:40.076936+0000","last_active":"2024-09-12T18:37:21.469138+0000","last_peered":"2024-09-12T18:37:21.469138+0000","last_clean":"2024-09-12T18:37:21.469138+0000","last_became_active":"2024-09-12T18:36:40.075987+0000","last_became_peered":"2024-09-12T18:36:40.075987+0000","last_unstale":"2024-09-12T18:37:21.469138+0000","last_undegraded":"2024-09-12T18:37:21.469138+0000","last_fullsized":"2024-09-12T18:37:21.469138+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:31.242588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":132,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.470511+0000","last_change":"2024-09-12T18:36:40.107062+0000","last_active":"2024-09-12T18:37:21.470511+0000","last_peered":"2024-09-12T18:37:21.470511+0000","last_clean":"2024-09-12T18:37:21.470511+0000","last_became_active":"2024-09-12T18:36:40.106366+0000","last_became_peered":"2024-09-12T18:36:40.106366+0000","last_unstale":"2024-09-12T18:37:21.470511+0000","last_undegraded":"2024-09-12T18:37:21.470511+0000","last_fullsized":"2024-09-12T18:37:21.470511+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:43.504139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080163599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.468845+0000","last_change":"2024-09-12T18:35:25.650717+0000","last_active":"2024-09-12T18:37:21.468845+0000","last_peered":"2024-09-12T18:37:21.468845+0000","last_clean":"2024-09-12T18:37:21.468845+0000","last_became_active":"2024-09-12T18:35:25.649147+0000","last_became_peered":"2024-09-12T18:35:25.649147+0000","last_unstale":"2024-09-12T18:37:21.468845+0000","last_undegraded":"2024-09-12T18:37:21.468845+0000","last_fullsized":"2024-09-12T18:37:21.468845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:07.365888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"68'12710","reported_seq":25756,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.526850+0000","last_change":"2024-09-12T18:37:17.275703+0000","last_active":"2024-09-12T18:37:21.526850+0000","last_peered":"2024-09-12T18:37:21.526850+0000","last_clean":"2024-09-12T18:37:21.526850+0000","last_became_active":"2024-09-12T18:37:17.230502+0000","last_became_peered":"2024-09-12T18:37:17.230502+0000","last_unstale":"2024-09-12T18:37:21.526850+0000","last_undegraded":"2024-09-12T18:37:21.526850+0000","last_fullsized":"2024-09-12T18:37:21.526850+0000","mapping_epoch":65,"log_start":"56'9601","ondisk_log_start":"56'9601","created":21,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3109,"log_dups_size":0,"ondisk_log_size":3109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:25.651321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247332864,"num_objects":3774,"num_object_clones":0,"num_object_copies":7548,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3774,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12710,"num_write_kb":527488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6464,"num_bytes_recovered":423624704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":115,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.472858+0000","last_change":"2024-09-12T18:35:24.657234+0000","last_active":"2024-09-12T18:37:21.472858+0000","last_peered":"2024-09-12T18:37:21.472858+0000","last_clean":"2024-09-12T18:37:21.472858+0000","last_became_active":"2024-09-12T18:35:24.655950+0000","last_became_peered":"2024-09-12T18:35:24.655950+0000","last_unstale":"2024-09-12T18:37:21.472858+0000","last_undegraded":"2024-09-12T18:37:21.472858+0000","last_fullsized":"2024-09-12T18:37:21.472858+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:17.466623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.470234+0000","last_change":"2024-09-12T18:36:40.076943+0000","last_active":"2024-09-12T18:37:21.470234+0000","last_peered":"2024-09-12T18:37:21.470234+0000","last_clean":"2024-09-12T18:37:21.470234+0000","last_became_active":"2024-09-12T18:36:40.075968+0000","last_became_peered":"2024-09-12T18:36:40.075968+0000","last_unstale":"2024-09-12T18:37:21.470234+0000","last_undegraded":"2024-09-12T18:37:21.470234+0000","last_fullsized":"2024-09-12T18:37:21.470234+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:41.716022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":50,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.474609+0000","last_change":"2024-09-12T18:36:39.071682+0000","last_active":"2024-09-12T18:37:21.474609+0000","last_peered":"2024-09-12T18:37:21.474609+0000","last_clean":"2024-09-12T18:37:21.474609+0000","last_became_active":"2024-09-12T18:36:39.070834+0000","last_became_peered":"2024-09-12T18:36:39.070834+0000","last_unstale":"2024-09-12T18:37:21.474609+0000","last_undegraded":"2024-09-12T18:37:21.474609+0000","last_fullsized":"2024-09-12T18:37:21.474609+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:58.394442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"68'13114","reported_seq":26211,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:23.551393+0000","last_change":"2024-09-12T18:37:17.272272+0000","last_active":"2024-09-12T18:37:23.551393+0000","last_peered":"2024-09-12T18:37:23.551393+0000","last_clean":"2024-09-12T18:37:23.551393+0000","last_became_active":"2024-09-12T18:37:17.229009+0000","last_became_peered":"2024-09-12T18:37:17.229009+0000","last_unstale":"2024-09-12T18:37:23.551393+0000","last_undegraded":"2024-09-12T18:37:23.551393+0000","last_fullsized":"2024-09-12T18:37:23.551393+0000","mapping_epoch":65,"log_start":"57'9828","ondisk_log_start":"57'9828","created":21,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3286,"log_dups_size":0,"ondisk_log_size":3286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:54.939350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":232128512,"num_objects":3542,"num_object_clones":0,"num_object_copies":7084,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3542,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13114,"num_write_kb":532992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6490,"num_bytes_recovered":425328640,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":66,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.475979+0000","last_change":"2024-09-12T18:36:40.122885+0000","last_active":"2024-09-12T18:37:21.475979+0000","last_peered":"2024-09-12T18:37:21.475979+0000","last_clean":"2024-09-12T18:37:21.475979+0000","last_became_active":"2024-09-12T18:36:40.090372+0000","last_became_peered":"2024-09-12T18:36:40.090372+0000","last_unstale":"2024-09-12T18:37:21.475979+0000","last_undegraded":"2024-09-12T18:37:21.475979+0000","last_fullsized":"2024-09-12T18:37:21.475979+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:55.648109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":126,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.476498+0000","last_change":"2024-09-12T18:35:22.459767+0000","last_active":"2024-09-12T18:37:21.476498+0000","last_peered":"2024-09-12T18:37:21.476498+0000","last_clean":"2024-09-12T18:37:21.476498+0000","last_became_active":"2024-09-12T18:35:20.448521+0000","last_became_peered":"2024-09-12T18:35:20.448521+0000","last_unstale":"2024-09-12T18:37:21.476498+0000","last_undegraded":"2024-09-12T18:37:21.476498+0000","last_fullsized":"2024-09-12T18:37:21.476498+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:33.463792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017009670000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.469943+0000","last_change":"2024-09-12T18:35:25.648150+0000","last_active":"2024-09-12T18:37:21.469943+0000","last_peered":"2024-09-12T18:37:21.469943+0000","last_clean":"2024-09-12T18:37:21.469943+0000","last_became_active":"2024-09-12T18:35:25.647347+0000","last_became_peered":"2024-09-12T18:35:25.647347+0000","last_unstale":"2024-09-12T18:37:21.469943+0000","last_undegraded":"2024-09-12T18:37:21.469943+0000","last_fullsized":"2024-09-12T18:37:21.469943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:48.968336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.475667+0000","last_change":"2024-09-12T18:35:25.660696+0000","last_active":"2024-09-12T18:37:21.475667+0000","last_peered":"2024-09-12T18:37:21.475667+0000","last_clean":"2024-09-12T18:37:21.475667+0000","last_became_active":"2024-09-12T18:35:25.659827+0000","last_became_peered":"2024-09-12T18:35:25.659827+0000","last_unstale":"2024-09-12T18:37:21.475667+0000","last_undegraded":"2024-09-12T18:37:21.475667+0000","last_fullsized":"2024-09-12T18:37:21.475667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:15.678289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":119,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.476230+0000","last_change":"2024-09-12T18:35:24.655051+0000","last_active":"2024-09-12T18:37:21.476230+0000","last_peered":"2024-09-12T18:37:21.476230+0000","last_clean":"2024-09-12T18:37:21.476230+0000","last_became_active":"2024-09-12T18:35:24.654282+0000","last_became_peered":"2024-09-12T18:35:24.654282+0000","last_unstale":"2024-09-12T18:37:21.476230+0000","last_undegraded":"2024-09-12T18:37:21.476230+0000","last_fullsized":"2024-09-12T18:37:21.476230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:08.159799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":48,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.468810+0000","last_change":"2024-09-12T18:36:40.073370+0000","last_active":"2024-09-12T18:37:21.468810+0000","last_peered":"2024-09-12T18:37:21.468810+0000","last_clean":"2024-09-12T18:37:21.468810+0000","last_became_active":"2024-09-12T18:36:40.071392+0000","last_became_peered":"2024-09-12T18:36:40.071392+0000","last_unstale":"2024-09-12T18:37:21.468810+0000","last_undegraded":"2024-09-12T18:37:21.468810+0000","last_fullsized":"2024-09-12T18:37:21.468810+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:32:33.237004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":116,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.470649+0000","last_change":"2024-09-12T18:35:24.648658+0000","last_active":"2024-09-12T18:37:21.470649+0000","last_peered":"2024-09-12T18:37:21.470649+0000","last_clean":"2024-09-12T18:37:21.470649+0000","last_became_active":"2024-09-12T18:35:24.647826+0000","last_became_peered":"2024-09-12T18:35:24.647826+0000","last_unstale":"2024-09-12T18:37:21.470649+0000","last_undegraded":"2024-09-12T18:37:21.470649+0000","last_fullsized":"2024-09-12T18:37:21.470649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:24.167549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":119,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.476259+0000","last_change":"2024-09-12T18:36:40.091223+0000","last_active":"2024-09-12T18:37:21.476259+0000","last_peered":"2024-09-12T18:37:21.476259+0000","last_clean":"2024-09-12T18:37:21.476259+0000","last_became_active":"2024-09-12T18:36:40.090813+0000","last_became_peered":"2024-09-12T18:36:40.090813+0000","last_unstale":"2024-09-12T18:37:21.476259+0000","last_undegraded":"2024-09-12T18:37:21.476259+0000","last_fullsized":"2024-09-12T18:37:21.476259+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:26.055034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.472259+0000","last_change":"2024-09-12T18:35:25.661801+0000","last_active":"2024-09-12T18:37:21.472259+0000","last_peered":"2024-09-12T18:37:21.472259+0000","last_clean":"2024-09-12T18:37:21.472259+0000","last_became_active":"2024-09-12T18:35:25.658476+0000","last_became_peered":"2024-09-12T18:35:25.658476+0000","last_unstale":"2024-09-12T18:37:21.472259+0000","last_undegraded":"2024-09-12T18:37:21.472259+0000","last_fullsized":"2024-09-12T18:37:21.472259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:58.246449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":113,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.472754+0000","last_change":"2024-09-12T18:35:24.652399+0000","last_active":"2024-09-12T18:37:21.472754+0000","last_peered":"2024-09-12T18:37:21.472754+0000","last_clean":"2024-09-12T18:37:21.472754+0000","last_became_active":"2024-09-12T18:35:24.651416+0000","last_became_peered":"2024-09-12T18:35:24.651416+0000","last_unstale":"2024-09-12T18:37:21.472754+0000","last_undegraded":"2024-09-12T18:37:21.472754+0000","last_fullsized":"2024-09-12T18:37:21.472754+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:32.594978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":50,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.470577+0000","last_change":"2024-09-12T18:36:39.073330+0000","last_active":"2024-09-12T18:37:21.470577+0000","last_peered":"2024-09-12T18:37:21.470577+0000","last_clean":"2024-09-12T18:37:21.470577+0000","last_became_active":"2024-09-12T18:36:39.072515+0000","last_became_peered":"2024-09-12T18:36:39.072515+0000","last_unstale":"2024-09-12T18:37:21.470577+0000","last_undegraded":"2024-09-12T18:37:21.470577+0000","last_fullsized":"2024-09-12T18:37:21.470577+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:17.697509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.469882+0000","last_change":"2024-09-12T18:35:25.651217+0000","last_active":"2024-09-12T18:37:21.469882+0000","last_peered":"2024-09-12T18:37:21.469882+0000","last_clean":"2024-09-12T18:37:21.469882+0000","last_became_active":"2024-09-12T18:35:25.649544+0000","last_became_peered":"2024-09-12T18:35:25.649544+0000","last_unstale":"2024-09-12T18:37:21.469882+0000","last_undegraded":"2024-09-12T18:37:21.469882+0000","last_fullsized":"2024-09-12T18:37:21.469882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:41.601376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":50,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.470234+0000","last_change":"2024-09-12T18:36:39.076239+0000","last_active":"2024-09-12T18:37:21.470234+0000","last_peered":"2024-09-12T18:37:21.470234+0000","last_clean":"2024-09-12T18:37:21.470234+0000","last_became_active":"2024-09-12T18:36:39.075023+0000","last_became_peered":"2024-09-12T18:36:39.075023+0000","last_unstale":"2024-09-12T18:37:21.470234+0000","last_undegraded":"2024-09-12T18:37:21.470234+0000","last_fullsized":"2024-09-12T18:37:21.470234+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:19.618576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.472569+0000","last_change":"2024-09-12T18:35:25.661544+0000","last_active":"2024-09-12T18:37:21.472569+0000","last_peered":"2024-09-12T18:37:21.472569+0000","last_clean":"2024-09-12T18:37:21.472569+0000","last_became_active":"2024-09-12T18:35:25.656985+0000","last_became_peered":"2024-09-12T18:35:25.656985+0000","last_unstale":"2024-09-12T18:37:21.472569+0000","last_undegraded":"2024-09-12T18:37:21.472569+0000","last_fullsized":"2024-09-12T18:37:21.472569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":50,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.475325+0000","last_change":"2024-09-12T18:36:39.073200+0000","last_active":"2024-09-12T18:37:21.475325+0000","last_peered":"2024-09-12T18:37:21.475325+0000","last_clean":"2024-09-12T18:37:21.475325+0000","last_became_active":"2024-09-12T18:36:39.072553+0000","last_became_peered":"2024-09-12T18:36:39.072553+0000","last_unstale":"2024-09-12T18:37:21.475325+0000","last_undegraded":"2024-09-12T18:37:21.475325+0000","last_fullsized":"2024-09-12T18:37:21.475325+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:02.283482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.471143+0000","last_change":"2024-09-12T18:35:25.656712+0000","last_active":"2024-09-12T18:37:21.471143+0000","last_peered":"2024-09-12T18:37:21.471143+0000","last_clean":"2024-09-12T18:37:21.471143+0000","last_became_active":"2024-09-12T18:35:25.654473+0000","last_became_peered":"2024-09-12T18:35:25.654473+0000","last_unstale":"2024-09-12T18:37:21.471143+0000","last_undegraded":"2024-09-12T18:37:21.471143+0000","last_fullsized":"2024-09-12T18:37:21.471143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:01.464680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":114,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.472461+0000","last_change":"2024-09-12T18:35:24.659935+0000","last_active":"2024-09-12T18:37:21.472461+0000","last_peered":"2024-09-12T18:37:21.472461+0000","last_clean":"2024-09-12T18:37:21.472461+0000","last_became_active":"2024-09-12T18:35:24.659111+0000","last_became_peered":"2024-09-12T18:35:24.659111+0000","last_unstale":"2024-09-12T18:37:21.472461+0000","last_undegraded":"2024-09-12T18:37:21.472461+0000","last_fullsized":"2024-09-12T18:37:21.472461+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:11.480154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":117,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.469185+0000","last_change":"2024-09-12T18:36:39.076804+0000","last_active":"2024-09-12T18:37:21.469185+0000","last_peered":"2024-09-12T18:37:21.469185+0000","last_clean":"2024-09-12T18:37:21.469185+0000","last_became_active":"2024-09-12T18:36:39.075916+0000","last_became_peered":"2024-09-12T18:36:39.075916+0000","last_unstale":"2024-09-12T18:37:21.469185+0000","last_undegraded":"2024-09-12T18:37:21.469185+0000","last_fullsized":"2024-09-12T18:37:21.469185+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:36.280719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":114,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.468937+0000","last_change":"2024-09-12T18:35:24.638538+0000","last_active":"2024-09-12T18:37:21.468937+0000","last_peered":"2024-09-12T18:37:21.468937+0000","last_clean":"2024-09-12T18:37:21.468937+0000","last_became_active":"2024-09-12T18:35:24.637242+0000","last_became_peered":"2024-09-12T18:35:24.637242+0000","last_unstale":"2024-09-12T18:37:21.468937+0000","last_undegraded":"2024-09-12T18:37:21.468937+0000","last_fullsized":"2024-09-12T18:37:21.468937+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:26.877441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.475570+0000","last_change":"2024-09-12T18:35:25.662537+0000","last_active":"2024-09-12T18:37:21.475570+0000","last_peered":"2024-09-12T18:37:21.475570+0000","last_clean":"2024-09-12T18:37:21.475570+0000","last_became_active":"2024-09-12T18:35:25.661441+0000","last_became_peered":"2024-09-12T18:35:25.661441+0000","last_unstale":"2024-09-12T18:37:21.475570+0000","last_undegraded":"2024-09-12T18:37:21.475570+0000","last_fullsized":"2024-09-12T18:37:21.475570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:14.397867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":125,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.476211+0000","last_change":"2024-09-12T18:36:39.091935+0000","last_active":"2024-09-12T18:37:21.476211+0000","last_peered":"2024-09-12T18:37:21.476211+0000","last_clean":"2024-09-12T18:37:21.476211+0000","last_became_active":"2024-09-12T18:36:39.071545+0000","last_became_peered":"2024-09-12T18:36:39.071545+0000","last_unstale":"2024-09-12T18:37:21.476211+0000","last_undegraded":"2024-09-12T18:37:21.476211+0000","last_fullsized":"2024-09-12T18:37:21.476211+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:35.815126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.475873+0000","last_change":"2024-09-12T18:35:25.651406+0000","last_active":"2024-09-12T18:37:21.475873+0000","last_peered":"2024-09-12T18:37:21.475873+0000","last_clean":"2024-09-12T18:37:21.475873+0000","last_became_active":"2024-09-12T18:35:25.649728+0000","last_became_peered":"2024-09-12T18:35:25.649728+0000","last_unstale":"2024-09-12T18:37:21.475873+0000","last_undegraded":"2024-09-12T18:37:21.475873+0000","last_fullsized":"2024-09-12T18:37:21.475873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:41.773283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":115,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.471017+0000","last_change":"2024-09-12T18:35:24.649153+0000","last_active":"2024-09-12T18:37:21.471017+0000","last_peered":"2024-09-12T18:37:21.471017+0000","last_clean":"2024-09-12T18:37:21.471017+0000","last_became_active":"2024-09-12T18:35:24.648512+0000","last_became_peered":"2024-09-12T18:35:24.648512+0000","last_unstale":"2024-09-12T18:37:21.471017+0000","last_undegraded":"2024-09-12T18:37:21.471017+0000","last_fullsized":"2024-09-12T18:37:21.471017+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:07.810456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.470197+0000","last_change":"2024-09-12T18:35:25.656799+0000","last_active":"2024-09-12T18:37:21.470197+0000","last_peered":"2024-09-12T18:37:21.470197+0000","last_clean":"2024-09-12T18:37:21.470197+0000","last_became_active":"2024-09-12T18:35:25.654980+0000","last_became_peered":"2024-09-12T18:35:25.654980+0000","last_unstale":"2024-09-12T18:37:21.470197+0000","last_undegraded":"2024-09-12T18:37:21.470197+0000","last_fullsized":"2024-09-12T18:37:21.470197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:10.735439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":114,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.472784+0000","last_change":"2024-09-12T18:35:24.656268+0000","last_active":"2024-09-12T18:37:21.472784+0000","last_peered":"2024-09-12T18:37:21.472784+0000","last_clean":"2024-09-12T18:37:21.472784+0000","last_became_active":"2024-09-12T18:35:24.655420+0000","last_became_peered":"2024-09-12T18:35:24.655420+0000","last_unstale":"2024-09-12T18:37:21.472784+0000","last_undegraded":"2024-09-12T18:37:21.472784+0000","last_fullsized":"2024-09-12T18:37:21.472784+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:04.654666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":117,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.474886+0000","last_change":"2024-09-12T18:36:40.154820+0000","last_active":"2024-09-12T18:37:21.474886+0000","last_peered":"2024-09-12T18:37:21.474886+0000","last_clean":"2024-09-12T18:37:21.474886+0000","last_became_active":"2024-09-12T18:36:40.154431+0000","last_became_peered":"2024-09-12T18:36:40.154431+0000","last_unstale":"2024-09-12T18:37:21.474886+0000","last_undegraded":"2024-09-12T18:37:21.474886+0000","last_fullsized":"2024-09-12T18:37:21.474886+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:04.432378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":67,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T18:37:21.476353+0000","last_change":"2024-09-12T18:36:39.087685+0000","last_active":"2024-09-12T18:37:21.476353+0000","last_peered":"2024-09-12T18:37:21.476353+0000","last_clean":"2024-09-12T18:37:21.476353+0000","last_became_active":"2024-09-12T18:36:39.071493+0000","last_became_peered":"2024-09-12T18:36:39.071493+0000","last_unstale":"2024-09-12T18:37:21.476353+0000","last_undegraded":"2024-09-12T18:37:21.476353+0000","last_fullsized":"2024-09-12T18:37:21.476353+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:13.765236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":3877240856,"num_objects":59163,"num_object_clones":0,"num_object_copies":118326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2952,"num_objects_unfound":0,"num_objects_dirty":59163,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":205387,"num_write_kb":8465537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13960,"num_bytes_recovered":914882560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":491511808,"data_stored":7864057904,"data_compressed":373492774,"data_compressed_allocated":491503616,"data_compressed_original":7864057856,"omap_allocated":0,"internal_metadata":0},"log_size":62135,"ondisk_log_size":62135,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705693,"num_pgs":94,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":403664,"kb_used_data":147580,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":93968176,"statfs":{"total":96636764160,"available":96223412224,"internally_reserved":0,"allocated":151121920,"data_stored":2405067796,"data_compressed":114219369,"data_compressed_allocated":150306816,"data_compressed_original":2404761600,"omap_allocated":1594,"internal_metadata":262207942},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738397,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":439284,"kb_used_data":169308,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":93932556,"statfs":{"total":96636764160,"available":96186937344,"internally_reserved":0,"allocated":173371392,"data_stored":2761120331,"data_compressed":131128089,"data_compressed_allocated":172560384,"data_compressed_original":2760818688,"omap_allocated":1595,"internal_metadata":276429253},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,9],"upper_bound":2048},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738397,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":439080,"kb_used_data":169092,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":93932760,"statfs":{"total":96636764160,"available":96187146240,"internally_reserved":0,"allocated":173150208,"data_stored":2758561483,"data_compressed":130999989,"data_compressed_allocated":172392448,"data_compressed_original":2758279168,"omap_allocated":1594,"internal_metadata":276429254},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,5,5],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":171053056,"data_stored":2736848896,"data_compressed":129982365,"data_compressed_allocated":171053056,"data_compressed_original":2736848896,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":149327872,"data_stored":2389180440,"data_compressed":113472010,"data_compressed_allocated":149323776,"data_compressed_original":2389180416,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":171130880,"data_stored":2738028568,"data_compressed":130038399,"data_compressed_allocated":171126784,"data_compressed_original":2738028544,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:37:26.525 INFO:tasks.thrashosds.thrasher:Setting 3.9 to [0, 1, 2] 2024-09-12T18:37:26.525 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '3.9', '0', '1', '2'] 2024-09-12T18:37:26.525 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 3.9 0 1 2 2024-09-12T18:37:26.531 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T18:37:26.552 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:26.552 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:26.572 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:37:26.583 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:26.578+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:26.684 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:26.678+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:26.772 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:26.772 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:26.784 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:26.778+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:26.794 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:37:26.885 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:26.878+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:26.899 INFO:teuthology.orchestra.run.smithi073.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2024-09-12T18:37:26.906 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T18:37:26.906 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2024-09-12T18:37:26.945 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:26.945 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:26.967 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:37:26.986 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:26.978+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:27.087 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:27.082+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:27.125 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:27.125 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:27.146 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:37:27.189 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:27.184+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:27.290 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:27.288+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:27.347 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:27.348 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:27.369 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:37:27.393 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:27.386+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:27.495 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:27.492+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:27.515 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is unset 2024-09-12T18:37:27.530 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:27.531 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:27.552 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:37:27.597 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:27.592+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:27.607 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:37:27.698 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:27.690+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:27.702 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:27.702 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:27.721 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:37:27.764 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:37:27.764 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:37:27.781 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:37:27.781 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:37:27.798 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:27.796+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:27.799 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:37:27.799 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:37:27.900 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:27.896+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:27.907 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:27.907 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2024-09-12T18:37:27.907 INFO:teuthology.orchestra.run.smithi114.stdout: "complaint_time": 30, 2024-09-12T18:37:27.908 INFO:teuthology.orchestra.run.smithi114.stdout: "num_blocked_ops": 0 2024-09-12T18:37:27.908 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:27.930 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:37:28.001 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:27.996+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:28.082 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:28.082 INFO:teuthology.orchestra.run.smithi114.stdout: "size": 20, 2024-09-12T18:37:28.082 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 600, 2024-09-12T18:37:28.082 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:37:28.082 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.082 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:26 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:28.082 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:37:28.082 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 122.449738334, 2024-09-12T18:37:28.082 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045702136999999997, 2024-09-12T18:37:28.082 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:28.083 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:28.083 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:28.083 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:28.083 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.083 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:28.083 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:37:28.083 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:28.083 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.083 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.083 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:28.083 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:37:28.083 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:28.083 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.083 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.084 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:28.084 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628699+0000", 2024-09-12T18:37:28.084 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3859999999999999e-06 2024-09-12T18:37:28.084 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.084 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.084 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:28.084 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628706+0000", 2024-09-12T18:37:28.084 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0169999999999999e-06 2024-09-12T18:37:28.084 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.084 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.084 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:28.084 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628725+0000", 2024-09-12T18:37:28.084 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8683000000000001e-05 2024-09-12T18:37:28.085 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.085 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.085 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.085 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628740+0000", 2024-09-12T18:37:28.085 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5413999999999998e-05 2024-09-12T18:37:28.085 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.085 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.085 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:28.085 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628907+0000", 2024-09-12T18:37:28.085 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00016670199999999999 2024-09-12T18:37:28.085 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.085 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.085 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:37:28.086 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628917+0000", 2024-09-12T18:37:28.086 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.046e-05 2024-09-12T18:37:28.086 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.086 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.086 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:28.086 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.660390+0000", 2024-09-12T18:37:28.086 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.031472364000000003 2024-09-12T18:37:28.086 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.086 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.086 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:28.086 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.661767+0000", 2024-09-12T18:37:28.086 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0013769190000000001 2024-09-12T18:37:28.086 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.086 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.087 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:28.087 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.662408+0000", 2024-09-12T18:37:28.087 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00064091099999999998 2024-09-12T18:37:28.087 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.087 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.087 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:28.087 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669577+0000", 2024-09-12T18:37:28.087 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.007169412 2024-09-12T18:37:28.087 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.087 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.087 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:28.087 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674244+0000", 2024-09-12T18:37:28.087 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0046671839999999996 2024-09-12T18:37:28.088 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.088 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.088 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:28.088 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674329+0000", 2024-09-12T18:37:28.088 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5276000000000001e-05 2024-09-12T18:37:28.088 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.088 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.088 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:28.088 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674400+0000", 2024-09-12T18:37:28.088 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0408999999999996e-05 2024-09-12T18:37:28.088 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:28.088 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:28.089 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:28.089 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.089 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.089 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:28.089 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:37:28.089 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 122.449314054, 2024-09-12T18:37:28.089 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.046431252999999999, 2024-09-12T18:37:28.089 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:28.089 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:28.089 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:28.089 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:28.089 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.089 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:28.090 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:37:28.090 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:28.090 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.090 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.090 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:28.090 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:37:28.090 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:28.090 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.090 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.090 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:28.090 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629123+0000", 2024-09-12T18:37:28.090 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0899999999999999e-06 2024-09-12T18:37:28.090 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.090 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.091 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:28.091 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629138+0000", 2024-09-12T18:37:28.091 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4977000000000001e-05 2024-09-12T18:37:28.091 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.091 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.091 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:28.091 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629149+0000", 2024-09-12T18:37:28.091 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1182999999999999e-05 2024-09-12T18:37:28.091 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.091 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.091 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.091 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629157+0000", 2024-09-12T18:37:28.091 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8129999999999996e-06 2024-09-12T18:37:28.091 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.092 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.092 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:28.092 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629223+0000", 2024-09-12T18:37:28.092 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6463000000000004e-05 2024-09-12T18:37:28.092 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.092 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.092 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:37:28.092 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629230+0000", 2024-09-12T18:37:28.092 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1360000000000002e-06 2024-09-12T18:37:28.092 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.092 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.092 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:28.093 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669605+0000", 2024-09-12T18:37:28.093 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.040375518999999999 2024-09-12T18:37:28.093 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.093 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.093 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:28.093 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669840+0000", 2024-09-12T18:37:28.093 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00023520099999999999 2024-09-12T18:37:28.094 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.094 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.094 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:28.094 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.675553+0000", 2024-09-12T18:37:28.094 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0057128709999999996 2024-09-12T18:37:28.094 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:28.094 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:28.094 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:28.094 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.094 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.094 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167352 5.a 5:5fc472d2:::benchmark_data_smithi073_23739_object35075:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:28.095 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.163066+0000", 2024-09-12T18:37:28.095 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 24.915370358000001, 2024-09-12T18:37:28.095 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.077708377999999995, 2024-09-12T18:37:28.095 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:28.095 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:28.095 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:28.095 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:28.095 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:28.095 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:28.095 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167352 2024-09-12T18:37:28.095 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.095 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:28.095 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.096 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:28.096 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163066+0000", 2024-09-12T18:37:28.096 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:28.096 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.096 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.096 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:28.096 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163066+0000", 2024-09-12T18:37:28.096 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:28.096 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.096 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.096 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:28.096 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163067+0000", 2024-09-12T18:37:28.097 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0499999999999999e-06 2024-09-12T18:37:28.097 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.097 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.097 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:28.097 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163071+0000", 2024-09-12T18:37:28.097 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4340000000000002e-06 2024-09-12T18:37:28.097 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.097 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.097 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:28.097 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163081+0000", 2024-09-12T18:37:28.097 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0304e-05 2024-09-12T18:37:28.097 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.098 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.098 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.098 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163090+0000", 2024-09-12T18:37:28.098 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7309999999999999e-06 2024-09-12T18:37:28.098 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.098 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.098 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:28.098 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163143+0000", 2024-09-12T18:37:28.098 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2942000000000002e-05 2024-09-12T18:37:28.098 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.098 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.098 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:28.098 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163270+0000", 2024-09-12T18:37:28.099 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012664100000000001 2024-09-12T18:37:28.099 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.099 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.099 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:28.099 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163378+0000", 2024-09-12T18:37:28.099 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000107995 2024-09-12T18:37:28.099 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.099 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.099 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:28.099 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234552+0000", 2024-09-12T18:37:28.099 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.071173831000000007 2024-09-12T18:37:28.099 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.099 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.099 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:28.100 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240640+0000", 2024-09-12T18:37:28.100 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.006088909 2024-09-12T18:37:28.100 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.100 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.100 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:28.100 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240709+0000", 2024-09-12T18:37:28.100 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8393999999999996e-05 2024-09-12T18:37:28.100 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.100 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.100 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:28.100 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240774+0000", 2024-09-12T18:37:28.100 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5147000000000005e-05 2024-09-12T18:37:28.101 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:28.101 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:28.101 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:28.101 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.101 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.101 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167358 5.a 5:533f6738:::benchmark_data_smithi073_23739_object35081:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:28.101 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.165639+0000", 2024-09-12T18:37:28.101 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 24.912797081000001, 2024-09-12T18:37:28.101 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.075287509000000002, 2024-09-12T18:37:28.101 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:28.101 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:28.101 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:28.101 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:28.102 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:28.102 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:28.102 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167358 2024-09-12T18:37:28.102 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.102 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:28.102 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.102 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:28.102 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165639+0000", 2024-09-12T18:37:28.102 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:28.102 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.102 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.102 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:28.102 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165639+0000", 2024-09-12T18:37:28.103 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:28.103 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.103 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.103 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:28.103 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165640+0000", 2024-09-12T18:37:28.103 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1999999999999999e-06 2024-09-12T18:37:28.103 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.103 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.103 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:28.103 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165646+0000", 2024-09-12T18:37:28.103 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4550000000000003e-06 2024-09-12T18:37:28.103 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.103 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.104 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:28.104 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165658+0000", 2024-09-12T18:37:28.104 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2721999999999999e-05 2024-09-12T18:37:28.104 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.104 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.104 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.104 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165668+0000", 2024-09-12T18:37:28.104 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4229999999999994e-06 2024-09-12T18:37:28.104 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.104 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.104 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:28.104 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165711+0000", 2024-09-12T18:37:28.104 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3785999999999997e-05 2024-09-12T18:37:28.105 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.105 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.105 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:28.105 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165788+0000", 2024-09-12T18:37:28.105 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6506000000000002e-05 2024-09-12T18:37:28.105 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.105 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.105 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:28.105 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165862+0000", 2024-09-12T18:37:28.105 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4012999999999998e-05 2024-09-12T18:37:28.105 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.105 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.105 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:28.106 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234718+0000", 2024-09-12T18:37:28.106 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.068856420000000002 2024-09-12T18:37:28.106 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.106 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.106 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:28.106 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240785+0000", 2024-09-12T18:37:28.106 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0060661489999999998 2024-09-12T18:37:28.106 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.106 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.106 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:28.106 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240844+0000", 2024-09-12T18:37:28.106 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9487000000000002e-05 2024-09-12T18:37:28.106 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.107 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.107 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:28.107 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240926+0000", 2024-09-12T18:37:28.107 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2348000000000005e-05 2024-09-12T18:37:28.107 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:28.107 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:28.107 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:28.107 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.107 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.107 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167361 5.a 5:56730f28:::benchmark_data_smithi073_23739_object35084:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:28.107 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.165979+0000", 2024-09-12T18:37:28.107 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 24.912457101000001, 2024-09-12T18:37:28.107 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.075128337000000003, 2024-09-12T18:37:28.107 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:28.108 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:28.108 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:28.108 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:28.108 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:28.108 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:28.108 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167361 2024-09-12T18:37:28.108 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.108 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:28.108 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.108 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:28.108 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165979+0000", 2024-09-12T18:37:28.108 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:28.108 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.109 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.109 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:28.109 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165979+0000", 2024-09-12T18:37:28.109 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:28.109 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.109 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.109 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:28.109 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165980+0000", 2024-09-12T18:37:28.109 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4499999999999997e-07 2024-09-12T18:37:28.109 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.109 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.109 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:28.109 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165985+0000", 2024-09-12T18:37:28.109 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.186e-06 2024-09-12T18:37:28.110 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.110 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.110 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:28.110 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165995+0000", 2024-09-12T18:37:28.110 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0378e-05 2024-09-12T18:37:28.110 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.110 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.110 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.110 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.166016+0000", 2024-09-12T18:37:28.110 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1316999999999999e-05 2024-09-12T18:37:28.110 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.110 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.110 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:28.111 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.167783+0000", 2024-09-12T18:37:28.111 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017662209999999999 2024-09-12T18:37:28.111 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.111 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.111 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:28.111 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.167851+0000", 2024-09-12T18:37:28.111 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7990000000000005e-05 2024-09-12T18:37:28.111 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.111 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.111 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:28.111 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.167929+0000", 2024-09-12T18:37:28.111 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8829e-05 2024-09-12T18:37:28.111 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.111 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.112 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:28.112 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234832+0000", 2024-09-12T18:37:28.112 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066902378999999998 2024-09-12T18:37:28.112 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.112 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.112 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:28.112 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240941+0000", 2024-09-12T18:37:28.112 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0061087470000000003 2024-09-12T18:37:28.112 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.112 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.112 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:28.112 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241053+0000", 2024-09-12T18:37:28.113 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00011197299999999999 2024-09-12T18:37:28.113 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.113 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.113 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:28.113 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241107+0000", 2024-09-12T18:37:28.113 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4672000000000001e-05 2024-09-12T18:37:28.113 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:28.113 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:28.113 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:28.113 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.113 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.113 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167362 5.3 5:cbd73b47:::benchmark_data_smithi073_23739_object35085:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:28.113 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:28.114 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 24.910360386000001, 2024-09-12T18:37:28.114 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.067202411000000004, 2024-09-12T18:37:28.114 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:28.114 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:28.114 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:28.114 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:28.114 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:28.114 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:28.114 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167362 2024-09-12T18:37:28.114 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.114 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:28.114 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.114 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:28.114 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:28.115 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:28.115 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.115 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.115 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:28.115 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:28.115 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:28.115 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.115 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.115 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:28.115 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:28.115 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3600000000000003e-07 2024-09-12T18:37:28.115 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.115 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.116 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:28.116 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168079+0000", 2024-09-12T18:37:28.116 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7949999999999999e-06 2024-09-12T18:37:28.116 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.116 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.116 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:28.116 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168085+0000", 2024-09-12T18:37:28.116 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2110000000000003e-06 2024-09-12T18:37:28.116 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.116 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.116 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.116 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168089+0000", 2024-09-12T18:37:28.117 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0840000000000002e-06 2024-09-12T18:37:28.117 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.117 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.117 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:28.117 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168121+0000", 2024-09-12T18:37:28.117 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.1489000000000003e-05 2024-09-12T18:37:28.117 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.117 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.117 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:28.117 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168186+0000", 2024-09-12T18:37:28.117 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5313000000000003e-05 2024-09-12T18:37:28.117 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.117 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.118 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:28.118 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168242+0000", 2024-09-12T18:37:28.118 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5560999999999999e-05 2024-09-12T18:37:28.118 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.118 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.118 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:28.118 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234467+0000", 2024-09-12T18:37:28.118 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066225424000000005 2024-09-12T18:37:28.118 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.118 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.118 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:28.118 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235088+0000", 2024-09-12T18:37:28.118 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00062118999999999998 2024-09-12T18:37:28.118 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.119 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.119 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:28.119 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235197+0000", 2024-09-12T18:37:28.119 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00010825899999999999 2024-09-12T18:37:28.119 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.119 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.119 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:28.119 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235278+0000", 2024-09-12T18:37:28.119 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1448999999999999e-05 2024-09-12T18:37:28.119 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:28.119 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:28.119 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:28.119 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.119 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.120 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167366 5.a 5:58e6a467:::benchmark_data_smithi073_23739_object35089:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:28.120 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168263+0000", 2024-09-12T18:37:28.120 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 24.910172848999999, 2024-09-12T18:37:28.120 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.078184744, 2024-09-12T18:37:28.120 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:28.120 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:28.120 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:28.120 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:28.120 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:28.120 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:28.120 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167366 2024-09-12T18:37:28.120 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.121 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:28.121 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.121 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:28.121 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168263+0000", 2024-09-12T18:37:28.121 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:28.121 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.121 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.121 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:28.121 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168263+0000", 2024-09-12T18:37:28.121 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:28.121 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.121 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.121 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:28.121 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168264+0000", 2024-09-12T18:37:28.122 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5700000000000002e-07 2024-09-12T18:37:28.122 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.122 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.122 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:28.122 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168266+0000", 2024-09-12T18:37:28.122 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1789999999999998e-06 2024-09-12T18:37:28.122 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.122 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.122 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:28.122 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168271+0000", 2024-09-12T18:37:28.122 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8160000000000001e-06 2024-09-12T18:37:28.122 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.122 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.122 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.123 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168275+0000", 2024-09-12T18:37:28.123 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4440000000000001e-06 2024-09-12T18:37:28.123 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.123 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.123 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:28.123 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170082+0000", 2024-09-12T18:37:28.123 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0018068800000000001 2024-09-12T18:37:28.123 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.123 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.123 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:28.123 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170154+0000", 2024-09-12T18:37:28.123 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1575000000000005e-05 2024-09-12T18:37:28.123 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.124 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.124 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:28.124 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170216+0000", 2024-09-12T18:37:28.124 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1989999999999994e-05 2024-09-12T18:37:28.124 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.124 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.124 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:28.124 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234933+0000", 2024-09-12T18:37:28.124 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064717514000000004 2024-09-12T18:37:28.124 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.124 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.124 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:28.124 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246226+0000", 2024-09-12T18:37:28.124 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011293151 2024-09-12T18:37:28.125 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.125 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.125 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:28.125 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246338+0000", 2024-09-12T18:37:28.125 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00011225 2024-09-12T18:37:28.125 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.125 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.125 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:28.125 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246448+0000", 2024-09-12T18:37:28.125 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000109388 2024-09-12T18:37:28.125 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:28.125 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:28.125 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:28.126 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.126 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.126 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167367 5.a 5:51778d97:::benchmark_data_smithi073_23739_object35090:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:28.126 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168388+0000", 2024-09-12T18:37:28.126 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 24.910047604999999, 2024-09-12T18:37:28.126 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.082583860999999995, 2024-09-12T18:37:28.126 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:28.126 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:28.126 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:28.126 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:28.126 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:28.126 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:28.126 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167367 2024-09-12T18:37:28.126 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.127 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:28.127 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.127 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:28.127 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168388+0000", 2024-09-12T18:37:28.127 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:28.127 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.127 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.127 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:28.127 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168388+0000", 2024-09-12T18:37:28.127 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:28.127 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.127 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.127 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:28.127 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168389+0000", 2024-09-12T18:37:28.128 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1099999999999996e-07 2024-09-12T18:37:28.128 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.128 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.128 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:28.128 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168391+0000", 2024-09-12T18:37:28.128 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.39e-06 2024-09-12T18:37:28.128 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.128 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.128 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:28.128 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168396+0000", 2024-09-12T18:37:28.128 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3460000000000004e-06 2024-09-12T18:37:28.128 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.128 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.128 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.129 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168399+0000", 2024-09-12T18:37:28.129 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.613e-06 2024-09-12T18:37:28.129 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.129 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.129 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:28.129 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235003+0000", 2024-09-12T18:37:28.129 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066603851000000006 2024-09-12T18:37:28.129 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.129 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.129 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:28.129 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235266+0000", 2024-09-12T18:37:28.129 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00026270999999999998 2024-09-12T18:37:28.129 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.130 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.130 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:28.130 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235510+0000", 2024-09-12T18:37:28.130 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00024394 2024-09-12T18:37:28.130 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.130 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.130 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:28.130 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246546+0000", 2024-09-12T18:37:28.130 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011035774 2024-09-12T18:37:28.130 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.130 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.130 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:28.130 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.250808+0000", 2024-09-12T18:37:28.131 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0042622700000000003 2024-09-12T18:37:28.131 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.131 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.131 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:28.131 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.250890+0000", 2024-09-12T18:37:28.131 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1874999999999998e-05 2024-09-12T18:37:28.131 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.131 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.131 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:28.131 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.250972+0000", 2024-09-12T18:37:28.131 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2581000000000001e-05 2024-09-12T18:37:28.131 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:28.131 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:28.131 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:28.132 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.132 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.132 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167370 5.a 5:5aab9477:::benchmark_data_smithi073_23739_object35093:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:28.132 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168603+0000", 2024-09-12T18:37:28.132 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 24.90983267, 2024-09-12T18:37:28.132 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.086603794999999997, 2024-09-12T18:37:28.132 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:28.132 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:28.132 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:28.132 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:28.132 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:28.132 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:28.132 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167370 2024-09-12T18:37:28.133 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.133 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:28.133 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.133 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:28.133 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168603+0000", 2024-09-12T18:37:28.133 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:28.133 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.133 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.133 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:28.133 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168603+0000", 2024-09-12T18:37:28.133 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:28.133 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.133 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.133 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:28.134 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168604+0000", 2024-09-12T18:37:28.134 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.1899999999999998e-07 2024-09-12T18:37:28.134 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.134 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.134 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:28.134 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168606+0000", 2024-09-12T18:37:28.134 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8309999999999999e-06 2024-09-12T18:37:28.134 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.134 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.134 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:28.134 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168610+0000", 2024-09-12T18:37:28.134 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8069999999999999e-06 2024-09-12T18:37:28.134 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.135 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.135 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.135 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168613+0000", 2024-09-12T18:37:28.135 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.118e-06 2024-09-12T18:37:28.135 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.135 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.135 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:28.135 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241145+0000", 2024-09-12T18:37:28.135 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.072531678000000002 2024-09-12T18:37:28.135 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.135 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.135 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:28.135 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241342+0000", 2024-09-12T18:37:28.135 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00019635900000000001 2024-09-12T18:37:28.136 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.136 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.136 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:28.136 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241483+0000", 2024-09-12T18:37:28.136 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014161100000000001 2024-09-12T18:37:28.136 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.136 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.136 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:28.136 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255039+0000", 2024-09-12T18:37:28.136 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013555724 2024-09-12T18:37:28.136 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.136 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.136 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:28.137 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255062+0000", 2024-09-12T18:37:28.137 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.3042000000000001e-05 2024-09-12T18:37:28.137 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.137 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.137 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:28.137 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255143+0000", 2024-09-12T18:37:28.137 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0999000000000002e-05 2024-09-12T18:37:28.137 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.137 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.137 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:28.137 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255207+0000", 2024-09-12T18:37:28.137 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4207000000000004e-05 2024-09-12T18:37:28.137 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:28.138 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:28.138 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:28.138 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.138 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.138 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167352 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:28.138 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:28.138 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 24.909708016, 2024-09-12T18:37:28.138 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065859953999999998, 2024-09-12T18:37:28.138 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:28.138 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:28.138 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:28.138 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:28.139 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.139 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:28.139 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:28.139 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:28.139 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.139 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.139 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:28.139 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:28.139 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:28.139 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.139 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.139 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:28.139 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:28.140 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.0800000000000001e-07 2024-09-12T18:37:28.140 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.140 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.140 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:28.140 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168730+0000", 2024-09-12T18:37:28.140 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6530000000000001e-06 2024-09-12T18:37:28.140 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.140 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.140 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:28.140 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168734+0000", 2024-09-12T18:37:28.140 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.721e-06 2024-09-12T18:37:28.140 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.140 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.141 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.141 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168736+0000", 2024-09-12T18:37:28.141 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.508e-06 2024-09-12T18:37:28.141 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.141 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.141 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:28.141 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171951+0000", 2024-09-12T18:37:28.141 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.003215281 2024-09-12T18:37:28.141 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.141 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.141 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:28.141 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234520+0000", 2024-09-12T18:37:28.141 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062568676000000004 2024-09-12T18:37:28.141 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.142 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.142 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:28.142 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234588+0000", 2024-09-12T18:37:28.142 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7806999999999996e-05 2024-09-12T18:37:28.142 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:28.142 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:28.142 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:28.142 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.142 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.142 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167368 5.4 e58/21 5:29a1ec58:::benchmark_data_smithi073_23739_object35091:head v 58'10399, mlcod=58'10396)", 2024-09-12T18:37:28.142 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:28.142 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 24.909584999, 2024-09-12T18:37:28.142 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066008885000000003, 2024-09-12T18:37:28.143 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:28.143 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:28.143 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:28.143 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:28.143 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.143 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:28.143 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:28.143 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:28.143 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.143 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.143 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:28.143 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:28.143 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:28.143 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.144 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.144 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:28.144 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:28.144 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4699999999999998e-07 2024-09-12T18:37:28.144 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.144 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.144 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:28.144 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168854+0000", 2024-09-12T18:37:28.144 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.3180000000000001e-06 2024-09-12T18:37:28.144 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.144 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.144 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:28.144 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168858+0000", 2024-09-12T18:37:28.145 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2799999999999997e-06 2024-09-12T18:37:28.145 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.145 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.145 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.145 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168861+0000", 2024-09-12T18:37:28.145 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7650000000000002e-06 2024-09-12T18:37:28.145 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.145 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.145 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:28.145 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168895+0000", 2024-09-12T18:37:28.145 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4533999999999998e-05 2024-09-12T18:37:28.145 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.145 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.146 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:28.146 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168906+0000", 2024-09-12T18:37:28.146 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0910000000000001e-05 2024-09-12T18:37:28.146 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.146 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.146 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:28.146 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234784+0000", 2024-09-12T18:37:28.146 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065877656000000007 2024-09-12T18:37:28.146 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.146 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.146 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:28.146 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234860+0000", 2024-09-12T18:37:28.146 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6174999999999995e-05 2024-09-12T18:37:28.147 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:28.147 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:28.147 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:28.147 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.147 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.147 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167358 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:28.147 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.170373+0000", 2024-09-12T18:37:28.147 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 24.908062718, 2024-09-12T18:37:28.147 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064370201000000002, 2024-09-12T18:37:28.147 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:28.147 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:28.147 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:28.147 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:28.147 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.148 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:28.148 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170373+0000", 2024-09-12T18:37:28.148 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:28.148 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.148 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.148 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:28.148 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170373+0000", 2024-09-12T18:37:28.148 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:28.148 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.148 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.148 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:28.148 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170374+0000", 2024-09-12T18:37:28.148 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5799999999999998e-07 2024-09-12T18:37:28.149 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.149 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.149 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:28.149 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170378+0000", 2024-09-12T18:37:28.149 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.732e-06 2024-09-12T18:37:28.149 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.149 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.149 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:28.149 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170388+0000", 2024-09-12T18:37:28.149 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0212e-05 2024-09-12T18:37:28.149 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.149 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.149 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.150 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170397+0000", 2024-09-12T18:37:28.150 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7090000000000008e-06 2024-09-12T18:37:28.150 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.150 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.150 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:28.150 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234682+0000", 2024-09-12T18:37:28.150 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064285518999999999 2024-09-12T18:37:28.150 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.150 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.150 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:28.150 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234703+0000", 2024-09-12T18:37:28.150 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.0199000000000001e-05 2024-09-12T18:37:28.150 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.150 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.151 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:28.151 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234743+0000", 2024-09-12T18:37:28.151 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0972e-05 2024-09-12T18:37:28.151 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:28.151 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:28.151 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:28.151 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.151 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.151 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167372 5.c 5:398d36a7:::benchmark_data_smithi073_23739_object35095:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:28.151 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171066+0000", 2024-09-12T18:37:28.151 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 24.907369505999998, 2024-09-12T18:37:28.151 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065889534999999999, 2024-09-12T18:37:28.151 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:28.152 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:28.152 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:28.152 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:28.152 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:28.152 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:28.152 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167372 2024-09-12T18:37:28.152 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.152 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:28.152 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.152 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:28.152 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171066+0000", 2024-09-12T18:37:28.152 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:28.152 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.153 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.153 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:28.153 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171066+0000", 2024-09-12T18:37:28.153 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:28.153 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.153 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.153 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:28.153 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171068+0000", 2024-09-12T18:37:28.153 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.186e-06 2024-09-12T18:37:28.153 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.153 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.153 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:28.153 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171072+0000", 2024-09-12T18:37:28.153 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3560000000000003e-06 2024-09-12T18:37:28.154 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.154 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.154 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:28.154 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171082+0000", 2024-09-12T18:37:28.154 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.9739999999999997e-06 2024-09-12T18:37:28.154 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.154 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.154 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.154 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171089+0000", 2024-09-12T18:37:28.154 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7159999999999997e-06 2024-09-12T18:37:28.154 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.154 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.154 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:28.154 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171133+0000", 2024-09-12T18:37:28.155 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4091999999999997e-05 2024-09-12T18:37:28.155 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.155 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.155 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:28.155 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171221+0000", 2024-09-12T18:37:28.155 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.8108000000000004e-05 2024-09-12T18:37:28.155 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.155 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.155 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:28.155 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171279+0000", 2024-09-12T18:37:28.155 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8062000000000001e-05 2024-09-12T18:37:28.155 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.156 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.156 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:28.156 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235007+0000", 2024-09-12T18:37:28.156 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.063727849000000003 2024-09-12T18:37:28.156 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.156 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.156 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:28.156 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236790+0000", 2024-09-12T18:37:28.156 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017829269999999999 2024-09-12T18:37:28.156 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.156 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.156 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:28.156 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236881+0000", 2024-09-12T18:37:28.157 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1347999999999993e-05 2024-09-12T18:37:28.157 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.157 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.157 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:28.157 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236956+0000", 2024-09-12T18:37:28.157 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4917000000000001e-05 2024-09-12T18:37:28.157 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:28.157 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:28.157 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:28.157 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.157 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.157 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167371 5.4 e58/21 5:24fea27c:::benchmark_data_smithi073_23739_object35094:head v 58'10400, mlcod=58'10397)", 2024-09-12T18:37:28.157 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171273+0000", 2024-09-12T18:37:28.157 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 24.907162931999999, 2024-09-12T18:37:28.158 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065500368000000003, 2024-09-12T18:37:28.158 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:28.158 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:28.158 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:28.158 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:28.158 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.158 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:28.158 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171273+0000", 2024-09-12T18:37:28.158 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:28.158 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.158 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.158 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:28.158 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171273+0000", 2024-09-12T18:37:28.159 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:28.159 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.159 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.159 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:28.159 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171274+0000", 2024-09-12T18:37:28.159 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0399999999999996e-07 2024-09-12T18:37:28.159 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.159 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.159 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:28.159 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171277+0000", 2024-09-12T18:37:28.159 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8689999999999997e-06 2024-09-12T18:37:28.159 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.159 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.159 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:28.160 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171284+0000", 2024-09-12T18:37:28.160 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2879999999999998e-06 2024-09-12T18:37:28.160 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.160 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.160 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.160 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171289+0000", 2024-09-12T18:37:28.160 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9049999999999996e-06 2024-09-12T18:37:28.160 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.160 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.160 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:28.160 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171322+0000", 2024-09-12T18:37:28.160 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3781000000000001e-05 2024-09-12T18:37:28.160 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.161 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.161 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:28.161 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171335+0000", 2024-09-12T18:37:28.161 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2639999999999999e-05 2024-09-12T18:37:28.161 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.161 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.161 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:28.161 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236691+0000", 2024-09-12T18:37:28.161 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065355835000000001 2024-09-12T18:37:28.161 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.161 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.161 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:28.161 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236773+0000", 2024-09-12T18:37:28.161 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2546000000000006e-05 2024-09-12T18:37:28.162 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:28.162 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:28.162 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:28.162 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.162 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.162 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167364 5.7 e58/21 5:ee50096a:::benchmark_data_smithi073_23739_object35087:head v 58'10504, mlcod=58'10502)", 2024-09-12T18:37:28.162 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171598+0000", 2024-09-12T18:37:28.162 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 24.906837812999999, 2024-09-12T18:37:28.162 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065149069000000004, 2024-09-12T18:37:28.162 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:28.162 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:28.162 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:28.162 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:28.163 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.163 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:28.163 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171598+0000", 2024-09-12T18:37:28.163 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:28.163 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.163 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.163 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:28.163 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171598+0000", 2024-09-12T18:37:28.163 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:28.163 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.163 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.163 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:28.164 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171599+0000", 2024-09-12T18:37:28.164 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6700000000000003e-07 2024-09-12T18:37:28.164 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.164 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.164 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:28.164 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171602+0000", 2024-09-12T18:37:28.164 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.841e-06 2024-09-12T18:37:28.164 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.164 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.164 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:28.164 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171608+0000", 2024-09-12T18:37:28.164 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9259999999999997e-06 2024-09-12T18:37:28.165 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.165 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.165 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.165 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171611+0000", 2024-09-12T18:37:28.165 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.9450000000000003e-06 2024-09-12T18:37:28.165 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.165 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.165 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:28.165 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171650+0000", 2024-09-12T18:37:28.165 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8464000000000003e-05 2024-09-12T18:37:28.165 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.165 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.166 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:28.166 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171662+0000", 2024-09-12T18:37:28.166 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1603999999999999e-05 2024-09-12T18:37:28.166 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.166 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.166 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:28.166 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236663+0000", 2024-09-12T18:37:28.166 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065001330999999996 2024-09-12T18:37:28.166 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.166 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.166 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:28.166 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236747+0000", 2024-09-12T18:37:28.166 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.4390999999999999e-05 2024-09-12T18:37:28.166 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:28.167 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:28.167 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:28.167 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.167 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.167 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167365 5.2 e58/21 5:4107875c:::benchmark_data_smithi073_23739_object35088:head v 58'10351, mlcod=58'10349)", 2024-09-12T18:37:28.167 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171733+0000", 2024-09-12T18:37:28.167 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 24.906702767999999, 2024-09-12T18:37:28.167 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.074804168000000004, 2024-09-12T18:37:28.167 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:28.167 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:28.167 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:28.167 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:28.167 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.168 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:28.168 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171733+0000", 2024-09-12T18:37:28.168 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:28.168 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.168 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.168 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:28.168 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171733+0000", 2024-09-12T18:37:28.168 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:28.168 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.168 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.168 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:28.168 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171734+0000", 2024-09-12T18:37:28.168 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9299999999999998e-07 2024-09-12T18:37:28.168 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.169 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.169 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:28.169 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171738+0000", 2024-09-12T18:37:28.169 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.301e-06 2024-09-12T18:37:28.169 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.169 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.169 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:28.169 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171746+0000", 2024-09-12T18:37:28.169 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.554e-06 2024-09-12T18:37:28.169 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.169 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.169 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.170 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171751+0000", 2024-09-12T18:37:28.170 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1880000000000001e-06 2024-09-12T18:37:28.170 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.170 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.170 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:28.170 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234659+0000", 2024-09-12T18:37:28.170 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062907807999999996 2024-09-12T18:37:28.170 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.170 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.170 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:28.170 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234708+0000", 2024-09-12T18:37:28.170 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8992000000000001e-05 2024-09-12T18:37:28.170 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.171 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.171 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:28.171 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246457+0000", 2024-09-12T18:37:28.171 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.01174974 2024-09-12T18:37:28.171 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.171 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.171 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:28.171 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246537+0000", 2024-09-12T18:37:28.171 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.9992000000000003e-05 2024-09-12T18:37:28.171 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:28.171 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:28.171 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:28.171 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.171 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.172 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167373 5.5 e58/49 5:ad283029:::benchmark_data_smithi073_23739_object35096:head v 58'10600, mlcod=58'10598)", 2024-09-12T18:37:28.172 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:28.172 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 24.906675283999999, 2024-09-12T18:37:28.172 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065058240000000003, 2024-09-12T18:37:28.172 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:28.172 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:28.172 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:28.172 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:28.172 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.172 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:28.172 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:28.172 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:28.173 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.173 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.173 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:28.173 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:28.173 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:28.173 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.173 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.173 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:28.173 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:28.173 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.2899999999999999e-07 2024-09-12T18:37:28.173 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.173 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.173 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:28.174 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171764+0000", 2024-09-12T18:37:28.174 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7310000000000002e-06 2024-09-12T18:37:28.174 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.174 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.174 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:28.174 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171769+0000", 2024-09-12T18:37:28.174 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.079e-06 2024-09-12T18:37:28.174 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.174 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.174 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.174 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171774+0000", 2024-09-12T18:37:28.174 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.48e-06 2024-09-12T18:37:28.174 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.175 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.175 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:28.175 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171819+0000", 2024-09-12T18:37:28.175 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4391999999999998e-05 2024-09-12T18:37:28.175 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.175 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.175 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:28.175 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171841+0000", 2024-09-12T18:37:28.175 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2245000000000001e-05 2024-09-12T18:37:28.175 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.175 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.175 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:28.175 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236750+0000", 2024-09-12T18:37:28.175 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064909123999999999 2024-09-12T18:37:28.176 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.176 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.176 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:28.176 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236819+0000", 2024-09-12T18:37:28.176 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8860000000000001e-05 2024-09-12T18:37:28.176 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:28.176 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:28.176 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:28.176 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.176 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.176 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167361 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:28.176 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:28.177 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 24.906619377999998, 2024-09-12T18:37:28.177 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.063049426000000006, 2024-09-12T18:37:28.177 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:28.177 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:28.177 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:28.177 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:28.177 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.177 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:28.177 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:28.177 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:28.177 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.177 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.177 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:28.177 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:28.178 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:28.178 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.178 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.178 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:28.178 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:28.178 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.9099999999999999e-07 2024-09-12T18:37:28.178 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.178 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.178 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:28.178 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171820+0000", 2024-09-12T18:37:28.178 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.5900000000000002e-06 2024-09-12T18:37:28.178 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.179 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.179 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:28.179 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171826+0000", 2024-09-12T18:37:28.179 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.64e-06 2024-09-12T18:37:28.179 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.179 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.179 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.179 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171831+0000", 2024-09-12T18:37:28.179 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.578e-06 2024-09-12T18:37:28.179 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.179 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.179 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:28.179 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234808+0000", 2024-09-12T18:37:28.179 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062976780999999996 2024-09-12T18:37:28.180 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.180 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.180 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:28.180 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234821+0000", 2024-09-12T18:37:28.180 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3002e-05 2024-09-12T18:37:28.180 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.180 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.180 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:28.180 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234866+0000", 2024-09-12T18:37:28.180 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5444000000000001e-05 2024-09-12T18:37:28.180 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:28.180 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:28.180 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:28.181 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.181 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.181 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167366 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:28.181 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.172133+0000", 2024-09-12T18:37:28.181 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 24.906302549999999, 2024-09-12T18:37:28.181 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062815840999999997, 2024-09-12T18:37:28.181 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:28.181 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:28.181 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:28.181 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:28.181 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.181 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:28.181 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172133+0000", 2024-09-12T18:37:28.182 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:28.182 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.182 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.182 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:28.182 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172133+0000", 2024-09-12T18:37:28.182 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:28.182 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.182 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.182 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:28.182 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172134+0000", 2024-09-12T18:37:28.182 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5000000000000003e-07 2024-09-12T18:37:28.182 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.183 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.183 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:28.183 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172137+0000", 2024-09-12T18:37:28.183 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.6460000000000002e-06 2024-09-12T18:37:28.183 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.183 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.183 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:28.183 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234511+0000", 2024-09-12T18:37:28.183 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062374603000000001 2024-09-12T18:37:28.183 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.183 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.183 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.183 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234525+0000", 2024-09-12T18:37:28.184 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3396e-05 2024-09-12T18:37:28.184 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.184 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.184 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:28.184 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234909+0000", 2024-09-12T18:37:28.184 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00038405299999999998 2024-09-12T18:37:28.184 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.184 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.184 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:28.184 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234922+0000", 2024-09-12T18:37:28.184 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3274e-05 2024-09-12T18:37:28.184 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.184 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.185 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:28.185 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234949+0000", 2024-09-12T18:37:28.185 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7319000000000001e-05 2024-09-12T18:37:28.185 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:28.185 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:28.185 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:28.185 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.185 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.185 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167369 5.7 e58/21 5:e64ecabd:::benchmark_data_smithi073_23739_object35092:head v 58'10505, mlcod=58'10502)", 2024-09-12T18:37:28.185 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:28.185 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 24.904772158, 2024-09-12T18:37:28.185 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.063873773999999994, 2024-09-12T18:37:28.185 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:28.185 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:28.186 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:28.186 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:28.186 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.186 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:28.186 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:28.186 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:28.186 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.186 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.186 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:28.186 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:28.186 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:28.186 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.186 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.187 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:28.187 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:28.187 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3500000000000002e-07 2024-09-12T18:37:28.187 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.187 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.187 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:28.187 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173668+0000", 2024-09-12T18:37:28.187 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4000000000000001e-06 2024-09-12T18:37:28.187 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.187 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.187 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:28.187 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234583+0000", 2024-09-12T18:37:28.187 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.060914889 2024-09-12T18:37:28.187 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.188 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.188 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.188 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234600+0000", 2024-09-12T18:37:28.188 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7192000000000001e-05 2024-09-12T18:37:28.188 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.188 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.188 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:28.188 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234791+0000", 2024-09-12T18:37:28.189 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00019115000000000001 2024-09-12T18:37:28.189 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.189 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.189 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:28.189 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234834+0000", 2024-09-12T18:37:28.189 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3296e-05 2024-09-12T18:37:28.189 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.189 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.189 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:28.189 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.237481+0000", 2024-09-12T18:37:28.189 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0026472050000000001 2024-09-12T18:37:28.189 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:28.189 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:28.190 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:28.190 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.237538+0000", 2024-09-12T18:37:28.190 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6206999999999999e-05 2024-09-12T18:37:28.190 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:28.190 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:28.190 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:28.190 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:28.190 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:28.190 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:28.191 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:37:28.192 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:28.188+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:28.292 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:28.286+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:28.346 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:28.347 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:37:28.347 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.347 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:218635 5.a e70/21 5:5e8181f3:::benchmark_data_smithi073_23739_object86358:head v 70'13859, mlcod=70'13857)", 2024-09-12T18:37:28.347 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:28.335824+0000", 2024-09-12T18:37:28.347 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0079887829999999993, 2024-09-12T18:37:28.347 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0080073060000000005, 2024-09-12T18:37:28.347 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:28.347 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:28.347 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:37:28.347 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:28.347 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.347 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:28.348 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.335824+0000", 2024-09-12T18:37:28.348 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.348 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.348 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.348 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:28.348 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.335824+0000", 2024-09-12T18:37:28.348 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.348 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.348 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.348 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:28.348 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.335825+0000", 2024-09-12T18:37:28.348 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.23e-07 2024-09-12T18:37:28.348 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.349 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.349 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:28.349 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.335830+0000", 2024-09-12T18:37:28.349 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2310000000000004e-06 2024-09-12T18:37:28.349 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.349 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.349 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:28.349 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.335842+0000", 2024-09-12T18:37:28.349 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1385e-05 2024-09-12T18:37:28.349 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.349 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.349 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.349 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.335848+0000", 2024-09-12T18:37:28.349 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8909999999999998e-06 2024-09-12T18:37:28.350 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.350 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.350 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:28.350 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.335909+0000", 2024-09-12T18:37:28.350 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0325999999999998e-05 2024-09-12T18:37:28.350 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.350 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.350 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:28.350 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.335929+0000", 2024-09-12T18:37:28.350 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0344e-05 2024-09-12T18:37:28.350 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.350 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:28.350 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.351 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.351 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.351 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:218644 5.0 5:000d4604:::benchmark_data_smithi073_23739_object86367:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-12T18:37:28.351 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:28.340721+0000", 2024-09-12T18:37:28.351 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0030922929999999999, 2024-09-12T18:37:28.351 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031488140000000002, 2024-09-12T18:37:28.351 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:28.351 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:28.351 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:28.351 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:28.351 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:28.351 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:28.351 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 218644 2024-09-12T18:37:28.352 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.352 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:28.352 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.352 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:28.352 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.340721+0000", 2024-09-12T18:37:28.352 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.352 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.352 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.352 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:28.352 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.340721+0000", 2024-09-12T18:37:28.352 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.352 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.352 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.353 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:28.353 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.340722+0000", 2024-09-12T18:37:28.353 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.097e-06 2024-09-12T18:37:28.353 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.353 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.353 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:28.353 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.340725+0000", 2024-09-12T18:37:28.353 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.614e-06 2024-09-12T18:37:28.353 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.353 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.353 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:28.353 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.340733+0000", 2024-09-12T18:37:28.354 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4499999999999998e-06 2024-09-12T18:37:28.354 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.354 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.354 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.354 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.340739+0000", 2024-09-12T18:37:28.354 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0920000000000003e-06 2024-09-12T18:37:28.354 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.354 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.354 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:28.354 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.340798+0000", 2024-09-12T18:37:28.354 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8958e-05 2024-09-12T18:37:28.354 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.354 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.355 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:28.355 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.340960+0000", 2024-09-12T18:37:28.355 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000162397 2024-09-12T18:37:28.355 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.355 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.355 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:28.355 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.341091+0000", 2024-09-12T18:37:28.355 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013044 2024-09-12T18:37:28.355 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.355 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:28.355 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.355 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.356 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.356 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:218645 5.0 5:05188deb:::benchmark_data_smithi073_23739_object86368:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-12T18:37:28.356 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:28.340758+0000", 2024-09-12T18:37:28.356 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0030550339999999999, 2024-09-12T18:37:28.356 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0031513779999999998, 2024-09-12T18:37:28.356 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:28.356 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:28.356 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:28.356 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:28.356 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:28.356 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:28.356 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 218645 2024-09-12T18:37:28.356 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.357 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:28.357 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.357 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:28.357 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.340758+0000", 2024-09-12T18:37:28.357 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.357 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.357 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.357 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:28.357 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.340758+0000", 2024-09-12T18:37:28.357 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.357 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.357 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.357 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:28.357 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.340758+0000", 2024-09-12T18:37:28.358 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9200000000000002e-07 2024-09-12T18:37:28.358 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.358 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.358 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:28.358 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.340760+0000", 2024-09-12T18:37:28.358 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.623e-06 2024-09-12T18:37:28.358 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.358 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.358 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:28.358 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.340769+0000", 2024-09-12T18:37:28.358 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5859999999999994e-06 2024-09-12T18:37:28.358 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.358 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.359 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.359 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.340773+0000", 2024-09-12T18:37:28.359 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.535e-06 2024-09-12T18:37:28.359 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.359 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.359 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:28.359 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.342936+0000", 2024-09-12T18:37:28.359 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0021627389999999999 2024-09-12T18:37:28.359 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.359 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.359 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:28.359 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.343047+0000", 2024-09-12T18:37:28.359 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000111227 2024-09-12T18:37:28.359 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.360 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.360 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:28.360 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.343148+0000", 2024-09-12T18:37:28.360 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000100671 2024-09-12T18:37:28.360 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.360 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:28.360 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.360 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.360 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.360 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:218641 5.5 e70/49 5:a53917f8:::benchmark_data_smithi073_23739_object86364:head v 70'13824, mlcod=70'13821)", 2024-09-12T18:37:28.360 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:28.340806+0000", 2024-09-12T18:37:28.360 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.003006454, 2024-09-12T18:37:28.360 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003135779, 2024-09-12T18:37:28.361 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:28.361 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:28.361 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:37:28.361 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:28.361 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.361 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:28.361 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.340806+0000", 2024-09-12T18:37:28.361 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.361 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.361 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.361 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:28.361 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.340806+0000", 2024-09-12T18:37:28.361 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.362 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.362 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.362 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:28.362 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.340807+0000", 2024-09-12T18:37:28.362 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7399999999999999e-07 2024-09-12T18:37:28.362 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.362 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.362 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:28.362 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.340810+0000", 2024-09-12T18:37:28.362 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2059999999999999e-06 2024-09-12T18:37:28.362 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.362 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.362 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:28.363 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.340815+0000", 2024-09-12T18:37:28.363 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6229999999999996e-06 2024-09-12T18:37:28.363 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.363 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.363 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.363 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.340819+0000", 2024-09-12T18:37:28.363 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0960000000000003e-06 2024-09-12T18:37:28.363 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.363 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.363 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:28.363 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.341318+0000", 2024-09-12T18:37:28.363 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00049940800000000001 2024-09-12T18:37:28.363 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.363 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.364 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:28.364 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.341339+0000", 2024-09-12T18:37:28.364 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0599e-05 2024-09-12T18:37:28.364 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.364 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:28.364 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.364 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.364 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.364 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:218646 5.1 e70/65 5:8a718594:::benchmark_data_smithi073_23739_object86369:head v 70'13620, mlcod=70'13618)", 2024-09-12T18:37:28.364 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:28.341130+0000", 2024-09-12T18:37:28.364 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0026824399999999999, 2024-09-12T18:37:28.364 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0028392840000000001, 2024-09-12T18:37:28.365 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:28.365 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:28.365 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:37:28.365 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:28.365 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.365 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:28.365 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.341130+0000", 2024-09-12T18:37:28.365 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.365 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.365 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.365 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:28.365 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.341130+0000", 2024-09-12T18:37:28.366 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.366 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.366 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.366 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:28.366 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.341131+0000", 2024-09-12T18:37:28.366 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0699999999999998e-07 2024-09-12T18:37:28.366 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.366 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.366 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:28.366 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.341135+0000", 2024-09-12T18:37:28.366 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9439999999999998e-06 2024-09-12T18:37:28.366 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.366 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.367 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:28.367 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.341141+0000", 2024-09-12T18:37:28.367 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5910000000000001e-06 2024-09-12T18:37:28.367 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.367 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.367 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.367 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.341145+0000", 2024-09-12T18:37:28.367 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2959999999999999e-06 2024-09-12T18:37:28.367 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.367 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.367 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:28.367 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.341199+0000", 2024-09-12T18:37:28.367 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4184000000000002e-05 2024-09-12T18:37:28.368 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.368 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.368 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:28.368 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.341221+0000", 2024-09-12T18:37:28.368 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1942000000000001e-05 2024-09-12T18:37:28.368 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.368 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:28.368 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.368 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.368 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.368 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:218643 5.f e70/21 5:f80e5a15:::benchmark_data_smithi073_23739_object86366:head v 70'13555, mlcod=70'13552)", 2024-09-12T18:37:28.368 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:28.341237+0000", 2024-09-12T18:37:28.369 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00257617, 2024-09-12T18:37:28.369 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0027594350000000002, 2024-09-12T18:37:28.369 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:28.369 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:28.369 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:37:28.369 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:28.369 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.369 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:28.369 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.341237+0000", 2024-09-12T18:37:28.369 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.369 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.369 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.369 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:28.370 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.341237+0000", 2024-09-12T18:37:28.370 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.370 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.370 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.370 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:28.370 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.341237+0000", 2024-09-12T18:37:28.370 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5499999999999998e-07 2024-09-12T18:37:28.370 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.370 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.370 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:28.370 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.341242+0000", 2024-09-12T18:37:28.370 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.369e-06 2024-09-12T18:37:28.370 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.370 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.371 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:28.371 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.341250+0000", 2024-09-12T18:37:28.371 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.14e-06 2024-09-12T18:37:28.371 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.371 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.371 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.371 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.341255+0000", 2024-09-12T18:37:28.371 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2079999999999999e-06 2024-09-12T18:37:28.371 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.371 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.371 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:28.371 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.341311+0000", 2024-09-12T18:37:28.371 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6289000000000003e-05 2024-09-12T18:37:28.372 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.372 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.372 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:28.372 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.341330+0000", 2024-09-12T18:37:28.372 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8527000000000001e-05 2024-09-12T18:37:28.372 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.372 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:28.372 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.372 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.372 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.372 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:218648 5.0 5.5feded60 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-12T18:37:28.372 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:28.342450+0000", 2024-09-12T18:37:28.372 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0013624380000000001, 2024-09-12T18:37:28.373 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001573599, 2024-09-12T18:37:28.373 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:28.373 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:28.373 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:28.373 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:28.373 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:28.373 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:28.373 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 218648 2024-09-12T18:37:28.373 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.373 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:28.373 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.373 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:28.373 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.342450+0000", 2024-09-12T18:37:28.374 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.374 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.374 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.374 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:28.374 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.342450+0000", 2024-09-12T18:37:28.374 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.374 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.374 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.374 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:28.374 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.342451+0000", 2024-09-12T18:37:28.374 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.5700000000000001e-07 2024-09-12T18:37:28.374 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.374 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.374 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:28.375 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.342455+0000", 2024-09-12T18:37:28.375 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1839999999999999e-06 2024-09-12T18:37:28.375 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.375 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.375 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:28.375 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.342461+0000", 2024-09-12T18:37:28.375 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.815e-06 2024-09-12T18:37:28.375 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.375 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.375 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.375 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.342466+0000", 2024-09-12T18:37:28.375 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5569999999999997e-06 2024-09-12T18:37:28.375 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.376 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:28.376 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.376 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.376 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.376 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:218647 5.5 e70/49 5:aabc63dc:::benchmark_data_smithi073_23739_object86370:head v 70'13825, mlcod=70'13821)", 2024-09-12T18:37:28.376 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:28.342918+0000", 2024-09-12T18:37:28.376 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00089514100000000001, 2024-09-12T18:37:28.376 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011340110000000001, 2024-09-12T18:37:28.376 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:28.376 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:28.376 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:37:28.376 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:28.376 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.377 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:28.377 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.342918+0000", 2024-09-12T18:37:28.377 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.377 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.377 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.377 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:28.377 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.342918+0000", 2024-09-12T18:37:28.377 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.377 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.377 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.378 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:28.378 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.342918+0000", 2024-09-12T18:37:28.378 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6199999999999999e-07 2024-09-12T18:37:28.378 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.378 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.378 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:28.378 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.342921+0000", 2024-09-12T18:37:28.378 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9079999999999999e-06 2024-09-12T18:37:28.378 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.378 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.378 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:28.378 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.342926+0000", 2024-09-12T18:37:28.378 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9679999999999997e-06 2024-09-12T18:37:28.379 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.379 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.379 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.379 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.342929+0000", 2024-09-12T18:37:28.379 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3469999999999999e-06 2024-09-12T18:37:28.379 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.379 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.379 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:28.379 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.342969+0000", 2024-09-12T18:37:28.379 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9925000000000001e-05 2024-09-12T18:37:28.379 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.379 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.379 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:28.380 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.342982+0000", 2024-09-12T18:37:28.380 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2879e-05 2024-09-12T18:37:28.380 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.380 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:28.380 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.380 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.380 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.380 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:218649 5.e 5:7b1a1495:::benchmark_data_smithi073_23739_object86372:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-12T18:37:28.380 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:28.343147+0000", 2024-09-12T18:37:28.380 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.000666411, 2024-09-12T18:37:28.380 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00093859100000000001, 2024-09-12T18:37:28.380 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:28.380 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:28.380 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:28.381 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:28.381 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:28.381 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:28.381 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 218649 2024-09-12T18:37:28.381 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.381 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:28.381 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.381 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:28.381 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.343147+0000", 2024-09-12T18:37:28.381 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.381 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.381 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.381 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:28.382 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.343147+0000", 2024-09-12T18:37:28.382 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.382 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.382 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.382 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:28.382 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.343147+0000", 2024-09-12T18:37:28.382 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6499999999999999e-07 2024-09-12T18:37:28.382 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.382 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.382 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:28.382 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.343150+0000", 2024-09-12T18:37:28.382 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.304e-06 2024-09-12T18:37:28.382 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.383 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.383 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:28.383 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.343157+0000", 2024-09-12T18:37:28.383 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5950000000000004e-06 2024-09-12T18:37:28.383 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.383 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.383 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.383 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.343161+0000", 2024-09-12T18:37:28.383 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8310000000000003e-06 2024-09-12T18:37:28.383 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.383 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.383 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:28.383 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.343216+0000", 2024-09-12T18:37:28.384 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4833999999999997e-05 2024-09-12T18:37:28.384 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.384 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.384 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:28.384 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.343325+0000", 2024-09-12T18:37:28.384 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000109163 2024-09-12T18:37:28.384 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.384 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.384 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:28.384 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.343431+0000", 2024-09-12T18:37:28.384 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000106492 2024-09-12T18:37:28.384 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.384 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:28.385 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.385 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.385 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.385 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:218651 5.8 5.4de37f08 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-12T18:37:28.385 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:28.343818+0000", 2024-09-12T18:37:28.385 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4294967295.9999948, 2024-09-12T18:37:28.385 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00030109400000000001, 2024-09-12T18:37:28.385 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:28.385 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:28.385 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:28.385 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:28.385 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:28.385 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:28.385 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 218651 2024-09-12T18:37:28.386 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.386 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:28.386 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.386 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:28.386 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.343818+0000", 2024-09-12T18:37:28.386 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.386 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.386 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.386 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:28.386 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.343818+0000", 2024-09-12T18:37:28.386 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.386 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.386 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.387 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:28.387 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.343819+0000", 2024-09-12T18:37:28.387 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9800000000000003e-07 2024-09-12T18:37:28.387 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.387 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.387 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:28.387 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.343821+0000", 2024-09-12T18:37:28.387 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6579999999999998e-06 2024-09-12T18:37:28.387 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.387 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.387 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:28.387 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.343827+0000", 2024-09-12T18:37:28.388 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8030000000000002e-06 2024-09-12T18:37:28.388 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.388 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.388 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.388 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:28.343831+0000", 2024-09-12T18:37:28.388 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6629999999999999e-06 2024-09-12T18:37:28.388 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.388 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:28.388 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.388 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.388 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-09-12T18:37:28.388 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 10 2024-09-12T18:37:28.388 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:28.389 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:37:28.434 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:28.432+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:28.495 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:28.486+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:28.546 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:28.546 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-09-12T18:37:28.547 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-09-12T18:37:28.547 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-09-12T18:37:28.547 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:28.567 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:37:28.595 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:28.586+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:28.695 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:28.692+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:28.786 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:28.786 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-09-12T18:37:28.786 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-09-12T18:37:28.786 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:37:28.786 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.787 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121096 5.8 5:13503891:::benchmark_data_smithi073_23739_object121095:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:28.787 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:37:28.787 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 48.601513824999998, 2024-09-12T18:37:28.787 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064025391000000001, 2024-09-12T18:37:28.787 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:28.787 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:28.787 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:28.787 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:28.787 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:28.787 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:28.787 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121096 2024-09-12T18:37:28.787 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.788 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:28.788 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.788 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:28.788 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:37:28.788 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.788 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.788 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.788 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:28.788 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:37:28.788 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.788 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.788 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.789 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:28.789 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178579+0000", 2024-09-12T18:37:28.789 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7369999999999998e-06 2024-09-12T18:37:28.789 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.789 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.789 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:28.789 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178846+0000", 2024-09-12T18:37:28.789 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026752699999999999 2024-09-12T18:37:28.789 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.789 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.789 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:28.789 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178877+0000", 2024-09-12T18:37:28.789 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1081999999999998e-05 2024-09-12T18:37:28.789 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.790 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.790 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.790 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178896+0000", 2024-09-12T18:37:28.790 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8522e-05 2024-09-12T18:37:28.790 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.790 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.790 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:28.790 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.192591+0000", 2024-09-12T18:37:28.790 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013695067 2024-09-12T18:37:28.790 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.790 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.790 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:28.790 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.192944+0000", 2024-09-12T18:37:28.790 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00035273699999999999 2024-09-12T18:37:28.791 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.791 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.791 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:28.791 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.193732+0000", 2024-09-12T18:37:28.791 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078849599999999997 2024-09-12T18:37:28.791 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.791 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.791 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:28.791 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.213583+0000", 2024-09-12T18:37:28.791 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.019851164000000001 2024-09-12T18:37:28.791 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.791 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.792 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:28.792 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242386+0000", 2024-09-12T18:37:28.792 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028802924000000001 2024-09-12T18:37:28.792 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.792 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.792 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:28.792 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242501+0000", 2024-09-12T18:37:28.792 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000114932 2024-09-12T18:37:28.792 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.792 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.792 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:28.792 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242602+0000", 2024-09-12T18:37:28.792 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000100203 2024-09-12T18:37:28.792 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.793 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:28.793 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.793 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.793 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.793 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121097 5.8 5:1b31a99e:::benchmark_data_smithi073_23739_object121096:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:28.793 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:37:28.793 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 48.585785534999999, 2024-09-12T18:37:28.793 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048475917, 2024-09-12T18:37:28.793 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:28.793 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:28.793 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:28.793 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:28.793 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:28.793 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:28.794 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121097 2024-09-12T18:37:28.794 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.794 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:28.794 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.794 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:28.794 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:37:28.794 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.794 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.794 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.794 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:28.794 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:37:28.794 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.794 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.795 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.795 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:28.795 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194308+0000", 2024-09-12T18:37:28.795 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2789999999999999e-06 2024-09-12T18:37:28.795 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.795 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.795 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:28.795 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194396+0000", 2024-09-12T18:37:28.795 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8324000000000003e-05 2024-09-12T18:37:28.795 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.795 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.795 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:28.795 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194424+0000", 2024-09-12T18:37:28.796 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7565000000000001e-05 2024-09-12T18:37:28.796 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.796 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.796 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.796 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194444+0000", 2024-09-12T18:37:28.796 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0363000000000001e-05 2024-09-12T18:37:28.796 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.796 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.796 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:28.796 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.206888+0000", 2024-09-12T18:37:28.796 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012443997 2024-09-12T18:37:28.796 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.796 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.796 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:28.797 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.207138+0000", 2024-09-12T18:37:28.797 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025035900000000002 2024-09-12T18:37:28.797 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.797 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.797 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:28.797 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.207365+0000", 2024-09-12T18:37:28.797 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000226407 2024-09-12T18:37:28.797 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.797 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.797 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:28.797 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.215059+0000", 2024-09-12T18:37:28.797 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076946860000000001 2024-09-12T18:37:28.797 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.798 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.798 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:28.798 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242619+0000", 2024-09-12T18:37:28.798 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.027559975 2024-09-12T18:37:28.798 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.798 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.798 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:28.798 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242706+0000", 2024-09-12T18:37:28.798 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6384999999999994e-05 2024-09-12T18:37:28.798 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.798 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.798 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:28.798 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242780+0000", 2024-09-12T18:37:28.799 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4577000000000001e-05 2024-09-12T18:37:28.799 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.799 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:28.799 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.799 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.799 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.799 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121101 5.e 5:7e18e9ed:::benchmark_data_smithi073_23739_object121100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:28.799 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.209084+0000", 2024-09-12T18:37:28.799 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 48.571005479999997, 2024-09-12T18:37:28.799 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028988566, 2024-09-12T18:37:28.799 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:28.799 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:28.799 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:28.799 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:28.800 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:28.800 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:28.800 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121101 2024-09-12T18:37:28.800 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.800 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:28.800 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.800 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:28.800 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209084+0000", 2024-09-12T18:37:28.800 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.800 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.800 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.801 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:28.801 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209084+0000", 2024-09-12T18:37:28.801 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.801 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.801 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.801 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:28.801 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209087+0000", 2024-09-12T18:37:28.801 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6800000000000002e-06 2024-09-12T18:37:28.801 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.801 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.801 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:28.801 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209182+0000", 2024-09-12T18:37:28.801 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5084e-05 2024-09-12T18:37:28.802 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.802 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.802 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:28.802 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209212+0000", 2024-09-12T18:37:28.802 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9825e-05 2024-09-12T18:37:28.802 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.802 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.802 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.802 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209234+0000", 2024-09-12T18:37:28.802 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1416e-05 2024-09-12T18:37:28.802 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.802 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.802 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:28.802 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209497+0000", 2024-09-12T18:37:28.803 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026390400000000003 2024-09-12T18:37:28.803 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.803 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.803 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:28.803 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209810+0000", 2024-09-12T18:37:28.803 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000313023 2024-09-12T18:37:28.803 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.803 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.803 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:28.803 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.210468+0000", 2024-09-12T18:37:28.804 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00065779300000000005 2024-09-12T18:37:28.804 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.804 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.804 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:28.804 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.235905+0000", 2024-09-12T18:37:28.804 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025436881000000001 2024-09-12T18:37:28.804 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.804 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.804 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:28.804 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237797+0000", 2024-09-12T18:37:28.804 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001892007 2024-09-12T18:37:28.804 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.804 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.804 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:28.805 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237941+0000", 2024-09-12T18:37:28.805 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000143411 2024-09-12T18:37:28.805 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.805 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.805 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:28.805 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.238073+0000", 2024-09-12T18:37:28.805 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013254200000000001 2024-09-12T18:37:28.805 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.805 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:28.805 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.805 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.805 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.805 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121106 5.d 5:b4a9a221:::benchmark_data_smithi073_23739_object121105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:28.806 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:37:28.806 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 48.542910599000002, 2024-09-12T18:37:28.806 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.034882274999999997, 2024-09-12T18:37:28.806 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:28.806 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:28.806 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:28.806 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:28.806 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:28.806 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:28.806 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121106 2024-09-12T18:37:28.806 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.806 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:28.806 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.807 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:28.807 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:37:28.807 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.807 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.807 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.807 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:28.807 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:37:28.807 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.807 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.807 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.807 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:28.807 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237182+0000", 2024-09-12T18:37:28.807 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6019999999999998e-06 2024-09-12T18:37:28.808 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.808 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.808 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:28.808 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237257+0000", 2024-09-12T18:37:28.808 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5420999999999995e-05 2024-09-12T18:37:28.808 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.808 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.808 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:28.808 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237305+0000", 2024-09-12T18:37:28.808 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7207999999999999e-05 2024-09-12T18:37:28.808 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.808 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.809 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.809 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237325+0000", 2024-09-12T18:37:28.809 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0001e-05 2024-09-12T18:37:28.809 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.809 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.809 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:28.809 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237505+0000", 2024-09-12T18:37:28.809 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000180798 2024-09-12T18:37:28.809 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.809 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.809 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:28.809 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237764+0000", 2024-09-12T18:37:28.809 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025862299999999998 2024-09-12T18:37:28.810 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.810 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.810 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:28.810 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.238264+0000", 2024-09-12T18:37:28.810 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00050016100000000005 2024-09-12T18:37:28.810 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.810 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.810 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:28.811 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256525+0000", 2024-09-12T18:37:28.811 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018260508000000002 2024-09-12T18:37:28.811 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.811 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.811 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:28.811 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.271903+0000", 2024-09-12T18:37:28.811 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015378739000000001 2024-09-12T18:37:28.811 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.811 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.811 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:28.811 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.271999+0000", 2024-09-12T18:37:28.811 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5989000000000005e-05 2024-09-12T18:37:28.811 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.811 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.812 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:28.812 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272062+0000", 2024-09-12T18:37:28.812 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2224999999999995e-05 2024-09-12T18:37:28.812 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.812 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:28.812 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.812 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.812 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.812 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121112 5.d 5:b9a2d671:::benchmark_data_smithi073_23739_object121111:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:28.812 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.243446+0000", 2024-09-12T18:37:28.812 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 48.536643873999999, 2024-09-12T18:37:28.812 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.02889415, 2024-09-12T18:37:28.812 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:28.812 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:28.813 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:28.813 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:28.813 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:28.813 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:28.813 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121112 2024-09-12T18:37:28.813 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.813 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:28.813 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.813 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:28.813 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243446+0000", 2024-09-12T18:37:28.813 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.813 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.813 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.814 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:28.814 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243446+0000", 2024-09-12T18:37:28.814 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.814 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.814 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.814 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:28.814 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243448+0000", 2024-09-12T18:37:28.814 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0829999999999998e-06 2024-09-12T18:37:28.814 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.814 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.814 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:28.814 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243527+0000", 2024-09-12T18:37:28.814 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9173999999999998e-05 2024-09-12T18:37:28.815 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.815 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.815 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:28.815 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243549+0000", 2024-09-12T18:37:28.815 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1169e-05 2024-09-12T18:37:28.815 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.815 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.815 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.815 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243564+0000", 2024-09-12T18:37:28.815 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5866999999999999e-05 2024-09-12T18:37:28.815 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.815 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.815 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:28.816 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.249905+0000", 2024-09-12T18:37:28.816 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063410360000000004 2024-09-12T18:37:28.816 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.816 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.816 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:28.816 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.250166+0000", 2024-09-12T18:37:28.816 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026052999999999997 2024-09-12T18:37:28.816 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.816 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.816 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:28.816 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.250486+0000", 2024-09-12T18:37:28.816 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00032002700000000002 2024-09-12T18:37:28.816 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.817 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.817 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:28.817 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.259263+0000", 2024-09-12T18:37:28.817 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0087774770000000005 2024-09-12T18:37:28.817 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.817 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.817 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:28.817 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272186+0000", 2024-09-12T18:37:28.817 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.01292213 2024-09-12T18:37:28.817 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.817 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.817 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:28.817 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272267+0000", 2024-09-12T18:37:28.818 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1153e-05 2024-09-12T18:37:28.818 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.818 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.818 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:28.818 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272340+0000", 2024-09-12T18:37:28.818 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3504000000000006e-05 2024-09-12T18:37:28.818 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.818 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:28.818 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.818 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.818 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.818 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121114 5.d 5:b8870c11:::benchmark_data_smithi073_23739_object121113:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:28.818 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.243603+0000", 2024-09-12T18:37:28.818 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 48.536486623000002, 2024-09-12T18:37:28.819 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028945746000000001, 2024-09-12T18:37:28.819 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:28.819 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:28.819 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:28.819 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:28.819 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:28.819 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:28.819 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121114 2024-09-12T18:37:28.819 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.819 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:28.819 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.819 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:28.819 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243603+0000", 2024-09-12T18:37:28.819 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.820 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.820 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.820 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:28.820 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243603+0000", 2024-09-12T18:37:28.820 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.820 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.820 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.820 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:28.820 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243605+0000", 2024-09-12T18:37:28.820 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.268e-06 2024-09-12T18:37:28.820 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.820 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.821 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:28.821 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243674+0000", 2024-09-12T18:37:28.821 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9375000000000006e-05 2024-09-12T18:37:28.821 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.821 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.821 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:28.821 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243691+0000", 2024-09-12T18:37:28.821 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6517000000000001e-05 2024-09-12T18:37:28.821 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.821 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.821 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.821 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243702+0000", 2024-09-12T18:37:28.821 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1905999999999999e-05 2024-09-12T18:37:28.822 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.822 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.822 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:28.822 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.253789+0000", 2024-09-12T18:37:28.822 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.010086776 2024-09-12T18:37:28.822 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.822 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.822 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:28.822 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.253959+0000", 2024-09-12T18:37:28.822 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00017000000000000001 2024-09-12T18:37:28.822 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.822 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.823 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:28.823 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.254179+0000", 2024-09-12T18:37:28.823 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022003699999999999 2024-09-12T18:37:28.823 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.823 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.823 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:28.823 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.259330+0000", 2024-09-12T18:37:28.823 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0051511559999999996 2024-09-12T18:37:28.823 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.823 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.823 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:28.823 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272403+0000", 2024-09-12T18:37:28.823 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013072342000000001 2024-09-12T18:37:28.823 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.824 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.824 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:28.824 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272493+0000", 2024-09-12T18:37:28.824 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0595999999999998e-05 2024-09-12T18:37:28.824 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.824 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.824 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:28.824 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272549+0000", 2024-09-12T18:37:28.824 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5773000000000003e-05 2024-09-12T18:37:28.824 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.824 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:28.824 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.824 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.825 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.825 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121115 5.d 5:bd4a51ea:::benchmark_data_smithi073_23739_object121114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:28.825 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.245059+0000", 2024-09-12T18:37:28.825 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 48.535030949000003, 2024-09-12T18:37:28.825 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.02767406, 2024-09-12T18:37:28.825 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:28.825 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:28.825 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:28.825 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:28.825 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:28.825 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:28.825 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121115 2024-09-12T18:37:28.825 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.826 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:28.826 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.826 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:28.826 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245059+0000", 2024-09-12T18:37:28.826 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.826 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.826 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.826 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:28.826 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245059+0000", 2024-09-12T18:37:28.826 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.826 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.826 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.826 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:28.827 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245061+0000", 2024-09-12T18:37:28.827 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9759999999999998e-06 2024-09-12T18:37:28.827 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.827 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.827 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:28.827 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245111+0000", 2024-09-12T18:37:28.827 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9838e-05 2024-09-12T18:37:28.827 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.827 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.827 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:28.827 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245132+0000", 2024-09-12T18:37:28.827 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1469999999999999e-05 2024-09-12T18:37:28.827 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.827 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.828 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.828 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245146+0000", 2024-09-12T18:37:28.828 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3377000000000001e-05 2024-09-12T18:37:28.828 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.828 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.828 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:28.828 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256596+0000", 2024-09-12T18:37:28.828 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011450241999999999 2024-09-12T18:37:28.828 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.828 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.828 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:28.828 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256838+0000", 2024-09-12T18:37:28.828 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000242255 2024-09-12T18:37:28.828 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.829 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.829 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:28.829 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.257095+0000", 2024-09-12T18:37:28.829 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025679300000000001 2024-09-12T18:37:28.829 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.829 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.829 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:28.829 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.259928+0000", 2024-09-12T18:37:28.829 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0028326290000000001 2024-09-12T18:37:28.829 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.829 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.829 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:28.829 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272607+0000", 2024-09-12T18:37:28.829 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012679466 2024-09-12T18:37:28.830 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.830 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.830 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:28.830 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272681+0000", 2024-09-12T18:37:28.830 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3580999999999999e-05 2024-09-12T18:37:28.830 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.830 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.830 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:28.830 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272733+0000", 2024-09-12T18:37:28.830 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2432999999999998e-05 2024-09-12T18:37:28.830 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.830 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:28.830 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.831 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.831 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.831 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:131551 5.d 5:b8f8c77a:::benchmark_data_smithi073_23739_object131550:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:37:28.831 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:45.499878+0000", 2024-09-12T18:37:28.831 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 43.280211684999998, 2024-09-12T18:37:28.831 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.027478433, 2024-09-12T18:37:28.831 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:28.831 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:28.831 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:28.831 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:28.831 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:28.831 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:28.831 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 131551 2024-09-12T18:37:28.832 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.832 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:28.832 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.832 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:28.832 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499878+0000", 2024-09-12T18:37:28.832 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.832 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.832 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.832 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:28.832 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499878+0000", 2024-09-12T18:37:28.832 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.832 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.832 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.832 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:28.833 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499879+0000", 2024-09-12T18:37:28.833 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.92e-07 2024-09-12T18:37:28.833 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.833 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.833 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:28.833 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499946+0000", 2024-09-12T18:37:28.833 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6712999999999996e-05 2024-09-12T18:37:28.833 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.833 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.833 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:28.833 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499953+0000", 2024-09-12T18:37:28.833 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5519999999999999e-06 2024-09-12T18:37:28.833 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.833 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.834 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.834 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499959+0000", 2024-09-12T18:37:28.834 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0430000000000004e-06 2024-09-12T18:37:28.834 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.834 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.834 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:28.834 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.500004+0000", 2024-09-12T18:37:28.834 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5058000000000001e-05 2024-09-12T18:37:28.834 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.835 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.835 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:28.835 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.500121+0000", 2024-09-12T18:37:28.835 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000116747 2024-09-12T18:37:28.835 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.835 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.835 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:28.835 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.500283+0000", 2024-09-12T18:37:28.835 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016190599999999999 2024-09-12T18:37:28.835 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.835 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.835 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:28.835 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.504017+0000", 2024-09-12T18:37:28.836 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003734125 2024-09-12T18:37:28.836 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.836 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.836 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:28.836 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.527224+0000", 2024-09-12T18:37:28.836 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.023206724000000001 2024-09-12T18:37:28.836 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.836 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.836 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:28.836 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.527290+0000", 2024-09-12T18:37:28.836 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5778999999999995e-05 2024-09-12T18:37:28.836 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.836 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.837 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:28.837 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.527357+0000", 2024-09-12T18:37:28.837 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7094000000000005e-05 2024-09-12T18:37:28.837 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.837 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:28.837 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.837 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.837 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.837 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:167368 5.4 5:29a1ec58:::benchmark_data_smithi073_23739_object35091:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:28.837 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:03.168773+0000", 2024-09-12T18:37:28.837 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 25.611316731999999, 2024-09-12T18:37:28.837 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.066578597000000003, 2024-09-12T18:37:28.837 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:28.837 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:28.838 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:28.838 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:28.838 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:28.838 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:28.838 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 167368 2024-09-12T18:37:28.838 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.838 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:28.838 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.838 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:28.838 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168773+0000", 2024-09-12T18:37:28.838 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.838 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.838 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.839 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:28.839 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168773+0000", 2024-09-12T18:37:28.839 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.839 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.839 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.839 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:28.839 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168774+0000", 2024-09-12T18:37:28.839 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.023e-06 2024-09-12T18:37:28.839 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.839 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.839 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:28.839 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168779+0000", 2024-09-12T18:37:28.839 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5800000000000002e-06 2024-09-12T18:37:28.839 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.840 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.840 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:28.840 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168789+0000", 2024-09-12T18:37:28.840 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0346999999999999e-05 2024-09-12T18:37:28.840 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.840 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.840 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.840 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168808+0000", 2024-09-12T18:37:28.840 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8423e-05 2024-09-12T18:37:28.840 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.840 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.840 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:28.840 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168864+0000", 2024-09-12T18:37:28.841 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-09-12T18:37:28.841 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.841 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.841 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:28.841 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168947+0000", 2024-09-12T18:37:28.841 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3274000000000003e-05 2024-09-12T18:37:28.841 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.841 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.841 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:28.841 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.169014+0000", 2024-09-12T18:37:28.841 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6284000000000004e-05 2024-09-12T18:37:28.841 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.841 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.842 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:28.842 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.170653+0000", 2024-09-12T18:37:28.842 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016389779999999999 2024-09-12T18:37:28.842 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.842 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.842 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:28.842 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.235279+0000", 2024-09-12T18:37:28.842 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064626464999999994 2024-09-12T18:37:28.842 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.842 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.842 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:28.842 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.235320+0000", 2024-09-12T18:37:28.842 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0377000000000003e-05 2024-09-12T18:37:28.843 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.843 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.843 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:28.843 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.235352+0000", 2024-09-12T18:37:28.843 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2322e-05 2024-09-12T18:37:28.843 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.843 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:28.843 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.843 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.843 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.843 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:167371 5.4 5:24fea27c:::benchmark_data_smithi073_23739_object35094:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:28.843 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:03.171234+0000", 2024-09-12T18:37:28.843 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 25.608855707, 2024-09-12T18:37:28.843 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.066048171000000003, 2024-09-12T18:37:28.844 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:28.844 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:28.844 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:28.844 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:28.844 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:28.844 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:28.844 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 167371 2024-09-12T18:37:28.844 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.844 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:28.844 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.844 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:28.844 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171234+0000", 2024-09-12T18:37:28.845 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.845 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.845 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.845 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:28.845 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171234+0000", 2024-09-12T18:37:28.845 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.845 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.845 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.845 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:28.845 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171235+0000", 2024-09-12T18:37:28.845 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8599999999999997e-07 2024-09-12T18:37:28.845 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.845 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.845 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:28.846 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171238+0000", 2024-09-12T18:37:28.846 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9739999999999998e-06 2024-09-12T18:37:28.846 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.846 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.846 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:28.846 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171245+0000", 2024-09-12T18:37:28.846 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6000000000000003e-06 2024-09-12T18:37:28.846 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.846 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.846 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.846 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171249+0000", 2024-09-12T18:37:28.846 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9960000000000004e-06 2024-09-12T18:37:28.846 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.847 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.847 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:28.847 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171288+0000", 2024-09-12T18:37:28.847 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9119999999999998e-05 2024-09-12T18:37:28.847 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.847 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.847 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:28.847 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171359+0000", 2024-09-12T18:37:28.847 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0951000000000006e-05 2024-09-12T18:37:28.847 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.847 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.847 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:28.847 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171425+0000", 2024-09-12T18:37:28.847 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.58e-05 2024-09-12T18:37:28.848 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.848 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.848 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:28.848 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.173093+0000", 2024-09-12T18:37:28.848 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016683939999999999 2024-09-12T18:37:28.848 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.848 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.848 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:28.848 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.237202+0000", 2024-09-12T18:37:28.848 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064109437000000005 2024-09-12T18:37:28.848 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.848 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.849 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:28.849 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.237249+0000", 2024-09-12T18:37:28.849 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6751e-05 2024-09-12T18:37:28.849 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.849 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.849 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:28.849 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.237282+0000", 2024-09-12T18:37:28.849 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3262000000000001e-05 2024-09-12T18:37:28.849 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.849 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:28.849 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.849 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.849 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.849 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:201498 5.a e67/21 5:5815d848:::benchmark_data_smithi073_23739_object69221:head v 67'12793, mlcod=67'12791)", 2024-09-12T18:37:28.850 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.430872+0000", 2024-09-12T18:37:28.850 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 8.3492177289999994, 2024-09-12T18:37:28.850 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.038775280000000002, 2024-09-12T18:37:28.850 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:28.850 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:28.850 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:28.850 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:28.850 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.850 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:28.850 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430872+0000", 2024-09-12T18:37:28.850 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.850 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.850 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.851 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:28.851 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430872+0000", 2024-09-12T18:37:28.851 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.851 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.851 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.851 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:28.851 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430873+0000", 2024-09-12T18:37:28.851 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6600000000000003e-07 2024-09-12T18:37:28.851 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.851 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.851 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:28.851 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430875+0000", 2024-09-12T18:37:28.851 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5399999999999998e-06 2024-09-12T18:37:28.851 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.852 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.852 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:28.852 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430879+0000", 2024-09-12T18:37:28.852 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7239999999999998e-06 2024-09-12T18:37:28.852 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.852 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.852 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.852 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430882+0000", 2024-09-12T18:37:28.852 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8679999999999999e-06 2024-09-12T18:37:28.852 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.852 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.852 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:28.852 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430909+0000", 2024-09-12T18:37:28.852 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7832999999999999e-05 2024-09-12T18:37:28.853 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.853 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.853 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:28.853 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430922+0000", 2024-09-12T18:37:28.853 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2164000000000001e-05 2024-09-12T18:37:28.853 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.853 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.853 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:28.853 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469578+0000", 2024-09-12T18:37:28.853 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.038656469999999998 2024-09-12T18:37:28.853 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.853 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.853 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:28.854 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469648+0000", 2024-09-12T18:37:28.854 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9414999999999999e-05 2024-09-12T18:37:28.854 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.854 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:28.854 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.854 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.854 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.854 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201513 5.e 5:7be2f597:::benchmark_data_smithi073_23739_object69236:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:28.854 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.435121+0000", 2024-09-12T18:37:28.854 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 8.3449689760000005, 2024-09-12T18:37:28.854 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.034945021999999999, 2024-09-12T18:37:28.854 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:28.854 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:28.855 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:28.855 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:28.855 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:28.855 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:28.855 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201513 2024-09-12T18:37:28.855 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.855 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:28.855 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.855 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:28.855 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.435121+0000", 2024-09-12T18:37:28.855 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.855 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.855 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.856 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:28.856 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.435121+0000", 2024-09-12T18:37:28.856 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.856 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.856 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.856 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:28.856 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.435122+0000", 2024-09-12T18:37:28.856 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2440000000000001e-06 2024-09-12T18:37:28.856 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.856 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.856 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:28.856 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.435126+0000", 2024-09-12T18:37:28.856 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1559999999999997e-06 2024-09-12T18:37:28.857 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.857 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.857 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:28.857 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445086+0000", 2024-09-12T18:37:28.857 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0099592389999999999 2024-09-12T18:37:28.857 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.857 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.857 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.857 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445095+0000", 2024-09-12T18:37:28.857 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2620000000000004e-06 2024-09-12T18:37:28.857 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.857 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.857 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:28.857 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445165+0000", 2024-09-12T18:37:28.858 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0257000000000002e-05 2024-09-12T18:37:28.858 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.858 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.858 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:28.858 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445311+0000", 2024-09-12T18:37:28.858 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014603899999999999 2024-09-12T18:37:28.858 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.858 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.858 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:28.858 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445445+0000", 2024-09-12T18:37:28.858 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000133654 2024-09-12T18:37:28.858 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.858 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.858 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:28.859 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469853+0000", 2024-09-12T18:37:28.859 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024407893999999999 2024-09-12T18:37:28.859 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.859 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.859 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:28.859 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469873+0000", 2024-09-12T18:37:28.859 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0622e-05 2024-09-12T18:37:28.859 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.859 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.859 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:28.859 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469949+0000", 2024-09-12T18:37:28.859 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5918000000000001e-05 2024-09-12T18:37:28.859 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.860 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.860 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:28.860 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470066+0000", 2024-09-12T18:37:28.860 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000116737 2024-09-12T18:37:28.860 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.860 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:28.860 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.860 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.860 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.860 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201521 5.d 5:b911ab6f:::benchmark_data_smithi073_23739_object69244:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:28.860 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445173+0000", 2024-09-12T18:37:28.860 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 8.3349165329999995, 2024-09-12T18:37:28.861 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.031483274999999998, 2024-09-12T18:37:28.861 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:28.861 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:28.861 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:28.861 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:28.861 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:28.861 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:28.861 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201521 2024-09-12T18:37:28.861 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.861 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:28.861 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.861 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:28.861 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445173+0000", 2024-09-12T18:37:28.861 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.862 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.862 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.862 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:28.862 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445173+0000", 2024-09-12T18:37:28.862 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.862 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.862 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.862 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:28.862 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445174+0000", 2024-09-12T18:37:28.862 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4299999999999998e-07 2024-09-12T18:37:28.862 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.862 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.862 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:28.862 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445176+0000", 2024-09-12T18:37:28.863 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.469e-06 2024-09-12T18:37:28.863 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.863 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.863 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:28.863 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445183+0000", 2024-09-12T18:37:28.863 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8719999999999996e-06 2024-09-12T18:37:28.863 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.863 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.863 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.863 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445188+0000", 2024-09-12T18:37:28.863 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7079999999999996e-06 2024-09-12T18:37:28.863 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.864 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.864 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:28.864 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445314+0000", 2024-09-12T18:37:28.864 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012627800000000001 2024-09-12T18:37:28.864 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.864 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.864 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:28.864 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445436+0000", 2024-09-12T18:37:28.864 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000122007 2024-09-12T18:37:28.864 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.864 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.864 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:28.864 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445541+0000", 2024-09-12T18:37:28.865 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000105068 2024-09-12T18:37:28.865 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.865 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.865 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:28.865 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470655+0000", 2024-09-12T18:37:28.865 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025114035 2024-09-12T18:37:28.865 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.865 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.865 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:28.865 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476570+0000", 2024-09-12T18:37:28.865 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0059143269999999996 2024-09-12T18:37:28.865 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.865 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.866 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:28.866 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476624+0000", 2024-09-12T18:37:28.866 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4261000000000001e-05 2024-09-12T18:37:28.866 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.866 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.866 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:28.866 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476657+0000", 2024-09-12T18:37:28.866 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2806999999999999e-05 2024-09-12T18:37:28.866 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.866 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:28.866 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.866 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.866 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.867 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201524 5.d 5:b330b18b:::benchmark_data_smithi073_23739_object69247:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:28.867 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445202+0000", 2024-09-12T18:37:28.867 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 8.3348882730000007, 2024-09-12T18:37:28.867 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.034036482, 2024-09-12T18:37:28.867 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:28.867 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:28.867 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:28.867 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:28.867 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:28.867 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:28.867 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201524 2024-09-12T18:37:28.867 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.867 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:28.868 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.868 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:28.868 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445202+0000", 2024-09-12T18:37:28.868 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.868 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.868 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.868 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:28.868 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445202+0000", 2024-09-12T18:37:28.868 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.868 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.868 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.868 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:28.868 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445202+0000", 2024-09-12T18:37:28.869 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2e-07 2024-09-12T18:37:28.869 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.869 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.869 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:28.869 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445204+0000", 2024-09-12T18:37:28.869 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0490000000000002e-06 2024-09-12T18:37:28.869 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.869 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.869 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:28.869 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445210+0000", 2024-09-12T18:37:28.869 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.959e-06 2024-09-12T18:37:28.869 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.869 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.870 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.870 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445215+0000", 2024-09-12T18:37:28.870 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.668e-06 2024-09-12T18:37:28.870 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.870 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.870 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:28.870 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470703+0000", 2024-09-12T18:37:28.870 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025488182000000002 2024-09-12T18:37:28.870 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.870 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.870 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:28.870 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470911+0000", 2024-09-12T18:37:28.870 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020755400000000001 2024-09-12T18:37:28.870 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.871 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.871 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:28.871 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.471309+0000", 2024-09-12T18:37:28.871 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00039868199999999998 2024-09-12T18:37:28.871 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.871 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.871 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:28.871 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476724+0000", 2024-09-12T18:37:28.871 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054150589999999998 2024-09-12T18:37:28.871 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.871 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.871 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:28.871 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.479050+0000", 2024-09-12T18:37:28.871 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0023259309999999998 2024-09-12T18:37:28.872 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.872 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.872 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:28.872 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.479164+0000", 2024-09-12T18:37:28.872 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000114127 2024-09-12T18:37:28.872 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.872 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.872 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:28.872 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.479238+0000", 2024-09-12T18:37:28.872 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3751000000000006e-05 2024-09-12T18:37:28.872 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.872 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:28.872 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.872 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.873 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.873 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_backfill(progress 5.5 e 67/67 lb 5:a30f9be2:::benchmark_data_smithi073_23739_object118666:head)", 2024-09-12T18:37:28.873 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445433+0000", 2024-09-12T18:37:28.873 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 8.334657387, 2024-09-12T18:37:28.873 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.029511351000000002, 2024-09-12T18:37:28.873 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:28.873 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:28.873 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:37:28.873 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:28.873 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.873 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:28.873 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445433+0000", 2024-09-12T18:37:28.873 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.874 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.874 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.874 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:28.874 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445433+0000", 2024-09-12T18:37:28.874 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.874 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.874 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.874 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:28.874 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445433+0000", 2024-09-12T18:37:28.874 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0699999999999998e-07 2024-09-12T18:37:28.874 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.874 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.874 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:28.875 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445440+0000", 2024-09-12T18:37:28.875 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6630000000000004e-06 2024-09-12T18:37:28.875 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.875 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.875 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:28.875 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445447+0000", 2024-09-12T18:37:28.875 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5159999999999997e-06 2024-09-12T18:37:28.875 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.875 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.876 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.876 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445454+0000", 2024-09-12T18:37:28.876 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.267e-06 2024-09-12T18:37:28.876 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.876 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.876 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:28.876 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.474780+0000", 2024-09-12T18:37:28.876 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.029325496999999999 2024-09-12T18:37:28.876 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.876 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.876 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:28.876 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.474802+0000", 2024-09-12T18:37:28.877 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2348999999999999e-05 2024-09-12T18:37:28.877 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.877 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.877 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:28.877 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.474944+0000", 2024-09-12T18:37:28.877 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014165200000000001 2024-09-12T18:37:28.877 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.877 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:28.877 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.877 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.877 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.877 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:201515 5.5 e67/49 5:a25bd8bb:::benchmark_data_smithi073_23739_object69238:head v 67'12752, mlcod=67'12750)", 2024-09-12T18:37:28.877 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445471+0000", 2024-09-12T18:37:28.878 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 8.334619472, 2024-09-12T18:37:28.878 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.031081396000000001, 2024-09-12T18:37:28.878 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:28.878 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:28.878 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:28.878 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:28.878 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.878 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:28.878 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445471+0000", 2024-09-12T18:37:28.878 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.878 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.878 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.878 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:28.879 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445471+0000", 2024-09-12T18:37:28.879 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.879 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.879 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.879 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:28.879 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445471+0000", 2024-09-12T18:37:28.879 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5400000000000002e-07 2024-09-12T18:37:28.879 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.879 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.879 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:28.879 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445475+0000", 2024-09-12T18:37:28.879 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2379999999999999e-06 2024-09-12T18:37:28.879 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.880 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.880 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:28.880 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445481+0000", 2024-09-12T18:37:28.880 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0229999999999998e-06 2024-09-12T18:37:28.880 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.880 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.880 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.880 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445486+0000", 2024-09-12T18:37:28.880 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5040000000000004e-06 2024-09-12T18:37:28.880 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.880 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.880 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:28.880 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445970+0000", 2024-09-12T18:37:28.881 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048416699999999997 2024-09-12T18:37:28.881 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.881 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.881 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:28.881 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445991+0000", 2024-09-12T18:37:28.881 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1067999999999999e-05 2024-09-12T18:37:28.881 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.881 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.881 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:28.881 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476511+0000", 2024-09-12T18:37:28.881 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.030520629000000001 2024-09-12T18:37:28.881 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.881 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.881 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:28.882 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476552+0000", 2024-09-12T18:37:28.882 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0413000000000001e-05 2024-09-12T18:37:28.882 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.882 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:28.882 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.882 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.882 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.882 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:201526 5.5 e67/49 5:a3549698:::benchmark_data_smithi073_23739_object69249:head v 67'12753, mlcod=67'12750)", 2024-09-12T18:37:28.882 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445957+0000", 2024-09-12T18:37:28.882 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 8.3341325400000006, 2024-09-12T18:37:28.882 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.030732494999999999, 2024-09-12T18:37:28.883 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:28.883 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:28.883 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:28.883 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:28.883 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.883 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:28.883 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445957+0000", 2024-09-12T18:37:28.883 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.883 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.883 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.883 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:28.883 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445957+0000", 2024-09-12T18:37:28.883 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.883 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.884 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.884 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:28.884 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445958+0000", 2024-09-12T18:37:28.884 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7800000000000001e-07 2024-09-12T18:37:28.884 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.884 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.884 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:28.884 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445963+0000", 2024-09-12T18:37:28.884 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5419999999999999e-06 2024-09-12T18:37:28.884 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.884 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.884 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:28.884 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445972+0000", 2024-09-12T18:37:28.884 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4169999999999998e-06 2024-09-12T18:37:28.885 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.885 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.885 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.885 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445979+0000", 2024-09-12T18:37:28.885 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2949999999999996e-06 2024-09-12T18:37:28.885 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.885 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.885 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:28.885 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.447710+0000", 2024-09-12T18:37:28.885 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001731067 2024-09-12T18:37:28.885 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.885 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.885 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:28.886 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.447734+0000", 2024-09-12T18:37:28.886 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4094e-05 2024-09-12T18:37:28.886 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.886 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.886 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:28.886 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476659+0000", 2024-09-12T18:37:28.886 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028924268999999999 2024-09-12T18:37:28.886 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.886 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.886 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:28.886 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476690+0000", 2024-09-12T18:37:28.886 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1232999999999997e-05 2024-09-12T18:37:28.886 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.886 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:28.887 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.887 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.887 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.887 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:201528 5.5 e67/49 5:a971b633:::benchmark_data_smithi073_23739_object69251:head v 67'12754, mlcod=67'12750)", 2024-09-12T18:37:28.887 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.449001+0000", 2024-09-12T18:37:28.887 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 8.3310890660000005, 2024-09-12T18:37:28.887 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.027719695999999999, 2024-09-12T18:37:28.887 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:28.887 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:28.887 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:28.887 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:28.887 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.887 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:28.887 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.449001+0000", 2024-09-12T18:37:28.888 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.888 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.888 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.888 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:28.888 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.449001+0000", 2024-09-12T18:37:28.888 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.888 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.888 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.888 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:28.888 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.449002+0000", 2024-09-12T18:37:28.888 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.16e-07 2024-09-12T18:37:28.888 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.889 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.889 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:28.889 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.449008+0000", 2024-09-12T18:37:28.889 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.9390000000000002e-06 2024-09-12T18:37:28.889 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.889 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.889 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:28.889 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469460+0000", 2024-09-12T18:37:28.889 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.020452060000000001 2024-09-12T18:37:28.889 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.889 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.889 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.890 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469476+0000", 2024-09-12T18:37:28.890 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6308e-05 2024-09-12T18:37:28.890 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.890 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.890 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:28.890 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470649+0000", 2024-09-12T18:37:28.890 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011725749999999999 2024-09-12T18:37:28.890 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.890 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.890 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:28.890 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470676+0000", 2024-09-12T18:37:28.890 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6806000000000001e-05 2024-09-12T18:37:28.890 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.890 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.891 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:28.891 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476703+0000", 2024-09-12T18:37:28.891 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0060279720000000004 2024-09-12T18:37:28.891 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.891 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.891 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:28.891 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476721+0000", 2024-09-12T18:37:28.891 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7119999999999999e-05 2024-09-12T18:37:28.891 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.891 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:28.891 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.891 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.891 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.892 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201583 5.d 5:b91eedec:::benchmark_data_smithi073_23739_object69306:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:28.892 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.494097+0000", 2024-09-12T18:37:28.892 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 8.2859926779999995, 2024-09-12T18:37:28.892 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049293508, 2024-09-12T18:37:28.892 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:28.892 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:28.892 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:28.892 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:28.892 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:28.892 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:28.892 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201583 2024-09-12T18:37:28.892 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.892 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:28.893 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.893 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:28.893 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494097+0000", 2024-09-12T18:37:28.893 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.893 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.893 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.893 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:28.893 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494097+0000", 2024-09-12T18:37:28.893 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.893 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.893 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.893 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:28.893 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494098+0000", 2024-09-12T18:37:28.894 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0699999999999996e-07 2024-09-12T18:37:28.894 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.894 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.894 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:28.894 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494102+0000", 2024-09-12T18:37:28.894 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.664e-06 2024-09-12T18:37:28.894 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.894 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.894 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:28.894 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494108+0000", 2024-09-12T18:37:28.894 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.3149999999999997e-06 2024-09-12T18:37:28.894 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.894 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.895 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.895 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494112+0000", 2024-09-12T18:37:28.895 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0659999999999997e-06 2024-09-12T18:37:28.895 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.895 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.895 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:28.895 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494200+0000", 2024-09-12T18:37:28.895 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7770999999999997e-05 2024-09-12T18:37:28.895 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.895 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.895 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:28.895 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494315+0000", 2024-09-12T18:37:28.895 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000115048 2024-09-12T18:37:28.895 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.896 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.896 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:28.896 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494414+0000", 2024-09-12T18:37:28.896 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8820999999999995e-05 2024-09-12T18:37:28.896 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.896 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.896 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:28.896 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.497199+0000", 2024-09-12T18:37:28.896 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0027854279999999999 2024-09-12T18:37:28.896 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.896 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.896 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:28.896 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543193+0000", 2024-09-12T18:37:28.897 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.045993500999999999 2024-09-12T18:37:28.897 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.897 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.897 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:28.897 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543315+0000", 2024-09-12T18:37:28.897 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012246800000000001 2024-09-12T18:37:28.897 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.897 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.897 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:28.897 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543391+0000", 2024-09-12T18:37:28.897 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5618999999999995e-05 2024-09-12T18:37:28.897 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.898 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:28.898 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.898 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.898 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.898 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201585 5.d 5:bb6c167f:::benchmark_data_smithi073_23739_object69308:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:28.898 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.495295+0000", 2024-09-12T18:37:28.898 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 8.2847945109999994, 2024-09-12T18:37:28.898 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048312129000000002, 2024-09-12T18:37:28.898 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:28.898 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:28.898 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:28.898 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:28.898 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:28.898 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:28.899 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201585 2024-09-12T18:37:28.899 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.899 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:28.899 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.899 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:28.899 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495295+0000", 2024-09-12T18:37:28.899 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.899 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.899 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.899 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:28.899 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495295+0000", 2024-09-12T18:37:28.899 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:28.899 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.900 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.900 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:28.900 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495296+0000", 2024-09-12T18:37:28.900 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0330000000000001e-06 2024-09-12T18:37:28.900 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.900 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.900 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:28.900 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495301+0000", 2024-09-12T18:37:28.900 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7049999999999998e-06 2024-09-12T18:37:28.900 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.900 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.900 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:28.900 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495312+0000", 2024-09-12T18:37:28.900 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0791000000000001e-05 2024-09-12T18:37:28.901 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.901 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.901 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:28.901 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495319+0000", 2024-09-12T18:37:28.901 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8240000000000002e-06 2024-09-12T18:37:28.901 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.901 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.901 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:28.901 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.496088+0000", 2024-09-12T18:37:28.901 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00076901200000000002 2024-09-12T18:37:28.901 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.901 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.901 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:28.901 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.496166+0000", 2024-09-12T18:37:28.902 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.8491000000000005e-05 2024-09-12T18:37:28.902 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.902 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.902 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:28.902 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.496232+0000", 2024-09-12T18:37:28.902 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5400000000000004e-05 2024-09-12T18:37:28.902 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.902 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.902 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:28.902 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.497467+0000", 2024-09-12T18:37:28.902 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001235049 2024-09-12T18:37:28.902 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.902 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.902 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:28.903 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543463+0000", 2024-09-12T18:37:28.903 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.045995743999999998 2024-09-12T18:37:28.903 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.903 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.903 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:28.903 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543546+0000", 2024-09-12T18:37:28.903 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3434000000000001e-05 2024-09-12T18:37:28.903 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:28.903 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:28.903 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:28.903 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543608+0000", 2024-09-12T18:37:28.903 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1645999999999999e-05 2024-09-12T18:37:28.903 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.903 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:28.904 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.904 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:28.904 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:28.904 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:28.905 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:37:28.906 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:28.900+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:29.006 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:28.998+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:29.069 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:29.069 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:37:29.069 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.069 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:220291 5.f 5:f5348497:::benchmark_data_smithi073_23739_object88014:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-12T18:37:29.069 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:29.065416+0000", 2024-09-12T18:37:29.069 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0015920019999999999, 2024-09-12T18:37:29.070 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001610453, 2024-09-12T18:37:29.070 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:29.070 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:29.070 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:29.070 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:29.070 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:29.070 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:29.070 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 220291 2024-09-12T18:37:29.070 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.070 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:29.070 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.070 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:29.070 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.065416+0000", 2024-09-12T18:37:29.070 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.071 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.071 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.071 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:29.071 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.065416+0000", 2024-09-12T18:37:29.071 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.071 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.071 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.071 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:29.071 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.065416+0000", 2024-09-12T18:37:29.071 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0599999999999999e-07 2024-09-12T18:37:29.071 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.071 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.071 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:29.072 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.065421+0000", 2024-09-12T18:37:29.072 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.1779999999999996e-06 2024-09-12T18:37:29.072 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.072 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.072 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:29.072 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.065434+0000", 2024-09-12T18:37:29.072 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2991e-05 2024-09-12T18:37:29.072 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.072 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.072 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:29.072 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.065441+0000", 2024-09-12T18:37:29.072 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.5460000000000003e-06 2024-09-12T18:37:29.072 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.072 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.073 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:29.073 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.065747+0000", 2024-09-12T18:37:29.073 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00030631300000000001 2024-09-12T18:37:29.073 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.073 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.073 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:29.073 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.065814+0000", 2024-09-12T18:37:29.073 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.6107999999999998e-05 2024-09-12T18:37:29.073 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.073 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.073 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:29.073 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.065877+0000", 2024-09-12T18:37:29.073 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.3e-05 2024-09-12T18:37:29.074 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.074 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:29.074 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.074 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.074 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.074 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop_reply(client.4480.0:220284 5.5 e70/49)", 2024-09-12T18:37:29.074 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:29.066547+0000", 2024-09-12T18:37:29.074 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.00046031000000000002, 2024-09-12T18:37:29.074 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000517717, 2024-09-12T18:37:29.074 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:29.074 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:29.074 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:29.074 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:29.074 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.075 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:29.075 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.066547+0000", 2024-09-12T18:37:29.075 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.075 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.075 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.075 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:29.075 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.066547+0000", 2024-09-12T18:37:29.075 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.075 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.075 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.075 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:29.075 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.066548+0000", 2024-09-12T18:37:29.075 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.44e-07 2024-09-12T18:37:29.076 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.076 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.076 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:29.076 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.066551+0000", 2024-09-12T18:37:29.076 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.411e-06 2024-09-12T18:37:29.076 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.076 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.076 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:29.076 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.066560+0000", 2024-09-12T18:37:29.076 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.0860000000000008e-06 2024-09-12T18:37:29.076 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.076 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.076 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:29.076 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.066565+0000", 2024-09-12T18:37:29.077 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.7899999999999999e-06 2024-09-12T18:37:29.077 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.077 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:29.077 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.077 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.077 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.077 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:220276 5.7 5:ecb86466:::benchmark_data_smithi073_23739_object87999:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-12T18:37:29.077 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:29.059760+0000", 2024-09-12T18:37:29.077 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0072476900000000002, 2024-09-12T18:37:29.077 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0073308180000000002, 2024-09-12T18:37:29.077 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:29.077 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:29.077 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:29.078 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:29.078 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:29.078 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:29.078 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 220276 2024-09-12T18:37:29.078 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.078 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:29.078 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.078 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:29.078 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.059760+0000", 2024-09-12T18:37:29.078 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.078 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.078 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.078 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:29.078 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.059760+0000", 2024-09-12T18:37:29.079 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.079 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.079 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.079 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:29.079 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.059761+0000", 2024-09-12T18:37:29.079 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.33e-07 2024-09-12T18:37:29.079 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.079 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.079 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:29.079 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.059764+0000", 2024-09-12T18:37:29.079 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5889999999999999e-06 2024-09-12T18:37:29.079 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.079 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.079 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:29.080 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.059774+0000", 2024-09-12T18:37:29.080 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.5149999999999995e-06 2024-09-12T18:37:29.080 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.080 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.080 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:29.080 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.059780+0000", 2024-09-12T18:37:29.080 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.7300000000000002e-06 2024-09-12T18:37:29.080 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.080 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.080 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:29.080 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.060612+0000", 2024-09-12T18:37:29.080 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00083220600000000005 2024-09-12T18:37:29.080 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.081 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.081 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:29.081 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.060737+0000", 2024-09-12T18:37:29.081 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012510900000000001 2024-09-12T18:37:29.081 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.081 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.081 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:29.081 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.060862+0000", 2024-09-12T18:37:29.081 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012499200000000001 2024-09-12T18:37:29.081 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.081 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.081 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:29.081 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.063586+0000", 2024-09-12T18:37:29.082 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0027240760000000002 2024-09-12T18:37:29.082 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.082 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:29.082 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.082 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.082 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.082 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:220282 5.9 5:9a8ceb3e:::benchmark_data_smithi073_23739_object88005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-12T18:37:29.082 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:29.060921+0000", 2024-09-12T18:37:29.082 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0060868049999999998, 2024-09-12T18:37:29.082 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0062066320000000001, 2024-09-12T18:37:29.082 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:29.082 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:29.082 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:29.082 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:29.083 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:29.083 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:29.083 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 220282 2024-09-12T18:37:29.083 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.083 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:29.083 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.083 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:29.083 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.060921+0000", 2024-09-12T18:37:29.083 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.083 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.083 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.083 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:29.083 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.060921+0000", 2024-09-12T18:37:29.084 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.084 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.084 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.084 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:29.084 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.060921+0000", 2024-09-12T18:37:29.084 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.3600000000000003e-07 2024-09-12T18:37:29.084 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.084 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.084 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:29.084 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.060924+0000", 2024-09-12T18:37:29.084 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.9349999999999999e-06 2024-09-12T18:37:29.084 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.084 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.085 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:29.085 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.060931+0000", 2024-09-12T18:37:29.085 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9659999999999999e-06 2024-09-12T18:37:29.085 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.085 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.085 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:29.085 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.060936+0000", 2024-09-12T18:37:29.085 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.9559999999999996e-06 2024-09-12T18:37:29.085 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.085 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.085 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:29.085 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.060985+0000", 2024-09-12T18:37:29.085 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.9011000000000002e-05 2024-09-12T18:37:29.086 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.086 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.086 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:29.086 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.061062+0000", 2024-09-12T18:37:29.086 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.6699999999999994e-05 2024-09-12T18:37:29.086 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.086 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.086 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:29.086 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.061124+0000", 2024-09-12T18:37:29.086 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.1667000000000004e-05 2024-09-12T18:37:29.086 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.086 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.086 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:29.086 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.063016+0000", 2024-09-12T18:37:29.087 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0018927239999999999 2024-09-12T18:37:29.087 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.087 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:29.087 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.087 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.087 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.087 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:220283 5.f 5:f5c170a4:::benchmark_data_smithi073_23739_object88006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-12T18:37:29.087 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:29.061453+0000", 2024-09-12T18:37:29.087 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0055547900000000004, 2024-09-12T18:37:29.087 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0057111719999999996, 2024-09-12T18:37:29.087 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:29.087 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:29.087 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:29.088 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:29.088 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:29.088 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:29.088 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 220283 2024-09-12T18:37:29.088 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.088 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:29.088 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.088 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:29.088 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.061453+0000", 2024-09-12T18:37:29.088 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.088 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.088 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.088 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:29.088 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.061453+0000", 2024-09-12T18:37:29.089 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.089 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.089 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.089 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:29.089 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.061453+0000", 2024-09-12T18:37:29.089 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.4199999999999995e-07 2024-09-12T18:37:29.089 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.089 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.089 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:29.089 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.061456+0000", 2024-09-12T18:37:29.089 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.5840000000000002e-06 2024-09-12T18:37:29.089 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.089 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.090 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:29.090 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.061464+0000", 2024-09-12T18:37:29.090 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8159999999999994e-06 2024-09-12T18:37:29.090 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.090 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.090 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:29.090 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.061468+0000", 2024-09-12T18:37:29.090 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.2799999999999997e-06 2024-09-12T18:37:29.090 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.090 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.090 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:29.090 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.062494+0000", 2024-09-12T18:37:29.090 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001026405 2024-09-12T18:37:29.090 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.091 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.091 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:29.091 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.062588+0000", 2024-09-12T18:37:29.091 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.3814000000000007e-05 2024-09-12T18:37:29.091 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.091 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.091 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:29.091 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.062664+0000", 2024-09-12T18:37:29.091 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.5681999999999998e-05 2024-09-12T18:37:29.091 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.091 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.091 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:29.091 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.065731+0000", 2024-09-12T18:37:29.091 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0030667950000000002 2024-09-12T18:37:29.092 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.092 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:29.092 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.092 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.092 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.092 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:220278 5.c e70/21 5:3d97c903:::benchmark_data_smithi073_23739_object88001:head v 70'13653, mlcod=70'13650)", 2024-09-12T18:37:29.092 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:29.061568+0000", 2024-09-12T18:37:29.092 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0054397170000000002, 2024-09-12T18:37:29.092 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0056310789999999998, 2024-09-12T18:37:29.092 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:29.092 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:29.092 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:37:29.092 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:29.093 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.093 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:29.093 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.061568+0000", 2024-09-12T18:37:29.093 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.093 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.093 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.093 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:29.093 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.061568+0000", 2024-09-12T18:37:29.093 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.093 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.093 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.093 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:29.093 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.061568+0000", 2024-09-12T18:37:29.094 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4900000000000001e-07 2024-09-12T18:37:29.094 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.094 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.094 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:29.094 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.061571+0000", 2024-09-12T18:37:29.094 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.2059999999999999e-06 2024-09-12T18:37:29.094 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.094 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.094 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:29.094 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.061584+0000", 2024-09-12T18:37:29.094 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2275e-05 2024-09-12T18:37:29.094 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.094 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.094 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:29.095 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.061588+0000", 2024-09-12T18:37:29.095 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.172e-06 2024-09-12T18:37:29.095 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.095 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.095 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:29.095 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.061668+0000", 2024-09-12T18:37:29.095 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.0552999999999999e-05 2024-09-12T18:37:29.095 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.095 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.095 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:29.095 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.061681+0000", 2024-09-12T18:37:29.095 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2227e-05 2024-09-12T18:37:29.095 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.096 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:29.096 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.096 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.096 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.096 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:220284 5.5 5:a59bd369:::benchmark_data_smithi073_23739_object88007:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-12T18:37:29.096 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:29.062621+0000", 2024-09-12T18:37:29.096 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0043865689999999999, 2024-09-12T18:37:29.096 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0046049979999999999, 2024-09-12T18:37:29.096 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:29.096 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:29.096 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:29.096 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:29.096 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:29.097 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:29.097 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 220284 2024-09-12T18:37:29.097 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.097 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:29.097 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.097 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:29.097 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.062621+0000", 2024-09-12T18:37:29.097 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.097 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.097 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.097 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:29.097 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.062621+0000", 2024-09-12T18:37:29.098 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.098 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.098 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.098 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:29.098 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.062622+0000", 2024-09-12T18:37:29.098 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.246e-06 2024-09-12T18:37:29.098 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.098 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.098 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:29.098 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.062627+0000", 2024-09-12T18:37:29.098 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1970000000000004e-06 2024-09-12T18:37:29.098 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.098 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.098 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:29.099 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.062641+0000", 2024-09-12T18:37:29.099 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3278999999999999e-05 2024-09-12T18:37:29.099 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.099 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.099 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:29.099 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.062649+0000", 2024-09-12T18:37:29.099 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.2830000000000001e-06 2024-09-12T18:37:29.099 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.099 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.099 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:29.099 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.063416+0000", 2024-09-12T18:37:29.099 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00076741999999999999 2024-09-12T18:37:29.099 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.100 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.100 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:29.100 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.063542+0000", 2024-09-12T18:37:29.100 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012586499999999999 2024-09-12T18:37:29.100 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.100 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.100 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:29.100 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.063686+0000", 2024-09-12T18:37:29.100 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014368399999999999 2024-09-12T18:37:29.100 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.100 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.100 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:29.100 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.066164+0000", 2024-09-12T18:37:29.101 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.002478109 2024-09-12T18:37:29.101 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.101 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:29.101 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.101 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.101 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.101 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:220285 5.3 e70/21 5:c16bf84d:::benchmark_data_smithi073_23739_object88008:head v 70'13552, mlcod=70'13550)", 2024-09-12T18:37:29.101 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:29.063077+0000", 2024-09-12T18:37:29.101 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0039309269999999999, 2024-09-12T18:37:29.101 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0041874540000000002, 2024-09-12T18:37:29.101 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:29.101 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:29.101 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:37:29.102 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:29.102 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.102 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:29.102 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.063077+0000", 2024-09-12T18:37:29.102 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.102 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.102 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.102 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:29.102 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.063077+0000", 2024-09-12T18:37:29.102 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.102 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.102 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.102 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:29.102 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.063077+0000", 2024-09-12T18:37:29.103 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9400000000000005e-07 2024-09-12T18:37:29.103 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.103 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.103 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:29.103 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.063083+0000", 2024-09-12T18:37:29.103 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2820000000000004e-06 2024-09-12T18:37:29.103 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.103 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.103 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:29.103 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.063094+0000", 2024-09-12T18:37:29.103 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1083e-05 2024-09-12T18:37:29.103 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.103 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.103 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:29.104 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.063102+0000", 2024-09-12T18:37:29.104 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8599999999999993e-06 2024-09-12T18:37:29.104 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.104 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.104 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:29.104 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.063158+0000", 2024-09-12T18:37:29.104 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.6331e-05 2024-09-12T18:37:29.104 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.104 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.104 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:29.104 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.063178+0000", 2024-09-12T18:37:29.104 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.0097000000000001e-05 2024-09-12T18:37:29.104 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.105 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:29.105 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.105 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.105 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.105 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:220288 5.7 5:e6e7ad51:::benchmark_data_smithi073_23739_object88011:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-12T18:37:29.105 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:29.064217+0000", 2024-09-12T18:37:29.105 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0027903680000000001, 2024-09-12T18:37:29.105 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0030736280000000001, 2024-09-12T18:37:29.105 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:29.105 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:29.105 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:29.105 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:29.105 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:29.105 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:29.106 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 220288 2024-09-12T18:37:29.106 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.106 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:29.106 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.106 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:29.106 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.064217+0000", 2024-09-12T18:37:29.106 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.106 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.106 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.106 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:29.106 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.064217+0000", 2024-09-12T18:37:29.106 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.106 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.106 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.106 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:29.107 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.064218+0000", 2024-09-12T18:37:29.107 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.172e-06 2024-09-12T18:37:29.107 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.107 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.107 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:29.107 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.064226+0000", 2024-09-12T18:37:29.107 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.5769999999999996e-06 2024-09-12T18:37:29.107 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.107 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.107 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:29.107 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.064239+0000", 2024-09-12T18:37:29.107 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2792999999999999e-05 2024-09-12T18:37:29.107 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.107 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.108 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:29.108 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.064247+0000", 2024-09-12T18:37:29.108 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.3930000000000008e-06 2024-09-12T18:37:29.108 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.108 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.108 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:29.108 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.064287+0000", 2024-09-12T18:37:29.108 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.0370000000000001e-05 2024-09-12T18:37:29.108 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.108 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.108 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:29.108 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.064353+0000", 2024-09-12T18:37:29.108 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.5296999999999995e-05 2024-09-12T18:37:29.108 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.109 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.109 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:29.109 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:29.064418+0000", 2024-09-12T18:37:29.109 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.5314999999999994e-05 2024-09-12T18:37:29.109 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.109 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:29.109 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.109 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.109 INFO:teuthology.orchestra.run.smithi162.stdout: ], 2024-09-12T18:37:29.109 INFO:teuthology.orchestra.run.smithi162.stdout: "num_ops": 9 2024-09-12T18:37:29.109 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:29.111 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:37:29.111 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:29.106+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:29.211 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:29.206+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:29.312 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:29.312 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [], 2024-09-12T18:37:29.312 INFO:teuthology.orchestra.run.smithi162.stdout: "complaint_time": 30, 2024-09-12T18:37:29.312 INFO:teuthology.orchestra.run.smithi162.stdout: "num_blocked_ops": 0 2024-09-12T18:37:29.312 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:29.313 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:29.306+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:29.337 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:37:29.413 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:29.406+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:29.498 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:29.498 INFO:teuthology.orchestra.run.smithi162.stdout: "size": 20, 2024-09-12T18:37:29.498 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 600, 2024-09-12T18:37:29.498 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:37:29.498 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.498 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167364 5.7 5:ee50096a:::benchmark_data_smithi073_23739_object35087:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:29.498 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.168715+0000", 2024-09-12T18:37:29.499 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 26.325584221, 2024-09-12T18:37:29.499 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.068831153000000006, 2024-09-12T18:37:29.499 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:29.499 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:29.499 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:29.499 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:29.499 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:29.499 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:29.499 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167364 2024-09-12T18:37:29.499 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.499 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:29.499 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.499 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:29.499 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168715+0000", 2024-09-12T18:37:29.500 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.500 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.500 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.500 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:29.500 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168715+0000", 2024-09-12T18:37:29.500 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.500 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.500 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.500 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:29.500 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168716+0000", 2024-09-12T18:37:29.500 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0559999999999999e-06 2024-09-12T18:37:29.500 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.501 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.501 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:29.501 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168721+0000", 2024-09-12T18:37:29.501 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8019999999999999e-06 2024-09-12T18:37:29.501 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.501 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.501 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:29.501 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168731+0000", 2024-09-12T18:37:29.501 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0315e-05 2024-09-12T18:37:29.501 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.501 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.501 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:29.501 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168738+0000", 2024-09-12T18:37:29.501 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.126e-06 2024-09-12T18:37:29.502 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.502 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.502 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:29.502 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168782+0000", 2024-09-12T18:37:29.502 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.3924000000000002e-05 2024-09-12T18:37:29.502 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.502 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.502 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:29.502 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168913+0000", 2024-09-12T18:37:29.502 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000131154 2024-09-12T18:37:29.502 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.502 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.502 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:29.502 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169026+0000", 2024-09-12T18:37:29.503 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011223299999999999 2024-09-12T18:37:29.503 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.503 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.503 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:29.503 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.175404+0000", 2024-09-12T18:37:29.503 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0063780319999999996 2024-09-12T18:37:29.503 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.503 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.503 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:29.503 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237446+0000", 2024-09-12T18:37:29.503 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.062042238 2024-09-12T18:37:29.503 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.503 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.504 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:29.504 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237501+0000", 2024-09-12T18:37:29.504 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4913000000000001e-05 2024-09-12T18:37:29.504 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.504 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.504 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:29.504 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237546+0000", 2024-09-12T18:37:29.504 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.5359999999999999e-05 2024-09-12T18:37:29.504 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.505 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:29.505 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.505 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.505 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.505 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167365 5.2 5:4107875c:::benchmark_data_smithi073_23739_object35088:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:29.505 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:29.505 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 26.325534647000001, 2024-09-12T18:37:29.505 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.078544438999999994, 2024-09-12T18:37:29.505 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:29.505 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:29.505 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:29.505 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:29.505 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:29.505 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:29.506 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167365 2024-09-12T18:37:29.506 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.506 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:29.506 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.506 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:29.506 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:29.506 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.506 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.506 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.506 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:29.506 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:29.506 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.506 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.507 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.507 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:29.507 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:29.507 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.4700000000000001e-07 2024-09-12T18:37:29.507 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.507 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.507 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:29.507 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168769+0000", 2024-09-12T18:37:29.507 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.4170000000000001e-06 2024-09-12T18:37:29.507 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.508 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.508 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:29.508 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168777+0000", 2024-09-12T18:37:29.508 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1499999999999999e-06 2024-09-12T18:37:29.508 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.508 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.508 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:29.508 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168783+0000", 2024-09-12T18:37:29.508 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.0460000000000002e-06 2024-09-12T18:37:29.508 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.508 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.508 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:29.508 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168865+0000", 2024-09-12T18:37:29.509 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1953999999999995e-05 2024-09-12T18:37:29.509 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.509 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.509 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:29.509 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169003+0000", 2024-09-12T18:37:29.509 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013798200000000001 2024-09-12T18:37:29.509 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.509 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.509 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:29.509 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169065+0000", 2024-09-12T18:37:29.509 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2218000000000006e-05 2024-09-12T18:37:29.510 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.510 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.510 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:29.510 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174771+0000", 2024-09-12T18:37:29.510 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0057054819999999996 2024-09-12T18:37:29.510 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.510 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.510 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:29.510 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.247234+0000", 2024-09-12T18:37:29.510 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.072463391000000002 2024-09-12T18:37:29.510 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.511 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.511 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:29.511 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.247273+0000", 2024-09-12T18:37:29.511 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.9069000000000002e-05 2024-09-12T18:37:29.511 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.511 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.511 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:29.511 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.247309+0000", 2024-09-12T18:37:29.511 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5982999999999998e-05 2024-09-12T18:37:29.511 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.511 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:29.511 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.511 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.512 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.512 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167369 5.7 5:e64ecabd:::benchmark_data_smithi073_23739_object35092:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:29.512 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.169042+0000", 2024-09-12T18:37:29.512 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 26.325257535999999, 2024-09-12T18:37:29.512 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.069229188999999997, 2024-09-12T18:37:29.512 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:29.512 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:29.512 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:29.512 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:29.512 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:29.512 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:29.512 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167369 2024-09-12T18:37:29.513 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.513 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:29.513 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.513 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:29.513 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169042+0000", 2024-09-12T18:37:29.513 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.513 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.513 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.513 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:29.513 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169042+0000", 2024-09-12T18:37:29.513 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.513 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.513 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.513 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:29.514 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169043+0000", 2024-09-12T18:37:29.514 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.9400000000000004e-07 2024-09-12T18:37:29.514 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.514 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.514 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:29.514 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169048+0000", 2024-09-12T18:37:29.514 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8420000000000004e-06 2024-09-12T18:37:29.514 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.514 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.514 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:29.514 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169055+0000", 2024-09-12T18:37:29.514 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.7989999999999994e-06 2024-09-12T18:37:29.515 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.515 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.515 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:29.515 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169062+0000", 2024-09-12T18:37:29.515 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.5950000000000004e-06 2024-09-12T18:37:29.515 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.515 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.515 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:29.515 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173858+0000", 2024-09-12T18:37:29.515 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0047959259999999998 2024-09-12T18:37:29.515 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.515 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.515 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:29.515 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173966+0000", 2024-09-12T18:37:29.516 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000107941 2024-09-12T18:37:29.516 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.516 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.516 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:29.516 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174043+0000", 2024-09-12T18:37:29.516 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.7360000000000005e-05 2024-09-12T18:37:29.516 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.516 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.516 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:29.516 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.175711+0000", 2024-09-12T18:37:29.516 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0016680810000000001 2024-09-12T18:37:29.516 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.516 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.516 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:29.517 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.238163+0000", 2024-09-12T18:37:29.517 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.062451523000000002 2024-09-12T18:37:29.517 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.517 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.517 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:29.517 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.238222+0000", 2024-09-12T18:37:29.517 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9723999999999999e-05 2024-09-12T18:37:29.517 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.517 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.517 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:29.517 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.238271+0000", 2024-09-12T18:37:29.517 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8504000000000002e-05 2024-09-12T18:37:29.517 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.517 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:29.518 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.518 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.518 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.518 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167373 5.5 5:ad283029:::benchmark_data_smithi073_23739_object35096:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:29.518 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:29.518 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 26.322752704999999, 2024-09-12T18:37:29.518 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.066200976999999994, 2024-09-12T18:37:29.518 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:29.518 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:29.518 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:29.518 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:29.518 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:29.518 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:29.519 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167373 2024-09-12T18:37:29.519 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.519 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:29.519 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.519 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:29.519 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:29.519 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.519 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.519 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.519 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:29.519 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:29.519 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.519 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.520 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.520 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:29.520 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:29.520 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4900000000000005e-07 2024-09-12T18:37:29.520 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.520 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.520 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:29.520 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171551+0000", 2024-09-12T18:37:29.520 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.7519999999999998e-06 2024-09-12T18:37:29.520 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.520 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.520 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:29.520 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171562+0000", 2024-09-12T18:37:29.520 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0353000000000001e-05 2024-09-12T18:37:29.521 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.521 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.521 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:29.521 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171566+0000", 2024-09-12T18:37:29.521 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8269999999999997e-06 2024-09-12T18:37:29.521 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.521 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.521 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:29.521 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171622+0000", 2024-09-12T18:37:29.521 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5220999999999999e-05 2024-09-12T18:37:29.521 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.521 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.521 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:29.521 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171719+0000", 2024-09-12T18:37:29.522 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7238999999999995e-05 2024-09-12T18:37:29.522 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.522 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.522 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:29.522 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171802+0000", 2024-09-12T18:37:29.522 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.3285e-05 2024-09-12T18:37:29.522 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.522 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.522 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:29.522 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174608+0000", 2024-09-12T18:37:29.522 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028054590000000002 2024-09-12T18:37:29.522 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.522 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.522 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:29.522 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174762+0000", 2024-09-12T18:37:29.523 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015465100000000001 2024-09-12T18:37:29.523 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.523 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.523 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:29.523 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237474+0000", 2024-09-12T18:37:29.523 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.062711683000000004 2024-09-12T18:37:29.523 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.523 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.523 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:29.523 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237540+0000", 2024-09-12T18:37:29.523 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.6132999999999999e-05 2024-09-12T18:37:29.523 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.523 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.523 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:29.523 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237748+0000", 2024-09-12T18:37:29.524 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020752499999999999 2024-09-12T18:37:29.524 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.524 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:29.524 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.524 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.524 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.524 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167374 5.1 5:81e25826:::benchmark_data_smithi073_23739_object35097:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:29.524 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.173748+0000", 2024-09-12T18:37:29.524 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 26.320551256999998, 2024-09-12T18:37:29.524 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.069225245000000005, 2024-09-12T18:37:29.524 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:29.524 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:29.524 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:29.524 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:29.524 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:29.525 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:29.525 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167374 2024-09-12T18:37:29.525 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.525 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:29.525 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.525 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:29.525 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173748+0000", 2024-09-12T18:37:29.525 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.525 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.525 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.525 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:29.525 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173748+0000", 2024-09-12T18:37:29.525 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.525 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.526 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.526 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:29.526 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173749+0000", 2024-09-12T18:37:29.526 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.418e-06 2024-09-12T18:37:29.526 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.526 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.526 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:29.526 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173755+0000", 2024-09-12T18:37:29.526 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.0730000000000004e-06 2024-09-12T18:37:29.526 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.526 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.526 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:29.526 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173768+0000", 2024-09-12T18:37:29.526 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3644e-05 2024-09-12T18:37:29.526 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.526 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.527 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:29.527 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173777+0000", 2024-09-12T18:37:29.527 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4160000000000004e-06 2024-09-12T18:37:29.527 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.527 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.527 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:29.527 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173927+0000", 2024-09-12T18:37:29.527 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015065900000000001 2024-09-12T18:37:29.527 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.527 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.527 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:29.527 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174052+0000", 2024-09-12T18:37:29.528 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012460699999999999 2024-09-12T18:37:29.528 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.528 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.528 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:29.528 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174181+0000", 2024-09-12T18:37:29.528 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012919299999999999 2024-09-12T18:37:29.528 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.528 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.528 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:29.528 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.178108+0000", 2024-09-12T18:37:29.528 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0039273210000000001 2024-09-12T18:37:29.528 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.528 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.528 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:29.529 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.178118+0000", 2024-09-12T18:37:29.529 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7550000000000006e-06 2024-09-12T18:37:29.529 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.529 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.529 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:29.529 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.242865+0000", 2024-09-12T18:37:29.529 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.064746597000000003 2024-09-12T18:37:29.529 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.529 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.529 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:29.529 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.242903+0000", 2024-09-12T18:37:29.530 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.8268e-05 2024-09-12T18:37:29.530 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.530 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.530 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:29.530 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.242973+0000", 2024-09-12T18:37:29.530 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0294000000000002e-05 2024-09-12T18:37:29.530 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.530 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:29.530 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.530 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.530 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.530 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167375 5.1 5:83a09102:::benchmark_data_smithi073_23739_object35098:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:29.530 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:29.531 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 26.32049971, 2024-09-12T18:37:29.531 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.069437463000000005, 2024-09-12T18:37:29.531 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:29.531 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:29.531 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:29.531 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:29.531 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:29.531 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:29.531 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167375 2024-09-12T18:37:29.531 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.531 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:29.531 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.531 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:29.531 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:29.532 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.532 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.532 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.532 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:29.532 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:29.532 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.532 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.532 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.532 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:29.532 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:29.532 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1399999999999997e-07 2024-09-12T18:37:29.532 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.533 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.533 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:29.533 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173803+0000", 2024-09-12T18:37:29.533 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.7860000000000001e-06 2024-09-12T18:37:29.533 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.533 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.533 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:29.533 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173811+0000", 2024-09-12T18:37:29.533 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4610000000000008e-06 2024-09-12T18:37:29.533 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.533 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.533 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:29.533 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173817+0000", 2024-09-12T18:37:29.534 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3569999999999997e-06 2024-09-12T18:37:29.534 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.534 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.534 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:29.534 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.176070+0000", 2024-09-12T18:37:29.534 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.002253405 2024-09-12T18:37:29.534 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.534 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.534 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:29.534 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.176263+0000", 2024-09-12T18:37:29.534 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000192583 2024-09-12T18:37:29.534 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.534 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.535 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:29.535 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.176429+0000", 2024-09-12T18:37:29.535 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00016626 2024-09-12T18:37:29.535 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.535 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.535 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:29.535 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.178154+0000", 2024-09-12T18:37:29.535 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0017247009999999999 2024-09-12T18:37:29.535 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.535 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.535 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:29.535 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.182110+0000", 2024-09-12T18:37:29.535 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0039568229999999999 2024-09-12T18:37:29.536 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.536 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.536 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:29.536 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.243024+0000", 2024-09-12T18:37:29.536 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.060913249000000003 2024-09-12T18:37:29.536 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.536 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.536 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:29.536 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.243107+0000", 2024-09-12T18:37:29.536 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.3090000000000006e-05 2024-09-12T18:37:29.536 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.536 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.536 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:29.537 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.243237+0000", 2024-09-12T18:37:29.537 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013023399999999999 2024-09-12T18:37:29.537 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.537 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:29.537 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.537 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.537 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.537 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201515 5.5 5:a25bd8bb:::benchmark_data_smithi073_23739_object69238:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:29.537 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.437024+0000", 2024-09-12T18:37:29.537 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 9.0572754779999993, 2024-09-12T18:37:29.537 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.040476102, 2024-09-12T18:37:29.537 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:29.538 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:29.538 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:29.538 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:29.538 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:29.538 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:29.538 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201515 2024-09-12T18:37:29.538 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.538 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:29.538 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.538 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:29.538 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437024+0000", 2024-09-12T18:37:29.538 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.538 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.538 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.539 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:29.539 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437024+0000", 2024-09-12T18:37:29.539 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.539 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.539 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.539 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:29.539 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437025+0000", 2024-09-12T18:37:29.539 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2240000000000001e-06 2024-09-12T18:37:29.539 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.539 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.539 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:29.539 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437030+0000", 2024-09-12T18:37:29.539 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.7049999999999998e-06 2024-09-12T18:37:29.539 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.539 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.540 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:29.540 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437040+0000", 2024-09-12T18:37:29.540 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0351e-05 2024-09-12T18:37:29.540 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.540 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.540 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:29.540 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437049+0000", 2024-09-12T18:37:29.540 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5750000000000001e-06 2024-09-12T18:37:29.540 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.540 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.540 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:29.540 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437574+0000", 2024-09-12T18:37:29.541 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00052566400000000001 2024-09-12T18:37:29.541 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.541 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.541 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:29.541 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437673+0000", 2024-09-12T18:37:29.541 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.8672000000000007e-05 2024-09-12T18:37:29.541 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.541 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.541 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:29.541 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437755+0000", 2024-09-12T18:37:29.541 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1705000000000005e-05 2024-09-12T18:37:29.541 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.541 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.542 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:29.542 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.439556+0000", 2024-09-12T18:37:29.542 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0018009020000000001 2024-09-12T18:37:29.542 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.542 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.542 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:29.542 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.439955+0000", 2024-09-12T18:37:29.542 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00039966900000000001 2024-09-12T18:37:29.542 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.542 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.542 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:29.542 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.477267+0000", 2024-09-12T18:37:29.543 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.037311614 2024-09-12T18:37:29.543 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.543 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.543 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:29.543 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.477368+0000", 2024-09-12T18:37:29.543 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000101495 2024-09-12T18:37:29.543 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.543 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.543 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:29.543 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.477500+0000", 2024-09-12T18:37:29.543 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000131526 2024-09-12T18:37:29.543 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.544 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:29.544 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.544 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.544 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.544 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201566 5.9 5:9ea8bdd3:::benchmark_data_smithi073_23739_object69289:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:29.544 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.487311+0000", 2024-09-12T18:37:29.544 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 9.0069879309999994, 2024-09-12T18:37:29.544 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.044734547, 2024-09-12T18:37:29.544 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:29.544 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:29.544 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:29.544 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:29.545 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:29.545 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:29.545 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201566 2024-09-12T18:37:29.545 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.545 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:29.545 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.545 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:29.545 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487311+0000", 2024-09-12T18:37:29.545 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.545 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.545 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.545 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:29.545 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487311+0000", 2024-09-12T18:37:29.546 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.546 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.546 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.546 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:29.546 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487313+0000", 2024-09-12T18:37:29.546 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3060000000000001e-06 2024-09-12T18:37:29.546 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.546 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.546 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:29.546 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487318+0000", 2024-09-12T18:37:29.546 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.181e-06 2024-09-12T18:37:29.546 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.546 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.546 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:29.546 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487333+0000", 2024-09-12T18:37:29.547 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5012e-05 2024-09-12T18:37:29.547 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.547 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.547 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:29.547 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487344+0000", 2024-09-12T18:37:29.547 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0733999999999999e-05 2024-09-12T18:37:29.547 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.547 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.547 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:29.547 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487403+0000", 2024-09-12T18:37:29.547 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9858999999999997e-05 2024-09-12T18:37:29.547 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.547 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.548 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:29.548 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487600+0000", 2024-09-12T18:37:29.548 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019617899999999999 2024-09-12T18:37:29.548 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.548 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.548 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:29.548 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487769+0000", 2024-09-12T18:37:29.548 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00016919299999999999 2024-09-12T18:37:29.548 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.548 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.548 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:29.548 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492984+0000", 2024-09-12T18:37:29.549 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0052155309999999998 2024-09-12T18:37:29.549 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.549 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.549 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:29.549 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531791+0000", 2024-09-12T18:37:29.549 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.038806861999999998 2024-09-12T18:37:29.549 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.549 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.549 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:29.549 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531946+0000", 2024-09-12T18:37:29.549 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015445300000000001 2024-09-12T18:37:29.549 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.550 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.550 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:29.550 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532046+0000", 2024-09-12T18:37:29.550 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000100237 2024-09-12T18:37:29.550 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.550 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:29.550 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.550 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.550 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.550 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201569 5.9 5:9719244e:::benchmark_data_smithi073_23739_object69292:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:29.550 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.487551+0000", 2024-09-12T18:37:29.550 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 9.0067485709999993, 2024-09-12T18:37:29.550 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.045212927, 2024-09-12T18:37:29.551 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:29.551 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:29.551 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:29.551 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:29.551 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:29.551 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:29.551 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201569 2024-09-12T18:37:29.551 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.551 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:29.551 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.551 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:29.551 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487551+0000", 2024-09-12T18:37:29.551 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.552 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.552 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.552 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:29.552 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487551+0000", 2024-09-12T18:37:29.552 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.552 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.552 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.552 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:29.552 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487552+0000", 2024-09-12T18:37:29.552 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6160000000000001e-06 2024-09-12T18:37:29.552 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.552 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.552 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:29.553 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487566+0000", 2024-09-12T18:37:29.553 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.344e-05 2024-09-12T18:37:29.553 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.553 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.553 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:29.553 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487581+0000", 2024-09-12T18:37:29.553 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5526e-05 2024-09-12T18:37:29.553 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.553 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.553 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:29.553 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487593+0000", 2024-09-12T18:37:29.553 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1443e-05 2024-09-12T18:37:29.553 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.554 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.554 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:29.554 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.489599+0000", 2024-09-12T18:37:29.554 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0020058960000000001 2024-09-12T18:37:29.554 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.554 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.554 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:29.554 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.489710+0000", 2024-09-12T18:37:29.554 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000111634 2024-09-12T18:37:29.554 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.554 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.554 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:29.554 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.489796+0000", 2024-09-12T18:37:29.554 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5235999999999995e-05 2024-09-12T18:37:29.555 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.555 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.555 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:29.555 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532140+0000", 2024-09-12T18:37:29.555 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.042344524000000001 2024-09-12T18:37:29.555 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.555 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.555 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:29.555 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532559+0000", 2024-09-12T18:37:29.555 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00041908800000000002 2024-09-12T18:37:29.555 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.555 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.555 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:29.556 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532676+0000", 2024-09-12T18:37:29.556 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011649100000000001 2024-09-12T18:37:29.556 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.556 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.556 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:29.556 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532764+0000", 2024-09-12T18:37:29.556 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8033000000000002e-05 2024-09-12T18:37:29.556 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.556 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:29.556 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.556 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.556 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.556 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201570 5.5 5:a97bff67:::benchmark_data_smithi073_23739_object69293:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:29.557 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.487618+0000", 2024-09-12T18:37:29.557 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 9.0066809859999992, 2024-09-12T18:37:29.557 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.049152553000000002, 2024-09-12T18:37:29.557 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:29.557 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:29.557 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:29.557 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:29.557 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:29.557 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:29.557 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201570 2024-09-12T18:37:29.557 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.557 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:29.557 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.558 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:29.558 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487618+0000", 2024-09-12T18:37:29.558 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.558 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.558 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.558 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:29.558 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487618+0000", 2024-09-12T18:37:29.558 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.558 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.558 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.558 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:29.558 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487619+0000", 2024-09-12T18:37:29.558 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.6099999999999999e-07 2024-09-12T18:37:29.558 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.559 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.559 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:29.559 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487623+0000", 2024-09-12T18:37:29.559 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.0940000000000001e-06 2024-09-12T18:37:29.559 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.559 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.559 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:29.559 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487635+0000", 2024-09-12T18:37:29.559 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1348e-05 2024-09-12T18:37:29.559 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.560 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.560 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:29.560 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487657+0000", 2024-09-12T18:37:29.560 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2246999999999999e-05 2024-09-12T18:37:29.560 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.560 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.560 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:29.560 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490684+0000", 2024-09-12T18:37:29.560 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0030268339999999999 2024-09-12T18:37:29.560 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.560 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.560 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:29.560 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490797+0000", 2024-09-12T18:37:29.561 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011372200000000001 2024-09-12T18:37:29.561 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.561 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.561 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:29.561 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490909+0000", 2024-09-12T18:37:29.561 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000111239 2024-09-12T18:37:29.561 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.561 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.561 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:29.561 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534345+0000", 2024-09-12T18:37:29.561 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.043436648000000001 2024-09-12T18:37:29.561 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.562 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.562 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:29.562 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534711+0000", 2024-09-12T18:37:29.562 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00036576399999999998 2024-09-12T18:37:29.562 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.562 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.562 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:29.562 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536225+0000", 2024-09-12T18:37:29.562 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001513983 2024-09-12T18:37:29.562 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.562 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.562 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:29.563 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536331+0000", 2024-09-12T18:37:29.563 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010603300000000001 2024-09-12T18:37:29.563 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.563 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.563 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:29.563 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536771+0000", 2024-09-12T18:37:29.563 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00043978000000000002 2024-09-12T18:37:29.563 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.563 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:29.563 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.563 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.563 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.564 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:201572 5.3 e67/21 5:caf692c5:::benchmark_data_smithi073_23739_object69295:head v 67'12362, mlcod=67'12360)", 2024-09-12T18:37:29.564 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.490255+0000", 2024-09-12T18:37:29.564 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 9.0040444859999997, 2024-09-12T18:37:29.564 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.044189501999999999, 2024-09-12T18:37:29.564 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:29.564 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:29.564 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:29.564 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:29.564 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.564 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:29.564 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490255+0000", 2024-09-12T18:37:29.564 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.564 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.565 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.565 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:29.565 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490255+0000", 2024-09-12T18:37:29.565 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.565 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.565 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.565 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:29.565 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490256+0000", 2024-09-12T18:37:29.565 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0500000000000003e-07 2024-09-12T18:37:29.565 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.565 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.566 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:29.566 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490260+0000", 2024-09-12T18:37:29.566 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8269999999999997e-06 2024-09-12T18:37:29.566 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.566 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.566 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:29.566 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490269+0000", 2024-09-12T18:37:29.566 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.6549999999999993e-06 2024-09-12T18:37:29.566 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.566 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.566 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:29.567 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490275+0000", 2024-09-12T18:37:29.567 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.46e-06 2024-09-12T18:37:29.567 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.567 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.567 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:29.567 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490328+0000", 2024-09-12T18:37:29.567 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2101999999999997e-05 2024-09-12T18:37:29.567 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.567 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.567 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:29.567 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490347+0000", 2024-09-12T18:37:29.567 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9457999999999999e-05 2024-09-12T18:37:29.568 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.568 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.568 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:29.568 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534382+0000", 2024-09-12T18:37:29.568 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.044034968000000001 2024-09-12T18:37:29.568 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.568 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.568 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:29.568 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534444+0000", 2024-09-12T18:37:29.568 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2327000000000001e-05 2024-09-12T18:37:29.568 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.568 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:29.568 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.569 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.569 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.569 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201574 5.5 5:a963f378:::benchmark_data_smithi073_23739_object69297:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:29.569 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.490449+0000", 2024-09-12T18:37:29.569 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 9.0038505109999996, 2024-09-12T18:37:29.569 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.046749974, 2024-09-12T18:37:29.569 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:29.569 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:29.569 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:29.569 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:29.569 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:29.569 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:29.569 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201574 2024-09-12T18:37:29.569 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.570 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:29.570 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.570 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:29.570 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490449+0000", 2024-09-12T18:37:29.570 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.570 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.570 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.570 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:29.570 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490449+0000", 2024-09-12T18:37:29.570 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.570 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.570 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.570 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:29.571 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490450+0000", 2024-09-12T18:37:29.571 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.17e-06 2024-09-12T18:37:29.571 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.571 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.571 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:29.571 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490455+0000", 2024-09-12T18:37:29.571 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.7319999999999998e-06 2024-09-12T18:37:29.571 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.571 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.571 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:29.571 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490464+0000", 2024-09-12T18:37:29.571 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.4760000000000004e-06 2024-09-12T18:37:29.571 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.571 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.572 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:29.572 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490471+0000", 2024-09-12T18:37:29.572 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.5400000000000001e-06 2024-09-12T18:37:29.572 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.572 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.572 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:29.572 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492695+0000", 2024-09-12T18:37:29.572 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0022245910000000002 2024-09-12T18:37:29.572 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.572 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.572 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:29.572 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492847+0000", 2024-09-12T18:37:29.572 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015127399999999999 2024-09-12T18:37:29.573 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.573 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.573 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:29.573 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492936+0000", 2024-09-12T18:37:29.573 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8953e-05 2024-09-12T18:37:29.573 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.573 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.573 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:29.573 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534614+0000", 2024-09-12T18:37:29.573 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.041678422999999999 2024-09-12T18:37:29.573 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.573 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.574 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:29.574 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534755+0000", 2024-09-12T18:37:29.574 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000140696 2024-09-12T18:37:29.574 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.574 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.574 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:29.574 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536891+0000", 2024-09-12T18:37:29.574 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0021365799999999999 2024-09-12T18:37:29.574 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.574 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.574 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:29.574 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537001+0000", 2024-09-12T18:37:29.574 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000109459 2024-09-12T18:37:29.575 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.575 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.575 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:29.575 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537199+0000", 2024-09-12T18:37:29.575 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019808 2024-09-12T18:37:29.575 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.575 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:29.575 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.575 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.575 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.575 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201576 5.2 5:42a132e0:::benchmark_data_smithi073_23739_object69299:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:29.575 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.490661+0000", 2024-09-12T18:37:29.575 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 9.0036384639999998, 2024-09-12T18:37:29.576 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.041905530000000003, 2024-09-12T18:37:29.576 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:29.576 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:29.576 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:29.576 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:29.576 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:29.576 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:29.576 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201576 2024-09-12T18:37:29.576 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.576 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:29.576 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.576 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:29.577 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490661+0000", 2024-09-12T18:37:29.577 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.577 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.577 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.577 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:29.577 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490661+0000", 2024-09-12T18:37:29.577 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.577 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.577 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.577 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:29.577 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490662+0000", 2024-09-12T18:37:29.577 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5030000000000001e-06 2024-09-12T18:37:29.578 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.578 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.578 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:29.578 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490667+0000", 2024-09-12T18:37:29.578 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4479999999999996e-06 2024-09-12T18:37:29.578 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.578 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.578 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:29.578 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490675+0000", 2024-09-12T18:37:29.578 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8529999999999992e-06 2024-09-12T18:37:29.578 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.579 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.579 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:29.579 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490680+0000", 2024-09-12T18:37:29.579 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1919999999999996e-06 2024-09-12T18:37:29.579 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.579 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.579 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:29.579 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490730+0000", 2024-09-12T18:37:29.579 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.9738999999999999e-05 2024-09-12T18:37:29.579 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.579 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.580 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:29.580 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490833+0000", 2024-09-12T18:37:29.580 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010333 2024-09-12T18:37:29.580 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.580 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.580 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:29.580 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490930+0000", 2024-09-12T18:37:29.580 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7355999999999994e-05 2024-09-12T18:37:29.580 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.580 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.580 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:29.581 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493735+0000", 2024-09-12T18:37:29.581 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028049329999999999 2024-09-12T18:37:29.581 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.581 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.581 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:29.581 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532451+0000", 2024-09-12T18:37:29.581 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.038715554999999999 2024-09-12T18:37:29.581 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.581 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.581 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:29.581 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532514+0000", 2024-09-12T18:37:29.581 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2885000000000005e-05 2024-09-12T18:37:29.582 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.582 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.582 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:29.582 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532566+0000", 2024-09-12T18:37:29.582 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2735999999999998e-05 2024-09-12T18:37:29.582 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.582 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:29.582 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.582 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.582 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.583 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201577 5.7 5:e93d4852:::benchmark_data_smithi073_23739_object69300:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:29.583 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.490721+0000", 2024-09-12T18:37:29.583 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 9.0035784529999994, 2024-09-12T18:37:29.583 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.042097930999999998, 2024-09-12T18:37:29.583 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:29.583 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:29.583 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:29.583 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:29.583 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:29.583 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:29.583 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201577 2024-09-12T18:37:29.583 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.584 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:29.584 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.584 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:29.584 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490721+0000", 2024-09-12T18:37:29.584 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.584 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.584 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.584 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:29.584 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490721+0000", 2024-09-12T18:37:29.584 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.584 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.584 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.584 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:29.585 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490721+0000", 2024-09-12T18:37:29.585 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.1900000000000002e-07 2024-09-12T18:37:29.585 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.585 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.585 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:29.585 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490724+0000", 2024-09-12T18:37:29.585 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.6189999999999998e-06 2024-09-12T18:37:29.585 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.585 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.585 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:29.585 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490731+0000", 2024-09-12T18:37:29.585 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0129999999999996e-06 2024-09-12T18:37:29.585 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.586 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.586 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:29.586 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490736+0000", 2024-09-12T18:37:29.586 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6929999999999998e-06 2024-09-12T18:37:29.586 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.586 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.586 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:29.586 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490788+0000", 2024-09-12T18:37:29.586 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2104000000000001e-05 2024-09-12T18:37:29.586 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.586 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.586 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:29.586 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490926+0000", 2024-09-12T18:37:29.587 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013852800000000001 2024-09-12T18:37:29.587 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.587 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.587 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:29.587 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491061+0000", 2024-09-12T18:37:29.587 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013499700000000001 2024-09-12T18:37:29.587 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.587 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.587 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:29.587 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531660+0000", 2024-09-12T18:37:29.587 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.040599046999999999 2024-09-12T18:37:29.587 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.587 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.587 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:29.588 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532630+0000", 2024-09-12T18:37:29.588 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00096974300000000002 2024-09-12T18:37:29.588 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.588 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.588 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:29.588 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532708+0000", 2024-09-12T18:37:29.588 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8108000000000005e-05 2024-09-12T18:37:29.588 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.588 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.588 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:29.588 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532819+0000", 2024-09-12T18:37:29.588 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011046 2024-09-12T18:37:29.589 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.589 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:29.589 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.589 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.589 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.589 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201578 5.f 5:f19e206c:::benchmark_data_smithi073_23739_object69301:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:29.589 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.491951+0000", 2024-09-12T18:37:29.589 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 9.0023480800000009, 2024-09-12T18:37:29.589 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.043303686000000001, 2024-09-12T18:37:29.589 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:29.589 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:29.589 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:29.589 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:29.590 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:29.590 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:29.590 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201578 2024-09-12T18:37:29.590 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.590 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:29.590 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.590 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:29.590 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491951+0000", 2024-09-12T18:37:29.590 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.590 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.590 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.590 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:29.590 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491951+0000", 2024-09-12T18:37:29.591 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.591 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.591 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.591 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:29.591 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491952+0000", 2024-09-12T18:37:29.591 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.221e-06 2024-09-12T18:37:29.591 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.591 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.591 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:29.591 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491957+0000", 2024-09-12T18:37:29.591 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.0529999999999997e-06 2024-09-12T18:37:29.591 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.592 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.592 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:29.592 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491970+0000", 2024-09-12T18:37:29.592 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2731000000000001e-05 2024-09-12T18:37:29.592 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.592 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.592 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:29.592 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491977+0000", 2024-09-12T18:37:29.592 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.1380000000000001e-06 2024-09-12T18:37:29.592 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.592 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.592 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:29.593 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492031+0000", 2024-09-12T18:37:29.593 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3857999999999998e-05 2024-09-12T18:37:29.593 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.593 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.593 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:29.593 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492125+0000", 2024-09-12T18:37:29.593 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.3275000000000004e-05 2024-09-12T18:37:29.593 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.593 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.593 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:29.593 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492205+0000", 2024-09-12T18:37:29.593 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.0793999999999999e-05 2024-09-12T18:37:29.594 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.594 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.594 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:29.594 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531712+0000", 2024-09-12T18:37:29.594 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.039506708000000001 2024-09-12T18:37:29.594 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.594 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.594 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:29.594 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535161+0000", 2024-09-12T18:37:29.594 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003448586 2024-09-12T18:37:29.594 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.594 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.595 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:29.595 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535202+0000", 2024-09-12T18:37:29.595 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.0945999999999997e-05 2024-09-12T18:37:29.595 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.595 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.595 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:29.595 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535255+0000", 2024-09-12T18:37:29.595 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3375999999999999e-05 2024-09-12T18:37:29.595 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.595 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:29.595 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.596 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.596 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.596 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201579 5.5 5:ac64e9fd:::benchmark_data_smithi073_23739_object69302:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:29.596 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.492711+0000", 2024-09-12T18:37:29.596 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 9.0015879089999995, 2024-09-12T18:37:29.596 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.04478994, 2024-09-12T18:37:29.596 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:29.596 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:29.596 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:29.596 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:29.596 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:29.597 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:29.597 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201579 2024-09-12T18:37:29.597 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.597 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:29.597 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.597 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:29.597 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492711+0000", 2024-09-12T18:37:29.597 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.597 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.597 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.597 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:29.598 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492711+0000", 2024-09-12T18:37:29.598 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.598 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.598 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.598 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:29.598 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492713+0000", 2024-09-12T18:37:29.598 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.105e-06 2024-09-12T18:37:29.598 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.598 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.598 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:29.598 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492720+0000", 2024-09-12T18:37:29.598 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.109e-06 2024-09-12T18:37:29.598 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.599 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.599 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:29.599 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492730+0000", 2024-09-12T18:37:29.599 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.049e-05 2024-09-12T18:37:29.599 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.599 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.599 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:29.599 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492737+0000", 2024-09-12T18:37:29.599 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0960000000000003e-06 2024-09-12T18:37:29.599 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.599 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.599 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:29.600 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.494541+0000", 2024-09-12T18:37:29.600 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0018034139999999999 2024-09-12T18:37:29.600 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.600 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.600 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:29.600 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.494692+0000", 2024-09-12T18:37:29.600 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000150956 2024-09-12T18:37:29.600 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.600 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.600 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:29.600 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.494843+0000", 2024-09-12T18:37:29.601 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000151896 2024-09-12T18:37:29.601 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.601 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.601 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:29.601 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534665+0000", 2024-09-12T18:37:29.601 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.039821829000000003 2024-09-12T18:37:29.601 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.601 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.601 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:29.601 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536866+0000", 2024-09-12T18:37:29.601 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0022007839999999999 2024-09-12T18:37:29.601 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.601 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.602 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:29.602 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537212+0000", 2024-09-12T18:37:29.602 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00034636299999999998 2024-09-12T18:37:29.602 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.602 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.602 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:29.602 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537298+0000", 2024-09-12T18:37:29.602 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5970999999999994e-05 2024-09-12T18:37:29.602 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.602 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.602 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:29.602 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537501+0000", 2024-09-12T18:37:29.602 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020292699999999999 2024-09-12T18:37:29.603 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.603 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:29.603 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.603 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.603 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.603 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201581 5.7 5:e819369d:::benchmark_data_smithi073_23739_object69304:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:29.603 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.493262+0000", 2024-09-12T18:37:29.603 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 9.0010375590000002, 2024-09-12T18:37:29.603 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.042091362, 2024-09-12T18:37:29.603 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:29.604 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:29.604 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:29.604 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:29.604 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:29.604 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:29.604 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201581 2024-09-12T18:37:29.604 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.604 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:29.604 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.604 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:29.604 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493262+0000", 2024-09-12T18:37:29.605 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.605 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.605 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.605 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:29.605 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493262+0000", 2024-09-12T18:37:29.605 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.605 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.605 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.605 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:29.605 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493263+0000", 2024-09-12T18:37:29.605 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.6700000000000003e-07 2024-09-12T18:37:29.605 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.605 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.606 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:29.606 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493266+0000", 2024-09-12T18:37:29.606 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.4850000000000001e-06 2024-09-12T18:37:29.606 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.606 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.606 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:29.606 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493273+0000", 2024-09-12T18:37:29.606 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2019999999999998e-06 2024-09-12T18:37:29.606 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.606 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.606 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:29.606 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493278+0000", 2024-09-12T18:37:29.606 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6210000000000003e-06 2024-09-12T18:37:29.607 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.607 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.607 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:29.607 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493330+0000", 2024-09-12T18:37:29.607 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2587000000000003e-05 2024-09-12T18:37:29.607 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.607 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.607 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:29.607 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493469+0000", 2024-09-12T18:37:29.607 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013901199999999999 2024-09-12T18:37:29.607 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.607 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.607 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:29.608 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493612+0000", 2024-09-12T18:37:29.608 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014237599999999999 2024-09-12T18:37:29.608 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.608 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.608 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:29.608 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531835+0000", 2024-09-12T18:37:29.608 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.038222735000000001 2024-09-12T18:37:29.608 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.608 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.608 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:29.608 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535265+0000", 2024-09-12T18:37:29.608 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003430064 2024-09-12T18:37:29.609 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.609 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.609 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:29.609 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535319+0000", 2024-09-12T18:37:29.609 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4375e-05 2024-09-12T18:37:29.609 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.609 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.609 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:29.609 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535353+0000", 2024-09-12T18:37:29.609 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.4137999999999997e-05 2024-09-12T18:37:29.609 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.609 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:29.609 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.609 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.610 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.610 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:201573 5.3 e67/21 5:cf4becdf:::benchmark_data_smithi073_23739_object69296:head v 67'12363, mlcod=67'12360)", 2024-09-12T18:37:29.610 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.493437+0000", 2024-09-12T18:37:29.610 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 9.0008626239999998, 2024-09-12T18:37:29.610 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.041109664999999997, 2024-09-12T18:37:29.610 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:29.610 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:29.610 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:29.610 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:29.610 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.610 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:29.610 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493437+0000", 2024-09-12T18:37:29.610 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.610 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.611 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.611 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:29.611 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493437+0000", 2024-09-12T18:37:29.611 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.611 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.611 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.611 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:29.611 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493438+0000", 2024-09-12T18:37:29.611 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.125e-06 2024-09-12T18:37:29.611 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.611 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.611 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:29.611 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493444+0000", 2024-09-12T18:37:29.611 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2269999999999998e-06 2024-09-12T18:37:29.612 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.612 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.612 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:29.612 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493457+0000", 2024-09-12T18:37:29.612 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.312e-05 2024-09-12T18:37:29.612 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.612 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.612 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:29.612 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493466+0000", 2024-09-12T18:37:29.612 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.6309999999999992e-06 2024-09-12T18:37:29.612 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.612 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.612 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:29.613 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493526+0000", 2024-09-12T18:37:29.613 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.0316000000000003e-05 2024-09-12T18:37:29.613 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.613 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.613 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:29.613 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493541+0000", 2024-09-12T18:37:29.613 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4459e-05 2024-09-12T18:37:29.613 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.613 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.613 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:29.613 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534501+0000", 2024-09-12T18:37:29.613 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.040960215000000001 2024-09-12T18:37:29.613 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.613 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.614 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:29.614 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534546+0000", 2024-09-12T18:37:29.614 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.5571999999999997e-05 2024-09-12T18:37:29.614 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.614 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:29.614 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.614 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.614 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.614 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201582 5.f 5:f90f147f:::benchmark_data_smithi073_23739_object69305:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:29.614 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.493597+0000", 2024-09-12T18:37:29.614 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 9.0007020929999992, 2024-09-12T18:37:29.614 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.045457567999999997, 2024-09-12T18:37:29.615 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:29.615 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:29.615 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:29.615 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:29.615 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:29.615 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:29.615 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201582 2024-09-12T18:37:29.615 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.615 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:29.615 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.615 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:29.615 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493597+0000", 2024-09-12T18:37:29.616 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.616 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.616 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.616 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:29.616 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493597+0000", 2024-09-12T18:37:29.616 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.616 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.616 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.616 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:29.616 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493598+0000", 2024-09-12T18:37:29.616 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7699999999999992e-07 2024-09-12T18:37:29.616 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.616 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.617 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:29.617 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493609+0000", 2024-09-12T18:37:29.617 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1297e-05 2024-09-12T18:37:29.617 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.617 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.617 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:29.617 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493620+0000", 2024-09-12T18:37:29.617 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0930999999999999e-05 2024-09-12T18:37:29.617 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.617 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.617 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:29.618 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493640+0000", 2024-09-12T18:37:29.618 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.0072e-05 2024-09-12T18:37:29.618 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.618 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.618 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:29.618 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531770+0000", 2024-09-12T18:37:29.618 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.038129652999999999 2024-09-12T18:37:29.618 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.618 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.618 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:29.618 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532046+0000", 2024-09-12T18:37:29.618 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027561600000000001 2024-09-12T18:37:29.619 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.619 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.619 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:29.619 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532337+0000", 2024-09-12T18:37:29.619 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00029169200000000003 2024-09-12T18:37:29.619 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.619 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.619 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:29.619 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536640+0000", 2024-09-12T18:37:29.619 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0043023499999999999 2024-09-12T18:37:29.619 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.619 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.619 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:29.619 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.538943+0000", 2024-09-12T18:37:29.620 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0023032740000000001 2024-09-12T18:37:29.620 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.620 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.620 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:29.620 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.539013+0000", 2024-09-12T18:37:29.620 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9944000000000007e-05 2024-09-12T18:37:29.620 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.620 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.620 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:29.620 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.539055+0000", 2024-09-12T18:37:29.620 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.1761999999999998e-05 2024-09-12T18:37:29.620 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.620 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:29.620 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.621 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.621 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.621 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:201583 5.d e67/21 5:b91eedec:::benchmark_data_smithi073_23739_object69306:head v 67'12761, mlcod=67'12759)", 2024-09-12T18:37:29.621 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.495034+0000", 2024-09-12T18:37:29.621 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 8.9992657180000002, 2024-09-12T18:37:29.621 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.047966852999999997, 2024-09-12T18:37:29.621 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:29.621 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:29.621 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:29.621 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:29.621 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.621 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:29.621 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.495034+0000", 2024-09-12T18:37:29.622 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.622 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.622 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.622 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:29.622 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.495034+0000", 2024-09-12T18:37:29.622 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:29.622 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.622 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.622 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:29.622 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.495035+0000", 2024-09-12T18:37:29.622 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.023e-06 2024-09-12T18:37:29.622 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.622 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.622 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:29.623 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.495040+0000", 2024-09-12T18:37:29.623 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.9300000000000002e-06 2024-09-12T18:37:29.623 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.623 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.623 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:29.623 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531510+0000", 2024-09-12T18:37:29.623 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.036470250000000003 2024-09-12T18:37:29.623 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.623 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.623 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:29.623 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531518+0000", 2024-09-12T18:37:29.623 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8490000000000006e-06 2024-09-12T18:37:29.623 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.623 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.623 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:29.624 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534395+0000", 2024-09-12T18:37:29.624 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.002877246 2024-09-12T18:37:29.624 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.624 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.624 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:29.624 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534418+0000", 2024-09-12T18:37:29.624 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.3119e-05 2024-09-12T18:37:29.624 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.624 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.624 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:29.624 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.542930+0000", 2024-09-12T18:37:29.624 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0085121929999999995 2024-09-12T18:37:29.624 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:29.624 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:29.624 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:29.625 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.543000+0000", 2024-09-12T18:37:29.625 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0242999999999998e-05 2024-09-12T18:37:29.625 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.625 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:29.625 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.625 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:29.625 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:29.625 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:29.626 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T18:37:29.627 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:29.624+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:29.628 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:37:29.728 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:29.722+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:29.782 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:29.782 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:37:29.782 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.782 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:221822 5.c 5:30c8d49f:::benchmark_data_smithi073_23739_object89545:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-12T18:37:29.782 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:29.775171+0000", 2024-09-12T18:37:29.782 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0039734289999999997, 2024-09-12T18:37:29.782 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0039960439999999998, 2024-09-12T18:37:29.783 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:29.783 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:29.783 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:29.783 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:29.783 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:29.783 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:29.783 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 221822 2024-09-12T18:37:29.783 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.783 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:29.783 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.783 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:29.783 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.775171+0000", 2024-09-12T18:37:29.783 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:29.783 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.784 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.784 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:29.784 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.775171+0000", 2024-09-12T18:37:29.784 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:29.784 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.784 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.784 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:29.784 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.775172+0000", 2024-09-12T18:37:29.784 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.02e-07 2024-09-12T18:37:29.784 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.784 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.784 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:29.784 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.775175+0000", 2024-09-12T18:37:29.785 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.5619999999999999e-06 2024-09-12T18:37:29.785 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.785 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.785 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:29.785 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.775184+0000", 2024-09-12T18:37:29.785 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.9279999999999999e-06 2024-09-12T18:37:29.785 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.785 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.785 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:29.785 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.775194+0000", 2024-09-12T18:37:29.785 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.8079999999999999e-06 2024-09-12T18:37:29.785 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.785 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.786 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:29.786 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.775241+0000", 2024-09-12T18:37:29.786 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.6745000000000001e-05 2024-09-12T18:37:29.786 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.786 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.786 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:29.786 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.775362+0000", 2024-09-12T18:37:29.786 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000121239 2024-09-12T18:37:29.786 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.786 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.786 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:29.786 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.775469+0000", 2024-09-12T18:37:29.786 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000106597 2024-09-12T18:37:29.787 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:29.787 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:29.787 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:29.787 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.787 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.787 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:221824 5.a 5:5e748b5a:::benchmark_data_smithi073_23739_object89547:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-12T18:37:29.787 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:29.775312+0000", 2024-09-12T18:37:29.787 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0038326599999999999, 2024-09-12T18:37:29.787 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0039406179999999999, 2024-09-12T18:37:29.787 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:29.787 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:29.787 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:29.787 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:29.787 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:29.788 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:29.788 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 221824 2024-09-12T18:37:29.788 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.788 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:29.788 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.788 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:29.788 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.775312+0000", 2024-09-12T18:37:29.788 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:29.788 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.788 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.788 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:29.788 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.775312+0000", 2024-09-12T18:37:29.788 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:29.789 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.789 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.789 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:29.789 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.775312+0000", 2024-09-12T18:37:29.789 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.54e-07 2024-09-12T18:37:29.789 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.789 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.789 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:29.789 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.775316+0000", 2024-09-12T18:37:29.789 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.5779999999999999e-06 2024-09-12T18:37:29.789 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.789 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.790 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:29.790 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.775325+0000", 2024-09-12T18:37:29.790 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5779999999999999e-06 2024-09-12T18:37:29.790 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.790 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.790 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:29.790 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.775331+0000", 2024-09-12T18:37:29.790 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7959999999999998e-06 2024-09-12T18:37:29.790 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.790 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.790 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:29.790 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.777800+0000", 2024-09-12T18:37:29.790 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.002469031 2024-09-12T18:37:29.790 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.791 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.791 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:29.791 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.777945+0000", 2024-09-12T18:37:29.791 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014423100000000001 2024-09-12T18:37:29.791 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.791 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.791 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:29.791 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.778078+0000", 2024-09-12T18:37:29.791 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013312 2024-09-12T18:37:29.791 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:29.792 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:29.792 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:29.792 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.792 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.792 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:221827 5.a 5.838735fa (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-12T18:37:29.792 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:29.777124+0000", 2024-09-12T18:37:29.792 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0020206270000000001, 2024-09-12T18:37:29.792 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0021881980000000001, 2024-09-12T18:37:29.792 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:29.792 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:29.792 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:29.792 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:29.792 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:29.793 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:29.793 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 221827 2024-09-12T18:37:29.793 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.793 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:29.793 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.793 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:29.793 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.777124+0000", 2024-09-12T18:37:29.793 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:29.793 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.793 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.793 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:29.793 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.777124+0000", 2024-09-12T18:37:29.793 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:29.794 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.794 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.794 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:29.794 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.777125+0000", 2024-09-12T18:37:29.794 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.161e-06 2024-09-12T18:37:29.794 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.794 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.794 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:29.794 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.777130+0000", 2024-09-12T18:37:29.794 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.079e-06 2024-09-12T18:37:29.794 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.795 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.795 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:29.795 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.777143+0000", 2024-09-12T18:37:29.795 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2627e-05 2024-09-12T18:37:29.795 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.795 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.795 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:29.795 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.777150+0000", 2024-09-12T18:37:29.795 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.7069999999999992e-06 2024-09-12T18:37:29.795 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:29.795 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:29.795 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:29.795 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.795 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.796 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:221828 5.c 5:362d42bc:::benchmark_data_smithi073_23739_object89551:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-12T18:37:29.796 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:29.777355+0000", 2024-09-12T18:37:29.796 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0017897080000000001, 2024-09-12T18:37:29.796 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0020025820000000001, 2024-09-12T18:37:29.796 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:29.796 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:29.796 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:29.796 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:29.796 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:29.796 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:29.796 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 221828 2024-09-12T18:37:29.796 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.796 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:29.797 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.797 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:29.797 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.777355+0000", 2024-09-12T18:37:29.797 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:29.797 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.797 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.797 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:29.797 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.777355+0000", 2024-09-12T18:37:29.797 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:29.797 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.797 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.797 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:29.797 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.777355+0000", 2024-09-12T18:37:29.798 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.7300000000000005e-07 2024-09-12T18:37:29.798 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.798 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.798 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:29.798 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.777359+0000", 2024-09-12T18:37:29.798 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.5650000000000002e-06 2024-09-12T18:37:29.798 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.798 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.798 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:29.798 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.777369+0000", 2024-09-12T18:37:29.798 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0417999999999999e-05 2024-09-12T18:37:29.798 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.798 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.799 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:29.799 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.777376+0000", 2024-09-12T18:37:29.799 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3219999999999998e-06 2024-09-12T18:37:29.799 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.799 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.799 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:29.799 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.778247+0000", 2024-09-12T18:37:29.799 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00087152099999999999 2024-09-12T18:37:29.799 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.799 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.799 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:29.799 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.778325+0000", 2024-09-12T18:37:29.799 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.7745999999999997e-05 2024-09-12T18:37:29.799 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.800 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.800 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:29.800 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.778392+0000", 2024-09-12T18:37:29.800 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7149000000000004e-05 2024-09-12T18:37:29.800 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:29.800 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:29.800 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:29.800 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.800 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.800 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:221829 5.5 e70/49 5:a500d301:::benchmark_data_smithi073_23739_object89552:head v 70'14022, mlcod=70'14020)", 2024-09-12T18:37:29.800 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:29.778494+0000", 2024-09-12T18:37:29.800 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00065069399999999995, 2024-09-12T18:37:29.800 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00093680399999999996, 2024-09-12T18:37:29.801 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:29.801 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:29.801 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:29.801 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:29.801 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.801 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:29.801 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.778494+0000", 2024-09-12T18:37:29.801 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:29.801 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.801 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.801 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:29.801 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.778494+0000", 2024-09-12T18:37:29.801 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:29.802 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.802 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.802 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:29.802 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.778494+0000", 2024-09-12T18:37:29.802 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.3399999999999998e-07 2024-09-12T18:37:29.802 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.802 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.802 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:29.802 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.778499+0000", 2024-09-12T18:37:29.802 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.7870000000000001e-06 2024-09-12T18:37:29.802 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.802 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.802 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:29.803 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.778507+0000", 2024-09-12T18:37:29.803 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0839999999999992e-06 2024-09-12T18:37:29.803 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.803 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.803 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:29.803 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.778514+0000", 2024-09-12T18:37:29.803 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8499999999999996e-06 2024-09-12T18:37:29.803 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.803 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.803 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:29.803 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.778571+0000", 2024-09-12T18:37:29.803 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6403000000000002e-05 2024-09-12T18:37:29.803 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.804 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.804 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:29.804 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.778586+0000", 2024-09-12T18:37:29.804 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5033e-05 2024-09-12T18:37:29.804 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:29.804 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:29.804 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:29.804 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.804 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.804 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:221804 5.a e70/21)", 2024-09-12T18:37:29.804 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:29.778675+0000", 2024-09-12T18:37:29.804 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00046944499999999998, 2024-09-12T18:37:29.804 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00079915100000000001, 2024-09-12T18:37:29.805 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:29.805 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:29.805 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:29.805 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:29.805 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.805 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:29.805 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.778675+0000", 2024-09-12T18:37:29.805 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:29.805 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.805 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.805 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:29.806 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.778675+0000", 2024-09-12T18:37:29.806 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:29.806 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.806 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.806 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:29.806 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.778676+0000", 2024-09-12T18:37:29.806 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2300000000000001e-07 2024-09-12T18:37:29.807 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.807 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.807 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:29.807 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.778682+0000", 2024-09-12T18:37:29.807 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8179999999999998e-06 2024-09-12T18:37:29.807 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.807 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.807 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:29.808 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.778693+0000", 2024-09-12T18:37:29.808 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0589e-05 2024-09-12T18:37:29.808 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.808 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.808 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:29.808 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.778700+0000", 2024-09-12T18:37:29.808 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5039999999999996e-06 2024-09-12T18:37:29.808 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:29.808 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:29.809 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:29.809 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.809 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.809 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:221826 5.b e70/21 5:d2780ac8:::benchmark_data_smithi073_23739_object89549:head v 70'14074, mlcod=70'14072)", 2024-09-12T18:37:29.809 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:29.778716+0000", 2024-09-12T18:37:29.809 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00042865399999999999, 2024-09-12T18:37:29.809 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00079669199999999999, 2024-09-12T18:37:29.809 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:29.809 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:29.809 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:29.809 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:29.809 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.809 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:29.810 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.778716+0000", 2024-09-12T18:37:29.810 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:29.810 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.810 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.810 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:29.810 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.778716+0000", 2024-09-12T18:37:29.810 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:29.810 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.810 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.810 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:29.810 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.778716+0000", 2024-09-12T18:37:29.810 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.5600000000000001e-07 2024-09-12T18:37:29.811 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.811 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.811 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:29.811 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.778719+0000", 2024-09-12T18:37:29.811 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.9500000000000001e-06 2024-09-12T18:37:29.811 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.811 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.811 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:29.811 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.778726+0000", 2024-09-12T18:37:29.811 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0480000000000001e-06 2024-09-12T18:37:29.811 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.811 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.811 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:29.812 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.778730+0000", 2024-09-12T18:37:29.812 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.1980000000000003e-06 2024-09-12T18:37:29.812 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.812 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.812 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:29.812 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.778780+0000", 2024-09-12T18:37:29.812 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9481000000000003e-05 2024-09-12T18:37:29.812 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.812 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.812 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:29.812 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.778802+0000", 2024-09-12T18:37:29.812 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1982999999999999e-05 2024-09-12T18:37:29.813 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:29.813 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:29.813 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:29.813 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.813 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.813 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:221831 5.c 5.b1b7318c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-12T18:37:29.813 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:29.778978+0000", 2024-09-12T18:37:29.813 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.000166121, 2024-09-12T18:37:29.813 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00057938399999999995, 2024-09-12T18:37:29.813 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:29.813 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:29.813 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:29.813 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:29.814 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:29.814 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:29.814 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 221831 2024-09-12T18:37:29.814 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.814 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:29.814 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.814 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:29.814 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.778978+0000", 2024-09-12T18:37:29.814 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:29.814 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.814 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.814 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:29.814 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.778978+0000", 2024-09-12T18:37:29.815 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:29.815 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.815 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.815 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:29.815 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.778979+0000", 2024-09-12T18:37:29.815 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1030000000000001e-06 2024-09-12T18:37:29.815 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.815 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.815 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:29.815 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.778984+0000", 2024-09-12T18:37:29.815 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.498e-06 2024-09-12T18:37:29.815 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.815 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.816 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:29.816 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.778995+0000", 2024-09-12T18:37:29.816 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1606e-05 2024-09-12T18:37:29.816 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.816 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.816 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:29.816 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.779003+0000", 2024-09-12T18:37:29.816 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.289e-06 2024-09-12T18:37:29.816 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:29.816 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:29.816 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:29.816 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.816 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.817 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:221830 5.e e70/21 5:72ddc6e0:::benchmark_data_smithi073_23739_object89553:head v 70'14001, mlcod=70'13999)", 2024-09-12T18:37:29.817 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:29.779233+0000", 2024-09-12T18:37:29.817 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4294967295.9999113, 2024-09-12T18:37:29.817 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00037357299999999998, 2024-09-12T18:37:29.817 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:29.817 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:29.817 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:29.817 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:29.817 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.817 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:29.817 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.779233+0000", 2024-09-12T18:37:29.817 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:29.817 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.818 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.818 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:29.818 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.779233+0000", 2024-09-12T18:37:29.818 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:29.818 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.818 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.818 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:29.818 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.779234+0000", 2024-09-12T18:37:29.818 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3e-07 2024-09-12T18:37:29.818 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.818 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.818 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:29.818 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.779239+0000", 2024-09-12T18:37:29.819 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.3369999999999999e-06 2024-09-12T18:37:29.819 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.819 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.819 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:29.819 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.779248+0000", 2024-09-12T18:37:29.819 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.8939999999999999e-06 2024-09-12T18:37:29.819 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.819 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.819 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:29.819 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.779254+0000", 2024-09-12T18:37:29.819 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3559999999999998e-06 2024-09-12T18:37:29.819 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.819 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.819 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:29.820 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.779334+0000", 2024-09-12T18:37:29.820 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.9350000000000004e-05 2024-09-12T18:37:29.820 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.820 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.820 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:29.820 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.779353+0000", 2024-09-12T18:37:29.820 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9284999999999999e-05 2024-09-12T18:37:29.820 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:29.820 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:29.820 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:29.820 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.820 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.820 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:221804 5.a 5:5346acd3:::benchmark_data_smithi073_23739_object89527:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-12T18:37:29.821 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:29.764405+0000", 2024-09-12T18:37:29.821 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.014739461000000001, 2024-09-12T18:37:29.821 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.015250921000000001, 2024-09-12T18:37:29.821 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:29.821 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:29.821 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:29.821 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:29.821 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:29.821 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:29.821 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 221804 2024-09-12T18:37:29.821 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.821 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:29.821 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.822 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:29.822 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.764405+0000", 2024-09-12T18:37:29.822 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:29.822 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.822 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.822 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:29.822 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.764405+0000", 2024-09-12T18:37:29.822 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:29.822 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.822 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.822 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:29.822 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.764405+0000", 2024-09-12T18:37:29.822 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0399999999999996e-07 2024-09-12T18:37:29.823 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.823 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.823 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:29.823 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.764408+0000", 2024-09-12T18:37:29.823 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.322e-06 2024-09-12T18:37:29.823 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.823 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.823 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:29.823 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.764414+0000", 2024-09-12T18:37:29.823 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8880000000000002e-06 2024-09-12T18:37:29.823 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.823 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.823 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:29.824 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.764419+0000", 2024-09-12T18:37:29.824 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.13e-06 2024-09-12T18:37:29.824 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.824 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.824 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:29.824 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.770433+0000", 2024-09-12T18:37:29.824 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0060147159999999998 2024-09-12T18:37:29.824 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.824 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.824 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:29.824 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.770580+0000", 2024-09-12T18:37:29.824 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000147038 2024-09-12T18:37:29.824 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.825 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.825 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:29.825 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.770743+0000", 2024-09-12T18:37:29.825 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00016250499999999999 2024-09-12T18:37:29.825 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.825 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.825 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:29.825 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.774776+0000", 2024-09-12T18:37:29.825 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0040332429999999997 2024-09-12T18:37:29.825 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:29.825 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:29.825 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:29.825 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.825 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.826 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:221820 5.a 5:565be050:::benchmark_data_smithi073_23739_object89543:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-12T18:37:29.826 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:29.774969+0000", 2024-09-12T18:37:29.826 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0041755730000000001, 2024-09-12T18:37:29.826 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.004753111, 2024-09-12T18:37:29.826 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:29.826 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:29.826 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:29.826 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:29.826 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:29.826 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:29.826 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 221820 2024-09-12T18:37:29.826 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.826 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:29.826 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.827 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:29.827 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.774969+0000", 2024-09-12T18:37:29.827 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:29.827 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.827 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.827 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:29.827 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.774969+0000", 2024-09-12T18:37:29.827 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:29.827 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.827 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.827 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:29.827 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.774970+0000", 2024-09-12T18:37:29.827 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4190000000000001e-06 2024-09-12T18:37:29.827 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.828 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.828 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:29.828 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.774976+0000", 2024-09-12T18:37:29.828 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9320000000000001e-06 2024-09-12T18:37:29.828 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.828 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.828 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:29.828 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.774996+0000", 2024-09-12T18:37:29.828 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.0248999999999999e-05 2024-09-12T18:37:29.828 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.828 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.828 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:29.828 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.775004+0000", 2024-09-12T18:37:29.828 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5820000000000004e-06 2024-09-12T18:37:29.829 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.829 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.829 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:29.829 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.775096+0000", 2024-09-12T18:37:29.829 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2449999999999997e-05 2024-09-12T18:37:29.829 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.829 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.829 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:29.829 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.775223+0000", 2024-09-12T18:37:29.829 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012677200000000001 2024-09-12T18:37:29.829 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:29.829 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:29.829 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:29.830 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:29.775300+0000", 2024-09-12T18:37:29.830 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.7090999999999998e-05 2024-09-12T18:37:29.830 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:29.830 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:29.830 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:29.830 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:29.830 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-12T18:37:29.830 INFO:teuthology.orchestra.run.smithi114.stdout: "num_ops": 11 2024-09-12T18:37:29.830 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:29.830 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:37:29.832 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:37:29.833 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:29.826+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:29.932 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:29.926+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:29.973 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:37:29.973 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:37:29.991 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:37:29.991 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:37:30.012 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:37:30.013 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:37:30.013 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is set 2024-09-12T18:37:30.031 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:30.031 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:30.033 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:30.026+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:30.054 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:37:30.134 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:30.128+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:30.209 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:30.209 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:30.229 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:37:30.234 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:30.230+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:30.335 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:30.330+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:30.387 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:30.387 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:30.407 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:37:30.501 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:30.452+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:30.537 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:30.532+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:30.543 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:30.543 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:30.564 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:37:30.650 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:30.648+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:30.739 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:30.734+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:30.757 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:30.758 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:30.781 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:37:30.840 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:30.834+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:30.942 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:30.934+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:30.942 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:30.942 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:30.964 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:37:31.050 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:31.046+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:31.142 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:31.140+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:31.156 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:31.157 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:31.178 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:37:31.268 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:31.262+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:31.345 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:31.340+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:31.381 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:31.382 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:31.403 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:37:31.450 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:31.446+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:31.547 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:31.538+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:31.560 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:31.560 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:31.583 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:37:31.668 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:31.662+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:31.749 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:31.742+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:31.777 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:31.777 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:31.796 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:37:31.885 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:31.878+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:31.907 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:37:31.907 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:37:31.908 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-12T18:37:31.908 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T18:37:31.951 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:31.942+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:31.992 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:31.993 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:32.012 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:37:32.034 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:37:32.035 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T18:37:32.056 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:32.050+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:32.153 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:32.146+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:32.171 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:32.171 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:32.192 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:37:32.193 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:37:32.193 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:37:32.217 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:37:32.217 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:37:32.237 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:37:32.237 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:37:32.254 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:32.248+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:32.262 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:37:32.262 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T18:37:32.262 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 71, 2024-09-12T18:37:32.262 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "c08d5a84-711b-44bf-bdf1-e06ecc2c7c00", 2024-09-12T18:37:32.263 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-12T18:35:02.695853+0000", 2024-09-12T18:37:32.263 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-12T18:37:30.005943+0000", 2024-09-12T18:37:32.263 INFO:teuthology.orchestra.run.smithi073.stdout: "last_up_change": "2024-09-12T18:35:12.464628+0000", 2024-09-12T18:37:32.263 INFO:teuthology.orchestra.run.smithi073.stdout: "last_in_change": "2024-09-12T18:35:04.352525+0000", 2024-09-12T18:37:32.263 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T18:37:32.263 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_num": 5801984, 2024-09-12T18:37:32.263 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_set": [ 2024-09-12T18:37:32.263 INFO:teuthology.orchestra.run.smithi073.stdout: "noscrub", 2024-09-12T18:37:32.263 INFO:teuthology.orchestra.run.smithi073.stdout: "pglog_hardlimit", 2024-09-12T18:37:32.264 INFO:teuthology.orchestra.run.smithi073.stdout: "purged_snapdirs", 2024-09-12T18:37:32.264 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_deletes", 2024-09-12T18:37:32.264 INFO:teuthology.orchestra.run.smithi073.stdout: "sortbitwise" 2024-09-12T18:37:32.264 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T18:37:32.264 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_version": 5, 2024-09-12T18:37:32.264 INFO:teuthology.orchestra.run.smithi073.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T18:37:32.264 INFO:teuthology.orchestra.run.smithi073.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T18:37:32.264 INFO:teuthology.orchestra.run.smithi073.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T18:37:32.264 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_snapshot": "", 2024-09-12T18:37:32.264 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_max": 5, 2024-09-12T18:37:32.264 INFO:teuthology.orchestra.run.smithi073.stdout: "max_osd": 3, 2024-09-12T18:37:32.265 INFO:teuthology.orchestra.run.smithi073.stdout: "require_min_compat_client": "luminous", 2024-09-12T18:37:32.265 INFO:teuthology.orchestra.run.smithi073.stdout: "min_compat_client": "jewel", 2024-09-12T18:37:32.265 INFO:teuthology.orchestra.run.smithi073.stdout: "require_osd_release": "squid", 2024-09-12T18:37:32.265 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_crimson": false, 2024-09-12T18:37:32.265 INFO:teuthology.orchestra.run.smithi073.stdout: "pools": [ 2024-09-12T18:37:32.265 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:32.265 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 1, 2024-09-12T18:37:32.265 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": ".mgr", 2024-09-12T18:37:32.265 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:12.418430+0000", 2024-09-12T18:37:32.265 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-12T18:37:32.265 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-09-12T18:37:32.265 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:37:32.265 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:37:32.266 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:37:32.266 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:37:32.266 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:37:32.266 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:37:32.266 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:37:32.266 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:37:32.266 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:37:32.266 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:37:32.266 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:37:32.266 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 1, 2024-09-12T18:37:32.266 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 1, 2024-09-12T18:37:32.266 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 1, 2024-09-12T18:37:32.266 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 1, 2024-09-12T18:37:32.266 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 1, 2024-09-12T18:37:32.267 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:37:32.267 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:37:32.267 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:37:32.267 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:37:32.267 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:37:32.267 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:37:32.267 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:37:32.267 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.267 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "11", 2024-09-12T18:37:32.267 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:37:32.268 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:37:32.268 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:37:32.268 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:37:32.268 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:37:32.268 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-09-12T18:37:32.268 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-09-12T18:37:32.268 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:37:32.268 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:37:32.268 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:37:32.268 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:37:32.268 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:37:32.268 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:37:32.268 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:37:32.269 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:37:32.269 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:37:32.269 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:37:32.269 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:37:32.269 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:37:32.269 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:37:32.269 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:37:32.269 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:37:32.269 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:37:32.269 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:37:32.269 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:37:32.269 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:37:32.269 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.270 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:37:32.270 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:37:32.270 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:37:32.270 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:37:32.270 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:37:32.270 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:37:32.270 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:37:32.270 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:37:32.270 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:37:32.270 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:37:32.270 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:37:32.270 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-09-12T18:37:32.270 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_max": 32, 2024-09-12T18:37:32.271 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 1 2024-09-12T18:37:32.271 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.271 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:37:32.271 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": {} 2024-09-12T18:37:32.271 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.271 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:37:32.271 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:37:32.271 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 2.9900000095367432, 2024-09-12T18:37:32.271 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 2.9900000095367432, 2024-09-12T18:37:32.271 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 0.67000001668930054, 2024-09-12T18:37:32.271 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 2, 2024-09-12T18:37:32.271 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 2, 2024-09-12T18:37:32.271 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:37:32.272 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:37:32.272 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:37:32.272 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:32.272 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.272 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:32.272 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 2, 2024-09-12T18:37:32.272 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "rbd", 2024-09-12T18:37:32.272 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:18.665309+0000", 2024-09-12T18:37:32.272 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 8193, 2024-09-12T18:37:32.272 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T18:37:32.272 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:37:32.272 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:37:32.272 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:37:32.273 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:37:32.273 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:37:32.273 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:37:32.273 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:37:32.273 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:37:32.273 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:37:32.273 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:37:32.273 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:37:32.273 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 8, 2024-09-12T18:37:32.273 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 8, 2024-09-12T18:37:32.273 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 8, 2024-09-12T18:37:32.273 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 8, 2024-09-12T18:37:32.273 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 8, 2024-09-12T18:37:32.274 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:37:32.274 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:37:32.274 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:37:32.274 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:37:32.274 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:37:32.274 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:37:32.274 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:37:32.274 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.274 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "15", 2024-09-12T18:37:32.274 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:37:32.274 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:37:32.274 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:37:32.274 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:37:32.275 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:37:32.275 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 2, 2024-09-12T18:37:32.275 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 15, 2024-09-12T18:37:32.275 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:37:32.275 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:37:32.275 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:37:32.275 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:37:32.275 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:37:32.275 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:37:32.275 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:37:32.275 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:37:32.275 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:37:32.275 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:37:32.275 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:37:32.276 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:37:32.276 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:37:32.276 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:37:32.276 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:37:32.276 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:37:32.276 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:37:32.276 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:37:32.276 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:37:32.276 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.276 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:37:32.276 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:37:32.276 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:37:32.276 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:37:32.277 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:37:32.277 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:37:32.277 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:37:32.277 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:37:32.277 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:37:32.277 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:37:32.277 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:37:32.277 INFO:teuthology.orchestra.run.smithi073.stdout: "options": {}, 2024-09-12T18:37:32.277 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:37:32.277 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd": {} 2024-09-12T18:37:32.277 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.277 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:37:32.277 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:37:32.278 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.5, 2024-09-12T18:37:32.278 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.5, 2024-09-12T18:37:32.278 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-09-12T18:37:32.278 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.5, 2024-09-12T18:37:32.278 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.5, 2024-09-12T18:37:32.278 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:37:32.278 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:37:32.278 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:37:32.278 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:32.278 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.278 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:32.279 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 3, 2024-09-12T18:37:32.279 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "cephfs_metadata", 2024-09-12T18:37:32.279 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:23.447845+0000", 2024-09-12T18:37:32.279 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-12T18:37:32.279 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-09-12T18:37:32.279 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:37:32.279 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:37:32.279 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:37:32.279 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:37:32.279 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:37:32.279 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:37:32.280 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:37:32.280 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:37:32.280 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:37:32.280 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:37:32.280 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:37:32.280 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 32, 2024-09-12T18:37:32.280 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 32, 2024-09-12T18:37:32.280 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 32, 2024-09-12T18:37:32.280 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 32, 2024-09-12T18:37:32.280 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 32, 2024-09-12T18:37:32.280 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:37:32.281 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:37:32.281 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:37:32.281 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:37:32.281 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:37:32.281 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:37:32.281 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:37:32.281 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.281 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "18", 2024-09-12T18:37:32.281 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:37:32.281 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:37:32.282 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:37:32.282 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:37:32.282 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:37:32.282 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-09-12T18:37:32.282 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-09-12T18:37:32.282 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:37:32.282 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:37:32.282 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:37:32.282 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:37:32.282 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:37:32.282 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:37:32.282 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:37:32.282 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:37:32.283 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:37:32.283 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:37:32.283 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:37:32.283 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:37:32.283 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:37:32.283 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:37:32.283 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:37:32.283 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:37:32.283 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:37:32.283 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:37:32.283 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:37:32.283 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.283 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:37:32.283 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:37:32.284 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:37:32.284 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:37:32.284 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:37:32.284 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:37:32.284 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:37:32.284 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:37:32.284 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:37:32.284 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:37:32.284 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:37:32.284 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-09-12T18:37:32.284 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_bias": 4, 2024-09-12T18:37:32.284 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 16, 2024-09-12T18:37:32.284 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_priority": 5 2024-09-12T18:37:32.285 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.285 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:37:32.285 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs": { 2024-09-12T18:37:32.285 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": "cephfs" 2024-09-12T18:37:32.285 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:32.285 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.285 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:37:32.285 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:37:32.285 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.4099999666213989, 2024-09-12T18:37:32.285 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.4099999666213989, 2024-09-12T18:37:32.285 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-09-12T18:37:32.286 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.4099999666213989, 2024-09-12T18:37:32.286 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.4099999666213989, 2024-09-12T18:37:32.286 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:37:32.286 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:37:32.286 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:37:32.286 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:32.286 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.286 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:32.286 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 4, 2024-09-12T18:37:32.286 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "cephfs_data", 2024-09-12T18:37:32.286 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:23.959973+0000", 2024-09-12T18:37:32.287 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-12T18:37:32.287 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-09-12T18:37:32.287 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:37:32.287 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:37:32.287 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:37:32.287 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:37:32.287 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:37:32.287 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:37:32.287 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:37:32.287 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:37:32.287 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:37:32.287 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:37:32.287 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:37:32.287 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 64, 2024-09-12T18:37:32.288 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 64, 2024-09-12T18:37:32.288 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 64, 2024-09-12T18:37:32.288 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 64, 2024-09-12T18:37:32.288 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 64, 2024-09-12T18:37:32.288 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:37:32.288 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:37:32.288 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:37:32.288 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:37:32.288 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:37:32.288 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:37:32.288 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:37:32.288 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.289 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "19", 2024-09-12T18:37:32.289 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:37:32.289 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:37:32.289 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:37:32.289 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:37:32.289 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:37:32.289 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-09-12T18:37:32.289 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-09-12T18:37:32.289 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:37:32.289 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:37:32.289 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:37:32.289 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:37:32.290 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:37:32.290 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:37:32.290 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:37:32.290 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:37:32.290 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:37:32.290 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:37:32.290 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:37:32.290 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:37:32.290 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:37:32.290 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:37:32.290 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:37:32.291 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:37:32.291 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:37:32.291 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:37:32.291 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:37:32.291 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.291 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:37:32.291 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:37:32.291 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:37:32.291 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:37:32.291 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:37:32.291 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:37:32.292 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:37:32.292 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:37:32.292 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:37:32.292 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:37:32.292 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:37:32.292 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-09-12T18:37:32.292 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 64, 2024-09-12T18:37:32.292 INFO:teuthology.orchestra.run.smithi073.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T18:37:32.292 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.292 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:37:32.292 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs": { 2024-09-12T18:37:32.292 INFO:teuthology.orchestra.run.smithi073.stdout: "data": "cephfs" 2024-09-12T18:37:32.292 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:32.293 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.293 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:37:32.293 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:37:32.293 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.4099999666213989, 2024-09-12T18:37:32.293 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.4099999666213989, 2024-09-12T18:37:32.293 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-09-12T18:37:32.293 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.4099999666213989, 2024-09-12T18:37:32.296 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.4099999666213989, 2024-09-12T18:37:32.297 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:37:32.297 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:37:32.297 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:37:32.297 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:32.297 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.297 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:32.297 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 5, 2024-09-12T18:37:32.297 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "unique_pool_0", 2024-09-12T18:37:32.297 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:43.562347+0000", 2024-09-12T18:37:32.297 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-12T18:37:32.297 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-09-12T18:37:32.297 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:37:32.297 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:37:32.298 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:37:32.298 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:37:32.298 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:37:32.298 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:37:32.298 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:37:32.298 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:37:32.298 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:37:32.298 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:37:32.298 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:37:32.298 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 16, 2024-09-12T18:37:32.298 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 16, 2024-09-12T18:37:32.298 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 16, 2024-09-12T18:37:32.298 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 16, 2024-09-12T18:37:32.299 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 16, 2024-09-12T18:37:32.299 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:37:32.299 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:37:32.299 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:37:32.299 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:37:32.299 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:37:32.299 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:37:32.299 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:37:32.299 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.299 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "23", 2024-09-12T18:37:32.300 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:37:32.300 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:37:32.300 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:37:32.300 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:37:32.300 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:37:32.300 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-09-12T18:37:32.300 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-09-12T18:37:32.300 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:37:32.300 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:37:32.300 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:37:32.300 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:37:32.300 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:37:32.300 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:37:32.301 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:37:32.301 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:37:32.301 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:37:32.301 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:37:32.301 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:37:32.301 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:37:32.301 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:37:32.301 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:37:32.301 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:37:32.301 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:37:32.301 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:37:32.301 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:37:32.301 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:37:32.301 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.302 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:37:32.302 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:37:32.302 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:37:32.302 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:37:32.302 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:37:32.302 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:37:32.302 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:37:32.302 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:37:32.302 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:37:32.302 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:37:32.302 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:37:32.302 INFO:teuthology.orchestra.run.smithi073.stdout: "options": {}, 2024-09-12T18:37:32.302 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:37:32.303 INFO:teuthology.orchestra.run.smithi073.stdout: "rados": {} 2024-09-12T18:37:32.303 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.303 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:37:32.303 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:37:32.303 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.1299999952316284, 2024-09-12T18:37:32.303 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.1299999952316284, 2024-09-12T18:37:32.303 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-09-12T18:37:32.303 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T18:37:32.303 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T18:37:32.303 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:37:32.303 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:37:32.303 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:37:32.303 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:32.304 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:32.304 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T18:37:32.304 INFO:teuthology.orchestra.run.smithi073.stdout: "osds": [ 2024-09-12T18:37:32.304 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:32.304 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-09-12T18:37:32.304 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "f1cf24e8-6179-4666-a444-fa81ef0d7482", 2024-09-12T18:37:32.304 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-09-12T18:37:32.304 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-09-12T18:37:32.304 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0.6371612548828125, 2024-09-12T18:37:32.304 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-09-12T18:37:32.304 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-09-12T18:37:32.304 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-09-12T18:37:32.304 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-09-12T18:37:32.305 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 21, 2024-09-12T18:37:32.305 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-09-12T18:37:32.305 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-09-12T18:37:32.305 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-12T18:37:32.305 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:32.305 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:32.305 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:32.305 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6800", 2024-09-12T18:37:32.305 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:37:32.305 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.305 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:32.306 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:32.306 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6801", 2024-09-12T18:37:32.306 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:37:32.306 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:32.306 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:32.306 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.306 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-09-12T18:37:32.306 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:32.306 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:32.306 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:32.306 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6802", 2024-09-12T18:37:32.306 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:37:32.306 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.307 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:32.307 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:32.307 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6803", 2024-09-12T18:37:32.307 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:37:32.307 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:32.307 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:32.307 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.307 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-09-12T18:37:32.307 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:32.307 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:32.307 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:32.307 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6806", 2024-09-12T18:37:32.308 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:37:32.308 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.308 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:32.308 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:32.308 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6807", 2024-09-12T18:37:32.308 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:37:32.308 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:32.308 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:32.308 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.308 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-09-12T18:37:32.309 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:32.309 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:32.309 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:32.309 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6804", 2024-09-12T18:37:32.309 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:37:32.309 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.309 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:32.309 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:32.309 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6805", 2024-09-12T18:37:32.309 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:37:32.309 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:32.309 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:32.309 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.310 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.114:6801/2710632206", 2024-09-12T18:37:32.310 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.114:6803/2710632206", 2024-09-12T18:37:32.310 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.114:6807/2710632206", 2024-09-12T18:37:32.310 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.114:6805/2710632206", 2024-09-12T18:37:32.310 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-09-12T18:37:32.310 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-09-12T18:37:32.310 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-09-12T18:37:32.310 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:32.310 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.310 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:32.310 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-09-12T18:37:32.311 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "3fdb0044-2820-4411-978b-4b6e94fbf0b1", 2024-09-12T18:37:32.311 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-09-12T18:37:32.311 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-09-12T18:37:32.311 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-09-12T18:37:32.311 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-09-12T18:37:32.311 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-09-12T18:37:32.311 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-09-12T18:37:32.311 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 9, 2024-09-12T18:37:32.311 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 65, 2024-09-12T18:37:32.311 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-09-12T18:37:32.311 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-09-12T18:37:32.311 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-12T18:37:32.311 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:32.312 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:32.312 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:32.312 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6800", 2024-09-12T18:37:32.312 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:37:32.312 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.312 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:32.312 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:32.312 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6801", 2024-09-12T18:37:32.312 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:37:32.312 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:32.312 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:32.313 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.313 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-09-12T18:37:32.313 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:32.313 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:32.313 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:32.313 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6802", 2024-09-12T18:37:32.313 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:37:32.313 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.313 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:32.313 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:32.314 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6803", 2024-09-12T18:37:32.314 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:37:32.314 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:32.314 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:32.314 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.314 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-09-12T18:37:32.314 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:32.314 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:32.314 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:32.314 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6806", 2024-09-12T18:37:32.315 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:37:32.315 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.315 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:32.315 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:32.315 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6807", 2024-09-12T18:37:32.315 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:37:32.315 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:32.315 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:32.315 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.315 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-09-12T18:37:32.315 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:32.315 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:32.315 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:32.315 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6804", 2024-09-12T18:37:32.316 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:37:32.316 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.316 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:32.316 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:32.316 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6805", 2024-09-12T18:37:32.316 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:37:32.316 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:32.316 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:32.316 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.316 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.143:6801/862189968", 2024-09-12T18:37:32.316 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.143:6803/862189968", 2024-09-12T18:37:32.316 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.143:6807/862189968", 2024-09-12T18:37:32.317 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.143:6805/862189968", 2024-09-12T18:37:32.317 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-09-12T18:37:32.317 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-09-12T18:37:32.317 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-09-12T18:37:32.317 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:32.317 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.317 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:32.317 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2024-09-12T18:37:32.317 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "6fb554da-561f-4aa2-b855-0e3adb98b057", 2024-09-12T18:37:32.317 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-09-12T18:37:32.317 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-09-12T18:37:32.318 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-09-12T18:37:32.318 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-09-12T18:37:32.318 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-09-12T18:37:32.318 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-09-12T18:37:32.318 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-09-12T18:37:32.318 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 65, 2024-09-12T18:37:32.318 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-09-12T18:37:32.318 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-09-12T18:37:32.318 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-12T18:37:32.319 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:32.319 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:32.319 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:32.319 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6800", 2024-09-12T18:37:32.319 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:37:32.319 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.319 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:32.319 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:32.319 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6801", 2024-09-12T18:37:32.319 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:37:32.319 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:32.319 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:32.319 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.320 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-09-12T18:37:32.320 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:32.320 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:32.320 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:32.320 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6802", 2024-09-12T18:37:32.320 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:37:32.320 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.320 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:32.320 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:32.320 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6803", 2024-09-12T18:37:32.320 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:37:32.320 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:32.320 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:32.321 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.321 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-09-12T18:37:32.321 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:32.321 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:32.321 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:32.321 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6806", 2024-09-12T18:37:32.321 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:37:32.321 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.321 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:32.321 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:32.321 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6807", 2024-09-12T18:37:32.321 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:37:32.322 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:32.322 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:32.322 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.322 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-09-12T18:37:32.322 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:32.322 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:32.322 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:32.322 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6804", 2024-09-12T18:37:32.322 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:37:32.322 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.322 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:32.322 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:32.322 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6805", 2024-09-12T18:37:32.322 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:37:32.323 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:32.323 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:32.323 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.323 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.162:6801/1397104153", 2024-09-12T18:37:32.323 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.162:6803/1397104153", 2024-09-12T18:37:32.323 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.162:6807/1397104153", 2024-09-12T18:37:32.323 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.162:6805/1397104153", 2024-09-12T18:37:32.323 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-09-12T18:37:32.323 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-09-12T18:37:32.323 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-09-12T18:37:32.323 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:32.323 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:32.323 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T18:37:32.323 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_xinfo": [ 2024-09-12T18:37:32.324 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:32.324 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-09-12T18:37:32.324 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-09-12T18:37:32.324 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-09-12T18:37:32.324 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-09-12T18:37:32.324 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540719139924082687, 2024-09-12T18:37:32.324 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-09-12T18:37:32.324 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-09-12T18:35:10.239320+0000", 2024-09-12T18:37:32.324 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-09-12T18:37:32.324 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.324 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:32.324 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-09-12T18:37:32.325 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-09-12T18:37:32.325 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-09-12T18:37:32.325 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-09-12T18:37:32.325 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540719139924082687, 2024-09-12T18:37:32.325 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-09-12T18:37:32.325 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-09-12T18:35:10.861760+0000", 2024-09-12T18:37:32.325 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-09-12T18:37:32.325 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.325 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:32.325 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2024-09-12T18:37:32.325 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-09-12T18:37:32.326 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-09-12T18:37:32.326 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-09-12T18:37:32.326 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540719139924082687, 2024-09-12T18:37:32.326 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-09-12T18:37:32.326 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-09-12T18:35:10.355997+0000", 2024-09-12T18:37:32.326 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-09-12T18:37:32.326 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:32.326 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T18:37:32.326 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap": [], 2024-09-12T18:37:32.326 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap_items": [], 2024-09-12T18:37:32.327 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap_primaries": [], 2024-09-12T18:37:32.327 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_temp": [ 2024-09-12T18:37:32.327 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:32.327 INFO:teuthology.orchestra.run.smithi073.stdout: "pgid": "5.5", 2024-09-12T18:37:32.327 INFO:teuthology.orchestra.run.smithi073.stdout: "osds": [ 2024-09-12T18:37:32.327 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-12T18:37:32.327 INFO:teuthology.orchestra.run.smithi073.stdout: 0 2024-09-12T18:37:32.327 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:32.327 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:32.327 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T18:37:32.327 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_temp": [], 2024-09-12T18:37:32.327 INFO:teuthology.orchestra.run.smithi073.stdout: "blocklist": {}, 2024-09-12T18:37:32.327 INFO:teuthology.orchestra.run.smithi073.stdout: "range_blocklist": {}, 2024-09-12T18:37:32.327 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profiles": { 2024-09-12T18:37:32.328 INFO:teuthology.orchestra.run.smithi073.stdout: "default": { 2024-09-12T18:37:32.328 INFO:teuthology.orchestra.run.smithi073.stdout: "crush-failure-domain": "osd", 2024-09-12T18:37:32.328 INFO:teuthology.orchestra.run.smithi073.stdout: "k": "2", 2024-09-12T18:37:32.328 INFO:teuthology.orchestra.run.smithi073.stdout: "m": "1", 2024-09-12T18:37:32.328 INFO:teuthology.orchestra.run.smithi073.stdout: "plugin": "jerasure", 2024-09-12T18:37:32.328 INFO:teuthology.orchestra.run.smithi073.stdout: "technique": "reed_sol_van" 2024-09-12T18:37:32.328 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:32.328 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:32.328 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps_queue": [], 2024-09-12T18:37:32.328 INFO:teuthology.orchestra.run.smithi073.stdout: "new_removed_snaps": [], 2024-09-12T18:37:32.328 INFO:teuthology.orchestra.run.smithi073.stdout: "new_purged_snaps": [], 2024-09-12T18:37:32.328 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_node_flags": {}, 2024-09-12T18:37:32.328 INFO:teuthology.orchestra.run.smithi073.stdout: "device_class_flags": {}, 2024-09-12T18:37:32.329 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": { 2024-09-12T18:37:32.329 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode_enabled": false, 2024-09-12T18:37:32.329 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_bucket_count": 0, 2024-09-12T18:37:32.329 INFO:teuthology.orchestra.run.smithi073.stdout: "degraded_stretch_mode": 0, 2024-09-12T18:37:32.329 INFO:teuthology.orchestra.run.smithi073.stdout: "recovering_stretch_mode": 0, 2024-09-12T18:37:32.329 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode_bucket": 0 2024-09-12T18:37:32.329 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:32.329 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T18:37:32.331 INFO:tasks.thrashosds.thrasher:j is {'epoch': 71, 'fsid': 'c08d5a84-711b-44bf-bdf1-e06ecc2c7c00', 'created': '2024-09-12T18:35:02.695853+0000', 'modified': '2024-09-12T18:37:30.005943+0000', 'last_up_change': '2024-09-12T18:35:12.464628+0000', 'last_in_change': '2024-09-12T18:35:04.352525+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T18:35:12.418430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-12T18:35:18.665309+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 15, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T18:35:23.447845+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.409999966621399, 'score_stable': 1.409999966621399, 'optimal_score': 1, 'raw_score_acting': 1.409999966621399, 'raw_score_stable': 1.409999966621399, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T18:35:23.959973+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.409999966621399, 'score_stable': 1.409999966621399, 'optimal_score': 1, 'raw_score_acting': 1.409999966621399, 'raw_score_stable': 1.409999966621399, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2024-09-12T18:35:43.562347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'f1cf24e8-6179-4666-a444-fa81ef0d7482', 'up': 1, 'in': 1, 'weight': 0.6371612548828125, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6800', 'nonce': 2710632206}, {'type': 'v1', 'addr': '172.21.15.114:6801', 'nonce': 2710632206}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6802', 'nonce': 2710632206}, {'type': 'v1', 'addr': '172.21.15.114:6803', 'nonce': 2710632206}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6806', 'nonce': 2710632206}, {'type': 'v1', 'addr': '172.21.15.114:6807', 'nonce': 2710632206}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6804', 'nonce': 2710632206}, {'type': 'v1', 'addr': '172.21.15.114:6805', 'nonce': 2710632206}]}, 'public_addr': '172.21.15.114:6801/2710632206', 'cluster_addr': '172.21.15.114:6803/2710632206', 'heartbeat_back_addr': '172.21.15.114:6807/2710632206', 'heartbeat_front_addr': '172.21.15.114:6805/2710632206', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '3fdb0044-2820-4411-978b-4b6e94fbf0b1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 9, 'up_thru': 65, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6800', 'nonce': 862189968}, {'type': 'v1', 'addr': '172.21.15.143:6801', 'nonce': 862189968}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6802', 'nonce': 862189968}, {'type': 'v1', 'addr': '172.21.15.143:6803', 'nonce': 862189968}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6806', 'nonce': 862189968}, {'type': 'v1', 'addr': '172.21.15.143:6807', 'nonce': 862189968}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6804', 'nonce': 862189968}, {'type': 'v1', 'addr': '172.21.15.143:6805', 'nonce': 862189968}]}, 'public_addr': '172.21.15.143:6801/862189968', 'cluster_addr': '172.21.15.143:6803/862189968', 'heartbeat_back_addr': '172.21.15.143:6807/862189968', 'heartbeat_front_addr': '172.21.15.143:6805/862189968', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '6fb554da-561f-4aa2-b855-0e3adb98b057', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 65, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6800', 'nonce': 1397104153}, {'type': 'v1', 'addr': '172.21.15.162:6801', 'nonce': 1397104153}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6802', 'nonce': 1397104153}, {'type': 'v1', 'addr': '172.21.15.162:6803', 'nonce': 1397104153}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6806', 'nonce': 1397104153}, {'type': 'v1', 'addr': '172.21.15.162:6807', 'nonce': 1397104153}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6804', 'nonce': 1397104153}, {'type': 'v1', 'addr': '172.21.15.162:6805', 'nonce': 1397104153}]}, 'public_addr': '172.21.15.162:6801/1397104153', 'cluster_addr': '172.21.15.162:6803/1397104153', 'heartbeat_back_addr': '172.21.15.162:6807/1397104153', 'heartbeat_front_addr': '172.21.15.162:6805/1397104153', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:35:10.239320+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:35:10.861760+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:35:10.355997+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [{'pgid': '5.5', 'osds': [2, 0]}], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T18:37:32.331 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:37:32.353 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:32.353 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-09-12T18:37:32.353 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-09-12T18:37:32.353 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-09-12T18:37:32.353 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:32.354 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:32.350+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:32.374 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:37:32.455 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:32.450+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:32.555 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:32.550+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:32.576 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:32.576 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-09-12T18:37:32.576 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-09-12T18:37:32.576 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:37:32.576 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.576 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121096 5.8 5:13503891:::benchmark_data_smithi073_23739_object121095:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:32.577 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:37:32.577 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 52.393379488000001, 2024-09-12T18:37:32.577 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064025391000000001, 2024-09-12T18:37:32.577 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:32.577 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:32.577 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:32.577 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:32.577 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:32.577 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:32.577 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121096 2024-09-12T18:37:32.578 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.578 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:32.578 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.578 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:32.578 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:37:32.578 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:32.578 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.578 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.578 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:32.578 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:37:32.578 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:32.578 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.579 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.579 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:32.579 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178579+0000", 2024-09-12T18:37:32.579 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7369999999999998e-06 2024-09-12T18:37:32.579 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.579 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.579 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:32.579 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178846+0000", 2024-09-12T18:37:32.579 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026752699999999999 2024-09-12T18:37:32.579 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.580 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.580 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:32.580 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178877+0000", 2024-09-12T18:37:32.580 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1081999999999998e-05 2024-09-12T18:37:32.580 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.580 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.580 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:32.581 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178896+0000", 2024-09-12T18:37:32.581 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8522e-05 2024-09-12T18:37:32.581 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.581 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.581 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:32.581 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.192591+0000", 2024-09-12T18:37:32.582 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013695067 2024-09-12T18:37:32.582 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.582 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.582 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:32.582 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.192944+0000", 2024-09-12T18:37:32.583 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00035273699999999999 2024-09-12T18:37:32.583 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.583 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.583 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:32.584 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.193732+0000", 2024-09-12T18:37:32.584 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078849599999999997 2024-09-12T18:37:32.584 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.584 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.584 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:32.584 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.213583+0000", 2024-09-12T18:37:32.584 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.019851164000000001 2024-09-12T18:37:32.584 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.585 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.585 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:32.585 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242386+0000", 2024-09-12T18:37:32.585 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028802924000000001 2024-09-12T18:37:32.585 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.585 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.586 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:32.586 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242501+0000", 2024-09-12T18:37:32.586 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000114932 2024-09-12T18:37:32.586 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.586 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.586 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:32.586 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242602+0000", 2024-09-12T18:37:32.587 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000100203 2024-09-12T18:37:32.587 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:32.587 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:32.587 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:32.588 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.588 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.588 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121097 5.8 5:1b31a99e:::benchmark_data_smithi073_23739_object121096:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:32.588 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:37:32.588 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 52.377651198000002, 2024-09-12T18:37:32.588 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048475917, 2024-09-12T18:37:32.588 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:32.589 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:32.589 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:32.589 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:32.589 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:32.589 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:32.589 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121097 2024-09-12T18:37:32.589 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.589 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:32.589 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.589 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:32.589 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:37:32.590 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:32.590 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.590 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.590 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:32.590 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:37:32.590 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:32.590 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.590 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.590 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:32.590 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194308+0000", 2024-09-12T18:37:32.590 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2789999999999999e-06 2024-09-12T18:37:32.591 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.591 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.591 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:32.591 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194396+0000", 2024-09-12T18:37:32.591 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8324000000000003e-05 2024-09-12T18:37:32.591 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.591 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.591 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:32.591 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194424+0000", 2024-09-12T18:37:32.591 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7565000000000001e-05 2024-09-12T18:37:32.591 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.592 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.592 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:32.592 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194444+0000", 2024-09-12T18:37:32.592 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0363000000000001e-05 2024-09-12T18:37:32.592 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.592 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.592 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:32.592 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.206888+0000", 2024-09-12T18:37:32.592 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012443997 2024-09-12T18:37:32.592 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.592 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.592 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:32.592 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.207138+0000", 2024-09-12T18:37:32.593 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025035900000000002 2024-09-12T18:37:32.593 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.593 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.593 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:32.593 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.207365+0000", 2024-09-12T18:37:32.593 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000226407 2024-09-12T18:37:32.593 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.593 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.593 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:32.594 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.215059+0000", 2024-09-12T18:37:32.594 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076946860000000001 2024-09-12T18:37:32.594 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.594 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.594 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:32.594 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242619+0000", 2024-09-12T18:37:32.594 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.027559975 2024-09-12T18:37:32.594 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.594 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.595 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:32.595 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242706+0000", 2024-09-12T18:37:32.595 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6384999999999994e-05 2024-09-12T18:37:32.595 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.595 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.595 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:32.595 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242780+0000", 2024-09-12T18:37:32.595 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4577000000000001e-05 2024-09-12T18:37:32.595 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:32.595 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:32.595 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:32.595 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.595 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.595 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121101 5.e 5:7e18e9ed:::benchmark_data_smithi073_23739_object121100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:32.596 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.209084+0000", 2024-09-12T18:37:32.596 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 52.362871143, 2024-09-12T18:37:32.596 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028988566, 2024-09-12T18:37:32.596 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:32.596 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:32.596 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:32.596 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:32.596 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:32.596 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:32.596 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121101 2024-09-12T18:37:32.597 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.597 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:32.597 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.597 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:32.597 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209084+0000", 2024-09-12T18:37:32.597 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:32.597 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.597 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.597 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:32.597 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209084+0000", 2024-09-12T18:37:32.598 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:32.598 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.598 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.598 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:32.598 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209087+0000", 2024-09-12T18:37:32.598 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6800000000000002e-06 2024-09-12T18:37:32.598 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.598 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.598 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:32.598 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209182+0000", 2024-09-12T18:37:32.598 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5084e-05 2024-09-12T18:37:32.599 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.599 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.599 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:32.599 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209212+0000", 2024-09-12T18:37:32.599 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9825e-05 2024-09-12T18:37:32.599 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.599 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.599 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:32.599 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209234+0000", 2024-09-12T18:37:32.599 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1416e-05 2024-09-12T18:37:32.599 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.600 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.600 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:32.600 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209497+0000", 2024-09-12T18:37:32.600 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026390400000000003 2024-09-12T18:37:32.600 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.600 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.600 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:32.600 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209810+0000", 2024-09-12T18:37:32.600 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000313023 2024-09-12T18:37:32.600 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.600 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.600 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:32.600 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.210468+0000", 2024-09-12T18:37:32.600 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00065779300000000005 2024-09-12T18:37:32.601 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.601 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.601 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:32.601 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.235905+0000", 2024-09-12T18:37:32.601 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025436881000000001 2024-09-12T18:37:32.601 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.601 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.601 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:32.601 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237797+0000", 2024-09-12T18:37:32.601 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001892007 2024-09-12T18:37:32.601 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.601 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.601 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:32.602 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237941+0000", 2024-09-12T18:37:32.602 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000143411 2024-09-12T18:37:32.602 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.602 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.602 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:32.602 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.238073+0000", 2024-09-12T18:37:32.602 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013254200000000001 2024-09-12T18:37:32.602 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:32.602 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:32.602 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:32.602 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.602 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.602 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121106 5.d 5:b4a9a221:::benchmark_data_smithi073_23739_object121105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:32.602 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:37:32.603 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 52.334776261999998, 2024-09-12T18:37:32.603 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.034882274999999997, 2024-09-12T18:37:32.603 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:32.603 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:32.603 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:32.603 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:32.603 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:32.603 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:32.603 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121106 2024-09-12T18:37:32.603 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.603 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:32.604 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.604 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:32.604 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:37:32.604 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:32.604 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.604 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.604 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:32.604 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:37:32.604 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:32.604 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.604 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.604 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:32.605 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237182+0000", 2024-09-12T18:37:32.605 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6019999999999998e-06 2024-09-12T18:37:32.605 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.605 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.605 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:32.605 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237257+0000", 2024-09-12T18:37:32.605 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5420999999999995e-05 2024-09-12T18:37:32.605 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.605 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.605 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:32.605 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237305+0000", 2024-09-12T18:37:32.605 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7207999999999999e-05 2024-09-12T18:37:32.605 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.606 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.606 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:32.606 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237325+0000", 2024-09-12T18:37:32.606 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0001e-05 2024-09-12T18:37:32.606 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.606 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.606 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:32.606 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237505+0000", 2024-09-12T18:37:32.606 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000180798 2024-09-12T18:37:32.606 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.606 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.606 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:32.607 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237764+0000", 2024-09-12T18:37:32.607 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025862299999999998 2024-09-12T18:37:32.607 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.607 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.607 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:32.607 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.238264+0000", 2024-09-12T18:37:32.607 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00050016100000000005 2024-09-12T18:37:32.607 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.607 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.607 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:32.607 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256525+0000", 2024-09-12T18:37:32.607 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018260508000000002 2024-09-12T18:37:32.607 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.607 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.608 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:32.608 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.271903+0000", 2024-09-12T18:37:32.608 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015378739000000001 2024-09-12T18:37:32.608 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.608 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.608 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:32.608 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.271999+0000", 2024-09-12T18:37:32.608 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5989000000000005e-05 2024-09-12T18:37:32.608 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.608 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.608 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:32.608 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272062+0000", 2024-09-12T18:37:32.609 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2224999999999995e-05 2024-09-12T18:37:32.609 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:32.609 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:32.609 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:32.609 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.609 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.609 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121112 5.d 5:b9a2d671:::benchmark_data_smithi073_23739_object121111:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:32.609 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.243446+0000", 2024-09-12T18:37:32.609 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 52.328509537000002, 2024-09-12T18:37:32.609 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.02889415, 2024-09-12T18:37:32.609 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:32.609 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:32.609 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:32.610 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:32.610 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:32.610 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:32.610 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121112 2024-09-12T18:37:32.610 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.610 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:32.610 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.610 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:32.610 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243446+0000", 2024-09-12T18:37:32.610 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:32.610 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.610 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.611 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:32.611 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243446+0000", 2024-09-12T18:37:32.611 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:32.611 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.611 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.611 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:32.611 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243448+0000", 2024-09-12T18:37:32.611 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0829999999999998e-06 2024-09-12T18:37:32.611 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.611 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.611 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:32.612 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243527+0000", 2024-09-12T18:37:32.612 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9173999999999998e-05 2024-09-12T18:37:32.612 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.612 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.612 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:32.612 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243549+0000", 2024-09-12T18:37:32.612 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1169e-05 2024-09-12T18:37:32.612 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.612 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.613 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:32.613 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243564+0000", 2024-09-12T18:37:32.613 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5866999999999999e-05 2024-09-12T18:37:32.613 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.613 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.613 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:32.613 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.249905+0000", 2024-09-12T18:37:32.613 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063410360000000004 2024-09-12T18:37:32.613 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.613 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.613 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:32.613 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.250166+0000", 2024-09-12T18:37:32.613 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026052999999999997 2024-09-12T18:37:32.614 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.614 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.614 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:32.614 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.250486+0000", 2024-09-12T18:37:32.614 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00032002700000000002 2024-09-12T18:37:32.614 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.614 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.614 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:32.614 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.259263+0000", 2024-09-12T18:37:32.614 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0087774770000000005 2024-09-12T18:37:32.615 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.615 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.615 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:32.615 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272186+0000", 2024-09-12T18:37:32.615 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.01292213 2024-09-12T18:37:32.615 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.615 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.615 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:32.615 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272267+0000", 2024-09-12T18:37:32.615 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1153e-05 2024-09-12T18:37:32.615 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.615 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.615 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:32.615 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272340+0000", 2024-09-12T18:37:32.616 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3504000000000006e-05 2024-09-12T18:37:32.616 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:32.616 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:32.616 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:32.616 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.616 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.616 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121114 5.d 5:b8870c11:::benchmark_data_smithi073_23739_object121113:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:32.616 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.243603+0000", 2024-09-12T18:37:32.616 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 52.328352285999998, 2024-09-12T18:37:32.616 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028945746000000001, 2024-09-12T18:37:32.616 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:32.616 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:32.617 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:32.617 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:32.617 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:32.617 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:32.617 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121114 2024-09-12T18:37:32.617 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.617 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:32.617 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.617 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:32.617 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243603+0000", 2024-09-12T18:37:32.617 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:32.617 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.617 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.617 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:32.618 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243603+0000", 2024-09-12T18:37:32.618 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:32.618 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.618 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.618 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:32.618 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243605+0000", 2024-09-12T18:37:32.618 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.268e-06 2024-09-12T18:37:32.618 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.618 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.618 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:32.618 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243674+0000", 2024-09-12T18:37:32.618 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9375000000000006e-05 2024-09-12T18:37:32.618 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.619 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.619 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:32.619 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243691+0000", 2024-09-12T18:37:32.619 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6517000000000001e-05 2024-09-12T18:37:32.619 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.619 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.619 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:32.619 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243702+0000", 2024-09-12T18:37:32.619 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1905999999999999e-05 2024-09-12T18:37:32.619 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.620 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.620 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:32.620 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.253789+0000", 2024-09-12T18:37:32.620 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.010086776 2024-09-12T18:37:32.620 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.620 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.620 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:32.620 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.253959+0000", 2024-09-12T18:37:32.620 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00017000000000000001 2024-09-12T18:37:32.620 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.621 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.621 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:32.621 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.254179+0000", 2024-09-12T18:37:32.621 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022003699999999999 2024-09-12T18:37:32.621 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.621 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.621 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:32.621 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.259330+0000", 2024-09-12T18:37:32.621 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0051511559999999996 2024-09-12T18:37:32.621 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.621 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.621 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:32.621 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272403+0000", 2024-09-12T18:37:32.622 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013072342000000001 2024-09-12T18:37:32.622 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.622 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.622 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:32.622 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272493+0000", 2024-09-12T18:37:32.622 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0595999999999998e-05 2024-09-12T18:37:32.622 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.622 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.622 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:32.622 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272549+0000", 2024-09-12T18:37:32.622 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5773000000000003e-05 2024-09-12T18:37:32.622 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:32.623 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:32.623 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:32.623 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.623 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.623 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121115 5.d 5:bd4a51ea:::benchmark_data_smithi073_23739_object121114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:32.623 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.245059+0000", 2024-09-12T18:37:32.623 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 52.326896611999999, 2024-09-12T18:37:32.623 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.02767406, 2024-09-12T18:37:32.623 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:32.623 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:32.623 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:32.623 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:32.623 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:32.624 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:32.624 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121115 2024-09-12T18:37:32.624 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.624 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:32.624 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.624 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:32.624 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245059+0000", 2024-09-12T18:37:32.624 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:32.624 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.624 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.625 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:32.625 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245059+0000", 2024-09-12T18:37:32.625 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:32.625 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.625 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.625 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:32.625 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245061+0000", 2024-09-12T18:37:32.625 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9759999999999998e-06 2024-09-12T18:37:32.625 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.625 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.625 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:32.625 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245111+0000", 2024-09-12T18:37:32.626 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9838e-05 2024-09-12T18:37:32.626 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.626 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.626 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:32.626 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245132+0000", 2024-09-12T18:37:32.626 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1469999999999999e-05 2024-09-12T18:37:32.626 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.626 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.626 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:32.626 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245146+0000", 2024-09-12T18:37:32.626 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3377000000000001e-05 2024-09-12T18:37:32.626 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.626 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.627 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:32.627 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256596+0000", 2024-09-12T18:37:32.627 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011450241999999999 2024-09-12T18:37:32.627 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.627 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.627 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:32.627 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256838+0000", 2024-09-12T18:37:32.628 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000242255 2024-09-12T18:37:32.628 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.628 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.628 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:32.628 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.257095+0000", 2024-09-12T18:37:32.628 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025679300000000001 2024-09-12T18:37:32.628 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.628 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.628 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:32.628 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.259928+0000", 2024-09-12T18:37:32.628 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0028326290000000001 2024-09-12T18:37:32.628 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.629 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.629 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:32.629 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272607+0000", 2024-09-12T18:37:32.629 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012679466 2024-09-12T18:37:32.629 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.629 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.629 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:32.629 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272681+0000", 2024-09-12T18:37:32.629 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3580999999999999e-05 2024-09-12T18:37:32.630 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.630 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.630 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:32.630 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272733+0000", 2024-09-12T18:37:32.630 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2432999999999998e-05 2024-09-12T18:37:32.630 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:32.630 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:32.630 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:32.630 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.630 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.630 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:131551 5.d 5:b8f8c77a:::benchmark_data_smithi073_23739_object131550:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:37:32.630 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:45.499878+0000", 2024-09-12T18:37:32.630 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 47.072077348000001, 2024-09-12T18:37:32.631 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.027478433, 2024-09-12T18:37:32.631 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:32.631 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:32.631 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:32.631 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:32.631 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:32.631 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:32.631 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 131551 2024-09-12T18:37:32.631 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.631 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:32.631 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.631 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:32.632 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499878+0000", 2024-09-12T18:37:32.632 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:32.632 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.632 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.632 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:32.632 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499878+0000", 2024-09-12T18:37:32.632 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:32.632 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.632 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.632 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:32.632 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499879+0000", 2024-09-12T18:37:32.632 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.92e-07 2024-09-12T18:37:32.633 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.633 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.633 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:32.633 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499946+0000", 2024-09-12T18:37:32.633 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6712999999999996e-05 2024-09-12T18:37:32.633 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.633 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.633 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:32.633 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499953+0000", 2024-09-12T18:37:32.633 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5519999999999999e-06 2024-09-12T18:37:32.634 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.634 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.634 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:32.634 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499959+0000", 2024-09-12T18:37:32.634 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0430000000000004e-06 2024-09-12T18:37:32.634 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.634 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.634 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:32.634 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.500004+0000", 2024-09-12T18:37:32.634 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5058000000000001e-05 2024-09-12T18:37:32.634 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.634 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.634 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:32.634 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.500121+0000", 2024-09-12T18:37:32.635 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000116747 2024-09-12T18:37:32.635 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.635 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.635 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:32.635 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.500283+0000", 2024-09-12T18:37:32.635 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016190599999999999 2024-09-12T18:37:32.635 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.635 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.635 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:32.636 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.504017+0000", 2024-09-12T18:37:32.636 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003734125 2024-09-12T18:37:32.636 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.636 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.636 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:32.636 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.527224+0000", 2024-09-12T18:37:32.636 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.023206724000000001 2024-09-12T18:37:32.636 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.636 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.636 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:32.636 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.527290+0000", 2024-09-12T18:37:32.636 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5778999999999995e-05 2024-09-12T18:37:32.636 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.636 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.637 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:32.637 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.527357+0000", 2024-09-12T18:37:32.637 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7094000000000005e-05 2024-09-12T18:37:32.637 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:32.637 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:32.637 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:32.637 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.637 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.637 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:167368 5.4 5:29a1ec58:::benchmark_data_smithi073_23739_object35091:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:32.637 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:03.168773+0000", 2024-09-12T18:37:32.637 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 29.403182395000002, 2024-09-12T18:37:32.637 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.066578597000000003, 2024-09-12T18:37:32.637 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:32.638 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:32.638 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:32.638 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:32.638 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:32.638 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:32.638 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 167368 2024-09-12T18:37:32.638 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.638 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:32.638 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.638 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:32.638 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168773+0000", 2024-09-12T18:37:32.638 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:32.638 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.639 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.639 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:32.639 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168773+0000", 2024-09-12T18:37:32.639 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:32.639 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.639 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.639 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:32.639 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168774+0000", 2024-09-12T18:37:32.639 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.023e-06 2024-09-12T18:37:32.639 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.639 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.639 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:32.639 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168779+0000", 2024-09-12T18:37:32.639 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5800000000000002e-06 2024-09-12T18:37:32.640 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.640 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.640 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:32.640 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168789+0000", 2024-09-12T18:37:32.640 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0346999999999999e-05 2024-09-12T18:37:32.640 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.640 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.640 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:32.640 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168808+0000", 2024-09-12T18:37:32.640 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8423e-05 2024-09-12T18:37:32.640 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.640 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.640 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:32.641 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168864+0000", 2024-09-12T18:37:32.641 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-09-12T18:37:32.641 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.641 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.641 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:32.641 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168947+0000", 2024-09-12T18:37:32.641 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3274000000000003e-05 2024-09-12T18:37:32.641 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.641 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.641 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:32.641 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.169014+0000", 2024-09-12T18:37:32.641 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6284000000000004e-05 2024-09-12T18:37:32.641 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.641 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.642 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:32.642 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.170653+0000", 2024-09-12T18:37:32.642 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016389779999999999 2024-09-12T18:37:32.642 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.642 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.642 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:32.642 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.235279+0000", 2024-09-12T18:37:32.642 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064626464999999994 2024-09-12T18:37:32.642 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.642 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.642 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:32.642 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.235320+0000", 2024-09-12T18:37:32.642 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0377000000000003e-05 2024-09-12T18:37:32.643 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.643 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.643 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:32.643 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.235352+0000", 2024-09-12T18:37:32.643 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2322e-05 2024-09-12T18:37:32.643 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:32.643 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:32.643 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:32.643 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.643 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.643 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:167371 5.4 5:24fea27c:::benchmark_data_smithi073_23739_object35094:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:32.643 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:03.171234+0000", 2024-09-12T18:37:32.643 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 29.400721369999999, 2024-09-12T18:37:32.643 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.066048171000000003, 2024-09-12T18:37:32.644 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:32.644 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:32.644 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:32.644 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:32.644 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:32.644 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:32.644 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 167371 2024-09-12T18:37:32.644 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.644 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:32.644 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.644 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:32.645 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171234+0000", 2024-09-12T18:37:32.645 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:32.645 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.645 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.645 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:32.645 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171234+0000", 2024-09-12T18:37:32.645 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:32.645 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.645 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.645 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:32.646 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171235+0000", 2024-09-12T18:37:32.646 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8599999999999997e-07 2024-09-12T18:37:32.646 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.646 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.646 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:32.646 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171238+0000", 2024-09-12T18:37:32.646 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9739999999999998e-06 2024-09-12T18:37:32.646 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.646 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.646 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:32.646 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171245+0000", 2024-09-12T18:37:32.646 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6000000000000003e-06 2024-09-12T18:37:32.646 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.647 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.647 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:32.647 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171249+0000", 2024-09-12T18:37:32.647 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9960000000000004e-06 2024-09-12T18:37:32.647 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.647 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.647 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:32.647 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171288+0000", 2024-09-12T18:37:32.647 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9119999999999998e-05 2024-09-12T18:37:32.647 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.647 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.647 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:32.647 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171359+0000", 2024-09-12T18:37:32.647 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0951000000000006e-05 2024-09-12T18:37:32.648 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.648 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.648 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:32.648 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171425+0000", 2024-09-12T18:37:32.648 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.58e-05 2024-09-12T18:37:32.648 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.648 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.648 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:32.648 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.173093+0000", 2024-09-12T18:37:32.648 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016683939999999999 2024-09-12T18:37:32.649 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.649 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.649 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:32.649 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.237202+0000", 2024-09-12T18:37:32.649 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064109437000000005 2024-09-12T18:37:32.649 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.649 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.649 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:32.649 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.237249+0000", 2024-09-12T18:37:32.649 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6751e-05 2024-09-12T18:37:32.649 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.650 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.650 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:32.650 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.237282+0000", 2024-09-12T18:37:32.650 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3262000000000001e-05 2024-09-12T18:37:32.650 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:32.650 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:32.650 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:32.650 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.650 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.650 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:201498 5.a e67/21 5:5815d848:::benchmark_data_smithi073_23739_object69221:head v 67'12793, mlcod=67'12791)", 2024-09-12T18:37:32.650 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.430872+0000", 2024-09-12T18:37:32.650 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 12.141083392000001, 2024-09-12T18:37:32.650 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.038775280000000002, 2024-09-12T18:37:32.650 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:32.651 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:32.651 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:32.651 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:32.651 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.651 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:32.651 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430872+0000", 2024-09-12T18:37:32.651 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:32.651 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.651 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.652 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:32.652 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430872+0000", 2024-09-12T18:37:32.652 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:32.652 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.652 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.653 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:32.653 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430873+0000", 2024-09-12T18:37:32.653 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6600000000000003e-07 2024-09-12T18:37:32.653 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.653 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.653 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:32.653 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430875+0000", 2024-09-12T18:37:32.653 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5399999999999998e-06 2024-09-12T18:37:32.653 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.653 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.653 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:32.653 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430879+0000", 2024-09-12T18:37:32.654 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7239999999999998e-06 2024-09-12T18:37:32.654 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.654 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.654 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:32.654 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430882+0000", 2024-09-12T18:37:32.654 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8679999999999999e-06 2024-09-12T18:37:32.654 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.654 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.654 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:32.654 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430909+0000", 2024-09-12T18:37:32.654 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7832999999999999e-05 2024-09-12T18:37:32.654 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.654 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.655 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:32.655 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430922+0000", 2024-09-12T18:37:32.655 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2164000000000001e-05 2024-09-12T18:37:32.655 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.655 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.655 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:32.655 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469578+0000", 2024-09-12T18:37:32.655 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.038656469999999998 2024-09-12T18:37:32.655 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.655 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.655 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:32.655 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469648+0000", 2024-09-12T18:37:32.655 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9414999999999999e-05 2024-09-12T18:37:32.655 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:32.656 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:32.656 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:32.656 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.656 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.656 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201513 5.e 5:7be2f597:::benchmark_data_smithi073_23739_object69236:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:32.656 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.435121+0000", 2024-09-12T18:37:32.656 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 12.136834639, 2024-09-12T18:37:32.656 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.034945021999999999, 2024-09-12T18:37:32.656 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:32.657 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:32.657 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:32.657 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:32.657 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:32.657 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:32.657 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201513 2024-09-12T18:37:32.657 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.657 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:32.657 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.657 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:32.657 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.435121+0000", 2024-09-12T18:37:32.657 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:32.657 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.658 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.658 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:32.658 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.435121+0000", 2024-09-12T18:37:32.658 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:32.658 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.658 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.658 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:32.658 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.435122+0000", 2024-09-12T18:37:32.658 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2440000000000001e-06 2024-09-12T18:37:32.658 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.658 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.658 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:32.658 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.435126+0000", 2024-09-12T18:37:32.658 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1559999999999997e-06 2024-09-12T18:37:32.659 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.659 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.659 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:32.659 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445086+0000", 2024-09-12T18:37:32.659 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0099592389999999999 2024-09-12T18:37:32.659 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.659 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.659 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:32.659 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445095+0000", 2024-09-12T18:37:32.659 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2620000000000004e-06 2024-09-12T18:37:32.659 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.659 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.659 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:32.659 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445165+0000", 2024-09-12T18:37:32.660 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0257000000000002e-05 2024-09-12T18:37:32.660 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.660 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.660 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:32.660 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445311+0000", 2024-09-12T18:37:32.660 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014603899999999999 2024-09-12T18:37:32.660 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.660 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.660 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:32.660 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445445+0000", 2024-09-12T18:37:32.660 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000133654 2024-09-12T18:37:32.660 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.661 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.661 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:32.661 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469853+0000", 2024-09-12T18:37:32.661 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024407893999999999 2024-09-12T18:37:32.661 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.661 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.661 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:32.661 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469873+0000", 2024-09-12T18:37:32.661 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0622e-05 2024-09-12T18:37:32.661 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.661 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.662 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:32.662 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469949+0000", 2024-09-12T18:37:32.662 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5918000000000001e-05 2024-09-12T18:37:32.662 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.662 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.662 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:32.662 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470066+0000", 2024-09-12T18:37:32.662 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000116737 2024-09-12T18:37:32.663 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:32.663 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:32.663 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:32.663 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.663 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.663 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201521 5.d 5:b911ab6f:::benchmark_data_smithi073_23739_object69244:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:32.663 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445173+0000", 2024-09-12T18:37:32.663 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 12.126782196000001, 2024-09-12T18:37:32.663 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.031483274999999998, 2024-09-12T18:37:32.664 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:32.664 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:32.664 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:32.664 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:32.664 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:32.664 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:32.664 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201521 2024-09-12T18:37:32.664 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.664 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:32.664 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.664 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:32.664 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445173+0000", 2024-09-12T18:37:32.664 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:32.665 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.665 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.665 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:32.665 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445173+0000", 2024-09-12T18:37:32.665 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:32.665 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.665 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.665 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:32.665 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445174+0000", 2024-09-12T18:37:32.666 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4299999999999998e-07 2024-09-12T18:37:32.666 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.666 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.666 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:32.666 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445176+0000", 2024-09-12T18:37:32.666 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.469e-06 2024-09-12T18:37:32.666 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.666 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.666 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:32.666 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445183+0000", 2024-09-12T18:37:32.667 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8719999999999996e-06 2024-09-12T18:37:32.667 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.667 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.667 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:32.667 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445188+0000", 2024-09-12T18:37:32.667 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7079999999999996e-06 2024-09-12T18:37:32.667 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.667 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.667 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:32.667 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445314+0000", 2024-09-12T18:37:32.668 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012627800000000001 2024-09-12T18:37:32.668 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.668 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.668 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:32.668 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445436+0000", 2024-09-12T18:37:32.668 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000122007 2024-09-12T18:37:32.668 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.668 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.668 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:32.668 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445541+0000", 2024-09-12T18:37:32.668 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000105068 2024-09-12T18:37:32.668 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.668 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.669 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:32.669 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470655+0000", 2024-09-12T18:37:32.669 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025114035 2024-09-12T18:37:32.669 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.669 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.669 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:32.669 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476570+0000", 2024-09-12T18:37:32.669 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0059143269999999996 2024-09-12T18:37:32.669 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.669 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.669 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:32.669 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476624+0000", 2024-09-12T18:37:32.669 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4261000000000001e-05 2024-09-12T18:37:32.670 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.670 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.670 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:32.670 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476657+0000", 2024-09-12T18:37:32.670 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2806999999999999e-05 2024-09-12T18:37:32.670 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:32.670 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:32.670 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:32.670 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.670 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.670 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201524 5.d 5:b330b18b:::benchmark_data_smithi073_23739_object69247:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:32.670 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445202+0000", 2024-09-12T18:37:32.670 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 12.126753936, 2024-09-12T18:37:32.670 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.034036482, 2024-09-12T18:37:32.671 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:32.671 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:32.671 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:32.671 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:32.671 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:32.671 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:32.671 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201524 2024-09-12T18:37:32.671 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.671 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:32.671 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.671 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:32.671 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445202+0000", 2024-09-12T18:37:32.671 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:32.672 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.672 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.672 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:32.672 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445202+0000", 2024-09-12T18:37:32.672 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:32.672 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.672 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.672 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:32.672 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445202+0000", 2024-09-12T18:37:32.672 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2e-07 2024-09-12T18:37:32.672 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.672 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.673 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:32.673 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445204+0000", 2024-09-12T18:37:32.673 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0490000000000002e-06 2024-09-12T18:37:32.673 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.673 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.673 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:32.673 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445210+0000", 2024-09-12T18:37:32.673 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.959e-06 2024-09-12T18:37:32.673 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.673 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.673 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:32.673 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445215+0000", 2024-09-12T18:37:32.674 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.668e-06 2024-09-12T18:37:32.674 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.674 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.674 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:32.674 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470703+0000", 2024-09-12T18:37:32.674 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025488182000000002 2024-09-12T18:37:32.674 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.674 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.674 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:32.674 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470911+0000", 2024-09-12T18:37:32.674 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020755400000000001 2024-09-12T18:37:32.674 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.674 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.675 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:32.675 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.471309+0000", 2024-09-12T18:37:32.675 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00039868199999999998 2024-09-12T18:37:32.675 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.675 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.675 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:32.675 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476724+0000", 2024-09-12T18:37:32.675 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054150589999999998 2024-09-12T18:37:32.675 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.675 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.676 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:32.676 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.479050+0000", 2024-09-12T18:37:32.676 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0023259309999999998 2024-09-12T18:37:32.676 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.676 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.676 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:32.676 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.479164+0000", 2024-09-12T18:37:32.676 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000114127 2024-09-12T18:37:32.676 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.676 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.677 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:32.677 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.479238+0000", 2024-09-12T18:37:32.677 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3751000000000006e-05 2024-09-12T18:37:32.677 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:32.677 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:32.677 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:32.677 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.677 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.677 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_backfill(progress 5.5 e 67/67 lb 5:a30f9be2:::benchmark_data_smithi073_23739_object118666:head)", 2024-09-12T18:37:32.677 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445433+0000", 2024-09-12T18:37:32.677 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 12.126523049999999, 2024-09-12T18:37:32.678 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.029511351000000002, 2024-09-12T18:37:32.678 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:32.678 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:32.678 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:37:32.678 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:32.678 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.678 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:32.678 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445433+0000", 2024-09-12T18:37:32.678 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:32.678 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.679 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.679 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:32.679 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445433+0000", 2024-09-12T18:37:32.679 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:32.679 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.679 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.679 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:32.679 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445433+0000", 2024-09-12T18:37:32.679 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0699999999999998e-07 2024-09-12T18:37:32.679 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.679 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.679 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:32.679 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445440+0000", 2024-09-12T18:37:32.679 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6630000000000004e-06 2024-09-12T18:37:32.680 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.680 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.680 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:32.680 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445447+0000", 2024-09-12T18:37:32.680 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5159999999999997e-06 2024-09-12T18:37:32.680 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.680 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.680 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:32.680 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445454+0000", 2024-09-12T18:37:32.680 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.267e-06 2024-09-12T18:37:32.680 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.680 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.680 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:32.681 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.474780+0000", 2024-09-12T18:37:32.681 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.029325496999999999 2024-09-12T18:37:32.681 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.681 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.681 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:32.681 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.474802+0000", 2024-09-12T18:37:32.681 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2348999999999999e-05 2024-09-12T18:37:32.681 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.681 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.681 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:32.681 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.474944+0000", 2024-09-12T18:37:32.681 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014165200000000001 2024-09-12T18:37:32.681 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:32.681 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:32.682 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:32.682 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.682 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.682 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:201515 5.5 e67/49 5:a25bd8bb:::benchmark_data_smithi073_23739_object69238:head v 67'12752, mlcod=67'12750)", 2024-09-12T18:37:32.682 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445471+0000", 2024-09-12T18:37:32.682 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 12.126485134999999, 2024-09-12T18:37:32.682 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.031081396000000001, 2024-09-12T18:37:32.682 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:32.682 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:32.682 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:32.683 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:32.683 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.683 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:32.683 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445471+0000", 2024-09-12T18:37:32.683 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:32.683 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.684 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.684 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:32.684 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445471+0000", 2024-09-12T18:37:32.684 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:32.684 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.684 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.684 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:32.684 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445471+0000", 2024-09-12T18:37:32.684 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5400000000000002e-07 2024-09-12T18:37:32.685 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.685 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.685 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:32.685 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445475+0000", 2024-09-12T18:37:32.685 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2379999999999999e-06 2024-09-12T18:37:32.685 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.685 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.685 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:32.685 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445481+0000", 2024-09-12T18:37:32.685 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0229999999999998e-06 2024-09-12T18:37:32.685 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.685 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.685 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:32.686 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445486+0000", 2024-09-12T18:37:32.686 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5040000000000004e-06 2024-09-12T18:37:32.686 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.686 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.686 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:32.686 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445970+0000", 2024-09-12T18:37:32.686 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048416699999999997 2024-09-12T18:37:32.686 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.686 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.686 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:32.686 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445991+0000", 2024-09-12T18:37:32.686 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1067999999999999e-05 2024-09-12T18:37:32.687 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.687 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.687 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:32.687 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476511+0000", 2024-09-12T18:37:32.687 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.030520629000000001 2024-09-12T18:37:32.687 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.687 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.687 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:32.687 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476552+0000", 2024-09-12T18:37:32.688 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0413000000000001e-05 2024-09-12T18:37:32.688 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:32.688 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:32.688 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:32.688 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.688 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.688 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:201526 5.5 e67/49 5:a3549698:::benchmark_data_smithi073_23739_object69249:head v 67'12753, mlcod=67'12750)", 2024-09-12T18:37:32.688 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445957+0000", 2024-09-12T18:37:32.688 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 12.125998203, 2024-09-12T18:37:32.688 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.030732494999999999, 2024-09-12T18:37:32.688 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:32.689 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:32.689 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:32.689 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:32.689 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.689 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:32.689 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445957+0000", 2024-09-12T18:37:32.689 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:32.689 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.689 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.689 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:32.689 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445957+0000", 2024-09-12T18:37:32.689 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:32.689 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.690 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.690 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:32.690 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445958+0000", 2024-09-12T18:37:32.690 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7800000000000001e-07 2024-09-12T18:37:32.690 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.690 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.690 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:32.690 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445963+0000", 2024-09-12T18:37:32.690 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5419999999999999e-06 2024-09-12T18:37:32.690 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.690 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.690 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:32.690 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445972+0000", 2024-09-12T18:37:32.691 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4169999999999998e-06 2024-09-12T18:37:32.691 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.691 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.691 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:32.691 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445979+0000", 2024-09-12T18:37:32.691 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2949999999999996e-06 2024-09-12T18:37:32.691 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.691 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.691 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:32.691 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.447710+0000", 2024-09-12T18:37:32.691 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001731067 2024-09-12T18:37:32.692 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.692 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.692 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:32.692 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.447734+0000", 2024-09-12T18:37:32.692 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4094e-05 2024-09-12T18:37:32.692 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.692 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.692 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:32.692 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476659+0000", 2024-09-12T18:37:32.692 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028924268999999999 2024-09-12T18:37:32.692 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.692 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.692 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:32.693 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476690+0000", 2024-09-12T18:37:32.693 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1232999999999997e-05 2024-09-12T18:37:32.693 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:32.693 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:32.693 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:32.693 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.693 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.693 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:201528 5.5 e67/49 5:a971b633:::benchmark_data_smithi073_23739_object69251:head v 67'12754, mlcod=67'12750)", 2024-09-12T18:37:32.693 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.449001+0000", 2024-09-12T18:37:32.693 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 12.122954729, 2024-09-12T18:37:32.693 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.027719695999999999, 2024-09-12T18:37:32.693 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:32.693 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:32.694 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:32.694 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:32.694 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.694 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:32.694 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.449001+0000", 2024-09-12T18:37:32.694 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:32.694 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.694 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.694 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:32.694 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.449001+0000", 2024-09-12T18:37:32.694 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:32.694 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.694 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.694 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:32.695 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.449002+0000", 2024-09-12T18:37:32.695 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.16e-07 2024-09-12T18:37:32.695 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.695 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.695 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:32.695 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.449008+0000", 2024-09-12T18:37:32.695 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.9390000000000002e-06 2024-09-12T18:37:32.695 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.695 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.695 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:32.695 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469460+0000", 2024-09-12T18:37:32.695 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.020452060000000001 2024-09-12T18:37:32.695 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.695 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.696 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:32.696 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469476+0000", 2024-09-12T18:37:32.696 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6308e-05 2024-09-12T18:37:32.696 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.696 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.696 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:32.696 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470649+0000", 2024-09-12T18:37:32.696 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011725749999999999 2024-09-12T18:37:32.696 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.696 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.696 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:32.696 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470676+0000", 2024-09-12T18:37:32.696 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6806000000000001e-05 2024-09-12T18:37:32.697 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.697 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.697 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:32.697 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476703+0000", 2024-09-12T18:37:32.697 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0060279720000000004 2024-09-12T18:37:32.697 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.697 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.697 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:32.697 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476721+0000", 2024-09-12T18:37:32.697 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7119999999999999e-05 2024-09-12T18:37:32.697 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:32.698 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:32.698 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:32.698 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.698 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.698 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201583 5.d 5:b91eedec:::benchmark_data_smithi073_23739_object69306:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:32.698 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.494097+0000", 2024-09-12T18:37:32.698 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 12.077858341000001, 2024-09-12T18:37:32.698 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049293508, 2024-09-12T18:37:32.698 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:32.699 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:32.699 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:32.699 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:32.699 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:32.699 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:32.699 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201583 2024-09-12T18:37:32.699 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.699 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:32.699 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.699 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:32.700 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494097+0000", 2024-09-12T18:37:32.700 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:32.700 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.700 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.700 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:32.700 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494097+0000", 2024-09-12T18:37:32.700 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:32.700 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.700 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.700 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:32.700 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494098+0000", 2024-09-12T18:37:32.700 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0699999999999996e-07 2024-09-12T18:37:32.700 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.701 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.701 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:32.701 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494102+0000", 2024-09-12T18:37:32.701 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.664e-06 2024-09-12T18:37:32.701 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.701 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.701 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:32.701 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494108+0000", 2024-09-12T18:37:32.701 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.3149999999999997e-06 2024-09-12T18:37:32.701 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.701 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.701 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:32.704 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494112+0000", 2024-09-12T18:37:32.704 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0659999999999997e-06 2024-09-12T18:37:32.704 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.704 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.704 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:32.704 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494200+0000", 2024-09-12T18:37:32.705 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7770999999999997e-05 2024-09-12T18:37:32.705 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.705 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.705 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:32.705 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494315+0000", 2024-09-12T18:37:32.705 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000115048 2024-09-12T18:37:32.705 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.705 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.705 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:32.705 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494414+0000", 2024-09-12T18:37:32.705 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8820999999999995e-05 2024-09-12T18:37:32.706 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.706 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.706 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:32.706 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.497199+0000", 2024-09-12T18:37:32.706 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0027854279999999999 2024-09-12T18:37:32.706 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.706 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.706 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:32.706 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543193+0000", 2024-09-12T18:37:32.706 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.045993500999999999 2024-09-12T18:37:32.706 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.707 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.707 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:32.707 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543315+0000", 2024-09-12T18:37:32.707 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012246800000000001 2024-09-12T18:37:32.707 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.707 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.707 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:32.707 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543391+0000", 2024-09-12T18:37:32.707 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5618999999999995e-05 2024-09-12T18:37:32.707 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:32.707 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:32.707 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:32.707 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.707 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.708 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201585 5.d 5:bb6c167f:::benchmark_data_smithi073_23739_object69308:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:32.708 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.495295+0000", 2024-09-12T18:37:32.708 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 12.076660174000001, 2024-09-12T18:37:32.708 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048312129000000002, 2024-09-12T18:37:32.708 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:32.708 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:32.708 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:32.708 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:32.708 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:32.709 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:32.709 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201585 2024-09-12T18:37:32.709 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.709 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:32.709 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.709 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:32.709 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495295+0000", 2024-09-12T18:37:32.709 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:32.709 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.709 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.709 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:32.709 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495295+0000", 2024-09-12T18:37:32.710 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:32.710 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.710 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.710 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:32.710 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495296+0000", 2024-09-12T18:37:32.710 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0330000000000001e-06 2024-09-12T18:37:32.710 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.710 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.710 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:32.710 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495301+0000", 2024-09-12T18:37:32.710 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7049999999999998e-06 2024-09-12T18:37:32.710 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.710 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.711 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:32.711 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495312+0000", 2024-09-12T18:37:32.711 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0791000000000001e-05 2024-09-12T18:37:32.711 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.711 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.711 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:32.711 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495319+0000", 2024-09-12T18:37:32.711 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8240000000000002e-06 2024-09-12T18:37:32.711 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.711 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.711 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:32.712 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.496088+0000", 2024-09-12T18:37:32.712 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00076901200000000002 2024-09-12T18:37:32.712 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.712 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.712 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:32.712 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.496166+0000", 2024-09-12T18:37:32.712 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.8491000000000005e-05 2024-09-12T18:37:32.712 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.712 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.712 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:32.712 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.496232+0000", 2024-09-12T18:37:32.712 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5400000000000004e-05 2024-09-12T18:37:32.713 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.713 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.713 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:32.713 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.497467+0000", 2024-09-12T18:37:32.713 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001235049 2024-09-12T18:37:32.713 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.713 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.713 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:32.713 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543463+0000", 2024-09-12T18:37:32.713 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.045995743999999998 2024-09-12T18:37:32.713 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.713 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.713 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:32.714 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543546+0000", 2024-09-12T18:37:32.714 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3434000000000001e-05 2024-09-12T18:37:32.714 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:32.714 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:32.714 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:32.714 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543608+0000", 2024-09-12T18:37:32.714 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1645999999999999e-05 2024-09-12T18:37:32.714 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:32.714 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:32.714 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:32.715 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:32.715 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:32.715 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:32.719 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:37:32.719 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:32.712+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:32.720 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:37:32.722 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T18:37:32.723 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2024-09-12T18:37:32.415532+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2720664501,"num_objects":41532,"num_object_clones":0,"num_object_copies":83064,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":474,"num_objects_unfound":0,"num_objects_dirty":41532,"num_whiteouts":0,"num_read":87,"num_read_kb":74,"num_write":223236,"num_write_kb":8468225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15750,"num_bytes_recovered":1031864902,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62446,"ondisk_log_size":62446,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":243,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1135984,"kb_used_data":339912,"kb_used_omap":4,"kb_used_meta":795963,"kb_avail":281979536,"statfs":{"total":289910292480,"available":288747044864,"internally_reserved":0,"allocated":348069888,"data_stored":5529651478,"data_compressed":262613712,"data_compressed_allocated":345563136,"data_compressed_original":5528715264,"omap_allocated":4783,"internal_metadata":815066449},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1157169152,"num_objects":-17657,"num_object_clones":0,"num_object_copies":-35314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-2478,"num_objects_unfound":0,"num_objects_dirty":-17657,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17657,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1785,"num_bytes_recovered":116981760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.909856"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":121,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.517486+0000","last_change":"2024-09-12T18:36:40.076316+0000","last_active":"2024-09-12T18:37:27.517486+0000","last_peered":"2024-09-12T18:37:27.517486+0000","last_clean":"2024-09-12T18:37:27.517486+0000","last_became_active":"2024-09-12T18:36:40.074014+0000","last_became_peered":"2024-09-12T18:36:40.074014+0000","last_unstale":"2024-09-12T18:37:27.517486+0000","last_undegraded":"2024-09-12T18:37:27.517486+0000","last_fullsized":"2024-09-12T18:37:27.517486+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:20.167564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":115,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.516058+0000","last_change":"2024-09-12T18:35:25.659760+0000","last_active":"2024-09-12T18:37:27.516058+0000","last_peered":"2024-09-12T18:37:27.516058+0000","last_clean":"2024-09-12T18:37:27.516058+0000","last_became_active":"2024-09-12T18:35:25.654920+0000","last_became_peered":"2024-09-12T18:35:25.654920+0000","last_unstale":"2024-09-12T18:37:27.516058+0000","last_undegraded":"2024-09-12T18:37:27.516058+0000","last_fullsized":"2024-09-12T18:37:27.516058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:21.519881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":118,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.012263+0000","last_change":"2024-09-12T18:35:25.659460+0000","last_active":"2024-09-12T18:37:30.012263+0000","last_peered":"2024-09-12T18:37:30.012263+0000","last_clean":"2024-09-12T18:37:30.012263+0000","last_became_active":"2024-09-12T18:35:25.657782+0000","last_became_peered":"2024-09-12T18:35:25.657782+0000","last_unstale":"2024-09-12T18:37:30.012263+0000","last_undegraded":"2024-09-12T18:37:30.012263+0000","last_fullsized":"2024-09-12T18:37:30.012263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:38.544284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":118,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.011232+0000","last_change":"2024-09-12T18:35:25.663617+0000","last_active":"2024-09-12T18:37:30.011232+0000","last_peered":"2024-09-12T18:37:30.011232+0000","last_clean":"2024-09-12T18:37:30.011232+0000","last_became_active":"2024-09-12T18:35:25.661977+0000","last_became_peered":"2024-09-12T18:35:25.661977+0000","last_unstale":"2024-09-12T18:37:30.011232+0000","last_undegraded":"2024-09-12T18:37:30.011232+0000","last_fullsized":"2024-09-12T18:37:30.011232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:14.748234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":115,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.515627+0000","last_change":"2024-09-12T18:35:25.656566+0000","last_active":"2024-09-12T18:37:27.515627+0000","last_peered":"2024-09-12T18:37:27.515627+0000","last_clean":"2024-09-12T18:37:27.515627+0000","last_became_active":"2024-09-12T18:35:25.654898+0000","last_became_peered":"2024-09-12T18:35:25.654898+0000","last_unstale":"2024-09-12T18:37:27.515627+0000","last_undegraded":"2024-09-12T18:37:27.515627+0000","last_fullsized":"2024-09-12T18:37:27.515627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:36.113250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":123,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.011553+0000","last_change":"2024-09-12T18:36:40.067812+0000","last_active":"2024-09-12T18:37:30.011553+0000","last_peered":"2024-09-12T18:37:30.011553+0000","last_clean":"2024-09-12T18:37:30.011553+0000","last_became_active":"2024-09-12T18:36:40.067396+0000","last_became_peered":"2024-09-12T18:36:40.067396+0000","last_unstale":"2024-09-12T18:37:30.011553+0000","last_undegraded":"2024-09-12T18:37:30.011553+0000","last_fullsized":"2024-09-12T18:37:30.011553+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:46.485518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":117,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.010897+0000","last_change":"2024-09-12T18:35:25.659811+0000","last_active":"2024-09-12T18:37:30.010897+0000","last_peered":"2024-09-12T18:37:30.010897+0000","last_clean":"2024-09-12T18:37:30.010897+0000","last_became_active":"2024-09-12T18:35:25.658998+0000","last_became_peered":"2024-09-12T18:35:25.658998+0000","last_unstale":"2024-09-12T18:37:30.010897+0000","last_undegraded":"2024-09-12T18:37:30.010897+0000","last_fullsized":"2024-09-12T18:37:30.010897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":123,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.010718+0000","last_change":"2024-09-12T18:36:40.154635+0000","last_active":"2024-09-12T18:37:30.010718+0000","last_peered":"2024-09-12T18:37:30.010718+0000","last_clean":"2024-09-12T18:37:30.010718+0000","last_became_active":"2024-09-12T18:36:40.153818+0000","last_became_peered":"2024-09-12T18:36:40.153818+0000","last_unstale":"2024-09-12T18:37:30.010718+0000","last_undegraded":"2024-09-12T18:37:30.010718+0000","last_fullsized":"2024-09-12T18:37:30.010718+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:54.571879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":117,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.015859+0000","last_change":"2024-09-12T18:35:25.668339+0000","last_active":"2024-09-12T18:37:30.015859+0000","last_peered":"2024-09-12T18:37:30.015859+0000","last_clean":"2024-09-12T18:37:30.015859+0000","last_became_active":"2024-09-12T18:35:25.667608+0000","last_became_peered":"2024-09-12T18:35:25.667608+0000","last_unstale":"2024-09-12T18:37:30.015859+0000","last_undegraded":"2024-09-12T18:37:30.015859+0000","last_fullsized":"2024-09-12T18:37:30.015859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:15.699745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":121,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.516163+0000","last_change":"2024-09-12T18:36:40.075686+0000","last_active":"2024-09-12T18:37:27.516163+0000","last_peered":"2024-09-12T18:37:27.516163+0000","last_clean":"2024-09-12T18:37:27.516163+0000","last_became_active":"2024-09-12T18:36:40.072911+0000","last_became_peered":"2024-09-12T18:36:40.072911+0000","last_unstale":"2024-09-12T18:37:27.516163+0000","last_undegraded":"2024-09-12T18:37:27.516163+0000","last_fullsized":"2024-09-12T18:37:27.516163+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:24.687842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":123,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.012194+0000","last_change":"2024-09-12T18:36:39.072342+0000","last_active":"2024-09-12T18:37:30.012194+0000","last_peered":"2024-09-12T18:37:30.012194+0000","last_clean":"2024-09-12T18:37:30.012194+0000","last_became_active":"2024-09-12T18:36:39.071488+0000","last_became_peered":"2024-09-12T18:36:39.071488+0000","last_unstale":"2024-09-12T18:37:30.012194+0000","last_undegraded":"2024-09-12T18:37:30.012194+0000","last_fullsized":"2024-09-12T18:37:30.012194+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:27.845874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":115,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.515704+0000","last_change":"2024-09-12T18:35:25.649885+0000","last_active":"2024-09-12T18:37:27.515704+0000","last_peered":"2024-09-12T18:37:27.515704+0000","last_clean":"2024-09-12T18:37:27.515704+0000","last_became_active":"2024-09-12T18:35:25.649111+0000","last_became_peered":"2024-09-12T18:35:25.649111+0000","last_unstale":"2024-09-12T18:37:27.515704+0000","last_undegraded":"2024-09-12T18:37:27.515704+0000","last_fullsized":"2024-09-12T18:37:27.515704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:17.162410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":121,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.515523+0000","last_change":"2024-09-12T18:36:39.074873+0000","last_active":"2024-09-12T18:37:27.515523+0000","last_peered":"2024-09-12T18:37:27.515523+0000","last_clean":"2024-09-12T18:37:27.515523+0000","last_became_active":"2024-09-12T18:36:39.074049+0000","last_became_peered":"2024-09-12T18:36:39.074049+0000","last_unstale":"2024-09-12T18:37:27.515523+0000","last_undegraded":"2024-09-12T18:37:27.515523+0000","last_fullsized":"2024-09-12T18:37:27.515523+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:14.773044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":117,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.011618+0000","last_change":"2024-09-12T18:35:25.657913+0000","last_active":"2024-09-12T18:37:30.011618+0000","last_peered":"2024-09-12T18:37:30.011618+0000","last_clean":"2024-09-12T18:37:30.011618+0000","last_became_active":"2024-09-12T18:35:25.657082+0000","last_became_peered":"2024-09-12T18:35:25.657082+0000","last_unstale":"2024-09-12T18:37:30.011618+0000","last_undegraded":"2024-09-12T18:37:30.011618+0000","last_fullsized":"2024-09-12T18:37:30.011618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:21.538633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":117,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.010989+0000","last_change":"2024-09-12T18:35:25.658763+0000","last_active":"2024-09-12T18:37:30.010989+0000","last_peered":"2024-09-12T18:37:30.010989+0000","last_clean":"2024-09-12T18:37:30.010989+0000","last_became_active":"2024-09-12T18:35:25.657508+0000","last_became_peered":"2024-09-12T18:35:25.657508+0000","last_unstale":"2024-09-12T18:37:30.010989+0000","last_undegraded":"2024-09-12T18:37:30.010989+0000","last_fullsized":"2024-09-12T18:37:30.010989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:13.170519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":117,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.010755+0000","last_change":"2024-09-12T18:35:25.653730+0000","last_active":"2024-09-12T18:37:30.010755+0000","last_peered":"2024-09-12T18:37:30.010755+0000","last_clean":"2024-09-12T18:37:30.010755+0000","last_became_active":"2024-09-12T18:35:25.651535+0000","last_became_peered":"2024-09-12T18:35:25.651535+0000","last_unstale":"2024-09-12T18:37:30.010755+0000","last_undegraded":"2024-09-12T18:37:30.010755+0000","last_fullsized":"2024-09-12T18:37:30.010755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":117,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.016218+0000","last_change":"2024-09-12T18:35:25.656513+0000","last_active":"2024-09-12T18:37:30.016218+0000","last_peered":"2024-09-12T18:37:30.016218+0000","last_clean":"2024-09-12T18:37:30.016218+0000","last_became_active":"2024-09-12T18:35:25.653440+0000","last_became_peered":"2024-09-12T18:35:25.653440+0000","last_unstale":"2024-09-12T18:37:30.016218+0000","last_undegraded":"2024-09-12T18:37:30.016218+0000","last_fullsized":"2024-09-12T18:37:30.016218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:18.693161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":115,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.516270+0000","last_change":"2024-09-12T18:35:25.657991+0000","last_active":"2024-09-12T18:37:27.516270+0000","last_peered":"2024-09-12T18:37:27.516270+0000","last_clean":"2024-09-12T18:37:27.516270+0000","last_became_active":"2024-09-12T18:35:25.653934+0000","last_became_peered":"2024-09-12T18:35:25.653934+0000","last_unstale":"2024-09-12T18:37:27.516270+0000","last_undegraded":"2024-09-12T18:37:27.516270+0000","last_fullsized":"2024-09-12T18:37:27.516270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:05.418901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":54,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.516323+0000","last_change":"2024-09-12T18:36:39.075412+0000","last_active":"2024-09-12T18:37:27.516323+0000","last_peered":"2024-09-12T18:37:27.516323+0000","last_clean":"2024-09-12T18:37:27.516323+0000","last_became_active":"2024-09-12T18:36:39.074539+0000","last_became_peered":"2024-09-12T18:36:39.074539+0000","last_unstale":"2024-09-12T18:37:27.516323+0000","last_undegraded":"2024-09-12T18:37:27.516323+0000","last_fullsized":"2024-09-12T18:37:27.516323+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:34.322250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":117,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.011151+0000","last_change":"2024-09-12T18:35:25.661176+0000","last_active":"2024-09-12T18:37:30.011151+0000","last_peered":"2024-09-12T18:37:30.011151+0000","last_clean":"2024-09-12T18:37:30.011151+0000","last_became_active":"2024-09-12T18:35:25.659534+0000","last_became_peered":"2024-09-12T18:35:25.659534+0000","last_unstale":"2024-09-12T18:37:30.011151+0000","last_undegraded":"2024-09-12T18:37:30.011151+0000","last_fullsized":"2024-09-12T18:37:30.011151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:40.145442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":117,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.013958+0000","last_change":"2024-09-12T18:35:25.650632+0000","last_active":"2024-09-12T18:37:30.013958+0000","last_peered":"2024-09-12T18:37:30.013958+0000","last_clean":"2024-09-12T18:37:30.013958+0000","last_became_active":"2024-09-12T18:35:25.649333+0000","last_became_peered":"2024-09-12T18:35:25.649333+0000","last_unstale":"2024-09-12T18:37:30.013958+0000","last_undegraded":"2024-09-12T18:37:30.013958+0000","last_fullsized":"2024-09-12T18:37:30.013958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:30.537572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":115,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.518379+0000","last_change":"2024-09-12T18:35:25.648245+0000","last_active":"2024-09-12T18:37:27.518379+0000","last_peered":"2024-09-12T18:37:27.518379+0000","last_clean":"2024-09-12T18:37:27.518379+0000","last_became_active":"2024-09-12T18:35:25.646357+0000","last_became_peered":"2024-09-12T18:35:25.646357+0000","last_unstale":"2024-09-12T18:37:27.518379+0000","last_undegraded":"2024-09-12T18:37:27.518379+0000","last_fullsized":"2024-09-12T18:37:27.518379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:05.662140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":117,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.015492+0000","last_change":"2024-09-12T18:35:25.661613+0000","last_active":"2024-09-12T18:37:30.015492+0000","last_peered":"2024-09-12T18:37:30.015492+0000","last_clean":"2024-09-12T18:37:30.015492+0000","last_became_active":"2024-09-12T18:35:25.658833+0000","last_became_peered":"2024-09-12T18:35:25.658833+0000","last_unstale":"2024-09-12T18:37:30.015492+0000","last_undegraded":"2024-09-12T18:37:30.015492+0000","last_fullsized":"2024-09-12T18:37:30.015492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:51.064080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":115,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.515300+0000","last_change":"2024-09-12T18:35:25.657782+0000","last_active":"2024-09-12T18:37:27.515300+0000","last_peered":"2024-09-12T18:37:27.515300+0000","last_clean":"2024-09-12T18:37:27.515300+0000","last_became_active":"2024-09-12T18:35:25.655295+0000","last_became_peered":"2024-09-12T18:35:25.655295+0000","last_unstale":"2024-09-12T18:37:27.515300+0000","last_undegraded":"2024-09-12T18:37:27.515300+0000","last_fullsized":"2024-09-12T18:37:27.515300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:37.744175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":115,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.517528+0000","last_change":"2024-09-12T18:35:25.654863+0000","last_active":"2024-09-12T18:37:27.517528+0000","last_peered":"2024-09-12T18:37:27.517528+0000","last_clean":"2024-09-12T18:37:27.517528+0000","last_became_active":"2024-09-12T18:35:25.650407+0000","last_became_peered":"2024-09-12T18:35:25.650407+0000","last_unstale":"2024-09-12T18:37:27.517528+0000","last_undegraded":"2024-09-12T18:37:27.517528+0000","last_fullsized":"2024-09-12T18:37:27.517528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:38.395666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":117,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.016390+0000","last_change":"2024-09-12T18:35:25.662414+0000","last_active":"2024-09-12T18:37:30.016390+0000","last_peered":"2024-09-12T18:37:30.016390+0000","last_clean":"2024-09-12T18:37:30.016390+0000","last_became_active":"2024-09-12T18:35:25.660126+0000","last_became_peered":"2024-09-12T18:35:25.660126+0000","last_unstale":"2024-09-12T18:37:30.016390+0000","last_undegraded":"2024-09-12T18:37:30.016390+0000","last_fullsized":"2024-09-12T18:37:30.016390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:48.437139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":117,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.012099+0000","last_change":"2024-09-12T18:35:25.661523+0000","last_active":"2024-09-12T18:37:30.012099+0000","last_peered":"2024-09-12T18:37:30.012099+0000","last_clean":"2024-09-12T18:37:30.012099+0000","last_became_active":"2024-09-12T18:35:25.659338+0000","last_became_peered":"2024-09-12T18:35:25.659338+0000","last_unstale":"2024-09-12T18:37:30.012099+0000","last_undegraded":"2024-09-12T18:37:30.012099+0000","last_fullsized":"2024-09-12T18:37:30.012099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:37.083820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":115,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.517783+0000","last_change":"2024-09-12T18:35:25.662445+0000","last_active":"2024-09-12T18:37:27.517783+0000","last_peered":"2024-09-12T18:37:27.517783+0000","last_clean":"2024-09-12T18:37:27.517783+0000","last_became_active":"2024-09-12T18:35:25.659496+0000","last_became_peered":"2024-09-12T18:35:25.659496+0000","last_unstale":"2024-09-12T18:37:27.517783+0000","last_undegraded":"2024-09-12T18:37:27.517783+0000","last_fullsized":"2024-09-12T18:37:27.517783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:03.270420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":54,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.515486+0000","last_change":"2024-09-12T18:36:39.074532+0000","last_active":"2024-09-12T18:37:27.515486+0000","last_peered":"2024-09-12T18:37:27.515486+0000","last_clean":"2024-09-12T18:37:27.515486+0000","last_became_active":"2024-09-12T18:36:39.073676+0000","last_became_peered":"2024-09-12T18:36:39.073676+0000","last_unstale":"2024-09-12T18:37:27.515486+0000","last_undegraded":"2024-09-12T18:37:27.515486+0000","last_fullsized":"2024-09-12T18:37:27.515486+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:53.080797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":115,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.518468+0000","last_change":"2024-09-12T18:35:25.650507+0000","last_active":"2024-09-12T18:37:27.518468+0000","last_peered":"2024-09-12T18:37:27.518468+0000","last_clean":"2024-09-12T18:37:27.518468+0000","last_became_active":"2024-09-12T18:35:25.649415+0000","last_became_peered":"2024-09-12T18:35:25.649415+0000","last_unstale":"2024-09-12T18:37:27.518468+0000","last_undegraded":"2024-09-12T18:37:27.518468+0000","last_fullsized":"2024-09-12T18:37:27.518468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:23.081416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":118,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.015631+0000","last_change":"2024-09-12T18:35:25.653949+0000","last_active":"2024-09-12T18:37:30.015631+0000","last_peered":"2024-09-12T18:37:30.015631+0000","last_clean":"2024-09-12T18:37:30.015631+0000","last_became_active":"2024-09-12T18:35:25.652992+0000","last_became_peered":"2024-09-12T18:35:25.652992+0000","last_unstale":"2024-09-12T18:37:30.015631+0000","last_undegraded":"2024-09-12T18:37:30.015631+0000","last_fullsized":"2024-09-12T18:37:30.015631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:47.687372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":124,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.010851+0000","last_change":"2024-09-12T18:36:40.154958+0000","last_active":"2024-09-12T18:37:30.010851+0000","last_peered":"2024-09-12T18:37:30.010851+0000","last_clean":"2024-09-12T18:37:30.010851+0000","last_became_active":"2024-09-12T18:36:40.154422+0000","last_became_peered":"2024-09-12T18:36:40.154422+0000","last_unstale":"2024-09-12T18:37:30.010851+0000","last_undegraded":"2024-09-12T18:37:30.010851+0000","last_fullsized":"2024-09-12T18:37:30.010851+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:33.288844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":121,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.517746+0000","last_change":"2024-09-12T18:36:40.079440+0000","last_active":"2024-09-12T18:37:27.517746+0000","last_peered":"2024-09-12T18:37:27.517746+0000","last_clean":"2024-09-12T18:37:27.517746+0000","last_became_active":"2024-09-12T18:36:40.076955+0000","last_became_peered":"2024-09-12T18:36:40.076955+0000","last_unstale":"2024-09-12T18:37:27.517746+0000","last_undegraded":"2024-09-12T18:37:27.517746+0000","last_fullsized":"2024-09-12T18:37:27.517746+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:18.565373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":121,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.014283+0000","last_change":"2024-09-12T18:35:24.657739+0000","last_active":"2024-09-12T18:37:30.014283+0000","last_peered":"2024-09-12T18:37:30.014283+0000","last_clean":"2024-09-12T18:37:30.014283+0000","last_became_active":"2024-09-12T18:35:24.656208+0000","last_became_peered":"2024-09-12T18:35:24.656208+0000","last_unstale":"2024-09-12T18:37:30.014283+0000","last_undegraded":"2024-09-12T18:37:30.014283+0000","last_fullsized":"2024-09-12T18:37:30.014283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:50.073716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":115,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.516072+0000","last_change":"2024-09-12T18:35:25.651651+0000","last_active":"2024-09-12T18:37:27.516072+0000","last_peered":"2024-09-12T18:37:27.516072+0000","last_clean":"2024-09-12T18:37:27.516072+0000","last_became_active":"2024-09-12T18:35:25.650849+0000","last_became_peered":"2024-09-12T18:35:25.650849+0000","last_unstale":"2024-09-12T18:37:27.516072+0000","last_undegraded":"2024-09-12T18:37:27.516072+0000","last_fullsized":"2024-09-12T18:37:27.516072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:18.555827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":119,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.015925+0000","last_change":"2024-09-12T18:35:24.656119+0000","last_active":"2024-09-12T18:37:30.015925+0000","last_peered":"2024-09-12T18:37:30.015925+0000","last_clean":"2024-09-12T18:37:30.015925+0000","last_became_active":"2024-09-12T18:35:24.653175+0000","last_became_peered":"2024-09-12T18:35:24.653175+0000","last_unstale":"2024-09-12T18:37:30.015925+0000","last_undegraded":"2024-09-12T18:37:30.015925+0000","last_fullsized":"2024-09-12T18:37:30.015925+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:00.551165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":54,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.013611+0000","last_change":"2024-09-12T18:36:40.090805+0000","last_active":"2024-09-12T18:37:30.013611+0000","last_peered":"2024-09-12T18:37:30.013611+0000","last_clean":"2024-09-12T18:37:30.013611+0000","last_became_active":"2024-09-12T18:36:40.090318+0000","last_became_peered":"2024-09-12T18:36:40.090318+0000","last_unstale":"2024-09-12T18:37:30.013611+0000","last_undegraded":"2024-09-12T18:37:30.013611+0000","last_fullsized":"2024-09-12T18:37:30.013611+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:15.103437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":117,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.515375+0000","last_change":"2024-09-12T18:35:24.640096+0000","last_active":"2024-09-12T18:37:27.515375+0000","last_peered":"2024-09-12T18:37:27.515375+0000","last_clean":"2024-09-12T18:37:27.515375+0000","last_became_active":"2024-09-12T18:35:24.638230+0000","last_became_peered":"2024-09-12T18:35:24.638230+0000","last_unstale":"2024-09-12T18:37:27.515375+0000","last_undegraded":"2024-09-12T18:37:27.515375+0000","last_fullsized":"2024-09-12T18:37:27.515375+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:38.435296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":54,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.011319+0000","last_change":"2024-09-12T18:36:40.075962+0000","last_active":"2024-09-12T18:37:30.011319+0000","last_peered":"2024-09-12T18:37:30.011319+0000","last_clean":"2024-09-12T18:37:30.011319+0000","last_became_active":"2024-09-12T18:36:40.075081+0000","last_became_peered":"2024-09-12T18:36:40.075081+0000","last_unstale":"2024-09-12T18:37:30.011319+0000","last_undegraded":"2024-09-12T18:37:30.011319+0000","last_fullsized":"2024-09-12T18:37:30.011319+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:00.410639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":127,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.011127+0000","last_change":"2024-09-12T18:35:24.653610+0000","last_active":"2024-09-12T18:37:30.011127+0000","last_peered":"2024-09-12T18:37:30.011127+0000","last_clean":"2024-09-12T18:37:30.011127+0000","last_became_active":"2024-09-12T18:35:24.652880+0000","last_became_peered":"2024-09-12T18:35:24.652880+0000","last_unstale":"2024-09-12T18:37:30.011127+0000","last_undegraded":"2024-09-12T18:37:30.011127+0000","last_fullsized":"2024-09-12T18:37:30.011127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:57.636251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"71'14033","reported_seq":14142,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:31.540622+0000","last_change":"2024-09-12T18:35:44.771794+0000","last_active":"2024-09-12T18:37:31.540622+0000","last_peered":"2024-09-12T18:37:31.540622+0000","last_clean":"2024-09-12T18:37:31.540622+0000","last_became_active":"2024-09-12T18:35:44.771286+0000","last_became_peered":"2024-09-12T18:35:44.771286+0000","last_unstale":"2024-09-12T18:37:31.540622+0000","last_undegraded":"2024-09-12T18:37:31.540622+0000","last_fullsized":"2024-09-12T18:37:31.540622+0000","mapping_epoch":21,"log_start":"60'10953","ondisk_log_start":"60'10953","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3080,"log_dups_size":0,"ondisk_log_size":3080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:10.094729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165609472,"num_objects":2527,"num_object_clones":0,"num_object_copies":5054,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2527,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14033,"num_write_kb":529920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":120,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.011721+0000","last_change":"2024-09-12T18:35:24.653465+0000","last_active":"2024-09-12T18:37:30.011721+0000","last_peered":"2024-09-12T18:37:30.011721+0000","last_clean":"2024-09-12T18:37:30.011721+0000","last_became_active":"2024-09-12T18:35:24.652792+0000","last_became_peered":"2024-09-12T18:35:24.652792+0000","last_unstale":"2024-09-12T18:37:30.011721+0000","last_undegraded":"2024-09-12T18:37:30.011721+0000","last_fullsized":"2024-09-12T18:37:30.011721+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:14.588993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":115,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.515200+0000","last_change":"2024-09-12T18:35:25.655426+0000","last_active":"2024-09-12T18:37:27.515200+0000","last_peered":"2024-09-12T18:37:27.515200+0000","last_clean":"2024-09-12T18:37:27.515200+0000","last_became_active":"2024-09-12T18:35:25.648186+0000","last_became_peered":"2024-09-12T18:35:25.648186+0000","last_unstale":"2024-09-12T18:37:27.515200+0000","last_undegraded":"2024-09-12T18:37:27.515200+0000","last_fullsized":"2024-09-12T18:37:27.515200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:48.802815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"70'13387","reported_seq":13494,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:28.525924+0000","last_change":"2024-09-12T18:35:44.767860+0000","last_active":"2024-09-12T18:37:28.525924+0000","last_peered":"2024-09-12T18:37:28.525924+0000","last_clean":"2024-09-12T18:37:28.525924+0000","last_became_active":"2024-09-12T18:35:44.766986+0000","last_became_peered":"2024-09-12T18:35:44.766986+0000","last_unstale":"2024-09-12T18:37:28.525924+0000","last_undegraded":"2024-09-12T18:37:28.525924+0000","last_fullsized":"2024-09-12T18:37:28.525924+0000","mapping_epoch":21,"log_start":"58'10135","ondisk_log_start":"58'10135","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3252,"log_dups_size":0,"ondisk_log_size":3252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:49.109157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185663488,"num_objects":2833,"num_object_clones":0,"num_object_copies":5666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2833,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13387,"num_write_kb":519040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":119,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.516349+0000","last_change":"2024-09-12T18:35:24.648439+0000","last_active":"2024-09-12T18:37:27.516349+0000","last_peered":"2024-09-12T18:37:27.516349+0000","last_clean":"2024-09-12T18:37:27.516349+0000","last_became_active":"2024-09-12T18:35:24.647629+0000","last_became_peered":"2024-09-12T18:35:24.647629+0000","last_unstale":"2024-09-12T18:37:27.516349+0000","last_undegraded":"2024-09-12T18:37:27.516349+0000","last_fullsized":"2024-09-12T18:37:27.516349+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:45.428223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":115,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.515280+0000","last_change":"2024-09-12T18:35:25.652496+0000","last_active":"2024-09-12T18:37:27.515280+0000","last_peered":"2024-09-12T18:37:27.515280+0000","last_clean":"2024-09-12T18:37:27.515280+0000","last_became_active":"2024-09-12T18:35:25.651628+0000","last_became_peered":"2024-09-12T18:35:25.651628+0000","last_unstale":"2024-09-12T18:37:27.515280+0000","last_undegraded":"2024-09-12T18:37:27.515280+0000","last_fullsized":"2024-09-12T18:37:27.515280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:44.920448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"70'13913","reported_seq":14020,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:28.548744+0000","last_change":"2024-09-12T18:35:44.767175+0000","last_active":"2024-09-12T18:37:28.548744+0000","last_peered":"2024-09-12T18:37:28.548744+0000","last_clean":"2024-09-12T18:37:28.548744+0000","last_became_active":"2024-09-12T18:35:44.766592+0000","last_became_peered":"2024-09-12T18:35:44.766592+0000","last_unstale":"2024-09-12T18:37:28.548744+0000","last_undegraded":"2024-09-12T18:37:28.548744+0000","last_fullsized":"2024-09-12T18:37:28.548744+0000","mapping_epoch":21,"log_start":"59'10648","ondisk_log_start":"59'10648","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3265,"log_dups_size":0,"ondisk_log_size":3265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:44.678279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182779904,"num_objects":2789,"num_object_clones":0,"num_object_copies":5578,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2789,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13913,"num_write_kb":534464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":120,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.011680+0000","last_change":"2024-09-12T18:35:24.654976+0000","last_active":"2024-09-12T18:37:30.011680+0000","last_peered":"2024-09-12T18:37:30.011680+0000","last_clean":"2024-09-12T18:37:30.011680+0000","last_became_active":"2024-09-12T18:35:24.654264+0000","last_became_peered":"2024-09-12T18:35:24.654264+0000","last_unstale":"2024-09-12T18:37:30.011680+0000","last_undegraded":"2024-09-12T18:37:30.011680+0000","last_fullsized":"2024-09-12T18:37:30.011680+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:00.115408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":123,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.011753+0000","last_change":"2024-09-12T18:36:40.070910+0000","last_active":"2024-09-12T18:37:30.011753+0000","last_peered":"2024-09-12T18:37:30.011753+0000","last_clean":"2024-09-12T18:37:30.011753+0000","last_became_active":"2024-09-12T18:36:40.070516+0000","last_became_peered":"2024-09-12T18:36:40.070516+0000","last_unstale":"2024-09-12T18:37:30.011753+0000","last_undegraded":"2024-09-12T18:37:30.011753+0000","last_fullsized":"2024-09-12T18:37:30.011753+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:23.962788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"71'14283","reported_seq":14392,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:31.523045+0000","last_change":"2024-09-12T18:35:44.763067+0000","last_active":"2024-09-12T18:37:31.523045+0000","last_peered":"2024-09-12T18:37:31.523045+0000","last_clean":"2024-09-12T18:37:31.523045+0000","last_became_active":"2024-09-12T18:35:44.762584+0000","last_became_peered":"2024-09-12T18:35:44.762584+0000","last_unstale":"2024-09-12T18:37:31.523045+0000","last_undegraded":"2024-09-12T18:37:31.523045+0000","last_fullsized":"2024-09-12T18:37:31.523045+0000","mapping_epoch":21,"log_start":"51'8200","ondisk_log_start":"51'8200","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":6083,"log_dups_size":0,"ondisk_log_size":6083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:47.847399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164691968,"num_objects":2513,"num_object_clones":0,"num_object_copies":5026,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2513,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14283,"num_write_kb":537472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":119,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.011433+0000","last_change":"2024-09-12T18:35:24.657665+0000","last_active":"2024-09-12T18:37:30.011433+0000","last_peered":"2024-09-12T18:37:30.011433+0000","last_clean":"2024-09-12T18:37:30.011433+0000","last_became_active":"2024-09-12T18:35:24.657015+0000","last_became_peered":"2024-09-12T18:35:24.657015+0000","last_unstale":"2024-09-12T18:37:30.011433+0000","last_undegraded":"2024-09-12T18:37:30.011433+0000","last_fullsized":"2024-09-12T18:37:30.011433+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:03.171326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":117,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.016385+0000","last_change":"2024-09-12T18:35:25.665275+0000","last_active":"2024-09-12T18:37:30.016385+0000","last_peered":"2024-09-12T18:37:30.016385+0000","last_clean":"2024-09-12T18:37:30.016385+0000","last_became_active":"2024-09-12T18:35:25.659511+0000","last_became_peered":"2024-09-12T18:35:25.659511+0000","last_unstale":"2024-09-12T18:37:30.016385+0000","last_undegraded":"2024-09-12T18:37:30.016385+0000","last_fullsized":"2024-09-12T18:37:30.016385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"70'13841","reported_seq":13947,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:28.559831+0000","last_change":"2024-09-12T18:35:44.773526+0000","last_active":"2024-09-12T18:37:28.559831+0000","last_peered":"2024-09-12T18:37:28.559831+0000","last_clean":"2024-09-12T18:37:28.559831+0000","last_became_active":"2024-09-12T18:35:44.772974+0000","last_became_peered":"2024-09-12T18:35:44.772974+0000","last_unstale":"2024-09-12T18:37:28.559831+0000","last_undegraded":"2024-09-12T18:37:28.559831+0000","last_fullsized":"2024-09-12T18:37:28.559831+0000","mapping_epoch":21,"log_start":"58'10566","ondisk_log_start":"58'10566","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3275,"log_dups_size":0,"ondisk_log_size":3275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:23.676840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191889432,"num_objects":2929,"num_object_clones":0,"num_object_copies":5858,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2929,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13841,"num_write_kb":536577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":69,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.013869+0000","last_change":"2024-09-12T18:36:40.115783+0000","last_active":"2024-09-12T18:37:30.013869+0000","last_peered":"2024-09-12T18:37:30.013869+0000","last_clean":"2024-09-12T18:37:30.013869+0000","last_became_active":"2024-09-12T18:36:40.068020+0000","last_became_peered":"2024-09-12T18:36:40.068020+0000","last_unstale":"2024-09-12T18:37:30.013869+0000","last_undegraded":"2024-09-12T18:37:30.013869+0000","last_fullsized":"2024-09-12T18:37:30.013869+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:02.999068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":123,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.011274+0000","last_change":"2024-09-12T18:36:39.071809+0000","last_active":"2024-09-12T18:37:30.011274+0000","last_peered":"2024-09-12T18:37:30.011274+0000","last_clean":"2024-09-12T18:37:30.011274+0000","last_became_active":"2024-09-12T18:36:39.070888+0000","last_became_peered":"2024-09-12T18:36:39.070888+0000","last_unstale":"2024-09-12T18:37:30.011274+0000","last_undegraded":"2024-09-12T18:37:30.011274+0000","last_fullsized":"2024-09-12T18:37:30.011274+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:19.740732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"71'13980","reported_seq":14089,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:31.541237+0000","last_change":"2024-09-12T18:35:44.767970+0000","last_active":"2024-09-12T18:37:31.541237+0000","last_peered":"2024-09-12T18:37:31.541237+0000","last_clean":"2024-09-12T18:37:31.541237+0000","last_became_active":"2024-09-12T18:35:44.767348+0000","last_became_peered":"2024-09-12T18:35:44.767348+0000","last_unstale":"2024-09-12T18:37:31.541237+0000","last_undegraded":"2024-09-12T18:37:31.541237+0000","last_fullsized":"2024-09-12T18:37:31.541237+0000","mapping_epoch":21,"log_start":"51'7900","ondisk_log_start":"51'7900","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":6080,"log_dups_size":0,"ondisk_log_size":6080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:48.745907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158597120,"num_objects":2420,"num_object_clones":0,"num_object_copies":4840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2420,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13980,"num_write_kb":524800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":119,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.011918+0000","last_change":"2024-09-12T18:35:24.659019+0000","last_active":"2024-09-12T18:37:30.011918+0000","last_peered":"2024-09-12T18:37:30.011918+0000","last_clean":"2024-09-12T18:37:30.011918+0000","last_became_active":"2024-09-12T18:35:24.658423+0000","last_became_peered":"2024-09-12T18:35:24.658423+0000","last_unstale":"2024-09-12T18:37:30.011918+0000","last_undegraded":"2024-09-12T18:37:30.011918+0000","last_fullsized":"2024-09-12T18:37:30.011918+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:37.668417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":117,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.011858+0000","last_change":"2024-09-12T18:35:25.662287+0000","last_active":"2024-09-12T18:37:30.011858+0000","last_peered":"2024-09-12T18:37:30.011858+0000","last_clean":"2024-09-12T18:37:30.011858+0000","last_became_active":"2024-09-12T18:35:25.660372+0000","last_became_peered":"2024-09-12T18:35:25.660372+0000","last_unstale":"2024-09-12T18:37:30.011858+0000","last_undegraded":"2024-09-12T18:37:30.011858+0000","last_fullsized":"2024-09-12T18:37:30.011858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:08.729541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.f","version":"71'13943","reported_seq":14052,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:31.540505+0000","last_change":"2024-09-12T18:35:44.774817+0000","last_active":"2024-09-12T18:37:31.540505+0000","last_peered":"2024-09-12T18:37:31.540505+0000","last_clean":"2024-09-12T18:37:31.540505+0000","last_became_active":"2024-09-12T18:35:44.774429+0000","last_became_peered":"2024-09-12T18:35:44.774429+0000","last_unstale":"2024-09-12T18:37:31.540505+0000","last_undegraded":"2024-09-12T18:37:31.540505+0000","last_fullsized":"2024-09-12T18:37:31.540505+0000","mapping_epoch":21,"log_start":"59'10824","ondisk_log_start":"59'10824","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3119,"log_dups_size":0,"ondisk_log_size":3119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:21.579103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155516928,"num_objects":2373,"num_object_clones":0,"num_object_copies":4746,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2373,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13943,"num_write_kb":522112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":117,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.515402+0000","last_change":"2024-09-12T18:35:24.648330+0000","last_active":"2024-09-12T18:37:27.515402+0000","last_peered":"2024-09-12T18:37:27.515402+0000","last_clean":"2024-09-12T18:37:27.515402+0000","last_became_active":"2024-09-12T18:35:24.647520+0000","last_became_peered":"2024-09-12T18:35:24.647520+0000","last_unstale":"2024-09-12T18:37:27.515402+0000","last_undegraded":"2024-09-12T18:37:27.515402+0000","last_fullsized":"2024-09-12T18:37:27.515402+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:25.552055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":117,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.013738+0000","last_change":"2024-09-12T18:35:25.658674+0000","last_active":"2024-09-12T18:37:30.013738+0000","last_peered":"2024-09-12T18:37:30.013738+0000","last_clean":"2024-09-12T18:37:30.013738+0000","last_became_active":"2024-09-12T18:35:25.657386+0000","last_became_peered":"2024-09-12T18:35:25.657386+0000","last_unstale":"2024-09-12T18:37:30.013738+0000","last_undegraded":"2024-09-12T18:37:30.013738+0000","last_fullsized":"2024-09-12T18:37:30.013738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:48.037086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"70'13829","reported_seq":13936,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:28.547683+0000","last_change":"2024-09-12T18:35:44.771738+0000","last_active":"2024-09-12T18:37:28.547683+0000","last_peered":"2024-09-12T18:37:28.547683+0000","last_clean":"2024-09-12T18:37:28.547683+0000","last_became_active":"2024-09-12T18:35:44.771227+0000","last_became_peered":"2024-09-12T18:35:44.771227+0000","last_unstale":"2024-09-12T18:37:28.547683+0000","last_undegraded":"2024-09-12T18:37:28.547683+0000","last_fullsized":"2024-09-12T18:37:28.547683+0000","mapping_epoch":21,"log_start":"59'10593","ondisk_log_start":"59'10593","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3236,"log_dups_size":0,"ondisk_log_size":3236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:27.329732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188284928,"num_objects":2873,"num_object_clones":0,"num_object_copies":5746,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2873,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13829,"num_write_kb":534464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":117,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.515196+0000","last_change":"2024-09-12T18:35:24.646810+0000","last_active":"2024-09-12T18:37:27.515196+0000","last_peered":"2024-09-12T18:37:27.515196+0000","last_clean":"2024-09-12T18:37:27.515196+0000","last_became_active":"2024-09-12T18:35:24.646008+0000","last_became_peered":"2024-09-12T18:35:24.646008+0000","last_unstale":"2024-09-12T18:37:27.515196+0000","last_undegraded":"2024-09-12T18:37:27.515196+0000","last_fullsized":"2024-09-12T18:37:27.515196+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:43.888776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":117,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.015963+0000","last_change":"2024-09-12T18:35:25.667710+0000","last_active":"2024-09-12T18:37:30.015963+0000","last_peered":"2024-09-12T18:37:30.015963+0000","last_clean":"2024-09-12T18:37:30.015963+0000","last_became_active":"2024-09-12T18:35:25.666940+0000","last_became_peered":"2024-09-12T18:35:25.666940+0000","last_unstale":"2024-09-12T18:37:30.015963+0000","last_undegraded":"2024-09-12T18:37:30.015963+0000","last_fullsized":"2024-09-12T18:37:30.015963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:09.823085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"70'13523","reported_seq":13629,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:28.561627+0000","last_change":"2024-09-12T18:35:44.769127+0000","last_active":"2024-09-12T18:37:28.561627+0000","last_peered":"2024-09-12T18:37:28.561627+0000","last_clean":"2024-09-12T18:37:28.561627+0000","last_became_active":"2024-09-12T18:35:44.768382+0000","last_became_peered":"2024-09-12T18:35:44.768382+0000","last_unstale":"2024-09-12T18:37:28.561627+0000","last_undegraded":"2024-09-12T18:37:28.561627+0000","last_fullsized":"2024-09-12T18:37:28.561627+0000","mapping_epoch":21,"log_start":"58'10329","ondisk_log_start":"58'10329","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3194,"log_dups_size":0,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:33.385476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187629568,"num_objects":2863,"num_object_clones":0,"num_object_copies":5726,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2863,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13523,"num_write_kb":524352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":270,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.011217+0000","last_change":"2024-09-12T18:35:13.489018+0000","last_active":"2024-09-12T18:37:30.011217+0000","last_peered":"2024-09-12T18:37:30.011217+0000","last_clean":"2024-09-12T18:37:30.011217+0000","last_became_active":"2024-09-12T18:35:13.488346+0000","last_became_peered":"2024-09-12T18:35:13.488346+0000","last_unstale":"2024-09-12T18:37:30.011217+0000","last_undegraded":"2024-09-12T18:37:30.011217+0000","last_fullsized":"2024-09-12T18:37:30.011217+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_clean_scrub_stamp":"2024-09-12T18:35:12.464628+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:54.864640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":134,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.014484+0000","last_change":"2024-09-12T18:35:22.459694+0000","last_active":"2024-09-12T18:37:30.014484+0000","last_peered":"2024-09-12T18:37:30.014484+0000","last_clean":"2024-09-12T18:37:30.014484+0000","last_became_active":"2024-09-12T18:35:20.446796+0000","last_became_peered":"2024-09-12T18:35:20.446796+0000","last_unstale":"2024-09-12T18:37:30.014484+0000","last_undegraded":"2024-09-12T18:37:30.014484+0000","last_fullsized":"2024-09-12T18:37:30.014484+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:21.506024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016291610000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":54,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.518325+0000","last_change":"2024-09-12T18:36:39.072775+0000","last_active":"2024-09-12T18:37:27.518325+0000","last_peered":"2024-09-12T18:37:27.518325+0000","last_clean":"2024-09-12T18:37:27.518325+0000","last_became_active":"2024-09-12T18:36:39.072247+0000","last_became_peered":"2024-09-12T18:36:39.072247+0000","last_unstale":"2024-09-12T18:37:27.518325+0000","last_undegraded":"2024-09-12T18:37:27.518325+0000","last_fullsized":"2024-09-12T18:37:27.518325+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:07.105080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":118,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.011982+0000","last_change":"2024-09-12T18:35:25.662424+0000","last_active":"2024-09-12T18:37:30.011982+0000","last_peered":"2024-09-12T18:37:30.011982+0000","last_clean":"2024-09-12T18:37:30.011982+0000","last_became_active":"2024-09-12T18:35:25.661043+0000","last_became_peered":"2024-09-12T18:35:25.661043+0000","last_unstale":"2024-09-12T18:37:30.011982+0000","last_undegraded":"2024-09-12T18:37:30.011982+0000","last_fullsized":"2024-09-12T18:37:30.011982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:52.551802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.7","version":"71'14150","reported_seq":14259,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:31.538934+0000","last_change":"2024-09-12T18:35:44.774505+0000","last_active":"2024-09-12T18:37:31.538934+0000","last_peered":"2024-09-12T18:37:31.538934+0000","last_clean":"2024-09-12T18:37:31.538934+0000","last_became_active":"2024-09-12T18:35:44.774259+0000","last_became_peered":"2024-09-12T18:35:44.774259+0000","last_unstale":"2024-09-12T18:37:31.538934+0000","last_undegraded":"2024-09-12T18:37:31.538934+0000","last_fullsized":"2024-09-12T18:37:31.538934+0000","mapping_epoch":21,"log_start":"60'11069","ondisk_log_start":"60'11069","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3081,"log_dups_size":0,"ondisk_log_size":3081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:21.731670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162398208,"num_objects":2478,"num_object_clones":0,"num_object_copies":4956,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2478,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14150,"num_write_kb":532096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":133,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.011000+0000","last_change":"2024-09-12T18:35:22.459090+0000","last_active":"2024-09-12T18:37:30.011000+0000","last_peered":"2024-09-12T18:37:30.011000+0000","last_clean":"2024-09-12T18:37:30.011000+0000","last_became_active":"2024-09-12T18:35:20.448553+0000","last_became_peered":"2024-09-12T18:35:20.448553+0000","last_unstale":"2024-09-12T18:37:30.011000+0000","last_undegraded":"2024-09-12T18:37:30.011000+0000","last_fullsized":"2024-09-12T18:37:30.011000+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:56.834808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001030836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":120,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.016405+0000","last_change":"2024-09-12T18:35:24.651597+0000","last_active":"2024-09-12T18:37:30.016405+0000","last_peered":"2024-09-12T18:37:30.016405+0000","last_clean":"2024-09-12T18:37:30.016405+0000","last_became_active":"2024-09-12T18:35:24.649940+0000","last_became_peered":"2024-09-12T18:35:24.649940+0000","last_unstale":"2024-09-12T18:37:30.016405+0000","last_undegraded":"2024-09-12T18:37:30.016405+0000","last_fullsized":"2024-09-12T18:37:30.016405+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:36.822432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":121,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.516271+0000","last_change":"2024-09-12T18:36:39.076901+0000","last_active":"2024-09-12T18:37:27.516271+0000","last_peered":"2024-09-12T18:37:27.516271+0000","last_clean":"2024-09-12T18:37:27.516271+0000","last_became_active":"2024-09-12T18:36:39.076178+0000","last_became_peered":"2024-09-12T18:36:39.076178+0000","last_unstale":"2024-09-12T18:37:27.516271+0000","last_undegraded":"2024-09-12T18:37:27.516271+0000","last_fullsized":"2024-09-12T18:37:27.516271+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:42.901643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"71'14144","reported_seq":14253,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:31.542023+0000","last_change":"2024-09-12T18:35:44.770379+0000","last_active":"2024-09-12T18:37:31.542023+0000","last_peered":"2024-09-12T18:37:31.542023+0000","last_clean":"2024-09-12T18:37:31.542023+0000","last_became_active":"2024-09-12T18:35:44.769739+0000","last_became_peered":"2024-09-12T18:35:44.769739+0000","last_unstale":"2024-09-12T18:37:31.542023+0000","last_undegraded":"2024-09-12T18:37:31.542023+0000","last_fullsized":"2024-09-12T18:37:31.542023+0000","mapping_epoch":21,"log_start":"51'8100","ondisk_log_start":"51'8100","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":6044,"log_dups_size":0,"ondisk_log_size":6044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:02:23.077263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":156631040,"num_objects":2390,"num_object_clones":0,"num_object_copies":4780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2390,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14144,"num_write_kb":529088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":133,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.015872+0000","last_change":"2024-09-12T18:35:22.464179+0000","last_active":"2024-09-12T18:37:30.015872+0000","last_peered":"2024-09-12T18:37:30.015872+0000","last_clean":"2024-09-12T18:37:30.015872+0000","last_became_active":"2024-09-12T18:35:20.442613+0000","last_became_peered":"2024-09-12T18:35:20.442613+0000","last_unstale":"2024-09-12T18:37:30.015872+0000","last_undegraded":"2024-09-12T18:37:30.015872+0000","last_fullsized":"2024-09-12T18:37:30.015872+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:17.636537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014134620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":118,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.515132+0000","last_change":"2024-09-12T18:35:24.641297+0000","last_active":"2024-09-12T18:37:27.515132+0000","last_peered":"2024-09-12T18:37:27.515132+0000","last_clean":"2024-09-12T18:37:27.515132+0000","last_became_active":"2024-09-12T18:35:24.637334+0000","last_became_peered":"2024-09-12T18:35:24.637334+0000","last_unstale":"2024-09-12T18:37:27.515132+0000","last_undegraded":"2024-09-12T18:37:27.515132+0000","last_fullsized":"2024-09-12T18:37:27.515132+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:50.772074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":52,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.517349+0000","last_change":"2024-09-12T18:36:40.073534+0000","last_active":"2024-09-12T18:37:27.517349+0000","last_peered":"2024-09-12T18:37:27.517349+0000","last_clean":"2024-09-12T18:37:27.517349+0000","last_became_active":"2024-09-12T18:36:40.071694+0000","last_became_peered":"2024-09-12T18:36:40.071694+0000","last_unstale":"2024-09-12T18:37:27.517349+0000","last_undegraded":"2024-09-12T18:37:27.517349+0000","last_fullsized":"2024-09-12T18:37:27.517349+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:16.018454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"71'14248","reported_seq":19943,"reported_epoch":71,"state":"active+remapped+backfilling","last_fresh":"2024-09-12T18:37:31.541574+0000","last_change":"2024-09-12T18:37:16.138383+0000","last_active":"2024-09-12T18:37:31.541574+0000","last_peered":"2024-09-12T18:37:31.541574+0000","last_clean":"2024-09-12T18:36:38.032256+0000","last_became_active":"2024-09-12T18:36:40.219923+0000","last_became_peered":"2024-09-12T18:36:40.219923+0000","last_unstale":"2024-09-12T18:37:31.541574+0000","last_undegraded":"2024-09-12T18:37:31.541574+0000","last_fullsized":"2024-09-12T18:37:31.541574+0000","mapping_epoch":49,"log_start":"60'11124","ondisk_log_start":"60'11124","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3124,"log_dups_size":0,"ondisk_log_size":3124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164102144,"num_objects":2504,"num_object_clones":0,"num_object_copies":5008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":474,"num_objects_unfound":0,"num_objects_dirty":2504,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14248,"num_write_kb":536064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2791,"num_bytes_recovered":182910976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[{"shards":"0,2","objects":2504}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":135,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.011917+0000","last_change":"2024-09-12T18:35:22.459049+0000","last_active":"2024-09-12T18:37:30.011917+0000","last_peered":"2024-09-12T18:37:30.011917+0000","last_clean":"2024-09-12T18:37:30.011917+0000","last_became_active":"2024-09-12T18:35:20.446814+0000","last_became_peered":"2024-09-12T18:35:20.446814+0000","last_unstale":"2024-09-12T18:37:30.011917+0000","last_undegraded":"2024-09-12T18:37:30.011917+0000","last_fullsized":"2024-09-12T18:37:30.011917+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:18.033595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010716149999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":120,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.014444+0000","last_change":"2024-09-12T18:35:24.658273+0000","last_active":"2024-09-12T18:37:30.014444+0000","last_peered":"2024-09-12T18:37:30.014444+0000","last_clean":"2024-09-12T18:37:30.014444+0000","last_became_active":"2024-09-12T18:35:24.657433+0000","last_became_peered":"2024-09-12T18:35:24.657433+0000","last_unstale":"2024-09-12T18:37:30.014444+0000","last_undegraded":"2024-09-12T18:37:30.014444+0000","last_fullsized":"2024-09-12T18:37:30.014444+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:48.497218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":52,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.515737+0000","last_change":"2024-09-12T18:36:40.076054+0000","last_active":"2024-09-12T18:37:27.515737+0000","last_peered":"2024-09-12T18:37:27.515737+0000","last_clean":"2024-09-12T18:37:27.515737+0000","last_became_active":"2024-09-12T18:36:40.073803+0000","last_became_peered":"2024-09-12T18:36:40.073803+0000","last_unstale":"2024-09-12T18:37:27.515737+0000","last_undegraded":"2024-09-12T18:37:27.515737+0000","last_fullsized":"2024-09-12T18:37:27.515737+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:49.085420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"71'13888","reported_seq":13997,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:31.516802+0000","last_change":"2024-09-12T18:35:44.770799+0000","last_active":"2024-09-12T18:37:31.516802+0000","last_peered":"2024-09-12T18:37:31.516802+0000","last_clean":"2024-09-12T18:37:31.516802+0000","last_became_active":"2024-09-12T18:35:44.770030+0000","last_became_peered":"2024-09-12T18:35:44.770030+0000","last_unstale":"2024-09-12T18:37:31.516802+0000","last_undegraded":"2024-09-12T18:37:31.516802+0000","last_fullsized":"2024-09-12T18:37:31.516802+0000","mapping_epoch":21,"log_start":"51'7800","ondisk_log_start":"51'7800","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":6088,"log_dups_size":0,"ondisk_log_size":6088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:24.786452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154402816,"num_objects":2356,"num_object_clones":0,"num_object_copies":4712,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2356,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13888,"num_write_kb":519808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":120,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.011603+0000","last_change":"2024-09-12T18:35:24.657618+0000","last_active":"2024-09-12T18:37:30.011603+0000","last_peered":"2024-09-12T18:37:30.011603+0000","last_clean":"2024-09-12T18:37:30.011603+0000","last_became_active":"2024-09-12T18:35:24.656741+0000","last_became_peered":"2024-09-12T18:35:24.656741+0000","last_unstale":"2024-09-12T18:37:30.011603+0000","last_undegraded":"2024-09-12T18:37:30.011603+0000","last_fullsized":"2024-09-12T18:37:30.011603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:43.113104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":133,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.016080+0000","last_change":"2024-09-12T18:35:22.464180+0000","last_active":"2024-09-12T18:37:30.016080+0000","last_peered":"2024-09-12T18:37:30.016080+0000","last_clean":"2024-09-12T18:37:30.016080+0000","last_became_active":"2024-09-12T18:35:20.442566+0000","last_became_peered":"2024-09-12T18:35:20.442566+0000","last_unstale":"2024-09-12T18:37:30.016080+0000","last_undegraded":"2024-09-12T18:37:30.016080+0000","last_fullsized":"2024-09-12T18:37:30.016080+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:29.021710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001325786,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":115,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.518412+0000","last_change":"2024-09-12T18:35:25.650458+0000","last_active":"2024-09-12T18:37:27.518412+0000","last_peered":"2024-09-12T18:37:27.518412+0000","last_clean":"2024-09-12T18:37:27.518412+0000","last_became_active":"2024-09-12T18:35:25.648761+0000","last_became_peered":"2024-09-12T18:35:25.648761+0000","last_unstale":"2024-09-12T18:37:27.518412+0000","last_undegraded":"2024-09-12T18:37:27.518412+0000","last_fullsized":"2024-09-12T18:37:27.518412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:53.026950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"71'13975","reported_seq":14084,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:31.531455+0000","last_change":"2024-09-12T18:35:44.773801+0000","last_active":"2024-09-12T18:37:31.531455+0000","last_peered":"2024-09-12T18:37:31.531455+0000","last_clean":"2024-09-12T18:37:31.531455+0000","last_became_active":"2024-09-12T18:35:44.772787+0000","last_became_peered":"2024-09-12T18:35:44.772787+0000","last_unstale":"2024-09-12T18:37:31.531455+0000","last_undegraded":"2024-09-12T18:37:31.531455+0000","last_fullsized":"2024-09-12T18:37:31.531455+0000","mapping_epoch":21,"log_start":"60'10882","ondisk_log_start":"60'10882","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3093,"log_dups_size":0,"ondisk_log_size":3093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:13.758208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158924800,"num_objects":2425,"num_object_clones":0,"num_object_copies":4850,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2425,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13975,"num_write_kb":524800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":52,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.517656+0000","last_change":"2024-09-12T18:36:40.076936+0000","last_active":"2024-09-12T18:37:27.517656+0000","last_peered":"2024-09-12T18:37:27.517656+0000","last_clean":"2024-09-12T18:37:27.517656+0000","last_became_active":"2024-09-12T18:36:40.075987+0000","last_became_peered":"2024-09-12T18:36:40.075987+0000","last_unstale":"2024-09-12T18:37:27.517656+0000","last_undegraded":"2024-09-12T18:37:27.517656+0000","last_fullsized":"2024-09-12T18:37:27.517656+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:31.242588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":137,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.515945+0000","last_change":"2024-09-12T18:36:40.107062+0000","last_active":"2024-09-12T18:37:27.515945+0000","last_peered":"2024-09-12T18:37:27.515945+0000","last_clean":"2024-09-12T18:37:27.515945+0000","last_became_active":"2024-09-12T18:36:40.106366+0000","last_became_peered":"2024-09-12T18:36:40.106366+0000","last_unstale":"2024-09-12T18:37:27.515945+0000","last_undegraded":"2024-09-12T18:37:27.515945+0000","last_fullsized":"2024-09-12T18:37:27.515945+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:43.504139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080163599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":115,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.515589+0000","last_change":"2024-09-12T18:35:25.650717+0000","last_active":"2024-09-12T18:37:27.515589+0000","last_peered":"2024-09-12T18:37:27.515589+0000","last_clean":"2024-09-12T18:37:27.515589+0000","last_became_active":"2024-09-12T18:35:25.649147+0000","last_became_peered":"2024-09-12T18:35:25.649147+0000","last_unstale":"2024-09-12T18:37:27.515589+0000","last_undegraded":"2024-09-12T18:37:27.515589+0000","last_fullsized":"2024-09-12T18:37:27.515589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:07.365888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"71'14047","reported_seq":27099,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:31.537758+0000","last_change":"2024-09-12T18:37:17.275703+0000","last_active":"2024-09-12T18:37:31.537758+0000","last_peered":"2024-09-12T18:37:31.537758+0000","last_clean":"2024-09-12T18:37:31.537758+0000","last_became_active":"2024-09-12T18:37:17.230502+0000","last_became_peered":"2024-09-12T18:37:17.230502+0000","last_unstale":"2024-09-12T18:37:31.537758+0000","last_undegraded":"2024-09-12T18:37:31.537758+0000","last_fullsized":"2024-09-12T18:37:31.537758+0000","mapping_epoch":65,"log_start":"60'11001","ondisk_log_start":"60'11001","created":21,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3046,"log_dups_size":0,"ondisk_log_size":3046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:25.651321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159711232,"num_objects":2437,"num_object_clones":0,"num_object_copies":4874,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2437,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14047,"num_write_kb":527488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6464,"num_bytes_recovered":423624704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":121,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.016311+0000","last_change":"2024-09-12T18:35:24.657234+0000","last_active":"2024-09-12T18:37:30.016311+0000","last_peered":"2024-09-12T18:37:30.016311+0000","last_clean":"2024-09-12T18:37:30.016311+0000","last_became_active":"2024-09-12T18:35:24.655950+0000","last_became_peered":"2024-09-12T18:35:24.655950+0000","last_unstale":"2024-09-12T18:37:30.016311+0000","last_undegraded":"2024-09-12T18:37:30.016311+0000","last_fullsized":"2024-09-12T18:37:30.016311+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:17.466623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.516397+0000","last_change":"2024-09-12T18:36:40.076943+0000","last_active":"2024-09-12T18:37:27.516397+0000","last_peered":"2024-09-12T18:37:27.516397+0000","last_clean":"2024-09-12T18:37:27.516397+0000","last_became_active":"2024-09-12T18:36:40.075968+0000","last_became_peered":"2024-09-12T18:36:40.075968+0000","last_unstale":"2024-09-12T18:37:27.516397+0000","last_undegraded":"2024-09-12T18:37:27.516397+0000","last_fullsized":"2024-09-12T18:37:27.516397+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:41.716022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":56,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.010645+0000","last_change":"2024-09-12T18:36:39.071682+0000","last_active":"2024-09-12T18:37:30.010645+0000","last_peered":"2024-09-12T18:37:30.010645+0000","last_clean":"2024-09-12T18:37:30.010645+0000","last_became_active":"2024-09-12T18:36:39.070834+0000","last_became_peered":"2024-09-12T18:36:39.070834+0000","last_unstale":"2024-09-12T18:37:30.010645+0000","last_undegraded":"2024-09-12T18:37:30.010645+0000","last_fullsized":"2024-09-12T18:37:30.010645+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:58.394442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"70'13860","reported_seq":26963,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:28.541323+0000","last_change":"2024-09-12T18:37:17.272272+0000","last_active":"2024-09-12T18:37:28.541323+0000","last_peered":"2024-09-12T18:37:28.541323+0000","last_clean":"2024-09-12T18:37:28.541323+0000","last_became_active":"2024-09-12T18:37:17.229009+0000","last_became_peered":"2024-09-12T18:37:17.229009+0000","last_unstale":"2024-09-12T18:37:28.541323+0000","last_undegraded":"2024-09-12T18:37:28.541323+0000","last_fullsized":"2024-09-12T18:37:28.541323+0000","mapping_epoch":65,"log_start":"59'10628","ondisk_log_start":"59'10628","created":21,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3232,"log_dups_size":0,"ondisk_log_size":3232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:54.939350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183238656,"num_objects":2796,"num_object_clones":0,"num_object_copies":5592,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2796,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13860,"num_write_kb":532992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6490,"num_bytes_recovered":425328640,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":72,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.013614+0000","last_change":"2024-09-12T18:36:40.122885+0000","last_active":"2024-09-12T18:37:30.013614+0000","last_peered":"2024-09-12T18:37:30.013614+0000","last_clean":"2024-09-12T18:37:30.013614+0000","last_became_active":"2024-09-12T18:36:40.090372+0000","last_became_peered":"2024-09-12T18:36:40.090372+0000","last_unstale":"2024-09-12T18:37:30.013614+0000","last_undegraded":"2024-09-12T18:37:30.013614+0000","last_fullsized":"2024-09-12T18:37:30.013614+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:55.648109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":133,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.011787+0000","last_change":"2024-09-12T18:35:22.459767+0000","last_active":"2024-09-12T18:37:30.011787+0000","last_peered":"2024-09-12T18:37:30.011787+0000","last_clean":"2024-09-12T18:37:30.011787+0000","last_became_active":"2024-09-12T18:35:20.448521+0000","last_became_peered":"2024-09-12T18:35:20.448521+0000","last_unstale":"2024-09-12T18:37:30.011787+0000","last_undegraded":"2024-09-12T18:37:30.011787+0000","last_fullsized":"2024-09-12T18:37:30.011787+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:33.463792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017009670000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":115,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.515301+0000","last_change":"2024-09-12T18:35:25.648150+0000","last_active":"2024-09-12T18:37:27.515301+0000","last_peered":"2024-09-12T18:37:27.515301+0000","last_clean":"2024-09-12T18:37:27.515301+0000","last_became_active":"2024-09-12T18:35:25.647347+0000","last_became_peered":"2024-09-12T18:35:25.647347+0000","last_unstale":"2024-09-12T18:37:27.515301+0000","last_undegraded":"2024-09-12T18:37:27.515301+0000","last_fullsized":"2024-09-12T18:37:27.515301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:48.968336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":117,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.014105+0000","last_change":"2024-09-12T18:35:25.660696+0000","last_active":"2024-09-12T18:37:30.014105+0000","last_peered":"2024-09-12T18:37:30.014105+0000","last_clean":"2024-09-12T18:37:30.014105+0000","last_became_active":"2024-09-12T18:35:25.659827+0000","last_became_peered":"2024-09-12T18:35:25.659827+0000","last_unstale":"2024-09-12T18:37:30.014105+0000","last_undegraded":"2024-09-12T18:37:30.014105+0000","last_fullsized":"2024-09-12T18:37:30.014105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:15.678289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":125,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.011389+0000","last_change":"2024-09-12T18:35:24.655051+0000","last_active":"2024-09-12T18:37:30.011389+0000","last_peered":"2024-09-12T18:37:30.011389+0000","last_clean":"2024-09-12T18:37:30.011389+0000","last_became_active":"2024-09-12T18:35:24.654282+0000","last_became_peered":"2024-09-12T18:35:24.654282+0000","last_unstale":"2024-09-12T18:37:30.011389+0000","last_undegraded":"2024-09-12T18:37:30.011389+0000","last_fullsized":"2024-09-12T18:37:30.011389+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:08.159799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":52,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.515312+0000","last_change":"2024-09-12T18:36:40.073370+0000","last_active":"2024-09-12T18:37:27.515312+0000","last_peered":"2024-09-12T18:37:27.515312+0000","last_clean":"2024-09-12T18:37:27.515312+0000","last_became_active":"2024-09-12T18:36:40.071392+0000","last_became_peered":"2024-09-12T18:36:40.071392+0000","last_unstale":"2024-09-12T18:37:27.515312+0000","last_undegraded":"2024-09-12T18:37:27.515312+0000","last_fullsized":"2024-09-12T18:37:27.515312+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:32:33.237004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":120,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.516010+0000","last_change":"2024-09-12T18:35:24.648658+0000","last_active":"2024-09-12T18:37:27.516010+0000","last_peered":"2024-09-12T18:37:27.516010+0000","last_clean":"2024-09-12T18:37:27.516010+0000","last_became_active":"2024-09-12T18:35:24.647826+0000","last_became_peered":"2024-09-12T18:35:24.647826+0000","last_unstale":"2024-09-12T18:37:27.516010+0000","last_undegraded":"2024-09-12T18:37:27.516010+0000","last_fullsized":"2024-09-12T18:37:27.516010+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:24.167549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":125,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.013888+0000","last_change":"2024-09-12T18:36:40.091223+0000","last_active":"2024-09-12T18:37:30.013888+0000","last_peered":"2024-09-12T18:37:30.013888+0000","last_clean":"2024-09-12T18:37:30.013888+0000","last_became_active":"2024-09-12T18:36:40.090813+0000","last_became_peered":"2024-09-12T18:36:40.090813+0000","last_unstale":"2024-09-12T18:37:30.013888+0000","last_undegraded":"2024-09-12T18:37:30.013888+0000","last_fullsized":"2024-09-12T18:37:30.013888+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:26.055034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":117,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.015632+0000","last_change":"2024-09-12T18:35:25.661801+0000","last_active":"2024-09-12T18:37:30.015632+0000","last_peered":"2024-09-12T18:37:30.015632+0000","last_clean":"2024-09-12T18:37:30.015632+0000","last_became_active":"2024-09-12T18:35:25.658476+0000","last_became_peered":"2024-09-12T18:35:25.658476+0000","last_unstale":"2024-09-12T18:37:30.015632+0000","last_undegraded":"2024-09-12T18:37:30.015632+0000","last_fullsized":"2024-09-12T18:37:30.015632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:58.246449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":119,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.016124+0000","last_change":"2024-09-12T18:35:24.652399+0000","last_active":"2024-09-12T18:37:30.016124+0000","last_peered":"2024-09-12T18:37:30.016124+0000","last_clean":"2024-09-12T18:37:30.016124+0000","last_became_active":"2024-09-12T18:35:24.651416+0000","last_became_peered":"2024-09-12T18:35:24.651416+0000","last_unstale":"2024-09-12T18:37:30.016124+0000","last_undegraded":"2024-09-12T18:37:30.016124+0000","last_fullsized":"2024-09-12T18:37:30.016124+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:32.594978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":54,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.515612+0000","last_change":"2024-09-12T18:36:39.073330+0000","last_active":"2024-09-12T18:37:27.515612+0000","last_peered":"2024-09-12T18:37:27.515612+0000","last_clean":"2024-09-12T18:37:27.515612+0000","last_became_active":"2024-09-12T18:36:39.072515+0000","last_became_peered":"2024-09-12T18:36:39.072515+0000","last_unstale":"2024-09-12T18:37:27.515612+0000","last_undegraded":"2024-09-12T18:37:27.515612+0000","last_fullsized":"2024-09-12T18:37:27.515612+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:17.697509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":115,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.517568+0000","last_change":"2024-09-12T18:35:25.651217+0000","last_active":"2024-09-12T18:37:27.517568+0000","last_peered":"2024-09-12T18:37:27.517568+0000","last_clean":"2024-09-12T18:37:27.517568+0000","last_became_active":"2024-09-12T18:35:25.649544+0000","last_became_peered":"2024-09-12T18:35:25.649544+0000","last_unstale":"2024-09-12T18:37:27.517568+0000","last_undegraded":"2024-09-12T18:37:27.517568+0000","last_fullsized":"2024-09-12T18:37:27.517568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:41.601376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":54,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.515077+0000","last_change":"2024-09-12T18:36:39.076239+0000","last_active":"2024-09-12T18:37:27.515077+0000","last_peered":"2024-09-12T18:37:27.515077+0000","last_clean":"2024-09-12T18:37:27.515077+0000","last_became_active":"2024-09-12T18:36:39.075023+0000","last_became_peered":"2024-09-12T18:36:39.075023+0000","last_unstale":"2024-09-12T18:37:27.515077+0000","last_undegraded":"2024-09-12T18:37:27.515077+0000","last_fullsized":"2024-09-12T18:37:27.515077+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:19.618576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":118,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.016265+0000","last_change":"2024-09-12T18:35:25.661544+0000","last_active":"2024-09-12T18:37:30.016265+0000","last_peered":"2024-09-12T18:37:30.016265+0000","last_clean":"2024-09-12T18:37:30.016265+0000","last_became_active":"2024-09-12T18:35:25.656985+0000","last_became_peered":"2024-09-12T18:35:25.656985+0000","last_unstale":"2024-09-12T18:37:30.016265+0000","last_undegraded":"2024-09-12T18:37:30.016265+0000","last_fullsized":"2024-09-12T18:37:30.016265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":56,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.011339+0000","last_change":"2024-09-12T18:36:39.073200+0000","last_active":"2024-09-12T18:37:30.011339+0000","last_peered":"2024-09-12T18:37:30.011339+0000","last_clean":"2024-09-12T18:37:30.011339+0000","last_became_active":"2024-09-12T18:36:39.072553+0000","last_became_peered":"2024-09-12T18:36:39.072553+0000","last_unstale":"2024-09-12T18:37:30.011339+0000","last_undegraded":"2024-09-12T18:37:30.011339+0000","last_fullsized":"2024-09-12T18:37:30.011339+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:02.283482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":115,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.516243+0000","last_change":"2024-09-12T18:35:25.656712+0000","last_active":"2024-09-12T18:37:27.516243+0000","last_peered":"2024-09-12T18:37:27.516243+0000","last_clean":"2024-09-12T18:37:27.516243+0000","last_became_active":"2024-09-12T18:35:25.654473+0000","last_became_peered":"2024-09-12T18:35:25.654473+0000","last_unstale":"2024-09-12T18:37:27.516243+0000","last_undegraded":"2024-09-12T18:37:27.516243+0000","last_fullsized":"2024-09-12T18:37:27.516243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:01.464680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":118,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.518498+0000","last_change":"2024-09-12T18:35:24.659935+0000","last_active":"2024-09-12T18:37:27.518498+0000","last_peered":"2024-09-12T18:37:27.518498+0000","last_clean":"2024-09-12T18:37:27.518498+0000","last_became_active":"2024-09-12T18:35:24.659111+0000","last_became_peered":"2024-09-12T18:35:24.659111+0000","last_unstale":"2024-09-12T18:37:27.518498+0000","last_undegraded":"2024-09-12T18:37:27.518498+0000","last_fullsized":"2024-09-12T18:37:27.518498+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:11.480154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":121,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.517677+0000","last_change":"2024-09-12T18:36:39.076804+0000","last_active":"2024-09-12T18:37:27.517677+0000","last_peered":"2024-09-12T18:37:27.517677+0000","last_clean":"2024-09-12T18:37:27.517677+0000","last_became_active":"2024-09-12T18:36:39.075916+0000","last_became_peered":"2024-09-12T18:36:39.075916+0000","last_unstale":"2024-09-12T18:37:27.517677+0000","last_undegraded":"2024-09-12T18:37:27.517677+0000","last_fullsized":"2024-09-12T18:37:27.517677+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:36.280719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":118,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.515704+0000","last_change":"2024-09-12T18:35:24.638538+0000","last_active":"2024-09-12T18:37:27.515704+0000","last_peered":"2024-09-12T18:37:27.515704+0000","last_clean":"2024-09-12T18:37:27.515704+0000","last_became_active":"2024-09-12T18:35:24.637242+0000","last_became_peered":"2024-09-12T18:35:24.637242+0000","last_unstale":"2024-09-12T18:37:27.515704+0000","last_undegraded":"2024-09-12T18:37:27.515704+0000","last_fullsized":"2024-09-12T18:37:27.515704+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:26.877441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":117,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.014032+0000","last_change":"2024-09-12T18:35:25.662537+0000","last_active":"2024-09-12T18:37:30.014032+0000","last_peered":"2024-09-12T18:37:30.014032+0000","last_clean":"2024-09-12T18:37:30.014032+0000","last_became_active":"2024-09-12T18:35:25.661441+0000","last_became_peered":"2024-09-12T18:35:25.661441+0000","last_unstale":"2024-09-12T18:37:30.014032+0000","last_undegraded":"2024-09-12T18:37:30.014032+0000","last_fullsized":"2024-09-12T18:37:30.014032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:14.397867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":131,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.011322+0000","last_change":"2024-09-12T18:36:39.091935+0000","last_active":"2024-09-12T18:37:30.011322+0000","last_peered":"2024-09-12T18:37:30.011322+0000","last_clean":"2024-09-12T18:37:30.011322+0000","last_became_active":"2024-09-12T18:36:39.071545+0000","last_became_peered":"2024-09-12T18:36:39.071545+0000","last_unstale":"2024-09-12T18:37:30.011322+0000","last_undegraded":"2024-09-12T18:37:30.011322+0000","last_fullsized":"2024-09-12T18:37:30.011322+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:35.815126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":117,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.011826+0000","last_change":"2024-09-12T18:35:25.651406+0000","last_active":"2024-09-12T18:37:30.011826+0000","last_peered":"2024-09-12T18:37:30.011826+0000","last_clean":"2024-09-12T18:37:30.011826+0000","last_became_active":"2024-09-12T18:35:25.649728+0000","last_became_peered":"2024-09-12T18:35:25.649728+0000","last_unstale":"2024-09-12T18:37:30.011826+0000","last_undegraded":"2024-09-12T18:37:30.011826+0000","last_fullsized":"2024-09-12T18:37:30.011826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:41.773283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":119,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.516166+0000","last_change":"2024-09-12T18:35:24.649153+0000","last_active":"2024-09-12T18:37:27.516166+0000","last_peered":"2024-09-12T18:37:27.516166+0000","last_clean":"2024-09-12T18:37:27.516166+0000","last_became_active":"2024-09-12T18:35:24.648512+0000","last_became_peered":"2024-09-12T18:35:24.648512+0000","last_unstale":"2024-09-12T18:37:27.516166+0000","last_undegraded":"2024-09-12T18:37:27.516166+0000","last_fullsized":"2024-09-12T18:37:27.516166+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:07.810456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":115,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-12T18:37:27.515493+0000","last_change":"2024-09-12T18:35:25.656799+0000","last_active":"2024-09-12T18:37:27.515493+0000","last_peered":"2024-09-12T18:37:27.515493+0000","last_clean":"2024-09-12T18:37:27.515493+0000","last_became_active":"2024-09-12T18:35:25.654980+0000","last_became_peered":"2024-09-12T18:35:25.654980+0000","last_unstale":"2024-09-12T18:37:27.515493+0000","last_undegraded":"2024-09-12T18:37:27.515493+0000","last_fullsized":"2024-09-12T18:37:27.515493+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:10.735439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":121,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.016594+0000","last_change":"2024-09-12T18:35:24.656268+0000","last_active":"2024-09-12T18:37:30.016594+0000","last_peered":"2024-09-12T18:37:30.016594+0000","last_clean":"2024-09-12T18:37:30.016594+0000","last_became_active":"2024-09-12T18:35:24.655420+0000","last_became_peered":"2024-09-12T18:35:24.655420+0000","last_unstale":"2024-09-12T18:37:30.016594+0000","last_undegraded":"2024-09-12T18:37:30.016594+0000","last_fullsized":"2024-09-12T18:37:30.016594+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:04.654666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":123,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.010917+0000","last_change":"2024-09-12T18:36:40.154820+0000","last_active":"2024-09-12T18:37:30.010917+0000","last_peered":"2024-09-12T18:37:30.010917+0000","last_clean":"2024-09-12T18:37:30.010917+0000","last_became_active":"2024-09-12T18:36:40.154431+0000","last_became_peered":"2024-09-12T18:36:40.154431+0000","last_unstale":"2024-09-12T18:37:30.010917+0000","last_undegraded":"2024-09-12T18:37:30.010917+0000","last_fullsized":"2024-09-12T18:37:30.010917+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:04.432378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":73,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-12T18:37:30.011620+0000","last_change":"2024-09-12T18:36:39.087685+0000","last_active":"2024-09-12T18:37:30.011620+0000","last_peered":"2024-09-12T18:37:30.011620+0000","last_clean":"2024-09-12T18:37:30.011620+0000","last_became_active":"2024-09-12T18:36:39.071493+0000","last_became_peered":"2024-09-12T18:36:39.071493+0000","last_unstale":"2024-09-12T18:37:30.011620+0000","last_undegraded":"2024-09-12T18:37:30.011620+0000","last_fullsized":"2024-09-12T18:37:30.011620+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:13.765236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":2720071704,"num_objects":41506,"num_object_clones":0,"num_object_copies":83012,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":474,"num_objects_unfound":0,"num_objects_dirty":41506,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":223044,"num_write_kb":8465537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15745,"num_bytes_recovered":1031864320,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":343658496,"data_stored":5498404912,"data_compressed":261159448,"data_compressed_allocated":343650304,"data_compressed_original":5498404864,"omap_allocated":0,"internal_metadata":0},"log_size":62292,"ondisk_log_size":62292,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705694,"num_pgs":94,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":383172,"kb_used_data":122908,"kb_used_omap":1,"kb_used_meta":260222,"kb_avail":93988668,"statfs":{"total":96636764160,"available":96244396032,"internally_reserved":0,"allocated":125857792,"data_stored":2000457744,"data_compressed":95006407,"data_compressed_allocated":125018112,"data_compressed_original":2000142336,"omap_allocated":1594,"internal_metadata":266467782},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738399,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":370316,"kb_used_data":108664,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94001524,"statfs":{"total":96636764160,"available":96257560576,"internally_reserved":0,"allocated":111271936,"data_stored":1766761027,"data_compressed":83909714,"data_compressed_allocated":110411776,"data_compressed_original":1766440960,"omap_allocated":1595,"internal_metadata":267909573},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738399,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":382496,"kb_used_data":108340,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":93989344,"statfs":{"total":96636764160,"available":96245088256,"internally_reserved":0,"allocated":110940160,"data_stored":1762432707,"data_compressed":83697591,"data_compressed_allocated":110133248,"data_compressed_original":1762131968,"omap_allocated":1594,"internal_metadata":280689094},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":109764608,"data_stored":1756233728,"data_compressed":83417511,"data_compressed_allocated":109764608,"data_compressed_original":1756233728,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":123953152,"data_stored":1983184920,"data_compressed":94193705,"data_compressed_allocated":123949056,"data_compressed_original":1983184896,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":109940736,"data_stored":1758986264,"data_compressed":83548232,"data_compressed_allocated":109936640,"data_compressed_original":1758986240,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:37:32.728 INFO:tasks.thrashosds.thrasher:Setting 2.6 to [2, 0] 2024-09-12T18:37:32.728 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '2.6', '2', '0'] 2024-09-12T18:37:32.728 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 2.6 2 0 2024-09-12T18:37:32.817 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:32.812+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:32.880 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:32.881 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:37:32.881 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.881 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:228457 5.2 5:4cc37dff:::benchmark_data_smithi073_23739_object96180:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T18:37:32.881 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:32.876627+0000", 2024-09-12T18:37:32.881 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0018563029999999999, 2024-09-12T18:37:32.881 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001873385, 2024-09-12T18:37:32.881 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:32.881 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:32.881 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:32.882 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:32.882 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:32.882 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:32.882 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 228457 2024-09-12T18:37:32.882 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.882 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:32.882 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.882 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:32.882 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.876627+0000", 2024-09-12T18:37:32.882 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:32.882 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.882 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.882 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:32.882 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.876627+0000", 2024-09-12T18:37:32.883 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:32.883 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.883 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.883 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:32.883 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.876627+0000", 2024-09-12T18:37:32.883 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.51e-07 2024-09-12T18:37:32.883 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.883 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.883 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:32.883 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.876629+0000", 2024-09-12T18:37:32.883 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2299999999999998e-06 2024-09-12T18:37:32.883 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.883 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.884 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:32.884 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.876635+0000", 2024-09-12T18:37:32.884 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.7860000000000002e-06 2024-09-12T18:37:32.884 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.884 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.884 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:32.884 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.876639+0000", 2024-09-12T18:37:32.884 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5370000000000002e-06 2024-09-12T18:37:32.884 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.884 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.884 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:32.885 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.876675+0000", 2024-09-12T18:37:32.885 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.6458999999999998e-05 2024-09-12T18:37:32.885 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.885 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.885 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:32.885 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.876758+0000", 2024-09-12T18:37:32.885 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.2495000000000002e-05 2024-09-12T18:37:32.885 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.885 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.885 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:32.885 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.876866+0000", 2024-09-12T18:37:32.886 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000108349 2024-09-12T18:37:32.886 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:32.886 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:32.886 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:32.886 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.886 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.886 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:228458 5.7 5:e014d5eb:::benchmark_data_smithi073_23739_object96181:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T18:37:32.886 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:32.876797+0000", 2024-09-12T18:37:32.886 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0016856079999999999, 2024-09-12T18:37:32.886 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001767551, 2024-09-12T18:37:32.886 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:32.886 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:32.886 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:32.887 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:32.887 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:32.887 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:32.887 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 228458 2024-09-12T18:37:32.887 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.887 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:32.887 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.887 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:32.887 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.876797+0000", 2024-09-12T18:37:32.887 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:32.887 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.887 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.888 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:32.888 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.876797+0000", 2024-09-12T18:37:32.888 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:32.888 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.888 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.888 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:32.888 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.876798+0000", 2024-09-12T18:37:32.888 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.09e-07 2024-09-12T18:37:32.888 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.888 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.888 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:32.888 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.876802+0000", 2024-09-12T18:37:32.889 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.8349999999999997e-06 2024-09-12T18:37:32.889 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.889 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.889 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:32.889 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.876810+0000", 2024-09-12T18:37:32.889 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1960000000000008e-06 2024-09-12T18:37:32.889 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.889 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.889 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:32.889 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.876816+0000", 2024-09-12T18:37:32.889 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.8880000000000002e-06 2024-09-12T18:37:32.889 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.890 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.890 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:32.890 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.876875+0000", 2024-09-12T18:37:32.890 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.8739999999999997e-05 2024-09-12T18:37:32.890 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.890 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.890 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:32.890 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.876994+0000", 2024-09-12T18:37:32.890 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000118981 2024-09-12T18:37:32.890 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.891 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.891 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:32.891 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.877090+0000", 2024-09-12T18:37:32.891 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.6644000000000005e-05 2024-09-12T18:37:32.891 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:32.891 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:32.891 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:32.891 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.891 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.891 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:228446 5.6 e71/21 5:6ac4108b:::benchmark_data_smithi073_23739_object96169:head v 71'14334, mlcod=71'14331)", 2024-09-12T18:37:32.892 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:32.871972+0000", 2024-09-12T18:37:32.892 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0065112690000000001, 2024-09-12T18:37:32.892 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.006661068, 2024-09-12T18:37:32.892 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:32.892 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:32.892 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:37:32.892 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:32.892 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.892 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:32.892 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.871972+0000", 2024-09-12T18:37:32.893 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:32.893 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.893 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.893 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:32.893 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.871972+0000", 2024-09-12T18:37:32.893 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:32.893 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.893 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.893 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:32.893 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.871972+0000", 2024-09-12T18:37:32.893 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.6599999999999996e-07 2024-09-12T18:37:32.893 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.894 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.894 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:32.894 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.871977+0000", 2024-09-12T18:37:32.894 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1109999999999999e-06 2024-09-12T18:37:32.894 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.894 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.894 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:32.894 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.871987+0000", 2024-09-12T18:37:32.894 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0030999999999999e-05 2024-09-12T18:37:32.894 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.894 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.895 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:32.895 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.871993+0000", 2024-09-12T18:37:32.895 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.0469999999999999e-06 2024-09-12T18:37:32.895 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.895 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.895 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:32.895 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.872041+0000", 2024-09-12T18:37:32.895 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8016999999999998e-05 2024-09-12T18:37:32.895 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.896 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.896 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:32.896 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.872061+0000", 2024-09-12T18:37:32.896 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.942e-05 2024-09-12T18:37:32.896 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:32.896 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:32.896 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:32.896 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.897 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.897 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:228452 5.6 e71/21 5:663e8031:::benchmark_data_smithi073_23739_object96175:head v 71'14335, mlcod=71'14332)", 2024-09-12T18:37:32.897 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:32.875939+0000", 2024-09-12T18:37:32.897 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0025440419999999998, 2024-09-12T18:37:32.897 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0027449649999999998, 2024-09-12T18:37:32.897 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:32.897 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:32.897 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:37:32.897 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:32.897 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.898 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:32.898 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.875939+0000", 2024-09-12T18:37:32.898 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:32.898 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.898 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.898 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:32.898 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.875939+0000", 2024-09-12T18:37:32.898 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:32.898 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.898 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.898 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:32.898 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.875939+0000", 2024-09-12T18:37:32.898 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.9900000000000001e-07 2024-09-12T18:37:32.899 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.899 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.899 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:32.899 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.875947+0000", 2024-09-12T18:37:32.899 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8970000000000008e-06 2024-09-12T18:37:32.899 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.899 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.899 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:32.899 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.875956+0000", 2024-09-12T18:37:32.899 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.7660000000000004e-06 2024-09-12T18:37:32.899 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.900 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.900 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:32.900 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.875962+0000", 2024-09-12T18:37:32.900 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.1319999999999999e-06 2024-09-12T18:37:32.900 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.900 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.900 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:32.900 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.876029+0000", 2024-09-12T18:37:32.900 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.7041999999999999e-05 2024-09-12T18:37:32.900 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.900 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.900 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:32.900 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.876047+0000", 2024-09-12T18:37:32.901 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7249999999999999e-05 2024-09-12T18:37:32.901 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:32.901 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:32.901 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:32.901 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.901 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.901 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:228453 5.1 5:808a84de:::benchmark_data_smithi073_23739_object96176:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T18:37:32.901 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:32.876000+0000", 2024-09-12T18:37:32.901 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0024826470000000002, 2024-09-12T18:37:32.901 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0027146499999999999, 2024-09-12T18:37:32.901 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:32.902 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:32.902 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:32.902 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:32.902 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:32.902 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:32.902 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 228453 2024-09-12T18:37:32.902 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.902 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:32.902 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.902 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:32.902 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.876000+0000", 2024-09-12T18:37:32.902 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:32.902 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.902 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.903 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:32.903 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.876000+0000", 2024-09-12T18:37:32.903 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:32.903 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.903 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.903 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:32.903 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.876002+0000", 2024-09-12T18:37:32.903 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.302e-06 2024-09-12T18:37:32.903 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.903 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.903 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:32.903 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.876007+0000", 2024-09-12T18:37:32.903 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.378e-06 2024-09-12T18:37:32.903 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.904 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.904 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:32.904 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.876017+0000", 2024-09-12T18:37:32.904 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.6889999999999999e-06 2024-09-12T18:37:32.904 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.904 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.904 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:32.904 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.876023+0000", 2024-09-12T18:37:32.904 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.5860000000000001e-06 2024-09-12T18:37:32.904 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.904 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.904 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:32.905 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.876072+0000", 2024-09-12T18:37:32.905 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8621000000000001e-05 2024-09-12T18:37:32.905 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.905 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.905 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:32.905 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.876207+0000", 2024-09-12T18:37:32.905 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000135127 2024-09-12T18:37:32.906 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.906 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.906 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:32.906 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.876346+0000", 2024-09-12T18:37:32.906 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000139269 2024-09-12T18:37:32.906 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.906 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.906 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:32.906 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.878410+0000", 2024-09-12T18:37:32.906 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0020639410000000001 2024-09-12T18:37:32.906 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:32.906 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:32.906 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:32.907 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.907 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.907 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:228455 5.5 5:a61d77bd:::benchmark_data_smithi073_23739_object96178:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T18:37:32.907 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:32.876501+0000", 2024-09-12T18:37:32.907 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0019820409999999999, 2024-09-12T18:37:32.907 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.002264584, 2024-09-12T18:37:32.907 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:32.907 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:32.907 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:32.907 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:32.908 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:32.908 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:32.908 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 228455 2024-09-12T18:37:32.908 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.908 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:32.908 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.908 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:32.908 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.876501+0000", 2024-09-12T18:37:32.908 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:32.908 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.908 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.908 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:32.908 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.876501+0000", 2024-09-12T18:37:32.909 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:32.909 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.909 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.909 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:32.909 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.876502+0000", 2024-09-12T18:37:32.909 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.3399999999999998e-07 2024-09-12T18:37:32.909 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.909 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.909 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:32.909 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.876505+0000", 2024-09-12T18:37:32.912 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5760000000000002e-06 2024-09-12T18:37:32.913 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.913 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.913 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:32.913 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.876512+0000", 2024-09-12T18:37:32.913 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.1119999999999998e-06 2024-09-12T18:37:32.913 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.914 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.914 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:32.914 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.876517+0000", 2024-09-12T18:37:32.914 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.7770000000000002e-06 2024-09-12T18:37:32.914 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.914 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.914 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:32.915 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.877219+0000", 2024-09-12T18:37:32.915 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00070201699999999998 2024-09-12T18:37:32.915 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.915 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.915 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:32.915 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.877344+0000", 2024-09-12T18:37:32.915 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000124876 2024-09-12T18:37:32.916 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:32.916 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:32.916 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:32.916 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:32.877543+0000", 2024-09-12T18:37:32.916 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000199089 2024-09-12T18:37:32.916 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:32.916 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:32.917 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:32.917 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:32.917 INFO:teuthology.orchestra.run.smithi162.stdout: ], 2024-09-12T18:37:32.917 INFO:teuthology.orchestra.run.smithi162.stdout: "num_ops": 6 2024-09-12T18:37:32.917 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:32.920 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:37:32.920 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:32.910+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:33.019 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:33.014+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:33.067 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:33.067 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [], 2024-09-12T18:37:33.068 INFO:teuthology.orchestra.run.smithi162.stdout: "complaint_time": 30, 2024-09-12T18:37:33.068 INFO:teuthology.orchestra.run.smithi162.stdout: "num_blocked_ops": 0 2024-09-12T18:37:33.068 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:33.086 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:37:33.122 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:33.114+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:33.223 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:33.214+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:33.242 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:33.242 INFO:teuthology.orchestra.run.smithi162.stdout: "size": 20, 2024-09-12T18:37:33.242 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 600, 2024-09-12T18:37:33.242 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:37:33.242 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.242 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167364 5.7 5:ee50096a:::benchmark_data_smithi073_23739_object35087:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:33.243 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.168715+0000", 2024-09-12T18:37:33.243 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 30.068352087000001, 2024-09-12T18:37:33.243 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.068831153000000006, 2024-09-12T18:37:33.243 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:33.243 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:33.243 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:33.243 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:33.243 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:33.244 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:33.244 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167364 2024-09-12T18:37:33.244 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.244 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:33.244 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.244 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:33.244 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168715+0000", 2024-09-12T18:37:33.244 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:33.244 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.244 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.245 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:33.245 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168715+0000", 2024-09-12T18:37:33.245 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:33.245 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.245 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.245 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:33.245 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168716+0000", 2024-09-12T18:37:33.245 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0559999999999999e-06 2024-09-12T18:37:33.245 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.245 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.245 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:33.245 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168721+0000", 2024-09-12T18:37:33.245 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8019999999999999e-06 2024-09-12T18:37:33.245 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.246 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.246 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:33.246 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168731+0000", 2024-09-12T18:37:33.246 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0315e-05 2024-09-12T18:37:33.246 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.246 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.246 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:33.246 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168738+0000", 2024-09-12T18:37:33.246 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.126e-06 2024-09-12T18:37:33.246 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.246 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.246 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:33.246 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168782+0000", 2024-09-12T18:37:33.246 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.3924000000000002e-05 2024-09-12T18:37:33.246 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.247 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.247 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:33.247 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168913+0000", 2024-09-12T18:37:33.247 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000131154 2024-09-12T18:37:33.247 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.247 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.247 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:33.247 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169026+0000", 2024-09-12T18:37:33.247 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011223299999999999 2024-09-12T18:37:33.247 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.247 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.247 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:33.247 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.175404+0000", 2024-09-12T18:37:33.247 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0063780319999999996 2024-09-12T18:37:33.248 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.248 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.248 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:33.248 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237446+0000", 2024-09-12T18:37:33.248 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.062042238 2024-09-12T18:37:33.248 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.248 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.248 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:33.248 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237501+0000", 2024-09-12T18:37:33.248 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4913000000000001e-05 2024-09-12T18:37:33.248 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.248 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.248 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:33.249 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237546+0000", 2024-09-12T18:37:33.249 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.5359999999999999e-05 2024-09-12T18:37:33.249 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:33.249 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:33.249 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:33.249 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.249 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.249 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167365 5.2 5:4107875c:::benchmark_data_smithi073_23739_object35088:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:33.249 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:33.249 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 30.068302512999999, 2024-09-12T18:37:33.250 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.078544438999999994, 2024-09-12T18:37:33.250 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:33.250 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:33.250 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:33.250 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:33.250 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:33.250 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:33.251 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167365 2024-09-12T18:37:33.251 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.251 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:33.251 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.251 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:33.251 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:33.251 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:33.251 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.251 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.251 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:33.251 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:33.251 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:33.251 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.251 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.252 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:33.252 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:33.252 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.4700000000000001e-07 2024-09-12T18:37:33.252 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.252 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.252 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:33.252 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168769+0000", 2024-09-12T18:37:33.252 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.4170000000000001e-06 2024-09-12T18:37:33.252 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.252 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.252 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:33.253 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168777+0000", 2024-09-12T18:37:33.253 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1499999999999999e-06 2024-09-12T18:37:33.253 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.253 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.253 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:33.253 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168783+0000", 2024-09-12T18:37:33.253 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.0460000000000002e-06 2024-09-12T18:37:33.253 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.253 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.253 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:33.253 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168865+0000", 2024-09-12T18:37:33.253 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1953999999999995e-05 2024-09-12T18:37:33.253 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.254 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.254 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:33.254 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169003+0000", 2024-09-12T18:37:33.254 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013798200000000001 2024-09-12T18:37:33.254 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.254 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.254 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:33.254 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169065+0000", 2024-09-12T18:37:33.254 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2218000000000006e-05 2024-09-12T18:37:33.254 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.254 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.254 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:33.255 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174771+0000", 2024-09-12T18:37:33.255 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0057054819999999996 2024-09-12T18:37:33.255 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.255 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.255 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:33.255 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.247234+0000", 2024-09-12T18:37:33.255 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.072463391000000002 2024-09-12T18:37:33.255 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.255 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.255 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:33.255 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.247273+0000", 2024-09-12T18:37:33.256 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.9069000000000002e-05 2024-09-12T18:37:33.256 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.256 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.256 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:33.256 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.247309+0000", 2024-09-12T18:37:33.256 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5982999999999998e-05 2024-09-12T18:37:33.256 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:33.256 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:33.256 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:33.256 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.256 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.256 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167369 5.7 5:e64ecabd:::benchmark_data_smithi073_23739_object35092:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:33.256 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.169042+0000", 2024-09-12T18:37:33.257 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 30.068025402, 2024-09-12T18:37:33.257 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.069229188999999997, 2024-09-12T18:37:33.257 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:33.257 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:33.257 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:33.257 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:33.257 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:33.257 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:33.257 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167369 2024-09-12T18:37:33.257 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.257 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:33.257 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.257 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:33.258 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169042+0000", 2024-09-12T18:37:33.258 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:33.258 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.258 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.258 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:33.258 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169042+0000", 2024-09-12T18:37:33.258 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:33.258 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.258 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.258 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:33.258 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169043+0000", 2024-09-12T18:37:33.258 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.9400000000000004e-07 2024-09-12T18:37:33.258 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.258 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.259 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:33.259 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169048+0000", 2024-09-12T18:37:33.259 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8420000000000004e-06 2024-09-12T18:37:33.259 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.259 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.259 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:33.259 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169055+0000", 2024-09-12T18:37:33.259 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.7989999999999994e-06 2024-09-12T18:37:33.259 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.259 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.259 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:33.259 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169062+0000", 2024-09-12T18:37:33.259 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.5950000000000004e-06 2024-09-12T18:37:33.260 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.260 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.260 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:33.260 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173858+0000", 2024-09-12T18:37:33.260 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0047959259999999998 2024-09-12T18:37:33.260 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.260 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.260 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:33.260 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173966+0000", 2024-09-12T18:37:33.260 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000107941 2024-09-12T18:37:33.260 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.260 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.260 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:33.260 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174043+0000", 2024-09-12T18:37:33.261 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.7360000000000005e-05 2024-09-12T18:37:33.261 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.261 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.261 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:33.261 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.175711+0000", 2024-09-12T18:37:33.261 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0016680810000000001 2024-09-12T18:37:33.261 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.261 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.261 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:33.261 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.238163+0000", 2024-09-12T18:37:33.261 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.062451523000000002 2024-09-12T18:37:33.261 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.261 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.261 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:33.262 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.238222+0000", 2024-09-12T18:37:33.262 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9723999999999999e-05 2024-09-12T18:37:33.262 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.262 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.262 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:33.262 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.238271+0000", 2024-09-12T18:37:33.262 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8504000000000002e-05 2024-09-12T18:37:33.262 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:33.262 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:33.262 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:33.262 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.262 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.262 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167373 5.5 5:ad283029:::benchmark_data_smithi073_23739_object35096:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:33.262 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:33.263 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 30.065520571, 2024-09-12T18:37:33.263 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.066200976999999994, 2024-09-12T18:37:33.263 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:33.263 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:33.263 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:33.263 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:33.263 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:33.263 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:33.263 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167373 2024-09-12T18:37:33.263 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.263 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:33.263 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.263 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:33.264 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:33.264 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:33.264 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.264 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.264 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:33.264 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:33.264 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:33.264 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.264 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.264 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:33.264 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:33.264 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4900000000000005e-07 2024-09-12T18:37:33.264 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.265 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.265 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:33.265 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171551+0000", 2024-09-12T18:37:33.265 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.7519999999999998e-06 2024-09-12T18:37:33.265 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.265 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.265 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:33.265 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171562+0000", 2024-09-12T18:37:33.265 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0353000000000001e-05 2024-09-12T18:37:33.265 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.265 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.265 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:33.265 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171566+0000", 2024-09-12T18:37:33.266 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8269999999999997e-06 2024-09-12T18:37:33.266 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.266 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.266 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:33.266 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171622+0000", 2024-09-12T18:37:33.266 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5220999999999999e-05 2024-09-12T18:37:33.266 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.266 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.266 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:33.266 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171719+0000", 2024-09-12T18:37:33.266 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7238999999999995e-05 2024-09-12T18:37:33.267 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.267 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.267 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:33.267 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171802+0000", 2024-09-12T18:37:33.267 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.3285e-05 2024-09-12T18:37:33.267 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.267 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.267 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:33.267 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174608+0000", 2024-09-12T18:37:33.267 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028054590000000002 2024-09-12T18:37:33.267 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.267 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.267 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:33.268 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174762+0000", 2024-09-12T18:37:33.268 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015465100000000001 2024-09-12T18:37:33.268 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.268 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.268 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:33.268 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237474+0000", 2024-09-12T18:37:33.268 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.062711683000000004 2024-09-12T18:37:33.268 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.268 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.268 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:33.268 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237540+0000", 2024-09-12T18:37:33.268 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.6132999999999999e-05 2024-09-12T18:37:33.268 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.269 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.269 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:33.269 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237748+0000", 2024-09-12T18:37:33.269 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020752499999999999 2024-09-12T18:37:33.269 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:33.269 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:33.269 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:33.269 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.269 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.269 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167374 5.1 5:81e25826:::benchmark_data_smithi073_23739_object35097:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:33.269 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.173748+0000", 2024-09-12T18:37:33.269 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 30.063319122999999, 2024-09-12T18:37:33.269 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.069225245000000005, 2024-09-12T18:37:33.270 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:33.270 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:33.270 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:33.270 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:33.270 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:33.270 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:33.270 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167374 2024-09-12T18:37:33.270 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.270 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:33.270 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.270 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:33.270 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173748+0000", 2024-09-12T18:37:33.271 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:33.271 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.271 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.271 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:33.271 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173748+0000", 2024-09-12T18:37:33.271 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:33.271 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.271 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.271 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:33.271 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173749+0000", 2024-09-12T18:37:33.271 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.418e-06 2024-09-12T18:37:33.271 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.271 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.272 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:33.272 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173755+0000", 2024-09-12T18:37:33.272 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.0730000000000004e-06 2024-09-12T18:37:33.272 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.272 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.272 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:33.272 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173768+0000", 2024-09-12T18:37:33.272 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3644e-05 2024-09-12T18:37:33.272 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.272 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.272 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:33.272 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173777+0000", 2024-09-12T18:37:33.273 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4160000000000004e-06 2024-09-12T18:37:33.273 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.273 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.273 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:33.273 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173927+0000", 2024-09-12T18:37:33.273 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015065900000000001 2024-09-12T18:37:33.273 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.273 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.273 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:33.273 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174052+0000", 2024-09-12T18:37:33.273 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012460699999999999 2024-09-12T18:37:33.273 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.273 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.274 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:33.274 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174181+0000", 2024-09-12T18:37:33.274 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012919299999999999 2024-09-12T18:37:33.274 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.274 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.274 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:33.274 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.178108+0000", 2024-09-12T18:37:33.274 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0039273210000000001 2024-09-12T18:37:33.274 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.274 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.274 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:33.275 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.178118+0000", 2024-09-12T18:37:33.275 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7550000000000006e-06 2024-09-12T18:37:33.275 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.275 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.275 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:33.275 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.242865+0000", 2024-09-12T18:37:33.275 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.064746597000000003 2024-09-12T18:37:33.275 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.275 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.275 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:33.275 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.242903+0000", 2024-09-12T18:37:33.275 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.8268e-05 2024-09-12T18:37:33.275 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.276 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.276 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:33.276 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.242973+0000", 2024-09-12T18:37:33.276 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0294000000000002e-05 2024-09-12T18:37:33.276 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:33.276 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:33.276 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:33.276 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.276 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.276 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167375 5.1 5:83a09102:::benchmark_data_smithi073_23739_object35098:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:33.276 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:33.276 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 30.063267576000001, 2024-09-12T18:37:33.276 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.069437463000000005, 2024-09-12T18:37:33.277 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:33.277 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:33.277 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:33.277 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:33.277 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:33.277 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:33.277 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167375 2024-09-12T18:37:33.277 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.277 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:33.277 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.277 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:33.277 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:33.278 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:33.278 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.278 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.278 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:33.278 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:33.278 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:33.278 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.279 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.279 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:33.279 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:33.279 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1399999999999997e-07 2024-09-12T18:37:33.279 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.279 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.279 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:33.279 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173803+0000", 2024-09-12T18:37:33.279 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.7860000000000001e-06 2024-09-12T18:37:33.279 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.279 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.279 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:33.279 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173811+0000", 2024-09-12T18:37:33.280 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4610000000000008e-06 2024-09-12T18:37:33.280 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.280 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.280 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:33.280 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173817+0000", 2024-09-12T18:37:33.280 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3569999999999997e-06 2024-09-12T18:37:33.280 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.280 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.280 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:33.280 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.176070+0000", 2024-09-12T18:37:33.280 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.002253405 2024-09-12T18:37:33.280 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.280 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.281 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:33.281 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.176263+0000", 2024-09-12T18:37:33.281 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000192583 2024-09-12T18:37:33.281 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.281 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.281 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:33.281 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.176429+0000", 2024-09-12T18:37:33.281 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00016626 2024-09-12T18:37:33.282 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.282 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.282 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:33.282 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.178154+0000", 2024-09-12T18:37:33.282 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0017247009999999999 2024-09-12T18:37:33.282 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.282 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.282 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:33.283 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.182110+0000", 2024-09-12T18:37:33.283 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0039568229999999999 2024-09-12T18:37:33.283 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.283 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.283 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:33.283 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.243024+0000", 2024-09-12T18:37:33.283 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.060913249000000003 2024-09-12T18:37:33.283 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.283 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.284 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:33.284 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.243107+0000", 2024-09-12T18:37:33.284 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.3090000000000006e-05 2024-09-12T18:37:33.284 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.284 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.284 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:33.284 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.243237+0000", 2024-09-12T18:37:33.284 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013023399999999999 2024-09-12T18:37:33.284 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:33.284 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:33.284 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:33.284 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.284 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.285 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201515 5.5 5:a25bd8bb:::benchmark_data_smithi073_23739_object69238:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:33.285 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.437024+0000", 2024-09-12T18:37:33.285 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 12.800043344000001, 2024-09-12T18:37:33.285 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.040476102, 2024-09-12T18:37:33.285 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:33.285 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:33.285 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:33.285 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:33.285 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:33.285 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:33.285 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201515 2024-09-12T18:37:33.285 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.285 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:33.285 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.286 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:33.286 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437024+0000", 2024-09-12T18:37:33.286 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:33.286 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.286 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.286 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:33.286 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437024+0000", 2024-09-12T18:37:33.286 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:33.286 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.286 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.286 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:33.286 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437025+0000", 2024-09-12T18:37:33.286 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2240000000000001e-06 2024-09-12T18:37:33.286 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.287 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.287 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:33.287 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437030+0000", 2024-09-12T18:37:33.287 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.7049999999999998e-06 2024-09-12T18:37:33.287 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.287 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.287 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:33.287 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437040+0000", 2024-09-12T18:37:33.287 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0351e-05 2024-09-12T18:37:33.287 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.287 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.287 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:33.287 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437049+0000", 2024-09-12T18:37:33.287 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5750000000000001e-06 2024-09-12T18:37:33.288 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.288 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.288 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:33.288 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437574+0000", 2024-09-12T18:37:33.288 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00052566400000000001 2024-09-12T18:37:33.288 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.288 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.288 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:33.288 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437673+0000", 2024-09-12T18:37:33.288 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.8672000000000007e-05 2024-09-12T18:37:33.288 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.288 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.288 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:33.288 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437755+0000", 2024-09-12T18:37:33.289 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1705000000000005e-05 2024-09-12T18:37:33.289 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.289 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.289 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:33.289 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.439556+0000", 2024-09-12T18:37:33.289 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0018009020000000001 2024-09-12T18:37:33.289 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.289 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.289 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:33.289 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.439955+0000", 2024-09-12T18:37:33.289 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00039966900000000001 2024-09-12T18:37:33.289 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.289 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.289 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:33.290 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.477267+0000", 2024-09-12T18:37:33.290 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.037311614 2024-09-12T18:37:33.290 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.290 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.290 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:33.290 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.477368+0000", 2024-09-12T18:37:33.290 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000101495 2024-09-12T18:37:33.290 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.290 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.290 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:33.290 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.477500+0000", 2024-09-12T18:37:33.290 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000131526 2024-09-12T18:37:33.290 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:33.291 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:33.291 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:33.291 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.291 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.291 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201566 5.9 5:9ea8bdd3:::benchmark_data_smithi073_23739_object69289:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:33.291 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.487311+0000", 2024-09-12T18:37:33.291 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 12.749755797000001, 2024-09-12T18:37:33.291 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.044734547, 2024-09-12T18:37:33.291 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:33.291 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:33.291 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:33.291 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:33.292 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:33.292 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:33.292 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201566 2024-09-12T18:37:33.292 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.292 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:33.292 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.292 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:33.292 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487311+0000", 2024-09-12T18:37:33.292 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:33.292 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.292 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.292 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:33.292 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487311+0000", 2024-09-12T18:37:33.293 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:33.293 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.293 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.293 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:33.293 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487313+0000", 2024-09-12T18:37:33.293 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3060000000000001e-06 2024-09-12T18:37:33.293 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.293 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.293 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:33.293 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487318+0000", 2024-09-12T18:37:33.293 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.181e-06 2024-09-12T18:37:33.293 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.293 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.294 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:33.294 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487333+0000", 2024-09-12T18:37:33.294 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5012e-05 2024-09-12T18:37:33.294 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.294 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.294 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:33.294 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487344+0000", 2024-09-12T18:37:33.294 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0733999999999999e-05 2024-09-12T18:37:33.294 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.294 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.294 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:33.294 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487403+0000", 2024-09-12T18:37:33.294 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9858999999999997e-05 2024-09-12T18:37:33.295 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.295 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.295 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:33.295 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487600+0000", 2024-09-12T18:37:33.295 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019617899999999999 2024-09-12T18:37:33.295 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.295 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.295 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:33.295 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487769+0000", 2024-09-12T18:37:33.295 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00016919299999999999 2024-09-12T18:37:33.295 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.295 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.296 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:33.296 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492984+0000", 2024-09-12T18:37:33.296 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0052155309999999998 2024-09-12T18:37:33.296 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.296 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.296 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:33.296 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531791+0000", 2024-09-12T18:37:33.296 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.038806861999999998 2024-09-12T18:37:33.296 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.296 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.296 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:33.296 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531946+0000", 2024-09-12T18:37:33.296 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015445300000000001 2024-09-12T18:37:33.296 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.297 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.297 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:33.297 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532046+0000", 2024-09-12T18:37:33.297 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000100237 2024-09-12T18:37:33.297 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:33.297 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:33.297 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:33.297 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.297 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.297 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201569 5.9 5:9719244e:::benchmark_data_smithi073_23739_object69292:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:33.297 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.487551+0000", 2024-09-12T18:37:33.298 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 12.749516437, 2024-09-12T18:37:33.298 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.045212927, 2024-09-12T18:37:33.298 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:33.298 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:33.298 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:33.298 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:33.298 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:33.298 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:33.299 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201569 2024-09-12T18:37:33.299 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.299 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:33.299 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.299 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:33.299 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487551+0000", 2024-09-12T18:37:33.299 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:33.299 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.299 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.299 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:33.300 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487551+0000", 2024-09-12T18:37:33.300 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:33.300 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.300 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.300 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:33.300 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487552+0000", 2024-09-12T18:37:33.300 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6160000000000001e-06 2024-09-12T18:37:33.300 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.301 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.301 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:33.301 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487566+0000", 2024-09-12T18:37:33.301 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.344e-05 2024-09-12T18:37:33.301 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.301 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.301 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:33.301 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487581+0000", 2024-09-12T18:37:33.302 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5526e-05 2024-09-12T18:37:33.302 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.302 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.302 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:33.302 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487593+0000", 2024-09-12T18:37:33.302 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1443e-05 2024-09-12T18:37:33.302 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.302 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.302 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:33.302 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.489599+0000", 2024-09-12T18:37:33.302 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0020058960000000001 2024-09-12T18:37:33.302 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.302 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.303 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:33.303 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.489710+0000", 2024-09-12T18:37:33.303 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000111634 2024-09-12T18:37:33.303 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.303 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.303 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:33.303 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.489796+0000", 2024-09-12T18:37:33.303 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5235999999999995e-05 2024-09-12T18:37:33.303 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.303 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.303 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:33.303 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532140+0000", 2024-09-12T18:37:33.303 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.042344524000000001 2024-09-12T18:37:33.304 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.304 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.304 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:33.304 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532559+0000", 2024-09-12T18:37:33.304 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00041908800000000002 2024-09-12T18:37:33.304 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.304 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.304 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:33.304 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532676+0000", 2024-09-12T18:37:33.304 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011649100000000001 2024-09-12T18:37:33.304 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.304 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.304 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:33.305 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532764+0000", 2024-09-12T18:37:33.305 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8033000000000002e-05 2024-09-12T18:37:33.305 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:33.305 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:33.305 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:33.305 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.305 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.305 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201570 5.5 5:a97bff67:::benchmark_data_smithi073_23739_object69293:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:33.305 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.487618+0000", 2024-09-12T18:37:33.305 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 12.749448852, 2024-09-12T18:37:33.305 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.049152553000000002, 2024-09-12T18:37:33.305 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:33.305 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:33.306 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:33.306 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:33.306 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:33.306 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:33.306 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201570 2024-09-12T18:37:33.306 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.306 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:33.306 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.306 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:33.306 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487618+0000", 2024-09-12T18:37:33.306 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:33.306 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.306 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.306 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:33.307 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487618+0000", 2024-09-12T18:37:33.307 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:33.307 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.307 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.307 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:33.307 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487619+0000", 2024-09-12T18:37:33.307 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.6099999999999999e-07 2024-09-12T18:37:33.307 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.307 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.307 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:33.307 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487623+0000", 2024-09-12T18:37:33.307 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.0940000000000001e-06 2024-09-12T18:37:33.307 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.307 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.308 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:33.308 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487635+0000", 2024-09-12T18:37:33.308 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1348e-05 2024-09-12T18:37:33.308 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.308 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.308 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:33.308 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487657+0000", 2024-09-12T18:37:33.308 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2246999999999999e-05 2024-09-12T18:37:33.308 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.308 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.308 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:33.308 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490684+0000", 2024-09-12T18:37:33.308 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0030268339999999999 2024-09-12T18:37:33.309 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.309 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.309 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:33.309 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490797+0000", 2024-09-12T18:37:33.309 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011372200000000001 2024-09-12T18:37:33.309 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.309 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.309 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:33.309 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490909+0000", 2024-09-12T18:37:33.309 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000111239 2024-09-12T18:37:33.309 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.309 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.309 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:33.310 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534345+0000", 2024-09-12T18:37:33.310 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.043436648000000001 2024-09-12T18:37:33.310 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.310 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.310 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:33.310 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534711+0000", 2024-09-12T18:37:33.310 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00036576399999999998 2024-09-12T18:37:33.310 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.310 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.310 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:33.310 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536225+0000", 2024-09-12T18:37:33.310 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001513983 2024-09-12T18:37:33.310 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.310 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.310 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:33.311 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536331+0000", 2024-09-12T18:37:33.311 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010603300000000001 2024-09-12T18:37:33.311 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.311 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.311 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:33.311 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536771+0000", 2024-09-12T18:37:33.311 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00043978000000000002 2024-09-12T18:37:33.311 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:33.311 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:33.311 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:33.311 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.311 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.311 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:201572 5.3 e67/21 5:caf692c5:::benchmark_data_smithi073_23739_object69295:head v 67'12362, mlcod=67'12360)", 2024-09-12T18:37:33.312 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.490255+0000", 2024-09-12T18:37:33.312 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 12.746812351999999, 2024-09-12T18:37:33.312 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.044189501999999999, 2024-09-12T18:37:33.312 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:33.312 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:33.312 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:33.312 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:33.312 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.312 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:33.312 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490255+0000", 2024-09-12T18:37:33.312 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:33.312 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.312 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.313 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:33.313 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490255+0000", 2024-09-12T18:37:33.313 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:33.313 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.313 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.313 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:33.313 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490256+0000", 2024-09-12T18:37:33.313 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0500000000000003e-07 2024-09-12T18:37:33.313 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.313 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.313 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:33.313 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490260+0000", 2024-09-12T18:37:33.313 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8269999999999997e-06 2024-09-12T18:37:33.314 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.314 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.314 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:33.314 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490269+0000", 2024-09-12T18:37:33.314 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.6549999999999993e-06 2024-09-12T18:37:33.314 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.314 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.314 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:33.314 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490275+0000", 2024-09-12T18:37:33.314 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.46e-06 2024-09-12T18:37:33.314 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.314 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.314 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:33.314 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490328+0000", 2024-09-12T18:37:33.315 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2101999999999997e-05 2024-09-12T18:37:33.315 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.315 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.315 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:33.315 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490347+0000", 2024-09-12T18:37:33.315 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9457999999999999e-05 2024-09-12T18:37:33.315 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.315 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.315 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:33.315 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534382+0000", 2024-09-12T18:37:33.315 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.044034968000000001 2024-09-12T18:37:33.315 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.315 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.315 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:33.316 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534444+0000", 2024-09-12T18:37:33.316 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2327000000000001e-05 2024-09-12T18:37:33.316 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:33.316 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:33.316 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:33.316 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.316 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.316 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201574 5.5 5:a963f378:::benchmark_data_smithi073_23739_object69297:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:33.316 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.490449+0000", 2024-09-12T18:37:33.316 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 12.746618377000001, 2024-09-12T18:37:33.316 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.046749974, 2024-09-12T18:37:33.316 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:33.316 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:33.317 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:33.317 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:33.317 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:33.317 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:33.317 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201574 2024-09-12T18:37:33.317 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.317 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:33.317 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.317 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:33.317 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490449+0000", 2024-09-12T18:37:33.317 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:33.317 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.317 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.318 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:33.318 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490449+0000", 2024-09-12T18:37:33.318 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:33.318 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.318 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.318 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:33.318 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490450+0000", 2024-09-12T18:37:33.318 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.17e-06 2024-09-12T18:37:33.318 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.318 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.318 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:33.318 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490455+0000", 2024-09-12T18:37:33.318 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.7319999999999998e-06 2024-09-12T18:37:33.318 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.319 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.319 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:33.319 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490464+0000", 2024-09-12T18:37:33.319 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.4760000000000004e-06 2024-09-12T18:37:33.319 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.319 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.319 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:33.319 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490471+0000", 2024-09-12T18:37:33.319 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.5400000000000001e-06 2024-09-12T18:37:33.319 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.319 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.319 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:33.319 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492695+0000", 2024-09-12T18:37:33.319 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0022245910000000002 2024-09-12T18:37:33.320 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.320 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.320 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:33.320 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492847+0000", 2024-09-12T18:37:33.320 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015127399999999999 2024-09-12T18:37:33.320 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.320 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.320 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:33.320 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492936+0000", 2024-09-12T18:37:33.320 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8953e-05 2024-09-12T18:37:33.320 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.320 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.320 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:33.321 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534614+0000", 2024-09-12T18:37:33.321 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.041678422999999999 2024-09-12T18:37:33.321 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.321 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.321 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:33.321 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534755+0000", 2024-09-12T18:37:33.321 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000140696 2024-09-12T18:37:33.321 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.321 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.321 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:33.322 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536891+0000", 2024-09-12T18:37:33.322 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0021365799999999999 2024-09-12T18:37:33.322 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.322 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.322 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:33.322 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537001+0000", 2024-09-12T18:37:33.322 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000109459 2024-09-12T18:37:33.322 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.323 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.323 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:33.323 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537199+0000", 2024-09-12T18:37:33.323 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019808 2024-09-12T18:37:33.323 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:33.323 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:33.323 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:33.323 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.323 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.324 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201576 5.2 5:42a132e0:::benchmark_data_smithi073_23739_object69299:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:33.324 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.490661+0000", 2024-09-12T18:37:33.324 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 12.746406329999999, 2024-09-12T18:37:33.324 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.041905530000000003, 2024-09-12T18:37:33.324 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:33.324 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:33.324 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:33.324 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:33.324 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:33.325 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:33.325 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201576 2024-09-12T18:37:33.328 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.328 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:33.328 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.328 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:33.329 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490661+0000", 2024-09-12T18:37:33.329 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:33.329 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.329 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.329 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:33.329 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490661+0000", 2024-09-12T18:37:33.329 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:33.329 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.329 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.329 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:33.329 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490662+0000", 2024-09-12T18:37:33.329 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5030000000000001e-06 2024-09-12T18:37:33.329 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.329 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.330 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:33.330 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490667+0000", 2024-09-12T18:37:33.330 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4479999999999996e-06 2024-09-12T18:37:33.330 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.330 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.330 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:33.330 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490675+0000", 2024-09-12T18:37:33.330 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8529999999999992e-06 2024-09-12T18:37:33.330 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.330 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.330 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:33.330 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490680+0000", 2024-09-12T18:37:33.330 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1919999999999996e-06 2024-09-12T18:37:33.331 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.331 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.331 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:33.331 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490730+0000", 2024-09-12T18:37:33.331 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.9738999999999999e-05 2024-09-12T18:37:33.331 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.331 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.331 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:33.331 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490833+0000", 2024-09-12T18:37:33.331 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010333 2024-09-12T18:37:33.331 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.331 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.331 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:33.331 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490930+0000", 2024-09-12T18:37:33.332 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7355999999999994e-05 2024-09-12T18:37:33.332 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.332 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.332 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:33.332 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493735+0000", 2024-09-12T18:37:33.332 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028049329999999999 2024-09-12T18:37:33.332 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.332 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.332 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:33.332 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532451+0000", 2024-09-12T18:37:33.332 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.038715554999999999 2024-09-12T18:37:33.332 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.333 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.333 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:33.333 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532514+0000", 2024-09-12T18:37:33.333 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2885000000000005e-05 2024-09-12T18:37:33.333 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.333 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.333 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:33.333 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532566+0000", 2024-09-12T18:37:33.333 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2735999999999998e-05 2024-09-12T18:37:33.333 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:33.333 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:33.333 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:33.333 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.334 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.334 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201577 5.7 5:e93d4852:::benchmark_data_smithi073_23739_object69300:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:33.334 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.490721+0000", 2024-09-12T18:37:33.334 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 12.746346319000001, 2024-09-12T18:37:33.334 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.042097930999999998, 2024-09-12T18:37:33.334 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:33.334 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:33.334 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:33.334 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:33.334 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:33.334 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:33.334 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201577 2024-09-12T18:37:33.334 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.334 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:33.335 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.335 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:33.335 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490721+0000", 2024-09-12T18:37:33.335 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:33.335 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.335 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.335 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:33.335 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490721+0000", 2024-09-12T18:37:33.335 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:33.335 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.335 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.335 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:33.336 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490721+0000", 2024-09-12T18:37:33.336 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.1900000000000002e-07 2024-09-12T18:37:33.336 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.336 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.336 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:33.336 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490724+0000", 2024-09-12T18:37:33.336 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.6189999999999998e-06 2024-09-12T18:37:33.336 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.336 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.336 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:33.336 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490731+0000", 2024-09-12T18:37:33.336 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0129999999999996e-06 2024-09-12T18:37:33.336 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.336 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.337 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:33.337 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490736+0000", 2024-09-12T18:37:33.337 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6929999999999998e-06 2024-09-12T18:37:33.337 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.337 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.337 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:33.337 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490788+0000", 2024-09-12T18:37:33.337 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2104000000000001e-05 2024-09-12T18:37:33.337 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.337 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.337 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:33.337 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490926+0000", 2024-09-12T18:37:33.337 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013852800000000001 2024-09-12T18:37:33.338 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.338 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.338 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:33.338 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491061+0000", 2024-09-12T18:37:33.338 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013499700000000001 2024-09-12T18:37:33.338 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.338 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.338 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:33.338 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531660+0000", 2024-09-12T18:37:33.338 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.040599046999999999 2024-09-12T18:37:33.338 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.338 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.338 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:33.338 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532630+0000", 2024-09-12T18:37:33.339 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00096974300000000002 2024-09-12T18:37:33.339 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.339 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.339 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:33.339 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532708+0000", 2024-09-12T18:37:33.339 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8108000000000005e-05 2024-09-12T18:37:33.339 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.339 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.339 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:33.339 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532819+0000", 2024-09-12T18:37:33.339 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011046 2024-09-12T18:37:33.339 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:33.340 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:33.340 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:33.340 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.340 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.340 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201578 5.f 5:f19e206c:::benchmark_data_smithi073_23739_object69301:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:33.340 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.491951+0000", 2024-09-12T18:37:33.340 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 12.745115946, 2024-09-12T18:37:33.340 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.043303686000000001, 2024-09-12T18:37:33.340 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:33.341 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:33.341 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:33.341 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:33.341 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:33.341 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:33.341 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201578 2024-09-12T18:37:33.341 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.341 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:33.341 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.342 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:33.342 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491951+0000", 2024-09-12T18:37:33.342 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:33.342 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.342 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.342 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:33.342 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491951+0000", 2024-09-12T18:37:33.342 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:33.343 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.343 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.343 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:33.343 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491952+0000", 2024-09-12T18:37:33.343 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.221e-06 2024-09-12T18:37:33.343 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.343 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.344 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:33.344 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491957+0000", 2024-09-12T18:37:33.344 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.0529999999999997e-06 2024-09-12T18:37:33.344 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.344 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.344 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:33.344 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491970+0000", 2024-09-12T18:37:33.344 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2731000000000001e-05 2024-09-12T18:37:33.344 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.344 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.344 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:33.344 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491977+0000", 2024-09-12T18:37:33.344 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.1380000000000001e-06 2024-09-12T18:37:33.344 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.345 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.345 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:33.345 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492031+0000", 2024-09-12T18:37:33.345 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3857999999999998e-05 2024-09-12T18:37:33.345 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.345 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.345 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:33.345 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492125+0000", 2024-09-12T18:37:33.345 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.3275000000000004e-05 2024-09-12T18:37:33.345 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.345 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.345 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:33.345 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492205+0000", 2024-09-12T18:37:33.346 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.0793999999999999e-05 2024-09-12T18:37:33.346 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.346 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.346 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:33.346 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531712+0000", 2024-09-12T18:37:33.346 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.039506708000000001 2024-09-12T18:37:33.346 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.346 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.346 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:33.346 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535161+0000", 2024-09-12T18:37:33.346 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003448586 2024-09-12T18:37:33.346 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.346 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.346 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:33.347 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535202+0000", 2024-09-12T18:37:33.347 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.0945999999999997e-05 2024-09-12T18:37:33.347 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.347 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.347 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:33.347 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535255+0000", 2024-09-12T18:37:33.347 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3375999999999999e-05 2024-09-12T18:37:33.347 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:33.347 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:33.347 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:33.347 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.347 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.347 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201579 5.5 5:ac64e9fd:::benchmark_data_smithi073_23739_object69302:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:33.347 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.492711+0000", 2024-09-12T18:37:33.348 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 12.744355775000001, 2024-09-12T18:37:33.348 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.04478994, 2024-09-12T18:37:33.348 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:33.348 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:33.348 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:33.348 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:33.348 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:33.348 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:33.348 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201579 2024-09-12T18:37:33.348 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.348 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:33.348 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.348 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:33.349 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492711+0000", 2024-09-12T18:37:33.349 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:33.349 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.349 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.349 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:33.349 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492711+0000", 2024-09-12T18:37:33.349 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:33.349 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.349 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.350 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:33.350 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492713+0000", 2024-09-12T18:37:33.350 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.105e-06 2024-09-12T18:37:33.350 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.350 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.350 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:33.350 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492720+0000", 2024-09-12T18:37:33.350 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.109e-06 2024-09-12T18:37:33.350 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.350 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.350 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:33.350 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492730+0000", 2024-09-12T18:37:33.350 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.049e-05 2024-09-12T18:37:33.351 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.351 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.351 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:33.351 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492737+0000", 2024-09-12T18:37:33.351 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0960000000000003e-06 2024-09-12T18:37:33.351 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.351 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.351 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:33.351 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.494541+0000", 2024-09-12T18:37:33.351 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0018034139999999999 2024-09-12T18:37:33.351 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.351 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.351 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:33.351 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.494692+0000", 2024-09-12T18:37:33.352 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000150956 2024-09-12T18:37:33.352 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.352 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.352 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:33.352 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.494843+0000", 2024-09-12T18:37:33.352 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000151896 2024-09-12T18:37:33.352 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.352 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.352 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:33.352 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534665+0000", 2024-09-12T18:37:33.352 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.039821829000000003 2024-09-12T18:37:33.352 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.353 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.353 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:33.353 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536866+0000", 2024-09-12T18:37:33.353 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0022007839999999999 2024-09-12T18:37:33.353 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.353 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.353 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:33.353 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537212+0000", 2024-09-12T18:37:33.353 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00034636299999999998 2024-09-12T18:37:33.353 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.353 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.353 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:33.353 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537298+0000", 2024-09-12T18:37:33.353 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5970999999999994e-05 2024-09-12T18:37:33.354 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.354 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.354 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:33.354 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537501+0000", 2024-09-12T18:37:33.354 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020292699999999999 2024-09-12T18:37:33.354 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:33.354 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:33.354 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:33.354 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.354 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.354 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201581 5.7 5:e819369d:::benchmark_data_smithi073_23739_object69304:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:33.354 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.493262+0000", 2024-09-12T18:37:33.354 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 12.743805425, 2024-09-12T18:37:33.355 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.042091362, 2024-09-12T18:37:33.355 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:33.355 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:33.355 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:33.355 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:33.355 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:33.355 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:33.355 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201581 2024-09-12T18:37:33.355 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.355 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:33.355 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.355 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:33.355 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493262+0000", 2024-09-12T18:37:33.356 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:33.356 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.356 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.356 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:33.356 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493262+0000", 2024-09-12T18:37:33.356 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:33.356 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.356 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.356 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:33.356 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493263+0000", 2024-09-12T18:37:33.356 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.6700000000000003e-07 2024-09-12T18:37:33.356 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.356 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.356 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:33.357 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493266+0000", 2024-09-12T18:37:33.357 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.4850000000000001e-06 2024-09-12T18:37:33.357 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.357 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.357 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:33.357 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493273+0000", 2024-09-12T18:37:33.357 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2019999999999998e-06 2024-09-12T18:37:33.357 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.357 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.357 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:33.357 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493278+0000", 2024-09-12T18:37:33.357 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6210000000000003e-06 2024-09-12T18:37:33.357 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.358 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.358 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:33.358 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493330+0000", 2024-09-12T18:37:33.358 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2587000000000003e-05 2024-09-12T18:37:33.358 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.358 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.358 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:33.358 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493469+0000", 2024-09-12T18:37:33.358 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013901199999999999 2024-09-12T18:37:33.358 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.358 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.359 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:33.359 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493612+0000", 2024-09-12T18:37:33.359 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014237599999999999 2024-09-12T18:37:33.359 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.359 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.359 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:33.359 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531835+0000", 2024-09-12T18:37:33.359 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.038222735000000001 2024-09-12T18:37:33.359 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.359 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.359 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:33.359 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535265+0000", 2024-09-12T18:37:33.359 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003430064 2024-09-12T18:37:33.359 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.360 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.360 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:33.360 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535319+0000", 2024-09-12T18:37:33.360 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4375e-05 2024-09-12T18:37:33.360 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.360 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.360 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:33.360 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535353+0000", 2024-09-12T18:37:33.360 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.4137999999999997e-05 2024-09-12T18:37:33.360 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:33.360 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:33.360 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:33.360 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.360 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.361 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:201573 5.3 e67/21 5:cf4becdf:::benchmark_data_smithi073_23739_object69296:head v 67'12363, mlcod=67'12360)", 2024-09-12T18:37:33.361 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.493437+0000", 2024-09-12T18:37:33.361 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 12.743630489999999, 2024-09-12T18:37:33.361 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.041109664999999997, 2024-09-12T18:37:33.361 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:33.361 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:33.361 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:33.361 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:33.361 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.361 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:33.362 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493437+0000", 2024-09-12T18:37:33.362 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:33.362 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.362 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.362 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:33.362 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493437+0000", 2024-09-12T18:37:33.362 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:33.362 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.363 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.363 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:33.363 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493438+0000", 2024-09-12T18:37:33.363 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.125e-06 2024-09-12T18:37:33.363 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.363 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.363 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:33.363 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493444+0000", 2024-09-12T18:37:33.363 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2269999999999998e-06 2024-09-12T18:37:33.363 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.363 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.363 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:33.363 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493457+0000", 2024-09-12T18:37:33.364 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.312e-05 2024-09-12T18:37:33.364 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.364 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.364 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:33.364 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493466+0000", 2024-09-12T18:37:33.364 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.6309999999999992e-06 2024-09-12T18:37:33.364 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.364 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.364 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:33.364 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493526+0000", 2024-09-12T18:37:33.364 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.0316000000000003e-05 2024-09-12T18:37:33.364 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.364 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.365 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:33.365 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493541+0000", 2024-09-12T18:37:33.365 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4459e-05 2024-09-12T18:37:33.365 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.365 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.365 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:33.365 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534501+0000", 2024-09-12T18:37:33.365 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.040960215000000001 2024-09-12T18:37:33.365 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.365 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.365 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:33.365 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534546+0000", 2024-09-12T18:37:33.365 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.5571999999999997e-05 2024-09-12T18:37:33.366 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:33.366 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:33.366 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:33.366 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.366 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.366 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201582 5.f 5:f90f147f:::benchmark_data_smithi073_23739_object69305:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:33.366 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.493597+0000", 2024-09-12T18:37:33.366 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 12.743469959, 2024-09-12T18:37:33.366 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.045457567999999997, 2024-09-12T18:37:33.366 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:33.366 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:33.366 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:33.367 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:33.367 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:33.367 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:33.367 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201582 2024-09-12T18:37:33.367 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.367 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:33.367 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.367 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:33.367 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493597+0000", 2024-09-12T18:37:33.367 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:33.367 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.367 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.367 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:33.368 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493597+0000", 2024-09-12T18:37:33.368 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:33.368 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.368 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.368 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:33.368 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493598+0000", 2024-09-12T18:37:33.368 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7699999999999992e-07 2024-09-12T18:37:33.368 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.368 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.368 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:33.368 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493609+0000", 2024-09-12T18:37:33.368 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1297e-05 2024-09-12T18:37:33.368 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.369 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.369 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:33.369 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493620+0000", 2024-09-12T18:37:33.369 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0930999999999999e-05 2024-09-12T18:37:33.369 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.369 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.369 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:33.369 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493640+0000", 2024-09-12T18:37:33.369 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.0072e-05 2024-09-12T18:37:33.369 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.369 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.369 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:33.369 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531770+0000", 2024-09-12T18:37:33.369 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.038129652999999999 2024-09-12T18:37:33.370 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.370 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.370 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:33.370 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532046+0000", 2024-09-12T18:37:33.370 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027561600000000001 2024-09-12T18:37:33.370 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.370 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.370 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:33.370 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532337+0000", 2024-09-12T18:37:33.370 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00029169200000000003 2024-09-12T18:37:33.370 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.370 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.370 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:33.371 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536640+0000", 2024-09-12T18:37:33.371 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0043023499999999999 2024-09-12T18:37:33.371 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.371 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.371 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:33.371 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.538943+0000", 2024-09-12T18:37:33.371 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0023032740000000001 2024-09-12T18:37:33.371 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.371 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.371 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:33.371 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.539013+0000", 2024-09-12T18:37:33.371 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9944000000000007e-05 2024-09-12T18:37:33.371 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.372 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.372 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:33.372 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.539055+0000", 2024-09-12T18:37:33.372 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.1761999999999998e-05 2024-09-12T18:37:33.372 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:33.372 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:33.372 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:33.372 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.372 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.372 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:201583 5.d e67/21 5:b91eedec:::benchmark_data_smithi073_23739_object69306:head v 67'12761, mlcod=67'12759)", 2024-09-12T18:37:33.372 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.495034+0000", 2024-09-12T18:37:33.372 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 12.742033584, 2024-09-12T18:37:33.372 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.047966852999999997, 2024-09-12T18:37:33.373 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:33.373 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:33.373 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:33.373 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:33.373 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.373 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:33.373 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.495034+0000", 2024-09-12T18:37:33.373 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:33.373 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.373 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.373 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:33.373 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.495034+0000", 2024-09-12T18:37:33.373 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:33.374 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.374 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.374 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:33.374 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.495035+0000", 2024-09-12T18:37:33.374 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.023e-06 2024-09-12T18:37:33.374 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.374 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.374 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:33.374 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.495040+0000", 2024-09-12T18:37:33.374 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.9300000000000002e-06 2024-09-12T18:37:33.374 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.374 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.374 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:33.374 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531510+0000", 2024-09-12T18:37:33.375 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.036470250000000003 2024-09-12T18:37:33.375 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.375 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.375 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:33.375 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531518+0000", 2024-09-12T18:37:33.375 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8490000000000006e-06 2024-09-12T18:37:33.375 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.375 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.375 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:33.375 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534395+0000", 2024-09-12T18:37:33.375 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.002877246 2024-09-12T18:37:33.375 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.375 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.376 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:33.376 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534418+0000", 2024-09-12T18:37:33.376 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.3119e-05 2024-09-12T18:37:33.376 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.376 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.376 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:33.376 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.542930+0000", 2024-09-12T18:37:33.376 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0085121929999999995 2024-09-12T18:37:33.376 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:33.376 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:33.376 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:33.376 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.543000+0000", 2024-09-12T18:37:33.376 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0242999999999998e-05 2024-09-12T18:37:33.376 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:33.377 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:33.377 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:33.377 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:33.377 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:33.377 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:33.378 INFO:teuthology.orchestra.run.smithi073.stderr:set 2.6 pg_upmap mapping to [2,0] 2024-09-12T18:37:33.379 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:33.374+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:33.380 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is set 2024-09-12T18:37:33.380 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:37:33.479 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:33.476+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:33.537 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:33.537 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:37:33.537 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.537 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:229860 5.c 5:381a5825:::benchmark_data_smithi073_23739_object97583:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T18:37:33.538 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:33.525175+0000", 2024-09-12T18:37:33.538 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0092043890000000003, 2024-09-12T18:37:33.538 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0092206340000000001, 2024-09-12T18:37:33.538 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:33.538 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:33.538 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:33.538 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:33.538 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:33.538 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:33.538 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 229860 2024-09-12T18:37:33.538 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.538 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:33.539 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.539 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:33.539 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.525175+0000", 2024-09-12T18:37:33.539 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:33.539 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.539 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.539 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:33.539 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.525175+0000", 2024-09-12T18:37:33.539 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:33.539 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.539 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.539 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:33.539 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.525176+0000", 2024-09-12T18:37:33.539 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0860000000000001e-06 2024-09-12T18:37:33.540 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.540 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.540 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:33.540 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.525181+0000", 2024-09-12T18:37:33.540 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3440000000000003e-06 2024-09-12T18:37:33.540 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.540 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.540 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:33.540 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.525192+0000", 2024-09-12T18:37:33.540 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1708e-05 2024-09-12T18:37:33.540 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.540 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.540 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:33.540 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.525201+0000", 2024-09-12T18:37:33.541 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6260000000000001e-06 2024-09-12T18:37:33.541 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.541 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.541 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:33.541 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.534143+0000", 2024-09-12T18:37:33.541 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0089421350000000004 2024-09-12T18:37:33.541 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.541 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.541 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:33.541 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.534308+0000", 2024-09-12T18:37:33.541 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00016506800000000001 2024-09-12T18:37:33.541 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:33.541 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:33.542 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:33.542 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.542 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.542 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:229862 5.4 e72/21 5:25519fc2:::benchmark_data_smithi073_23739_object97585:head v 72'14191, mlcod=72'14189)", 2024-09-12T18:37:33.542 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:33.526372+0000", 2024-09-12T18:37:33.542 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.008008098, 2024-09-12T18:37:33.542 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0080635189999999999, 2024-09-12T18:37:33.542 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:33.542 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:33.542 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:33.542 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:33.542 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.542 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:33.542 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.526372+0000", 2024-09-12T18:37:33.543 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:33.543 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.543 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.543 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:33.543 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.526372+0000", 2024-09-12T18:37:33.543 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:33.543 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.543 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.543 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:33.543 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.526372+0000", 2024-09-12T18:37:33.543 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.0200000000000002e-07 2024-09-12T18:37:33.543 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.543 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.543 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:33.544 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.526376+0000", 2024-09-12T18:37:33.544 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.7189999999999999e-06 2024-09-12T18:37:33.544 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.544 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.544 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:33.544 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.526383+0000", 2024-09-12T18:37:33.544 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8560000000000001e-06 2024-09-12T18:37:33.544 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.544 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.544 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:33.544 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.526388+0000", 2024-09-12T18:37:33.544 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.7949999999999998e-06 2024-09-12T18:37:33.544 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.544 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.545 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:33.545 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.529075+0000", 2024-09-12T18:37:33.545 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0026872319999999999 2024-09-12T18:37:33.545 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.545 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.545 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:33.545 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.529094+0000", 2024-09-12T18:37:33.545 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9485999999999999e-05 2024-09-12T18:37:33.545 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:33.545 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:33.545 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:33.545 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.545 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.546 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:229865 5.4 e72/21 5:2e2de5e9:::benchmark_data_smithi073_23739_object97588:head v 72'14192, mlcod=72'14189)", 2024-09-12T18:37:33.546 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:33.528206+0000", 2024-09-12T18:37:33.546 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0061733990000000004, 2024-09-12T18:37:33.546 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0062585999999999996, 2024-09-12T18:37:33.546 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:33.546 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:33.546 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:33.546 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:33.546 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.546 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:33.546 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.528206+0000", 2024-09-12T18:37:33.546 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:33.546 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.546 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.547 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:33.547 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.528206+0000", 2024-09-12T18:37:33.547 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:33.547 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.547 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.547 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:33.547 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.528207+0000", 2024-09-12T18:37:33.548 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2900000000000002e-07 2024-09-12T18:37:33.548 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.548 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.548 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:33.548 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.528213+0000", 2024-09-12T18:37:33.548 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.665e-06 2024-09-12T18:37:33.548 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.548 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.548 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:33.548 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.528224+0000", 2024-09-12T18:37:33.548 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0735e-05 2024-09-12T18:37:33.548 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.548 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.549 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:33.549 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.528230+0000", 2024-09-12T18:37:33.549 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4590000000000003e-06 2024-09-12T18:37:33.549 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.549 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.549 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:33.549 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.531673+0000", 2024-09-12T18:37:33.549 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0034430559999999999 2024-09-12T18:37:33.549 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.549 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.549 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:33.549 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.531696+0000", 2024-09-12T18:37:33.549 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2841999999999999e-05 2024-09-12T18:37:33.549 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:33.550 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:33.550 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:33.550 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.550 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.550 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:229835 5.c 5:3dbc7d1a:::benchmark_data_smithi073_23739_object97558:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T18:37:33.550 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:33.514201+0000", 2024-09-12T18:37:33.550 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.020178853, 2024-09-12T18:37:33.550 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.020292755999999999, 2024-09-12T18:37:33.550 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:33.550 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:33.550 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:33.550 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:33.550 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:33.551 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:33.551 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 229835 2024-09-12T18:37:33.551 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.551 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:33.551 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.551 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:33.551 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.514201+0000", 2024-09-12T18:37:33.551 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:33.551 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.551 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.551 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:33.551 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.514201+0000", 2024-09-12T18:37:33.552 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:33.552 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.552 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.552 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:33.552 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.514202+0000", 2024-09-12T18:37:33.552 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.9099999999999991e-07 2024-09-12T18:37:33.552 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.552 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.552 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:33.552 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.514209+0000", 2024-09-12T18:37:33.552 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1620000000000002e-06 2024-09-12T18:37:33.552 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.553 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.553 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:33.553 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.514218+0000", 2024-09-12T18:37:33.553 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4669999999999993e-06 2024-09-12T18:37:33.553 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.553 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.553 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:33.553 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.514223+0000", 2024-09-12T18:37:33.553 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9640000000000002e-06 2024-09-12T18:37:33.553 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.553 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.553 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:33.553 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.515091+0000", 2024-09-12T18:37:33.554 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00086726900000000005 2024-09-12T18:37:33.554 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.554 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.554 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:33.554 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.515250+0000", 2024-09-12T18:37:33.554 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000159192 2024-09-12T18:37:33.554 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.554 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.554 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:33.554 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.515373+0000", 2024-09-12T18:37:33.554 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012346500000000001 2024-09-12T18:37:33.554 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.554 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.554 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:33.555 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.518027+0000", 2024-09-12T18:37:33.555 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0026532729999999998 2024-09-12T18:37:33.555 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:33.555 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:33.555 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:33.555 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.555 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.555 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:229868 5.b e72/21 5:d461db88:::benchmark_data_smithi073_23739_object97591:head v 72'14594, mlcod=72'14592)", 2024-09-12T18:37:33.555 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:33.529646+0000", 2024-09-12T18:37:33.555 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0047338559999999998, 2024-09-12T18:37:33.555 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.004885347, 2024-09-12T18:37:33.555 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:33.555 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:33.556 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:33.556 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:33.556 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.556 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:33.556 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.529646+0000", 2024-09-12T18:37:33.556 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:33.556 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.556 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.556 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:33.556 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.529646+0000", 2024-09-12T18:37:33.556 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:33.556 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.556 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.556 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:33.557 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.529647+0000", 2024-09-12T18:37:33.557 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1200000000000002e-07 2024-09-12T18:37:33.557 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.557 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.557 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:33.557 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.529652+0000", 2024-09-12T18:37:33.557 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.994e-06 2024-09-12T18:37:33.557 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.557 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.557 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:33.557 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.529660+0000", 2024-09-12T18:37:33.557 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.6319999999999997e-06 2024-09-12T18:37:33.557 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.557 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.558 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:33.558 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.529667+0000", 2024-09-12T18:37:33.558 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5939999999999999e-06 2024-09-12T18:37:33.558 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.558 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.558 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:33.558 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.529714+0000", 2024-09-12T18:37:33.558 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.7169999999999997e-05 2024-09-12T18:37:33.558 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.558 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.558 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:33.558 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.529734+0000", 2024-09-12T18:37:33.558 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9928e-05 2024-09-12T18:37:33.558 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:33.559 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:33.559 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:33.559 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.559 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.559 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:229871 5.2 e72/21 5:41fd9269:::benchmark_data_smithi073_23739_object97594:head v 72'14247, mlcod=72'14245)", 2024-09-12T18:37:33.559 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:33.529831+0000", 2024-09-12T18:37:33.559 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0045483909999999997, 2024-09-12T18:37:33.559 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.004726137, 2024-09-12T18:37:33.559 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:33.559 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:33.559 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:33.559 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:33.559 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.560 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:33.560 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.529831+0000", 2024-09-12T18:37:33.560 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:33.560 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.560 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.560 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:33.560 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.529831+0000", 2024-09-12T18:37:33.560 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:33.560 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.560 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.560 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:33.560 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.529832+0000", 2024-09-12T18:37:33.561 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6599999999999996e-07 2024-09-12T18:37:33.561 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.561 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.561 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:33.561 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.529838+0000", 2024-09-12T18:37:33.561 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4289999999999998e-06 2024-09-12T18:37:33.561 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.561 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.561 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:33.562 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.529847+0000", 2024-09-12T18:37:33.562 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.3040000000000005e-06 2024-09-12T18:37:33.562 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.562 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.562 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:33.562 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.529852+0000", 2024-09-12T18:37:33.562 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5520000000000004e-06 2024-09-12T18:37:33.562 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.562 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.562 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:33.562 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.529911+0000", 2024-09-12T18:37:33.562 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8325000000000001e-05 2024-09-12T18:37:33.562 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.563 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.563 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:33.563 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.529929+0000", 2024-09-12T18:37:33.563 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8323999999999999e-05 2024-09-12T18:37:33.563 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:33.563 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:33.563 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:33.563 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.563 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.563 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:229873 5.7 e72/21 5:e478dc45:::benchmark_data_smithi073_23739_object97596:head v 72'14416, mlcod=72'14413)", 2024-09-12T18:37:33.563 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:33.532941+0000", 2024-09-12T18:37:33.563 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0014382850000000001, 2024-09-12T18:37:33.564 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001643306, 2024-09-12T18:37:33.564 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:33.564 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:33.564 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:33.564 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:33.564 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.564 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:33.564 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.532941+0000", 2024-09-12T18:37:33.564 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:33.564 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.564 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.565 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:33.565 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.532941+0000", 2024-09-12T18:37:33.565 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:33.565 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.565 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.565 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:33.565 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.532942+0000", 2024-09-12T18:37:33.565 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1500000000000004e-07 2024-09-12T18:37:33.565 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.566 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.566 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:33.566 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.532950+0000", 2024-09-12T18:37:33.566 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1499999999999999e-06 2024-09-12T18:37:33.566 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.566 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.566 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:33.566 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.532958+0000", 2024-09-12T18:37:33.566 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3000000000000004e-06 2024-09-12T18:37:33.566 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.567 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.567 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:33.567 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.532962+0000", 2024-09-12T18:37:33.567 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.1810000000000003e-06 2024-09-12T18:37:33.567 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.567 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.567 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:33.567 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.533005+0000", 2024-09-12T18:37:33.567 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3127000000000002e-05 2024-09-12T18:37:33.567 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.567 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.567 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:33.568 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.533025+0000", 2024-09-12T18:37:33.568 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.0007999999999999e-05 2024-09-12T18:37:33.568 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:33.568 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:33.568 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:33.568 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.568 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.568 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:229875 5.5 e72/49 5:ab2c5fcd:::benchmark_data_smithi073_23739_object97598:head v 72'14537, mlcod=72'14534)", 2024-09-12T18:37:33.568 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:33.533010+0000", 2024-09-12T18:37:33.568 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.001369297, 2024-09-12T18:37:33.568 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00160213, 2024-09-12T18:37:33.568 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:33.569 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:33.569 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:33.569 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:33.569 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.569 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:33.569 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.533010+0000", 2024-09-12T18:37:33.569 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:33.569 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.569 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.569 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:33.569 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.533010+0000", 2024-09-12T18:37:33.569 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:33.570 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.570 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.570 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:33.570 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.533011+0000", 2024-09-12T18:37:33.570 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2100000000000002e-07 2024-09-12T18:37:33.570 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.570 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.570 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:33.570 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.533016+0000", 2024-09-12T18:37:33.570 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.327e-06 2024-09-12T18:37:33.570 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.570 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.571 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:33.571 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.533024+0000", 2024-09-12T18:37:33.571 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5619999999999998e-06 2024-09-12T18:37:33.571 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.571 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.571 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:33.571 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.533028+0000", 2024-09-12T18:37:33.571 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8330000000000004e-06 2024-09-12T18:37:33.571 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.571 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.571 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:33.572 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.533078+0000", 2024-09-12T18:37:33.572 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0911000000000001e-05 2024-09-12T18:37:33.572 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.572 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.572 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:33.572 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.533100+0000", 2024-09-12T18:37:33.572 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1599000000000001e-05 2024-09-12T18:37:33.572 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:33.572 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:33.572 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:33.572 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.572 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.572 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:229877 5.b e72/21 5:df053892:::benchmark_data_smithi073_23739_object97600:head v 72'14595, mlcod=72'14592)", 2024-09-12T18:37:33.572 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:33.533687+0000", 2024-09-12T18:37:33.573 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00069310200000000002, 2024-09-12T18:37:33.573 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000951811, 2024-09-12T18:37:33.573 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:33.573 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:33.573 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:33.573 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:33.573 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.573 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:33.573 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.533687+0000", 2024-09-12T18:37:33.573 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:33.573 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.573 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.573 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:33.574 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.533687+0000", 2024-09-12T18:37:33.574 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:33.574 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.574 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.574 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:33.574 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.533687+0000", 2024-09-12T18:37:33.574 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0299999999999998e-07 2024-09-12T18:37:33.574 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.574 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.574 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:33.574 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.533696+0000", 2024-09-12T18:37:33.574 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1410000000000005e-06 2024-09-12T18:37:33.574 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.574 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.575 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:33.575 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.533706+0000", 2024-09-12T18:37:33.575 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0915e-05 2024-09-12T18:37:33.575 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.575 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.575 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:33.575 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.533712+0000", 2024-09-12T18:37:33.575 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9800000000000003e-06 2024-09-12T18:37:33.575 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.575 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.575 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:33.575 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.533822+0000", 2024-09-12T18:37:33.575 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000109182 2024-09-12T18:37:33.575 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.576 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.576 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:33.576 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.533840+0000", 2024-09-12T18:37:33.576 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8445999999999999e-05 2024-09-12T18:37:33.576 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:33.576 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:33.576 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:33.576 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.576 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.576 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:229849 5.c e72/21)", 2024-09-12T18:37:33.576 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:33.534631+0000", 2024-09-12T18:37:33.576 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4294967295.9997492, 2024-09-12T18:37:33.576 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3516000000000002e-05, 2024-09-12T18:37:33.577 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:33.577 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:33.577 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:33.577 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:33.577 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.577 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:33.577 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.534631+0000", 2024-09-12T18:37:33.577 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:33.577 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.577 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.578 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:33.578 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.534631+0000", 2024-09-12T18:37:33.578 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:33.578 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.578 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.578 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:33.578 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.534631+0000", 2024-09-12T18:37:33.578 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2600000000000002e-07 2024-09-12T18:37:33.578 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.578 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.578 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:33.578 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.534635+0000", 2024-09-12T18:37:33.578 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.163e-06 2024-09-12T18:37:33.578 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.579 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.579 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:33.579 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.534643+0000", 2024-09-12T18:37:33.579 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0579999999999998e-06 2024-09-12T18:37:33.579 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.579 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.579 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:33.579 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.534648+0000", 2024-09-12T18:37:33.579 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.3630000000000002e-06 2024-09-12T18:37:33.579 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:33.579 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:33.579 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:33.579 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.579 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.580 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:229848 5.c 5:31107ef2:::benchmark_data_smithi073_23739_object97571:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T18:37:33.580 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:33.520853+0000", 2024-09-12T18:37:33.580 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.013527099000000001, 2024-09-12T18:37:33.580 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013834993, 2024-09-12T18:37:33.580 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:33.580 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:33.580 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:33.580 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:33.580 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:33.580 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:33.580 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 229848 2024-09-12T18:37:33.580 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.580 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:33.581 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.581 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:33.581 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.520853+0000", 2024-09-12T18:37:33.581 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:33.581 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.581 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.581 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:33.581 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.520853+0000", 2024-09-12T18:37:33.581 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:33.581 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.581 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.581 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:33.581 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.520854+0000", 2024-09-12T18:37:33.581 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.003e-06 2024-09-12T18:37:33.581 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.582 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.582 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:33.582 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.520858+0000", 2024-09-12T18:37:33.582 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3510000000000004e-06 2024-09-12T18:37:33.582 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.582 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.582 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:33.582 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.520870+0000", 2024-09-12T18:37:33.582 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1681e-05 2024-09-12T18:37:33.582 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.582 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.582 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:33.582 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.520878+0000", 2024-09-12T18:37:33.582 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5969999999999992e-06 2024-09-12T18:37:33.583 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.583 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.583 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:33.583 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.520932+0000", 2024-09-12T18:37:33.583 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.3773000000000002e-05 2024-09-12T18:37:33.583 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.583 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.583 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:33.583 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.521065+0000", 2024-09-12T18:37:33.583 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000132528 2024-09-12T18:37:33.583 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.583 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.583 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:33.583 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.521191+0000", 2024-09-12T18:37:33.584 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012623300000000001 2024-09-12T18:37:33.584 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.584 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.584 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:33.584 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.529102+0000", 2024-09-12T18:37:33.584 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0079113459999999997 2024-09-12T18:37:33.584 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:33.584 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:33.584 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:33.584 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.584 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.584 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:229849 5.c 5:361446a9:::benchmark_data_smithi073_23739_object97572:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T18:37:33.584 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:33.520895+0000", 2024-09-12T18:37:33.585 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.013485156999999999, 2024-09-12T18:37:33.585 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013829517, 2024-09-12T18:37:33.585 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:33.585 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:33.585 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:33.585 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:33.585 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:33.585 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:33.585 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 229849 2024-09-12T18:37:33.585 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.585 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:33.585 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.585 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:33.585 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.520895+0000", 2024-09-12T18:37:33.586 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:33.586 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.586 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.586 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:33.586 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.520895+0000", 2024-09-12T18:37:33.586 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:33.586 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.586 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.586 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:33.586 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.520895+0000", 2024-09-12T18:37:33.586 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2200000000000004e-07 2024-09-12T18:37:33.586 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.586 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.586 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:33.586 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.520897+0000", 2024-09-12T18:37:33.587 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2539999999999999e-06 2024-09-12T18:37:33.587 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.587 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.587 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:33.587 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.520905+0000", 2024-09-12T18:37:33.587 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.7379999999999994e-06 2024-09-12T18:37:33.587 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.587 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.587 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:33.587 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.520910+0000", 2024-09-12T18:37:33.587 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8010000000000003e-06 2024-09-12T18:37:33.587 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.587 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.588 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:33.588 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.525572+0000", 2024-09-12T18:37:33.588 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0046621370000000002 2024-09-12T18:37:33.588 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.588 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.588 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:33.588 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.525706+0000", 2024-09-12T18:37:33.588 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013429300000000001 2024-09-12T18:37:33.588 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.588 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.588 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:33.588 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.525822+0000", 2024-09-12T18:37:33.588 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000115363 2024-09-12T18:37:33.588 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:33.589 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:33.589 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:33.589 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.589 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.589 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:229856 5.c 5:385e308e:::benchmark_data_smithi073_23739_object97579:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T18:37:33.589 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:33.523049+0000", 2024-09-12T18:37:33.589 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.011330644000000001, 2024-09-12T18:37:33.589 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011734695999999999, 2024-09-12T18:37:33.589 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:33.589 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:33.589 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:33.589 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:33.590 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:33.590 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:33.590 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 229856 2024-09-12T18:37:33.590 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.590 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:33.590 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.590 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:33.590 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.523049+0000", 2024-09-12T18:37:33.590 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:33.590 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.590 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.590 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:33.590 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.523049+0000", 2024-09-12T18:37:33.590 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:33.591 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.591 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.591 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:33.591 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.523050+0000", 2024-09-12T18:37:33.591 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1999999999999998e-07 2024-09-12T18:37:33.591 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.591 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.591 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:33.591 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.523053+0000", 2024-09-12T18:37:33.591 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.523e-06 2024-09-12T18:37:33.591 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.592 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.592 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:33.592 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.523065+0000", 2024-09-12T18:37:33.592 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1113e-05 2024-09-12T18:37:33.592 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.592 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.592 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:33.592 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.523072+0000", 2024-09-12T18:37:33.592 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.644e-06 2024-09-12T18:37:33.592 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.592 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.593 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:33.593 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.530823+0000", 2024-09-12T18:37:33.593 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0077511409999999996 2024-09-12T18:37:33.593 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.593 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.593 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:33.593 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.530956+0000", 2024-09-12T18:37:33.593 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013254599999999999 2024-09-12T18:37:33.593 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.593 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.593 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:33.593 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:33.531088+0000", 2024-09-12T18:37:33.593 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013257899999999999 2024-09-12T18:37:33.593 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:33.593 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:33.594 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:33.594 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:33.594 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-12T18:37:33.594 INFO:teuthology.orchestra.run.smithi114.stdout: "num_ops": 13 2024-09-12T18:37:33.594 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:33.595 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:33.590+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:33.596 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:37:33.698 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:33.690+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:33.747 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:33.748 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2024-09-12T18:37:33.748 INFO:teuthology.orchestra.run.smithi114.stdout: "complaint_time": 30, 2024-09-12T18:37:33.748 INFO:teuthology.orchestra.run.smithi114.stdout: "num_blocked_ops": 0 2024-09-12T18:37:33.748 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:33.768 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:37:33.796 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:33.792+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:33.898 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:33.890+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:33.970 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:33.971 INFO:teuthology.orchestra.run.smithi114.stdout: "size": 20, 2024-09-12T18:37:33.971 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 600, 2024-09-12T18:37:33.971 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:37:33.971 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.971 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:26 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:33.971 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:37:33.971 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 128.33796003399999, 2024-09-12T18:37:33.971 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045702136999999997, 2024-09-12T18:37:33.971 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:33.971 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:33.971 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:33.971 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:33.971 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.972 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:33.972 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:37:33.972 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:33.972 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.972 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.972 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:33.972 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:37:33.972 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:33.972 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.972 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.972 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:33.972 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628699+0000", 2024-09-12T18:37:33.973 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3859999999999999e-06 2024-09-12T18:37:33.973 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.973 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.973 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:33.973 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628706+0000", 2024-09-12T18:37:33.973 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0169999999999999e-06 2024-09-12T18:37:33.973 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.973 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.973 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:33.973 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628725+0000", 2024-09-12T18:37:33.973 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8683000000000001e-05 2024-09-12T18:37:33.973 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.973 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.973 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:33.974 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628740+0000", 2024-09-12T18:37:33.974 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5413999999999998e-05 2024-09-12T18:37:33.974 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.974 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.974 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:33.974 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628907+0000", 2024-09-12T18:37:33.974 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00016670199999999999 2024-09-12T18:37:33.974 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.974 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.974 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:37:33.974 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628917+0000", 2024-09-12T18:37:33.974 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.046e-05 2024-09-12T18:37:33.974 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.974 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.975 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:33.975 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.660390+0000", 2024-09-12T18:37:33.975 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.031472364000000003 2024-09-12T18:37:33.975 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.975 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.975 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:33.975 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.661767+0000", 2024-09-12T18:37:33.975 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0013769190000000001 2024-09-12T18:37:33.975 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.975 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.975 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:33.975 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.662408+0000", 2024-09-12T18:37:33.975 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00064091099999999998 2024-09-12T18:37:33.975 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.976 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.976 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:33.976 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669577+0000", 2024-09-12T18:37:33.976 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.007169412 2024-09-12T18:37:33.976 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.976 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.976 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:33.976 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674244+0000", 2024-09-12T18:37:33.976 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0046671839999999996 2024-09-12T18:37:33.976 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.976 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.976 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:33.976 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674329+0000", 2024-09-12T18:37:33.977 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5276000000000001e-05 2024-09-12T18:37:33.977 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.977 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.977 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:33.977 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674400+0000", 2024-09-12T18:37:33.977 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0408999999999996e-05 2024-09-12T18:37:33.977 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:33.977 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:33.977 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:33.978 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.978 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.978 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:33.978 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:37:33.978 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 128.33753575399999, 2024-09-12T18:37:33.978 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.046431252999999999, 2024-09-12T18:37:33.978 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:33.978 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:33.978 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:33.978 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:33.978 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.978 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:33.979 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:37:33.979 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:33.979 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.979 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.979 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:33.979 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:37:33.979 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:33.979 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.979 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.979 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:33.979 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629123+0000", 2024-09-12T18:37:33.979 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0899999999999999e-06 2024-09-12T18:37:33.979 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.980 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.980 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:33.980 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629138+0000", 2024-09-12T18:37:33.980 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4977000000000001e-05 2024-09-12T18:37:33.980 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.980 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.980 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:33.980 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629149+0000", 2024-09-12T18:37:33.980 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1182999999999999e-05 2024-09-12T18:37:33.980 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.981 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.981 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:33.981 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629157+0000", 2024-09-12T18:37:33.981 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8129999999999996e-06 2024-09-12T18:37:33.981 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.981 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.981 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:33.981 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629223+0000", 2024-09-12T18:37:33.981 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6463000000000004e-05 2024-09-12T18:37:33.981 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.981 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.981 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:37:33.982 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629230+0000", 2024-09-12T18:37:33.982 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1360000000000002e-06 2024-09-12T18:37:33.982 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.982 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.982 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:33.982 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669605+0000", 2024-09-12T18:37:33.982 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.040375518999999999 2024-09-12T18:37:33.982 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.982 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.982 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:33.982 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669840+0000", 2024-09-12T18:37:33.982 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00023520099999999999 2024-09-12T18:37:33.982 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.983 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.983 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:33.983 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.675553+0000", 2024-09-12T18:37:33.983 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0057128709999999996 2024-09-12T18:37:33.983 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:33.983 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:33.983 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:33.983 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.983 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.983 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167352 5.a 5:5fc472d2:::benchmark_data_smithi073_23739_object35075:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:33.983 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.163066+0000", 2024-09-12T18:37:33.983 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 30.803592058, 2024-09-12T18:37:33.983 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.077708377999999995, 2024-09-12T18:37:33.983 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:33.984 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:33.984 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:33.984 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:33.984 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:33.984 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:33.984 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167352 2024-09-12T18:37:33.984 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.984 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:33.984 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.984 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:33.984 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163066+0000", 2024-09-12T18:37:33.984 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:33.984 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.984 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.985 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:33.985 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163066+0000", 2024-09-12T18:37:33.985 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:33.985 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.985 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.985 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:33.985 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163067+0000", 2024-09-12T18:37:33.985 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0499999999999999e-06 2024-09-12T18:37:33.985 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.985 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.985 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:33.985 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163071+0000", 2024-09-12T18:37:33.985 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4340000000000002e-06 2024-09-12T18:37:33.986 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.986 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.986 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:33.986 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163081+0000", 2024-09-12T18:37:33.986 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0304e-05 2024-09-12T18:37:33.986 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.986 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.986 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:33.986 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163090+0000", 2024-09-12T18:37:33.986 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7309999999999999e-06 2024-09-12T18:37:33.986 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.986 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.986 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:33.987 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163143+0000", 2024-09-12T18:37:33.987 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2942000000000002e-05 2024-09-12T18:37:33.987 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.987 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.987 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:33.987 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163270+0000", 2024-09-12T18:37:33.987 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012664100000000001 2024-09-12T18:37:33.987 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.987 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.987 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:33.987 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163378+0000", 2024-09-12T18:37:33.987 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000107995 2024-09-12T18:37:33.987 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.988 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.988 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:33.988 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234552+0000", 2024-09-12T18:37:33.988 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.071173831000000007 2024-09-12T18:37:33.988 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.988 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.988 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:33.988 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240640+0000", 2024-09-12T18:37:33.988 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.006088909 2024-09-12T18:37:33.988 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.988 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.989 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:33.989 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240709+0000", 2024-09-12T18:37:33.989 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8393999999999996e-05 2024-09-12T18:37:33.989 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.989 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.989 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:33.989 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240774+0000", 2024-09-12T18:37:33.989 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5147000000000005e-05 2024-09-12T18:37:33.989 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:33.989 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:33.989 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:33.989 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.989 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.990 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167358 5.a 5:533f6738:::benchmark_data_smithi073_23739_object35081:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:33.990 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.165639+0000", 2024-09-12T18:37:33.990 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 30.801018781, 2024-09-12T18:37:33.990 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.075287509000000002, 2024-09-12T18:37:33.990 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:33.990 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:33.990 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:33.990 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:33.990 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:33.990 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:33.990 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167358 2024-09-12T18:37:33.990 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.990 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:33.991 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.991 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:33.991 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165639+0000", 2024-09-12T18:37:33.991 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:33.991 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.991 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.991 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:33.991 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165639+0000", 2024-09-12T18:37:33.991 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:33.991 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.991 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.991 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:33.991 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165640+0000", 2024-09-12T18:37:33.991 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1999999999999999e-06 2024-09-12T18:37:33.992 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.992 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.992 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:33.992 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165646+0000", 2024-09-12T18:37:33.992 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4550000000000003e-06 2024-09-12T18:37:33.992 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.992 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.992 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:33.992 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165658+0000", 2024-09-12T18:37:33.992 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2721999999999999e-05 2024-09-12T18:37:33.992 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.992 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.992 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:33.993 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165668+0000", 2024-09-12T18:37:33.993 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4229999999999994e-06 2024-09-12T18:37:33.993 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.993 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.993 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:33.993 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165711+0000", 2024-09-12T18:37:33.993 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3785999999999997e-05 2024-09-12T18:37:33.993 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.993 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.993 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:33.993 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165788+0000", 2024-09-12T18:37:33.993 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6506000000000002e-05 2024-09-12T18:37:33.994 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.994 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.994 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:33.994 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165862+0000", 2024-09-12T18:37:33.994 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4012999999999998e-05 2024-09-12T18:37:33.994 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.994 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.994 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:33.994 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234718+0000", 2024-09-12T18:37:33.994 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.068856420000000002 2024-09-12T18:37:33.994 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.995 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.995 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:33.995 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240785+0000", 2024-09-12T18:37:33.995 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0060661489999999998 2024-09-12T18:37:33.995 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.995 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.995 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:33.995 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240844+0000", 2024-09-12T18:37:33.995 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9487000000000002e-05 2024-09-12T18:37:33.995 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.995 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.995 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:33.995 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240926+0000", 2024-09-12T18:37:33.995 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2348000000000005e-05 2024-09-12T18:37:33.996 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:33.996 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:33.996 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:33.996 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.996 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.996 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167361 5.a 5:56730f28:::benchmark_data_smithi073_23739_object35084:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:33.996 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.165979+0000", 2024-09-12T18:37:33.996 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 30.800678801, 2024-09-12T18:37:33.996 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.075128337000000003, 2024-09-12T18:37:33.996 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:33.997 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:33.997 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:33.997 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:33.997 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:33.997 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:33.997 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167361 2024-09-12T18:37:33.997 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.997 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:33.997 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.997 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:33.997 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165979+0000", 2024-09-12T18:37:33.997 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:33.997 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.998 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.998 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:33.998 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165979+0000", 2024-09-12T18:37:33.998 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:33.998 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.998 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.998 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:33.998 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165980+0000", 2024-09-12T18:37:33.998 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4499999999999997e-07 2024-09-12T18:37:33.998 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.998 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.998 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:33.998 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165985+0000", 2024-09-12T18:37:33.998 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.186e-06 2024-09-12T18:37:33.999 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.999 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.999 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:33.999 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165995+0000", 2024-09-12T18:37:33.999 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0378e-05 2024-09-12T18:37:33.999 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.999 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:33.999 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:33.999 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.166016+0000", 2024-09-12T18:37:33.999 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1316999999999999e-05 2024-09-12T18:37:33.999 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:33.999 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.000 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:34.000 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.167783+0000", 2024-09-12T18:37:34.000 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017662209999999999 2024-09-12T18:37:34.000 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.000 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.000 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:34.000 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.167851+0000", 2024-09-12T18:37:34.000 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7990000000000005e-05 2024-09-12T18:37:34.000 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.000 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.000 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:34.001 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.167929+0000", 2024-09-12T18:37:34.001 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8829e-05 2024-09-12T18:37:34.001 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.001 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.001 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:34.001 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234832+0000", 2024-09-12T18:37:34.001 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066902378999999998 2024-09-12T18:37:34.001 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.001 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.001 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:34.001 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240941+0000", 2024-09-12T18:37:34.001 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0061087470000000003 2024-09-12T18:37:34.001 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.002 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.002 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:34.002 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241053+0000", 2024-09-12T18:37:34.002 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00011197299999999999 2024-09-12T18:37:34.002 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.002 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.002 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:34.002 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241107+0000", 2024-09-12T18:37:34.002 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4672000000000001e-05 2024-09-12T18:37:34.002 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:34.002 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:34.002 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:34.002 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.002 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.003 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167362 5.3 5:cbd73b47:::benchmark_data_smithi073_23739_object35085:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:34.003 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:34.003 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 30.798582086, 2024-09-12T18:37:34.003 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.067202411000000004, 2024-09-12T18:37:34.003 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:34.003 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:34.003 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:34.003 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:34.003 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:34.003 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:34.003 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167362 2024-09-12T18:37:34.003 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.003 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:34.004 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.004 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:34.004 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:34.004 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:34.004 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.004 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.004 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:34.004 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:34.004 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:34.004 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.004 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.005 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:34.005 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:34.005 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3600000000000003e-07 2024-09-12T18:37:34.005 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.005 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.005 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:34.005 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168079+0000", 2024-09-12T18:37:34.005 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7949999999999999e-06 2024-09-12T18:37:34.005 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.005 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.005 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:34.005 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168085+0000", 2024-09-12T18:37:34.005 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2110000000000003e-06 2024-09-12T18:37:34.005 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.006 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.006 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:34.006 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168089+0000", 2024-09-12T18:37:34.006 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0840000000000002e-06 2024-09-12T18:37:34.006 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.006 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.006 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:34.006 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168121+0000", 2024-09-12T18:37:34.006 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.1489000000000003e-05 2024-09-12T18:37:34.006 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.006 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.006 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:34.006 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168186+0000", 2024-09-12T18:37:34.007 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5313000000000003e-05 2024-09-12T18:37:34.007 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.007 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.007 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:34.007 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168242+0000", 2024-09-12T18:37:34.007 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5560999999999999e-05 2024-09-12T18:37:34.007 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.007 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.007 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:34.007 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234467+0000", 2024-09-12T18:37:34.007 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066225424000000005 2024-09-12T18:37:34.007 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.007 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.007 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:34.008 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235088+0000", 2024-09-12T18:37:34.008 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00062118999999999998 2024-09-12T18:37:34.008 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.008 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.008 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:34.008 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235197+0000", 2024-09-12T18:37:34.008 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00010825899999999999 2024-09-12T18:37:34.008 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.008 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.008 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:34.008 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235278+0000", 2024-09-12T18:37:34.008 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1448999999999999e-05 2024-09-12T18:37:34.009 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:34.009 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:34.009 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:34.009 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.009 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.009 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167366 5.a 5:58e6a467:::benchmark_data_smithi073_23739_object35089:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:34.009 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168263+0000", 2024-09-12T18:37:34.009 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 30.798394549000001, 2024-09-12T18:37:34.009 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.078184744, 2024-09-12T18:37:34.009 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:34.009 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:34.010 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:34.010 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:34.010 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:34.010 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:34.010 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167366 2024-09-12T18:37:34.010 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.010 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:34.010 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.010 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:34.010 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168263+0000", 2024-09-12T18:37:34.010 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:34.010 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.010 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.011 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:34.011 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168263+0000", 2024-09-12T18:37:34.011 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:34.011 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.011 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.011 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:34.011 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168264+0000", 2024-09-12T18:37:34.011 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5700000000000002e-07 2024-09-12T18:37:34.011 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.011 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.011 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:34.011 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168266+0000", 2024-09-12T18:37:34.011 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1789999999999998e-06 2024-09-12T18:37:34.011 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.012 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.012 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:34.012 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168271+0000", 2024-09-12T18:37:34.012 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8160000000000001e-06 2024-09-12T18:37:34.012 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.012 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.012 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:34.012 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168275+0000", 2024-09-12T18:37:34.012 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4440000000000001e-06 2024-09-12T18:37:34.012 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.012 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.012 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:34.013 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170082+0000", 2024-09-12T18:37:34.013 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0018068800000000001 2024-09-12T18:37:34.013 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.013 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.013 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:34.013 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170154+0000", 2024-09-12T18:37:34.013 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1575000000000005e-05 2024-09-12T18:37:34.013 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.013 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.013 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:34.013 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170216+0000", 2024-09-12T18:37:34.013 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1989999999999994e-05 2024-09-12T18:37:34.013 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.013 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.014 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:34.014 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234933+0000", 2024-09-12T18:37:34.014 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064717514000000004 2024-09-12T18:37:34.014 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.014 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.014 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:34.014 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246226+0000", 2024-09-12T18:37:34.014 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011293151 2024-09-12T18:37:34.014 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.014 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.014 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:34.014 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246338+0000", 2024-09-12T18:37:34.014 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00011225 2024-09-12T18:37:34.014 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.015 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.015 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:34.015 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246448+0000", 2024-09-12T18:37:34.015 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000109388 2024-09-12T18:37:34.015 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:34.015 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:34.015 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:34.015 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.015 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.015 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167367 5.a 5:51778d97:::benchmark_data_smithi073_23739_object35090:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:34.015 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168388+0000", 2024-09-12T18:37:34.015 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 30.798269305000002, 2024-09-12T18:37:34.016 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.082583860999999995, 2024-09-12T18:37:34.016 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:34.016 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:34.016 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:34.016 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:34.016 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:34.016 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:34.016 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167367 2024-09-12T18:37:34.016 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.016 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:34.016 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.016 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:34.016 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168388+0000", 2024-09-12T18:37:34.017 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:34.017 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.017 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.017 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:34.017 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168388+0000", 2024-09-12T18:37:34.017 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:34.017 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.017 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.017 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:34.017 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168389+0000", 2024-09-12T18:37:34.017 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1099999999999996e-07 2024-09-12T18:37:34.018 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.018 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.018 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:34.018 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168391+0000", 2024-09-12T18:37:34.018 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.39e-06 2024-09-12T18:37:34.018 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.018 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.018 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:34.018 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168396+0000", 2024-09-12T18:37:34.018 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3460000000000004e-06 2024-09-12T18:37:34.018 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.019 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.019 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:34.019 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168399+0000", 2024-09-12T18:37:34.019 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.613e-06 2024-09-12T18:37:34.019 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.019 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.019 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:34.019 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235003+0000", 2024-09-12T18:37:34.019 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066603851000000006 2024-09-12T18:37:34.019 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.019 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.020 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:34.020 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235266+0000", 2024-09-12T18:37:34.020 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00026270999999999998 2024-09-12T18:37:34.020 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.020 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.020 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:34.020 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235510+0000", 2024-09-12T18:37:34.020 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00024394 2024-09-12T18:37:34.020 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.020 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.020 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:34.020 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246546+0000", 2024-09-12T18:37:34.020 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011035774 2024-09-12T18:37:34.021 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.021 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.021 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:34.021 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.250808+0000", 2024-09-12T18:37:34.021 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0042622700000000003 2024-09-12T18:37:34.021 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.021 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.021 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:34.021 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.250890+0000", 2024-09-12T18:37:34.021 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1874999999999998e-05 2024-09-12T18:37:34.021 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.022 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.022 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:34.022 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.250972+0000", 2024-09-12T18:37:34.022 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2581000000000001e-05 2024-09-12T18:37:34.022 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:34.022 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:34.022 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:34.022 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.022 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.022 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167370 5.a 5:5aab9477:::benchmark_data_smithi073_23739_object35093:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:34.022 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168603+0000", 2024-09-12T18:37:34.023 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 30.798054369999999, 2024-09-12T18:37:34.023 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.086603794999999997, 2024-09-12T18:37:34.023 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:34.023 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:34.023 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:34.023 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:34.023 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:34.023 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:34.023 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167370 2024-09-12T18:37:34.023 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.023 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:34.024 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.024 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:34.024 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168603+0000", 2024-09-12T18:37:34.024 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:34.024 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.024 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.024 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:34.024 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168603+0000", 2024-09-12T18:37:34.024 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:34.024 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.024 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.024 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:34.024 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168604+0000", 2024-09-12T18:37:34.025 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.1899999999999998e-07 2024-09-12T18:37:34.025 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.025 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.025 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:34.025 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168606+0000", 2024-09-12T18:37:34.025 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8309999999999999e-06 2024-09-12T18:37:34.025 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.025 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.025 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:34.025 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168610+0000", 2024-09-12T18:37:34.025 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8069999999999999e-06 2024-09-12T18:37:34.025 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.025 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.025 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:34.026 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168613+0000", 2024-09-12T18:37:34.026 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.118e-06 2024-09-12T18:37:34.026 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.026 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.026 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:34.026 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241145+0000", 2024-09-12T18:37:34.026 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.072531678000000002 2024-09-12T18:37:34.026 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.026 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.026 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:34.026 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241342+0000", 2024-09-12T18:37:34.026 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00019635900000000001 2024-09-12T18:37:34.026 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.027 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.027 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:34.027 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241483+0000", 2024-09-12T18:37:34.027 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014161100000000001 2024-09-12T18:37:34.027 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.027 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.027 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:34.027 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255039+0000", 2024-09-12T18:37:34.027 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013555724 2024-09-12T18:37:34.027 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.027 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.027 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:34.028 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255062+0000", 2024-09-12T18:37:34.028 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.3042000000000001e-05 2024-09-12T18:37:34.028 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.028 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.028 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:34.028 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255143+0000", 2024-09-12T18:37:34.028 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0999000000000002e-05 2024-09-12T18:37:34.028 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.028 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.028 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:34.028 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255207+0000", 2024-09-12T18:37:34.028 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4207000000000004e-05 2024-09-12T18:37:34.028 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:34.029 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:34.029 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:34.029 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.029 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.029 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167352 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:34.029 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:34.029 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 30.797929715999999, 2024-09-12T18:37:34.029 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065859953999999998, 2024-09-12T18:37:34.029 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:34.029 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:34.029 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:34.029 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:34.029 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.029 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:34.030 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:34.030 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:34.030 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.030 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.030 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:34.030 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:34.030 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:34.030 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.030 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.030 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:34.031 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:34.031 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.0800000000000001e-07 2024-09-12T18:37:34.031 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.031 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.031 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:34.031 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168730+0000", 2024-09-12T18:37:34.031 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6530000000000001e-06 2024-09-12T18:37:34.031 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.031 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.032 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:34.032 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168734+0000", 2024-09-12T18:37:34.032 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.721e-06 2024-09-12T18:37:34.032 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.032 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.032 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:34.032 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168736+0000", 2024-09-12T18:37:34.032 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.508e-06 2024-09-12T18:37:34.033 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.033 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.033 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:34.033 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171951+0000", 2024-09-12T18:37:34.033 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.003215281 2024-09-12T18:37:34.033 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.033 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.033 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:34.033 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234520+0000", 2024-09-12T18:37:34.033 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062568676000000004 2024-09-12T18:37:34.033 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.034 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.034 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:34.034 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234588+0000", 2024-09-12T18:37:34.034 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7806999999999996e-05 2024-09-12T18:37:34.034 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:34.034 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:34.034 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:34.034 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.034 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.034 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167368 5.4 e58/21 5:29a1ec58:::benchmark_data_smithi073_23739_object35091:head v 58'10399, mlcod=58'10396)", 2024-09-12T18:37:34.034 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:34.034 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 30.797806698999999, 2024-09-12T18:37:34.034 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066008885000000003, 2024-09-12T18:37:34.034 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:34.035 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:34.035 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:34.035 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:34.035 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.035 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:34.035 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:34.035 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:34.035 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.035 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.035 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:34.035 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:34.035 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:34.035 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.036 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.036 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:34.036 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:34.036 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4699999999999998e-07 2024-09-12T18:37:34.036 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.036 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.036 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:34.036 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168854+0000", 2024-09-12T18:37:34.036 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.3180000000000001e-06 2024-09-12T18:37:34.036 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.036 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.036 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:34.036 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168858+0000", 2024-09-12T18:37:34.036 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2799999999999997e-06 2024-09-12T18:37:34.037 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.037 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.037 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:34.037 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168861+0000", 2024-09-12T18:37:34.037 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7650000000000002e-06 2024-09-12T18:37:34.037 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.037 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.037 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:34.037 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168895+0000", 2024-09-12T18:37:34.037 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4533999999999998e-05 2024-09-12T18:37:34.037 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.037 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.037 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:34.038 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168906+0000", 2024-09-12T18:37:34.038 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0910000000000001e-05 2024-09-12T18:37:34.038 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.038 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.038 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:34.038 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234784+0000", 2024-09-12T18:37:34.038 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065877656000000007 2024-09-12T18:37:34.038 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.038 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.038 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:34.038 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234860+0000", 2024-09-12T18:37:34.039 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6174999999999995e-05 2024-09-12T18:37:34.039 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:34.039 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:34.039 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:34.039 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.039 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.039 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167358 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:34.039 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.170373+0000", 2024-09-12T18:37:34.039 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 30.796284417999999, 2024-09-12T18:37:34.039 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064370201000000002, 2024-09-12T18:37:34.039 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:34.039 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:34.039 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:34.039 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:34.039 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.040 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:34.040 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170373+0000", 2024-09-12T18:37:34.040 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:34.040 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.040 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.040 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:34.040 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170373+0000", 2024-09-12T18:37:34.040 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:34.040 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.040 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.040 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:34.040 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170374+0000", 2024-09-12T18:37:34.040 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5799999999999998e-07 2024-09-12T18:37:34.040 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.041 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.041 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:34.041 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170378+0000", 2024-09-12T18:37:34.041 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.732e-06 2024-09-12T18:37:34.041 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.041 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.041 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:34.041 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170388+0000", 2024-09-12T18:37:34.042 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0212e-05 2024-09-12T18:37:34.042 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.042 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.042 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:34.042 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170397+0000", 2024-09-12T18:37:34.042 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7090000000000008e-06 2024-09-12T18:37:34.042 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.042 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.042 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:34.042 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234682+0000", 2024-09-12T18:37:34.042 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064285518999999999 2024-09-12T18:37:34.042 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.043 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.043 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:34.043 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234703+0000", 2024-09-12T18:37:34.043 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.0199000000000001e-05 2024-09-12T18:37:34.043 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.043 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.043 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:34.043 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234743+0000", 2024-09-12T18:37:34.043 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0972e-05 2024-09-12T18:37:34.043 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:34.043 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:34.043 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:34.043 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.044 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.044 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167372 5.c 5:398d36a7:::benchmark_data_smithi073_23739_object35095:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:34.044 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171066+0000", 2024-09-12T18:37:34.044 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 30.795591206000001, 2024-09-12T18:37:34.044 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065889534999999999, 2024-09-12T18:37:34.044 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:34.044 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:34.044 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:34.044 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:34.044 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:34.044 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:34.044 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167372 2024-09-12T18:37:34.045 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.045 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:34.045 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.045 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:34.045 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171066+0000", 2024-09-12T18:37:34.045 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:34.045 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.045 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.045 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:34.045 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171066+0000", 2024-09-12T18:37:34.045 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:34.045 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.045 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.045 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:34.046 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171068+0000", 2024-09-12T18:37:34.046 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.186e-06 2024-09-12T18:37:34.046 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.046 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.046 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:34.046 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171072+0000", 2024-09-12T18:37:34.046 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3560000000000003e-06 2024-09-12T18:37:34.046 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.046 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.046 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:34.046 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171082+0000", 2024-09-12T18:37:34.046 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.9739999999999997e-06 2024-09-12T18:37:34.046 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.046 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.047 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:34.047 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171089+0000", 2024-09-12T18:37:34.047 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7159999999999997e-06 2024-09-12T18:37:34.047 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.047 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.047 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:34.047 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171133+0000", 2024-09-12T18:37:34.047 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4091999999999997e-05 2024-09-12T18:37:34.047 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.047 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.047 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:34.047 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171221+0000", 2024-09-12T18:37:34.047 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.8108000000000004e-05 2024-09-12T18:37:34.048 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.048 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.048 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:34.048 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171279+0000", 2024-09-12T18:37:34.048 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8062000000000001e-05 2024-09-12T18:37:34.048 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.048 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.048 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:34.048 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235007+0000", 2024-09-12T18:37:34.048 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.063727849000000003 2024-09-12T18:37:34.048 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.048 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.048 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:34.049 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236790+0000", 2024-09-12T18:37:34.049 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017829269999999999 2024-09-12T18:37:34.049 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.049 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.049 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:34.049 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236881+0000", 2024-09-12T18:37:34.049 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1347999999999993e-05 2024-09-12T18:37:34.049 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.049 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.049 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:34.049 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236956+0000", 2024-09-12T18:37:34.049 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4917000000000001e-05 2024-09-12T18:37:34.050 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:34.050 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:34.050 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:34.050 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.050 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.050 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167371 5.4 e58/21 5:24fea27c:::benchmark_data_smithi073_23739_object35094:head v 58'10400, mlcod=58'10397)", 2024-09-12T18:37:34.050 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171273+0000", 2024-09-12T18:37:34.050 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 30.795384632000001, 2024-09-12T18:37:34.050 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065500368000000003, 2024-09-12T18:37:34.050 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:34.050 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:34.050 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:34.050 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:34.050 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.051 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:34.051 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171273+0000", 2024-09-12T18:37:34.051 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:34.051 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.051 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.051 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:34.051 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171273+0000", 2024-09-12T18:37:34.051 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:34.051 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.051 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.051 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:34.052 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171274+0000", 2024-09-12T18:37:34.052 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0399999999999996e-07 2024-09-12T18:37:34.052 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.052 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.052 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:34.052 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171277+0000", 2024-09-12T18:37:34.052 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8689999999999997e-06 2024-09-12T18:37:34.052 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.052 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.053 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:34.053 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171284+0000", 2024-09-12T18:37:34.053 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2879999999999998e-06 2024-09-12T18:37:34.053 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.053 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.053 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:34.053 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171289+0000", 2024-09-12T18:37:34.053 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9049999999999996e-06 2024-09-12T18:37:34.053 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.053 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.053 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:34.053 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171322+0000", 2024-09-12T18:37:34.053 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3781000000000001e-05 2024-09-12T18:37:34.054 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.054 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.054 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:34.054 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171335+0000", 2024-09-12T18:37:34.054 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2639999999999999e-05 2024-09-12T18:37:34.054 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.054 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.054 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:34.054 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236691+0000", 2024-09-12T18:37:34.054 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065355835000000001 2024-09-12T18:37:34.054 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.054 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.055 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:34.055 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236773+0000", 2024-09-12T18:37:34.055 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2546000000000006e-05 2024-09-12T18:37:34.055 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:34.055 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:34.055 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:34.055 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.055 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.055 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167364 5.7 e58/21 5:ee50096a:::benchmark_data_smithi073_23739_object35087:head v 58'10504, mlcod=58'10502)", 2024-09-12T18:37:34.055 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171598+0000", 2024-09-12T18:37:34.055 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 30.795059512999998, 2024-09-12T18:37:34.055 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065149069000000004, 2024-09-12T18:37:34.055 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:34.056 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:34.056 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:34.056 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:34.056 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.056 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:34.056 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171598+0000", 2024-09-12T18:37:34.056 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:34.056 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.056 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.056 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:34.056 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171598+0000", 2024-09-12T18:37:34.056 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:34.056 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.057 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.057 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:34.057 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171599+0000", 2024-09-12T18:37:34.057 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6700000000000003e-07 2024-09-12T18:37:34.057 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.057 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.057 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:34.057 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171602+0000", 2024-09-12T18:37:34.057 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.841e-06 2024-09-12T18:37:34.057 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.057 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.057 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:34.057 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171608+0000", 2024-09-12T18:37:34.057 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9259999999999997e-06 2024-09-12T18:37:34.058 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.058 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.058 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:34.058 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171611+0000", 2024-09-12T18:37:34.058 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.9450000000000003e-06 2024-09-12T18:37:34.058 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.058 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.058 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:34.058 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171650+0000", 2024-09-12T18:37:34.058 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8464000000000003e-05 2024-09-12T18:37:34.058 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.059 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.059 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:34.059 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171662+0000", 2024-09-12T18:37:34.059 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1603999999999999e-05 2024-09-12T18:37:34.059 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.059 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.059 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:34.059 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236663+0000", 2024-09-12T18:37:34.059 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065001330999999996 2024-09-12T18:37:34.059 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.059 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.059 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:34.059 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236747+0000", 2024-09-12T18:37:34.059 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.4390999999999999e-05 2024-09-12T18:37:34.059 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:34.060 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:34.060 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:34.060 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.060 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.060 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167365 5.2 e58/21 5:4107875c:::benchmark_data_smithi073_23739_object35088:head v 58'10351, mlcod=58'10349)", 2024-09-12T18:37:34.060 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171733+0000", 2024-09-12T18:37:34.060 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 30.794924468000001, 2024-09-12T18:37:34.060 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.074804168000000004, 2024-09-12T18:37:34.060 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:34.060 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:34.060 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:34.060 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:34.060 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.060 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:34.061 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171733+0000", 2024-09-12T18:37:34.061 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:34.061 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.061 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.061 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:34.061 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171733+0000", 2024-09-12T18:37:34.061 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:34.061 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.061 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.061 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:34.061 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171734+0000", 2024-09-12T18:37:34.061 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9299999999999998e-07 2024-09-12T18:37:34.061 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.062 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.062 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:34.062 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171738+0000", 2024-09-12T18:37:34.062 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.301e-06 2024-09-12T18:37:34.062 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.062 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.062 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:34.062 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171746+0000", 2024-09-12T18:37:34.062 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.554e-06 2024-09-12T18:37:34.062 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.062 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.063 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:34.063 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171751+0000", 2024-09-12T18:37:34.063 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1880000000000001e-06 2024-09-12T18:37:34.063 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.063 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.063 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:34.063 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234659+0000", 2024-09-12T18:37:34.063 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062907807999999996 2024-09-12T18:37:34.063 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.063 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.063 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:34.063 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234708+0000", 2024-09-12T18:37:34.063 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8992000000000001e-05 2024-09-12T18:37:34.064 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.064 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.064 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:34.064 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246457+0000", 2024-09-12T18:37:34.064 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.01174974 2024-09-12T18:37:34.064 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.064 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.064 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:34.064 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246537+0000", 2024-09-12T18:37:34.064 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.9992000000000003e-05 2024-09-12T18:37:34.064 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:34.064 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:34.065 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:34.065 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.065 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.065 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167373 5.5 e58/49 5:ad283029:::benchmark_data_smithi073_23739_object35096:head v 58'10600, mlcod=58'10598)", 2024-09-12T18:37:34.065 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:34.065 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 30.794896984000001, 2024-09-12T18:37:34.065 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065058240000000003, 2024-09-12T18:37:34.065 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:34.066 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:34.066 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:34.066 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:34.066 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.066 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:34.066 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:34.066 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:34.066 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.066 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.066 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:34.066 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:34.066 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:34.067 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.067 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.067 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:34.067 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:34.067 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.2899999999999999e-07 2024-09-12T18:37:34.067 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.067 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.067 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:34.067 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171764+0000", 2024-09-12T18:37:34.067 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7310000000000002e-06 2024-09-12T18:37:34.068 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.068 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.068 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:34.068 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171769+0000", 2024-09-12T18:37:34.068 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.079e-06 2024-09-12T18:37:34.068 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.068 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.068 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:34.068 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171774+0000", 2024-09-12T18:37:34.069 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.48e-06 2024-09-12T18:37:34.069 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.069 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.069 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:34.069 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171819+0000", 2024-09-12T18:37:34.069 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4391999999999998e-05 2024-09-12T18:37:34.069 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.069 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.069 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:34.069 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171841+0000", 2024-09-12T18:37:34.069 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2245000000000001e-05 2024-09-12T18:37:34.069 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.069 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.070 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:34.070 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236750+0000", 2024-09-12T18:37:34.070 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064909123999999999 2024-09-12T18:37:34.070 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.070 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.070 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:34.070 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236819+0000", 2024-09-12T18:37:34.070 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8860000000000001e-05 2024-09-12T18:37:34.070 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:34.070 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:34.070 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:34.070 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.070 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.070 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167361 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:34.071 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:34.071 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 30.794841078000001, 2024-09-12T18:37:34.071 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.063049426000000006, 2024-09-12T18:37:34.071 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:34.071 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:34.071 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:34.071 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:34.071 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.071 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:34.071 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:34.071 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:34.071 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.071 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.072 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:34.072 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:34.072 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:34.072 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.072 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.072 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:34.072 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:34.072 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.9099999999999999e-07 2024-09-12T18:37:34.072 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.072 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.073 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:34.073 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171820+0000", 2024-09-12T18:37:34.073 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.5900000000000002e-06 2024-09-12T18:37:34.073 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.073 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.073 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:34.073 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171826+0000", 2024-09-12T18:37:34.073 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.64e-06 2024-09-12T18:37:34.073 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.073 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.073 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:34.073 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171831+0000", 2024-09-12T18:37:34.073 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.578e-06 2024-09-12T18:37:34.074 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.074 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.074 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:34.074 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234808+0000", 2024-09-12T18:37:34.074 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062976780999999996 2024-09-12T18:37:34.074 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.074 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.074 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:34.074 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234821+0000", 2024-09-12T18:37:34.074 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3002e-05 2024-09-12T18:37:34.074 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.074 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.074 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:34.075 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234866+0000", 2024-09-12T18:37:34.075 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5444000000000001e-05 2024-09-12T18:37:34.075 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:34.075 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:34.075 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:34.075 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.075 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.075 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167366 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:34.075 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.172133+0000", 2024-09-12T18:37:34.075 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 30.794524249999998, 2024-09-12T18:37:34.075 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062815840999999997, 2024-09-12T18:37:34.076 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:34.076 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:34.076 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:34.076 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:34.076 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.076 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:34.076 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172133+0000", 2024-09-12T18:37:34.076 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:34.076 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.076 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.076 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:34.076 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172133+0000", 2024-09-12T18:37:34.076 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:34.077 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.077 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.077 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:34.077 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172134+0000", 2024-09-12T18:37:34.077 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5000000000000003e-07 2024-09-12T18:37:34.077 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.077 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.077 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:34.077 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172137+0000", 2024-09-12T18:37:34.077 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.6460000000000002e-06 2024-09-12T18:37:34.077 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.077 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.078 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:34.078 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234511+0000", 2024-09-12T18:37:34.078 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062374603000000001 2024-09-12T18:37:34.078 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.078 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.078 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:34.078 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234525+0000", 2024-09-12T18:37:34.078 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3396e-05 2024-09-12T18:37:34.078 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.078 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.078 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:34.078 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234909+0000", 2024-09-12T18:37:34.078 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00038405299999999998 2024-09-12T18:37:34.078 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.079 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.079 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:34.079 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234922+0000", 2024-09-12T18:37:34.079 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3274e-05 2024-09-12T18:37:34.079 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.079 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.079 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:34.079 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234949+0000", 2024-09-12T18:37:34.079 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7319000000000001e-05 2024-09-12T18:37:34.079 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:34.079 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:34.079 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:34.079 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.080 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.080 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167369 5.7 e58/21 5:e64ecabd:::benchmark_data_smithi073_23739_object35092:head v 58'10505, mlcod=58'10502)", 2024-09-12T18:37:34.080 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:34.080 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 30.792993857999999, 2024-09-12T18:37:34.080 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.063873773999999994, 2024-09-12T18:37:34.080 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:34.080 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:34.080 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:34.080 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:34.080 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.080 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:34.080 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:34.081 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:34.081 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.081 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.081 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:34.081 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:34.081 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:34.081 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.081 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.082 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:34.082 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:34.082 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3500000000000002e-07 2024-09-12T18:37:34.082 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.082 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.082 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:34.082 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173668+0000", 2024-09-12T18:37:34.082 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4000000000000001e-06 2024-09-12T18:37:34.082 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.082 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.082 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:34.082 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234583+0000", 2024-09-12T18:37:34.082 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.060914889 2024-09-12T18:37:34.083 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.083 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.083 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:34.083 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234600+0000", 2024-09-12T18:37:34.083 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7192000000000001e-05 2024-09-12T18:37:34.083 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.083 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.083 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:34.083 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234791+0000", 2024-09-12T18:37:34.083 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00019115000000000001 2024-09-12T18:37:34.083 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.084 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.084 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:34.084 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234834+0000", 2024-09-12T18:37:34.084 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3296e-05 2024-09-12T18:37:34.084 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.084 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.084 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:34.084 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.237481+0000", 2024-09-12T18:37:34.084 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0026472050000000001 2024-09-12T18:37:34.084 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:34.084 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:34.084 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:34.084 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.237538+0000", 2024-09-12T18:37:34.085 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6206999999999999e-05 2024-09-12T18:37:34.085 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:34.085 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:34.085 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:34.085 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:34.085 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:34.085 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:34.086 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:34.084+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:34.087 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:37:34.187 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:34.178+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:34.243 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:34.243 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:37:34.244 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.244 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:231407 5.b 5:da31c5dd:::benchmark_data_smithi073_23739_object99130:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T18:37:34.244 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:34.235860+0000", 2024-09-12T18:37:34.244 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0047441009999999997, 2024-09-12T18:37:34.244 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0047671889999999998, 2024-09-12T18:37:34.244 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:34.244 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:34.244 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:34.244 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:34.244 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:34.244 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:34.245 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 231407 2024-09-12T18:37:34.245 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.245 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:34.245 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.245 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:34.245 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.235860+0000", 2024-09-12T18:37:34.245 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:34.245 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.245 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.245 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:34.245 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.235860+0000", 2024-09-12T18:37:34.245 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:34.245 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.245 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.246 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:34.246 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.235861+0000", 2024-09-12T18:37:34.246 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9400000000000004e-07 2024-09-12T18:37:34.246 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.246 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.246 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:34.246 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.235864+0000", 2024-09-12T18:37:34.246 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.72e-06 2024-09-12T18:37:34.246 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.246 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.246 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:34.246 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.235875+0000", 2024-09-12T18:37:34.246 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0791999999999999e-05 2024-09-12T18:37:34.247 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.247 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.247 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:34.247 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.235880+0000", 2024-09-12T18:37:34.247 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6700000000000002e-06 2024-09-12T18:37:34.247 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.247 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.247 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:34.247 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.235949+0000", 2024-09-12T18:37:34.247 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9678999999999995e-05 2024-09-12T18:37:34.248 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.248 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.248 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:34.248 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.236115+0000", 2024-09-12T18:37:34.248 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000165978 2024-09-12T18:37:34.248 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.248 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.248 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:34.248 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.236275+0000", 2024-09-12T18:37:34.248 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015997599999999999 2024-09-12T18:37:34.248 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.248 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.248 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:34.249 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.238674+0000", 2024-09-12T18:37:34.249 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0023982309999999998 2024-09-12T18:37:34.249 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:34.249 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:34.249 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:34.249 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.249 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.249 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:231409 5.e 5:773600c5:::benchmark_data_smithi073_23739_object99132:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T18:37:34.249 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:34.235894+0000", 2024-09-12T18:37:34.249 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0047099689999999996, 2024-09-12T18:37:34.249 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0048138490000000003, 2024-09-12T18:37:34.249 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:34.250 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:34.250 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:34.250 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:34.250 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:34.250 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:34.250 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 231409 2024-09-12T18:37:34.250 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.250 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:34.250 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.250 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:34.250 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.235894+0000", 2024-09-12T18:37:34.250 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:34.251 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.251 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.251 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:34.251 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.235894+0000", 2024-09-12T18:37:34.251 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:34.251 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.251 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.251 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:34.251 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.235894+0000", 2024-09-12T18:37:34.251 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.46e-07 2024-09-12T18:37:34.251 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.251 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.251 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:34.252 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.235896+0000", 2024-09-12T18:37:34.252 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7749999999999999e-06 2024-09-12T18:37:34.252 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.252 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.252 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:34.252 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.235901+0000", 2024-09-12T18:37:34.252 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1170000000000003e-06 2024-09-12T18:37:34.252 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.252 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.252 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:34.252 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.235904+0000", 2024-09-12T18:37:34.252 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9780000000000001e-06 2024-09-12T18:37:34.253 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.253 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.253 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:34.253 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.235968+0000", 2024-09-12T18:37:34.253 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4337000000000004e-05 2024-09-12T18:37:34.253 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.253 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.253 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:34.253 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.236102+0000", 2024-09-12T18:37:34.253 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000133149 2024-09-12T18:37:34.253 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.253 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.254 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:34.254 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.236220+0000", 2024-09-12T18:37:34.254 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000118658 2024-09-12T18:37:34.254 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.254 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.254 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:34.254 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.238712+0000", 2024-09-12T18:37:34.254 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0024917260000000001 2024-09-12T18:37:34.254 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:34.254 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:34.254 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:34.254 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.254 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.254 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:231406 5.a e72/21 5:5a8d71a2:::benchmark_data_smithi073_23739_object99129:head v 72'14647, mlcod=72'14644)", 2024-09-12T18:37:34.255 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:34.238348+0000", 2024-09-12T18:37:34.255 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0022553460000000001, 2024-09-12T18:37:34.255 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0024304050000000001, 2024-09-12T18:37:34.255 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:34.255 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:34.255 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:37:34.255 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:34.255 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.255 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:34.255 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.238348+0000", 2024-09-12T18:37:34.255 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:34.256 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.256 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.256 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:34.256 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.238348+0000", 2024-09-12T18:37:34.256 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:34.256 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.256 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.256 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:34.256 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.238349+0000", 2024-09-12T18:37:34.256 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.96e-07 2024-09-12T18:37:34.256 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.257 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.257 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:34.257 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.238353+0000", 2024-09-12T18:37:34.257 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1679999999999997e-06 2024-09-12T18:37:34.257 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.257 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.257 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:34.257 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.238363+0000", 2024-09-12T18:37:34.257 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5249999999999994e-06 2024-09-12T18:37:34.257 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.257 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.258 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:34.258 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.238371+0000", 2024-09-12T18:37:34.258 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0790000000000001e-06 2024-09-12T18:37:34.258 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.258 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.258 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:34.258 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.238484+0000", 2024-09-12T18:37:34.258 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011332600000000001 2024-09-12T18:37:34.258 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.258 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.258 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:34.258 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.238504+0000", 2024-09-12T18:37:34.258 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0310999999999999e-05 2024-09-12T18:37:34.258 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:34.259 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:34.259 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:34.259 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.259 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.259 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:231415 5.0 5:05037aff:::benchmark_data_smithi073_23739_object99138:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T18:37:34.259 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:34.239166+0000", 2024-09-12T18:37:34.259 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0014381520000000001, 2024-09-12T18:37:34.259 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016732850000000001, 2024-09-12T18:37:34.259 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:34.259 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:34.259 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:34.259 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:34.259 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:34.260 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:34.260 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 231415 2024-09-12T18:37:34.260 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.260 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:34.260 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.260 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:34.260 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.239166+0000", 2024-09-12T18:37:34.260 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:34.260 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.260 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.260 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:34.260 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.239166+0000", 2024-09-12T18:37:34.260 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:34.260 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.261 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.261 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:34.261 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.239167+0000", 2024-09-12T18:37:34.261 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9900000000000009e-07 2024-09-12T18:37:34.261 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.261 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.261 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:34.261 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.239171+0000", 2024-09-12T18:37:34.261 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9559999999999999e-06 2024-09-12T18:37:34.261 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.261 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.261 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:34.261 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.239255+0000", 2024-09-12T18:37:34.261 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4163e-05 2024-09-12T18:37:34.262 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.262 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.262 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:34.262 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.239264+0000", 2024-09-12T18:37:34.262 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4150000000000005e-06 2024-09-12T18:37:34.262 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.262 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.262 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:34.262 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.239692+0000", 2024-09-12T18:37:34.262 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00042794600000000001 2024-09-12T18:37:34.262 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.262 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.262 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:34.262 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.239832+0000", 2024-09-12T18:37:34.263 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013981900000000001 2024-09-12T18:37:34.263 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.263 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.263 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:34.263 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.239955+0000", 2024-09-12T18:37:34.263 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012333900000000001 2024-09-12T18:37:34.263 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:34.263 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:34.263 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:34.263 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.263 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.263 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:231416 5.4 5:29d22a6e:::benchmark_data_smithi073_23739_object99139:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T18:37:34.263 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:34.239280+0000", 2024-09-12T18:37:34.263 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.001323388, 2024-09-12T18:37:34.264 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016255359999999999, 2024-09-12T18:37:34.264 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:34.264 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:34.264 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:34.264 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:34.264 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:34.264 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:34.264 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 231416 2024-09-12T18:37:34.264 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.264 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:34.264 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.264 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:34.264 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.239280+0000", 2024-09-12T18:37:34.265 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:34.265 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.265 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.265 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:34.265 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.239280+0000", 2024-09-12T18:37:34.265 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:34.265 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.265 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.265 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:34.265 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.239281+0000", 2024-09-12T18:37:34.265 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7100000000000001e-07 2024-09-12T18:37:34.265 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.265 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.266 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:34.266 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.239285+0000", 2024-09-12T18:37:34.266 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7069999999999998e-06 2024-09-12T18:37:34.266 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.266 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.266 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:34.266 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.239292+0000", 2024-09-12T18:37:34.266 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5719999999999997e-06 2024-09-12T18:37:34.266 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.266 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.267 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:34.267 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.239299+0000", 2024-09-12T18:37:34.267 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9870000000000002e-06 2024-09-12T18:37:34.267 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.267 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.267 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:34.267 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.240542+0000", 2024-09-12T18:37:34.267 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00124255 2024-09-12T18:37:34.267 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.267 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.267 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:34.267 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.240655+0000", 2024-09-12T18:37:34.268 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011317200000000001 2024-09-12T18:37:34.268 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.268 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.268 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:34.268 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.240766+0000", 2024-09-12T18:37:34.268 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000110707 2024-09-12T18:37:34.268 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:34.268 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:34.268 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:34.269 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.269 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.269 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:231412 5.a e72/21)", 2024-09-12T18:37:34.269 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:34.239800+0000", 2024-09-12T18:37:34.269 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00080390699999999997, 2024-09-12T18:37:34.269 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011626449999999999, 2024-09-12T18:37:34.269 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:34.269 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:34.269 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:34.269 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:34.270 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.270 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:34.270 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.239800+0000", 2024-09-12T18:37:34.270 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:34.270 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.270 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.270 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:34.270 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.239800+0000", 2024-09-12T18:37:34.270 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:34.270 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.270 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.270 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:34.270 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.239801+0000", 2024-09-12T18:37:34.270 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6400000000000002e-07 2024-09-12T18:37:34.271 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.271 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.271 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:34.271 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.239806+0000", 2024-09-12T18:37:34.271 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2859999999999999e-06 2024-09-12T18:37:34.271 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.271 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.271 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:34.271 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.239814+0000", 2024-09-12T18:37:34.271 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3669999999999997e-06 2024-09-12T18:37:34.271 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:34.271 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:34.271 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:34.271 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:34.239823+0000", 2024-09-12T18:37:34.271 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6989999999999992e-06 2024-09-12T18:37:34.272 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:34.272 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:34.272 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:34.272 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:34.272 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-09-12T18:37:34.272 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 6 2024-09-12T18:37:34.272 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:34.272 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:37:34.273 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:37:34.318 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:34.315+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:34.389 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:34.382+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:34.396 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:34.396 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-09-12T18:37:34.396 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-09-12T18:37:34.396 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-09-12T18:37:34.397 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:34.411 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:37:34.427 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:37:34.427 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:37:34.447 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:37:34.448 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:37:34.468 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:37:34.469 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:37:34.490 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:34.486+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:34.579 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:34.579 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:34.591 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:34.582+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:34.592 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:37:34.692 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:34.686+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:34.720 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:34.720 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:34.734 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:37:34.793 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:34.787+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:34.852 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:34.852 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:34.865 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:37:34.910 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:34.906+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:34.987 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:34.987 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:34.993 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:34.987+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:35.001 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:37:35.095 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:35.090+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:35.132 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:35.132 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:35.147 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:37:35.196 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:35.190+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:35.268 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:35.268 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:35.282 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:37:35.296 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:35.290+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:35.381 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T18:37:35.398 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:35.390+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:35.477 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:35.478 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:35.497 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:37:35.498 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:35.494+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:35.599 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:35.595+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:35.650 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:35.650 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:35.664 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:37:35.700 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:35.694+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:35.802 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:35.794+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:35.859 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:35.860 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:35.879 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:37:35.922 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:35.919+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:36.003 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:35.998+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:36.034 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:36.035 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:36.054 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:37:36.104 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:36.098+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:36.205 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:36.205 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:36.206 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:36.198+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:36.226 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:37:36.259 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is unset 2024-09-12T18:37:36.317 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:36.310+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:36.407 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:36.402+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:36.424 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:36.424 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:36.445 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:37:36.488 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:37:36.507 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:36.502+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:36.608 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:36.602+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:36.642 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:36.643 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:36.647 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:37:36.648 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:37:36.664 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:37:36.665 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:37:36.666 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:37:36.684 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:37:36.684 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:37:36.709 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:36.702+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:36.810 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:36.802+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:36.818 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:36.818 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:37:36.818 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.818 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:234554 5.3 5:cb5b1f93:::benchmark_data_smithi073_23739_object102277:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:36.818 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:36.809879+0000", 2024-09-12T18:37:36.818 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0051809819999999998, 2024-09-12T18:37:36.818 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0052040400000000001, 2024-09-12T18:37:36.818 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:36.819 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:36.819 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:36.819 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:36.819 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:36.819 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:36.819 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 234554 2024-09-12T18:37:36.820 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.820 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:36.820 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.820 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:36.820 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.809879+0000", 2024-09-12T18:37:36.820 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:36.820 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.821 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.821 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:36.821 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.809879+0000", 2024-09-12T18:37:36.821 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:36.821 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.821 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.821 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:36.821 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.809881+0000", 2024-09-12T18:37:36.821 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.533e-06 2024-09-12T18:37:36.821 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.821 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.821 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:36.821 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.809886+0000", 2024-09-12T18:37:36.822 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6930000000000004e-06 2024-09-12T18:37:36.822 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.822 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.822 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:36.822 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.809901+0000", 2024-09-12T18:37:36.822 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4970000000000001e-05 2024-09-12T18:37:36.822 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.822 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.822 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:36.823 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.809910+0000", 2024-09-12T18:37:36.823 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2549999999999997e-06 2024-09-12T18:37:36.823 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.823 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.823 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:36.823 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.809963+0000", 2024-09-12T18:37:36.823 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.3773000000000002e-05 2024-09-12T18:37:36.823 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.823 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.823 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:36.823 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.810058+0000", 2024-09-12T18:37:36.823 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4491e-05 2024-09-12T18:37:36.824 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.824 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.824 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:36.824 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.810138+0000", 2024-09-12T18:37:36.824 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0604000000000003e-05 2024-09-12T18:37:36.824 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:36.824 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:36.824 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:36.824 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.824 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.824 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:234550 5.4 e75/21 5:2a7a2ccb:::benchmark_data_smithi073_23739_object102273:head v 75'14492, mlcod=75'14488)", 2024-09-12T18:37:36.825 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:36.810106+0000", 2024-09-12T18:37:36.825 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0049542060000000001, 2024-09-12T18:37:36.825 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0050442969999999997, 2024-09-12T18:37:36.825 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:36.825 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:36.825 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:36.825 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:36.825 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.826 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:36.826 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.810106+0000", 2024-09-12T18:37:36.826 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:36.826 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.826 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.826 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:36.826 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.810106+0000", 2024-09-12T18:37:36.826 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:36.826 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.826 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.826 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:36.826 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.810107+0000", 2024-09-12T18:37:36.826 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.7400000000000002e-07 2024-09-12T18:37:36.827 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.827 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.827 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:36.827 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.810112+0000", 2024-09-12T18:37:36.827 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4940000000000003e-06 2024-09-12T18:37:36.827 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.827 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.827 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:36.827 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.810123+0000", 2024-09-12T18:37:36.827 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0777e-05 2024-09-12T18:37:36.827 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.827 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.828 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:36.828 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.810131+0000", 2024-09-12T18:37:36.828 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8820000000000001e-06 2024-09-12T18:37:36.828 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.828 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.828 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:36.828 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.810780+0000", 2024-09-12T18:37:36.828 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00064880899999999997 2024-09-12T18:37:36.828 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.828 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.828 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:36.828 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.810790+0000", 2024-09-12T18:37:36.828 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0720000000000001e-05 2024-09-12T18:37:36.829 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:36.829 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:36.829 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:36.829 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.829 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.829 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:234551 5.2 e75/21 5:40991a84:::benchmark_data_smithi073_23739_object102274:head v 75'14520, mlcod=75'14518)", 2024-09-12T18:37:36.829 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:36.810135+0000", 2024-09-12T18:37:36.829 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0049252549999999999, 2024-09-12T18:37:36.829 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0050647119999999999, 2024-09-12T18:37:36.829 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:36.829 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:36.829 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:36.829 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:36.830 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.830 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:36.830 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.810135+0000", 2024-09-12T18:37:36.830 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:36.830 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.830 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.830 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:36.831 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.810135+0000", 2024-09-12T18:37:36.831 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:36.831 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.831 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.831 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:36.831 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.810136+0000", 2024-09-12T18:37:36.831 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.5499999999999996e-07 2024-09-12T18:37:36.831 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.831 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.831 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:36.831 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.810141+0000", 2024-09-12T18:37:36.831 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2569999999999998e-06 2024-09-12T18:37:36.832 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.832 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.832 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:36.832 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.810151+0000", 2024-09-12T18:37:36.832 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4590000000000004e-06 2024-09-12T18:37:36.832 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.832 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.832 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:36.832 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.810157+0000", 2024-09-12T18:37:36.832 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4989999999999999e-06 2024-09-12T18:37:36.832 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.832 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.832 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:36.833 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.810204+0000", 2024-09-12T18:37:36.833 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.6694999999999999e-05 2024-09-12T18:37:36.833 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.833 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.833 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:36.833 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.810221+0000", 2024-09-12T18:37:36.833 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7238999999999999e-05 2024-09-12T18:37:36.833 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:36.833 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:36.833 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:36.833 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.833 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.834 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:234552 5.4 e75/21 5:212acfe6:::benchmark_data_smithi073_23739_object102275:head v 75'14493, mlcod=75'14488)", 2024-09-12T18:37:36.834 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:36.811416+0000", 2024-09-12T18:37:36.834 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.003644071, 2024-09-12T18:37:36.834 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0038304340000000002, 2024-09-12T18:37:36.834 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:36.834 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:36.834 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:36.834 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:36.834 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.834 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:36.834 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.811416+0000", 2024-09-12T18:37:36.834 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:36.834 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.835 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.835 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:36.835 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.811416+0000", 2024-09-12T18:37:36.835 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:36.835 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.835 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.835 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:36.836 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.811417+0000", 2024-09-12T18:37:36.836 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0200000000000001e-07 2024-09-12T18:37:36.836 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.836 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.836 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:36.836 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.811422+0000", 2024-09-12T18:37:36.836 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0860000000000001e-06 2024-09-12T18:37:36.836 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.836 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.836 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:36.836 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.811433+0000", 2024-09-12T18:37:36.836 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1355000000000001e-05 2024-09-12T18:37:36.836 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.837 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.837 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:36.837 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.811440+0000", 2024-09-12T18:37:36.837 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4239999999999998e-06 2024-09-12T18:37:36.837 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.837 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.837 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:36.837 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.811825+0000", 2024-09-12T18:37:36.837 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000385559 2024-09-12T18:37:36.837 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.837 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.837 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:36.837 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.811843+0000", 2024-09-12T18:37:36.838 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7567e-05 2024-09-12T18:37:36.838 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:36.838 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:36.838 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:36.838 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.838 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.838 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:234558 5.6 5:60277513:::benchmark_data_smithi073_23739_object102281:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:36.838 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:36.811823+0000", 2024-09-12T18:37:36.838 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0032368990000000001, 2024-09-12T18:37:36.838 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0034731390000000001, 2024-09-12T18:37:36.838 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:36.838 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:36.838 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:36.838 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:36.839 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:36.839 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:36.839 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 234558 2024-09-12T18:37:36.839 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.839 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:36.839 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.839 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:36.839 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.811823+0000", 2024-09-12T18:37:36.839 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:36.839 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.839 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.839 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:36.839 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.811823+0000", 2024-09-12T18:37:36.839 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:36.840 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.840 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.840 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:36.840 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.811824+0000", 2024-09-12T18:37:36.840 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2299999999999999e-07 2024-09-12T18:37:36.840 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.840 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.840 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:36.840 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.811828+0000", 2024-09-12T18:37:36.840 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.9330000000000003e-06 2024-09-12T18:37:36.840 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.840 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.840 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:36.841 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.811838+0000", 2024-09-12T18:37:36.841 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0217000000000001e-05 2024-09-12T18:37:36.841 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.841 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.841 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:36.841 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.811846+0000", 2024-09-12T18:37:36.841 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6350000000000006e-06 2024-09-12T18:37:36.841 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.841 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.841 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:36.841 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.811897+0000", 2024-09-12T18:37:36.841 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0918999999999998e-05 2024-09-12T18:37:36.841 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.842 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.842 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:36.842 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.811983+0000", 2024-09-12T18:37:36.842 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5852000000000004e-05 2024-09-12T18:37:36.842 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.842 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.842 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:36.842 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.812052+0000", 2024-09-12T18:37:36.842 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8880999999999993e-05 2024-09-12T18:37:36.842 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:36.842 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:36.842 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:36.842 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.843 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.843 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:234559 5.3 5:c10fb064:::benchmark_data_smithi073_23739_object102282:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:36.843 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:36.811872+0000", 2024-09-12T18:37:36.843 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.003187811, 2024-09-12T18:37:36.843 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.003484764, 2024-09-12T18:37:36.843 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:36.843 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:36.843 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:36.843 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:36.843 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:36.843 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:36.843 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 234559 2024-09-12T18:37:36.844 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.844 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:36.844 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.844 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:36.844 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.811872+0000", 2024-09-12T18:37:36.844 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:36.844 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.844 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.844 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:36.844 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.811872+0000", 2024-09-12T18:37:36.844 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:36.844 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.845 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.845 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:36.845 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.811873+0000", 2024-09-12T18:37:36.845 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5499999999999998e-07 2024-09-12T18:37:36.845 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.845 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.845 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:36.845 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.811875+0000", 2024-09-12T18:37:36.845 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4169999999999999e-06 2024-09-12T18:37:36.845 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.845 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.846 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:36.846 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.811882+0000", 2024-09-12T18:37:36.846 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3119999999999999e-06 2024-09-12T18:37:36.846 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.846 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.846 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:36.846 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.811887+0000", 2024-09-12T18:37:36.846 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5210000000000002e-06 2024-09-12T18:37:36.846 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.846 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.846 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:36.846 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.813212+0000", 2024-09-12T18:37:36.846 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001324977 2024-09-12T18:37:36.847 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.847 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.847 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:36.847 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.813326+0000", 2024-09-12T18:37:36.847 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000114151 2024-09-12T18:37:36.847 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.847 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.847 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:36.848 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.813431+0000", 2024-09-12T18:37:36.848 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00010461100000000001 2024-09-12T18:37:36.848 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:36.848 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:36.848 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:36.848 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.848 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.848 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:234557 5.8 e75/21 5:1105625b:::benchmark_data_smithi073_23739_object102280:head v 75'14349, mlcod=75'14346)", 2024-09-12T18:37:36.848 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:36.812010+0000", 2024-09-12T18:37:36.848 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0030500470000000002, 2024-09-12T18:37:36.848 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0034064249999999998, 2024-09-12T18:37:36.848 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:36.849 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:36.849 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:36.849 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:36.849 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.849 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:36.849 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.812010+0000", 2024-09-12T18:37:36.849 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:36.849 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.849 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.849 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:36.849 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.812010+0000", 2024-09-12T18:37:36.849 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:36.849 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.850 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.850 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:36.850 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.812011+0000", 2024-09-12T18:37:36.850 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.89e-07 2024-09-12T18:37:36.850 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.850 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.850 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:36.850 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.812015+0000", 2024-09-12T18:37:36.850 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2690000000000001e-06 2024-09-12T18:37:36.850 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.850 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.850 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:36.851 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.812023+0000", 2024-09-12T18:37:36.851 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.729e-06 2024-09-12T18:37:36.851 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.851 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.851 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:36.851 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.812028+0000", 2024-09-12T18:37:36.851 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1070000000000004e-06 2024-09-12T18:37:36.851 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.851 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.851 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:36.851 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.812068+0000", 2024-09-12T18:37:36.851 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0433999999999999e-05 2024-09-12T18:37:36.851 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.851 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.852 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:36.852 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.812096+0000", 2024-09-12T18:37:36.852 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.8158e-05 2024-09-12T18:37:36.852 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:36.852 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:36.852 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:36.852 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.852 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.852 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:234561 5.e e75/21 5:7109a40d:::benchmark_data_smithi073_23739_object102284:head v 75'14845, mlcod=75'14842)", 2024-09-12T18:37:36.852 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:36.812543+0000", 2024-09-12T18:37:36.853 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0025168730000000002, 2024-09-12T18:37:36.853 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0029229249999999998, 2024-09-12T18:37:36.853 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:36.853 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:36.853 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:36.853 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:36.853 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.853 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:36.853 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.812543+0000", 2024-09-12T18:37:36.853 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:36.853 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.853 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.853 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:36.854 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.812543+0000", 2024-09-12T18:37:36.854 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:36.854 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.854 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.854 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:36.854 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.812544+0000", 2024-09-12T18:37:36.854 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.3099999999999996e-07 2024-09-12T18:37:36.854 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.854 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.854 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:36.854 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.812550+0000", 2024-09-12T18:37:36.854 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.0240000000000003e-06 2024-09-12T18:37:36.854 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.854 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.855 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:36.855 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.812565+0000", 2024-09-12T18:37:36.855 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5274e-05 2024-09-12T18:37:36.855 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.855 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.855 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:36.855 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.812573+0000", 2024-09-12T18:37:36.855 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.5460000000000003e-06 2024-09-12T18:37:36.855 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.855 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.855 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:36.855 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.812618+0000", 2024-09-12T18:37:36.856 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4916000000000002e-05 2024-09-12T18:37:36.856 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.856 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.856 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:36.856 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.812635+0000", 2024-09-12T18:37:36.856 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6714e-05 2024-09-12T18:37:36.856 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:36.856 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:36.856 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:36.856 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.856 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.856 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:234560 5.7 e75/21 5:e778ff0d:::benchmark_data_smithi073_23739_object102283:head v 75'14716, mlcod=75'14714)", 2024-09-12T18:37:36.856 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:36.813116+0000", 2024-09-12T18:37:36.856 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0019437040000000001, 2024-09-12T18:37:36.857 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00240157, 2024-09-12T18:37:36.857 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:36.857 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:36.857 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:36.857 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:36.857 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.857 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:36.857 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.813116+0000", 2024-09-12T18:37:36.857 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:36.857 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.857 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.857 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:36.857 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.813116+0000", 2024-09-12T18:37:36.858 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:36.858 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.858 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.858 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:36.858 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.813117+0000", 2024-09-12T18:37:36.858 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5499999999999998e-07 2024-09-12T18:37:36.858 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.858 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.858 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:36.858 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.813121+0000", 2024-09-12T18:37:36.858 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.1740000000000002e-06 2024-09-12T18:37:36.858 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.858 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.858 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:36.859 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.813130+0000", 2024-09-12T18:37:36.859 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.8419999999999994e-06 2024-09-12T18:37:36.859 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.859 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.859 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:36.859 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.813134+0000", 2024-09-12T18:37:36.859 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5140000000000003e-06 2024-09-12T18:37:36.859 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.859 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.859 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:36.859 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.813178+0000", 2024-09-12T18:37:36.859 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3933000000000001e-05 2024-09-12T18:37:36.859 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.860 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.860 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:36.860 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.813199+0000", 2024-09-12T18:37:36.860 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.0339999999999998e-05 2024-09-12T18:37:36.860 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:36.860 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:36.860 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:36.860 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.860 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.860 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:234554 5.3 e75/21)", 2024-09-12T18:37:36.860 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:36.813150+0000", 2024-09-12T18:37:36.860 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.001910321, 2024-09-12T18:37:36.861 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0024137120000000001, 2024-09-12T18:37:36.861 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:36.861 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:36.861 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:36.861 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:36.861 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.861 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:36.861 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.813150+0000", 2024-09-12T18:37:36.861 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:36.861 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.861 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.861 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:36.861 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.813150+0000", 2024-09-12T18:37:36.861 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:36.862 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.862 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.862 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:36.862 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.813150+0000", 2024-09-12T18:37:36.862 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4299999999999999e-07 2024-09-12T18:37:36.862 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.862 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.862 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:36.862 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.813153+0000", 2024-09-12T18:37:36.862 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.8540000000000001e-06 2024-09-12T18:37:36.862 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.862 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.862 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:36.863 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.813159+0000", 2024-09-12T18:37:36.863 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.0900000000000001e-06 2024-09-12T18:37:36.863 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.863 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.863 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:36.863 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.813164+0000", 2024-09-12T18:37:36.863 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5990000000000004e-06 2024-09-12T18:37:36.863 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:36.863 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:36.863 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:36.863 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.863 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.863 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:234562 5.6 5:69d30d0c:::benchmark_data_smithi073_23739_object102285:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:36.864 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:36.814482+0000", 2024-09-12T18:37:36.864 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00057812100000000002, 2024-09-12T18:37:36.864 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0011212430000000001, 2024-09-12T18:37:36.865 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:36.865 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:36.865 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:36.865 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:36.865 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:36.865 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:36.865 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 234562 2024-09-12T18:37:36.865 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.865 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:36.865 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.866 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:36.866 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.814482+0000", 2024-09-12T18:37:36.866 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:36.866 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.866 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.866 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:36.866 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.814482+0000", 2024-09-12T18:37:36.866 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:36.866 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.866 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.866 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:36.866 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.814483+0000", 2024-09-12T18:37:36.866 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0640000000000001e-06 2024-09-12T18:37:36.867 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.867 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.867 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:36.867 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.814488+0000", 2024-09-12T18:37:36.867 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.7450000000000003e-06 2024-09-12T18:37:36.867 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.867 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.867 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:36.867 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.814501+0000", 2024-09-12T18:37:36.867 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3216e-05 2024-09-12T18:37:36.867 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.867 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.867 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:36.867 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.814508+0000", 2024-09-12T18:37:36.868 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.2110000000000001e-06 2024-09-12T18:37:36.868 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.868 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.868 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:36.868 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.815006+0000", 2024-09-12T18:37:36.868 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00049732599999999997 2024-09-12T18:37:36.868 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.868 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.868 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:36.868 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.815174+0000", 2024-09-12T18:37:36.868 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00016860000000000001 2024-09-12T18:37:36.868 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.869 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.869 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:36.869 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.815303+0000", 2024-09-12T18:37:36.869 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000128396 2024-09-12T18:37:36.869 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:36.869 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:36.869 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:36.869 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.869 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.869 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:234563 5.8 e75/21 5:18d1e5f0:::benchmark_data_smithi073_23739_object102286:head v 75'14350, mlcod=75'14347)", 2024-09-12T18:37:36.869 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:36.814785+0000", 2024-09-12T18:37:36.869 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00027529200000000001, 2024-09-12T18:37:36.869 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000876018, 2024-09-12T18:37:36.870 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:36.870 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:36.870 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:36.870 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:36.870 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.870 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:36.870 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.814785+0000", 2024-09-12T18:37:36.870 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:36.870 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.870 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.870 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:36.870 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.814785+0000", 2024-09-12T18:37:36.870 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:36.871 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.871 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.871 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:36.871 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.814786+0000", 2024-09-12T18:37:36.871 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.0999999999999997e-07 2024-09-12T18:37:36.871 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.871 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.871 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:36.871 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.814791+0000", 2024-09-12T18:37:36.871 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.3029999999999999e-06 2024-09-12T18:37:36.871 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.871 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.871 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:36.872 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.814805+0000", 2024-09-12T18:37:36.872 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.429e-05 2024-09-12T18:37:36.872 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.872 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.872 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:36.872 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.814813+0000", 2024-09-12T18:37:36.872 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3050000000000004e-06 2024-09-12T18:37:36.872 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.872 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.872 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:36.872 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.814860+0000", 2024-09-12T18:37:36.872 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.7796000000000001e-05 2024-09-12T18:37:36.872 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.873 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.873 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:36.873 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.814880+0000", 2024-09-12T18:37:36.873 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9644e-05 2024-09-12T18:37:36.873 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:36.873 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:36.873 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:36.873 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.873 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.873 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:234565 5.4 e75/21)", 2024-09-12T18:37:36.873 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:36.815464+0000", 2024-09-12T18:37:36.873 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4294967295.9995956, 2024-09-12T18:37:36.873 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00024063900000000001, 2024-09-12T18:37:36.873 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:36.874 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:36.874 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:36.874 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:36.874 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.874 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:36.874 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.815464+0000", 2024-09-12T18:37:36.874 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:36.874 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.874 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.874 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:36.874 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.815464+0000", 2024-09-12T18:37:36.874 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:36.874 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.875 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.875 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:36.875 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.815465+0000", 2024-09-12T18:37:36.875 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8899999999999999e-07 2024-09-12T18:37:36.875 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.875 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.875 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:36.875 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.815476+0000", 2024-09-12T18:37:36.875 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0890000000000001e-05 2024-09-12T18:37:36.875 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.875 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.875 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:36.875 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.815492+0000", 2024-09-12T18:37:36.875 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5580999999999999e-05 2024-09-12T18:37:36.876 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.876 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.876 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:36.876 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.815499+0000", 2024-09-12T18:37:36.876 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0190000000000001e-06 2024-09-12T18:37:36.876 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:36.876 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:36.876 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:36.876 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.876 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.876 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:234566 5.3 5.150b7003 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:36.876 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:36.815500+0000", 2024-09-12T18:37:36.876 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4294967295.9995599, 2024-09-12T18:37:36.877 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00024292300000000001, 2024-09-12T18:37:36.877 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:36.877 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:36.877 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:36.877 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:36.877 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:36.877 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:36.877 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 234566 2024-09-12T18:37:36.877 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.877 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:36.877 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.877 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:36.877 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.815500+0000", 2024-09-12T18:37:36.877 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:36.878 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.878 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.878 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:36.878 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.815500+0000", 2024-09-12T18:37:36.878 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:36.878 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.878 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.878 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:36.878 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.815501+0000", 2024-09-12T18:37:36.878 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.850000000000001e-07 2024-09-12T18:37:36.878 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.878 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.878 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:36.879 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.815506+0000", 2024-09-12T18:37:36.879 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5909999999999998e-06 2024-09-12T18:37:36.879 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.879 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.879 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:36.879 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.815518+0000", 2024-09-12T18:37:36.879 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2343e-05 2024-09-12T18:37:36.879 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:36.879 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:36.879 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:36.879 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:36.815524+0000", 2024-09-12T18:37:36.879 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.3109999999999996e-06 2024-09-12T18:37:36.879 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:36.879 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:36.880 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:36.880 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:36.880 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-12T18:37:36.880 INFO:teuthology.orchestra.run.smithi114.stdout: "num_ops": 14 2024-09-12T18:37:36.880 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:36.881 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:37:36.912 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:36.906+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:37.012 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:37.006+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:37.076 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:37.076 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2024-09-12T18:37:37.076 INFO:teuthology.orchestra.run.smithi114.stdout: "complaint_time": 30, 2024-09-12T18:37:37.076 INFO:teuthology.orchestra.run.smithi114.stdout: "num_blocked_ops": 0 2024-09-12T18:37:37.076 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:37.097 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:37:37.139 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:37.134+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:37.217 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:37.210+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:37.244 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:37.245 INFO:teuthology.orchestra.run.smithi114.stdout: "size": 20, 2024-09-12T18:37:37.245 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 600, 2024-09-12T18:37:37.245 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:37:37.245 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.245 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:26 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:37.245 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:37:37.245 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 131.61264492199999, 2024-09-12T18:37:37.245 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.045702136999999997, 2024-09-12T18:37:37.245 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:37.245 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:37.245 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:37.245 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:37.246 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.246 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:37.246 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:37:37.246 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:37.246 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.246 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.246 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:37.246 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628698+0000", 2024-09-12T18:37:37.246 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:37.246 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.246 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.246 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:37.246 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628699+0000", 2024-09-12T18:37:37.246 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3859999999999999e-06 2024-09-12T18:37:37.247 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.247 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.247 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:37.247 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628706+0000", 2024-09-12T18:37:37.247 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0169999999999999e-06 2024-09-12T18:37:37.247 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.247 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.247 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:37.247 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628725+0000", 2024-09-12T18:37:37.247 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8683000000000001e-05 2024-09-12T18:37:37.247 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.247 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.247 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.248 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628740+0000", 2024-09-12T18:37:37.248 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.5413999999999998e-05 2024-09-12T18:37:37.248 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.248 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.248 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:37.248 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628907+0000", 2024-09-12T18:37:37.248 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00016670199999999999 2024-09-12T18:37:37.248 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.248 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.248 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:37:37.248 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.628917+0000", 2024-09-12T18:37:37.248 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.046e-05 2024-09-12T18:37:37.248 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.249 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.249 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:37.249 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.660390+0000", 2024-09-12T18:37:37.249 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.031472364000000003 2024-09-12T18:37:37.249 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.249 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.249 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:37.249 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.661767+0000", 2024-09-12T18:37:37.250 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0013769190000000001 2024-09-12T18:37:37.250 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.250 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.250 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:37.250 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.662408+0000", 2024-09-12T18:37:37.250 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00064091099999999998 2024-09-12T18:37:37.250 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.250 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.250 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:37.250 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669577+0000", 2024-09-12T18:37:37.250 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.007169412 2024-09-12T18:37:37.250 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.250 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.251 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:37.251 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674244+0000", 2024-09-12T18:37:37.251 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0046671839999999996 2024-09-12T18:37:37.251 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.251 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.251 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:37.251 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674329+0000", 2024-09-12T18:37:37.251 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5276000000000001e-05 2024-09-12T18:37:37.251 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.251 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.251 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:37.251 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.674400+0000", 2024-09-12T18:37:37.251 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0408999999999996e-05 2024-09-12T18:37:37.251 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:37.252 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:37.252 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:37.252 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.252 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.252 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:37:37.252 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:37:37.252 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 131.61222064200001, 2024-09-12T18:37:37.252 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.046431252999999999, 2024-09-12T18:37:37.252 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:37.252 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:37.252 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:37.252 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:37.252 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.253 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:37.253 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:37:37.253 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:37.253 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.253 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.253 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:37.253 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629122+0000", 2024-09-12T18:37:37.253 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:37.253 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.253 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.253 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:37.253 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629123+0000", 2024-09-12T18:37:37.253 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0899999999999999e-06 2024-09-12T18:37:37.254 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.254 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.254 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:37.254 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629138+0000", 2024-09-12T18:37:37.254 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.4977000000000001e-05 2024-09-12T18:37:37.254 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.254 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.254 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:37.254 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629149+0000", 2024-09-12T18:37:37.254 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1182999999999999e-05 2024-09-12T18:37:37.254 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.254 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.254 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.254 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629157+0000", 2024-09-12T18:37:37.255 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8129999999999996e-06 2024-09-12T18:37:37.255 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.255 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.255 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:37.255 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629223+0000", 2024-09-12T18:37:37.255 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.6463000000000004e-05 2024-09-12T18:37:37.255 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.255 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.255 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:37:37.255 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.629230+0000", 2024-09-12T18:37:37.255 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1360000000000002e-06 2024-09-12T18:37:37.255 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.255 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.256 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:37.256 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669605+0000", 2024-09-12T18:37:37.256 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.040375518999999999 2024-09-12T18:37:37.256 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.256 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.256 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:37.256 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.669840+0000", 2024-09-12T18:37:37.256 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00023520099999999999 2024-09-12T18:37:37.256 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.256 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.256 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:37.256 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:35:25.675553+0000", 2024-09-12T18:37:37.256 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0057128709999999996 2024-09-12T18:37:37.256 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:37.257 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:37.257 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:37.257 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.257 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.257 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167352 5.a 5:5fc472d2:::benchmark_data_smithi073_23739_object35075:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:37.257 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.163066+0000", 2024-09-12T18:37:37.257 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 34.078276946000003, 2024-09-12T18:37:37.257 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.077708377999999995, 2024-09-12T18:37:37.257 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:37.257 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:37.257 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:37.257 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:37.257 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:37.257 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:37.258 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167352 2024-09-12T18:37:37.258 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.258 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:37.258 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.258 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:37.258 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163066+0000", 2024-09-12T18:37:37.258 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:37.258 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.258 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.258 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:37.258 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163066+0000", 2024-09-12T18:37:37.258 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:37.258 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.259 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.259 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:37.259 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163067+0000", 2024-09-12T18:37:37.259 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0499999999999999e-06 2024-09-12T18:37:37.259 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.259 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.259 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:37.259 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163071+0000", 2024-09-12T18:37:37.259 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4340000000000002e-06 2024-09-12T18:37:37.259 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.259 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.259 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:37.259 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163081+0000", 2024-09-12T18:37:37.260 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0304e-05 2024-09-12T18:37:37.260 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.260 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.260 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.260 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163090+0000", 2024-09-12T18:37:37.260 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7309999999999999e-06 2024-09-12T18:37:37.260 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.260 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.260 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:37.260 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163143+0000", 2024-09-12T18:37:37.260 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2942000000000002e-05 2024-09-12T18:37:37.260 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.260 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.261 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:37.261 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163270+0000", 2024-09-12T18:37:37.261 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012664100000000001 2024-09-12T18:37:37.261 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.261 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.261 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:37.261 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163378+0000", 2024-09-12T18:37:37.261 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000107995 2024-09-12T18:37:37.261 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.261 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.261 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:37.261 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234552+0000", 2024-09-12T18:37:37.261 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.071173831000000007 2024-09-12T18:37:37.261 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.262 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.262 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:37.262 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240640+0000", 2024-09-12T18:37:37.262 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.006088909 2024-09-12T18:37:37.262 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.262 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.262 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:37.262 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240709+0000", 2024-09-12T18:37:37.262 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8393999999999996e-05 2024-09-12T18:37:37.262 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.262 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.262 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:37.262 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240774+0000", 2024-09-12T18:37:37.263 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5147000000000005e-05 2024-09-12T18:37:37.263 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:37.263 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:37.263 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:37.263 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.263 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.263 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167358 5.a 5:533f6738:::benchmark_data_smithi073_23739_object35081:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:37.263 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.165639+0000", 2024-09-12T18:37:37.263 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 34.075703668999999, 2024-09-12T18:37:37.263 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.075287509000000002, 2024-09-12T18:37:37.263 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:37.263 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:37.263 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:37.264 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:37.264 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:37.264 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:37.264 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167358 2024-09-12T18:37:37.264 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.264 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:37.264 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.264 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:37.264 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165639+0000", 2024-09-12T18:37:37.264 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:37.264 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.264 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.264 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:37.265 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165639+0000", 2024-09-12T18:37:37.265 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:37.265 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.265 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.265 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:37.265 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165640+0000", 2024-09-12T18:37:37.265 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1999999999999999e-06 2024-09-12T18:37:37.265 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.265 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.266 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:37.266 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165646+0000", 2024-09-12T18:37:37.266 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4550000000000003e-06 2024-09-12T18:37:37.266 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.266 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.266 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:37.266 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165658+0000", 2024-09-12T18:37:37.266 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2721999999999999e-05 2024-09-12T18:37:37.267 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.267 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.267 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.267 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165668+0000", 2024-09-12T18:37:37.267 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4229999999999994e-06 2024-09-12T18:37:37.267 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.267 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.267 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:37.267 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165711+0000", 2024-09-12T18:37:37.267 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3785999999999997e-05 2024-09-12T18:37:37.267 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.267 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.267 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:37.267 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165788+0000", 2024-09-12T18:37:37.268 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6506000000000002e-05 2024-09-12T18:37:37.268 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.268 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.268 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:37.268 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165862+0000", 2024-09-12T18:37:37.268 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4012999999999998e-05 2024-09-12T18:37:37.268 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.268 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.268 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:37.268 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234718+0000", 2024-09-12T18:37:37.268 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.068856420000000002 2024-09-12T18:37:37.268 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.268 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.269 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:37.269 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240785+0000", 2024-09-12T18:37:37.269 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0060661489999999998 2024-09-12T18:37:37.269 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.269 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.269 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:37.269 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240844+0000", 2024-09-12T18:37:37.269 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9487000000000002e-05 2024-09-12T18:37:37.269 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.269 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.269 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:37.269 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240926+0000", 2024-09-12T18:37:37.269 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2348000000000005e-05 2024-09-12T18:37:37.270 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:37.270 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:37.270 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:37.270 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.270 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.270 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167361 5.a 5:56730f28:::benchmark_data_smithi073_23739_object35084:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:37.270 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.165979+0000", 2024-09-12T18:37:37.270 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 34.075363689, 2024-09-12T18:37:37.270 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.075128337000000003, 2024-09-12T18:37:37.270 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:37.270 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:37.270 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:37.271 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:37.271 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:37.271 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:37.271 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167361 2024-09-12T18:37:37.271 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.271 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:37.271 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.271 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:37.271 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165979+0000", 2024-09-12T18:37:37.271 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:37.271 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.271 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.271 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:37.271 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165979+0000", 2024-09-12T18:37:37.272 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:37.272 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.272 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.272 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:37.272 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165980+0000", 2024-09-12T18:37:37.272 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4499999999999997e-07 2024-09-12T18:37:37.272 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.272 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.272 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:37.272 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165985+0000", 2024-09-12T18:37:37.272 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.186e-06 2024-09-12T18:37:37.272 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.272 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.273 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:37.273 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165995+0000", 2024-09-12T18:37:37.273 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0378e-05 2024-09-12T18:37:37.273 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.273 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.273 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.273 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.166016+0000", 2024-09-12T18:37:37.273 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1316999999999999e-05 2024-09-12T18:37:37.273 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.273 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.273 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:37.273 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.167783+0000", 2024-09-12T18:37:37.273 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017662209999999999 2024-09-12T18:37:37.273 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.274 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.274 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:37.274 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.167851+0000", 2024-09-12T18:37:37.274 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7990000000000005e-05 2024-09-12T18:37:37.274 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.274 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.274 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:37.274 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.167929+0000", 2024-09-12T18:37:37.274 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8829e-05 2024-09-12T18:37:37.274 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.274 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.274 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:37.274 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234832+0000", 2024-09-12T18:37:37.275 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066902378999999998 2024-09-12T18:37:37.275 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.275 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.275 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:37.275 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240941+0000", 2024-09-12T18:37:37.275 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0061087470000000003 2024-09-12T18:37:37.275 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.275 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.275 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:37.275 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241053+0000", 2024-09-12T18:37:37.275 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00011197299999999999 2024-09-12T18:37:37.275 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.275 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.275 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:37.276 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241107+0000", 2024-09-12T18:37:37.276 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4672000000000001e-05 2024-09-12T18:37:37.276 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:37.276 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:37.276 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:37.276 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.276 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.276 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167362 5.3 5:cbd73b47:::benchmark_data_smithi073_23739_object35085:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:37.276 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:37.276 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 34.073266973999999, 2024-09-12T18:37:37.276 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.067202411000000004, 2024-09-12T18:37:37.276 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:37.276 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:37.277 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:37.277 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:37.277 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:37.277 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:37.277 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167362 2024-09-12T18:37:37.277 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.277 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:37.277 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.277 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:37.277 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:37.277 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:37.277 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.277 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.278 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:37.278 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:37.278 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:37.278 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.278 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.278 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:37.278 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:37.278 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3600000000000003e-07 2024-09-12T18:37:37.278 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.278 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.278 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:37.278 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168079+0000", 2024-09-12T18:37:37.278 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7949999999999999e-06 2024-09-12T18:37:37.278 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.279 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.279 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:37.279 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168085+0000", 2024-09-12T18:37:37.279 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2110000000000003e-06 2024-09-12T18:37:37.279 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.279 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.279 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.279 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168089+0000", 2024-09-12T18:37:37.279 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0840000000000002e-06 2024-09-12T18:37:37.279 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.279 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.279 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:37.279 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168121+0000", 2024-09-12T18:37:37.279 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.1489000000000003e-05 2024-09-12T18:37:37.280 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.280 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.280 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:37.280 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168186+0000", 2024-09-12T18:37:37.280 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5313000000000003e-05 2024-09-12T18:37:37.280 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.280 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.280 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:37.280 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168242+0000", 2024-09-12T18:37:37.280 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5560999999999999e-05 2024-09-12T18:37:37.280 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.280 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.280 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:37.281 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234467+0000", 2024-09-12T18:37:37.281 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066225424000000005 2024-09-12T18:37:37.281 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.281 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.281 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:37.281 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235088+0000", 2024-09-12T18:37:37.281 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00062118999999999998 2024-09-12T18:37:37.281 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.281 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.281 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:37.281 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235197+0000", 2024-09-12T18:37:37.281 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00010825899999999999 2024-09-12T18:37:37.281 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.282 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.282 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:37.282 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235278+0000", 2024-09-12T18:37:37.282 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1448999999999999e-05 2024-09-12T18:37:37.282 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:37.282 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:37.282 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:37.282 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.282 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.282 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167366 5.a 5:58e6a467:::benchmark_data_smithi073_23739_object35089:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:37.282 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168263+0000", 2024-09-12T18:37:37.282 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 34.073079436999997, 2024-09-12T18:37:37.282 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.078184744, 2024-09-12T18:37:37.282 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:37.283 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:37.283 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:37.283 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:37.283 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:37.283 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:37.283 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167366 2024-09-12T18:37:37.284 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.284 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:37.284 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.284 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:37.284 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168263+0000", 2024-09-12T18:37:37.284 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:37.284 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.284 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.284 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:37.284 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168263+0000", 2024-09-12T18:37:37.285 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:37.285 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.285 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.285 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:37.285 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168264+0000", 2024-09-12T18:37:37.285 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5700000000000002e-07 2024-09-12T18:37:37.285 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.285 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.285 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:37.285 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168266+0000", 2024-09-12T18:37:37.285 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1789999999999998e-06 2024-09-12T18:37:37.285 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.286 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.286 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:37.286 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168271+0000", 2024-09-12T18:37:37.286 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8160000000000001e-06 2024-09-12T18:37:37.286 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.286 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.286 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.286 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168275+0000", 2024-09-12T18:37:37.286 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4440000000000001e-06 2024-09-12T18:37:37.286 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.286 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.286 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:37.286 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170082+0000", 2024-09-12T18:37:37.286 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0018068800000000001 2024-09-12T18:37:37.287 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.287 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.287 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:37.287 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170154+0000", 2024-09-12T18:37:37.287 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1575000000000005e-05 2024-09-12T18:37:37.287 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.287 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.287 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:37.287 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170216+0000", 2024-09-12T18:37:37.287 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1989999999999994e-05 2024-09-12T18:37:37.287 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.287 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.287 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:37.287 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234933+0000", 2024-09-12T18:37:37.288 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064717514000000004 2024-09-12T18:37:37.288 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.288 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.288 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:37.288 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246226+0000", 2024-09-12T18:37:37.288 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011293151 2024-09-12T18:37:37.288 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.288 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.288 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:37.288 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246338+0000", 2024-09-12T18:37:37.288 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00011225 2024-09-12T18:37:37.288 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.288 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.289 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:37.289 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246448+0000", 2024-09-12T18:37:37.289 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000109388 2024-09-12T18:37:37.289 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:37.289 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:37.289 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:37.289 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.289 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.289 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167367 5.a 5:51778d97:::benchmark_data_smithi073_23739_object35090:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:37.289 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168388+0000", 2024-09-12T18:37:37.289 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 34.072954193000001, 2024-09-12T18:37:37.289 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.082583860999999995, 2024-09-12T18:37:37.289 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:37.289 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:37.290 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:37.290 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:37.290 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:37.290 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:37.290 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167367 2024-09-12T18:37:37.290 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.290 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:37.290 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.290 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:37.290 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168388+0000", 2024-09-12T18:37:37.290 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:37.290 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.290 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.291 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:37.291 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168388+0000", 2024-09-12T18:37:37.291 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:37.291 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.291 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.291 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:37.291 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168389+0000", 2024-09-12T18:37:37.291 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1099999999999996e-07 2024-09-12T18:37:37.291 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.291 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.291 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:37.291 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168391+0000", 2024-09-12T18:37:37.291 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.39e-06 2024-09-12T18:37:37.291 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.292 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.292 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:37.292 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168396+0000", 2024-09-12T18:37:37.292 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3460000000000004e-06 2024-09-12T18:37:37.292 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.292 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.292 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.292 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168399+0000", 2024-09-12T18:37:37.292 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.613e-06 2024-09-12T18:37:37.292 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.292 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.292 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:37.292 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235003+0000", 2024-09-12T18:37:37.292 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066603851000000006 2024-09-12T18:37:37.293 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.293 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.293 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:37.293 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235266+0000", 2024-09-12T18:37:37.293 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00026270999999999998 2024-09-12T18:37:37.293 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.293 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.293 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:37.293 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235510+0000", 2024-09-12T18:37:37.293 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00024394 2024-09-12T18:37:37.293 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.293 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.293 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:37.294 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246546+0000", 2024-09-12T18:37:37.294 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011035774 2024-09-12T18:37:37.294 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.294 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.294 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:37.294 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.250808+0000", 2024-09-12T18:37:37.294 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0042622700000000003 2024-09-12T18:37:37.294 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.294 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.294 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:37.294 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.250890+0000", 2024-09-12T18:37:37.294 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1874999999999998e-05 2024-09-12T18:37:37.294 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.294 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.295 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:37.295 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.250972+0000", 2024-09-12T18:37:37.295 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2581000000000001e-05 2024-09-12T18:37:37.295 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:37.295 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:37.295 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:37.295 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.295 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.295 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167370 5.a 5:5aab9477:::benchmark_data_smithi073_23739_object35093:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:37.295 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168603+0000", 2024-09-12T18:37:37.295 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 34.072739257999999, 2024-09-12T18:37:37.295 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.086603794999999997, 2024-09-12T18:37:37.295 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:37.295 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:37.296 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:37.296 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:37.296 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:37.296 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:37.296 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167370 2024-09-12T18:37:37.296 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.296 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:37.296 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.296 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:37.296 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168603+0000", 2024-09-12T18:37:37.296 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:37.296 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.296 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.297 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:37.297 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168603+0000", 2024-09-12T18:37:37.297 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:37.297 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.297 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.297 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:37.297 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168604+0000", 2024-09-12T18:37:37.297 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.1899999999999998e-07 2024-09-12T18:37:37.297 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.297 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.297 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:37.297 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168606+0000", 2024-09-12T18:37:37.297 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8309999999999999e-06 2024-09-12T18:37:37.298 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.298 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.298 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:37.298 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168610+0000", 2024-09-12T18:37:37.298 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8069999999999999e-06 2024-09-12T18:37:37.298 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.298 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.298 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.298 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168613+0000", 2024-09-12T18:37:37.298 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.118e-06 2024-09-12T18:37:37.298 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.298 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.298 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:37.298 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241145+0000", 2024-09-12T18:37:37.299 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.072531678000000002 2024-09-12T18:37:37.299 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.299 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.299 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:37.299 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241342+0000", 2024-09-12T18:37:37.299 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00019635900000000001 2024-09-12T18:37:37.299 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.299 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.299 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:37.299 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241483+0000", 2024-09-12T18:37:37.299 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014161100000000001 2024-09-12T18:37:37.299 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.299 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.299 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:37.300 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255039+0000", 2024-09-12T18:37:37.300 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013555724 2024-09-12T18:37:37.300 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.300 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.300 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:37.300 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255062+0000", 2024-09-12T18:37:37.300 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.3042000000000001e-05 2024-09-12T18:37:37.300 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.300 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.301 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:37.301 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255143+0000", 2024-09-12T18:37:37.301 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0999000000000002e-05 2024-09-12T18:37:37.301 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.301 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.301 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:37.301 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255207+0000", 2024-09-12T18:37:37.301 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4207000000000004e-05 2024-09-12T18:37:37.301 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:37.301 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:37.301 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:37.301 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.301 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.302 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167352 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:37.302 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:37.302 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 34.072614604000002, 2024-09-12T18:37:37.302 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065859953999999998, 2024-09-12T18:37:37.302 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:37.302 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:37.302 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:37.302 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:37.302 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.302 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:37.302 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:37.302 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:37.302 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.303 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.303 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:37.303 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:37.303 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:37.303 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.303 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.303 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:37.303 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:37.303 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.0800000000000001e-07 2024-09-12T18:37:37.303 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.303 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.303 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:37.303 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168730+0000", 2024-09-12T18:37:37.303 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6530000000000001e-06 2024-09-12T18:37:37.304 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.304 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.304 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:37.304 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168734+0000", 2024-09-12T18:37:37.304 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.721e-06 2024-09-12T18:37:37.304 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.304 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.304 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.304 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168736+0000", 2024-09-12T18:37:37.304 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.508e-06 2024-09-12T18:37:37.304 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.304 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.304 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:37.305 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171951+0000", 2024-09-12T18:37:37.305 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.003215281 2024-09-12T18:37:37.305 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.305 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.305 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:37.305 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234520+0000", 2024-09-12T18:37:37.305 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062568676000000004 2024-09-12T18:37:37.305 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.305 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.305 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:37.305 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234588+0000", 2024-09-12T18:37:37.305 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7806999999999996e-05 2024-09-12T18:37:37.305 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:37.306 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:37.306 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:37.306 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.306 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.306 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167368 5.4 e58/21 5:29a1ec58:::benchmark_data_smithi073_23739_object35091:head v 58'10399, mlcod=58'10396)", 2024-09-12T18:37:37.306 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:37.306 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 34.072491587000002, 2024-09-12T18:37:37.306 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066008885000000003, 2024-09-12T18:37:37.306 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:37.306 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:37.306 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:37.306 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:37.306 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.307 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:37.307 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:37.307 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:37.307 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.307 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.307 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:37.307 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:37.307 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:37.307 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.307 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.307 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:37.307 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:37.307 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4699999999999998e-07 2024-09-12T18:37:37.308 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.308 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.308 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:37.308 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168854+0000", 2024-09-12T18:37:37.308 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.3180000000000001e-06 2024-09-12T18:37:37.308 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.308 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.308 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:37.308 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168858+0000", 2024-09-12T18:37:37.308 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2799999999999997e-06 2024-09-12T18:37:37.308 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.308 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.308 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.308 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168861+0000", 2024-09-12T18:37:37.309 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7650000000000002e-06 2024-09-12T18:37:37.309 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.309 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.309 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:37.309 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168895+0000", 2024-09-12T18:37:37.309 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4533999999999998e-05 2024-09-12T18:37:37.309 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.309 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.309 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:37.309 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168906+0000", 2024-09-12T18:37:37.309 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0910000000000001e-05 2024-09-12T18:37:37.309 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.309 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.310 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:37.310 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234784+0000", 2024-09-12T18:37:37.310 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065877656000000007 2024-09-12T18:37:37.310 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.310 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.310 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:37.310 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234860+0000", 2024-09-12T18:37:37.310 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6174999999999995e-05 2024-09-12T18:37:37.310 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:37.310 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:37.310 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:37.310 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.310 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.311 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167358 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:37.311 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.170373+0000", 2024-09-12T18:37:37.311 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 34.070969306000002, 2024-09-12T18:37:37.311 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064370201000000002, 2024-09-12T18:37:37.311 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:37.311 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:37.311 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:37.311 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:37.311 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.311 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:37.311 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170373+0000", 2024-09-12T18:37:37.311 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:37.311 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.311 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.312 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:37.312 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170373+0000", 2024-09-12T18:37:37.312 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:37.312 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.312 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.312 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:37.312 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170374+0000", 2024-09-12T18:37:37.312 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5799999999999998e-07 2024-09-12T18:37:37.312 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.312 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.312 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:37.312 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170378+0000", 2024-09-12T18:37:37.313 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.732e-06 2024-09-12T18:37:37.313 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.313 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.313 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:37.313 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170388+0000", 2024-09-12T18:37:37.313 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0212e-05 2024-09-12T18:37:37.313 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.313 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.313 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.313 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170397+0000", 2024-09-12T18:37:37.313 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7090000000000008e-06 2024-09-12T18:37:37.313 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.313 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.313 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:37.314 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234682+0000", 2024-09-12T18:37:37.314 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064285518999999999 2024-09-12T18:37:37.314 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.314 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.314 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:37.314 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234703+0000", 2024-09-12T18:37:37.314 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.0199000000000001e-05 2024-09-12T18:37:37.314 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.314 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.314 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:37.314 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234743+0000", 2024-09-12T18:37:37.314 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0972e-05 2024-09-12T18:37:37.315 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:37.315 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:37.315 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:37.315 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.315 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.315 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167372 5.c 5:398d36a7:::benchmark_data_smithi073_23739_object35095:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:37.315 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171066+0000", 2024-09-12T18:37:37.315 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 34.070276094, 2024-09-12T18:37:37.315 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065889534999999999, 2024-09-12T18:37:37.315 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:37.315 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:37.315 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:37.315 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:37.316 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:37.316 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:37.316 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167372 2024-09-12T18:37:37.316 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.316 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:37.316 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.316 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:37.316 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171066+0000", 2024-09-12T18:37:37.316 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:37.316 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.316 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.316 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:37.316 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171066+0000", 2024-09-12T18:37:37.317 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:37.317 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.317 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.317 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:37.317 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171068+0000", 2024-09-12T18:37:37.317 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.186e-06 2024-09-12T18:37:37.317 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.317 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.317 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:37.317 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171072+0000", 2024-09-12T18:37:37.317 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3560000000000003e-06 2024-09-12T18:37:37.318 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.318 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.318 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:37.318 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171082+0000", 2024-09-12T18:37:37.318 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.9739999999999997e-06 2024-09-12T18:37:37.318 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.318 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.318 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.318 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171089+0000", 2024-09-12T18:37:37.318 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7159999999999997e-06 2024-09-12T18:37:37.318 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.318 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.318 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:37.319 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171133+0000", 2024-09-12T18:37:37.319 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4091999999999997e-05 2024-09-12T18:37:37.319 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.319 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.319 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:37.319 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171221+0000", 2024-09-12T18:37:37.319 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.8108000000000004e-05 2024-09-12T18:37:37.319 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.319 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.319 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:37.319 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171279+0000", 2024-09-12T18:37:37.319 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8062000000000001e-05 2024-09-12T18:37:37.319 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.320 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.320 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:37.320 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235007+0000", 2024-09-12T18:37:37.320 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.063727849000000003 2024-09-12T18:37:37.320 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.320 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.320 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:37.320 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236790+0000", 2024-09-12T18:37:37.320 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017829269999999999 2024-09-12T18:37:37.320 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.320 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.320 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:37.320 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236881+0000", 2024-09-12T18:37:37.321 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1347999999999993e-05 2024-09-12T18:37:37.321 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.321 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.321 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:37.321 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236956+0000", 2024-09-12T18:37:37.322 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4917000000000001e-05 2024-09-12T18:37:37.322 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:37.322 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:37.322 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:37.322 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.322 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.322 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167371 5.4 e58/21 5:24fea27c:::benchmark_data_smithi073_23739_object35094:head v 58'10400, mlcod=58'10397)", 2024-09-12T18:37:37.322 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171273+0000", 2024-09-12T18:37:37.322 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 34.070069519999997, 2024-09-12T18:37:37.322 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065500368000000003, 2024-09-12T18:37:37.322 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:37.322 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:37.323 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:37.323 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:37.323 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.323 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:37.323 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171273+0000", 2024-09-12T18:37:37.323 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:37.323 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.323 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.323 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:37.323 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171273+0000", 2024-09-12T18:37:37.323 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:37.323 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.323 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.323 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:37.324 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171274+0000", 2024-09-12T18:37:37.324 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0399999999999996e-07 2024-09-12T18:37:37.324 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.324 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.324 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:37.324 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171277+0000", 2024-09-12T18:37:37.324 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8689999999999997e-06 2024-09-12T18:37:37.324 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.324 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.324 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:37.324 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171284+0000", 2024-09-12T18:37:37.324 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2879999999999998e-06 2024-09-12T18:37:37.324 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.325 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.325 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.325 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171289+0000", 2024-09-12T18:37:37.325 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9049999999999996e-06 2024-09-12T18:37:37.325 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.325 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.325 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:37.325 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171322+0000", 2024-09-12T18:37:37.325 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3781000000000001e-05 2024-09-12T18:37:37.325 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.325 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.325 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:37.325 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171335+0000", 2024-09-12T18:37:37.325 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2639999999999999e-05 2024-09-12T18:37:37.326 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.326 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.326 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:37.326 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236691+0000", 2024-09-12T18:37:37.326 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065355835000000001 2024-09-12T18:37:37.326 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.326 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.326 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:37.326 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236773+0000", 2024-09-12T18:37:37.326 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2546000000000006e-05 2024-09-12T18:37:37.326 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:37.326 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:37.326 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:37.327 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.327 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.327 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167364 5.7 e58/21 5:ee50096a:::benchmark_data_smithi073_23739_object35087:head v 58'10504, mlcod=58'10502)", 2024-09-12T18:37:37.327 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171598+0000", 2024-09-12T18:37:37.327 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 34.069744401000001, 2024-09-12T18:37:37.327 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065149069000000004, 2024-09-12T18:37:37.327 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:37.327 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:37.327 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:37.327 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:37.327 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.327 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:37.327 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171598+0000", 2024-09-12T18:37:37.327 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:37.328 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.328 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.328 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:37.328 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171598+0000", 2024-09-12T18:37:37.328 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:37.328 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.328 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.328 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:37.328 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171599+0000", 2024-09-12T18:37:37.328 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6700000000000003e-07 2024-09-12T18:37:37.328 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.328 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.329 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:37.329 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171602+0000", 2024-09-12T18:37:37.329 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.841e-06 2024-09-12T18:37:37.329 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.329 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.329 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:37.329 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171608+0000", 2024-09-12T18:37:37.329 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9259999999999997e-06 2024-09-12T18:37:37.329 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.329 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.329 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.329 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171611+0000", 2024-09-12T18:37:37.329 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.9450000000000003e-06 2024-09-12T18:37:37.329 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.330 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.330 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:37.330 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171650+0000", 2024-09-12T18:37:37.330 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8464000000000003e-05 2024-09-12T18:37:37.330 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.330 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.330 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:37.330 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171662+0000", 2024-09-12T18:37:37.330 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1603999999999999e-05 2024-09-12T18:37:37.330 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.330 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.330 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:37.330 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236663+0000", 2024-09-12T18:37:37.330 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065001330999999996 2024-09-12T18:37:37.331 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.331 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.331 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:37.331 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236747+0000", 2024-09-12T18:37:37.331 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.4390999999999999e-05 2024-09-12T18:37:37.331 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:37.331 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:37.331 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:37.331 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.331 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.331 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167365 5.2 e58/21 5:4107875c:::benchmark_data_smithi073_23739_object35088:head v 58'10351, mlcod=58'10349)", 2024-09-12T18:37:37.332 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171733+0000", 2024-09-12T18:37:37.332 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 34.069609356000001, 2024-09-12T18:37:37.332 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.074804168000000004, 2024-09-12T18:37:37.332 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:37.332 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:37.332 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:37.332 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:37.332 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.332 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:37.332 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171733+0000", 2024-09-12T18:37:37.332 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:37.332 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.332 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.333 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:37.333 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171733+0000", 2024-09-12T18:37:37.333 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:37.333 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.333 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.333 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:37.333 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171734+0000", 2024-09-12T18:37:37.333 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9299999999999998e-07 2024-09-12T18:37:37.333 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.333 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.333 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:37.333 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171738+0000", 2024-09-12T18:37:37.333 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.301e-06 2024-09-12T18:37:37.333 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.334 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.334 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:37.334 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171746+0000", 2024-09-12T18:37:37.334 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.554e-06 2024-09-12T18:37:37.334 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.334 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.334 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.334 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171751+0000", 2024-09-12T18:37:37.334 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1880000000000001e-06 2024-09-12T18:37:37.334 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.334 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.334 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:37.334 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234659+0000", 2024-09-12T18:37:37.334 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062907807999999996 2024-09-12T18:37:37.335 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.335 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.335 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:37.335 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234708+0000", 2024-09-12T18:37:37.335 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8992000000000001e-05 2024-09-12T18:37:37.335 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.335 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.335 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:37.335 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246457+0000", 2024-09-12T18:37:37.335 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.01174974 2024-09-12T18:37:37.335 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.335 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.335 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:37.336 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246537+0000", 2024-09-12T18:37:37.336 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.9992000000000003e-05 2024-09-12T18:37:37.336 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:37.336 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:37.336 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:37.336 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.336 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.336 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167373 5.5 e58/49 5:ad283029:::benchmark_data_smithi073_23739_object35096:head v 58'10600, mlcod=58'10598)", 2024-09-12T18:37:37.336 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:37.336 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 34.069581872000001, 2024-09-12T18:37:37.336 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065058240000000003, 2024-09-12T18:37:37.336 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:37.336 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:37.336 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:37.337 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:37.337 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.337 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:37.337 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:37.337 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:37.337 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.337 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.337 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:37.337 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:37.337 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:37.337 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.337 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.337 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:37.338 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:37.338 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.2899999999999999e-07 2024-09-12T18:37:37.338 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.338 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.338 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:37.338 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171764+0000", 2024-09-12T18:37:37.338 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7310000000000002e-06 2024-09-12T18:37:37.338 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.338 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.338 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:37.338 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171769+0000", 2024-09-12T18:37:37.338 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.079e-06 2024-09-12T18:37:37.338 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.338 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.339 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.339 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171774+0000", 2024-09-12T18:37:37.339 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.48e-06 2024-09-12T18:37:37.339 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.339 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.339 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:37.339 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171819+0000", 2024-09-12T18:37:37.339 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4391999999999998e-05 2024-09-12T18:37:37.339 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.339 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.339 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:37.339 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171841+0000", 2024-09-12T18:37:37.339 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2245000000000001e-05 2024-09-12T18:37:37.339 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.340 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.340 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:37.340 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236750+0000", 2024-09-12T18:37:37.340 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064909123999999999 2024-09-12T18:37:37.340 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.340 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.340 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:37.340 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236819+0000", 2024-09-12T18:37:37.340 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8860000000000001e-05 2024-09-12T18:37:37.340 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:37.340 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:37.340 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:37.340 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.340 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.341 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167361 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:37.341 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:37.341 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 34.069525966, 2024-09-12T18:37:37.341 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.063049426000000006, 2024-09-12T18:37:37.341 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:37.341 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:37.341 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:37.341 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:37.341 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.341 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:37.341 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:37.341 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:37.341 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.342 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.342 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:37.342 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:37.342 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:37.342 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.342 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.342 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:37.342 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:37.342 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.9099999999999999e-07 2024-09-12T18:37:37.342 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.342 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.342 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:37.342 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171820+0000", 2024-09-12T18:37:37.342 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.5900000000000002e-06 2024-09-12T18:37:37.343 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.343 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.343 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:37.343 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171826+0000", 2024-09-12T18:37:37.343 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.64e-06 2024-09-12T18:37:37.343 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.343 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.343 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.343 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171831+0000", 2024-09-12T18:37:37.343 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.578e-06 2024-09-12T18:37:37.343 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.343 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.343 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:37.344 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234808+0000", 2024-09-12T18:37:37.344 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062976780999999996 2024-09-12T18:37:37.344 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.344 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.344 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:37.344 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234821+0000", 2024-09-12T18:37:37.344 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3002e-05 2024-09-12T18:37:37.344 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.344 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.344 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:37.344 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234866+0000", 2024-09-12T18:37:37.344 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5444000000000001e-05 2024-09-12T18:37:37.344 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:37.344 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:37.345 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:37.345 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.345 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.345 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167366 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:37.345 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.172133+0000", 2024-09-12T18:37:37.345 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 34.069209137999998, 2024-09-12T18:37:37.345 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062815840999999997, 2024-09-12T18:37:37.345 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:37.345 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:37.345 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:37.345 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:37.345 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.345 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:37.346 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172133+0000", 2024-09-12T18:37:37.346 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:37.346 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.346 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.346 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:37.346 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172133+0000", 2024-09-12T18:37:37.346 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:37.346 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.346 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.346 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:37.346 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172134+0000", 2024-09-12T18:37:37.346 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5000000000000003e-07 2024-09-12T18:37:37.346 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.347 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.347 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:37.347 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172137+0000", 2024-09-12T18:37:37.347 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.6460000000000002e-06 2024-09-12T18:37:37.347 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.347 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.347 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:37.347 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234511+0000", 2024-09-12T18:37:37.347 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062374603000000001 2024-09-12T18:37:37.347 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.347 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.347 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.347 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234525+0000", 2024-09-12T18:37:37.348 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3396e-05 2024-09-12T18:37:37.348 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.348 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.348 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:37.348 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234909+0000", 2024-09-12T18:37:37.348 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00038405299999999998 2024-09-12T18:37:37.348 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.348 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.348 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:37.348 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234922+0000", 2024-09-12T18:37:37.348 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3274e-05 2024-09-12T18:37:37.348 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.348 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.348 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:37.349 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234949+0000", 2024-09-12T18:37:37.349 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7319000000000001e-05 2024-09-12T18:37:37.349 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:37.349 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:37.349 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:37.349 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.349 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.349 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167369 5.7 e58/21 5:e64ecabd:::benchmark_data_smithi073_23739_object35092:head v 58'10505, mlcod=58'10502)", 2024-09-12T18:37:37.349 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:37.349 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 34.067678745999999, 2024-09-12T18:37:37.349 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.063873773999999994, 2024-09-12T18:37:37.349 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:37.349 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:37.350 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:37.350 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:37.350 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.350 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:37.350 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:37.350 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:37.350 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.350 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.350 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:37.350 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:37.350 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:37.350 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.350 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.351 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:37.351 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:37.351 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3500000000000002e-07 2024-09-12T18:37:37.351 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.351 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.351 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:37.351 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173668+0000", 2024-09-12T18:37:37.351 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4000000000000001e-06 2024-09-12T18:37:37.351 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.351 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.351 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:37.351 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234583+0000", 2024-09-12T18:37:37.351 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.060914889 2024-09-12T18:37:37.351 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.352 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.352 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.352 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234600+0000", 2024-09-12T18:37:37.352 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7192000000000001e-05 2024-09-12T18:37:37.352 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.352 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.352 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:37.352 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234791+0000", 2024-09-12T18:37:37.352 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00019115000000000001 2024-09-12T18:37:37.352 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.352 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.352 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:37.352 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234834+0000", 2024-09-12T18:37:37.353 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3296e-05 2024-09-12T18:37:37.353 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.353 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.353 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:37.353 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.237481+0000", 2024-09-12T18:37:37.353 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0026472050000000001 2024-09-12T18:37:37.353 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:37.353 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:37.353 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:37.353 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.237538+0000", 2024-09-12T18:37:37.353 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6206999999999999e-05 2024-09-12T18:37:37.353 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:37.353 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:37.354 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:37.354 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:37.354 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:37.354 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:37.355 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:37:37.356 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:37.351+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:37.456 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:37.450+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:37.509 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:37.509 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:37:37.509 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.510 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:236083 5.9 e75/21 5:98d7de77:::benchmark_data_smithi073_23739_object103806:head v 75'14693, mlcod=75'14690)", 2024-09-12T18:37:37.510 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:37.501264+0000", 2024-09-12T18:37:37.510 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.001252186, 2024-09-12T18:37:37.510 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0012671410000000001, 2024-09-12T18:37:37.510 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:37.510 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:37.510 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:37:37.511 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:37.511 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.511 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:37.511 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.501264+0000", 2024-09-12T18:37:37.511 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.511 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.512 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.512 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:37.512 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.501264+0000", 2024-09-12T18:37:37.512 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.512 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.513 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.513 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:37.513 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.501264+0000", 2024-09-12T18:37:37.513 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4899999999999995e-07 2024-09-12T18:37:37.513 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.513 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.514 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:37.514 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.501277+0000", 2024-09-12T18:37:37.514 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2282e-05 2024-09-12T18:37:37.514 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.514 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.514 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:37.515 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.501287+0000", 2024-09-12T18:37:37.515 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9000000000000001e-06 2024-09-12T18:37:37.515 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.515 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.515 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.515 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.501300+0000", 2024-09-12T18:37:37.516 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3665e-05 2024-09-12T18:37:37.516 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.516 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.516 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:37.516 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.501345+0000", 2024-09-12T18:37:37.517 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4845999999999997e-05 2024-09-12T18:37:37.517 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.517 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.517 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:37.517 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.501368+0000", 2024-09-12T18:37:37.517 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3037999999999999e-05 2024-09-12T18:37:37.518 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.518 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:37.518 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.518 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.518 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.519 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:236087 5.f e75/21 5:fedae9f6:::benchmark_data_smithi073_23739_object103810:head v 75'14595, mlcod=75'14593)", 2024-09-12T18:37:37.519 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:37.501319+0000", 2024-09-12T18:37:37.519 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.001196573, 2024-09-12T18:37:37.519 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0012456520000000001, 2024-09-12T18:37:37.519 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:37.519 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:37.520 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:37:37.520 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:37.520 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.520 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:37.520 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.501319+0000", 2024-09-12T18:37:37.521 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.521 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.521 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.521 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:37.521 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.501319+0000", 2024-09-12T18:37:37.522 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.522 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.522 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.522 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:37.523 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.501320+0000", 2024-09-12T18:37:37.523 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1100000000000002e-07 2024-09-12T18:37:37.523 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.523 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.523 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:37.523 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.501324+0000", 2024-09-12T18:37:37.523 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9570000000000004e-06 2024-09-12T18:37:37.523 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.523 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.523 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:37.523 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.501330+0000", 2024-09-12T18:37:37.523 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5459999999999997e-06 2024-09-12T18:37:37.523 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.524 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.524 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.524 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.501335+0000", 2024-09-12T18:37:37.524 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.848e-06 2024-09-12T18:37:37.524 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.524 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.524 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:37.524 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.501385+0000", 2024-09-12T18:37:37.524 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9972999999999997e-05 2024-09-12T18:37:37.524 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.524 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.524 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:37.525 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.501403+0000", 2024-09-12T18:37:37.525 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7784000000000001e-05 2024-09-12T18:37:37.525 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.525 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:37.525 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.525 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.525 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.525 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:236085 5.5 e75/73 5:a5b2909b:::benchmark_data_smithi073_23739_object103808:head v 75'14957, mlcod=75'14953)", 2024-09-12T18:37:37.525 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:37.501362+0000", 2024-09-12T18:37:37.525 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0011538589999999999, 2024-09-12T18:37:37.525 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0012474750000000001, 2024-09-12T18:37:37.526 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:37.526 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:37.526 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:37:37.526 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:37.526 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.526 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:37.526 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.501362+0000", 2024-09-12T18:37:37.526 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.526 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.526 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.527 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:37.527 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.501362+0000", 2024-09-12T18:37:37.527 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.527 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.527 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.527 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:37.527 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.501362+0000", 2024-09-12T18:37:37.527 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9299999999999999e-07 2024-09-12T18:37:37.527 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.527 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.527 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:37.528 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.501366+0000", 2024-09-12T18:37:37.528 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0069999999999999e-06 2024-09-12T18:37:37.528 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.528 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.528 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:37.528 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.501373+0000", 2024-09-12T18:37:37.528 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7839999999999998e-06 2024-09-12T18:37:37.528 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.528 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.528 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.529 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.501378+0000", 2024-09-12T18:37:37.529 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9629999999999997e-06 2024-09-12T18:37:37.529 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.529 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.529 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:37.529 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.501439+0000", 2024-09-12T18:37:37.529 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1100999999999997e-05 2024-09-12T18:37:37.529 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.529 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.529 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:37.529 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.501455+0000", 2024-09-12T18:37:37.530 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5914e-05 2024-09-12T18:37:37.530 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.530 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:37.530 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.530 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.530 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.530 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:236090 5.0 5.19df6f60 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:37.530 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:37.501488+0000", 2024-09-12T18:37:37.530 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0010274220000000001, 2024-09-12T18:37:37.530 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011730759999999999, 2024-09-12T18:37:37.530 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:37.531 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:37.531 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:37.531 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:37.531 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:37.531 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:37.531 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 236090 2024-09-12T18:37:37.531 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.531 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:37.531 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.531 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:37.531 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.501488+0000", 2024-09-12T18:37:37.531 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.531 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.532 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.532 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:37.532 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.501488+0000", 2024-09-12T18:37:37.532 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.532 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.532 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.532 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:37.532 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.501489+0000", 2024-09-12T18:37:37.532 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1900000000000001e-07 2024-09-12T18:37:37.532 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.533 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.533 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:37.533 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.501494+0000", 2024-09-12T18:37:37.533 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.369e-06 2024-09-12T18:37:37.533 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.533 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.533 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:37.533 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.501504+0000", 2024-09-12T18:37:37.533 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0013999999999999e-05 2024-09-12T18:37:37.533 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.533 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.534 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.534 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.501511+0000", 2024-09-12T18:37:37.534 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8689999999999998e-06 2024-09-12T18:37:37.534 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.534 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:37.534 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.534 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.534 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.534 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:236091 5.b 5:dfc9b6c7:::benchmark_data_smithi073_23739_object103814:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:37.534 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:37.502534+0000", 2024-09-12T18:37:37.535 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4294967295.9999819, 2024-09-12T18:37:37.535 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00018382000000000001, 2024-09-12T18:37:37.535 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:37.535 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:37.535 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-09-12T18:37:37.535 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:37.535 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:37.535 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:37.535 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 236091 2024-09-12T18:37:37.535 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.535 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:37.535 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.536 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:37.536 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.502534+0000", 2024-09-12T18:37:37.536 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.536 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.536 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.536 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:37.536 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.502534+0000", 2024-09-12T18:37:37.536 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.536 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.536 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.537 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:37.537 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.502535+0000", 2024-09-12T18:37:37.537 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.128e-06 2024-09-12T18:37:37.537 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.537 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.537 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:37.537 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.502540+0000", 2024-09-12T18:37:37.537 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5809999999999998e-06 2024-09-12T18:37:37.537 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.537 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.537 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:37.538 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.502552+0000", 2024-09-12T18:37:37.538 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2267e-05 2024-09-12T18:37:37.538 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.538 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.538 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.538 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.502560+0000", 2024-09-12T18:37:37.538 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7959999999999996e-06 2024-09-12T18:37:37.538 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.538 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.538 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:37.538 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.502615+0000", 2024-09-12T18:37:37.539 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5597999999999999e-05 2024-09-12T18:37:37.539 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.539 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:37.539 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.539 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.539 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.539 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:236082 5.8 5:1c0b2cc6:::benchmark_data_smithi073_23739_object103805:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:37.539 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:37.499574+0000", 2024-09-12T18:37:37.539 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0029419490000000001, 2024-09-12T18:37:37.539 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0032029020000000001, 2024-09-12T18:37:37.539 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:37.539 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:37.539 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:37.540 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:37.540 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:37.540 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:37.540 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 236082 2024-09-12T18:37:37.540 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.540 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:37.540 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.540 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:37.540 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.499574+0000", 2024-09-12T18:37:37.540 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.540 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.540 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.541 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:37.541 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.499574+0000", 2024-09-12T18:37:37.541 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.541 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.541 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.541 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:37.541 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.499575+0000", 2024-09-12T18:37:37.541 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0389999999999999e-06 2024-09-12T18:37:37.541 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.541 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.541 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:37.542 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.499579+0000", 2024-09-12T18:37:37.542 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8319999999999999e-06 2024-09-12T18:37:37.542 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.542 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.542 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:37.542 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.499587+0000", 2024-09-12T18:37:37.542 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6430000000000001e-06 2024-09-12T18:37:37.542 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.542 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.542 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.543 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.499593+0000", 2024-09-12T18:37:37.543 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4949999999999999e-06 2024-09-12T18:37:37.543 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.543 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.543 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:37.543 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.499629+0000", 2024-09-12T18:37:37.543 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6127999999999997e-05 2024-09-12T18:37:37.543 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.543 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.543 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:37.543 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.499704+0000", 2024-09-12T18:37:37.544 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5185999999999995e-05 2024-09-12T18:37:37.544 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.544 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.544 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:37.544 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.499767+0000", 2024-09-12T18:37:37.544 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2572999999999999e-05 2024-09-12T18:37:37.544 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.544 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:37.544 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.544 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.545 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.545 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:236084 5.0 5:0e985ce8:::benchmark_data_smithi073_23739_object103807:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:37.545 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:37.500760+0000", 2024-09-12T18:37:37.545 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0017554249999999999, 2024-09-12T18:37:37.545 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020839859999999999, 2024-09-12T18:37:37.545 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:37.545 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:37.545 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:37.545 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:37.545 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:37.545 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:37.545 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 236084 2024-09-12T18:37:37.545 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.546 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:37.546 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.546 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:37.546 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.500760+0000", 2024-09-12T18:37:37.546 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.546 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.546 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.546 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:37.546 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.500760+0000", 2024-09-12T18:37:37.546 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.546 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.546 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.547 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:37.547 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.500762+0000", 2024-09-12T18:37:37.547 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.113e-06 2024-09-12T18:37:37.547 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.547 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.547 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:37.547 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.500766+0000", 2024-09-12T18:37:37.547 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6380000000000003e-06 2024-09-12T18:37:37.547 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.547 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.547 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:37.547 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.500780+0000", 2024-09-12T18:37:37.548 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3468999999999999e-05 2024-09-12T18:37:37.548 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.548 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.548 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.548 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.500787+0000", 2024-09-12T18:37:37.548 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6329999999999996e-06 2024-09-12T18:37:37.548 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.548 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.548 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:37.548 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.500822+0000", 2024-09-12T18:37:37.549 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4681000000000002e-05 2024-09-12T18:37:37.549 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.549 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.549 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:37.549 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.500897+0000", 2024-09-12T18:37:37.549 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4641999999999994e-05 2024-09-12T18:37:37.549 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.549 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.549 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:37.549 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:37.500974+0000", 2024-09-12T18:37:37.549 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7746999999999999e-05 2024-09-12T18:37:37.549 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.549 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:37.550 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.550 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.550 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-09-12T18:37:37.550 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 7 2024-09-12T18:37:37.550 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:37.551 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:37:37.556 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:37.550+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:37.657 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:37.650+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:37.700 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:37.700 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-09-12T18:37:37.701 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-09-12T18:37:37.701 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-09-12T18:37:37.701 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:37.720 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:37:37.758 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:37.754+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:37.858 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:37.854+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:37.875 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:37.875 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-09-12T18:37:37.875 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-09-12T18:37:37.875 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:37:37.875 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.875 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121096 5.8 5:13503891:::benchmark_data_smithi073_23739_object121095:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:37.875 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:37:37.875 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 57.691775385, 2024-09-12T18:37:37.876 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064025391000000001, 2024-09-12T18:37:37.876 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:37.876 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:37.876 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:37.876 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:37.876 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:37.876 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:37.876 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121096 2024-09-12T18:37:37.876 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.876 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:37.876 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.877 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:37.877 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:37:37.877 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.877 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.877 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.877 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:37.877 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:37:37.877 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.877 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.877 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.877 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:37.877 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178579+0000", 2024-09-12T18:37:37.877 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7369999999999998e-06 2024-09-12T18:37:37.878 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.878 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.878 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:37.878 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178846+0000", 2024-09-12T18:37:37.878 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026752699999999999 2024-09-12T18:37:37.878 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.878 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.878 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:37.878 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178877+0000", 2024-09-12T18:37:37.879 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1081999999999998e-05 2024-09-12T18:37:37.879 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.879 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.879 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.879 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178896+0000", 2024-09-12T18:37:37.879 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8522e-05 2024-09-12T18:37:37.879 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.879 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.879 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:37.879 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.192591+0000", 2024-09-12T18:37:37.879 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013695067 2024-09-12T18:37:37.879 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.879 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.880 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:37.880 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.192944+0000", 2024-09-12T18:37:37.880 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00035273699999999999 2024-09-12T18:37:37.880 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.880 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.880 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:37.880 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.193732+0000", 2024-09-12T18:37:37.880 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078849599999999997 2024-09-12T18:37:37.880 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.880 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.880 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:37.880 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.213583+0000", 2024-09-12T18:37:37.881 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.019851164000000001 2024-09-12T18:37:37.881 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.881 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.881 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:37.881 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242386+0000", 2024-09-12T18:37:37.881 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028802924000000001 2024-09-12T18:37:37.881 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.881 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.881 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:37.881 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242501+0000", 2024-09-12T18:37:37.881 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000114932 2024-09-12T18:37:37.881 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.882 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.882 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:37.882 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242602+0000", 2024-09-12T18:37:37.882 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000100203 2024-09-12T18:37:37.882 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.882 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:37.882 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.882 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.882 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.882 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121097 5.8 5:1b31a99e:::benchmark_data_smithi073_23739_object121096:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:37.882 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:37:37.882 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 57.676047095000001, 2024-09-12T18:37:37.882 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048475917, 2024-09-12T18:37:37.882 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:37.883 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:37.883 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:37.883 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:37.883 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:37.883 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:37.883 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121097 2024-09-12T18:37:37.883 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.883 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:37.883 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.883 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:37.883 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:37:37.883 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.883 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.883 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.884 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:37.884 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:37:37.884 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.884 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.884 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.884 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:37.884 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194308+0000", 2024-09-12T18:37:37.884 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2789999999999999e-06 2024-09-12T18:37:37.884 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.884 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.884 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:37.884 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194396+0000", 2024-09-12T18:37:37.885 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8324000000000003e-05 2024-09-12T18:37:37.885 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.885 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.885 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:37.885 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194424+0000", 2024-09-12T18:37:37.885 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7565000000000001e-05 2024-09-12T18:37:37.885 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.885 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.885 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.885 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194444+0000", 2024-09-12T18:37:37.885 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0363000000000001e-05 2024-09-12T18:37:37.885 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.885 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.885 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:37.886 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.206888+0000", 2024-09-12T18:37:37.886 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012443997 2024-09-12T18:37:37.886 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.886 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.886 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:37.886 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.207138+0000", 2024-09-12T18:37:37.886 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025035900000000002 2024-09-12T18:37:37.886 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.886 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.886 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:37.886 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.207365+0000", 2024-09-12T18:37:37.886 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000226407 2024-09-12T18:37:37.886 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.887 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.887 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:37.887 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.215059+0000", 2024-09-12T18:37:37.887 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076946860000000001 2024-09-12T18:37:37.887 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.887 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.887 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:37.887 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242619+0000", 2024-09-12T18:37:37.887 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.027559975 2024-09-12T18:37:37.887 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.887 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.887 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:37.887 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242706+0000", 2024-09-12T18:37:37.888 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6384999999999994e-05 2024-09-12T18:37:37.888 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.888 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.888 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:37.888 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242780+0000", 2024-09-12T18:37:37.888 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4577000000000001e-05 2024-09-12T18:37:37.888 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.888 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:37.888 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.888 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.888 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.888 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121101 5.e 5:7e18e9ed:::benchmark_data_smithi073_23739_object121100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:37.888 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.209084+0000", 2024-09-12T18:37:37.889 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 57.661267039999998, 2024-09-12T18:37:37.889 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028988566, 2024-09-12T18:37:37.889 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:37.889 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:37.889 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:37.889 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:37.889 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:37.889 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:37.889 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121101 2024-09-12T18:37:37.889 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.889 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:37.889 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.890 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:37.890 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209084+0000", 2024-09-12T18:37:37.890 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.890 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.890 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.890 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:37.890 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209084+0000", 2024-09-12T18:37:37.890 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.890 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.890 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.890 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:37.890 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209087+0000", 2024-09-12T18:37:37.891 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6800000000000002e-06 2024-09-12T18:37:37.891 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.891 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.891 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:37.891 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209182+0000", 2024-09-12T18:37:37.891 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5084e-05 2024-09-12T18:37:37.891 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.891 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.891 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:37.891 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209212+0000", 2024-09-12T18:37:37.891 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9825e-05 2024-09-12T18:37:37.891 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.891 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.891 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.892 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209234+0000", 2024-09-12T18:37:37.892 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1416e-05 2024-09-12T18:37:37.892 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.892 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.892 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:37.892 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209497+0000", 2024-09-12T18:37:37.892 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026390400000000003 2024-09-12T18:37:37.892 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.892 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.892 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:37.892 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.209810+0000", 2024-09-12T18:37:37.892 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000313023 2024-09-12T18:37:37.892 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.893 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.893 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:37.893 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.210468+0000", 2024-09-12T18:37:37.893 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00065779300000000005 2024-09-12T18:37:37.893 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.893 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.893 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:37.893 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.235905+0000", 2024-09-12T18:37:37.893 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025436881000000001 2024-09-12T18:37:37.893 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.893 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.893 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:37.893 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237797+0000", 2024-09-12T18:37:37.893 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001892007 2024-09-12T18:37:37.894 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.894 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.894 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:37.894 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237941+0000", 2024-09-12T18:37:37.894 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000143411 2024-09-12T18:37:37.894 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.894 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.894 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:37.894 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.238073+0000", 2024-09-12T18:37:37.894 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013254200000000001 2024-09-12T18:37:37.894 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.894 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:37.894 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.895 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.895 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.895 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121106 5.d 5:b4a9a221:::benchmark_data_smithi073_23739_object121105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:37.895 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:37:37.895 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 57.633172158999997, 2024-09-12T18:37:37.895 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.034882274999999997, 2024-09-12T18:37:37.895 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:37.895 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:37.895 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:37.895 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:37.895 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:37.895 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:37.895 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121106 2024-09-12T18:37:37.895 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.896 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:37.896 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.896 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:37.896 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:37:37.896 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.896 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.896 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.896 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:37.896 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:37:37.896 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.896 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.896 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.896 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:37.897 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237182+0000", 2024-09-12T18:37:37.897 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6019999999999998e-06 2024-09-12T18:37:37.897 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.897 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.897 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:37.897 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237257+0000", 2024-09-12T18:37:37.897 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5420999999999995e-05 2024-09-12T18:37:37.897 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.897 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.897 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:37.897 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237305+0000", 2024-09-12T18:37:37.897 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7207999999999999e-05 2024-09-12T18:37:37.897 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.897 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.898 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.898 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237325+0000", 2024-09-12T18:37:37.898 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0001e-05 2024-09-12T18:37:37.898 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.898 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.898 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:37.898 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237505+0000", 2024-09-12T18:37:37.898 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000180798 2024-09-12T18:37:37.898 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.898 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.898 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:37.898 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237764+0000", 2024-09-12T18:37:37.898 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025862299999999998 2024-09-12T18:37:37.898 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.899 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.899 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:37.899 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.238264+0000", 2024-09-12T18:37:37.899 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00050016100000000005 2024-09-12T18:37:37.899 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.899 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.899 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:37.899 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256525+0000", 2024-09-12T18:37:37.899 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018260508000000002 2024-09-12T18:37:37.899 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.899 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.899 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:37.899 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.271903+0000", 2024-09-12T18:37:37.900 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015378739000000001 2024-09-12T18:37:37.900 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.900 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.900 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:37.900 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.271999+0000", 2024-09-12T18:37:37.900 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5989000000000005e-05 2024-09-12T18:37:37.900 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.900 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.900 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:37.900 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272062+0000", 2024-09-12T18:37:37.900 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2224999999999995e-05 2024-09-12T18:37:37.900 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.900 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:37.900 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.901 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.901 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.901 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121112 5.d 5:b9a2d671:::benchmark_data_smithi073_23739_object121111:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:37.901 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.243446+0000", 2024-09-12T18:37:37.901 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 57.626905434000001, 2024-09-12T18:37:37.901 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.02889415, 2024-09-12T18:37:37.901 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:37.901 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:37.901 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:37.901 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:37.901 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:37.901 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:37.902 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121112 2024-09-12T18:37:37.902 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.902 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:37.902 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.902 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:37.902 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243446+0000", 2024-09-12T18:37:37.902 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.902 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.902 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.902 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:37.902 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243446+0000", 2024-09-12T18:37:37.902 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.902 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.903 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.903 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:37.903 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243448+0000", 2024-09-12T18:37:37.903 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0829999999999998e-06 2024-09-12T18:37:37.903 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.903 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.903 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:37.903 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243527+0000", 2024-09-12T18:37:37.903 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.9173999999999998e-05 2024-09-12T18:37:37.903 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.903 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.903 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:37.903 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243549+0000", 2024-09-12T18:37:37.903 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1169e-05 2024-09-12T18:37:37.903 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.904 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.904 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.904 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243564+0000", 2024-09-12T18:37:37.904 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5866999999999999e-05 2024-09-12T18:37:37.904 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.904 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.904 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:37.904 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.249905+0000", 2024-09-12T18:37:37.904 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0063410360000000004 2024-09-12T18:37:37.904 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.904 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.905 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:37.905 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.250166+0000", 2024-09-12T18:37:37.905 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026052999999999997 2024-09-12T18:37:37.905 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.905 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.905 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:37.905 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.250486+0000", 2024-09-12T18:37:37.905 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00032002700000000002 2024-09-12T18:37:37.905 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.905 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.905 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:37.905 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.259263+0000", 2024-09-12T18:37:37.905 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0087774770000000005 2024-09-12T18:37:37.905 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.906 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.906 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:37.906 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272186+0000", 2024-09-12T18:37:37.906 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.01292213 2024-09-12T18:37:37.906 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.906 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.906 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:37.906 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272267+0000", 2024-09-12T18:37:37.906 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1153e-05 2024-09-12T18:37:37.906 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.906 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.906 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:37.906 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272340+0000", 2024-09-12T18:37:37.907 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3504000000000006e-05 2024-09-12T18:37:37.907 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.907 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:37.907 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.907 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.907 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.907 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121114 5.d 5:b8870c11:::benchmark_data_smithi073_23739_object121113:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:37.907 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.243603+0000", 2024-09-12T18:37:37.907 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 57.626748182999997, 2024-09-12T18:37:37.907 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028945746000000001, 2024-09-12T18:37:37.907 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:37.907 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:37.908 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:37.908 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:37.908 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:37.908 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:37.908 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121114 2024-09-12T18:37:37.908 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.908 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:37.908 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.908 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:37.908 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243603+0000", 2024-09-12T18:37:37.908 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.908 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.908 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.909 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:37.909 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243603+0000", 2024-09-12T18:37:37.909 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.909 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.909 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.909 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:37.909 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243605+0000", 2024-09-12T18:37:37.909 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.268e-06 2024-09-12T18:37:37.909 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.909 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.909 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:37.909 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243674+0000", 2024-09-12T18:37:37.909 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9375000000000006e-05 2024-09-12T18:37:37.909 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.910 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.910 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:37.910 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243691+0000", 2024-09-12T18:37:37.910 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6517000000000001e-05 2024-09-12T18:37:37.910 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.910 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.910 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.910 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.243702+0000", 2024-09-12T18:37:37.910 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1905999999999999e-05 2024-09-12T18:37:37.910 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.910 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.910 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:37.910 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.253789+0000", 2024-09-12T18:37:37.910 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.010086776 2024-09-12T18:37:37.911 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.911 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.911 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:37.911 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.253959+0000", 2024-09-12T18:37:37.911 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00017000000000000001 2024-09-12T18:37:37.911 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.911 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.911 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:37.911 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.254179+0000", 2024-09-12T18:37:37.911 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00022003699999999999 2024-09-12T18:37:37.911 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.911 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.911 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:37.911 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.259330+0000", 2024-09-12T18:37:37.912 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0051511559999999996 2024-09-12T18:37:37.912 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.912 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.912 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:37.912 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272403+0000", 2024-09-12T18:37:37.912 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013072342000000001 2024-09-12T18:37:37.912 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.912 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.912 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:37.912 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272493+0000", 2024-09-12T18:37:37.912 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0595999999999998e-05 2024-09-12T18:37:37.912 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.912 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.913 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:37.913 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272549+0000", 2024-09-12T18:37:37.913 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5773000000000003e-05 2024-09-12T18:37:37.913 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.913 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:37.913 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.913 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.913 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.913 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121115 5.d 5:bd4a51ea:::benchmark_data_smithi073_23739_object121114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:37.913 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.245059+0000", 2024-09-12T18:37:37.913 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 57.625292508999998, 2024-09-12T18:37:37.913 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.02767406, 2024-09-12T18:37:37.914 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:37.914 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:37.914 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:37.914 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:37.914 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:37.914 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:37.914 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121115 2024-09-12T18:37:37.914 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.914 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:37.914 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.914 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:37.914 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245059+0000", 2024-09-12T18:37:37.914 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.915 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.915 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.915 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:37.915 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245059+0000", 2024-09-12T18:37:37.915 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.915 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.915 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.915 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:37.915 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245061+0000", 2024-09-12T18:37:37.915 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.9759999999999998e-06 2024-09-12T18:37:37.915 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.915 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.915 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:37.916 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245111+0000", 2024-09-12T18:37:37.916 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9838e-05 2024-09-12T18:37:37.916 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.916 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.916 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:37.916 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245132+0000", 2024-09-12T18:37:37.916 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1469999999999999e-05 2024-09-12T18:37:37.916 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.916 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.916 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.916 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.245146+0000", 2024-09-12T18:37:37.916 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3377000000000001e-05 2024-09-12T18:37:37.916 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.917 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.917 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:37.917 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256596+0000", 2024-09-12T18:37:37.917 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.011450241999999999 2024-09-12T18:37:37.917 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.917 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.917 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:37.917 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256838+0000", 2024-09-12T18:37:37.917 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000242255 2024-09-12T18:37:37.917 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.917 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.917 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:37.917 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.257095+0000", 2024-09-12T18:37:37.918 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025679300000000001 2024-09-12T18:37:37.918 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.918 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.918 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:37.918 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.259928+0000", 2024-09-12T18:37:37.918 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0028326290000000001 2024-09-12T18:37:37.918 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.918 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.918 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:37.918 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272607+0000", 2024-09-12T18:37:37.918 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012679466 2024-09-12T18:37:37.918 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.918 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.919 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:37.919 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272681+0000", 2024-09-12T18:37:37.919 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3580999999999999e-05 2024-09-12T18:37:37.919 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.919 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.919 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:37.919 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272733+0000", 2024-09-12T18:37:37.919 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2432999999999998e-05 2024-09-12T18:37:37.919 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.919 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:37.919 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.919 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.919 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.919 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:131551 5.d 5:b8f8c77a:::benchmark_data_smithi073_23739_object131550:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:37:37.920 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:45.499878+0000", 2024-09-12T18:37:37.920 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 52.370473244999999, 2024-09-12T18:37:37.920 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.027478433, 2024-09-12T18:37:37.920 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:37.920 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:37.920 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:37.920 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:37.920 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:37.920 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:37.920 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 131551 2024-09-12T18:37:37.920 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.920 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:37.920 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.921 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:37.921 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499878+0000", 2024-09-12T18:37:37.921 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.921 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.921 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.921 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:37.921 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499878+0000", 2024-09-12T18:37:37.921 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.921 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.921 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.921 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:37.921 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499879+0000", 2024-09-12T18:37:37.921 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.92e-07 2024-09-12T18:37:37.921 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.922 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.922 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:37.922 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499946+0000", 2024-09-12T18:37:37.922 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6712999999999996e-05 2024-09-12T18:37:37.922 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.922 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.922 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:37.922 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499953+0000", 2024-09-12T18:37:37.922 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5519999999999999e-06 2024-09-12T18:37:37.922 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.922 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.922 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.922 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.499959+0000", 2024-09-12T18:37:37.922 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0430000000000004e-06 2024-09-12T18:37:37.922 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.923 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.923 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:37.923 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.500004+0000", 2024-09-12T18:37:37.923 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5058000000000001e-05 2024-09-12T18:37:37.924 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.924 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.924 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:37.924 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.500121+0000", 2024-09-12T18:37:37.924 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000116747 2024-09-12T18:37:37.924 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.924 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.924 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:37.924 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.500283+0000", 2024-09-12T18:37:37.924 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00016190599999999999 2024-09-12T18:37:37.924 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.924 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.924 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:37.925 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.504017+0000", 2024-09-12T18:37:37.925 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.003734125 2024-09-12T18:37:37.925 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.925 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.925 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:37.925 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.527224+0000", 2024-09-12T18:37:37.925 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.023206724000000001 2024-09-12T18:37:37.925 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.925 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.925 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:37.925 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.527290+0000", 2024-09-12T18:37:37.925 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5778999999999995e-05 2024-09-12T18:37:37.925 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.925 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.926 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:37.926 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:45.527357+0000", 2024-09-12T18:37:37.926 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7094000000000005e-05 2024-09-12T18:37:37.926 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.926 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:37.926 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.926 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.926 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.926 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:167368 5.4 5:29a1ec58:::benchmark_data_smithi073_23739_object35091:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:37.926 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:03.168773+0000", 2024-09-12T18:37:37.926 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 34.701578292000001, 2024-09-12T18:37:37.926 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.066578597000000003, 2024-09-12T18:37:37.927 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:37.927 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:37.927 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:37.927 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:37.927 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:37.927 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:37.927 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 167368 2024-09-12T18:37:37.927 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.927 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:37.927 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.927 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:37.927 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168773+0000", 2024-09-12T18:37:37.927 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.927 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.928 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:37.928 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168773+0000", 2024-09-12T18:37:37.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.928 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.928 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:37.928 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168774+0000", 2024-09-12T18:37:37.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.023e-06 2024-09-12T18:37:37.928 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.928 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:37.928 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168779+0000", 2024-09-12T18:37:37.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5800000000000002e-06 2024-09-12T18:37:37.929 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.929 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.929 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:37.929 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168789+0000", 2024-09-12T18:37:37.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0346999999999999e-05 2024-09-12T18:37:37.929 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.929 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.929 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.929 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168808+0000", 2024-09-12T18:37:37.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8423e-05 2024-09-12T18:37:37.929 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.929 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.929 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:37.930 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168864+0000", 2024-09-12T18:37:37.930 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-09-12T18:37:37.930 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.930 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:37.930 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168947+0000", 2024-09-12T18:37:37.930 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3274000000000003e-05 2024-09-12T18:37:37.930 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.930 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:37.930 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.169014+0000", 2024-09-12T18:37:37.930 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6284000000000004e-05 2024-09-12T18:37:37.930 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.931 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:37.931 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.170653+0000", 2024-09-12T18:37:37.931 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016389779999999999 2024-09-12T18:37:37.931 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.931 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.931 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:37.931 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.235279+0000", 2024-09-12T18:37:37.931 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064626464999999994 2024-09-12T18:37:37.931 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.931 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.931 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:37.931 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.235320+0000", 2024-09-12T18:37:37.931 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0377000000000003e-05 2024-09-12T18:37:37.931 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.932 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.932 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:37.932 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.235352+0000", 2024-09-12T18:37:37.932 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2322e-05 2024-09-12T18:37:37.932 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.932 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:37.932 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.932 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.932 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.933 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:167371 5.4 5:24fea27c:::benchmark_data_smithi073_23739_object35094:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:37.933 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:03.171234+0000", 2024-09-12T18:37:37.933 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 34.699117266999998, 2024-09-12T18:37:37.933 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.066048171000000003, 2024-09-12T18:37:37.933 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:37.933 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:37.933 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:37.933 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:37.933 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:37.933 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:37.933 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 167371 2024-09-12T18:37:37.933 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.933 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:37.933 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.934 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:37.934 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171234+0000", 2024-09-12T18:37:37.934 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.934 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.934 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.934 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:37.934 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171234+0000", 2024-09-12T18:37:37.934 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.934 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.934 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.934 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:37.934 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171235+0000", 2024-09-12T18:37:37.934 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8599999999999997e-07 2024-09-12T18:37:37.935 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.935 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:37.935 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171238+0000", 2024-09-12T18:37:37.935 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9739999999999998e-06 2024-09-12T18:37:37.935 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.935 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:37.935 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171245+0000", 2024-09-12T18:37:37.935 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6000000000000003e-06 2024-09-12T18:37:37.935 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.935 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.935 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171249+0000", 2024-09-12T18:37:37.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9960000000000004e-06 2024-09-12T18:37:37.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.936 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.936 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:37.936 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171288+0000", 2024-09-12T18:37:37.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9119999999999998e-05 2024-09-12T18:37:37.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.936 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.936 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:37.936 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171359+0000", 2024-09-12T18:37:37.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0951000000000006e-05 2024-09-12T18:37:37.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.936 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.937 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:37.937 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171425+0000", 2024-09-12T18:37:37.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.58e-05 2024-09-12T18:37:37.937 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.937 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.937 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:37.937 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.173093+0000", 2024-09-12T18:37:37.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016683939999999999 2024-09-12T18:37:37.937 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.937 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.937 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:37.937 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.237202+0000", 2024-09-12T18:37:37.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064109437000000005 2024-09-12T18:37:37.937 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.938 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.938 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:37.938 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.237249+0000", 2024-09-12T18:37:37.938 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6751e-05 2024-09-12T18:37:37.938 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.938 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.938 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:37.938 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.237282+0000", 2024-09-12T18:37:37.938 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3262000000000001e-05 2024-09-12T18:37:37.938 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.938 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:37.938 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.938 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.938 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.939 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:201498 5.a e67/21 5:5815d848:::benchmark_data_smithi073_23739_object69221:head v 67'12793, mlcod=67'12791)", 2024-09-12T18:37:37.939 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.430872+0000", 2024-09-12T18:37:37.939 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 17.439479289000001, 2024-09-12T18:37:37.939 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.038775280000000002, 2024-09-12T18:37:37.939 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:37.939 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:37.939 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:37.939 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:37.939 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.939 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:37.939 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430872+0000", 2024-09-12T18:37:37.939 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.939 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.940 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.940 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:37.940 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430872+0000", 2024-09-12T18:37:37.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.940 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.940 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.940 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:37.940 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430873+0000", 2024-09-12T18:37:37.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6600000000000003e-07 2024-09-12T18:37:37.940 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.940 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.940 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:37.940 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430875+0000", 2024-09-12T18:37:37.941 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5399999999999998e-06 2024-09-12T18:37:37.941 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.941 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.941 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:37.941 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430879+0000", 2024-09-12T18:37:37.941 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7239999999999998e-06 2024-09-12T18:37:37.941 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.941 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.941 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.941 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430882+0000", 2024-09-12T18:37:37.941 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8679999999999999e-06 2024-09-12T18:37:37.941 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.941 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.941 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:37.942 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430909+0000", 2024-09-12T18:37:37.942 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7832999999999999e-05 2024-09-12T18:37:37.942 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.942 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:37.942 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430922+0000", 2024-09-12T18:37:37.942 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2164000000000001e-05 2024-09-12T18:37:37.942 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.942 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:37.942 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469578+0000", 2024-09-12T18:37:37.942 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.038656469999999998 2024-09-12T18:37:37.942 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:37.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469648+0000", 2024-09-12T18:37:37.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9414999999999999e-05 2024-09-12T18:37:37.943 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.943 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:37.943 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.943 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.943 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201513 5.e 5:7be2f597:::benchmark_data_smithi073_23739_object69236:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:37.943 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.435121+0000", 2024-09-12T18:37:37.943 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 17.435230535999999, 2024-09-12T18:37:37.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.034945021999999999, 2024-09-12T18:37:37.943 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:37.943 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:37.944 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:37.944 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:37.944 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:37.944 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:37.944 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201513 2024-09-12T18:37:37.944 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.944 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:37.944 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.944 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:37.944 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.435121+0000", 2024-09-12T18:37:37.944 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.944 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.944 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.945 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:37.945 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.435121+0000", 2024-09-12T18:37:37.945 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.945 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.945 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.945 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:37.945 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.435122+0000", 2024-09-12T18:37:37.945 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2440000000000001e-06 2024-09-12T18:37:37.945 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.945 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.945 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:37.945 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.435126+0000", 2024-09-12T18:37:37.945 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1559999999999997e-06 2024-09-12T18:37:37.945 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.946 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:37.946 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445086+0000", 2024-09-12T18:37:37.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0099592389999999999 2024-09-12T18:37:37.946 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.946 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.946 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445095+0000", 2024-09-12T18:37:37.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2620000000000004e-06 2024-09-12T18:37:37.946 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.946 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:37.946 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445165+0000", 2024-09-12T18:37:37.947 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0257000000000002e-05 2024-09-12T18:37:37.947 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.947 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.947 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:37.947 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445311+0000", 2024-09-12T18:37:37.947 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014603899999999999 2024-09-12T18:37:37.947 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.947 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.947 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:37.947 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445445+0000", 2024-09-12T18:37:37.947 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000133654 2024-09-12T18:37:37.947 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.947 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.947 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:37.947 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469853+0000", 2024-09-12T18:37:37.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024407893999999999 2024-09-12T18:37:37.948 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:37.948 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469873+0000", 2024-09-12T18:37:37.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0622e-05 2024-09-12T18:37:37.948 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:37.948 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469949+0000", 2024-09-12T18:37:37.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5918000000000001e-05 2024-09-12T18:37:37.948 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:37.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470066+0000", 2024-09-12T18:37:37.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000116737 2024-09-12T18:37:37.949 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.949 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:37.949 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.949 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201521 5.d 5:b911ab6f:::benchmark_data_smithi073_23739_object69244:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:37.949 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445173+0000", 2024-09-12T18:37:37.949 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 17.425178093, 2024-09-12T18:37:37.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.031483274999999998, 2024-09-12T18:37:37.949 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:37.949 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:37.950 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:37.950 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:37.950 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:37.950 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:37.950 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201521 2024-09-12T18:37:37.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.950 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:37.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.950 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:37.950 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445173+0000", 2024-09-12T18:37:37.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.951 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:37.951 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445173+0000", 2024-09-12T18:37:37.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.951 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.951 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:37.951 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445174+0000", 2024-09-12T18:37:37.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4299999999999998e-07 2024-09-12T18:37:37.951 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.952 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.952 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:37.952 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445176+0000", 2024-09-12T18:37:37.952 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.469e-06 2024-09-12T18:37:37.952 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.952 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.952 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:37.952 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445183+0000", 2024-09-12T18:37:37.952 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8719999999999996e-06 2024-09-12T18:37:37.952 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.953 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.953 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.953 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445188+0000", 2024-09-12T18:37:37.953 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7079999999999996e-06 2024-09-12T18:37:37.953 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.953 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.953 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:37.953 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445314+0000", 2024-09-12T18:37:37.953 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012627800000000001 2024-09-12T18:37:37.953 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.953 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.953 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:37.953 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445436+0000", 2024-09-12T18:37:37.954 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000122007 2024-09-12T18:37:37.954 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.954 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.954 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:37.954 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445541+0000", 2024-09-12T18:37:37.954 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000105068 2024-09-12T18:37:37.954 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.954 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.954 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:37.954 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470655+0000", 2024-09-12T18:37:37.954 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025114035 2024-09-12T18:37:37.954 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.954 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:37.955 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476570+0000", 2024-09-12T18:37:37.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0059143269999999996 2024-09-12T18:37:37.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:37.955 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476624+0000", 2024-09-12T18:37:37.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4261000000000001e-05 2024-09-12T18:37:37.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:37.956 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476657+0000", 2024-09-12T18:37:37.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2806999999999999e-05 2024-09-12T18:37:37.956 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.956 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:37.956 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.956 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.956 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.956 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201524 5.d 5:b330b18b:::benchmark_data_smithi073_23739_object69247:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:37.956 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445202+0000", 2024-09-12T18:37:37.956 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 17.425149832999999, 2024-09-12T18:37:37.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.034036482, 2024-09-12T18:37:37.956 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:37.957 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:37.957 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:37.957 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:37.957 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:37.957 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:37.957 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201524 2024-09-12T18:37:37.957 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.957 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:37.957 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.957 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:37.957 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445202+0000", 2024-09-12T18:37:37.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.958 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.958 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.958 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:37.958 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445202+0000", 2024-09-12T18:37:37.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.958 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.958 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.958 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:37.958 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445202+0000", 2024-09-12T18:37:37.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2e-07 2024-09-12T18:37:37.958 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.958 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.959 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:37.959 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445204+0000", 2024-09-12T18:37:37.959 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0490000000000002e-06 2024-09-12T18:37:37.959 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.959 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:37.959 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445210+0000", 2024-09-12T18:37:37.959 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.959e-06 2024-09-12T18:37:37.959 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.959 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.959 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445215+0000", 2024-09-12T18:37:37.959 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.668e-06 2024-09-12T18:37:37.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.960 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:37.960 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470703+0000", 2024-09-12T18:37:37.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025488182000000002 2024-09-12T18:37:37.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.960 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:37.960 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470911+0000", 2024-09-12T18:37:37.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020755400000000001 2024-09-12T18:37:37.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.960 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:37.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.471309+0000", 2024-09-12T18:37:37.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00039868199999999998 2024-09-12T18:37:37.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:37.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476724+0000", 2024-09-12T18:37:37.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054150589999999998 2024-09-12T18:37:37.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:37.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.479050+0000", 2024-09-12T18:37:37.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0023259309999999998 2024-09-12T18:37:37.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:37.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.479164+0000", 2024-09-12T18:37:37.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000114127 2024-09-12T18:37:37.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:37.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.479238+0000", 2024-09-12T18:37:37.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3751000000000006e-05 2024-09-12T18:37:37.962 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.962 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:37.962 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.962 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_backfill(progress 5.5 e 67/67 lb 5:a30f9be2:::benchmark_data_smithi073_23739_object118666:head)", 2024-09-12T18:37:37.963 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445433+0000", 2024-09-12T18:37:37.963 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 17.424918946999998, 2024-09-12T18:37:37.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.029511351000000002, 2024-09-12T18:37:37.963 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:37.963 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:37.963 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:37:37.963 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:37.963 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.963 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:37.963 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445433+0000", 2024-09-12T18:37:37.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.963 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.963 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.964 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:37.964 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445433+0000", 2024-09-12T18:37:37.964 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.964 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.964 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.964 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:37.964 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445433+0000", 2024-09-12T18:37:37.964 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0699999999999998e-07 2024-09-12T18:37:37.964 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.964 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.964 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:37.964 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445440+0000", 2024-09-12T18:37:37.964 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6630000000000004e-06 2024-09-12T18:37:37.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:37.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445447+0000", 2024-09-12T18:37:37.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5159999999999997e-06 2024-09-12T18:37:37.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445454+0000", 2024-09-12T18:37:37.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.267e-06 2024-09-12T18:37:37.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:37.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.474780+0000", 2024-09-12T18:37:37.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.029325496999999999 2024-09-12T18:37:37.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:37.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.474802+0000", 2024-09-12T18:37:37.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2348999999999999e-05 2024-09-12T18:37:37.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:37.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.474944+0000", 2024-09-12T18:37:37.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014165200000000001 2024-09-12T18:37:37.966 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.966 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:37.967 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.967 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:201515 5.5 e67/49 5:a25bd8bb:::benchmark_data_smithi073_23739_object69238:head v 67'12752, mlcod=67'12750)", 2024-09-12T18:37:37.967 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445471+0000", 2024-09-12T18:37:37.967 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 17.424881031999998, 2024-09-12T18:37:37.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.031081396000000001, 2024-09-12T18:37:37.967 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:37.967 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:37.967 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:37.967 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:37.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:37.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445471+0000", 2024-09-12T18:37:37.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.968 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:37.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445471+0000", 2024-09-12T18:37:37.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:37.969 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445471+0000", 2024-09-12T18:37:37.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5400000000000002e-07 2024-09-12T18:37:37.969 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:37.969 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445475+0000", 2024-09-12T18:37:37.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2379999999999999e-06 2024-09-12T18:37:37.970 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.970 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.970 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:37.970 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445481+0000", 2024-09-12T18:37:37.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0229999999999998e-06 2024-09-12T18:37:37.970 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.970 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.970 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.970 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445486+0000", 2024-09-12T18:37:37.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5040000000000004e-06 2024-09-12T18:37:37.970 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.970 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.970 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:37.970 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445970+0000", 2024-09-12T18:37:37.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048416699999999997 2024-09-12T18:37:37.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:37.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445991+0000", 2024-09-12T18:37:37.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1067999999999999e-05 2024-09-12T18:37:37.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:37.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476511+0000", 2024-09-12T18:37:37.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.030520629000000001 2024-09-12T18:37:37.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:37.972 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476552+0000", 2024-09-12T18:37:37.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0413000000000001e-05 2024-09-12T18:37:37.972 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.972 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:37.972 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.972 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:201526 5.5 e67/49 5:a3549698:::benchmark_data_smithi073_23739_object69249:head v 67'12753, mlcod=67'12750)", 2024-09-12T18:37:37.972 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445957+0000", 2024-09-12T18:37:37.972 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 17.424394100000001, 2024-09-12T18:37:37.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.030732494999999999, 2024-09-12T18:37:37.972 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:37.972 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:37.973 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:37.973 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:37.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:37.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445957+0000", 2024-09-12T18:37:37.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:37.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445957+0000", 2024-09-12T18:37:37.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:37.974 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445958+0000", 2024-09-12T18:37:37.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7800000000000001e-07 2024-09-12T18:37:37.974 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.974 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:37.974 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445963+0000", 2024-09-12T18:37:37.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5419999999999999e-06 2024-09-12T18:37:37.974 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.974 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:37.974 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445972+0000", 2024-09-12T18:37:37.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4169999999999998e-06 2024-09-12T18:37:37.974 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.975 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.975 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445979+0000", 2024-09-12T18:37:37.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2949999999999996e-06 2024-09-12T18:37:37.975 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.975 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.975 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:37.975 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.447710+0000", 2024-09-12T18:37:37.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001731067 2024-09-12T18:37:37.975 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.975 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.975 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:37.975 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.447734+0000", 2024-09-12T18:37:37.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4094e-05 2024-09-12T18:37:37.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.976 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:37.976 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476659+0000", 2024-09-12T18:37:37.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028924268999999999 2024-09-12T18:37:37.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.976 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:37.976 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476690+0000", 2024-09-12T18:37:37.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1232999999999997e-05 2024-09-12T18:37:37.976 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.976 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:37.976 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.977 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:201528 5.5 e67/49 5:a971b633:::benchmark_data_smithi073_23739_object69251:head v 67'12754, mlcod=67'12750)", 2024-09-12T18:37:37.977 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.449001+0000", 2024-09-12T18:37:37.977 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 17.421350625999999, 2024-09-12T18:37:37.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.027719695999999999, 2024-09-12T18:37:37.977 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:37.977 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:37.977 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:37.977 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:37.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:37.977 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.449001+0000", 2024-09-12T18:37:37.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.978 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.978 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:37.978 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.449001+0000", 2024-09-12T18:37:37.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.978 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.978 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:37.978 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.449002+0000", 2024-09-12T18:37:37.978 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.16e-07 2024-09-12T18:37:37.978 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.978 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.978 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:37.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.449008+0000", 2024-09-12T18:37:37.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.9390000000000002e-06 2024-09-12T18:37:37.979 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.979 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:37.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469460+0000", 2024-09-12T18:37:37.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.020452060000000001 2024-09-12T18:37:37.979 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.979 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.979 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469476+0000", 2024-09-12T18:37:37.979 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6308e-05 2024-09-12T18:37:37.979 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.979 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.980 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:37.980 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470649+0000", 2024-09-12T18:37:37.980 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0011725749999999999 2024-09-12T18:37:37.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.980 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:37.980 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470676+0000", 2024-09-12T18:37:37.980 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6806000000000001e-05 2024-09-12T18:37:37.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.980 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.980 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:37.980 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476703+0000", 2024-09-12T18:37:37.980 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0060279720000000004 2024-09-12T18:37:37.980 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.981 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.981 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:37.981 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476721+0000", 2024-09-12T18:37:37.981 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7119999999999999e-05 2024-09-12T18:37:37.981 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.981 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:37.981 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.981 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.981 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.981 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201583 5.d 5:b91eedec:::benchmark_data_smithi073_23739_object69306:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:37.981 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.494097+0000", 2024-09-12T18:37:37.981 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 17.376254238000001, 2024-09-12T18:37:37.981 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049293508, 2024-09-12T18:37:37.982 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:37.982 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:37.982 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:37.982 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:37.982 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:37.982 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:37.982 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201583 2024-09-12T18:37:37.982 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.982 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:37.982 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.982 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:37.982 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494097+0000", 2024-09-12T18:37:37.982 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.982 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.983 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.983 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:37.983 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494097+0000", 2024-09-12T18:37:37.983 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.983 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.983 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.983 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:37.983 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494098+0000", 2024-09-12T18:37:37.983 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0699999999999996e-07 2024-09-12T18:37:37.983 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.983 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.983 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:37.983 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494102+0000", 2024-09-12T18:37:37.984 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.664e-06 2024-09-12T18:37:37.984 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.984 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:37.984 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494108+0000", 2024-09-12T18:37:37.984 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.3149999999999997e-06 2024-09-12T18:37:37.984 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.984 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.984 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494112+0000", 2024-09-12T18:37:37.984 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0659999999999997e-06 2024-09-12T18:37:37.984 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.984 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.984 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:37.985 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494200+0000", 2024-09-12T18:37:37.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7770999999999997e-05 2024-09-12T18:37:37.985 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.985 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.985 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:37.985 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494315+0000", 2024-09-12T18:37:37.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000115048 2024-09-12T18:37:37.985 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.985 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.985 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:37.985 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494414+0000", 2024-09-12T18:37:37.985 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8820999999999995e-05 2024-09-12T18:37:37.985 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.986 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.986 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:37.986 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.497199+0000", 2024-09-12T18:37:37.986 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0027854279999999999 2024-09-12T18:37:37.986 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.986 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.986 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:37.986 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543193+0000", 2024-09-12T18:37:37.986 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.045993500999999999 2024-09-12T18:37:37.986 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.986 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.986 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:37.986 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543315+0000", 2024-09-12T18:37:37.987 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012246800000000001 2024-09-12T18:37:37.987 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.987 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.987 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:37.987 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543391+0000", 2024-09-12T18:37:37.987 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5618999999999995e-05 2024-09-12T18:37:37.987 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.987 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:37.987 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.987 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.987 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.987 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201585 5.d 5:bb6c167f:::benchmark_data_smithi073_23739_object69308:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:37.987 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.495295+0000", 2024-09-12T18:37:37.988 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 17.375056070999999, 2024-09-12T18:37:37.988 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048312129000000002, 2024-09-12T18:37:37.988 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:37.988 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:37.988 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:37.988 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:37.988 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:37.988 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:37.988 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201585 2024-09-12T18:37:37.988 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.988 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:37.988 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.988 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:37.988 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495295+0000", 2024-09-12T18:37:37.989 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.989 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.989 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.989 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:37.989 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495295+0000", 2024-09-12T18:37:37.989 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:37.989 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.989 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.989 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:37.989 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495296+0000", 2024-09-12T18:37:37.989 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0330000000000001e-06 2024-09-12T18:37:37.989 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.989 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.989 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:37.990 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495301+0000", 2024-09-12T18:37:37.990 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7049999999999998e-06 2024-09-12T18:37:37.990 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.990 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.990 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:37.990 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495312+0000", 2024-09-12T18:37:37.990 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0791000000000001e-05 2024-09-12T18:37:37.990 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.990 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.990 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:37.990 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495319+0000", 2024-09-12T18:37:37.990 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8240000000000002e-06 2024-09-12T18:37:37.990 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.990 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.991 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:37.991 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.496088+0000", 2024-09-12T18:37:37.991 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00076901200000000002 2024-09-12T18:37:37.991 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.991 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.991 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:37.991 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.496166+0000", 2024-09-12T18:37:37.991 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.8491000000000005e-05 2024-09-12T18:37:37.991 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.991 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.991 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:37.991 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.496232+0000", 2024-09-12T18:37:37.991 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5400000000000004e-05 2024-09-12T18:37:37.991 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.992 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.992 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:37.992 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.497467+0000", 2024-09-12T18:37:37.992 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001235049 2024-09-12T18:37:37.992 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.992 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.992 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:37.992 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543463+0000", 2024-09-12T18:37:37.992 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.045995743999999998 2024-09-12T18:37:37.992 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.992 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.992 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:37.992 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543546+0000", 2024-09-12T18:37:37.992 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3434000000000001e-05 2024-09-12T18:37:37.993 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:37.993 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:37.993 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:37.993 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543608+0000", 2024-09-12T18:37:37.993 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1645999999999999e-05 2024-09-12T18:37:37.993 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.993 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:37.993 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.993 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:37.993 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:37.993 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:37.995 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:37:37.995 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:37.991+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:38.096 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:38.090+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:38.152 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:38.152 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:37:38.152 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.152 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:237472 5.3 e75/21 5:c5225bdd:::benchmark_data_smithi073_23739_object105195:head v 75'14602, mlcod=75'14600)", 2024-09-12T18:37:38.152 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:38.144997+0000", 2024-09-12T18:37:38.152 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0046291659999999997, 2024-09-12T18:37:38.152 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0046580079999999999, 2024-09-12T18:37:38.152 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:38.153 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:38.153 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:37:38.153 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:38.153 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.153 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:38.153 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.144997+0000", 2024-09-12T18:37:38.153 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.153 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.153 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.153 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:38.153 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.144997+0000", 2024-09-12T18:37:38.153 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.154 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.154 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.154 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:38.154 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.144998+0000", 2024-09-12T18:37:38.154 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.0800000000000005e-07 2024-09-12T18:37:38.154 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.154 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.154 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:38.154 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.145002+0000", 2024-09-12T18:37:38.154 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.5820000000000003e-06 2024-09-12T18:37:38.154 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.154 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.155 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:38.155 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.145012+0000", 2024-09-12T18:37:38.155 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7170000000000003e-06 2024-09-12T18:37:38.155 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.155 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.155 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:38.155 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.145018+0000", 2024-09-12T18:37:38.155 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.1589999999999998e-06 2024-09-12T18:37:38.155 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.155 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.155 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:38.155 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.145068+0000", 2024-09-12T18:37:38.155 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.0260999999999999e-05 2024-09-12T18:37:38.156 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.156 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.156 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:38.156 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.145089+0000", 2024-09-12T18:37:38.156 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.0871000000000001e-05 2024-09-12T18:37:38.156 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.156 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:38.156 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.156 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.156 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.156 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:237479 5.2 5:4340b60c:::benchmark_data_smithi073_23739_object105202:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:38.156 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:38.145733+0000", 2024-09-12T18:37:38.157 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0038929659999999999, 2024-09-12T18:37:38.157 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003990426, 2024-09-12T18:37:38.157 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:38.157 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:38.157 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:38.157 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:38.157 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:38.157 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:38.157 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 237479 2024-09-12T18:37:38.157 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.157 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:38.157 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.158 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:38.158 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.145733+0000", 2024-09-12T18:37:38.158 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.158 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.158 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.158 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:38.158 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.145733+0000", 2024-09-12T18:37:38.158 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.158 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.158 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.158 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:38.158 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.145735+0000", 2024-09-12T18:37:38.158 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4479999999999999e-06 2024-09-12T18:37:38.159 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.159 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.159 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:38.159 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.145739+0000", 2024-09-12T18:37:38.159 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.1459999999999998e-06 2024-09-12T18:37:38.159 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.159 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.159 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:38.159 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.145749+0000", 2024-09-12T18:37:38.159 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.499e-06 2024-09-12T18:37:38.159 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.159 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.160 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:38.160 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.145755+0000", 2024-09-12T18:37:38.160 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.7399999999999998e-06 2024-09-12T18:37:38.160 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.160 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.160 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:38.160 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.145824+0000", 2024-09-12T18:37:38.160 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.8306999999999995e-05 2024-09-12T18:37:38.160 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.160 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.160 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:38.160 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.145913+0000", 2024-09-12T18:37:38.160 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.9773999999999998e-05 2024-09-12T18:37:38.161 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.161 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.161 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:38.161 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.145977+0000", 2024-09-12T18:37:38.161 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.3700000000000003e-05 2024-09-12T18:37:38.161 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.161 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.161 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:38.161 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.147881+0000", 2024-09-12T18:37:38.161 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001903709 2024-09-12T18:37:38.161 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.161 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:38.161 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.162 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.162 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.162 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:237480 5.0 e75/65 5:0d862bbf:::benchmark_data_smithi073_23739_object105203:head v 75'15015, mlcod=75'15013)", 2024-09-12T18:37:38.162 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:38.147160+0000", 2024-09-12T18:37:38.162 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0024667539999999998, 2024-09-12T18:37:38.162 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0026395899999999998, 2024-09-12T18:37:38.162 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:38.162 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:38.162 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:37:38.162 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:38.162 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.162 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:38.163 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.147160+0000", 2024-09-12T18:37:38.163 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.163 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.163 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.163 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:38.163 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.147160+0000", 2024-09-12T18:37:38.163 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.163 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.163 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.163 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:38.163 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.147160+0000", 2024-09-12T18:37:38.163 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9299999999999998e-07 2024-09-12T18:37:38.163 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.164 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.164 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:38.164 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.147190+0000", 2024-09-12T18:37:38.164 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.9921999999999999e-05 2024-09-12T18:37:38.164 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.164 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.164 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:38.164 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.147200+0000", 2024-09-12T18:37:38.164 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.5200000000000003e-06 2024-09-12T18:37:38.164 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.164 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.164 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:38.164 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.147206+0000", 2024-09-12T18:37:38.165 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2770000000000002e-06 2024-09-12T18:37:38.165 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.165 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.165 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:38.165 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.147252+0000", 2024-09-12T18:37:38.165 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.5698999999999997e-05 2024-09-12T18:37:38.165 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.165 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.165 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:38.165 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.147271+0000", 2024-09-12T18:37:38.165 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9794999999999999e-05 2024-09-12T18:37:38.165 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.165 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:38.166 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.166 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.166 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.166 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:237481 5.3 e75/21 5:c1992dfc:::benchmark_data_smithi073_23739_object105204:head v 75'14603, mlcod=75'14600)", 2024-09-12T18:37:38.166 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:38.148038+0000", 2024-09-12T18:37:38.166 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.001588309, 2024-09-12T18:37:38.166 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0018055790000000001, 2024-09-12T18:37:38.166 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:38.166 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:38.166 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:37:38.166 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:38.166 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.166 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:38.167 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.148038+0000", 2024-09-12T18:37:38.167 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.167 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.167 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.167 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:38.167 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.148038+0000", 2024-09-12T18:37:38.167 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.167 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.167 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.167 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:38.167 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.148039+0000", 2024-09-12T18:37:38.167 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.23e-07 2024-09-12T18:37:38.167 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.168 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.168 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:38.168 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.148043+0000", 2024-09-12T18:37:38.168 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.5859999999999998e-06 2024-09-12T18:37:38.168 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.168 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.168 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:38.168 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.148050+0000", 2024-09-12T18:37:38.168 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.1739999999999997e-06 2024-09-12T18:37:38.168 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.168 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.168 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:38.168 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.148054+0000", 2024-09-12T18:37:38.169 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.7829999999999998e-06 2024-09-12T18:37:38.169 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.169 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.169 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:38.169 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.148098+0000", 2024-09-12T18:37:38.169 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.3268e-05 2024-09-12T18:37:38.169 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.170 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.170 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:38.170 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.148114+0000", 2024-09-12T18:37:38.170 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6214000000000001e-05 2024-09-12T18:37:38.170 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.170 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:38.170 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.170 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.170 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.170 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:237483 5.d e75/21 5:b91e9960:::benchmark_data_smithi073_23739_object105206:head v 75'15041, mlcod=75'15038)", 2024-09-12T18:37:38.170 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:38.148403+0000", 2024-09-12T18:37:38.170 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0012230710000000001, 2024-09-12T18:37:38.171 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001467737, 2024-09-12T18:37:38.171 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:38.171 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:38.171 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:37:38.171 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:38.171 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.171 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:38.171 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.148403+0000", 2024-09-12T18:37:38.171 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.171 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.171 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.171 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:38.172 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.148403+0000", 2024-09-12T18:37:38.172 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.172 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.172 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.172 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:38.172 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.148404+0000", 2024-09-12T18:37:38.172 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.1399999999999997e-07 2024-09-12T18:37:38.172 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.172 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.172 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:38.172 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.148411+0000", 2024-09-12T18:37:38.172 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2649999999999999e-06 2024-09-12T18:37:38.172 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.173 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.173 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:38.173 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.148417+0000", 2024-09-12T18:37:38.173 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.1319999999999999e-06 2024-09-12T18:37:38.173 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.173 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.173 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:38.173 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.148422+0000", 2024-09-12T18:37:38.173 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.5480000000000003e-06 2024-09-12T18:37:38.173 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.173 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.173 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:38.173 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.148468+0000", 2024-09-12T18:37:38.174 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.5618999999999998e-05 2024-09-12T18:37:38.174 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.174 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.174 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:38.174 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.148487+0000", 2024-09-12T18:37:38.174 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9678999999999999e-05 2024-09-12T18:37:38.174 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.174 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:38.174 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.174 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.174 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.174 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:237484 5.9 5:99f8596f:::benchmark_data_smithi073_23739_object105207:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:38.175 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:38.148556+0000", 2024-09-12T18:37:38.175 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0010702859999999999, 2024-09-12T18:37:38.175 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0013423619999999999, 2024-09-12T18:37:38.175 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:38.175 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:38.175 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:38.175 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:38.175 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:38.175 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:38.175 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 237484 2024-09-12T18:37:38.175 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.175 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:38.175 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.176 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:38.176 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.148556+0000", 2024-09-12T18:37:38.176 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.176 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.176 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.176 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:38.176 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.148556+0000", 2024-09-12T18:37:38.176 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.176 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.176 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.176 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:38.176 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.148557+0000", 2024-09-12T18:37:38.176 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.2200000000000002e-07 2024-09-12T18:37:38.177 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.177 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.177 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:38.177 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.148560+0000", 2024-09-12T18:37:38.177 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.4060000000000001e-06 2024-09-12T18:37:38.178 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.178 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.178 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:38.178 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.148571+0000", 2024-09-12T18:37:38.178 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0964e-05 2024-09-12T18:37:38.179 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.179 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.179 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:38.179 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.148577+0000", 2024-09-12T18:37:38.179 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.908e-06 2024-09-12T18:37:38.179 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.179 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.179 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:38.179 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.148619+0000", 2024-09-12T18:37:38.179 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.1975999999999999e-05 2024-09-12T18:37:38.179 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.179 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.179 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:38.180 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.148698+0000", 2024-09-12T18:37:38.180 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8916000000000001e-05 2024-09-12T18:37:38.180 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.180 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.180 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:38.180 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.148762+0000", 2024-09-12T18:37:38.180 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.3761000000000002e-05 2024-09-12T18:37:38.180 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.180 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:38.180 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.180 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.180 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.180 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:237482 5.0 e75/65 5:00304eff:::benchmark_data_smithi073_23739_object105205:head v 75'15016, mlcod=75'15013)", 2024-09-12T18:37:38.181 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:38.149141+0000", 2024-09-12T18:37:38.181 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.00048582900000000001, 2024-09-12T18:37:38.181 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00080584000000000005, 2024-09-12T18:37:38.181 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:38.181 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:38.181 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:37:38.181 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:38.181 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.181 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:38.181 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.149141+0000", 2024-09-12T18:37:38.181 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.181 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.181 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.182 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:38.182 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.149141+0000", 2024-09-12T18:37:38.182 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.182 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.182 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.182 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:38.182 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.149141+0000", 2024-09-12T18:37:38.182 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.92e-07 2024-09-12T18:37:38.182 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.182 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.182 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:38.182 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.149146+0000", 2024-09-12T18:37:38.182 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8060000000000002e-06 2024-09-12T18:37:38.182 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.183 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.183 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:38.183 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.149157+0000", 2024-09-12T18:37:38.183 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0726e-05 2024-09-12T18:37:38.183 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.183 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.183 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:38.183 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.149163+0000", 2024-09-12T18:37:38.183 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.5420000000000002e-06 2024-09-12T18:37:38.183 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.183 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.183 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:38.183 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.149207+0000", 2024-09-12T18:37:38.184 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.3628000000000003e-05 2024-09-12T18:37:38.184 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.184 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.184 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:38.184 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.149234+0000", 2024-09-12T18:37:38.184 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.7229999999999998e-05 2024-09-12T18:37:38.184 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.184 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:38.184 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.184 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.184 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.184 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:237474 5.6 e75/21 5:65fb36a5:::benchmark_data_smithi073_23739_object105197:head v 75'14866, mlcod=75'14863)", 2024-09-12T18:37:38.185 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:38.149580+0000", 2024-09-12T18:37:38.185 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 4.6535000000000001e-05, 2024-09-12T18:37:38.185 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00039639800000000001, 2024-09-12T18:37:38.185 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:38.185 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:38.185 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:37:38.185 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:38.185 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.185 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:38.185 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.149580+0000", 2024-09-12T18:37:38.185 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.185 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.185 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.186 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:38.186 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.149580+0000", 2024-09-12T18:37:38.186 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.186 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.186 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.186 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:38.186 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.149580+0000", 2024-09-12T18:37:38.186 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5899999999999996e-07 2024-09-12T18:37:38.186 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.186 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.186 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:38.186 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.149585+0000", 2024-09-12T18:37:38.186 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.5820000000000003e-06 2024-09-12T18:37:38.187 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.187 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.187 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:38.187 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.149596+0000", 2024-09-12T18:37:38.187 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0521e-05 2024-09-12T18:37:38.187 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.187 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.187 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:38.187 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.149601+0000", 2024-09-12T18:37:38.187 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4140000000000002e-06 2024-09-12T18:37:38.187 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.187 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.188 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:38.188 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.149646+0000", 2024-09-12T18:37:38.188 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4644999999999997e-05 2024-09-12T18:37:38.188 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.188 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.188 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:38.188 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:38.149664+0000", 2024-09-12T18:37:38.188 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.8664e-05 2024-09-12T18:37:38.188 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.188 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:38.188 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.188 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.189 INFO:teuthology.orchestra.run.smithi162.stdout: ], 2024-09-12T18:37:38.189 INFO:teuthology.orchestra.run.smithi162.stdout: "num_ops": 8 2024-09-12T18:37:38.189 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:38.190 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:37:38.196 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:38.190+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:38.286 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T18:37:38.297 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:38.290+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:38.381 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:37:38.382 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:37:38.382 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-09-12T18:37:38.382 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-12T18:37:38.382 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-12T18:37:38.382 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-09-12T18:37:38.385 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:38.385 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [], 2024-09-12T18:37:38.385 INFO:teuthology.orchestra.run.smithi162.stdout: "complaint_time": 30, 2024-09-12T18:37:38.385 INFO:teuthology.orchestra.run.smithi162.stdout: "num_blocked_ops": 0 2024-09-12T18:37:38.385 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:38.399 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:38.390+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:38.406 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:37:38.499 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:38.495+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:38.544 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:38.544 INFO:teuthology.orchestra.run.smithi162.stdout: "success": "" 2024-09-12T18:37:38.544 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:38.600 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:38.594+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:38.614 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:38.614 INFO:teuthology.orchestra.run.smithi162.stdout: "size": 20, 2024-09-12T18:37:38.614 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 600, 2024-09-12T18:37:38.614 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:37:38.615 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.615 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167364 5.7 5:ee50096a:::benchmark_data_smithi073_23739_object35087:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:38.615 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.168715+0000", 2024-09-12T18:37:38.615 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 35.442105980000001, 2024-09-12T18:37:38.615 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.068831153000000006, 2024-09-12T18:37:38.615 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:38.615 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:38.615 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:38.615 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:38.615 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:38.615 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:38.615 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167364 2024-09-12T18:37:38.615 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.616 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:38.616 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.616 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:38.616 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168715+0000", 2024-09-12T18:37:38.616 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.616 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.616 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.616 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:38.616 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168715+0000", 2024-09-12T18:37:38.616 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.616 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.616 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.616 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:38.617 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168716+0000", 2024-09-12T18:37:38.617 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0559999999999999e-06 2024-09-12T18:37:38.617 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.617 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.617 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:38.617 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168721+0000", 2024-09-12T18:37:38.617 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8019999999999999e-06 2024-09-12T18:37:38.617 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.617 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.617 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:38.617 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168731+0000", 2024-09-12T18:37:38.617 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0315e-05 2024-09-12T18:37:38.617 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.618 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.618 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:38.618 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168738+0000", 2024-09-12T18:37:38.618 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.126e-06 2024-09-12T18:37:38.618 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.618 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.618 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:38.618 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168782+0000", 2024-09-12T18:37:38.618 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.3924000000000002e-05 2024-09-12T18:37:38.618 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.618 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.618 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:38.618 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168913+0000", 2024-09-12T18:37:38.619 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000131154 2024-09-12T18:37:38.619 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.619 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.619 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:38.619 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169026+0000", 2024-09-12T18:37:38.619 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011223299999999999 2024-09-12T18:37:38.619 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.619 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.619 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:38.619 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.175404+0000", 2024-09-12T18:37:38.619 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0063780319999999996 2024-09-12T18:37:38.620 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.620 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.620 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:38.620 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237446+0000", 2024-09-12T18:37:38.620 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.062042238 2024-09-12T18:37:38.620 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.620 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.620 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:38.620 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237501+0000", 2024-09-12T18:37:38.620 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4913000000000001e-05 2024-09-12T18:37:38.620 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.620 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.620 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:38.621 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237546+0000", 2024-09-12T18:37:38.621 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.5359999999999999e-05 2024-09-12T18:37:38.621 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.621 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:38.621 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.621 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.621 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.621 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167365 5.2 5:4107875c:::benchmark_data_smithi073_23739_object35088:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:38.621 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:38.621 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 35.442056405999999, 2024-09-12T18:37:38.622 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.078544438999999994, 2024-09-12T18:37:38.622 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:38.622 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:38.622 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:38.622 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:38.622 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:38.622 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:38.622 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167365 2024-09-12T18:37:38.622 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.622 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:38.623 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.623 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:38.623 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:38.623 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.623 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.623 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.623 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:38.623 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:38.623 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.623 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.623 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.623 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:38.623 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:38.624 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.4700000000000001e-07 2024-09-12T18:37:38.624 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.624 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.624 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:38.624 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168769+0000", 2024-09-12T18:37:38.624 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.4170000000000001e-06 2024-09-12T18:37:38.624 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.624 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.624 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:38.624 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168777+0000", 2024-09-12T18:37:38.624 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1499999999999999e-06 2024-09-12T18:37:38.624 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.625 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.625 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:38.625 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168783+0000", 2024-09-12T18:37:38.625 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.0460000000000002e-06 2024-09-12T18:37:38.625 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.625 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.625 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:38.625 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168865+0000", 2024-09-12T18:37:38.625 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1953999999999995e-05 2024-09-12T18:37:38.625 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.625 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.625 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:38.625 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169003+0000", 2024-09-12T18:37:38.626 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013798200000000001 2024-09-12T18:37:38.626 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.626 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.626 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:38.626 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169065+0000", 2024-09-12T18:37:38.626 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2218000000000006e-05 2024-09-12T18:37:38.626 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.626 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.627 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:38.627 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174771+0000", 2024-09-12T18:37:38.627 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0057054819999999996 2024-09-12T18:37:38.627 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.627 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.627 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:38.627 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.247234+0000", 2024-09-12T18:37:38.627 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.072463391000000002 2024-09-12T18:37:38.628 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.628 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.628 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:38.628 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.247273+0000", 2024-09-12T18:37:38.628 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.9069000000000002e-05 2024-09-12T18:37:38.628 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.629 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.629 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:38.629 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.247309+0000", 2024-09-12T18:37:38.629 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5982999999999998e-05 2024-09-12T18:37:38.629 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.629 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:38.630 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.630 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.630 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.630 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167369 5.7 5:e64ecabd:::benchmark_data_smithi073_23739_object35092:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:38.630 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.169042+0000", 2024-09-12T18:37:38.630 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 35.441779295000003, 2024-09-12T18:37:38.631 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.069229188999999997, 2024-09-12T18:37:38.631 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:38.631 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:38.631 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:38.631 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:38.631 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:38.631 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:38.631 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167369 2024-09-12T18:37:38.632 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.632 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:38.632 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.632 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:38.632 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169042+0000", 2024-09-12T18:37:38.632 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.632 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.632 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.633 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:38.633 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169042+0000", 2024-09-12T18:37:38.633 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.633 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.633 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.633 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:38.634 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169043+0000", 2024-09-12T18:37:38.634 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.9400000000000004e-07 2024-09-12T18:37:38.634 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.634 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.634 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:38.634 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169048+0000", 2024-09-12T18:37:38.634 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8420000000000004e-06 2024-09-12T18:37:38.635 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.635 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.635 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:38.635 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169055+0000", 2024-09-12T18:37:38.635 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.7989999999999994e-06 2024-09-12T18:37:38.635 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.635 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.635 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:38.636 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169062+0000", 2024-09-12T18:37:38.636 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.5950000000000004e-06 2024-09-12T18:37:38.636 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.636 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.636 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:38.636 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173858+0000", 2024-09-12T18:37:38.636 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0047959259999999998 2024-09-12T18:37:38.637 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.637 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.637 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:38.637 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173966+0000", 2024-09-12T18:37:38.637 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000107941 2024-09-12T18:37:38.637 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.637 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.637 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:38.638 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174043+0000", 2024-09-12T18:37:38.638 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.7360000000000005e-05 2024-09-12T18:37:38.638 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.638 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.638 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:38.638 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.175711+0000", 2024-09-12T18:37:38.638 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0016680810000000001 2024-09-12T18:37:38.639 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.639 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.639 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:38.639 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.238163+0000", 2024-09-12T18:37:38.639 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.062451523000000002 2024-09-12T18:37:38.639 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.639 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.639 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:38.640 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.238222+0000", 2024-09-12T18:37:38.640 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9723999999999999e-05 2024-09-12T18:37:38.640 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.640 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.640 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:38.640 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.238271+0000", 2024-09-12T18:37:38.641 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8504000000000002e-05 2024-09-12T18:37:38.641 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.641 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:38.641 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.641 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.641 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.642 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167373 5.5 5:ad283029:::benchmark_data_smithi073_23739_object35096:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:38.642 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:38.642 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 35.439274464, 2024-09-12T18:37:38.642 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.066200976999999994, 2024-09-12T18:37:38.642 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:38.642 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:38.643 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:38.643 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:38.643 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:38.643 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:38.643 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167373 2024-09-12T18:37:38.643 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.644 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:38.644 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.644 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:38.644 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:38.644 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.644 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.645 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.645 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:38.645 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:38.645 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.645 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.645 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.646 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:38.646 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:38.646 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4900000000000005e-07 2024-09-12T18:37:38.646 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.646 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.646 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:38.646 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171551+0000", 2024-09-12T18:37:38.647 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.7519999999999998e-06 2024-09-12T18:37:38.647 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.647 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.647 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:38.647 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171562+0000", 2024-09-12T18:37:38.647 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0353000000000001e-05 2024-09-12T18:37:38.648 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.648 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.648 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:38.648 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171566+0000", 2024-09-12T18:37:38.648 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8269999999999997e-06 2024-09-12T18:37:38.649 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.649 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.649 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:38.649 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171622+0000", 2024-09-12T18:37:38.649 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5220999999999999e-05 2024-09-12T18:37:38.649 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.650 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.650 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:38.650 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171719+0000", 2024-09-12T18:37:38.650 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7238999999999995e-05 2024-09-12T18:37:38.650 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.650 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.651 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:38.651 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171802+0000", 2024-09-12T18:37:38.651 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.3285e-05 2024-09-12T18:37:38.651 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.651 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.651 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:38.652 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174608+0000", 2024-09-12T18:37:38.652 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028054590000000002 2024-09-12T18:37:38.652 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.652 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.652 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:38.652 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174762+0000", 2024-09-12T18:37:38.652 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015465100000000001 2024-09-12T18:37:38.653 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.653 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.653 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:38.653 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237474+0000", 2024-09-12T18:37:38.653 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.062711683000000004 2024-09-12T18:37:38.653 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.654 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.654 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:38.654 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237540+0000", 2024-09-12T18:37:38.654 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.6132999999999999e-05 2024-09-12T18:37:38.654 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.654 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.654 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:38.654 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237748+0000", 2024-09-12T18:37:38.654 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020752499999999999 2024-09-12T18:37:38.655 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.655 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:38.655 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.655 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.655 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.655 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167374 5.1 5:81e25826:::benchmark_data_smithi073_23739_object35097:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:38.655 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.173748+0000", 2024-09-12T18:37:38.655 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 35.437073015999999, 2024-09-12T18:37:38.655 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.069225245000000005, 2024-09-12T18:37:38.655 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:38.655 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:38.655 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:38.655 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:38.656 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:38.656 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:38.656 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167374 2024-09-12T18:37:38.656 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.656 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:38.656 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.656 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:38.656 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173748+0000", 2024-09-12T18:37:38.656 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.656 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.656 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.656 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:38.656 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173748+0000", 2024-09-12T18:37:38.657 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.657 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.657 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.657 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:38.657 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173749+0000", 2024-09-12T18:37:38.657 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.418e-06 2024-09-12T18:37:38.657 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.657 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.657 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:38.657 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173755+0000", 2024-09-12T18:37:38.657 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.0730000000000004e-06 2024-09-12T18:37:38.657 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.657 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.658 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:38.658 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173768+0000", 2024-09-12T18:37:38.658 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3644e-05 2024-09-12T18:37:38.658 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.658 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.658 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:38.658 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173777+0000", 2024-09-12T18:37:38.658 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4160000000000004e-06 2024-09-12T18:37:38.658 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.658 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.658 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:38.658 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173927+0000", 2024-09-12T18:37:38.658 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015065900000000001 2024-09-12T18:37:38.659 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.659 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.659 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:38.659 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174052+0000", 2024-09-12T18:37:38.659 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012460699999999999 2024-09-12T18:37:38.659 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.659 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.659 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:38.659 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174181+0000", 2024-09-12T18:37:38.659 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012919299999999999 2024-09-12T18:37:38.659 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.659 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.660 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:38.660 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.178108+0000", 2024-09-12T18:37:38.660 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0039273210000000001 2024-09-12T18:37:38.660 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.660 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.660 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:38.660 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.178118+0000", 2024-09-12T18:37:38.660 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7550000000000006e-06 2024-09-12T18:37:38.660 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.660 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.660 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:38.660 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.242865+0000", 2024-09-12T18:37:38.661 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.064746597000000003 2024-09-12T18:37:38.661 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.661 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.661 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:38.661 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.242903+0000", 2024-09-12T18:37:38.661 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.8268e-05 2024-09-12T18:37:38.661 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.661 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.661 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:38.661 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.242973+0000", 2024-09-12T18:37:38.661 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0294000000000002e-05 2024-09-12T18:37:38.661 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.662 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:38.662 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.662 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.662 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.662 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167375 5.1 5:83a09102:::benchmark_data_smithi073_23739_object35098:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:38.662 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:38.662 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 35.437021469000001, 2024-09-12T18:37:38.662 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.069437463000000005, 2024-09-12T18:37:38.662 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:38.662 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:38.662 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:38.662 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:38.662 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:38.663 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:38.663 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167375 2024-09-12T18:37:38.663 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.663 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:38.663 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.663 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:38.663 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:38.663 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.663 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.663 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.664 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:38.664 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:38.664 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.664 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.664 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.664 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:38.664 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:38.664 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1399999999999997e-07 2024-09-12T18:37:38.664 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.664 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.664 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:38.664 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173803+0000", 2024-09-12T18:37:38.665 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.7860000000000001e-06 2024-09-12T18:37:38.665 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.665 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.665 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:38.665 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173811+0000", 2024-09-12T18:37:38.665 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4610000000000008e-06 2024-09-12T18:37:38.665 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.665 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.665 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:38.665 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173817+0000", 2024-09-12T18:37:38.665 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3569999999999997e-06 2024-09-12T18:37:38.665 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.665 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.666 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:38.666 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.176070+0000", 2024-09-12T18:37:38.666 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.002253405 2024-09-12T18:37:38.666 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.666 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.666 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:38.666 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.176263+0000", 2024-09-12T18:37:38.666 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000192583 2024-09-12T18:37:38.667 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.667 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.667 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:38.667 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.176429+0000", 2024-09-12T18:37:38.667 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00016626 2024-09-12T18:37:38.668 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.668 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.668 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:38.668 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.178154+0000", 2024-09-12T18:37:38.668 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0017247009999999999 2024-09-12T18:37:38.669 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.669 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.669 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:38.669 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.182110+0000", 2024-09-12T18:37:38.669 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0039568229999999999 2024-09-12T18:37:38.669 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.670 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.670 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:38.670 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.243024+0000", 2024-09-12T18:37:38.670 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.060913249000000003 2024-09-12T18:37:38.670 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.670 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.670 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:38.670 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.243107+0000", 2024-09-12T18:37:38.670 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.3090000000000006e-05 2024-09-12T18:37:38.670 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.670 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.670 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:38.670 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.243237+0000", 2024-09-12T18:37:38.670 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013023399999999999 2024-09-12T18:37:38.671 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.671 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:38.671 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.671 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.671 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.671 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201515 5.5 5:a25bd8bb:::benchmark_data_smithi073_23739_object69238:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:38.671 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.437024+0000", 2024-09-12T18:37:38.671 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 18.173797236999999, 2024-09-12T18:37:38.671 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.040476102, 2024-09-12T18:37:38.671 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:38.671 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:38.671 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:38.672 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:38.672 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:38.672 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:38.672 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201515 2024-09-12T18:37:38.672 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.672 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:38.672 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.672 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:38.672 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437024+0000", 2024-09-12T18:37:38.672 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.672 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.672 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.672 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:38.672 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437024+0000", 2024-09-12T18:37:38.673 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.673 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.673 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.673 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:38.673 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437025+0000", 2024-09-12T18:37:38.673 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2240000000000001e-06 2024-09-12T18:37:38.673 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.673 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.673 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:38.673 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437030+0000", 2024-09-12T18:37:38.673 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.7049999999999998e-06 2024-09-12T18:37:38.673 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.674 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.674 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:38.674 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437040+0000", 2024-09-12T18:37:38.674 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0351e-05 2024-09-12T18:37:38.674 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.674 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.674 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:38.674 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437049+0000", 2024-09-12T18:37:38.674 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5750000000000001e-06 2024-09-12T18:37:38.674 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.674 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.674 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:38.674 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437574+0000", 2024-09-12T18:37:38.675 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00052566400000000001 2024-09-12T18:37:38.675 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.675 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.675 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:38.675 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437673+0000", 2024-09-12T18:37:38.675 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.8672000000000007e-05 2024-09-12T18:37:38.675 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.675 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.675 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:38.675 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437755+0000", 2024-09-12T18:37:38.675 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1705000000000005e-05 2024-09-12T18:37:38.675 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.675 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.675 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:38.676 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.439556+0000", 2024-09-12T18:37:38.676 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0018009020000000001 2024-09-12T18:37:38.676 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.676 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.676 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:38.676 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.439955+0000", 2024-09-12T18:37:38.676 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00039966900000000001 2024-09-12T18:37:38.676 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.676 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.676 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:38.676 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.477267+0000", 2024-09-12T18:37:38.676 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.037311614 2024-09-12T18:37:38.676 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.677 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.677 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:38.677 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.477368+0000", 2024-09-12T18:37:38.677 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000101495 2024-09-12T18:37:38.677 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.677 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.677 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:38.677 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.477500+0000", 2024-09-12T18:37:38.677 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000131526 2024-09-12T18:37:38.677 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.677 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:38.677 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.677 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.678 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.678 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201566 5.9 5:9ea8bdd3:::benchmark_data_smithi073_23739_object69289:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:38.678 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.487311+0000", 2024-09-12T18:37:38.678 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 18.123509689999999, 2024-09-12T18:37:38.678 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.044734547, 2024-09-12T18:37:38.678 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:38.678 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:38.678 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:38.678 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:38.678 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:38.678 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:38.678 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201566 2024-09-12T18:37:38.678 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.678 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:38.679 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.679 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:38.679 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487311+0000", 2024-09-12T18:37:38.679 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.679 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.679 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.679 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:38.679 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487311+0000", 2024-09-12T18:37:38.679 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.679 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.679 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.679 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:38.679 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487313+0000", 2024-09-12T18:37:38.680 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3060000000000001e-06 2024-09-12T18:37:38.680 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.680 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.680 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:38.680 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487318+0000", 2024-09-12T18:37:38.680 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.181e-06 2024-09-12T18:37:38.680 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.680 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.680 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:38.680 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487333+0000", 2024-09-12T18:37:38.680 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5012e-05 2024-09-12T18:37:38.680 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.680 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.680 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:38.681 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487344+0000", 2024-09-12T18:37:38.681 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0733999999999999e-05 2024-09-12T18:37:38.681 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.681 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.681 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:38.681 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487403+0000", 2024-09-12T18:37:38.681 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9858999999999997e-05 2024-09-12T18:37:38.681 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.681 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.681 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:38.681 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487600+0000", 2024-09-12T18:37:38.681 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019617899999999999 2024-09-12T18:37:38.681 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.682 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.682 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:38.682 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487769+0000", 2024-09-12T18:37:38.682 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00016919299999999999 2024-09-12T18:37:38.682 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.682 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.682 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:38.682 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492984+0000", 2024-09-12T18:37:38.682 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0052155309999999998 2024-09-12T18:37:38.682 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.682 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.682 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:38.682 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531791+0000", 2024-09-12T18:37:38.683 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.038806861999999998 2024-09-12T18:37:38.683 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.683 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.683 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:38.683 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531946+0000", 2024-09-12T18:37:38.683 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015445300000000001 2024-09-12T18:37:38.683 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.683 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.683 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:38.683 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532046+0000", 2024-09-12T18:37:38.683 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000100237 2024-09-12T18:37:38.683 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.683 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:38.683 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.684 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.684 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.684 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201569 5.9 5:9719244e:::benchmark_data_smithi073_23739_object69292:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:38.684 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.487551+0000", 2024-09-12T18:37:38.684 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 18.12327033, 2024-09-12T18:37:38.684 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.045212927, 2024-09-12T18:37:38.684 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:38.684 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:38.684 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:38.684 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:38.684 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:38.684 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:38.685 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201569 2024-09-12T18:37:38.685 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.685 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:38.685 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.685 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:38.685 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487551+0000", 2024-09-12T18:37:38.685 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.685 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.685 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.685 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:38.685 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487551+0000", 2024-09-12T18:37:38.685 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.685 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.686 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.686 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:38.686 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487552+0000", 2024-09-12T18:37:38.686 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6160000000000001e-06 2024-09-12T18:37:38.686 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.686 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.686 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:38.686 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487566+0000", 2024-09-12T18:37:38.686 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.344e-05 2024-09-12T18:37:38.686 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.686 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.686 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:38.686 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487581+0000", 2024-09-12T18:37:38.687 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5526e-05 2024-09-12T18:37:38.687 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.687 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.687 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:38.687 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487593+0000", 2024-09-12T18:37:38.687 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1443e-05 2024-09-12T18:37:38.687 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.687 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.687 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:38.687 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.489599+0000", 2024-09-12T18:37:38.687 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0020058960000000001 2024-09-12T18:37:38.687 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.687 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.688 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:38.688 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.489710+0000", 2024-09-12T18:37:38.688 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000111634 2024-09-12T18:37:38.688 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.688 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.688 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:38.688 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.489796+0000", 2024-09-12T18:37:38.688 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5235999999999995e-05 2024-09-12T18:37:38.688 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.688 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.688 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:38.688 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532140+0000", 2024-09-12T18:37:38.689 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.042344524000000001 2024-09-12T18:37:38.689 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.689 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.689 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:38.689 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532559+0000", 2024-09-12T18:37:38.689 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00041908800000000002 2024-09-12T18:37:38.689 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.689 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.689 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:38.689 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532676+0000", 2024-09-12T18:37:38.690 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011649100000000001 2024-09-12T18:37:38.690 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.690 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.690 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:38.690 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532764+0000", 2024-09-12T18:37:38.690 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8033000000000002e-05 2024-09-12T18:37:38.690 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.690 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:38.690 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.690 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.690 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.690 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201570 5.5 5:a97bff67:::benchmark_data_smithi073_23739_object69293:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:38.691 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.487618+0000", 2024-09-12T18:37:38.691 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 18.123202745, 2024-09-12T18:37:38.691 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.049152553000000002, 2024-09-12T18:37:38.691 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:38.691 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:38.691 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:38.691 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:38.691 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:38.691 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:38.691 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201570 2024-09-12T18:37:38.691 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.692 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:38.692 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.692 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:38.692 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487618+0000", 2024-09-12T18:37:38.692 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.692 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.692 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.692 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:38.692 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487618+0000", 2024-09-12T18:37:38.692 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.692 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.692 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.693 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:38.693 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487619+0000", 2024-09-12T18:37:38.693 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.6099999999999999e-07 2024-09-12T18:37:38.693 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.693 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.693 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:38.693 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487623+0000", 2024-09-12T18:37:38.693 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.0940000000000001e-06 2024-09-12T18:37:38.693 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.693 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.693 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:38.693 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487635+0000", 2024-09-12T18:37:38.693 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1348e-05 2024-09-12T18:37:38.694 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.694 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.694 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:38.694 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487657+0000", 2024-09-12T18:37:38.694 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2246999999999999e-05 2024-09-12T18:37:38.694 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.694 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.694 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:38.694 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490684+0000", 2024-09-12T18:37:38.694 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0030268339999999999 2024-09-12T18:37:38.694 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.694 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.695 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:38.695 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490797+0000", 2024-09-12T18:37:38.695 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011372200000000001 2024-09-12T18:37:38.695 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.695 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.695 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:38.695 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490909+0000", 2024-09-12T18:37:38.695 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000111239 2024-09-12T18:37:38.695 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.695 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.695 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:38.695 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534345+0000", 2024-09-12T18:37:38.695 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.043436648000000001 2024-09-12T18:37:38.696 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.696 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.696 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:38.696 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534711+0000", 2024-09-12T18:37:38.696 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00036576399999999998 2024-09-12T18:37:38.696 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.696 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.696 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:38.696 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536225+0000", 2024-09-12T18:37:38.696 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001513983 2024-09-12T18:37:38.696 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.696 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.697 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:38.697 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536331+0000", 2024-09-12T18:37:38.697 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010603300000000001 2024-09-12T18:37:38.697 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.697 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.697 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:38.697 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536771+0000", 2024-09-12T18:37:38.697 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00043978000000000002 2024-09-12T18:37:38.697 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.697 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:38.697 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.697 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.697 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.697 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:201572 5.3 e67/21 5:caf692c5:::benchmark_data_smithi073_23739_object69295:head v 67'12362, mlcod=67'12360)", 2024-09-12T18:37:38.698 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.490255+0000", 2024-09-12T18:37:38.698 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 18.120566244999999, 2024-09-12T18:37:38.698 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.044189501999999999, 2024-09-12T18:37:38.698 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:38.698 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:38.698 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:38.698 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:38.698 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.698 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:38.698 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490255+0000", 2024-09-12T18:37:38.698 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.698 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.698 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.699 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:38.699 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490255+0000", 2024-09-12T18:37:38.699 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.699 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.699 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.699 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:38.699 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490256+0000", 2024-09-12T18:37:38.699 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0500000000000003e-07 2024-09-12T18:37:38.699 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.699 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.699 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:38.699 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490260+0000", 2024-09-12T18:37:38.699 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8269999999999997e-06 2024-09-12T18:37:38.700 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.700 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.700 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:38.700 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490269+0000", 2024-09-12T18:37:38.700 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.6549999999999993e-06 2024-09-12T18:37:38.700 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.700 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.700 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:38.700 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490275+0000", 2024-09-12T18:37:38.700 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.46e-06 2024-09-12T18:37:38.700 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.700 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.700 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:38.701 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490328+0000", 2024-09-12T18:37:38.701 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2101999999999997e-05 2024-09-12T18:37:38.701 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.701 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.701 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:38.701 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490347+0000", 2024-09-12T18:37:38.701 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9457999999999999e-05 2024-09-12T18:37:38.701 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.701 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.701 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:38.701 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534382+0000", 2024-09-12T18:37:38.701 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.044034968000000001 2024-09-12T18:37:38.701 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.702 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.702 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:38.702 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534444+0000", 2024-09-12T18:37:38.702 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2327000000000001e-05 2024-09-12T18:37:38.702 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.702 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:38.702 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.702 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.702 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.702 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201574 5.5 5:a963f378:::benchmark_data_smithi073_23739_object69297:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:38.702 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.490449+0000", 2024-09-12T18:37:38.703 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 18.120372270000001, 2024-09-12T18:37:38.703 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.046749974, 2024-09-12T18:37:38.703 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:38.703 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:38.703 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:38.703 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:38.703 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:38.703 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:38.703 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201574 2024-09-12T18:37:38.703 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.703 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:38.703 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.704 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:38.704 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490449+0000", 2024-09-12T18:37:38.704 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.704 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.704 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.704 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:38.704 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490449+0000", 2024-09-12T18:37:38.704 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.704 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.704 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.704 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:38.704 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490450+0000", 2024-09-12T18:37:38.704 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.17e-06 2024-09-12T18:37:38.704 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.705 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.705 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:38.705 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490455+0000", 2024-09-12T18:37:38.705 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.7319999999999998e-06 2024-09-12T18:37:38.705 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.705 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.705 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:38.705 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490464+0000", 2024-09-12T18:37:38.705 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.4760000000000004e-06 2024-09-12T18:37:38.705 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.705 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.705 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:38.705 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490471+0000", 2024-09-12T18:37:38.706 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.5400000000000001e-06 2024-09-12T18:37:38.706 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.706 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.706 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:38.706 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492695+0000", 2024-09-12T18:37:38.706 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0022245910000000002 2024-09-12T18:37:38.706 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.706 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.706 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:38.706 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492847+0000", 2024-09-12T18:37:38.706 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015127399999999999 2024-09-12T18:37:38.706 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.706 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.706 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:38.707 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492936+0000", 2024-09-12T18:37:38.707 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8953e-05 2024-09-12T18:37:38.707 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.707 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.707 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:38.707 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534614+0000", 2024-09-12T18:37:38.707 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.041678422999999999 2024-09-12T18:37:38.707 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.707 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.707 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:38.707 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534755+0000", 2024-09-12T18:37:38.707 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000140696 2024-09-12T18:37:38.707 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.708 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.708 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:38.708 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536891+0000", 2024-09-12T18:37:38.708 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0021365799999999999 2024-09-12T18:37:38.708 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.708 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.708 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:38.708 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537001+0000", 2024-09-12T18:37:38.708 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000109459 2024-09-12T18:37:38.708 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.708 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.708 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:38.709 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537199+0000", 2024-09-12T18:37:38.709 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019808 2024-09-12T18:37:38.709 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.709 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:38.709 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.709 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.709 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.709 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201576 5.2 5:42a132e0:::benchmark_data_smithi073_23739_object69299:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:38.709 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.490661+0000", 2024-09-12T18:37:38.709 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 18.120160222999999, 2024-09-12T18:37:38.709 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.041905530000000003, 2024-09-12T18:37:38.709 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:38.709 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:38.710 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:38.710 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:38.710 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:38.710 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:38.710 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201576 2024-09-12T18:37:38.710 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.710 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:38.710 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.710 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:38.710 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490661+0000", 2024-09-12T18:37:38.710 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.710 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.710 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.710 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:38.711 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490661+0000", 2024-09-12T18:37:38.711 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.711 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.711 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.711 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:38.711 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490662+0000", 2024-09-12T18:37:38.711 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5030000000000001e-06 2024-09-12T18:37:38.711 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.711 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.711 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:38.711 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490667+0000", 2024-09-12T18:37:38.711 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4479999999999996e-06 2024-09-12T18:37:38.711 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.712 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.712 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:38.712 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490675+0000", 2024-09-12T18:37:38.712 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8529999999999992e-06 2024-09-12T18:37:38.712 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.712 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.712 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:38.712 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490680+0000", 2024-09-12T18:37:38.712 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1919999999999996e-06 2024-09-12T18:37:38.712 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.712 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.712 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:38.713 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490730+0000", 2024-09-12T18:37:38.713 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.9738999999999999e-05 2024-09-12T18:37:38.713 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.713 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.713 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:38.713 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490833+0000", 2024-09-12T18:37:38.713 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010333 2024-09-12T18:37:38.713 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.713 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.713 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:38.713 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490930+0000", 2024-09-12T18:37:38.713 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7355999999999994e-05 2024-09-12T18:37:38.713 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.714 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.714 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:38.714 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493735+0000", 2024-09-12T18:37:38.714 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028049329999999999 2024-09-12T18:37:38.714 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.714 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.714 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:38.714 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532451+0000", 2024-09-12T18:37:38.714 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.038715554999999999 2024-09-12T18:37:38.714 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.714 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.714 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:38.714 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532514+0000", 2024-09-12T18:37:38.715 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2885000000000005e-05 2024-09-12T18:37:38.715 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.715 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.715 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:38.715 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532566+0000", 2024-09-12T18:37:38.715 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2735999999999998e-05 2024-09-12T18:37:38.715 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.715 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:38.715 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.715 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.715 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.715 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201577 5.7 5:e93d4852:::benchmark_data_smithi073_23739_object69300:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:38.715 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.490721+0000", 2024-09-12T18:37:38.715 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 18.120100212000001, 2024-09-12T18:37:38.716 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.042097930999999998, 2024-09-12T18:37:38.716 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:38.716 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:38.716 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:38.716 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:38.716 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:38.716 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:38.716 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201577 2024-09-12T18:37:38.716 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.716 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:38.716 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.716 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:38.717 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490721+0000", 2024-09-12T18:37:38.717 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.717 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.717 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.717 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:38.717 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490721+0000", 2024-09-12T18:37:38.717 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.717 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.717 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.717 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:38.717 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490721+0000", 2024-09-12T18:37:38.717 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.1900000000000002e-07 2024-09-12T18:37:38.717 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.718 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.718 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:38.718 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490724+0000", 2024-09-12T18:37:38.718 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.6189999999999998e-06 2024-09-12T18:37:38.718 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.718 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.718 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:38.718 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490731+0000", 2024-09-12T18:37:38.718 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0129999999999996e-06 2024-09-12T18:37:38.718 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.718 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.718 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:38.718 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490736+0000", 2024-09-12T18:37:38.719 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6929999999999998e-06 2024-09-12T18:37:38.719 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.719 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.719 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:38.719 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490788+0000", 2024-09-12T18:37:38.719 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2104000000000001e-05 2024-09-12T18:37:38.719 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.719 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.719 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:38.719 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490926+0000", 2024-09-12T18:37:38.719 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013852800000000001 2024-09-12T18:37:38.719 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.719 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.720 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:38.720 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491061+0000", 2024-09-12T18:37:38.720 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013499700000000001 2024-09-12T18:37:38.720 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.720 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.720 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:38.720 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531660+0000", 2024-09-12T18:37:38.720 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.040599046999999999 2024-09-12T18:37:38.720 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.720 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.720 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:38.720 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532630+0000", 2024-09-12T18:37:38.720 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00096974300000000002 2024-09-12T18:37:38.721 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.721 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.721 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:38.721 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532708+0000", 2024-09-12T18:37:38.721 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8108000000000005e-05 2024-09-12T18:37:38.721 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.721 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.721 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:38.721 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532819+0000", 2024-09-12T18:37:38.721 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011046 2024-09-12T18:37:38.721 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.721 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:38.721 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.722 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.722 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.722 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201578 5.f 5:f19e206c:::benchmark_data_smithi073_23739_object69301:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:38.722 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.491951+0000", 2024-09-12T18:37:38.722 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 18.118869838999998, 2024-09-12T18:37:38.722 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.043303686000000001, 2024-09-12T18:37:38.722 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:38.722 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:38.722 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:38.722 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:38.722 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:38.722 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:38.722 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201578 2024-09-12T18:37:38.723 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.723 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:38.723 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.723 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:38.723 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491951+0000", 2024-09-12T18:37:38.723 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.723 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.723 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.723 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:38.723 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491951+0000", 2024-09-12T18:37:38.723 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.723 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.723 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.723 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:38.724 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491952+0000", 2024-09-12T18:37:38.724 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.221e-06 2024-09-12T18:37:38.724 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.724 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.724 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:38.724 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491957+0000", 2024-09-12T18:37:38.724 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.0529999999999997e-06 2024-09-12T18:37:38.724 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.724 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.724 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:38.724 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491970+0000", 2024-09-12T18:37:38.724 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2731000000000001e-05 2024-09-12T18:37:38.724 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.725 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.725 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:38.725 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491977+0000", 2024-09-12T18:37:38.725 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.1380000000000001e-06 2024-09-12T18:37:38.725 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.725 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.725 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:38.725 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492031+0000", 2024-09-12T18:37:38.725 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3857999999999998e-05 2024-09-12T18:37:38.725 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.725 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.725 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:38.726 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492125+0000", 2024-09-12T18:37:38.726 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.3275000000000004e-05 2024-09-12T18:37:38.726 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.726 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.726 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:38.726 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492205+0000", 2024-09-12T18:37:38.726 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.0793999999999999e-05 2024-09-12T18:37:38.726 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.726 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.726 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:38.726 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531712+0000", 2024-09-12T18:37:38.726 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.039506708000000001 2024-09-12T18:37:38.726 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.727 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.727 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:38.727 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535161+0000", 2024-09-12T18:37:38.727 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003448586 2024-09-12T18:37:38.727 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.727 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.727 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:38.727 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535202+0000", 2024-09-12T18:37:38.727 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.0945999999999997e-05 2024-09-12T18:37:38.727 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.727 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.727 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:38.727 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535255+0000", 2024-09-12T18:37:38.728 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3375999999999999e-05 2024-09-12T18:37:38.728 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.728 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:38.728 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.728 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.728 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.728 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201579 5.5 5:ac64e9fd:::benchmark_data_smithi073_23739_object69302:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:38.728 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.492711+0000", 2024-09-12T18:37:38.728 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 18.118109667999999, 2024-09-12T18:37:38.728 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.04478994, 2024-09-12T18:37:38.728 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:38.728 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:38.728 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:38.729 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:38.729 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:38.729 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:38.729 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201579 2024-09-12T18:37:38.729 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.729 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:38.729 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.729 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:38.729 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492711+0000", 2024-09-12T18:37:38.729 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.729 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.729 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.729 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:38.730 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492711+0000", 2024-09-12T18:37:38.730 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.730 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.730 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.730 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:38.730 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492713+0000", 2024-09-12T18:37:38.730 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.105e-06 2024-09-12T18:37:38.730 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.730 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.730 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:38.730 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492720+0000", 2024-09-12T18:37:38.730 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.109e-06 2024-09-12T18:37:38.730 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.730 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.731 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:38.731 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492730+0000", 2024-09-12T18:37:38.731 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.049e-05 2024-09-12T18:37:38.731 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.731 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.731 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:38.731 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492737+0000", 2024-09-12T18:37:38.731 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0960000000000003e-06 2024-09-12T18:37:38.731 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.731 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.731 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:38.731 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.494541+0000", 2024-09-12T18:37:38.731 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0018034139999999999 2024-09-12T18:37:38.732 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.732 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.732 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:38.732 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.494692+0000", 2024-09-12T18:37:38.732 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000150956 2024-09-12T18:37:38.732 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.732 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.732 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:38.732 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.494843+0000", 2024-09-12T18:37:38.732 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000151896 2024-09-12T18:37:38.732 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.732 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.732 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:38.732 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534665+0000", 2024-09-12T18:37:38.733 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.039821829000000003 2024-09-12T18:37:38.733 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.733 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.733 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:38.733 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536866+0000", 2024-09-12T18:37:38.733 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0022007839999999999 2024-09-12T18:37:38.733 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.733 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.733 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:38.733 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537212+0000", 2024-09-12T18:37:38.733 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00034636299999999998 2024-09-12T18:37:38.733 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.733 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.734 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:38.734 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537298+0000", 2024-09-12T18:37:38.734 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5970999999999994e-05 2024-09-12T18:37:38.734 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.734 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.734 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:38.734 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537501+0000", 2024-09-12T18:37:38.734 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020292699999999999 2024-09-12T18:37:38.734 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.734 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:38.734 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.734 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.734 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.734 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201581 5.7 5:e819369d:::benchmark_data_smithi073_23739_object69304:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:38.735 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.493262+0000", 2024-09-12T18:37:38.735 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 18.117559318000001, 2024-09-12T18:37:38.735 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.042091362, 2024-09-12T18:37:38.735 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:38.735 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:38.735 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:38.735 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:38.735 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:38.735 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:38.735 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201581 2024-09-12T18:37:38.735 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.735 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:38.735 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.736 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:38.736 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493262+0000", 2024-09-12T18:37:38.736 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.736 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.736 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.736 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:38.736 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493262+0000", 2024-09-12T18:37:38.736 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.736 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.736 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.736 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:38.737 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493263+0000", 2024-09-12T18:37:38.737 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.6700000000000003e-07 2024-09-12T18:37:38.737 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.737 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.737 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:38.737 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493266+0000", 2024-09-12T18:37:38.737 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.4850000000000001e-06 2024-09-12T18:37:38.737 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.737 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.737 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:38.737 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493273+0000", 2024-09-12T18:37:38.737 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2019999999999998e-06 2024-09-12T18:37:38.737 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.738 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.738 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:38.738 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493278+0000", 2024-09-12T18:37:38.738 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6210000000000003e-06 2024-09-12T18:37:38.738 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.738 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.738 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:38.738 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493330+0000", 2024-09-12T18:37:38.738 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2587000000000003e-05 2024-09-12T18:37:38.738 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.738 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.738 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:38.739 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493469+0000", 2024-09-12T18:37:38.739 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013901199999999999 2024-09-12T18:37:38.739 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.739 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.739 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:38.739 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493612+0000", 2024-09-12T18:37:38.739 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014237599999999999 2024-09-12T18:37:38.739 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.739 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.739 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:38.739 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531835+0000", 2024-09-12T18:37:38.739 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.038222735000000001 2024-09-12T18:37:38.739 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.739 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.740 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:38.740 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535265+0000", 2024-09-12T18:37:38.740 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003430064 2024-09-12T18:37:38.740 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.740 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.740 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:38.740 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535319+0000", 2024-09-12T18:37:38.740 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4375e-05 2024-09-12T18:37:38.740 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.740 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.740 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:38.740 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535353+0000", 2024-09-12T18:37:38.740 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.4137999999999997e-05 2024-09-12T18:37:38.741 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.741 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:38.741 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.741 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.741 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.741 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:201573 5.3 e67/21 5:cf4becdf:::benchmark_data_smithi073_23739_object69296:head v 67'12363, mlcod=67'12360)", 2024-09-12T18:37:38.741 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.493437+0000", 2024-09-12T18:37:38.741 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 18.117384383000001, 2024-09-12T18:37:38.741 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.041109664999999997, 2024-09-12T18:37:38.741 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:38.741 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:38.741 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:38.741 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:38.742 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.742 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:38.742 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493437+0000", 2024-09-12T18:37:38.742 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.742 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.742 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.742 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:38.742 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493437+0000", 2024-09-12T18:37:38.742 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.742 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.742 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.742 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:38.742 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493438+0000", 2024-09-12T18:37:38.743 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.125e-06 2024-09-12T18:37:38.743 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.743 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.743 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:38.743 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493444+0000", 2024-09-12T18:37:38.743 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2269999999999998e-06 2024-09-12T18:37:38.743 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.743 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.743 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:38.743 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493457+0000", 2024-09-12T18:37:38.743 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.312e-05 2024-09-12T18:37:38.743 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.743 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.743 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:38.744 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493466+0000", 2024-09-12T18:37:38.744 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.6309999999999992e-06 2024-09-12T18:37:38.744 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.744 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.744 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:38.744 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493526+0000", 2024-09-12T18:37:38.744 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.0316000000000003e-05 2024-09-12T18:37:38.744 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.744 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.744 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:38.744 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493541+0000", 2024-09-12T18:37:38.744 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4459e-05 2024-09-12T18:37:38.744 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.745 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.745 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:38.745 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534501+0000", 2024-09-12T18:37:38.745 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.040960215000000001 2024-09-12T18:37:38.745 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.745 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.745 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:38.745 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534546+0000", 2024-09-12T18:37:38.745 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.5571999999999997e-05 2024-09-12T18:37:38.745 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.745 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:38.745 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.745 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.745 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.746 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201582 5.f 5:f90f147f:::benchmark_data_smithi073_23739_object69305:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:38.746 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.493597+0000", 2024-09-12T18:37:38.746 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 18.117223851999999, 2024-09-12T18:37:38.746 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.045457567999999997, 2024-09-12T18:37:38.746 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:38.746 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:38.746 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:38.746 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:38.746 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:38.746 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:38.746 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201582 2024-09-12T18:37:38.746 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.746 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:38.747 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.747 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:38.747 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493597+0000", 2024-09-12T18:37:38.747 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.747 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.747 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.747 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:38.747 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493597+0000", 2024-09-12T18:37:38.747 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.747 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.747 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.747 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:38.747 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493598+0000", 2024-09-12T18:37:38.747 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7699999999999992e-07 2024-09-12T18:37:38.748 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.748 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.748 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:38.748 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493609+0000", 2024-09-12T18:37:38.748 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1297e-05 2024-09-12T18:37:38.748 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.748 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.748 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:38.748 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493620+0000", 2024-09-12T18:37:38.748 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0930999999999999e-05 2024-09-12T18:37:38.748 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.748 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.749 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:38.749 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493640+0000", 2024-09-12T18:37:38.749 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.0072e-05 2024-09-12T18:37:38.749 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.749 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.749 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:38.749 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531770+0000", 2024-09-12T18:37:38.749 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.038129652999999999 2024-09-12T18:37:38.749 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.749 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.749 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:38.749 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532046+0000", 2024-09-12T18:37:38.749 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027561600000000001 2024-09-12T18:37:38.750 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.750 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.750 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:38.750 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532337+0000", 2024-09-12T18:37:38.750 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00029169200000000003 2024-09-12T18:37:38.750 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.750 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.750 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:38.750 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536640+0000", 2024-09-12T18:37:38.750 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0043023499999999999 2024-09-12T18:37:38.750 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.750 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.751 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:38.751 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.538943+0000", 2024-09-12T18:37:38.751 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0023032740000000001 2024-09-12T18:37:38.751 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.751 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.751 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:38.751 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.539013+0000", 2024-09-12T18:37:38.751 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9944000000000007e-05 2024-09-12T18:37:38.751 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.751 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.751 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:38.751 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.539055+0000", 2024-09-12T18:37:38.752 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.1761999999999998e-05 2024-09-12T18:37:38.752 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.752 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:38.752 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.752 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.752 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.752 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:201583 5.d e67/21 5:b91eedec:::benchmark_data_smithi073_23739_object69306:head v 67'12761, mlcod=67'12759)", 2024-09-12T18:37:38.752 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.495034+0000", 2024-09-12T18:37:38.752 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 18.115787477000001, 2024-09-12T18:37:38.752 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.047966852999999997, 2024-09-12T18:37:38.752 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:38.752 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:38.752 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:38.753 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:38.753 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.753 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:38.753 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.495034+0000", 2024-09-12T18:37:38.753 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.753 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.753 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.753 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:38.753 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.495034+0000", 2024-09-12T18:37:38.753 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:38.753 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.753 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.753 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:38.754 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.495035+0000", 2024-09-12T18:37:38.754 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.023e-06 2024-09-12T18:37:38.754 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.754 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.754 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:38.754 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.495040+0000", 2024-09-12T18:37:38.754 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.9300000000000002e-06 2024-09-12T18:37:38.754 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.754 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.754 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:38.754 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531510+0000", 2024-09-12T18:37:38.754 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.036470250000000003 2024-09-12T18:37:38.754 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.755 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.755 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:38.755 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531518+0000", 2024-09-12T18:37:38.755 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8490000000000006e-06 2024-09-12T18:37:38.755 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.755 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.755 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:38.755 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534395+0000", 2024-09-12T18:37:38.755 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.002877246 2024-09-12T18:37:38.755 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.755 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.755 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:38.755 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534418+0000", 2024-09-12T18:37:38.755 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.3119e-05 2024-09-12T18:37:38.756 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.756 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.756 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:38.756 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.542930+0000", 2024-09-12T18:37:38.756 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0085121929999999995 2024-09-12T18:37:38.756 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:38.756 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:38.756 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:38.756 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.543000+0000", 2024-09-12T18:37:38.756 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0242999999999998e-05 2024-09-12T18:37:38.756 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.756 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:38.756 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.757 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:38.757 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:38.757 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:38.757 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:37:38.758 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:38.751+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:38.759 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:37:38.860 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:38.850+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:38.915 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:37:38.915 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:37:38.916 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:38.916 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:38.932 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:37:38.932 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:37:38.936 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:37:38.950 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:37:38.951 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:37:38.960 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:38.954+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:39.061 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:39.054+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:39.126 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:39.126 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:39.148 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:37:39.192 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:39.186+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:39.263 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:39.258+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:39.298 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:39.298 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:39.317 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:37:39.364 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:39.358+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:39.466 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:39.458+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:39.468 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:39.468 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:39.482 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is unset 2024-09-12T18:37:39.490 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:37:39.567 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:39.562+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:39.646 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:39.647 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:39.668 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:37:39.669 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:39.663+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:39.769 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:39.762+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:39.861 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:39.862 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:39.870 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:39.862+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:39.881 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:37:39.971 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:39.966+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:40.037 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:40.037 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:40.058 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:37:40.102 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:40.098+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:40.173 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:40.167+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:40.252 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:40.253 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:40.271 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:37:40.273 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:40.267+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:40.374 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:40.366+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:40.428 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:40.428 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:40.448 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:37:40.492 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:40.486+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:40.576 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:40.571+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:40.600 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:40.600 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:40.622 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:37:40.677 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:40.670+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:40.777 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:40.771+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:40.809 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:40.809 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:40.829 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:37:40.879 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:40.870+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:40.968 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:37:40.980 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:40.975+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:40.980 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:40.981 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:41.003 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:37:41.081 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:41.074+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:41.129 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:37:41.129 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:37:41.148 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:37:41.148 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:37:41.153 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:41.153 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:37:41.153 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.153 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:243793 5.f e76/21 5:fe6001d2:::benchmark_data_smithi073_23739_object111516:head v 76'15039, mlcod=76'15037)", 2024-09-12T18:37:41.154 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:41.148621+0000", 2024-09-12T18:37:41.154 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.001821905, 2024-09-12T18:37:41.154 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018371559999999999, 2024-09-12T18:37:41.154 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:41.154 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:41.154 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:37:41.155 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:41.155 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.155 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:41.155 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.148621+0000", 2024-09-12T18:37:41.155 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.155 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.155 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.156 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:41.156 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.148621+0000", 2024-09-12T18:37:41.156 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.156 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.156 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.156 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:41.156 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.148622+0000", 2024-09-12T18:37:41.156 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7199999999999999e-07 2024-09-12T18:37:41.156 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.156 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.156 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:41.157 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.148625+0000", 2024-09-12T18:37:41.157 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.658e-06 2024-09-12T18:37:41.157 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.157 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.157 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:41.157 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.148634+0000", 2024-09-12T18:37:41.157 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7870000000000007e-06 2024-09-12T18:37:41.157 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.157 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.157 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:41.157 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.148640+0000", 2024-09-12T18:37:41.157 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2659999999999998e-06 2024-09-12T18:37:41.158 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.158 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.158 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:41.158 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.148689+0000", 2024-09-12T18:37:41.158 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8408999999999997e-05 2024-09-12T18:37:41.158 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.158 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.158 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:41.158 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.148701+0000", 2024-09-12T18:37:41.158 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2300000000000001e-05 2024-09-12T18:37:41.158 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.158 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:41.158 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.159 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.159 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.159 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:243797 5.a e76/21 5:57ff842d:::benchmark_data_smithi073_23739_object111520:head v 76'15452, mlcod=76'15450)", 2024-09-12T18:37:41.159 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:41.149051+0000", 2024-09-12T18:37:41.159 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0013920790000000001, 2024-09-12T18:37:41.159 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0014399, 2024-09-12T18:37:41.159 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:41.159 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:41.159 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:37:41.159 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:41.159 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.159 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:41.160 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.149051+0000", 2024-09-12T18:37:41.160 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.160 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.160 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.160 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:41.160 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.149051+0000", 2024-09-12T18:37:41.160 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.160 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.160 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.160 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:41.160 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.149051+0000", 2024-09-12T18:37:41.160 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4499999999999997e-07 2024-09-12T18:37:41.161 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.161 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.161 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:41.161 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.149055+0000", 2024-09-12T18:37:41.161 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.292e-06 2024-09-12T18:37:41.161 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.161 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.161 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:41.161 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.149063+0000", 2024-09-12T18:37:41.161 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4579999999999993e-06 2024-09-12T18:37:41.161 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.161 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.161 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:41.162 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.149069+0000", 2024-09-12T18:37:41.162 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4319999999999998e-06 2024-09-12T18:37:41.162 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.162 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.162 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:41.162 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.149121+0000", 2024-09-12T18:37:41.162 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2658000000000003e-05 2024-09-12T18:37:41.162 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.162 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.162 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:41.162 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.149141+0000", 2024-09-12T18:37:41.162 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0122000000000001e-05 2024-09-12T18:37:41.162 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.163 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:41.163 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.163 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.163 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.163 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:243798 5.e 5:72a21c2f:::benchmark_data_smithi073_23739_object111521:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T18:37:41.163 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:41.149818+0000", 2024-09-12T18:37:41.163 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00062540199999999995, 2024-09-12T18:37:41.163 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00070297999999999997, 2024-09-12T18:37:41.163 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:41.163 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:41.163 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:41.163 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:41.164 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:41.164 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:41.164 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 243798 2024-09-12T18:37:41.164 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.164 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:41.164 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.164 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:41.164 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.149818+0000", 2024-09-12T18:37:41.164 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.164 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.164 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.164 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:41.164 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.149818+0000", 2024-09-12T18:37:41.165 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.165 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.165 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.165 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:41.165 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.149818+0000", 2024-09-12T18:37:41.165 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5099999999999999e-07 2024-09-12T18:37:41.165 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.165 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.165 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:41.165 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.149822+0000", 2024-09-12T18:37:41.165 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2540000000000001e-06 2024-09-12T18:37:41.165 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.166 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.166 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:41.166 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.149830+0000", 2024-09-12T18:37:41.166 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1410000000000005e-06 2024-09-12T18:37:41.166 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.166 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.166 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:41.166 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.149836+0000", 2024-09-12T18:37:41.166 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.635e-06 2024-09-12T18:37:41.167 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.167 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.167 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:41.167 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.149897+0000", 2024-09-12T18:37:41.167 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0275999999999997e-05 2024-09-12T18:37:41.167 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.167 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.167 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:41.167 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.150043+0000", 2024-09-12T18:37:41.167 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014621100000000001 2024-09-12T18:37:41.168 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.168 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.168 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:41.168 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.150170+0000", 2024-09-12T18:37:41.168 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012695999999999999 2024-09-12T18:37:41.168 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.168 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:41.168 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.168 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.168 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.168 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(client.4480.0:243791 5.e e76/21)", 2024-09-12T18:37:41.168 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:41.150038+0000", 2024-09-12T18:37:41.168 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00040462700000000001, 2024-09-12T18:37:41.169 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00051466999999999995, 2024-09-12T18:37:41.169 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:41.169 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:41.169 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:41.169 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:41.169 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.169 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:41.169 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.150038+0000", 2024-09-12T18:37:41.169 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.169 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.169 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.169 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:41.170 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.150038+0000", 2024-09-12T18:37:41.170 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.170 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.170 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.170 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:41.170 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.150039+0000", 2024-09-12T18:37:41.170 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8500000000000002e-07 2024-09-12T18:37:41.170 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.170 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.170 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:41.170 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.150042+0000", 2024-09-12T18:37:41.170 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3280000000000002e-06 2024-09-12T18:37:41.170 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.170 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.171 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:41.171 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.150050+0000", 2024-09-12T18:37:41.171 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.8830000000000006e-06 2024-09-12T18:37:41.171 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.171 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.171 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:41.171 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.150058+0000", 2024-09-12T18:37:41.171 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6090000000000003e-06 2024-09-12T18:37:41.171 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.171 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:41.172 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.172 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.172 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.172 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:243791 5.e 5:78b17fc6:::benchmark_data_smithi073_23739_object111514:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T18:37:41.172 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:41.145922+0000", 2024-09-12T18:37:41.172 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0045210679999999996, 2024-09-12T18:37:41.172 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0046559440000000004, 2024-09-12T18:37:41.172 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:41.172 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:41.172 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:41.172 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:41.172 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:41.173 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:41.173 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 243791 2024-09-12T18:37:41.173 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.173 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:41.173 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.173 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:41.173 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.145922+0000", 2024-09-12T18:37:41.173 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.173 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.173 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.173 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:41.173 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.145922+0000", 2024-09-12T18:37:41.173 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.174 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.174 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.174 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:41.174 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.145923+0000", 2024-09-12T18:37:41.174 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8299999999999995e-07 2024-09-12T18:37:41.174 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.174 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.174 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:41.174 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.145927+0000", 2024-09-12T18:37:41.174 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2579999999999997e-06 2024-09-12T18:37:41.175 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.175 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.175 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:41.175 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.145937+0000", 2024-09-12T18:37:41.175 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8349999999999999e-06 2024-09-12T18:37:41.175 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.175 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.175 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:41.175 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.145943+0000", 2024-09-12T18:37:41.175 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7610000000000004e-06 2024-09-12T18:37:41.175 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.175 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.176 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:41.176 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.145989+0000", 2024-09-12T18:37:41.176 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6418999999999997e-05 2024-09-12T18:37:41.176 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.176 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.176 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:41.176 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.146091+0000", 2024-09-12T18:37:41.176 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000101372 2024-09-12T18:37:41.176 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.176 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.177 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:41.177 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.146163+0000", 2024-09-12T18:37:41.177 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2334000000000002e-05 2024-09-12T18:37:41.177 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.177 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.177 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:41.177 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.148785+0000", 2024-09-12T18:37:41.177 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0026215259999999999 2024-09-12T18:37:41.177 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.177 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:41.177 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.177 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.178 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.178 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:243794 5.9 e76/21 5:95a369e3:::benchmark_data_smithi073_23739_object111517:head v 76'15207, mlcod=76'15205)", 2024-09-12T18:37:41.178 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:41.148440+0000", 2024-09-12T18:37:41.178 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0020027949999999999, 2024-09-12T18:37:41.178 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0021719759999999999, 2024-09-12T18:37:41.178 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:41.178 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:41.178 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:37:41.178 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:41.178 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.178 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:41.178 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.148440+0000", 2024-09-12T18:37:41.178 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.179 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.179 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.179 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:41.179 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.148440+0000", 2024-09-12T18:37:41.179 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.179 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.179 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.179 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:41.179 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.148441+0000", 2024-09-12T18:37:41.179 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5499999999999998e-07 2024-09-12T18:37:41.179 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.179 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.179 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:41.180 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.148447+0000", 2024-09-12T18:37:41.180 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1449999999999996e-06 2024-09-12T18:37:41.180 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.180 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.180 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:41.180 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.148456+0000", 2024-09-12T18:37:41.180 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.1009999999999998e-06 2024-09-12T18:37:41.180 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.180 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.180 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:41.180 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.148463+0000", 2024-09-12T18:37:41.180 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.4370000000000004e-06 2024-09-12T18:37:41.180 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.181 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.181 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:41.181 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.148516+0000", 2024-09-12T18:37:41.181 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3748000000000001e-05 2024-09-12T18:37:41.181 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.181 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.181 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:41.181 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:41.148533+0000", 2024-09-12T18:37:41.181 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.6657999999999999e-05 2024-09-12T18:37:41.181 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.181 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:41.181 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.181 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.181 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-09-12T18:37:41.182 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 6 2024-09-12T18:37:41.182 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:41.183 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:37:41.183 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:41.178+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:41.184 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:37:41.185 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:37:41.283 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:41.278+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:41.335 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:41.335 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-09-12T18:37:41.335 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-09-12T18:37:41.335 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-09-12T18:37:41.335 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:41.355 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:37:41.385 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:41.378+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:41.485 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:41.479+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:41.511 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T18:37:41.515 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:41.515 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-09-12T18:37:41.516 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-09-12T18:37:41.516 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:37:41.516 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.516 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121096 5.8 5:13503891:::benchmark_data_smithi073_23739_object121095:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:41.516 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:37:41.516 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 61.332055142999998, 2024-09-12T18:37:41.516 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064025391000000001, 2024-09-12T18:37:41.516 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:41.516 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:41.516 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:41.516 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:41.517 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:41.517 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:41.517 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121096 2024-09-12T18:37:41.517 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.517 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:41.517 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.517 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:41.517 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:37:41.517 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.517 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.517 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.517 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:41.517 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:37:41.518 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.518 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.518 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.518 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:41.518 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178579+0000", 2024-09-12T18:37:41.518 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7369999999999998e-06 2024-09-12T18:37:41.518 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.518 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.518 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:41.518 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178846+0000", 2024-09-12T18:37:41.518 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026752699999999999 2024-09-12T18:37:41.519 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.519 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.519 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:41.519 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178877+0000", 2024-09-12T18:37:41.519 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1081999999999998e-05 2024-09-12T18:37:41.519 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.519 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.519 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:41.519 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178896+0000", 2024-09-12T18:37:41.519 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8522e-05 2024-09-12T18:37:41.519 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.519 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.519 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:41.519 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.192591+0000", 2024-09-12T18:37:41.520 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013695067 2024-09-12T18:37:41.520 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.520 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.520 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:41.520 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.192944+0000", 2024-09-12T18:37:41.520 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00035273699999999999 2024-09-12T18:37:41.520 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.520 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.520 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:41.520 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.193732+0000", 2024-09-12T18:37:41.520 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078849599999999997 2024-09-12T18:37:41.520 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.520 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.521 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:41.521 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.213583+0000", 2024-09-12T18:37:41.521 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.019851164000000001 2024-09-12T18:37:41.521 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.521 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.521 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:41.521 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242386+0000", 2024-09-12T18:37:41.521 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028802924000000001 2024-09-12T18:37:41.521 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.521 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.521 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:41.521 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242501+0000", 2024-09-12T18:37:41.521 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000114932 2024-09-12T18:37:41.522 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.522 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.522 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:41.522 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242602+0000", 2024-09-12T18:37:41.522 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000100203 2024-09-12T18:37:41.522 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.522 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:41.522 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.522 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.522 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.522 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121097 5.8 5:1b31a99e:::benchmark_data_smithi073_23739_object121096:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:41.522 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:37:41.523 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 61.316326853, 2024-09-12T18:37:41.523 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048475917, 2024-09-12T18:37:41.523 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:41.523 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:41.523 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:41.523 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:41.523 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:41.523 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:41.523 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121097 2024-09-12T18:37:41.523 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.523 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:41.523 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.524 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:41.524 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:37:41.524 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.524 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.524 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.524 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:41.524 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:37:41.524 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.524 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.524 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.524 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:41.524 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194308+0000", 2024-09-12T18:37:41.524 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2789999999999999e-06 2024-09-12T18:37:41.525 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.525 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.525 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:41.525 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194396+0000", 2024-09-12T18:37:41.525 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8324000000000003e-05 2024-09-12T18:37:41.525 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.525 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.525 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:41.525 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194424+0000", 2024-09-12T18:37:41.525 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7565000000000001e-05 2024-09-12T18:37:41.525 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.525 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.525 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:41.526 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194444+0000", 2024-09-12T18:37:41.526 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0363000000000001e-05 2024-09-12T18:37:41.526 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.526 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.526 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:41.526 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.206888+0000", 2024-09-12T18:37:41.526 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012443997 2024-09-12T18:37:41.526 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.526 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.526 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:41.527 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.207138+0000", 2024-09-12T18:37:41.527 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025035900000000002 2024-09-12T18:37:41.527 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.527 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.527 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:41.527 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.207365+0000", 2024-09-12T18:37:41.527 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000226407 2024-09-12T18:37:41.528 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.528 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.528 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:41.528 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.215059+0000", 2024-09-12T18:37:41.528 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076946860000000001 2024-09-12T18:37:41.528 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.528 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.528 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:41.529 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242619+0000", 2024-09-12T18:37:41.529 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.027559975 2024-09-12T18:37:41.529 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.529 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.529 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:41.529 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242706+0000", 2024-09-12T18:37:41.529 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6384999999999994e-05 2024-09-12T18:37:41.529 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.529 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.529 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:41.529 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242780+0000", 2024-09-12T18:37:41.529 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4577000000000001e-05 2024-09-12T18:37:41.530 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.530 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:41.530 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.530 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.530 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.530 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121106 5.d 5:b4a9a221:::benchmark_data_smithi073_23739_object121105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:41.530 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:37:41.530 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 61.273451917000003, 2024-09-12T18:37:41.530 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.034882274999999997, 2024-09-12T18:37:41.530 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:41.530 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:41.530 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:41.530 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:41.531 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:41.531 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:41.531 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121106 2024-09-12T18:37:41.531 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.531 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:41.531 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.531 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:41.531 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:37:41.531 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.531 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.531 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.531 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:41.531 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:37:41.532 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.532 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.532 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.532 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:41.532 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237182+0000", 2024-09-12T18:37:41.532 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6019999999999998e-06 2024-09-12T18:37:41.532 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.532 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.532 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:41.532 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237257+0000", 2024-09-12T18:37:41.532 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5420999999999995e-05 2024-09-12T18:37:41.532 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.532 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.533 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:41.533 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237305+0000", 2024-09-12T18:37:41.533 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7207999999999999e-05 2024-09-12T18:37:41.533 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.533 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.533 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:41.533 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237325+0000", 2024-09-12T18:37:41.533 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0001e-05 2024-09-12T18:37:41.533 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.533 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.533 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:41.533 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237505+0000", 2024-09-12T18:37:41.533 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000180798 2024-09-12T18:37:41.533 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.534 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.534 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:41.534 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237764+0000", 2024-09-12T18:37:41.534 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025862299999999998 2024-09-12T18:37:41.534 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.534 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.534 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:41.534 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.238264+0000", 2024-09-12T18:37:41.534 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00050016100000000005 2024-09-12T18:37:41.535 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.535 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.535 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:41.535 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256525+0000", 2024-09-12T18:37:41.535 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018260508000000002 2024-09-12T18:37:41.535 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.535 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.535 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:41.535 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.271903+0000", 2024-09-12T18:37:41.535 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015378739000000001 2024-09-12T18:37:41.535 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.535 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.536 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:41.536 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.271999+0000", 2024-09-12T18:37:41.536 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5989000000000005e-05 2024-09-12T18:37:41.536 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.536 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.536 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:41.536 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272062+0000", 2024-09-12T18:37:41.536 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2224999999999995e-05 2024-09-12T18:37:41.536 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.536 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:41.536 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.536 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.536 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.537 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:167368 5.4 5:29a1ec58:::benchmark_data_smithi073_23739_object35091:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:41.537 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:03.168773+0000", 2024-09-12T18:37:41.537 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 38.341858049999999, 2024-09-12T18:37:41.537 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.066578597000000003, 2024-09-12T18:37:41.537 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:41.537 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:41.537 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:41.537 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:41.537 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:41.538 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:41.538 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 167368 2024-09-12T18:37:41.538 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.538 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:41.538 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.538 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:41.538 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168773+0000", 2024-09-12T18:37:41.538 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.538 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.538 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.538 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:41.538 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168773+0000", 2024-09-12T18:37:41.538 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.539 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.539 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.539 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:41.539 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168774+0000", 2024-09-12T18:37:41.539 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.023e-06 2024-09-12T18:37:41.539 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.539 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.539 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:41.539 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168779+0000", 2024-09-12T18:37:41.539 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5800000000000002e-06 2024-09-12T18:37:41.539 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.539 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.539 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:41.540 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168789+0000", 2024-09-12T18:37:41.540 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0346999999999999e-05 2024-09-12T18:37:41.540 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.540 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.540 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:41.540 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168808+0000", 2024-09-12T18:37:41.540 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8423e-05 2024-09-12T18:37:41.540 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.540 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.540 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:41.540 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168864+0000", 2024-09-12T18:37:41.540 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-09-12T18:37:41.540 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.541 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.541 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:41.541 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168947+0000", 2024-09-12T18:37:41.541 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3274000000000003e-05 2024-09-12T18:37:41.541 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.541 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.541 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:41.541 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.169014+0000", 2024-09-12T18:37:41.541 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6284000000000004e-05 2024-09-12T18:37:41.541 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.541 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.542 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:41.542 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.170653+0000", 2024-09-12T18:37:41.542 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016389779999999999 2024-09-12T18:37:41.542 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.542 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.542 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:41.542 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.235279+0000", 2024-09-12T18:37:41.542 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064626464999999994 2024-09-12T18:37:41.542 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.542 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.542 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:41.542 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.235320+0000", 2024-09-12T18:37:41.542 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0377000000000003e-05 2024-09-12T18:37:41.543 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.543 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.543 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:41.543 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.235352+0000", 2024-09-12T18:37:41.543 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2322e-05 2024-09-12T18:37:41.543 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.543 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:41.543 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.543 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.543 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.543 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:167371 5.4 5:24fea27c:::benchmark_data_smithi073_23739_object35094:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:41.543 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:03.171234+0000", 2024-09-12T18:37:41.543 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 38.339397024999997, 2024-09-12T18:37:41.544 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.066048171000000003, 2024-09-12T18:37:41.544 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:41.544 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:41.544 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:41.544 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:41.544 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:41.544 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:41.544 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 167371 2024-09-12T18:37:41.544 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.544 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:41.544 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.544 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:41.545 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171234+0000", 2024-09-12T18:37:41.545 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.545 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.545 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.545 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:41.545 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171234+0000", 2024-09-12T18:37:41.545 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.545 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.545 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.545 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:41.545 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171235+0000", 2024-09-12T18:37:41.545 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8599999999999997e-07 2024-09-12T18:37:41.545 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.546 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.546 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:41.546 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171238+0000", 2024-09-12T18:37:41.546 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9739999999999998e-06 2024-09-12T18:37:41.546 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.546 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.546 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:41.546 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171245+0000", 2024-09-12T18:37:41.546 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6000000000000003e-06 2024-09-12T18:37:41.546 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.546 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.546 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:41.546 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171249+0000", 2024-09-12T18:37:41.546 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9960000000000004e-06 2024-09-12T18:37:41.547 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.547 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.547 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:41.547 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171288+0000", 2024-09-12T18:37:41.547 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9119999999999998e-05 2024-09-12T18:37:41.547 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.548 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.548 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:41.548 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171359+0000", 2024-09-12T18:37:41.548 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0951000000000006e-05 2024-09-12T18:37:41.548 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.548 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.549 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:41.549 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171425+0000", 2024-09-12T18:37:41.549 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.58e-05 2024-09-12T18:37:41.549 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.549 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.549 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:41.550 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.173093+0000", 2024-09-12T18:37:41.550 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016683939999999999 2024-09-12T18:37:41.550 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.550 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.550 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:41.550 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.237202+0000", 2024-09-12T18:37:41.550 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064109437000000005 2024-09-12T18:37:41.551 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.551 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.551 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:41.551 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.237249+0000", 2024-09-12T18:37:41.551 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6751e-05 2024-09-12T18:37:41.551 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.551 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.551 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:41.552 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.237282+0000", 2024-09-12T18:37:41.552 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3262000000000001e-05 2024-09-12T18:37:41.552 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.552 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:41.552 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.553 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.553 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.553 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:201498 5.a e67/21 5:5815d848:::benchmark_data_smithi073_23739_object69221:head v 67'12793, mlcod=67'12791)", 2024-09-12T18:37:41.553 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.430872+0000", 2024-09-12T18:37:41.553 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 21.079759047, 2024-09-12T18:37:41.553 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.038775280000000002, 2024-09-12T18:37:41.553 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:41.554 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:41.554 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:41.554 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:41.554 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.554 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:41.555 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430872+0000", 2024-09-12T18:37:41.555 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.555 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.555 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.555 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:41.555 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430872+0000", 2024-09-12T18:37:41.555 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.555 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.555 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.556 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:41.556 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430873+0000", 2024-09-12T18:37:41.556 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6600000000000003e-07 2024-09-12T18:37:41.556 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.556 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.556 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:41.556 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430875+0000", 2024-09-12T18:37:41.556 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5399999999999998e-06 2024-09-12T18:37:41.556 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.556 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.556 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:41.557 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430879+0000", 2024-09-12T18:37:41.557 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7239999999999998e-06 2024-09-12T18:37:41.557 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.557 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.557 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:41.557 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430882+0000", 2024-09-12T18:37:41.557 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8679999999999999e-06 2024-09-12T18:37:41.557 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.557 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.557 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:41.557 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430909+0000", 2024-09-12T18:37:41.557 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7832999999999999e-05 2024-09-12T18:37:41.558 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.558 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.558 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:41.558 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430922+0000", 2024-09-12T18:37:41.558 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2164000000000001e-05 2024-09-12T18:37:41.558 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.558 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.558 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:41.558 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469578+0000", 2024-09-12T18:37:41.558 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.038656469999999998 2024-09-12T18:37:41.558 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.558 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.558 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:41.559 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469648+0000", 2024-09-12T18:37:41.559 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9414999999999999e-05 2024-09-12T18:37:41.559 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.559 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:41.559 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.559 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.559 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.559 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201513 5.e 5:7be2f597:::benchmark_data_smithi073_23739_object69236:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:41.559 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.435121+0000", 2024-09-12T18:37:41.559 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 21.075510294000001, 2024-09-12T18:37:41.559 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.034945021999999999, 2024-09-12T18:37:41.559 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:41.560 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:41.560 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:41.560 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:41.560 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:41.560 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:41.560 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201513 2024-09-12T18:37:41.560 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.560 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:41.560 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.560 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:41.560 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.435121+0000", 2024-09-12T18:37:41.560 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.561 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.561 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.561 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:41.561 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.435121+0000", 2024-09-12T18:37:41.561 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.561 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.561 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.561 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:41.561 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.435122+0000", 2024-09-12T18:37:41.561 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2440000000000001e-06 2024-09-12T18:37:41.561 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.561 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.562 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:41.562 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.435126+0000", 2024-09-12T18:37:41.562 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1559999999999997e-06 2024-09-12T18:37:41.562 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.562 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.562 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:41.562 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445086+0000", 2024-09-12T18:37:41.562 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0099592389999999999 2024-09-12T18:37:41.562 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.562 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.562 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:41.562 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445095+0000", 2024-09-12T18:37:41.562 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2620000000000004e-06 2024-09-12T18:37:41.562 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.563 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.563 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:41.563 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445165+0000", 2024-09-12T18:37:41.563 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0257000000000002e-05 2024-09-12T18:37:41.563 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.563 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.563 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:41.563 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445311+0000", 2024-09-12T18:37:41.563 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014603899999999999 2024-09-12T18:37:41.563 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.563 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.563 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:41.563 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445445+0000", 2024-09-12T18:37:41.564 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000133654 2024-09-12T18:37:41.564 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.564 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.564 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:41.564 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469853+0000", 2024-09-12T18:37:41.564 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024407893999999999 2024-09-12T18:37:41.564 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.564 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.564 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:41.564 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469873+0000", 2024-09-12T18:37:41.564 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0622e-05 2024-09-12T18:37:41.564 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.565 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.565 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:41.565 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469949+0000", 2024-09-12T18:37:41.565 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5918000000000001e-05 2024-09-12T18:37:41.565 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.565 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.565 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:41.565 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470066+0000", 2024-09-12T18:37:41.565 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000116737 2024-09-12T18:37:41.565 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.565 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:41.565 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.566 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.566 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.566 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201521 5.d 5:b911ab6f:::benchmark_data_smithi073_23739_object69244:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:41.566 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445173+0000", 2024-09-12T18:37:41.566 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 21.065457851000001, 2024-09-12T18:37:41.566 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.031483274999999998, 2024-09-12T18:37:41.566 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:41.566 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:41.566 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:41.566 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:41.566 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:41.566 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:41.566 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201521 2024-09-12T18:37:41.567 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.567 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:41.567 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.567 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:41.567 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445173+0000", 2024-09-12T18:37:41.567 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.567 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.567 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.567 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:41.567 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445173+0000", 2024-09-12T18:37:41.567 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.568 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.568 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.568 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:41.568 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445174+0000", 2024-09-12T18:37:41.568 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4299999999999998e-07 2024-09-12T18:37:41.568 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.568 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.568 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:41.568 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445176+0000", 2024-09-12T18:37:41.568 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.469e-06 2024-09-12T18:37:41.568 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.569 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.569 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:41.569 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445183+0000", 2024-09-12T18:37:41.569 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8719999999999996e-06 2024-09-12T18:37:41.569 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.569 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.569 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:41.569 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445188+0000", 2024-09-12T18:37:41.569 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7079999999999996e-06 2024-09-12T18:37:41.569 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.569 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.569 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:41.570 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445314+0000", 2024-09-12T18:37:41.570 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012627800000000001 2024-09-12T18:37:41.570 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.570 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.570 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:41.570 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445436+0000", 2024-09-12T18:37:41.570 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000122007 2024-09-12T18:37:41.570 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.570 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.570 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:41.570 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445541+0000", 2024-09-12T18:37:41.570 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000105068 2024-09-12T18:37:41.570 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.571 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.571 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:41.571 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470655+0000", 2024-09-12T18:37:41.571 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025114035 2024-09-12T18:37:41.571 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.571 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.571 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:41.571 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476570+0000", 2024-09-12T18:37:41.571 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0059143269999999996 2024-09-12T18:37:41.571 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.571 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.571 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:41.571 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476624+0000", 2024-09-12T18:37:41.572 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4261000000000001e-05 2024-09-12T18:37:41.572 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.572 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.572 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:41.572 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476657+0000", 2024-09-12T18:37:41.572 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2806999999999999e-05 2024-09-12T18:37:41.572 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.572 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:41.572 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.572 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.572 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.572 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201524 5.d 5:b330b18b:::benchmark_data_smithi073_23739_object69247:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:41.572 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445202+0000", 2024-09-12T18:37:41.573 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 21.065429591000001, 2024-09-12T18:37:41.573 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.034036482, 2024-09-12T18:37:41.573 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:41.573 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:41.573 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:41.573 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:41.573 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:41.573 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:41.573 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201524 2024-09-12T18:37:41.573 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.573 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:41.573 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.573 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:41.574 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445202+0000", 2024-09-12T18:37:41.574 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.574 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.574 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.574 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:41.574 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445202+0000", 2024-09-12T18:37:41.574 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.574 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.574 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.574 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:41.574 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445202+0000", 2024-09-12T18:37:41.574 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2e-07 2024-09-12T18:37:41.574 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.574 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.575 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:41.575 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445204+0000", 2024-09-12T18:37:41.575 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0490000000000002e-06 2024-09-12T18:37:41.575 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.575 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.575 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:41.575 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445210+0000", 2024-09-12T18:37:41.575 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.959e-06 2024-09-12T18:37:41.575 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.575 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.575 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:41.575 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445215+0000", 2024-09-12T18:37:41.575 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.668e-06 2024-09-12T18:37:41.576 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.576 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.576 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:41.576 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470703+0000", 2024-09-12T18:37:41.576 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025488182000000002 2024-09-12T18:37:41.576 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.576 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.576 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:41.576 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470911+0000", 2024-09-12T18:37:41.577 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020755400000000001 2024-09-12T18:37:41.577 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.577 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.577 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:41.577 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.471309+0000", 2024-09-12T18:37:41.577 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00039868199999999998 2024-09-12T18:37:41.577 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.577 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.577 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:41.577 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476724+0000", 2024-09-12T18:37:41.577 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054150589999999998 2024-09-12T18:37:41.577 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.577 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.577 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:41.578 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.479050+0000", 2024-09-12T18:37:41.578 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0023259309999999998 2024-09-12T18:37:41.578 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.578 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.578 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:41.578 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.479164+0000", 2024-09-12T18:37:41.578 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000114127 2024-09-12T18:37:41.578 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.578 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.578 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:41.578 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.479238+0000", 2024-09-12T18:37:41.578 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3751000000000006e-05 2024-09-12T18:37:41.578 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.578 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:41.579 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.579 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.579 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.579 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_backfill(progress 5.5 e 67/67 lb 5:a30f9be2:::benchmark_data_smithi073_23739_object118666:head)", 2024-09-12T18:37:41.579 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445433+0000", 2024-09-12T18:37:41.579 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 21.065198705, 2024-09-12T18:37:41.579 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.029511351000000002, 2024-09-12T18:37:41.579 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:41.580 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:41.580 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:37:41.580 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:41.580 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.580 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:41.580 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445433+0000", 2024-09-12T18:37:41.580 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.580 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.580 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.580 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:41.580 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445433+0000", 2024-09-12T18:37:41.580 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.580 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.580 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.581 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:41.581 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445433+0000", 2024-09-12T18:37:41.581 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0699999999999998e-07 2024-09-12T18:37:41.581 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.581 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.581 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:41.581 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445440+0000", 2024-09-12T18:37:41.581 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6630000000000004e-06 2024-09-12T18:37:41.582 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.582 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.582 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:41.582 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445447+0000", 2024-09-12T18:37:41.582 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5159999999999997e-06 2024-09-12T18:37:41.582 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.582 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.583 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:41.583 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445454+0000", 2024-09-12T18:37:41.583 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.267e-06 2024-09-12T18:37:41.583 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.583 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.583 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:41.583 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.474780+0000", 2024-09-12T18:37:41.583 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.029325496999999999 2024-09-12T18:37:41.583 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.583 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.583 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:41.583 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.474802+0000", 2024-09-12T18:37:41.583 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2348999999999999e-05 2024-09-12T18:37:41.584 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.584 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.584 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:41.584 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.474944+0000", 2024-09-12T18:37:41.584 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014165200000000001 2024-09-12T18:37:41.584 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.584 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:41.584 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.584 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.584 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.584 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:201515 5.5 e67/49 5:a25bd8bb:::benchmark_data_smithi073_23739_object69238:head v 67'12752, mlcod=67'12750)", 2024-09-12T18:37:41.584 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445471+0000", 2024-09-12T18:37:41.584 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 21.06516079, 2024-09-12T18:37:41.585 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.031081396000000001, 2024-09-12T18:37:41.585 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:41.585 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:41.585 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:41.585 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:41.585 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.585 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:41.585 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445471+0000", 2024-09-12T18:37:41.585 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.585 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.585 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.585 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:41.585 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445471+0000", 2024-09-12T18:37:41.586 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.586 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.586 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.586 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:41.586 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445471+0000", 2024-09-12T18:37:41.586 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5400000000000002e-07 2024-09-12T18:37:41.586 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.586 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.586 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:41.586 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445475+0000", 2024-09-12T18:37:41.586 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2379999999999999e-06 2024-09-12T18:37:41.586 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.586 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.586 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:41.587 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445481+0000", 2024-09-12T18:37:41.587 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0229999999999998e-06 2024-09-12T18:37:41.587 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.587 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.587 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:41.587 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445486+0000", 2024-09-12T18:37:41.587 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5040000000000004e-06 2024-09-12T18:37:41.587 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.587 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.587 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:41.587 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445970+0000", 2024-09-12T18:37:41.587 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048416699999999997 2024-09-12T18:37:41.587 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.587 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.588 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:41.588 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445991+0000", 2024-09-12T18:37:41.588 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1067999999999999e-05 2024-09-12T18:37:41.588 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.588 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.588 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:41.588 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476511+0000", 2024-09-12T18:37:41.588 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.030520629000000001 2024-09-12T18:37:41.588 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.588 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.588 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:41.588 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476552+0000", 2024-09-12T18:37:41.588 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0413000000000001e-05 2024-09-12T18:37:41.589 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.589 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:41.589 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.589 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.589 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.589 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:201526 5.5 e67/49 5:a3549698:::benchmark_data_smithi073_23739_object69249:head v 67'12753, mlcod=67'12750)", 2024-09-12T18:37:41.589 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445957+0000", 2024-09-12T18:37:41.589 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 21.064673857999999, 2024-09-12T18:37:41.589 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.030732494999999999, 2024-09-12T18:37:41.589 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:41.589 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:41.590 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:41.590 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:41.590 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.590 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:41.590 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445957+0000", 2024-09-12T18:37:41.590 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.590 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.590 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.590 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:41.590 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445957+0000", 2024-09-12T18:37:41.591 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.591 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.591 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.591 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:41.591 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445958+0000", 2024-09-12T18:37:41.591 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7800000000000001e-07 2024-09-12T18:37:41.591 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.592 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.592 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:41.592 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445963+0000", 2024-09-12T18:37:41.592 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5419999999999999e-06 2024-09-12T18:37:41.592 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.592 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.592 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:41.592 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445972+0000", 2024-09-12T18:37:41.592 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4169999999999998e-06 2024-09-12T18:37:41.592 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.592 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.592 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:41.592 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445979+0000", 2024-09-12T18:37:41.593 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2949999999999996e-06 2024-09-12T18:37:41.593 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.593 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.593 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:41.593 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.447710+0000", 2024-09-12T18:37:41.593 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001731067 2024-09-12T18:37:41.593 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.593 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.593 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:41.593 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.447734+0000", 2024-09-12T18:37:41.593 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4094e-05 2024-09-12T18:37:41.593 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.594 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.594 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:41.594 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476659+0000", 2024-09-12T18:37:41.594 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028924268999999999 2024-09-12T18:37:41.594 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.594 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.594 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:41.594 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476690+0000", 2024-09-12T18:37:41.594 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1232999999999997e-05 2024-09-12T18:37:41.594 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.594 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:41.594 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.595 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.595 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.595 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201583 5.d 5:b91eedec:::benchmark_data_smithi073_23739_object69306:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:41.595 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.494097+0000", 2024-09-12T18:37:41.595 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 21.016533996, 2024-09-12T18:37:41.595 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049293508, 2024-09-12T18:37:41.595 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:41.595 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:41.595 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:41.595 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:41.595 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:41.595 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:41.596 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201583 2024-09-12T18:37:41.596 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.596 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:41.596 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.596 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:41.596 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494097+0000", 2024-09-12T18:37:41.596 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.596 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.596 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.596 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:41.596 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494097+0000", 2024-09-12T18:37:41.596 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.596 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.597 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.597 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:41.597 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494098+0000", 2024-09-12T18:37:41.597 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0699999999999996e-07 2024-09-12T18:37:41.597 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.597 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.597 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:41.597 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494102+0000", 2024-09-12T18:37:41.597 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.664e-06 2024-09-12T18:37:41.597 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.597 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.597 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:41.597 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494108+0000", 2024-09-12T18:37:41.597 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.3149999999999997e-06 2024-09-12T18:37:41.598 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.598 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.598 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:41.598 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494112+0000", 2024-09-12T18:37:41.598 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0659999999999997e-06 2024-09-12T18:37:41.598 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.598 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.598 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:41.598 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494200+0000", 2024-09-12T18:37:41.599 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7770999999999997e-05 2024-09-12T18:37:41.599 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.599 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.599 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:41.599 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494315+0000", 2024-09-12T18:37:41.599 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000115048 2024-09-12T18:37:41.599 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.599 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.599 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:41.599 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494414+0000", 2024-09-12T18:37:41.599 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8820999999999995e-05 2024-09-12T18:37:41.599 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.599 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.600 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:41.600 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.497199+0000", 2024-09-12T18:37:41.600 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0027854279999999999 2024-09-12T18:37:41.600 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.600 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.600 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:41.600 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543193+0000", 2024-09-12T18:37:41.600 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.045993500999999999 2024-09-12T18:37:41.600 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.600 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.600 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:41.600 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543315+0000", 2024-09-12T18:37:41.601 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012246800000000001 2024-09-12T18:37:41.601 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.601 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.601 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:41.601 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543391+0000", 2024-09-12T18:37:41.601 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5618999999999995e-05 2024-09-12T18:37:41.601 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.601 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:41.601 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.601 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.601 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.601 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201585 5.d 5:bb6c167f:::benchmark_data_smithi073_23739_object69308:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:41.602 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.495295+0000", 2024-09-12T18:37:41.602 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 21.015335829000001, 2024-09-12T18:37:41.602 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048312129000000002, 2024-09-12T18:37:41.602 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:41.602 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:41.602 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:41.602 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:41.602 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:41.602 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:41.602 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201585 2024-09-12T18:37:41.602 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.602 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:41.602 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.603 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:41.603 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495295+0000", 2024-09-12T18:37:41.603 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.603 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.603 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.603 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:41.603 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495295+0000", 2024-09-12T18:37:41.603 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.603 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.603 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.603 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:41.603 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495296+0000", 2024-09-12T18:37:41.603 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0330000000000001e-06 2024-09-12T18:37:41.604 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.604 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.604 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:41.604 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495301+0000", 2024-09-12T18:37:41.604 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7049999999999998e-06 2024-09-12T18:37:41.604 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.604 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.604 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:41.604 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495312+0000", 2024-09-12T18:37:41.604 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0791000000000001e-05 2024-09-12T18:37:41.604 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.604 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.604 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:41.605 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495319+0000", 2024-09-12T18:37:41.605 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8240000000000002e-06 2024-09-12T18:37:41.605 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.605 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.605 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:41.605 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.496088+0000", 2024-09-12T18:37:41.605 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00076901200000000002 2024-09-12T18:37:41.605 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.605 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.605 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:41.605 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.496166+0000", 2024-09-12T18:37:41.605 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.8491000000000005e-05 2024-09-12T18:37:41.605 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.605 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.606 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:41.606 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.496232+0000", 2024-09-12T18:37:41.606 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5400000000000004e-05 2024-09-12T18:37:41.606 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.606 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.606 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:41.606 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.497467+0000", 2024-09-12T18:37:41.606 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001235049 2024-09-12T18:37:41.606 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.606 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.606 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:41.606 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543463+0000", 2024-09-12T18:37:41.606 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.045995743999999998 2024-09-12T18:37:41.606 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.607 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.607 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:41.607 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543546+0000", 2024-09-12T18:37:41.607 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3434000000000001e-05 2024-09-12T18:37:41.607 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.607 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.607 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:41.607 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543608+0000", 2024-09-12T18:37:41.607 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1645999999999999e-05 2024-09-12T18:37:41.607 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.607 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:41.607 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.607 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.608 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.608 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:238484 5.8 5:135aca90:::benchmark_data_smithi073_23739_object106207:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:41.608 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:38.618805+0000", 2024-09-12T18:37:41.608 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 2.8918263749999999, 2024-09-12T18:37:41.608 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051696747000000001, 2024-09-12T18:37:41.608 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:41.608 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:41.608 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:41.608 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:41.608 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:41.608 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:41.608 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 238484 2024-09-12T18:37:41.609 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.609 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:41.609 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.609 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:41.609 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.618805+0000", 2024-09-12T18:37:41.609 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.609 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.609 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.609 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:41.609 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.618805+0000", 2024-09-12T18:37:41.609 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.609 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.609 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.609 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:41.610 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.618806+0000", 2024-09-12T18:37:41.610 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1829999999999999e-06 2024-09-12T18:37:41.610 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.610 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.610 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:41.610 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.618810+0000", 2024-09-12T18:37:41.610 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8380000000000004e-06 2024-09-12T18:37:41.610 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.610 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.610 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:41.610 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.618820+0000", 2024-09-12T18:37:41.610 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0047999999999999e-05 2024-09-12T18:37:41.610 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.611 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.611 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:41.611 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.618826+0000", 2024-09-12T18:37:41.611 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7710000000000003e-06 2024-09-12T18:37:41.611 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.611 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.611 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:41.611 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.618869+0000", 2024-09-12T18:37:41.611 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3412999999999999e-05 2024-09-12T18:37:41.611 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.611 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.611 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:41.611 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.618945+0000", 2024-09-12T18:37:41.611 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5992e-05 2024-09-12T18:37:41.612 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.612 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.612 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:41.612 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.619014+0000", 2024-09-12T18:37:41.612 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9298e-05 2024-09-12T18:37:41.612 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.612 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.612 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:41.612 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.623942+0000", 2024-09-12T18:37:41.612 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0049273909999999997 2024-09-12T18:37:41.612 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.612 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.613 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:41.613 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.670424+0000", 2024-09-12T18:37:41.613 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.046482453999999999 2024-09-12T18:37:41.613 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.613 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.613 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:41.613 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.670468+0000", 2024-09-12T18:37:41.613 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3449999999999999e-05 2024-09-12T18:37:41.613 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.613 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.613 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:41.613 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.670502+0000", 2024-09-12T18:37:41.613 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3908999999999997e-05 2024-09-12T18:37:41.614 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.614 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:41.614 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.614 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.614 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.614 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:238488 5.e 5:7267a760:::benchmark_data_smithi073_23739_object106211:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:41.614 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:38.622076+0000", 2024-09-12T18:37:41.614 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 2.8885555360000001, 2024-09-12T18:37:41.614 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053006515999999997, 2024-09-12T18:37:41.614 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:41.614 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:41.614 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:41.614 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:41.615 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:41.615 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:41.615 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 238488 2024-09-12T18:37:41.615 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.615 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:41.615 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.615 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:41.615 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622076+0000", 2024-09-12T18:37:41.615 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.616 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.616 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.616 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:41.616 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622076+0000", 2024-09-12T18:37:41.616 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.616 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.616 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.616 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:41.616 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622076+0000", 2024-09-12T18:37:41.616 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1900000000000002e-07 2024-09-12T18:37:41.616 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.617 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.617 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:41.617 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622080+0000", 2024-09-12T18:37:41.617 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.225e-06 2024-09-12T18:37:41.617 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.617 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.617 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:41.617 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622088+0000", 2024-09-12T18:37:41.617 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0949999999999996e-06 2024-09-12T18:37:41.617 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.617 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.617 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:41.618 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622092+0000", 2024-09-12T18:37:41.618 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5850000000000001e-06 2024-09-12T18:37:41.618 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.618 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.618 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:41.618 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622148+0000", 2024-09-12T18:37:41.618 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5587000000000002e-05 2024-09-12T18:37:41.618 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.618 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.618 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:41.618 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622283+0000", 2024-09-12T18:37:41.618 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013473900000000001 2024-09-12T18:37:41.619 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.619 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.619 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:41.619 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622404+0000", 2024-09-12T18:37:41.619 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000120865 2024-09-12T18:37:41.619 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.619 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.619 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:41.619 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.629341+0000", 2024-09-12T18:37:41.619 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0069376849999999999 2024-09-12T18:37:41.619 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.619 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.619 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:41.620 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.674829+0000", 2024-09-12T18:37:41.620 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.045488046999999997 2024-09-12T18:37:41.620 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.620 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.620 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:41.620 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.674973+0000", 2024-09-12T18:37:41.620 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000143719 2024-09-12T18:37:41.620 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.620 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.620 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:41.621 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.675082+0000", 2024-09-12T18:37:41.621 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010925 2024-09-12T18:37:41.621 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.621 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:41.621 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.621 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.621 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.621 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:238489 5.8 5:1da619cf:::benchmark_data_smithi073_23739_object106212:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:41.621 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:38.622114+0000", 2024-09-12T18:37:41.621 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 2.8885170360000001, 2024-09-12T18:37:41.621 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.05040443, 2024-09-12T18:37:41.621 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:41.621 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:41.622 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:41.622 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:41.622 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:41.622 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:41.622 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 238489 2024-09-12T18:37:41.622 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.622 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:41.622 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.622 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:41.622 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622114+0000", 2024-09-12T18:37:41.622 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.622 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.622 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.623 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:41.623 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622114+0000", 2024-09-12T18:37:41.623 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.623 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.623 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.623 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:41.623 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622115+0000", 2024-09-12T18:37:41.623 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8999999999999997e-07 2024-09-12T18:37:41.623 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.623 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.623 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:41.623 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622117+0000", 2024-09-12T18:37:41.623 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.182e-06 2024-09-12T18:37:41.623 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.624 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.624 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:41.624 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622122+0000", 2024-09-12T18:37:41.624 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7350000000000004e-06 2024-09-12T18:37:41.624 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.624 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.624 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:41.624 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622126+0000", 2024-09-12T18:37:41.624 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8550000000000004e-06 2024-09-12T18:37:41.624 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.624 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.624 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:41.624 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622172+0000", 2024-09-12T18:37:41.625 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6108e-05 2024-09-12T18:37:41.625 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.625 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.625 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:41.625 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622258+0000", 2024-09-12T18:37:41.625 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6050000000000005e-05 2024-09-12T18:37:41.625 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.625 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.625 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:41.625 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622323+0000", 2024-09-12T18:37:41.625 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5501999999999997e-05 2024-09-12T18:37:41.625 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.625 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.626 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:41.626 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.626718+0000", 2024-09-12T18:37:41.626 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0043947609999999996 2024-09-12T18:37:41.626 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.626 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.626 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:41.626 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.672398+0000", 2024-09-12T18:37:41.626 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.045679768000000003 2024-09-12T18:37:41.626 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.626 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.627 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:41.627 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.672468+0000", 2024-09-12T18:37:41.627 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0094999999999999e-05 2024-09-12T18:37:41.627 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.627 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.627 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:41.627 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.672519+0000", 2024-09-12T18:37:41.627 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0884000000000003e-05 2024-09-12T18:37:41.627 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.627 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:41.627 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.627 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.628 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.628 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:238490 5.e 5:7aa44d17:::benchmark_data_smithi073_23739_object106213:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:41.628 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:38.624702+0000", 2024-09-12T18:37:41.628 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 2.8859291000000002, 2024-09-12T18:37:41.628 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055637870999999998, 2024-09-12T18:37:41.628 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:41.628 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:41.628 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:41.628 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:41.628 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:41.628 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:41.628 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 238490 2024-09-12T18:37:41.628 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.629 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:41.629 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.629 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:41.629 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624702+0000", 2024-09-12T18:37:41.629 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.629 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.629 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.629 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:41.629 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624702+0000", 2024-09-12T18:37:41.629 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.629 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.630 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.630 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:41.630 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624703+0000", 2024-09-12T18:37:41.630 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1900000000000001e-07 2024-09-12T18:37:41.630 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.630 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.630 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:41.630 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624707+0000", 2024-09-12T18:37:41.630 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6100000000000002e-06 2024-09-12T18:37:41.630 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.631 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.631 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:41.631 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624715+0000", 2024-09-12T18:37:41.631 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4689999999999997e-06 2024-09-12T18:37:41.631 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.631 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.631 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:41.631 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624720+0000", 2024-09-12T18:37:41.631 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5719999999999996e-06 2024-09-12T18:37:41.631 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.631 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.631 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:41.632 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624762+0000", 2024-09-12T18:37:41.632 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2633000000000003e-05 2024-09-12T18:37:41.632 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.632 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.632 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:41.632 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624859+0000", 2024-09-12T18:37:41.632 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6667000000000001e-05 2024-09-12T18:37:41.632 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.632 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.632 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:41.632 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624927+0000", 2024-09-12T18:37:41.632 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7780000000000005e-05 2024-09-12T18:37:41.632 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.633 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.633 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:41.633 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.629361+0000", 2024-09-12T18:37:41.633 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0044346990000000003 2024-09-12T18:37:41.633 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.633 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.633 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:41.633 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.680101+0000", 2024-09-12T18:37:41.633 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.050739751999999999 2024-09-12T18:37:41.633 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.633 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.633 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:41.633 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.680223+0000", 2024-09-12T18:37:41.634 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012207 2024-09-12T18:37:41.634 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.634 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.634 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:41.634 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.680340+0000", 2024-09-12T18:37:41.634 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011680000000000001 2024-09-12T18:37:41.634 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.634 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:41.634 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.634 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.634 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.634 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:238492 5.e 5:7ec5c6d3:::benchmark_data_smithi073_23739_object106215:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:41.634 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:38.624755+0000", 2024-09-12T18:37:41.635 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 2.885876171, 2024-09-12T18:37:41.635 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.059045981999999997, 2024-09-12T18:37:41.635 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:41.635 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:41.635 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:41.635 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:41.635 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:41.635 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:41.635 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 238492 2024-09-12T18:37:41.635 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.635 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:41.635 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.636 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:41.636 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624755+0000", 2024-09-12T18:37:41.636 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.636 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.636 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.636 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:41.636 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624755+0000", 2024-09-12T18:37:41.636 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.636 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.637 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.637 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:41.637 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624756+0000", 2024-09-12T18:37:41.637 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2e-07 2024-09-12T18:37:41.637 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.637 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.637 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:41.637 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624758+0000", 2024-09-12T18:37:41.637 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0379999999999998e-06 2024-09-12T18:37:41.638 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.638 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.638 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:41.638 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624763+0000", 2024-09-12T18:37:41.638 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6400000000000002e-06 2024-09-12T18:37:41.638 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.638 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.638 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:41.638 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624768+0000", 2024-09-12T18:37:41.638 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9509999999999997e-06 2024-09-12T18:37:41.638 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.638 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.639 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:41.639 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.625824+0000", 2024-09-12T18:37:41.639 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0010553540000000001 2024-09-12T18:37:41.639 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.639 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.639 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:41.639 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.626059+0000", 2024-09-12T18:37:41.639 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00023545200000000001 2024-09-12T18:37:41.639 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.639 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.639 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:41.639 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.626277+0000", 2024-09-12T18:37:41.640 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021797400000000001 2024-09-12T18:37:41.640 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.640 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.640 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:41.640 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.632160+0000", 2024-09-12T18:37:41.640 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0058828020000000003 2024-09-12T18:37:41.641 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.641 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.641 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:41.641 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.683543+0000", 2024-09-12T18:37:41.641 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051383073000000001 2024-09-12T18:37:41.641 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.641 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.641 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:41.641 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.683677+0000", 2024-09-12T18:37:41.641 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000134091 2024-09-12T18:37:41.642 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.642 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.642 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:41.642 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.683801+0000", 2024-09-12T18:37:41.642 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012408699999999999 2024-09-12T18:37:41.642 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.642 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:41.642 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.642 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.642 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.642 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:238493 5.8 5:17b7de1b:::benchmark_data_smithi073_23739_object106216:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:41.642 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:38.624778+0000", 2024-09-12T18:37:41.643 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 2.8858534599999999, 2024-09-12T18:37:41.643 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048129221999999999, 2024-09-12T18:37:41.643 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:41.643 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:41.643 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:41.643 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:41.643 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:41.643 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:41.643 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 238493 2024-09-12T18:37:41.643 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.643 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:41.643 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.643 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:41.644 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624778+0000", 2024-09-12T18:37:41.644 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.644 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.644 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.644 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:41.644 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624778+0000", 2024-09-12T18:37:41.644 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:41.644 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.644 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.644 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:41.644 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624778+0000", 2024-09-12T18:37:41.644 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.32e-07 2024-09-12T18:37:41.645 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.645 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.645 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:41.645 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624780+0000", 2024-09-12T18:37:41.645 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0530000000000001e-06 2024-09-12T18:37:41.645 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.645 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.645 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:41.645 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624787+0000", 2024-09-12T18:37:41.645 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2790000000000004e-06 2024-09-12T18:37:41.645 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.645 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.646 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:41.646 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624792+0000", 2024-09-12T18:37:41.646 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9629999999999997e-06 2024-09-12T18:37:41.646 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.646 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.646 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:41.646 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624828+0000", 2024-09-12T18:37:41.646 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6177000000000003e-05 2024-09-12T18:37:41.646 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.646 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.646 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:41.646 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624905+0000", 2024-09-12T18:37:41.646 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7671999999999998e-05 2024-09-12T18:37:41.647 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.647 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.647 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:41.647 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624972+0000", 2024-09-12T18:37:41.647 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6977000000000006e-05 2024-09-12T18:37:41.647 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.647 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.647 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:41.647 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.629376+0000", 2024-09-12T18:37:41.647 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0044033229999999998 2024-09-12T18:37:41.647 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.647 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.647 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:41.648 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.672808+0000", 2024-09-12T18:37:41.648 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.043431889000000001 2024-09-12T18:37:41.648 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.648 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.648 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:41.648 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.672865+0000", 2024-09-12T18:37:41.648 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.753e-05 2024-09-12T18:37:41.648 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:41.648 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:41.648 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:41.648 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.672907+0000", 2024-09-12T18:37:41.648 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1927e-05 2024-09-12T18:37:41.648 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.649 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:41.649 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.649 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:41.649 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:41.649 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:41.650 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:37:41.651 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:41.642+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:41.751 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:41.746+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:41.806 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:41.806 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:37:41.806 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.806 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:245230 5.3 e76/21 5:ca2097f2:::benchmark_data_smithi073_23739_object112953:head v 76'15103, mlcod=76'15100)", 2024-09-12T18:37:41.806 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:41.796507+0000", 2024-09-12T18:37:41.806 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0070369969999999997, 2024-09-12T18:37:41.806 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0070540120000000001, 2024-09-12T18:37:41.806 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:41.807 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:41.807 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:37:41.807 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:41.807 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.807 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:41.807 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.796507+0000", 2024-09-12T18:37:41.807 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:41.807 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.807 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.807 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:41.807 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.796507+0000", 2024-09-12T18:37:41.807 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:41.807 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.808 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.808 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:41.808 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.796508+0000", 2024-09-12T18:37:41.808 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.8899999999999999e-07 2024-09-12T18:37:41.808 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.808 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.808 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:41.808 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.796517+0000", 2024-09-12T18:37:41.808 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.6479999999999992e-06 2024-09-12T18:37:41.808 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.808 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.808 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:41.808 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.796524+0000", 2024-09-12T18:37:41.809 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.1999999999999997e-06 2024-09-12T18:37:41.809 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.809 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.809 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:41.809 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.796528+0000", 2024-09-12T18:37:41.809 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.0899999999999998e-06 2024-09-12T18:37:41.809 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.809 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.809 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:41.809 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.796558+0000", 2024-09-12T18:37:41.809 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.9992999999999999e-05 2024-09-12T18:37:41.810 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.810 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.810 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:41.810 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.796575+0000", 2024-09-12T18:37:41.810 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7303999999999999e-05 2024-09-12T18:37:41.810 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:41.810 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:41.810 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:41.811 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.811 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.811 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:245231 5.d e76/21 5:bacaf20a:::benchmark_data_smithi073_23739_object112954:head v 76'15545, mlcod=76'15543)", 2024-09-12T18:37:41.811 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:41.796530+0000", 2024-09-12T18:37:41.811 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0070149119999999999, 2024-09-12T18:37:41.811 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0070649329999999998, 2024-09-12T18:37:41.811 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:41.812 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:41.812 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:37:41.812 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:41.812 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.812 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:41.813 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.796530+0000", 2024-09-12T18:37:41.813 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:41.813 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.813 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.813 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:41.813 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.796530+0000", 2024-09-12T18:37:41.814 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:41.814 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.814 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.814 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:41.814 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.796530+0000", 2024-09-12T18:37:41.814 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.54e-07 2024-09-12T18:37:41.814 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.815 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.815 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:41.815 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.796535+0000", 2024-09-12T18:37:41.815 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.3390000000000003e-06 2024-09-12T18:37:41.815 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.816 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.816 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:41.816 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.796541+0000", 2024-09-12T18:37:41.816 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9030000000000001e-06 2024-09-12T18:37:41.816 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.816 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.817 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:41.817 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.796546+0000", 2024-09-12T18:37:41.817 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.0239999999999997e-06 2024-09-12T18:37:41.817 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.817 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.818 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:41.818 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.796587+0000", 2024-09-12T18:37:41.818 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.1448e-05 2024-09-12T18:37:41.818 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.818 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.818 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:41.818 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.796604+0000", 2024-09-12T18:37:41.818 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.7221e-05 2024-09-12T18:37:41.818 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:41.818 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:41.819 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:41.819 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.819 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.819 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:245233 5.5 5:a761c550:::benchmark_data_smithi073_23739_object112956:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T18:37:41.819 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:41.796780+0000", 2024-09-12T18:37:41.819 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0067648810000000004, 2024-09-12T18:37:41.819 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0068552409999999998, 2024-09-12T18:37:41.819 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:41.819 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:41.819 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:41.819 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:41.819 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:41.819 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:41.820 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 245233 2024-09-12T18:37:41.820 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.820 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:41.820 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.820 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:41.820 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.796780+0000", 2024-09-12T18:37:41.820 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:41.820 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.820 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.820 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:41.820 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.796780+0000", 2024-09-12T18:37:41.820 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:41.820 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.821 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.821 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:41.821 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.796780+0000", 2024-09-12T18:37:41.821 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.5199999999999996e-07 2024-09-12T18:37:41.821 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.821 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.821 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:41.821 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.796784+0000", 2024-09-12T18:37:41.821 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.236e-06 2024-09-12T18:37:41.821 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.821 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.821 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:41.821 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.796791+0000", 2024-09-12T18:37:41.822 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8299999999999996e-06 2024-09-12T18:37:41.822 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.822 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.822 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:41.822 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.796796+0000", 2024-09-12T18:37:41.822 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4619999999999998e-06 2024-09-12T18:37:41.822 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.822 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.822 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:41.822 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.796838+0000", 2024-09-12T18:37:41.822 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.2502000000000001e-05 2024-09-12T18:37:41.822 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.822 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.823 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:41.823 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.796954+0000", 2024-09-12T18:37:41.823 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000115952 2024-09-12T18:37:41.823 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.823 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.823 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:41.823 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.797070+0000", 2024-09-12T18:37:41.823 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000115203 2024-09-12T18:37:41.823 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.823 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.823 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:41.823 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.799361+0000", 2024-09-12T18:37:41.823 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.002291548 2024-09-12T18:37:41.824 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:41.824 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:41.824 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:41.824 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.824 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.824 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:245237 5.0 e76/65 5:03dca22f:::benchmark_data_smithi073_23739_object112960:head v 76'15483, mlcod=76'15481)", 2024-09-12T18:37:41.824 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:41.799327+0000", 2024-09-12T18:37:41.824 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0042179419999999997, 2024-09-12T18:37:41.824 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0043781280000000002, 2024-09-12T18:37:41.824 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:41.825 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:41.825 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:37:41.825 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:41.825 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.825 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:41.825 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.799327+0000", 2024-09-12T18:37:41.825 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:41.825 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.825 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.825 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:41.825 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.799327+0000", 2024-09-12T18:37:41.825 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:41.825 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.826 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.826 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:41.826 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.799327+0000", 2024-09-12T18:37:41.826 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.2100000000000002e-07 2024-09-12T18:37:41.826 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.826 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.826 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:41.826 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.799331+0000", 2024-09-12T18:37:41.826 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4190000000000004e-06 2024-09-12T18:37:41.826 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.827 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.827 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:41.827 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.799338+0000", 2024-09-12T18:37:41.827 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.6980000000000001e-06 2024-09-12T18:37:41.827 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.827 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.827 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:41.827 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.799345+0000", 2024-09-12T18:37:41.827 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.6120000000000004e-06 2024-09-12T18:37:41.828 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.828 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.828 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:41.828 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.799402+0000", 2024-09-12T18:37:41.828 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.7179999999999998e-05 2024-09-12T18:37:41.828 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.828 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.828 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:41.828 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.799424+0000", 2024-09-12T18:37:41.828 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2294e-05 2024-09-12T18:37:41.828 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:41.828 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:41.828 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:41.829 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.829 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.829 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:245238 5.6 e76/21 5:6c5f9c67:::benchmark_data_smithi073_23739_object112961:head v 76'15337, mlcod=76'15335)", 2024-09-12T18:37:41.829 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:41.799757+0000", 2024-09-12T18:37:41.829 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0037877729999999999, 2024-09-12T18:37:41.829 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0040057360000000002, 2024-09-12T18:37:41.829 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:41.829 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:41.829 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:37:41.829 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:41.829 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.829 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:41.829 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.799757+0000", 2024-09-12T18:37:41.829 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:41.830 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.830 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.830 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:41.830 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.799757+0000", 2024-09-12T18:37:41.830 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:41.830 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.830 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.830 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:41.830 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.799757+0000", 2024-09-12T18:37:41.830 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0900000000000001e-07 2024-09-12T18:37:41.830 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.831 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.831 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:41.831 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.799762+0000", 2024-09-12T18:37:41.831 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.233e-06 2024-09-12T18:37:41.831 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.831 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.831 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:41.831 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.799770+0000", 2024-09-12T18:37:41.831 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1710000000000002e-06 2024-09-12T18:37:41.831 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.831 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.831 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:41.831 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.799775+0000", 2024-09-12T18:37:41.831 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6929999999999998e-06 2024-09-12T18:37:41.832 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.832 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.832 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:41.832 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.799809+0000", 2024-09-12T18:37:41.832 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.4591999999999997e-05 2024-09-12T18:37:41.832 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.832 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.832 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:41.832 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.799821+0000", 2024-09-12T18:37:41.832 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1386000000000001e-05 2024-09-12T18:37:41.832 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:41.832 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:41.832 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:41.833 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.833 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.833 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:245235 5.3 e76/21 5:c66cbb37:::benchmark_data_smithi073_23739_object112958:head v 76'15104, mlcod=76'15100)", 2024-09-12T18:37:41.833 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:41.799796+0000", 2024-09-12T18:37:41.833 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0037480259999999998, 2024-09-12T18:37:41.833 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.004008111, 2024-09-12T18:37:41.833 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:41.833 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:41.833 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:37:41.833 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:41.833 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.833 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:41.834 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.799796+0000", 2024-09-12T18:37:41.834 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:41.834 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.834 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.834 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:41.834 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.799796+0000", 2024-09-12T18:37:41.834 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:41.834 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.834 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.834 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:41.834 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.799797+0000", 2024-09-12T18:37:41.834 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.7899999999999999e-07 2024-09-12T18:37:41.834 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.834 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.835 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:41.835 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.799801+0000", 2024-09-12T18:37:41.835 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.9419999999999997e-06 2024-09-12T18:37:41.835 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.835 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.835 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:41.835 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.799807+0000", 2024-09-12T18:37:41.835 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.545e-06 2024-09-12T18:37:41.835 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.835 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.835 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:41.835 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.799812+0000", 2024-09-12T18:37:41.835 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4179999999999999e-06 2024-09-12T18:37:41.836 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.836 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.836 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:41.836 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.799851+0000", 2024-09-12T18:37:41.836 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.9625000000000001e-05 2024-09-12T18:37:41.836 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.836 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.836 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:41.836 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.799863+0000", 2024-09-12T18:37:41.837 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1625e-05 2024-09-12T18:37:41.837 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:41.837 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:41.837 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:41.837 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.837 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.837 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:245242 5.7 5:e6618e45:::benchmark_data_smithi073_23739_object112965:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T18:37:41.837 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:41.802077+0000", 2024-09-12T18:37:41.838 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.001467482, 2024-09-12T18:37:41.838 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001779426, 2024-09-12T18:37:41.838 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:41.838 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:41.838 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:41.838 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:41.838 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:41.838 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:41.838 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 245242 2024-09-12T18:37:41.838 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.839 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:41.839 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.839 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:41.839 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.802077+0000", 2024-09-12T18:37:41.839 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:41.839 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.839 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.839 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:41.839 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.802077+0000", 2024-09-12T18:37:41.839 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:41.839 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.839 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.839 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:41.840 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.802078+0000", 2024-09-12T18:37:41.840 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1930000000000001e-06 2024-09-12T18:37:41.840 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.840 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.840 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:41.840 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.802082+0000", 2024-09-12T18:37:41.840 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.2699999999999998e-06 2024-09-12T18:37:41.840 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.840 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.840 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:41.840 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.802090+0000", 2024-09-12T18:37:41.840 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.96e-06 2024-09-12T18:37:41.840 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.841 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.841 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:41.841 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.802097+0000", 2024-09-12T18:37:41.841 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.3810000000000004e-06 2024-09-12T18:37:41.841 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.841 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.841 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:41.841 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.802140+0000", 2024-09-12T18:37:41.841 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.3582999999999999e-05 2024-09-12T18:37:41.841 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.841 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.841 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:41.841 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.802252+0000", 2024-09-12T18:37:41.841 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000111665 2024-09-12T18:37:41.842 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.842 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.842 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:41.842 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.802326+0000", 2024-09-12T18:37:41.842 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.3706000000000002e-05 2024-09-12T18:37:41.842 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:41.842 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:41.842 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:41.842 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.842 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.842 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:245241 5.d e76/21 5:b2cc5f5e:::benchmark_data_smithi073_23739_object112964:head v 76'15546, mlcod=76'15543)", 2024-09-12T18:37:41.842 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:41.802196+0000", 2024-09-12T18:37:41.842 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.001348719, 2024-09-12T18:37:41.843 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0016993069999999999, 2024-09-12T18:37:41.843 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:41.843 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:41.843 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:37:41.843 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:41.843 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.843 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:41.843 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.802196+0000", 2024-09-12T18:37:41.843 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:41.843 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.843 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.843 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:41.843 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.802196+0000", 2024-09-12T18:37:41.844 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:41.844 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.844 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.844 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:41.844 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.802197+0000", 2024-09-12T18:37:41.844 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.9899999999999999e-07 2024-09-12T18:37:41.844 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.844 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.844 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:41.844 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.802202+0000", 2024-09-12T18:37:41.844 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9100000000000002e-06 2024-09-12T18:37:41.844 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.845 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.845 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:41.845 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.802211+0000", 2024-09-12T18:37:41.845 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.9560000000000003e-06 2024-09-12T18:37:41.845 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.845 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.845 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:41.845 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.802218+0000", 2024-09-12T18:37:41.845 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.6150000000000002e-06 2024-09-12T18:37:41.845 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.845 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.846 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:41.846 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.802266+0000", 2024-09-12T18:37:41.846 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.7985999999999998e-05 2024-09-12T18:37:41.846 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.846 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.846 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:41.846 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.802283+0000", 2024-09-12T18:37:41.846 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6718000000000002e-05 2024-09-12T18:37:41.846 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:41.846 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:41.846 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:41.846 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.846 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.847 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:245236 5.3 e76/21 5:ce031d83:::benchmark_data_smithi073_23739_object112959:head v 76'15105, mlcod=76'15100)", 2024-09-12T18:37:41.847 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:41.802501+0000", 2024-09-12T18:37:41.847 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0010435640000000001, 2024-09-12T18:37:41.847 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001447472, 2024-09-12T18:37:41.847 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:41.847 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:41.847 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:37:41.847 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:41.847 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.847 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:41.848 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.802501+0000", 2024-09-12T18:37:41.848 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:41.848 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.848 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.848 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:41.848 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.802501+0000", 2024-09-12T18:37:41.848 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:41.848 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.848 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.848 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:41.848 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.802502+0000", 2024-09-12T18:37:41.848 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1500000000000003e-07 2024-09-12T18:37:41.848 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.849 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.849 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:41.849 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.802506+0000", 2024-09-12T18:37:41.849 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.702e-06 2024-09-12T18:37:41.849 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.849 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.849 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:41.849 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.802517+0000", 2024-09-12T18:37:41.849 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0445000000000001e-05 2024-09-12T18:37:41.849 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.849 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.849 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:41.849 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.802524+0000", 2024-09-12T18:37:41.850 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.7499999999999997e-06 2024-09-12T18:37:41.850 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.850 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.850 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:41.850 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.802574+0000", 2024-09-12T18:37:41.850 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.0742999999999999e-05 2024-09-12T18:37:41.850 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:41.850 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:41.850 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:41.850 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:41.802602+0000", 2024-09-12T18:37:41.850 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.7744000000000001e-05 2024-09-12T18:37:41.851 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:41.851 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:41.851 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:41.851 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:41.851 INFO:teuthology.orchestra.run.smithi162.stdout: ], 2024-09-12T18:37:41.851 INFO:teuthology.orchestra.run.smithi162.stdout: "num_ops": 9 2024-09-12T18:37:41.851 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:41.852 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:37:41.853 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:41.846+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:41.953 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:41.946+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:42.050 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:42.051 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [], 2024-09-12T18:37:42.051 INFO:teuthology.orchestra.run.smithi162.stdout: "complaint_time": 30, 2024-09-12T18:37:42.051 INFO:teuthology.orchestra.run.smithi162.stdout: "num_blocked_ops": 0 2024-09-12T18:37:42.051 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:42.054 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:42.051+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:42.072 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:37:42.155 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:42.150+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:42.225 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:42.226 INFO:teuthology.orchestra.run.smithi162.stdout: "size": 20, 2024-09-12T18:37:42.226 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 600, 2024-09-12T18:37:42.226 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:37:42.226 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.226 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167364 5.7 5:ee50096a:::benchmark_data_smithi073_23739_object35087:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:42.226 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.168715+0000", 2024-09-12T18:37:42.226 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 39.053207594, 2024-09-12T18:37:42.226 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.068831153000000006, 2024-09-12T18:37:42.226 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:42.226 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:42.226 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:42.226 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:42.226 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:42.227 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:42.227 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167364 2024-09-12T18:37:42.227 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.227 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:42.227 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.227 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:42.227 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168715+0000", 2024-09-12T18:37:42.227 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:42.227 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.227 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.227 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:42.228 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168715+0000", 2024-09-12T18:37:42.228 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:42.228 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.228 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.228 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:42.228 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168716+0000", 2024-09-12T18:37:42.228 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0559999999999999e-06 2024-09-12T18:37:42.228 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.228 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.228 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:42.228 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168721+0000", 2024-09-12T18:37:42.228 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8019999999999999e-06 2024-09-12T18:37:42.229 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.229 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.229 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:42.229 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168731+0000", 2024-09-12T18:37:42.229 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0315e-05 2024-09-12T18:37:42.229 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.229 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.230 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:42.230 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168738+0000", 2024-09-12T18:37:42.230 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.126e-06 2024-09-12T18:37:42.230 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.230 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.230 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:42.230 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168782+0000", 2024-09-12T18:37:42.230 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.3924000000000002e-05 2024-09-12T18:37:42.230 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.230 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.230 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:42.231 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168913+0000", 2024-09-12T18:37:42.231 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000131154 2024-09-12T18:37:42.231 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.231 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.231 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:42.231 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169026+0000", 2024-09-12T18:37:42.231 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011223299999999999 2024-09-12T18:37:42.231 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.231 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.232 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:42.232 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.175404+0000", 2024-09-12T18:37:42.232 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0063780319999999996 2024-09-12T18:37:42.232 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.232 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.232 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:42.232 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237446+0000", 2024-09-12T18:37:42.232 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.062042238 2024-09-12T18:37:42.233 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.233 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.233 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:42.233 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237501+0000", 2024-09-12T18:37:42.233 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4913000000000001e-05 2024-09-12T18:37:42.233 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.233 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.233 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:42.233 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237546+0000", 2024-09-12T18:37:42.234 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.5359999999999999e-05 2024-09-12T18:37:42.234 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:42.234 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:42.234 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:42.234 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.234 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.234 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167365 5.2 5:4107875c:::benchmark_data_smithi073_23739_object35088:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:42.234 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:42.234 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 39.053158019999998, 2024-09-12T18:37:42.235 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.078544438999999994, 2024-09-12T18:37:42.235 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:42.235 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:42.235 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:42.235 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:42.235 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:42.235 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:42.235 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167365 2024-09-12T18:37:42.236 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.236 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:42.236 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.236 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:42.236 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:42.236 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:42.236 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.236 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.237 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:42.237 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:42.237 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:42.237 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.237 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.237 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:42.237 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:42.237 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.4700000000000001e-07 2024-09-12T18:37:42.237 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.238 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.238 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:42.238 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168769+0000", 2024-09-12T18:37:42.238 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.4170000000000001e-06 2024-09-12T18:37:42.238 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.238 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.238 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:42.238 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168777+0000", 2024-09-12T18:37:42.238 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1499999999999999e-06 2024-09-12T18:37:42.239 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.239 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.239 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:42.239 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168783+0000", 2024-09-12T18:37:42.239 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.0460000000000002e-06 2024-09-12T18:37:42.239 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.239 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.240 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:42.240 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168865+0000", 2024-09-12T18:37:42.240 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1953999999999995e-05 2024-09-12T18:37:42.240 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.240 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.240 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:42.240 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169003+0000", 2024-09-12T18:37:42.240 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013798200000000001 2024-09-12T18:37:42.240 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.241 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.241 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:42.241 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169065+0000", 2024-09-12T18:37:42.241 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2218000000000006e-05 2024-09-12T18:37:42.241 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.241 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.241 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:42.241 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174771+0000", 2024-09-12T18:37:42.241 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0057054819999999996 2024-09-12T18:37:42.242 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.242 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.242 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:42.242 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.247234+0000", 2024-09-12T18:37:42.242 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.072463391000000002 2024-09-12T18:37:42.242 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.242 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.242 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:42.243 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.247273+0000", 2024-09-12T18:37:42.243 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.9069000000000002e-05 2024-09-12T18:37:42.243 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.243 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.243 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:42.243 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.247309+0000", 2024-09-12T18:37:42.243 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5982999999999998e-05 2024-09-12T18:37:42.243 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:42.243 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:42.244 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:42.244 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.244 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.244 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167369 5.7 5:e64ecabd:::benchmark_data_smithi073_23739_object35092:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:42.244 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.169042+0000", 2024-09-12T18:37:42.244 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 39.052880909000002, 2024-09-12T18:37:42.244 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.069229188999999997, 2024-09-12T18:37:42.244 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:42.244 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:42.244 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:42.245 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:42.245 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:42.245 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:42.245 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167369 2024-09-12T18:37:42.245 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.245 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:42.245 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.245 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:42.245 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169042+0000", 2024-09-12T18:37:42.246 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:42.246 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.246 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.246 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:42.246 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169042+0000", 2024-09-12T18:37:42.246 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:42.246 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.246 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.246 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:42.246 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169043+0000", 2024-09-12T18:37:42.246 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.9400000000000004e-07 2024-09-12T18:37:42.247 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.247 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.247 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:42.247 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169048+0000", 2024-09-12T18:37:42.247 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8420000000000004e-06 2024-09-12T18:37:42.247 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.247 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.247 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:42.247 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169055+0000", 2024-09-12T18:37:42.248 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.7989999999999994e-06 2024-09-12T18:37:42.248 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.248 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.248 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:42.248 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169062+0000", 2024-09-12T18:37:42.248 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.5950000000000004e-06 2024-09-12T18:37:42.248 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.248 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.248 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:42.248 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173858+0000", 2024-09-12T18:37:42.249 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0047959259999999998 2024-09-12T18:37:42.249 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.249 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.249 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:42.249 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173966+0000", 2024-09-12T18:37:42.249 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000107941 2024-09-12T18:37:42.249 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.249 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.249 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:42.249 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174043+0000", 2024-09-12T18:37:42.250 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.7360000000000005e-05 2024-09-12T18:37:42.250 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.250 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.250 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:42.250 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.175711+0000", 2024-09-12T18:37:42.250 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0016680810000000001 2024-09-12T18:37:42.250 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.250 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.250 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:42.251 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.238163+0000", 2024-09-12T18:37:42.251 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.062451523000000002 2024-09-12T18:37:42.251 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.251 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.251 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:42.251 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.238222+0000", 2024-09-12T18:37:42.251 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9723999999999999e-05 2024-09-12T18:37:42.251 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.251 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.251 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:42.251 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.238271+0000", 2024-09-12T18:37:42.251 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8504000000000002e-05 2024-09-12T18:37:42.251 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:42.251 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:42.252 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:42.252 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.252 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.252 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167373 5.5 5:ad283029:::benchmark_data_smithi073_23739_object35096:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:42.252 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:42.252 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 39.050376077999999, 2024-09-12T18:37:42.252 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.066200976999999994, 2024-09-12T18:37:42.252 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:42.252 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:42.253 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:42.253 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:42.253 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:42.253 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:42.253 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167373 2024-09-12T18:37:42.253 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.253 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:42.254 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.254 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:42.254 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:42.254 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:42.254 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.254 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.254 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:42.255 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:42.255 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:42.255 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.255 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.255 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:42.255 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:42.255 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4900000000000005e-07 2024-09-12T18:37:42.255 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.255 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.255 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:42.255 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171551+0000", 2024-09-12T18:37:42.255 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.7519999999999998e-06 2024-09-12T18:37:42.255 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.255 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.256 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:42.256 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171562+0000", 2024-09-12T18:37:42.256 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0353000000000001e-05 2024-09-12T18:37:42.256 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.256 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.256 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:42.256 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171566+0000", 2024-09-12T18:37:42.256 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8269999999999997e-06 2024-09-12T18:37:42.256 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.256 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.256 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:42.256 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171622+0000", 2024-09-12T18:37:42.257 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5220999999999999e-05 2024-09-12T18:37:42.257 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.257 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.257 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:42.257 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171719+0000", 2024-09-12T18:37:42.257 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7238999999999995e-05 2024-09-12T18:37:42.257 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.257 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.257 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:42.257 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171802+0000", 2024-09-12T18:37:42.257 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.3285e-05 2024-09-12T18:37:42.258 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.258 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.258 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:42.258 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174608+0000", 2024-09-12T18:37:42.258 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028054590000000002 2024-09-12T18:37:42.258 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.258 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.258 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:42.258 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174762+0000", 2024-09-12T18:37:42.258 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015465100000000001 2024-09-12T18:37:42.258 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.258 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.259 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:42.259 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237474+0000", 2024-09-12T18:37:42.259 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.062711683000000004 2024-09-12T18:37:42.259 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.259 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.259 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:42.259 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237540+0000", 2024-09-12T18:37:42.259 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.6132999999999999e-05 2024-09-12T18:37:42.259 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.259 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.259 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:42.260 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237748+0000", 2024-09-12T18:37:42.260 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020752499999999999 2024-09-12T18:37:42.260 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:42.260 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:42.260 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:42.260 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.260 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.260 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167374 5.1 5:81e25826:::benchmark_data_smithi073_23739_object35097:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:42.260 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.173748+0000", 2024-09-12T18:37:42.260 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 39.048174629999998, 2024-09-12T18:37:42.260 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.069225245000000005, 2024-09-12T18:37:42.261 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:42.261 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:42.261 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:42.261 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:42.261 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:42.261 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:42.261 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167374 2024-09-12T18:37:42.261 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.261 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:42.261 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.261 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:42.261 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173748+0000", 2024-09-12T18:37:42.261 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:42.262 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.262 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.262 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:42.262 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173748+0000", 2024-09-12T18:37:42.262 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:42.262 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.262 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.262 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:42.262 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173749+0000", 2024-09-12T18:37:42.262 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.418e-06 2024-09-12T18:37:42.262 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.262 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.262 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:42.262 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173755+0000", 2024-09-12T18:37:42.263 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.0730000000000004e-06 2024-09-12T18:37:42.263 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.263 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.263 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:42.263 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173768+0000", 2024-09-12T18:37:42.263 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3644e-05 2024-09-12T18:37:42.263 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.263 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.263 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:42.263 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173777+0000", 2024-09-12T18:37:42.263 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4160000000000004e-06 2024-09-12T18:37:42.263 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.264 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.264 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:42.264 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173927+0000", 2024-09-12T18:37:42.264 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015065900000000001 2024-09-12T18:37:42.264 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.264 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.265 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:42.265 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174052+0000", 2024-09-12T18:37:42.265 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012460699999999999 2024-09-12T18:37:42.265 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.265 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.265 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:42.265 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174181+0000", 2024-09-12T18:37:42.266 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012919299999999999 2024-09-12T18:37:42.266 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.266 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.266 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:42.266 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.178108+0000", 2024-09-12T18:37:42.266 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0039273210000000001 2024-09-12T18:37:42.266 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.267 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.267 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:42.267 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.178118+0000", 2024-09-12T18:37:42.267 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7550000000000006e-06 2024-09-12T18:37:42.267 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.267 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.267 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:42.267 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.242865+0000", 2024-09-12T18:37:42.267 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.064746597000000003 2024-09-12T18:37:42.268 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.268 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.268 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:42.268 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.242903+0000", 2024-09-12T18:37:42.268 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.8268e-05 2024-09-12T18:37:42.268 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.268 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.268 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:42.268 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.242973+0000", 2024-09-12T18:37:42.268 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0294000000000002e-05 2024-09-12T18:37:42.268 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:42.269 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:42.269 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:42.269 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.269 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.269 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167375 5.1 5:83a09102:::benchmark_data_smithi073_23739_object35098:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:42.269 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:42.269 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 39.048123083, 2024-09-12T18:37:42.269 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.069437463000000005, 2024-09-12T18:37:42.270 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:42.270 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:42.270 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:42.270 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:42.270 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:42.270 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:42.270 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167375 2024-09-12T18:37:42.270 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.270 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:42.270 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.270 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:42.270 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:42.270 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:42.271 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.271 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.271 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:42.271 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:42.271 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:42.271 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.271 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.271 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:42.271 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:42.271 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1399999999999997e-07 2024-09-12T18:37:42.272 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.272 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.272 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:42.272 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173803+0000", 2024-09-12T18:37:42.272 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.7860000000000001e-06 2024-09-12T18:37:42.272 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.272 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.272 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:42.272 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173811+0000", 2024-09-12T18:37:42.272 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4610000000000008e-06 2024-09-12T18:37:42.272 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.272 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.272 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:42.273 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173817+0000", 2024-09-12T18:37:42.273 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3569999999999997e-06 2024-09-12T18:37:42.273 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.273 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.273 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:42.273 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.176070+0000", 2024-09-12T18:37:42.273 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.002253405 2024-09-12T18:37:42.274 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.274 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.274 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:42.274 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.176263+0000", 2024-09-12T18:37:42.274 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000192583 2024-09-12T18:37:42.274 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.274 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.274 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:42.274 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.176429+0000", 2024-09-12T18:37:42.274 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00016626 2024-09-12T18:37:42.274 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.274 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.274 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:42.275 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.178154+0000", 2024-09-12T18:37:42.275 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0017247009999999999 2024-09-12T18:37:42.275 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.275 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.275 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:42.275 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.182110+0000", 2024-09-12T18:37:42.275 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0039568229999999999 2024-09-12T18:37:42.275 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.275 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.275 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:42.275 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.243024+0000", 2024-09-12T18:37:42.275 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.060913249000000003 2024-09-12T18:37:42.275 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.275 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.276 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:42.276 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.243107+0000", 2024-09-12T18:37:42.276 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.3090000000000006e-05 2024-09-12T18:37:42.276 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.276 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.276 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:42.276 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.243237+0000", 2024-09-12T18:37:42.276 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013023399999999999 2024-09-12T18:37:42.276 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:42.276 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:42.276 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:42.276 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.276 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.277 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201515 5.5 5:a25bd8bb:::benchmark_data_smithi073_23739_object69238:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:42.277 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.437024+0000", 2024-09-12T18:37:42.277 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 21.784898851000001, 2024-09-12T18:37:42.277 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.040476102, 2024-09-12T18:37:42.277 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:42.277 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:42.277 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:42.277 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:42.277 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:42.278 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:42.278 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201515 2024-09-12T18:37:42.278 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.278 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:42.278 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.278 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:42.278 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437024+0000", 2024-09-12T18:37:42.278 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:42.279 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.279 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.279 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:42.279 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437024+0000", 2024-09-12T18:37:42.279 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:42.279 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.279 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.279 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:42.280 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437025+0000", 2024-09-12T18:37:42.280 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2240000000000001e-06 2024-09-12T18:37:42.280 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.280 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.280 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:42.280 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437030+0000", 2024-09-12T18:37:42.280 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.7049999999999998e-06 2024-09-12T18:37:42.280 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.280 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.281 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:42.281 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437040+0000", 2024-09-12T18:37:42.281 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0351e-05 2024-09-12T18:37:42.281 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.281 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.281 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:42.281 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437049+0000", 2024-09-12T18:37:42.281 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5750000000000001e-06 2024-09-12T18:37:42.282 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.282 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.282 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:42.282 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437574+0000", 2024-09-12T18:37:42.282 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00052566400000000001 2024-09-12T18:37:42.282 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.282 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.282 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:42.282 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437673+0000", 2024-09-12T18:37:42.283 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.8672000000000007e-05 2024-09-12T18:37:42.283 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.283 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.283 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:42.283 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437755+0000", 2024-09-12T18:37:42.283 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1705000000000005e-05 2024-09-12T18:37:42.283 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.283 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.283 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:42.284 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.439556+0000", 2024-09-12T18:37:42.284 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0018009020000000001 2024-09-12T18:37:42.284 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.284 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.284 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:42.284 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.439955+0000", 2024-09-12T18:37:42.284 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00039966900000000001 2024-09-12T18:37:42.285 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.285 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.285 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:42.285 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.477267+0000", 2024-09-12T18:37:42.285 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.037311614 2024-09-12T18:37:42.285 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.285 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.285 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:42.286 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.477368+0000", 2024-09-12T18:37:42.286 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000101495 2024-09-12T18:37:42.286 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.286 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.286 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:42.286 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.477500+0000", 2024-09-12T18:37:42.286 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000131526 2024-09-12T18:37:42.286 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:42.286 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:42.287 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:42.287 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.287 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.287 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201566 5.9 5:9ea8bdd3:::benchmark_data_smithi073_23739_object69289:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:42.287 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.487311+0000", 2024-09-12T18:37:42.287 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 21.734611304000001, 2024-09-12T18:37:42.287 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.044734547, 2024-09-12T18:37:42.287 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:42.287 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:42.288 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:42.288 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:42.288 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:42.288 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:42.288 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201566 2024-09-12T18:37:42.288 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.288 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:42.288 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.289 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:42.289 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487311+0000", 2024-09-12T18:37:42.289 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:42.289 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.289 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.289 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:42.289 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487311+0000", 2024-09-12T18:37:42.289 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:42.289 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.290 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.290 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:42.290 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487313+0000", 2024-09-12T18:37:42.290 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3060000000000001e-06 2024-09-12T18:37:42.290 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.290 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.290 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:42.290 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487318+0000", 2024-09-12T18:37:42.290 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.181e-06 2024-09-12T18:37:42.290 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.291 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.291 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:42.291 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487333+0000", 2024-09-12T18:37:42.291 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5012e-05 2024-09-12T18:37:42.291 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.291 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.291 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:42.291 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487344+0000", 2024-09-12T18:37:42.291 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0733999999999999e-05 2024-09-12T18:37:42.291 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.291 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.291 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:42.291 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487403+0000", 2024-09-12T18:37:42.292 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9858999999999997e-05 2024-09-12T18:37:42.292 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.292 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.292 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:42.292 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487600+0000", 2024-09-12T18:37:42.292 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019617899999999999 2024-09-12T18:37:42.292 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.292 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.292 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:42.292 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487769+0000", 2024-09-12T18:37:42.292 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00016919299999999999 2024-09-12T18:37:42.292 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.293 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.293 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:42.293 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492984+0000", 2024-09-12T18:37:42.293 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0052155309999999998 2024-09-12T18:37:42.293 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.293 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.293 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:42.293 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531791+0000", 2024-09-12T18:37:42.293 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.038806861999999998 2024-09-12T18:37:42.293 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.293 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.293 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:42.293 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531946+0000", 2024-09-12T18:37:42.293 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015445300000000001 2024-09-12T18:37:42.294 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.294 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.294 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:42.294 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532046+0000", 2024-09-12T18:37:42.294 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000100237 2024-09-12T18:37:42.294 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:42.294 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:42.294 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:42.294 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.294 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.294 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201569 5.9 5:9719244e:::benchmark_data_smithi073_23739_object69292:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:42.294 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.487551+0000", 2024-09-12T18:37:42.294 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 21.734371943999999, 2024-09-12T18:37:42.294 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.045212927, 2024-09-12T18:37:42.295 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:42.295 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:42.295 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:42.295 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:42.295 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:42.295 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:42.295 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201569 2024-09-12T18:37:42.295 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.295 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:42.295 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.295 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:42.295 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487551+0000", 2024-09-12T18:37:42.295 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:42.295 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.296 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.296 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:42.296 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487551+0000", 2024-09-12T18:37:42.296 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:42.296 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.296 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.296 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:42.297 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487552+0000", 2024-09-12T18:37:42.297 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6160000000000001e-06 2024-09-12T18:37:42.297 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.297 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.297 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:42.297 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487566+0000", 2024-09-12T18:37:42.297 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.344e-05 2024-09-12T18:37:42.297 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.297 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.297 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:42.298 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487581+0000", 2024-09-12T18:37:42.298 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5526e-05 2024-09-12T18:37:42.298 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.298 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.298 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:42.298 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487593+0000", 2024-09-12T18:37:42.298 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1443e-05 2024-09-12T18:37:42.298 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.298 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.298 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:42.298 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.489599+0000", 2024-09-12T18:37:42.298 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0020058960000000001 2024-09-12T18:37:42.298 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.298 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.298 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:42.299 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.489710+0000", 2024-09-12T18:37:42.299 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000111634 2024-09-12T18:37:42.299 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.299 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.299 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:42.299 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.489796+0000", 2024-09-12T18:37:42.299 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5235999999999995e-05 2024-09-12T18:37:42.299 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.299 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.299 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:42.299 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532140+0000", 2024-09-12T18:37:42.299 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.042344524000000001 2024-09-12T18:37:42.299 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.299 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.300 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:42.300 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532559+0000", 2024-09-12T18:37:42.300 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00041908800000000002 2024-09-12T18:37:42.300 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.300 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.300 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:42.300 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532676+0000", 2024-09-12T18:37:42.300 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011649100000000001 2024-09-12T18:37:42.300 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.300 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.300 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:42.301 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532764+0000", 2024-09-12T18:37:42.301 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8033000000000002e-05 2024-09-12T18:37:42.301 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:42.301 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:42.301 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:42.301 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.301 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.301 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201570 5.5 5:a97bff67:::benchmark_data_smithi073_23739_object69293:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:42.301 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.487618+0000", 2024-09-12T18:37:42.301 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 21.734304358999999, 2024-09-12T18:37:42.301 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.049152553000000002, 2024-09-12T18:37:42.301 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:42.301 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:42.301 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:42.302 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:42.302 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:42.302 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:42.302 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201570 2024-09-12T18:37:42.302 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.302 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:42.302 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.302 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:42.302 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487618+0000", 2024-09-12T18:37:42.302 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:42.302 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.302 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.302 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:42.303 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487618+0000", 2024-09-12T18:37:42.303 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:42.303 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.303 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.303 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:42.303 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487619+0000", 2024-09-12T18:37:42.303 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.6099999999999999e-07 2024-09-12T18:37:42.303 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.303 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.303 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:42.303 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487623+0000", 2024-09-12T18:37:42.303 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.0940000000000001e-06 2024-09-12T18:37:42.303 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.304 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.304 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:42.304 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487635+0000", 2024-09-12T18:37:42.304 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1348e-05 2024-09-12T18:37:42.304 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.304 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.304 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:42.304 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487657+0000", 2024-09-12T18:37:42.304 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2246999999999999e-05 2024-09-12T18:37:42.304 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.304 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.304 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:42.304 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490684+0000", 2024-09-12T18:37:42.305 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0030268339999999999 2024-09-12T18:37:42.305 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.305 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.305 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:42.305 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490797+0000", 2024-09-12T18:37:42.305 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011372200000000001 2024-09-12T18:37:42.305 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.305 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.305 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:42.305 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490909+0000", 2024-09-12T18:37:42.305 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000111239 2024-09-12T18:37:42.305 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.305 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.306 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:42.306 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534345+0000", 2024-09-12T18:37:42.306 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.043436648000000001 2024-09-12T18:37:42.306 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.306 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.306 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:42.306 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534711+0000", 2024-09-12T18:37:42.306 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00036576399999999998 2024-09-12T18:37:42.306 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.306 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.306 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:42.307 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536225+0000", 2024-09-12T18:37:42.307 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001513983 2024-09-12T18:37:42.307 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.307 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.307 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:42.307 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536331+0000", 2024-09-12T18:37:42.307 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010603300000000001 2024-09-12T18:37:42.307 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.308 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.308 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:42.308 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536771+0000", 2024-09-12T18:37:42.308 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00043978000000000002 2024-09-12T18:37:42.308 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:42.308 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:42.308 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:42.308 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.308 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.309 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:201572 5.3 e67/21 5:caf692c5:::benchmark_data_smithi073_23739_object69295:head v 67'12362, mlcod=67'12360)", 2024-09-12T18:37:42.309 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.490255+0000", 2024-09-12T18:37:42.309 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 21.731667859000002, 2024-09-12T18:37:42.309 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.044189501999999999, 2024-09-12T18:37:42.309 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:42.309 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:42.309 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:42.309 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:42.309 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.309 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:42.309 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490255+0000", 2024-09-12T18:37:42.310 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:42.310 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.310 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.310 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:42.310 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490255+0000", 2024-09-12T18:37:42.310 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:42.311 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.311 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.311 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:42.311 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490256+0000", 2024-09-12T18:37:42.311 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0500000000000003e-07 2024-09-12T18:37:42.311 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.311 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.311 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:42.312 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490260+0000", 2024-09-12T18:37:42.312 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8269999999999997e-06 2024-09-12T18:37:42.312 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.312 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.312 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:42.312 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490269+0000", 2024-09-12T18:37:42.312 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.6549999999999993e-06 2024-09-12T18:37:42.312 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.312 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.312 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:42.312 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490275+0000", 2024-09-12T18:37:42.313 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.46e-06 2024-09-12T18:37:42.313 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.313 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.313 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:42.313 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490328+0000", 2024-09-12T18:37:42.313 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2101999999999997e-05 2024-09-12T18:37:42.313 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.313 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.313 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:42.313 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490347+0000", 2024-09-12T18:37:42.313 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9457999999999999e-05 2024-09-12T18:37:42.313 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.314 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.314 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:42.314 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534382+0000", 2024-09-12T18:37:42.314 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.044034968000000001 2024-09-12T18:37:42.314 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.314 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.314 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:42.314 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534444+0000", 2024-09-12T18:37:42.314 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2327000000000001e-05 2024-09-12T18:37:42.314 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:42.314 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:42.315 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:42.315 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.315 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.315 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201574 5.5 5:a963f378:::benchmark_data_smithi073_23739_object69297:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:42.315 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.490449+0000", 2024-09-12T18:37:42.315 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 21.731473884, 2024-09-12T18:37:42.315 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.046749974, 2024-09-12T18:37:42.315 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:42.315 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:42.315 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:42.315 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:42.315 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:42.315 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:42.315 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201574 2024-09-12T18:37:42.315 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.315 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:42.316 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.316 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:42.316 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490449+0000", 2024-09-12T18:37:42.316 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:42.316 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.316 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.316 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:42.316 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490449+0000", 2024-09-12T18:37:42.316 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:42.316 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.316 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.316 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:42.316 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490450+0000", 2024-09-12T18:37:42.316 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.17e-06 2024-09-12T18:37:42.317 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.317 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.317 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:42.317 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490455+0000", 2024-09-12T18:37:42.317 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.7319999999999998e-06 2024-09-12T18:37:42.317 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.317 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.317 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:42.317 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490464+0000", 2024-09-12T18:37:42.318 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.4760000000000004e-06 2024-09-12T18:37:42.318 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.318 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.318 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:42.318 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490471+0000", 2024-09-12T18:37:42.318 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.5400000000000001e-06 2024-09-12T18:37:42.318 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.318 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.318 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:42.318 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492695+0000", 2024-09-12T18:37:42.318 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0022245910000000002 2024-09-12T18:37:42.318 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.319 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.319 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:42.319 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492847+0000", 2024-09-12T18:37:42.319 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015127399999999999 2024-09-12T18:37:42.319 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.319 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.319 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:42.319 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492936+0000", 2024-09-12T18:37:42.319 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8953e-05 2024-09-12T18:37:42.319 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.319 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.319 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:42.319 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534614+0000", 2024-09-12T18:37:42.319 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.041678422999999999 2024-09-12T18:37:42.320 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.320 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.320 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:42.320 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534755+0000", 2024-09-12T18:37:42.320 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000140696 2024-09-12T18:37:42.320 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.320 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.320 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:42.320 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536891+0000", 2024-09-12T18:37:42.320 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0021365799999999999 2024-09-12T18:37:42.320 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.320 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.320 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:42.321 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537001+0000", 2024-09-12T18:37:42.321 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000109459 2024-09-12T18:37:42.321 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.321 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.321 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:42.321 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537199+0000", 2024-09-12T18:37:42.321 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019808 2024-09-12T18:37:42.321 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:42.321 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:42.321 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:42.321 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.321 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.321 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201576 5.2 5:42a132e0:::benchmark_data_smithi073_23739_object69299:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:42.322 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.490661+0000", 2024-09-12T18:37:42.322 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 21.731261837000002, 2024-09-12T18:37:42.322 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.041905530000000003, 2024-09-12T18:37:42.322 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:42.322 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:42.322 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:42.322 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:42.322 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:42.322 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:42.322 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201576 2024-09-12T18:37:42.322 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.322 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:42.322 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.323 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:42.323 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490661+0000", 2024-09-12T18:37:42.323 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:42.323 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.323 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.323 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:42.323 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490661+0000", 2024-09-12T18:37:42.323 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:42.323 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.323 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.324 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:42.324 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490662+0000", 2024-09-12T18:37:42.324 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5030000000000001e-06 2024-09-12T18:37:42.324 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.324 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.324 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:42.324 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490667+0000", 2024-09-12T18:37:42.324 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4479999999999996e-06 2024-09-12T18:37:42.324 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.324 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.324 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:42.324 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490675+0000", 2024-09-12T18:37:42.324 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8529999999999992e-06 2024-09-12T18:37:42.325 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.325 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.325 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:42.325 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490680+0000", 2024-09-12T18:37:42.325 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1919999999999996e-06 2024-09-12T18:37:42.325 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.325 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.325 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:42.325 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490730+0000", 2024-09-12T18:37:42.325 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.9738999999999999e-05 2024-09-12T18:37:42.325 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.325 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.325 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:42.326 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490833+0000", 2024-09-12T18:37:42.326 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010333 2024-09-12T18:37:42.326 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.326 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.326 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:42.326 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490930+0000", 2024-09-12T18:37:42.326 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7355999999999994e-05 2024-09-12T18:37:42.326 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.326 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.326 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:42.326 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493735+0000", 2024-09-12T18:37:42.326 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028049329999999999 2024-09-12T18:37:42.326 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.327 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.327 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:42.327 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532451+0000", 2024-09-12T18:37:42.327 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.038715554999999999 2024-09-12T18:37:42.327 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.327 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.327 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:42.327 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532514+0000", 2024-09-12T18:37:42.327 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2885000000000005e-05 2024-09-12T18:37:42.327 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.328 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.328 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:42.328 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532566+0000", 2024-09-12T18:37:42.328 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2735999999999998e-05 2024-09-12T18:37:42.328 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:42.328 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:42.328 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:42.328 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.328 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.328 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201577 5.7 5:e93d4852:::benchmark_data_smithi073_23739_object69300:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:42.328 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.490721+0000", 2024-09-12T18:37:42.328 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 21.731201825999999, 2024-09-12T18:37:42.329 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.042097930999999998, 2024-09-12T18:37:42.329 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:42.329 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:42.329 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:42.329 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:42.329 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:42.329 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:42.329 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201577 2024-09-12T18:37:42.330 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.330 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:42.330 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.330 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:42.330 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490721+0000", 2024-09-12T18:37:42.330 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:42.330 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.331 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.331 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:42.331 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490721+0000", 2024-09-12T18:37:42.331 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:42.331 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.331 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.332 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:42.332 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490721+0000", 2024-09-12T18:37:42.332 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.1900000000000002e-07 2024-09-12T18:37:42.332 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.332 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.332 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:42.333 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490724+0000", 2024-09-12T18:37:42.333 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.6189999999999998e-06 2024-09-12T18:37:42.333 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.333 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.333 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:42.333 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490731+0000", 2024-09-12T18:37:42.334 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0129999999999996e-06 2024-09-12T18:37:42.334 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.334 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.334 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:42.334 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490736+0000", 2024-09-12T18:37:42.334 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6929999999999998e-06 2024-09-12T18:37:42.334 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.335 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.335 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:42.335 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490788+0000", 2024-09-12T18:37:42.335 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2104000000000001e-05 2024-09-12T18:37:42.335 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.336 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.336 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:42.336 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490926+0000", 2024-09-12T18:37:42.336 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013852800000000001 2024-09-12T18:37:42.336 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.336 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.337 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:42.337 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491061+0000", 2024-09-12T18:37:42.337 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013499700000000001 2024-09-12T18:37:42.337 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.337 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.337 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:42.338 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531660+0000", 2024-09-12T18:37:42.338 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.040599046999999999 2024-09-12T18:37:42.338 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.338 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.338 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:42.338 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532630+0000", 2024-09-12T18:37:42.339 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00096974300000000002 2024-09-12T18:37:42.339 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.339 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.339 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:42.339 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532708+0000", 2024-09-12T18:37:42.339 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8108000000000005e-05 2024-09-12T18:37:42.340 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.340 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.340 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:42.340 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532819+0000", 2024-09-12T18:37:42.340 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011046 2024-09-12T18:37:42.340 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:42.341 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:42.341 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:42.341 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.341 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.341 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201578 5.f 5:f19e206c:::benchmark_data_smithi073_23739_object69301:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:42.341 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.491951+0000", 2024-09-12T18:37:42.342 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 21.729971453000001, 2024-09-12T18:37:42.342 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.043303686000000001, 2024-09-12T18:37:42.342 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:42.342 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:42.342 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:42.343 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:42.343 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:42.343 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:42.343 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201578 2024-09-12T18:37:42.343 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.343 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:42.344 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.344 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:42.344 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491951+0000", 2024-09-12T18:37:42.344 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:42.344 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.344 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.345 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:42.345 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491951+0000", 2024-09-12T18:37:42.345 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:42.345 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.345 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.345 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:42.345 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491952+0000", 2024-09-12T18:37:42.345 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.221e-06 2024-09-12T18:37:42.346 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.346 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.346 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:42.346 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491957+0000", 2024-09-12T18:37:42.346 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.0529999999999997e-06 2024-09-12T18:37:42.346 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.347 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.347 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:42.347 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491970+0000", 2024-09-12T18:37:42.347 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2731000000000001e-05 2024-09-12T18:37:42.347 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.347 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.347 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:42.347 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491977+0000", 2024-09-12T18:37:42.347 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.1380000000000001e-06 2024-09-12T18:37:42.347 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.347 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.348 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:42.348 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492031+0000", 2024-09-12T18:37:42.348 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3857999999999998e-05 2024-09-12T18:37:42.348 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.348 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.348 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:42.348 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492125+0000", 2024-09-12T18:37:42.348 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.3275000000000004e-05 2024-09-12T18:37:42.348 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.348 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.348 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:42.348 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492205+0000", 2024-09-12T18:37:42.348 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.0793999999999999e-05 2024-09-12T18:37:42.349 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.349 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.349 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:42.349 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531712+0000", 2024-09-12T18:37:42.349 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.039506708000000001 2024-09-12T18:37:42.349 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.349 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.349 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:42.349 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535161+0000", 2024-09-12T18:37:42.349 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003448586 2024-09-12T18:37:42.349 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.349 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.349 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:42.350 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535202+0000", 2024-09-12T18:37:42.350 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.0945999999999997e-05 2024-09-12T18:37:42.350 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.350 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.350 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:42.350 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535255+0000", 2024-09-12T18:37:42.350 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3375999999999999e-05 2024-09-12T18:37:42.350 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:42.350 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:42.350 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:42.350 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.350 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.350 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201579 5.5 5:ac64e9fd:::benchmark_data_smithi073_23739_object69302:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:42.351 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.492711+0000", 2024-09-12T18:37:42.351 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 21.729211282000001, 2024-09-12T18:37:42.351 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.04478994, 2024-09-12T18:37:42.351 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:42.351 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:42.351 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:42.351 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:42.351 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:42.351 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:42.351 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201579 2024-09-12T18:37:42.351 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.351 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:42.351 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.352 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:42.352 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492711+0000", 2024-09-12T18:37:42.352 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:42.352 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.352 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.352 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:42.352 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492711+0000", 2024-09-12T18:37:42.352 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:42.352 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.352 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.353 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:42.353 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492713+0000", 2024-09-12T18:37:42.353 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.105e-06 2024-09-12T18:37:42.353 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.353 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.353 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:42.353 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492720+0000", 2024-09-12T18:37:42.353 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.109e-06 2024-09-12T18:37:42.353 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.353 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.353 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:42.354 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492730+0000", 2024-09-12T18:37:42.354 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.049e-05 2024-09-12T18:37:42.354 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.354 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.354 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:42.354 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492737+0000", 2024-09-12T18:37:42.354 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0960000000000003e-06 2024-09-12T18:37:42.354 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.354 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.354 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:42.355 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.494541+0000", 2024-09-12T18:37:42.355 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0018034139999999999 2024-09-12T18:37:42.355 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.355 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.355 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:42.355 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.494692+0000", 2024-09-12T18:37:42.355 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000150956 2024-09-12T18:37:42.355 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.355 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.355 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:42.355 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.494843+0000", 2024-09-12T18:37:42.355 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000151896 2024-09-12T18:37:42.355 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.356 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.356 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:42.356 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534665+0000", 2024-09-12T18:37:42.356 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.039821829000000003 2024-09-12T18:37:42.356 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.356 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.356 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:42.356 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536866+0000", 2024-09-12T18:37:42.356 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0022007839999999999 2024-09-12T18:37:42.356 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.356 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.356 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:42.356 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537212+0000", 2024-09-12T18:37:42.357 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00034636299999999998 2024-09-12T18:37:42.357 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.357 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.357 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:42.357 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537298+0000", 2024-09-12T18:37:42.357 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5970999999999994e-05 2024-09-12T18:37:42.357 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.357 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.357 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:42.357 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537501+0000", 2024-09-12T18:37:42.357 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020292699999999999 2024-09-12T18:37:42.357 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:42.357 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:42.357 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:42.358 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.358 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.358 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201581 5.7 5:e819369d:::benchmark_data_smithi073_23739_object69304:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:42.358 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.493262+0000", 2024-09-12T18:37:42.358 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 21.728660932, 2024-09-12T18:37:42.358 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.042091362, 2024-09-12T18:37:42.358 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:42.358 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:42.358 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:42.358 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:42.358 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:42.358 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:42.358 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201581 2024-09-12T18:37:42.358 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.359 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:42.359 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.359 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:42.359 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493262+0000", 2024-09-12T18:37:42.359 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:42.359 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.359 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.359 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:42.359 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493262+0000", 2024-09-12T18:37:42.359 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:42.359 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.359 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.359 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:42.359 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493263+0000", 2024-09-12T18:37:42.360 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.6700000000000003e-07 2024-09-12T18:37:42.360 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.360 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.360 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:42.360 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493266+0000", 2024-09-12T18:37:42.360 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.4850000000000001e-06 2024-09-12T18:37:42.360 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.360 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.360 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:42.360 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493273+0000", 2024-09-12T18:37:42.360 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2019999999999998e-06 2024-09-12T18:37:42.360 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.361 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.361 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:42.361 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493278+0000", 2024-09-12T18:37:42.361 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6210000000000003e-06 2024-09-12T18:37:42.361 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.361 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.361 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:42.361 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493330+0000", 2024-09-12T18:37:42.361 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2587000000000003e-05 2024-09-12T18:37:42.361 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.361 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.362 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:42.362 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493469+0000", 2024-09-12T18:37:42.362 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013901199999999999 2024-09-12T18:37:42.362 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.362 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.362 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:42.362 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493612+0000", 2024-09-12T18:37:42.362 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014237599999999999 2024-09-12T18:37:42.362 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.362 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.362 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:42.362 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531835+0000", 2024-09-12T18:37:42.363 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.038222735000000001 2024-09-12T18:37:42.363 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.363 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.363 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:42.363 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535265+0000", 2024-09-12T18:37:42.363 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003430064 2024-09-12T18:37:42.363 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.363 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.363 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:42.363 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535319+0000", 2024-09-12T18:37:42.363 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4375e-05 2024-09-12T18:37:42.363 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.363 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.364 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:42.364 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535353+0000", 2024-09-12T18:37:42.364 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.4137999999999997e-05 2024-09-12T18:37:42.364 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:42.364 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:42.364 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:42.364 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.364 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.364 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:201573 5.3 e67/21 5:cf4becdf:::benchmark_data_smithi073_23739_object69296:head v 67'12363, mlcod=67'12360)", 2024-09-12T18:37:42.364 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.493437+0000", 2024-09-12T18:37:42.364 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 21.728485997, 2024-09-12T18:37:42.365 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.041109664999999997, 2024-09-12T18:37:42.365 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:42.365 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:42.365 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:42.365 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:42.365 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.365 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:42.365 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493437+0000", 2024-09-12T18:37:42.365 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:42.365 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.365 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.366 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:42.366 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493437+0000", 2024-09-12T18:37:42.366 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:42.366 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.366 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.366 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:42.366 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493438+0000", 2024-09-12T18:37:42.366 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.125e-06 2024-09-12T18:37:42.366 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.367 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.367 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:42.367 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493444+0000", 2024-09-12T18:37:42.367 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2269999999999998e-06 2024-09-12T18:37:42.367 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.367 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.367 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:42.367 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493457+0000", 2024-09-12T18:37:42.367 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.312e-05 2024-09-12T18:37:42.367 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.367 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.367 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:42.368 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493466+0000", 2024-09-12T18:37:42.368 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.6309999999999992e-06 2024-09-12T18:37:42.368 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.368 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.368 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:42.368 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493526+0000", 2024-09-12T18:37:42.368 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.0316000000000003e-05 2024-09-12T18:37:42.368 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.368 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.368 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:42.368 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493541+0000", 2024-09-12T18:37:42.368 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4459e-05 2024-09-12T18:37:42.368 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.369 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.369 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:42.369 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534501+0000", 2024-09-12T18:37:42.369 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.040960215000000001 2024-09-12T18:37:42.369 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.369 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.369 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:42.369 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534546+0000", 2024-09-12T18:37:42.369 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.5571999999999997e-05 2024-09-12T18:37:42.369 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:42.370 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:42.370 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:42.370 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.370 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.370 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201582 5.f 5:f90f147f:::benchmark_data_smithi073_23739_object69305:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:42.370 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.493597+0000", 2024-09-12T18:37:42.370 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 21.728325466000001, 2024-09-12T18:37:42.370 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.045457567999999997, 2024-09-12T18:37:42.370 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:42.370 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:42.370 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:42.371 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:42.371 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:42.371 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:42.371 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201582 2024-09-12T18:37:42.371 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.371 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:42.371 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.372 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:42.372 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493597+0000", 2024-09-12T18:37:42.372 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:42.372 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.372 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.373 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:42.373 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493597+0000", 2024-09-12T18:37:42.373 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:42.373 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.373 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.373 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:42.373 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493598+0000", 2024-09-12T18:37:42.373 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7699999999999992e-07 2024-09-12T18:37:42.373 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.373 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.373 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:42.373 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493609+0000", 2024-09-12T18:37:42.373 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1297e-05 2024-09-12T18:37:42.374 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.374 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.374 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:42.374 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493620+0000", 2024-09-12T18:37:42.374 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0930999999999999e-05 2024-09-12T18:37:42.374 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.374 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.374 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:42.374 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493640+0000", 2024-09-12T18:37:42.374 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.0072e-05 2024-09-12T18:37:42.374 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.374 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.374 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:42.374 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531770+0000", 2024-09-12T18:37:42.375 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.038129652999999999 2024-09-12T18:37:42.375 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.375 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.375 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:42.375 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532046+0000", 2024-09-12T18:37:42.375 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027561600000000001 2024-09-12T18:37:42.375 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.375 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.375 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:42.375 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532337+0000", 2024-09-12T18:37:42.376 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00029169200000000003 2024-09-12T18:37:42.376 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.376 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.376 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:42.376 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536640+0000", 2024-09-12T18:37:42.376 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0043023499999999999 2024-09-12T18:37:42.376 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.376 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.376 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:42.376 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.538943+0000", 2024-09-12T18:37:42.376 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0023032740000000001 2024-09-12T18:37:42.376 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.376 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.377 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:42.377 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.539013+0000", 2024-09-12T18:37:42.377 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9944000000000007e-05 2024-09-12T18:37:42.377 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.377 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.377 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:42.377 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.539055+0000", 2024-09-12T18:37:42.377 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.1761999999999998e-05 2024-09-12T18:37:42.377 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:42.377 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:42.377 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:42.377 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.377 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.378 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:201583 5.d e67/21 5:b91eedec:::benchmark_data_smithi073_23739_object69306:head v 67'12761, mlcod=67'12759)", 2024-09-12T18:37:42.378 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.495034+0000", 2024-09-12T18:37:42.378 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 21.726889091, 2024-09-12T18:37:42.378 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.047966852999999997, 2024-09-12T18:37:42.378 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:42.378 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:42.378 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:42.378 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:42.378 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.378 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:42.378 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.495034+0000", 2024-09-12T18:37:42.378 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:42.378 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.379 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.379 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:42.379 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.495034+0000", 2024-09-12T18:37:42.379 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:42.379 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.379 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.379 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:42.379 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.495035+0000", 2024-09-12T18:37:42.379 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.023e-06 2024-09-12T18:37:42.379 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.380 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.380 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:42.380 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.495040+0000", 2024-09-12T18:37:42.380 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.9300000000000002e-06 2024-09-12T18:37:42.380 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.380 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.380 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:42.380 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531510+0000", 2024-09-12T18:37:42.380 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.036470250000000003 2024-09-12T18:37:42.380 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.380 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.380 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:42.380 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531518+0000", 2024-09-12T18:37:42.381 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8490000000000006e-06 2024-09-12T18:37:42.381 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.381 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.381 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:42.381 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534395+0000", 2024-09-12T18:37:42.381 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.002877246 2024-09-12T18:37:42.381 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.381 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.381 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:42.381 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534418+0000", 2024-09-12T18:37:42.381 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.3119e-05 2024-09-12T18:37:42.381 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.381 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.381 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:42.382 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.542930+0000", 2024-09-12T18:37:42.382 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0085121929999999995 2024-09-12T18:37:42.382 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:42.382 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:42.382 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:42.382 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.543000+0000", 2024-09-12T18:37:42.382 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0242999999999998e-05 2024-09-12T18:37:42.382 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:42.382 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:42.382 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:42.382 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:42.382 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:42.382 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:42.384 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:42.378+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:42.384 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:37:42.484 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:42.478+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:42.490 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is set 2024-09-12T18:37:42.541 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:42.541 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:37:42.541 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.541 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:246945 5.3 5:c63c6da8:::benchmark_data_smithi073_23739_object114668:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-12T18:37:42.542 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:42.529422+0000", 2024-09-12T18:37:42.542 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0085974410000000008, 2024-09-12T18:37:42.542 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0086157379999999995, 2024-09-12T18:37:42.542 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:42.542 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:42.542 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:42.542 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:42.542 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:42.542 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:42.542 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 246945 2024-09-12T18:37:42.542 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.542 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:42.542 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.543 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:42.543 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.529422+0000", 2024-09-12T18:37:42.543 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:42.543 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.543 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.543 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:42.543 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.529422+0000", 2024-09-12T18:37:42.543 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:42.543 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.543 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.543 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:42.543 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.529424+0000", 2024-09-12T18:37:42.543 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.175e-06 2024-09-12T18:37:42.543 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.544 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.544 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:42.544 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.529428+0000", 2024-09-12T18:37:42.544 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5159999999999996e-06 2024-09-12T18:37:42.544 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.544 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.544 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:42.544 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.529441+0000", 2024-09-12T18:37:42.544 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2442e-05 2024-09-12T18:37:42.544 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.544 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.544 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:42.544 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.529448+0000", 2024-09-12T18:37:42.545 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.9289999999999998e-06 2024-09-12T18:37:42.545 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.545 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.545 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:42.545 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.529505+0000", 2024-09-12T18:37:42.545 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6817000000000002e-05 2024-09-12T18:37:42.545 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.545 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.545 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:42.545 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.529630+0000", 2024-09-12T18:37:42.545 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000124573 2024-09-12T18:37:42.545 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.545 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.545 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:42.546 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.529703+0000", 2024-09-12T18:37:42.546 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3529999999999996e-05 2024-09-12T18:37:42.546 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:42.546 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:42.546 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:42.546 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.546 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.546 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:246946 5.3 5:ccb7f22b:::benchmark_data_smithi073_23739_object114669:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-12T18:37:42.547 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:42.529649+0000", 2024-09-12T18:37:42.547 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0083704379999999991, 2024-09-12T18:37:42.547 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0084319760000000007, 2024-09-12T18:37:42.547 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:42.547 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:42.547 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:42.547 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:42.547 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:42.547 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:42.548 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 246946 2024-09-12T18:37:42.548 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.548 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:42.548 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.548 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:42.548 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.529649+0000", 2024-09-12T18:37:42.548 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:42.548 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.548 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.549 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:42.549 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.529649+0000", 2024-09-12T18:37:42.549 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:42.549 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.549 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.549 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:42.549 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.529650+0000", 2024-09-12T18:37:42.549 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:37:42.550 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.550 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.550 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:42.550 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.529654+0000", 2024-09-12T18:37:42.550 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8010000000000001e-06 2024-09-12T18:37:42.550 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.550 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.550 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:42.551 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.529663+0000", 2024-09-12T18:37:42.551 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.3579999999999992e-06 2024-09-12T18:37:42.551 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.551 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.551 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:42.551 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.529670+0000", 2024-09-12T18:37:42.551 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1189999999999999e-06 2024-09-12T18:37:42.551 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.551 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.552 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:42.552 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.532650+0000", 2024-09-12T18:37:42.552 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0029792019999999998 2024-09-12T18:37:42.552 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.552 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.552 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:42.552 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.532755+0000", 2024-09-12T18:37:42.552 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000105184 2024-09-12T18:37:42.553 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.553 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.553 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:42.553 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.532852+0000", 2024-09-12T18:37:42.553 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.7546000000000004e-05 2024-09-12T18:37:42.553 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:42.553 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:42.553 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:42.554 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.554 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.554 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:246949 5.6 5:63fea72a:::benchmark_data_smithi073_23739_object114672:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-12T18:37:42.554 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:42.530257+0000", 2024-09-12T18:37:42.554 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0077628259999999996, 2024-09-12T18:37:42.554 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0078598720000000004, 2024-09-12T18:37:42.554 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:42.554 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:42.554 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:42.555 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:42.555 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:42.555 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:42.555 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 246949 2024-09-12T18:37:42.555 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.555 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:42.555 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.555 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:42.555 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.530257+0000", 2024-09-12T18:37:42.556 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:42.556 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.556 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.556 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:42.556 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.530257+0000", 2024-09-12T18:37:42.556 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:42.556 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.556 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.557 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:42.557 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.530258+0000", 2024-09-12T18:37:42.557 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8400000000000003e-07 2024-09-12T18:37:42.557 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.557 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.557 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:42.557 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.530262+0000", 2024-09-12T18:37:42.557 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.873e-06 2024-09-12T18:37:42.557 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.558 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.558 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:42.558 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.530271+0000", 2024-09-12T18:37:42.558 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1989999999999995e-06 2024-09-12T18:37:42.558 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.558 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.558 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:42.558 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.530277+0000", 2024-09-12T18:37:42.559 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4810000000000003e-06 2024-09-12T18:37:42.559 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.559 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.559 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:42.559 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.531649+0000", 2024-09-12T18:37:42.559 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0013720130000000001 2024-09-12T18:37:42.559 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.559 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.559 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:42.559 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.531743+0000", 2024-09-12T18:37:42.559 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.3181000000000001e-05 2024-09-12T18:37:42.559 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.559 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.560 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:42.560 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.531806+0000", 2024-09-12T18:37:42.560 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3310000000000002e-05 2024-09-12T18:37:42.560 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:42.560 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:42.560 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:42.560 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.560 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.560 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:246948 5.b e77/21 5:d7db87bc:::benchmark_data_smithi073_23739_object114671:head v 77'15593, mlcod=77'15589)", 2024-09-12T18:37:42.560 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:42.530396+0000", 2024-09-12T18:37:42.560 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0076243309999999998, 2024-09-12T18:37:42.560 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0077622999999999998, 2024-09-12T18:37:42.560 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:42.561 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:42.561 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:42.561 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:42.561 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.561 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:42.561 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.530396+0000", 2024-09-12T18:37:42.561 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:42.561 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.561 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.561 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:42.561 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.530396+0000", 2024-09-12T18:37:42.561 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:42.561 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.561 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.562 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:42.562 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.530396+0000", 2024-09-12T18:37:42.562 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.75e-07 2024-09-12T18:37:42.562 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.562 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.562 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:42.562 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.530403+0000", 2024-09-12T18:37:42.562 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.2860000000000002e-06 2024-09-12T18:37:42.562 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.562 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.562 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:42.562 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.530411+0000", 2024-09-12T18:37:42.562 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.7810000000000005e-06 2024-09-12T18:37:42.562 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.563 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.563 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:42.563 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.530417+0000", 2024-09-12T18:37:42.563 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.7200000000000003e-06 2024-09-12T18:37:42.563 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.563 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.563 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:42.563 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.532658+0000", 2024-09-12T18:37:42.563 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.002240831 2024-09-12T18:37:42.563 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.563 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.563 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:42.563 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.532675+0000", 2024-09-12T18:37:42.563 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6821999999999999e-05 2024-09-12T18:37:42.564 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:42.564 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:42.564 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:42.564 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.564 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.564 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:246951 5.c 5:3bf3ca8e:::benchmark_data_smithi073_23739_object114674:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-12T18:37:42.564 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:42.531877+0000", 2024-09-12T18:37:42.564 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.006142837, 2024-09-12T18:37:42.564 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0063350760000000002, 2024-09-12T18:37:42.564 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:42.564 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:42.564 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:42.564 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:42.564 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:42.565 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:42.565 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 246951 2024-09-12T18:37:42.565 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.565 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:42.565 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.565 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:42.565 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.531877+0000", 2024-09-12T18:37:42.565 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:42.565 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.565 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.565 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:42.565 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.531877+0000", 2024-09-12T18:37:42.565 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:42.565 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.566 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.566 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:42.566 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.531878+0000", 2024-09-12T18:37:42.566 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.034e-06 2024-09-12T18:37:42.566 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.566 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.566 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:42.566 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.531883+0000", 2024-09-12T18:37:42.566 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5800000000000002e-06 2024-09-12T18:37:42.566 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.566 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.566 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:42.566 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.531894+0000", 2024-09-12T18:37:42.566 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1304999999999999e-05 2024-09-12T18:37:42.567 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.567 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.567 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:42.567 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.531914+0000", 2024-09-12T18:37:42.567 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.0098999999999998e-05 2024-09-12T18:37:42.567 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.567 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.567 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:42.567 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.532414+0000", 2024-09-12T18:37:42.567 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00049987600000000001 2024-09-12T18:37:42.567 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.567 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.567 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:42.567 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.532525+0000", 2024-09-12T18:37:42.568 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000111044 2024-09-12T18:37:42.568 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.568 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.568 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:42.568 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.532657+0000", 2024-09-12T18:37:42.568 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000131891 2024-09-12T18:37:42.568 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:42.568 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:42.568 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:42.568 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.568 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.569 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:246950 5.4 e77/21 5:221c9f57:::benchmark_data_smithi073_23739_object114673:head v 77'15297, mlcod=77'15294)", 2024-09-12T18:37:42.569 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:42.532031+0000", 2024-09-12T18:37:42.569 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0059887120000000002, 2024-09-12T18:37:42.569 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0062386109999999998, 2024-09-12T18:37:42.569 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:42.569 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:42.569 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:42.569 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:42.569 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.569 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:42.569 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.532031+0000", 2024-09-12T18:37:42.569 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:42.569 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.569 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.570 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:42.570 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.532031+0000", 2024-09-12T18:37:42.570 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:42.570 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.570 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.570 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:42.570 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.532032+0000", 2024-09-12T18:37:42.570 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0299999999999998e-07 2024-09-12T18:37:42.570 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.570 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.570 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:42.570 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.532038+0000", 2024-09-12T18:37:42.570 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.0859999999999998e-06 2024-09-12T18:37:42.570 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.571 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.571 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:42.571 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.532049+0000", 2024-09-12T18:37:42.571 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0621e-05 2024-09-12T18:37:42.571 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.571 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.571 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:42.571 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.532056+0000", 2024-09-12T18:37:42.571 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.922e-06 2024-09-12T18:37:42.571 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.571 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.571 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:42.571 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.532408+0000", 2024-09-12T18:37:42.571 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00035277300000000002 2024-09-12T18:37:42.572 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.572 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.572 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:42.572 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.532426+0000", 2024-09-12T18:37:42.572 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7524e-05 2024-09-12T18:37:42.572 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:42.572 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:42.572 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:42.572 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.572 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.572 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:246952 5.6 5:6d2565a3:::benchmark_data_smithi073_23739_object114675:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-12T18:37:42.572 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:42.534664+0000", 2024-09-12T18:37:42.572 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0033558329999999999, 2024-09-12T18:37:42.573 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0036346540000000002, 2024-09-12T18:37:42.573 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:42.573 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:42.573 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:42.573 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:42.573 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:42.573 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:42.573 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 246952 2024-09-12T18:37:42.573 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.573 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:42.573 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.573 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:42.573 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.534664+0000", 2024-09-12T18:37:42.573 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:42.574 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.574 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.574 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:42.574 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.534664+0000", 2024-09-12T18:37:42.574 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:42.574 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.574 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.574 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:42.574 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.534665+0000", 2024-09-12T18:37:42.574 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2750000000000001e-06 2024-09-12T18:37:42.574 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.574 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.574 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:42.574 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.534671+0000", 2024-09-12T18:37:42.575 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5450000000000003e-06 2024-09-12T18:37:42.575 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.575 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.575 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:42.575 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.534682+0000", 2024-09-12T18:37:42.575 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1265e-05 2024-09-12T18:37:42.575 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.575 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.575 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:42.575 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.534690+0000", 2024-09-12T18:37:42.575 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.9019999999999999e-06 2024-09-12T18:37:42.575 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.575 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.575 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:42.576 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.534783+0000", 2024-09-12T18:37:42.576 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2596000000000006e-05 2024-09-12T18:37:42.576 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.576 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.576 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:42.576 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.534986+0000", 2024-09-12T18:37:42.576 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00020361000000000001 2024-09-12T18:37:42.576 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.576 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.576 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:42.576 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.535127+0000", 2024-09-12T18:37:42.576 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014114100000000001 2024-09-12T18:37:42.576 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:42.576 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:42.577 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:42.577 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.577 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.577 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:246956 5.6 5:6736cd73:::benchmark_data_smithi073_23739_object114679:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-12T18:37:42.577 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:42.534853+0000", 2024-09-12T18:37:42.577 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0031669160000000001, 2024-09-12T18:37:42.577 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0035146230000000001, 2024-09-12T18:37:42.577 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:42.577 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:42.577 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:42.577 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:42.577 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:42.577 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:42.577 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 246956 2024-09-12T18:37:42.578 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.578 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:42.578 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.578 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:42.578 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.534853+0000", 2024-09-12T18:37:42.578 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:42.578 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.578 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.578 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:42.578 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.534853+0000", 2024-09-12T18:37:42.578 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:42.578 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.578 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.578 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:42.579 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.534854+0000", 2024-09-12T18:37:42.579 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0300000000000001e-06 2024-09-12T18:37:42.579 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.579 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.579 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:42.579 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.534859+0000", 2024-09-12T18:37:42.579 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.7400000000000004e-06 2024-09-12T18:37:42.579 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.579 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.579 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:42.579 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.534877+0000", 2024-09-12T18:37:42.580 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7955999999999999e-05 2024-09-12T18:37:42.580 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.580 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.580 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:42.580 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.534884+0000", 2024-09-12T18:37:42.580 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.2370000000000003e-06 2024-09-12T18:37:42.580 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.580 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.580 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:42.580 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.538214+0000", 2024-09-12T18:37:42.581 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0033301429999999998 2024-09-12T18:37:42.581 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.581 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.581 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:42.581 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.538341+0000", 2024-09-12T18:37:42.581 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012647900000000001 2024-09-12T18:37:42.581 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:42.581 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:42.581 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:42.581 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.581 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.582 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:246958 5.3 5:cd183f45:::benchmark_data_smithi073_23739_object114681:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-12T18:37:42.582 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:42.534926+0000", 2024-09-12T18:37:42.582 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0030939050000000001, 2024-09-12T18:37:42.582 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0035015519999999998, 2024-09-12T18:37:42.582 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:42.582 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:42.582 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:42.582 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:42.582 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:42.582 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:42.582 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 246958 2024-09-12T18:37:42.582 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.583 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:42.583 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.583 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:42.583 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.534926+0000", 2024-09-12T18:37:42.583 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:42.583 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.583 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.583 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:42.583 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.534926+0000", 2024-09-12T18:37:42.583 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:42.584 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.584 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.584 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:42.584 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.534927+0000", 2024-09-12T18:37:42.584 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.37e-07 2024-09-12T18:37:42.584 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.584 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.584 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:42.584 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.534930+0000", 2024-09-12T18:37:42.584 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.2990000000000001e-06 2024-09-12T18:37:42.584 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.584 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.584 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:42.584 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.534942+0000", 2024-09-12T18:37:42.585 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1781e-05 2024-09-12T18:37:42.585 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.585 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.585 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:42.585 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.534948+0000", 2024-09-12T18:37:42.585 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9780000000000002e-06 2024-09-12T18:37:42.585 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.585 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.586 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:42.586 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.535758+0000", 2024-09-12T18:37:42.586 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00081010999999999995 2024-09-12T18:37:42.586 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.586 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.586 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:42.586 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.535886+0000", 2024-09-12T18:37:42.586 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000128598 2024-09-12T18:37:42.586 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.586 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.586 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:42.586 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.535999+0000", 2024-09-12T18:37:42.586 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00011271499999999999 2024-09-12T18:37:42.587 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:42.587 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:42.587 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:42.587 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.587 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.587 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:246954 5.4 e77/21 5:25fb99ed:::benchmark_data_smithi073_23739_object114677:head v 77'15298, mlcod=77'15294)", 2024-09-12T18:37:42.587 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:42.535271+0000", 2024-09-12T18:37:42.587 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0027491009999999999, 2024-09-12T18:37:42.587 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.003217358, 2024-09-12T18:37:42.587 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:42.587 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:42.587 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:42.587 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:42.587 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.587 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:42.588 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.535271+0000", 2024-09-12T18:37:42.588 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:42.588 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.588 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.588 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:42.588 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.535271+0000", 2024-09-12T18:37:42.588 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:42.588 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.588 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.588 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:42.588 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.535271+0000", 2024-09-12T18:37:42.589 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.2500000000000001e-07 2024-09-12T18:37:42.589 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.589 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.589 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:42.589 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.535275+0000", 2024-09-12T18:37:42.589 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4860000000000002e-06 2024-09-12T18:37:42.589 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.589 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.589 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:42.589 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.535281+0000", 2024-09-12T18:37:42.589 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9989999999999997e-06 2024-09-12T18:37:42.590 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.590 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.590 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:42.590 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.535284+0000", 2024-09-12T18:37:42.590 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.9079999999999997e-06 2024-09-12T18:37:42.590 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.590 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.590 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:42.590 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.535721+0000", 2024-09-12T18:37:42.590 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00043632600000000001 2024-09-12T18:37:42.590 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.590 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.590 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:42.591 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.535739+0000", 2024-09-12T18:37:42.591 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8046e-05 2024-09-12T18:37:42.591 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:42.591 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:42.591 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:42.591 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.591 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.591 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:246959 5.4 e77/21 5:28731378:::benchmark_data_smithi073_23739_object114682:head v 77'15299, mlcod=77'15295)", 2024-09-12T18:37:42.591 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:42.536739+0000", 2024-09-12T18:37:42.591 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.001281239, 2024-09-12T18:37:42.591 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001786089, 2024-09-12T18:37:42.591 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:42.591 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:42.591 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:42.592 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:42.592 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.592 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:42.592 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.536739+0000", 2024-09-12T18:37:42.592 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:42.592 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.592 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.592 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:42.592 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.536739+0000", 2024-09-12T18:37:42.593 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:42.593 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.593 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.593 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:42.593 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.536739+0000", 2024-09-12T18:37:42.593 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1399999999999996e-07 2024-09-12T18:37:42.593 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.593 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.593 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:42.593 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.536748+0000", 2024-09-12T18:37:42.593 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.4740000000000005e-06 2024-09-12T18:37:42.593 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.593 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.594 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:42.594 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.536758+0000", 2024-09-12T18:37:42.594 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0264e-05 2024-09-12T18:37:42.594 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.594 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.594 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:42.594 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.536766+0000", 2024-09-12T18:37:42.594 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.763e-06 2024-09-12T18:37:42.594 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.594 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.594 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:42.595 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.537470+0000", 2024-09-12T18:37:42.595 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00070419500000000002 2024-09-12T18:37:42.595 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.595 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.595 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:42.595 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.537491+0000", 2024-09-12T18:37:42.595 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.109e-05 2024-09-12T18:37:42.595 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:42.595 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:42.595 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:42.595 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.595 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.595 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:246938 5.c e77/21)", 2024-09-12T18:37:42.596 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:42.536957+0000", 2024-09-12T18:37:42.596 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.001062704, 2024-09-12T18:37:42.596 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001592598, 2024-09-12T18:37:42.596 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:42.596 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:42.596 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:42.596 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:42.596 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.596 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:42.596 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.536957+0000", 2024-09-12T18:37:42.596 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:42.596 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.596 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.596 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:42.597 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.536957+0000", 2024-09-12T18:37:42.597 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:42.597 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.597 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.597 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:42.597 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.536958+0000", 2024-09-12T18:37:42.597 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6100000000000001e-07 2024-09-12T18:37:42.597 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.597 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.597 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:42.597 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.536963+0000", 2024-09-12T18:37:42.598 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5450000000000003e-06 2024-09-12T18:37:42.598 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.598 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.598 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:42.598 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.536972+0000", 2024-09-12T18:37:42.598 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.0489999999999993e-06 2024-09-12T18:37:42.598 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.598 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.598 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:42.598 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.536978+0000", 2024-09-12T18:37:42.598 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.0000000000000002e-06 2024-09-12T18:37:42.598 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:42.598 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:42.598 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:42.599 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.599 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.599 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:246957 5.8 e77/21 5:17a12a8f:::benchmark_data_smithi073_23739_object114680:head v 77'15098, mlcod=77'15095)", 2024-09-12T18:37:42.599 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:42.537179+0000", 2024-09-12T18:37:42.599 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00084122299999999999, 2024-09-12T18:37:42.599 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0013936700000000001, 2024-09-12T18:37:42.599 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:42.599 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:42.599 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:42.599 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:42.600 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.600 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:42.600 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.537179+0000", 2024-09-12T18:37:42.600 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:42.600 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.600 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.600 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:42.600 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.537179+0000", 2024-09-12T18:37:42.600 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:42.600 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.601 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.601 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:42.601 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.537179+0000", 2024-09-12T18:37:42.601 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8199999999999999e-07 2024-09-12T18:37:42.601 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.601 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.601 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:42.601 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.537185+0000", 2024-09-12T18:37:42.601 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.913e-06 2024-09-12T18:37:42.601 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.601 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.601 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:42.602 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.537196+0000", 2024-09-12T18:37:42.602 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0501e-05 2024-09-12T18:37:42.602 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.602 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.602 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:42.602 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.537205+0000", 2024-09-12T18:37:42.602 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1710000000000008e-06 2024-09-12T18:37:42.602 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.602 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.602 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:42.603 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.537249+0000", 2024-09-12T18:37:42.603 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3764000000000003e-05 2024-09-12T18:37:42.603 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.603 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.603 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:42.603 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.537268+0000", 2024-09-12T18:37:42.603 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.9290999999999999e-05 2024-09-12T18:37:42.603 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:42.603 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:42.603 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:42.603 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.603 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.603 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:246949 5.6 e77/21)", 2024-09-12T18:37:42.604 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:42.537290+0000", 2024-09-12T18:37:42.604 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00072961499999999997, 2024-09-12T18:37:42.604 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0013079400000000001, 2024-09-12T18:37:42.604 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:42.604 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:42.604 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:42.604 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:42.604 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.604 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:42.604 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.537290+0000", 2024-09-12T18:37:42.604 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:42.604 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.604 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.604 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:42.605 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.537290+0000", 2024-09-12T18:37:42.605 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:42.605 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.605 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.605 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:42.605 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.537291+0000", 2024-09-12T18:37:42.605 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7700000000000004e-07 2024-09-12T18:37:42.605 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.605 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.605 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:42.605 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.537294+0000", 2024-09-12T18:37:42.605 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.1719999999999999e-06 2024-09-12T18:37:42.605 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.605 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.606 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:42.606 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.537302+0000", 2024-09-12T18:37:42.606 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2570000000000007e-06 2024-09-12T18:37:42.606 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.606 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.606 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:42.606 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.537309+0000", 2024-09-12T18:37:42.606 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.173e-06 2024-09-12T18:37:42.606 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:42.606 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:42.606 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:42.606 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.606 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.606 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:246945 5.3 e77/21)", 2024-09-12T18:37:42.607 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:42.538389+0000", 2024-09-12T18:37:42.607 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4294967295.9996314, 2024-09-12T18:37:42.607 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00023022400000000001, 2024-09-12T18:37:42.607 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:42.607 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:42.607 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:42.607 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:42.607 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.607 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:42.607 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.538389+0000", 2024-09-12T18:37:42.607 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:42.608 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.608 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.608 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:42.608 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.538389+0000", 2024-09-12T18:37:42.608 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:42.608 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.608 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.608 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:42.608 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.538389+0000", 2024-09-12T18:37:42.608 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6599999999999995e-07 2024-09-12T18:37:42.608 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.608 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.608 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:42.609 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.538393+0000", 2024-09-12T18:37:42.609 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8279999999999996e-06 2024-09-12T18:37:42.609 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.609 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.609 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:42.609 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.538402+0000", 2024-09-12T18:37:42.609 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.2010000000000005e-06 2024-09-12T18:37:42.609 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.609 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.609 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:42.609 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.538410+0000", 2024-09-12T18:37:42.609 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.7849999999999992e-06 2024-09-12T18:37:42.609 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:42.609 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:42.610 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:42.610 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.610 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.610 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:246938 5.c 5:3f39d0a9:::benchmark_data_smithi073_23739_object114661:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-12T18:37:42.610 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:42.526372+0000", 2024-09-12T18:37:42.610 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.011648192999999999, 2024-09-12T18:37:42.610 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.012275451, 2024-09-12T18:37:42.610 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:42.610 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:42.610 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:42.610 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:42.610 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:42.610 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:42.610 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 246938 2024-09-12T18:37:42.611 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.611 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:42.611 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.611 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:42.611 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.526372+0000", 2024-09-12T18:37:42.611 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:42.611 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.611 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.611 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:42.611 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.526372+0000", 2024-09-12T18:37:42.611 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:42.611 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.611 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.611 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:42.612 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.526372+0000", 2024-09-12T18:37:42.612 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.7700000000000005e-07 2024-09-12T18:37:42.612 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.612 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.612 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:42.612 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.526375+0000", 2024-09-12T18:37:42.612 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.5689999999999999e-06 2024-09-12T18:37:42.612 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.612 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.612 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:42.612 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.526393+0000", 2024-09-12T18:37:42.612 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7821000000000001e-05 2024-09-12T18:37:42.612 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.613 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.613 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:42.613 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.526399+0000", 2024-09-12T18:37:42.613 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.302e-06 2024-09-12T18:37:42.613 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.613 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.613 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:42.613 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.529490+0000", 2024-09-12T18:37:42.613 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0030907729999999998 2024-09-12T18:37:42.614 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.614 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.614 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:42.614 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.529624+0000", 2024-09-12T18:37:42.614 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000134158 2024-09-12T18:37:42.614 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.614 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.614 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:42.614 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.529734+0000", 2024-09-12T18:37:42.614 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00011011299999999999 2024-09-12T18:37:42.614 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.614 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.614 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:42.614 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:42.537446+0000", 2024-09-12T18:37:42.615 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.007712422 2024-09-12T18:37:42.615 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:42.615 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:42.615 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:42.615 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:42.615 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-12T18:37:42.615 INFO:teuthology.orchestra.run.smithi114.stdout: "num_ops": 16 2024-09-12T18:37:42.615 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:42.617 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:37:42.617 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:42.611+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:42.717 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:42.713+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:42.769 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:42.769 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2024-09-12T18:37:42.769 INFO:teuthology.orchestra.run.smithi114.stdout: "complaint_time": 30, 2024-09-12T18:37:42.769 INFO:teuthology.orchestra.run.smithi114.stdout: "num_blocked_ops": 0 2024-09-12T18:37:42.770 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:42.791 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:37:42.836 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:42.833+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:42.919 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:42.913+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:42.987 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:42.987 INFO:teuthology.orchestra.run.smithi114.stdout: "size": 20, 2024-09-12T18:37:42.987 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 600, 2024-09-12T18:37:42.987 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:37:42.987 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.987 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167352 5.a 5:5fc472d2:::benchmark_data_smithi073_23739_object35075:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:42.988 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.163066+0000", 2024-09-12T18:37:42.988 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 39.820562410999997, 2024-09-12T18:37:42.988 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.077708377999999995, 2024-09-12T18:37:42.988 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:42.988 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:42.988 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:42.988 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:42.988 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:42.988 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:42.988 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167352 2024-09-12T18:37:42.988 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.988 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:42.989 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.989 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:42.989 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163066+0000", 2024-09-12T18:37:42.989 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:42.989 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.989 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.989 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:42.989 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163066+0000", 2024-09-12T18:37:42.989 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:42.989 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.989 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.989 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:42.989 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163067+0000", 2024-09-12T18:37:42.990 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0499999999999999e-06 2024-09-12T18:37:42.990 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.990 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.990 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:42.990 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163071+0000", 2024-09-12T18:37:42.990 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4340000000000002e-06 2024-09-12T18:37:42.990 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.990 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.990 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:42.990 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163081+0000", 2024-09-12T18:37:42.990 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0304e-05 2024-09-12T18:37:42.990 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.990 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.991 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:42.991 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163090+0000", 2024-09-12T18:37:42.991 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7309999999999999e-06 2024-09-12T18:37:42.991 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.991 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.991 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:42.991 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163143+0000", 2024-09-12T18:37:42.991 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2942000000000002e-05 2024-09-12T18:37:42.991 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.991 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.991 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:42.991 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163270+0000", 2024-09-12T18:37:42.991 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012664100000000001 2024-09-12T18:37:42.991 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.992 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.992 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:42.992 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163378+0000", 2024-09-12T18:37:42.992 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000107995 2024-09-12T18:37:42.992 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.992 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.992 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:42.992 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234552+0000", 2024-09-12T18:37:42.992 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.071173831000000007 2024-09-12T18:37:42.992 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.992 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.992 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:42.992 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240640+0000", 2024-09-12T18:37:42.993 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.006088909 2024-09-12T18:37:42.993 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.993 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.993 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:42.993 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240709+0000", 2024-09-12T18:37:42.993 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8393999999999996e-05 2024-09-12T18:37:42.993 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.993 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.993 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:42.993 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240774+0000", 2024-09-12T18:37:42.993 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5147000000000005e-05 2024-09-12T18:37:42.993 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:42.993 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:42.993 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:42.994 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.994 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.994 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167358 5.a 5:533f6738:::benchmark_data_smithi073_23739_object35081:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:42.994 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.165639+0000", 2024-09-12T18:37:42.994 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 39.817989134000001, 2024-09-12T18:37:42.994 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.075287509000000002, 2024-09-12T18:37:42.994 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:42.994 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:42.994 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:42.994 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:42.994 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:42.994 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:42.994 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167358 2024-09-12T18:37:42.995 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.995 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:42.995 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.995 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:42.995 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165639+0000", 2024-09-12T18:37:42.995 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:42.995 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.995 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.995 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:42.995 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165639+0000", 2024-09-12T18:37:42.995 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:42.995 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.995 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.995 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:42.996 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165640+0000", 2024-09-12T18:37:42.996 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1999999999999999e-06 2024-09-12T18:37:42.996 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.996 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.996 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:42.996 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165646+0000", 2024-09-12T18:37:42.996 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4550000000000003e-06 2024-09-12T18:37:42.996 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.996 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.996 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:42.996 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165658+0000", 2024-09-12T18:37:42.996 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2721999999999999e-05 2024-09-12T18:37:42.996 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.997 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.997 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:42.997 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165668+0000", 2024-09-12T18:37:42.997 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4229999999999994e-06 2024-09-12T18:37:42.997 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.997 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.997 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:42.997 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165711+0000", 2024-09-12T18:37:42.997 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3785999999999997e-05 2024-09-12T18:37:42.997 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.997 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.997 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:42.997 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165788+0000", 2024-09-12T18:37:42.998 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6506000000000002e-05 2024-09-12T18:37:42.998 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.998 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.998 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:42.998 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165862+0000", 2024-09-12T18:37:42.998 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4012999999999998e-05 2024-09-12T18:37:42.998 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.998 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.998 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:42.998 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234718+0000", 2024-09-12T18:37:42.998 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.068856420000000002 2024-09-12T18:37:42.998 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.998 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.998 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:42.999 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240785+0000", 2024-09-12T18:37:42.999 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0060661489999999998 2024-09-12T18:37:42.999 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.999 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.999 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:42.999 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240844+0000", 2024-09-12T18:37:42.999 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9487000000000002e-05 2024-09-12T18:37:42.999 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:42.999 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:42.999 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:42.999 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240926+0000", 2024-09-12T18:37:42.999 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2348000000000005e-05 2024-09-12T18:37:42.999 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:43.000 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:43.000 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:43.000 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.000 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.000 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167361 5.a 5:56730f28:::benchmark_data_smithi073_23739_object35084:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:43.000 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.165979+0000", 2024-09-12T18:37:43.000 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 39.817649154000001, 2024-09-12T18:37:43.000 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.075128337000000003, 2024-09-12T18:37:43.000 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:43.000 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:43.000 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:43.000 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:43.000 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:43.001 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:43.001 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167361 2024-09-12T18:37:43.001 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.001 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:43.001 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.001 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:43.001 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165979+0000", 2024-09-12T18:37:43.001 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:43.001 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.001 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.001 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:43.001 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165979+0000", 2024-09-12T18:37:43.001 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:43.002 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.002 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.002 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:43.002 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165980+0000", 2024-09-12T18:37:43.002 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4499999999999997e-07 2024-09-12T18:37:43.002 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.002 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.002 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:43.002 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165985+0000", 2024-09-12T18:37:43.002 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.186e-06 2024-09-12T18:37:43.002 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.002 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.002 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:43.002 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165995+0000", 2024-09-12T18:37:43.003 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0378e-05 2024-09-12T18:37:43.003 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.003 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.003 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:43.003 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.166016+0000", 2024-09-12T18:37:43.003 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1316999999999999e-05 2024-09-12T18:37:43.003 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.003 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.003 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:43.003 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.167783+0000", 2024-09-12T18:37:43.003 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017662209999999999 2024-09-12T18:37:43.003 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.003 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.003 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:43.004 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.167851+0000", 2024-09-12T18:37:43.004 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7990000000000005e-05 2024-09-12T18:37:43.004 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.004 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.004 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:43.004 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.167929+0000", 2024-09-12T18:37:43.004 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8829e-05 2024-09-12T18:37:43.004 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.004 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.004 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:43.004 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234832+0000", 2024-09-12T18:37:43.004 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066902378999999998 2024-09-12T18:37:43.004 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.005 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.005 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:43.005 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240941+0000", 2024-09-12T18:37:43.005 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0061087470000000003 2024-09-12T18:37:43.005 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.005 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.005 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:43.005 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241053+0000", 2024-09-12T18:37:43.005 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00011197299999999999 2024-09-12T18:37:43.005 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.005 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.005 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:43.005 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241107+0000", 2024-09-12T18:37:43.005 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4672000000000001e-05 2024-09-12T18:37:43.006 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:43.006 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:43.006 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:43.006 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.006 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.006 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167362 5.3 5:cbd73b47:::benchmark_data_smithi073_23739_object35085:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:43.006 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:43.006 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 39.815552439000001, 2024-09-12T18:37:43.006 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.067202411000000004, 2024-09-12T18:37:43.006 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:43.006 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:43.006 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:43.006 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:43.007 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:43.007 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:43.007 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167362 2024-09-12T18:37:43.007 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.007 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:43.007 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.007 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:43.007 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:43.007 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:43.007 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.007 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.007 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:43.007 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:43.008 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:43.008 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.008 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.008 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:43.008 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:43.008 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3600000000000003e-07 2024-09-12T18:37:43.008 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.008 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.008 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:43.008 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168079+0000", 2024-09-12T18:37:43.008 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7949999999999999e-06 2024-09-12T18:37:43.008 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.008 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.009 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:43.009 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168085+0000", 2024-09-12T18:37:43.009 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2110000000000003e-06 2024-09-12T18:37:43.009 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.009 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.009 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:43.009 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168089+0000", 2024-09-12T18:37:43.009 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0840000000000002e-06 2024-09-12T18:37:43.009 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.009 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.009 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:43.009 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168121+0000", 2024-09-12T18:37:43.009 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.1489000000000003e-05 2024-09-12T18:37:43.009 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.010 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.010 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:43.010 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168186+0000", 2024-09-12T18:37:43.010 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5313000000000003e-05 2024-09-12T18:37:43.010 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.010 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.010 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:43.010 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168242+0000", 2024-09-12T18:37:43.010 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5560999999999999e-05 2024-09-12T18:37:43.010 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.010 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.010 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:43.010 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234467+0000", 2024-09-12T18:37:43.011 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066225424000000005 2024-09-12T18:37:43.011 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.011 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.011 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:43.011 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235088+0000", 2024-09-12T18:37:43.011 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00062118999999999998 2024-09-12T18:37:43.011 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.011 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.011 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:43.011 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235197+0000", 2024-09-12T18:37:43.011 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00010825899999999999 2024-09-12T18:37:43.011 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.012 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.012 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:43.012 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235278+0000", 2024-09-12T18:37:43.012 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1448999999999999e-05 2024-09-12T18:37:43.012 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:43.012 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:43.012 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:43.012 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.012 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.012 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167366 5.a 5:58e6a467:::benchmark_data_smithi073_23739_object35089:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:43.012 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168263+0000", 2024-09-12T18:37:43.012 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 39.815364901999999, 2024-09-12T18:37:43.012 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.078184744, 2024-09-12T18:37:43.013 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:43.013 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:43.013 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:43.013 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:43.013 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:43.013 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:43.013 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167366 2024-09-12T18:37:43.013 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.013 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:43.013 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.013 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:43.013 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168263+0000", 2024-09-12T18:37:43.013 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:43.013 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.014 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.014 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:43.014 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168263+0000", 2024-09-12T18:37:43.014 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:43.014 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.014 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.014 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:43.014 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168264+0000", 2024-09-12T18:37:43.014 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5700000000000002e-07 2024-09-12T18:37:43.014 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.014 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.014 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:43.014 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168266+0000", 2024-09-12T18:37:43.014 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1789999999999998e-06 2024-09-12T18:37:43.015 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.015 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.015 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:43.015 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168271+0000", 2024-09-12T18:37:43.015 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8160000000000001e-06 2024-09-12T18:37:43.015 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.015 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.015 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:43.015 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168275+0000", 2024-09-12T18:37:43.015 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4440000000000001e-06 2024-09-12T18:37:43.015 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.015 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.015 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:43.015 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170082+0000", 2024-09-12T18:37:43.015 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0018068800000000001 2024-09-12T18:37:43.016 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.016 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.016 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:43.016 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170154+0000", 2024-09-12T18:37:43.016 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1575000000000005e-05 2024-09-12T18:37:43.016 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.016 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.016 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:43.016 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170216+0000", 2024-09-12T18:37:43.016 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1989999999999994e-05 2024-09-12T18:37:43.016 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.016 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.016 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:43.017 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234933+0000", 2024-09-12T18:37:43.017 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064717514000000004 2024-09-12T18:37:43.017 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.017 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.017 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:43.017 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246226+0000", 2024-09-12T18:37:43.017 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011293151 2024-09-12T18:37:43.017 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.017 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.017 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:43.017 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246338+0000", 2024-09-12T18:37:43.017 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00011225 2024-09-12T18:37:43.017 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.017 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.018 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:43.018 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246448+0000", 2024-09-12T18:37:43.018 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000109388 2024-09-12T18:37:43.018 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:43.018 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:43.018 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:43.018 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.018 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.018 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167367 5.a 5:51778d97:::benchmark_data_smithi073_23739_object35090:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:43.018 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168388+0000", 2024-09-12T18:37:43.018 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 39.815239658000003, 2024-09-12T18:37:43.018 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.082583860999999995, 2024-09-12T18:37:43.018 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:43.019 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:43.019 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:43.019 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:43.019 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:43.019 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:43.019 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167367 2024-09-12T18:37:43.019 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.019 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:43.019 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.019 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:43.019 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168388+0000", 2024-09-12T18:37:43.019 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:43.019 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.019 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.020 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:43.020 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168388+0000", 2024-09-12T18:37:43.020 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:43.020 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.020 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.020 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:43.020 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168389+0000", 2024-09-12T18:37:43.020 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1099999999999996e-07 2024-09-12T18:37:43.020 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.020 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.020 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:43.020 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168391+0000", 2024-09-12T18:37:43.020 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.39e-06 2024-09-12T18:37:43.021 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.021 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.021 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:43.021 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168396+0000", 2024-09-12T18:37:43.021 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3460000000000004e-06 2024-09-12T18:37:43.021 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.021 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.021 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:43.021 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168399+0000", 2024-09-12T18:37:43.021 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.613e-06 2024-09-12T18:37:43.021 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.021 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.021 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:43.021 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235003+0000", 2024-09-12T18:37:43.022 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066603851000000006 2024-09-12T18:37:43.022 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.022 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.022 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:43.022 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235266+0000", 2024-09-12T18:37:43.022 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00026270999999999998 2024-09-12T18:37:43.022 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.022 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.022 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:43.022 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235510+0000", 2024-09-12T18:37:43.022 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00024394 2024-09-12T18:37:43.022 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.022 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.023 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:43.023 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246546+0000", 2024-09-12T18:37:43.023 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011035774 2024-09-12T18:37:43.023 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.023 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.023 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:43.023 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.250808+0000", 2024-09-12T18:37:43.023 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0042622700000000003 2024-09-12T18:37:43.023 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.023 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.023 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:43.023 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.250890+0000", 2024-09-12T18:37:43.023 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1874999999999998e-05 2024-09-12T18:37:43.023 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.024 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.024 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:43.024 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.250972+0000", 2024-09-12T18:37:43.024 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2581000000000001e-05 2024-09-12T18:37:43.024 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:43.024 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:43.024 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:43.024 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.024 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.024 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167370 5.a 5:5aab9477:::benchmark_data_smithi073_23739_object35093:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:43.024 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168603+0000", 2024-09-12T18:37:43.024 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 39.815024723000001, 2024-09-12T18:37:43.024 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.086603794999999997, 2024-09-12T18:37:43.025 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:43.025 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:43.025 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:43.025 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:43.025 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:43.025 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:43.025 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167370 2024-09-12T18:37:43.025 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.025 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:43.025 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.025 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:43.025 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168603+0000", 2024-09-12T18:37:43.025 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:43.026 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.026 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.026 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:43.026 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168603+0000", 2024-09-12T18:37:43.026 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:43.026 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.026 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.026 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:43.026 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168604+0000", 2024-09-12T18:37:43.026 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.1899999999999998e-07 2024-09-12T18:37:43.026 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.026 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.026 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:43.027 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168606+0000", 2024-09-12T18:37:43.027 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8309999999999999e-06 2024-09-12T18:37:43.027 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.027 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.027 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:43.027 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168610+0000", 2024-09-12T18:37:43.027 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8069999999999999e-06 2024-09-12T18:37:43.027 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.027 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.027 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:43.027 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168613+0000", 2024-09-12T18:37:43.027 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.118e-06 2024-09-12T18:37:43.027 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.027 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.028 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:43.028 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241145+0000", 2024-09-12T18:37:43.028 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.072531678000000002 2024-09-12T18:37:43.028 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.028 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.028 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:43.028 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241342+0000", 2024-09-12T18:37:43.028 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00019635900000000001 2024-09-12T18:37:43.028 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.028 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.028 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:43.028 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241483+0000", 2024-09-12T18:37:43.028 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014161100000000001 2024-09-12T18:37:43.029 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.029 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.029 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:43.029 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255039+0000", 2024-09-12T18:37:43.029 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013555724 2024-09-12T18:37:43.029 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.029 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.029 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:43.029 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255062+0000", 2024-09-12T18:37:43.029 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.3042000000000001e-05 2024-09-12T18:37:43.029 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.029 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.029 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:43.029 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255143+0000", 2024-09-12T18:37:43.030 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0999000000000002e-05 2024-09-12T18:37:43.030 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.030 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.030 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:43.030 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255207+0000", 2024-09-12T18:37:43.030 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4207000000000004e-05 2024-09-12T18:37:43.030 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:43.030 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:43.030 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:43.030 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.030 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.030 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167352 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:43.030 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:43.031 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 39.814900068999997, 2024-09-12T18:37:43.031 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065859953999999998, 2024-09-12T18:37:43.031 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:43.031 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:43.031 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:43.031 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:43.031 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.031 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:43.031 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:43.031 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:43.031 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.031 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.031 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:43.032 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:43.032 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:43.032 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.032 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.032 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:43.032 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:43.032 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.0800000000000001e-07 2024-09-12T18:37:43.032 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.032 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.032 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:43.032 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168730+0000", 2024-09-12T18:37:43.032 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6530000000000001e-06 2024-09-12T18:37:43.032 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.033 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.033 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:43.033 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168734+0000", 2024-09-12T18:37:43.033 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.721e-06 2024-09-12T18:37:43.033 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.033 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.033 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:43.033 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168736+0000", 2024-09-12T18:37:43.033 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.508e-06 2024-09-12T18:37:43.033 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.033 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.033 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:43.034 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171951+0000", 2024-09-12T18:37:43.034 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.003215281 2024-09-12T18:37:43.034 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.034 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.034 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:43.034 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234520+0000", 2024-09-12T18:37:43.034 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062568676000000004 2024-09-12T18:37:43.034 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.034 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.034 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:43.034 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234588+0000", 2024-09-12T18:37:43.034 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7806999999999996e-05 2024-09-12T18:37:43.034 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:43.034 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:43.035 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:43.035 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.035 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.035 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167368 5.4 e58/21 5:29a1ec58:::benchmark_data_smithi073_23739_object35091:head v 58'10399, mlcod=58'10396)", 2024-09-12T18:37:43.035 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:43.035 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 39.814777051999997, 2024-09-12T18:37:43.035 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066008885000000003, 2024-09-12T18:37:43.035 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:43.035 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:43.035 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:43.035 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:43.035 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.035 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:43.036 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:43.036 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:43.036 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.036 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.036 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:43.036 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:43.036 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:43.036 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.036 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.036 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:43.036 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:43.036 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4699999999999998e-07 2024-09-12T18:37:43.036 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.036 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.037 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:43.037 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168854+0000", 2024-09-12T18:37:43.037 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.3180000000000001e-06 2024-09-12T18:37:43.037 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.037 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.037 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:43.037 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168858+0000", 2024-09-12T18:37:43.037 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2799999999999997e-06 2024-09-12T18:37:43.037 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.037 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.037 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:43.037 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168861+0000", 2024-09-12T18:37:43.038 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7650000000000002e-06 2024-09-12T18:37:43.038 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.038 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.038 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:43.038 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168895+0000", 2024-09-12T18:37:43.038 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4533999999999998e-05 2024-09-12T18:37:43.038 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.038 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.038 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:43.038 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168906+0000", 2024-09-12T18:37:43.038 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0910000000000001e-05 2024-09-12T18:37:43.038 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.038 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.039 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:43.039 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234784+0000", 2024-09-12T18:37:43.039 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065877656000000007 2024-09-12T18:37:43.039 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.039 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.039 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:43.039 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234860+0000", 2024-09-12T18:37:43.039 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6174999999999995e-05 2024-09-12T18:37:43.039 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:43.039 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:43.039 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:43.039 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.039 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.040 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167358 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:43.040 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.170373+0000", 2024-09-12T18:37:43.040 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 39.813254770999997, 2024-09-12T18:37:43.040 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064370201000000002, 2024-09-12T18:37:43.040 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:43.040 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:43.040 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:43.040 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:43.040 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.040 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:43.040 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170373+0000", 2024-09-12T18:37:43.040 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:43.040 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.041 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.041 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:43.041 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170373+0000", 2024-09-12T18:37:43.041 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:43.041 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.041 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.041 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:43.041 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170374+0000", 2024-09-12T18:37:43.041 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5799999999999998e-07 2024-09-12T18:37:43.041 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.041 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.041 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:43.041 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170378+0000", 2024-09-12T18:37:43.042 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.732e-06 2024-09-12T18:37:43.042 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.042 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.042 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:43.042 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170388+0000", 2024-09-12T18:37:43.042 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0212e-05 2024-09-12T18:37:43.042 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.042 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.042 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:43.042 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170397+0000", 2024-09-12T18:37:43.042 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7090000000000008e-06 2024-09-12T18:37:43.042 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.042 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.042 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:43.043 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234682+0000", 2024-09-12T18:37:43.043 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064285518999999999 2024-09-12T18:37:43.043 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.043 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.043 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:43.043 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234703+0000", 2024-09-12T18:37:43.043 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.0199000000000001e-05 2024-09-12T18:37:43.043 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.043 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.043 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:43.043 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234743+0000", 2024-09-12T18:37:43.043 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0972e-05 2024-09-12T18:37:43.043 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:43.043 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:43.044 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:43.044 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.044 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.044 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167372 5.c 5:398d36a7:::benchmark_data_smithi073_23739_object35095:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:43.044 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171066+0000", 2024-09-12T18:37:43.044 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 39.812561559000002, 2024-09-12T18:37:43.044 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065889534999999999, 2024-09-12T18:37:43.044 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:43.044 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:43.044 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:43.044 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:43.044 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:43.044 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:43.044 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167372 2024-09-12T18:37:43.045 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.045 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:43.045 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.045 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:43.045 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171066+0000", 2024-09-12T18:37:43.045 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:43.045 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.045 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.045 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:43.045 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171066+0000", 2024-09-12T18:37:43.045 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:43.045 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.045 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.046 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:43.046 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171068+0000", 2024-09-12T18:37:43.046 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.186e-06 2024-09-12T18:37:43.046 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.046 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.046 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:43.046 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171072+0000", 2024-09-12T18:37:43.046 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3560000000000003e-06 2024-09-12T18:37:43.046 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.046 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.046 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:43.046 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171082+0000", 2024-09-12T18:37:43.046 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.9739999999999997e-06 2024-09-12T18:37:43.047 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.047 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.047 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:43.047 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171089+0000", 2024-09-12T18:37:43.047 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7159999999999997e-06 2024-09-12T18:37:43.047 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.047 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.047 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:43.047 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171133+0000", 2024-09-12T18:37:43.047 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4091999999999997e-05 2024-09-12T18:37:43.047 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.047 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.047 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:43.048 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171221+0000", 2024-09-12T18:37:43.048 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.8108000000000004e-05 2024-09-12T18:37:43.048 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.048 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.048 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:43.048 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171279+0000", 2024-09-12T18:37:43.048 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8062000000000001e-05 2024-09-12T18:37:43.048 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.048 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.048 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:43.048 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235007+0000", 2024-09-12T18:37:43.048 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.063727849000000003 2024-09-12T18:37:43.048 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.049 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.049 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:43.049 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236790+0000", 2024-09-12T18:37:43.049 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017829269999999999 2024-09-12T18:37:43.049 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.049 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.049 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:43.049 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236881+0000", 2024-09-12T18:37:43.049 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1347999999999993e-05 2024-09-12T18:37:43.049 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.049 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.049 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:43.049 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236956+0000", 2024-09-12T18:37:43.050 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4917000000000001e-05 2024-09-12T18:37:43.050 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:43.050 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:43.050 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:43.050 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.050 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.050 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167371 5.4 e58/21 5:24fea27c:::benchmark_data_smithi073_23739_object35094:head v 58'10400, mlcod=58'10397)", 2024-09-12T18:37:43.050 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171273+0000", 2024-09-12T18:37:43.050 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 39.812354984999999, 2024-09-12T18:37:43.050 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065500368000000003, 2024-09-12T18:37:43.050 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:43.050 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:43.050 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:43.051 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:43.051 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.051 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:43.051 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171273+0000", 2024-09-12T18:37:43.051 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:43.051 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.051 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.051 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:43.051 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171273+0000", 2024-09-12T18:37:43.051 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:43.051 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.051 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.051 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:43.051 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171274+0000", 2024-09-12T18:37:43.052 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0399999999999996e-07 2024-09-12T18:37:43.052 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.052 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.052 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:43.052 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171277+0000", 2024-09-12T18:37:43.052 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8689999999999997e-06 2024-09-12T18:37:43.052 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.052 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.052 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:43.052 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171284+0000", 2024-09-12T18:37:43.052 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2879999999999998e-06 2024-09-12T18:37:43.052 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.052 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.053 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:43.053 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171289+0000", 2024-09-12T18:37:43.053 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9049999999999996e-06 2024-09-12T18:37:43.053 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.053 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.053 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:43.053 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171322+0000", 2024-09-12T18:37:43.053 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3781000000000001e-05 2024-09-12T18:37:43.053 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.053 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.053 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:43.053 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171335+0000", 2024-09-12T18:37:43.053 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2639999999999999e-05 2024-09-12T18:37:43.053 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.054 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.054 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:43.054 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236691+0000", 2024-09-12T18:37:43.054 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065355835000000001 2024-09-12T18:37:43.054 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.054 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.054 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:43.054 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236773+0000", 2024-09-12T18:37:43.054 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2546000000000006e-05 2024-09-12T18:37:43.054 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:43.054 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:43.054 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:43.054 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.055 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.055 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167364 5.7 e58/21 5:ee50096a:::benchmark_data_smithi073_23739_object35087:head v 58'10504, mlcod=58'10502)", 2024-09-12T18:37:43.055 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171598+0000", 2024-09-12T18:37:43.055 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 39.812029866000003, 2024-09-12T18:37:43.055 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065149069000000004, 2024-09-12T18:37:43.055 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:43.055 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:43.055 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:43.055 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:43.055 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.055 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:43.055 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171598+0000", 2024-09-12T18:37:43.055 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:43.055 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.056 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.056 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:43.056 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171598+0000", 2024-09-12T18:37:43.056 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:43.056 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.056 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.056 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:43.056 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171599+0000", 2024-09-12T18:37:43.056 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6700000000000003e-07 2024-09-12T18:37:43.056 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.056 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.056 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:43.056 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171602+0000", 2024-09-12T18:37:43.057 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.841e-06 2024-09-12T18:37:43.057 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.057 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.057 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:43.057 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171608+0000", 2024-09-12T18:37:43.057 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9259999999999997e-06 2024-09-12T18:37:43.057 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.057 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.057 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:43.057 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171611+0000", 2024-09-12T18:37:43.057 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.9450000000000003e-06 2024-09-12T18:37:43.057 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.057 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.057 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:43.058 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171650+0000", 2024-09-12T18:37:43.058 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8464000000000003e-05 2024-09-12T18:37:43.058 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.058 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.058 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:43.058 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171662+0000", 2024-09-12T18:37:43.058 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1603999999999999e-05 2024-09-12T18:37:43.058 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.058 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.058 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:43.058 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236663+0000", 2024-09-12T18:37:43.058 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065001330999999996 2024-09-12T18:37:43.058 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.058 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.059 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:43.059 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236747+0000", 2024-09-12T18:37:43.059 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.4390999999999999e-05 2024-09-12T18:37:43.059 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:43.059 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:43.059 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:43.059 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.059 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.059 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167365 5.2 e58/21 5:4107875c:::benchmark_data_smithi073_23739_object35088:head v 58'10351, mlcod=58'10349)", 2024-09-12T18:37:43.059 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171733+0000", 2024-09-12T18:37:43.059 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 39.811894821000003, 2024-09-12T18:37:43.059 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.074804168000000004, 2024-09-12T18:37:43.059 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:43.060 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:43.060 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:43.060 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:43.060 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.060 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:43.060 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171733+0000", 2024-09-12T18:37:43.060 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:43.060 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.060 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.060 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:43.060 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171733+0000", 2024-09-12T18:37:43.060 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:43.060 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.061 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.061 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:43.061 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171734+0000", 2024-09-12T18:37:43.061 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9299999999999998e-07 2024-09-12T18:37:43.061 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.061 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.061 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:43.061 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171738+0000", 2024-09-12T18:37:43.061 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.301e-06 2024-09-12T18:37:43.061 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.061 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.061 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:43.061 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171746+0000", 2024-09-12T18:37:43.061 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.554e-06 2024-09-12T18:37:43.062 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.062 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.062 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:43.062 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171751+0000", 2024-09-12T18:37:43.062 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1880000000000001e-06 2024-09-12T18:37:43.062 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.062 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.062 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:43.062 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234659+0000", 2024-09-12T18:37:43.062 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062907807999999996 2024-09-12T18:37:43.062 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.062 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.062 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:43.063 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234708+0000", 2024-09-12T18:37:43.063 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8992000000000001e-05 2024-09-12T18:37:43.063 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.063 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.063 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:43.063 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246457+0000", 2024-09-12T18:37:43.063 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.01174974 2024-09-12T18:37:43.063 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.063 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.063 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:43.063 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246537+0000", 2024-09-12T18:37:43.063 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.9992000000000003e-05 2024-09-12T18:37:43.063 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:43.064 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:43.064 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:43.064 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.064 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.064 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167373 5.5 e58/49 5:ad283029:::benchmark_data_smithi073_23739_object35096:head v 58'10600, mlcod=58'10598)", 2024-09-12T18:37:43.064 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:43.064 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 39.811867337000002, 2024-09-12T18:37:43.064 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065058240000000003, 2024-09-12T18:37:43.064 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:43.064 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:43.064 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:43.064 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:43.064 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.065 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:43.065 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:43.065 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:43.065 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.065 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.065 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:43.065 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:43.065 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:43.065 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.065 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.065 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:43.065 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:43.065 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.2899999999999999e-07 2024-09-12T18:37:43.065 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.066 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.066 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:43.066 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171764+0000", 2024-09-12T18:37:43.066 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7310000000000002e-06 2024-09-12T18:37:43.066 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.066 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.066 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:43.066 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171769+0000", 2024-09-12T18:37:43.066 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.079e-06 2024-09-12T18:37:43.066 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.066 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.066 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:43.066 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171774+0000", 2024-09-12T18:37:43.067 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.48e-06 2024-09-12T18:37:43.067 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.067 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.067 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:43.067 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171819+0000", 2024-09-12T18:37:43.067 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4391999999999998e-05 2024-09-12T18:37:43.067 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.067 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.067 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:43.067 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171841+0000", 2024-09-12T18:37:43.067 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2245000000000001e-05 2024-09-12T18:37:43.067 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.067 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.068 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:43.068 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236750+0000", 2024-09-12T18:37:43.068 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064909123999999999 2024-09-12T18:37:43.068 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.068 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.068 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:43.068 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236819+0000", 2024-09-12T18:37:43.068 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8860000000000001e-05 2024-09-12T18:37:43.068 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:43.068 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:43.068 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:43.068 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.068 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.069 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167361 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:43.069 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:43.069 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 39.811811431000002, 2024-09-12T18:37:43.069 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.063049426000000006, 2024-09-12T18:37:43.069 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:43.069 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:43.069 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:43.069 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:43.069 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.069 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:43.069 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:43.069 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:43.069 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.069 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.070 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:43.070 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:43.070 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:43.070 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.070 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.070 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:43.070 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:43.070 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.9099999999999999e-07 2024-09-12T18:37:43.070 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.070 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.070 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:43.070 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171820+0000", 2024-09-12T18:37:43.070 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.5900000000000002e-06 2024-09-12T18:37:43.071 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.071 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.071 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:43.071 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171826+0000", 2024-09-12T18:37:43.071 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.64e-06 2024-09-12T18:37:43.071 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.071 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.071 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:43.071 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171831+0000", 2024-09-12T18:37:43.071 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.578e-06 2024-09-12T18:37:43.071 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.071 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.071 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:43.071 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234808+0000", 2024-09-12T18:37:43.072 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062976780999999996 2024-09-12T18:37:43.072 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.072 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.072 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:43.072 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234821+0000", 2024-09-12T18:37:43.072 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3002e-05 2024-09-12T18:37:43.072 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.072 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.072 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:43.072 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234866+0000", 2024-09-12T18:37:43.072 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5444000000000001e-05 2024-09-12T18:37:43.072 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:43.072 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:43.072 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:43.073 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.073 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.073 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167366 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:43.073 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.172133+0000", 2024-09-12T18:37:43.073 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 39.811494603, 2024-09-12T18:37:43.073 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062815840999999997, 2024-09-12T18:37:43.073 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:43.073 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:43.073 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:43.073 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:43.073 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.073 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:43.073 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172133+0000", 2024-09-12T18:37:43.074 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:43.074 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.074 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.074 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:43.074 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172133+0000", 2024-09-12T18:37:43.074 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:43.074 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.074 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.074 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:43.074 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172134+0000", 2024-09-12T18:37:43.074 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5000000000000003e-07 2024-09-12T18:37:43.074 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.074 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.074 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:43.075 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172137+0000", 2024-09-12T18:37:43.075 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.6460000000000002e-06 2024-09-12T18:37:43.075 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.075 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.075 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:43.075 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234511+0000", 2024-09-12T18:37:43.075 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062374603000000001 2024-09-12T18:37:43.075 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.075 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.075 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:43.075 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234525+0000", 2024-09-12T18:37:43.075 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3396e-05 2024-09-12T18:37:43.075 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.076 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.076 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:43.076 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234909+0000", 2024-09-12T18:37:43.076 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00038405299999999998 2024-09-12T18:37:43.076 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.076 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.076 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:43.076 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234922+0000", 2024-09-12T18:37:43.076 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3274e-05 2024-09-12T18:37:43.076 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.076 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.076 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:43.076 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234949+0000", 2024-09-12T18:37:43.077 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7319000000000001e-05 2024-09-12T18:37:43.077 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:43.077 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:43.077 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:43.077 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.077 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.077 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167369 5.7 e58/21 5:e64ecabd:::benchmark_data_smithi073_23739_object35092:head v 58'10505, mlcod=58'10502)", 2024-09-12T18:37:43.077 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:43.077 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 39.809964211, 2024-09-12T18:37:43.077 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.063873773999999994, 2024-09-12T18:37:43.077 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:43.077 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:43.077 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:43.077 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:43.078 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.078 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:43.078 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:43.078 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:43.078 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.078 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.078 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:43.078 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:43.078 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:43.078 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.078 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.078 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:43.078 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:43.079 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3500000000000002e-07 2024-09-12T18:37:43.079 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.079 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.079 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:43.079 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173668+0000", 2024-09-12T18:37:43.079 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4000000000000001e-06 2024-09-12T18:37:43.079 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.079 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.079 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:43.079 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234583+0000", 2024-09-12T18:37:43.079 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.060914889 2024-09-12T18:37:43.079 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.079 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.080 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:43.080 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234600+0000", 2024-09-12T18:37:43.080 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7192000000000001e-05 2024-09-12T18:37:43.080 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.080 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.080 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:43.080 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234791+0000", 2024-09-12T18:37:43.080 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00019115000000000001 2024-09-12T18:37:43.080 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.080 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.080 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:43.080 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234834+0000", 2024-09-12T18:37:43.080 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3296e-05 2024-09-12T18:37:43.081 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.081 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.081 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:43.081 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.237481+0000", 2024-09-12T18:37:43.081 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0026472050000000001 2024-09-12T18:37:43.081 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.081 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.081 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:43.081 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.237538+0000", 2024-09-12T18:37:43.081 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6206999999999999e-05 2024-09-12T18:37:43.081 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:43.081 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:43.081 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:43.082 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.082 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.082 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:238478 5.c 5:38260ae8:::benchmark_data_smithi073_23739_object106201:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:43.082 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:38.617167+0000", 2024-09-12T18:37:43.082 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4.3664607929999999, 2024-09-12T18:37:43.082 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062584934999999994, 2024-09-12T18:37:43.082 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:43.082 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:43.082 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:43.082 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:43.082 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:43.082 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:43.082 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 238478 2024-09-12T18:37:43.082 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.083 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:43.083 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.083 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:43.083 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.617167+0000", 2024-09-12T18:37:43.083 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:43.083 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.083 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.083 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:43.083 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.617167+0000", 2024-09-12T18:37:43.083 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:43.083 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.083 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.083 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:43.084 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.617168+0000", 2024-09-12T18:37:43.084 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.091e-06 2024-09-12T18:37:43.084 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.084 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.084 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:43.084 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.617173+0000", 2024-09-12T18:37:43.084 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2490000000000003e-06 2024-09-12T18:37:43.084 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.084 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.084 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:43.084 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.617182+0000", 2024-09-12T18:37:43.084 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.6390000000000004e-06 2024-09-12T18:37:43.084 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.084 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.085 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:43.085 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.617189+0000", 2024-09-12T18:37:43.085 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0119999999999999e-06 2024-09-12T18:37:43.085 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.085 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.085 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:43.085 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.617678+0000", 2024-09-12T18:37:43.085 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00048910800000000003 2024-09-12T18:37:43.085 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.085 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.085 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:43.085 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.665641+0000", 2024-09-12T18:37:43.085 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.047962481000000001 2024-09-12T18:37:43.086 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.086 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.086 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:43.086 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.665895+0000", 2024-09-12T18:37:43.086 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00025440199999999998 2024-09-12T18:37:43.086 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.086 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.086 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:43.086 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.670817+0000", 2024-09-12T18:37:43.086 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0049221120000000002 2024-09-12T18:37:43.086 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.086 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.086 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:43.086 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.679695+0000", 2024-09-12T18:37:43.087 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0088778269999999996 2024-09-12T18:37:43.087 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.087 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.087 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:43.087 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.679726+0000", 2024-09-12T18:37:43.087 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.0830999999999997e-05 2024-09-12T18:37:43.087 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.087 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.087 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:43.087 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.679752+0000", 2024-09-12T18:37:43.087 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.6183e-05 2024-09-12T18:37:43.087 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:43.087 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:43.087 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:43.088 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.088 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.088 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:238480 5.c 5:3d043cef:::benchmark_data_smithi073_23739_object106203:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:43.088 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:38.618189+0000", 2024-09-12T18:37:43.088 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 4.3654389870000001, 2024-09-12T18:37:43.088 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.061642400999999999, 2024-09-12T18:37:43.088 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:43.088 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:43.088 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:43.088 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:43.088 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:43.088 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:43.088 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 238480 2024-09-12T18:37:43.089 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.089 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:43.089 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.089 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:43.089 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.618189+0000", 2024-09-12T18:37:43.089 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:43.089 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.089 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.089 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:43.089 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.618189+0000", 2024-09-12T18:37:43.089 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:43.089 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.089 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.090 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:43.090 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.618190+0000", 2024-09-12T18:37:43.090 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3e-07 2024-09-12T18:37:43.090 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.090 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.090 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:43.090 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.618193+0000", 2024-09-12T18:37:43.090 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.6349999999999999e-06 2024-09-12T18:37:43.090 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.090 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.090 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:43.090 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.665526+0000", 2024-09-12T18:37:43.090 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.047332200999999997 2024-09-12T18:37:43.090 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.091 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.091 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:43.091 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.665561+0000", 2024-09-12T18:37:43.091 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.5858999999999997e-05 2024-09-12T18:37:43.091 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.091 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.091 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:43.091 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.670869+0000", 2024-09-12T18:37:43.091 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0053076720000000003 2024-09-12T18:37:43.091 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.091 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.091 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:43.091 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.671094+0000", 2024-09-12T18:37:43.091 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000225009 2024-09-12T18:37:43.092 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.092 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.092 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:43.092 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.671272+0000", 2024-09-12T18:37:43.092 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000177725 2024-09-12T18:37:43.092 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.092 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.092 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:43.092 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.679687+0000", 2024-09-12T18:37:43.092 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0084148379999999991 2024-09-12T18:37:43.092 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.092 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.092 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:43.092 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.679787+0000", 2024-09-12T18:37:43.093 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.9950000000000004e-05 2024-09-12T18:37:43.093 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.093 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.093 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:43.093 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.679811+0000", 2024-09-12T18:37:43.093 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4088999999999999e-05 2024-09-12T18:37:43.093 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:43.093 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:43.093 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:43.093 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.679831+0000", 2024-09-12T18:37:43.093 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.0693e-05 2024-09-12T18:37:43.093 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:43.093 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:43.093 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:43.094 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:43.094 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:43.094 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:43.095 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:37:43.096 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:43.089+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:43.186 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:37:43.195 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:43.190+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:43.249 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:43.249 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:37:43.249 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.249 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:248559 5.b 5:d66f65ab:::benchmark_data_smithi073_23739_object116282:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-12T18:37:43.249 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:43.243169+0000", 2024-09-12T18:37:43.249 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0026508859999999999, 2024-09-12T18:37:43.249 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0026687820000000002, 2024-09-12T18:37:43.249 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:43.249 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:43.249 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:43.249 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:43.249 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:43.249 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:43.250 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 248559 2024-09-12T18:37:43.250 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.250 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:43.250 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.250 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:43.250 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.243169+0000", 2024-09-12T18:37:43.250 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:43.250 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.250 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.250 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:43.250 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.243169+0000", 2024-09-12T18:37:43.250 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:43.250 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.250 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.251 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:43.251 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.243170+0000", 2024-09-12T18:37:43.251 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.37e-07 2024-09-12T18:37:43.251 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.251 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.251 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:43.251 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.243172+0000", 2024-09-12T18:37:43.251 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.3700000000000002e-06 2024-09-12T18:37:43.251 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.251 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.251 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:43.251 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.243188+0000", 2024-09-12T18:37:43.251 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5661000000000001e-05 2024-09-12T18:37:43.251 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.252 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.252 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:43.252 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.243193+0000", 2024-09-12T18:37:43.252 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.339e-06 2024-09-12T18:37:43.252 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.252 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.252 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:43.252 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.243240+0000", 2024-09-12T18:37:43.252 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6564999999999999e-05 2024-09-12T18:37:43.252 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.252 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.252 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:43.253 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.243354+0000", 2024-09-12T18:37:43.253 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000113751 2024-09-12T18:37:43.253 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.253 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.253 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:43.253 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.243480+0000", 2024-09-12T18:37:43.253 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000126138 2024-09-12T18:37:43.253 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:43.253 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:43.253 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:43.253 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.253 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.253 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:248562 5.d 5:bfaf43af:::benchmark_data_smithi073_23739_object116285:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-12T18:37:43.254 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:43.245550+0000", 2024-09-12T18:37:43.254 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00026990800000000002, 2024-09-12T18:37:43.254 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00034970800000000001, 2024-09-12T18:37:43.254 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:43.254 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:43.254 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:43.254 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:43.254 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:43.254 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:43.254 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 248562 2024-09-12T18:37:43.254 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.254 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:43.254 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.254 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:43.254 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.245550+0000", 2024-09-12T18:37:43.255 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:43.255 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.255 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.255 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:43.255 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.245550+0000", 2024-09-12T18:37:43.255 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:43.255 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.255 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.255 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:43.255 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.245551+0000", 2024-09-12T18:37:43.255 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7199999999999997e-07 2024-09-12T18:37:43.255 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.255 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.256 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:43.256 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.245555+0000", 2024-09-12T18:37:43.256 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9960000000000004e-06 2024-09-12T18:37:43.256 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.256 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.256 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:43.256 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.245564+0000", 2024-09-12T18:37:43.256 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.1600000000000004e-06 2024-09-12T18:37:43.256 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.256 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.256 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:43.256 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.245570+0000", 2024-09-12T18:37:43.256 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5759999999999996e-06 2024-09-12T18:37:43.256 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.257 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.257 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:43.257 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.245619+0000", 2024-09-12T18:37:43.257 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9193999999999997e-05 2024-09-12T18:37:43.257 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.257 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.257 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:43.257 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.245703+0000", 2024-09-12T18:37:43.257 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3280000000000002e-05 2024-09-12T18:37:43.257 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.257 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.257 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:43.257 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.245771+0000", 2024-09-12T18:37:43.258 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8668000000000001e-05 2024-09-12T18:37:43.258 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:43.258 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:43.258 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:43.258 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.258 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.258 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:248552 5.4 5:20e30c48:::benchmark_data_smithi073_23739_object116275:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-12T18:37:43.258 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:43.239655+0000", 2024-09-12T18:37:43.258 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0061652139999999996, 2024-09-12T18:37:43.258 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0062957509999999996, 2024-09-12T18:37:43.258 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:43.258 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:43.258 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:43.258 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:43.259 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:43.259 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:43.259 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 248552 2024-09-12T18:37:43.259 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.259 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:43.259 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.259 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:43.259 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.239655+0000", 2024-09-12T18:37:43.259 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:43.259 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.259 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.259 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:43.259 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.239655+0000", 2024-09-12T18:37:43.260 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:43.260 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.260 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.260 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:43.260 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.239656+0000", 2024-09-12T18:37:43.260 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.9299999999999998e-07 2024-09-12T18:37:43.260 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.260 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.260 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:43.260 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.239659+0000", 2024-09-12T18:37:43.260 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9100000000000001e-06 2024-09-12T18:37:43.260 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.260 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.260 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:43.261 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.239666+0000", 2024-09-12T18:37:43.261 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2450000000000001e-06 2024-09-12T18:37:43.261 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.261 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.261 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:43.261 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.239671+0000", 2024-09-12T18:37:43.261 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1959999999999999e-06 2024-09-12T18:37:43.261 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.261 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.261 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:43.261 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.239917+0000", 2024-09-12T18:37:43.261 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00024625200000000003 2024-09-12T18:37:43.261 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.262 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.262 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:43.262 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.240042+0000", 2024-09-12T18:37:43.262 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012438099999999999 2024-09-12T18:37:43.262 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.262 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.262 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:43.262 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.240170+0000", 2024-09-12T18:37:43.262 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000128546 2024-09-12T18:37:43.262 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.262 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.262 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:43.262 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.244784+0000", 2024-09-12T18:37:43.262 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0046136079999999999 2024-09-12T18:37:43.262 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:43.263 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:43.263 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:43.263 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.263 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.263 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:248553 5.b 5:d9383801:::benchmark_data_smithi073_23739_object116276:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-12T18:37:43.263 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:43.240400+0000", 2024-09-12T18:37:43.263 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0054207320000000002, 2024-09-12T18:37:43.263 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0056046359999999996, 2024-09-12T18:37:43.263 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:43.263 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:43.263 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:43.263 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:43.263 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:43.263 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:43.264 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 248553 2024-09-12T18:37:43.264 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.264 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:43.264 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.264 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:43.264 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.240400+0000", 2024-09-12T18:37:43.264 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:43.264 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.264 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.264 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:43.264 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.240400+0000", 2024-09-12T18:37:43.264 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:43.264 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.264 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.265 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:43.265 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.240401+0000", 2024-09-12T18:37:43.265 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.006e-06 2024-09-12T18:37:43.265 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.265 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.265 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:43.265 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.240405+0000", 2024-09-12T18:37:43.265 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8160000000000001e-06 2024-09-12T18:37:43.265 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.265 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.265 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:43.265 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.240417+0000", 2024-09-12T18:37:43.265 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1698e-05 2024-09-12T18:37:43.266 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.266 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.266 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:43.266 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.240426+0000", 2024-09-12T18:37:43.266 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.0440000000000001e-06 2024-09-12T18:37:43.266 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.266 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.266 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:43.266 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.240466+0000", 2024-09-12T18:37:43.266 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0241000000000003e-05 2024-09-12T18:37:43.266 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.266 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.266 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:43.267 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.240585+0000", 2024-09-12T18:37:43.267 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000118637 2024-09-12T18:37:43.267 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.267 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.267 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:43.267 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.240685+0000", 2024-09-12T18:37:43.267 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9895999999999994e-05 2024-09-12T18:37:43.267 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:43.267 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:43.267 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:43.267 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.267 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.267 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:248554 5.d 5:bc0dec0e:::benchmark_data_smithi073_23739_object116277:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-12T18:37:43.268 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:43.240675+0000", 2024-09-12T18:37:43.268 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0051450630000000001, 2024-09-12T18:37:43.268 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0053765560000000002, 2024-09-12T18:37:43.268 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:43.268 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:43.268 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:43.268 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:43.268 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:43.268 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:43.268 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 248554 2024-09-12T18:37:43.268 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.268 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:43.268 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.269 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:43.269 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.240675+0000", 2024-09-12T18:37:43.269 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:43.269 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.269 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.269 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:43.269 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.240675+0000", 2024-09-12T18:37:43.269 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:43.269 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.269 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.269 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:43.269 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.240676+0000", 2024-09-12T18:37:43.269 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.9100000000000002e-07 2024-09-12T18:37:43.270 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.270 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.270 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:43.270 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.240681+0000", 2024-09-12T18:37:43.270 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5059999999999997e-06 2024-09-12T18:37:43.270 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.270 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.270 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:43.270 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.240696+0000", 2024-09-12T18:37:43.270 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5082999999999999e-05 2024-09-12T18:37:43.270 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.270 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.270 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:43.271 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.240705+0000", 2024-09-12T18:37:43.271 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.3370000000000006e-06 2024-09-12T18:37:43.271 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.271 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.271 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:43.271 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.240765+0000", 2024-09-12T18:37:43.271 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.9914999999999998e-05 2024-09-12T18:37:43.271 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.271 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.271 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:43.271 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.240891+0000", 2024-09-12T18:37:43.271 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012592899999999999 2024-09-12T18:37:43.271 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.271 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.272 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:43.272 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.240993+0000", 2024-09-12T18:37:43.272 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010163899999999999 2024-09-12T18:37:43.272 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:43.272 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:43.272 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:43.272 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.272 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.272 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:248556 5.5 e77/73 5:a94ead32:::benchmark_data_smithi073_23739_object116279:head v 77'15741, mlcod=77'15739)", 2024-09-12T18:37:43.272 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:43.241136+0000", 2024-09-12T18:37:43.272 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0046839830000000001, 2024-09-12T18:37:43.272 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0049624689999999997, 2024-09-12T18:37:43.272 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:43.272 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:43.273 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:37:43.273 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:43.273 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.273 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:43.273 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.241136+0000", 2024-09-12T18:37:43.273 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:43.273 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.273 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.273 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:43.273 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.241136+0000", 2024-09-12T18:37:43.273 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:43.273 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.273 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.273 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:43.274 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.241137+0000", 2024-09-12T18:37:43.274 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2900000000000003e-07 2024-09-12T18:37:43.274 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.274 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.274 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:43.274 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.241141+0000", 2024-09-12T18:37:43.274 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3719999999999998e-06 2024-09-12T18:37:43.274 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.274 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.274 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:43.274 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.241152+0000", 2024-09-12T18:37:43.274 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.094e-05 2024-09-12T18:37:43.274 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.275 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.275 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:43.275 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.241159+0000", 2024-09-12T18:37:43.275 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.246e-06 2024-09-12T18:37:43.275 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.275 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.275 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:43.275 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.241207+0000", 2024-09-12T18:37:43.275 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8367e-05 2024-09-12T18:37:43.275 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.275 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.275 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:43.275 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.241225+0000", 2024-09-12T18:37:43.276 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.7850999999999999e-05 2024-09-12T18:37:43.276 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:43.276 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:43.276 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:43.276 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.276 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.276 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:248555 5.1 e77/65 5:8abd23d3:::benchmark_data_smithi073_23739_object116278:head v 77'15489, mlcod=77'15487)", 2024-09-12T18:37:43.276 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:43.241181+0000", 2024-09-12T18:37:43.276 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0046389059999999999, 2024-09-12T18:37:43.276 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0049562110000000003, 2024-09-12T18:37:43.276 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:43.276 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:43.276 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:37:43.276 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:43.277 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.277 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:43.277 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.241181+0000", 2024-09-12T18:37:43.277 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:43.277 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.277 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.277 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:43.277 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.241181+0000", 2024-09-12T18:37:43.277 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:43.277 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.277 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.278 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:43.278 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.241182+0000", 2024-09-12T18:37:43.278 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.4999999999999998e-07 2024-09-12T18:37:43.278 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.278 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.278 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:43.278 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.241185+0000", 2024-09-12T18:37:43.278 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3510000000000002e-06 2024-09-12T18:37:43.278 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.278 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.278 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:43.278 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.241192+0000", 2024-09-12T18:37:43.279 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1729999999999998e-06 2024-09-12T18:37:43.279 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.279 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.279 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:43.279 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.241197+0000", 2024-09-12T18:37:43.279 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8470000000000003e-06 2024-09-12T18:37:43.279 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.279 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.279 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:43.279 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.241307+0000", 2024-09-12T18:37:43.279 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000109589 2024-09-12T18:37:43.279 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.279 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.280 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:43.280 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.241322+0000", 2024-09-12T18:37:43.280 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.5167999999999999e-05 2024-09-12T18:37:43.280 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:43.280 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:43.280 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:43.280 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.280 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.280 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:248547 5.f e77/21 5:f8c6afd1:::benchmark_data_smithi073_23739_object116270:head v 77'15315, mlcod=77'15312)", 2024-09-12T18:37:43.280 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:43.241239+0000", 2024-09-12T18:37:43.280 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0045812759999999996, 2024-09-12T18:37:43.280 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0049386940000000004, 2024-09-12T18:37:43.280 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:43.281 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:43.281 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:37:43.281 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:43.281 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.281 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:43.281 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.241239+0000", 2024-09-12T18:37:43.281 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:43.281 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.281 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.281 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:43.281 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.241239+0000", 2024-09-12T18:37:43.281 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:43.281 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.282 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.282 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:43.282 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.241240+0000", 2024-09-12T18:37:43.282 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.8699999999999995e-07 2024-09-12T18:37:43.282 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.282 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.282 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:43.282 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.241244+0000", 2024-09-12T18:37:43.282 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.929e-06 2024-09-12T18:37:43.282 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.282 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.282 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:43.282 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.241251+0000", 2024-09-12T18:37:43.282 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5469999999999999e-06 2024-09-12T18:37:43.283 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.283 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.283 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:43.283 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.241257+0000", 2024-09-12T18:37:43.283 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6779999999999997e-06 2024-09-12T18:37:43.283 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.283 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.283 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:43.283 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.241314+0000", 2024-09-12T18:37:43.283 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7204000000000003e-05 2024-09-12T18:37:43.283 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.283 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.283 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:43.284 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.241326+0000", 2024-09-12T18:37:43.284 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2261e-05 2024-09-12T18:37:43.284 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:43.284 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:43.284 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:43.284 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.284 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.284 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:248558 5.8 5:10d4d418:::benchmark_data_smithi073_23739_object116281:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-12T18:37:43.284 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:43.243123+0000", 2024-09-12T18:37:43.284 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0026973420000000001, 2024-09-12T18:37:43.284 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0030935709999999998, 2024-09-12T18:37:43.284 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:43.284 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:43.285 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:43.285 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:43.285 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:43.285 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:43.285 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 248558 2024-09-12T18:37:43.285 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.285 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:43.285 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.285 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:43.285 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.243123+0000", 2024-09-12T18:37:43.285 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:43.285 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.285 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.286 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:43.286 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.243123+0000", 2024-09-12T18:37:43.286 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:43.286 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.286 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.286 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:43.286 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.243125+0000", 2024-09-12T18:37:43.286 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.4890000000000001e-06 2024-09-12T18:37:43.286 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.286 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.286 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:43.286 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.243129+0000", 2024-09-12T18:37:43.286 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.831e-06 2024-09-12T18:37:43.287 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.287 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.287 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:43.287 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.243141+0000", 2024-09-12T18:37:43.287 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1979e-05 2024-09-12T18:37:43.287 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.287 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.287 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:43.287 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.243150+0000", 2024-09-12T18:37:43.287 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4489999999999999e-06 2024-09-12T18:37:43.287 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.287 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.287 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:43.287 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.243207+0000", 2024-09-12T18:37:43.288 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7704999999999997e-05 2024-09-12T18:37:43.288 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.288 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.288 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:43.288 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.243347+0000", 2024-09-12T18:37:43.288 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013992099999999999 2024-09-12T18:37:43.288 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:43.288 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:43.288 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:43.288 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:43.243480+0000", 2024-09-12T18:37:43.288 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013244400000000001 2024-09-12T18:37:43.288 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:43.288 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:43.288 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:43.289 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:43.289 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-09-12T18:37:43.289 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 9 2024-09-12T18:37:43.289 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:43.290 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:37:43.296 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:43.293+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:43.343 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:37:43.343 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:37:43.361 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:37:43.361 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:37:43.378 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:37:43.378 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:37:43.397 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:43.391+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:43.445 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:43.446 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:43.465 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:37:43.498 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:43.493+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:43.566 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:37:43.566 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:37:43.566 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-12T18:37:43.566 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T18:37:43.599 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:43.593+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:43.658 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:43.659 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:43.678 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:37:43.700 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:43.695+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:43.801 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:43.795+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:43.833 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:43.833 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:43.858 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:37:43.898 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:37:43.898 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T18:37:43.898 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 77, 2024-09-12T18:37:43.898 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "c08d5a84-711b-44bf-bdf1-e06ecc2c7c00", 2024-09-12T18:37:43.898 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-12T18:35:02.695853+0000", 2024-09-12T18:37:43.898 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-12T18:37:42.475580+0000", 2024-09-12T18:37:43.899 INFO:teuthology.orchestra.run.smithi073.stdout: "last_up_change": "2024-09-12T18:35:12.464628+0000", 2024-09-12T18:37:43.899 INFO:teuthology.orchestra.run.smithi073.stdout: "last_in_change": "2024-09-12T18:35:04.352525+0000", 2024-09-12T18:37:43.899 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T18:37:43.899 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_num": 5801984, 2024-09-12T18:37:43.899 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_set": [ 2024-09-12T18:37:43.899 INFO:teuthology.orchestra.run.smithi073.stdout: "noscrub", 2024-09-12T18:37:43.899 INFO:teuthology.orchestra.run.smithi073.stdout: "pglog_hardlimit", 2024-09-12T18:37:43.899 INFO:teuthology.orchestra.run.smithi073.stdout: "purged_snapdirs", 2024-09-12T18:37:43.899 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_deletes", 2024-09-12T18:37:43.899 INFO:teuthology.orchestra.run.smithi073.stdout: "sortbitwise" 2024-09-12T18:37:43.899 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T18:37:43.899 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_version": 5, 2024-09-12T18:37:43.899 INFO:teuthology.orchestra.run.smithi073.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T18:37:43.900 INFO:teuthology.orchestra.run.smithi073.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T18:37:43.900 INFO:teuthology.orchestra.run.smithi073.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T18:37:43.900 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_snapshot": "", 2024-09-12T18:37:43.900 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_max": 5, 2024-09-12T18:37:43.900 INFO:teuthology.orchestra.run.smithi073.stdout: "max_osd": 3, 2024-09-12T18:37:43.900 INFO:teuthology.orchestra.run.smithi073.stdout: "require_min_compat_client": "luminous", 2024-09-12T18:37:43.900 INFO:teuthology.orchestra.run.smithi073.stdout: "min_compat_client": "luminous", 2024-09-12T18:37:43.900 INFO:teuthology.orchestra.run.smithi073.stdout: "require_osd_release": "squid", 2024-09-12T18:37:43.901 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_crimson": false, 2024-09-12T18:37:43.901 INFO:teuthology.orchestra.run.smithi073.stdout: "pools": [ 2024-09-12T18:37:43.901 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:43.901 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 1, 2024-09-12T18:37:43.901 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": ".mgr", 2024-09-12T18:37:43.901 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:12.418430+0000", 2024-09-12T18:37:43.901 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-12T18:37:43.901 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-09-12T18:37:43.901 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:37:43.901 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:37:43.901 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:37:43.901 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:37:43.901 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:37:43.902 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:37:43.902 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:37:43.902 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:37:43.902 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:37:43.902 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:37:43.902 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:37:43.902 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 1, 2024-09-12T18:37:43.902 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 1, 2024-09-12T18:37:43.902 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 1, 2024-09-12T18:37:43.902 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 1, 2024-09-12T18:37:43.902 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 1, 2024-09-12T18:37:43.902 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:37:43.902 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:37:43.902 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:37:43.903 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:37:43.903 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:37:43.903 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:37:43.903 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:37:43.903 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.903 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "11", 2024-09-12T18:37:43.903 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:37:43.903 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:37:43.903 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:37:43.903 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:37:43.903 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:37:43.903 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-09-12T18:37:43.903 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-09-12T18:37:43.904 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:37:43.904 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:37:43.904 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:37:43.904 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:37:43.904 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:37:43.904 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:37:43.904 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:37:43.904 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:37:43.904 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:37:43.904 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:37:43.904 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:37:43.904 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:37:43.906 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:37:43.906 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:37:43.906 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:37:43.906 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:37:43.906 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:37:43.906 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:37:43.906 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:37:43.906 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.906 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:37:43.906 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:37:43.906 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:37:43.906 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:37:43.907 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:37:43.907 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:37:43.907 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:37:43.907 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:37:43.907 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:37:43.907 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:37:43.907 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:37:43.907 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-09-12T18:37:43.907 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_max": 32, 2024-09-12T18:37:43.907 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 1 2024-09-12T18:37:43.907 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.907 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:37:43.907 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": {} 2024-09-12T18:37:43.908 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.908 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:37:43.908 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:37:43.908 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 2.9900000095367432, 2024-09-12T18:37:43.908 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 2.9900000095367432, 2024-09-12T18:37:43.908 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 0.67000001668930054, 2024-09-12T18:37:43.908 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 2, 2024-09-12T18:37:43.908 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 2, 2024-09-12T18:37:43.908 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:37:43.908 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:37:43.908 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:37:43.908 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:43.908 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.909 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:43.909 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 2, 2024-09-12T18:37:43.909 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "rbd", 2024-09-12T18:37:43.909 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:18.665309+0000", 2024-09-12T18:37:43.909 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 8193, 2024-09-12T18:37:43.909 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T18:37:43.909 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:37:43.909 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:37:43.909 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:37:43.909 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:37:43.909 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:37:43.909 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:37:43.909 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:37:43.910 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:37:43.910 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:37:43.910 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:37:43.910 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:37:43.910 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 8, 2024-09-12T18:37:43.910 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 8, 2024-09-12T18:37:43.910 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 8, 2024-09-12T18:37:43.910 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 8, 2024-09-12T18:37:43.910 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 8, 2024-09-12T18:37:43.910 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:37:43.910 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:37:43.910 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:37:43.911 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:37:43.911 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:37:43.911 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:37:43.911 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:37:43.911 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.911 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "15", 2024-09-12T18:37:43.911 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:37:43.911 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:37:43.911 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:37:43.911 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:37:43.911 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:37:43.911 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 2, 2024-09-12T18:37:43.911 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 15, 2024-09-12T18:37:43.912 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:37:43.912 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:37:43.912 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:37:43.912 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:37:43.912 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:37:43.912 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:37:43.912 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:37:43.912 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:37:43.912 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:37:43.912 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:37:43.912 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:37:43.913 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:37:43.913 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:37:43.913 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:37:43.913 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:37:43.913 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:37:43.913 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:37:43.913 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:37:43.913 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:37:43.913 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.913 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:37:43.913 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:37:43.913 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:37:43.914 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:37:43.914 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:37:43.914 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:37:43.914 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:37:43.914 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:37:43.914 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:37:43.914 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:37:43.914 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:37:43.914 INFO:teuthology.orchestra.run.smithi073.stdout: "options": {}, 2024-09-12T18:37:43.914 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:37:43.914 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd": {} 2024-09-12T18:37:43.914 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.914 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:37:43.914 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:37:43.915 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.8799999952316284, 2024-09-12T18:37:43.915 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.8799999952316284, 2024-09-12T18:37:43.915 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-09-12T18:37:43.915 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.8799999952316284, 2024-09-12T18:37:43.915 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.8799999952316284, 2024-09-12T18:37:43.915 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:37:43.915 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:37:43.915 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:37:43.915 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:43.915 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.915 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:43.915 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 3, 2024-09-12T18:37:43.915 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "cephfs_metadata", 2024-09-12T18:37:43.915 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:23.447845+0000", 2024-09-12T18:37:43.916 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-12T18:37:43.916 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-09-12T18:37:43.916 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:37:43.916 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:37:43.916 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:37:43.916 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:37:43.916 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:37:43.916 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:37:43.916 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:37:43.916 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:37:43.916 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:37:43.916 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:37:43.916 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:37:43.916 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 32, 2024-09-12T18:37:43.917 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 32, 2024-09-12T18:37:43.917 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 32, 2024-09-12T18:37:43.917 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 32, 2024-09-12T18:37:43.917 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 32, 2024-09-12T18:37:43.917 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:37:43.917 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:37:43.917 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:37:43.917 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:37:43.917 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:37:43.917 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:37:43.917 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:37:43.917 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.917 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "18", 2024-09-12T18:37:43.918 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:37:43.918 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:37:43.918 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:37:43.918 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:37:43.918 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:37:43.918 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-09-12T18:37:43.918 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-09-12T18:37:43.918 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:37:43.918 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:37:43.918 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:37:43.918 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:37:43.918 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:37:43.918 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:37:43.919 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:37:43.919 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:37:43.919 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:37:43.919 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:37:43.919 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:37:43.919 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:37:43.919 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:37:43.919 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:37:43.919 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:37:43.919 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:37:43.919 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:37:43.919 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:37:43.919 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:37:43.919 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.920 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:37:43.920 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:37:43.920 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:37:43.920 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:37:43.920 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:37:43.920 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:37:43.920 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:37:43.920 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:37:43.920 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:37:43.920 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:37:43.920 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:37:43.920 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-09-12T18:37:43.920 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_bias": 4, 2024-09-12T18:37:43.921 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 16, 2024-09-12T18:37:43.921 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_priority": 5 2024-09-12T18:37:43.921 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.921 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:37:43.921 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs": { 2024-09-12T18:37:43.921 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": "cephfs" 2024-09-12T18:37:43.921 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:43.921 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.921 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:37:43.921 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:37:43.921 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.4099999666213989, 2024-09-12T18:37:43.921 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.4099999666213989, 2024-09-12T18:37:43.921 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-09-12T18:37:43.922 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.4099999666213989, 2024-09-12T18:37:43.922 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.4099999666213989, 2024-09-12T18:37:43.922 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:37:43.922 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:37:43.922 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:37:43.922 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:43.922 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.922 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:43.922 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 4, 2024-09-12T18:37:43.922 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "cephfs_data", 2024-09-12T18:37:43.922 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:23.959973+0000", 2024-09-12T18:37:43.922 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-12T18:37:43.922 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-09-12T18:37:43.923 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:37:43.923 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:37:43.923 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:37:43.923 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:37:43.923 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:37:43.923 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:37:43.923 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:37:43.923 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:37:43.923 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:37:43.923 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:37:43.923 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:37:43.923 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 64, 2024-09-12T18:37:43.923 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 64, 2024-09-12T18:37:43.923 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 64, 2024-09-12T18:37:43.924 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 64, 2024-09-12T18:37:43.924 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 64, 2024-09-12T18:37:43.924 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:37:43.924 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:37:43.924 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:37:43.924 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:37:43.924 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:37:43.924 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:37:43.924 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:37:43.925 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.925 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "19", 2024-09-12T18:37:43.925 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:37:43.925 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:37:43.925 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:37:43.925 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:37:43.925 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:37:43.925 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-09-12T18:37:43.925 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-09-12T18:37:43.925 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:37:43.925 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:37:43.925 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:37:43.925 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:37:43.925 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:37:43.926 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:37:43.926 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:37:43.926 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:37:43.926 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:37:43.926 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:37:43.926 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:37:43.926 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:37:43.926 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:37:43.926 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:37:43.926 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:37:43.926 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:37:43.926 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:37:43.926 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:37:43.927 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:37:43.927 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.927 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:37:43.927 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:37:43.927 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:37:43.927 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:37:43.927 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:37:43.927 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:37:43.927 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:37:43.927 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:37:43.927 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:37:43.927 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:37:43.927 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:37:43.928 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-09-12T18:37:43.928 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 64, 2024-09-12T18:37:43.928 INFO:teuthology.orchestra.run.smithi073.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T18:37:43.928 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.928 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:37:43.928 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs": { 2024-09-12T18:37:43.928 INFO:teuthology.orchestra.run.smithi073.stdout: "data": "cephfs" 2024-09-12T18:37:43.928 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:43.928 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.928 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:37:43.928 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:37:43.928 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.4099999666213989, 2024-09-12T18:37:43.928 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.4099999666213989, 2024-09-12T18:37:43.929 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-09-12T18:37:43.929 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.4099999666213989, 2024-09-12T18:37:43.929 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.4099999666213989, 2024-09-12T18:37:43.929 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:37:43.929 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:37:43.929 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:37:43.929 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:43.929 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.929 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:43.929 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 5, 2024-09-12T18:37:43.929 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "unique_pool_0", 2024-09-12T18:37:43.929 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-09-12T18:35:43.562347+0000", 2024-09-12T18:37:43.929 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-09-12T18:37:43.930 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-09-12T18:37:43.930 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-09-12T18:37:43.930 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-09-12T18:37:43.930 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-09-12T18:37:43.930 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-09-12T18:37:43.930 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:37:43.930 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:37:43.930 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:37:43.930 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:37:43.930 INFO:teuthology.orchestra.run.smithi073.stdout: "is_stretch_pool": false, 2024-09-12T18:37:43.930 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-09-12T18:37:43.930 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:37:43.930 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 16, 2024-09-12T18:37:43.931 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 16, 2024-09-12T18:37:43.931 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 16, 2024-09-12T18:37:43.931 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 16, 2024-09-12T18:37:43.931 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 16, 2024-09-12T18:37:43.931 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-09-12T18:37:43.931 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-09-12T18:37:43.931 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-09-12T18:37:43.931 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-09-12T18:37:43.931 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-09-12T18:37:43.931 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-09-12T18:37:43.931 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-09-12T18:37:43.931 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.931 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "23", 2024-09-12T18:37:43.931 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-09-12T18:37:43.932 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:37:43.932 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:37:43.932 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-09-12T18:37:43.932 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:37:43.932 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-09-12T18:37:43.932 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-09-12T18:37:43.932 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-09-12T18:37:43.932 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-09-12T18:37:43.932 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-09-12T18:37:43.932 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-09-12T18:37:43.932 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-09-12T18:37:43.932 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-09-12T18:37:43.932 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-09-12T18:37:43.933 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-09-12T18:37:43.933 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-09-12T18:37:43.933 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-09-12T18:37:43.933 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-09-12T18:37:43.933 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:37:43.933 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:37:43.933 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:37:43.933 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-09-12T18:37:43.933 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-09-12T18:37:43.933 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-09-12T18:37:43.933 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-09-12T18:37:43.933 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-09-12T18:37:43.933 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.934 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-09-12T18:37:43.934 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-09-12T18:37:43.934 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-09-12T18:37:43.934 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:37:43.934 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:37:43.934 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:37:43.934 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:37:43.934 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-09-12T18:37:43.934 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-09-12T18:37:43.934 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-09-12T18:37:43.934 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-09-12T18:37:43.934 INFO:teuthology.orchestra.run.smithi073.stdout: "options": {}, 2024-09-12T18:37:43.934 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-09-12T18:37:43.934 INFO:teuthology.orchestra.run.smithi073.stdout: "rados": {} 2024-09-12T18:37:43.934 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.935 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-09-12T18:37:43.935 INFO:teuthology.orchestra.run.smithi073.stdout: "score_type": "Fair distribution", 2024-09-12T18:37:43.935 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.1299999952316284, 2024-09-12T18:37:43.935 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.1299999952316284, 2024-09-12T18:37:43.935 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-09-12T18:37:43.935 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T18:37:43.935 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T18:37:43.935 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:37:43.935 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-09-12T18:37:43.935 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:37:43.935 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:43.935 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:43.936 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T18:37:43.936 INFO:teuthology.orchestra.run.smithi073.stdout: "osds": [ 2024-09-12T18:37:43.936 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:43.936 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-09-12T18:37:43.936 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "f1cf24e8-6179-4666-a444-fa81ef0d7482", 2024-09-12T18:37:43.936 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-09-12T18:37:43.936 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-09-12T18:37:43.936 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0.6371612548828125, 2024-09-12T18:37:43.936 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-09-12T18:37:43.936 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-09-12T18:37:43.936 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-09-12T18:37:43.936 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-09-12T18:37:43.936 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 21, 2024-09-12T18:37:43.937 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-09-12T18:37:43.937 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-09-12T18:37:43.937 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-12T18:37:43.937 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:43.937 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:43.937 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:43.937 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6800", 2024-09-12T18:37:43.937 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:37:43.937 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.938 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:43.938 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:43.938 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6801", 2024-09-12T18:37:43.938 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:37:43.938 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:43.938 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:43.938 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.938 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-09-12T18:37:43.938 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:43.938 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:43.938 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:43.938 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6802", 2024-09-12T18:37:43.938 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:37:43.938 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.939 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:43.939 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:43.939 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6803", 2024-09-12T18:37:43.939 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:37:43.939 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:43.939 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:43.939 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.939 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-09-12T18:37:43.939 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:43.939 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:43.939 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:43.939 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6806", 2024-09-12T18:37:43.939 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:37:43.939 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.940 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:43.940 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:43.940 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6807", 2024-09-12T18:37:43.940 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:37:43.940 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:43.940 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:43.940 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.940 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-09-12T18:37:43.940 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:43.940 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:43.940 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:43.940 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6804", 2024-09-12T18:37:43.940 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:37:43.941 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.941 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:43.941 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:43.941 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.114:6805", 2024-09-12T18:37:43.941 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2710632206 2024-09-12T18:37:43.941 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:43.942 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:43.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.942 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.114:6801/2710632206", 2024-09-12T18:37:43.942 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.114:6803/2710632206", 2024-09-12T18:37:43.942 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.114:6807/2710632206", 2024-09-12T18:37:43.942 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.114:6805/2710632206", 2024-09-12T18:37:43.942 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-09-12T18:37:43.942 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-09-12T18:37:43.942 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-09-12T18:37:43.942 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:43.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.942 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:43.942 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-09-12T18:37:43.943 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "3fdb0044-2820-4411-978b-4b6e94fbf0b1", 2024-09-12T18:37:43.943 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-09-12T18:37:43.943 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-09-12T18:37:43.943 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-09-12T18:37:43.943 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-09-12T18:37:43.943 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-09-12T18:37:43.943 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-09-12T18:37:43.943 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 9, 2024-09-12T18:37:43.943 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 65, 2024-09-12T18:37:43.943 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-09-12T18:37:43.943 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-09-12T18:37:43.943 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-12T18:37:43.943 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:43.943 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:43.944 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:43.944 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6800", 2024-09-12T18:37:43.944 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:37:43.944 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.944 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:43.944 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:43.944 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6801", 2024-09-12T18:37:43.944 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:37:43.944 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:43.944 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:43.945 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.945 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-09-12T18:37:43.945 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:43.945 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:43.945 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:43.945 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6802", 2024-09-12T18:37:43.945 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:37:43.945 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.945 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:43.946 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:43.946 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6803", 2024-09-12T18:37:43.946 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:37:43.946 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:43.946 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:43.946 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.946 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-09-12T18:37:43.946 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:43.946 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:43.946 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:43.946 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6806", 2024-09-12T18:37:43.946 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:37:43.946 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.946 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:43.947 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:43.947 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6807", 2024-09-12T18:37:43.947 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:37:43.947 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:43.947 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:43.947 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.947 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-09-12T18:37:43.947 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:43.947 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:43.947 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:43.947 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6804", 2024-09-12T18:37:43.947 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:37:43.947 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.948 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:43.948 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:43.948 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.143:6805", 2024-09-12T18:37:43.948 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 862189968 2024-09-12T18:37:43.948 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:43.948 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:43.948 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.948 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.143:6801/862189968", 2024-09-12T18:37:43.948 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.143:6803/862189968", 2024-09-12T18:37:43.948 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.143:6807/862189968", 2024-09-12T18:37:43.948 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.143:6805/862189968", 2024-09-12T18:37:43.948 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-09-12T18:37:43.948 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-09-12T18:37:43.948 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-09-12T18:37:43.949 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:43.949 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.949 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:43.949 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2024-09-12T18:37:43.949 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "6fb554da-561f-4aa2-b855-0e3adb98b057", 2024-09-12T18:37:43.949 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-09-12T18:37:43.949 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-09-12T18:37:43.949 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-09-12T18:37:43.949 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-09-12T18:37:43.949 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-09-12T18:37:43.949 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-09-12T18:37:43.949 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-09-12T18:37:43.949 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 73, 2024-09-12T18:37:43.950 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-09-12T18:37:43.950 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-09-12T18:37:43.950 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-12T18:37:43.950 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:43.950 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:43.950 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:43.950 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6800", 2024-09-12T18:37:43.950 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:37:43.950 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.950 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:43.950 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:43.950 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6801", 2024-09-12T18:37:43.950 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:37:43.950 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:43.951 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:43.951 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.951 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-09-12T18:37:43.951 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:43.951 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:43.951 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:43.951 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6802", 2024-09-12T18:37:43.951 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:37:43.951 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.951 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:43.951 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:43.951 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6803", 2024-09-12T18:37:43.951 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:37:43.951 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:43.952 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:43.952 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.952 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-09-12T18:37:43.952 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:43.952 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:43.952 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:43.952 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6806", 2024-09-12T18:37:43.952 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:37:43.952 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.952 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:43.952 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:43.952 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6807", 2024-09-12T18:37:43.952 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:37:43.953 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:43.953 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:43.953 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.953 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-09-12T18:37:43.953 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-12T18:37:43.953 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:43.953 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-09-12T18:37:43.953 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6804", 2024-09-12T18:37:43.953 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:37:43.953 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.953 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:43.953 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T18:37:43.953 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.162:6805", 2024-09-12T18:37:43.954 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1397104153 2024-09-12T18:37:43.954 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:43.954 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:43.954 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.954 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.162:6801/1397104153", 2024-09-12T18:37:43.954 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.162:6803/1397104153", 2024-09-12T18:37:43.954 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.162:6807/1397104153", 2024-09-12T18:37:43.954 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.162:6805/1397104153", 2024-09-12T18:37:43.954 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-09-12T18:37:43.954 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-09-12T18:37:43.954 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-09-12T18:37:43.954 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:43.954 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:43.954 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T18:37:43.955 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_xinfo": [ 2024-09-12T18:37:43.955 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:43.955 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-09-12T18:37:43.955 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-09-12T18:37:43.955 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-09-12T18:37:43.955 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-09-12T18:37:43.955 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540719139924082687, 2024-09-12T18:37:43.955 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-09-12T18:37:43.955 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-09-12T18:35:10.239320+0000", 2024-09-12T18:37:43.955 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-09-12T18:37:43.955 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.955 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:43.955 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-09-12T18:37:43.956 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-09-12T18:37:43.956 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-09-12T18:37:43.956 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-09-12T18:37:43.956 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540719139924082687, 2024-09-12T18:37:43.956 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-09-12T18:37:43.956 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-09-12T18:35:10.861760+0000", 2024-09-12T18:37:43.956 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-09-12T18:37:43.956 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.956 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:43.956 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2024-09-12T18:37:43.956 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-09-12T18:37:43.956 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-09-12T18:37:43.956 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-09-12T18:37:43.956 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540719139924082687, 2024-09-12T18:37:43.957 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-09-12T18:37:43.957 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-09-12T18:35:10.355997+0000", 2024-09-12T18:37:43.957 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-09-12T18:37:43.957 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:43.957 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T18:37:43.957 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap": [ 2024-09-12T18:37:43.957 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T18:37:43.957 INFO:teuthology.orchestra.run.smithi073.stdout: "pgid": "2.6", 2024-09-12T18:37:43.957 INFO:teuthology.orchestra.run.smithi073.stdout: "osds": [ 2024-09-12T18:37:43.957 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-12T18:37:43.957 INFO:teuthology.orchestra.run.smithi073.stdout: 0 2024-09-12T18:37:43.957 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T18:37:43.957 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:43.958 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T18:37:43.958 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap_items": [], 2024-09-12T18:37:43.958 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap_primaries": [], 2024-09-12T18:37:43.958 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_temp": [], 2024-09-12T18:37:43.958 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_temp": [], 2024-09-12T18:37:43.958 INFO:teuthology.orchestra.run.smithi073.stdout: "blocklist": {}, 2024-09-12T18:37:43.958 INFO:teuthology.orchestra.run.smithi073.stdout: "range_blocklist": {}, 2024-09-12T18:37:43.958 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profiles": { 2024-09-12T18:37:43.958 INFO:teuthology.orchestra.run.smithi073.stdout: "default": { 2024-09-12T18:37:43.958 INFO:teuthology.orchestra.run.smithi073.stdout: "crush-failure-domain": "osd", 2024-09-12T18:37:43.958 INFO:teuthology.orchestra.run.smithi073.stdout: "k": "2", 2024-09-12T18:37:43.958 INFO:teuthology.orchestra.run.smithi073.stdout: "m": "1", 2024-09-12T18:37:43.958 INFO:teuthology.orchestra.run.smithi073.stdout: "plugin": "jerasure", 2024-09-12T18:37:43.958 INFO:teuthology.orchestra.run.smithi073.stdout: "technique": "reed_sol_van" 2024-09-12T18:37:43.959 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:43.959 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T18:37:43.959 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps_queue": [], 2024-09-12T18:37:43.959 INFO:teuthology.orchestra.run.smithi073.stdout: "new_removed_snaps": [], 2024-09-12T18:37:43.959 INFO:teuthology.orchestra.run.smithi073.stdout: "new_purged_snaps": [], 2024-09-12T18:37:43.959 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_node_flags": {}, 2024-09-12T18:37:43.959 INFO:teuthology.orchestra.run.smithi073.stdout: "device_class_flags": {}, 2024-09-12T18:37:43.959 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": { 2024-09-12T18:37:43.959 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode_enabled": false, 2024-09-12T18:37:43.959 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_bucket_count": 0, 2024-09-12T18:37:43.959 INFO:teuthology.orchestra.run.smithi073.stdout: "degraded_stretch_mode": 0, 2024-09-12T18:37:43.959 INFO:teuthology.orchestra.run.smithi073.stdout: "recovering_stretch_mode": 0, 2024-09-12T18:37:43.959 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode_bucket": 0 2024-09-12T18:37:43.960 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T18:37:43.960 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T18:37:43.961 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:43.954+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:43.962 INFO:tasks.thrashosds.thrasher:j is {'epoch': 77, 'fsid': 'c08d5a84-711b-44bf-bdf1-e06ecc2c7c00', 'created': '2024-09-12T18:35:02.695853+0000', 'modified': '2024-09-12T18:37:42.475580+0000', 'last_up_change': '2024-09-12T18:35:12.464628+0000', 'last_in_change': '2024-09-12T18:35:04.352525+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T18:35:12.418430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-12T18:35:18.665309+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 15, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T18:35:23.447845+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.409999966621399, 'score_stable': 1.409999966621399, 'optimal_score': 1, 'raw_score_acting': 1.409999966621399, 'raw_score_stable': 1.409999966621399, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T18:35:23.959973+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.409999966621399, 'score_stable': 1.409999966621399, 'optimal_score': 1, 'raw_score_acting': 1.409999966621399, 'raw_score_stable': 1.409999966621399, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2024-09-12T18:35:43.562347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'f1cf24e8-6179-4666-a444-fa81ef0d7482', 'up': 1, 'in': 1, 'weight': 0.6371612548828125, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6800', 'nonce': 2710632206}, {'type': 'v1', 'addr': '172.21.15.114:6801', 'nonce': 2710632206}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6802', 'nonce': 2710632206}, {'type': 'v1', 'addr': '172.21.15.114:6803', 'nonce': 2710632206}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6806', 'nonce': 2710632206}, {'type': 'v1', 'addr': '172.21.15.114:6807', 'nonce': 2710632206}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6804', 'nonce': 2710632206}, {'type': 'v1', 'addr': '172.21.15.114:6805', 'nonce': 2710632206}]}, 'public_addr': '172.21.15.114:6801/2710632206', 'cluster_addr': '172.21.15.114:6803/2710632206', 'heartbeat_back_addr': '172.21.15.114:6807/2710632206', 'heartbeat_front_addr': '172.21.15.114:6805/2710632206', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '3fdb0044-2820-4411-978b-4b6e94fbf0b1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 9, 'up_thru': 65, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6800', 'nonce': 862189968}, {'type': 'v1', 'addr': '172.21.15.143:6801', 'nonce': 862189968}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6802', 'nonce': 862189968}, {'type': 'v1', 'addr': '172.21.15.143:6803', 'nonce': 862189968}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6806', 'nonce': 862189968}, {'type': 'v1', 'addr': '172.21.15.143:6807', 'nonce': 862189968}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6804', 'nonce': 862189968}, {'type': 'v1', 'addr': '172.21.15.143:6805', 'nonce': 862189968}]}, 'public_addr': '172.21.15.143:6801/862189968', 'cluster_addr': '172.21.15.143:6803/862189968', 'heartbeat_back_addr': '172.21.15.143:6807/862189968', 'heartbeat_front_addr': '172.21.15.143:6805/862189968', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '6fb554da-561f-4aa2-b855-0e3adb98b057', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 73, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6800', 'nonce': 1397104153}, {'type': 'v1', 'addr': '172.21.15.162:6801', 'nonce': 1397104153}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6802', 'nonce': 1397104153}, {'type': 'v1', 'addr': '172.21.15.162:6803', 'nonce': 1397104153}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6806', 'nonce': 1397104153}, {'type': 'v1', 'addr': '172.21.15.162:6807', 'nonce': 1397104153}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6804', 'nonce': 1397104153}, {'type': 'v1', 'addr': '172.21.15.162:6805', 'nonce': 1397104153}]}, 'public_addr': '172.21.15.162:6801/1397104153', 'cluster_addr': '172.21.15.162:6803/1397104153', 'heartbeat_back_addr': '172.21.15.162:6807/1397104153', 'heartbeat_front_addr': '172.21.15.162:6805/1397104153', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:35:10.239320+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:35:10.861760+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:35:10.355997+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '2.6', 'osds': [2, 0]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T18:37:43.962 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:37:44.014 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:44.014 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:44.035 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:37:44.061 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:44.055+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:44.161 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:44.157+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:44.234 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:44.234 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:44.257 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:37:44.262 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:44.258+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:44.286 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:37:44.288 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T18:37:44.304 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2024-09-12T18:37:42.489259+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1460079541,"num_objects":22297,"num_object_clones":0,"num_object_copies":44594,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22297,"num_whiteouts":0,"num_read":87,"num_read_kb":74,"num_write":242471,"num_write_kb":8468225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16201,"num_bytes_recovered":1061421638,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62437,"ondisk_log_size":62437,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1010632,"kb_used_data":185400,"kb_used_omap":4,"kb_used_meta":825147,"kb_avail":282104888,"statfs":{"total":289910292480,"available":288875405312,"internally_reserved":0,"allocated":189849600,"data_stored":2995247125,"data_compressed":142243248,"data_compressed_allocated":187158528,"data_compressed_original":2994241536,"omap_allocated":4783,"internal_metadata":844950865},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,2,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-993001472,"num_objects":-15152,"num_object_clones":0,"num_object_copies":-30304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-474,"num_objects_unfound":0,"num_objects_dirty":-15152,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15152,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":451,"num_bytes_recovered":29556736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.223626"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":132,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:36.260831+0000","last_change":"2024-09-12T18:36:40.076316+0000","last_active":"2024-09-12T18:37:36.260831+0000","last_peered":"2024-09-12T18:37:36.260831+0000","last_clean":"2024-09-12T18:37:36.260831+0000","last_became_active":"2024-09-12T18:36:40.074014+0000","last_became_peered":"2024-09-12T18:36:40.074014+0000","last_unstale":"2024-09-12T18:37:36.260831+0000","last_undegraded":"2024-09-12T18:37:36.260831+0000","last_fullsized":"2024-09-12T18:37:36.260831+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:20.167564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":126,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:36.260524+0000","last_change":"2024-09-12T18:35:25.659760+0000","last_active":"2024-09-12T18:37:36.260524+0000","last_peered":"2024-09-12T18:37:36.260524+0000","last_clean":"2024-09-12T18:37:36.260524+0000","last_became_active":"2024-09-12T18:35:25.654920+0000","last_became_peered":"2024-09-12T18:35:25.654920+0000","last_unstale":"2024-09-12T18:37:36.260524+0000","last_undegraded":"2024-09-12T18:37:36.260524+0000","last_fullsized":"2024-09-12T18:37:36.260524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:21.519881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":128,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.489716+0000","last_change":"2024-09-12T18:35:25.659460+0000","last_active":"2024-09-12T18:37:39.489716+0000","last_peered":"2024-09-12T18:37:39.489716+0000","last_clean":"2024-09-12T18:37:39.489716+0000","last_became_active":"2024-09-12T18:35:25.657782+0000","last_became_peered":"2024-09-12T18:35:25.657782+0000","last_unstale":"2024-09-12T18:37:39.489716+0000","last_undegraded":"2024-09-12T18:37:39.489716+0000","last_fullsized":"2024-09-12T18:37:39.489716+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:38.544284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":128,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.489117+0000","last_change":"2024-09-12T18:35:25.663617+0000","last_active":"2024-09-12T18:37:39.489117+0000","last_peered":"2024-09-12T18:37:39.489117+0000","last_clean":"2024-09-12T18:37:39.489117+0000","last_became_active":"2024-09-12T18:35:25.661977+0000","last_became_peered":"2024-09-12T18:35:25.661977+0000","last_unstale":"2024-09-12T18:37:39.489117+0000","last_undegraded":"2024-09-12T18:37:39.489117+0000","last_fullsized":"2024-09-12T18:37:39.489117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:14.748234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":125,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:36.260150+0000","last_change":"2024-09-12T18:35:25.656566+0000","last_active":"2024-09-12T18:37:36.260150+0000","last_peered":"2024-09-12T18:37:36.260150+0000","last_clean":"2024-09-12T18:37:36.260150+0000","last_became_active":"2024-09-12T18:35:25.654898+0000","last_became_peered":"2024-09-12T18:35:25.654898+0000","last_unstale":"2024-09-12T18:37:36.260150+0000","last_undegraded":"2024-09-12T18:37:36.260150+0000","last_fullsized":"2024-09-12T18:37:36.260150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:36.113250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":133,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.488359+0000","last_change":"2024-09-12T18:36:40.067812+0000","last_active":"2024-09-12T18:37:39.488359+0000","last_peered":"2024-09-12T18:37:39.488359+0000","last_clean":"2024-09-12T18:37:39.488359+0000","last_became_active":"2024-09-12T18:36:40.067396+0000","last_became_peered":"2024-09-12T18:36:40.067396+0000","last_unstale":"2024-09-12T18:37:39.488359+0000","last_undegraded":"2024-09-12T18:37:39.488359+0000","last_fullsized":"2024-09-12T18:37:39.488359+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:46.485518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":127,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.488396+0000","last_change":"2024-09-12T18:35:25.659811+0000","last_active":"2024-09-12T18:37:39.488396+0000","last_peered":"2024-09-12T18:37:39.488396+0000","last_clean":"2024-09-12T18:37:39.488396+0000","last_became_active":"2024-09-12T18:35:25.658998+0000","last_became_peered":"2024-09-12T18:35:25.658998+0000","last_unstale":"2024-09-12T18:37:39.488396+0000","last_undegraded":"2024-09-12T18:37:39.488396+0000","last_fullsized":"2024-09-12T18:37:39.488396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":133,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.488130+0000","last_change":"2024-09-12T18:36:40.154635+0000","last_active":"2024-09-12T18:37:39.488130+0000","last_peered":"2024-09-12T18:37:39.488130+0000","last_clean":"2024-09-12T18:37:39.488130+0000","last_became_active":"2024-09-12T18:36:40.153818+0000","last_became_peered":"2024-09-12T18:36:40.153818+0000","last_unstale":"2024-09-12T18:37:39.488130+0000","last_undegraded":"2024-09-12T18:37:39.488130+0000","last_fullsized":"2024-09-12T18:37:39.488130+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:54.571879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":127,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.489917+0000","last_change":"2024-09-12T18:35:25.668339+0000","last_active":"2024-09-12T18:37:39.489917+0000","last_peered":"2024-09-12T18:37:39.489917+0000","last_clean":"2024-09-12T18:37:39.489917+0000","last_became_active":"2024-09-12T18:35:25.667608+0000","last_became_peered":"2024-09-12T18:35:25.667608+0000","last_unstale":"2024-09-12T18:37:39.489917+0000","last_undegraded":"2024-09-12T18:37:39.489917+0000","last_fullsized":"2024-09-12T18:37:39.489917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:15.699745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":131,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:36.260666+0000","last_change":"2024-09-12T18:36:40.075686+0000","last_active":"2024-09-12T18:37:36.260666+0000","last_peered":"2024-09-12T18:37:36.260666+0000","last_clean":"2024-09-12T18:37:36.260666+0000","last_became_active":"2024-09-12T18:36:40.072911+0000","last_became_peered":"2024-09-12T18:36:40.072911+0000","last_unstale":"2024-09-12T18:37:36.260666+0000","last_undegraded":"2024-09-12T18:37:36.260666+0000","last_fullsized":"2024-09-12T18:37:36.260666+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:24.687842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":133,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.489606+0000","last_change":"2024-09-12T18:36:39.072342+0000","last_active":"2024-09-12T18:37:39.489606+0000","last_peered":"2024-09-12T18:37:39.489606+0000","last_clean":"2024-09-12T18:37:39.489606+0000","last_became_active":"2024-09-12T18:36:39.071488+0000","last_became_peered":"2024-09-12T18:36:39.071488+0000","last_unstale":"2024-09-12T18:37:39.489606+0000","last_undegraded":"2024-09-12T18:37:39.489606+0000","last_fullsized":"2024-09-12T18:37:39.489606+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:27.845874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":125,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:36.260347+0000","last_change":"2024-09-12T18:35:25.649885+0000","last_active":"2024-09-12T18:37:36.260347+0000","last_peered":"2024-09-12T18:37:36.260347+0000","last_clean":"2024-09-12T18:37:36.260347+0000","last_became_active":"2024-09-12T18:35:25.649111+0000","last_became_peered":"2024-09-12T18:35:25.649111+0000","last_unstale":"2024-09-12T18:37:36.260347+0000","last_undegraded":"2024-09-12T18:37:36.260347+0000","last_fullsized":"2024-09-12T18:37:36.260347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:17.162410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":131,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:36.260020+0000","last_change":"2024-09-12T18:36:39.074873+0000","last_active":"2024-09-12T18:37:36.260020+0000","last_peered":"2024-09-12T18:37:36.260020+0000","last_clean":"2024-09-12T18:37:36.260020+0000","last_became_active":"2024-09-12T18:36:39.074049+0000","last_became_peered":"2024-09-12T18:36:39.074049+0000","last_unstale":"2024-09-12T18:37:36.260020+0000","last_undegraded":"2024-09-12T18:37:36.260020+0000","last_fullsized":"2024-09-12T18:37:36.260020+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:14.773044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":127,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.488409+0000","last_change":"2024-09-12T18:35:25.657913+0000","last_active":"2024-09-12T18:37:39.488409+0000","last_peered":"2024-09-12T18:37:39.488409+0000","last_clean":"2024-09-12T18:37:39.488409+0000","last_became_active":"2024-09-12T18:35:25.657082+0000","last_became_peered":"2024-09-12T18:35:25.657082+0000","last_unstale":"2024-09-12T18:37:39.488409+0000","last_undegraded":"2024-09-12T18:37:39.488409+0000","last_fullsized":"2024-09-12T18:37:39.488409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:21.538633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":127,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.488435+0000","last_change":"2024-09-12T18:35:25.658763+0000","last_active":"2024-09-12T18:37:39.488435+0000","last_peered":"2024-09-12T18:37:39.488435+0000","last_clean":"2024-09-12T18:37:39.488435+0000","last_became_active":"2024-09-12T18:35:25.657508+0000","last_became_peered":"2024-09-12T18:35:25.657508+0000","last_unstale":"2024-09-12T18:37:39.488435+0000","last_undegraded":"2024-09-12T18:37:39.488435+0000","last_fullsized":"2024-09-12T18:37:39.488435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:13.170519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":127,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.488196+0000","last_change":"2024-09-12T18:35:25.653730+0000","last_active":"2024-09-12T18:37:39.488196+0000","last_peered":"2024-09-12T18:37:39.488196+0000","last_clean":"2024-09-12T18:37:39.488196+0000","last_became_active":"2024-09-12T18:35:25.651535+0000","last_became_peered":"2024-09-12T18:35:25.651535+0000","last_unstale":"2024-09-12T18:37:39.488196+0000","last_undegraded":"2024-09-12T18:37:39.488196+0000","last_fullsized":"2024-09-12T18:37:39.488196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":127,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.490103+0000","last_change":"2024-09-12T18:35:25.656513+0000","last_active":"2024-09-12T18:37:39.490103+0000","last_peered":"2024-09-12T18:37:39.490103+0000","last_clean":"2024-09-12T18:37:39.490103+0000","last_became_active":"2024-09-12T18:35:25.653440+0000","last_became_peered":"2024-09-12T18:35:25.653440+0000","last_unstale":"2024-09-12T18:37:39.490103+0000","last_undegraded":"2024-09-12T18:37:39.490103+0000","last_fullsized":"2024-09-12T18:37:39.490103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:18.693161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":125,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:36.260804+0000","last_change":"2024-09-12T18:35:25.657991+0000","last_active":"2024-09-12T18:37:36.260804+0000","last_peered":"2024-09-12T18:37:36.260804+0000","last_clean":"2024-09-12T18:37:36.260804+0000","last_became_active":"2024-09-12T18:35:25.653934+0000","last_became_peered":"2024-09-12T18:35:25.653934+0000","last_unstale":"2024-09-12T18:37:36.260804+0000","last_undegraded":"2024-09-12T18:37:36.260804+0000","last_fullsized":"2024-09-12T18:37:36.260804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:05.418901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":64,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:36.261071+0000","last_change":"2024-09-12T18:36:39.075412+0000","last_active":"2024-09-12T18:37:36.261071+0000","last_peered":"2024-09-12T18:37:36.261071+0000","last_clean":"2024-09-12T18:37:36.261071+0000","last_became_active":"2024-09-12T18:36:39.074539+0000","last_became_peered":"2024-09-12T18:36:39.074539+0000","last_unstale":"2024-09-12T18:37:36.261071+0000","last_undegraded":"2024-09-12T18:37:36.261071+0000","last_fullsized":"2024-09-12T18:37:36.261071+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:34.322250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":128,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.489214+0000","last_change":"2024-09-12T18:35:25.661176+0000","last_active":"2024-09-12T18:37:39.489214+0000","last_peered":"2024-09-12T18:37:39.489214+0000","last_clean":"2024-09-12T18:37:39.489214+0000","last_became_active":"2024-09-12T18:35:25.659534+0000","last_became_peered":"2024-09-12T18:35:25.659534+0000","last_unstale":"2024-09-12T18:37:39.489214+0000","last_undegraded":"2024-09-12T18:37:39.489214+0000","last_fullsized":"2024-09-12T18:37:39.489214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:40.145442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":128,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.488779+0000","last_change":"2024-09-12T18:35:25.650632+0000","last_active":"2024-09-12T18:37:39.488779+0000","last_peered":"2024-09-12T18:37:39.488779+0000","last_clean":"2024-09-12T18:37:39.488779+0000","last_became_active":"2024-09-12T18:35:25.649333+0000","last_became_peered":"2024-09-12T18:35:25.649333+0000","last_unstale":"2024-09-12T18:37:39.488779+0000","last_undegraded":"2024-09-12T18:37:39.488779+0000","last_fullsized":"2024-09-12T18:37:39.488779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:30.537572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":125,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:36.260005+0000","last_change":"2024-09-12T18:35:25.648245+0000","last_active":"2024-09-12T18:37:36.260005+0000","last_peered":"2024-09-12T18:37:36.260005+0000","last_clean":"2024-09-12T18:37:36.260005+0000","last_became_active":"2024-09-12T18:35:25.646357+0000","last_became_peered":"2024-09-12T18:35:25.646357+0000","last_unstale":"2024-09-12T18:37:36.260005+0000","last_undegraded":"2024-09-12T18:37:36.260005+0000","last_fullsized":"2024-09-12T18:37:36.260005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:05.662140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":128,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.489545+0000","last_change":"2024-09-12T18:35:25.661613+0000","last_active":"2024-09-12T18:37:39.489545+0000","last_peered":"2024-09-12T18:37:39.489545+0000","last_clean":"2024-09-12T18:37:39.489545+0000","last_became_active":"2024-09-12T18:35:25.658833+0000","last_became_peered":"2024-09-12T18:35:25.658833+0000","last_unstale":"2024-09-12T18:37:39.489545+0000","last_undegraded":"2024-09-12T18:37:39.489545+0000","last_fullsized":"2024-09-12T18:37:39.489545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:51.064080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":126,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:36.259642+0000","last_change":"2024-09-12T18:35:25.657782+0000","last_active":"2024-09-12T18:37:36.259642+0000","last_peered":"2024-09-12T18:37:36.259642+0000","last_clean":"2024-09-12T18:37:36.259642+0000","last_became_active":"2024-09-12T18:35:25.655295+0000","last_became_peered":"2024-09-12T18:35:25.655295+0000","last_unstale":"2024-09-12T18:37:36.259642+0000","last_undegraded":"2024-09-12T18:37:36.259642+0000","last_fullsized":"2024-09-12T18:37:36.259642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:37.744175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":126,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:36.260894+0000","last_change":"2024-09-12T18:35:25.654863+0000","last_active":"2024-09-12T18:37:36.260894+0000","last_peered":"2024-09-12T18:37:36.260894+0000","last_clean":"2024-09-12T18:37:36.260894+0000","last_became_active":"2024-09-12T18:35:25.650407+0000","last_became_peered":"2024-09-12T18:35:25.650407+0000","last_unstale":"2024-09-12T18:37:36.260894+0000","last_undegraded":"2024-09-12T18:37:36.260894+0000","last_fullsized":"2024-09-12T18:37:36.260894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:38.395666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":128,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.490033+0000","last_change":"2024-09-12T18:35:25.662414+0000","last_active":"2024-09-12T18:37:39.490033+0000","last_peered":"2024-09-12T18:37:39.490033+0000","last_clean":"2024-09-12T18:37:39.490033+0000","last_became_active":"2024-09-12T18:35:25.660126+0000","last_became_peered":"2024-09-12T18:35:25.660126+0000","last_unstale":"2024-09-12T18:37:39.490033+0000","last_undegraded":"2024-09-12T18:37:39.490033+0000","last_fullsized":"2024-09-12T18:37:39.490033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:48.437139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":128,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.489615+0000","last_change":"2024-09-12T18:35:25.661523+0000","last_active":"2024-09-12T18:37:39.489615+0000","last_peered":"2024-09-12T18:37:39.489615+0000","last_clean":"2024-09-12T18:37:39.489615+0000","last_became_active":"2024-09-12T18:35:25.659338+0000","last_became_peered":"2024-09-12T18:35:25.659338+0000","last_unstale":"2024-09-12T18:37:39.489615+0000","last_undegraded":"2024-09-12T18:37:39.489615+0000","last_fullsized":"2024-09-12T18:37:39.489615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:37.083820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":126,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:36.260663+0000","last_change":"2024-09-12T18:35:25.662445+0000","last_active":"2024-09-12T18:37:36.260663+0000","last_peered":"2024-09-12T18:37:36.260663+0000","last_clean":"2024-09-12T18:37:36.260663+0000","last_became_active":"2024-09-12T18:35:25.659496+0000","last_became_peered":"2024-09-12T18:35:25.659496+0000","last_unstale":"2024-09-12T18:37:36.260663+0000","last_undegraded":"2024-09-12T18:37:36.260663+0000","last_fullsized":"2024-09-12T18:37:36.260663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:03.270420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":64,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:36.259910+0000","last_change":"2024-09-12T18:36:39.074532+0000","last_active":"2024-09-12T18:37:36.259910+0000","last_peered":"2024-09-12T18:37:36.259910+0000","last_clean":"2024-09-12T18:37:36.259910+0000","last_became_active":"2024-09-12T18:36:39.073676+0000","last_became_peered":"2024-09-12T18:36:39.073676+0000","last_unstale":"2024-09-12T18:37:36.259910+0000","last_undegraded":"2024-09-12T18:37:36.259910+0000","last_fullsized":"2024-09-12T18:37:36.259910+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:53.080797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":126,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:36.260148+0000","last_change":"2024-09-12T18:35:25.650507+0000","last_active":"2024-09-12T18:37:36.260148+0000","last_peered":"2024-09-12T18:37:36.260148+0000","last_clean":"2024-09-12T18:37:36.260148+0000","last_became_active":"2024-09-12T18:35:25.649415+0000","last_became_peered":"2024-09-12T18:35:25.649415+0000","last_unstale":"2024-09-12T18:37:36.260148+0000","last_undegraded":"2024-09-12T18:37:36.260148+0000","last_fullsized":"2024-09-12T18:37:36.260148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:23.081416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":128,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.489535+0000","last_change":"2024-09-12T18:35:25.653949+0000","last_active":"2024-09-12T18:37:39.489535+0000","last_peered":"2024-09-12T18:37:39.489535+0000","last_clean":"2024-09-12T18:37:39.489535+0000","last_became_active":"2024-09-12T18:35:25.652992+0000","last_became_peered":"2024-09-12T18:35:25.652992+0000","last_unstale":"2024-09-12T18:37:39.489535+0000","last_undegraded":"2024-09-12T18:37:39.489535+0000","last_fullsized":"2024-09-12T18:37:39.489535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:47.687372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":134,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.488236+0000","last_change":"2024-09-12T18:36:40.154958+0000","last_active":"2024-09-12T18:37:39.488236+0000","last_peered":"2024-09-12T18:37:39.488236+0000","last_clean":"2024-09-12T18:37:39.488236+0000","last_became_active":"2024-09-12T18:36:40.154422+0000","last_became_peered":"2024-09-12T18:36:40.154422+0000","last_unstale":"2024-09-12T18:37:39.488236+0000","last_undegraded":"2024-09-12T18:37:39.488236+0000","last_fullsized":"2024-09-12T18:37:39.488236+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:33.288844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":131,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:36.260467+0000","last_change":"2024-09-12T18:36:40.079440+0000","last_active":"2024-09-12T18:37:36.260467+0000","last_peered":"2024-09-12T18:37:36.260467+0000","last_clean":"2024-09-12T18:37:36.260467+0000","last_became_active":"2024-09-12T18:36:40.076955+0000","last_became_peered":"2024-09-12T18:36:40.076955+0000","last_unstale":"2024-09-12T18:37:36.260467+0000","last_undegraded":"2024-09-12T18:37:36.260467+0000","last_fullsized":"2024-09-12T18:37:36.260467+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:18.565373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":131,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.489012+0000","last_change":"2024-09-12T18:35:24.657739+0000","last_active":"2024-09-12T18:37:39.489012+0000","last_peered":"2024-09-12T18:37:39.489012+0000","last_clean":"2024-09-12T18:37:39.489012+0000","last_became_active":"2024-09-12T18:35:24.656208+0000","last_became_peered":"2024-09-12T18:35:24.656208+0000","last_unstale":"2024-09-12T18:37:39.489012+0000","last_undegraded":"2024-09-12T18:37:39.489012+0000","last_fullsized":"2024-09-12T18:37:39.489012+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:50.073716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":125,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:36.260835+0000","last_change":"2024-09-12T18:35:25.651651+0000","last_active":"2024-09-12T18:37:36.260835+0000","last_peered":"2024-09-12T18:37:36.260835+0000","last_clean":"2024-09-12T18:37:36.260835+0000","last_became_active":"2024-09-12T18:35:25.650849+0000","last_became_peered":"2024-09-12T18:35:25.650849+0000","last_unstale":"2024-09-12T18:37:36.260835+0000","last_undegraded":"2024-09-12T18:37:36.260835+0000","last_fullsized":"2024-09-12T18:37:36.260835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:18.555827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":129,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.489878+0000","last_change":"2024-09-12T18:35:24.656119+0000","last_active":"2024-09-12T18:37:39.489878+0000","last_peered":"2024-09-12T18:37:39.489878+0000","last_clean":"2024-09-12T18:37:39.489878+0000","last_became_active":"2024-09-12T18:35:24.653175+0000","last_became_peered":"2024-09-12T18:35:24.653175+0000","last_unstale":"2024-09-12T18:37:39.489878+0000","last_undegraded":"2024-09-12T18:37:39.489878+0000","last_fullsized":"2024-09-12T18:37:39.489878+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:00.551165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":64,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.489427+0000","last_change":"2024-09-12T18:36:40.090805+0000","last_active":"2024-09-12T18:37:39.489427+0000","last_peered":"2024-09-12T18:37:39.489427+0000","last_clean":"2024-09-12T18:37:39.489427+0000","last_became_active":"2024-09-12T18:36:40.090318+0000","last_became_peered":"2024-09-12T18:36:40.090318+0000","last_unstale":"2024-09-12T18:37:39.489427+0000","last_undegraded":"2024-09-12T18:37:39.489427+0000","last_fullsized":"2024-09-12T18:37:39.489427+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:15.103437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":127,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:36.259792+0000","last_change":"2024-09-12T18:35:24.640096+0000","last_active":"2024-09-12T18:37:36.259792+0000","last_peered":"2024-09-12T18:37:36.259792+0000","last_clean":"2024-09-12T18:37:36.259792+0000","last_became_active":"2024-09-12T18:35:24.638230+0000","last_became_peered":"2024-09-12T18:35:24.638230+0000","last_unstale":"2024-09-12T18:37:36.259792+0000","last_undegraded":"2024-09-12T18:37:36.259792+0000","last_fullsized":"2024-09-12T18:37:36.259792+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:38.435296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":64,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.489495+0000","last_change":"2024-09-12T18:36:40.075962+0000","last_active":"2024-09-12T18:37:39.489495+0000","last_peered":"2024-09-12T18:37:39.489495+0000","last_clean":"2024-09-12T18:37:39.489495+0000","last_became_active":"2024-09-12T18:36:40.075081+0000","last_became_peered":"2024-09-12T18:36:40.075081+0000","last_unstale":"2024-09-12T18:37:39.489495+0000","last_undegraded":"2024-09-12T18:37:39.489495+0000","last_fullsized":"2024-09-12T18:37:39.489495+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:00.410639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":137,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.488360+0000","last_change":"2024-09-12T18:35:24.653610+0000","last_active":"2024-09-12T18:37:39.488360+0000","last_peered":"2024-09-12T18:37:39.488360+0000","last_clean":"2024-09-12T18:37:39.488360+0000","last_became_active":"2024-09-12T18:35:24.652880+0000","last_became_peered":"2024-09-12T18:35:24.652880+0000","last_unstale":"2024-09-12T18:37:39.488360+0000","last_undegraded":"2024-09-12T18:37:39.488360+0000","last_fullsized":"2024-09-12T18:37:39.488360+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:57.636251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"76'15281","reported_seq":15400,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:41.544097+0000","last_change":"2024-09-12T18:35:44.771794+0000","last_active":"2024-09-12T18:37:41.544097+0000","last_peered":"2024-09-12T18:37:41.544097+0000","last_clean":"2024-09-12T18:37:41.544097+0000","last_became_active":"2024-09-12T18:35:44.771286+0000","last_became_peered":"2024-09-12T18:35:44.771286+0000","last_unstale":"2024-09-12T18:37:41.544097+0000","last_undegraded":"2024-09-12T18:37:41.544097+0000","last_fullsized":"2024-09-12T18:37:41.544097+0000","mapping_epoch":21,"log_start":"64'12153","ondisk_log_start":"64'12153","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3128,"log_dups_size":0,"ondisk_log_size":3128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:10.094729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83820544,"num_objects":1279,"num_object_clones":0,"num_object_copies":2558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1279,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15281,"num_write_kb":529920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":131,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.489916+0000","last_change":"2024-09-12T18:35:24.653465+0000","last_active":"2024-09-12T18:37:39.489916+0000","last_peered":"2024-09-12T18:37:39.489916+0000","last_clean":"2024-09-12T18:37:39.489916+0000","last_became_active":"2024-09-12T18:35:24.652792+0000","last_became_peered":"2024-09-12T18:35:24.652792+0000","last_unstale":"2024-09-12T18:37:39.489916+0000","last_undegraded":"2024-09-12T18:37:39.489916+0000","last_fullsized":"2024-09-12T18:37:39.489916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:14.588993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":126,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:36.259639+0000","last_change":"2024-09-12T18:35:25.655426+0000","last_active":"2024-09-12T18:37:36.259639+0000","last_peered":"2024-09-12T18:37:36.259639+0000","last_clean":"2024-09-12T18:37:36.259639+0000","last_became_active":"2024-09-12T18:35:25.648186+0000","last_became_peered":"2024-09-12T18:35:25.648186+0000","last_unstale":"2024-09-12T18:37:36.259639+0000","last_undegraded":"2024-09-12T18:37:36.259639+0000","last_fullsized":"2024-09-12T18:37:36.259639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:48.802815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"75'14584","reported_seq":14700,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:38.566513+0000","last_change":"2024-09-12T18:35:44.767860+0000","last_active":"2024-09-12T18:37:38.566513+0000","last_peered":"2024-09-12T18:37:38.566513+0000","last_clean":"2024-09-12T18:37:38.566513+0000","last_became_active":"2024-09-12T18:35:44.766986+0000","last_became_peered":"2024-09-12T18:35:44.766986+0000","last_unstale":"2024-09-12T18:37:38.566513+0000","last_undegraded":"2024-09-12T18:37:38.566513+0000","last_fullsized":"2024-09-12T18:37:38.566513+0000","mapping_epoch":21,"log_start":"61'11335","ondisk_log_start":"61'11335","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3249,"log_dups_size":0,"ondisk_log_size":3249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:49.109157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107216896,"num_objects":1636,"num_object_clones":0,"num_object_copies":3272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1636,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14584,"num_write_kb":519040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":129,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:36.260908+0000","last_change":"2024-09-12T18:35:24.648439+0000","last_active":"2024-09-12T18:37:36.260908+0000","last_peered":"2024-09-12T18:37:36.260908+0000","last_clean":"2024-09-12T18:37:36.260908+0000","last_became_active":"2024-09-12T18:35:24.647629+0000","last_became_peered":"2024-09-12T18:35:24.647629+0000","last_unstale":"2024-09-12T18:37:36.260908+0000","last_undegraded":"2024-09-12T18:37:36.260908+0000","last_fullsized":"2024-09-12T18:37:36.260908+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:45.428223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":126,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:36.259729+0000","last_change":"2024-09-12T18:35:25.652496+0000","last_active":"2024-09-12T18:37:36.259729+0000","last_peered":"2024-09-12T18:37:36.259729+0000","last_clean":"2024-09-12T18:37:36.259729+0000","last_became_active":"2024-09-12T18:35:25.651628+0000","last_became_peered":"2024-09-12T18:35:25.651628+0000","last_unstale":"2024-09-12T18:37:36.259729+0000","last_undegraded":"2024-09-12T18:37:36.259729+0000","last_fullsized":"2024-09-12T18:37:36.259729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:44.920448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"75'15065","reported_seq":15182,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:38.549696+0000","last_change":"2024-09-12T18:35:44.767175+0000","last_active":"2024-09-12T18:37:38.549696+0000","last_peered":"2024-09-12T18:37:38.549696+0000","last_clean":"2024-09-12T18:37:38.549696+0000","last_became_active":"2024-09-12T18:35:44.766592+0000","last_became_peered":"2024-09-12T18:35:44.766592+0000","last_unstale":"2024-09-12T18:37:38.549696+0000","last_undegraded":"2024-09-12T18:37:38.549696+0000","last_fullsized":"2024-09-12T18:37:38.549696+0000","mapping_epoch":21,"log_start":"61'11748","ondisk_log_start":"61'11748","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3317,"log_dups_size":0,"ondisk_log_size":3317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:44.678279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107282432,"num_objects":1637,"num_object_clones":0,"num_object_copies":3274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1637,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15065,"num_write_kb":534464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":131,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.489194+0000","last_change":"2024-09-12T18:35:24.654976+0000","last_active":"2024-09-12T18:37:39.489194+0000","last_peered":"2024-09-12T18:37:39.489194+0000","last_clean":"2024-09-12T18:37:39.489194+0000","last_became_active":"2024-09-12T18:35:24.654264+0000","last_became_peered":"2024-09-12T18:35:24.654264+0000","last_unstale":"2024-09-12T18:37:39.489194+0000","last_undegraded":"2024-09-12T18:37:39.489194+0000","last_fullsized":"2024-09-12T18:37:39.489194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:00.115408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":134,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.488563+0000","last_change":"2024-09-12T18:36:40.070910+0000","last_active":"2024-09-12T18:37:39.488563+0000","last_peered":"2024-09-12T18:37:39.488563+0000","last_clean":"2024-09-12T18:37:39.488563+0000","last_became_active":"2024-09-12T18:36:40.070516+0000","last_became_peered":"2024-09-12T18:36:40.070516+0000","last_unstale":"2024-09-12T18:37:39.488563+0000","last_undegraded":"2024-09-12T18:37:39.488563+0000","last_fullsized":"2024-09-12T18:37:39.488563+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:23.962788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"76'15502","reported_seq":15621,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:41.549343+0000","last_change":"2024-09-12T18:35:44.763067+0000","last_active":"2024-09-12T18:37:41.549343+0000","last_peered":"2024-09-12T18:37:41.549343+0000","last_clean":"2024-09-12T18:37:41.549343+0000","last_became_active":"2024-09-12T18:35:44.762584+0000","last_became_peered":"2024-09-12T18:35:44.762584+0000","last_unstale":"2024-09-12T18:37:41.549343+0000","last_undegraded":"2024-09-12T18:37:41.549343+0000","last_fullsized":"2024-09-12T18:37:41.549343+0000","mapping_epoch":21,"log_start":"56'9466","ondisk_log_start":"56'9466","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":6036,"log_dups_size":0,"ondisk_log_size":6036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:47.847399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84803584,"num_objects":1294,"num_object_clones":0,"num_object_copies":2588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1294,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15502,"num_write_kb":537472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":130,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.489445+0000","last_change":"2024-09-12T18:35:24.657665+0000","last_active":"2024-09-12T18:37:39.489445+0000","last_peered":"2024-09-12T18:37:39.489445+0000","last_clean":"2024-09-12T18:37:39.489445+0000","last_became_active":"2024-09-12T18:35:24.657015+0000","last_became_peered":"2024-09-12T18:35:24.657015+0000","last_unstale":"2024-09-12T18:37:39.489445+0000","last_undegraded":"2024-09-12T18:37:39.489445+0000","last_fullsized":"2024-09-12T18:37:39.489445+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:03.171326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":128,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.489947+0000","last_change":"2024-09-12T18:35:25.665275+0000","last_active":"2024-09-12T18:37:39.489947+0000","last_peered":"2024-09-12T18:37:39.489947+0000","last_clean":"2024-09-12T18:37:39.489947+0000","last_became_active":"2024-09-12T18:35:25.659511+0000","last_became_peered":"2024-09-12T18:35:25.659511+0000","last_unstale":"2024-09-12T18:37:39.489947+0000","last_undegraded":"2024-09-12T18:37:39.489947+0000","last_fullsized":"2024-09-12T18:37:39.489947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"75'15099","reported_seq":15217,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:38.546920+0000","last_change":"2024-09-12T18:35:44.773526+0000","last_active":"2024-09-12T18:37:38.546920+0000","last_peered":"2024-09-12T18:37:38.546920+0000","last_clean":"2024-09-12T18:37:38.546920+0000","last_became_active":"2024-09-12T18:35:44.772974+0000","last_became_peered":"2024-09-12T18:35:44.772974+0000","last_unstale":"2024-09-12T18:37:38.546920+0000","last_undegraded":"2024-09-12T18:37:38.546920+0000","last_fullsized":"2024-09-12T18:37:38.546920+0000","mapping_epoch":21,"log_start":"62'11866","ondisk_log_start":"62'11866","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3233,"log_dups_size":0,"ondisk_log_size":3233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:23.676840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109445144,"num_objects":1671,"num_object_clones":0,"num_object_copies":3342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1671,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":15099,"num_write_kb":536577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":79,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.488633+0000","last_change":"2024-09-12T18:36:40.115783+0000","last_active":"2024-09-12T18:37:39.488633+0000","last_peered":"2024-09-12T18:37:39.488633+0000","last_clean":"2024-09-12T18:37:39.488633+0000","last_became_active":"2024-09-12T18:36:40.068020+0000","last_became_peered":"2024-09-12T18:36:40.068020+0000","last_unstale":"2024-09-12T18:37:39.488633+0000","last_undegraded":"2024-09-12T18:37:39.488633+0000","last_fullsized":"2024-09-12T18:37:39.488633+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:02.999068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":134,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.489278+0000","last_change":"2024-09-12T18:36:39.071809+0000","last_active":"2024-09-12T18:37:39.489278+0000","last_peered":"2024-09-12T18:37:39.489278+0000","last_clean":"2024-09-12T18:37:39.489278+0000","last_became_active":"2024-09-12T18:36:39.070888+0000","last_became_peered":"2024-09-12T18:36:39.070888+0000","last_unstale":"2024-09-12T18:37:39.489278+0000","last_undegraded":"2024-09-12T18:37:39.489278+0000","last_fullsized":"2024-09-12T18:37:39.489278+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:19.740732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"76'15183","reported_seq":15302,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:41.546823+0000","last_change":"2024-09-12T18:35:44.767970+0000","last_active":"2024-09-12T18:37:41.546823+0000","last_peered":"2024-09-12T18:37:41.546823+0000","last_clean":"2024-09-12T18:37:41.546823+0000","last_became_active":"2024-09-12T18:35:44.767348+0000","last_became_peered":"2024-09-12T18:35:44.767348+0000","last_unstale":"2024-09-12T18:37:41.546823+0000","last_undegraded":"2024-09-12T18:37:41.546823+0000","last_fullsized":"2024-09-12T18:37:41.546823+0000","mapping_epoch":21,"log_start":"55'9099","ondisk_log_start":"55'9099","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":6084,"log_dups_size":0,"ondisk_log_size":6084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:48.745907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79757312,"num_objects":1217,"num_object_clones":0,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15183,"num_write_kb":524800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":130,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.488676+0000","last_change":"2024-09-12T18:35:24.659019+0000","last_active":"2024-09-12T18:37:39.488676+0000","last_peered":"2024-09-12T18:37:39.488676+0000","last_clean":"2024-09-12T18:37:39.488676+0000","last_became_active":"2024-09-12T18:35:24.658423+0000","last_became_peered":"2024-09-12T18:35:24.658423+0000","last_unstale":"2024-09-12T18:37:39.488676+0000","last_undegraded":"2024-09-12T18:37:39.488676+0000","last_fullsized":"2024-09-12T18:37:39.488676+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:37.668417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":128,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.489408+0000","last_change":"2024-09-12T18:35:25.662287+0000","last_active":"2024-09-12T18:37:39.489408+0000","last_peered":"2024-09-12T18:37:39.489408+0000","last_clean":"2024-09-12T18:37:39.489408+0000","last_became_active":"2024-09-12T18:35:25.660372+0000","last_became_peered":"2024-09-12T18:35:25.660372+0000","last_unstale":"2024-09-12T18:37:39.489408+0000","last_undegraded":"2024-09-12T18:37:39.489408+0000","last_fullsized":"2024-09-12T18:37:39.489408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:08.729541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.f","version":"76'15087","reported_seq":15206,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:41.543862+0000","last_change":"2024-09-12T18:35:44.774817+0000","last_active":"2024-09-12T18:37:41.543862+0000","last_peered":"2024-09-12T18:37:41.543862+0000","last_clean":"2024-09-12T18:37:41.543862+0000","last_became_active":"2024-09-12T18:35:44.774429+0000","last_became_peered":"2024-09-12T18:35:44.774429+0000","last_unstale":"2024-09-12T18:37:41.543862+0000","last_undegraded":"2024-09-12T18:37:41.543862+0000","last_fullsized":"2024-09-12T18:37:41.543862+0000","mapping_epoch":21,"log_start":"64'12024","ondisk_log_start":"64'12024","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3063,"log_dups_size":0,"ondisk_log_size":3063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:21.579103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80543744,"num_objects":1229,"num_object_clones":0,"num_object_copies":2458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1229,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15087,"num_write_kb":522112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":128,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:36.260121+0000","last_change":"2024-09-12T18:35:24.648330+0000","last_active":"2024-09-12T18:37:36.260121+0000","last_peered":"2024-09-12T18:37:36.260121+0000","last_clean":"2024-09-12T18:37:36.260121+0000","last_became_active":"2024-09-12T18:35:24.647520+0000","last_became_peered":"2024-09-12T18:35:24.647520+0000","last_unstale":"2024-09-12T18:37:36.260121+0000","last_undegraded":"2024-09-12T18:37:36.260121+0000","last_fullsized":"2024-09-12T18:37:36.260121+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:25.552055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":128,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.489575+0000","last_change":"2024-09-12T18:35:25.658674+0000","last_active":"2024-09-12T18:37:39.489575+0000","last_peered":"2024-09-12T18:37:39.489575+0000","last_clean":"2024-09-12T18:37:39.489575+0000","last_became_active":"2024-09-12T18:35:25.657386+0000","last_became_peered":"2024-09-12T18:35:25.657386+0000","last_unstale":"2024-09-12T18:37:39.489575+0000","last_undegraded":"2024-09-12T18:37:39.489575+0000","last_fullsized":"2024-09-12T18:37:39.489575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:48.037086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"75'15068","reported_seq":15185,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:38.563690+0000","last_change":"2024-09-12T18:35:44.771738+0000","last_active":"2024-09-12T18:37:38.563690+0000","last_peered":"2024-09-12T18:37:38.563690+0000","last_clean":"2024-09-12T18:37:38.563690+0000","last_became_active":"2024-09-12T18:35:44.771227+0000","last_became_peered":"2024-09-12T18:35:44.771227+0000","last_unstale":"2024-09-12T18:37:38.563690+0000","last_undegraded":"2024-09-12T18:37:38.563690+0000","last_fullsized":"2024-09-12T18:37:38.563690+0000","mapping_epoch":21,"log_start":"62'11793","ondisk_log_start":"62'11793","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3275,"log_dups_size":0,"ondisk_log_size":3275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:27.329732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107085824,"num_objects":1634,"num_object_clones":0,"num_object_copies":3268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1634,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15068,"num_write_kb":534464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":128,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:36.259554+0000","last_change":"2024-09-12T18:35:24.646810+0000","last_active":"2024-09-12T18:37:36.259554+0000","last_peered":"2024-09-12T18:37:36.259554+0000","last_clean":"2024-09-12T18:37:36.259554+0000","last_became_active":"2024-09-12T18:35:24.646008+0000","last_became_peered":"2024-09-12T18:35:24.646008+0000","last_unstale":"2024-09-12T18:37:36.259554+0000","last_undegraded":"2024-09-12T18:37:36.259554+0000","last_fullsized":"2024-09-12T18:37:36.259554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:43.888776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":128,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.490055+0000","last_change":"2024-09-12T18:35:25.667710+0000","last_active":"2024-09-12T18:37:39.490055+0000","last_peered":"2024-09-12T18:37:39.490055+0000","last_clean":"2024-09-12T18:37:39.490055+0000","last_became_active":"2024-09-12T18:35:25.666940+0000","last_became_peered":"2024-09-12T18:35:25.666940+0000","last_unstale":"2024-09-12T18:37:39.490055+0000","last_undegraded":"2024-09-12T18:37:39.490055+0000","last_fullsized":"2024-09-12T18:37:39.490055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:09.823085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"75'14727","reported_seq":14842,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:38.553568+0000","last_change":"2024-09-12T18:35:44.769127+0000","last_active":"2024-09-12T18:37:38.553568+0000","last_peered":"2024-09-12T18:37:38.553568+0000","last_clean":"2024-09-12T18:37:38.553568+0000","last_became_active":"2024-09-12T18:35:44.768382+0000","last_became_peered":"2024-09-12T18:35:44.768382+0000","last_unstale":"2024-09-12T18:37:38.553568+0000","last_undegraded":"2024-09-12T18:37:38.553568+0000","last_fullsized":"2024-09-12T18:37:38.553568+0000","mapping_epoch":21,"log_start":"61'11429","ondisk_log_start":"61'11429","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3298,"log_dups_size":0,"ondisk_log_size":3298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:33.385476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108724224,"num_objects":1659,"num_object_clones":0,"num_object_copies":3318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1659,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14727,"num_write_kb":524352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":280,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.488652+0000","last_change":"2024-09-12T18:35:13.489018+0000","last_active":"2024-09-12T18:37:39.488652+0000","last_peered":"2024-09-12T18:37:39.488652+0000","last_clean":"2024-09-12T18:37:39.488652+0000","last_became_active":"2024-09-12T18:35:13.488346+0000","last_became_peered":"2024-09-12T18:35:13.488346+0000","last_unstale":"2024-09-12T18:37:39.488652+0000","last_undegraded":"2024-09-12T18:37:39.488652+0000","last_fullsized":"2024-09-12T18:37:39.488652+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_clean_scrub_stamp":"2024-09-12T18:35:12.464628+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:54.864640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":144,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.489163+0000","last_change":"2024-09-12T18:35:22.459694+0000","last_active":"2024-09-12T18:37:39.489163+0000","last_peered":"2024-09-12T18:37:39.489163+0000","last_clean":"2024-09-12T18:37:39.489163+0000","last_became_active":"2024-09-12T18:35:20.446796+0000","last_became_peered":"2024-09-12T18:35:20.446796+0000","last_unstale":"2024-09-12T18:37:39.489163+0000","last_undegraded":"2024-09-12T18:37:39.489163+0000","last_fullsized":"2024-09-12T18:37:39.489163+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:21.506024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016291610000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":64,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:36.259869+0000","last_change":"2024-09-12T18:36:39.072775+0000","last_active":"2024-09-12T18:37:36.259869+0000","last_peered":"2024-09-12T18:37:36.259869+0000","last_clean":"2024-09-12T18:37:36.259869+0000","last_became_active":"2024-09-12T18:36:39.072247+0000","last_became_peered":"2024-09-12T18:36:39.072247+0000","last_unstale":"2024-09-12T18:37:36.259869+0000","last_undegraded":"2024-09-12T18:37:36.259869+0000","last_fullsized":"2024-09-12T18:37:36.259869+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:07.105080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":128,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.489483+0000","last_change":"2024-09-12T18:35:25.662424+0000","last_active":"2024-09-12T18:37:39.489483+0000","last_peered":"2024-09-12T18:37:39.489483+0000","last_clean":"2024-09-12T18:37:39.489483+0000","last_became_active":"2024-09-12T18:35:25.661043+0000","last_became_peered":"2024-09-12T18:35:25.661043+0000","last_unstale":"2024-09-12T18:37:39.489483+0000","last_undegraded":"2024-09-12T18:37:39.489483+0000","last_fullsized":"2024-09-12T18:37:39.489483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:52.551802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.7","version":"76'15346","reported_seq":15465,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:41.563829+0000","last_change":"2024-09-12T18:35:44.774505+0000","last_active":"2024-09-12T18:37:41.563829+0000","last_peered":"2024-09-12T18:37:41.563829+0000","last_clean":"2024-09-12T18:37:41.563829+0000","last_became_active":"2024-09-12T18:35:44.774259+0000","last_became_peered":"2024-09-12T18:35:44.774259+0000","last_unstale":"2024-09-12T18:37:41.563829+0000","last_undegraded":"2024-09-12T18:37:41.563829+0000","last_fullsized":"2024-09-12T18:37:41.563829+0000","mapping_epoch":21,"log_start":"66'12269","ondisk_log_start":"66'12269","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3077,"log_dups_size":0,"ondisk_log_size":3077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:21.731670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84017152,"num_objects":1282,"num_object_clones":0,"num_object_copies":2564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1282,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15346,"num_write_kb":532096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":143,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.488478+0000","last_change":"2024-09-12T18:35:22.459090+0000","last_active":"2024-09-12T18:37:39.488478+0000","last_peered":"2024-09-12T18:37:39.488478+0000","last_clean":"2024-09-12T18:37:39.488478+0000","last_became_active":"2024-09-12T18:35:20.448553+0000","last_became_peered":"2024-09-12T18:35:20.448553+0000","last_unstale":"2024-09-12T18:37:39.488478+0000","last_undegraded":"2024-09-12T18:37:39.488478+0000","last_fullsized":"2024-09-12T18:37:39.488478+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:56.834808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001030836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":130,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.489892+0000","last_change":"2024-09-12T18:35:24.651597+0000","last_active":"2024-09-12T18:37:39.489892+0000","last_peered":"2024-09-12T18:37:39.489892+0000","last_clean":"2024-09-12T18:37:39.489892+0000","last_became_active":"2024-09-12T18:35:24.649940+0000","last_became_peered":"2024-09-12T18:35:24.649940+0000","last_unstale":"2024-09-12T18:37:39.489892+0000","last_undegraded":"2024-09-12T18:37:39.489892+0000","last_fullsized":"2024-09-12T18:37:39.489892+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:36.822432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":132,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:36.260858+0000","last_change":"2024-09-12T18:36:39.076901+0000","last_active":"2024-09-12T18:37:36.260858+0000","last_peered":"2024-09-12T18:37:36.260858+0000","last_clean":"2024-09-12T18:37:36.260858+0000","last_became_active":"2024-09-12T18:36:39.076178+0000","last_became_peered":"2024-09-12T18:36:39.076178+0000","last_unstale":"2024-09-12T18:37:36.260858+0000","last_undegraded":"2024-09-12T18:37:36.260858+0000","last_fullsized":"2024-09-12T18:37:36.260858+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:42.901643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"76'15306","reported_seq":15425,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:41.559206+0000","last_change":"2024-09-12T18:35:44.770379+0000","last_active":"2024-09-12T18:37:41.559206+0000","last_peered":"2024-09-12T18:37:41.559206+0000","last_clean":"2024-09-12T18:37:41.559206+0000","last_became_active":"2024-09-12T18:35:44.769739+0000","last_became_peered":"2024-09-12T18:35:44.769739+0000","last_unstale":"2024-09-12T18:37:41.559206+0000","last_undegraded":"2024-09-12T18:37:41.559206+0000","last_fullsized":"2024-09-12T18:37:41.559206+0000","mapping_epoch":21,"log_start":"55'9223","ondisk_log_start":"55'9223","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":6083,"log_dups_size":0,"ondisk_log_size":6083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:02:23.077263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80478208,"num_objects":1228,"num_object_clones":0,"num_object_copies":2456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1228,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15306,"num_write_kb":529088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":143,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.489785+0000","last_change":"2024-09-12T18:35:22.464179+0000","last_active":"2024-09-12T18:37:39.489785+0000","last_peered":"2024-09-12T18:37:39.489785+0000","last_clean":"2024-09-12T18:37:39.489785+0000","last_became_active":"2024-09-12T18:35:20.442613+0000","last_became_peered":"2024-09-12T18:35:20.442613+0000","last_unstale":"2024-09-12T18:37:39.489785+0000","last_undegraded":"2024-09-12T18:37:39.489785+0000","last_fullsized":"2024-09-12T18:37:39.489785+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:17.636537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014134620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":128,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:36.259459+0000","last_change":"2024-09-12T18:35:24.641297+0000","last_active":"2024-09-12T18:37:36.259459+0000","last_peered":"2024-09-12T18:37:36.259459+0000","last_clean":"2024-09-12T18:37:36.259459+0000","last_became_active":"2024-09-12T18:35:24.637334+0000","last_became_peered":"2024-09-12T18:35:24.637334+0000","last_unstale":"2024-09-12T18:37:36.259459+0000","last_undegraded":"2024-09-12T18:37:36.259459+0000","last_fullsized":"2024-09-12T18:37:36.259459+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:50.772074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":62,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:36.260676+0000","last_change":"2024-09-12T18:36:40.073534+0000","last_active":"2024-09-12T18:37:36.260676+0000","last_peered":"2024-09-12T18:37:36.260676+0000","last_clean":"2024-09-12T18:37:36.260676+0000","last_became_active":"2024-09-12T18:36:40.071694+0000","last_became_peered":"2024-09-12T18:36:40.071694+0000","last_unstale":"2024-09-12T18:37:36.260676+0000","last_undegraded":"2024-09-12T18:37:36.260676+0000","last_fullsized":"2024-09-12T18:37:36.260676+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:16.018454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"76'15492","reported_seq":22109,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:41.518564+0000","last_change":"2024-09-12T18:37:35.345752+0000","last_active":"2024-09-12T18:37:41.518564+0000","last_peered":"2024-09-12T18:37:41.518564+0000","last_clean":"2024-09-12T18:37:41.518564+0000","last_became_active":"2024-09-12T18:37:35.269137+0000","last_became_peered":"2024-09-12T18:37:35.269137+0000","last_unstale":"2024-09-12T18:37:41.518564+0000","last_undegraded":"2024-09-12T18:37:41.518564+0000","last_fullsized":"2024-09-12T18:37:41.518564+0000","mapping_epoch":73,"log_start":"66'12424","ondisk_log_start":"66'12424","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3068,"log_dups_size":0,"ondisk_log_size":3068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:59.463354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82575360,"num_objects":1260,"num_object_clones":0,"num_object_copies":2520,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1260,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15492,"num_write_kb":536064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3242,"num_bytes_recovered":212467712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":145,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.488718+0000","last_change":"2024-09-12T18:35:22.459049+0000","last_active":"2024-09-12T18:37:39.488718+0000","last_peered":"2024-09-12T18:37:39.488718+0000","last_clean":"2024-09-12T18:37:39.488718+0000","last_became_active":"2024-09-12T18:35:20.446814+0000","last_became_peered":"2024-09-12T18:35:20.446814+0000","last_unstale":"2024-09-12T18:37:39.488718+0000","last_undegraded":"2024-09-12T18:37:39.488718+0000","last_fullsized":"2024-09-12T18:37:39.488718+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:18.033595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010716149999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":130,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.489122+0000","last_change":"2024-09-12T18:35:24.658273+0000","last_active":"2024-09-12T18:37:39.489122+0000","last_peered":"2024-09-12T18:37:39.489122+0000","last_clean":"2024-09-12T18:37:39.489122+0000","last_became_active":"2024-09-12T18:35:24.657433+0000","last_became_peered":"2024-09-12T18:35:24.657433+0000","last_unstale":"2024-09-12T18:37:39.489122+0000","last_undegraded":"2024-09-12T18:37:39.489122+0000","last_fullsized":"2024-09-12T18:37:39.489122+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:48.497218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":62,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:36.260246+0000","last_change":"2024-09-12T18:36:40.076054+0000","last_active":"2024-09-12T18:37:36.260246+0000","last_peered":"2024-09-12T18:37:36.260246+0000","last_clean":"2024-09-12T18:37:36.260246+0000","last_became_active":"2024-09-12T18:36:40.073803+0000","last_became_peered":"2024-09-12T18:36:40.073803+0000","last_unstale":"2024-09-12T18:37:36.260246+0000","last_undegraded":"2024-09-12T18:37:36.260246+0000","last_fullsized":"2024-09-12T18:37:36.260246+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:49.085420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"76'15073","reported_seq":15192,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:41.548117+0000","last_change":"2024-09-12T18:35:44.770799+0000","last_active":"2024-09-12T18:37:41.548117+0000","last_peered":"2024-09-12T18:37:41.548117+0000","last_clean":"2024-09-12T18:37:41.548117+0000","last_became_active":"2024-09-12T18:35:44.770030+0000","last_became_peered":"2024-09-12T18:35:44.770030+0000","last_unstale":"2024-09-12T18:37:41.548117+0000","last_undegraded":"2024-09-12T18:37:41.548117+0000","last_fullsized":"2024-09-12T18:37:41.548117+0000","mapping_epoch":21,"log_start":"55'9056","ondisk_log_start":"55'9056","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":6017,"log_dups_size":0,"ondisk_log_size":6017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:24.786452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76742656,"num_objects":1171,"num_object_clones":0,"num_object_copies":2342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1171,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15073,"num_write_kb":519808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":130,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.489034+0000","last_change":"2024-09-12T18:35:24.657618+0000","last_active":"2024-09-12T18:37:39.489034+0000","last_peered":"2024-09-12T18:37:39.489034+0000","last_clean":"2024-09-12T18:37:39.489034+0000","last_became_active":"2024-09-12T18:35:24.656741+0000","last_became_peered":"2024-09-12T18:35:24.656741+0000","last_unstale":"2024-09-12T18:37:39.489034+0000","last_undegraded":"2024-09-12T18:37:39.489034+0000","last_fullsized":"2024-09-12T18:37:39.489034+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:43.113104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":143,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.490227+0000","last_change":"2024-09-12T18:35:22.464180+0000","last_active":"2024-09-12T18:37:39.490227+0000","last_peered":"2024-09-12T18:37:39.490227+0000","last_clean":"2024-09-12T18:37:39.490227+0000","last_became_active":"2024-09-12T18:35:20.442566+0000","last_became_peered":"2024-09-12T18:35:20.442566+0000","last_unstale":"2024-09-12T18:37:39.490227+0000","last_undegraded":"2024-09-12T18:37:39.490227+0000","last_fullsized":"2024-09-12T18:37:39.490227+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:29.021710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001325786,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":126,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:36.260124+0000","last_change":"2024-09-12T18:35:25.650458+0000","last_active":"2024-09-12T18:37:36.260124+0000","last_peered":"2024-09-12T18:37:36.260124+0000","last_clean":"2024-09-12T18:37:36.260124+0000","last_became_active":"2024-09-12T18:35:25.648761+0000","last_became_peered":"2024-09-12T18:35:25.648761+0000","last_unstale":"2024-09-12T18:37:36.260124+0000","last_undegraded":"2024-09-12T18:37:36.260124+0000","last_fullsized":"2024-09-12T18:37:36.260124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:53.026950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"76'15166","reported_seq":15285,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:41.551979+0000","last_change":"2024-09-12T18:35:44.773801+0000","last_active":"2024-09-12T18:37:41.551979+0000","last_peered":"2024-09-12T18:37:41.551979+0000","last_clean":"2024-09-12T18:37:41.551979+0000","last_became_active":"2024-09-12T18:35:44.772787+0000","last_became_peered":"2024-09-12T18:35:44.772787+0000","last_unstale":"2024-09-12T18:37:41.551979+0000","last_undegraded":"2024-09-12T18:37:41.551979+0000","last_fullsized":"2024-09-12T18:37:41.551979+0000","mapping_epoch":21,"log_start":"64'12082","ondisk_log_start":"64'12082","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3084,"log_dups_size":0,"ondisk_log_size":3084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:13.758208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80871424,"num_objects":1234,"num_object_clones":0,"num_object_copies":2468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1234,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15166,"num_write_kb":524800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":62,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:36.260350+0000","last_change":"2024-09-12T18:36:40.076936+0000","last_active":"2024-09-12T18:37:36.260350+0000","last_peered":"2024-09-12T18:37:36.260350+0000","last_clean":"2024-09-12T18:37:36.260350+0000","last_became_active":"2024-09-12T18:36:40.075987+0000","last_became_peered":"2024-09-12T18:36:40.075987+0000","last_unstale":"2024-09-12T18:37:36.260350+0000","last_undegraded":"2024-09-12T18:37:36.260350+0000","last_fullsized":"2024-09-12T18:37:36.260350+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:31.242588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":147,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:36.260457+0000","last_change":"2024-09-12T18:36:40.107062+0000","last_active":"2024-09-12T18:37:36.260457+0000","last_peered":"2024-09-12T18:37:36.260457+0000","last_clean":"2024-09-12T18:37:36.260457+0000","last_became_active":"2024-09-12T18:36:40.106366+0000","last_became_peered":"2024-09-12T18:36:40.106366+0000","last_unstale":"2024-09-12T18:37:36.260457+0000","last_undegraded":"2024-09-12T18:37:36.260457+0000","last_fullsized":"2024-09-12T18:37:36.260457+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:43.504139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080163599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":126,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:36.260097+0000","last_change":"2024-09-12T18:35:25.650717+0000","last_active":"2024-09-12T18:37:36.260097+0000","last_peered":"2024-09-12T18:37:36.260097+0000","last_clean":"2024-09-12T18:37:36.260097+0000","last_became_active":"2024-09-12T18:35:25.649147+0000","last_became_peered":"2024-09-12T18:35:25.649147+0000","last_unstale":"2024-09-12T18:37:36.260097+0000","last_undegraded":"2024-09-12T18:37:36.260097+0000","last_fullsized":"2024-09-12T18:37:36.260097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:07.365888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"76'15245","reported_seq":28307,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:41.539600+0000","last_change":"2024-09-12T18:37:17.275703+0000","last_active":"2024-09-12T18:37:41.539600+0000","last_peered":"2024-09-12T18:37:41.539600+0000","last_clean":"2024-09-12T18:37:41.539600+0000","last_became_active":"2024-09-12T18:37:17.230502+0000","last_became_peered":"2024-09-12T18:37:17.230502+0000","last_unstale":"2024-09-12T18:37:41.539600+0000","last_undegraded":"2024-09-12T18:37:41.539600+0000","last_fullsized":"2024-09-12T18:37:41.539600+0000","mapping_epoch":65,"log_start":"66'12201","ondisk_log_start":"66'12201","created":21,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3044,"log_dups_size":0,"ondisk_log_size":3044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:25.651321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81199104,"num_objects":1239,"num_object_clones":0,"num_object_copies":2478,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1239,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15245,"num_write_kb":527488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6464,"num_bytes_recovered":423624704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":132,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.490201+0000","last_change":"2024-09-12T18:35:24.657234+0000","last_active":"2024-09-12T18:37:39.490201+0000","last_peered":"2024-09-12T18:37:39.490201+0000","last_clean":"2024-09-12T18:37:39.490201+0000","last_became_active":"2024-09-12T18:35:24.655950+0000","last_became_peered":"2024-09-12T18:35:24.655950+0000","last_unstale":"2024-09-12T18:37:39.490201+0000","last_undegraded":"2024-09-12T18:37:39.490201+0000","last_fullsized":"2024-09-12T18:37:39.490201+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:17.466623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.489245+0000","last_change":"2024-09-12T18:37:34.258443+0000","last_active":"2024-09-12T18:37:39.489245+0000","last_peered":"2024-09-12T18:37:39.489245+0000","last_clean":"2024-09-12T18:37:39.489245+0000","last_became_active":"2024-09-12T18:37:34.254999+0000","last_became_peered":"2024-09-12T18:37:34.254999+0000","last_unstale":"2024-09-12T18:37:39.489245+0000","last_undegraded":"2024-09-12T18:37:39.489245+0000","last_fullsized":"2024-09-12T18:37:39.489245+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:23.164676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":66,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.488068+0000","last_change":"2024-09-12T18:36:39.071682+0000","last_active":"2024-09-12T18:37:39.488068+0000","last_peered":"2024-09-12T18:37:39.488068+0000","last_clean":"2024-09-12T18:37:39.488068+0000","last_became_active":"2024-09-12T18:36:39.070834+0000","last_became_peered":"2024-09-12T18:36:39.070834+0000","last_unstale":"2024-09-12T18:37:39.488068+0000","last_undegraded":"2024-09-12T18:37:39.488068+0000","last_fullsized":"2024-09-12T18:37:39.488068+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:58.394442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"75'15055","reported_seq":28168,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:38.547637+0000","last_change":"2024-09-12T18:37:17.272272+0000","last_active":"2024-09-12T18:37:38.547637+0000","last_peered":"2024-09-12T18:37:38.547637+0000","last_clean":"2024-09-12T18:37:38.547637+0000","last_became_active":"2024-09-12T18:37:17.229009+0000","last_became_peered":"2024-09-12T18:37:17.229009+0000","last_unstale":"2024-09-12T18:37:38.547637+0000","last_undegraded":"2024-09-12T18:37:38.547637+0000","last_fullsized":"2024-09-12T18:37:38.547637+0000","mapping_epoch":65,"log_start":"63'11828","ondisk_log_start":"63'11828","created":21,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3227,"log_dups_size":0,"ondisk_log_size":3227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:54.939350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104923136,"num_objects":1601,"num_object_clones":0,"num_object_copies":3202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1601,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15055,"num_write_kb":532992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6490,"num_bytes_recovered":425328640,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":82,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.489523+0000","last_change":"2024-09-12T18:36:40.122885+0000","last_active":"2024-09-12T18:37:39.489523+0000","last_peered":"2024-09-12T18:37:39.489523+0000","last_clean":"2024-09-12T18:37:39.489523+0000","last_became_active":"2024-09-12T18:36:40.090372+0000","last_became_peered":"2024-09-12T18:36:40.090372+0000","last_unstale":"2024-09-12T18:37:39.489523+0000","last_undegraded":"2024-09-12T18:37:39.489523+0000","last_fullsized":"2024-09-12T18:37:39.489523+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:55.648109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":143,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.489870+0000","last_change":"2024-09-12T18:35:22.459767+0000","last_active":"2024-09-12T18:37:39.489870+0000","last_peered":"2024-09-12T18:37:39.489870+0000","last_clean":"2024-09-12T18:37:39.489870+0000","last_became_active":"2024-09-12T18:35:20.448521+0000","last_became_peered":"2024-09-12T18:35:20.448521+0000","last_unstale":"2024-09-12T18:37:39.489870+0000","last_undegraded":"2024-09-12T18:37:39.489870+0000","last_fullsized":"2024-09-12T18:37:39.489870+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:33.463792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017009670000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":126,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:36.259745+0000","last_change":"2024-09-12T18:35:25.648150+0000","last_active":"2024-09-12T18:37:36.259745+0000","last_peered":"2024-09-12T18:37:36.259745+0000","last_clean":"2024-09-12T18:37:36.259745+0000","last_became_active":"2024-09-12T18:35:25.647347+0000","last_became_peered":"2024-09-12T18:35:25.647347+0000","last_unstale":"2024-09-12T18:37:36.259745+0000","last_undegraded":"2024-09-12T18:37:36.259745+0000","last_fullsized":"2024-09-12T18:37:36.259745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:48.968336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":127,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.488846+0000","last_change":"2024-09-12T18:35:25.660696+0000","last_active":"2024-09-12T18:37:39.488846+0000","last_peered":"2024-09-12T18:37:39.488846+0000","last_clean":"2024-09-12T18:37:39.488846+0000","last_became_active":"2024-09-12T18:35:25.659827+0000","last_became_peered":"2024-09-12T18:35:25.659827+0000","last_unstale":"2024-09-12T18:37:39.488846+0000","last_undegraded":"2024-09-12T18:37:39.488846+0000","last_fullsized":"2024-09-12T18:37:39.488846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:15.678289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":135,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.489333+0000","last_change":"2024-09-12T18:35:24.655051+0000","last_active":"2024-09-12T18:37:39.489333+0000","last_peered":"2024-09-12T18:37:39.489333+0000","last_clean":"2024-09-12T18:37:39.489333+0000","last_became_active":"2024-09-12T18:35:24.654282+0000","last_became_peered":"2024-09-12T18:35:24.654282+0000","last_unstale":"2024-09-12T18:37:39.489333+0000","last_undegraded":"2024-09-12T18:37:39.489333+0000","last_fullsized":"2024-09-12T18:37:39.489333+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:08.159799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":62,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:36.259624+0000","last_change":"2024-09-12T18:36:40.073370+0000","last_active":"2024-09-12T18:37:36.259624+0000","last_peered":"2024-09-12T18:37:36.259624+0000","last_clean":"2024-09-12T18:37:36.259624+0000","last_became_active":"2024-09-12T18:36:40.071392+0000","last_became_peered":"2024-09-12T18:36:40.071392+0000","last_unstale":"2024-09-12T18:37:36.259624+0000","last_undegraded":"2024-09-12T18:37:36.259624+0000","last_fullsized":"2024-09-12T18:37:36.259624+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:32:33.237004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":130,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:36.260560+0000","last_change":"2024-09-12T18:35:24.648658+0000","last_active":"2024-09-12T18:37:36.260560+0000","last_peered":"2024-09-12T18:37:36.260560+0000","last_clean":"2024-09-12T18:37:36.260560+0000","last_became_active":"2024-09-12T18:35:24.647826+0000","last_became_peered":"2024-09-12T18:35:24.647826+0000","last_unstale":"2024-09-12T18:37:36.260560+0000","last_undegraded":"2024-09-12T18:37:36.260560+0000","last_fullsized":"2024-09-12T18:37:36.260560+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:24.167549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":135,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.489821+0000","last_change":"2024-09-12T18:36:40.091223+0000","last_active":"2024-09-12T18:37:39.489821+0000","last_peered":"2024-09-12T18:37:39.489821+0000","last_clean":"2024-09-12T18:37:39.489821+0000","last_became_active":"2024-09-12T18:36:40.090813+0000","last_became_peered":"2024-09-12T18:36:40.090813+0000","last_unstale":"2024-09-12T18:37:39.489821+0000","last_undegraded":"2024-09-12T18:37:39.489821+0000","last_fullsized":"2024-09-12T18:37:39.489821+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:26.055034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":127,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.489602+0000","last_change":"2024-09-12T18:35:25.661801+0000","last_active":"2024-09-12T18:37:39.489602+0000","last_peered":"2024-09-12T18:37:39.489602+0000","last_clean":"2024-09-12T18:37:39.489602+0000","last_became_active":"2024-09-12T18:35:25.658476+0000","last_became_peered":"2024-09-12T18:35:25.658476+0000","last_unstale":"2024-09-12T18:37:39.489602+0000","last_undegraded":"2024-09-12T18:37:39.489602+0000","last_fullsized":"2024-09-12T18:37:39.489602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:58.246449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":129,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.490098+0000","last_change":"2024-09-12T18:35:24.652399+0000","last_active":"2024-09-12T18:37:39.490098+0000","last_peered":"2024-09-12T18:37:39.490098+0000","last_clean":"2024-09-12T18:37:39.490098+0000","last_became_active":"2024-09-12T18:35:24.651416+0000","last_became_peered":"2024-09-12T18:35:24.651416+0000","last_unstale":"2024-09-12T18:37:39.490098+0000","last_undegraded":"2024-09-12T18:37:39.490098+0000","last_fullsized":"2024-09-12T18:37:39.490098+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:32.594978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":64,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:36.259790+0000","last_change":"2024-09-12T18:36:39.073330+0000","last_active":"2024-09-12T18:37:36.259790+0000","last_peered":"2024-09-12T18:37:36.259790+0000","last_clean":"2024-09-12T18:37:36.259790+0000","last_became_active":"2024-09-12T18:36:39.072515+0000","last_became_peered":"2024-09-12T18:36:39.072515+0000","last_unstale":"2024-09-12T18:37:36.259790+0000","last_undegraded":"2024-09-12T18:37:36.259790+0000","last_fullsized":"2024-09-12T18:37:36.259790+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:17.697509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":126,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:36.260986+0000","last_change":"2024-09-12T18:35:25.651217+0000","last_active":"2024-09-12T18:37:36.260986+0000","last_peered":"2024-09-12T18:37:36.260986+0000","last_clean":"2024-09-12T18:37:36.260986+0000","last_became_active":"2024-09-12T18:35:25.649544+0000","last_became_peered":"2024-09-12T18:35:25.649544+0000","last_unstale":"2024-09-12T18:37:36.260986+0000","last_undegraded":"2024-09-12T18:37:36.260986+0000","last_fullsized":"2024-09-12T18:37:36.260986+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:41.601376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":64,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:36.259452+0000","last_change":"2024-09-12T18:36:39.076239+0000","last_active":"2024-09-12T18:37:36.259452+0000","last_peered":"2024-09-12T18:37:36.259452+0000","last_clean":"2024-09-12T18:37:36.259452+0000","last_became_active":"2024-09-12T18:36:39.075023+0000","last_became_peered":"2024-09-12T18:36:39.075023+0000","last_unstale":"2024-09-12T18:37:36.259452+0000","last_undegraded":"2024-09-12T18:37:36.259452+0000","last_fullsized":"2024-09-12T18:37:36.259452+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:19.618576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":128,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.489985+0000","last_change":"2024-09-12T18:35:25.661544+0000","last_active":"2024-09-12T18:37:39.489985+0000","last_peered":"2024-09-12T18:37:39.489985+0000","last_clean":"2024-09-12T18:37:39.489985+0000","last_became_active":"2024-09-12T18:35:25.656985+0000","last_became_peered":"2024-09-12T18:35:25.656985+0000","last_unstale":"2024-09-12T18:37:39.489985+0000","last_undegraded":"2024-09-12T18:37:39.489985+0000","last_fullsized":"2024-09-12T18:37:39.489985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":66,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.488274+0000","last_change":"2024-09-12T18:36:39.073200+0000","last_active":"2024-09-12T18:37:39.488274+0000","last_peered":"2024-09-12T18:37:39.488274+0000","last_clean":"2024-09-12T18:37:39.488274+0000","last_became_active":"2024-09-12T18:36:39.072553+0000","last_became_peered":"2024-09-12T18:36:39.072553+0000","last_unstale":"2024-09-12T18:37:39.488274+0000","last_undegraded":"2024-09-12T18:37:39.488274+0000","last_fullsized":"2024-09-12T18:37:39.488274+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:02.283482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":125,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:36.261035+0000","last_change":"2024-09-12T18:35:25.656712+0000","last_active":"2024-09-12T18:37:36.261035+0000","last_peered":"2024-09-12T18:37:36.261035+0000","last_clean":"2024-09-12T18:37:36.261035+0000","last_became_active":"2024-09-12T18:35:25.654473+0000","last_became_peered":"2024-09-12T18:35:25.654473+0000","last_unstale":"2024-09-12T18:37:36.261035+0000","last_undegraded":"2024-09-12T18:37:36.261035+0000","last_fullsized":"2024-09-12T18:37:36.261035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:01.464680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":128,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:36.260215+0000","last_change":"2024-09-12T18:35:24.659935+0000","last_active":"2024-09-12T18:37:36.260215+0000","last_peered":"2024-09-12T18:37:36.260215+0000","last_clean":"2024-09-12T18:37:36.260215+0000","last_became_active":"2024-09-12T18:35:24.659111+0000","last_became_peered":"2024-09-12T18:35:24.659111+0000","last_unstale":"2024-09-12T18:37:36.260215+0000","last_undegraded":"2024-09-12T18:37:36.260215+0000","last_fullsized":"2024-09-12T18:37:36.260215+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:11.480154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":131,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:36.260465+0000","last_change":"2024-09-12T18:36:39.076804+0000","last_active":"2024-09-12T18:37:36.260465+0000","last_peered":"2024-09-12T18:37:36.260465+0000","last_clean":"2024-09-12T18:37:36.260465+0000","last_became_active":"2024-09-12T18:36:39.075916+0000","last_became_peered":"2024-09-12T18:36:39.075916+0000","last_unstale":"2024-09-12T18:37:36.260465+0000","last_undegraded":"2024-09-12T18:37:36.260465+0000","last_fullsized":"2024-09-12T18:37:36.260465+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:36.280719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":128,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:36.260202+0000","last_change":"2024-09-12T18:35:24.638538+0000","last_active":"2024-09-12T18:37:36.260202+0000","last_peered":"2024-09-12T18:37:36.260202+0000","last_clean":"2024-09-12T18:37:36.260202+0000","last_became_active":"2024-09-12T18:35:24.637242+0000","last_became_peered":"2024-09-12T18:35:24.637242+0000","last_unstale":"2024-09-12T18:37:36.260202+0000","last_undegraded":"2024-09-12T18:37:36.260202+0000","last_fullsized":"2024-09-12T18:37:36.260202+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:26.877441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":127,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.488836+0000","last_change":"2024-09-12T18:35:25.662537+0000","last_active":"2024-09-12T18:37:39.488836+0000","last_peered":"2024-09-12T18:37:39.488836+0000","last_clean":"2024-09-12T18:37:39.488836+0000","last_became_active":"2024-09-12T18:35:25.661441+0000","last_became_peered":"2024-09-12T18:35:25.661441+0000","last_unstale":"2024-09-12T18:37:39.488836+0000","last_undegraded":"2024-09-12T18:37:39.488836+0000","last_fullsized":"2024-09-12T18:37:39.488836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:14.397867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":141,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.489270+0000","last_change":"2024-09-12T18:36:39.091935+0000","last_active":"2024-09-12T18:37:39.489270+0000","last_peered":"2024-09-12T18:37:39.489270+0000","last_clean":"2024-09-12T18:37:39.489270+0000","last_became_active":"2024-09-12T18:36:39.071545+0000","last_became_peered":"2024-09-12T18:36:39.071545+0000","last_unstale":"2024-09-12T18:37:39.489270+0000","last_undegraded":"2024-09-12T18:37:39.489270+0000","last_fullsized":"2024-09-12T18:37:39.489270+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:35.815126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":127,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.488610+0000","last_change":"2024-09-12T18:35:25.651406+0000","last_active":"2024-09-12T18:37:39.488610+0000","last_peered":"2024-09-12T18:37:39.488610+0000","last_clean":"2024-09-12T18:37:39.488610+0000","last_became_active":"2024-09-12T18:35:25.649728+0000","last_became_peered":"2024-09-12T18:35:25.649728+0000","last_unstale":"2024-09-12T18:37:39.488610+0000","last_undegraded":"2024-09-12T18:37:39.488610+0000","last_fullsized":"2024-09-12T18:37:39.488610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:41.773283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":129,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:36.260956+0000","last_change":"2024-09-12T18:35:24.649153+0000","last_active":"2024-09-12T18:37:36.260956+0000","last_peered":"2024-09-12T18:37:36.260956+0000","last_clean":"2024-09-12T18:37:36.260956+0000","last_became_active":"2024-09-12T18:35:24.648512+0000","last_became_peered":"2024-09-12T18:35:24.648512+0000","last_unstale":"2024-09-12T18:37:36.260956+0000","last_undegraded":"2024-09-12T18:37:36.260956+0000","last_fullsized":"2024-09-12T18:37:36.260956+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:07.810456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":125,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T18:37:36.260127+0000","last_change":"2024-09-12T18:35:25.656799+0000","last_active":"2024-09-12T18:37:36.260127+0000","last_peered":"2024-09-12T18:37:36.260127+0000","last_clean":"2024-09-12T18:37:36.260127+0000","last_became_active":"2024-09-12T18:35:25.654980+0000","last_became_peered":"2024-09-12T18:35:25.654980+0000","last_unstale":"2024-09-12T18:37:36.260127+0000","last_undegraded":"2024-09-12T18:37:36.260127+0000","last_fullsized":"2024-09-12T18:37:36.260127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:10.735439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":131,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.490235+0000","last_change":"2024-09-12T18:35:24.656268+0000","last_active":"2024-09-12T18:37:39.490235+0000","last_peered":"2024-09-12T18:37:39.490235+0000","last_clean":"2024-09-12T18:37:39.490235+0000","last_became_active":"2024-09-12T18:35:24.655420+0000","last_became_peered":"2024-09-12T18:35:24.655420+0000","last_unstale":"2024-09-12T18:37:39.490235+0000","last_undegraded":"2024-09-12T18:37:39.490235+0000","last_fullsized":"2024-09-12T18:37:39.490235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:04.654666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":133,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.488375+0000","last_change":"2024-09-12T18:36:40.154820+0000","last_active":"2024-09-12T18:37:39.488375+0000","last_peered":"2024-09-12T18:37:39.488375+0000","last_clean":"2024-09-12T18:37:39.488375+0000","last_became_active":"2024-09-12T18:36:40.154431+0000","last_became_peered":"2024-09-12T18:36:40.154431+0000","last_unstale":"2024-09-12T18:37:39.488375+0000","last_undegraded":"2024-09-12T18:37:39.488375+0000","last_fullsized":"2024-09-12T18:37:39.488375+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:04.432378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":83,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-12T18:37:39.489662+0000","last_change":"2024-09-12T18:36:39.087685+0000","last_active":"2024-09-12T18:37:39.489662+0000","last_peered":"2024-09-12T18:37:39.489662+0000","last_clean":"2024-09-12T18:37:39.489662+0000","last_became_active":"2024-09-12T18:36:39.071493+0000","last_became_peered":"2024-09-12T18:36:39.071493+0000","last_unstale":"2024-09-12T18:37:39.489662+0000","last_undegraded":"2024-09-12T18:37:39.489662+0000","last_fullsized":"2024-09-12T18:37:39.489662+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:13.765236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1459486744,"num_objects":22271,"num_object_clones":0,"num_object_copies":44542,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22271,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":242279,"num_write_kb":8465537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16196,"num_bytes_recovered":1061421056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":180436992,"data_stored":2886860848,"data_compressed":137127635,"data_compressed_allocated":180428800,"data_compressed_original":2886860800,"omap_allocated":0,"internal_metadata":0},"log_size":62283,"ondisk_log_size":62283,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705696,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":335876,"kb_used_data":74216,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94035964,"statfs":{"total":96636764160,"available":96292827136,"internally_reserved":0,"allocated":75997184,"data_stored":1201728101,"data_compressed":57074210,"data_compressed_allocated":75096064,"data_compressed_original":1201389568,"omap_allocated":1594,"internal_metadata":267909574},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,2,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738401,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":335292,"kb_used_data":55588,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94036548,"statfs":{"total":96636764160,"available":96293425152,"internally_reserved":0,"allocated":56922112,"data_stored":896203928,"data_compressed":42561414,"data_compressed_allocated":56000512,"data_compressed_original":895860736,"omap_allocated":1595,"internal_metadata":286390725},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738401,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":339464,"kb_used_data":55596,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":94032376,"statfs":{"total":96636764160,"available":96289153024,"internally_reserved":0,"allocated":56930304,"data_stored":897315096,"data_compressed":42607624,"data_compressed_allocated":56061952,"data_compressed_original":896991232,"omap_allocated":1594,"internal_metadata":290650566},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":50675712,"data_stored":810811392,"data_compressed":38514033,"data_compressed_allocated":50675712,"data_compressed_original":810811392,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":74145792,"data_stored":1186267160,"data_compressed":56348402,"data_compressed_allocated":74141696,"data_compressed_original":1186267136,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55615488,"data_stored":889782296,"data_compressed":42265200,"data_compressed_allocated":55611392,"data_compressed_original":889782272,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:37:44.309 INFO:tasks.thrashosds.thrasher:Setting 4.20 to [1, 2, 0] 2024-09-12T18:37:44.309 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '4.20', '1', '2', '0'] 2024-09-12T18:37:44.309 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 4.20 1 2 0 2024-09-12T18:37:44.364 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:44.358+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:44.412 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:44.412 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:44.433 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:37:44.464 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:44.459+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:44.515 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T18:37:44.565 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:44.561+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:44.583 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:44.583 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:44.602 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:37:44.666 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:44.663+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:44.682 INFO:teuthology.orchestra.run.smithi073.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2024-09-12T18:37:44.687 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T18:37:44.687 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2024-09-12T18:37:44.767 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:44.765+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:44.795 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:44.796 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:44.816 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:37:44.868 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:44.863+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:44.964 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:44.964 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:44.969 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:44.965+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:44.984 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:37:45.070 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:45.062+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:45.171 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:45.166+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:45.178 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:45.178 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:45.199 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:37:45.272 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:45.266+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:45.351 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:45.351 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:45.369 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:37:45.372 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:45.366+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:45.396 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:37:45.473 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:45.466+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:45.497 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is set 2024-09-12T18:37:45.530 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:45.530 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:45.551 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:37:45.555 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:37:45.555 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:37:45.573 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:37:45.574 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:37:45.574 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:45.567+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:45.591 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:37:45.592 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:37:45.674 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:45.670+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:45.749 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:45.750 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [], 2024-09-12T18:37:45.750 INFO:teuthology.orchestra.run.smithi162.stdout: "complaint_time": 30, 2024-09-12T18:37:45.750 INFO:teuthology.orchestra.run.smithi162.stdout: "num_blocked_ops": 0 2024-09-12T18:37:45.750 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:45.773 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:37:45.816 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:45.810+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:45.876 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:45.871+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:45.973 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:45.974 INFO:teuthology.orchestra.run.smithi162.stdout: "size": 20, 2024-09-12T18:37:45.974 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 600, 2024-09-12T18:37:45.974 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:37:45.974 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.974 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167364 5.7 5:ee50096a:::benchmark_data_smithi073_23739_object35087:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:45.974 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.168715+0000", 2024-09-12T18:37:45.974 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 42.801375710999999, 2024-09-12T18:37:45.974 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.068831153000000006, 2024-09-12T18:37:45.974 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:45.974 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:45.974 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:45.974 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:45.975 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:45.975 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:45.975 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167364 2024-09-12T18:37:45.975 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.975 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:45.975 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.975 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:45.975 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168715+0000", 2024-09-12T18:37:45.975 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:45.975 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.975 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.975 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:45.975 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168715+0000", 2024-09-12T18:37:45.975 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:45.976 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.976 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.976 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:45.976 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168716+0000", 2024-09-12T18:37:45.976 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0559999999999999e-06 2024-09-12T18:37:45.976 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.976 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.976 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:45.976 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168721+0000", 2024-09-12T18:37:45.976 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8019999999999999e-06 2024-09-12T18:37:45.976 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.976 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.976 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:45.977 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168731+0000", 2024-09-12T18:37:45.977 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0315e-05 2024-09-12T18:37:45.977 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.977 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.977 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:45.977 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168738+0000", 2024-09-12T18:37:45.977 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.126e-06 2024-09-12T18:37:45.977 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.977 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.977 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:45.977 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168782+0000", 2024-09-12T18:37:45.977 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.3924000000000002e-05 2024-09-12T18:37:45.977 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.978 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.978 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:45.978 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168913+0000", 2024-09-12T18:37:45.978 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000131154 2024-09-12T18:37:45.978 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.978 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.978 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:45.978 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169026+0000", 2024-09-12T18:37:45.978 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011223299999999999 2024-09-12T18:37:45.978 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.978 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.978 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:45.978 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.175404+0000", 2024-09-12T18:37:45.978 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0063780319999999996 2024-09-12T18:37:45.979 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.979 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.979 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:45.979 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237446+0000", 2024-09-12T18:37:45.979 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.062042238 2024-09-12T18:37:45.979 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.979 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.979 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:45.979 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237501+0000", 2024-09-12T18:37:45.979 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4913000000000001e-05 2024-09-12T18:37:45.979 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.979 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.979 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:45.980 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237546+0000", 2024-09-12T18:37:45.980 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.5359999999999999e-05 2024-09-12T18:37:45.980 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:45.980 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:45.980 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:45.980 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.980 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.980 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167365 5.2 5:4107875c:::benchmark_data_smithi073_23739_object35088:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:45.980 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:45.980 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 42.801326136999997, 2024-09-12T18:37:45.980 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.078544438999999994, 2024-09-12T18:37:45.980 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:45.980 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:45.980 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:45.981 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:45.981 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:45.981 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:45.981 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167365 2024-09-12T18:37:45.981 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.981 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:45.981 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.981 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:45.981 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:45.981 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:45.981 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.981 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.981 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:45.981 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:45.982 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:45.982 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.982 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.982 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:45.982 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:45.982 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.4700000000000001e-07 2024-09-12T18:37:45.982 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.982 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.982 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:45.982 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168769+0000", 2024-09-12T18:37:45.982 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.4170000000000001e-06 2024-09-12T18:37:45.982 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.982 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.983 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:45.983 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168777+0000", 2024-09-12T18:37:45.983 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1499999999999999e-06 2024-09-12T18:37:45.983 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.983 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.983 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:45.983 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168783+0000", 2024-09-12T18:37:45.983 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.0460000000000002e-06 2024-09-12T18:37:45.983 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.983 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.983 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:45.983 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168865+0000", 2024-09-12T18:37:45.983 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1953999999999995e-05 2024-09-12T18:37:45.983 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.984 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.984 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:45.984 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169003+0000", 2024-09-12T18:37:45.984 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013798200000000001 2024-09-12T18:37:45.984 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.984 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.984 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:45.984 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169065+0000", 2024-09-12T18:37:45.984 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2218000000000006e-05 2024-09-12T18:37:45.984 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.984 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.984 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:45.984 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174771+0000", 2024-09-12T18:37:45.985 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0057054819999999996 2024-09-12T18:37:45.985 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.985 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.985 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:45.985 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.247234+0000", 2024-09-12T18:37:45.985 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.072463391000000002 2024-09-12T18:37:45.985 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.985 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.985 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:45.985 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.247273+0000", 2024-09-12T18:37:45.985 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.9069000000000002e-05 2024-09-12T18:37:45.985 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.985 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.985 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:45.986 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.247309+0000", 2024-09-12T18:37:45.986 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5982999999999998e-05 2024-09-12T18:37:45.986 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:45.986 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:45.986 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:45.986 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.986 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.986 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167369 5.7 5:e64ecabd:::benchmark_data_smithi073_23739_object35092:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:45.986 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.169042+0000", 2024-09-12T18:37:45.986 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 42.801049026000001, 2024-09-12T18:37:45.986 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.069229188999999997, 2024-09-12T18:37:45.986 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:45.986 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:45.987 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:45.987 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:45.987 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:45.987 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:45.987 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167369 2024-09-12T18:37:45.987 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.987 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:45.987 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.987 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:45.987 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169042+0000", 2024-09-12T18:37:45.987 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:45.987 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.987 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.987 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:45.988 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169042+0000", 2024-09-12T18:37:45.988 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:45.988 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.988 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.988 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:45.988 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169043+0000", 2024-09-12T18:37:45.988 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.9400000000000004e-07 2024-09-12T18:37:45.988 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.988 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.988 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:45.988 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169048+0000", 2024-09-12T18:37:45.988 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8420000000000004e-06 2024-09-12T18:37:45.989 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.989 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.989 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:45.989 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169055+0000", 2024-09-12T18:37:45.989 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.7989999999999994e-06 2024-09-12T18:37:45.989 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.989 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.989 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:45.989 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169062+0000", 2024-09-12T18:37:45.989 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.5950000000000004e-06 2024-09-12T18:37:45.989 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.989 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.989 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:45.990 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173858+0000", 2024-09-12T18:37:45.990 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0047959259999999998 2024-09-12T18:37:45.990 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.990 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.990 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:45.990 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173966+0000", 2024-09-12T18:37:45.990 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000107941 2024-09-12T18:37:45.990 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.990 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.990 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:45.990 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174043+0000", 2024-09-12T18:37:45.990 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.7360000000000005e-05 2024-09-12T18:37:45.990 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.990 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.991 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:45.991 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.175711+0000", 2024-09-12T18:37:45.991 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0016680810000000001 2024-09-12T18:37:45.991 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.991 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.991 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:45.991 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.238163+0000", 2024-09-12T18:37:45.991 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.062451523000000002 2024-09-12T18:37:45.991 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.991 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.991 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:45.991 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.238222+0000", 2024-09-12T18:37:45.991 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9723999999999999e-05 2024-09-12T18:37:45.992 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.992 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.992 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:45.992 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.238271+0000", 2024-09-12T18:37:45.992 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8504000000000002e-05 2024-09-12T18:37:45.992 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:45.992 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:45.992 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:45.992 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.992 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.992 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167373 5.5 5:ad283029:::benchmark_data_smithi073_23739_object35096:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:45.992 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:45.992 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 42.798544194999998, 2024-09-12T18:37:45.993 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.066200976999999994, 2024-09-12T18:37:45.993 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:45.993 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:45.993 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:45.993 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:45.993 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:45.993 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:45.993 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167373 2024-09-12T18:37:45.993 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.993 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:45.993 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.993 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:45.993 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:45.994 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:45.994 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.994 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.994 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:45.994 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:45.994 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:45.994 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.994 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.994 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:45.994 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:45.994 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4900000000000005e-07 2024-09-12T18:37:45.994 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.994 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.995 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:45.995 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171551+0000", 2024-09-12T18:37:45.995 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.7519999999999998e-06 2024-09-12T18:37:45.995 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.995 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.995 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:45.995 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171562+0000", 2024-09-12T18:37:45.995 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0353000000000001e-05 2024-09-12T18:37:45.995 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.995 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.995 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:45.995 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171566+0000", 2024-09-12T18:37:45.995 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8269999999999997e-06 2024-09-12T18:37:45.996 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.996 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.996 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:45.996 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171622+0000", 2024-09-12T18:37:45.996 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5220999999999999e-05 2024-09-12T18:37:45.996 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.996 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.996 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:45.996 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171719+0000", 2024-09-12T18:37:45.996 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7238999999999995e-05 2024-09-12T18:37:45.996 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.996 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.997 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:45.997 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171802+0000", 2024-09-12T18:37:45.997 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.3285e-05 2024-09-12T18:37:45.997 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.997 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.997 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:45.997 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174608+0000", 2024-09-12T18:37:45.997 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028054590000000002 2024-09-12T18:37:45.997 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.997 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.997 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:45.997 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174762+0000", 2024-09-12T18:37:45.997 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015465100000000001 2024-09-12T18:37:45.997 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.998 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.998 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:45.998 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237474+0000", 2024-09-12T18:37:45.998 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.062711683000000004 2024-09-12T18:37:45.998 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.998 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.998 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:45.998 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237540+0000", 2024-09-12T18:37:45.998 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.6132999999999999e-05 2024-09-12T18:37:45.999 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.999 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.999 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:45.999 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237748+0000", 2024-09-12T18:37:45.999 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020752499999999999 2024-09-12T18:37:45.999 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:45.999 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:45.999 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:45.999 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:45.999 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:45.999 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167374 5.1 5:81e25826:::benchmark_data_smithi073_23739_object35097:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:45.999 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.173748+0000", 2024-09-12T18:37:45.999 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 42.796342746999997, 2024-09-12T18:37:46.000 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.069225245000000005, 2024-09-12T18:37:46.000 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:46.000 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:46.000 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:46.000 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:46.000 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:46.000 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:46.000 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167374 2024-09-12T18:37:46.000 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.000 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:46.000 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.000 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:46.000 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173748+0000", 2024-09-12T18:37:46.000 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:46.001 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.001 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.001 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:46.001 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173748+0000", 2024-09-12T18:37:46.001 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:46.001 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.001 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.001 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:46.001 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173749+0000", 2024-09-12T18:37:46.001 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.418e-06 2024-09-12T18:37:46.001 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.001 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.001 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:46.001 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173755+0000", 2024-09-12T18:37:46.002 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.0730000000000004e-06 2024-09-12T18:37:46.002 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.002 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.002 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:46.002 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173768+0000", 2024-09-12T18:37:46.002 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3644e-05 2024-09-12T18:37:46.002 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.002 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.002 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.002 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173777+0000", 2024-09-12T18:37:46.002 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4160000000000004e-06 2024-09-12T18:37:46.002 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.003 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.003 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:46.003 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173927+0000", 2024-09-12T18:37:46.003 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015065900000000001 2024-09-12T18:37:46.003 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.003 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.003 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:46.003 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174052+0000", 2024-09-12T18:37:46.003 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012460699999999999 2024-09-12T18:37:46.003 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.003 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.003 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:46.003 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174181+0000", 2024-09-12T18:37:46.004 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012919299999999999 2024-09-12T18:37:46.004 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.004 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.004 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:46.004 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.178108+0000", 2024-09-12T18:37:46.004 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0039273210000000001 2024-09-12T18:37:46.004 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.004 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.004 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:46.004 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.178118+0000", 2024-09-12T18:37:46.004 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7550000000000006e-06 2024-09-12T18:37:46.004 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.004 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.004 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:46.005 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.242865+0000", 2024-09-12T18:37:46.005 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.064746597000000003 2024-09-12T18:37:46.005 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.005 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.005 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:46.005 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.242903+0000", 2024-09-12T18:37:46.005 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.8268e-05 2024-09-12T18:37:46.005 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.005 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.005 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:46.005 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.242973+0000", 2024-09-12T18:37:46.005 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0294000000000002e-05 2024-09-12T18:37:46.006 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:46.006 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:46.006 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:46.006 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.006 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.006 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167375 5.1 5:83a09102:::benchmark_data_smithi073_23739_object35098:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:46.006 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:46.006 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 42.796291199999999, 2024-09-12T18:37:46.006 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.069437463000000005, 2024-09-12T18:37:46.006 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:46.006 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:46.006 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:46.006 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:46.007 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:46.007 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:46.007 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167375 2024-09-12T18:37:46.007 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.007 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:46.007 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.007 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:46.007 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:46.007 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:46.007 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.007 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.007 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:46.007 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:46.007 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:46.008 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.008 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.008 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:46.008 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:46.008 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1399999999999997e-07 2024-09-12T18:37:46.008 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.008 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.008 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:46.008 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173803+0000", 2024-09-12T18:37:46.008 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.7860000000000001e-06 2024-09-12T18:37:46.008 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.008 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.008 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:46.008 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173811+0000", 2024-09-12T18:37:46.009 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4610000000000008e-06 2024-09-12T18:37:46.009 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.009 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.009 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.009 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173817+0000", 2024-09-12T18:37:46.009 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3569999999999997e-06 2024-09-12T18:37:46.009 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.009 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.009 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:46.009 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.176070+0000", 2024-09-12T18:37:46.009 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.002253405 2024-09-12T18:37:46.009 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.009 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.009 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:46.010 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.176263+0000", 2024-09-12T18:37:46.010 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000192583 2024-09-12T18:37:46.010 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.010 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.010 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:46.010 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.176429+0000", 2024-09-12T18:37:46.010 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00016626 2024-09-12T18:37:46.010 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.010 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.010 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:46.010 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.178154+0000", 2024-09-12T18:37:46.010 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0017247009999999999 2024-09-12T18:37:46.010 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.011 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.011 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:46.011 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.182110+0000", 2024-09-12T18:37:46.011 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0039568229999999999 2024-09-12T18:37:46.011 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.011 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.011 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:46.011 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.243024+0000", 2024-09-12T18:37:46.011 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.060913249000000003 2024-09-12T18:37:46.011 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.011 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.011 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:46.011 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.243107+0000", 2024-09-12T18:37:46.011 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.3090000000000006e-05 2024-09-12T18:37:46.012 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.012 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.012 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:46.012 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.243237+0000", 2024-09-12T18:37:46.012 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013023399999999999 2024-09-12T18:37:46.012 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:46.012 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:46.012 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:46.012 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.012 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.012 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201515 5.5 5:a25bd8bb:::benchmark_data_smithi073_23739_object69238:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:46.012 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.437024+0000", 2024-09-12T18:37:46.012 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 25.533066968, 2024-09-12T18:37:46.012 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.040476102, 2024-09-12T18:37:46.013 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:46.013 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:46.013 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:46.013 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:46.013 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:46.013 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:46.013 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201515 2024-09-12T18:37:46.013 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.013 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:46.013 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.013 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:46.013 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437024+0000", 2024-09-12T18:37:46.013 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:46.014 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.014 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.014 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:46.014 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437024+0000", 2024-09-12T18:37:46.014 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:46.014 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.014 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.014 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:46.014 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437025+0000", 2024-09-12T18:37:46.014 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2240000000000001e-06 2024-09-12T18:37:46.014 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.014 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.014 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:46.014 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437030+0000", 2024-09-12T18:37:46.015 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.7049999999999998e-06 2024-09-12T18:37:46.015 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.015 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.015 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:46.015 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437040+0000", 2024-09-12T18:37:46.015 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0351e-05 2024-09-12T18:37:46.015 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.015 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.015 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.015 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437049+0000", 2024-09-12T18:37:46.015 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5750000000000001e-06 2024-09-12T18:37:46.015 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.015 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.015 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:46.016 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437574+0000", 2024-09-12T18:37:46.016 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00052566400000000001 2024-09-12T18:37:46.016 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.016 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.016 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:46.016 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437673+0000", 2024-09-12T18:37:46.016 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.8672000000000007e-05 2024-09-12T18:37:46.016 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.016 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.016 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:46.016 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437755+0000", 2024-09-12T18:37:46.016 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1705000000000005e-05 2024-09-12T18:37:46.016 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.016 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.017 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:46.017 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.439556+0000", 2024-09-12T18:37:46.017 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0018009020000000001 2024-09-12T18:37:46.017 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.017 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.017 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:46.017 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.439955+0000", 2024-09-12T18:37:46.017 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00039966900000000001 2024-09-12T18:37:46.017 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.017 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.017 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:46.017 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.477267+0000", 2024-09-12T18:37:46.017 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.037311614 2024-09-12T18:37:46.018 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.018 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.018 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:46.018 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.477368+0000", 2024-09-12T18:37:46.018 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000101495 2024-09-12T18:37:46.018 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.018 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.018 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:46.018 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.477500+0000", 2024-09-12T18:37:46.018 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000131526 2024-09-12T18:37:46.018 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:46.018 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:46.018 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:46.018 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.019 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.019 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201566 5.9 5:9ea8bdd3:::benchmark_data_smithi073_23739_object69289:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:46.019 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.487311+0000", 2024-09-12T18:37:46.019 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 25.482779421, 2024-09-12T18:37:46.019 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.044734547, 2024-09-12T18:37:46.019 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:46.019 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:46.019 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:46.019 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:46.019 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:46.019 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:46.019 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201566 2024-09-12T18:37:46.020 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.020 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:46.020 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.020 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:46.020 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487311+0000", 2024-09-12T18:37:46.020 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:46.020 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.020 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.020 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:46.020 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487311+0000", 2024-09-12T18:37:46.020 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:46.020 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.020 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.020 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:46.021 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487313+0000", 2024-09-12T18:37:46.021 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3060000000000001e-06 2024-09-12T18:37:46.021 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.021 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.021 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:46.021 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487318+0000", 2024-09-12T18:37:46.021 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.181e-06 2024-09-12T18:37:46.021 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.021 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.021 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:46.021 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487333+0000", 2024-09-12T18:37:46.021 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5012e-05 2024-09-12T18:37:46.022 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.022 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.022 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.022 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487344+0000", 2024-09-12T18:37:46.022 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0733999999999999e-05 2024-09-12T18:37:46.022 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.022 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.022 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:46.022 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487403+0000", 2024-09-12T18:37:46.022 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9858999999999997e-05 2024-09-12T18:37:46.022 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.022 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.022 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:46.022 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487600+0000", 2024-09-12T18:37:46.023 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019617899999999999 2024-09-12T18:37:46.023 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.023 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.023 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:46.023 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487769+0000", 2024-09-12T18:37:46.023 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00016919299999999999 2024-09-12T18:37:46.023 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.023 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.023 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:46.023 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492984+0000", 2024-09-12T18:37:46.023 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0052155309999999998 2024-09-12T18:37:46.023 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.023 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.023 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:46.024 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531791+0000", 2024-09-12T18:37:46.024 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.038806861999999998 2024-09-12T18:37:46.024 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.024 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.024 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:46.024 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531946+0000", 2024-09-12T18:37:46.024 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015445300000000001 2024-09-12T18:37:46.024 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.024 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.024 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:46.024 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532046+0000", 2024-09-12T18:37:46.024 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000100237 2024-09-12T18:37:46.024 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:46.025 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:46.025 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:46.025 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.025 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.025 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201569 5.9 5:9719244e:::benchmark_data_smithi073_23739_object69292:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:46.025 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.487551+0000", 2024-09-12T18:37:46.025 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 25.482540061000002, 2024-09-12T18:37:46.025 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.045212927, 2024-09-12T18:37:46.025 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:46.025 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:46.025 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:46.025 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:46.025 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:46.025 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:46.026 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201569 2024-09-12T18:37:46.026 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.026 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:46.026 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.026 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:46.026 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487551+0000", 2024-09-12T18:37:46.026 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:46.026 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.026 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.026 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:46.026 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487551+0000", 2024-09-12T18:37:46.026 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:46.026 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.026 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.027 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:46.027 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487552+0000", 2024-09-12T18:37:46.027 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6160000000000001e-06 2024-09-12T18:37:46.027 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.027 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.027 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:46.027 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487566+0000", 2024-09-12T18:37:46.027 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.344e-05 2024-09-12T18:37:46.027 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.027 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.027 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:46.027 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487581+0000", 2024-09-12T18:37:46.027 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5526e-05 2024-09-12T18:37:46.027 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.027 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.027 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.028 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487593+0000", 2024-09-12T18:37:46.028 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1443e-05 2024-09-12T18:37:46.028 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.028 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.028 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:46.028 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.489599+0000", 2024-09-12T18:37:46.028 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0020058960000000001 2024-09-12T18:37:46.028 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.028 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.028 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:46.028 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.489710+0000", 2024-09-12T18:37:46.028 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000111634 2024-09-12T18:37:46.028 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.029 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.029 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:46.029 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.489796+0000", 2024-09-12T18:37:46.029 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5235999999999995e-05 2024-09-12T18:37:46.029 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.029 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.029 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:46.029 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532140+0000", 2024-09-12T18:37:46.029 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.042344524000000001 2024-09-12T18:37:46.029 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.029 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.029 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:46.029 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532559+0000", 2024-09-12T18:37:46.029 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00041908800000000002 2024-09-12T18:37:46.029 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.030 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.030 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:46.030 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532676+0000", 2024-09-12T18:37:46.030 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011649100000000001 2024-09-12T18:37:46.030 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.030 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.030 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:46.030 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532764+0000", 2024-09-12T18:37:46.030 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8033000000000002e-05 2024-09-12T18:37:46.030 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:46.030 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:46.030 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:46.030 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.030 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.030 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201570 5.5 5:a97bff67:::benchmark_data_smithi073_23739_object69293:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:46.031 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.487618+0000", 2024-09-12T18:37:46.031 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 25.482472476000002, 2024-09-12T18:37:46.031 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.049152553000000002, 2024-09-12T18:37:46.031 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:46.031 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:46.031 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:46.031 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:46.031 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:46.031 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:46.031 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201570 2024-09-12T18:37:46.031 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.031 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:46.031 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.031 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:46.032 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487618+0000", 2024-09-12T18:37:46.032 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:46.032 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.032 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.032 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:46.032 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487618+0000", 2024-09-12T18:37:46.032 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:46.032 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.032 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.032 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:46.032 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487619+0000", 2024-09-12T18:37:46.032 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.6099999999999999e-07 2024-09-12T18:37:46.032 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.032 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.032 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:46.033 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487623+0000", 2024-09-12T18:37:46.033 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.0940000000000001e-06 2024-09-12T18:37:46.033 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.033 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.033 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:46.033 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487635+0000", 2024-09-12T18:37:46.033 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1348e-05 2024-09-12T18:37:46.033 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.033 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.033 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.033 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487657+0000", 2024-09-12T18:37:46.033 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2246999999999999e-05 2024-09-12T18:37:46.033 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.033 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.034 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:46.034 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490684+0000", 2024-09-12T18:37:46.034 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0030268339999999999 2024-09-12T18:37:46.034 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.034 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.034 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:46.034 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490797+0000", 2024-09-12T18:37:46.034 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011372200000000001 2024-09-12T18:37:46.034 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.034 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.034 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:46.034 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490909+0000", 2024-09-12T18:37:46.034 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000111239 2024-09-12T18:37:46.034 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.035 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.035 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:46.035 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534345+0000", 2024-09-12T18:37:46.035 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.043436648000000001 2024-09-12T18:37:46.035 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.035 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.035 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:46.035 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534711+0000", 2024-09-12T18:37:46.035 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00036576399999999998 2024-09-12T18:37:46.035 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.035 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.035 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:46.035 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536225+0000", 2024-09-12T18:37:46.035 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001513983 2024-09-12T18:37:46.036 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.036 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.036 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:46.036 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536331+0000", 2024-09-12T18:37:46.036 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010603300000000001 2024-09-12T18:37:46.036 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.036 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.036 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:46.036 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536771+0000", 2024-09-12T18:37:46.036 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00043978000000000002 2024-09-12T18:37:46.036 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:46.036 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:46.036 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:46.036 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.037 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.037 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:201572 5.3 e67/21 5:caf692c5:::benchmark_data_smithi073_23739_object69295:head v 67'12362, mlcod=67'12360)", 2024-09-12T18:37:46.037 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.490255+0000", 2024-09-12T18:37:46.037 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 25.479835976, 2024-09-12T18:37:46.037 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.044189501999999999, 2024-09-12T18:37:46.037 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:46.037 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:46.037 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:46.037 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:46.037 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.037 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:46.037 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490255+0000", 2024-09-12T18:37:46.037 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:46.037 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.038 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.038 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:46.038 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490255+0000", 2024-09-12T18:37:46.038 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:46.038 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.038 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.038 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:46.038 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490256+0000", 2024-09-12T18:37:46.038 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0500000000000003e-07 2024-09-12T18:37:46.038 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.038 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.038 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:46.038 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490260+0000", 2024-09-12T18:37:46.038 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8269999999999997e-06 2024-09-12T18:37:46.039 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.039 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.039 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:46.039 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490269+0000", 2024-09-12T18:37:46.039 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.6549999999999993e-06 2024-09-12T18:37:46.039 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.039 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.039 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.039 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490275+0000", 2024-09-12T18:37:46.039 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.46e-06 2024-09-12T18:37:46.039 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.039 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.039 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:46.039 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490328+0000", 2024-09-12T18:37:46.040 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2101999999999997e-05 2024-09-12T18:37:46.040 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.040 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.040 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:46.040 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490347+0000", 2024-09-12T18:37:46.040 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9457999999999999e-05 2024-09-12T18:37:46.040 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.040 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.040 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:46.040 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534382+0000", 2024-09-12T18:37:46.040 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.044034968000000001 2024-09-12T18:37:46.040 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.040 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.040 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:46.041 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534444+0000", 2024-09-12T18:37:46.041 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2327000000000001e-05 2024-09-12T18:37:46.041 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:46.041 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:46.041 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:46.041 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.041 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.041 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201574 5.5 5:a963f378:::benchmark_data_smithi073_23739_object69297:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:46.041 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.490449+0000", 2024-09-12T18:37:46.041 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 25.479642000999998, 2024-09-12T18:37:46.041 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.046749974, 2024-09-12T18:37:46.041 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:46.041 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:46.041 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:46.042 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:46.042 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:46.042 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:46.042 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201574 2024-09-12T18:37:46.042 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.042 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:46.042 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.042 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:46.042 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490449+0000", 2024-09-12T18:37:46.042 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:46.042 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.042 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.042 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:46.043 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490449+0000", 2024-09-12T18:37:46.043 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:46.043 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.043 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.043 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:46.043 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490450+0000", 2024-09-12T18:37:46.043 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.17e-06 2024-09-12T18:37:46.043 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.043 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.043 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:46.043 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490455+0000", 2024-09-12T18:37:46.043 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.7319999999999998e-06 2024-09-12T18:37:46.043 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.043 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.044 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:46.044 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490464+0000", 2024-09-12T18:37:46.044 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.4760000000000004e-06 2024-09-12T18:37:46.044 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.044 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.044 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.044 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490471+0000", 2024-09-12T18:37:46.044 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.5400000000000001e-06 2024-09-12T18:37:46.044 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.044 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.044 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:46.044 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492695+0000", 2024-09-12T18:37:46.044 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0022245910000000002 2024-09-12T18:37:46.045 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.045 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.045 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:46.045 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492847+0000", 2024-09-12T18:37:46.045 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015127399999999999 2024-09-12T18:37:46.045 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.045 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.045 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:46.045 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492936+0000", 2024-09-12T18:37:46.045 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8953e-05 2024-09-12T18:37:46.045 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.045 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.045 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:46.045 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534614+0000", 2024-09-12T18:37:46.045 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.041678422999999999 2024-09-12T18:37:46.046 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.046 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.046 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:46.046 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534755+0000", 2024-09-12T18:37:46.046 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000140696 2024-09-12T18:37:46.046 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.046 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.046 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:46.046 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536891+0000", 2024-09-12T18:37:46.046 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0021365799999999999 2024-09-12T18:37:46.046 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.046 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.046 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:46.046 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537001+0000", 2024-09-12T18:37:46.047 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000109459 2024-09-12T18:37:46.047 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.047 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.047 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:46.047 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537199+0000", 2024-09-12T18:37:46.047 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019808 2024-09-12T18:37:46.047 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:46.047 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:46.047 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:46.047 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.047 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.047 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201576 5.2 5:42a132e0:::benchmark_data_smithi073_23739_object69299:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:46.047 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.490661+0000", 2024-09-12T18:37:46.047 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 25.479429954, 2024-09-12T18:37:46.048 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.041905530000000003, 2024-09-12T18:37:46.048 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:46.048 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:46.048 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:46.048 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:46.048 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:46.048 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:46.048 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201576 2024-09-12T18:37:46.048 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.048 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:46.048 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.048 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:46.048 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490661+0000", 2024-09-12T18:37:46.048 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:46.049 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.049 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.049 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:46.049 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490661+0000", 2024-09-12T18:37:46.049 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:46.049 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.049 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.049 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:46.049 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490662+0000", 2024-09-12T18:37:46.049 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5030000000000001e-06 2024-09-12T18:37:46.049 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.050 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.050 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:46.050 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490667+0000", 2024-09-12T18:37:46.050 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4479999999999996e-06 2024-09-12T18:37:46.050 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.050 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.050 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:46.050 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490675+0000", 2024-09-12T18:37:46.050 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8529999999999992e-06 2024-09-12T18:37:46.050 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.050 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.050 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.050 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490680+0000", 2024-09-12T18:37:46.050 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1919999999999996e-06 2024-09-12T18:37:46.051 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.051 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.051 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:46.051 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490730+0000", 2024-09-12T18:37:46.051 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.9738999999999999e-05 2024-09-12T18:37:46.051 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.051 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.051 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:46.051 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490833+0000", 2024-09-12T18:37:46.051 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010333 2024-09-12T18:37:46.051 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.051 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.051 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:46.051 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490930+0000", 2024-09-12T18:37:46.051 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7355999999999994e-05 2024-09-12T18:37:46.052 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.052 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.052 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:46.052 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493735+0000", 2024-09-12T18:37:46.052 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028049329999999999 2024-09-12T18:37:46.052 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.052 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.052 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:46.052 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532451+0000", 2024-09-12T18:37:46.052 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.038715554999999999 2024-09-12T18:37:46.052 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.052 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.053 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:46.053 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532514+0000", 2024-09-12T18:37:46.053 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2885000000000005e-05 2024-09-12T18:37:46.053 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.053 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.053 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:46.053 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532566+0000", 2024-09-12T18:37:46.053 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2735999999999998e-05 2024-09-12T18:37:46.053 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:46.053 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:46.054 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:46.054 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.054 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.054 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201577 5.7 5:e93d4852:::benchmark_data_smithi073_23739_object69300:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:46.054 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.490721+0000", 2024-09-12T18:37:46.054 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 25.479369943000002, 2024-09-12T18:37:46.054 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.042097930999999998, 2024-09-12T18:37:46.054 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:46.054 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:46.054 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:46.054 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:46.054 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:46.054 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:46.054 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201577 2024-09-12T18:37:46.055 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.055 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:46.055 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.055 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:46.055 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490721+0000", 2024-09-12T18:37:46.055 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:46.055 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.055 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.055 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:46.055 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490721+0000", 2024-09-12T18:37:46.055 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:46.055 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.055 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.055 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:46.056 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490721+0000", 2024-09-12T18:37:46.056 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.1900000000000002e-07 2024-09-12T18:37:46.056 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.056 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.056 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:46.056 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490724+0000", 2024-09-12T18:37:46.056 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.6189999999999998e-06 2024-09-12T18:37:46.056 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.056 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.056 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:46.056 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490731+0000", 2024-09-12T18:37:46.056 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0129999999999996e-06 2024-09-12T18:37:46.056 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.056 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.057 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.057 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490736+0000", 2024-09-12T18:37:46.057 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6929999999999998e-06 2024-09-12T18:37:46.057 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.057 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.057 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:46.057 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490788+0000", 2024-09-12T18:37:46.057 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2104000000000001e-05 2024-09-12T18:37:46.057 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.057 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.057 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:46.057 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490926+0000", 2024-09-12T18:37:46.057 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013852800000000001 2024-09-12T18:37:46.057 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.058 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.058 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:46.058 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491061+0000", 2024-09-12T18:37:46.058 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013499700000000001 2024-09-12T18:37:46.058 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.058 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.058 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:46.058 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531660+0000", 2024-09-12T18:37:46.058 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.040599046999999999 2024-09-12T18:37:46.058 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.058 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.058 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:46.058 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532630+0000", 2024-09-12T18:37:46.058 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00096974300000000002 2024-09-12T18:37:46.058 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.059 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.059 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:46.059 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532708+0000", 2024-09-12T18:37:46.059 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8108000000000005e-05 2024-09-12T18:37:46.059 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.059 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.059 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:46.059 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532819+0000", 2024-09-12T18:37:46.059 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011046 2024-09-12T18:37:46.059 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:46.059 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:46.059 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:46.059 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.059 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.059 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201578 5.f 5:f19e206c:::benchmark_data_smithi073_23739_object69301:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:46.059 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.491951+0000", 2024-09-12T18:37:46.060 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 25.47813957, 2024-09-12T18:37:46.060 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.043303686000000001, 2024-09-12T18:37:46.060 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:46.060 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:46.060 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:46.060 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:46.060 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:46.060 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:46.060 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201578 2024-09-12T18:37:46.060 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.060 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:46.060 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.060 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:46.060 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491951+0000", 2024-09-12T18:37:46.061 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:46.061 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.061 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.061 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:46.061 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491951+0000", 2024-09-12T18:37:46.061 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:46.061 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.061 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.061 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:46.061 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491952+0000", 2024-09-12T18:37:46.061 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.221e-06 2024-09-12T18:37:46.061 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.061 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.061 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:46.062 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491957+0000", 2024-09-12T18:37:46.062 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.0529999999999997e-06 2024-09-12T18:37:46.062 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.062 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.062 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:46.062 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491970+0000", 2024-09-12T18:37:46.062 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2731000000000001e-05 2024-09-12T18:37:46.062 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.062 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.062 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.062 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491977+0000", 2024-09-12T18:37:46.062 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.1380000000000001e-06 2024-09-12T18:37:46.062 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.063 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.063 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:46.063 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492031+0000", 2024-09-12T18:37:46.063 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3857999999999998e-05 2024-09-12T18:37:46.063 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.063 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.063 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:46.063 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492125+0000", 2024-09-12T18:37:46.063 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.3275000000000004e-05 2024-09-12T18:37:46.063 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.063 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.063 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:46.063 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492205+0000", 2024-09-12T18:37:46.063 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.0793999999999999e-05 2024-09-12T18:37:46.064 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.064 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.064 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:46.064 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531712+0000", 2024-09-12T18:37:46.064 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.039506708000000001 2024-09-12T18:37:46.064 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.064 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.064 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:46.064 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535161+0000", 2024-09-12T18:37:46.064 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003448586 2024-09-12T18:37:46.064 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.064 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.065 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:46.065 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535202+0000", 2024-09-12T18:37:46.065 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.0945999999999997e-05 2024-09-12T18:37:46.065 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.065 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.065 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:46.065 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535255+0000", 2024-09-12T18:37:46.065 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3375999999999999e-05 2024-09-12T18:37:46.065 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:46.065 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:46.065 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:46.065 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.065 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.065 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201579 5.5 5:ac64e9fd:::benchmark_data_smithi073_23739_object69302:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:46.066 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.492711+0000", 2024-09-12T18:37:46.066 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 25.477379399, 2024-09-12T18:37:46.066 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.04478994, 2024-09-12T18:37:46.066 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:46.066 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:46.066 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:46.066 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:46.066 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:46.066 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:46.066 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201579 2024-09-12T18:37:46.066 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.066 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:46.066 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.066 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:46.067 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492711+0000", 2024-09-12T18:37:46.067 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:46.067 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.067 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.067 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:46.067 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492711+0000", 2024-09-12T18:37:46.067 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:46.067 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.067 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.067 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:46.067 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492713+0000", 2024-09-12T18:37:46.067 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.105e-06 2024-09-12T18:37:46.067 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.067 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.068 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:46.068 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492720+0000", 2024-09-12T18:37:46.068 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.109e-06 2024-09-12T18:37:46.068 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.068 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.068 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:46.068 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492730+0000", 2024-09-12T18:37:46.068 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.049e-05 2024-09-12T18:37:46.068 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.068 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.068 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.068 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492737+0000", 2024-09-12T18:37:46.068 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0960000000000003e-06 2024-09-12T18:37:46.068 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.068 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.069 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:46.069 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.494541+0000", 2024-09-12T18:37:46.069 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0018034139999999999 2024-09-12T18:37:46.069 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.069 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.069 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:46.069 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.494692+0000", 2024-09-12T18:37:46.069 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000150956 2024-09-12T18:37:46.069 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.069 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.069 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:46.069 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.494843+0000", 2024-09-12T18:37:46.069 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000151896 2024-09-12T18:37:46.069 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.069 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.070 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:46.070 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534665+0000", 2024-09-12T18:37:46.070 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.039821829000000003 2024-09-12T18:37:46.070 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.070 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.070 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:46.070 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536866+0000", 2024-09-12T18:37:46.070 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0022007839999999999 2024-09-12T18:37:46.070 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.070 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.070 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:46.070 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537212+0000", 2024-09-12T18:37:46.070 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00034636299999999998 2024-09-12T18:37:46.071 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.071 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.071 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:46.071 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537298+0000", 2024-09-12T18:37:46.071 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5970999999999994e-05 2024-09-12T18:37:46.071 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.071 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.071 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:46.071 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537501+0000", 2024-09-12T18:37:46.071 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020292699999999999 2024-09-12T18:37:46.071 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:46.071 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:46.071 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:46.071 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.071 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.072 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201581 5.7 5:e819369d:::benchmark_data_smithi073_23739_object69304:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:46.072 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.493262+0000", 2024-09-12T18:37:46.072 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 25.476829048999999, 2024-09-12T18:37:46.072 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.042091362, 2024-09-12T18:37:46.072 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:46.072 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:46.072 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:46.072 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:46.072 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:46.072 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:46.072 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201581 2024-09-12T18:37:46.072 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.072 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:46.072 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.073 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:46.073 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493262+0000", 2024-09-12T18:37:46.073 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:46.073 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.073 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.073 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:46.073 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493262+0000", 2024-09-12T18:37:46.073 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:46.073 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.073 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.073 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:46.073 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493263+0000", 2024-09-12T18:37:46.073 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.6700000000000003e-07 2024-09-12T18:37:46.073 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.074 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.074 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:46.074 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493266+0000", 2024-09-12T18:37:46.074 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.4850000000000001e-06 2024-09-12T18:37:46.074 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.074 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.074 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:46.074 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493273+0000", 2024-09-12T18:37:46.074 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2019999999999998e-06 2024-09-12T18:37:46.074 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.074 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.074 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.074 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493278+0000", 2024-09-12T18:37:46.074 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6210000000000003e-06 2024-09-12T18:37:46.075 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.075 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.075 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:46.075 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493330+0000", 2024-09-12T18:37:46.075 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2587000000000003e-05 2024-09-12T18:37:46.075 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.075 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.075 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:46.075 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493469+0000", 2024-09-12T18:37:46.075 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013901199999999999 2024-09-12T18:37:46.075 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.075 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.075 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:46.075 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493612+0000", 2024-09-12T18:37:46.076 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014237599999999999 2024-09-12T18:37:46.076 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.076 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.076 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:46.076 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531835+0000", 2024-09-12T18:37:46.076 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.038222735000000001 2024-09-12T18:37:46.076 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.076 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.076 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:46.076 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535265+0000", 2024-09-12T18:37:46.076 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003430064 2024-09-12T18:37:46.076 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.077 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.077 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:46.077 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535319+0000", 2024-09-12T18:37:46.077 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4375e-05 2024-09-12T18:37:46.077 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.077 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.077 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:46.077 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535353+0000", 2024-09-12T18:37:46.077 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.4137999999999997e-05 2024-09-12T18:37:46.077 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:46.077 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:46.077 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:46.077 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.077 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.078 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:201573 5.3 e67/21 5:cf4becdf:::benchmark_data_smithi073_23739_object69296:head v 67'12363, mlcod=67'12360)", 2024-09-12T18:37:46.078 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.493437+0000", 2024-09-12T18:37:46.078 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 25.476654113999999, 2024-09-12T18:37:46.078 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.041109664999999997, 2024-09-12T18:37:46.078 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:46.078 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:46.078 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:46.078 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:46.078 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.078 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:46.078 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493437+0000", 2024-09-12T18:37:46.078 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:46.078 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.078 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.078 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:46.079 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493437+0000", 2024-09-12T18:37:46.079 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:46.079 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.079 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.079 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:46.079 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493438+0000", 2024-09-12T18:37:46.079 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.125e-06 2024-09-12T18:37:46.079 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.079 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.079 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:46.079 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493444+0000", 2024-09-12T18:37:46.079 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2269999999999998e-06 2024-09-12T18:37:46.079 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.079 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.080 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:46.080 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493457+0000", 2024-09-12T18:37:46.080 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.312e-05 2024-09-12T18:37:46.080 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.080 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.080 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.080 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493466+0000", 2024-09-12T18:37:46.080 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.6309999999999992e-06 2024-09-12T18:37:46.080 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.080 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.080 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:46.080 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493526+0000", 2024-09-12T18:37:46.080 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.0316000000000003e-05 2024-09-12T18:37:46.080 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.081 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.081 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:46.081 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493541+0000", 2024-09-12T18:37:46.081 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4459e-05 2024-09-12T18:37:46.081 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.081 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.081 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:46.081 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534501+0000", 2024-09-12T18:37:46.081 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.040960215000000001 2024-09-12T18:37:46.081 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.081 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.081 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:46.082 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534546+0000", 2024-09-12T18:37:46.082 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.5571999999999997e-05 2024-09-12T18:37:46.082 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:46.082 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:46.082 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:46.082 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.082 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.082 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201582 5.f 5:f90f147f:::benchmark_data_smithi073_23739_object69305:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:46.082 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.493597+0000", 2024-09-12T18:37:46.082 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 25.476493583, 2024-09-12T18:37:46.082 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.045457567999999997, 2024-09-12T18:37:46.082 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:46.083 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:46.083 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:46.083 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:46.083 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:46.083 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:46.083 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201582 2024-09-12T18:37:46.083 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.083 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:46.083 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.083 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:46.083 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493597+0000", 2024-09-12T18:37:46.083 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:46.083 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.083 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.084 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:46.084 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493597+0000", 2024-09-12T18:37:46.084 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:46.084 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.084 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.084 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:46.084 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493598+0000", 2024-09-12T18:37:46.084 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7699999999999992e-07 2024-09-12T18:37:46.084 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.084 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.084 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:46.084 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493609+0000", 2024-09-12T18:37:46.084 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1297e-05 2024-09-12T18:37:46.085 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.085 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.085 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:46.085 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493620+0000", 2024-09-12T18:37:46.085 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0930999999999999e-05 2024-09-12T18:37:46.085 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.085 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.085 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.085 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493640+0000", 2024-09-12T18:37:46.085 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.0072e-05 2024-09-12T18:37:46.085 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.085 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.085 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:46.085 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531770+0000", 2024-09-12T18:37:46.086 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.038129652999999999 2024-09-12T18:37:46.086 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.086 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.086 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:46.086 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532046+0000", 2024-09-12T18:37:46.086 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027561600000000001 2024-09-12T18:37:46.086 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.086 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.086 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:46.086 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532337+0000", 2024-09-12T18:37:46.086 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00029169200000000003 2024-09-12T18:37:46.086 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.086 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.086 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:46.086 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536640+0000", 2024-09-12T18:37:46.087 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0043023499999999999 2024-09-12T18:37:46.087 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.087 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.087 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:46.087 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.538943+0000", 2024-09-12T18:37:46.087 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0023032740000000001 2024-09-12T18:37:46.087 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.087 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.087 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:46.087 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.539013+0000", 2024-09-12T18:37:46.087 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9944000000000007e-05 2024-09-12T18:37:46.087 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.087 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.087 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:46.087 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.539055+0000", 2024-09-12T18:37:46.088 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.1761999999999998e-05 2024-09-12T18:37:46.088 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:46.088 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:46.088 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:46.088 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.088 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.088 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:201583 5.d e67/21 5:b91eedec:::benchmark_data_smithi073_23739_object69306:head v 67'12761, mlcod=67'12759)", 2024-09-12T18:37:46.088 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.495034+0000", 2024-09-12T18:37:46.088 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 25.475057207999999, 2024-09-12T18:37:46.088 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.047966852999999997, 2024-09-12T18:37:46.088 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:46.088 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:46.088 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:46.088 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:46.088 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.089 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:46.089 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.495034+0000", 2024-09-12T18:37:46.089 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:46.089 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.089 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.089 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:46.089 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.495034+0000", 2024-09-12T18:37:46.089 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:46.089 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.089 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.089 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:46.089 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.495035+0000", 2024-09-12T18:37:46.089 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.023e-06 2024-09-12T18:37:46.089 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.089 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.090 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:46.090 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.495040+0000", 2024-09-12T18:37:46.090 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.9300000000000002e-06 2024-09-12T18:37:46.090 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.090 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.090 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:46.090 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531510+0000", 2024-09-12T18:37:46.090 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.036470250000000003 2024-09-12T18:37:46.090 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.090 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.090 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.090 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531518+0000", 2024-09-12T18:37:46.090 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8490000000000006e-06 2024-09-12T18:37:46.090 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.091 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.091 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:46.091 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534395+0000", 2024-09-12T18:37:46.091 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.002877246 2024-09-12T18:37:46.091 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.091 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.091 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:46.091 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534418+0000", 2024-09-12T18:37:46.091 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.3119e-05 2024-09-12T18:37:46.091 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.091 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.091 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:46.091 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.542930+0000", 2024-09-12T18:37:46.091 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0085121929999999995 2024-09-12T18:37:46.091 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:46.092 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:46.092 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:46.092 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.543000+0000", 2024-09-12T18:37:46.092 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0242999999999998e-05 2024-09-12T18:37:46.092 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:46.092 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:46.092 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:46.092 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:46.092 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:46.092 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:46.094 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:46.086+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:46.094 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:37:46.194 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:46.190+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:46.248 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:46.248 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:37:46.249 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.249 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:255345 5.b e78/21 5:d6338c87:::benchmark_data_smithi073_23739_object123068:head v 78'16107, mlcod=78'16104)", 2024-09-12T18:37:46.249 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:46.239553+0000", 2024-09-12T18:37:46.249 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0067652739999999999, 2024-09-12T18:37:46.249 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0067811399999999997, 2024-09-12T18:37:46.249 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:46.249 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:46.249 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:46.249 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:46.249 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.250 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:46.250 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.239553+0000", 2024-09-12T18:37:46.250 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.250 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.250 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.250 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:46.250 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.239553+0000", 2024-09-12T18:37:46.250 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.250 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.250 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.250 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:46.250 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.239554+0000", 2024-09-12T18:37:46.251 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5300000000000004e-07 2024-09-12T18:37:46.251 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.251 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.251 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:46.251 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.239560+0000", 2024-09-12T18:37:46.251 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9390000000000002e-06 2024-09-12T18:37:46.251 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.251 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.251 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:46.251 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.239568+0000", 2024-09-12T18:37:46.251 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.3680000000000002e-06 2024-09-12T18:37:46.251 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.251 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.251 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.252 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.239576+0000", 2024-09-12T18:37:46.252 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8180000000000004e-06 2024-09-12T18:37:46.252 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.252 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.252 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:46.252 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.241709+0000", 2024-09-12T18:37:46.252 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0021323639999999999 2024-09-12T18:37:46.252 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.252 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.252 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:46.252 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.241730+0000", 2024-09-12T18:37:46.252 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1248000000000001e-05 2024-09-12T18:37:46.252 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.252 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:46.253 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.253 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.253 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.253 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:255349 5.3 5:c080a130:::benchmark_data_smithi073_23739_object123072:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T18:37:46.253 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:46.239606+0000", 2024-09-12T18:37:46.253 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0067125969999999998, 2024-09-12T18:37:46.253 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0067625970000000004, 2024-09-12T18:37:46.253 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:46.254 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:46.254 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:46.254 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:46.254 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:46.254 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:46.254 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 255349 2024-09-12T18:37:46.254 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.254 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:46.254 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.254 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:46.254 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.239606+0000", 2024-09-12T18:37:46.255 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.255 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.255 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.255 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:46.255 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.239606+0000", 2024-09-12T18:37:46.255 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.255 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.255 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.255 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:46.255 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.239607+0000", 2024-09-12T18:37:46.255 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.2500000000000005e-07 2024-09-12T18:37:46.255 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.255 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.255 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:46.256 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.239610+0000", 2024-09-12T18:37:46.256 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4000000000000001e-06 2024-09-12T18:37:46.256 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.256 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.256 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:46.256 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.239617+0000", 2024-09-12T18:37:46.256 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.9949999999999999e-06 2024-09-12T18:37:46.256 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.256 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.256 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.256 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.239622+0000", 2024-09-12T18:37:46.256 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2360000000000004e-06 2024-09-12T18:37:46.256 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.256 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.257 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:46.257 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.241805+0000", 2024-09-12T18:37:46.257 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.002182649 2024-09-12T18:37:46.257 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.257 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.257 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:46.257 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.241920+0000", 2024-09-12T18:37:46.257 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000114892 2024-09-12T18:37:46.257 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.257 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.257 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:46.257 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.242008+0000", 2024-09-12T18:37:46.257 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.8222999999999999e-05 2024-09-12T18:37:46.257 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.257 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:46.258 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.258 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.258 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.258 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:255352 5.3 5:c69dd578:::benchmark_data_smithi073_23739_object123075:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T18:37:46.258 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:46.240268+0000", 2024-09-12T18:37:46.258 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0060506450000000003, 2024-09-12T18:37:46.258 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0061379210000000002, 2024-09-12T18:37:46.258 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:46.258 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:46.258 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:46.258 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:46.258 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:46.258 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:46.258 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 255352 2024-09-12T18:37:46.258 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.259 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:46.259 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.259 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:46.259 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.240268+0000", 2024-09-12T18:37:46.259 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.259 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.259 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.259 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:46.259 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.240268+0000", 2024-09-12T18:37:46.259 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.259 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.260 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.260 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:46.260 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.240269+0000", 2024-09-12T18:37:46.260 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.5600000000000004e-07 2024-09-12T18:37:46.260 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.260 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.260 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:46.260 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.240273+0000", 2024-09-12T18:37:46.260 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0600000000000001e-06 2024-09-12T18:37:46.261 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.261 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.261 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:46.261 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.240284+0000", 2024-09-12T18:37:46.261 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1219e-05 2024-09-12T18:37:46.261 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.261 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.261 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.261 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.240292+0000", 2024-09-12T18:37:46.261 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.9219999999999997e-06 2024-09-12T18:37:46.261 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.261 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.261 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:46.262 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.245098+0000", 2024-09-12T18:37:46.262 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0048053439999999996 2024-09-12T18:37:46.262 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.262 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.262 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:46.262 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.245246+0000", 2024-09-12T18:37:46.262 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000148207 2024-09-12T18:37:46.262 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.262 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.262 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:46.262 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.245379+0000", 2024-09-12T18:37:46.262 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00013318 2024-09-12T18:37:46.262 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.262 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:46.263 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.263 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.263 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.263 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:255349 5.3 e78/21)", 2024-09-12T18:37:46.263 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:46.245203+0000", 2024-09-12T18:37:46.263 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.0011161190000000001, 2024-09-12T18:37:46.263 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.001235049, 2024-09-12T18:37:46.263 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:46.263 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:46.263 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:46.263 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:46.263 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.263 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:46.263 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.245203+0000", 2024-09-12T18:37:46.263 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.264 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.264 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.264 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:46.264 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.245203+0000", 2024-09-12T18:37:46.264 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.264 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.264 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.264 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:46.264 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.245203+0000", 2024-09-12T18:37:46.264 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4300000000000003e-07 2024-09-12T18:37:46.264 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.264 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.264 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:46.265 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.245206+0000", 2024-09-12T18:37:46.265 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7530000000000002e-06 2024-09-12T18:37:46.265 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.265 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.265 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:46.265 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.245213+0000", 2024-09-12T18:37:46.265 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4630000000000004e-06 2024-09-12T18:37:46.265 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.265 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.265 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.265 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.245219+0000", 2024-09-12T18:37:46.265 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1959999999999999e-06 2024-09-12T18:37:46.265 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.266 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:46.266 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.266 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.266 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.266 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:255360 5.4 e78/21 5:24b8e2d7:::benchmark_data_smithi073_23739_object123083:head v 78'15840, mlcod=78'15838)", 2024-09-12T18:37:46.266 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:46.245667+0000", 2024-09-12T18:37:46.266 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.00065186300000000003, 2024-09-12T18:37:46.266 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00079436399999999999, 2024-09-12T18:37:46.266 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:46.266 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:46.267 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:46.267 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:46.267 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.267 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:46.267 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.245667+0000", 2024-09-12T18:37:46.267 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.267 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.267 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.267 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:46.267 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.245667+0000", 2024-09-12T18:37:46.267 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.267 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.267 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.268 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:46.268 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.245667+0000", 2024-09-12T18:37:46.268 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8699999999999995e-07 2024-09-12T18:37:46.268 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.268 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.268 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:46.268 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.245671+0000", 2024-09-12T18:37:46.268 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.9519999999999996e-06 2024-09-12T18:37:46.268 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.268 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.268 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:46.268 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.245682+0000", 2024-09-12T18:37:46.268 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0739e-05 2024-09-12T18:37:46.268 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.269 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.269 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.269 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.245687+0000", 2024-09-12T18:37:46.269 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.6770000000000003e-06 2024-09-12T18:37:46.269 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.269 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.269 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:46.269 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.245732+0000", 2024-09-12T18:37:46.269 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5037000000000003e-05 2024-09-12T18:37:46.269 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.269 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.269 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:46.269 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.245744+0000", 2024-09-12T18:37:46.269 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2034e-05 2024-09-12T18:37:46.270 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.270 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:46.270 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.270 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.270 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.270 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:255340 5.3 5:c29da801:::benchmark_data_smithi073_23739_object123063:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T18:37:46.270 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:46.235529+0000", 2024-09-12T18:37:46.270 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 0.010790146, 2024-09-12T18:37:46.270 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.010960599, 2024-09-12T18:37:46.270 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:46.270 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:46.270 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:46.270 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:46.270 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:46.271 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:46.271 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 255340 2024-09-12T18:37:46.271 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.271 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:46.271 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.271 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:46.271 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.235529+0000", 2024-09-12T18:37:46.271 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.271 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.271 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.271 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:46.271 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.235529+0000", 2024-09-12T18:37:46.271 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.271 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.272 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.272 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:46.272 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.235530+0000", 2024-09-12T18:37:46.272 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.175e-06 2024-09-12T18:37:46.272 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.272 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.272 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:46.272 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.235534+0000", 2024-09-12T18:37:46.272 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.6290000000000001e-06 2024-09-12T18:37:46.272 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.272 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.272 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:46.272 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.235545+0000", 2024-09-12T18:37:46.272 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0732e-05 2024-09-12T18:37:46.273 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.273 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.273 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.273 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.235552+0000", 2024-09-12T18:37:46.273 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.9720000000000003e-06 2024-09-12T18:37:46.273 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.273 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.273 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:46.273 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.238378+0000", 2024-09-12T18:37:46.273 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.002826149 2024-09-12T18:37:46.273 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.273 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.273 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:46.273 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.238485+0000", 2024-09-12T18:37:46.273 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000106669 2024-09-12T18:37:46.274 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.274 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.274 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:46.274 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.238588+0000", 2024-09-12T18:37:46.274 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000103263 2024-09-12T18:37:46.274 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.274 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.274 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:46.274 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:46.245058+0000", 2024-09-12T18:37:46.274 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0064700970000000002 2024-09-12T18:37:46.274 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.274 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:46.274 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.274 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.274 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-12T18:37:46.275 INFO:teuthology.orchestra.run.smithi114.stdout: "num_ops": 6 2024-09-12T18:37:46.275 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:46.276 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:37:46.295 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:46.291+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:46.396 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:46.389+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:46.433 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:46.434 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2024-09-12T18:37:46.434 INFO:teuthology.orchestra.run.smithi114.stdout: "complaint_time": 30, 2024-09-12T18:37:46.434 INFO:teuthology.orchestra.run.smithi114.stdout: "num_blocked_ops": 0 2024-09-12T18:37:46.434 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:46.454 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:37:46.497 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:46.491+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:46.599 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:46.593+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:46.612 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:46.612 INFO:teuthology.orchestra.run.smithi114.stdout: "size": 20, 2024-09-12T18:37:46.612 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 600, 2024-09-12T18:37:46.612 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:37:46.613 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.613 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167352 5.a 5:5fc472d2:::benchmark_data_smithi073_23739_object35075:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:46.613 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.163066+0000", 2024-09-12T18:37:46.613 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 43.444535492999997, 2024-09-12T18:37:46.613 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.077708377999999995, 2024-09-12T18:37:46.613 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:46.613 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:46.613 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:46.614 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:46.614 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:46.614 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:46.614 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167352 2024-09-12T18:37:46.614 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.614 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:46.614 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.614 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:46.615 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163066+0000", 2024-09-12T18:37:46.615 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.615 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.615 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.615 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:46.615 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163066+0000", 2024-09-12T18:37:46.615 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.615 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.616 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.616 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:46.616 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163067+0000", 2024-09-12T18:37:46.616 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0499999999999999e-06 2024-09-12T18:37:46.616 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.616 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.616 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:46.616 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163071+0000", 2024-09-12T18:37:46.616 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4340000000000002e-06 2024-09-12T18:37:46.617 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.617 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.617 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:46.617 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163081+0000", 2024-09-12T18:37:46.617 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0304e-05 2024-09-12T18:37:46.617 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.617 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.618 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.618 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163090+0000", 2024-09-12T18:37:46.618 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7309999999999999e-06 2024-09-12T18:37:46.618 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.618 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.618 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:46.618 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163143+0000", 2024-09-12T18:37:46.618 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2942000000000002e-05 2024-09-12T18:37:46.619 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.619 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.619 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:46.619 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163270+0000", 2024-09-12T18:37:46.619 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012664100000000001 2024-09-12T18:37:46.619 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.619 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.620 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:46.620 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163378+0000", 2024-09-12T18:37:46.620 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000107995 2024-09-12T18:37:46.620 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.620 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.620 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:46.620 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234552+0000", 2024-09-12T18:37:46.621 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.071173831000000007 2024-09-12T18:37:46.621 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.621 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.621 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:46.621 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240640+0000", 2024-09-12T18:37:46.621 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.006088909 2024-09-12T18:37:46.621 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.621 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.621 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:46.621 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240709+0000", 2024-09-12T18:37:46.621 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8393999999999996e-05 2024-09-12T18:37:46.622 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.622 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.622 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:46.622 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240774+0000", 2024-09-12T18:37:46.622 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5147000000000005e-05 2024-09-12T18:37:46.622 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.622 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:46.622 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.622 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.622 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.622 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167358 5.a 5:533f6738:::benchmark_data_smithi073_23739_object35081:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:46.622 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.165639+0000", 2024-09-12T18:37:46.623 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 43.441962216, 2024-09-12T18:37:46.623 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.075287509000000002, 2024-09-12T18:37:46.623 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:46.623 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:46.623 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:46.623 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:46.623 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:46.623 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:46.623 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167358 2024-09-12T18:37:46.623 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.623 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:46.623 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.623 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:46.624 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165639+0000", 2024-09-12T18:37:46.624 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.624 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.624 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.624 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:46.624 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165639+0000", 2024-09-12T18:37:46.624 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.624 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.624 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.624 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:46.624 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165640+0000", 2024-09-12T18:37:46.624 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1999999999999999e-06 2024-09-12T18:37:46.625 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.625 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.625 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:46.625 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165646+0000", 2024-09-12T18:37:46.625 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4550000000000003e-06 2024-09-12T18:37:46.625 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.625 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.625 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:46.625 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165658+0000", 2024-09-12T18:37:46.625 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2721999999999999e-05 2024-09-12T18:37:46.625 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.625 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.625 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.626 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165668+0000", 2024-09-12T18:37:46.626 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4229999999999994e-06 2024-09-12T18:37:46.626 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.626 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.626 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:46.626 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165711+0000", 2024-09-12T18:37:46.626 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3785999999999997e-05 2024-09-12T18:37:46.626 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.626 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.626 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:46.626 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165788+0000", 2024-09-12T18:37:46.626 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6506000000000002e-05 2024-09-12T18:37:46.626 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.626 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.627 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:46.627 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165862+0000", 2024-09-12T18:37:46.627 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4012999999999998e-05 2024-09-12T18:37:46.627 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.627 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.627 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:46.627 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234718+0000", 2024-09-12T18:37:46.627 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.068856420000000002 2024-09-12T18:37:46.627 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.627 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.627 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:46.627 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240785+0000", 2024-09-12T18:37:46.627 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0060661489999999998 2024-09-12T18:37:46.628 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.628 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.628 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:46.628 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240844+0000", 2024-09-12T18:37:46.628 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9487000000000002e-05 2024-09-12T18:37:46.628 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.628 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.628 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:46.628 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240926+0000", 2024-09-12T18:37:46.628 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2348000000000005e-05 2024-09-12T18:37:46.628 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.628 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:46.628 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.629 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.629 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.629 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167361 5.a 5:56730f28:::benchmark_data_smithi073_23739_object35084:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:46.629 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.165979+0000", 2024-09-12T18:37:46.629 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 43.441622236000001, 2024-09-12T18:37:46.629 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.075128337000000003, 2024-09-12T18:37:46.629 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:46.629 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:46.629 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:46.629 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:46.630 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:46.630 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:46.630 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167361 2024-09-12T18:37:46.630 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.630 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:46.630 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.630 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:46.630 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165979+0000", 2024-09-12T18:37:46.630 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.630 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.630 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.630 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:46.630 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165979+0000", 2024-09-12T18:37:46.631 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.631 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.631 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.631 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:46.631 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165980+0000", 2024-09-12T18:37:46.631 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4499999999999997e-07 2024-09-12T18:37:46.631 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.631 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.631 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:46.631 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165985+0000", 2024-09-12T18:37:46.631 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.186e-06 2024-09-12T18:37:46.631 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.631 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.631 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:46.632 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165995+0000", 2024-09-12T18:37:46.632 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0378e-05 2024-09-12T18:37:46.632 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.632 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.632 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.632 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.166016+0000", 2024-09-12T18:37:46.632 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1316999999999999e-05 2024-09-12T18:37:46.632 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.632 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.632 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:46.632 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.167783+0000", 2024-09-12T18:37:46.632 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017662209999999999 2024-09-12T18:37:46.632 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.633 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.633 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:46.633 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.167851+0000", 2024-09-12T18:37:46.633 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7990000000000005e-05 2024-09-12T18:37:46.633 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.633 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.633 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:46.633 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.167929+0000", 2024-09-12T18:37:46.633 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8829e-05 2024-09-12T18:37:46.633 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.633 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.633 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:46.633 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234832+0000", 2024-09-12T18:37:46.634 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066902378999999998 2024-09-12T18:37:46.634 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.634 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.634 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:46.634 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240941+0000", 2024-09-12T18:37:46.634 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0061087470000000003 2024-09-12T18:37:46.634 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.634 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.634 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:46.634 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241053+0000", 2024-09-12T18:37:46.634 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00011197299999999999 2024-09-12T18:37:46.634 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.634 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.635 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:46.635 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241107+0000", 2024-09-12T18:37:46.635 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4672000000000001e-05 2024-09-12T18:37:46.635 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.635 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:46.635 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.635 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.635 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.635 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167362 5.3 5:cbd73b47:::benchmark_data_smithi073_23739_object35085:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:46.635 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:46.635 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 43.439525521, 2024-09-12T18:37:46.636 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.067202411000000004, 2024-09-12T18:37:46.636 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:46.636 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:46.636 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:46.636 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:46.636 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:46.636 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:46.636 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167362 2024-09-12T18:37:46.636 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.636 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:46.636 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.636 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:46.636 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:46.637 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.637 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.637 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.637 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:46.637 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:46.637 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.637 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.637 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.637 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:46.637 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:46.637 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3600000000000003e-07 2024-09-12T18:37:46.637 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.637 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.637 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:46.637 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168079+0000", 2024-09-12T18:37:46.638 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7949999999999999e-06 2024-09-12T18:37:46.638 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.638 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.638 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:46.638 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168085+0000", 2024-09-12T18:37:46.638 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2110000000000003e-06 2024-09-12T18:37:46.638 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.638 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.638 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.638 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168089+0000", 2024-09-12T18:37:46.638 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0840000000000002e-06 2024-09-12T18:37:46.638 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.638 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.638 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:46.639 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168121+0000", 2024-09-12T18:37:46.639 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.1489000000000003e-05 2024-09-12T18:37:46.639 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.639 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.639 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:46.639 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168186+0000", 2024-09-12T18:37:46.639 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5313000000000003e-05 2024-09-12T18:37:46.639 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.639 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.640 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:46.640 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168242+0000", 2024-09-12T18:37:46.640 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5560999999999999e-05 2024-09-12T18:37:46.640 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.640 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.640 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:46.640 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234467+0000", 2024-09-12T18:37:46.640 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066225424000000005 2024-09-12T18:37:46.640 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.640 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.640 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:46.640 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235088+0000", 2024-09-12T18:37:46.641 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00062118999999999998 2024-09-12T18:37:46.641 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.641 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.641 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:46.641 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235197+0000", 2024-09-12T18:37:46.641 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00010825899999999999 2024-09-12T18:37:46.641 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.641 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.641 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:46.641 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235278+0000", 2024-09-12T18:37:46.641 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1448999999999999e-05 2024-09-12T18:37:46.641 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.641 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:46.642 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.642 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.642 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.642 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167366 5.a 5:58e6a467:::benchmark_data_smithi073_23739_object35089:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:46.642 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168263+0000", 2024-09-12T18:37:46.642 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 43.439337983999998, 2024-09-12T18:37:46.642 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.078184744, 2024-09-12T18:37:46.642 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:46.642 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:46.642 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:46.642 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:46.642 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:46.643 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:46.643 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167366 2024-09-12T18:37:46.643 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.643 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:46.643 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.643 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:46.643 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168263+0000", 2024-09-12T18:37:46.643 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.643 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.643 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.643 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:46.643 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168263+0000", 2024-09-12T18:37:46.643 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.644 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.644 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.644 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:46.644 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168264+0000", 2024-09-12T18:37:46.644 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5700000000000002e-07 2024-09-12T18:37:46.644 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.644 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.644 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:46.644 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168266+0000", 2024-09-12T18:37:46.644 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1789999999999998e-06 2024-09-12T18:37:46.644 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.644 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.644 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:46.645 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168271+0000", 2024-09-12T18:37:46.645 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8160000000000001e-06 2024-09-12T18:37:46.645 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.645 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.645 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.645 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168275+0000", 2024-09-12T18:37:46.645 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4440000000000001e-06 2024-09-12T18:37:46.645 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.645 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.645 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:46.645 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170082+0000", 2024-09-12T18:37:46.645 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0018068800000000001 2024-09-12T18:37:46.645 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.645 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.646 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:46.646 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170154+0000", 2024-09-12T18:37:46.646 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1575000000000005e-05 2024-09-12T18:37:46.646 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.646 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.646 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:46.646 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170216+0000", 2024-09-12T18:37:46.646 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1989999999999994e-05 2024-09-12T18:37:46.646 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.646 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.646 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:46.646 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234933+0000", 2024-09-12T18:37:46.647 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064717514000000004 2024-09-12T18:37:46.647 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.647 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.647 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:46.647 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246226+0000", 2024-09-12T18:37:46.647 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011293151 2024-09-12T18:37:46.647 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.647 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.647 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:46.647 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246338+0000", 2024-09-12T18:37:46.647 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00011225 2024-09-12T18:37:46.647 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.647 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.648 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:46.648 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246448+0000", 2024-09-12T18:37:46.648 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000109388 2024-09-12T18:37:46.648 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.648 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:46.648 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.648 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.648 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.648 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167367 5.a 5:51778d97:::benchmark_data_smithi073_23739_object35090:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:46.648 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168388+0000", 2024-09-12T18:37:46.648 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 43.439212740000002, 2024-09-12T18:37:46.648 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.082583860999999995, 2024-09-12T18:37:46.648 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:46.649 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:46.649 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:46.649 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:46.649 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:46.649 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:46.649 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167367 2024-09-12T18:37:46.649 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.649 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:46.649 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.649 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:46.649 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168388+0000", 2024-09-12T18:37:46.649 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.650 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.650 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.650 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:46.650 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168388+0000", 2024-09-12T18:37:46.650 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.650 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.650 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.650 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:46.650 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168389+0000", 2024-09-12T18:37:46.650 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1099999999999996e-07 2024-09-12T18:37:46.650 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.650 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.650 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:46.651 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168391+0000", 2024-09-12T18:37:46.651 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.39e-06 2024-09-12T18:37:46.651 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.651 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.651 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:46.651 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168396+0000", 2024-09-12T18:37:46.651 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3460000000000004e-06 2024-09-12T18:37:46.651 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.651 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.651 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.651 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168399+0000", 2024-09-12T18:37:46.651 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.613e-06 2024-09-12T18:37:46.651 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.652 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.652 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:46.652 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235003+0000", 2024-09-12T18:37:46.652 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066603851000000006 2024-09-12T18:37:46.652 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.652 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.652 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:46.652 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235266+0000", 2024-09-12T18:37:46.652 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00026270999999999998 2024-09-12T18:37:46.652 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.653 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.653 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:46.653 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235510+0000", 2024-09-12T18:37:46.653 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00024394 2024-09-12T18:37:46.653 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.653 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.653 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:46.653 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246546+0000", 2024-09-12T18:37:46.653 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011035774 2024-09-12T18:37:46.653 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.654 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.654 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:46.654 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.250808+0000", 2024-09-12T18:37:46.654 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0042622700000000003 2024-09-12T18:37:46.654 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.654 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.654 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:46.654 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.250890+0000", 2024-09-12T18:37:46.654 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1874999999999998e-05 2024-09-12T18:37:46.654 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.654 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.654 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:46.654 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.250972+0000", 2024-09-12T18:37:46.655 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2581000000000001e-05 2024-09-12T18:37:46.655 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.655 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:46.655 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.655 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.655 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.655 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167370 5.a 5:5aab9477:::benchmark_data_smithi073_23739_object35093:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:46.656 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168603+0000", 2024-09-12T18:37:46.656 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 43.438997805, 2024-09-12T18:37:46.656 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.086603794999999997, 2024-09-12T18:37:46.656 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:46.656 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:46.656 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:46.657 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:46.657 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:46.657 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:46.657 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167370 2024-09-12T18:37:46.657 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.657 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:46.657 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.657 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:46.657 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168603+0000", 2024-09-12T18:37:46.657 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.657 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.657 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.657 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:46.658 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168603+0000", 2024-09-12T18:37:46.658 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.658 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.658 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.658 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:46.658 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168604+0000", 2024-09-12T18:37:46.658 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.1899999999999998e-07 2024-09-12T18:37:46.658 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.658 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.658 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:46.658 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168606+0000", 2024-09-12T18:37:46.658 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8309999999999999e-06 2024-09-12T18:37:46.658 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.659 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.659 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:46.659 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168610+0000", 2024-09-12T18:37:46.659 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8069999999999999e-06 2024-09-12T18:37:46.659 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.659 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.659 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.659 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168613+0000", 2024-09-12T18:37:46.659 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.118e-06 2024-09-12T18:37:46.659 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.659 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.659 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:46.659 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241145+0000", 2024-09-12T18:37:46.660 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.072531678000000002 2024-09-12T18:37:46.660 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.660 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.660 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:46.660 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241342+0000", 2024-09-12T18:37:46.660 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00019635900000000001 2024-09-12T18:37:46.660 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.660 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.660 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:46.660 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241483+0000", 2024-09-12T18:37:46.660 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014161100000000001 2024-09-12T18:37:46.660 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.660 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.661 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:46.661 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255039+0000", 2024-09-12T18:37:46.661 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013555724 2024-09-12T18:37:46.661 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.661 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.661 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:46.661 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255062+0000", 2024-09-12T18:37:46.661 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.3042000000000001e-05 2024-09-12T18:37:46.661 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.661 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.661 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:46.661 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255143+0000", 2024-09-12T18:37:46.661 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0999000000000002e-05 2024-09-12T18:37:46.662 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.662 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.662 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:46.662 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255207+0000", 2024-09-12T18:37:46.662 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4207000000000004e-05 2024-09-12T18:37:46.662 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.662 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:46.662 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.662 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.662 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.662 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167352 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:46.662 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:46.663 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 43.438873151000003, 2024-09-12T18:37:46.663 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065859953999999998, 2024-09-12T18:37:46.663 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:46.663 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:46.663 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:46.663 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:46.663 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.663 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:46.664 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:46.664 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.664 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.664 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.664 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:46.664 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:46.664 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.664 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.665 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.665 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:46.665 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:46.665 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.0800000000000001e-07 2024-09-12T18:37:46.665 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.665 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.665 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:46.665 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168730+0000", 2024-09-12T18:37:46.665 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6530000000000001e-06 2024-09-12T18:37:46.665 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.666 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.666 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:46.666 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168734+0000", 2024-09-12T18:37:46.666 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.721e-06 2024-09-12T18:37:46.666 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.666 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.666 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.666 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168736+0000", 2024-09-12T18:37:46.666 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.508e-06 2024-09-12T18:37:46.667 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.667 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.667 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:46.667 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171951+0000", 2024-09-12T18:37:46.667 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.003215281 2024-09-12T18:37:46.667 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.668 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.668 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:46.668 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234520+0000", 2024-09-12T18:37:46.668 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062568676000000004 2024-09-12T18:37:46.668 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.668 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.669 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:46.669 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234588+0000", 2024-09-12T18:37:46.669 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7806999999999996e-05 2024-09-12T18:37:46.669 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.669 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:46.669 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.670 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.670 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.670 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167368 5.4 e58/21 5:29a1ec58:::benchmark_data_smithi073_23739_object35091:head v 58'10399, mlcod=58'10396)", 2024-09-12T18:37:46.670 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:46.671 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 43.438750134000003, 2024-09-12T18:37:46.671 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066008885000000003, 2024-09-12T18:37:46.671 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:46.671 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:46.671 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:46.672 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:46.672 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.672 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:46.672 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:46.673 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.673 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.673 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.673 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:46.673 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:46.673 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.674 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.674 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.674 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:46.674 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:46.674 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4699999999999998e-07 2024-09-12T18:37:46.674 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.675 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.675 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:46.675 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168854+0000", 2024-09-12T18:37:46.675 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.3180000000000001e-06 2024-09-12T18:37:46.675 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.675 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.676 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:46.676 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168858+0000", 2024-09-12T18:37:46.676 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2799999999999997e-06 2024-09-12T18:37:46.676 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.676 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.677 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.677 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168861+0000", 2024-09-12T18:37:46.677 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7650000000000002e-06 2024-09-12T18:37:46.677 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.677 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.677 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:46.678 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168895+0000", 2024-09-12T18:37:46.678 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4533999999999998e-05 2024-09-12T18:37:46.678 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.678 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.678 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:46.678 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168906+0000", 2024-09-12T18:37:46.678 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0910000000000001e-05 2024-09-12T18:37:46.678 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.678 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.678 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:46.678 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234784+0000", 2024-09-12T18:37:46.678 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065877656000000007 2024-09-12T18:37:46.679 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.679 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.679 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:46.679 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234860+0000", 2024-09-12T18:37:46.679 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6174999999999995e-05 2024-09-12T18:37:46.679 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.679 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:46.679 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.679 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.679 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.679 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167358 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:46.680 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.170373+0000", 2024-09-12T18:37:46.680 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 43.437227853000003, 2024-09-12T18:37:46.680 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064370201000000002, 2024-09-12T18:37:46.680 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:46.680 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:46.680 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:46.680 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:46.680 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.681 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:46.681 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170373+0000", 2024-09-12T18:37:46.681 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.681 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.681 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.681 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:46.681 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170373+0000", 2024-09-12T18:37:46.681 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.681 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.681 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.681 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:46.681 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170374+0000", 2024-09-12T18:37:46.681 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5799999999999998e-07 2024-09-12T18:37:46.682 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.682 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.682 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:46.683 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170378+0000", 2024-09-12T18:37:46.683 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.732e-06 2024-09-12T18:37:46.683 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.683 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.683 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:46.683 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170388+0000", 2024-09-12T18:37:46.683 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0212e-05 2024-09-12T18:37:46.683 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.683 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.683 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.683 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170397+0000", 2024-09-12T18:37:46.683 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7090000000000008e-06 2024-09-12T18:37:46.684 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.684 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.684 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:46.684 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234682+0000", 2024-09-12T18:37:46.684 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064285518999999999 2024-09-12T18:37:46.684 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.684 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.684 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:46.684 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234703+0000", 2024-09-12T18:37:46.684 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.0199000000000001e-05 2024-09-12T18:37:46.684 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.684 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.685 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:46.685 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234743+0000", 2024-09-12T18:37:46.685 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0972e-05 2024-09-12T18:37:46.685 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.685 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:46.685 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.685 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.685 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.685 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167372 5.c 5:398d36a7:::benchmark_data_smithi073_23739_object35095:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:46.685 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171066+0000", 2024-09-12T18:37:46.685 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 43.436534641000001, 2024-09-12T18:37:46.685 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065889534999999999, 2024-09-12T18:37:46.685 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:46.686 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:46.686 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:46.686 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:46.686 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:46.686 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:46.686 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167372 2024-09-12T18:37:46.686 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.686 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:46.686 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.686 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:46.686 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171066+0000", 2024-09-12T18:37:46.687 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.687 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.687 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.687 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:46.687 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171066+0000", 2024-09-12T18:37:46.687 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.687 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.687 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.687 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:46.687 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171068+0000", 2024-09-12T18:37:46.687 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.186e-06 2024-09-12T18:37:46.687 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.688 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.688 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:46.688 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171072+0000", 2024-09-12T18:37:46.688 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3560000000000003e-06 2024-09-12T18:37:46.688 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.688 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.688 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:46.688 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171082+0000", 2024-09-12T18:37:46.688 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.9739999999999997e-06 2024-09-12T18:37:46.688 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.688 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.688 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.689 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171089+0000", 2024-09-12T18:37:46.689 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7159999999999997e-06 2024-09-12T18:37:46.689 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.689 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.689 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:46.689 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171133+0000", 2024-09-12T18:37:46.689 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4091999999999997e-05 2024-09-12T18:37:46.689 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.689 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.689 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:46.690 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171221+0000", 2024-09-12T18:37:46.690 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.8108000000000004e-05 2024-09-12T18:37:46.690 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.690 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.690 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:46.690 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171279+0000", 2024-09-12T18:37:46.690 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8062000000000001e-05 2024-09-12T18:37:46.690 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.690 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.690 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:46.690 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235007+0000", 2024-09-12T18:37:46.690 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.063727849000000003 2024-09-12T18:37:46.690 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.691 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.691 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:46.691 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236790+0000", 2024-09-12T18:37:46.691 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017829269999999999 2024-09-12T18:37:46.691 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.691 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.691 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:46.691 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236881+0000", 2024-09-12T18:37:46.691 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1347999999999993e-05 2024-09-12T18:37:46.691 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.691 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.691 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:46.691 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236956+0000", 2024-09-12T18:37:46.692 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4917000000000001e-05 2024-09-12T18:37:46.692 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.692 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:46.692 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.692 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.692 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.692 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167371 5.4 e58/21 5:24fea27c:::benchmark_data_smithi073_23739_object35094:head v 58'10400, mlcod=58'10397)", 2024-09-12T18:37:46.692 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171273+0000", 2024-09-12T18:37:46.692 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 43.436328066999998, 2024-09-12T18:37:46.693 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065500368000000003, 2024-09-12T18:37:46.693 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:46.693 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:46.693 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:46.693 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:46.693 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.693 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:46.693 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171273+0000", 2024-09-12T18:37:46.693 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.693 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.693 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.693 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:46.694 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171273+0000", 2024-09-12T18:37:46.694 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.694 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.694 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.694 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:46.694 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171274+0000", 2024-09-12T18:37:46.694 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0399999999999996e-07 2024-09-12T18:37:46.694 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.694 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.694 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:46.694 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171277+0000", 2024-09-12T18:37:46.695 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8689999999999997e-06 2024-09-12T18:37:46.695 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.695 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.695 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:46.695 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171284+0000", 2024-09-12T18:37:46.695 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2879999999999998e-06 2024-09-12T18:37:46.695 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.695 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.695 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.695 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171289+0000", 2024-09-12T18:37:46.695 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9049999999999996e-06 2024-09-12T18:37:46.695 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.695 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.695 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:46.696 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171322+0000", 2024-09-12T18:37:46.696 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3781000000000001e-05 2024-09-12T18:37:46.696 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.696 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.696 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:46.696 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171335+0000", 2024-09-12T18:37:46.696 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2639999999999999e-05 2024-09-12T18:37:46.696 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.696 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.696 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:46.696 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236691+0000", 2024-09-12T18:37:46.696 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065355835000000001 2024-09-12T18:37:46.697 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.697 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.697 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:46.697 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236773+0000", 2024-09-12T18:37:46.697 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2546000000000006e-05 2024-09-12T18:37:46.697 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.697 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:46.697 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.697 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.697 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.697 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167364 5.7 e58/21 5:ee50096a:::benchmark_data_smithi073_23739_object35087:head v 58'10504, mlcod=58'10502)", 2024-09-12T18:37:46.697 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171598+0000", 2024-09-12T18:37:46.697 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 43.436002948000002, 2024-09-12T18:37:46.697 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065149069000000004, 2024-09-12T18:37:46.698 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:46.698 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:46.698 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:46.698 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:46.698 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.698 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:46.698 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171598+0000", 2024-09-12T18:37:46.698 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.698 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.698 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.698 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:46.698 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171598+0000", 2024-09-12T18:37:46.698 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.698 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.699 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.699 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:46.699 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171599+0000", 2024-09-12T18:37:46.699 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6700000000000003e-07 2024-09-12T18:37:46.699 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.699 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.699 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:46.699 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171602+0000", 2024-09-12T18:37:46.699 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.841e-06 2024-09-12T18:37:46.699 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.699 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.699 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:46.699 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171608+0000", 2024-09-12T18:37:46.700 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9259999999999997e-06 2024-09-12T18:37:46.700 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.700 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.700 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.700 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171611+0000", 2024-09-12T18:37:46.700 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.9450000000000003e-06 2024-09-12T18:37:46.700 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.700 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.700 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:46.700 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171650+0000", 2024-09-12T18:37:46.701 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8464000000000003e-05 2024-09-12T18:37:46.701 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.701 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.701 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:46.701 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171662+0000", 2024-09-12T18:37:46.701 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1603999999999999e-05 2024-09-12T18:37:46.701 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.701 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.701 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:46.701 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236663+0000", 2024-09-12T18:37:46.701 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065001330999999996 2024-09-12T18:37:46.701 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.702 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.702 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:46.702 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236747+0000", 2024-09-12T18:37:46.702 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.4390999999999999e-05 2024-09-12T18:37:46.702 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.702 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:46.702 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.702 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.702 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.702 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167365 5.2 e58/21 5:4107875c:::benchmark_data_smithi073_23739_object35088:head v 58'10351, mlcod=58'10349)", 2024-09-12T18:37:46.702 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171733+0000", 2024-09-12T18:37:46.702 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 43.435867903000002, 2024-09-12T18:37:46.703 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.074804168000000004, 2024-09-12T18:37:46.703 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:46.703 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:46.703 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:46.703 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:46.703 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.703 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:46.703 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171733+0000", 2024-09-12T18:37:46.703 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.703 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.703 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.703 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:46.703 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171733+0000", 2024-09-12T18:37:46.704 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.704 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.704 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.704 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:46.704 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171734+0000", 2024-09-12T18:37:46.704 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9299999999999998e-07 2024-09-12T18:37:46.704 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.704 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.704 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:46.704 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171738+0000", 2024-09-12T18:37:46.704 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.301e-06 2024-09-12T18:37:46.704 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.705 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.705 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:46.705 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171746+0000", 2024-09-12T18:37:46.705 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.554e-06 2024-09-12T18:37:46.705 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.705 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.705 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.705 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171751+0000", 2024-09-12T18:37:46.705 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1880000000000001e-06 2024-09-12T18:37:46.705 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.705 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.705 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:46.705 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234659+0000", 2024-09-12T18:37:46.706 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062907807999999996 2024-09-12T18:37:46.706 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.706 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.706 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:46.706 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234708+0000", 2024-09-12T18:37:46.706 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8992000000000001e-05 2024-09-12T18:37:46.706 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.706 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.706 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:46.706 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246457+0000", 2024-09-12T18:37:46.706 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.01174974 2024-09-12T18:37:46.706 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.706 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.706 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:46.707 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246537+0000", 2024-09-12T18:37:46.707 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.9992000000000003e-05 2024-09-12T18:37:46.707 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.707 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:46.707 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.707 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.707 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.707 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167373 5.5 e58/49 5:ad283029:::benchmark_data_smithi073_23739_object35096:head v 58'10600, mlcod=58'10598)", 2024-09-12T18:37:46.707 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:46.707 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 43.435840419000002, 2024-09-12T18:37:46.707 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065058240000000003, 2024-09-12T18:37:46.707 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:46.707 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:46.708 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:46.708 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:46.708 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.708 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:46.708 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:46.708 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.708 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.708 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.708 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:46.708 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:46.708 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.708 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.708 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.709 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:46.709 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:46.709 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.2899999999999999e-07 2024-09-12T18:37:46.709 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.709 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.709 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:46.709 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171764+0000", 2024-09-12T18:37:46.709 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7310000000000002e-06 2024-09-12T18:37:46.709 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.709 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.709 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:46.709 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171769+0000", 2024-09-12T18:37:46.710 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.079e-06 2024-09-12T18:37:46.710 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.710 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.710 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.710 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171774+0000", 2024-09-12T18:37:46.710 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.48e-06 2024-09-12T18:37:46.710 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.710 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.710 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:46.710 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171819+0000", 2024-09-12T18:37:46.711 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4391999999999998e-05 2024-09-12T18:37:46.711 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.711 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.711 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:46.711 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171841+0000", 2024-09-12T18:37:46.711 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2245000000000001e-05 2024-09-12T18:37:46.711 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.711 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.711 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:46.711 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236750+0000", 2024-09-12T18:37:46.711 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064909123999999999 2024-09-12T18:37:46.711 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.712 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.712 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:46.712 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236819+0000", 2024-09-12T18:37:46.712 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8860000000000001e-05 2024-09-12T18:37:46.712 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.712 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:46.712 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.712 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.712 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.712 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167361 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:46.712 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:46.712 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 43.435784513000002, 2024-09-12T18:37:46.712 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.063049426000000006, 2024-09-12T18:37:46.713 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:46.713 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:46.713 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:46.713 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:46.713 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.713 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:46.713 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:46.713 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.713 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.713 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.713 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:46.713 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:46.714 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.714 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.714 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.714 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:46.714 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:46.714 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.9099999999999999e-07 2024-09-12T18:37:46.714 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.714 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.714 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:46.714 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171820+0000", 2024-09-12T18:37:46.714 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.5900000000000002e-06 2024-09-12T18:37:46.714 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.714 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.715 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:46.715 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171826+0000", 2024-09-12T18:37:46.715 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.64e-06 2024-09-12T18:37:46.715 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.715 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.715 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.715 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171831+0000", 2024-09-12T18:37:46.715 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.578e-06 2024-09-12T18:37:46.715 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.715 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.715 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:46.715 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234808+0000", 2024-09-12T18:37:46.715 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062976780999999996 2024-09-12T18:37:46.715 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.716 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.716 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:46.716 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234821+0000", 2024-09-12T18:37:46.716 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3002e-05 2024-09-12T18:37:46.716 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.716 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.716 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:46.716 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234866+0000", 2024-09-12T18:37:46.716 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5444000000000001e-05 2024-09-12T18:37:46.716 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.716 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:46.716 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.716 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.717 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.717 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167366 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:46.717 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.172133+0000", 2024-09-12T18:37:46.717 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 43.435467684999999, 2024-09-12T18:37:46.717 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062815840999999997, 2024-09-12T18:37:46.717 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:46.717 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:46.717 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:46.717 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:46.717 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.717 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:46.717 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172133+0000", 2024-09-12T18:37:46.717 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.718 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.718 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.718 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:46.718 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172133+0000", 2024-09-12T18:37:46.718 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.718 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.718 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.718 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:46.718 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172134+0000", 2024-09-12T18:37:46.718 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5000000000000003e-07 2024-09-12T18:37:46.718 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.718 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.718 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:46.719 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172137+0000", 2024-09-12T18:37:46.719 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.6460000000000002e-06 2024-09-12T18:37:46.719 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.719 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.719 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:46.719 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234511+0000", 2024-09-12T18:37:46.719 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062374603000000001 2024-09-12T18:37:46.719 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.719 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.719 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.719 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234525+0000", 2024-09-12T18:37:46.720 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3396e-05 2024-09-12T18:37:46.720 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.720 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.720 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:46.720 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234909+0000", 2024-09-12T18:37:46.720 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00038405299999999998 2024-09-12T18:37:46.720 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.720 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.720 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:46.720 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234922+0000", 2024-09-12T18:37:46.720 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3274e-05 2024-09-12T18:37:46.720 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.721 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.721 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:46.721 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234949+0000", 2024-09-12T18:37:46.721 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7319000000000001e-05 2024-09-12T18:37:46.721 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.721 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:46.721 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.721 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.721 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.721 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167369 5.7 e58/21 5:e64ecabd:::benchmark_data_smithi073_23739_object35092:head v 58'10505, mlcod=58'10502)", 2024-09-12T18:37:46.721 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:46.721 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 43.433937293, 2024-09-12T18:37:46.721 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.063873773999999994, 2024-09-12T18:37:46.722 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:46.722 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:46.722 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:46.722 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:46.722 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.722 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:46.722 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:46.722 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.722 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.722 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.722 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:46.722 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:46.722 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.723 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.723 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.723 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:46.723 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:46.723 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3500000000000002e-07 2024-09-12T18:37:46.723 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.723 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.723 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:46.723 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173668+0000", 2024-09-12T18:37:46.723 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4000000000000001e-06 2024-09-12T18:37:46.723 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.723 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.724 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:46.724 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234583+0000", 2024-09-12T18:37:46.724 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.060914889 2024-09-12T18:37:46.724 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.724 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.724 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.724 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234600+0000", 2024-09-12T18:37:46.724 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7192000000000001e-05 2024-09-12T18:37:46.724 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.724 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.724 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:46.724 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234791+0000", 2024-09-12T18:37:46.725 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00019115000000000001 2024-09-12T18:37:46.725 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.725 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.725 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:46.725 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234834+0000", 2024-09-12T18:37:46.725 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3296e-05 2024-09-12T18:37:46.725 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.725 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.725 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:46.725 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.237481+0000", 2024-09-12T18:37:46.725 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0026472050000000001 2024-09-12T18:37:46.725 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.725 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.726 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:46.726 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.237538+0000", 2024-09-12T18:37:46.726 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6206999999999999e-05 2024-09-12T18:37:46.726 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.726 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:46.726 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.726 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.726 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.726 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:238478 5.c 5:38260ae8:::benchmark_data_smithi073_23739_object106201:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:46.726 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:38.617167+0000", 2024-09-12T18:37:46.726 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 7.9904338749999999, 2024-09-12T18:37:46.726 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062584934999999994, 2024-09-12T18:37:46.726 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:46.727 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:46.727 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:46.727 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:46.727 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:46.727 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:46.727 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 238478 2024-09-12T18:37:46.727 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.727 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:46.727 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.727 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:46.727 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.617167+0000", 2024-09-12T18:37:46.727 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.727 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.728 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.728 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:46.728 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.617167+0000", 2024-09-12T18:37:46.728 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.728 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.728 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.728 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:46.728 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.617168+0000", 2024-09-12T18:37:46.728 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.091e-06 2024-09-12T18:37:46.729 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.729 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.729 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:46.729 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.617173+0000", 2024-09-12T18:37:46.729 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2490000000000003e-06 2024-09-12T18:37:46.729 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.729 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.729 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:46.729 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.617182+0000", 2024-09-12T18:37:46.729 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.6390000000000004e-06 2024-09-12T18:37:46.730 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.730 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.730 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.730 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.617189+0000", 2024-09-12T18:37:46.730 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0119999999999999e-06 2024-09-12T18:37:46.730 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.730 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.730 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:46.730 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.617678+0000", 2024-09-12T18:37:46.730 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00048910800000000003 2024-09-12T18:37:46.730 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.730 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.730 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:46.730 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.665641+0000", 2024-09-12T18:37:46.731 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.047962481000000001 2024-09-12T18:37:46.731 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.731 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.731 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:46.731 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.665895+0000", 2024-09-12T18:37:46.731 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00025440199999999998 2024-09-12T18:37:46.731 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.731 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.731 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:46.731 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.670817+0000", 2024-09-12T18:37:46.731 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0049221120000000002 2024-09-12T18:37:46.731 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.731 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.731 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:46.732 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.679695+0000", 2024-09-12T18:37:46.732 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0088778269999999996 2024-09-12T18:37:46.732 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.732 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.732 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:46.732 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.679726+0000", 2024-09-12T18:37:46.732 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.0830999999999997e-05 2024-09-12T18:37:46.732 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.732 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.732 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:46.732 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.679752+0000", 2024-09-12T18:37:46.732 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.6183e-05 2024-09-12T18:37:46.732 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.733 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:46.733 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.733 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.733 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.733 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:238480 5.c 5:3d043cef:::benchmark_data_smithi073_23739_object106203:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:46.733 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:38.618189+0000", 2024-09-12T18:37:46.733 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 7.9894120690000001, 2024-09-12T18:37:46.733 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.061642400999999999, 2024-09-12T18:37:46.733 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:46.733 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:46.733 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:46.733 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:46.733 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:46.734 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:46.734 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 238480 2024-09-12T18:37:46.734 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.734 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:46.734 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.734 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:46.734 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.618189+0000", 2024-09-12T18:37:46.734 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.734 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.734 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.734 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:46.734 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.618189+0000", 2024-09-12T18:37:46.734 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:46.735 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.735 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.735 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:46.735 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.618190+0000", 2024-09-12T18:37:46.735 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3e-07 2024-09-12T18:37:46.735 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.735 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.735 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:46.735 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.618193+0000", 2024-09-12T18:37:46.735 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.6349999999999999e-06 2024-09-12T18:37:46.735 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.735 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.735 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:46.735 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.665526+0000", 2024-09-12T18:37:46.736 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.047332200999999997 2024-09-12T18:37:46.736 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.736 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.736 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.736 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.665561+0000", 2024-09-12T18:37:46.736 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.5858999999999997e-05 2024-09-12T18:37:46.736 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.736 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.736 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:46.736 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.670869+0000", 2024-09-12T18:37:46.736 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0053076720000000003 2024-09-12T18:37:46.736 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.736 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.736 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:46.737 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.671094+0000", 2024-09-12T18:37:46.737 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000225009 2024-09-12T18:37:46.737 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.737 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.737 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:46.737 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.671272+0000", 2024-09-12T18:37:46.737 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000177725 2024-09-12T18:37:46.737 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.737 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.737 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:46.737 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.679687+0000", 2024-09-12T18:37:46.737 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0084148379999999991 2024-09-12T18:37:46.737 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.737 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.738 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:46.738 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.679787+0000", 2024-09-12T18:37:46.738 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.9950000000000004e-05 2024-09-12T18:37:46.738 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.738 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.738 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:46.738 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.679811+0000", 2024-09-12T18:37:46.738 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4088999999999999e-05 2024-09-12T18:37:46.738 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:46.738 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:46.738 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:46.738 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.679831+0000", 2024-09-12T18:37:46.739 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.0693e-05 2024-09-12T18:37:46.739 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.739 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:46.739 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.739 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:46.739 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:46.739 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:46.740 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:46.735+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:46.741 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:37:46.841 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:46.837+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:46.897 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:46.898 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:37:46.898 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.898 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:256891 5.e 5:7855b506:::benchmark_data_smithi073_23739_object124614:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T18:37:46.898 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:46.889099+0000", 2024-09-12T18:37:46.898 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0052282780000000003, 2024-09-12T18:37:46.898 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0052456619999999999, 2024-09-12T18:37:46.898 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:46.898 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:46.898 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:46.898 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:46.898 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:46.898 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:46.898 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 256891 2024-09-12T18:37:46.899 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.899 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:46.899 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.899 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:46.899 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.889099+0000", 2024-09-12T18:37:46.899 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:46.899 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.899 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.899 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:46.899 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.889099+0000", 2024-09-12T18:37:46.899 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:46.899 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.899 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.900 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:46.900 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.889100+0000", 2024-09-12T18:37:46.900 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0399999999999996e-07 2024-09-12T18:37:46.900 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.900 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.900 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:46.900 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.889103+0000", 2024-09-12T18:37:46.900 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8090000000000001e-06 2024-09-12T18:37:46.900 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.901 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.901 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:46.901 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.889110+0000", 2024-09-12T18:37:46.901 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1420000000000004e-06 2024-09-12T18:37:46.901 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.901 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.902 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.902 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.889115+0000", 2024-09-12T18:37:46.902 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4e-06 2024-09-12T18:37:46.902 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.902 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.902 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:46.902 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.889155+0000", 2024-09-12T18:37:46.903 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9498e-05 2024-09-12T18:37:46.903 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.903 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.903 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:46.903 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.889280+0000", 2024-09-12T18:37:46.903 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000125446 2024-09-12T18:37:46.903 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.903 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.904 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:46.904 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.889392+0000", 2024-09-12T18:37:46.904 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000111296 2024-09-12T18:37:46.904 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.904 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.904 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:46.904 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.891253+0000", 2024-09-12T18:37:46.904 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0018611610000000001 2024-09-12T18:37:46.904 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:46.904 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:46.904 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:46.904 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.905 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.905 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:256899 5.0 5:00a9652f:::benchmark_data_smithi073_23739_object124622:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T18:37:46.905 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:46.892308+0000", 2024-09-12T18:37:46.905 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0020200819999999999, 2024-09-12T18:37:46.905 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0020817219999999998, 2024-09-12T18:37:46.905 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:46.905 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:46.905 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:46.905 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:46.905 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:46.905 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:46.905 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 256899 2024-09-12T18:37:46.906 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.906 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:46.906 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.906 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:46.906 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.892308+0000", 2024-09-12T18:37:46.906 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:46.906 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.906 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.906 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:46.906 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.892308+0000", 2024-09-12T18:37:46.906 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:46.906 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.906 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.906 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:46.907 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.892309+0000", 2024-09-12T18:37:46.907 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.144e-06 2024-09-12T18:37:46.907 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.907 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.907 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:46.907 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.892313+0000", 2024-09-12T18:37:46.907 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1570000000000002e-06 2024-09-12T18:37:46.907 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.907 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.907 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:46.907 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.892321+0000", 2024-09-12T18:37:46.907 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4889999999999995e-06 2024-09-12T18:37:46.907 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.908 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.908 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.908 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.892327+0000", 2024-09-12T18:37:46.908 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.1460000000000004e-06 2024-09-12T18:37:46.908 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.908 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.908 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:46.908 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.892397+0000", 2024-09-12T18:37:46.908 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0471999999999999e-05 2024-09-12T18:37:46.908 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.908 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.908 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:46.908 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.892556+0000", 2024-09-12T18:37:46.909 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00015880000000000001 2024-09-12T18:37:46.909 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.909 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.909 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:46.909 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.892696+0000", 2024-09-12T18:37:46.909 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013997599999999999 2024-09-12T18:37:46.909 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:46.909 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:46.909 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:46.909 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.909 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.909 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:256902 5.e 5:7fd3143d:::benchmark_data_smithi073_23739_object124625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T18:37:46.910 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:46.893685+0000", 2024-09-12T18:37:46.910 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.000642262, 2024-09-12T18:37:46.910 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00074901399999999999, 2024-09-12T18:37:46.910 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:46.910 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:46.910 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:46.910 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:46.910 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:46.910 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:46.910 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 256902 2024-09-12T18:37:46.910 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.910 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:46.911 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.911 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:46.911 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.893685+0000", 2024-09-12T18:37:46.911 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:46.911 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.911 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.911 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:46.911 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.893685+0000", 2024-09-12T18:37:46.911 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:46.911 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.911 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.911 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:46.912 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.893686+0000", 2024-09-12T18:37:46.912 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7499999999999999e-07 2024-09-12T18:37:46.912 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.912 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.912 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:46.912 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.893689+0000", 2024-09-12T18:37:46.912 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1429999999999998e-06 2024-09-12T18:37:46.912 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.912 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.912 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:46.912 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.893697+0000", 2024-09-12T18:37:46.912 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2339999999999997e-06 2024-09-12T18:37:46.912 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.913 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.913 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.913 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.893701+0000", 2024-09-12T18:37:46.913 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1869999999999999e-06 2024-09-12T18:37:46.913 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.913 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.913 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:46.913 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.893742+0000", 2024-09-12T18:37:46.913 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1681999999999998e-05 2024-09-12T18:37:46.913 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.913 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.913 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:46.913 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.893853+0000", 2024-09-12T18:37:46.913 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011095999999999999 2024-09-12T18:37:46.914 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.914 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.914 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:46.914 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.893950+0000", 2024-09-12T18:37:46.914 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6811000000000005e-05 2024-09-12T18:37:46.914 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:46.914 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:46.914 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:46.914 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.914 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.914 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop_reply(client.4480.0:256889 5.e e78/21)", 2024-09-12T18:37:46.914 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:46.893950+0000", 2024-09-12T18:37:46.914 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.00037754500000000002, 2024-09-12T18:37:46.915 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00054135200000000004, 2024-09-12T18:37:46.915 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:46.915 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:46.915 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:46.915 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:46.915 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.915 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:46.915 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.893950+0000", 2024-09-12T18:37:46.915 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:46.915 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.915 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.915 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:46.915 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.893950+0000", 2024-09-12T18:37:46.915 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:46.916 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.916 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.916 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:46.916 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.893950+0000", 2024-09-12T18:37:46.916 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1799999999999999e-07 2024-09-12T18:37:46.916 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.916 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.916 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:46.916 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.893952+0000", 2024-09-12T18:37:46.916 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.528e-06 2024-09-12T18:37:46.916 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.916 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.917 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:46.917 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.893956+0000", 2024-09-12T18:37:46.917 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8360000000000002e-06 2024-09-12T18:37:46.917 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.917 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.917 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.917 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.893960+0000", 2024-09-12T18:37:46.917 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6530000000000002e-06 2024-09-12T18:37:46.917 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:46.917 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:46.917 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:46.917 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.917 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.918 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:256907 5.0 5.2dc29210 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T18:37:46.918 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:46.894427+0000", 2024-09-12T18:37:46.918 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4294967295.9999008, 2024-09-12T18:37:46.918 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000110201, 2024-09-12T18:37:46.918 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:46.918 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:46.918 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:46.918 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:46.918 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:46.918 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:46.918 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 256907 2024-09-12T18:37:46.918 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.918 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:46.918 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.919 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:46.919 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.894427+0000", 2024-09-12T18:37:46.919 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:46.919 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.919 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.919 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:46.919 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.894427+0000", 2024-09-12T18:37:46.919 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:46.919 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.919 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.919 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:46.919 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.894428+0000", 2024-09-12T18:37:46.919 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0160000000000001e-06 2024-09-12T18:37:46.920 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.920 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.920 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:46.920 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.894431+0000", 2024-09-12T18:37:46.920 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.332e-06 2024-09-12T18:37:46.920 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.920 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.920 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:46.920 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.894442+0000", 2024-09-12T18:37:46.920 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1058e-05 2024-09-12T18:37:46.920 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.920 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.920 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.921 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.894449+0000", 2024-09-12T18:37:46.921 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8279999999999997e-06 2024-09-12T18:37:46.921 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:46.921 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:46.921 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:46.921 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.921 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.921 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:256908 5.b 5:d121951b:::benchmark_data_smithi073_23739_object124631:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T18:37:46.921 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:46.894464+0000", 2024-09-12T18:37:46.921 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4294967295.9998641, 2024-09-12T18:37:46.921 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013139599999999999, 2024-09-12T18:37:46.922 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:46.922 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:46.922 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-09-12T18:37:46.922 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:46.922 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:46.922 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:46.922 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 256908 2024-09-12T18:37:46.922 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.922 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:46.922 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.922 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:46.922 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.894464+0000", 2024-09-12T18:37:46.922 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:46.923 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.923 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.923 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:46.923 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.894464+0000", 2024-09-12T18:37:46.923 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:46.923 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.923 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.923 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:46.923 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.894464+0000", 2024-09-12T18:37:46.923 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9500000000000003e-07 2024-09-12T18:37:46.923 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.923 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.923 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:46.924 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.894466+0000", 2024-09-12T18:37:46.924 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.266e-06 2024-09-12T18:37:46.924 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.924 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.924 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:46.924 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.894473+0000", 2024-09-12T18:37:46.924 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0160000000000003e-06 2024-09-12T18:37:46.924 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.924 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.924 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.924 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.894478+0000", 2024-09-12T18:37:46.924 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7779999999999998e-06 2024-09-12T18:37:46.925 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.925 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.925 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:46.925 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.894512+0000", 2024-09-12T18:37:46.925 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3633999999999997e-05 2024-09-12T18:37:46.925 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:46.925 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:46.925 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:46.925 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.925 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.925 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:256906 5.5 e78/73)", 2024-09-12T18:37:46.925 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:46.894572+0000", 2024-09-12T18:37:46.925 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4294967295.9997554, 2024-09-12T18:37:46.926 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.6582999999999995e-05, 2024-09-12T18:37:46.926 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:46.926 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:46.926 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "reached pg", 2024-09-12T18:37:46.926 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:46.926 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.926 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:46.926 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.894572+0000", 2024-09-12T18:37:46.926 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:46.926 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.926 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.926 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:46.926 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.894572+0000", 2024-09-12T18:37:46.926 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:46.927 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.927 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.927 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:46.927 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.894573+0000", 2024-09-12T18:37:46.927 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1999999999999999e-07 2024-09-12T18:37:46.927 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.927 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.927 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:46.927 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.894578+0000", 2024-09-12T18:37:46.927 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6809999999999997e-06 2024-09-12T18:37:46.927 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.927 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.927 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:46.927 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.894585+0000", 2024-09-12T18:37:46.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0099999999999998e-06 2024-09-12T18:37:46.928 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.928 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.928 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.894591+0000", 2024-09-12T18:37:46.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2369999999999997e-06 2024-09-12T18:37:46.928 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.928 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:46.928 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.894634+0000", 2024-09-12T18:37:46.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3259e-05 2024-09-12T18:37:46.928 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:46.928 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:46.929 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:46.929 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.929 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.929 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:256903 5.9 e78/21)", 2024-09-12T18:37:46.929 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:46.894663+0000", 2024-09-12T18:37:46.929 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 4294967295.9996653, 2024-09-12T18:37:46.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3773999999999999e-05, 2024-09-12T18:37:46.929 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:46.929 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:46.929 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "queued for pg", 2024-09-12T18:37:46.929 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:46.929 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.929 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:46.929 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.894663+0000", 2024-09-12T18:37:46.930 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:46.930 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.930 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:46.930 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.894663+0000", 2024-09-12T18:37:46.930 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:46.930 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.930 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:46.930 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.894663+0000", 2024-09-12T18:37:46.930 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.3900000000000005e-07 2024-09-12T18:37:46.930 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.931 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:46.931 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.894667+0000", 2024-09-12T18:37:46.931 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0090000000000001e-06 2024-09-12T18:37:46.931 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.931 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.931 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:46.931 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.894675+0000", 2024-09-12T18:37:46.931 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0180000000000001e-06 2024-09-12T18:37:46.931 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.931 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.931 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.931 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.894681+0000", 2024-09-12T18:37:46.931 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6550000000000001e-06 2024-09-12T18:37:46.931 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:46.932 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:46.932 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:46.932 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.932 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.932 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:256889 5.e 5:7594dca2:::benchmark_data_smithi073_23739_object124612:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T18:37:46.932 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:46.887172+0000", 2024-09-12T18:37:46.932 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 0.0071555350000000002, 2024-09-12T18:37:46.932 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0075772590000000003, 2024-09-12T18:37:46.932 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:46.932 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:46.932 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:46.932 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:46.932 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:46.933 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:46.933 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 256889 2024-09-12T18:37:46.933 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.933 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:46.933 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.933 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:46.933 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.887172+0000", 2024-09-12T18:37:46.933 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:46.933 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.933 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.933 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:46.933 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.887172+0000", 2024-09-12T18:37:46.933 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:46.934 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.934 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.934 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:46.934 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.887174+0000", 2024-09-12T18:37:46.934 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.3260000000000001e-06 2024-09-12T18:37:46.934 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.934 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.934 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:46.934 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.887178+0000", 2024-09-12T18:37:46.934 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7079999999999996e-06 2024-09-12T18:37:46.934 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.934 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.934 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:46.934 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.887190+0000", 2024-09-12T18:37:46.935 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2232000000000001e-05 2024-09-12T18:37:46.935 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.935 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:46.935 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.887198+0000", 2024-09-12T18:37:46.935 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0639999999999996e-06 2024-09-12T18:37:46.935 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.935 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:46.935 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.887252+0000", 2024-09-12T18:37:46.935 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4892999999999998e-05 2024-09-12T18:37:46.935 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.936 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:46.936 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.887356+0000", 2024-09-12T18:37:46.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010399 2024-09-12T18:37:46.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.936 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.936 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:46.936 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.887456+0000", 2024-09-12T18:37:46.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.9316999999999998e-05 2024-09-12T18:37:46.936 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:46.936 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:46.936 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:46.936 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:46.890938+0000", 2024-09-12T18:37:46.936 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0034820060000000002 2024-09-12T18:37:46.937 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:46.937 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:46.937 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:46.937 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:46.937 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-09-12T18:37:46.937 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 9 2024-09-12T18:37:46.937 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:46.938 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:37:46.982 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:46.979+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:47.043 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:47.039+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:47.097 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:47.097 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-09-12T18:37:47.097 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-09-12T18:37:47.097 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-09-12T18:37:47.097 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:47.117 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:37:47.144 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:47.141+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:47.244 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:47.237+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:47.314 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:47.314 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-09-12T18:37:47.314 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-09-12T18:37:47.314 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:37:47.314 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.315 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121096 5.8 5:13503891:::benchmark_data_smithi073_23739_object121095:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:47.315 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:37:47.315 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 67.131328902999996, 2024-09-12T18:37:47.315 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064025391000000001, 2024-09-12T18:37:47.315 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:47.315 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:47.315 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:47.315 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:47.315 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:47.315 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:47.315 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121096 2024-09-12T18:37:47.315 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.315 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:47.315 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.316 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:47.316 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:37:47.316 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:47.316 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.316 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.316 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:47.316 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:37:47.316 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:47.316 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.316 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.316 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:47.316 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178579+0000", 2024-09-12T18:37:47.316 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7369999999999998e-06 2024-09-12T18:37:47.317 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.317 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.317 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:47.317 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178846+0000", 2024-09-12T18:37:47.317 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026752699999999999 2024-09-12T18:37:47.317 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.317 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.317 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:47.317 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178877+0000", 2024-09-12T18:37:47.317 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1081999999999998e-05 2024-09-12T18:37:47.317 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.317 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.317 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:47.318 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178896+0000", 2024-09-12T18:37:47.318 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8522e-05 2024-09-12T18:37:47.318 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.318 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.318 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:47.318 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.192591+0000", 2024-09-12T18:37:47.318 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013695067 2024-09-12T18:37:47.318 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.318 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.318 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:47.318 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.192944+0000", 2024-09-12T18:37:47.318 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00035273699999999999 2024-09-12T18:37:47.318 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.319 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.319 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:47.319 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.193732+0000", 2024-09-12T18:37:47.319 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078849599999999997 2024-09-12T18:37:47.319 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.319 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.319 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:47.319 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.213583+0000", 2024-09-12T18:37:47.319 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.019851164000000001 2024-09-12T18:37:47.319 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.319 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.319 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:47.319 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242386+0000", 2024-09-12T18:37:47.320 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028802924000000001 2024-09-12T18:37:47.320 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.320 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.320 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:47.320 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242501+0000", 2024-09-12T18:37:47.320 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000114932 2024-09-12T18:37:47.320 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.320 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.320 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:47.320 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242602+0000", 2024-09-12T18:37:47.320 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000100203 2024-09-12T18:37:47.320 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:47.320 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:47.321 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:47.321 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.321 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.321 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121097 5.8 5:1b31a99e:::benchmark_data_smithi073_23739_object121096:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:47.321 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:37:47.321 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 67.115600612999998, 2024-09-12T18:37:47.321 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048475917, 2024-09-12T18:37:47.321 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:47.321 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:47.321 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:47.322 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:47.322 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:47.322 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:47.322 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121097 2024-09-12T18:37:47.322 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.322 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:47.322 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.322 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:47.322 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:37:47.322 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:47.322 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.322 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.323 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:47.323 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:37:47.323 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:47.323 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.323 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.323 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:47.323 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194308+0000", 2024-09-12T18:37:47.323 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2789999999999999e-06 2024-09-12T18:37:47.323 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.323 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.323 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:47.323 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194396+0000", 2024-09-12T18:37:47.324 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8324000000000003e-05 2024-09-12T18:37:47.324 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.324 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.324 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:47.324 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194424+0000", 2024-09-12T18:37:47.324 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7565000000000001e-05 2024-09-12T18:37:47.324 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.324 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.324 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:47.324 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194444+0000", 2024-09-12T18:37:47.324 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0363000000000001e-05 2024-09-12T18:37:47.324 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.325 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.325 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:47.325 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.206888+0000", 2024-09-12T18:37:47.325 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012443997 2024-09-12T18:37:47.325 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.325 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.325 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:47.325 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.207138+0000", 2024-09-12T18:37:47.325 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025035900000000002 2024-09-12T18:37:47.325 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.325 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.325 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:47.325 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.207365+0000", 2024-09-12T18:37:47.326 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000226407 2024-09-12T18:37:47.326 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.326 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.326 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:47.326 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.215059+0000", 2024-09-12T18:37:47.326 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076946860000000001 2024-09-12T18:37:47.326 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.326 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.326 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:47.326 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242619+0000", 2024-09-12T18:37:47.326 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.027559975 2024-09-12T18:37:47.326 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.326 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.327 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:47.327 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242706+0000", 2024-09-12T18:37:47.327 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6384999999999994e-05 2024-09-12T18:37:47.327 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.327 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.327 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:47.327 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242780+0000", 2024-09-12T18:37:47.327 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4577000000000001e-05 2024-09-12T18:37:47.327 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:47.327 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:47.327 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:47.327 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.327 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.327 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121106 5.d 5:b4a9a221:::benchmark_data_smithi073_23739_object121105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:47.328 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:37:47.328 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 67.072725676999994, 2024-09-12T18:37:47.328 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.034882274999999997, 2024-09-12T18:37:47.328 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:47.328 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:47.328 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:47.328 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:47.329 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:47.329 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:47.329 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121106 2024-09-12T18:37:47.329 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.329 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:47.329 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.330 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:47.330 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:37:47.330 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:47.330 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.330 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.330 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:47.330 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:37:47.330 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:47.330 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.330 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.330 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:47.330 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237182+0000", 2024-09-12T18:37:47.331 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6019999999999998e-06 2024-09-12T18:37:47.331 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.331 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.331 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:47.331 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237257+0000", 2024-09-12T18:37:47.331 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5420999999999995e-05 2024-09-12T18:37:47.331 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.331 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.331 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:47.331 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237305+0000", 2024-09-12T18:37:47.331 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7207999999999999e-05 2024-09-12T18:37:47.331 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.331 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.331 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:47.332 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237325+0000", 2024-09-12T18:37:47.332 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0001e-05 2024-09-12T18:37:47.332 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.332 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.332 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:47.332 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237505+0000", 2024-09-12T18:37:47.332 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000180798 2024-09-12T18:37:47.332 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.332 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.332 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:47.332 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237764+0000", 2024-09-12T18:37:47.332 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025862299999999998 2024-09-12T18:37:47.332 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.333 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.333 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:47.333 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.238264+0000", 2024-09-12T18:37:47.333 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00050016100000000005 2024-09-12T18:37:47.333 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.333 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.333 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:47.333 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256525+0000", 2024-09-12T18:37:47.333 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018260508000000002 2024-09-12T18:37:47.333 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.333 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.333 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:47.334 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.271903+0000", 2024-09-12T18:37:47.334 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015378739000000001 2024-09-12T18:37:47.334 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.334 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.334 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:47.334 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.271999+0000", 2024-09-12T18:37:47.335 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5989000000000005e-05 2024-09-12T18:37:47.335 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.335 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.335 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:47.336 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272062+0000", 2024-09-12T18:37:47.336 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2224999999999995e-05 2024-09-12T18:37:47.336 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:47.336 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:47.336 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:47.337 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.337 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.337 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:167368 5.4 5:29a1ec58:::benchmark_data_smithi073_23739_object35091:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:47.337 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:03.168773+0000", 2024-09-12T18:37:47.337 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 44.141131809999997, 2024-09-12T18:37:47.337 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.066578597000000003, 2024-09-12T18:37:47.337 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:47.337 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:47.337 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:47.337 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:47.337 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:47.338 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:47.338 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 167368 2024-09-12T18:37:47.338 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.338 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:47.338 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.338 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:47.338 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168773+0000", 2024-09-12T18:37:47.338 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:47.338 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.338 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.338 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:47.338 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168773+0000", 2024-09-12T18:37:47.338 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:47.339 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.339 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.339 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:47.339 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168774+0000", 2024-09-12T18:37:47.339 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.023e-06 2024-09-12T18:37:47.339 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.339 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.339 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:47.339 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168779+0000", 2024-09-12T18:37:47.339 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5800000000000002e-06 2024-09-12T18:37:47.339 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.340 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.340 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:47.340 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168789+0000", 2024-09-12T18:37:47.340 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0346999999999999e-05 2024-09-12T18:37:47.340 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.340 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.340 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:47.340 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168808+0000", 2024-09-12T18:37:47.340 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8423e-05 2024-09-12T18:37:47.340 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.340 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.340 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:47.341 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168864+0000", 2024-09-12T18:37:47.341 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-09-12T18:37:47.341 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.341 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.341 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:47.341 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168947+0000", 2024-09-12T18:37:47.341 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3274000000000003e-05 2024-09-12T18:37:47.341 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.341 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.341 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:47.341 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.169014+0000", 2024-09-12T18:37:47.341 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6284000000000004e-05 2024-09-12T18:37:47.341 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.342 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.342 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:47.342 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.170653+0000", 2024-09-12T18:37:47.342 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016389779999999999 2024-09-12T18:37:47.342 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.342 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.342 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:47.342 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.235279+0000", 2024-09-12T18:37:47.342 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064626464999999994 2024-09-12T18:37:47.342 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.342 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.342 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:47.342 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.235320+0000", 2024-09-12T18:37:47.343 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0377000000000003e-05 2024-09-12T18:37:47.343 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.343 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.343 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:47.343 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.235352+0000", 2024-09-12T18:37:47.343 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2322e-05 2024-09-12T18:37:47.343 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:47.343 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:47.343 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:47.343 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.343 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.343 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:167371 5.4 5:24fea27c:::benchmark_data_smithi073_23739_object35094:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:47.343 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:03.171234+0000", 2024-09-12T18:37:47.344 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 44.138670785000002, 2024-09-12T18:37:47.344 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.066048171000000003, 2024-09-12T18:37:47.344 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:47.344 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:47.344 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:47.344 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:47.344 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:47.344 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:47.344 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 167371 2024-09-12T18:37:47.344 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.344 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:47.344 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.344 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:47.345 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171234+0000", 2024-09-12T18:37:47.345 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:47.345 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.345 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.345 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:47.345 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171234+0000", 2024-09-12T18:37:47.345 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:47.345 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.345 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.345 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:47.345 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171235+0000", 2024-09-12T18:37:47.345 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8599999999999997e-07 2024-09-12T18:37:47.345 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.346 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.346 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:47.346 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171238+0000", 2024-09-12T18:37:47.346 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9739999999999998e-06 2024-09-12T18:37:47.346 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.346 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.346 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:47.346 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171245+0000", 2024-09-12T18:37:47.346 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6000000000000003e-06 2024-09-12T18:37:47.346 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.346 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.346 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:47.346 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171249+0000", 2024-09-12T18:37:47.347 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9960000000000004e-06 2024-09-12T18:37:47.347 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.347 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.347 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:47.347 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171288+0000", 2024-09-12T18:37:47.347 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9119999999999998e-05 2024-09-12T18:37:47.347 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.347 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.347 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:47.347 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171359+0000", 2024-09-12T18:37:47.347 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0951000000000006e-05 2024-09-12T18:37:47.347 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.347 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.348 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:47.348 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171425+0000", 2024-09-12T18:37:47.348 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.58e-05 2024-09-12T18:37:47.348 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.348 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.348 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:47.348 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.173093+0000", 2024-09-12T18:37:47.348 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016683939999999999 2024-09-12T18:37:47.348 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.348 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.348 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:47.348 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.237202+0000", 2024-09-12T18:37:47.349 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064109437000000005 2024-09-12T18:37:47.349 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.349 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.349 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:47.349 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.237249+0000", 2024-09-12T18:37:47.349 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6751e-05 2024-09-12T18:37:47.349 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.349 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.349 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:47.349 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.237282+0000", 2024-09-12T18:37:47.349 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3262000000000001e-05 2024-09-12T18:37:47.349 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:47.349 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:47.350 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:47.350 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.350 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.350 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:201498 5.a e67/21 5:5815d848:::benchmark_data_smithi073_23739_object69221:head v 67'12793, mlcod=67'12791)", 2024-09-12T18:37:47.350 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.430872+0000", 2024-09-12T18:37:47.350 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 26.879032807000002, 2024-09-12T18:37:47.350 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.038775280000000002, 2024-09-12T18:37:47.350 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:47.350 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:47.350 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:47.350 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:47.350 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.350 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:47.351 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430872+0000", 2024-09-12T18:37:47.351 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:47.351 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.351 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.351 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:47.351 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430872+0000", 2024-09-12T18:37:47.351 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:47.351 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.351 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.351 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:47.351 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430873+0000", 2024-09-12T18:37:47.351 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6600000000000003e-07 2024-09-12T18:37:47.352 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.352 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.352 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:47.352 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430875+0000", 2024-09-12T18:37:47.352 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5399999999999998e-06 2024-09-12T18:37:47.352 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.352 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.352 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:47.352 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430879+0000", 2024-09-12T18:37:47.352 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7239999999999998e-06 2024-09-12T18:37:47.352 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.352 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.352 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:47.353 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430882+0000", 2024-09-12T18:37:47.353 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8679999999999999e-06 2024-09-12T18:37:47.353 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.353 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.353 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:47.353 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430909+0000", 2024-09-12T18:37:47.353 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7832999999999999e-05 2024-09-12T18:37:47.353 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.353 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.353 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:47.353 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430922+0000", 2024-09-12T18:37:47.354 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2164000000000001e-05 2024-09-12T18:37:47.354 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.354 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.354 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:47.354 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469578+0000", 2024-09-12T18:37:47.354 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.038656469999999998 2024-09-12T18:37:47.354 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.354 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.354 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:47.354 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469648+0000", 2024-09-12T18:37:47.354 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9414999999999999e-05 2024-09-12T18:37:47.354 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:47.354 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:47.355 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:47.355 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.355 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.355 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201513 5.e 5:7be2f597:::benchmark_data_smithi073_23739_object69236:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:47.355 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.435121+0000", 2024-09-12T18:37:47.355 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 26.874784053999999, 2024-09-12T18:37:47.355 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.034945021999999999, 2024-09-12T18:37:47.355 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:47.355 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:47.355 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:47.355 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:47.355 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:47.355 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:47.356 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201513 2024-09-12T18:37:47.356 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.356 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:47.356 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.356 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:47.356 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.435121+0000", 2024-09-12T18:37:47.356 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:47.356 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.356 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.356 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:47.356 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.435121+0000", 2024-09-12T18:37:47.356 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:47.356 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.357 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.357 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:47.357 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.435122+0000", 2024-09-12T18:37:47.357 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2440000000000001e-06 2024-09-12T18:37:47.357 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.357 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.357 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:47.357 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.435126+0000", 2024-09-12T18:37:47.357 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1559999999999997e-06 2024-09-12T18:37:47.357 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.357 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.358 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:47.358 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445086+0000", 2024-09-12T18:37:47.358 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0099592389999999999 2024-09-12T18:37:47.358 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.358 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.358 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:47.358 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445095+0000", 2024-09-12T18:37:47.358 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2620000000000004e-06 2024-09-12T18:37:47.358 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.358 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.358 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:47.358 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445165+0000", 2024-09-12T18:37:47.358 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0257000000000002e-05 2024-09-12T18:37:47.359 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.359 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.359 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:47.359 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445311+0000", 2024-09-12T18:37:47.359 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014603899999999999 2024-09-12T18:37:47.359 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.359 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.359 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:47.359 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445445+0000", 2024-09-12T18:37:47.359 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000133654 2024-09-12T18:37:47.359 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.359 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.359 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:47.360 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469853+0000", 2024-09-12T18:37:47.360 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024407893999999999 2024-09-12T18:37:47.360 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.360 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.360 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:47.360 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469873+0000", 2024-09-12T18:37:47.360 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0622e-05 2024-09-12T18:37:47.360 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.360 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.360 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:47.360 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469949+0000", 2024-09-12T18:37:47.360 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5918000000000001e-05 2024-09-12T18:37:47.360 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.361 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.361 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:47.361 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470066+0000", 2024-09-12T18:37:47.361 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000116737 2024-09-12T18:37:47.361 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:47.361 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:47.361 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:47.361 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.361 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.361 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201521 5.d 5:b911ab6f:::benchmark_data_smithi073_23739_object69244:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:47.362 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445173+0000", 2024-09-12T18:37:47.362 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 26.864731611, 2024-09-12T18:37:47.362 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.031483274999999998, 2024-09-12T18:37:47.362 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:47.362 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:47.362 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:47.362 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:47.362 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:47.362 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:47.362 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201521 2024-09-12T18:37:47.362 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.362 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:47.362 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.363 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:47.363 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445173+0000", 2024-09-12T18:37:47.363 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:47.363 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.363 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.363 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:47.363 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445173+0000", 2024-09-12T18:37:47.363 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:47.363 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.363 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.363 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:47.363 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445174+0000", 2024-09-12T18:37:47.363 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4299999999999998e-07 2024-09-12T18:37:47.364 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.364 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.364 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:47.364 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445176+0000", 2024-09-12T18:37:47.364 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.469e-06 2024-09-12T18:37:47.364 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.364 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.364 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:47.364 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445183+0000", 2024-09-12T18:37:47.364 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8719999999999996e-06 2024-09-12T18:37:47.364 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.364 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.364 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:47.365 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445188+0000", 2024-09-12T18:37:47.365 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7079999999999996e-06 2024-09-12T18:37:47.365 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.365 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.365 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:47.365 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445314+0000", 2024-09-12T18:37:47.365 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012627800000000001 2024-09-12T18:37:47.365 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.365 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.365 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:47.365 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445436+0000", 2024-09-12T18:37:47.365 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000122007 2024-09-12T18:37:47.365 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.366 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.366 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:47.366 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445541+0000", 2024-09-12T18:37:47.366 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000105068 2024-09-12T18:37:47.366 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.366 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.366 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:47.366 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470655+0000", 2024-09-12T18:37:47.366 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025114035 2024-09-12T18:37:47.366 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.366 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.366 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:47.366 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476570+0000", 2024-09-12T18:37:47.366 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0059143269999999996 2024-09-12T18:37:47.367 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.367 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.367 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:47.367 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476624+0000", 2024-09-12T18:37:47.367 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4261000000000001e-05 2024-09-12T18:37:47.367 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.367 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.367 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:47.367 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476657+0000", 2024-09-12T18:37:47.367 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2806999999999999e-05 2024-09-12T18:37:47.367 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:47.367 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:47.367 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:47.368 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.368 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.368 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201524 5.d 5:b330b18b:::benchmark_data_smithi073_23739_object69247:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:47.368 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445202+0000", 2024-09-12T18:37:47.368 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 26.864703350999999, 2024-09-12T18:37:47.368 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.034036482, 2024-09-12T18:37:47.368 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:47.368 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:47.368 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:47.368 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:47.368 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:47.368 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:47.368 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201524 2024-09-12T18:37:47.369 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.369 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:47.369 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.369 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:47.369 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445202+0000", 2024-09-12T18:37:47.369 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:47.369 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.369 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.369 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:47.369 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445202+0000", 2024-09-12T18:37:47.369 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:47.369 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.370 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.370 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:47.370 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445202+0000", 2024-09-12T18:37:47.370 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2e-07 2024-09-12T18:37:47.370 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.370 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.370 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:47.370 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445204+0000", 2024-09-12T18:37:47.370 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0490000000000002e-06 2024-09-12T18:37:47.370 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.370 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.370 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:47.371 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445210+0000", 2024-09-12T18:37:47.371 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.959e-06 2024-09-12T18:37:47.371 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.371 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.371 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:47.371 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445215+0000", 2024-09-12T18:37:47.371 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.668e-06 2024-09-12T18:37:47.371 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.371 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.371 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:47.371 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470703+0000", 2024-09-12T18:37:47.371 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025488182000000002 2024-09-12T18:37:47.372 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.372 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.372 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:47.372 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470911+0000", 2024-09-12T18:37:47.372 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020755400000000001 2024-09-12T18:37:47.372 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.372 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.372 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:47.372 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.471309+0000", 2024-09-12T18:37:47.372 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00039868199999999998 2024-09-12T18:37:47.372 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.372 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.372 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:47.373 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476724+0000", 2024-09-12T18:37:47.373 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054150589999999998 2024-09-12T18:37:47.373 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.373 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.373 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:47.373 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.479050+0000", 2024-09-12T18:37:47.373 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0023259309999999998 2024-09-12T18:37:47.373 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.373 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.373 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:47.373 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.479164+0000", 2024-09-12T18:37:47.373 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000114127 2024-09-12T18:37:47.374 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.374 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.374 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:47.374 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.479238+0000", 2024-09-12T18:37:47.374 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3751000000000006e-05 2024-09-12T18:37:47.374 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:47.374 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:47.374 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:47.374 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.374 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.375 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_backfill(progress 5.5 e 67/67 lb 5:a30f9be2:::benchmark_data_smithi073_23739_object118666:head)", 2024-09-12T18:37:47.375 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445433+0000", 2024-09-12T18:37:47.375 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 26.864472464999999, 2024-09-12T18:37:47.375 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.029511351000000002, 2024-09-12T18:37:47.375 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:47.375 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:47.375 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:37:47.375 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:47.375 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.375 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:47.375 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445433+0000", 2024-09-12T18:37:47.375 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:47.376 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.376 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.376 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:47.376 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445433+0000", 2024-09-12T18:37:47.376 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:47.376 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.376 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.376 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:47.376 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445433+0000", 2024-09-12T18:37:47.376 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0699999999999998e-07 2024-09-12T18:37:47.376 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.376 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.376 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:47.377 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445440+0000", 2024-09-12T18:37:47.377 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6630000000000004e-06 2024-09-12T18:37:47.377 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.377 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.377 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:47.377 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445447+0000", 2024-09-12T18:37:47.377 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5159999999999997e-06 2024-09-12T18:37:47.377 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.377 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.377 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:47.377 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445454+0000", 2024-09-12T18:37:47.377 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.267e-06 2024-09-12T18:37:47.377 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.378 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.378 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:47.378 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.474780+0000", 2024-09-12T18:37:47.378 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.029325496999999999 2024-09-12T18:37:47.378 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.378 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.378 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:47.378 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.474802+0000", 2024-09-12T18:37:47.378 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2348999999999999e-05 2024-09-12T18:37:47.378 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.378 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.378 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:47.378 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.474944+0000", 2024-09-12T18:37:47.379 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014165200000000001 2024-09-12T18:37:47.379 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:47.379 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:47.379 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:47.379 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.379 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.379 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:201515 5.5 e67/49 5:a25bd8bb:::benchmark_data_smithi073_23739_object69238:head v 67'12752, mlcod=67'12750)", 2024-09-12T18:37:47.379 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445471+0000", 2024-09-12T18:37:47.379 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 26.864434549999999, 2024-09-12T18:37:47.380 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.031081396000000001, 2024-09-12T18:37:47.380 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:47.380 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:47.380 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:47.380 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:47.380 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.380 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:47.380 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445471+0000", 2024-09-12T18:37:47.380 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:47.380 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.380 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.380 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:47.380 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445471+0000", 2024-09-12T18:37:47.381 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:47.381 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.381 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.381 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:47.381 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445471+0000", 2024-09-12T18:37:47.381 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5400000000000002e-07 2024-09-12T18:37:47.381 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.381 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.381 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:47.381 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445475+0000", 2024-09-12T18:37:47.381 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2379999999999999e-06 2024-09-12T18:37:47.381 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.381 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.381 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:47.382 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445481+0000", 2024-09-12T18:37:47.382 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0229999999999998e-06 2024-09-12T18:37:47.382 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.382 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.382 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:47.382 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445486+0000", 2024-09-12T18:37:47.382 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5040000000000004e-06 2024-09-12T18:37:47.382 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.382 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.382 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:47.382 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445970+0000", 2024-09-12T18:37:47.382 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048416699999999997 2024-09-12T18:37:47.382 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.383 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.383 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:47.383 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445991+0000", 2024-09-12T18:37:47.383 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1067999999999999e-05 2024-09-12T18:37:47.383 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.383 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.383 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:47.383 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476511+0000", 2024-09-12T18:37:47.383 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.030520629000000001 2024-09-12T18:37:47.383 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.383 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.383 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:47.383 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476552+0000", 2024-09-12T18:37:47.383 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0413000000000001e-05 2024-09-12T18:37:47.384 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:47.384 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:47.384 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:47.384 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.384 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.384 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:201526 5.5 e67/49 5:a3549698:::benchmark_data_smithi073_23739_object69249:head v 67'12753, mlcod=67'12750)", 2024-09-12T18:37:47.384 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445957+0000", 2024-09-12T18:37:47.384 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 26.863947618000001, 2024-09-12T18:37:47.384 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.030732494999999999, 2024-09-12T18:37:47.384 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:47.384 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:47.384 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:47.384 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:47.385 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.385 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:47.385 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445957+0000", 2024-09-12T18:37:47.385 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:47.385 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.385 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.385 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:47.385 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445957+0000", 2024-09-12T18:37:47.385 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:47.385 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.385 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.385 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:47.386 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445958+0000", 2024-09-12T18:37:47.386 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7800000000000001e-07 2024-09-12T18:37:47.386 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.386 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.386 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:47.386 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445963+0000", 2024-09-12T18:37:47.386 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5419999999999999e-06 2024-09-12T18:37:47.386 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.386 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.386 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:47.386 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445972+0000", 2024-09-12T18:37:47.386 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4169999999999998e-06 2024-09-12T18:37:47.386 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.386 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.387 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:47.387 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445979+0000", 2024-09-12T18:37:47.387 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2949999999999996e-06 2024-09-12T18:37:47.387 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.387 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.387 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:47.387 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.447710+0000", 2024-09-12T18:37:47.387 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001731067 2024-09-12T18:37:47.387 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.387 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.387 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:47.387 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.447734+0000", 2024-09-12T18:37:47.387 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4094e-05 2024-09-12T18:37:47.388 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.388 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.388 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:47.388 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476659+0000", 2024-09-12T18:37:47.388 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028924268999999999 2024-09-12T18:37:47.388 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.388 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.388 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:47.388 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476690+0000", 2024-09-12T18:37:47.388 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1232999999999997e-05 2024-09-12T18:37:47.388 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:47.389 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:47.389 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:47.389 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.389 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.389 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201583 5.d 5:b91eedec:::benchmark_data_smithi073_23739_object69306:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:47.389 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.494097+0000", 2024-09-12T18:37:47.389 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 26.815807756000002, 2024-09-12T18:37:47.389 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049293508, 2024-09-12T18:37:47.389 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:47.389 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:47.389 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:47.389 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:47.389 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:47.389 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:47.390 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201583 2024-09-12T18:37:47.390 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.390 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:47.390 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.390 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:47.390 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494097+0000", 2024-09-12T18:37:47.390 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:47.390 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.390 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.390 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:47.390 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494097+0000", 2024-09-12T18:37:47.390 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:47.390 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.390 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.391 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:47.391 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494098+0000", 2024-09-12T18:37:47.391 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0699999999999996e-07 2024-09-12T18:37:47.391 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.391 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.391 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:47.391 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494102+0000", 2024-09-12T18:37:47.391 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.664e-06 2024-09-12T18:37:47.391 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.391 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.391 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:47.391 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494108+0000", 2024-09-12T18:37:47.391 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.3149999999999997e-06 2024-09-12T18:37:47.392 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.392 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.392 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:47.392 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494112+0000", 2024-09-12T18:37:47.392 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0659999999999997e-06 2024-09-12T18:37:47.392 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.392 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.392 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:47.392 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494200+0000", 2024-09-12T18:37:47.392 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7770999999999997e-05 2024-09-12T18:37:47.392 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.392 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.392 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:47.393 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494315+0000", 2024-09-12T18:37:47.393 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000115048 2024-09-12T18:37:47.393 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.393 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.393 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:47.393 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494414+0000", 2024-09-12T18:37:47.393 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8820999999999995e-05 2024-09-12T18:37:47.393 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.393 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.393 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:47.393 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.497199+0000", 2024-09-12T18:37:47.394 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0027854279999999999 2024-09-12T18:37:47.394 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.394 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.394 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:47.394 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543193+0000", 2024-09-12T18:37:47.394 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.045993500999999999 2024-09-12T18:37:47.394 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.394 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.394 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:47.394 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543315+0000", 2024-09-12T18:37:47.394 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012246800000000001 2024-09-12T18:37:47.394 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.394 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.395 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:47.395 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543391+0000", 2024-09-12T18:37:47.395 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5618999999999995e-05 2024-09-12T18:37:47.395 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:47.395 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:47.395 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:47.395 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.395 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.395 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201585 5.d 5:bb6c167f:::benchmark_data_smithi073_23739_object69308:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:47.395 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.495295+0000", 2024-09-12T18:37:47.395 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 26.814609589, 2024-09-12T18:37:47.395 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048312129000000002, 2024-09-12T18:37:47.395 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:47.395 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:47.396 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:47.396 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:47.396 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:47.396 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:47.396 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201585 2024-09-12T18:37:47.396 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.396 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:47.396 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.396 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:47.396 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495295+0000", 2024-09-12T18:37:47.397 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:47.397 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.397 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.397 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:47.397 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495295+0000", 2024-09-12T18:37:47.397 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:47.397 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.397 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.397 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:47.398 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495296+0000", 2024-09-12T18:37:47.398 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0330000000000001e-06 2024-09-12T18:37:47.398 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.398 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.398 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:47.398 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495301+0000", 2024-09-12T18:37:47.398 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7049999999999998e-06 2024-09-12T18:37:47.398 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.398 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.398 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:47.398 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495312+0000", 2024-09-12T18:37:47.398 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0791000000000001e-05 2024-09-12T18:37:47.398 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.398 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.399 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:47.399 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495319+0000", 2024-09-12T18:37:47.399 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8240000000000002e-06 2024-09-12T18:37:47.399 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.399 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.399 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:47.399 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.496088+0000", 2024-09-12T18:37:47.399 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00076901200000000002 2024-09-12T18:37:47.399 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.399 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.399 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:47.399 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.496166+0000", 2024-09-12T18:37:47.399 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.8491000000000005e-05 2024-09-12T18:37:47.400 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.400 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.400 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:47.400 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.496232+0000", 2024-09-12T18:37:47.400 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5400000000000004e-05 2024-09-12T18:37:47.400 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.400 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.400 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:47.400 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.497467+0000", 2024-09-12T18:37:47.400 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001235049 2024-09-12T18:37:47.400 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.400 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.400 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:47.401 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543463+0000", 2024-09-12T18:37:47.401 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.045995743999999998 2024-09-12T18:37:47.401 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.401 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.401 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:47.401 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543546+0000", 2024-09-12T18:37:47.401 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3434000000000001e-05 2024-09-12T18:37:47.401 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.401 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.401 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:47.401 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543608+0000", 2024-09-12T18:37:47.401 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1645999999999999e-05 2024-09-12T18:37:47.402 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:47.402 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:47.402 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:47.402 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.402 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.402 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:238484 5.8 5:135aca90:::benchmark_data_smithi073_23739_object106207:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:47.402 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:38.618805+0000", 2024-09-12T18:37:47.402 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 8.6911001349999992, 2024-09-12T18:37:47.402 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051696747000000001, 2024-09-12T18:37:47.402 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:47.402 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:47.402 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:47.402 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:47.403 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:47.403 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:47.403 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 238484 2024-09-12T18:37:47.403 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.403 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:47.403 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.403 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:47.403 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.618805+0000", 2024-09-12T18:37:47.403 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:47.403 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.403 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.403 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:47.403 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.618805+0000", 2024-09-12T18:37:47.404 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:47.404 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.404 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.404 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:47.404 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.618806+0000", 2024-09-12T18:37:47.404 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1829999999999999e-06 2024-09-12T18:37:47.404 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.404 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.404 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:47.404 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.618810+0000", 2024-09-12T18:37:47.404 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8380000000000004e-06 2024-09-12T18:37:47.404 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.404 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.404 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:47.405 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.618820+0000", 2024-09-12T18:37:47.405 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0047999999999999e-05 2024-09-12T18:37:47.405 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.405 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.405 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:47.405 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.618826+0000", 2024-09-12T18:37:47.405 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7710000000000003e-06 2024-09-12T18:37:47.405 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.405 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.405 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:47.405 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.618869+0000", 2024-09-12T18:37:47.405 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3412999999999999e-05 2024-09-12T18:37:47.405 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.406 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.406 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:47.406 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.618945+0000", 2024-09-12T18:37:47.406 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5992e-05 2024-09-12T18:37:47.406 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.406 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.406 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:47.406 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.619014+0000", 2024-09-12T18:37:47.406 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9298e-05 2024-09-12T18:37:47.406 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.406 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.406 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:47.407 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.623942+0000", 2024-09-12T18:37:47.407 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0049273909999999997 2024-09-12T18:37:47.407 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.407 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.407 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:47.407 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.670424+0000", 2024-09-12T18:37:47.407 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.046482453999999999 2024-09-12T18:37:47.407 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.407 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.407 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:47.407 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.670468+0000", 2024-09-12T18:37:47.407 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3449999999999999e-05 2024-09-12T18:37:47.407 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.407 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.408 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:47.408 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.670502+0000", 2024-09-12T18:37:47.408 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3908999999999997e-05 2024-09-12T18:37:47.408 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:47.408 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:47.408 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:47.408 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.408 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.408 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:238488 5.e 5:7267a760:::benchmark_data_smithi073_23739_object106211:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:47.408 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:38.622076+0000", 2024-09-12T18:37:47.408 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 8.6878292960000003, 2024-09-12T18:37:47.408 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053006515999999997, 2024-09-12T18:37:47.409 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:47.409 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:47.409 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:47.409 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:47.409 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:47.409 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:47.409 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 238488 2024-09-12T18:37:47.409 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.409 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:47.409 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.409 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:47.409 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622076+0000", 2024-09-12T18:37:47.409 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:47.409 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.410 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.410 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:47.410 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622076+0000", 2024-09-12T18:37:47.410 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:47.410 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.410 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.410 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:47.410 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622076+0000", 2024-09-12T18:37:47.410 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1900000000000002e-07 2024-09-12T18:37:47.410 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.410 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.410 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:47.410 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622080+0000", 2024-09-12T18:37:47.410 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.225e-06 2024-09-12T18:37:47.411 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.411 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.411 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:47.411 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622088+0000", 2024-09-12T18:37:47.411 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0949999999999996e-06 2024-09-12T18:37:47.411 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.411 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.411 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:47.411 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622092+0000", 2024-09-12T18:37:47.411 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5850000000000001e-06 2024-09-12T18:37:47.411 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.411 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.411 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:47.412 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622148+0000", 2024-09-12T18:37:47.412 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5587000000000002e-05 2024-09-12T18:37:47.412 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.412 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.412 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:47.412 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622283+0000", 2024-09-12T18:37:47.412 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013473900000000001 2024-09-12T18:37:47.412 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.412 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.412 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:47.413 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622404+0000", 2024-09-12T18:37:47.413 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000120865 2024-09-12T18:37:47.413 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.413 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.413 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:47.413 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.629341+0000", 2024-09-12T18:37:47.413 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0069376849999999999 2024-09-12T18:37:47.413 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.413 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.414 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:47.414 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.674829+0000", 2024-09-12T18:37:47.414 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.045488046999999997 2024-09-12T18:37:47.414 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.414 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.414 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:47.414 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.674973+0000", 2024-09-12T18:37:47.414 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000143719 2024-09-12T18:37:47.414 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.414 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.414 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:47.414 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.675082+0000", 2024-09-12T18:37:47.414 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010925 2024-09-12T18:37:47.415 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:47.415 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:47.415 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:47.415 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.415 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.415 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:238489 5.8 5:1da619cf:::benchmark_data_smithi073_23739_object106212:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:47.415 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:38.622114+0000", 2024-09-12T18:37:47.415 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 8.6877907959999998, 2024-09-12T18:37:47.415 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.05040443, 2024-09-12T18:37:47.415 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:47.415 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:47.415 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:47.415 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:47.416 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:47.416 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:47.416 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 238489 2024-09-12T18:37:47.416 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.416 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:47.416 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.416 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:47.416 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622114+0000", 2024-09-12T18:37:47.416 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:47.416 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.416 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.417 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:47.417 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622114+0000", 2024-09-12T18:37:47.417 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:47.417 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.417 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.417 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:47.417 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622115+0000", 2024-09-12T18:37:47.417 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8999999999999997e-07 2024-09-12T18:37:47.417 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.417 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.417 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:47.417 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622117+0000", 2024-09-12T18:37:47.417 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.182e-06 2024-09-12T18:37:47.418 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.418 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.418 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:47.418 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622122+0000", 2024-09-12T18:37:47.418 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7350000000000004e-06 2024-09-12T18:37:47.418 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.418 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.418 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:47.418 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622126+0000", 2024-09-12T18:37:47.418 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8550000000000004e-06 2024-09-12T18:37:47.418 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.418 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.418 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:47.418 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622172+0000", 2024-09-12T18:37:47.419 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6108e-05 2024-09-12T18:37:47.419 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.419 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.419 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:47.419 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622258+0000", 2024-09-12T18:37:47.419 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6050000000000005e-05 2024-09-12T18:37:47.419 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.419 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.419 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:47.419 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622323+0000", 2024-09-12T18:37:47.419 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5501999999999997e-05 2024-09-12T18:37:47.419 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.419 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.419 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:47.420 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.626718+0000", 2024-09-12T18:37:47.420 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0043947609999999996 2024-09-12T18:37:47.420 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.420 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.420 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:47.420 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.672398+0000", 2024-09-12T18:37:47.420 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.045679768000000003 2024-09-12T18:37:47.420 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.420 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.420 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:47.420 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.672468+0000", 2024-09-12T18:37:47.420 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0094999999999999e-05 2024-09-12T18:37:47.421 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.421 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.421 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:47.421 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.672519+0000", 2024-09-12T18:37:47.421 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0884000000000003e-05 2024-09-12T18:37:47.421 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:47.421 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:47.421 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:47.421 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.421 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.421 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:238490 5.e 5:7aa44d17:::benchmark_data_smithi073_23739_object106213:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:47.421 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:38.624702+0000", 2024-09-12T18:37:47.421 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 8.6852028600000004, 2024-09-12T18:37:47.421 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055637870999999998, 2024-09-12T18:37:47.422 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:47.422 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:47.422 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:47.422 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:47.422 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:47.422 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:47.422 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 238490 2024-09-12T18:37:47.422 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.422 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:47.422 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.422 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:47.422 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624702+0000", 2024-09-12T18:37:47.422 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:47.423 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.423 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.423 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:47.423 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624702+0000", 2024-09-12T18:37:47.423 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:47.423 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.423 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.423 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:47.423 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624703+0000", 2024-09-12T18:37:47.423 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1900000000000001e-07 2024-09-12T18:37:47.423 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.423 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.423 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:47.424 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624707+0000", 2024-09-12T18:37:47.424 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6100000000000002e-06 2024-09-12T18:37:47.424 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.424 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.424 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:47.424 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624715+0000", 2024-09-12T18:37:47.424 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4689999999999997e-06 2024-09-12T18:37:47.424 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.424 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.424 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:47.424 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624720+0000", 2024-09-12T18:37:47.424 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5719999999999996e-06 2024-09-12T18:37:47.425 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.425 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.425 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:47.425 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624762+0000", 2024-09-12T18:37:47.425 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2633000000000003e-05 2024-09-12T18:37:47.425 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.425 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.425 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:47.425 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624859+0000", 2024-09-12T18:37:47.425 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6667000000000001e-05 2024-09-12T18:37:47.425 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.425 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.425 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:47.425 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624927+0000", 2024-09-12T18:37:47.426 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7780000000000005e-05 2024-09-12T18:37:47.426 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.426 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.426 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:47.426 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.629361+0000", 2024-09-12T18:37:47.426 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0044346990000000003 2024-09-12T18:37:47.426 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.426 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.426 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:47.426 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.680101+0000", 2024-09-12T18:37:47.426 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.050739751999999999 2024-09-12T18:37:47.426 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.427 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.427 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:47.427 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.680223+0000", 2024-09-12T18:37:47.427 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012207 2024-09-12T18:37:47.427 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.427 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.427 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:47.427 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.680340+0000", 2024-09-12T18:37:47.427 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011680000000000001 2024-09-12T18:37:47.427 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:47.427 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:47.427 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:47.427 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.427 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.428 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:238492 5.e 5:7ec5c6d3:::benchmark_data_smithi073_23739_object106215:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:47.428 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:38.624755+0000", 2024-09-12T18:37:47.428 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 8.6851499309999998, 2024-09-12T18:37:47.428 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.059045981999999997, 2024-09-12T18:37:47.428 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:47.428 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:47.428 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:47.428 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:47.428 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:47.428 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:47.428 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 238492 2024-09-12T18:37:47.429 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.429 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:47.429 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.429 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:47.429 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624755+0000", 2024-09-12T18:37:47.429 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:47.429 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.429 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.429 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:47.429 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624755+0000", 2024-09-12T18:37:47.429 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:47.429 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.429 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.430 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:47.430 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624756+0000", 2024-09-12T18:37:47.430 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2e-07 2024-09-12T18:37:47.430 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.430 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.430 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:47.430 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624758+0000", 2024-09-12T18:37:47.430 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0379999999999998e-06 2024-09-12T18:37:47.430 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.430 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.430 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:47.431 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624763+0000", 2024-09-12T18:37:47.431 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6400000000000002e-06 2024-09-12T18:37:47.431 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.431 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.431 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:47.431 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624768+0000", 2024-09-12T18:37:47.431 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9509999999999997e-06 2024-09-12T18:37:47.431 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.431 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.431 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:47.431 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.625824+0000", 2024-09-12T18:37:47.431 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0010553540000000001 2024-09-12T18:37:47.431 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.432 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.432 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:47.432 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.626059+0000", 2024-09-12T18:37:47.432 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00023545200000000001 2024-09-12T18:37:47.432 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.432 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.432 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:47.432 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.626277+0000", 2024-09-12T18:37:47.432 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021797400000000001 2024-09-12T18:37:47.432 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.432 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.433 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:47.433 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.632160+0000", 2024-09-12T18:37:47.433 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0058828020000000003 2024-09-12T18:37:47.433 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.433 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.433 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:47.433 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.683543+0000", 2024-09-12T18:37:47.433 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051383073000000001 2024-09-12T18:37:47.433 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.433 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.433 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:47.433 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.683677+0000", 2024-09-12T18:37:47.434 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000134091 2024-09-12T18:37:47.434 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.434 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.434 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:47.434 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.683801+0000", 2024-09-12T18:37:47.434 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012408699999999999 2024-09-12T18:37:47.434 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:47.434 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:47.434 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:47.435 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.435 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.435 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:238493 5.8 5:17b7de1b:::benchmark_data_smithi073_23739_object106216:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:47.435 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:38.624778+0000", 2024-09-12T18:37:47.435 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 8.68512722, 2024-09-12T18:37:47.435 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048129221999999999, 2024-09-12T18:37:47.435 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:47.435 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:47.435 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:47.435 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:47.435 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:47.435 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:47.436 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 238493 2024-09-12T18:37:47.436 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.436 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:47.436 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.436 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:47.436 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624778+0000", 2024-09-12T18:37:47.436 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:47.436 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.436 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.436 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:47.436 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624778+0000", 2024-09-12T18:37:47.436 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:47.437 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.437 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.437 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:47.437 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624778+0000", 2024-09-12T18:37:47.437 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.32e-07 2024-09-12T18:37:47.437 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.437 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.437 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:47.437 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624780+0000", 2024-09-12T18:37:47.437 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0530000000000001e-06 2024-09-12T18:37:47.438 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.438 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.438 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:47.438 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624787+0000", 2024-09-12T18:37:47.438 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2790000000000004e-06 2024-09-12T18:37:47.438 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.438 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.438 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:47.438 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624792+0000", 2024-09-12T18:37:47.439 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9629999999999997e-06 2024-09-12T18:37:47.439 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.439 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.439 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:47.439 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624828+0000", 2024-09-12T18:37:47.439 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6177000000000003e-05 2024-09-12T18:37:47.439 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.439 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.439 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:47.439 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624905+0000", 2024-09-12T18:37:47.439 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7671999999999998e-05 2024-09-12T18:37:47.439 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.439 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.440 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:47.440 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624972+0000", 2024-09-12T18:37:47.440 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6977000000000006e-05 2024-09-12T18:37:47.440 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.440 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.440 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:47.440 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.629376+0000", 2024-09-12T18:37:47.440 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0044033229999999998 2024-09-12T18:37:47.440 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.440 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.440 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:47.440 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.672808+0000", 2024-09-12T18:37:47.440 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.043431889000000001 2024-09-12T18:37:47.441 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.441 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.441 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:47.441 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.672865+0000", 2024-09-12T18:37:47.441 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.753e-05 2024-09-12T18:37:47.441 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:47.441 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:47.441 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:47.441 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.672907+0000", 2024-09-12T18:37:47.441 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1927e-05 2024-09-12T18:37:47.441 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:47.441 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:47.442 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:47.442 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:47.442 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:47.442 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:47.443 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:47.437+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:47.444 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:37:47.520 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T18:37:47.544 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:47.541+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:47.594 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:47.594 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:37:47.594 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.594 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:258461 5.6 e78/21 5:693ebb78:::benchmark_data_smithi073_23739_object126184:head v 78'16136, mlcod=78'16134)", 2024-09-12T18:37:47.594 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:47.584823+0000", 2024-09-12T18:37:47.594 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0070128250000000003, 2024-09-12T18:37:47.594 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0070339879999999997, 2024-09-12T18:37:47.594 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:47.595 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:47.595 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:37:47.595 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:47.595 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.595 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:47.595 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.584823+0000", 2024-09-12T18:37:47.595 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:47.595 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.595 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.595 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:47.595 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.584823+0000", 2024-09-12T18:37:47.595 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:47.596 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.596 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.596 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:47.596 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.584824+0000", 2024-09-12T18:37:47.596 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.6199999999999997e-07 2024-09-12T18:37:47.597 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.597 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.597 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:47.597 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.584830+0000", 2024-09-12T18:37:47.597 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.6880000000000002e-06 2024-09-12T18:37:47.597 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.597 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.597 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:47.597 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.584839+0000", 2024-09-12T18:37:47.597 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.2979999999999992e-06 2024-09-12T18:37:47.597 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.597 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.597 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:47.598 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.584843+0000", 2024-09-12T18:37:47.598 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6700000000000002e-06 2024-09-12T18:37:47.598 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.598 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.598 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:47.598 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.584875+0000", 2024-09-12T18:37:47.598 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.1933000000000001e-05 2024-09-12T18:37:47.598 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.598 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.599 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:47.599 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.584886+0000", 2024-09-12T18:37:47.599 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1277000000000001e-05 2024-09-12T18:37:47.599 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:47.599 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:47.599 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:47.599 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.599 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.599 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:258466 5.1 5:83e36410:::benchmark_data_smithi073_23739_object126189:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T18:37:47.599 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:47.588564+0000", 2024-09-12T18:37:47.599 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0032717800000000002, 2024-09-12T18:37:47.599 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0033449809999999999, 2024-09-12T18:37:47.599 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:47.600 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:47.600 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:47.600 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:47.600 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:47.600 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:47.600 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 258466 2024-09-12T18:37:47.600 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.600 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:47.600 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.600 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:47.600 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.588564+0000", 2024-09-12T18:37:47.600 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:47.600 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.601 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.601 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:47.601 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.588564+0000", 2024-09-12T18:37:47.601 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:47.601 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.601 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.601 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:47.601 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.588565+0000", 2024-09-12T18:37:47.601 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:37:47.601 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.601 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.601 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:47.601 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.588569+0000", 2024-09-12T18:37:47.602 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4000000000000002e-06 2024-09-12T18:37:47.602 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.602 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.602 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:47.602 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.588580+0000", 2024-09-12T18:37:47.602 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0352e-05 2024-09-12T18:37:47.602 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.602 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.602 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:47.602 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.588587+0000", 2024-09-12T18:37:47.602 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9099999999999999e-06 2024-09-12T18:37:47.602 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.602 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.603 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:47.603 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.588668+0000", 2024-09-12T18:37:47.603 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1714999999999999e-05 2024-09-12T18:37:47.603 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.603 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.603 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:47.603 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.588807+0000", 2024-09-12T18:37:47.603 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000138663 2024-09-12T18:37:47.603 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.603 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.604 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:47.604 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.588924+0000", 2024-09-12T18:37:47.604 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000117376 2024-09-12T18:37:47.604 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.604 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.604 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:47.604 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.590817+0000", 2024-09-12T18:37:47.604 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0018929509999999999 2024-09-12T18:37:47.604 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:47.604 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:47.604 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:47.604 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.605 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.605 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:258470 5.9 5:9dfee37e:::benchmark_data_smithi073_23739_object126193:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T18:37:47.605 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:47.588902+0000", 2024-09-12T18:37:47.605 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0029332809999999998, 2024-09-12T18:37:47.605 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0030445659999999999, 2024-09-12T18:37:47.605 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:47.605 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:47.605 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:47.605 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:47.605 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:47.605 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:47.605 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 258470 2024-09-12T18:37:47.605 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.606 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:47.606 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.606 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:47.606 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.588902+0000", 2024-09-12T18:37:47.606 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:47.606 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.606 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.606 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:47.606 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.588902+0000", 2024-09-12T18:37:47.606 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:47.606 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.606 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.606 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:47.606 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.588903+0000", 2024-09-12T18:37:47.607 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.1500000000000004e-07 2024-09-12T18:37:47.607 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.607 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.607 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:47.607 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.588906+0000", 2024-09-12T18:37:47.607 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.2959999999999999e-06 2024-09-12T18:37:47.607 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.607 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.607 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:47.607 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.588915+0000", 2024-09-12T18:37:47.607 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.3780000000000001e-06 2024-09-12T18:37:47.607 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.607 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.608 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:47.608 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.588921+0000", 2024-09-12T18:37:47.608 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2879999999999998e-06 2024-09-12T18:37:47.608 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.608 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.608 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:47.608 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.588956+0000", 2024-09-12T18:37:47.608 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.4669000000000003e-05 2024-09-12T18:37:47.608 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.608 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.608 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:47.608 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.589054+0000", 2024-09-12T18:37:47.608 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.8643999999999999e-05 2024-09-12T18:37:47.609 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.609 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.609 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:47.609 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.589118+0000", 2024-09-12T18:37:47.609 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.3439e-05 2024-09-12T18:37:47.609 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.609 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.609 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:47.609 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.591387+0000", 2024-09-12T18:37:47.609 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0022691790000000001 2024-09-12T18:37:47.609 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:47.609 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:47.609 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:47.609 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.610 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.610 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:258472 5.6 e78/21 5:6fa100cc:::benchmark_data_smithi073_23739_object126195:head v 78'16137, mlcod=78'16134)", 2024-09-12T18:37:47.610 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:47.589380+0000", 2024-09-12T18:37:47.610 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0024559289999999999, 2024-09-12T18:37:47.610 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0026025140000000002, 2024-09-12T18:37:47.610 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:47.610 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:47.610 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "started", 2024-09-12T18:37:47.610 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:47.610 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.610 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:47.610 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.589380+0000", 2024-09-12T18:37:47.611 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:47.611 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.611 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.611 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:47.611 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.589380+0000", 2024-09-12T18:37:47.611 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:47.611 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.611 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.611 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:47.611 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.589381+0000", 2024-09-12T18:37:47.611 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1299999999999999e-07 2024-09-12T18:37:47.611 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.611 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.611 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:47.612 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.589385+0000", 2024-09-12T18:37:47.612 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.7890000000000002e-06 2024-09-12T18:37:47.612 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.612 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.612 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:47.612 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.589396+0000", 2024-09-12T18:37:47.612 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0397999999999999e-05 2024-09-12T18:37:47.612 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.612 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.612 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:47.612 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.589403+0000", 2024-09-12T18:37:47.612 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.4329999999999998e-06 2024-09-12T18:37:47.612 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.613 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.613 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:47.613 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.589449+0000", 2024-09-12T18:37:47.613 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.5340000000000003e-05 2024-09-12T18:37:47.613 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.613 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.613 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:47.613 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.589465+0000", 2024-09-12T18:37:47.613 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6506000000000001e-05 2024-09-12T18:37:47.613 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:47.613 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:47.613 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:47.613 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.614 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.614 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:258474 5.5 5:a9a70840:::benchmark_data_smithi073_23739_object126197:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T18:37:47.614 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:47.589564+0000", 2024-09-12T18:37:47.614 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.0022722010000000002, 2024-09-12T18:37:47.614 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0024469399999999999, 2024-09-12T18:37:47.614 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:47.614 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:47.614 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:47.614 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:47.614 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:47.614 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:47.614 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 258474 2024-09-12T18:37:47.614 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.615 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:47.615 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.615 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:47.615 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.589564+0000", 2024-09-12T18:37:47.615 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:47.615 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.615 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.615 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:47.615 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.589564+0000", 2024-09-12T18:37:47.615 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:47.616 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.616 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.616 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:47.616 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.589564+0000", 2024-09-12T18:37:47.616 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4600000000000005e-07 2024-09-12T18:37:47.616 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.616 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.616 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:47.616 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.589567+0000", 2024-09-12T18:37:47.616 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.6309999999999999e-06 2024-09-12T18:37:47.616 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.616 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.617 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:47.617 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.589574+0000", 2024-09-12T18:37:47.617 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0790000000000003e-06 2024-09-12T18:37:47.617 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.617 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.617 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:47.617 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.589580+0000", 2024-09-12T18:37:47.617 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2709999999999998e-06 2024-09-12T18:37:47.617 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.617 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.617 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:47.617 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.589633+0000", 2024-09-12T18:37:47.617 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3301999999999999e-05 2024-09-12T18:37:47.617 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.618 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.618 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:47.618 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.589752+0000", 2024-09-12T18:37:47.618 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000119047 2024-09-12T18:37:47.618 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.618 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.618 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:47.618 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.589862+0000", 2024-09-12T18:37:47.618 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000109831 2024-09-12T18:37:47.618 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:47.618 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:47.618 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:47.619 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.619 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.619 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:258475 5.5 5:a31e0545:::benchmark_data_smithi073_23739_object126198:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T18:37:47.619 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:47.590978+0000", 2024-09-12T18:37:47.619 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.00085760800000000005, 2024-09-12T18:37:47.619 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0010639860000000001, 2024-09-12T18:37:47.619 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:47.619 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:47.619 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:47.619 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:47.619 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:47.620 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:47.620 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 258475 2024-09-12T18:37:47.620 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.620 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:47.620 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.620 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:47.620 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.590978+0000", 2024-09-12T18:37:47.620 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:47.620 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.620 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.620 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:47.620 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.590978+0000", 2024-09-12T18:37:47.620 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:47.621 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.621 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.621 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:47.621 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.590979+0000", 2024-09-12T18:37:47.621 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.3399999999999999e-07 2024-09-12T18:37:47.621 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.621 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.621 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:47.621 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.590982+0000", 2024-09-12T18:37:47.621 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.016e-06 2024-09-12T18:37:47.621 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.621 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.621 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:47.622 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.590992+0000", 2024-09-12T18:37:47.622 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.8020000000000003e-06 2024-09-12T18:37:47.622 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.622 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.622 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:47.622 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.590998+0000", 2024-09-12T18:37:47.622 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2879999999999998e-06 2024-09-12T18:37:47.622 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.622 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.622 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:47.622 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.591316+0000", 2024-09-12T18:37:47.622 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00031781499999999999 2024-09-12T18:37:47.623 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.623 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.623 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:47.623 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.591478+0000", 2024-09-12T18:37:47.623 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000162301 2024-09-12T18:37:47.623 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.623 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.623 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:47.623 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.591613+0000", 2024-09-12T18:37:47.623 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013469600000000001 2024-09-12T18:37:47.623 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:47.623 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:47.623 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:47.624 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.624 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.624 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:258476 5.1 5:8cd8f373:::benchmark_data_smithi073_23739_object126199:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-12T18:37:47.624 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:47.591687+0000", 2024-09-12T18:37:47.624 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 0.000149037, 2024-09-12T18:37:47.624 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00038820499999999997, 2024-09-12T18:37:47.624 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:47.624 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:47.624 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:37:47.624 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:47.624 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:47.624 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:47.624 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 258476 2024-09-12T18:37:47.625 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.625 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:47.625 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.625 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:47.625 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.591687+0000", 2024-09-12T18:37:47.625 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:47.625 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.625 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.625 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:47.625 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.591687+0000", 2024-09-12T18:37:47.625 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:47.625 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.625 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.626 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:47.626 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.591687+0000", 2024-09-12T18:37:47.626 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.3099999999999996e-07 2024-09-12T18:37:47.626 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.626 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.626 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:47.626 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.591692+0000", 2024-09-12T18:37:47.626 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.0080000000000004e-06 2024-09-12T18:37:47.626 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.626 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.626 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:47.626 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.591700+0000", 2024-09-12T18:37:47.627 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.0930000000000003e-06 2024-09-12T18:37:47.627 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.627 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.627 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:47.627 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.591706+0000", 2024-09-12T18:37:47.627 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2360000000000001e-06 2024-09-12T18:37:47.627 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.627 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.627 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:47.627 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.591804+0000", 2024-09-12T18:37:47.627 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.8228999999999998e-05 2024-09-12T18:37:47.627 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.627 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.628 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:47.628 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.591940+0000", 2024-09-12T18:37:47.628 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013546899999999999 2024-09-12T18:37:47.628 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:47.628 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:47.628 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:47.628 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:47.592055+0000", 2024-09-12T18:37:47.628 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000115662 2024-09-12T18:37:47.628 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:47.628 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:47.628 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:47.628 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:47.628 INFO:teuthology.orchestra.run.smithi162.stdout: ], 2024-09-12T18:37:47.629 INFO:teuthology.orchestra.run.smithi162.stdout: "num_ops": 7 2024-09-12T18:37:47.629 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:47.629 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:37:47.631 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:37:47.674 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:47.669+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:47.746 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:47.741+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:47.778 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:47.778 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [], 2024-09-12T18:37:47.778 INFO:teuthology.orchestra.run.smithi162.stdout: "complaint_time": 30, 2024-09-12T18:37:47.778 INFO:teuthology.orchestra.run.smithi162.stdout: "num_blocked_ops": 0 2024-09-12T18:37:47.778 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:47.796 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:37:47.797 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:37:47.798 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:37:47.815 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:37:47.815 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:37:47.835 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:37:47.835 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:37:47.886 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:47.881+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:47.947 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:47.943+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:47.990 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:47.990 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:48.009 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:37:48.050 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:48.045+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:48.149 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:48.145+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:48.163 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:48.164 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:48.183 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:37:48.250 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:48.245+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:48.351 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:48.345+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:48.370 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:48.370 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:48.388 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:37:48.451 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:48.445+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:48.552 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:48.547+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:48.585 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:48.585 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:48.605 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:37:48.653 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:48.645+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:48.755 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:48.749+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:48.759 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:48.759 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:48.781 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:37:48.844 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is unset 2024-09-12T18:37:48.855 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:48.849+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:48.934 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:48.935 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:48.955 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:37:48.956 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:48.949+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:49.057 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:49.051+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:49.109 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:49.109 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:49.130 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:37:49.175 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:49.169+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:49.258 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:49.255+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:49.279 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:49.279 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:49.303 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:37:49.394 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:49.389+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:49.460 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:49.457+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:49.500 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:49.501 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:49.517 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:37:49.602 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:49.597+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:49.663 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:49.659+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:49.688 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:37:49.689 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:37:49.689 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:37:49.710 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:49.710 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:49.731 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:37:49.763 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:49.759+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:49.852 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:37:49.864 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:49.859+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:49.886 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:49.886 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:49.905 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:37:49.964 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:49.957+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:49.996 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:37:49.997 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:37:50.015 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:37:50.015 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:37:50.022 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:37:50.024 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T18:37:50.033 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:37:50.033 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:37:50.041 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":156,"stamp":"2024-09-12T18:37:48.837063+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":440535989,"num_objects":6740,"num_object_clones":0,"num_object_copies":13480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6740,"num_whiteouts":0,"num_read":87,"num_read_kb":74,"num_write":258028,"num_write_kb":8468225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16201,"num_bytes_recovered":1061421638,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62594,"ondisk_log_size":62594,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":903000,"kb_used_data":65304,"kb_used_omap":4,"kb_used_meta":837627,"kb_avail":282212520,"statfs":{"total":289910292480,"available":288985620480,"internally_reserved":0,"allocated":66871296,"data_stored":1026250247,"data_compressed":48713179,"data_compressed_allocated":64094208,"data_compressed_original":1025212416,"omap_allocated":4783,"internal_metadata":857730385},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1019543552,"num_objects":-15557,"num_object_clones":0,"num_object_copies":-31114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-15557,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15557,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.419178"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":138,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.495640+0000","last_change":"2024-09-12T18:36:40.076316+0000","last_active":"2024-09-12T18:37:45.495640+0000","last_peered":"2024-09-12T18:37:45.495640+0000","last_clean":"2024-09-12T18:37:45.495640+0000","last_became_active":"2024-09-12T18:36:40.074014+0000","last_became_peered":"2024-09-12T18:36:40.074014+0000","last_unstale":"2024-09-12T18:37:45.495640+0000","last_undegraded":"2024-09-12T18:37:45.495640+0000","last_fullsized":"2024-09-12T18:37:45.495640+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:20.167564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.494928+0000","last_change":"2024-09-12T18:35:25.659760+0000","last_active":"2024-09-12T18:37:45.494928+0000","last_peered":"2024-09-12T18:37:45.494928+0000","last_clean":"2024-09-12T18:37:45.494928+0000","last_became_active":"2024-09-12T18:35:25.654920+0000","last_became_peered":"2024-09-12T18:35:25.654920+0000","last_unstale":"2024-09-12T18:37:45.494928+0000","last_undegraded":"2024-09-12T18:37:45.494928+0000","last_fullsized":"2024-09-12T18:37:45.494928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:21.519881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.499679+0000","last_change":"2024-09-12T18:35:25.659460+0000","last_active":"2024-09-12T18:37:45.499679+0000","last_peered":"2024-09-12T18:37:45.499679+0000","last_clean":"2024-09-12T18:37:45.499679+0000","last_became_active":"2024-09-12T18:35:25.657782+0000","last_became_peered":"2024-09-12T18:35:25.657782+0000","last_unstale":"2024-09-12T18:37:45.499679+0000","last_undegraded":"2024-09-12T18:37:45.499679+0000","last_fullsized":"2024-09-12T18:37:45.499679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:38.544284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.498439+0000","last_change":"2024-09-12T18:35:25.663617+0000","last_active":"2024-09-12T18:37:45.498439+0000","last_peered":"2024-09-12T18:37:45.498439+0000","last_clean":"2024-09-12T18:37:45.498439+0000","last_became_active":"2024-09-12T18:35:25.661977+0000","last_became_peered":"2024-09-12T18:35:25.661977+0000","last_unstale":"2024-09-12T18:37:45.498439+0000","last_undegraded":"2024-09-12T18:37:45.498439+0000","last_fullsized":"2024-09-12T18:37:45.498439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:14.748234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":131,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.494496+0000","last_change":"2024-09-12T18:35:25.656566+0000","last_active":"2024-09-12T18:37:45.494496+0000","last_peered":"2024-09-12T18:37:45.494496+0000","last_clean":"2024-09-12T18:37:45.494496+0000","last_became_active":"2024-09-12T18:35:25.654898+0000","last_became_peered":"2024-09-12T18:35:25.654898+0000","last_unstale":"2024-09-12T18:37:45.494496+0000","last_undegraded":"2024-09-12T18:37:45.494496+0000","last_fullsized":"2024-09-12T18:37:45.494496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:36.113250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":137,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.498486+0000","last_change":"2024-09-12T18:36:40.067812+0000","last_active":"2024-09-12T18:37:45.498486+0000","last_peered":"2024-09-12T18:37:45.498486+0000","last_clean":"2024-09-12T18:37:45.498486+0000","last_became_active":"2024-09-12T18:36:40.067396+0000","last_became_peered":"2024-09-12T18:36:40.067396+0000","last_unstale":"2024-09-12T18:37:45.498486+0000","last_undegraded":"2024-09-12T18:37:45.498486+0000","last_fullsized":"2024-09-12T18:37:45.498486+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:46.485518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":131,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.499409+0000","last_change":"2024-09-12T18:35:25.659811+0000","last_active":"2024-09-12T18:37:45.499409+0000","last_peered":"2024-09-12T18:37:45.499409+0000","last_clean":"2024-09-12T18:37:45.499409+0000","last_became_active":"2024-09-12T18:35:25.658998+0000","last_became_peered":"2024-09-12T18:35:25.658998+0000","last_unstale":"2024-09-12T18:37:45.499409+0000","last_undegraded":"2024-09-12T18:37:45.499409+0000","last_fullsized":"2024-09-12T18:37:45.499409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":137,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.498148+0000","last_change":"2024-09-12T18:36:40.154635+0000","last_active":"2024-09-12T18:37:45.498148+0000","last_peered":"2024-09-12T18:37:45.498148+0000","last_clean":"2024-09-12T18:37:45.498148+0000","last_became_active":"2024-09-12T18:36:40.153818+0000","last_became_peered":"2024-09-12T18:36:40.153818+0000","last_unstale":"2024-09-12T18:37:45.498148+0000","last_undegraded":"2024-09-12T18:37:45.498148+0000","last_fullsized":"2024-09-12T18:37:45.498148+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:54.571879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":131,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.502150+0000","last_change":"2024-09-12T18:35:25.668339+0000","last_active":"2024-09-12T18:37:45.502150+0000","last_peered":"2024-09-12T18:37:45.502150+0000","last_clean":"2024-09-12T18:37:45.502150+0000","last_became_active":"2024-09-12T18:35:25.667608+0000","last_became_peered":"2024-09-12T18:35:25.667608+0000","last_unstale":"2024-09-12T18:37:45.502150+0000","last_undegraded":"2024-09-12T18:37:45.502150+0000","last_fullsized":"2024-09-12T18:37:45.502150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:15.699745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":137,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.495018+0000","last_change":"2024-09-12T18:36:40.075686+0000","last_active":"2024-09-12T18:37:45.495018+0000","last_peered":"2024-09-12T18:37:45.495018+0000","last_clean":"2024-09-12T18:37:45.495018+0000","last_became_active":"2024-09-12T18:36:40.072911+0000","last_became_peered":"2024-09-12T18:36:40.072911+0000","last_unstale":"2024-09-12T18:37:45.495018+0000","last_undegraded":"2024-09-12T18:37:45.495018+0000","last_fullsized":"2024-09-12T18:37:45.495018+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:24.687842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":137,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.499645+0000","last_change":"2024-09-12T18:36:39.072342+0000","last_active":"2024-09-12T18:37:45.499645+0000","last_peered":"2024-09-12T18:37:45.499645+0000","last_clean":"2024-09-12T18:37:45.499645+0000","last_became_active":"2024-09-12T18:36:39.071488+0000","last_became_peered":"2024-09-12T18:36:39.071488+0000","last_unstale":"2024-09-12T18:37:45.499645+0000","last_undegraded":"2024-09-12T18:37:45.499645+0000","last_fullsized":"2024-09-12T18:37:45.499645+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:27.845874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":131,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.494795+0000","last_change":"2024-09-12T18:35:25.649885+0000","last_active":"2024-09-12T18:37:45.494795+0000","last_peered":"2024-09-12T18:37:45.494795+0000","last_clean":"2024-09-12T18:37:45.494795+0000","last_became_active":"2024-09-12T18:35:25.649111+0000","last_became_peered":"2024-09-12T18:35:25.649111+0000","last_unstale":"2024-09-12T18:37:45.494795+0000","last_undegraded":"2024-09-12T18:37:45.494795+0000","last_fullsized":"2024-09-12T18:37:45.494795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:17.162410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":137,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.494344+0000","last_change":"2024-09-12T18:36:39.074873+0000","last_active":"2024-09-12T18:37:45.494344+0000","last_peered":"2024-09-12T18:37:45.494344+0000","last_clean":"2024-09-12T18:37:45.494344+0000","last_became_active":"2024-09-12T18:36:39.074049+0000","last_became_peered":"2024-09-12T18:36:39.074049+0000","last_unstale":"2024-09-12T18:37:45.494344+0000","last_undegraded":"2024-09-12T18:37:45.494344+0000","last_fullsized":"2024-09-12T18:37:45.494344+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:14.773044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.498651+0000","last_change":"2024-09-12T18:35:25.657913+0000","last_active":"2024-09-12T18:37:45.498651+0000","last_peered":"2024-09-12T18:37:45.498651+0000","last_clean":"2024-09-12T18:37:45.498651+0000","last_became_active":"2024-09-12T18:35:25.657082+0000","last_became_peered":"2024-09-12T18:35:25.657082+0000","last_unstale":"2024-09-12T18:37:45.498651+0000","last_undegraded":"2024-09-12T18:37:45.498651+0000","last_fullsized":"2024-09-12T18:37:45.498651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:21.538633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.499555+0000","last_change":"2024-09-12T18:35:25.658763+0000","last_active":"2024-09-12T18:37:45.499555+0000","last_peered":"2024-09-12T18:37:45.499555+0000","last_clean":"2024-09-12T18:37:45.499555+0000","last_became_active":"2024-09-12T18:35:25.657508+0000","last_became_peered":"2024-09-12T18:35:25.657508+0000","last_unstale":"2024-09-12T18:37:45.499555+0000","last_undegraded":"2024-09-12T18:37:45.499555+0000","last_fullsized":"2024-09-12T18:37:45.499555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:13.170519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.498312+0000","last_change":"2024-09-12T18:35:25.653730+0000","last_active":"2024-09-12T18:37:45.498312+0000","last_peered":"2024-09-12T18:37:45.498312+0000","last_clean":"2024-09-12T18:37:45.498312+0000","last_became_active":"2024-09-12T18:35:25.651535+0000","last_became_peered":"2024-09-12T18:35:25.651535+0000","last_unstale":"2024-09-12T18:37:45.498312+0000","last_undegraded":"2024-09-12T18:37:45.498312+0000","last_fullsized":"2024-09-12T18:37:45.498312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.502475+0000","last_change":"2024-09-12T18:35:25.656513+0000","last_active":"2024-09-12T18:37:45.502475+0000","last_peered":"2024-09-12T18:37:45.502475+0000","last_clean":"2024-09-12T18:37:45.502475+0000","last_became_active":"2024-09-12T18:35:25.653440+0000","last_became_peered":"2024-09-12T18:35:25.653440+0000","last_unstale":"2024-09-12T18:37:45.502475+0000","last_undegraded":"2024-09-12T18:37:45.502475+0000","last_fullsized":"2024-09-12T18:37:45.502475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:18.693161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.495152+0000","last_change":"2024-09-12T18:35:25.657991+0000","last_active":"2024-09-12T18:37:45.495152+0000","last_peered":"2024-09-12T18:37:45.495152+0000","last_clean":"2024-09-12T18:37:45.495152+0000","last_became_active":"2024-09-12T18:35:25.653934+0000","last_became_peered":"2024-09-12T18:35:25.653934+0000","last_unstale":"2024-09-12T18:37:45.495152+0000","last_undegraded":"2024-09-12T18:37:45.495152+0000","last_fullsized":"2024-09-12T18:37:45.495152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:05.418901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":70,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.497335+0000","last_change":"2024-09-12T18:36:39.075412+0000","last_active":"2024-09-12T18:37:45.497335+0000","last_peered":"2024-09-12T18:37:45.497335+0000","last_clean":"2024-09-12T18:37:45.497335+0000","last_became_active":"2024-09-12T18:36:39.074539+0000","last_became_peered":"2024-09-12T18:36:39.074539+0000","last_unstale":"2024-09-12T18:37:45.497335+0000","last_undegraded":"2024-09-12T18:37:45.497335+0000","last_fullsized":"2024-09-12T18:37:45.497335+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:34.322250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.498488+0000","last_change":"2024-09-12T18:35:25.661176+0000","last_active":"2024-09-12T18:37:45.498488+0000","last_peered":"2024-09-12T18:37:45.498488+0000","last_clean":"2024-09-12T18:37:45.498488+0000","last_became_active":"2024-09-12T18:35:25.659534+0000","last_became_peered":"2024-09-12T18:35:25.659534+0000","last_unstale":"2024-09-12T18:37:45.498488+0000","last_undegraded":"2024-09-12T18:37:45.498488+0000","last_fullsized":"2024-09-12T18:37:45.498488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:40.145442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.504373+0000","last_change":"2024-09-12T18:35:25.650632+0000","last_active":"2024-09-12T18:37:45.504373+0000","last_peered":"2024-09-12T18:37:45.504373+0000","last_clean":"2024-09-12T18:37:45.504373+0000","last_became_active":"2024-09-12T18:35:25.649333+0000","last_became_peered":"2024-09-12T18:35:25.649333+0000","last_unstale":"2024-09-12T18:37:45.504373+0000","last_undegraded":"2024-09-12T18:37:45.504373+0000","last_fullsized":"2024-09-12T18:37:45.504373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:30.537572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.494465+0000","last_change":"2024-09-12T18:35:25.648245+0000","last_active":"2024-09-12T18:37:45.494465+0000","last_peered":"2024-09-12T18:37:45.494465+0000","last_clean":"2024-09-12T18:37:45.494465+0000","last_became_active":"2024-09-12T18:35:25.646357+0000","last_became_peered":"2024-09-12T18:35:25.646357+0000","last_unstale":"2024-09-12T18:37:45.494465+0000","last_undegraded":"2024-09-12T18:37:45.494465+0000","last_fullsized":"2024-09-12T18:37:45.494465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:05.662140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.500532+0000","last_change":"2024-09-12T18:35:25.661613+0000","last_active":"2024-09-12T18:37:45.500532+0000","last_peered":"2024-09-12T18:37:45.500532+0000","last_clean":"2024-09-12T18:37:45.500532+0000","last_became_active":"2024-09-12T18:35:25.658833+0000","last_became_peered":"2024-09-12T18:35:25.658833+0000","last_unstale":"2024-09-12T18:37:45.500532+0000","last_undegraded":"2024-09-12T18:37:45.500532+0000","last_fullsized":"2024-09-12T18:37:45.500532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:51.064080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.494017+0000","last_change":"2024-09-12T18:35:25.657782+0000","last_active":"2024-09-12T18:37:45.494017+0000","last_peered":"2024-09-12T18:37:45.494017+0000","last_clean":"2024-09-12T18:37:45.494017+0000","last_became_active":"2024-09-12T18:35:25.655295+0000","last_became_peered":"2024-09-12T18:35:25.655295+0000","last_unstale":"2024-09-12T18:37:45.494017+0000","last_undegraded":"2024-09-12T18:37:45.494017+0000","last_fullsized":"2024-09-12T18:37:45.494017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:37.744175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.495701+0000","last_change":"2024-09-12T18:35:25.654863+0000","last_active":"2024-09-12T18:37:45.495701+0000","last_peered":"2024-09-12T18:37:45.495701+0000","last_clean":"2024-09-12T18:37:45.495701+0000","last_became_active":"2024-09-12T18:35:25.650407+0000","last_became_peered":"2024-09-12T18:35:25.650407+0000","last_unstale":"2024-09-12T18:37:45.495701+0000","last_undegraded":"2024-09-12T18:37:45.495701+0000","last_fullsized":"2024-09-12T18:37:45.495701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:38.395666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.501179+0000","last_change":"2024-09-12T18:35:25.662414+0000","last_active":"2024-09-12T18:37:45.501179+0000","last_peered":"2024-09-12T18:37:45.501179+0000","last_clean":"2024-09-12T18:37:45.501179+0000","last_became_active":"2024-09-12T18:35:25.660126+0000","last_became_peered":"2024-09-12T18:35:25.660126+0000","last_unstale":"2024-09-12T18:37:45.501179+0000","last_undegraded":"2024-09-12T18:37:45.501179+0000","last_fullsized":"2024-09-12T18:37:45.501179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:48.437139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.499525+0000","last_change":"2024-09-12T18:35:25.661523+0000","last_active":"2024-09-12T18:37:45.499525+0000","last_peered":"2024-09-12T18:37:45.499525+0000","last_clean":"2024-09-12T18:37:45.499525+0000","last_became_active":"2024-09-12T18:35:25.659338+0000","last_became_peered":"2024-09-12T18:35:25.659338+0000","last_unstale":"2024-09-12T18:37:45.499525+0000","last_undegraded":"2024-09-12T18:37:45.499525+0000","last_fullsized":"2024-09-12T18:37:45.499525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:37.083820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.495051+0000","last_change":"2024-09-12T18:35:25.662445+0000","last_active":"2024-09-12T18:37:45.495051+0000","last_peered":"2024-09-12T18:37:45.495051+0000","last_clean":"2024-09-12T18:37:45.495051+0000","last_became_active":"2024-09-12T18:35:25.659496+0000","last_became_peered":"2024-09-12T18:35:25.659496+0000","last_unstale":"2024-09-12T18:37:45.495051+0000","last_undegraded":"2024-09-12T18:37:45.495051+0000","last_fullsized":"2024-09-12T18:37:45.495051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:03.270420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":70,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.494276+0000","last_change":"2024-09-12T18:36:39.074532+0000","last_active":"2024-09-12T18:37:45.494276+0000","last_peered":"2024-09-12T18:37:45.494276+0000","last_clean":"2024-09-12T18:37:45.494276+0000","last_became_active":"2024-09-12T18:36:39.073676+0000","last_became_peered":"2024-09-12T18:36:39.073676+0000","last_unstale":"2024-09-12T18:37:45.494276+0000","last_undegraded":"2024-09-12T18:37:45.494276+0000","last_fullsized":"2024-09-12T18:37:45.494276+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:53.080797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.494467+0000","last_change":"2024-09-12T18:35:25.650507+0000","last_active":"2024-09-12T18:37:45.494467+0000","last_peered":"2024-09-12T18:37:45.494467+0000","last_clean":"2024-09-12T18:37:45.494467+0000","last_became_active":"2024-09-12T18:35:25.649415+0000","last_became_peered":"2024-09-12T18:35:25.649415+0000","last_unstale":"2024-09-12T18:37:45.494467+0000","last_undegraded":"2024-09-12T18:37:45.494467+0000","last_fullsized":"2024-09-12T18:37:45.494467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:23.081416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.500590+0000","last_change":"2024-09-12T18:35:25.653949+0000","last_active":"2024-09-12T18:37:45.500590+0000","last_peered":"2024-09-12T18:37:45.500590+0000","last_clean":"2024-09-12T18:37:45.500590+0000","last_became_active":"2024-09-12T18:35:25.652992+0000","last_became_peered":"2024-09-12T18:35:25.652992+0000","last_unstale":"2024-09-12T18:37:45.500590+0000","last_undegraded":"2024-09-12T18:37:45.500590+0000","last_fullsized":"2024-09-12T18:37:45.500590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:47.687372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":138,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.498463+0000","last_change":"2024-09-12T18:36:40.154958+0000","last_active":"2024-09-12T18:37:45.498463+0000","last_peered":"2024-09-12T18:37:45.498463+0000","last_clean":"2024-09-12T18:37:45.498463+0000","last_became_active":"2024-09-12T18:36:40.154422+0000","last_became_peered":"2024-09-12T18:36:40.154422+0000","last_unstale":"2024-09-12T18:37:45.498463+0000","last_undegraded":"2024-09-12T18:37:45.498463+0000","last_fullsized":"2024-09-12T18:37:45.498463+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:33.288844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":138,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.494971+0000","last_change":"2024-09-12T18:36:40.079440+0000","last_active":"2024-09-12T18:37:45.494971+0000","last_peered":"2024-09-12T18:37:45.494971+0000","last_clean":"2024-09-12T18:37:45.494971+0000","last_became_active":"2024-09-12T18:36:40.076955+0000","last_became_peered":"2024-09-12T18:36:40.076955+0000","last_unstale":"2024-09-12T18:37:45.494971+0000","last_undegraded":"2024-09-12T18:37:45.494971+0000","last_fullsized":"2024-09-12T18:37:45.494971+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:18.565373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":136,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.505690+0000","last_change":"2024-09-12T18:35:24.657739+0000","last_active":"2024-09-12T18:37:45.505690+0000","last_peered":"2024-09-12T18:37:45.505690+0000","last_clean":"2024-09-12T18:37:45.505690+0000","last_became_active":"2024-09-12T18:35:24.656208+0000","last_became_peered":"2024-09-12T18:35:24.656208+0000","last_unstale":"2024-09-12T18:37:45.505690+0000","last_undegraded":"2024-09-12T18:37:45.505690+0000","last_fullsized":"2024-09-12T18:37:45.505690+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:50.073716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":131,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.497022+0000","last_change":"2024-09-12T18:35:25.651651+0000","last_active":"2024-09-12T18:37:45.497022+0000","last_peered":"2024-09-12T18:37:45.497022+0000","last_clean":"2024-09-12T18:37:45.497022+0000","last_became_active":"2024-09-12T18:35:25.650849+0000","last_became_peered":"2024-09-12T18:35:25.650849+0000","last_unstale":"2024-09-12T18:37:45.497022+0000","last_undegraded":"2024-09-12T18:37:45.497022+0000","last_fullsized":"2024-09-12T18:37:45.497022+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:18.555827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.501088+0000","last_change":"2024-09-12T18:35:24.656119+0000","last_active":"2024-09-12T18:37:45.501088+0000","last_peered":"2024-09-12T18:37:45.501088+0000","last_clean":"2024-09-12T18:37:45.501088+0000","last_became_active":"2024-09-12T18:35:24.653175+0000","last_became_peered":"2024-09-12T18:35:24.653175+0000","last_unstale":"2024-09-12T18:37:45.501088+0000","last_undegraded":"2024-09-12T18:37:45.501088+0000","last_fullsized":"2024-09-12T18:37:45.501088+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:00.551165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":68,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.498692+0000","last_change":"2024-09-12T18:36:40.090805+0000","last_active":"2024-09-12T18:37:45.498692+0000","last_peered":"2024-09-12T18:37:45.498692+0000","last_clean":"2024-09-12T18:37:45.498692+0000","last_became_active":"2024-09-12T18:36:40.090318+0000","last_became_peered":"2024-09-12T18:36:40.090318+0000","last_unstale":"2024-09-12T18:37:45.498692+0000","last_undegraded":"2024-09-12T18:37:45.498692+0000","last_fullsized":"2024-09-12T18:37:45.498692+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:15.103437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.494132+0000","last_change":"2024-09-12T18:35:24.640096+0000","last_active":"2024-09-12T18:37:45.494132+0000","last_peered":"2024-09-12T18:37:45.494132+0000","last_clean":"2024-09-12T18:37:45.494132+0000","last_became_active":"2024-09-12T18:35:24.638230+0000","last_became_peered":"2024-09-12T18:35:24.638230+0000","last_unstale":"2024-09-12T18:37:45.494132+0000","last_undegraded":"2024-09-12T18:37:45.494132+0000","last_fullsized":"2024-09-12T18:37:45.494132+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:38.435296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":68,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.499170+0000","last_change":"2024-09-12T18:36:40.075962+0000","last_active":"2024-09-12T18:37:45.499170+0000","last_peered":"2024-09-12T18:37:45.499170+0000","last_clean":"2024-09-12T18:37:45.499170+0000","last_became_active":"2024-09-12T18:36:40.075081+0000","last_became_peered":"2024-09-12T18:36:40.075081+0000","last_unstale":"2024-09-12T18:37:45.499170+0000","last_undegraded":"2024-09-12T18:37:45.499170+0000","last_fullsized":"2024-09-12T18:37:45.499170+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:00.410639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":142,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.498733+0000","last_change":"2024-09-12T18:35:24.653610+0000","last_active":"2024-09-12T18:37:45.498733+0000","last_peered":"2024-09-12T18:37:45.498733+0000","last_clean":"2024-09-12T18:37:45.498733+0000","last_became_active":"2024-09-12T18:35:24.652880+0000","last_became_peered":"2024-09-12T18:35:24.652880+0000","last_unstale":"2024-09-12T18:37:45.498733+0000","last_undegraded":"2024-09-12T18:37:45.498733+0000","last_fullsized":"2024-09-12T18:37:45.498733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:57.636251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"78'16043","reported_seq":16165,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:46.571449+0000","last_change":"2024-09-12T18:35:44.771794+0000","last_active":"2024-09-12T18:37:46.571449+0000","last_peered":"2024-09-12T18:37:46.571449+0000","last_clean":"2024-09-12T18:37:46.571449+0000","last_became_active":"2024-09-12T18:35:44.771286+0000","last_became_peered":"2024-09-12T18:35:44.771286+0000","last_unstale":"2024-09-12T18:37:46.571449+0000","last_undegraded":"2024-09-12T18:37:46.571449+0000","last_fullsized":"2024-09-12T18:37:46.571449+0000","mapping_epoch":21,"log_start":"68'12953","ondisk_log_start":"68'12953","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3090,"log_dups_size":0,"ondisk_log_size":3090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:10.094729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33882112,"num_objects":517,"num_object_clones":0,"num_object_copies":1034,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":517,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16043,"num_write_kb":529920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":135,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.499613+0000","last_change":"2024-09-12T18:35:24.653465+0000","last_active":"2024-09-12T18:37:45.499613+0000","last_peered":"2024-09-12T18:37:45.499613+0000","last_clean":"2024-09-12T18:37:45.499613+0000","last_became_active":"2024-09-12T18:35:24.652792+0000","last_became_peered":"2024-09-12T18:35:24.652792+0000","last_unstale":"2024-09-12T18:37:45.499613+0000","last_undegraded":"2024-09-12T18:37:45.499613+0000","last_fullsized":"2024-09-12T18:37:45.499613+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:14.588993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.494173+0000","last_change":"2024-09-12T18:35:25.655426+0000","last_active":"2024-09-12T18:37:45.494173+0000","last_peered":"2024-09-12T18:37:45.494173+0000","last_clean":"2024-09-12T18:37:45.494173+0000","last_became_active":"2024-09-12T18:35:25.648186+0000","last_became_peered":"2024-09-12T18:35:25.648186+0000","last_unstale":"2024-09-12T18:37:45.494173+0000","last_undegraded":"2024-09-12T18:37:45.494173+0000","last_fullsized":"2024-09-12T18:37:45.494173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:48.802815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"78'15982","reported_seq":16105,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:48.559938+0000","last_change":"2024-09-12T18:35:44.767860+0000","last_active":"2024-09-12T18:37:48.559938+0000","last_peered":"2024-09-12T18:37:48.559938+0000","last_clean":"2024-09-12T18:37:48.559938+0000","last_became_active":"2024-09-12T18:35:44.766986+0000","last_became_peered":"2024-09-12T18:35:44.766986+0000","last_unstale":"2024-09-12T18:37:48.559938+0000","last_undegraded":"2024-09-12T18:37:48.559938+0000","last_fullsized":"2024-09-12T18:37:48.559938+0000","mapping_epoch":21,"log_start":"68'12735","ondisk_log_start":"68'12735","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3247,"log_dups_size":0,"ondisk_log_size":3247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:49.109157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15597568,"num_objects":238,"num_object_clones":0,"num_object_copies":476,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":238,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15982,"num_write_kb":519040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":136,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.495273+0000","last_change":"2024-09-12T18:35:24.648439+0000","last_active":"2024-09-12T18:37:45.495273+0000","last_peered":"2024-09-12T18:37:45.495273+0000","last_clean":"2024-09-12T18:37:45.495273+0000","last_became_active":"2024-09-12T18:35:24.647629+0000","last_became_peered":"2024-09-12T18:35:24.647629+0000","last_unstale":"2024-09-12T18:37:45.495273+0000","last_undegraded":"2024-09-12T18:37:45.495273+0000","last_fullsized":"2024-09-12T18:37:45.495273+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:45.428223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.493983+0000","last_change":"2024-09-12T18:35:25.652496+0000","last_active":"2024-09-12T18:37:45.493983+0000","last_peered":"2024-09-12T18:37:45.493983+0000","last_clean":"2024-09-12T18:37:45.493983+0000","last_became_active":"2024-09-12T18:35:25.651628+0000","last_became_peered":"2024-09-12T18:35:25.651628+0000","last_unstale":"2024-09-12T18:37:45.493983+0000","last_undegraded":"2024-09-12T18:37:45.493983+0000","last_fullsized":"2024-09-12T18:37:45.493983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:44.920448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"78'16459","reported_seq":16582,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:48.557253+0000","last_change":"2024-09-12T18:35:44.767175+0000","last_active":"2024-09-12T18:37:48.557253+0000","last_peered":"2024-09-12T18:37:48.557253+0000","last_clean":"2024-09-12T18:37:48.557253+0000","last_became_active":"2024-09-12T18:35:44.766592+0000","last_became_peered":"2024-09-12T18:35:44.766592+0000","last_unstale":"2024-09-12T18:37:48.557253+0000","last_undegraded":"2024-09-12T18:37:48.557253+0000","last_fullsized":"2024-09-12T18:37:48.557253+0000","mapping_epoch":21,"log_start":"68'13148","ondisk_log_start":"68'13148","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3311,"log_dups_size":0,"ondisk_log_size":3311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:44.678279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15925248,"num_objects":243,"num_object_clones":0,"num_object_copies":486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":243,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16459,"num_write_kb":534464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":135,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.499090+0000","last_change":"2024-09-12T18:35:24.654976+0000","last_active":"2024-09-12T18:37:45.499090+0000","last_peered":"2024-09-12T18:37:45.499090+0000","last_clean":"2024-09-12T18:37:45.499090+0000","last_became_active":"2024-09-12T18:35:24.654264+0000","last_became_peered":"2024-09-12T18:35:24.654264+0000","last_unstale":"2024-09-12T18:37:45.499090+0000","last_undegraded":"2024-09-12T18:37:45.499090+0000","last_fullsized":"2024-09-12T18:37:45.499090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:00.115408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":138,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.498721+0000","last_change":"2024-09-12T18:36:40.070910+0000","last_active":"2024-09-12T18:37:45.498721+0000","last_peered":"2024-09-12T18:37:45.498721+0000","last_clean":"2024-09-12T18:37:45.498721+0000","last_became_active":"2024-09-12T18:36:40.070516+0000","last_became_peered":"2024-09-12T18:36:40.070516+0000","last_unstale":"2024-09-12T18:37:45.498721+0000","last_undegraded":"2024-09-12T18:37:45.498721+0000","last_fullsized":"2024-09-12T18:37:45.498721+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:23.962788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"78'16234","reported_seq":16357,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:46.562903+0000","last_change":"2024-09-12T18:35:44.763067+0000","last_active":"2024-09-12T18:37:46.562903+0000","last_peered":"2024-09-12T18:37:46.562903+0000","last_clean":"2024-09-12T18:37:46.562903+0000","last_became_active":"2024-09-12T18:35:44.762584+0000","last_became_peered":"2024-09-12T18:35:44.762584+0000","last_unstale":"2024-09-12T18:37:46.562903+0000","last_undegraded":"2024-09-12T18:37:46.562903+0000","last_fullsized":"2024-09-12T18:37:46.562903+0000","mapping_epoch":21,"log_start":"57'10166","ondisk_log_start":"57'10166","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":6068,"log_dups_size":0,"ondisk_log_size":6068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:47.847399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36831232,"num_objects":562,"num_object_clones":0,"num_object_copies":1124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":562,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16234,"num_write_kb":537472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.498807+0000","last_change":"2024-09-12T18:35:24.657665+0000","last_active":"2024-09-12T18:37:45.498807+0000","last_peered":"2024-09-12T18:37:45.498807+0000","last_clean":"2024-09-12T18:37:45.498807+0000","last_became_active":"2024-09-12T18:35:24.657015+0000","last_became_peered":"2024-09-12T18:35:24.657015+0000","last_unstale":"2024-09-12T18:37:45.498807+0000","last_undegraded":"2024-09-12T18:37:45.498807+0000","last_fullsized":"2024-09-12T18:37:45.498807+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:03.171326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.501320+0000","last_change":"2024-09-12T18:35:25.665275+0000","last_active":"2024-09-12T18:37:45.501320+0000","last_peered":"2024-09-12T18:37:45.501320+0000","last_clean":"2024-09-12T18:37:45.501320+0000","last_became_active":"2024-09-12T18:35:25.659511+0000","last_became_peered":"2024-09-12T18:35:25.659511+0000","last_unstale":"2024-09-12T18:37:45.501320+0000","last_undegraded":"2024-09-12T18:37:45.501320+0000","last_fullsized":"2024-09-12T18:37:45.501320+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"78'16521","reported_seq":16645,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:48.559904+0000","last_change":"2024-09-12T18:35:44.773526+0000","last_active":"2024-09-12T18:37:48.559904+0000","last_peered":"2024-09-12T18:37:48.559904+0000","last_clean":"2024-09-12T18:37:48.559904+0000","last_became_active":"2024-09-12T18:35:44.772974+0000","last_became_peered":"2024-09-12T18:35:44.772974+0000","last_unstale":"2024-09-12T18:37:48.559904+0000","last_undegraded":"2024-09-12T18:37:48.559904+0000","last_fullsized":"2024-09-12T18:37:48.559904+0000","mapping_epoch":21,"log_start":"68'13266","ondisk_log_start":"68'13266","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3255,"log_dups_size":0,"ondisk_log_size":3255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:23.676840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16252952,"num_objects":249,"num_object_clones":0,"num_object_copies":498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":249,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":16521,"num_write_kb":536577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":83,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.504370+0000","last_change":"2024-09-12T18:36:40.115783+0000","last_active":"2024-09-12T18:37:45.504370+0000","last_peered":"2024-09-12T18:37:45.504370+0000","last_clean":"2024-09-12T18:37:45.504370+0000","last_became_active":"2024-09-12T18:36:40.068020+0000","last_became_peered":"2024-09-12T18:36:40.068020+0000","last_unstale":"2024-09-12T18:37:45.504370+0000","last_undegraded":"2024-09-12T18:37:45.504370+0000","last_fullsized":"2024-09-12T18:37:45.504370+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:02.999068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":138,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.498545+0000","last_change":"2024-09-12T18:36:39.071809+0000","last_active":"2024-09-12T18:37:45.498545+0000","last_peered":"2024-09-12T18:37:45.498545+0000","last_clean":"2024-09-12T18:37:45.498545+0000","last_became_active":"2024-09-12T18:36:39.070888+0000","last_became_peered":"2024-09-12T18:36:39.070888+0000","last_unstale":"2024-09-12T18:37:45.498545+0000","last_undegraded":"2024-09-12T18:37:45.498545+0000","last_fullsized":"2024-09-12T18:37:45.498545+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:19.740732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"78'15875","reported_seq":15998,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:46.549750+0000","last_change":"2024-09-12T18:35:44.767970+0000","last_active":"2024-09-12T18:37:46.549750+0000","last_peered":"2024-09-12T18:37:46.549750+0000","last_clean":"2024-09-12T18:37:46.549750+0000","last_became_active":"2024-09-12T18:35:44.767348+0000","last_became_peered":"2024-09-12T18:35:44.767348+0000","last_unstale":"2024-09-12T18:37:46.549750+0000","last_undegraded":"2024-09-12T18:37:46.549750+0000","last_fullsized":"2024-09-12T18:37:46.549750+0000","mapping_epoch":21,"log_start":"57'9799","ondisk_log_start":"57'9799","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":6076,"log_dups_size":0,"ondisk_log_size":6076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:48.745907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34406400,"num_objects":525,"num_object_clones":0,"num_object_copies":1050,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":525,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15875,"num_write_kb":524800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.501333+0000","last_change":"2024-09-12T18:35:24.659019+0000","last_active":"2024-09-12T18:37:45.501333+0000","last_peered":"2024-09-12T18:37:45.501333+0000","last_clean":"2024-09-12T18:37:45.501333+0000","last_became_active":"2024-09-12T18:35:24.658423+0000","last_became_peered":"2024-09-12T18:35:24.658423+0000","last_unstale":"2024-09-12T18:37:45.501333+0000","last_undegraded":"2024-09-12T18:37:45.501333+0000","last_fullsized":"2024-09-12T18:37:45.501333+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:37.668417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.499197+0000","last_change":"2024-09-12T18:35:25.662287+0000","last_active":"2024-09-12T18:37:45.499197+0000","last_peered":"2024-09-12T18:37:45.499197+0000","last_clean":"2024-09-12T18:37:45.499197+0000","last_became_active":"2024-09-12T18:35:25.660372+0000","last_became_peered":"2024-09-12T18:35:25.660372+0000","last_unstale":"2024-09-12T18:37:45.499197+0000","last_undegraded":"2024-09-12T18:37:45.499197+0000","last_fullsized":"2024-09-12T18:37:45.499197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:08.729541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.f","version":"78'15796","reported_seq":15919,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:46.563542+0000","last_change":"2024-09-12T18:35:44.774817+0000","last_active":"2024-09-12T18:37:46.563542+0000","last_peered":"2024-09-12T18:37:46.563542+0000","last_clean":"2024-09-12T18:37:46.563542+0000","last_became_active":"2024-09-12T18:35:44.774429+0000","last_became_peered":"2024-09-12T18:35:44.774429+0000","last_unstale":"2024-09-12T18:37:46.563542+0000","last_undegraded":"2024-09-12T18:37:46.563542+0000","last_fullsized":"2024-09-12T18:37:46.563542+0000","mapping_epoch":21,"log_start":"68'12724","ondisk_log_start":"68'12724","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3072,"log_dups_size":0,"ondisk_log_size":3072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:21.579103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34078720,"num_objects":520,"num_object_clones":0,"num_object_copies":1040,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":520,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15796,"num_write_kb":522112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.494183+0000","last_change":"2024-09-12T18:35:24.648330+0000","last_active":"2024-09-12T18:37:45.494183+0000","last_peered":"2024-09-12T18:37:45.494183+0000","last_clean":"2024-09-12T18:37:45.494183+0000","last_became_active":"2024-09-12T18:35:24.647520+0000","last_became_peered":"2024-09-12T18:35:24.647520+0000","last_unstale":"2024-09-12T18:37:45.494183+0000","last_undegraded":"2024-09-12T18:37:45.494183+0000","last_fullsized":"2024-09-12T18:37:45.494183+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:25.552055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.499062+0000","last_change":"2024-09-12T18:35:25.658674+0000","last_active":"2024-09-12T18:37:45.499062+0000","last_peered":"2024-09-12T18:37:45.499062+0000","last_clean":"2024-09-12T18:37:45.499062+0000","last_became_active":"2024-09-12T18:35:25.657386+0000","last_became_peered":"2024-09-12T18:35:25.657386+0000","last_unstale":"2024-09-12T18:37:45.499062+0000","last_undegraded":"2024-09-12T18:37:45.499062+0000","last_fullsized":"2024-09-12T18:37:45.499062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:48.037086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"78'16483","reported_seq":16606,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:48.553600+0000","last_change":"2024-09-12T18:35:44.771738+0000","last_active":"2024-09-12T18:37:48.553600+0000","last_peered":"2024-09-12T18:37:48.553600+0000","last_clean":"2024-09-12T18:37:48.553600+0000","last_became_active":"2024-09-12T18:35:44.771227+0000","last_became_peered":"2024-09-12T18:35:44.771227+0000","last_unstale":"2024-09-12T18:37:48.553600+0000","last_undegraded":"2024-09-12T18:37:48.553600+0000","last_fullsized":"2024-09-12T18:37:48.553600+0000","mapping_epoch":21,"log_start":"68'13193","ondisk_log_start":"68'13193","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3290,"log_dups_size":0,"ondisk_log_size":3290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:27.329732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14352384,"num_objects":219,"num_object_clones":0,"num_object_copies":438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":219,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16483,"num_write_kb":534464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.493926+0000","last_change":"2024-09-12T18:35:24.646810+0000","last_active":"2024-09-12T18:37:45.493926+0000","last_peered":"2024-09-12T18:37:45.493926+0000","last_clean":"2024-09-12T18:37:45.493926+0000","last_became_active":"2024-09-12T18:35:24.646008+0000","last_became_peered":"2024-09-12T18:35:24.646008+0000","last_unstale":"2024-09-12T18:37:45.493926+0000","last_undegraded":"2024-09-12T18:37:45.493926+0000","last_fullsized":"2024-09-12T18:37:45.493926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:43.888776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.502236+0000","last_change":"2024-09-12T18:35:25.667710+0000","last_active":"2024-09-12T18:37:45.502236+0000","last_peered":"2024-09-12T18:37:45.502236+0000","last_clean":"2024-09-12T18:37:45.502236+0000","last_became_active":"2024-09-12T18:35:25.666940+0000","last_became_peered":"2024-09-12T18:35:25.666940+0000","last_unstale":"2024-09-12T18:37:45.502236+0000","last_undegraded":"2024-09-12T18:37:45.502236+0000","last_fullsized":"2024-09-12T18:37:45.502236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:09.823085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"78'16143","reported_seq":16265,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:48.565081+0000","last_change":"2024-09-12T18:35:44.769127+0000","last_active":"2024-09-12T18:37:48.565081+0000","last_peered":"2024-09-12T18:37:48.565081+0000","last_clean":"2024-09-12T18:37:48.565081+0000","last_became_active":"2024-09-12T18:35:44.768382+0000","last_became_peered":"2024-09-12T18:35:44.768382+0000","last_unstale":"2024-09-12T18:37:48.565081+0000","last_undegraded":"2024-09-12T18:37:48.565081+0000","last_fullsized":"2024-09-12T18:37:48.565081+0000","mapping_epoch":21,"log_start":"68'12829","ondisk_log_start":"68'12829","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3314,"log_dups_size":0,"ondisk_log_size":3314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:33.385476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15925248,"num_objects":243,"num_object_clones":0,"num_object_copies":486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":243,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16143,"num_write_kb":524352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":284,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.499491+0000","last_change":"2024-09-12T18:35:13.489018+0000","last_active":"2024-09-12T18:37:45.499491+0000","last_peered":"2024-09-12T18:37:45.499491+0000","last_clean":"2024-09-12T18:37:45.499491+0000","last_became_active":"2024-09-12T18:35:13.488346+0000","last_became_peered":"2024-09-12T18:35:13.488346+0000","last_unstale":"2024-09-12T18:37:45.499491+0000","last_undegraded":"2024-09-12T18:37:45.499491+0000","last_fullsized":"2024-09-12T18:37:45.499491+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_clean_scrub_stamp":"2024-09-12T18:35:12.464628+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:54.864640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":148,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.505879+0000","last_change":"2024-09-12T18:35:22.459694+0000","last_active":"2024-09-12T18:37:45.505879+0000","last_peered":"2024-09-12T18:37:45.505879+0000","last_clean":"2024-09-12T18:37:45.505879+0000","last_became_active":"2024-09-12T18:35:20.446796+0000","last_became_peered":"2024-09-12T18:35:20.446796+0000","last_unstale":"2024-09-12T18:37:45.505879+0000","last_undegraded":"2024-09-12T18:37:45.505879+0000","last_fullsized":"2024-09-12T18:37:45.505879+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:21.506024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016291610000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":70,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.494194+0000","last_change":"2024-09-12T18:36:39.072775+0000","last_active":"2024-09-12T18:37:45.494194+0000","last_peered":"2024-09-12T18:37:45.494194+0000","last_clean":"2024-09-12T18:37:45.494194+0000","last_became_active":"2024-09-12T18:36:39.072247+0000","last_became_peered":"2024-09-12T18:36:39.072247+0000","last_unstale":"2024-09-12T18:37:45.494194+0000","last_undegraded":"2024-09-12T18:37:45.494194+0000","last_fullsized":"2024-09-12T18:37:45.494194+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:07.105080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.499225+0000","last_change":"2024-09-12T18:35:25.662424+0000","last_active":"2024-09-12T18:37:45.499225+0000","last_peered":"2024-09-12T18:37:45.499225+0000","last_clean":"2024-09-12T18:37:45.499225+0000","last_became_active":"2024-09-12T18:35:25.661043+0000","last_became_peered":"2024-09-12T18:35:25.661043+0000","last_unstale":"2024-09-12T18:37:45.499225+0000","last_undegraded":"2024-09-12T18:37:45.499225+0000","last_fullsized":"2024-09-12T18:37:45.499225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:52.551802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.7","version":"78'16106","reported_seq":16228,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:46.569247+0000","last_change":"2024-09-12T18:35:44.774505+0000","last_active":"2024-09-12T18:37:46.569247+0000","last_peered":"2024-09-12T18:37:46.569247+0000","last_clean":"2024-09-12T18:37:46.569247+0000","last_became_active":"2024-09-12T18:35:44.774259+0000","last_became_peered":"2024-09-12T18:35:44.774259+0000","last_unstale":"2024-09-12T18:37:46.569247+0000","last_undegraded":"2024-09-12T18:37:46.569247+0000","last_fullsized":"2024-09-12T18:37:46.569247+0000","mapping_epoch":21,"log_start":"68'13069","ondisk_log_start":"68'13069","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3037,"log_dups_size":0,"ondisk_log_size":3037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:21.731670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34209792,"num_objects":522,"num_object_clones":0,"num_object_copies":1044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":522,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16106,"num_write_kb":532096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":147,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.499147+0000","last_change":"2024-09-12T18:35:22.459090+0000","last_active":"2024-09-12T18:37:45.499147+0000","last_peered":"2024-09-12T18:37:45.499147+0000","last_clean":"2024-09-12T18:37:45.499147+0000","last_became_active":"2024-09-12T18:35:20.448553+0000","last_became_peered":"2024-09-12T18:35:20.448553+0000","last_unstale":"2024-09-12T18:37:45.499147+0000","last_undegraded":"2024-09-12T18:37:45.499147+0000","last_fullsized":"2024-09-12T18:37:45.499147+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:56.834808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001030836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.500783+0000","last_change":"2024-09-12T18:35:24.651597+0000","last_active":"2024-09-12T18:37:45.500783+0000","last_peered":"2024-09-12T18:37:45.500783+0000","last_clean":"2024-09-12T18:37:45.500783+0000","last_became_active":"2024-09-12T18:35:24.649940+0000","last_became_peered":"2024-09-12T18:35:24.649940+0000","last_unstale":"2024-09-12T18:37:45.500783+0000","last_undegraded":"2024-09-12T18:37:45.500783+0000","last_fullsized":"2024-09-12T18:37:45.500783+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:36.822432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":138,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.495178+0000","last_change":"2024-09-12T18:36:39.076901+0000","last_active":"2024-09-12T18:37:45.495178+0000","last_peered":"2024-09-12T18:37:45.495178+0000","last_clean":"2024-09-12T18:37:45.495178+0000","last_became_active":"2024-09-12T18:36:39.076178+0000","last_became_peered":"2024-09-12T18:36:39.076178+0000","last_unstale":"2024-09-12T18:37:45.495178+0000","last_undegraded":"2024-09-12T18:37:45.495178+0000","last_fullsized":"2024-09-12T18:37:45.495178+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:42.901643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"78'15990","reported_seq":16113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:46.548483+0000","last_change":"2024-09-12T18:35:44.770379+0000","last_active":"2024-09-12T18:37:46.548483+0000","last_peered":"2024-09-12T18:37:46.548483+0000","last_clean":"2024-09-12T18:37:46.548483+0000","last_became_active":"2024-09-12T18:35:44.769739+0000","last_became_peered":"2024-09-12T18:35:44.769739+0000","last_unstale":"2024-09-12T18:37:46.548483+0000","last_undegraded":"2024-09-12T18:37:46.548483+0000","last_fullsized":"2024-09-12T18:37:46.548483+0000","mapping_epoch":21,"log_start":"57'9923","ondisk_log_start":"57'9923","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":6067,"log_dups_size":0,"ondisk_log_size":6067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:02:23.077263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":544,"num_object_clones":0,"num_object_copies":1088,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":544,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15990,"num_write_kb":529088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":147,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.500912+0000","last_change":"2024-09-12T18:35:22.464179+0000","last_active":"2024-09-12T18:37:45.500912+0000","last_peered":"2024-09-12T18:37:45.500912+0000","last_clean":"2024-09-12T18:37:45.500912+0000","last_became_active":"2024-09-12T18:35:20.442613+0000","last_became_peered":"2024-09-12T18:35:20.442613+0000","last_unstale":"2024-09-12T18:37:45.500912+0000","last_undegraded":"2024-09-12T18:37:45.500912+0000","last_fullsized":"2024-09-12T18:37:45.500912+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:17.636537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014134620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.493885+0000","last_change":"2024-09-12T18:35:24.641297+0000","last_active":"2024-09-12T18:37:45.493885+0000","last_peered":"2024-09-12T18:37:45.493885+0000","last_clean":"2024-09-12T18:37:45.493885+0000","last_became_active":"2024-09-12T18:35:24.637334+0000","last_became_peered":"2024-09-12T18:35:24.637334+0000","last_unstale":"2024-09-12T18:37:45.493885+0000","last_undegraded":"2024-09-12T18:37:45.493885+0000","last_fullsized":"2024-09-12T18:37:45.493885+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:50.772074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":68,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.495425+0000","last_change":"2024-09-12T18:36:40.073534+0000","last_active":"2024-09-12T18:37:45.495425+0000","last_peered":"2024-09-12T18:37:45.495425+0000","last_clean":"2024-09-12T18:37:45.495425+0000","last_became_active":"2024-09-12T18:36:40.071694+0000","last_became_peered":"2024-09-12T18:36:40.071694+0000","last_unstale":"2024-09-12T18:37:45.495425+0000","last_undegraded":"2024-09-12T18:37:45.495425+0000","last_fullsized":"2024-09-12T18:37:45.495425+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:16.018454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"78'16207","reported_seq":22828,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:46.565993+0000","last_change":"2024-09-12T18:37:35.345752+0000","last_active":"2024-09-12T18:37:46.565993+0000","last_peered":"2024-09-12T18:37:46.565993+0000","last_clean":"2024-09-12T18:37:46.565993+0000","last_became_active":"2024-09-12T18:37:35.269137+0000","last_became_peered":"2024-09-12T18:37:35.269137+0000","last_unstale":"2024-09-12T18:37:46.565993+0000","last_undegraded":"2024-09-12T18:37:46.565993+0000","last_fullsized":"2024-09-12T18:37:46.565993+0000","mapping_epoch":73,"log_start":"68'13124","ondisk_log_start":"68'13124","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3083,"log_dups_size":0,"ondisk_log_size":3083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:59.463354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35717120,"num_objects":545,"num_object_clones":0,"num_object_copies":1090,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":545,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16207,"num_write_kb":536064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3242,"num_bytes_recovered":212467712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":149,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.501356+0000","last_change":"2024-09-12T18:35:22.459049+0000","last_active":"2024-09-12T18:37:45.501356+0000","last_peered":"2024-09-12T18:37:45.501356+0000","last_clean":"2024-09-12T18:37:45.501356+0000","last_became_active":"2024-09-12T18:35:20.446814+0000","last_became_peered":"2024-09-12T18:35:20.446814+0000","last_unstale":"2024-09-12T18:37:45.501356+0000","last_undegraded":"2024-09-12T18:37:45.501356+0000","last_fullsized":"2024-09-12T18:37:45.501356+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:18.033595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010716149999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.505790+0000","last_change":"2024-09-12T18:35:24.658273+0000","last_active":"2024-09-12T18:37:45.505790+0000","last_peered":"2024-09-12T18:37:45.505790+0000","last_clean":"2024-09-12T18:37:45.505790+0000","last_became_active":"2024-09-12T18:35:24.657433+0000","last_became_peered":"2024-09-12T18:35:24.657433+0000","last_unstale":"2024-09-12T18:37:45.505790+0000","last_undegraded":"2024-09-12T18:37:45.505790+0000","last_fullsized":"2024-09-12T18:37:45.505790+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:48.497218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":68,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.494353+0000","last_change":"2024-09-12T18:36:40.076054+0000","last_active":"2024-09-12T18:37:45.494353+0000","last_peered":"2024-09-12T18:37:45.494353+0000","last_clean":"2024-09-12T18:37:45.494353+0000","last_became_active":"2024-09-12T18:36:40.073803+0000","last_became_peered":"2024-09-12T18:36:40.073803+0000","last_unstale":"2024-09-12T18:37:45.494353+0000","last_undegraded":"2024-09-12T18:37:45.494353+0000","last_fullsized":"2024-09-12T18:37:45.494353+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:49.085420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"78'15734","reported_seq":15856,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:46.560179+0000","last_change":"2024-09-12T18:35:44.770799+0000","last_active":"2024-09-12T18:37:46.560179+0000","last_peered":"2024-09-12T18:37:46.560179+0000","last_clean":"2024-09-12T18:37:46.560179+0000","last_became_active":"2024-09-12T18:35:44.770030+0000","last_became_peered":"2024-09-12T18:35:44.770030+0000","last_unstale":"2024-09-12T18:37:46.560179+0000","last_undegraded":"2024-09-12T18:37:46.560179+0000","last_fullsized":"2024-09-12T18:37:46.560179+0000","mapping_epoch":21,"log_start":"57'9656","ondisk_log_start":"57'9656","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":6078,"log_dups_size":0,"ondisk_log_size":6078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:24.786452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33423360,"num_objects":510,"num_object_clones":0,"num_object_copies":1020,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":510,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15734,"num_write_kb":519808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.498684+0000","last_change":"2024-09-12T18:35:24.657618+0000","last_active":"2024-09-12T18:37:45.498684+0000","last_peered":"2024-09-12T18:37:45.498684+0000","last_clean":"2024-09-12T18:37:45.498684+0000","last_became_active":"2024-09-12T18:35:24.656741+0000","last_became_peered":"2024-09-12T18:35:24.656741+0000","last_unstale":"2024-09-12T18:37:45.498684+0000","last_undegraded":"2024-09-12T18:37:45.498684+0000","last_fullsized":"2024-09-12T18:37:45.498684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:43.113104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":147,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.501086+0000","last_change":"2024-09-12T18:35:22.464180+0000","last_active":"2024-09-12T18:37:45.501086+0000","last_peered":"2024-09-12T18:37:45.501086+0000","last_clean":"2024-09-12T18:37:45.501086+0000","last_became_active":"2024-09-12T18:35:20.442566+0000","last_became_peered":"2024-09-12T18:35:20.442566+0000","last_unstale":"2024-09-12T18:37:45.501086+0000","last_undegraded":"2024-09-12T18:37:45.501086+0000","last_fullsized":"2024-09-12T18:37:45.501086+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:29.021710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001325786,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.494321+0000","last_change":"2024-09-12T18:35:25.650458+0000","last_active":"2024-09-12T18:37:45.494321+0000","last_peered":"2024-09-12T18:37:45.494321+0000","last_clean":"2024-09-12T18:37:45.494321+0000","last_became_active":"2024-09-12T18:35:25.648761+0000","last_became_peered":"2024-09-12T18:35:25.648761+0000","last_unstale":"2024-09-12T18:37:45.494321+0000","last_undegraded":"2024-09-12T18:37:45.494321+0000","last_fullsized":"2024-09-12T18:37:45.494321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:53.026950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"78'15888","reported_seq":16011,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:46.563466+0000","last_change":"2024-09-12T18:35:44.773801+0000","last_active":"2024-09-12T18:37:46.563466+0000","last_peered":"2024-09-12T18:37:46.563466+0000","last_clean":"2024-09-12T18:37:46.563466+0000","last_became_active":"2024-09-12T18:35:44.772787+0000","last_became_peered":"2024-09-12T18:35:44.772787+0000","last_unstale":"2024-09-12T18:37:46.563466+0000","last_undegraded":"2024-09-12T18:37:46.563466+0000","last_fullsized":"2024-09-12T18:37:46.563466+0000","mapping_epoch":21,"log_start":"68'12782","ondisk_log_start":"68'12782","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3106,"log_dups_size":0,"ondisk_log_size":3106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:13.758208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":512,"num_object_clones":0,"num_object_copies":1024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":512,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15888,"num_write_kb":524800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":68,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.494836+0000","last_change":"2024-09-12T18:36:40.076936+0000","last_active":"2024-09-12T18:37:45.494836+0000","last_peered":"2024-09-12T18:37:45.494836+0000","last_clean":"2024-09-12T18:37:45.494836+0000","last_became_active":"2024-09-12T18:36:40.075987+0000","last_became_peered":"2024-09-12T18:36:40.075987+0000","last_unstale":"2024-09-12T18:37:45.494836+0000","last_undegraded":"2024-09-12T18:37:45.494836+0000","last_fullsized":"2024-09-12T18:37:45.494836+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:31.242588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":153,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.496911+0000","last_change":"2024-09-12T18:36:40.107062+0000","last_active":"2024-09-12T18:37:45.496911+0000","last_peered":"2024-09-12T18:37:45.496911+0000","last_clean":"2024-09-12T18:37:45.496911+0000","last_became_active":"2024-09-12T18:36:40.106366+0000","last_became_peered":"2024-09-12T18:36:40.106366+0000","last_unstale":"2024-09-12T18:37:45.496911+0000","last_undegraded":"2024-09-12T18:37:45.496911+0000","last_fullsized":"2024-09-12T18:37:45.496911+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:43.504139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080163599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.494462+0000","last_change":"2024-09-12T18:35:25.650717+0000","last_active":"2024-09-12T18:37:45.494462+0000","last_peered":"2024-09-12T18:37:45.494462+0000","last_clean":"2024-09-12T18:37:45.494462+0000","last_became_active":"2024-09-12T18:35:25.649147+0000","last_became_peered":"2024-09-12T18:35:25.649147+0000","last_unstale":"2024-09-12T18:37:45.494462+0000","last_undegraded":"2024-09-12T18:37:45.494462+0000","last_fullsized":"2024-09-12T18:37:45.494462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:07.365888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"78'15949","reported_seq":29015,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:46.561893+0000","last_change":"2024-09-12T18:37:17.275703+0000","last_active":"2024-09-12T18:37:46.561893+0000","last_peered":"2024-09-12T18:37:46.561893+0000","last_clean":"2024-09-12T18:37:46.561893+0000","last_became_active":"2024-09-12T18:37:17.230502+0000","last_became_peered":"2024-09-12T18:37:17.230502+0000","last_unstale":"2024-09-12T18:37:46.561893+0000","last_undegraded":"2024-09-12T18:37:46.561893+0000","last_fullsized":"2024-09-12T18:37:46.561893+0000","mapping_epoch":65,"log_start":"68'12901","ondisk_log_start":"68'12901","created":21,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3048,"log_dups_size":0,"ondisk_log_size":3048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:25.651321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35061760,"num_objects":535,"num_object_clones":0,"num_object_copies":1070,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":535,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15949,"num_write_kb":527488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6464,"num_bytes_recovered":423624704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":136,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.502517+0000","last_change":"2024-09-12T18:35:24.657234+0000","last_active":"2024-09-12T18:37:45.502517+0000","last_peered":"2024-09-12T18:37:45.502517+0000","last_clean":"2024-09-12T18:37:45.502517+0000","last_became_active":"2024-09-12T18:35:24.655950+0000","last_became_peered":"2024-09-12T18:35:24.655950+0000","last_unstale":"2024-09-12T18:37:45.502517+0000","last_undegraded":"2024-09-12T18:37:45.502517+0000","last_fullsized":"2024-09-12T18:37:45.502517+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:17.466623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.498292+0000","last_change":"2024-09-12T18:37:34.258443+0000","last_active":"2024-09-12T18:37:45.498292+0000","last_peered":"2024-09-12T18:37:45.498292+0000","last_clean":"2024-09-12T18:37:45.498292+0000","last_became_active":"2024-09-12T18:37:34.254999+0000","last_became_peered":"2024-09-12T18:37:34.254999+0000","last_unstale":"2024-09-12T18:37:45.498292+0000","last_undegraded":"2024-09-12T18:37:45.498292+0000","last_fullsized":"2024-09-12T18:37:45.498292+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:23.164676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":70,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.497932+0000","last_change":"2024-09-12T18:36:39.071682+0000","last_active":"2024-09-12T18:37:45.497932+0000","last_peered":"2024-09-12T18:37:45.497932+0000","last_clean":"2024-09-12T18:37:45.497932+0000","last_became_active":"2024-09-12T18:36:39.070834+0000","last_became_peered":"2024-09-12T18:36:39.070834+0000","last_unstale":"2024-09-12T18:37:45.497932+0000","last_undegraded":"2024-09-12T18:37:45.497932+0000","last_fullsized":"2024-09-12T18:37:45.497932+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:58.394442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"78'16426","reported_seq":29546,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:48.564869+0000","last_change":"2024-09-12T18:37:17.272272+0000","last_active":"2024-09-12T18:37:48.564869+0000","last_peered":"2024-09-12T18:37:48.564869+0000","last_clean":"2024-09-12T18:37:48.564869+0000","last_became_active":"2024-09-12T18:37:17.229009+0000","last_became_peered":"2024-09-12T18:37:17.229009+0000","last_unstale":"2024-09-12T18:37:48.564869+0000","last_undegraded":"2024-09-12T18:37:48.564869+0000","last_fullsized":"2024-09-12T18:37:48.564869+0000","mapping_epoch":65,"log_start":"68'13128","ondisk_log_start":"68'13128","created":21,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:43.732737+0000","last_clean_scrub_stamp":"2024-09-12T18:35:43.732737+0000","objects_scrubbed":0,"log_size":3298,"log_dups_size":0,"ondisk_log_size":3298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:54.939350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15073280,"num_objects":230,"num_object_clones":0,"num_object_copies":460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":230,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16426,"num_write_kb":532992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6490,"num_bytes_recovered":425328640,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":86,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.498809+0000","last_change":"2024-09-12T18:36:40.122885+0000","last_active":"2024-09-12T18:37:45.498809+0000","last_peered":"2024-09-12T18:37:45.498809+0000","last_clean":"2024-09-12T18:37:45.498809+0000","last_became_active":"2024-09-12T18:36:40.090372+0000","last_became_peered":"2024-09-12T18:36:40.090372+0000","last_unstale":"2024-09-12T18:37:45.498809+0000","last_undegraded":"2024-09-12T18:37:45.498809+0000","last_fullsized":"2024-09-12T18:37:45.498809+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:55.648109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":147,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.499732+0000","last_change":"2024-09-12T18:35:22.459767+0000","last_active":"2024-09-12T18:37:45.499732+0000","last_peered":"2024-09-12T18:37:45.499732+0000","last_clean":"2024-09-12T18:37:45.499732+0000","last_became_active":"2024-09-12T18:35:20.448521+0000","last_became_peered":"2024-09-12T18:35:20.448521+0000","last_unstale":"2024-09-12T18:37:45.499732+0000","last_undegraded":"2024-09-12T18:37:45.499732+0000","last_fullsized":"2024-09-12T18:37:45.499732+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:33.463792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017009670000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.493986+0000","last_change":"2024-09-12T18:35:25.648150+0000","last_active":"2024-09-12T18:37:45.493986+0000","last_peered":"2024-09-12T18:37:45.493986+0000","last_clean":"2024-09-12T18:37:45.493986+0000","last_became_active":"2024-09-12T18:35:25.647347+0000","last_became_peered":"2024-09-12T18:35:25.647347+0000","last_unstale":"2024-09-12T18:37:45.493986+0000","last_undegraded":"2024-09-12T18:37:45.493986+0000","last_fullsized":"2024-09-12T18:37:45.493986+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:48.968336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.505460+0000","last_change":"2024-09-12T18:35:25.660696+0000","last_active":"2024-09-12T18:37:45.505460+0000","last_peered":"2024-09-12T18:37:45.505460+0000","last_clean":"2024-09-12T18:37:45.505460+0000","last_became_active":"2024-09-12T18:35:25.659827+0000","last_became_peered":"2024-09-12T18:35:25.659827+0000","last_unstale":"2024-09-12T18:37:45.505460+0000","last_undegraded":"2024-09-12T18:37:45.505460+0000","last_fullsized":"2024-09-12T18:37:45.505460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:15.678289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":140,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.498752+0000","last_change":"2024-09-12T18:35:24.655051+0000","last_active":"2024-09-12T18:37:45.498752+0000","last_peered":"2024-09-12T18:37:45.498752+0000","last_clean":"2024-09-12T18:37:45.498752+0000","last_became_active":"2024-09-12T18:35:24.654282+0000","last_became_peered":"2024-09-12T18:35:24.654282+0000","last_unstale":"2024-09-12T18:37:45.498752+0000","last_undegraded":"2024-09-12T18:37:45.498752+0000","last_fullsized":"2024-09-12T18:37:45.498752+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:08.159799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":68,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.494001+0000","last_change":"2024-09-12T18:36:40.073370+0000","last_active":"2024-09-12T18:37:45.494001+0000","last_peered":"2024-09-12T18:37:45.494001+0000","last_clean":"2024-09-12T18:37:45.494001+0000","last_became_active":"2024-09-12T18:36:40.071392+0000","last_became_peered":"2024-09-12T18:36:40.071392+0000","last_unstale":"2024-09-12T18:37:45.494001+0000","last_undegraded":"2024-09-12T18:37:45.494001+0000","last_fullsized":"2024-09-12T18:37:45.494001+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:32:33.237004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":136,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.496984+0000","last_change":"2024-09-12T18:35:24.648658+0000","last_active":"2024-09-12T18:37:45.496984+0000","last_peered":"2024-09-12T18:37:45.496984+0000","last_clean":"2024-09-12T18:37:45.496984+0000","last_became_active":"2024-09-12T18:35:24.647826+0000","last_became_peered":"2024-09-12T18:35:24.647826+0000","last_unstale":"2024-09-12T18:37:45.496984+0000","last_undegraded":"2024-09-12T18:37:45.496984+0000","last_fullsized":"2024-09-12T18:37:45.496984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:24.167549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":139,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.499371+0000","last_change":"2024-09-12T18:36:40.091223+0000","last_active":"2024-09-12T18:37:45.499371+0000","last_peered":"2024-09-12T18:37:45.499371+0000","last_clean":"2024-09-12T18:37:45.499371+0000","last_became_active":"2024-09-12T18:36:40.090813+0000","last_became_peered":"2024-09-12T18:36:40.090813+0000","last_unstale":"2024-09-12T18:37:45.499371+0000","last_undegraded":"2024-09-12T18:37:45.499371+0000","last_fullsized":"2024-09-12T18:37:45.499371+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:26.055034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.500750+0000","last_change":"2024-09-12T18:35:25.661801+0000","last_active":"2024-09-12T18:37:45.500750+0000","last_peered":"2024-09-12T18:37:45.500750+0000","last_clean":"2024-09-12T18:37:45.500750+0000","last_became_active":"2024-09-12T18:35:25.658476+0000","last_became_peered":"2024-09-12T18:35:25.658476+0000","last_unstale":"2024-09-12T18:37:45.500750+0000","last_undegraded":"2024-09-12T18:37:45.500750+0000","last_fullsized":"2024-09-12T18:37:45.500750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:58.246449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":133,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.502360+0000","last_change":"2024-09-12T18:35:24.652399+0000","last_active":"2024-09-12T18:37:45.502360+0000","last_peered":"2024-09-12T18:37:45.502360+0000","last_clean":"2024-09-12T18:37:45.502360+0000","last_became_active":"2024-09-12T18:35:24.651416+0000","last_became_peered":"2024-09-12T18:35:24.651416+0000","last_unstale":"2024-09-12T18:37:45.502360+0000","last_undegraded":"2024-09-12T18:37:45.502360+0000","last_fullsized":"2024-09-12T18:37:45.502360+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:32.594978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":70,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.494412+0000","last_change":"2024-09-12T18:36:39.073330+0000","last_active":"2024-09-12T18:37:45.494412+0000","last_peered":"2024-09-12T18:37:45.494412+0000","last_clean":"2024-09-12T18:37:45.494412+0000","last_became_active":"2024-09-12T18:36:39.072515+0000","last_became_peered":"2024-09-12T18:36:39.072515+0000","last_unstale":"2024-09-12T18:37:45.494412+0000","last_undegraded":"2024-09-12T18:37:45.494412+0000","last_fullsized":"2024-09-12T18:37:45.494412+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:17.697509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.495735+0000","last_change":"2024-09-12T18:35:25.651217+0000","last_active":"2024-09-12T18:37:45.495735+0000","last_peered":"2024-09-12T18:37:45.495735+0000","last_clean":"2024-09-12T18:37:45.495735+0000","last_became_active":"2024-09-12T18:35:25.649544+0000","last_became_peered":"2024-09-12T18:35:25.649544+0000","last_unstale":"2024-09-12T18:37:45.495735+0000","last_undegraded":"2024-09-12T18:37:45.495735+0000","last_fullsized":"2024-09-12T18:37:45.495735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:41.601376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":70,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.493805+0000","last_change":"2024-09-12T18:36:39.076239+0000","last_active":"2024-09-12T18:37:45.493805+0000","last_peered":"2024-09-12T18:37:45.493805+0000","last_clean":"2024-09-12T18:37:45.493805+0000","last_became_active":"2024-09-12T18:36:39.075023+0000","last_became_peered":"2024-09-12T18:36:39.075023+0000","last_unstale":"2024-09-12T18:37:45.493805+0000","last_undegraded":"2024-09-12T18:37:45.493805+0000","last_fullsized":"2024-09-12T18:37:45.493805+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:19.618576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.501072+0000","last_change":"2024-09-12T18:35:25.661544+0000","last_active":"2024-09-12T18:37:45.501072+0000","last_peered":"2024-09-12T18:37:45.501072+0000","last_clean":"2024-09-12T18:37:45.501072+0000","last_became_active":"2024-09-12T18:35:25.656985+0000","last_became_peered":"2024-09-12T18:35:25.656985+0000","last_unstale":"2024-09-12T18:37:45.501072+0000","last_undegraded":"2024-09-12T18:37:45.501072+0000","last_fullsized":"2024-09-12T18:37:45.501072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":70,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.498679+0000","last_change":"2024-09-12T18:36:39.073200+0000","last_active":"2024-09-12T18:37:45.498679+0000","last_peered":"2024-09-12T18:37:45.498679+0000","last_clean":"2024-09-12T18:37:45.498679+0000","last_became_active":"2024-09-12T18:36:39.072553+0000","last_became_peered":"2024-09-12T18:36:39.072553+0000","last_unstale":"2024-09-12T18:37:45.498679+0000","last_undegraded":"2024-09-12T18:37:45.498679+0000","last_fullsized":"2024-09-12T18:37:45.498679+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:02.283482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":131,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.497256+0000","last_change":"2024-09-12T18:35:25.656712+0000","last_active":"2024-09-12T18:37:45.497256+0000","last_peered":"2024-09-12T18:37:45.497256+0000","last_clean":"2024-09-12T18:37:45.497256+0000","last_became_active":"2024-09-12T18:35:25.654473+0000","last_became_peered":"2024-09-12T18:35:25.654473+0000","last_unstale":"2024-09-12T18:37:45.497256+0000","last_undegraded":"2024-09-12T18:37:45.497256+0000","last_fullsized":"2024-09-12T18:37:45.497256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:01.464680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.494598+0000","last_change":"2024-09-12T18:35:24.659935+0000","last_active":"2024-09-12T18:37:45.494598+0000","last_peered":"2024-09-12T18:37:45.494598+0000","last_clean":"2024-09-12T18:37:45.494598+0000","last_became_active":"2024-09-12T18:35:24.659111+0000","last_became_peered":"2024-09-12T18:35:24.659111+0000","last_unstale":"2024-09-12T18:37:45.494598+0000","last_undegraded":"2024-09-12T18:37:45.494598+0000","last_fullsized":"2024-09-12T18:37:45.494598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:11.480154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":137,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.494908+0000","last_change":"2024-09-12T18:36:39.076804+0000","last_active":"2024-09-12T18:37:45.494908+0000","last_peered":"2024-09-12T18:37:45.494908+0000","last_clean":"2024-09-12T18:37:45.494908+0000","last_became_active":"2024-09-12T18:36:39.075916+0000","last_became_peered":"2024-09-12T18:36:39.075916+0000","last_unstale":"2024-09-12T18:37:45.494908+0000","last_undegraded":"2024-09-12T18:37:45.494908+0000","last_fullsized":"2024-09-12T18:37:45.494908+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:36.280719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.494612+0000","last_change":"2024-09-12T18:35:24.638538+0000","last_active":"2024-09-12T18:37:45.494612+0000","last_peered":"2024-09-12T18:37:45.494612+0000","last_clean":"2024-09-12T18:37:45.494612+0000","last_became_active":"2024-09-12T18:35:24.637242+0000","last_became_peered":"2024-09-12T18:35:24.637242+0000","last_unstale":"2024-09-12T18:37:45.494612+0000","last_undegraded":"2024-09-12T18:37:45.494612+0000","last_fullsized":"2024-09-12T18:37:45.494612+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:26.877441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":131,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.505313+0000","last_change":"2024-09-12T18:35:25.662537+0000","last_active":"2024-09-12T18:37:45.505313+0000","last_peered":"2024-09-12T18:37:45.505313+0000","last_clean":"2024-09-12T18:37:45.505313+0000","last_became_active":"2024-09-12T18:35:25.661441+0000","last_became_peered":"2024-09-12T18:35:25.661441+0000","last_unstale":"2024-09-12T18:37:45.505313+0000","last_undegraded":"2024-09-12T18:37:45.505313+0000","last_fullsized":"2024-09-12T18:37:45.505313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:14.397867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":145,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.498595+0000","last_change":"2024-09-12T18:36:39.091935+0000","last_active":"2024-09-12T18:37:45.498595+0000","last_peered":"2024-09-12T18:37:45.498595+0000","last_clean":"2024-09-12T18:37:45.498595+0000","last_became_active":"2024-09-12T18:36:39.071545+0000","last_became_peered":"2024-09-12T18:36:39.071545+0000","last_unstale":"2024-09-12T18:37:45.498595+0000","last_undegraded":"2024-09-12T18:37:45.498595+0000","last_fullsized":"2024-09-12T18:37:45.498595+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:35.815126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":131,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.501270+0000","last_change":"2024-09-12T18:35:25.651406+0000","last_active":"2024-09-12T18:37:45.501270+0000","last_peered":"2024-09-12T18:37:45.501270+0000","last_clean":"2024-09-12T18:37:45.501270+0000","last_became_active":"2024-09-12T18:35:25.649728+0000","last_became_peered":"2024-09-12T18:35:25.649728+0000","last_unstale":"2024-09-12T18:37:45.501270+0000","last_undegraded":"2024-09-12T18:37:45.501270+0000","last_fullsized":"2024-09-12T18:37:45.501270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:41.773283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":135,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.497120+0000","last_change":"2024-09-12T18:35:24.649153+0000","last_active":"2024-09-12T18:37:45.497120+0000","last_peered":"2024-09-12T18:37:45.497120+0000","last_clean":"2024-09-12T18:37:45.497120+0000","last_became_active":"2024-09-12T18:35:24.648512+0000","last_became_peered":"2024-09-12T18:35:24.648512+0000","last_unstale":"2024-09-12T18:37:45.497120+0000","last_undegraded":"2024-09-12T18:37:45.497120+0000","last_fullsized":"2024-09-12T18:37:45.497120+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:07.810456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":131,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.494278+0000","last_change":"2024-09-12T18:35:25.656799+0000","last_active":"2024-09-12T18:37:45.494278+0000","last_peered":"2024-09-12T18:37:45.494278+0000","last_clean":"2024-09-12T18:37:45.494278+0000","last_became_active":"2024-09-12T18:35:25.654980+0000","last_became_peered":"2024-09-12T18:35:25.654980+0000","last_unstale":"2024-09-12T18:37:45.494278+0000","last_undegraded":"2024-09-12T18:37:45.494278+0000","last_fullsized":"2024-09-12T18:37:45.494278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:10.735439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":135,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.503031+0000","last_change":"2024-09-12T18:35:24.656268+0000","last_active":"2024-09-12T18:37:45.503031+0000","last_peered":"2024-09-12T18:37:45.503031+0000","last_clean":"2024-09-12T18:37:45.503031+0000","last_became_active":"2024-09-12T18:35:24.655420+0000","last_became_peered":"2024-09-12T18:35:24.655420+0000","last_unstale":"2024-09-12T18:37:45.503031+0000","last_undegraded":"2024-09-12T18:37:45.503031+0000","last_fullsized":"2024-09-12T18:37:45.503031+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:04.654666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":137,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.498816+0000","last_change":"2024-09-12T18:36:40.154820+0000","last_active":"2024-09-12T18:37:45.498816+0000","last_peered":"2024-09-12T18:37:45.498816+0000","last_clean":"2024-09-12T18:37:45.498816+0000","last_became_active":"2024-09-12T18:36:40.154431+0000","last_became_peered":"2024-09-12T18:36:40.154431+0000","last_unstale":"2024-09-12T18:37:45.498816+0000","last_undegraded":"2024-09-12T18:37:45.498816+0000","last_fullsized":"2024-09-12T18:37:45.498816+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:04.432378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":87,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T18:37:45.499399+0000","last_change":"2024-09-12T18:36:39.087685+0000","last_active":"2024-09-12T18:37:45.499399+0000","last_peered":"2024-09-12T18:37:45.499399+0000","last_clean":"2024-09-12T18:37:45.499399+0000","last_became_active":"2024-09-12T18:36:39.071493+0000","last_became_peered":"2024-09-12T18:36:39.071493+0000","last_unstale":"2024-09-12T18:37:45.499399+0000","last_undegraded":"2024-09-12T18:37:45.499399+0000","last_fullsized":"2024-09-12T18:37:45.499399+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:13.765236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":439943192,"num_objects":6714,"num_object_clones":0,"num_object_copies":13428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6714,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":257836,"num_write_kb":8465537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16196,"num_bytes_recovered":1061421056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":56107008,"data_stored":897581104,"data_compressed":42635646,"data_compressed_allocated":56098816,"data_compressed_original":897581056,"omap_allocated":0,"internal_metadata":0},"log_size":62440,"ondisk_log_size":62440,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705698,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":282772,"kb_used_data":12796,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94089068,"statfs":{"total":96636764160,"available":96347205632,"internally_reserved":0,"allocated":13103104,"data_stored":194846815,"data_compressed":9246088,"data_compressed_allocated":12165120,"data_compressed_original":194494464,"omap_allocated":1594,"internal_metadata":276429254},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738402,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308736,"kb_used_data":24876,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":94063104,"statfs":{"total":96636764160,"available":96320618496,"internally_reserved":0,"allocated":25473024,"data_stored":392634516,"data_compressed":18641123,"data_compressed_allocated":24526848,"data_compressed_original":392282112,"omap_allocated":1595,"internal_metadata":290650565},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738402,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311492,"kb_used_data":27632,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":94060348,"statfs":{"total":96636764160,"available":96317796352,"internally_reserved":0,"allocated":28295168,"data_stored":438768916,"data_compressed":20825968,"data_compressed_allocated":27402240,"data_compressed_original":438435840,"omap_allocated":1594,"internal_metadata":290650566},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21381120,"data_stored":342097920,"data_compressed":16249859,"data_compressed_allocated":21381120,"data_compressed_original":342097920,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10952704,"data_stored":175177752,"data_compressed":8321048,"data_compressed_allocated":10948608,"data_compressed_original":175177728,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23773184,"data_stored":380305432,"data_compressed":18064739,"data_compressed_allocated":23769088,"data_compressed_original":380305408,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:37:50.058 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:50.058 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2024-09-12T18:37:50.058 INFO:teuthology.orchestra.run.smithi114.stdout: "complaint_time": 30, 2024-09-12T18:37:50.058 INFO:teuthology.orchestra.run.smithi114.stdout: "num_blocked_ops": 0 2024-09-12T18:37:50.058 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:50.065 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:50.059+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:50.079 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:37:50.165 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:50.157+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:50.234 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:50.234 INFO:teuthology.orchestra.run.smithi114.stdout: "size": 20, 2024-09-12T18:37:50.234 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 600, 2024-09-12T18:37:50.234 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:37:50.234 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.234 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167352 5.a 5:5fc472d2:::benchmark_data_smithi073_23739_object35075:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:50.235 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.163066+0000", 2024-09-12T18:37:50.235 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 47.067742150000001, 2024-09-12T18:37:50.235 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.077708377999999995, 2024-09-12T18:37:50.235 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:50.235 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:50.235 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:50.235 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:50.235 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:50.235 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:50.235 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167352 2024-09-12T18:37:50.235 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.235 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:50.235 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.236 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:50.236 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163066+0000", 2024-09-12T18:37:50.236 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:50.236 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.236 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.236 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:50.236 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163066+0000", 2024-09-12T18:37:50.236 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:50.236 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.236 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.236 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:50.237 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163067+0000", 2024-09-12T18:37:50.237 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0499999999999999e-06 2024-09-12T18:37:50.237 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.237 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.237 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:50.237 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163071+0000", 2024-09-12T18:37:50.237 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4340000000000002e-06 2024-09-12T18:37:50.237 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.237 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.237 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:50.237 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163081+0000", 2024-09-12T18:37:50.237 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0304e-05 2024-09-12T18:37:50.238 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.238 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.238 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:50.238 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163090+0000", 2024-09-12T18:37:50.238 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7309999999999999e-06 2024-09-12T18:37:50.238 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.238 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.238 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:50.238 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163143+0000", 2024-09-12T18:37:50.238 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2942000000000002e-05 2024-09-12T18:37:50.239 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.239 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.239 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:50.239 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163270+0000", 2024-09-12T18:37:50.239 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012664100000000001 2024-09-12T18:37:50.239 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.239 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.239 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:50.239 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163378+0000", 2024-09-12T18:37:50.239 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000107995 2024-09-12T18:37:50.239 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.239 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.240 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:50.240 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234552+0000", 2024-09-12T18:37:50.240 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.071173831000000007 2024-09-12T18:37:50.240 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.240 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.240 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:50.240 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240640+0000", 2024-09-12T18:37:50.240 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.006088909 2024-09-12T18:37:50.240 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.240 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.240 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:50.240 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240709+0000", 2024-09-12T18:37:50.241 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8393999999999996e-05 2024-09-12T18:37:50.241 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.241 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.241 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:50.241 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240774+0000", 2024-09-12T18:37:50.241 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5147000000000005e-05 2024-09-12T18:37:50.241 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:50.241 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:50.241 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:50.241 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.241 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.241 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167358 5.a 5:533f6738:::benchmark_data_smithi073_23739_object35081:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:50.241 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.165639+0000", 2024-09-12T18:37:50.241 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 47.065168872999998, 2024-09-12T18:37:50.242 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.075287509000000002, 2024-09-12T18:37:50.242 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:50.242 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:50.242 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:50.242 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:50.242 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:50.242 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:50.242 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167358 2024-09-12T18:37:50.242 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.242 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:50.242 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.242 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:50.242 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165639+0000", 2024-09-12T18:37:50.242 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:50.243 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.243 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.243 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:50.243 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165639+0000", 2024-09-12T18:37:50.243 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:50.243 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.243 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.243 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:50.244 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165640+0000", 2024-09-12T18:37:50.244 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1999999999999999e-06 2024-09-12T18:37:50.244 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.244 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.244 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:50.244 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165646+0000", 2024-09-12T18:37:50.244 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4550000000000003e-06 2024-09-12T18:37:50.244 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.244 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.245 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:50.245 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165658+0000", 2024-09-12T18:37:50.245 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2721999999999999e-05 2024-09-12T18:37:50.245 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.245 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.245 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:50.245 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165668+0000", 2024-09-12T18:37:50.245 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4229999999999994e-06 2024-09-12T18:37:50.245 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.246 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.246 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:50.246 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165711+0000", 2024-09-12T18:37:50.246 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3785999999999997e-05 2024-09-12T18:37:50.246 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.246 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.246 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:50.246 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165788+0000", 2024-09-12T18:37:50.246 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6506000000000002e-05 2024-09-12T18:37:50.246 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.246 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.246 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:50.246 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165862+0000", 2024-09-12T18:37:50.247 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4012999999999998e-05 2024-09-12T18:37:50.247 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.247 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.247 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:50.247 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234718+0000", 2024-09-12T18:37:50.247 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.068856420000000002 2024-09-12T18:37:50.247 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.247 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.247 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:50.247 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240785+0000", 2024-09-12T18:37:50.247 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0060661489999999998 2024-09-12T18:37:50.248 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.248 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.248 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:50.248 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240844+0000", 2024-09-12T18:37:50.248 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9487000000000002e-05 2024-09-12T18:37:50.248 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.248 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.248 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:50.248 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240926+0000", 2024-09-12T18:37:50.248 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2348000000000005e-05 2024-09-12T18:37:50.249 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:50.249 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:50.249 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:50.249 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.249 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.249 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167361 5.a 5:56730f28:::benchmark_data_smithi073_23739_object35084:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:50.249 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.165979+0000", 2024-09-12T18:37:50.249 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 47.064828892999998, 2024-09-12T18:37:50.249 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.075128337000000003, 2024-09-12T18:37:50.249 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:50.250 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:50.250 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:50.250 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:50.250 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:50.250 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:50.250 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167361 2024-09-12T18:37:50.250 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.250 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:50.250 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.250 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:50.251 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165979+0000", 2024-09-12T18:37:50.251 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:50.251 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.251 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.251 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:50.251 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165979+0000", 2024-09-12T18:37:50.251 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:50.251 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.251 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.251 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:50.251 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165980+0000", 2024-09-12T18:37:50.251 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4499999999999997e-07 2024-09-12T18:37:50.251 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.252 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.252 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:50.252 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165985+0000", 2024-09-12T18:37:50.252 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.186e-06 2024-09-12T18:37:50.252 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.252 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.252 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:50.252 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165995+0000", 2024-09-12T18:37:50.252 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0378e-05 2024-09-12T18:37:50.252 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.252 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.252 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:50.253 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.166016+0000", 2024-09-12T18:37:50.253 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1316999999999999e-05 2024-09-12T18:37:50.253 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.253 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.253 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:50.253 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.167783+0000", 2024-09-12T18:37:50.253 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017662209999999999 2024-09-12T18:37:50.254 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.254 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.254 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:50.254 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.167851+0000", 2024-09-12T18:37:50.254 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7990000000000005e-05 2024-09-12T18:37:50.254 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.254 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.254 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:50.254 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.167929+0000", 2024-09-12T18:37:50.254 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8829e-05 2024-09-12T18:37:50.255 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.255 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.255 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:50.255 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234832+0000", 2024-09-12T18:37:50.255 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066902378999999998 2024-09-12T18:37:50.255 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.255 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.255 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:50.255 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240941+0000", 2024-09-12T18:37:50.255 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0061087470000000003 2024-09-12T18:37:50.256 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.256 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.256 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:50.256 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241053+0000", 2024-09-12T18:37:50.256 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00011197299999999999 2024-09-12T18:37:50.256 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.256 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.256 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:50.256 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241107+0000", 2024-09-12T18:37:50.256 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4672000000000001e-05 2024-09-12T18:37:50.256 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:50.256 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:50.256 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:50.257 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.257 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.257 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167362 5.3 5:cbd73b47:::benchmark_data_smithi073_23739_object35085:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:50.257 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:50.257 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 47.062732177999997, 2024-09-12T18:37:50.257 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.067202411000000004, 2024-09-12T18:37:50.257 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:50.257 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:50.257 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:50.257 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:50.257 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:50.257 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:50.257 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167362 2024-09-12T18:37:50.258 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.258 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:50.258 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.258 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:50.258 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:50.258 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:50.258 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.258 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.258 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:50.258 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:50.258 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:50.258 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.258 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.258 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:50.259 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:50.259 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3600000000000003e-07 2024-09-12T18:37:50.259 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.259 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.259 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:50.259 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168079+0000", 2024-09-12T18:37:50.259 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7949999999999999e-06 2024-09-12T18:37:50.259 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.259 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.259 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:50.259 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168085+0000", 2024-09-12T18:37:50.259 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2110000000000003e-06 2024-09-12T18:37:50.260 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.260 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.260 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:50.260 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168089+0000", 2024-09-12T18:37:50.260 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0840000000000002e-06 2024-09-12T18:37:50.260 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.260 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.260 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:50.260 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168121+0000", 2024-09-12T18:37:50.260 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.1489000000000003e-05 2024-09-12T18:37:50.260 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.260 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.260 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:50.261 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168186+0000", 2024-09-12T18:37:50.261 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5313000000000003e-05 2024-09-12T18:37:50.261 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.261 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.261 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:50.261 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168242+0000", 2024-09-12T18:37:50.261 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5560999999999999e-05 2024-09-12T18:37:50.261 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.261 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.261 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:50.261 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234467+0000", 2024-09-12T18:37:50.261 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066225424000000005 2024-09-12T18:37:50.261 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.261 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.262 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:50.262 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235088+0000", 2024-09-12T18:37:50.262 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00062118999999999998 2024-09-12T18:37:50.262 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.262 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.262 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:50.262 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235197+0000", 2024-09-12T18:37:50.262 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00010825899999999999 2024-09-12T18:37:50.262 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.262 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.263 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:50.263 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235278+0000", 2024-09-12T18:37:50.263 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1448999999999999e-05 2024-09-12T18:37:50.263 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:50.263 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:50.263 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:50.263 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.263 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.263 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167366 5.a 5:58e6a467:::benchmark_data_smithi073_23739_object35089:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:50.263 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168263+0000", 2024-09-12T18:37:50.263 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 47.062544641000002, 2024-09-12T18:37:50.263 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.078184744, 2024-09-12T18:37:50.264 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:50.264 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:50.264 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:50.264 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:50.264 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:50.264 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:50.265 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167366 2024-09-12T18:37:50.265 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.265 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:50.265 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.265 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:50.265 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168263+0000", 2024-09-12T18:37:50.265 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:50.265 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.266 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.266 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:50.266 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168263+0000", 2024-09-12T18:37:50.266 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:50.266 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.266 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.266 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:50.266 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168264+0000", 2024-09-12T18:37:50.266 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5700000000000002e-07 2024-09-12T18:37:50.266 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.266 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.266 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:50.266 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168266+0000", 2024-09-12T18:37:50.267 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1789999999999998e-06 2024-09-12T18:37:50.267 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.267 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.267 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:50.267 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168271+0000", 2024-09-12T18:37:50.267 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8160000000000001e-06 2024-09-12T18:37:50.267 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.267 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.267 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:50.267 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168275+0000", 2024-09-12T18:37:50.267 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4440000000000001e-06 2024-09-12T18:37:50.267 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.267 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.267 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:50.268 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170082+0000", 2024-09-12T18:37:50.268 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0018068800000000001 2024-09-12T18:37:50.268 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.268 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.269 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:50.269 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170154+0000", 2024-09-12T18:37:50.269 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1575000000000005e-05 2024-09-12T18:37:50.269 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.269 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.269 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:50.269 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170216+0000", 2024-09-12T18:37:50.269 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1989999999999994e-05 2024-09-12T18:37:50.269 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.269 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.269 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:50.269 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234933+0000", 2024-09-12T18:37:50.269 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064717514000000004 2024-09-12T18:37:50.270 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.270 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.270 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:50.270 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246226+0000", 2024-09-12T18:37:50.270 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011293151 2024-09-12T18:37:50.270 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.270 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.270 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:50.270 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246338+0000", 2024-09-12T18:37:50.270 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00011225 2024-09-12T18:37:50.270 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.270 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.270 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:50.270 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246448+0000", 2024-09-12T18:37:50.270 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000109388 2024-09-12T18:37:50.271 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:50.271 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:50.271 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:50.271 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.271 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.271 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167367 5.a 5:51778d97:::benchmark_data_smithi073_23739_object35090:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:50.271 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168388+0000", 2024-09-12T18:37:50.271 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 47.062419396999999, 2024-09-12T18:37:50.271 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.082583860999999995, 2024-09-12T18:37:50.271 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:50.271 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:50.271 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:50.272 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:50.272 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:50.272 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:50.272 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167367 2024-09-12T18:37:50.272 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.272 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:50.272 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.272 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:50.272 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168388+0000", 2024-09-12T18:37:50.272 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:50.272 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.272 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.272 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:50.273 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168388+0000", 2024-09-12T18:37:50.273 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:50.273 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.273 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.273 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:50.273 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168389+0000", 2024-09-12T18:37:50.273 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1099999999999996e-07 2024-09-12T18:37:50.273 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.274 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.274 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:50.274 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168391+0000", 2024-09-12T18:37:50.274 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.39e-06 2024-09-12T18:37:50.274 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.274 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.274 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:50.274 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168396+0000", 2024-09-12T18:37:50.274 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3460000000000004e-06 2024-09-12T18:37:50.274 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.274 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.275 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:50.275 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168399+0000", 2024-09-12T18:37:50.275 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.613e-06 2024-09-12T18:37:50.275 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.276 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.276 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:50.276 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235003+0000", 2024-09-12T18:37:50.276 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066603851000000006 2024-09-12T18:37:50.276 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.276 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.276 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:50.276 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235266+0000", 2024-09-12T18:37:50.276 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00026270999999999998 2024-09-12T18:37:50.277 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.277 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.277 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:50.277 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235510+0000", 2024-09-12T18:37:50.277 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00024394 2024-09-12T18:37:50.277 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.277 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.277 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:50.277 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246546+0000", 2024-09-12T18:37:50.277 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011035774 2024-09-12T18:37:50.277 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.278 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.278 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:50.278 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.250808+0000", 2024-09-12T18:37:50.278 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0042622700000000003 2024-09-12T18:37:50.278 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.278 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.278 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:50.279 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.250890+0000", 2024-09-12T18:37:50.279 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1874999999999998e-05 2024-09-12T18:37:50.279 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.279 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.279 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:50.279 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.250972+0000", 2024-09-12T18:37:50.279 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2581000000000001e-05 2024-09-12T18:37:50.280 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:50.280 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:50.280 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:50.280 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.280 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.280 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167370 5.a 5:5aab9477:::benchmark_data_smithi073_23739_object35093:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:50.280 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168603+0000", 2024-09-12T18:37:50.281 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 47.062204461999997, 2024-09-12T18:37:50.281 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.086603794999999997, 2024-09-12T18:37:50.281 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:50.281 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:50.281 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:50.281 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:50.281 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:50.281 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:50.282 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167370 2024-09-12T18:37:50.282 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.282 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:50.282 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.282 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:50.282 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168603+0000", 2024-09-12T18:37:50.282 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:50.282 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.282 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.282 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:50.282 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168603+0000", 2024-09-12T18:37:50.283 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:50.283 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.283 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.283 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:50.283 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168604+0000", 2024-09-12T18:37:50.283 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.1899999999999998e-07 2024-09-12T18:37:50.283 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.283 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.283 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:50.283 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168606+0000", 2024-09-12T18:37:50.283 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8309999999999999e-06 2024-09-12T18:37:50.283 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.283 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.284 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:50.284 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168610+0000", 2024-09-12T18:37:50.284 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8069999999999999e-06 2024-09-12T18:37:50.284 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.284 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.284 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:50.284 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168613+0000", 2024-09-12T18:37:50.284 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.118e-06 2024-09-12T18:37:50.284 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.285 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.285 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:50.285 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241145+0000", 2024-09-12T18:37:50.285 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.072531678000000002 2024-09-12T18:37:50.285 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.285 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.285 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:50.285 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241342+0000", 2024-09-12T18:37:50.286 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00019635900000000001 2024-09-12T18:37:50.286 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.286 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.286 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:50.286 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241483+0000", 2024-09-12T18:37:50.286 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014161100000000001 2024-09-12T18:37:50.286 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.286 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.287 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:50.287 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255039+0000", 2024-09-12T18:37:50.287 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013555724 2024-09-12T18:37:50.287 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.287 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.287 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:50.287 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255062+0000", 2024-09-12T18:37:50.287 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.3042000000000001e-05 2024-09-12T18:37:50.288 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.288 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.288 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:50.288 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255143+0000", 2024-09-12T18:37:50.288 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0999000000000002e-05 2024-09-12T18:37:50.288 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.288 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.288 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:50.288 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255207+0000", 2024-09-12T18:37:50.288 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4207000000000004e-05 2024-09-12T18:37:50.288 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:50.288 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:50.289 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:50.289 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.289 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.289 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167352 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:50.289 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:50.289 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 47.062079808, 2024-09-12T18:37:50.289 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065859953999999998, 2024-09-12T18:37:50.289 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:50.289 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:50.289 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:50.289 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:50.289 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.289 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:50.289 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:50.290 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:50.290 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.290 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.290 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:50.290 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:50.290 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:50.290 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.290 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.290 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:50.290 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:50.290 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.0800000000000001e-07 2024-09-12T18:37:50.290 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.290 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.290 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:50.291 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168730+0000", 2024-09-12T18:37:50.291 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6530000000000001e-06 2024-09-12T18:37:50.291 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.291 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.291 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:50.291 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168734+0000", 2024-09-12T18:37:50.291 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.721e-06 2024-09-12T18:37:50.291 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.291 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.291 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:50.291 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168736+0000", 2024-09-12T18:37:50.291 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.508e-06 2024-09-12T18:37:50.291 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.291 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.292 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:50.292 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171951+0000", 2024-09-12T18:37:50.292 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.003215281 2024-09-12T18:37:50.292 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.292 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.292 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:50.292 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234520+0000", 2024-09-12T18:37:50.292 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062568676000000004 2024-09-12T18:37:50.292 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.292 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.292 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:50.292 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234588+0000", 2024-09-12T18:37:50.292 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7806999999999996e-05 2024-09-12T18:37:50.292 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:50.293 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:50.293 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:50.293 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.293 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.293 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167368 5.4 e58/21 5:29a1ec58:::benchmark_data_smithi073_23739_object35091:head v 58'10399, mlcod=58'10396)", 2024-09-12T18:37:50.293 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:50.293 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 47.061956791, 2024-09-12T18:37:50.293 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066008885000000003, 2024-09-12T18:37:50.293 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:50.293 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:50.293 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:50.293 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:50.293 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.294 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:50.294 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:50.294 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:50.294 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.294 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.294 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:50.294 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:50.294 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:50.294 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.295 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.295 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:50.295 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:50.295 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4699999999999998e-07 2024-09-12T18:37:50.295 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.295 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.295 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:50.295 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168854+0000", 2024-09-12T18:37:50.295 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.3180000000000001e-06 2024-09-12T18:37:50.295 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.295 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.295 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:50.295 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168858+0000", 2024-09-12T18:37:50.295 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2799999999999997e-06 2024-09-12T18:37:50.296 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.296 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.296 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:50.296 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168861+0000", 2024-09-12T18:37:50.296 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7650000000000002e-06 2024-09-12T18:37:50.296 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.296 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.296 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:50.296 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168895+0000", 2024-09-12T18:37:50.296 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4533999999999998e-05 2024-09-12T18:37:50.296 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.296 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.296 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:50.297 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168906+0000", 2024-09-12T18:37:50.297 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0910000000000001e-05 2024-09-12T18:37:50.297 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.297 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.297 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:50.297 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234784+0000", 2024-09-12T18:37:50.297 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065877656000000007 2024-09-12T18:37:50.297 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.297 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.297 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:50.297 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234860+0000", 2024-09-12T18:37:50.297 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6174999999999995e-05 2024-09-12T18:37:50.297 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:50.298 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:50.298 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:50.298 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.298 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.298 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167358 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:50.298 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.170373+0000", 2024-09-12T18:37:50.298 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 47.06043451, 2024-09-12T18:37:50.298 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064370201000000002, 2024-09-12T18:37:50.298 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:50.298 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:50.298 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:50.298 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:50.298 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.298 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:50.299 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170373+0000", 2024-09-12T18:37:50.299 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:50.299 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.299 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.299 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:50.299 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170373+0000", 2024-09-12T18:37:50.299 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:50.299 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.299 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.299 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:50.299 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170374+0000", 2024-09-12T18:37:50.299 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5799999999999998e-07 2024-09-12T18:37:50.299 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.300 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.300 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:50.300 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170378+0000", 2024-09-12T18:37:50.300 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.732e-06 2024-09-12T18:37:50.300 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.300 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.300 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:50.300 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170388+0000", 2024-09-12T18:37:50.300 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0212e-05 2024-09-12T18:37:50.300 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.300 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.300 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:50.300 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170397+0000", 2024-09-12T18:37:50.300 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7090000000000008e-06 2024-09-12T18:37:50.301 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.301 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.301 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:50.301 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234682+0000", 2024-09-12T18:37:50.301 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064285518999999999 2024-09-12T18:37:50.301 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.301 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.301 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:50.301 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234703+0000", 2024-09-12T18:37:50.301 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.0199000000000001e-05 2024-09-12T18:37:50.301 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.301 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.301 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:50.301 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234743+0000", 2024-09-12T18:37:50.302 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0972e-05 2024-09-12T18:37:50.302 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:50.302 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:50.302 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:50.302 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.302 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.302 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167372 5.c 5:398d36a7:::benchmark_data_smithi073_23739_object35095:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:50.303 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171066+0000", 2024-09-12T18:37:50.303 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 47.059741297999999, 2024-09-12T18:37:50.303 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065889534999999999, 2024-09-12T18:37:50.303 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:50.303 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:50.303 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:50.303 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:50.303 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:50.303 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:50.303 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167372 2024-09-12T18:37:50.303 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.304 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:50.304 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.304 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:50.304 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171066+0000", 2024-09-12T18:37:50.304 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:50.304 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.304 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.304 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:50.304 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171066+0000", 2024-09-12T18:37:50.304 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:50.304 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.304 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.305 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:50.305 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171068+0000", 2024-09-12T18:37:50.305 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.186e-06 2024-09-12T18:37:50.305 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.305 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.305 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:50.305 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171072+0000", 2024-09-12T18:37:50.305 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3560000000000003e-06 2024-09-12T18:37:50.305 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.305 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.305 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:50.305 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171082+0000", 2024-09-12T18:37:50.305 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.9739999999999997e-06 2024-09-12T18:37:50.306 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.306 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.306 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:50.306 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171089+0000", 2024-09-12T18:37:50.306 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7159999999999997e-06 2024-09-12T18:37:50.306 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.306 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.306 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:50.306 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171133+0000", 2024-09-12T18:37:50.306 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4091999999999997e-05 2024-09-12T18:37:50.306 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.306 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.306 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:50.307 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171221+0000", 2024-09-12T18:37:50.307 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.8108000000000004e-05 2024-09-12T18:37:50.307 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.307 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.307 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:50.307 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171279+0000", 2024-09-12T18:37:50.307 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8062000000000001e-05 2024-09-12T18:37:50.307 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.307 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.307 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:50.307 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235007+0000", 2024-09-12T18:37:50.307 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.063727849000000003 2024-09-12T18:37:50.307 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.307 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.308 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:50.308 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236790+0000", 2024-09-12T18:37:50.308 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017829269999999999 2024-09-12T18:37:50.308 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.308 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.308 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:50.308 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236881+0000", 2024-09-12T18:37:50.308 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1347999999999993e-05 2024-09-12T18:37:50.308 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.308 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.308 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:50.308 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236956+0000", 2024-09-12T18:37:50.308 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4917000000000001e-05 2024-09-12T18:37:50.309 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:50.309 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:50.309 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:50.309 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.309 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.309 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167371 5.4 e58/21 5:24fea27c:::benchmark_data_smithi073_23739_object35094:head v 58'10400, mlcod=58'10397)", 2024-09-12T18:37:50.309 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171273+0000", 2024-09-12T18:37:50.309 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 47.059534724000002, 2024-09-12T18:37:50.309 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065500368000000003, 2024-09-12T18:37:50.309 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:50.309 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:50.309 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:50.309 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:50.309 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.310 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:50.310 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171273+0000", 2024-09-12T18:37:50.310 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:50.310 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.310 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.310 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:50.310 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171273+0000", 2024-09-12T18:37:50.310 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:50.310 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.310 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.310 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:50.310 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171274+0000", 2024-09-12T18:37:50.310 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0399999999999996e-07 2024-09-12T18:37:50.311 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.311 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.311 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:50.311 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171277+0000", 2024-09-12T18:37:50.311 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8689999999999997e-06 2024-09-12T18:37:50.311 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.311 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.311 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:50.311 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171284+0000", 2024-09-12T18:37:50.311 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2879999999999998e-06 2024-09-12T18:37:50.311 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.311 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.311 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:50.311 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171289+0000", 2024-09-12T18:37:50.312 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9049999999999996e-06 2024-09-12T18:37:50.312 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.312 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.312 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:50.312 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171322+0000", 2024-09-12T18:37:50.312 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3781000000000001e-05 2024-09-12T18:37:50.312 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.312 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.312 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:50.312 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171335+0000", 2024-09-12T18:37:50.312 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2639999999999999e-05 2024-09-12T18:37:50.312 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.312 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.313 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:50.313 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236691+0000", 2024-09-12T18:37:50.313 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065355835000000001 2024-09-12T18:37:50.313 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.313 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.313 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:50.313 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236773+0000", 2024-09-12T18:37:50.313 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2546000000000006e-05 2024-09-12T18:37:50.313 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:50.313 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:50.314 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:50.314 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.314 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.314 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167364 5.7 e58/21 5:ee50096a:::benchmark_data_smithi073_23739_object35087:head v 58'10504, mlcod=58'10502)", 2024-09-12T18:37:50.314 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171598+0000", 2024-09-12T18:37:50.314 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 47.059209604999999, 2024-09-12T18:37:50.314 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065149069000000004, 2024-09-12T18:37:50.314 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:50.314 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:50.314 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:50.314 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:50.314 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.314 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:50.315 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171598+0000", 2024-09-12T18:37:50.315 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:50.315 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.315 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.315 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:50.315 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171598+0000", 2024-09-12T18:37:50.315 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:50.315 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.315 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.315 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:50.315 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171599+0000", 2024-09-12T18:37:50.315 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6700000000000003e-07 2024-09-12T18:37:50.315 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.315 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.316 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:50.316 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171602+0000", 2024-09-12T18:37:50.316 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.841e-06 2024-09-12T18:37:50.316 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.316 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.316 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:50.316 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171608+0000", 2024-09-12T18:37:50.316 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9259999999999997e-06 2024-09-12T18:37:50.316 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.316 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.316 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:50.316 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171611+0000", 2024-09-12T18:37:50.316 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.9450000000000003e-06 2024-09-12T18:37:50.317 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.317 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.317 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:50.317 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171650+0000", 2024-09-12T18:37:50.317 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8464000000000003e-05 2024-09-12T18:37:50.317 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.317 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.317 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:50.317 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171662+0000", 2024-09-12T18:37:50.317 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1603999999999999e-05 2024-09-12T18:37:50.317 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.317 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.317 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:50.318 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236663+0000", 2024-09-12T18:37:50.318 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065001330999999996 2024-09-12T18:37:50.318 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.318 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.318 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:50.318 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236747+0000", 2024-09-12T18:37:50.318 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.4390999999999999e-05 2024-09-12T18:37:50.318 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:50.318 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:50.318 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:50.318 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.318 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.320 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167365 5.2 e58/21 5:4107875c:::benchmark_data_smithi073_23739_object35088:head v 58'10351, mlcod=58'10349)", 2024-09-12T18:37:50.320 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171733+0000", 2024-09-12T18:37:50.320 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 47.059074559999999, 2024-09-12T18:37:50.320 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.074804168000000004, 2024-09-12T18:37:50.320 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:50.321 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:50.321 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:50.321 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:50.321 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.321 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:50.321 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171733+0000", 2024-09-12T18:37:50.321 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:50.321 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.321 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.321 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:50.321 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171733+0000", 2024-09-12T18:37:50.321 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:50.321 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.321 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.322 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:50.322 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171734+0000", 2024-09-12T18:37:50.322 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9299999999999998e-07 2024-09-12T18:37:50.322 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.322 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.322 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:50.322 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171738+0000", 2024-09-12T18:37:50.322 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.301e-06 2024-09-12T18:37:50.322 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.322 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.322 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:50.322 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171746+0000", 2024-09-12T18:37:50.322 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.554e-06 2024-09-12T18:37:50.322 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.323 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.323 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:50.323 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171751+0000", 2024-09-12T18:37:50.323 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1880000000000001e-06 2024-09-12T18:37:50.323 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.323 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.323 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:50.323 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234659+0000", 2024-09-12T18:37:50.323 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062907807999999996 2024-09-12T18:37:50.323 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.323 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.323 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:50.323 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234708+0000", 2024-09-12T18:37:50.323 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8992000000000001e-05 2024-09-12T18:37:50.324 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.324 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.324 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:50.324 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246457+0000", 2024-09-12T18:37:50.324 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.01174974 2024-09-12T18:37:50.324 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.324 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.324 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:50.324 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246537+0000", 2024-09-12T18:37:50.324 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.9992000000000003e-05 2024-09-12T18:37:50.324 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:50.324 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:50.324 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:50.325 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.325 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.325 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167373 5.5 e58/49 5:ad283029:::benchmark_data_smithi073_23739_object35096:head v 58'10600, mlcod=58'10598)", 2024-09-12T18:37:50.325 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:50.325 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 47.059047075999999, 2024-09-12T18:37:50.325 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065058240000000003, 2024-09-12T18:37:50.325 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:50.325 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:50.325 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:50.325 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:50.325 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.325 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:50.325 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:50.325 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:50.326 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.326 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.326 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:50.326 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:50.326 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:50.326 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.326 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.326 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:50.326 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:50.326 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.2899999999999999e-07 2024-09-12T18:37:50.326 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.326 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.326 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:50.326 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171764+0000", 2024-09-12T18:37:50.327 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7310000000000002e-06 2024-09-12T18:37:50.327 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.327 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.327 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:50.327 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171769+0000", 2024-09-12T18:37:50.327 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.079e-06 2024-09-12T18:37:50.327 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.327 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.327 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:50.327 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171774+0000", 2024-09-12T18:37:50.327 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.48e-06 2024-09-12T18:37:50.327 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.327 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.328 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:50.328 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171819+0000", 2024-09-12T18:37:50.328 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4391999999999998e-05 2024-09-12T18:37:50.328 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.328 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.328 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:50.328 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171841+0000", 2024-09-12T18:37:50.328 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2245000000000001e-05 2024-09-12T18:37:50.328 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.328 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.328 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:50.328 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236750+0000", 2024-09-12T18:37:50.328 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064909123999999999 2024-09-12T18:37:50.328 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.329 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.329 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:50.330 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236819+0000", 2024-09-12T18:37:50.330 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8860000000000001e-05 2024-09-12T18:37:50.330 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:50.330 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:50.330 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:50.331 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.331 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.331 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167361 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:50.331 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:50.331 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 47.058991169999999, 2024-09-12T18:37:50.331 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.063049426000000006, 2024-09-12T18:37:50.331 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:50.331 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:50.331 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:50.331 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:50.331 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.331 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:50.332 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:50.332 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:50.332 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.332 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.332 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:50.332 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:50.332 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:50.332 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.332 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.333 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:50.333 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:50.333 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.9099999999999999e-07 2024-09-12T18:37:50.333 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.333 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.333 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:50.333 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171820+0000", 2024-09-12T18:37:50.333 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.5900000000000002e-06 2024-09-12T18:37:50.333 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.333 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.333 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:50.334 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171826+0000", 2024-09-12T18:37:50.334 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.64e-06 2024-09-12T18:37:50.334 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.334 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.334 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:50.334 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171831+0000", 2024-09-12T18:37:50.334 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.578e-06 2024-09-12T18:37:50.334 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.334 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.335 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:50.335 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234808+0000", 2024-09-12T18:37:50.335 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062976780999999996 2024-09-12T18:37:50.335 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.335 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.335 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:50.335 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234821+0000", 2024-09-12T18:37:50.335 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3002e-05 2024-09-12T18:37:50.335 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.335 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.335 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:50.336 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234866+0000", 2024-09-12T18:37:50.336 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5444000000000001e-05 2024-09-12T18:37:50.336 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:50.336 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:50.336 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:50.336 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.336 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.336 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167366 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:50.337 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.172133+0000", 2024-09-12T18:37:50.337 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 47.058674342000003, 2024-09-12T18:37:50.337 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062815840999999997, 2024-09-12T18:37:50.337 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:50.337 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:50.337 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:50.337 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:50.337 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.338 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:50.338 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172133+0000", 2024-09-12T18:37:50.338 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:50.338 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.338 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.339 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:50.339 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172133+0000", 2024-09-12T18:37:50.339 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:50.339 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.339 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.339 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:50.339 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172134+0000", 2024-09-12T18:37:50.339 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5000000000000003e-07 2024-09-12T18:37:50.339 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.339 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.340 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:50.340 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172137+0000", 2024-09-12T18:37:50.340 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.6460000000000002e-06 2024-09-12T18:37:50.340 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.340 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.340 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:50.340 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234511+0000", 2024-09-12T18:37:50.340 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062374603000000001 2024-09-12T18:37:50.340 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.340 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.340 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:50.340 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234525+0000", 2024-09-12T18:37:50.341 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3396e-05 2024-09-12T18:37:50.341 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.341 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.341 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:50.341 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234909+0000", 2024-09-12T18:37:50.341 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00038405299999999998 2024-09-12T18:37:50.341 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.341 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.341 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:50.341 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234922+0000", 2024-09-12T18:37:50.341 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3274e-05 2024-09-12T18:37:50.341 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.341 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.342 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:50.342 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234949+0000", 2024-09-12T18:37:50.342 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7319000000000001e-05 2024-09-12T18:37:50.342 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:50.342 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:50.342 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:50.342 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.342 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.342 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167369 5.7 e58/21 5:e64ecabd:::benchmark_data_smithi073_23739_object35092:head v 58'10505, mlcod=58'10502)", 2024-09-12T18:37:50.342 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:50.342 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 47.057143949999997, 2024-09-12T18:37:50.342 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.063873773999999994, 2024-09-12T18:37:50.342 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:50.343 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:50.343 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:50.343 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:50.343 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.343 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:50.343 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:50.343 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:50.343 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.343 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.343 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:50.343 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:50.344 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:50.344 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.344 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.344 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:50.344 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:50.344 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3500000000000002e-07 2024-09-12T18:37:50.344 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.344 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.344 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:50.344 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173668+0000", 2024-09-12T18:37:50.344 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4000000000000001e-06 2024-09-12T18:37:50.344 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.344 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.345 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:50.345 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234583+0000", 2024-09-12T18:37:50.345 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.060914889 2024-09-12T18:37:50.345 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.345 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.345 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:50.345 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234600+0000", 2024-09-12T18:37:50.345 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7192000000000001e-05 2024-09-12T18:37:50.345 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.345 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.345 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:50.345 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234791+0000", 2024-09-12T18:37:50.345 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00019115000000000001 2024-09-12T18:37:50.346 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.346 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.346 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:50.346 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234834+0000", 2024-09-12T18:37:50.346 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3296e-05 2024-09-12T18:37:50.347 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.347 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.347 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:50.347 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.237481+0000", 2024-09-12T18:37:50.347 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0026472050000000001 2024-09-12T18:37:50.347 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.348 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.348 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:50.348 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.237538+0000", 2024-09-12T18:37:50.348 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6206999999999999e-05 2024-09-12T18:37:50.348 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:50.349 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:50.349 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:50.349 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.349 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.349 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:238478 5.c 5:38260ae8:::benchmark_data_smithi073_23739_object106201:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:50.349 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:38.617167+0000", 2024-09-12T18:37:50.349 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 11.613640532, 2024-09-12T18:37:50.349 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062584934999999994, 2024-09-12T18:37:50.349 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:50.350 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:50.350 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:50.350 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:50.350 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:50.350 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:50.350 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 238478 2024-09-12T18:37:50.350 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.351 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:50.351 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.351 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:50.351 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.617167+0000", 2024-09-12T18:37:50.351 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:50.351 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.352 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.352 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:50.352 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.617167+0000", 2024-09-12T18:37:50.352 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:50.352 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.353 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.353 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:50.353 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.617168+0000", 2024-09-12T18:37:50.353 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.091e-06 2024-09-12T18:37:50.353 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.353 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.353 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:50.354 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.617173+0000", 2024-09-12T18:37:50.354 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2490000000000003e-06 2024-09-12T18:37:50.354 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.355 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.355 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:50.355 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.617182+0000", 2024-09-12T18:37:50.355 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.6390000000000004e-06 2024-09-12T18:37:50.355 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.356 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.356 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:50.356 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.617189+0000", 2024-09-12T18:37:50.357 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0119999999999999e-06 2024-09-12T18:37:50.357 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.357 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.357 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:50.357 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.617678+0000", 2024-09-12T18:37:50.357 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00048910800000000003 2024-09-12T18:37:50.358 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.358 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.358 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:50.358 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.665641+0000", 2024-09-12T18:37:50.358 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.047962481000000001 2024-09-12T18:37:50.358 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.359 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.359 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:50.359 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.665895+0000", 2024-09-12T18:37:50.359 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00025440199999999998 2024-09-12T18:37:50.359 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.359 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.360 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:50.360 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.670817+0000", 2024-09-12T18:37:50.360 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0049221120000000002 2024-09-12T18:37:50.360 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.360 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.360 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:50.361 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.679695+0000", 2024-09-12T18:37:50.361 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0088778269999999996 2024-09-12T18:37:50.361 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.361 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.361 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:50.361 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.679726+0000", 2024-09-12T18:37:50.362 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.0830999999999997e-05 2024-09-12T18:37:50.362 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.362 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.362 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:50.362 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.679752+0000", 2024-09-12T18:37:50.362 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.6183e-05 2024-09-12T18:37:50.363 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:50.363 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:50.363 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:50.363 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.363 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.364 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:238480 5.c 5:3d043cef:::benchmark_data_smithi073_23739_object106203:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:50.364 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:38.618189+0000", 2024-09-12T18:37:50.364 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 11.612618726000001, 2024-09-12T18:37:50.364 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.061642400999999999, 2024-09-12T18:37:50.364 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:50.364 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:50.364 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:50.365 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:50.365 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:50.365 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:50.365 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 238480 2024-09-12T18:37:50.365 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.365 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:50.366 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.366 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:50.366 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.618189+0000", 2024-09-12T18:37:50.366 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:50.366 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.366 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.366 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:50.367 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.618189+0000", 2024-09-12T18:37:50.367 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:50.367 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.367 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.367 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:50.367 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.618190+0000", 2024-09-12T18:37:50.367 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3e-07 2024-09-12T18:37:50.367 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.367 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.367 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:50.367 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.618193+0000", 2024-09-12T18:37:50.368 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.6349999999999999e-06 2024-09-12T18:37:50.368 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.368 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.368 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:50.368 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.665526+0000", 2024-09-12T18:37:50.368 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.047332200999999997 2024-09-12T18:37:50.369 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.369 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.369 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:50.369 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.665561+0000", 2024-09-12T18:37:50.369 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.5858999999999997e-05 2024-09-12T18:37:50.369 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.369 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.369 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:50.369 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.670869+0000", 2024-09-12T18:37:50.369 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0053076720000000003 2024-09-12T18:37:50.369 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.369 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.369 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:50.370 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.671094+0000", 2024-09-12T18:37:50.370 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000225009 2024-09-12T18:37:50.370 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.370 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.370 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:50.370 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.671272+0000", 2024-09-12T18:37:50.370 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000177725 2024-09-12T18:37:50.370 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.370 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.370 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:50.370 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.679687+0000", 2024-09-12T18:37:50.370 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0084148379999999991 2024-09-12T18:37:50.370 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.370 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.370 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:50.371 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.679787+0000", 2024-09-12T18:37:50.371 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.9950000000000004e-05 2024-09-12T18:37:50.371 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.371 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.371 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:50.371 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.679811+0000", 2024-09-12T18:37:50.371 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4088999999999999e-05 2024-09-12T18:37:50.371 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:50.371 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:50.371 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:50.371 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.679831+0000", 2024-09-12T18:37:50.371 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.0693e-05 2024-09-12T18:37:50.371 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:50.372 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:50.372 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:50.372 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:50.372 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:50.372 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:50.374 INFO:tasks.radosbench.radosbench.0.smithi073.stdout:Removed 132274 objects 2024-09-12T18:37:50.374 INFO:tasks.radosbench.radosbench.0.smithi073.stdout:Clean up completed and total clean up time :63.4697 2024-09-12T18:37:50.374 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:37:50.375 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:50.369+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:50.475 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:50.471+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:50.494 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:50.494 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-09-12T18:37:50.494 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-09-12T18:37:50.494 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:50.508 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:37:50.595 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:50.591+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:50.673 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:50.673 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-09-12T18:37:50.673 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-09-12T18:37:50.673 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-09-12T18:37:50.674 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:50.676 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:50.671+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:50.687 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:37:50.777 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:50.773+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:50.857 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:50.858 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-09-12T18:37:50.858 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-09-12T18:37:50.858 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:37:50.858 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.858 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121096 5.8 5:13503891:::benchmark_data_smithi073_23739_object121095:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:50.858 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:37:50.858 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 70.673119658999994, 2024-09-12T18:37:50.858 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064025391000000001, 2024-09-12T18:37:50.858 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:50.858 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:50.858 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:50.858 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:50.859 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:50.859 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:50.859 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121096 2024-09-12T18:37:50.859 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.859 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:50.859 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.859 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:50.859 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:37:50.859 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:50.859 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.859 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.859 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:50.859 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:37:50.859 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:50.860 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.860 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.860 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:50.860 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178579+0000", 2024-09-12T18:37:50.860 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7369999999999998e-06 2024-09-12T18:37:50.860 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.860 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.860 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:50.860 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178846+0000", 2024-09-12T18:37:50.860 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026752699999999999 2024-09-12T18:37:50.860 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.860 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.860 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:50.861 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178877+0000", 2024-09-12T18:37:50.861 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1081999999999998e-05 2024-09-12T18:37:50.861 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.861 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.861 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:50.861 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178896+0000", 2024-09-12T18:37:50.861 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8522e-05 2024-09-12T18:37:50.861 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.861 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.861 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:50.861 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.192591+0000", 2024-09-12T18:37:50.861 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013695067 2024-09-12T18:37:50.861 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.861 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.862 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:50.862 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.192944+0000", 2024-09-12T18:37:50.862 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00035273699999999999 2024-09-12T18:37:50.862 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.862 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.862 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:50.862 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.193732+0000", 2024-09-12T18:37:50.862 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078849599999999997 2024-09-12T18:37:50.862 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.862 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.862 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:50.862 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.213583+0000", 2024-09-12T18:37:50.862 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.019851164000000001 2024-09-12T18:37:50.862 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.863 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.863 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:50.863 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242386+0000", 2024-09-12T18:37:50.863 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028802924000000001 2024-09-12T18:37:50.863 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.863 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.863 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:50.863 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242501+0000", 2024-09-12T18:37:50.863 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000114932 2024-09-12T18:37:50.863 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.863 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.863 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:50.863 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242602+0000", 2024-09-12T18:37:50.863 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000100203 2024-09-12T18:37:50.864 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:50.864 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:50.864 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:50.864 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.864 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.864 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121097 5.8 5:1b31a99e:::benchmark_data_smithi073_23739_object121096:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:50.864 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:37:50.864 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 70.657391368999996, 2024-09-12T18:37:50.864 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048475917, 2024-09-12T18:37:50.864 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:50.864 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:50.864 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:50.864 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:50.865 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:50.865 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:50.865 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121097 2024-09-12T18:37:50.865 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.865 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:50.865 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.865 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:50.865 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:37:50.865 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:50.865 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.865 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.865 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:50.865 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:37:50.866 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:50.866 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.866 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.866 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:50.866 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194308+0000", 2024-09-12T18:37:50.866 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2789999999999999e-06 2024-09-12T18:37:50.866 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.866 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.866 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:50.866 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194396+0000", 2024-09-12T18:37:50.866 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8324000000000003e-05 2024-09-12T18:37:50.866 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.866 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.866 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:50.867 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194424+0000", 2024-09-12T18:37:50.867 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7565000000000001e-05 2024-09-12T18:37:50.867 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.867 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.867 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:50.867 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194444+0000", 2024-09-12T18:37:50.867 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0363000000000001e-05 2024-09-12T18:37:50.867 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.867 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.867 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:50.867 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.206888+0000", 2024-09-12T18:37:50.867 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012443997 2024-09-12T18:37:50.867 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.867 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.868 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:50.868 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.207138+0000", 2024-09-12T18:37:50.868 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025035900000000002 2024-09-12T18:37:50.868 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.868 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.868 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:50.868 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.207365+0000", 2024-09-12T18:37:50.868 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000226407 2024-09-12T18:37:50.868 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.868 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.868 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:50.868 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.215059+0000", 2024-09-12T18:37:50.868 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076946860000000001 2024-09-12T18:37:50.869 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.869 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.869 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:50.869 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242619+0000", 2024-09-12T18:37:50.869 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.027559975 2024-09-12T18:37:50.869 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.869 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.869 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:50.869 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242706+0000", 2024-09-12T18:37:50.869 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6384999999999994e-05 2024-09-12T18:37:50.869 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.869 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.869 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:50.869 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242780+0000", 2024-09-12T18:37:50.870 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4577000000000001e-05 2024-09-12T18:37:50.870 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:50.870 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:50.870 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:50.870 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.870 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.870 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121106 5.d 5:b4a9a221:::benchmark_data_smithi073_23739_object121105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:50.870 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:37:50.870 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 70.614516433000006, 2024-09-12T18:37:50.870 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.034882274999999997, 2024-09-12T18:37:50.870 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:50.870 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:50.870 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:50.871 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:50.871 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:50.871 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:50.871 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121106 2024-09-12T18:37:50.871 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.871 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:50.871 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.871 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:50.871 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:37:50.871 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:50.871 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.871 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.871 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:50.871 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:37:50.872 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:50.872 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.872 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.872 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:50.872 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237182+0000", 2024-09-12T18:37:50.872 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6019999999999998e-06 2024-09-12T18:37:50.872 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.872 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.872 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:50.872 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237257+0000", 2024-09-12T18:37:50.872 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5420999999999995e-05 2024-09-12T18:37:50.872 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.872 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.873 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:50.873 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237305+0000", 2024-09-12T18:37:50.873 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7207999999999999e-05 2024-09-12T18:37:50.873 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.873 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.873 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:50.873 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237325+0000", 2024-09-12T18:37:50.873 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0001e-05 2024-09-12T18:37:50.873 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.873 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.873 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:50.873 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237505+0000", 2024-09-12T18:37:50.873 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000180798 2024-09-12T18:37:50.873 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.874 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.874 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:50.874 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237764+0000", 2024-09-12T18:37:50.874 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025862299999999998 2024-09-12T18:37:50.874 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.874 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.874 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:50.874 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.238264+0000", 2024-09-12T18:37:50.874 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00050016100000000005 2024-09-12T18:37:50.874 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.874 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.874 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:50.874 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256525+0000", 2024-09-12T18:37:50.874 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018260508000000002 2024-09-12T18:37:50.875 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.875 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.875 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:50.875 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.271903+0000", 2024-09-12T18:37:50.875 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015378739000000001 2024-09-12T18:37:50.875 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.875 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.875 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:50.875 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.271999+0000", 2024-09-12T18:37:50.875 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5989000000000005e-05 2024-09-12T18:37:50.875 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.875 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.875 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:50.875 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272062+0000", 2024-09-12T18:37:50.876 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2224999999999995e-05 2024-09-12T18:37:50.876 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:50.876 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:50.876 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:50.876 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.876 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.876 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:167368 5.4 5:29a1ec58:::benchmark_data_smithi073_23739_object35091:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:50.876 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:03.168773+0000", 2024-09-12T18:37:50.876 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 47.682922566000002, 2024-09-12T18:37:50.876 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.066578597000000003, 2024-09-12T18:37:50.876 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:50.876 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:50.876 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:50.876 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:50.877 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:50.877 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:50.877 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 167368 2024-09-12T18:37:50.877 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.877 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:50.877 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.877 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:50.877 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168773+0000", 2024-09-12T18:37:50.877 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:50.878 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.878 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.878 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:50.878 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168773+0000", 2024-09-12T18:37:50.878 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:50.878 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.878 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.878 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:50.878 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168774+0000", 2024-09-12T18:37:50.878 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.023e-06 2024-09-12T18:37:50.878 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.878 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.878 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:50.878 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168779+0000", 2024-09-12T18:37:50.879 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5800000000000002e-06 2024-09-12T18:37:50.879 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.879 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.879 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:50.879 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168789+0000", 2024-09-12T18:37:50.879 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0346999999999999e-05 2024-09-12T18:37:50.879 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.879 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.879 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:50.879 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168808+0000", 2024-09-12T18:37:50.879 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8423e-05 2024-09-12T18:37:50.879 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.879 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.880 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:50.880 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168864+0000", 2024-09-12T18:37:50.880 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-09-12T18:37:50.880 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.880 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.880 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:50.880 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168947+0000", 2024-09-12T18:37:50.880 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3274000000000003e-05 2024-09-12T18:37:50.880 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.880 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.880 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:50.880 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.169014+0000", 2024-09-12T18:37:50.880 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6284000000000004e-05 2024-09-12T18:37:50.881 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.881 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.881 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:50.881 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.170653+0000", 2024-09-12T18:37:50.881 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016389779999999999 2024-09-12T18:37:50.881 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.881 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.881 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:50.881 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.235279+0000", 2024-09-12T18:37:50.881 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064626464999999994 2024-09-12T18:37:50.881 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.881 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.881 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:50.881 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.235320+0000", 2024-09-12T18:37:50.882 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0377000000000003e-05 2024-09-12T18:37:50.882 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.882 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.882 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:50.882 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.235352+0000", 2024-09-12T18:37:50.882 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2322e-05 2024-09-12T18:37:50.882 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:50.882 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:50.882 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:50.882 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.882 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.882 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:167371 5.4 5:24fea27c:::benchmark_data_smithi073_23739_object35094:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:50.882 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:03.171234+0000", 2024-09-12T18:37:50.882 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 47.680461541, 2024-09-12T18:37:50.883 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.066048171000000003, 2024-09-12T18:37:50.883 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:50.883 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:50.883 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:50.883 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:50.883 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:50.883 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:50.883 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 167371 2024-09-12T18:37:50.883 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.883 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:50.883 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.883 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:50.883 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171234+0000", 2024-09-12T18:37:50.883 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:50.884 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.884 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.884 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:50.884 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171234+0000", 2024-09-12T18:37:50.884 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:50.884 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.884 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.884 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:50.884 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171235+0000", 2024-09-12T18:37:50.884 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8599999999999997e-07 2024-09-12T18:37:50.884 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.884 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.884 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:50.884 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171238+0000", 2024-09-12T18:37:50.885 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9739999999999998e-06 2024-09-12T18:37:50.885 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.885 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.885 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:50.885 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171245+0000", 2024-09-12T18:37:50.885 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6000000000000003e-06 2024-09-12T18:37:50.885 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.885 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.885 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:50.885 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171249+0000", 2024-09-12T18:37:50.885 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9960000000000004e-06 2024-09-12T18:37:50.885 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.885 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.886 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:50.886 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171288+0000", 2024-09-12T18:37:50.886 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9119999999999998e-05 2024-09-12T18:37:50.886 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.886 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.886 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:50.886 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171359+0000", 2024-09-12T18:37:50.886 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0951000000000006e-05 2024-09-12T18:37:50.886 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.886 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.886 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:50.886 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171425+0000", 2024-09-12T18:37:50.886 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.58e-05 2024-09-12T18:37:50.887 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.887 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.887 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:50.887 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.173093+0000", 2024-09-12T18:37:50.887 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016683939999999999 2024-09-12T18:37:50.887 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.887 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.887 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:50.887 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.237202+0000", 2024-09-12T18:37:50.887 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064109437000000005 2024-09-12T18:37:50.887 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.887 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.887 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:50.887 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.237249+0000", 2024-09-12T18:37:50.888 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6751e-05 2024-09-12T18:37:50.888 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.888 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.888 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:50.888 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.237282+0000", 2024-09-12T18:37:50.888 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3262000000000001e-05 2024-09-12T18:37:50.888 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:50.888 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:50.888 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:50.888 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.888 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.888 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:201498 5.a e67/21 5:5815d848:::benchmark_data_smithi073_23739_object69221:head v 67'12793, mlcod=67'12791)", 2024-09-12T18:37:50.888 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.430872+0000", 2024-09-12T18:37:50.889 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 30.420823562999999, 2024-09-12T18:37:50.889 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.038775280000000002, 2024-09-12T18:37:50.889 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:50.889 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:50.889 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:50.889 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:50.889 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.889 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:50.889 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430872+0000", 2024-09-12T18:37:50.889 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:50.889 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.889 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.889 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:50.890 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430872+0000", 2024-09-12T18:37:50.890 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:50.890 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.890 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.890 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:50.890 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430873+0000", 2024-09-12T18:37:50.890 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6600000000000003e-07 2024-09-12T18:37:50.890 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.890 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.890 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:50.890 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430875+0000", 2024-09-12T18:37:50.890 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5399999999999998e-06 2024-09-12T18:37:50.890 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.890 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.891 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:50.891 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430879+0000", 2024-09-12T18:37:50.891 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7239999999999998e-06 2024-09-12T18:37:50.891 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.891 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.891 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:50.891 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430882+0000", 2024-09-12T18:37:50.891 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8679999999999999e-06 2024-09-12T18:37:50.891 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.891 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.891 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:50.891 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430909+0000", 2024-09-12T18:37:50.891 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7832999999999999e-05 2024-09-12T18:37:50.891 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.892 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.892 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:50.892 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430922+0000", 2024-09-12T18:37:50.892 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2164000000000001e-05 2024-09-12T18:37:50.892 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.892 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.892 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:50.892 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469578+0000", 2024-09-12T18:37:50.892 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.038656469999999998 2024-09-12T18:37:50.892 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.892 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.892 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:50.892 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469648+0000", 2024-09-12T18:37:50.893 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9414999999999999e-05 2024-09-12T18:37:50.893 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:50.893 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:50.893 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:50.893 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.893 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.893 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201513 5.e 5:7be2f597:::benchmark_data_smithi073_23739_object69236:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:50.893 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.435121+0000", 2024-09-12T18:37:50.893 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 30.41657481, 2024-09-12T18:37:50.893 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.034945021999999999, 2024-09-12T18:37:50.893 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:50.893 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:50.893 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:50.893 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:50.894 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:50.894 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:50.894 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201513 2024-09-12T18:37:50.894 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.894 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:50.894 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.894 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:50.894 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.435121+0000", 2024-09-12T18:37:50.894 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:50.894 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.894 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.894 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:50.894 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.435121+0000", 2024-09-12T18:37:50.894 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:50.895 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.895 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.895 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:50.895 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.435122+0000", 2024-09-12T18:37:50.895 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2440000000000001e-06 2024-09-12T18:37:50.895 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.895 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.895 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:50.895 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.435126+0000", 2024-09-12T18:37:50.896 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1559999999999997e-06 2024-09-12T18:37:50.896 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.896 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.896 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:50.896 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445086+0000", 2024-09-12T18:37:50.896 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0099592389999999999 2024-09-12T18:37:50.896 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.896 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.896 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:50.896 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445095+0000", 2024-09-12T18:37:50.896 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2620000000000004e-06 2024-09-12T18:37:50.896 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.896 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.896 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:50.897 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445165+0000", 2024-09-12T18:37:50.897 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0257000000000002e-05 2024-09-12T18:37:50.897 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.897 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.897 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:50.897 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445311+0000", 2024-09-12T18:37:50.897 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014603899999999999 2024-09-12T18:37:50.897 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.897 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.897 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:50.897 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445445+0000", 2024-09-12T18:37:50.897 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000133654 2024-09-12T18:37:50.897 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.897 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.898 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:50.898 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469853+0000", 2024-09-12T18:37:50.898 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024407893999999999 2024-09-12T18:37:50.898 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.898 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.898 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:50.898 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469873+0000", 2024-09-12T18:37:50.898 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0622e-05 2024-09-12T18:37:50.898 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.898 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.898 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:50.898 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469949+0000", 2024-09-12T18:37:50.898 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5918000000000001e-05 2024-09-12T18:37:50.898 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.899 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.899 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:50.899 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470066+0000", 2024-09-12T18:37:50.899 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000116737 2024-09-12T18:37:50.899 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:50.899 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:50.899 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:50.899 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.899 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.899 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201521 5.d 5:b911ab6f:::benchmark_data_smithi073_23739_object69244:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:50.899 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445173+0000", 2024-09-12T18:37:50.899 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 30.406522367000001, 2024-09-12T18:37:50.899 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.031483274999999998, 2024-09-12T18:37:50.900 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:50.900 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:50.900 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:50.900 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:50.900 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:50.900 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:50.900 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201521 2024-09-12T18:37:50.900 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.900 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:50.900 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.900 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:50.900 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445173+0000", 2024-09-12T18:37:50.900 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:50.901 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.901 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.901 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:50.901 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445173+0000", 2024-09-12T18:37:50.901 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:50.901 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.901 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.901 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:50.901 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445174+0000", 2024-09-12T18:37:50.901 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4299999999999998e-07 2024-09-12T18:37:50.901 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.901 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.901 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:50.901 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445176+0000", 2024-09-12T18:37:50.902 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.469e-06 2024-09-12T18:37:50.902 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.902 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.902 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:50.902 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445183+0000", 2024-09-12T18:37:50.902 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8719999999999996e-06 2024-09-12T18:37:50.902 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.902 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.902 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:50.902 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445188+0000", 2024-09-12T18:37:50.902 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7079999999999996e-06 2024-09-12T18:37:50.902 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.902 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.902 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:50.903 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445314+0000", 2024-09-12T18:37:50.903 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012627800000000001 2024-09-12T18:37:50.903 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.903 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.903 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:50.903 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445436+0000", 2024-09-12T18:37:50.903 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000122007 2024-09-12T18:37:50.903 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.903 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.903 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:50.903 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445541+0000", 2024-09-12T18:37:50.903 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000105068 2024-09-12T18:37:50.903 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.903 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.904 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:50.904 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470655+0000", 2024-09-12T18:37:50.904 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025114035 2024-09-12T18:37:50.904 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.904 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.904 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:50.904 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476570+0000", 2024-09-12T18:37:50.904 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0059143269999999996 2024-09-12T18:37:50.904 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.904 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.904 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:50.904 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476624+0000", 2024-09-12T18:37:50.904 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4261000000000001e-05 2024-09-12T18:37:50.904 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.905 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.905 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:50.905 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476657+0000", 2024-09-12T18:37:50.905 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2806999999999999e-05 2024-09-12T18:37:50.905 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:50.905 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:50.905 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:50.905 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.905 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.905 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201524 5.d 5:b330b18b:::benchmark_data_smithi073_23739_object69247:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:50.905 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445202+0000", 2024-09-12T18:37:50.905 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 30.406494107, 2024-09-12T18:37:50.905 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.034036482, 2024-09-12T18:37:50.905 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:50.906 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:50.906 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:50.906 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:50.906 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:50.906 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:50.906 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201524 2024-09-12T18:37:50.906 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.906 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:50.906 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.906 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:50.906 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445202+0000", 2024-09-12T18:37:50.906 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:50.906 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.906 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.907 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:50.907 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445202+0000", 2024-09-12T18:37:50.907 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:50.907 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.907 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.907 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:50.907 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445202+0000", 2024-09-12T18:37:50.907 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2e-07 2024-09-12T18:37:50.907 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.907 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.907 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:50.907 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445204+0000", 2024-09-12T18:37:50.907 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0490000000000002e-06 2024-09-12T18:37:50.908 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.908 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.908 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:50.908 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445210+0000", 2024-09-12T18:37:50.908 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.959e-06 2024-09-12T18:37:50.908 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.908 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.908 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:50.908 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445215+0000", 2024-09-12T18:37:50.908 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.668e-06 2024-09-12T18:37:50.908 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.908 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.908 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:50.909 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470703+0000", 2024-09-12T18:37:50.909 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025488182000000002 2024-09-12T18:37:50.909 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.909 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.909 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:50.909 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470911+0000", 2024-09-12T18:37:50.909 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020755400000000001 2024-09-12T18:37:50.909 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.909 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.909 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:50.909 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.471309+0000", 2024-09-12T18:37:50.909 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00039868199999999998 2024-09-12T18:37:50.909 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.909 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.910 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:50.910 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476724+0000", 2024-09-12T18:37:50.910 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054150589999999998 2024-09-12T18:37:50.910 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.910 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.910 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:50.910 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.479050+0000", 2024-09-12T18:37:50.910 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0023259309999999998 2024-09-12T18:37:50.910 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.910 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.910 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:50.910 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.479164+0000", 2024-09-12T18:37:50.910 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000114127 2024-09-12T18:37:50.910 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.911 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.911 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:50.911 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.479238+0000", 2024-09-12T18:37:50.911 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3751000000000006e-05 2024-09-12T18:37:50.911 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:50.911 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:50.911 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:50.911 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.911 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.911 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_backfill(progress 5.5 e 67/67 lb 5:a30f9be2:::benchmark_data_smithi073_23739_object118666:head)", 2024-09-12T18:37:50.911 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445433+0000", 2024-09-12T18:37:50.911 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 30.406263221, 2024-09-12T18:37:50.911 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.029511351000000002, 2024-09-12T18:37:50.911 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:50.912 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:50.912 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:37:50.912 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:50.912 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.912 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:50.912 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445433+0000", 2024-09-12T18:37:50.912 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:50.912 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.912 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.912 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:50.912 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445433+0000", 2024-09-12T18:37:50.912 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:50.912 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.912 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.913 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:50.913 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445433+0000", 2024-09-12T18:37:50.913 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0699999999999998e-07 2024-09-12T18:37:50.913 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.913 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.913 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:50.913 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445440+0000", 2024-09-12T18:37:50.913 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6630000000000004e-06 2024-09-12T18:37:50.913 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.913 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.913 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:50.913 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445447+0000", 2024-09-12T18:37:50.913 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5159999999999997e-06 2024-09-12T18:37:50.914 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.914 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.914 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:50.914 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445454+0000", 2024-09-12T18:37:50.914 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.267e-06 2024-09-12T18:37:50.914 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.914 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.914 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:50.914 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.474780+0000", 2024-09-12T18:37:50.914 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.029325496999999999 2024-09-12T18:37:50.914 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.914 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.914 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:50.914 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.474802+0000", 2024-09-12T18:37:50.915 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2348999999999999e-05 2024-09-12T18:37:50.915 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.915 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.915 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:50.915 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.474944+0000", 2024-09-12T18:37:50.915 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014165200000000001 2024-09-12T18:37:50.915 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:50.915 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:50.915 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:50.915 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.915 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.916 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:201515 5.5 e67/49 5:a25bd8bb:::benchmark_data_smithi073_23739_object69238:head v 67'12752, mlcod=67'12750)", 2024-09-12T18:37:50.916 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445471+0000", 2024-09-12T18:37:50.916 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 30.406225306, 2024-09-12T18:37:50.916 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.031081396000000001, 2024-09-12T18:37:50.916 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:50.916 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:50.916 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:50.916 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:50.916 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.916 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:50.916 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445471+0000", 2024-09-12T18:37:50.917 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:50.917 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.917 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.917 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:50.917 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445471+0000", 2024-09-12T18:37:50.917 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:50.917 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.917 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.917 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:50.917 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445471+0000", 2024-09-12T18:37:50.917 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5400000000000002e-07 2024-09-12T18:37:50.917 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.917 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.918 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:50.918 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445475+0000", 2024-09-12T18:37:50.918 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2379999999999999e-06 2024-09-12T18:37:50.918 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.918 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.918 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:50.918 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445481+0000", 2024-09-12T18:37:50.918 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0229999999999998e-06 2024-09-12T18:37:50.918 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.918 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.918 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:50.918 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445486+0000", 2024-09-12T18:37:50.918 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5040000000000004e-06 2024-09-12T18:37:50.919 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.919 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.919 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:50.919 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445970+0000", 2024-09-12T18:37:50.919 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048416699999999997 2024-09-12T18:37:50.919 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.919 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.919 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:50.919 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445991+0000", 2024-09-12T18:37:50.919 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1067999999999999e-05 2024-09-12T18:37:50.919 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.919 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.919 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:50.919 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476511+0000", 2024-09-12T18:37:50.920 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.030520629000000001 2024-09-12T18:37:50.920 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.920 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.920 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:50.920 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476552+0000", 2024-09-12T18:37:50.920 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0413000000000001e-05 2024-09-12T18:37:50.920 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:50.920 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:50.920 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:50.920 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.920 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.920 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:201526 5.5 e67/49 5:a3549698:::benchmark_data_smithi073_23739_object69249:head v 67'12753, mlcod=67'12750)", 2024-09-12T18:37:50.920 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445957+0000", 2024-09-12T18:37:50.921 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 30.405738373999998, 2024-09-12T18:37:50.921 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.030732494999999999, 2024-09-12T18:37:50.921 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:50.921 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:50.921 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:50.921 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:50.921 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.921 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:50.921 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445957+0000", 2024-09-12T18:37:50.921 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:50.921 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.921 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.921 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:50.921 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445957+0000", 2024-09-12T18:37:50.922 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:50.922 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.922 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.922 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:50.922 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445958+0000", 2024-09-12T18:37:50.922 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7800000000000001e-07 2024-09-12T18:37:50.922 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.922 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.922 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:50.923 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445963+0000", 2024-09-12T18:37:50.923 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5419999999999999e-06 2024-09-12T18:37:50.923 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.923 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.923 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:50.923 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445972+0000", 2024-09-12T18:37:50.923 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4169999999999998e-06 2024-09-12T18:37:50.923 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.924 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.924 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:50.924 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445979+0000", 2024-09-12T18:37:50.924 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2949999999999996e-06 2024-09-12T18:37:50.924 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.924 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.924 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:50.924 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.447710+0000", 2024-09-12T18:37:50.924 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001731067 2024-09-12T18:37:50.924 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.924 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.924 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:50.925 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.447734+0000", 2024-09-12T18:37:50.925 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4094e-05 2024-09-12T18:37:50.925 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.925 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.925 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:50.925 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476659+0000", 2024-09-12T18:37:50.925 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028924268999999999 2024-09-12T18:37:50.925 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.925 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.925 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:50.925 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476690+0000", 2024-09-12T18:37:50.925 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1232999999999997e-05 2024-09-12T18:37:50.925 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:50.926 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:50.926 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:50.926 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.926 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.926 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201583 5.d 5:b91eedec:::benchmark_data_smithi073_23739_object69306:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:50.926 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.494097+0000", 2024-09-12T18:37:50.926 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 30.357598511999999, 2024-09-12T18:37:50.926 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049293508, 2024-09-12T18:37:50.926 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:50.926 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:50.926 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:50.926 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:50.926 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:50.926 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:50.927 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201583 2024-09-12T18:37:50.927 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.927 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:50.927 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.927 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:50.927 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494097+0000", 2024-09-12T18:37:50.927 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:50.927 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.927 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.927 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:50.927 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494097+0000", 2024-09-12T18:37:50.927 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:50.927 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.928 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:50.928 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494098+0000", 2024-09-12T18:37:50.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0699999999999996e-07 2024-09-12T18:37:50.928 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.928 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:50.928 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494102+0000", 2024-09-12T18:37:50.928 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.664e-06 2024-09-12T18:37:50.928 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.928 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.928 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:50.929 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494108+0000", 2024-09-12T18:37:50.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.3149999999999997e-06 2024-09-12T18:37:50.929 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.929 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.929 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:50.929 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494112+0000", 2024-09-12T18:37:50.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0659999999999997e-06 2024-09-12T18:37:50.929 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.929 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.929 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:50.929 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494200+0000", 2024-09-12T18:37:50.929 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7770999999999997e-05 2024-09-12T18:37:50.929 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.930 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:50.930 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494315+0000", 2024-09-12T18:37:50.930 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000115048 2024-09-12T18:37:50.930 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.930 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:50.930 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494414+0000", 2024-09-12T18:37:50.930 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8820999999999995e-05 2024-09-12T18:37:50.930 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.930 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.930 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:50.930 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.497199+0000", 2024-09-12T18:37:50.931 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0027854279999999999 2024-09-12T18:37:50.931 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.931 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.931 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:50.931 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543193+0000", 2024-09-12T18:37:50.931 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.045993500999999999 2024-09-12T18:37:50.931 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.931 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.931 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:50.931 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543315+0000", 2024-09-12T18:37:50.931 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012246800000000001 2024-09-12T18:37:50.931 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.931 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.932 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:50.932 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543391+0000", 2024-09-12T18:37:50.932 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5618999999999995e-05 2024-09-12T18:37:50.932 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:50.932 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:50.932 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:50.932 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.932 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.932 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201585 5.d 5:bb6c167f:::benchmark_data_smithi073_23739_object69308:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:50.932 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.495295+0000", 2024-09-12T18:37:50.932 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 30.356400345000001, 2024-09-12T18:37:50.932 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048312129000000002, 2024-09-12T18:37:50.932 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:50.933 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:50.933 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:50.933 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:50.933 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:50.933 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:50.933 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201585 2024-09-12T18:37:50.933 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.933 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:50.933 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.933 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:50.933 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495295+0000", 2024-09-12T18:37:50.933 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:50.933 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.934 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.934 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:50.934 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495295+0000", 2024-09-12T18:37:50.934 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:50.934 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.934 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.934 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:50.934 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495296+0000", 2024-09-12T18:37:50.934 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0330000000000001e-06 2024-09-12T18:37:50.934 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.934 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.934 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:50.934 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495301+0000", 2024-09-12T18:37:50.934 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7049999999999998e-06 2024-09-12T18:37:50.935 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.935 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.937 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:50.937 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495312+0000", 2024-09-12T18:37:50.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0791000000000001e-05 2024-09-12T18:37:50.937 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.937 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.937 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:50.937 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495319+0000", 2024-09-12T18:37:50.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8240000000000002e-06 2024-09-12T18:37:50.937 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.937 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.937 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:50.937 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.496088+0000", 2024-09-12T18:37:50.937 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00076901200000000002 2024-09-12T18:37:50.938 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.938 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.938 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:50.938 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.496166+0000", 2024-09-12T18:37:50.938 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.8491000000000005e-05 2024-09-12T18:37:50.938 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.938 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.938 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:50.938 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.496232+0000", 2024-09-12T18:37:50.938 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5400000000000004e-05 2024-09-12T18:37:50.939 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.939 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.939 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:50.939 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.497467+0000", 2024-09-12T18:37:50.939 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001235049 2024-09-12T18:37:50.939 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.939 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.939 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:50.939 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543463+0000", 2024-09-12T18:37:50.939 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.045995743999999998 2024-09-12T18:37:50.939 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.939 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.939 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:50.939 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543546+0000", 2024-09-12T18:37:50.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3434000000000001e-05 2024-09-12T18:37:50.940 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.940 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.940 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:50.940 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543608+0000", 2024-09-12T18:37:50.940 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1645999999999999e-05 2024-09-12T18:37:50.940 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:50.940 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:50.940 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:50.940 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.940 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.940 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:238484 5.8 5:135aca90:::benchmark_data_smithi073_23739_object106207:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:50.941 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:38.618805+0000", 2024-09-12T18:37:50.941 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 12.232890891, 2024-09-12T18:37:50.941 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051696747000000001, 2024-09-12T18:37:50.941 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:50.941 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:50.941 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:50.941 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:50.941 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:50.941 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:50.941 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 238484 2024-09-12T18:37:50.941 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.941 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:50.941 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.942 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:50.942 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.618805+0000", 2024-09-12T18:37:50.942 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:50.942 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.942 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:50.942 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.618805+0000", 2024-09-12T18:37:50.942 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:50.942 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.942 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.942 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:50.942 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.618806+0000", 2024-09-12T18:37:50.942 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1829999999999999e-06 2024-09-12T18:37:50.942 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:50.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.618810+0000", 2024-09-12T18:37:50.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8380000000000004e-06 2024-09-12T18:37:50.943 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:50.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.618820+0000", 2024-09-12T18:37:50.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0047999999999999e-05 2024-09-12T18:37:50.943 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.943 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.943 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:50.943 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.618826+0000", 2024-09-12T18:37:50.943 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7710000000000003e-06 2024-09-12T18:37:50.944 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.944 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.944 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:50.944 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.618869+0000", 2024-09-12T18:37:50.944 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3412999999999999e-05 2024-09-12T18:37:50.944 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.944 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.944 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:50.944 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.618945+0000", 2024-09-12T18:37:50.944 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5992e-05 2024-09-12T18:37:50.944 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.944 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.944 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:50.945 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.619014+0000", 2024-09-12T18:37:50.945 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9298e-05 2024-09-12T18:37:50.945 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.945 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.945 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:50.945 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.623942+0000", 2024-09-12T18:37:50.945 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0049273909999999997 2024-09-12T18:37:50.945 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.945 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.945 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:50.945 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.670424+0000", 2024-09-12T18:37:50.945 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.046482453999999999 2024-09-12T18:37:50.946 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.946 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:50.946 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.670468+0000", 2024-09-12T18:37:50.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3449999999999999e-05 2024-09-12T18:37:50.946 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.946 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.946 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:50.946 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.670502+0000", 2024-09-12T18:37:50.946 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3908999999999997e-05 2024-09-12T18:37:50.946 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:50.946 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:50.946 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:50.947 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.947 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.947 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:238488 5.e 5:7267a760:::benchmark_data_smithi073_23739_object106211:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:50.947 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:38.622076+0000", 2024-09-12T18:37:50.947 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 12.229620052, 2024-09-12T18:37:50.947 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053006515999999997, 2024-09-12T18:37:50.947 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:50.947 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:50.947 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:50.947 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:50.947 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:50.947 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:50.947 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 238488 2024-09-12T18:37:50.948 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.948 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:50.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:50.948 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622076+0000", 2024-09-12T18:37:50.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:50.948 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.948 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.948 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:50.948 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622076+0000", 2024-09-12T18:37:50.948 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:50.948 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:50.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622076+0000", 2024-09-12T18:37:50.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1900000000000002e-07 2024-09-12T18:37:50.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:50.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622080+0000", 2024-09-12T18:37:50.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.225e-06 2024-09-12T18:37:50.949 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.949 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.949 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:50.949 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622088+0000", 2024-09-12T18:37:50.949 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0949999999999996e-06 2024-09-12T18:37:50.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.950 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:50.950 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622092+0000", 2024-09-12T18:37:50.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5850000000000001e-06 2024-09-12T18:37:50.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.950 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:50.950 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622148+0000", 2024-09-12T18:37:50.950 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5587000000000002e-05 2024-09-12T18:37:50.950 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.950 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.950 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:50.951 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622283+0000", 2024-09-12T18:37:50.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013473900000000001 2024-09-12T18:37:50.951 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.951 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:50.951 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622404+0000", 2024-09-12T18:37:50.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000120865 2024-09-12T18:37:50.951 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.951 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:50.951 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.629341+0000", 2024-09-12T18:37:50.951 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0069376849999999999 2024-09-12T18:37:50.951 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.951 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.952 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:50.952 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.674829+0000", 2024-09-12T18:37:50.952 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.045488046999999997 2024-09-12T18:37:50.952 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.952 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.952 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:50.952 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.674973+0000", 2024-09-12T18:37:50.952 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000143719 2024-09-12T18:37:50.952 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.952 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.952 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:50.953 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.675082+0000", 2024-09-12T18:37:50.953 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010925 2024-09-12T18:37:50.953 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:50.953 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:50.953 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:50.953 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.953 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.953 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:238489 5.8 5:1da619cf:::benchmark_data_smithi073_23739_object106212:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:50.953 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:38.622114+0000", 2024-09-12T18:37:50.953 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 12.229581552000001, 2024-09-12T18:37:50.953 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.05040443, 2024-09-12T18:37:50.953 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:50.953 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:50.954 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:50.954 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:50.954 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:50.954 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:50.954 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 238489 2024-09-12T18:37:50.954 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.954 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:50.954 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.954 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:50.954 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622114+0000", 2024-09-12T18:37:50.954 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:50.954 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.954 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:50.955 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622114+0000", 2024-09-12T18:37:50.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:50.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:50.955 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622115+0000", 2024-09-12T18:37:50.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8999999999999997e-07 2024-09-12T18:37:50.955 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.955 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.955 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:50.955 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622117+0000", 2024-09-12T18:37:50.955 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.182e-06 2024-09-12T18:37:50.956 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.956 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.956 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:50.956 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622122+0000", 2024-09-12T18:37:50.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7350000000000004e-06 2024-09-12T18:37:50.956 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.956 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.956 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:50.956 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622126+0000", 2024-09-12T18:37:50.956 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8550000000000004e-06 2024-09-12T18:37:50.956 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.956 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.956 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:50.957 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622172+0000", 2024-09-12T18:37:50.957 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6108e-05 2024-09-12T18:37:50.957 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.957 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.957 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:50.957 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622258+0000", 2024-09-12T18:37:50.957 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6050000000000005e-05 2024-09-12T18:37:50.957 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.957 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.957 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:50.957 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622323+0000", 2024-09-12T18:37:50.957 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5501999999999997e-05 2024-09-12T18:37:50.957 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.957 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.958 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:50.958 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.626718+0000", 2024-09-12T18:37:50.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0043947609999999996 2024-09-12T18:37:50.958 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.958 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.958 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:50.958 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.672398+0000", 2024-09-12T18:37:50.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.045679768000000003 2024-09-12T18:37:50.958 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.958 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.958 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:50.958 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.672468+0000", 2024-09-12T18:37:50.958 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0094999999999999e-05 2024-09-12T18:37:50.959 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.959 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:50.959 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.672519+0000", 2024-09-12T18:37:50.959 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0884000000000003e-05 2024-09-12T18:37:50.959 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:50.959 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:50.959 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:50.959 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.959 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.959 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:238490 5.e 5:7aa44d17:::benchmark_data_smithi073_23739_object106213:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:50.959 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:38.624702+0000", 2024-09-12T18:37:50.959 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 12.226993616, 2024-09-12T18:37:50.959 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055637870999999998, 2024-09-12T18:37:50.960 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:50.960 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:50.960 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:50.960 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:50.960 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:50.960 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:50.960 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 238490 2024-09-12T18:37:50.960 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.960 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:50.960 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.960 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:50.960 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624702+0000", 2024-09-12T18:37:50.960 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:50.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:50.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624702+0000", 2024-09-12T18:37:50.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:50.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:50.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624703+0000", 2024-09-12T18:37:50.961 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1900000000000001e-07 2024-09-12T18:37:50.961 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.961 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.961 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:50.961 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624707+0000", 2024-09-12T18:37:50.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6100000000000002e-06 2024-09-12T18:37:50.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:50.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624715+0000", 2024-09-12T18:37:50.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4689999999999997e-06 2024-09-12T18:37:50.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.962 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:50.962 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624720+0000", 2024-09-12T18:37:50.962 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5719999999999996e-06 2024-09-12T18:37:50.962 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.962 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.963 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:50.963 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624762+0000", 2024-09-12T18:37:50.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2633000000000003e-05 2024-09-12T18:37:50.963 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.963 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.963 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:50.963 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624859+0000", 2024-09-12T18:37:50.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6667000000000001e-05 2024-09-12T18:37:50.963 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.963 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.963 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:50.963 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624927+0000", 2024-09-12T18:37:50.963 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7780000000000005e-05 2024-09-12T18:37:50.963 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.964 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.964 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:50.964 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.629361+0000", 2024-09-12T18:37:50.964 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0044346990000000003 2024-09-12T18:37:50.964 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.964 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.964 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:50.964 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.680101+0000", 2024-09-12T18:37:50.964 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.050739751999999999 2024-09-12T18:37:50.964 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.964 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.964 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:50.964 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.680223+0000", 2024-09-12T18:37:50.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012207 2024-09-12T18:37:50.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.965 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:50.965 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.680340+0000", 2024-09-12T18:37:50.965 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011680000000000001 2024-09-12T18:37:50.965 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:50.965 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:50.965 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:50.965 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.965 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.965 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:238492 5.e 5:7ec5c6d3:::benchmark_data_smithi073_23739_object106215:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:50.965 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:38.624755+0000", 2024-09-12T18:37:50.966 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 12.226940687000001, 2024-09-12T18:37:50.966 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.059045981999999997, 2024-09-12T18:37:50.966 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:50.966 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:50.966 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:50.966 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:50.966 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:50.966 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:50.966 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 238492 2024-09-12T18:37:50.966 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.966 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:50.966 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.966 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:50.966 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624755+0000", 2024-09-12T18:37:50.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:50.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:50.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624755+0000", 2024-09-12T18:37:50.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:50.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:50.967 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624756+0000", 2024-09-12T18:37:50.967 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2e-07 2024-09-12T18:37:50.967 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.967 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.967 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:50.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624758+0000", 2024-09-12T18:37:50.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0379999999999998e-06 2024-09-12T18:37:50.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.968 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:50.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624763+0000", 2024-09-12T18:37:50.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6400000000000002e-06 2024-09-12T18:37:50.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.968 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.968 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:50.968 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624768+0000", 2024-09-12T18:37:50.968 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9509999999999997e-06 2024-09-12T18:37:50.968 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:50.969 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.625824+0000", 2024-09-12T18:37:50.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0010553540000000001 2024-09-12T18:37:50.969 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.969 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.969 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:50.969 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.626059+0000", 2024-09-12T18:37:50.969 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00023545200000000001 2024-09-12T18:37:50.970 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.970 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.970 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:50.970 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.626277+0000", 2024-09-12T18:37:50.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021797400000000001 2024-09-12T18:37:50.970 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.970 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.970 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:50.970 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.632160+0000", 2024-09-12T18:37:50.970 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0058828020000000003 2024-09-12T18:37:50.970 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.970 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.970 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:50.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.683543+0000", 2024-09-12T18:37:50.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051383073000000001 2024-09-12T18:37:50.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:50.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.683677+0000", 2024-09-12T18:37:50.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000134091 2024-09-12T18:37:50.971 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.971 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.971 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:50.971 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.683801+0000", 2024-09-12T18:37:50.971 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012408699999999999 2024-09-12T18:37:50.971 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:50.971 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:50.972 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:50.972 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.972 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.972 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:238493 5.8 5:17b7de1b:::benchmark_data_smithi073_23739_object106216:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:50.972 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:38.624778+0000", 2024-09-12T18:37:50.972 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 12.226917975999999, 2024-09-12T18:37:50.972 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048129221999999999, 2024-09-12T18:37:50.972 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:50.972 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:50.972 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:50.972 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:50.972 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:50.972 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:50.973 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 238493 2024-09-12T18:37:50.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.973 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:50.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:50.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624778+0000", 2024-09-12T18:37:50.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:50.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.973 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.973 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:50.973 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624778+0000", 2024-09-12T18:37:50.973 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:50.973 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.974 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:50.974 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624778+0000", 2024-09-12T18:37:50.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.32e-07 2024-09-12T18:37:50.974 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.974 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:50.974 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624780+0000", 2024-09-12T18:37:50.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0530000000000001e-06 2024-09-12T18:37:50.974 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.974 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.974 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:50.974 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624787+0000", 2024-09-12T18:37:50.974 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2790000000000004e-06 2024-09-12T18:37:50.975 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.975 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.975 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:50.975 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624792+0000", 2024-09-12T18:37:50.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9629999999999997e-06 2024-09-12T18:37:50.975 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.975 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.975 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:50.975 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624828+0000", 2024-09-12T18:37:50.975 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6177000000000003e-05 2024-09-12T18:37:50.975 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.975 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.975 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:50.975 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624905+0000", 2024-09-12T18:37:50.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7671999999999998e-05 2024-09-12T18:37:50.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.976 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:50.976 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624972+0000", 2024-09-12T18:37:50.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6977000000000006e-05 2024-09-12T18:37:50.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.976 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:50.976 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.629376+0000", 2024-09-12T18:37:50.976 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0044033229999999998 2024-09-12T18:37:50.976 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.976 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:50.977 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.672808+0000", 2024-09-12T18:37:50.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.043431889000000001 2024-09-12T18:37:50.977 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:50.977 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.672865+0000", 2024-09-12T18:37:50.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.753e-05 2024-09-12T18:37:50.977 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:50.977 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:50.977 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:50.977 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.672907+0000", 2024-09-12T18:37:50.977 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1927e-05 2024-09-12T18:37:50.978 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:50.978 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:50.978 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:50.978 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:50.978 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:50.978 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:50.978 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T18:37:50.980 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:37:50.981 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:50.975+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:51.080 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:51.075+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:51.112 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:51.112 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [], 2024-09-12T18:37:51.112 INFO:teuthology.orchestra.run.smithi162.stdout: "num_ops": 0 2024-09-12T18:37:51.112 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:51.126 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:37:51.181 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:51.173+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:51.243 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:51.243 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [], 2024-09-12T18:37:51.243 INFO:teuthology.orchestra.run.smithi162.stdout: "complaint_time": 30, 2024-09-12T18:37:51.243 INFO:teuthology.orchestra.run.smithi162.stdout: "num_blocked_ops": 0 2024-09-12T18:37:51.243 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:51.257 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:37:51.283 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:51.277+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:51.384 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:51.379+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:51.427 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:51.427 INFO:teuthology.orchestra.run.smithi162.stdout: "size": 20, 2024-09-12T18:37:51.427 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 600, 2024-09-12T18:37:51.427 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:37:51.427 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.427 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167364 5.7 5:ee50096a:::benchmark_data_smithi073_23739_object35087:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:51.427 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.168715+0000", 2024-09-12T18:37:51.427 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 48.252318670999998, 2024-09-12T18:37:51.427 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.068831153000000006, 2024-09-12T18:37:51.428 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:51.428 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:51.428 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:51.428 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:51.428 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:51.428 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:51.428 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167364 2024-09-12T18:37:51.428 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.428 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:51.428 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.428 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:51.428 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168715+0000", 2024-09-12T18:37:51.428 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:51.429 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.429 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.429 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:51.429 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168715+0000", 2024-09-12T18:37:51.429 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:51.429 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.429 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.429 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:51.429 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168716+0000", 2024-09-12T18:37:51.429 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0559999999999999e-06 2024-09-12T18:37:51.429 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.429 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.430 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:51.430 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168721+0000", 2024-09-12T18:37:51.430 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8019999999999999e-06 2024-09-12T18:37:51.430 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.430 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.430 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:51.430 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168731+0000", 2024-09-12T18:37:51.430 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0315e-05 2024-09-12T18:37:51.430 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.430 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.430 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:51.430 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168738+0000", 2024-09-12T18:37:51.430 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.126e-06 2024-09-12T18:37:51.431 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.431 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.431 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:51.431 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168782+0000", 2024-09-12T18:37:51.431 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.3924000000000002e-05 2024-09-12T18:37:51.431 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.431 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.431 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:51.431 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168913+0000", 2024-09-12T18:37:51.431 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000131154 2024-09-12T18:37:51.431 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.431 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.431 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:51.432 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169026+0000", 2024-09-12T18:37:51.432 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011223299999999999 2024-09-12T18:37:51.432 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.432 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.432 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:51.432 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.175404+0000", 2024-09-12T18:37:51.432 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0063780319999999996 2024-09-12T18:37:51.432 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.432 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.432 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:51.432 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237446+0000", 2024-09-12T18:37:51.432 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.062042238 2024-09-12T18:37:51.432 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.433 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.433 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:51.433 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237501+0000", 2024-09-12T18:37:51.433 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4913000000000001e-05 2024-09-12T18:37:51.433 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.433 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.433 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:51.433 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237546+0000", 2024-09-12T18:37:51.433 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.5359999999999999e-05 2024-09-12T18:37:51.433 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:51.433 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:51.433 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:51.434 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.434 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.434 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167365 5.2 5:4107875c:::benchmark_data_smithi073_23739_object35088:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:51.434 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:51.434 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 48.252269097000003, 2024-09-12T18:37:51.434 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.078544438999999994, 2024-09-12T18:37:51.434 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:51.434 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:51.434 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:51.434 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:51.434 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:51.434 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:51.434 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167365 2024-09-12T18:37:51.434 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.435 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:51.435 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.435 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:51.435 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:51.435 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:51.435 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.435 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.435 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:51.435 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:51.435 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:51.435 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.435 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.436 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:51.436 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:51.436 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.4700000000000001e-07 2024-09-12T18:37:51.436 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.436 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.436 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:51.436 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168769+0000", 2024-09-12T18:37:51.436 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.4170000000000001e-06 2024-09-12T18:37:51.436 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.436 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.436 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:51.436 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168777+0000", 2024-09-12T18:37:51.436 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1499999999999999e-06 2024-09-12T18:37:51.437 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.437 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.437 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:51.437 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168783+0000", 2024-09-12T18:37:51.437 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.0460000000000002e-06 2024-09-12T18:37:51.437 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.437 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.437 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:51.437 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168865+0000", 2024-09-12T18:37:51.437 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1953999999999995e-05 2024-09-12T18:37:51.437 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.437 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.437 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:51.438 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169003+0000", 2024-09-12T18:37:51.438 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013798200000000001 2024-09-12T18:37:51.438 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.438 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.438 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:51.438 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169065+0000", 2024-09-12T18:37:51.438 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2218000000000006e-05 2024-09-12T18:37:51.438 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.438 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.438 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:51.438 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174771+0000", 2024-09-12T18:37:51.438 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0057054819999999996 2024-09-12T18:37:51.438 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.439 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.439 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:51.439 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.247234+0000", 2024-09-12T18:37:51.439 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.072463391000000002 2024-09-12T18:37:51.439 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.439 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.439 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:51.439 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.247273+0000", 2024-09-12T18:37:51.439 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.9069000000000002e-05 2024-09-12T18:37:51.439 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.439 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.439 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:51.439 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.247309+0000", 2024-09-12T18:37:51.440 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5982999999999998e-05 2024-09-12T18:37:51.440 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:51.440 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:51.440 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:51.440 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.440 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.440 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167369 5.7 5:e64ecabd:::benchmark_data_smithi073_23739_object35092:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:51.440 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.169042+0000", 2024-09-12T18:37:51.440 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 48.251991986, 2024-09-12T18:37:51.440 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.069229188999999997, 2024-09-12T18:37:51.440 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:51.440 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:51.440 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:51.440 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:51.441 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:51.441 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:51.441 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167369 2024-09-12T18:37:51.441 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.441 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:51.441 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.441 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:51.441 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169042+0000", 2024-09-12T18:37:51.441 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:51.441 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.441 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.441 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:51.441 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169042+0000", 2024-09-12T18:37:51.442 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:51.442 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.442 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.442 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:51.442 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169043+0000", 2024-09-12T18:37:51.442 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.9400000000000004e-07 2024-09-12T18:37:51.442 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.442 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.442 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:51.442 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169048+0000", 2024-09-12T18:37:51.442 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8420000000000004e-06 2024-09-12T18:37:51.442 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.442 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.443 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:51.443 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169055+0000", 2024-09-12T18:37:51.443 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.7989999999999994e-06 2024-09-12T18:37:51.443 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.443 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.443 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:51.443 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169062+0000", 2024-09-12T18:37:51.443 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.5950000000000004e-06 2024-09-12T18:37:51.443 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.443 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.443 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:51.443 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173858+0000", 2024-09-12T18:37:51.443 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0047959259999999998 2024-09-12T18:37:51.444 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.444 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.444 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:51.444 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173966+0000", 2024-09-12T18:37:51.444 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000107941 2024-09-12T18:37:51.444 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.444 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.444 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:51.444 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174043+0000", 2024-09-12T18:37:51.444 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.7360000000000005e-05 2024-09-12T18:37:51.444 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.444 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.444 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:51.445 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.175711+0000", 2024-09-12T18:37:51.445 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0016680810000000001 2024-09-12T18:37:51.445 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.445 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.445 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:51.445 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.238163+0000", 2024-09-12T18:37:51.445 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.062451523000000002 2024-09-12T18:37:51.445 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.445 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.445 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:51.445 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.238222+0000", 2024-09-12T18:37:51.445 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9723999999999999e-05 2024-09-12T18:37:51.445 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.445 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.446 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:51.446 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.238271+0000", 2024-09-12T18:37:51.446 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8504000000000002e-05 2024-09-12T18:37:51.446 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:51.446 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:51.446 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:51.446 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.446 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.446 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167373 5.5 5:ad283029:::benchmark_data_smithi073_23739_object35096:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:51.446 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:51.446 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 48.249487154999997, 2024-09-12T18:37:51.446 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.066200976999999994, 2024-09-12T18:37:51.446 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:51.447 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:51.447 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:51.447 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:51.447 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:51.447 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:51.447 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167373 2024-09-12T18:37:51.447 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.447 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:51.447 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.447 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:51.447 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:51.447 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:51.447 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.448 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.448 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:51.448 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:51.448 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:51.448 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.448 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.448 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:51.448 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:51.448 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4900000000000005e-07 2024-09-12T18:37:51.448 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.448 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.448 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:51.449 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171551+0000", 2024-09-12T18:37:51.449 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.7519999999999998e-06 2024-09-12T18:37:51.449 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.449 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.449 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:51.449 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171562+0000", 2024-09-12T18:37:51.449 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0353000000000001e-05 2024-09-12T18:37:51.449 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.449 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.449 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:51.449 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171566+0000", 2024-09-12T18:37:51.449 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8269999999999997e-06 2024-09-12T18:37:51.449 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.449 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.450 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:51.450 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171622+0000", 2024-09-12T18:37:51.450 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5220999999999999e-05 2024-09-12T18:37:51.450 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.450 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.450 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:51.450 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171719+0000", 2024-09-12T18:37:51.450 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7238999999999995e-05 2024-09-12T18:37:51.450 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.450 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.450 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:51.450 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171802+0000", 2024-09-12T18:37:51.450 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.3285e-05 2024-09-12T18:37:51.451 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.451 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.451 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:51.451 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174608+0000", 2024-09-12T18:37:51.451 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028054590000000002 2024-09-12T18:37:51.451 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.451 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.451 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:51.451 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174762+0000", 2024-09-12T18:37:51.451 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015465100000000001 2024-09-12T18:37:51.451 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.451 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.451 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:51.451 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237474+0000", 2024-09-12T18:37:51.452 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.062711683000000004 2024-09-12T18:37:51.452 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.452 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.452 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:51.452 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237540+0000", 2024-09-12T18:37:51.452 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.6132999999999999e-05 2024-09-12T18:37:51.452 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.452 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.452 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:51.452 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237748+0000", 2024-09-12T18:37:51.452 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020752499999999999 2024-09-12T18:37:51.452 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:51.452 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:51.453 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:51.453 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.453 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.453 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167374 5.1 5:81e25826:::benchmark_data_smithi073_23739_object35097:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:51.453 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.173748+0000", 2024-09-12T18:37:51.453 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 48.247285707000003, 2024-09-12T18:37:51.453 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.069225245000000005, 2024-09-12T18:37:51.453 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:51.453 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:51.453 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:51.453 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:51.453 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:51.453 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:51.454 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167374 2024-09-12T18:37:51.454 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.454 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:51.454 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.454 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:51.454 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173748+0000", 2024-09-12T18:37:51.454 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:51.454 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.454 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.454 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:51.454 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173748+0000", 2024-09-12T18:37:51.454 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:51.454 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.454 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.455 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:51.455 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173749+0000", 2024-09-12T18:37:51.455 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.418e-06 2024-09-12T18:37:51.455 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.455 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.455 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:51.455 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173755+0000", 2024-09-12T18:37:51.455 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.0730000000000004e-06 2024-09-12T18:37:51.455 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.455 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.455 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:51.455 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173768+0000", 2024-09-12T18:37:51.455 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3644e-05 2024-09-12T18:37:51.456 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.456 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.456 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:51.456 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173777+0000", 2024-09-12T18:37:51.456 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4160000000000004e-06 2024-09-12T18:37:51.456 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.456 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.456 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:51.456 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173927+0000", 2024-09-12T18:37:51.456 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015065900000000001 2024-09-12T18:37:51.456 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.456 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.457 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:51.457 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174052+0000", 2024-09-12T18:37:51.457 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012460699999999999 2024-09-12T18:37:51.457 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.457 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.457 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:51.457 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174181+0000", 2024-09-12T18:37:51.457 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012919299999999999 2024-09-12T18:37:51.457 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.457 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.457 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:51.457 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.178108+0000", 2024-09-12T18:37:51.457 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0039273210000000001 2024-09-12T18:37:51.457 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.458 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.458 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:51.458 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.178118+0000", 2024-09-12T18:37:51.458 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7550000000000006e-06 2024-09-12T18:37:51.458 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.458 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.458 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:51.458 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.242865+0000", 2024-09-12T18:37:51.458 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.064746597000000003 2024-09-12T18:37:51.458 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.458 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.458 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:51.458 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.242903+0000", 2024-09-12T18:37:51.459 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.8268e-05 2024-09-12T18:37:51.459 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.459 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.459 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:51.459 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.242973+0000", 2024-09-12T18:37:51.459 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0294000000000002e-05 2024-09-12T18:37:51.459 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:51.459 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:51.459 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:51.459 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.459 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.459 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167375 5.1 5:83a09102:::benchmark_data_smithi073_23739_object35098:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:51.459 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:51.459 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 48.247234159999998, 2024-09-12T18:37:51.460 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.069437463000000005, 2024-09-12T18:37:51.460 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:51.460 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:51.460 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:51.460 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:51.460 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:51.460 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:51.460 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167375 2024-09-12T18:37:51.460 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.460 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:51.460 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.460 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:51.460 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:51.461 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:51.461 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.461 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.461 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:51.461 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:51.461 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:51.461 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.461 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.461 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:51.461 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:51.461 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1399999999999997e-07 2024-09-12T18:37:51.461 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.461 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.462 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:51.462 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173803+0000", 2024-09-12T18:37:51.462 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.7860000000000001e-06 2024-09-12T18:37:51.462 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.462 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.462 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:51.462 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173811+0000", 2024-09-12T18:37:51.462 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4610000000000008e-06 2024-09-12T18:37:51.462 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.462 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.462 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:51.462 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173817+0000", 2024-09-12T18:37:51.462 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3569999999999997e-06 2024-09-12T18:37:51.463 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.463 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.463 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:51.463 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.176070+0000", 2024-09-12T18:37:51.463 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.002253405 2024-09-12T18:37:51.463 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.463 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.463 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:51.463 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.176263+0000", 2024-09-12T18:37:51.463 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000192583 2024-09-12T18:37:51.463 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.463 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.463 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:51.463 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.176429+0000", 2024-09-12T18:37:51.464 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00016626 2024-09-12T18:37:51.464 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.464 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.464 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:51.464 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.178154+0000", 2024-09-12T18:37:51.464 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0017247009999999999 2024-09-12T18:37:51.464 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.464 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.464 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:51.464 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.182110+0000", 2024-09-12T18:37:51.464 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0039568229999999999 2024-09-12T18:37:51.464 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.464 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.465 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:51.465 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.243024+0000", 2024-09-12T18:37:51.465 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.060913249000000003 2024-09-12T18:37:51.465 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.465 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.465 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:51.465 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.243107+0000", 2024-09-12T18:37:51.465 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.3090000000000006e-05 2024-09-12T18:37:51.465 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.465 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.465 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:51.465 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.243237+0000", 2024-09-12T18:37:51.465 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013023399999999999 2024-09-12T18:37:51.466 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:51.466 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:51.466 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:51.466 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.466 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.466 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201515 5.5 5:a25bd8bb:::benchmark_data_smithi073_23739_object69238:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:51.466 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.437024+0000", 2024-09-12T18:37:51.466 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 30.984009927999999, 2024-09-12T18:37:51.466 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.040476102, 2024-09-12T18:37:51.466 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:51.466 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:51.466 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:51.466 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:51.466 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:51.467 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:51.467 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201515 2024-09-12T18:37:51.467 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.467 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:51.467 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.467 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:51.467 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437024+0000", 2024-09-12T18:37:51.467 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:51.467 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.467 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.467 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:51.467 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437024+0000", 2024-09-12T18:37:51.467 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:51.468 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.468 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.468 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:51.468 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437025+0000", 2024-09-12T18:37:51.468 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2240000000000001e-06 2024-09-12T18:37:51.468 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.468 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.468 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:51.468 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437030+0000", 2024-09-12T18:37:51.468 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.7049999999999998e-06 2024-09-12T18:37:51.468 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.468 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.468 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:51.469 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437040+0000", 2024-09-12T18:37:51.469 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0351e-05 2024-09-12T18:37:51.469 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.469 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.469 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:51.469 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437049+0000", 2024-09-12T18:37:51.469 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5750000000000001e-06 2024-09-12T18:37:51.469 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.469 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.469 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:51.469 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437574+0000", 2024-09-12T18:37:51.469 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00052566400000000001 2024-09-12T18:37:51.469 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.469 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.470 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:51.470 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437673+0000", 2024-09-12T18:37:51.470 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.8672000000000007e-05 2024-09-12T18:37:51.470 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.470 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.470 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:51.470 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437755+0000", 2024-09-12T18:37:51.470 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1705000000000005e-05 2024-09-12T18:37:51.470 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.470 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.470 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:51.470 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.439556+0000", 2024-09-12T18:37:51.471 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0018009020000000001 2024-09-12T18:37:51.471 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.471 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.471 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:51.471 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.439955+0000", 2024-09-12T18:37:51.471 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00039966900000000001 2024-09-12T18:37:51.471 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.471 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.471 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:51.471 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.477267+0000", 2024-09-12T18:37:51.471 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.037311614 2024-09-12T18:37:51.471 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.471 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.472 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:51.472 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.477368+0000", 2024-09-12T18:37:51.472 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000101495 2024-09-12T18:37:51.472 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.472 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.472 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:51.472 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.477500+0000", 2024-09-12T18:37:51.472 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000131526 2024-09-12T18:37:51.472 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:51.472 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:51.472 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:51.472 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.472 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.472 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201566 5.9 5:9ea8bdd3:::benchmark_data_smithi073_23739_object69289:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:51.473 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.487311+0000", 2024-09-12T18:37:51.473 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 30.933722380999999, 2024-09-12T18:37:51.473 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.044734547, 2024-09-12T18:37:51.473 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:51.473 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:51.473 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:51.473 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:51.473 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:51.473 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:51.473 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201566 2024-09-12T18:37:51.473 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.473 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:51.473 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.474 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:51.474 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487311+0000", 2024-09-12T18:37:51.474 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:51.474 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.474 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.474 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:51.474 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487311+0000", 2024-09-12T18:37:51.474 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:51.474 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.474 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.474 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:51.474 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487313+0000", 2024-09-12T18:37:51.474 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3060000000000001e-06 2024-09-12T18:37:51.475 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.475 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.475 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:51.475 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487318+0000", 2024-09-12T18:37:51.475 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.181e-06 2024-09-12T18:37:51.475 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.475 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.475 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:51.475 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487333+0000", 2024-09-12T18:37:51.475 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5012e-05 2024-09-12T18:37:51.475 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.475 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.475 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:51.476 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487344+0000", 2024-09-12T18:37:51.476 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0733999999999999e-05 2024-09-12T18:37:51.476 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.476 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.476 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:51.476 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487403+0000", 2024-09-12T18:37:51.476 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9858999999999997e-05 2024-09-12T18:37:51.476 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.476 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.476 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:51.476 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487600+0000", 2024-09-12T18:37:51.476 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019617899999999999 2024-09-12T18:37:51.476 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.477 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.477 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:51.477 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487769+0000", 2024-09-12T18:37:51.477 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00016919299999999999 2024-09-12T18:37:51.477 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.477 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.477 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:51.477 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492984+0000", 2024-09-12T18:37:51.477 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0052155309999999998 2024-09-12T18:37:51.477 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.477 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.477 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:51.477 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531791+0000", 2024-09-12T18:37:51.478 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.038806861999999998 2024-09-12T18:37:51.478 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.478 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.478 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:51.478 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531946+0000", 2024-09-12T18:37:51.478 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015445300000000001 2024-09-12T18:37:51.478 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.478 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.478 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:51.478 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532046+0000", 2024-09-12T18:37:51.478 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000100237 2024-09-12T18:37:51.478 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:51.478 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:51.479 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:51.479 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.479 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.479 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201569 5.9 5:9719244e:::benchmark_data_smithi073_23739_object69292:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:51.479 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.487551+0000", 2024-09-12T18:37:51.479 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 30.933483021000001, 2024-09-12T18:37:51.479 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.045212927, 2024-09-12T18:37:51.479 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:51.479 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:51.479 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:51.479 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:51.479 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:51.479 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:51.479 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201569 2024-09-12T18:37:51.480 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.480 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:51.480 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.480 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:51.480 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487551+0000", 2024-09-12T18:37:51.480 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:51.480 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.480 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.480 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:51.480 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487551+0000", 2024-09-12T18:37:51.480 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:51.480 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.480 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.481 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:51.481 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487552+0000", 2024-09-12T18:37:51.481 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6160000000000001e-06 2024-09-12T18:37:51.481 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.481 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.481 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:51.481 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487566+0000", 2024-09-12T18:37:51.481 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.344e-05 2024-09-12T18:37:51.481 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.481 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.481 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:51.481 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487581+0000", 2024-09-12T18:37:51.481 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5526e-05 2024-09-12T18:37:51.482 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.482 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.482 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:51.482 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487593+0000", 2024-09-12T18:37:51.482 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1443e-05 2024-09-12T18:37:51.482 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.482 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.482 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:51.482 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.489599+0000", 2024-09-12T18:37:51.482 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0020058960000000001 2024-09-12T18:37:51.482 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.482 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.482 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:51.483 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.489710+0000", 2024-09-12T18:37:51.483 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000111634 2024-09-12T18:37:51.483 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.483 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.483 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:51.483 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.489796+0000", 2024-09-12T18:37:51.483 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5235999999999995e-05 2024-09-12T18:37:51.483 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.483 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.483 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:51.483 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532140+0000", 2024-09-12T18:37:51.483 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.042344524000000001 2024-09-12T18:37:51.483 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.483 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.484 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:51.484 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532559+0000", 2024-09-12T18:37:51.484 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00041908800000000002 2024-09-12T18:37:51.484 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.484 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.484 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:51.484 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532676+0000", 2024-09-12T18:37:51.484 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011649100000000001 2024-09-12T18:37:51.484 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.484 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.484 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:51.484 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532764+0000", 2024-09-12T18:37:51.485 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8033000000000002e-05 2024-09-12T18:37:51.485 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:51.485 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:51.485 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:51.485 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.485 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.485 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201570 5.5 5:a97bff67:::benchmark_data_smithi073_23739_object69293:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:51.485 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.487618+0000", 2024-09-12T18:37:51.485 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 30.933415436000001, 2024-09-12T18:37:51.485 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.049152553000000002, 2024-09-12T18:37:51.485 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:51.485 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:51.485 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:51.486 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:51.486 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:51.486 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:51.486 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201570 2024-09-12T18:37:51.486 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.486 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:51.486 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.486 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:51.486 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487618+0000", 2024-09-12T18:37:51.486 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:51.486 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.486 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.486 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:51.487 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487618+0000", 2024-09-12T18:37:51.487 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:51.487 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.487 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.487 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:51.487 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487619+0000", 2024-09-12T18:37:51.487 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.6099999999999999e-07 2024-09-12T18:37:51.487 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.487 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.487 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:51.487 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487623+0000", 2024-09-12T18:37:51.487 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.0940000000000001e-06 2024-09-12T18:37:51.487 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.487 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.488 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:51.488 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487635+0000", 2024-09-12T18:37:51.488 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1348e-05 2024-09-12T18:37:51.488 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.488 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.488 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:51.488 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487657+0000", 2024-09-12T18:37:51.489 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2246999999999999e-05 2024-09-12T18:37:51.489 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.489 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.489 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:51.489 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490684+0000", 2024-09-12T18:37:51.489 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0030268339999999999 2024-09-12T18:37:51.489 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.489 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.489 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:51.489 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490797+0000", 2024-09-12T18:37:51.489 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011372200000000001 2024-09-12T18:37:51.490 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.490 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.490 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:51.490 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490909+0000", 2024-09-12T18:37:51.490 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000111239 2024-09-12T18:37:51.490 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.490 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.490 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:51.490 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534345+0000", 2024-09-12T18:37:51.490 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.043436648000000001 2024-09-12T18:37:51.490 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.490 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.490 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:51.490 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534711+0000", 2024-09-12T18:37:51.491 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00036576399999999998 2024-09-12T18:37:51.491 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.491 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.491 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:51.491 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536225+0000", 2024-09-12T18:37:51.491 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001513983 2024-09-12T18:37:51.491 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.491 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.491 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:51.491 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536331+0000", 2024-09-12T18:37:51.491 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010603300000000001 2024-09-12T18:37:51.491 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.491 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.492 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:51.492 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536771+0000", 2024-09-12T18:37:51.492 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00043978000000000002 2024-09-12T18:37:51.492 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:51.492 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:51.492 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:51.492 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.492 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.492 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:201572 5.3 e67/21 5:caf692c5:::benchmark_data_smithi073_23739_object69295:head v 67'12362, mlcod=67'12360)", 2024-09-12T18:37:51.492 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.490255+0000", 2024-09-12T18:37:51.493 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 30.930778935999999, 2024-09-12T18:37:51.493 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.044189501999999999, 2024-09-12T18:37:51.493 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:51.493 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:51.493 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:51.493 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:51.493 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.493 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:51.493 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490255+0000", 2024-09-12T18:37:51.493 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:51.493 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.493 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.493 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:51.494 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490255+0000", 2024-09-12T18:37:51.494 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:51.494 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.494 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.494 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:51.494 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490256+0000", 2024-09-12T18:37:51.494 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0500000000000003e-07 2024-09-12T18:37:51.494 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.494 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.494 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:51.494 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490260+0000", 2024-09-12T18:37:51.494 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8269999999999997e-06 2024-09-12T18:37:51.494 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.495 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.495 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:51.495 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490269+0000", 2024-09-12T18:37:51.495 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.6549999999999993e-06 2024-09-12T18:37:51.495 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.495 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.495 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:51.495 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490275+0000", 2024-09-12T18:37:51.495 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.46e-06 2024-09-12T18:37:51.495 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.495 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.495 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:51.495 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490328+0000", 2024-09-12T18:37:51.495 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2101999999999997e-05 2024-09-12T18:37:51.496 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.496 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.496 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:51.496 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490347+0000", 2024-09-12T18:37:51.496 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9457999999999999e-05 2024-09-12T18:37:51.496 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.496 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.496 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:51.496 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534382+0000", 2024-09-12T18:37:51.496 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.044034968000000001 2024-09-12T18:37:51.496 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.496 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.496 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:51.497 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534444+0000", 2024-09-12T18:37:51.497 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2327000000000001e-05 2024-09-12T18:37:51.497 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:51.497 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:51.497 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:51.497 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.497 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.497 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201574 5.5 5:a963f378:::benchmark_data_smithi073_23739_object69297:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:51.497 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.490449+0000", 2024-09-12T18:37:51.497 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 30.930584961000001, 2024-09-12T18:37:51.497 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.046749974, 2024-09-12T18:37:51.497 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:51.497 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:51.498 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:51.498 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:51.498 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:51.498 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:51.498 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201574 2024-09-12T18:37:51.498 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.498 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:51.498 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.498 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:51.498 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490449+0000", 2024-09-12T18:37:51.498 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:51.498 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.498 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.499 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:51.499 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490449+0000", 2024-09-12T18:37:51.499 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:51.499 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.499 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.499 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:51.499 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490450+0000", 2024-09-12T18:37:51.499 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.17e-06 2024-09-12T18:37:51.499 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.499 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.499 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:51.499 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490455+0000", 2024-09-12T18:37:51.499 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.7319999999999998e-06 2024-09-12T18:37:51.499 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.500 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.500 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:51.500 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490464+0000", 2024-09-12T18:37:51.500 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.4760000000000004e-06 2024-09-12T18:37:51.500 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.500 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.500 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:51.500 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490471+0000", 2024-09-12T18:37:51.500 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.5400000000000001e-06 2024-09-12T18:37:51.500 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.500 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.500 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:51.500 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492695+0000", 2024-09-12T18:37:51.501 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0022245910000000002 2024-09-12T18:37:51.501 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.501 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.501 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:51.501 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492847+0000", 2024-09-12T18:37:51.501 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015127399999999999 2024-09-12T18:37:51.501 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.501 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.501 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:51.501 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492936+0000", 2024-09-12T18:37:51.501 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8953e-05 2024-09-12T18:37:51.501 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.501 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.502 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:51.502 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534614+0000", 2024-09-12T18:37:51.502 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.041678422999999999 2024-09-12T18:37:51.502 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.502 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.502 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:51.502 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534755+0000", 2024-09-12T18:37:51.502 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000140696 2024-09-12T18:37:51.502 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.502 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.502 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:51.502 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536891+0000", 2024-09-12T18:37:51.502 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0021365799999999999 2024-09-12T18:37:51.503 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.503 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.503 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:51.503 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537001+0000", 2024-09-12T18:37:51.503 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000109459 2024-09-12T18:37:51.503 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.503 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.503 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:51.503 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537199+0000", 2024-09-12T18:37:51.503 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019808 2024-09-12T18:37:51.503 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:51.503 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:51.503 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:51.503 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.504 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.504 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201576 5.2 5:42a132e0:::benchmark_data_smithi073_23739_object69299:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:51.504 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.490661+0000", 2024-09-12T18:37:51.504 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 30.930372913999999, 2024-09-12T18:37:51.504 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.041905530000000003, 2024-09-12T18:37:51.504 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:51.504 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:51.504 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:51.504 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:51.504 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:51.504 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:51.504 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201576 2024-09-12T18:37:51.504 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.505 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:51.505 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.505 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:51.505 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490661+0000", 2024-09-12T18:37:51.505 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:51.505 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.505 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.505 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:51.505 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490661+0000", 2024-09-12T18:37:51.505 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:51.505 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.505 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.506 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:51.506 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490662+0000", 2024-09-12T18:37:51.506 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5030000000000001e-06 2024-09-12T18:37:51.506 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.506 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.506 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:51.506 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490667+0000", 2024-09-12T18:37:51.506 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4479999999999996e-06 2024-09-12T18:37:51.506 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.506 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.507 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:51.507 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490675+0000", 2024-09-12T18:37:51.507 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8529999999999992e-06 2024-09-12T18:37:51.507 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.507 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.507 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:51.507 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490680+0000", 2024-09-12T18:37:51.507 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1919999999999996e-06 2024-09-12T18:37:51.507 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.507 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.507 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:51.507 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490730+0000", 2024-09-12T18:37:51.507 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.9738999999999999e-05 2024-09-12T18:37:51.508 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.508 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.508 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:51.508 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490833+0000", 2024-09-12T18:37:51.508 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010333 2024-09-12T18:37:51.508 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.508 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.508 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:51.508 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490930+0000", 2024-09-12T18:37:51.508 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7355999999999994e-05 2024-09-12T18:37:51.508 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.508 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.508 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:51.508 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493735+0000", 2024-09-12T18:37:51.509 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028049329999999999 2024-09-12T18:37:51.509 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.509 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.509 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:51.509 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532451+0000", 2024-09-12T18:37:51.509 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.038715554999999999 2024-09-12T18:37:51.509 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.509 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.509 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:51.509 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532514+0000", 2024-09-12T18:37:51.509 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2885000000000005e-05 2024-09-12T18:37:51.509 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.509 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.510 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:51.510 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532566+0000", 2024-09-12T18:37:51.510 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2735999999999998e-05 2024-09-12T18:37:51.510 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:51.510 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:51.510 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:51.510 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.510 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.510 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201577 5.7 5:e93d4852:::benchmark_data_smithi073_23739_object69300:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:51.510 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.490721+0000", 2024-09-12T18:37:51.510 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 30.930312903000001, 2024-09-12T18:37:51.510 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.042097930999999998, 2024-09-12T18:37:51.510 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:51.511 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:51.511 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:51.511 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:51.511 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:51.511 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:51.511 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201577 2024-09-12T18:37:51.511 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.511 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:51.511 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.511 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:51.511 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490721+0000", 2024-09-12T18:37:51.511 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:51.511 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.512 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.512 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:51.512 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490721+0000", 2024-09-12T18:37:51.512 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:51.512 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.512 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.512 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:51.512 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490721+0000", 2024-09-12T18:37:51.512 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.1900000000000002e-07 2024-09-12T18:37:51.512 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.512 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.512 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:51.512 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490724+0000", 2024-09-12T18:37:51.513 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.6189999999999998e-06 2024-09-12T18:37:51.513 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.513 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.513 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:51.513 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490731+0000", 2024-09-12T18:37:51.513 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0129999999999996e-06 2024-09-12T18:37:51.513 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.513 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.513 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:51.513 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490736+0000", 2024-09-12T18:37:51.513 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6929999999999998e-06 2024-09-12T18:37:51.513 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.513 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.513 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:51.514 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490788+0000", 2024-09-12T18:37:51.514 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2104000000000001e-05 2024-09-12T18:37:51.514 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.514 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.514 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:51.514 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490926+0000", 2024-09-12T18:37:51.514 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013852800000000001 2024-09-12T18:37:51.514 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.514 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.514 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:51.514 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491061+0000", 2024-09-12T18:37:51.514 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013499700000000001 2024-09-12T18:37:51.514 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.515 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.515 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:51.515 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531660+0000", 2024-09-12T18:37:51.515 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.040599046999999999 2024-09-12T18:37:51.515 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.515 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.515 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:51.515 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532630+0000", 2024-09-12T18:37:51.515 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00096974300000000002 2024-09-12T18:37:51.515 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.515 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.515 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:51.515 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532708+0000", 2024-09-12T18:37:51.516 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8108000000000005e-05 2024-09-12T18:37:51.516 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.516 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.516 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:51.516 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532819+0000", 2024-09-12T18:37:51.516 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011046 2024-09-12T18:37:51.516 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:51.516 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:51.516 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:51.516 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.516 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.516 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201578 5.f 5:f19e206c:::benchmark_data_smithi073_23739_object69301:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:51.516 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.491951+0000", 2024-09-12T18:37:51.517 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 30.929082529999999, 2024-09-12T18:37:51.517 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.043303686000000001, 2024-09-12T18:37:51.517 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:51.517 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:51.517 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:51.517 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:51.517 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:51.517 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:51.517 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201578 2024-09-12T18:37:51.517 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.517 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:51.517 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.517 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:51.518 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491951+0000", 2024-09-12T18:37:51.518 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:51.518 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.518 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.518 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:51.518 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491951+0000", 2024-09-12T18:37:51.518 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:51.518 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.518 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.519 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:51.519 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491952+0000", 2024-09-12T18:37:51.519 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.221e-06 2024-09-12T18:37:51.519 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.519 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.519 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:51.519 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491957+0000", 2024-09-12T18:37:51.520 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.0529999999999997e-06 2024-09-12T18:37:51.520 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.520 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.520 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:51.520 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491970+0000", 2024-09-12T18:37:51.520 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2731000000000001e-05 2024-09-12T18:37:51.520 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.520 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.520 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:51.520 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491977+0000", 2024-09-12T18:37:51.520 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.1380000000000001e-06 2024-09-12T18:37:51.520 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.521 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.521 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:51.521 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492031+0000", 2024-09-12T18:37:51.521 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3857999999999998e-05 2024-09-12T18:37:51.521 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.521 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.521 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:51.521 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492125+0000", 2024-09-12T18:37:51.521 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.3275000000000004e-05 2024-09-12T18:37:51.521 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.521 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.521 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:51.521 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492205+0000", 2024-09-12T18:37:51.522 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.0793999999999999e-05 2024-09-12T18:37:51.522 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.522 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.522 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:51.522 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531712+0000", 2024-09-12T18:37:51.522 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.039506708000000001 2024-09-12T18:37:51.522 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.522 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.522 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:51.522 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535161+0000", 2024-09-12T18:37:51.522 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003448586 2024-09-12T18:37:51.522 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.522 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.523 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:51.523 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535202+0000", 2024-09-12T18:37:51.523 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.0945999999999997e-05 2024-09-12T18:37:51.523 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.523 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.523 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:51.523 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535255+0000", 2024-09-12T18:37:51.523 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3375999999999999e-05 2024-09-12T18:37:51.523 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:51.523 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:51.523 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:51.523 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.523 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.524 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201579 5.5 5:ac64e9fd:::benchmark_data_smithi073_23739_object69302:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:51.524 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.492711+0000", 2024-09-12T18:37:51.524 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 30.928322358999999, 2024-09-12T18:37:51.524 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.04478994, 2024-09-12T18:37:51.524 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:51.524 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:51.524 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:51.524 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:51.524 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:51.524 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:51.524 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201579 2024-09-12T18:37:51.524 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.525 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:51.525 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.525 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:51.525 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492711+0000", 2024-09-12T18:37:51.525 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:51.525 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.525 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.525 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:51.525 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492711+0000", 2024-09-12T18:37:51.525 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:51.525 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.525 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.525 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:51.526 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492713+0000", 2024-09-12T18:37:51.526 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.105e-06 2024-09-12T18:37:51.526 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.526 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.526 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:51.526 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492720+0000", 2024-09-12T18:37:51.526 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.109e-06 2024-09-12T18:37:51.526 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.526 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.526 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:51.526 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492730+0000", 2024-09-12T18:37:51.526 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.049e-05 2024-09-12T18:37:51.526 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.527 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.527 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:51.527 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492737+0000", 2024-09-12T18:37:51.527 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0960000000000003e-06 2024-09-12T18:37:51.527 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.527 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.527 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:51.527 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.494541+0000", 2024-09-12T18:37:51.527 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0018034139999999999 2024-09-12T18:37:51.527 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.527 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.527 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:51.527 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.494692+0000", 2024-09-12T18:37:51.528 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000150956 2024-09-12T18:37:51.528 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.528 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.528 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:51.528 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.494843+0000", 2024-09-12T18:37:51.528 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000151896 2024-09-12T18:37:51.528 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.528 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.528 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:51.528 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534665+0000", 2024-09-12T18:37:51.528 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.039821829000000003 2024-09-12T18:37:51.528 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.528 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.529 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:51.529 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536866+0000", 2024-09-12T18:37:51.529 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0022007839999999999 2024-09-12T18:37:51.529 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.529 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.529 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:51.529 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537212+0000", 2024-09-12T18:37:51.529 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00034636299999999998 2024-09-12T18:37:51.529 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.529 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.529 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:51.529 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537298+0000", 2024-09-12T18:37:51.529 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5970999999999994e-05 2024-09-12T18:37:51.529 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.530 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.530 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:51.530 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537501+0000", 2024-09-12T18:37:51.530 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020292699999999999 2024-09-12T18:37:51.530 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:51.530 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:51.530 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:51.530 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.530 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.530 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201581 5.7 5:e819369d:::benchmark_data_smithi073_23739_object69304:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:51.530 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.493262+0000", 2024-09-12T18:37:51.530 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 30.927772009000002, 2024-09-12T18:37:51.530 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.042091362, 2024-09-12T18:37:51.531 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:51.531 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:51.531 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:51.531 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:51.531 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:51.531 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:51.531 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201581 2024-09-12T18:37:51.531 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.531 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:51.531 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.531 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:51.531 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493262+0000", 2024-09-12T18:37:51.531 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:51.532 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.532 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.532 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:51.532 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493262+0000", 2024-09-12T18:37:51.532 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:51.532 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.532 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.532 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:51.532 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493263+0000", 2024-09-12T18:37:51.532 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.6700000000000003e-07 2024-09-12T18:37:51.532 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.532 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.532 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:51.533 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493266+0000", 2024-09-12T18:37:51.533 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.4850000000000001e-06 2024-09-12T18:37:51.533 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.533 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.533 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:51.533 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493273+0000", 2024-09-12T18:37:51.533 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2019999999999998e-06 2024-09-12T18:37:51.533 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.533 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.533 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:51.533 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493278+0000", 2024-09-12T18:37:51.533 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6210000000000003e-06 2024-09-12T18:37:51.533 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.534 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.534 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:51.534 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493330+0000", 2024-09-12T18:37:51.534 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2587000000000003e-05 2024-09-12T18:37:51.534 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.534 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.534 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:51.534 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493469+0000", 2024-09-12T18:37:51.534 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013901199999999999 2024-09-12T18:37:51.534 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.534 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.534 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:51.534 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493612+0000", 2024-09-12T18:37:51.534 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014237599999999999 2024-09-12T18:37:51.535 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.535 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.535 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:51.535 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531835+0000", 2024-09-12T18:37:51.535 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.038222735000000001 2024-09-12T18:37:51.535 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.535 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.535 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:51.535 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535265+0000", 2024-09-12T18:37:51.535 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003430064 2024-09-12T18:37:51.535 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.535 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.535 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:51.536 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535319+0000", 2024-09-12T18:37:51.536 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4375e-05 2024-09-12T18:37:51.536 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.536 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.536 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:51.536 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535353+0000", 2024-09-12T18:37:51.536 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.4137999999999997e-05 2024-09-12T18:37:51.536 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:51.536 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:51.536 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:51.536 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.536 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.536 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:201573 5.3 e67/21 5:cf4becdf:::benchmark_data_smithi073_23739_object69296:head v 67'12363, mlcod=67'12360)", 2024-09-12T18:37:51.537 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.493437+0000", 2024-09-12T18:37:51.537 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 30.927597074000001, 2024-09-12T18:37:51.537 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.041109664999999997, 2024-09-12T18:37:51.537 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:51.537 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:51.537 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:51.537 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:51.537 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.537 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:51.537 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493437+0000", 2024-09-12T18:37:51.537 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:51.537 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.537 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.538 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:51.538 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493437+0000", 2024-09-12T18:37:51.538 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:51.538 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.538 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.538 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:51.538 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493438+0000", 2024-09-12T18:37:51.538 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.125e-06 2024-09-12T18:37:51.538 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.538 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.538 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:51.538 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493444+0000", 2024-09-12T18:37:51.538 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2269999999999998e-06 2024-09-12T18:37:51.538 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.539 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.539 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:51.539 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493457+0000", 2024-09-12T18:37:51.539 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.312e-05 2024-09-12T18:37:51.539 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.539 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.539 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:51.539 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493466+0000", 2024-09-12T18:37:51.539 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.6309999999999992e-06 2024-09-12T18:37:51.539 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.539 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.539 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:51.539 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493526+0000", 2024-09-12T18:37:51.540 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.0316000000000003e-05 2024-09-12T18:37:51.540 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.540 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.540 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:51.540 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493541+0000", 2024-09-12T18:37:51.540 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4459e-05 2024-09-12T18:37:51.540 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.540 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.540 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:51.540 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534501+0000", 2024-09-12T18:37:51.540 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.040960215000000001 2024-09-12T18:37:51.540 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.540 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.541 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:51.541 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534546+0000", 2024-09-12T18:37:51.541 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.5571999999999997e-05 2024-09-12T18:37:51.541 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:51.541 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:51.541 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:51.541 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.541 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.541 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201582 5.f 5:f90f147f:::benchmark_data_smithi073_23739_object69305:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:51.541 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.493597+0000", 2024-09-12T18:37:51.541 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 30.927436542999999, 2024-09-12T18:37:51.541 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.045457567999999997, 2024-09-12T18:37:51.541 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:51.541 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:51.542 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:51.542 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:51.542 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:51.542 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:51.542 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201582 2024-09-12T18:37:51.542 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.542 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:51.542 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.542 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:51.542 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493597+0000", 2024-09-12T18:37:51.542 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:51.542 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.542 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.543 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:51.543 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493597+0000", 2024-09-12T18:37:51.543 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:51.543 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.543 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.543 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:51.543 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493598+0000", 2024-09-12T18:37:51.543 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7699999999999992e-07 2024-09-12T18:37:51.543 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.543 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.543 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:51.543 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493609+0000", 2024-09-12T18:37:51.543 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1297e-05 2024-09-12T18:37:51.543 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.544 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.544 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:51.544 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493620+0000", 2024-09-12T18:37:51.544 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0930999999999999e-05 2024-09-12T18:37:51.544 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.544 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.544 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:51.544 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493640+0000", 2024-09-12T18:37:51.544 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.0072e-05 2024-09-12T18:37:51.544 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.544 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.544 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:51.544 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531770+0000", 2024-09-12T18:37:51.545 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.038129652999999999 2024-09-12T18:37:51.545 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.545 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.545 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:51.545 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532046+0000", 2024-09-12T18:37:51.545 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027561600000000001 2024-09-12T18:37:51.545 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.545 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.545 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:51.545 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532337+0000", 2024-09-12T18:37:51.545 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00029169200000000003 2024-09-12T18:37:51.545 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.545 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.546 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:51.546 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536640+0000", 2024-09-12T18:37:51.546 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0043023499999999999 2024-09-12T18:37:51.546 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.546 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.546 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:51.547 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.538943+0000", 2024-09-12T18:37:51.547 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0023032740000000001 2024-09-12T18:37:51.548 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.548 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.548 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:51.548 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.539013+0000", 2024-09-12T18:37:51.548 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9944000000000007e-05 2024-09-12T18:37:51.548 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.548 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.548 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:51.548 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.539055+0000", 2024-09-12T18:37:51.548 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.1761999999999998e-05 2024-09-12T18:37:51.548 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:51.548 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:51.548 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:51.549 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.549 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.549 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:201583 5.d e67/21 5:b91eedec:::benchmark_data_smithi073_23739_object69306:head v 67'12761, mlcod=67'12759)", 2024-09-12T18:37:51.549 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.495034+0000", 2024-09-12T18:37:51.549 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 30.926000168000002, 2024-09-12T18:37:51.549 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.047966852999999997, 2024-09-12T18:37:51.549 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:51.549 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:51.549 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:51.549 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:51.549 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.549 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:51.549 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.495034+0000", 2024-09-12T18:37:51.550 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:51.550 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.550 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.550 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:51.550 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.495034+0000", 2024-09-12T18:37:51.550 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:51.550 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.550 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.550 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:51.550 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.495035+0000", 2024-09-12T18:37:51.550 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.023e-06 2024-09-12T18:37:51.550 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.550 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.550 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:51.551 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.495040+0000", 2024-09-12T18:37:51.551 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.9300000000000002e-06 2024-09-12T18:37:51.551 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.551 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.551 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:51.551 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531510+0000", 2024-09-12T18:37:51.551 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.036470250000000003 2024-09-12T18:37:51.551 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.551 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.551 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:51.551 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531518+0000", 2024-09-12T18:37:51.551 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8490000000000006e-06 2024-09-12T18:37:51.551 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.551 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.552 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:51.552 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534395+0000", 2024-09-12T18:37:51.552 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.002877246 2024-09-12T18:37:51.552 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.552 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.552 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:51.552 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534418+0000", 2024-09-12T18:37:51.552 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.3119e-05 2024-09-12T18:37:51.552 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.552 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.552 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:51.552 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.542930+0000", 2024-09-12T18:37:51.552 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0085121929999999995 2024-09-12T18:37:51.553 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:51.553 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:51.553 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:51.553 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.543000+0000", 2024-09-12T18:37:51.553 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0242999999999998e-05 2024-09-12T18:37:51.553 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:51.553 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:51.553 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:51.553 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:51.553 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:51.553 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:51.555 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:51.549+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:51.555 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:37:51.655 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:51.653+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:51.687 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:51.687 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2024-09-12T18:37:51.687 INFO:teuthology.orchestra.run.smithi114.stdout: "num_ops": 0 2024-09-12T18:37:51.687 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:51.701 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:37:51.756 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:51.749+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:51.818 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:51.818 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2024-09-12T18:37:51.818 INFO:teuthology.orchestra.run.smithi114.stdout: "complaint_time": 30, 2024-09-12T18:37:51.818 INFO:teuthology.orchestra.run.smithi114.stdout: "num_blocked_ops": 0 2024-09-12T18:37:51.818 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:51.831 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:37:51.862 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is unset 2024-09-12T18:37:51.876 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:51.873+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:51.956 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:51.956 INFO:teuthology.orchestra.run.smithi114.stdout: "size": 20, 2024-09-12T18:37:51.956 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 600, 2024-09-12T18:37:51.957 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:37:51.957 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.957 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167352 5.a 5:5fc472d2:::benchmark_data_smithi073_23739_object35075:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:51.958 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.163066+0000", 2024-09-12T18:37:51.958 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 48.785603866999999, 2024-09-12T18:37:51.958 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.077708377999999995, 2024-09-12T18:37:51.958 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:51.958 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:51.959 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:51.959 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:51.959 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:51.959 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:51.959 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167352 2024-09-12T18:37:51.959 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.960 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:51.961 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.961 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:51.962 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163066+0000", 2024-09-12T18:37:51.962 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:51.962 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.962 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.962 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:51.963 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163066+0000", 2024-09-12T18:37:51.963 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:51.963 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.963 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.963 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:51.963 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163067+0000", 2024-09-12T18:37:51.964 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0499999999999999e-06 2024-09-12T18:37:51.964 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.966 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.966 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:51.966 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163071+0000", 2024-09-12T18:37:51.966 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4340000000000002e-06 2024-09-12T18:37:51.966 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.967 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.967 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:51.967 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163081+0000", 2024-09-12T18:37:51.967 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0304e-05 2024-09-12T18:37:51.968 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.968 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.970 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:51.970 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163090+0000", 2024-09-12T18:37:51.970 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7309999999999999e-06 2024-09-12T18:37:51.971 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.971 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.971 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:51.971 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163143+0000", 2024-09-12T18:37:51.971 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2942000000000002e-05 2024-09-12T18:37:51.972 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.972 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.972 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:51.972 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163270+0000", 2024-09-12T18:37:51.972 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012664100000000001 2024-09-12T18:37:51.973 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.973 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.973 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:51.973 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163378+0000", 2024-09-12T18:37:51.974 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000107995 2024-09-12T18:37:51.974 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.974 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.975 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:51.975 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234552+0000", 2024-09-12T18:37:51.975 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.071173831000000007 2024-09-12T18:37:51.975 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.975 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.976 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:51.976 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240640+0000", 2024-09-12T18:37:51.976 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.006088909 2024-09-12T18:37:51.976 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.977 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.977 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:51.977 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240709+0000", 2024-09-12T18:37:51.977 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8393999999999996e-05 2024-09-12T18:37:51.977 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.977 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.978 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:51.978 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240774+0000", 2024-09-12T18:37:51.978 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5147000000000005e-05 2024-09-12T18:37:51.979 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:51.979 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:51.979 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:51.979 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.979 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.980 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167358 5.a 5:533f6738:::benchmark_data_smithi073_23739_object35081:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:51.980 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.165639+0000", 2024-09-12T18:37:51.980 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 48.783030590000003, 2024-09-12T18:37:51.980 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.075287509000000002, 2024-09-12T18:37:51.980 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:51.981 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:51.981 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:51.981 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:51.981 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:51.981 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:51.983 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167358 2024-09-12T18:37:51.983 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.983 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:51.984 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.984 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:51.984 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165639+0000", 2024-09-12T18:37:51.984 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:51.984 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.984 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.984 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:51.984 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165639+0000", 2024-09-12T18:37:51.984 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:51.984 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.984 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.984 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:51.985 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165640+0000", 2024-09-12T18:37:51.985 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1999999999999999e-06 2024-09-12T18:37:51.985 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.985 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.985 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:51.985 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165646+0000", 2024-09-12T18:37:51.985 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4550000000000003e-06 2024-09-12T18:37:51.985 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.985 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.985 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:51.985 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165658+0000", 2024-09-12T18:37:51.985 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2721999999999999e-05 2024-09-12T18:37:51.985 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.986 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.986 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:51.986 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165668+0000", 2024-09-12T18:37:51.986 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4229999999999994e-06 2024-09-12T18:37:51.986 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.986 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.986 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:51.986 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165711+0000", 2024-09-12T18:37:51.986 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3785999999999997e-05 2024-09-12T18:37:51.986 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.987 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.987 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:51.987 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165788+0000", 2024-09-12T18:37:51.987 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6506000000000002e-05 2024-09-12T18:37:51.987 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.987 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.987 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:51.987 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165862+0000", 2024-09-12T18:37:51.987 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4012999999999998e-05 2024-09-12T18:37:51.988 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.988 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.988 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:51.988 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234718+0000", 2024-09-12T18:37:51.988 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.068856420000000002 2024-09-12T18:37:51.988 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.988 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.988 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:51.988 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240785+0000", 2024-09-12T18:37:51.988 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0060661489999999998 2024-09-12T18:37:51.988 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.988 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.988 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:51.989 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240844+0000", 2024-09-12T18:37:51.989 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9487000000000002e-05 2024-09-12T18:37:51.989 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.989 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.989 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:51.989 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240926+0000", 2024-09-12T18:37:51.989 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2348000000000005e-05 2024-09-12T18:37:51.989 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:51.989 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:51.989 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:51.989 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.989 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.989 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167361 5.a 5:56730f28:::benchmark_data_smithi073_23739_object35084:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:51.989 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.165979+0000", 2024-09-12T18:37:51.990 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 48.782690610000003, 2024-09-12T18:37:51.990 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.075128337000000003, 2024-09-12T18:37:51.990 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:51.990 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:51.990 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:51.990 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:51.990 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:51.990 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:51.990 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167361 2024-09-12T18:37:51.990 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.990 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:51.990 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.990 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:51.990 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165979+0000", 2024-09-12T18:37:51.991 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:51.991 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.991 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.991 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:51.991 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165979+0000", 2024-09-12T18:37:51.991 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:51.991 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.991 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.991 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:51.991 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165980+0000", 2024-09-12T18:37:51.991 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4499999999999997e-07 2024-09-12T18:37:51.991 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.991 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.992 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:51.992 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165985+0000", 2024-09-12T18:37:51.992 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.186e-06 2024-09-12T18:37:51.992 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.992 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.992 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:51.992 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165995+0000", 2024-09-12T18:37:51.992 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0378e-05 2024-09-12T18:37:51.992 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.992 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.992 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:51.992 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.166016+0000", 2024-09-12T18:37:51.992 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1316999999999999e-05 2024-09-12T18:37:51.993 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.993 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.993 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:51.993 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.167783+0000", 2024-09-12T18:37:51.994 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017662209999999999 2024-09-12T18:37:51.994 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.994 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.994 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:51.994 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.167851+0000", 2024-09-12T18:37:51.994 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7990000000000005e-05 2024-09-12T18:37:51.994 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.994 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.994 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:51.994 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.167929+0000", 2024-09-12T18:37:51.994 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8829e-05 2024-09-12T18:37:51.994 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.994 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.995 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:51.995 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234832+0000", 2024-09-12T18:37:51.995 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066902378999999998 2024-09-12T18:37:51.995 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.995 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.995 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:51.995 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240941+0000", 2024-09-12T18:37:51.995 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0061087470000000003 2024-09-12T18:37:51.995 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.995 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.995 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:51.995 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241053+0000", 2024-09-12T18:37:51.995 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00011197299999999999 2024-09-12T18:37:51.996 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.996 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.996 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:51.996 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241107+0000", 2024-09-12T18:37:51.996 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4672000000000001e-05 2024-09-12T18:37:51.996 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:51.996 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:51.996 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:51.996 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.996 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.996 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167362 5.3 5:cbd73b47:::benchmark_data_smithi073_23739_object35085:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:51.996 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:51.996 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 48.780593895000003, 2024-09-12T18:37:51.997 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.067202411000000004, 2024-09-12T18:37:51.997 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:51.997 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:51.997 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:51.998 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:51.998 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:51.998 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:51.998 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167362 2024-09-12T18:37:51.998 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.998 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:51.998 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.998 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:51.998 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:51.998 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:51.998 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.998 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.998 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:51.999 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:51.999 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:51.999 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.999 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.999 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:51.999 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:51.999 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3600000000000003e-07 2024-09-12T18:37:51.999 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.999 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:51.999 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:51.999 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168079+0000", 2024-09-12T18:37:51.999 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7949999999999999e-06 2024-09-12T18:37:51.999 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:51.999 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.000 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:52.000 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168085+0000", 2024-09-12T18:37:52.000 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2110000000000003e-06 2024-09-12T18:37:52.000 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.000 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.000 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:52.000 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168089+0000", 2024-09-12T18:37:52.000 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0840000000000002e-06 2024-09-12T18:37:52.000 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.000 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.000 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:52.000 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168121+0000", 2024-09-12T18:37:52.000 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.1489000000000003e-05 2024-09-12T18:37:52.001 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.001 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.001 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:52.001 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168186+0000", 2024-09-12T18:37:52.001 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5313000000000003e-05 2024-09-12T18:37:52.001 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.001 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.001 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:52.001 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168242+0000", 2024-09-12T18:37:52.001 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5560999999999999e-05 2024-09-12T18:37:52.001 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.001 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.001 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:52.002 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234467+0000", 2024-09-12T18:37:52.002 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066225424000000005 2024-09-12T18:37:52.002 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.002 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.002 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:52.002 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235088+0000", 2024-09-12T18:37:52.002 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00062118999999999998 2024-09-12T18:37:52.002 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.002 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.002 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:52.002 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235197+0000", 2024-09-12T18:37:52.002 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00010825899999999999 2024-09-12T18:37:52.002 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.003 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.003 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:52.003 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235278+0000", 2024-09-12T18:37:52.003 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1448999999999999e-05 2024-09-12T18:37:52.003 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:52.003 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:52.003 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:52.003 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.003 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.003 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167366 5.a 5:58e6a467:::benchmark_data_smithi073_23739_object35089:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:52.003 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168263+0000", 2024-09-12T18:37:52.003 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 48.780406358, 2024-09-12T18:37:52.003 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.078184744, 2024-09-12T18:37:52.004 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:52.004 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:52.004 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:52.004 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:52.004 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:52.004 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:52.004 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167366 2024-09-12T18:37:52.004 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.004 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:52.004 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.004 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:52.004 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168263+0000", 2024-09-12T18:37:52.004 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:52.004 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.005 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.005 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:52.005 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168263+0000", 2024-09-12T18:37:52.005 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:52.005 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.005 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.005 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:52.005 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168264+0000", 2024-09-12T18:37:52.005 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5700000000000002e-07 2024-09-12T18:37:52.005 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.005 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.005 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:52.005 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168266+0000", 2024-09-12T18:37:52.006 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1789999999999998e-06 2024-09-12T18:37:52.006 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.006 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.006 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:52.006 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168271+0000", 2024-09-12T18:37:52.006 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8160000000000001e-06 2024-09-12T18:37:52.006 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.006 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.006 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:52.006 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168275+0000", 2024-09-12T18:37:52.006 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4440000000000001e-06 2024-09-12T18:37:52.006 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.006 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.006 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:52.007 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170082+0000", 2024-09-12T18:37:52.007 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0018068800000000001 2024-09-12T18:37:52.007 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.007 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.007 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:52.007 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170154+0000", 2024-09-12T18:37:52.007 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1575000000000005e-05 2024-09-12T18:37:52.007 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.007 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.007 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:52.007 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170216+0000", 2024-09-12T18:37:52.007 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1989999999999994e-05 2024-09-12T18:37:52.008 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.008 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.008 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:52.008 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234933+0000", 2024-09-12T18:37:52.008 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064717514000000004 2024-09-12T18:37:52.008 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.008 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.008 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:52.008 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246226+0000", 2024-09-12T18:37:52.008 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011293151 2024-09-12T18:37:52.008 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.008 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.008 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:52.009 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246338+0000", 2024-09-12T18:37:52.009 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00011225 2024-09-12T18:37:52.009 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.009 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.009 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:52.009 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246448+0000", 2024-09-12T18:37:52.009 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000109388 2024-09-12T18:37:52.009 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:52.009 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:52.009 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:52.009 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.009 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.010 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167367 5.a 5:51778d97:::benchmark_data_smithi073_23739_object35090:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:52.010 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168388+0000", 2024-09-12T18:37:52.010 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 48.780281113999997, 2024-09-12T18:37:52.010 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.082583860999999995, 2024-09-12T18:37:52.010 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:52.010 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:52.010 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:52.010 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:52.010 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:52.010 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:52.010 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167367 2024-09-12T18:37:52.010 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.010 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:52.010 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.011 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:52.011 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168388+0000", 2024-09-12T18:37:52.011 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:52.011 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.011 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.011 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:52.011 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168388+0000", 2024-09-12T18:37:52.011 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:52.011 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.011 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.011 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:52.011 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168389+0000", 2024-09-12T18:37:52.011 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1099999999999996e-07 2024-09-12T18:37:52.012 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.012 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.012 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:52.012 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168391+0000", 2024-09-12T18:37:52.012 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.39e-06 2024-09-12T18:37:52.012 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.012 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.012 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:52.012 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168396+0000", 2024-09-12T18:37:52.012 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3460000000000004e-06 2024-09-12T18:37:52.012 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.012 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.012 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:52.013 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168399+0000", 2024-09-12T18:37:52.013 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.613e-06 2024-09-12T18:37:52.013 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.013 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.013 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:52.013 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235003+0000", 2024-09-12T18:37:52.013 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066603851000000006 2024-09-12T18:37:52.013 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.013 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.013 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:52.013 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235266+0000", 2024-09-12T18:37:52.013 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00026270999999999998 2024-09-12T18:37:52.013 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.013 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.014 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:52.014 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235510+0000", 2024-09-12T18:37:52.014 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00024394 2024-09-12T18:37:52.014 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.014 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.014 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:52.014 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246546+0000", 2024-09-12T18:37:52.014 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011035774 2024-09-12T18:37:52.014 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.014 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.014 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:52.014 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.250808+0000", 2024-09-12T18:37:52.014 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0042622700000000003 2024-09-12T18:37:52.015 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.015 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.015 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:52.015 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.250890+0000", 2024-09-12T18:37:52.015 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1874999999999998e-05 2024-09-12T18:37:52.015 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.015 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.015 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:52.015 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.250972+0000", 2024-09-12T18:37:52.015 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2581000000000001e-05 2024-09-12T18:37:52.015 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:52.015 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:52.015 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:52.015 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.016 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.016 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167370 5.a 5:5aab9477:::benchmark_data_smithi073_23739_object35093:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:52.016 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168603+0000", 2024-09-12T18:37:52.016 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 48.780066179000002, 2024-09-12T18:37:52.016 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.086603794999999997, 2024-09-12T18:37:52.016 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:52.016 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:52.016 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:52.016 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:52.016 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:52.016 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:52.016 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167370 2024-09-12T18:37:52.016 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.017 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:52.017 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.017 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:52.017 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168603+0000", 2024-09-12T18:37:52.017 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:52.017 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.017 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.017 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:52.017 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168603+0000", 2024-09-12T18:37:52.017 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:52.018 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.018 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.018 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:52.018 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168604+0000", 2024-09-12T18:37:52.018 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.1899999999999998e-07 2024-09-12T18:37:52.018 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.018 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.018 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:52.018 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168606+0000", 2024-09-12T18:37:52.018 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8309999999999999e-06 2024-09-12T18:37:52.018 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.018 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.018 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:52.019 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168610+0000", 2024-09-12T18:37:52.019 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8069999999999999e-06 2024-09-12T18:37:52.019 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.019 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.019 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:52.019 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168613+0000", 2024-09-12T18:37:52.019 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.118e-06 2024-09-12T18:37:52.019 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.019 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.019 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:52.019 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241145+0000", 2024-09-12T18:37:52.019 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.072531678000000002 2024-09-12T18:37:52.020 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.020 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.020 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:52.020 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241342+0000", 2024-09-12T18:37:52.020 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00019635900000000001 2024-09-12T18:37:52.020 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.020 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.020 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:52.020 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241483+0000", 2024-09-12T18:37:52.020 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014161100000000001 2024-09-12T18:37:52.020 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.021 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.021 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:52.021 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255039+0000", 2024-09-12T18:37:52.021 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013555724 2024-09-12T18:37:52.021 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.021 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.021 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:52.021 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255062+0000", 2024-09-12T18:37:52.021 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.3042000000000001e-05 2024-09-12T18:37:52.021 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.022 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.022 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:52.022 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255143+0000", 2024-09-12T18:37:52.022 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0999000000000002e-05 2024-09-12T18:37:52.022 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.022 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.022 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:52.022 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255207+0000", 2024-09-12T18:37:52.022 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4207000000000004e-05 2024-09-12T18:37:52.022 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:52.022 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:52.022 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:52.022 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.023 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.023 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167352 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:52.023 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:52.023 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 48.779941524999998, 2024-09-12T18:37:52.023 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065859953999999998, 2024-09-12T18:37:52.023 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:52.023 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:52.023 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:52.023 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:52.023 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.023 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:52.023 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:52.023 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:52.023 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.024 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.024 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:52.024 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:52.024 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:52.024 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.024 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.024 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:52.024 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:52.024 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.0800000000000001e-07 2024-09-12T18:37:52.024 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.024 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.024 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:52.024 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168730+0000", 2024-09-12T18:37:52.025 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6530000000000001e-06 2024-09-12T18:37:52.025 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.025 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.025 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:52.025 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168734+0000", 2024-09-12T18:37:52.025 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.721e-06 2024-09-12T18:37:52.025 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.025 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.025 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:52.025 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168736+0000", 2024-09-12T18:37:52.025 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.508e-06 2024-09-12T18:37:52.025 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.025 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.025 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:52.026 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171951+0000", 2024-09-12T18:37:52.026 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.003215281 2024-09-12T18:37:52.026 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.026 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.026 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:52.026 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234520+0000", 2024-09-12T18:37:52.026 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062568676000000004 2024-09-12T18:37:52.026 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.026 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.026 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:52.026 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234588+0000", 2024-09-12T18:37:52.026 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7806999999999996e-05 2024-09-12T18:37:52.026 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:52.026 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:52.027 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:52.027 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.027 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.027 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167368 5.4 e58/21 5:29a1ec58:::benchmark_data_smithi073_23739_object35091:head v 58'10399, mlcod=58'10396)", 2024-09-12T18:37:52.027 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:52.027 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 48.779818507999998, 2024-09-12T18:37:52.027 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066008885000000003, 2024-09-12T18:37:52.027 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:52.027 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:52.027 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:52.027 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:52.027 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.027 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:52.027 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:52.028 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:52.028 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.028 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.028 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:52.028 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:52.028 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:52.028 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.028 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.028 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:52.028 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:52.028 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4699999999999998e-07 2024-09-12T18:37:52.028 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.028 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.029 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:52.029 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168854+0000", 2024-09-12T18:37:52.029 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.3180000000000001e-06 2024-09-12T18:37:52.029 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.029 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.029 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:52.029 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168858+0000", 2024-09-12T18:37:52.029 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2799999999999997e-06 2024-09-12T18:37:52.029 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.029 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.029 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:52.029 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168861+0000", 2024-09-12T18:37:52.029 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7650000000000002e-06 2024-09-12T18:37:52.030 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.030 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.030 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:52.030 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168895+0000", 2024-09-12T18:37:52.030 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4533999999999998e-05 2024-09-12T18:37:52.030 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.030 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.030 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:52.030 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168906+0000", 2024-09-12T18:37:52.030 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0910000000000001e-05 2024-09-12T18:37:52.030 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.030 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.030 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:52.031 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234784+0000", 2024-09-12T18:37:52.031 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065877656000000007 2024-09-12T18:37:52.031 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.031 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.031 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:52.031 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234860+0000", 2024-09-12T18:37:52.031 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6174999999999995e-05 2024-09-12T18:37:52.031 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:52.031 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:52.031 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:52.032 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.032 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.032 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167358 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:52.032 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.170373+0000", 2024-09-12T18:37:52.032 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 48.778296226999998, 2024-09-12T18:37:52.032 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064370201000000002, 2024-09-12T18:37:52.032 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:52.032 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:52.032 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:52.032 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:52.032 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.032 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:52.032 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170373+0000", 2024-09-12T18:37:52.032 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:52.033 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.033 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.033 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:52.033 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170373+0000", 2024-09-12T18:37:52.033 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:52.033 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.033 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.033 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:52.033 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170374+0000", 2024-09-12T18:37:52.033 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5799999999999998e-07 2024-09-12T18:37:52.033 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.033 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.033 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:52.034 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170378+0000", 2024-09-12T18:37:52.034 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.732e-06 2024-09-12T18:37:52.034 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.034 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.034 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:52.034 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170388+0000", 2024-09-12T18:37:52.034 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0212e-05 2024-09-12T18:37:52.034 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.034 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.034 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:52.034 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170397+0000", 2024-09-12T18:37:52.034 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7090000000000008e-06 2024-09-12T18:37:52.034 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.034 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.035 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:52.035 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234682+0000", 2024-09-12T18:37:52.035 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064285518999999999 2024-09-12T18:37:52.035 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.035 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.035 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:52.035 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234703+0000", 2024-09-12T18:37:52.035 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.0199000000000001e-05 2024-09-12T18:37:52.035 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.035 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.035 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:52.035 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234743+0000", 2024-09-12T18:37:52.035 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0972e-05 2024-09-12T18:37:52.036 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:52.036 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:52.036 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:52.036 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.036 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.036 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167372 5.c 5:398d36a7:::benchmark_data_smithi073_23739_object35095:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:52.036 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171066+0000", 2024-09-12T18:37:52.036 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 48.777603014999997, 2024-09-12T18:37:52.036 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065889534999999999, 2024-09-12T18:37:52.036 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:52.036 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:52.036 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:52.036 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:52.036 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:52.037 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:52.037 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167372 2024-09-12T18:37:52.037 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.037 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:52.037 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.037 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:52.037 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171066+0000", 2024-09-12T18:37:52.037 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:52.037 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.037 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.037 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:52.037 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171066+0000", 2024-09-12T18:37:52.037 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:52.038 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.038 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.038 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:52.038 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171068+0000", 2024-09-12T18:37:52.038 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.186e-06 2024-09-12T18:37:52.038 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.038 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.038 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:52.038 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171072+0000", 2024-09-12T18:37:52.038 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3560000000000003e-06 2024-09-12T18:37:52.038 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.038 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.038 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:52.038 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171082+0000", 2024-09-12T18:37:52.039 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.9739999999999997e-06 2024-09-12T18:37:52.039 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.039 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.039 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:52.039 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171089+0000", 2024-09-12T18:37:52.039 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7159999999999997e-06 2024-09-12T18:37:52.039 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.039 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.039 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:52.039 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171133+0000", 2024-09-12T18:37:52.040 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4091999999999997e-05 2024-09-12T18:37:52.040 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.040 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.040 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:52.040 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171221+0000", 2024-09-12T18:37:52.041 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.8108000000000004e-05 2024-09-12T18:37:52.041 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.041 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.041 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:52.041 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171279+0000", 2024-09-12T18:37:52.041 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8062000000000001e-05 2024-09-12T18:37:52.041 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.042 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.042 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:52.042 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235007+0000", 2024-09-12T18:37:52.042 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.063727849000000003 2024-09-12T18:37:52.042 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.042 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.042 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:52.042 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236790+0000", 2024-09-12T18:37:52.042 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017829269999999999 2024-09-12T18:37:52.042 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.042 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.042 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:52.043 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236881+0000", 2024-09-12T18:37:52.043 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1347999999999993e-05 2024-09-12T18:37:52.043 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.043 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.043 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:52.043 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236956+0000", 2024-09-12T18:37:52.043 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4917000000000001e-05 2024-09-12T18:37:52.043 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:52.043 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:52.043 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:52.043 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.043 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.043 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167371 5.4 e58/21 5:24fea27c:::benchmark_data_smithi073_23739_object35094:head v 58'10400, mlcod=58'10397)", 2024-09-12T18:37:52.043 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171273+0000", 2024-09-12T18:37:52.044 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 48.777396441, 2024-09-12T18:37:52.044 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065500368000000003, 2024-09-12T18:37:52.044 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:52.044 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:52.044 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:52.044 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:52.044 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.044 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:52.044 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171273+0000", 2024-09-12T18:37:52.044 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:52.044 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.044 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.045 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:52.045 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171273+0000", 2024-09-12T18:37:52.045 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:52.045 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.045 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.045 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:52.045 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171274+0000", 2024-09-12T18:37:52.046 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0399999999999996e-07 2024-09-12T18:37:52.046 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.046 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.046 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:52.046 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171277+0000", 2024-09-12T18:37:52.046 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8689999999999997e-06 2024-09-12T18:37:52.047 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.047 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.047 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:52.047 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171284+0000", 2024-09-12T18:37:52.047 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2879999999999998e-06 2024-09-12T18:37:52.047 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.048 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.048 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:52.048 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171289+0000", 2024-09-12T18:37:52.048 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9049999999999996e-06 2024-09-12T18:37:52.048 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.048 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.048 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:52.049 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171322+0000", 2024-09-12T18:37:52.049 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3781000000000001e-05 2024-09-12T18:37:52.049 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.049 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.049 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:52.049 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171335+0000", 2024-09-12T18:37:52.049 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2639999999999999e-05 2024-09-12T18:37:52.049 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.050 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.050 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:52.050 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236691+0000", 2024-09-12T18:37:52.050 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065355835000000001 2024-09-12T18:37:52.050 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.050 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.051 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:52.051 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236773+0000", 2024-09-12T18:37:52.051 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2546000000000006e-05 2024-09-12T18:37:52.051 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:52.051 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:52.051 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:52.051 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.052 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.052 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167364 5.7 e58/21 5:ee50096a:::benchmark_data_smithi073_23739_object35087:head v 58'10504, mlcod=58'10502)", 2024-09-12T18:37:52.052 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171598+0000", 2024-09-12T18:37:52.052 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 48.777071321999998, 2024-09-12T18:37:52.052 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065149069000000004, 2024-09-12T18:37:52.052 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:52.053 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:52.053 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:52.053 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:52.053 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.053 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:52.054 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171598+0000", 2024-09-12T18:37:52.054 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:52.054 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.054 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.054 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:52.054 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171598+0000", 2024-09-12T18:37:52.054 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:52.054 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.055 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.055 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:52.055 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171599+0000", 2024-09-12T18:37:52.055 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6700000000000003e-07 2024-09-12T18:37:52.055 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.055 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.055 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:52.055 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171602+0000", 2024-09-12T18:37:52.055 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.841e-06 2024-09-12T18:37:52.055 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.055 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.055 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:52.055 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171608+0000", 2024-09-12T18:37:52.055 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9259999999999997e-06 2024-09-12T18:37:52.056 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.056 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.056 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:52.056 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171611+0000", 2024-09-12T18:37:52.056 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.9450000000000003e-06 2024-09-12T18:37:52.056 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.056 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.056 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:52.056 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171650+0000", 2024-09-12T18:37:52.056 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8464000000000003e-05 2024-09-12T18:37:52.056 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.056 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.056 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:52.056 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171662+0000", 2024-09-12T18:37:52.057 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1603999999999999e-05 2024-09-12T18:37:52.057 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.057 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.057 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:52.057 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236663+0000", 2024-09-12T18:37:52.057 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065001330999999996 2024-09-12T18:37:52.057 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.057 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.057 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:52.057 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236747+0000", 2024-09-12T18:37:52.057 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.4390999999999999e-05 2024-09-12T18:37:52.057 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:52.057 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:52.058 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:52.058 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.058 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.058 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167365 5.2 e58/21 5:4107875c:::benchmark_data_smithi073_23739_object35088:head v 58'10351, mlcod=58'10349)", 2024-09-12T18:37:52.058 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171733+0000", 2024-09-12T18:37:52.058 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 48.776936276999997, 2024-09-12T18:37:52.058 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.074804168000000004, 2024-09-12T18:37:52.058 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:52.058 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:52.058 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:52.058 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:52.058 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.058 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:52.059 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171733+0000", 2024-09-12T18:37:52.059 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:52.059 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.059 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.059 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:52.059 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171733+0000", 2024-09-12T18:37:52.059 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:52.059 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.059 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.059 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:52.059 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171734+0000", 2024-09-12T18:37:52.059 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9299999999999998e-07 2024-09-12T18:37:52.059 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.060 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.060 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:52.060 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171738+0000", 2024-09-12T18:37:52.060 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.301e-06 2024-09-12T18:37:52.060 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.060 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.060 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:52.060 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171746+0000", 2024-09-12T18:37:52.060 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.554e-06 2024-09-12T18:37:52.060 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.060 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.060 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:52.060 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171751+0000", 2024-09-12T18:37:52.061 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1880000000000001e-06 2024-09-12T18:37:52.061 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.061 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.061 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:52.061 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234659+0000", 2024-09-12T18:37:52.061 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062907807999999996 2024-09-12T18:37:52.061 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.061 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.061 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:52.061 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234708+0000", 2024-09-12T18:37:52.061 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8992000000000001e-05 2024-09-12T18:37:52.061 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.061 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.062 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:52.062 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246457+0000", 2024-09-12T18:37:52.062 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.01174974 2024-09-12T18:37:52.062 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.062 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.062 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:52.062 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246537+0000", 2024-09-12T18:37:52.062 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.9992000000000003e-05 2024-09-12T18:37:52.062 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:52.062 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:52.062 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:52.062 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.062 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.062 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167373 5.5 e58/49 5:ad283029:::benchmark_data_smithi073_23739_object35096:head v 58'10600, mlcod=58'10598)", 2024-09-12T18:37:52.063 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:52.063 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 48.776908792999997, 2024-09-12T18:37:52.063 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065058240000000003, 2024-09-12T18:37:52.063 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:52.063 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:52.063 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:52.063 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:52.063 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.064 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:52.064 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:52.064 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:52.064 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.064 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.064 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:52.065 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:52.065 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:52.065 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.065 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.065 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:52.065 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:52.065 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.2899999999999999e-07 2024-09-12T18:37:52.066 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.066 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.066 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:52.066 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171764+0000", 2024-09-12T18:37:52.066 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7310000000000002e-06 2024-09-12T18:37:52.066 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.066 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.067 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:52.067 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171769+0000", 2024-09-12T18:37:52.067 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.079e-06 2024-09-12T18:37:52.067 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.067 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.067 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:52.067 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171774+0000", 2024-09-12T18:37:52.067 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.48e-06 2024-09-12T18:37:52.068 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.068 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.068 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:52.068 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171819+0000", 2024-09-12T18:37:52.068 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4391999999999998e-05 2024-09-12T18:37:52.068 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.069 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.069 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:52.069 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171841+0000", 2024-09-12T18:37:52.069 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2245000000000001e-05 2024-09-12T18:37:52.069 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.069 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.070 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:52.070 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236750+0000", 2024-09-12T18:37:52.070 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064909123999999999 2024-09-12T18:37:52.070 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.070 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.070 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:52.071 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236819+0000", 2024-09-12T18:37:52.071 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8860000000000001e-05 2024-09-12T18:37:52.071 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:52.071 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:52.071 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:52.071 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.071 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.071 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167361 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:52.071 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:52.071 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 48.776852886999997, 2024-09-12T18:37:52.071 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.063049426000000006, 2024-09-12T18:37:52.071 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:52.072 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:52.072 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:52.072 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:52.072 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.072 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:52.072 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:52.072 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:52.072 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.072 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.072 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:52.073 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:52.073 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:52.073 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.073 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.073 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:52.073 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:52.073 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.9099999999999999e-07 2024-09-12T18:37:52.073 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.073 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.073 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:52.073 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171820+0000", 2024-09-12T18:37:52.073 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.5900000000000002e-06 2024-09-12T18:37:52.073 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.074 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.074 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:52.074 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171826+0000", 2024-09-12T18:37:52.074 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.64e-06 2024-09-12T18:37:52.074 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.074 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.074 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:52.074 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171831+0000", 2024-09-12T18:37:52.074 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.578e-06 2024-09-12T18:37:52.074 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.074 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.074 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:52.074 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234808+0000", 2024-09-12T18:37:52.075 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062976780999999996 2024-09-12T18:37:52.075 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.075 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.075 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:52.075 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234821+0000", 2024-09-12T18:37:52.075 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3002e-05 2024-09-12T18:37:52.075 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.075 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.075 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:52.075 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234866+0000", 2024-09-12T18:37:52.075 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5444000000000001e-05 2024-09-12T18:37:52.075 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:52.075 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:52.075 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:52.076 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.076 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.076 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167366 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:52.076 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.172133+0000", 2024-09-12T18:37:52.076 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 48.776536059000001, 2024-09-12T18:37:52.076 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062815840999999997, 2024-09-12T18:37:52.076 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:52.076 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:52.076 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:52.076 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:52.076 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.076 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:52.076 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172133+0000", 2024-09-12T18:37:52.076 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:52.077 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.077 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.077 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:52.077 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172133+0000", 2024-09-12T18:37:52.077 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:52.077 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.077 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.077 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:52.077 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172134+0000", 2024-09-12T18:37:52.077 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5000000000000003e-07 2024-09-12T18:37:52.077 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.077 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.077 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:52.078 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172137+0000", 2024-09-12T18:37:52.078 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.6460000000000002e-06 2024-09-12T18:37:52.078 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.078 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.078 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:52.078 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234511+0000", 2024-09-12T18:37:52.078 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062374603000000001 2024-09-12T18:37:52.078 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.078 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.078 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:52.078 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234525+0000", 2024-09-12T18:37:52.078 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3396e-05 2024-09-12T18:37:52.078 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.078 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.079 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:52.079 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234909+0000", 2024-09-12T18:37:52.079 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00038405299999999998 2024-09-12T18:37:52.079 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.079 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.079 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:52.079 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234922+0000", 2024-09-12T18:37:52.079 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3274e-05 2024-09-12T18:37:52.079 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.079 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.079 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:52.079 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234949+0000", 2024-09-12T18:37:52.079 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7319000000000001e-05 2024-09-12T18:37:52.080 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:52.080 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:52.080 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:52.080 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.080 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.080 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167369 5.7 e58/21 5:e64ecabd:::benchmark_data_smithi073_23739_object35092:head v 58'10505, mlcod=58'10502)", 2024-09-12T18:37:52.080 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:52.080 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 48.775005667000002, 2024-09-12T18:37:52.080 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.063873773999999994, 2024-09-12T18:37:52.080 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:52.080 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:52.080 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:52.080 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:52.081 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.081 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:52.081 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:52.081 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:52.081 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.081 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.081 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:52.081 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:52.081 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:52.081 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.081 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.081 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:52.081 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:52.081 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3500000000000002e-07 2024-09-12T18:37:52.082 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.082 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.082 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:52.082 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173668+0000", 2024-09-12T18:37:52.082 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4000000000000001e-06 2024-09-12T18:37:52.082 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.082 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.082 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:52.082 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234583+0000", 2024-09-12T18:37:52.083 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.060914889 2024-09-12T18:37:52.083 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.083 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.083 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:52.083 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234600+0000", 2024-09-12T18:37:52.083 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7192000000000001e-05 2024-09-12T18:37:52.083 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.083 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.083 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:52.083 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234791+0000", 2024-09-12T18:37:52.083 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00019115000000000001 2024-09-12T18:37:52.083 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.083 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.083 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:52.084 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234834+0000", 2024-09-12T18:37:52.084 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3296e-05 2024-09-12T18:37:52.084 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.084 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.084 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:52.084 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.237481+0000", 2024-09-12T18:37:52.084 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0026472050000000001 2024-09-12T18:37:52.084 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.084 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.084 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:52.084 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.237538+0000", 2024-09-12T18:37:52.084 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6206999999999999e-05 2024-09-12T18:37:52.084 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:52.085 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:52.085 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:52.085 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.085 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.085 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:238478 5.c 5:38260ae8:::benchmark_data_smithi073_23739_object106201:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:52.085 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:38.617167+0000", 2024-09-12T18:37:52.085 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 13.331502249, 2024-09-12T18:37:52.085 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062584934999999994, 2024-09-12T18:37:52.085 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:52.085 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:52.085 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:52.085 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:52.085 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:52.086 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:52.086 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 238478 2024-09-12T18:37:52.086 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.086 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:52.086 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.086 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:52.086 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.617167+0000", 2024-09-12T18:37:52.086 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:52.086 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.086 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.086 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:52.086 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.617167+0000", 2024-09-12T18:37:52.086 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:52.086 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.087 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.087 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:52.087 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.617168+0000", 2024-09-12T18:37:52.087 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.091e-06 2024-09-12T18:37:52.087 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.087 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.087 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:52.087 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.617173+0000", 2024-09-12T18:37:52.087 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2490000000000003e-06 2024-09-12T18:37:52.087 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.087 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.087 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:52.087 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.617182+0000", 2024-09-12T18:37:52.087 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.6390000000000004e-06 2024-09-12T18:37:52.088 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.088 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.088 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:52.088 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.617189+0000", 2024-09-12T18:37:52.088 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0119999999999999e-06 2024-09-12T18:37:52.088 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.088 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.088 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:52.088 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.617678+0000", 2024-09-12T18:37:52.088 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00048910800000000003 2024-09-12T18:37:52.088 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.088 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.088 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:52.088 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.665641+0000", 2024-09-12T18:37:52.089 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.047962481000000001 2024-09-12T18:37:52.089 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.089 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.089 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:52.089 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.665895+0000", 2024-09-12T18:37:52.089 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00025440199999999998 2024-09-12T18:37:52.089 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.089 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.089 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:52.089 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.670817+0000", 2024-09-12T18:37:52.089 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0049221120000000002 2024-09-12T18:37:52.089 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.089 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.090 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:52.090 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.679695+0000", 2024-09-12T18:37:52.090 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0088778269999999996 2024-09-12T18:37:52.090 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.090 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.090 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:52.090 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.679726+0000", 2024-09-12T18:37:52.090 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.0830999999999997e-05 2024-09-12T18:37:52.090 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.090 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.090 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:52.090 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.679752+0000", 2024-09-12T18:37:52.090 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.6183e-05 2024-09-12T18:37:52.090 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:52.091 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:52.091 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:52.091 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.091 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.091 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:238480 5.c 5:3d043cef:::benchmark_data_smithi073_23739_object106203:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:52.091 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:38.618189+0000", 2024-09-12T18:37:52.091 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 13.330480443000001, 2024-09-12T18:37:52.091 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.061642400999999999, 2024-09-12T18:37:52.091 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:52.091 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:52.091 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:52.091 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:52.091 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:52.091 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:52.092 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 238480 2024-09-12T18:37:52.092 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.092 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:52.092 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.092 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:52.092 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.618189+0000", 2024-09-12T18:37:52.092 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:52.092 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.092 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.092 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:52.092 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.618189+0000", 2024-09-12T18:37:52.092 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:52.092 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.093 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.093 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:52.093 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.618190+0000", 2024-09-12T18:37:52.093 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3e-07 2024-09-12T18:37:52.093 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.093 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.093 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:52.093 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.618193+0000", 2024-09-12T18:37:52.093 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.6349999999999999e-06 2024-09-12T18:37:52.093 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.094 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.094 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:52.094 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.665526+0000", 2024-09-12T18:37:52.094 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.047332200999999997 2024-09-12T18:37:52.094 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.094 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.094 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:52.094 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.665561+0000", 2024-09-12T18:37:52.094 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.5858999999999997e-05 2024-09-12T18:37:52.094 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.094 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.094 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:52.094 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.670869+0000", 2024-09-12T18:37:52.095 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0053076720000000003 2024-09-12T18:37:52.095 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.095 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.095 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:52.095 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.671094+0000", 2024-09-12T18:37:52.095 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000225009 2024-09-12T18:37:52.095 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.095 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.095 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:52.095 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.671272+0000", 2024-09-12T18:37:52.095 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000177725 2024-09-12T18:37:52.095 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.095 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.095 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:52.096 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.679687+0000", 2024-09-12T18:37:52.096 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0084148379999999991 2024-09-12T18:37:52.096 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.096 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.096 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:52.096 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.679787+0000", 2024-09-12T18:37:52.096 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.9950000000000004e-05 2024-09-12T18:37:52.096 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.096 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.096 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:52.096 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.679811+0000", 2024-09-12T18:37:52.096 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4088999999999999e-05 2024-09-12T18:37:52.096 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:52.096 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:52.097 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:52.097 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.679831+0000", 2024-09-12T18:37:52.097 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.0693e-05 2024-09-12T18:37:52.097 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:52.097 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:52.097 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:52.097 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:52.097 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:52.097 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:52.098 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:37:52.099 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:52.093+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:52.100 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:37:52.200 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:52.197+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:52.231 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:52.232 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-09-12T18:37:52.232 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-09-12T18:37:52.232 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:52.245 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:37:52.256 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:37:52.256 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:37:52.275 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:37:52.275 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:37:52.296 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:37:52.297 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:37:52.300 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:52.295+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:52.362 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:52.362 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:52.375 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:37:52.419 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:52.415+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:52.502 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:52.497+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:52.540 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:52.540 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:52.554 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:37:52.603 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:52.597+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:52.685 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:52.685 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:52.698 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:37:52.704 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:52.699+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:52.805 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:52.799+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:52.866 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:52.866 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:52.880 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:37:52.905 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:52.901+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:52.997 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:52.997 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:53.006 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:52.999+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:53.011 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:37:53.107 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:53.101+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:53.146 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:53.146 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:53.162 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:37:53.208 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:53.205+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:53.281 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:53.281 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:53.294 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:37:53.308 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:53.303+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:53.409 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:53.403+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:53.411 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:53.411 INFO:teuthology.orchestra.run.smithi114.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:53.427 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:37:53.510 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:53.505+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:53.557 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:53.557 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:53.573 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:37:53.618 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:53.615+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:53.696 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:53.696 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:53.710 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:37:53.711 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:53.705+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:53.812 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:53.809+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:53.871 INFO:teuthology.orchestra.run.smithi143.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:53.871 INFO:teuthology.orchestra.run.smithi143.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:53.885 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:37:53.886 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T18:37:53.913 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:53.907+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:54.014 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:54.009+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:54.015 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:54.015 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:54.030 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:37:54.116 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:54.113+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:54.199 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:54.199 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:54.213 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:37:54.258 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:54.253+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:54.267 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is set 2024-09-12T18:37:54.315 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:37:54.316 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:54.311+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:54.330 INFO:teuthology.orchestra.run.smithi162.stdout:ERROR: (22) Invalid argument 2024-09-12T18:37:54.330 INFO:teuthology.orchestra.run.smithi162.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:37:54.344 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:37:54.417 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:54.413+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:54.467 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-09-12T18:37:54.467 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:37:54.475 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:54.475 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2024-09-12T18:37:54.475 INFO:teuthology.orchestra.run.smithi114.stdout: "num_ops": 0 2024-09-12T18:37:54.475 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:54.489 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:37:54.490 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-09-12T18:37:54.490 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:37:54.510 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-09-12T18:37:54.510 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:37:54.518 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:54.511+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:54.618 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:54.613+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:54.652 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:54.653 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2024-09-12T18:37:54.653 INFO:teuthology.orchestra.run.smithi114.stdout: "complaint_time": 30, 2024-09-12T18:37:54.653 INFO:teuthology.orchestra.run.smithi114.stdout: "num_blocked_ops": 0 2024-09-12T18:37:54.653 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:54.667 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:37:54.719 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:54.715+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:54.820 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:54.813+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:54.834 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:54.834 INFO:teuthology.orchestra.run.smithi114.stdout: "size": 20, 2024-09-12T18:37:54.834 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 600, 2024-09-12T18:37:54.835 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:37:54.835 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.835 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167352 5.a 5:5fc472d2:::benchmark_data_smithi073_23739_object35075:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:54.835 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.163066+0000", 2024-09-12T18:37:54.835 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 51.667068767000004, 2024-09-12T18:37:54.835 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.077708377999999995, 2024-09-12T18:37:54.835 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:54.835 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:54.835 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:54.835 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:54.835 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:54.835 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:54.836 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167352 2024-09-12T18:37:54.836 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.836 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:54.836 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.836 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:54.836 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163066+0000", 2024-09-12T18:37:54.836 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:54.836 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.836 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.836 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:54.836 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163066+0000", 2024-09-12T18:37:54.836 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:54.836 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.837 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.837 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:54.837 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163067+0000", 2024-09-12T18:37:54.837 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0499999999999999e-06 2024-09-12T18:37:54.837 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.837 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.837 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:54.837 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163071+0000", 2024-09-12T18:37:54.837 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4340000000000002e-06 2024-09-12T18:37:54.837 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.837 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.838 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:54.838 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163081+0000", 2024-09-12T18:37:54.838 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0304e-05 2024-09-12T18:37:54.838 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.838 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.838 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:54.838 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163090+0000", 2024-09-12T18:37:54.838 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7309999999999999e-06 2024-09-12T18:37:54.838 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.838 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.838 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:54.838 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163143+0000", 2024-09-12T18:37:54.839 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2942000000000002e-05 2024-09-12T18:37:54.839 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.839 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.839 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:54.839 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163270+0000", 2024-09-12T18:37:54.839 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012664100000000001 2024-09-12T18:37:54.839 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.839 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.839 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:54.839 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163378+0000", 2024-09-12T18:37:54.839 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000107995 2024-09-12T18:37:54.839 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.839 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.840 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:54.840 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234552+0000", 2024-09-12T18:37:54.840 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.071173831000000007 2024-09-12T18:37:54.840 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.840 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.840 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:54.840 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240640+0000", 2024-09-12T18:37:54.840 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.006088909 2024-09-12T18:37:54.840 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.840 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.840 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:54.840 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240709+0000", 2024-09-12T18:37:54.841 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8393999999999996e-05 2024-09-12T18:37:54.841 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.841 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.841 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:54.841 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240774+0000", 2024-09-12T18:37:54.841 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5147000000000005e-05 2024-09-12T18:37:54.841 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:54.841 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:54.841 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:54.841 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.841 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.842 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167358 5.a 5:533f6738:::benchmark_data_smithi073_23739_object35081:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:54.842 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.165639+0000", 2024-09-12T18:37:54.842 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 51.66449549, 2024-09-12T18:37:54.842 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.075287509000000002, 2024-09-12T18:37:54.842 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:54.842 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:54.842 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:54.842 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:54.842 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:54.842 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:54.842 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167358 2024-09-12T18:37:54.842 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.843 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:54.843 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.843 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:54.843 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165639+0000", 2024-09-12T18:37:54.843 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:54.843 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.843 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.843 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:54.843 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165639+0000", 2024-09-12T18:37:54.843 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:54.843 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.843 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.843 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:54.844 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165640+0000", 2024-09-12T18:37:54.844 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1999999999999999e-06 2024-09-12T18:37:54.844 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.844 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.844 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:54.844 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165646+0000", 2024-09-12T18:37:54.844 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4550000000000003e-06 2024-09-12T18:37:54.844 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.844 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.844 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:54.844 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165658+0000", 2024-09-12T18:37:54.845 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2721999999999999e-05 2024-09-12T18:37:54.845 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.845 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.845 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:54.845 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165668+0000", 2024-09-12T18:37:54.845 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4229999999999994e-06 2024-09-12T18:37:54.845 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.845 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.845 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:54.845 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165711+0000", 2024-09-12T18:37:54.845 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3785999999999997e-05 2024-09-12T18:37:54.845 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.846 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.846 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:54.846 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165788+0000", 2024-09-12T18:37:54.846 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6506000000000002e-05 2024-09-12T18:37:54.846 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.846 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.846 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:54.846 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165862+0000", 2024-09-12T18:37:54.846 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4012999999999998e-05 2024-09-12T18:37:54.846 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.846 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.846 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:54.846 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234718+0000", 2024-09-12T18:37:54.846 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.068856420000000002 2024-09-12T18:37:54.847 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.847 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.847 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:54.847 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240785+0000", 2024-09-12T18:37:54.847 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0060661489999999998 2024-09-12T18:37:54.847 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.847 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.847 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:54.847 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240844+0000", 2024-09-12T18:37:54.847 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9487000000000002e-05 2024-09-12T18:37:54.847 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.847 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.847 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:54.848 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240926+0000", 2024-09-12T18:37:54.848 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2348000000000005e-05 2024-09-12T18:37:54.848 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:54.848 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:54.848 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:54.848 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.848 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.848 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167361 5.a 5:56730f28:::benchmark_data_smithi073_23739_object35084:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:54.848 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.165979+0000", 2024-09-12T18:37:54.848 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 51.664155510000001, 2024-09-12T18:37:54.848 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.075128337000000003, 2024-09-12T18:37:54.848 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:54.849 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:54.849 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:54.849 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:54.849 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:54.849 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:54.849 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167361 2024-09-12T18:37:54.849 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.849 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:54.849 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.849 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:54.849 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165979+0000", 2024-09-12T18:37:54.849 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:54.849 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.850 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.850 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:54.850 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165979+0000", 2024-09-12T18:37:54.850 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:54.850 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.850 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.850 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:54.850 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165980+0000", 2024-09-12T18:37:54.850 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4499999999999997e-07 2024-09-12T18:37:54.850 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.850 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.850 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:54.851 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165985+0000", 2024-09-12T18:37:54.851 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.186e-06 2024-09-12T18:37:54.851 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.851 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.851 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:54.851 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165995+0000", 2024-09-12T18:37:54.851 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0378e-05 2024-09-12T18:37:54.851 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.851 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.851 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:54.851 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.166016+0000", 2024-09-12T18:37:54.851 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1316999999999999e-05 2024-09-12T18:37:54.851 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.852 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.852 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:54.852 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.167783+0000", 2024-09-12T18:37:54.852 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017662209999999999 2024-09-12T18:37:54.852 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.852 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.852 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:54.852 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.167851+0000", 2024-09-12T18:37:54.852 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7990000000000005e-05 2024-09-12T18:37:54.852 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.852 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.852 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:54.852 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.167929+0000", 2024-09-12T18:37:54.853 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8829e-05 2024-09-12T18:37:54.853 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.853 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.853 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:54.853 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234832+0000", 2024-09-12T18:37:54.853 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066902378999999998 2024-09-12T18:37:54.853 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.853 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.853 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:54.853 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240941+0000", 2024-09-12T18:37:54.853 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0061087470000000003 2024-09-12T18:37:54.853 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.853 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.854 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:54.854 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241053+0000", 2024-09-12T18:37:54.854 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00011197299999999999 2024-09-12T18:37:54.854 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.854 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.854 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:54.854 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241107+0000", 2024-09-12T18:37:54.854 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4672000000000001e-05 2024-09-12T18:37:54.854 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:54.854 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:54.854 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:54.854 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.854 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.855 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167362 5.3 5:cbd73b47:::benchmark_data_smithi073_23739_object35085:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:54.855 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:54.855 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 51.662058795, 2024-09-12T18:37:54.855 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.067202411000000004, 2024-09-12T18:37:54.855 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:54.855 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:54.855 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:54.855 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:54.855 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:54.855 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:54.855 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167362 2024-09-12T18:37:54.855 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.856 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:54.856 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.856 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:54.856 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:54.856 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:54.856 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.856 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.856 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:54.856 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:54.856 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:54.856 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.856 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.856 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:54.856 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:54.857 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3600000000000003e-07 2024-09-12T18:37:54.857 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.857 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.857 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:54.857 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168079+0000", 2024-09-12T18:37:54.857 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7949999999999999e-06 2024-09-12T18:37:54.857 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.857 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.857 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:54.857 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168085+0000", 2024-09-12T18:37:54.857 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2110000000000003e-06 2024-09-12T18:37:54.857 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.858 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.858 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:54.858 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168089+0000", 2024-09-12T18:37:54.858 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0840000000000002e-06 2024-09-12T18:37:54.858 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.858 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.858 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:54.858 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168121+0000", 2024-09-12T18:37:54.858 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.1489000000000003e-05 2024-09-12T18:37:54.858 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.858 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.858 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:54.859 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168186+0000", 2024-09-12T18:37:54.859 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5313000000000003e-05 2024-09-12T18:37:54.859 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.859 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.859 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:54.859 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168242+0000", 2024-09-12T18:37:54.859 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5560999999999999e-05 2024-09-12T18:37:54.859 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.859 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.859 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:54.859 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234467+0000", 2024-09-12T18:37:54.859 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066225424000000005 2024-09-12T18:37:54.859 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.860 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.860 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:54.860 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235088+0000", 2024-09-12T18:37:54.860 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00062118999999999998 2024-09-12T18:37:54.860 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.860 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.860 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:54.860 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235197+0000", 2024-09-12T18:37:54.860 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00010825899999999999 2024-09-12T18:37:54.860 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.860 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.860 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:54.860 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235278+0000", 2024-09-12T18:37:54.861 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1448999999999999e-05 2024-09-12T18:37:54.861 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:54.861 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:54.861 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:54.861 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.861 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.861 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167366 5.a 5:58e6a467:::benchmark_data_smithi073_23739_object35089:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:54.861 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168263+0000", 2024-09-12T18:37:54.861 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 51.661871257999998, 2024-09-12T18:37:54.861 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.078184744, 2024-09-12T18:37:54.861 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:54.861 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:54.862 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:54.862 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:54.862 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:54.862 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:54.862 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167366 2024-09-12T18:37:54.862 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.862 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:54.862 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.862 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:54.862 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168263+0000", 2024-09-12T18:37:54.862 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:54.862 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.862 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.863 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:54.863 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168263+0000", 2024-09-12T18:37:54.863 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:54.863 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.863 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.863 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:54.863 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168264+0000", 2024-09-12T18:37:54.863 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5700000000000002e-07 2024-09-12T18:37:54.863 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.863 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.863 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:54.863 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168266+0000", 2024-09-12T18:37:54.863 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1789999999999998e-06 2024-09-12T18:37:54.863 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.864 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.864 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:54.864 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168271+0000", 2024-09-12T18:37:54.864 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8160000000000001e-06 2024-09-12T18:37:54.864 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.864 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.864 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:54.864 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168275+0000", 2024-09-12T18:37:54.864 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4440000000000001e-06 2024-09-12T18:37:54.864 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.864 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.864 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:54.864 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170082+0000", 2024-09-12T18:37:54.865 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0018068800000000001 2024-09-12T18:37:54.865 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.865 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.865 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:54.865 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170154+0000", 2024-09-12T18:37:54.865 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1575000000000005e-05 2024-09-12T18:37:54.865 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.865 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.865 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:54.865 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170216+0000", 2024-09-12T18:37:54.865 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1989999999999994e-05 2024-09-12T18:37:54.865 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.865 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.866 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:54.866 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234933+0000", 2024-09-12T18:37:54.866 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064717514000000004 2024-09-12T18:37:54.866 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.866 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.866 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:54.866 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246226+0000", 2024-09-12T18:37:54.866 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011293151 2024-09-12T18:37:54.866 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.866 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.866 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:54.866 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246338+0000", 2024-09-12T18:37:54.866 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00011225 2024-09-12T18:37:54.866 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.867 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.867 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:54.867 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246448+0000", 2024-09-12T18:37:54.867 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000109388 2024-09-12T18:37:54.867 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:54.867 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:54.867 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:54.867 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.867 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.867 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167367 5.a 5:51778d97:::benchmark_data_smithi073_23739_object35090:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:54.867 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168388+0000", 2024-09-12T18:37:54.868 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 51.661746014000002, 2024-09-12T18:37:54.868 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.082583860999999995, 2024-09-12T18:37:54.868 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:54.868 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:54.868 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:54.868 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:54.868 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:54.868 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:54.868 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167367 2024-09-12T18:37:54.868 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.868 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:54.868 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.868 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:54.869 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168388+0000", 2024-09-12T18:37:54.869 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:54.869 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.869 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.869 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:54.869 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168388+0000", 2024-09-12T18:37:54.869 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:54.869 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.869 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.869 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:54.869 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168389+0000", 2024-09-12T18:37:54.869 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1099999999999996e-07 2024-09-12T18:37:54.869 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.870 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.870 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:54.870 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168391+0000", 2024-09-12T18:37:54.870 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.39e-06 2024-09-12T18:37:54.870 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.870 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.870 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:54.870 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168396+0000", 2024-09-12T18:37:54.870 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3460000000000004e-06 2024-09-12T18:37:54.870 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.870 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.870 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:54.870 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168399+0000", 2024-09-12T18:37:54.871 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.613e-06 2024-09-12T18:37:54.871 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.871 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.871 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:54.871 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235003+0000", 2024-09-12T18:37:54.871 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066603851000000006 2024-09-12T18:37:54.871 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.871 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.871 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:54.871 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235266+0000", 2024-09-12T18:37:54.871 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00026270999999999998 2024-09-12T18:37:54.871 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.871 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.872 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:54.872 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235510+0000", 2024-09-12T18:37:54.872 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00024394 2024-09-12T18:37:54.872 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.872 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.872 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:54.872 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246546+0000", 2024-09-12T18:37:54.872 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011035774 2024-09-12T18:37:54.872 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.872 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.872 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:54.872 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.250808+0000", 2024-09-12T18:37:54.872 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0042622700000000003 2024-09-12T18:37:54.873 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.873 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.873 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:54.873 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.250890+0000", 2024-09-12T18:37:54.873 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1874999999999998e-05 2024-09-12T18:37:54.873 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.873 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.873 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:54.873 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.250972+0000", 2024-09-12T18:37:54.873 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2581000000000001e-05 2024-09-12T18:37:54.873 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:54.873 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:54.873 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:54.874 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.874 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.874 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167370 5.a 5:5aab9477:::benchmark_data_smithi073_23739_object35093:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:54.874 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168603+0000", 2024-09-12T18:37:54.874 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 51.661531079, 2024-09-12T18:37:54.874 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.086603794999999997, 2024-09-12T18:37:54.874 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:54.874 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:54.874 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:54.874 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:54.874 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:54.874 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:54.874 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167370 2024-09-12T18:37:54.875 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.875 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:54.875 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.875 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:54.875 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168603+0000", 2024-09-12T18:37:54.875 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:54.875 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.875 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.875 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:54.875 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168603+0000", 2024-09-12T18:37:54.875 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:54.875 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.875 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.876 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:54.876 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168604+0000", 2024-09-12T18:37:54.876 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.1899999999999998e-07 2024-09-12T18:37:54.876 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.876 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.876 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:54.876 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168606+0000", 2024-09-12T18:37:54.876 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8309999999999999e-06 2024-09-12T18:37:54.876 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.876 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.876 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:54.876 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168610+0000", 2024-09-12T18:37:54.876 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8069999999999999e-06 2024-09-12T18:37:54.877 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.877 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.877 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:54.877 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168613+0000", 2024-09-12T18:37:54.877 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.118e-06 2024-09-12T18:37:54.877 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.877 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.877 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:54.877 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241145+0000", 2024-09-12T18:37:54.877 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.072531678000000002 2024-09-12T18:37:54.877 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.877 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.878 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:54.878 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241342+0000", 2024-09-12T18:37:54.878 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00019635900000000001 2024-09-12T18:37:54.878 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.878 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.878 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:54.878 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241483+0000", 2024-09-12T18:37:54.878 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014161100000000001 2024-09-12T18:37:54.878 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.878 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.878 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:54.878 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255039+0000", 2024-09-12T18:37:54.878 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013555724 2024-09-12T18:37:54.878 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.879 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.879 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:54.879 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255062+0000", 2024-09-12T18:37:54.879 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.3042000000000001e-05 2024-09-12T18:37:54.879 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.879 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.879 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:54.879 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255143+0000", 2024-09-12T18:37:54.879 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0999000000000002e-05 2024-09-12T18:37:54.879 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.879 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.879 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:54.879 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255207+0000", 2024-09-12T18:37:54.880 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4207000000000004e-05 2024-09-12T18:37:54.880 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:54.880 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:54.880 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:54.880 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.880 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.880 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167352 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:54.880 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:54.880 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 51.661406425000003, 2024-09-12T18:37:54.880 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065859953999999998, 2024-09-12T18:37:54.880 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:54.880 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:54.880 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:54.881 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:54.881 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.881 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:54.881 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:54.881 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:54.881 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.881 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.881 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:54.881 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:54.881 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:54.881 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.881 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.881 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:54.881 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:54.882 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.0800000000000001e-07 2024-09-12T18:37:54.882 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.882 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.882 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:54.882 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168730+0000", 2024-09-12T18:37:54.882 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6530000000000001e-06 2024-09-12T18:37:54.882 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.882 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.882 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:54.882 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168734+0000", 2024-09-12T18:37:54.882 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.721e-06 2024-09-12T18:37:54.882 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.882 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.883 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:54.883 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168736+0000", 2024-09-12T18:37:54.883 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.508e-06 2024-09-12T18:37:54.883 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.883 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.883 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:54.883 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171951+0000", 2024-09-12T18:37:54.883 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.003215281 2024-09-12T18:37:54.883 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.883 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.883 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:54.883 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234520+0000", 2024-09-12T18:37:54.883 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062568676000000004 2024-09-12T18:37:54.884 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.884 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.884 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:54.884 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234588+0000", 2024-09-12T18:37:54.884 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7806999999999996e-05 2024-09-12T18:37:54.884 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:54.884 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:54.884 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:54.884 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.884 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.884 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167368 5.4 e58/21 5:29a1ec58:::benchmark_data_smithi073_23739_object35091:head v 58'10399, mlcod=58'10396)", 2024-09-12T18:37:54.884 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:54.885 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 51.661283408000003, 2024-09-12T18:37:54.885 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066008885000000003, 2024-09-12T18:37:54.885 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:54.885 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:54.885 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:54.885 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:54.885 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.885 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:54.885 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:54.885 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:54.885 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.885 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.885 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:54.885 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:54.886 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:54.886 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.886 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.886 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:54.886 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:54.886 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4699999999999998e-07 2024-09-12T18:37:54.886 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.886 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.886 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:54.887 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168854+0000", 2024-09-12T18:37:54.887 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.3180000000000001e-06 2024-09-12T18:37:54.887 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.887 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.887 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:54.887 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168858+0000", 2024-09-12T18:37:54.887 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2799999999999997e-06 2024-09-12T18:37:54.887 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.887 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.887 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:54.887 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168861+0000", 2024-09-12T18:37:54.887 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7650000000000002e-06 2024-09-12T18:37:54.887 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.887 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.888 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:54.888 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168895+0000", 2024-09-12T18:37:54.888 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4533999999999998e-05 2024-09-12T18:37:54.888 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.888 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.888 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:54.888 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168906+0000", 2024-09-12T18:37:54.888 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0910000000000001e-05 2024-09-12T18:37:54.888 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.888 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.888 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:54.888 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234784+0000", 2024-09-12T18:37:54.888 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065877656000000007 2024-09-12T18:37:54.889 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.889 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.889 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:54.889 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234860+0000", 2024-09-12T18:37:54.889 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6174999999999995e-05 2024-09-12T18:37:54.889 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:54.889 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:54.889 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:54.889 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.889 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.889 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167358 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:54.889 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.170373+0000", 2024-09-12T18:37:54.889 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 51.659761127000003, 2024-09-12T18:37:54.890 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064370201000000002, 2024-09-12T18:37:54.890 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:54.890 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:54.890 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:54.890 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:54.890 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.890 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:54.890 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170373+0000", 2024-09-12T18:37:54.890 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:54.890 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.890 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.890 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:54.891 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170373+0000", 2024-09-12T18:37:54.891 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:54.891 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.891 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.891 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:54.891 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170374+0000", 2024-09-12T18:37:54.891 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5799999999999998e-07 2024-09-12T18:37:54.891 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.891 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.891 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:54.891 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170378+0000", 2024-09-12T18:37:54.891 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.732e-06 2024-09-12T18:37:54.891 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.892 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.892 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:54.892 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170388+0000", 2024-09-12T18:37:54.892 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0212e-05 2024-09-12T18:37:54.892 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.892 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.892 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:54.892 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170397+0000", 2024-09-12T18:37:54.892 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7090000000000008e-06 2024-09-12T18:37:54.892 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.892 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.892 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:54.893 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234682+0000", 2024-09-12T18:37:54.893 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064285518999999999 2024-09-12T18:37:54.893 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.893 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.893 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:54.893 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234703+0000", 2024-09-12T18:37:54.893 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.0199000000000001e-05 2024-09-12T18:37:54.893 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.893 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.893 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:54.893 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234743+0000", 2024-09-12T18:37:54.893 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0972e-05 2024-09-12T18:37:54.893 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:54.894 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:54.894 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:54.894 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.894 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.894 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167372 5.c 5:398d36a7:::benchmark_data_smithi073_23739_object35095:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:54.894 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171066+0000", 2024-09-12T18:37:54.894 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 51.659067915000001, 2024-09-12T18:37:54.894 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065889534999999999, 2024-09-12T18:37:54.894 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:54.894 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:54.894 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:54.894 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:54.894 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:54.895 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:54.895 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167372 2024-09-12T18:37:54.895 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.895 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:54.895 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.895 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:54.895 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171066+0000", 2024-09-12T18:37:54.895 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:54.895 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.895 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.895 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:54.895 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171066+0000", 2024-09-12T18:37:54.895 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:54.896 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.896 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.896 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:54.896 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171068+0000", 2024-09-12T18:37:54.896 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.186e-06 2024-09-12T18:37:54.896 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.896 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.896 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:54.896 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171072+0000", 2024-09-12T18:37:54.896 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3560000000000003e-06 2024-09-12T18:37:54.896 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.896 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.896 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:54.896 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171082+0000", 2024-09-12T18:37:54.897 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.9739999999999997e-06 2024-09-12T18:37:54.897 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.897 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.897 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:54.897 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171089+0000", 2024-09-12T18:37:54.897 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7159999999999997e-06 2024-09-12T18:37:54.897 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.897 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.897 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:54.897 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171133+0000", 2024-09-12T18:37:54.897 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4091999999999997e-05 2024-09-12T18:37:54.897 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.897 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.898 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:54.898 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171221+0000", 2024-09-12T18:37:54.898 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.8108000000000004e-05 2024-09-12T18:37:54.898 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.898 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.898 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:54.898 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171279+0000", 2024-09-12T18:37:54.898 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8062000000000001e-05 2024-09-12T18:37:54.898 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.898 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.898 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:54.898 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235007+0000", 2024-09-12T18:37:54.898 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.063727849000000003 2024-09-12T18:37:54.898 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.899 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.899 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:54.899 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236790+0000", 2024-09-12T18:37:54.899 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017829269999999999 2024-09-12T18:37:54.899 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.899 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.899 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:54.899 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236881+0000", 2024-09-12T18:37:54.899 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1347999999999993e-05 2024-09-12T18:37:54.899 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.899 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.899 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:54.899 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236956+0000", 2024-09-12T18:37:54.899 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4917000000000001e-05 2024-09-12T18:37:54.900 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:54.900 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:54.900 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:54.900 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.900 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.900 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167371 5.4 e58/21 5:24fea27c:::benchmark_data_smithi073_23739_object35094:head v 58'10400, mlcod=58'10397)", 2024-09-12T18:37:54.900 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171273+0000", 2024-09-12T18:37:54.900 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 51.658861340999998, 2024-09-12T18:37:54.900 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065500368000000003, 2024-09-12T18:37:54.900 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:54.900 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:54.900 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:54.900 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:54.901 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.901 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:54.901 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171273+0000", 2024-09-12T18:37:54.901 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:54.901 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.901 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.901 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:54.901 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171273+0000", 2024-09-12T18:37:54.901 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:54.901 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.901 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.901 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:54.901 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171274+0000", 2024-09-12T18:37:54.902 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0399999999999996e-07 2024-09-12T18:37:54.902 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.902 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.902 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:54.902 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171277+0000", 2024-09-12T18:37:54.902 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8689999999999997e-06 2024-09-12T18:37:54.902 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.902 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.902 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:54.902 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171284+0000", 2024-09-12T18:37:54.902 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2879999999999998e-06 2024-09-12T18:37:54.902 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.902 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.902 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:54.903 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171289+0000", 2024-09-12T18:37:54.903 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9049999999999996e-06 2024-09-12T18:37:54.903 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.903 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.903 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:54.903 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171322+0000", 2024-09-12T18:37:54.903 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3781000000000001e-05 2024-09-12T18:37:54.903 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.903 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.903 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:54.903 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171335+0000", 2024-09-12T18:37:54.903 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2639999999999999e-05 2024-09-12T18:37:54.903 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.904 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.904 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:54.904 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236691+0000", 2024-09-12T18:37:54.904 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065355835000000001 2024-09-12T18:37:54.904 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.904 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.904 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:54.904 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236773+0000", 2024-09-12T18:37:54.904 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2546000000000006e-05 2024-09-12T18:37:54.904 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:54.905 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:54.905 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:54.905 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.905 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.905 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167364 5.7 e58/21 5:ee50096a:::benchmark_data_smithi073_23739_object35087:head v 58'10504, mlcod=58'10502)", 2024-09-12T18:37:54.905 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171598+0000", 2024-09-12T18:37:54.905 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 51.658536222000002, 2024-09-12T18:37:54.905 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065149069000000004, 2024-09-12T18:37:54.905 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:54.905 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:54.905 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:54.905 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:54.905 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.906 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:54.906 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171598+0000", 2024-09-12T18:37:54.906 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:54.906 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.906 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.906 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:54.906 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171598+0000", 2024-09-12T18:37:54.906 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:54.906 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.906 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.906 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:54.906 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171599+0000", 2024-09-12T18:37:54.906 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6700000000000003e-07 2024-09-12T18:37:54.907 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.907 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.907 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:54.907 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171602+0000", 2024-09-12T18:37:54.907 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.841e-06 2024-09-12T18:37:54.907 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.907 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.907 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:54.907 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171608+0000", 2024-09-12T18:37:54.907 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9259999999999997e-06 2024-09-12T18:37:54.907 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.907 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.907 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:54.908 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171611+0000", 2024-09-12T18:37:54.908 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.9450000000000003e-06 2024-09-12T18:37:54.908 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.908 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.908 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:54.908 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171650+0000", 2024-09-12T18:37:54.908 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8464000000000003e-05 2024-09-12T18:37:54.908 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.908 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.909 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:54.909 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171662+0000", 2024-09-12T18:37:54.909 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1603999999999999e-05 2024-09-12T18:37:54.909 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.909 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.909 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:54.909 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236663+0000", 2024-09-12T18:37:54.909 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065001330999999996 2024-09-12T18:37:54.909 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.909 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.910 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:54.910 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236747+0000", 2024-09-12T18:37:54.910 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.4390999999999999e-05 2024-09-12T18:37:54.910 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:54.910 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:54.910 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:54.910 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.910 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.910 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167365 5.2 e58/21 5:4107875c:::benchmark_data_smithi073_23739_object35088:head v 58'10351, mlcod=58'10349)", 2024-09-12T18:37:54.910 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171733+0000", 2024-09-12T18:37:54.911 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 51.658401177000002, 2024-09-12T18:37:54.911 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.074804168000000004, 2024-09-12T18:37:54.911 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:54.911 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:54.911 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:54.911 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:54.911 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.911 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:54.911 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171733+0000", 2024-09-12T18:37:54.911 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:54.911 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.911 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.912 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:54.912 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171733+0000", 2024-09-12T18:37:54.912 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:54.912 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.912 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.912 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:54.912 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171734+0000", 2024-09-12T18:37:54.912 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9299999999999998e-07 2024-09-12T18:37:54.912 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.912 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.912 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:54.912 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171738+0000", 2024-09-12T18:37:54.912 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.301e-06 2024-09-12T18:37:54.913 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.913 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.913 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:54.913 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171746+0000", 2024-09-12T18:37:54.913 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.554e-06 2024-09-12T18:37:54.913 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.913 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.913 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:54.914 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171751+0000", 2024-09-12T18:37:54.914 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1880000000000001e-06 2024-09-12T18:37:54.914 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.914 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.914 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:54.915 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234659+0000", 2024-09-12T18:37:54.915 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062907807999999996 2024-09-12T18:37:54.915 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.915 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.915 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:54.915 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234708+0000", 2024-09-12T18:37:54.915 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8992000000000001e-05 2024-09-12T18:37:54.915 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.915 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.915 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:54.915 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246457+0000", 2024-09-12T18:37:54.915 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.01174974 2024-09-12T18:37:54.915 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.916 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.916 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:54.916 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246537+0000", 2024-09-12T18:37:54.916 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.9992000000000003e-05 2024-09-12T18:37:54.916 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:54.916 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:54.916 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:54.916 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.916 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.916 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167373 5.5 e58/49 5:ad283029:::benchmark_data_smithi073_23739_object35096:head v 58'10600, mlcod=58'10598)", 2024-09-12T18:37:54.916 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:54.916 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 51.658373693000001, 2024-09-12T18:37:54.917 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065058240000000003, 2024-09-12T18:37:54.917 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:54.917 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:54.917 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:54.917 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:54.917 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.917 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:54.917 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:54.917 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:54.917 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.917 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.917 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:54.917 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:54.918 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:54.918 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.918 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.918 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:54.918 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:54.918 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.2899999999999999e-07 2024-09-12T18:37:54.918 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.918 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.918 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:54.918 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171764+0000", 2024-09-12T18:37:54.918 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7310000000000002e-06 2024-09-12T18:37:54.918 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.918 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.919 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:54.919 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171769+0000", 2024-09-12T18:37:54.919 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.079e-06 2024-09-12T18:37:54.919 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.919 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.919 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:54.919 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171774+0000", 2024-09-12T18:37:54.919 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.48e-06 2024-09-12T18:37:54.919 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.919 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.919 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:54.919 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171819+0000", 2024-09-12T18:37:54.919 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4391999999999998e-05 2024-09-12T18:37:54.920 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.920 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.920 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:54.920 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171841+0000", 2024-09-12T18:37:54.920 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2245000000000001e-05 2024-09-12T18:37:54.920 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.920 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.920 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:54.920 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236750+0000", 2024-09-12T18:37:54.920 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064909123999999999 2024-09-12T18:37:54.920 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.920 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.920 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:54.921 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236819+0000", 2024-09-12T18:37:54.921 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8860000000000001e-05 2024-09-12T18:37:54.921 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:54.921 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:54.921 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:54.921 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.921 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.921 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167361 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:54.921 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:54.921 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 51.658317787000001, 2024-09-12T18:37:54.921 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.063049426000000006, 2024-09-12T18:37:54.922 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:54.922 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:54.922 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:54.922 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:54.922 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.922 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:54.922 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:54.922 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:54.922 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.922 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.922 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:54.922 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:54.922 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:54.923 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.923 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.923 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:54.923 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:54.923 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.9099999999999999e-07 2024-09-12T18:37:54.923 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.923 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.923 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:54.923 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171820+0000", 2024-09-12T18:37:54.923 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.5900000000000002e-06 2024-09-12T18:37:54.923 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.923 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.923 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:54.923 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171826+0000", 2024-09-12T18:37:54.924 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.64e-06 2024-09-12T18:37:54.924 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.924 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.924 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:54.924 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171831+0000", 2024-09-12T18:37:54.924 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.578e-06 2024-09-12T18:37:54.924 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.924 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.924 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:54.924 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234808+0000", 2024-09-12T18:37:54.924 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062976780999999996 2024-09-12T18:37:54.924 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.925 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.925 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:54.925 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234821+0000", 2024-09-12T18:37:54.925 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3002e-05 2024-09-12T18:37:54.925 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.925 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.925 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:54.925 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234866+0000", 2024-09-12T18:37:54.925 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5444000000000001e-05 2024-09-12T18:37:54.925 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:54.925 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:54.925 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:54.925 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.926 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.926 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167366 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:54.926 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.172133+0000", 2024-09-12T18:37:54.926 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 51.658000958999999, 2024-09-12T18:37:54.926 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062815840999999997, 2024-09-12T18:37:54.926 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:54.926 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:54.926 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:54.926 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:54.926 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.926 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:54.926 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172133+0000", 2024-09-12T18:37:54.926 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:54.927 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.927 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.927 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:54.927 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172133+0000", 2024-09-12T18:37:54.927 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:54.927 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.927 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.927 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:54.927 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172134+0000", 2024-09-12T18:37:54.927 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5000000000000003e-07 2024-09-12T18:37:54.927 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.927 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.927 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:54.928 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172137+0000", 2024-09-12T18:37:54.928 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.6460000000000002e-06 2024-09-12T18:37:54.928 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.928 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.928 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:54.928 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234511+0000", 2024-09-12T18:37:54.928 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062374603000000001 2024-09-12T18:37:54.928 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.928 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.929 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:54.929 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234525+0000", 2024-09-12T18:37:54.929 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3396e-05 2024-09-12T18:37:54.929 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.929 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.929 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:54.929 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234909+0000", 2024-09-12T18:37:54.929 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00038405299999999998 2024-09-12T18:37:54.929 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.929 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.929 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:54.929 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234922+0000", 2024-09-12T18:37:54.929 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3274e-05 2024-09-12T18:37:54.929 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.930 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.930 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:54.930 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234949+0000", 2024-09-12T18:37:54.930 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7319000000000001e-05 2024-09-12T18:37:54.930 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:54.930 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:54.930 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:54.930 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.930 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.930 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167369 5.7 e58/21 5:e64ecabd:::benchmark_data_smithi073_23739_object35092:head v 58'10505, mlcod=58'10502)", 2024-09-12T18:37:54.930 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:54.930 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 51.656470567, 2024-09-12T18:37:54.930 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.063873773999999994, 2024-09-12T18:37:54.931 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:54.931 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:54.931 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:54.931 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:54.931 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.931 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:54.931 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:54.931 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:54.931 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.932 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.932 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:54.932 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:54.932 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:54.932 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.932 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.932 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:54.932 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:54.932 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3500000000000002e-07 2024-09-12T18:37:54.932 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.932 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.932 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:54.932 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173668+0000", 2024-09-12T18:37:54.933 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4000000000000001e-06 2024-09-12T18:37:54.933 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.933 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.933 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:54.933 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234583+0000", 2024-09-12T18:37:54.933 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.060914889 2024-09-12T18:37:54.933 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.933 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.933 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:54.933 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234600+0000", 2024-09-12T18:37:54.933 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7192000000000001e-05 2024-09-12T18:37:54.933 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.933 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.933 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:54.934 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234791+0000", 2024-09-12T18:37:54.934 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00019115000000000001 2024-09-12T18:37:54.934 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.934 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.934 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:54.934 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234834+0000", 2024-09-12T18:37:54.934 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3296e-05 2024-09-12T18:37:54.934 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.934 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.934 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:54.934 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.237481+0000", 2024-09-12T18:37:54.934 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0026472050000000001 2024-09-12T18:37:54.934 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.935 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.935 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:54.935 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.237538+0000", 2024-09-12T18:37:54.935 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6206999999999999e-05 2024-09-12T18:37:54.935 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:54.935 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:54.935 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:54.935 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.935 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.935 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:238478 5.c 5:38260ae8:::benchmark_data_smithi073_23739_object106201:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:54.935 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:38.617167+0000", 2024-09-12T18:37:54.935 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 16.212967149000001, 2024-09-12T18:37:54.935 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062584934999999994, 2024-09-12T18:37:54.936 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:54.936 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:54.936 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:54.936 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:54.936 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:54.936 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:54.936 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 238478 2024-09-12T18:37:54.936 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.936 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:54.936 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.936 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:54.936 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.617167+0000", 2024-09-12T18:37:54.936 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:54.937 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.937 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.937 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:54.937 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.617167+0000", 2024-09-12T18:37:54.937 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:54.937 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.937 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.937 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:54.937 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.617168+0000", 2024-09-12T18:37:54.937 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.091e-06 2024-09-12T18:37:54.937 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.937 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.937 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:54.938 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.617173+0000", 2024-09-12T18:37:54.938 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2490000000000003e-06 2024-09-12T18:37:54.938 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.938 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.938 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:54.938 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.617182+0000", 2024-09-12T18:37:54.938 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.6390000000000004e-06 2024-09-12T18:37:54.938 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.938 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.938 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:54.938 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.617189+0000", 2024-09-12T18:37:54.938 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0119999999999999e-06 2024-09-12T18:37:54.938 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.938 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.939 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:54.939 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.617678+0000", 2024-09-12T18:37:54.939 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00048910800000000003 2024-09-12T18:37:54.939 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.939 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.939 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:54.939 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.665641+0000", 2024-09-12T18:37:54.939 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.047962481000000001 2024-09-12T18:37:54.939 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.939 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.939 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:54.939 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.665895+0000", 2024-09-12T18:37:54.940 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00025440199999999998 2024-09-12T18:37:54.940 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.940 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.940 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:54.940 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.670817+0000", 2024-09-12T18:37:54.940 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0049221120000000002 2024-09-12T18:37:54.940 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.940 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.940 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:54.940 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.679695+0000", 2024-09-12T18:37:54.940 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0088778269999999996 2024-09-12T18:37:54.940 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.940 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.940 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:54.941 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.679726+0000", 2024-09-12T18:37:54.941 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.0830999999999997e-05 2024-09-12T18:37:54.941 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.941 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.941 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:54.941 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.679752+0000", 2024-09-12T18:37:54.941 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.6183e-05 2024-09-12T18:37:54.941 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:54.941 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:54.941 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:54.941 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.941 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.941 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:238480 5.c 5:3d043cef:::benchmark_data_smithi073_23739_object106203:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:54.942 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:38.618189+0000", 2024-09-12T18:37:54.942 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 16.211945343, 2024-09-12T18:37:54.942 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.061642400999999999, 2024-09-12T18:37:54.942 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:54.942 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:54.942 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:54.942 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:54.942 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:54.942 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:54.942 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 238480 2024-09-12T18:37:54.942 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.942 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:54.942 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.942 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:54.943 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.618189+0000", 2024-09-12T18:37:54.943 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:54.943 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.943 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.943 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:54.943 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.618189+0000", 2024-09-12T18:37:54.943 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:54.943 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.943 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.943 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:54.943 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.618190+0000", 2024-09-12T18:37:54.943 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3e-07 2024-09-12T18:37:54.944 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.944 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.944 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:54.944 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.618193+0000", 2024-09-12T18:37:54.944 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.6349999999999999e-06 2024-09-12T18:37:54.944 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.944 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.944 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:54.944 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.665526+0000", 2024-09-12T18:37:54.944 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.047332200999999997 2024-09-12T18:37:54.945 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.945 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.945 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:54.945 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.665561+0000", 2024-09-12T18:37:54.945 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.5858999999999997e-05 2024-09-12T18:37:54.945 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.945 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.945 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:54.945 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.670869+0000", 2024-09-12T18:37:54.945 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0053076720000000003 2024-09-12T18:37:54.945 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.945 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.946 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:54.946 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.671094+0000", 2024-09-12T18:37:54.946 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000225009 2024-09-12T18:37:54.946 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.946 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.946 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:54.946 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.671272+0000", 2024-09-12T18:37:54.946 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000177725 2024-09-12T18:37:54.946 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.946 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.946 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:54.946 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.679687+0000", 2024-09-12T18:37:54.946 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0084148379999999991 2024-09-12T18:37:54.947 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.947 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.947 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:54.947 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.679787+0000", 2024-09-12T18:37:54.947 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.9950000000000004e-05 2024-09-12T18:37:54.947 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.947 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.947 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:54.947 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.679811+0000", 2024-09-12T18:37:54.947 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4088999999999999e-05 2024-09-12T18:37:54.947 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:54.947 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:54.947 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:54.948 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.679831+0000", 2024-09-12T18:37:54.948 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.0693e-05 2024-09-12T18:37:54.948 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:54.948 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:54.948 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:54.948 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:54.948 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:54.948 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:54.950 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:37:54.950 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:54.941+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:55.047 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:37:55.048 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:37:55.048 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '1000', 'type': 'reweight-by-utilization'} 2024-09-12T18:37:55.048 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 1.0 2024-09-12T18:37:55.050 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:55.043+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:55.083 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:55.083 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-09-12T18:37:55.083 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-09-12T18:37:55.084 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:55.097 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:37:55.152 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:55.149+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:55.252 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:55.247+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:55.264 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:55.264 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-09-12T18:37:55.265 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-09-12T18:37:55.265 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-09-12T18:37:55.265 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:55.278 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:37:55.370 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:55.367+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:55.372 INFO:teuthology.orchestra.run.smithi073.stdout:moved 0 / 242 (0%) 2024-09-12T18:37:55.372 INFO:teuthology.orchestra.run.smithi073.stdout:avg 80.6667 2024-09-12T18:37:55.372 INFO:teuthology.orchestra.run.smithi073.stdout:stddev 21.8225 -> 21.8225 (expected baseline 7.33333) 2024-09-12T18:37:55.372 INFO:teuthology.orchestra.run.smithi073.stdout:min osd.0 with 50 -> 50 pgs (0.619835 -> 0.619835 * mean) 2024-09-12T18:37:55.372 INFO:teuthology.orchestra.run.smithi073.stdout:max osd.2 with 99 -> 99 pgs (1.22727 -> 1.22727 * mean) 2024-09-12T18:37:55.373 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:37:55.373 INFO:teuthology.orchestra.run.smithi073.stdout:oload 1000 2024-09-12T18:37:55.373 INFO:teuthology.orchestra.run.smithi073.stdout:max_change 1 2024-09-12T18:37:55.373 INFO:teuthology.orchestra.run.smithi073.stdout:max_change_osds 4 2024-09-12T18:37:55.373 INFO:teuthology.orchestra.run.smithi073.stdout:average_utilization 0.0030 2024-09-12T18:37:55.373 INFO:teuthology.orchestra.run.smithi073.stdout:overload_utilization 0.0298 2024-09-12T18:37:55.373 INFO:teuthology.orchestra.run.smithi073.stderr:no change 2024-09-12T18:37:55.391 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-09-12T18:37:55.391 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 3.0 2024-09-12T18:37:55.448 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:55.449 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-09-12T18:37:55.449 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-09-12T18:37:55.449 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:37:55.449 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.449 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121096 5.8 5:13503891:::benchmark_data_smithi073_23739_object121095:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:55.449 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:37:55.449 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 75.263689319999997, 2024-09-12T18:37:55.450 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064025391000000001, 2024-09-12T18:37:55.450 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:55.450 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:55.450 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:55.450 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:55.450 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:55.450 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:55.450 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121096 2024-09-12T18:37:55.451 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.451 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:55.451 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.451 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:55.451 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:37:55.451 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:55.451 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.452 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.452 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:55.452 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:37:55.452 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:55.453 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.453 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.453 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:55.453 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178579+0000", 2024-09-12T18:37:55.453 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7369999999999998e-06 2024-09-12T18:37:55.453 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.454 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.454 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:55.454 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178846+0000", 2024-09-12T18:37:55.454 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026752699999999999 2024-09-12T18:37:55.454 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.454 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.455 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:55.455 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178877+0000", 2024-09-12T18:37:55.455 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1081999999999998e-05 2024-09-12T18:37:55.455 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.455 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.455 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:55.456 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178896+0000", 2024-09-12T18:37:55.456 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8522e-05 2024-09-12T18:37:55.456 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.456 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.456 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:55.456 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.192591+0000", 2024-09-12T18:37:55.457 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013695067 2024-09-12T18:37:55.457 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.457 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.457 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:55.457 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.192944+0000", 2024-09-12T18:37:55.457 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00035273699999999999 2024-09-12T18:37:55.458 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.458 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.458 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:55.458 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.193732+0000", 2024-09-12T18:37:55.458 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078849599999999997 2024-09-12T18:37:55.458 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.459 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.459 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:55.459 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.213583+0000", 2024-09-12T18:37:55.459 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.019851164000000001 2024-09-12T18:37:55.459 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.459 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.460 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:55.460 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242386+0000", 2024-09-12T18:37:55.460 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028802924000000001 2024-09-12T18:37:55.460 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.460 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.460 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:55.461 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242501+0000", 2024-09-12T18:37:55.461 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000114932 2024-09-12T18:37:55.461 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.461 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.461 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:55.461 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242602+0000", 2024-09-12T18:37:55.462 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000100203 2024-09-12T18:37:55.462 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:55.462 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:55.462 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:55.462 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.463 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.463 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121097 5.8 5:1b31a99e:::benchmark_data_smithi073_23739_object121096:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:55.463 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:37:55.464 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 75.247961029999999, 2024-09-12T18:37:55.464 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048475917, 2024-09-12T18:37:55.464 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:55.464 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:55.464 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:55.464 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:55.465 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:55.465 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:55.465 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121097 2024-09-12T18:37:55.465 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.465 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:55.465 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.465 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:55.466 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:37:55.466 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:55.466 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.466 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.466 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:55.467 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:37:55.467 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:55.467 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.467 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.467 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:55.467 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194308+0000", 2024-09-12T18:37:55.468 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2789999999999999e-06 2024-09-12T18:37:55.468 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.468 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.468 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:55.468 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194396+0000", 2024-09-12T18:37:55.468 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8324000000000003e-05 2024-09-12T18:37:55.469 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.469 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.469 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:55.469 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194424+0000", 2024-09-12T18:37:55.469 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7565000000000001e-05 2024-09-12T18:37:55.469 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.470 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.470 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:55.470 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194444+0000", 2024-09-12T18:37:55.470 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0363000000000001e-05 2024-09-12T18:37:55.470 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.470 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.471 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:55.471 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.206888+0000", 2024-09-12T18:37:55.471 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012443997 2024-09-12T18:37:55.471 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.471 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.471 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:55.472 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.207138+0000", 2024-09-12T18:37:55.472 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025035900000000002 2024-09-12T18:37:55.472 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.472 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.472 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:55.472 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.207365+0000", 2024-09-12T18:37:55.473 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000226407 2024-09-12T18:37:55.473 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.473 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.473 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:55.473 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.215059+0000", 2024-09-12T18:37:55.473 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076946860000000001 2024-09-12T18:37:55.474 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.474 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.474 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:55.474 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242619+0000", 2024-09-12T18:37:55.474 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.027559975 2024-09-12T18:37:55.474 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.475 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.475 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:55.475 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242706+0000", 2024-09-12T18:37:55.475 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6384999999999994e-05 2024-09-12T18:37:55.475 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.476 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.476 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:55.476 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242780+0000", 2024-09-12T18:37:55.476 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4577000000000001e-05 2024-09-12T18:37:55.476 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:55.476 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:55.476 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:55.477 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.477 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.477 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121106 5.d 5:b4a9a221:::benchmark_data_smithi073_23739_object121105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:55.477 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:37:55.477 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 75.205086093999995, 2024-09-12T18:37:55.477 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.034882274999999997, 2024-09-12T18:37:55.477 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:55.478 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:55.478 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:55.478 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:55.478 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:55.478 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:55.478 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121106 2024-09-12T18:37:55.478 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.479 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:55.479 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.479 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:55.479 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:37:55.479 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:55.479 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.479 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.479 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:55.479 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:37:55.479 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:55.479 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.480 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.480 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:55.480 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237182+0000", 2024-09-12T18:37:55.480 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6019999999999998e-06 2024-09-12T18:37:55.480 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.480 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.480 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:55.480 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237257+0000", 2024-09-12T18:37:55.480 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5420999999999995e-05 2024-09-12T18:37:55.480 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.480 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.481 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:55.481 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237305+0000", 2024-09-12T18:37:55.481 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7207999999999999e-05 2024-09-12T18:37:55.481 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.481 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.481 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:55.481 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237325+0000", 2024-09-12T18:37:55.481 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0001e-05 2024-09-12T18:37:55.481 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.481 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.481 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:55.481 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237505+0000", 2024-09-12T18:37:55.481 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000180798 2024-09-12T18:37:55.482 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.482 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.482 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:55.482 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237764+0000", 2024-09-12T18:37:55.482 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025862299999999998 2024-09-12T18:37:55.482 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.482 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.482 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:55.482 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.238264+0000", 2024-09-12T18:37:55.482 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00050016100000000005 2024-09-12T18:37:55.482 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.482 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.482 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:55.482 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256525+0000", 2024-09-12T18:37:55.483 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018260508000000002 2024-09-12T18:37:55.483 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.483 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.483 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:55.483 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.271903+0000", 2024-09-12T18:37:55.483 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015378739000000001 2024-09-12T18:37:55.483 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.483 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.483 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:55.483 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.271999+0000", 2024-09-12T18:37:55.483 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5989000000000005e-05 2024-09-12T18:37:55.483 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.483 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.483 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:55.484 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272062+0000", 2024-09-12T18:37:55.484 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2224999999999995e-05 2024-09-12T18:37:55.484 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:55.484 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:55.484 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:55.484 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.484 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.484 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:167368 5.4 5:29a1ec58:::benchmark_data_smithi073_23739_object35091:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:55.484 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:03.168773+0000", 2024-09-12T18:37:55.484 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 52.273492226999998, 2024-09-12T18:37:55.484 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.066578597000000003, 2024-09-12T18:37:55.485 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:55.485 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:55.485 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:55.485 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:55.485 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:55.485 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:55.485 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 167368 2024-09-12T18:37:55.485 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.485 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:55.485 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.486 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:55.486 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168773+0000", 2024-09-12T18:37:55.486 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:55.486 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.486 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.486 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:55.486 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168773+0000", 2024-09-12T18:37:55.486 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:55.486 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.486 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.486 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:55.487 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168774+0000", 2024-09-12T18:37:55.487 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.023e-06 2024-09-12T18:37:55.487 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.487 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.487 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:55.487 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168779+0000", 2024-09-12T18:37:55.487 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5800000000000002e-06 2024-09-12T18:37:55.487 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.487 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.487 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:55.487 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168789+0000", 2024-09-12T18:37:55.488 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0346999999999999e-05 2024-09-12T18:37:55.488 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.488 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.488 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:55.488 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168808+0000", 2024-09-12T18:37:55.488 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8423e-05 2024-09-12T18:37:55.488 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.489 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.489 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:55.489 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168864+0000", 2024-09-12T18:37:55.489 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-09-12T18:37:55.489 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.489 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.489 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:55.489 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168947+0000", 2024-09-12T18:37:55.489 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3274000000000003e-05 2024-09-12T18:37:55.489 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.489 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.489 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:55.489 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.169014+0000", 2024-09-12T18:37:55.490 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6284000000000004e-05 2024-09-12T18:37:55.490 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.490 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.490 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:55.490 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.170653+0000", 2024-09-12T18:37:55.490 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016389779999999999 2024-09-12T18:37:55.490 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.490 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.490 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:55.490 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.235279+0000", 2024-09-12T18:37:55.490 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064626464999999994 2024-09-12T18:37:55.490 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.490 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.490 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:55.491 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.235320+0000", 2024-09-12T18:37:55.491 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0377000000000003e-05 2024-09-12T18:37:55.491 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.491 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.491 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:55.491 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.235352+0000", 2024-09-12T18:37:55.491 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2322e-05 2024-09-12T18:37:55.491 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:55.491 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:55.491 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:55.491 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.491 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.491 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:167371 5.4 5:24fea27c:::benchmark_data_smithi073_23739_object35094:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:55.492 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:03.171234+0000", 2024-09-12T18:37:55.492 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 52.271031202000003, 2024-09-12T18:37:55.492 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.066048171000000003, 2024-09-12T18:37:55.492 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:55.492 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:55.492 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:55.492 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:55.492 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:55.492 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:55.492 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 167371 2024-09-12T18:37:55.492 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.492 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:55.492 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.493 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:55.493 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171234+0000", 2024-09-12T18:37:55.493 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:55.493 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.493 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.493 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:55.493 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171234+0000", 2024-09-12T18:37:55.493 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:55.493 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.493 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.493 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:55.494 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171235+0000", 2024-09-12T18:37:55.494 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8599999999999997e-07 2024-09-12T18:37:55.494 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.494 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.494 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:55.494 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171238+0000", 2024-09-12T18:37:55.494 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9739999999999998e-06 2024-09-12T18:37:55.494 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.495 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.495 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:55.495 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171245+0000", 2024-09-12T18:37:55.495 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6000000000000003e-06 2024-09-12T18:37:55.495 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.495 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.495 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:55.495 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171249+0000", 2024-09-12T18:37:55.495 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9960000000000004e-06 2024-09-12T18:37:55.496 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.496 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.496 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:55.496 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171288+0000", 2024-09-12T18:37:55.496 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9119999999999998e-05 2024-09-12T18:37:55.497 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.497 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.497 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:55.497 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171359+0000", 2024-09-12T18:37:55.497 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0951000000000006e-05 2024-09-12T18:37:55.497 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.497 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.497 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:55.497 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171425+0000", 2024-09-12T18:37:55.498 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.58e-05 2024-09-12T18:37:55.498 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.498 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.498 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:55.498 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.173093+0000", 2024-09-12T18:37:55.498 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016683939999999999 2024-09-12T18:37:55.498 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.498 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.498 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:55.499 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.237202+0000", 2024-09-12T18:37:55.499 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064109437000000005 2024-09-12T18:37:55.499 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.499 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.499 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:55.499 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.237249+0000", 2024-09-12T18:37:55.499 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6751e-05 2024-09-12T18:37:55.499 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.500 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.500 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:55.500 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.237282+0000", 2024-09-12T18:37:55.500 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3262000000000001e-05 2024-09-12T18:37:55.500 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:55.500 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:55.500 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:55.500 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.500 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.501 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:201498 5.a e67/21 5:5815d848:::benchmark_data_smithi073_23739_object69221:head v 67'12793, mlcod=67'12791)", 2024-09-12T18:37:55.501 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.430872+0000", 2024-09-12T18:37:55.501 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 35.011393224000003, 2024-09-12T18:37:55.501 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.038775280000000002, 2024-09-12T18:37:55.501 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:55.501 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:55.501 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:55.501 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:55.502 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.502 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:55.502 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430872+0000", 2024-09-12T18:37:55.502 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:55.502 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.502 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.502 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:55.502 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430872+0000", 2024-09-12T18:37:55.503 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:55.503 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.503 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.503 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:55.503 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430873+0000", 2024-09-12T18:37:55.503 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6600000000000003e-07 2024-09-12T18:37:55.503 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.503 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.503 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:55.504 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430875+0000", 2024-09-12T18:37:55.504 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5399999999999998e-06 2024-09-12T18:37:55.504 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.504 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.504 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:55.504 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430879+0000", 2024-09-12T18:37:55.504 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7239999999999998e-06 2024-09-12T18:37:55.504 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.505 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.505 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:55.505 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430882+0000", 2024-09-12T18:37:55.505 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8679999999999999e-06 2024-09-12T18:37:55.505 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.505 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.505 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:55.505 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430909+0000", 2024-09-12T18:37:55.506 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7832999999999999e-05 2024-09-12T18:37:55.506 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.506 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.506 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:55.506 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430922+0000", 2024-09-12T18:37:55.506 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2164000000000001e-05 2024-09-12T18:37:55.506 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.506 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.507 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:55.507 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469578+0000", 2024-09-12T18:37:55.507 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.038656469999999998 2024-09-12T18:37:55.507 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.507 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.507 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:55.507 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469648+0000", 2024-09-12T18:37:55.507 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9414999999999999e-05 2024-09-12T18:37:55.508 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:55.508 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:55.508 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:55.508 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.508 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.508 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201513 5.e 5:7be2f597:::benchmark_data_smithi073_23739_object69236:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:55.508 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.435121+0000", 2024-09-12T18:37:55.508 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 35.007144470999997, 2024-09-12T18:37:55.508 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.034945021999999999, 2024-09-12T18:37:55.509 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:55.509 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:55.509 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:55.509 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:55.509 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:55.509 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:55.509 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201513 2024-09-12T18:37:55.509 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.510 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:55.510 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.510 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:55.510 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.435121+0000", 2024-09-12T18:37:55.510 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:55.510 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.510 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.510 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:55.510 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.435121+0000", 2024-09-12T18:37:55.511 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:55.511 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.511 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.511 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:55.511 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.435122+0000", 2024-09-12T18:37:55.511 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2440000000000001e-06 2024-09-12T18:37:55.511 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.511 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.511 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:55.512 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.435126+0000", 2024-09-12T18:37:55.512 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1559999999999997e-06 2024-09-12T18:37:55.512 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.512 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.512 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:55.512 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445086+0000", 2024-09-12T18:37:55.512 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0099592389999999999 2024-09-12T18:37:55.512 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.512 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.512 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:55.512 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445095+0000", 2024-09-12T18:37:55.512 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2620000000000004e-06 2024-09-12T18:37:55.513 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.513 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.513 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:55.513 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445165+0000", 2024-09-12T18:37:55.513 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0257000000000002e-05 2024-09-12T18:37:55.513 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.513 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.514 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:55.514 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445311+0000", 2024-09-12T18:37:55.514 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014603899999999999 2024-09-12T18:37:55.514 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.514 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.514 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:55.514 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445445+0000", 2024-09-12T18:37:55.514 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000133654 2024-09-12T18:37:55.514 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.514 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.514 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:55.514 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469853+0000", 2024-09-12T18:37:55.515 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024407893999999999 2024-09-12T18:37:55.515 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.515 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.515 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:55.515 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469873+0000", 2024-09-12T18:37:55.515 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0622e-05 2024-09-12T18:37:55.515 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.515 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.515 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:55.515 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469949+0000", 2024-09-12T18:37:55.515 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5918000000000001e-05 2024-09-12T18:37:55.515 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.515 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.516 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:55.516 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470066+0000", 2024-09-12T18:37:55.516 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000116737 2024-09-12T18:37:55.516 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:55.516 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:55.516 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:55.516 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.516 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.516 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201521 5.d 5:b911ab6f:::benchmark_data_smithi073_23739_object69244:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:55.516 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445173+0000", 2024-09-12T18:37:55.516 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 34.997092027999997, 2024-09-12T18:37:55.517 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.031483274999999998, 2024-09-12T18:37:55.517 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:55.517 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:55.517 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:55.517 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:55.517 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:55.517 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:55.517 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201521 2024-09-12T18:37:55.517 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.517 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:55.517 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.517 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:55.517 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445173+0000", 2024-09-12T18:37:55.518 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:55.518 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.518 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.518 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:55.518 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445173+0000", 2024-09-12T18:37:55.518 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:55.518 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.518 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.518 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:55.518 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445174+0000", 2024-09-12T18:37:55.518 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4299999999999998e-07 2024-09-12T18:37:55.518 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.518 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.518 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:55.519 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445176+0000", 2024-09-12T18:37:55.519 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.469e-06 2024-09-12T18:37:55.519 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.519 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.519 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:55.519 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445183+0000", 2024-09-12T18:37:55.519 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8719999999999996e-06 2024-09-12T18:37:55.519 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.519 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.519 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:55.519 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445188+0000", 2024-09-12T18:37:55.519 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7079999999999996e-06 2024-09-12T18:37:55.519 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.519 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.520 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:55.520 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445314+0000", 2024-09-12T18:37:55.520 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012627800000000001 2024-09-12T18:37:55.520 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.520 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.520 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:55.520 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445436+0000", 2024-09-12T18:37:55.520 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000122007 2024-09-12T18:37:55.520 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.520 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.520 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:55.520 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445541+0000", 2024-09-12T18:37:55.520 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000105068 2024-09-12T18:37:55.520 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.521 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.521 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:55.521 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470655+0000", 2024-09-12T18:37:55.521 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025114035 2024-09-12T18:37:55.521 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.521 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.521 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:55.521 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476570+0000", 2024-09-12T18:37:55.521 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0059143269999999996 2024-09-12T18:37:55.521 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.521 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.521 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:55.521 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476624+0000", 2024-09-12T18:37:55.522 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4261000000000001e-05 2024-09-12T18:37:55.522 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.522 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.522 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:55.522 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476657+0000", 2024-09-12T18:37:55.522 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2806999999999999e-05 2024-09-12T18:37:55.522 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:55.522 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:55.522 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:55.522 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.522 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.522 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201524 5.d 5:b330b18b:::benchmark_data_smithi073_23739_object69247:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:55.522 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445202+0000", 2024-09-12T18:37:55.523 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 34.997063767999997, 2024-09-12T18:37:55.523 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.034036482, 2024-09-12T18:37:55.523 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:55.523 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:55.523 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:55.523 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:55.523 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:55.523 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:55.523 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201524 2024-09-12T18:37:55.523 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.523 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:55.523 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.523 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:55.523 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445202+0000", 2024-09-12T18:37:55.524 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:55.524 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.524 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.524 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:55.524 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445202+0000", 2024-09-12T18:37:55.524 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:55.524 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.524 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.524 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:55.524 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445202+0000", 2024-09-12T18:37:55.524 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2e-07 2024-09-12T18:37:55.524 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.524 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.524 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:55.525 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445204+0000", 2024-09-12T18:37:55.525 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0490000000000002e-06 2024-09-12T18:37:55.525 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.525 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.525 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:55.525 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445210+0000", 2024-09-12T18:37:55.526 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.959e-06 2024-09-12T18:37:55.526 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.526 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.526 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:55.526 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445215+0000", 2024-09-12T18:37:55.526 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.668e-06 2024-09-12T18:37:55.526 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.526 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.526 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:55.526 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470703+0000", 2024-09-12T18:37:55.527 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025488182000000002 2024-09-12T18:37:55.527 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.527 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.527 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:55.527 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470911+0000", 2024-09-12T18:37:55.527 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020755400000000001 2024-09-12T18:37:55.527 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.527 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.527 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:55.527 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.471309+0000", 2024-09-12T18:37:55.527 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00039868199999999998 2024-09-12T18:37:55.527 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.527 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.528 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:55.528 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476724+0000", 2024-09-12T18:37:55.528 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054150589999999998 2024-09-12T18:37:55.528 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.528 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.528 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:55.528 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.479050+0000", 2024-09-12T18:37:55.528 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0023259309999999998 2024-09-12T18:37:55.528 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.528 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.528 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:55.528 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.479164+0000", 2024-09-12T18:37:55.528 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000114127 2024-09-12T18:37:55.529 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.529 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.529 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:55.529 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.479238+0000", 2024-09-12T18:37:55.529 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3751000000000006e-05 2024-09-12T18:37:55.529 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:55.529 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:55.529 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:55.529 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.529 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.529 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_backfill(progress 5.5 e 67/67 lb 5:a30f9be2:::benchmark_data_smithi073_23739_object118666:head)", 2024-09-12T18:37:55.529 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445433+0000", 2024-09-12T18:37:55.530 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 34.996832882, 2024-09-12T18:37:55.530 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.029511351000000002, 2024-09-12T18:37:55.530 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:55.530 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:55.530 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:37:55.530 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:55.530 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.530 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:55.530 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445433+0000", 2024-09-12T18:37:55.530 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:55.530 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.530 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.530 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:55.531 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445433+0000", 2024-09-12T18:37:55.531 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:55.531 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.531 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.531 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:55.531 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445433+0000", 2024-09-12T18:37:55.531 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0699999999999998e-07 2024-09-12T18:37:55.531 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.531 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.531 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:55.531 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445440+0000", 2024-09-12T18:37:55.531 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6630000000000004e-06 2024-09-12T18:37:55.532 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.532 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.532 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:55.532 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445447+0000", 2024-09-12T18:37:55.532 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5159999999999997e-06 2024-09-12T18:37:55.532 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.532 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.532 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:55.533 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445454+0000", 2024-09-12T18:37:55.533 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.267e-06 2024-09-12T18:37:55.534 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.534 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.534 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:55.534 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.474780+0000", 2024-09-12T18:37:55.534 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.029325496999999999 2024-09-12T18:37:55.534 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.534 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.534 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:55.535 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.474802+0000", 2024-09-12T18:37:55.535 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2348999999999999e-05 2024-09-12T18:37:55.535 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.535 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.535 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:55.535 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.474944+0000", 2024-09-12T18:37:55.535 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014165200000000001 2024-09-12T18:37:55.535 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:55.535 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:55.535 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:55.535 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.536 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.536 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:201515 5.5 e67/49 5:a25bd8bb:::benchmark_data_smithi073_23739_object69238:head v 67'12752, mlcod=67'12750)", 2024-09-12T18:37:55.536 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445471+0000", 2024-09-12T18:37:55.536 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 34.996794967, 2024-09-12T18:37:55.536 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.031081396000000001, 2024-09-12T18:37:55.536 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:55.536 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:55.536 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:55.536 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:55.536 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.536 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:55.537 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445471+0000", 2024-09-12T18:37:55.537 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:55.537 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.537 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.537 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:55.537 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445471+0000", 2024-09-12T18:37:55.537 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:55.537 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.537 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.537 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:55.537 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445471+0000", 2024-09-12T18:37:55.538 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5400000000000002e-07 2024-09-12T18:37:55.538 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.538 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.538 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:55.538 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445475+0000", 2024-09-12T18:37:55.538 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2379999999999999e-06 2024-09-12T18:37:55.538 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.538 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.538 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:55.538 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445481+0000", 2024-09-12T18:37:55.538 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0229999999999998e-06 2024-09-12T18:37:55.539 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.539 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.539 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:55.539 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445486+0000", 2024-09-12T18:37:55.539 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5040000000000004e-06 2024-09-12T18:37:55.539 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.539 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.539 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:55.539 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445970+0000", 2024-09-12T18:37:55.539 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048416699999999997 2024-09-12T18:37:55.540 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.540 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.540 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:55.540 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445991+0000", 2024-09-12T18:37:55.540 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1067999999999999e-05 2024-09-12T18:37:55.540 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.540 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.540 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:55.540 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476511+0000", 2024-09-12T18:37:55.540 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.030520629000000001 2024-09-12T18:37:55.541 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.541 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.541 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:55.541 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476552+0000", 2024-09-12T18:37:55.541 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0413000000000001e-05 2024-09-12T18:37:55.541 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:55.541 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:55.541 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:55.541 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.541 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.541 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:201526 5.5 e67/49 5:a3549698:::benchmark_data_smithi073_23739_object69249:head v 67'12753, mlcod=67'12750)", 2024-09-12T18:37:55.542 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445957+0000", 2024-09-12T18:37:55.542 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 34.996308034999998, 2024-09-12T18:37:55.542 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.030732494999999999, 2024-09-12T18:37:55.542 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:55.542 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:55.542 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:55.542 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:55.542 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.542 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:55.542 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445957+0000", 2024-09-12T18:37:55.543 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:55.543 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.543 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.543 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:55.543 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445957+0000", 2024-09-12T18:37:55.543 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:55.543 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.543 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.543 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:55.543 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445958+0000", 2024-09-12T18:37:55.543 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7800000000000001e-07 2024-09-12T18:37:55.543 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.544 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.544 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:55.544 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445963+0000", 2024-09-12T18:37:55.544 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5419999999999999e-06 2024-09-12T18:37:55.544 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.544 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.544 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:55.544 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445972+0000", 2024-09-12T18:37:55.544 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4169999999999998e-06 2024-09-12T18:37:55.544 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.545 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.545 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:55.545 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445979+0000", 2024-09-12T18:37:55.545 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2949999999999996e-06 2024-09-12T18:37:55.545 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.545 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.545 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:55.545 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.447710+0000", 2024-09-12T18:37:55.545 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001731067 2024-09-12T18:37:55.545 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.546 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.546 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:55.546 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.447734+0000", 2024-09-12T18:37:55.546 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4094e-05 2024-09-12T18:37:55.546 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.546 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.546 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:55.546 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476659+0000", 2024-09-12T18:37:55.546 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028924268999999999 2024-09-12T18:37:55.546 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.547 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.547 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:55.547 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476690+0000", 2024-09-12T18:37:55.547 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1232999999999997e-05 2024-09-12T18:37:55.547 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:55.547 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:55.547 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:55.547 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.547 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.547 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201583 5.d 5:b91eedec:::benchmark_data_smithi073_23739_object69306:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:55.548 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.494097+0000", 2024-09-12T18:37:55.548 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 34.948168172999999, 2024-09-12T18:37:55.548 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049293508, 2024-09-12T18:37:55.548 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:55.548 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:55.548 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:55.548 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:55.548 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:55.548 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:55.548 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201583 2024-09-12T18:37:55.548 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.549 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:55.549 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.549 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:55.549 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494097+0000", 2024-09-12T18:37:55.549 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:55.549 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.549 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.549 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:55.549 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494097+0000", 2024-09-12T18:37:55.549 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:55.549 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.550 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.550 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:55.550 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494098+0000", 2024-09-12T18:37:55.550 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0699999999999996e-07 2024-09-12T18:37:55.550 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.550 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.550 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:55.550 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494102+0000", 2024-09-12T18:37:55.550 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.664e-06 2024-09-12T18:37:55.550 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.550 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.551 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:55.551 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494108+0000", 2024-09-12T18:37:55.551 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.3149999999999997e-06 2024-09-12T18:37:55.551 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.551 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.551 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:55.551 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494112+0000", 2024-09-12T18:37:55.551 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0659999999999997e-06 2024-09-12T18:37:55.551 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.551 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.551 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:55.552 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494200+0000", 2024-09-12T18:37:55.552 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7770999999999997e-05 2024-09-12T18:37:55.552 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.552 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.552 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:55.552 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494315+0000", 2024-09-12T18:37:55.552 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000115048 2024-09-12T18:37:55.552 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.552 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.552 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:55.552 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494414+0000", 2024-09-12T18:37:55.553 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8820999999999995e-05 2024-09-12T18:37:55.553 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.553 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.553 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:55.553 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.497199+0000", 2024-09-12T18:37:55.553 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0027854279999999999 2024-09-12T18:37:55.553 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.553 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.553 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:55.553 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543193+0000", 2024-09-12T18:37:55.554 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.045993500999999999 2024-09-12T18:37:55.554 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.554 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.554 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:55.554 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543315+0000", 2024-09-12T18:37:55.554 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012246800000000001 2024-09-12T18:37:55.554 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.554 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.554 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:55.554 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543391+0000", 2024-09-12T18:37:55.554 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5618999999999995e-05 2024-09-12T18:37:55.555 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:55.555 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:55.555 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:55.555 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.555 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.555 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201585 5.d 5:bb6c167f:::benchmark_data_smithi073_23739_object69308:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:55.555 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.495295+0000", 2024-09-12T18:37:55.555 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 34.946970006000001, 2024-09-12T18:37:55.555 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048312129000000002, 2024-09-12T18:37:55.555 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:55.555 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:55.556 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:55.556 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:55.556 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:55.556 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:55.556 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201585 2024-09-12T18:37:55.556 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.556 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:55.556 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.556 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:55.556 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495295+0000", 2024-09-12T18:37:55.556 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:55.557 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.557 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.557 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:55.557 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495295+0000", 2024-09-12T18:37:55.557 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:55.557 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.557 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.557 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:55.557 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495296+0000", 2024-09-12T18:37:55.557 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0330000000000001e-06 2024-09-12T18:37:55.557 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.558 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.558 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:55.558 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495301+0000", 2024-09-12T18:37:55.558 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7049999999999998e-06 2024-09-12T18:37:55.558 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.558 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.558 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:55.558 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495312+0000", 2024-09-12T18:37:55.558 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0791000000000001e-05 2024-09-12T18:37:55.558 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.559 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.559 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:55.559 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495319+0000", 2024-09-12T18:37:55.559 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8240000000000002e-06 2024-09-12T18:37:55.559 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.559 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.559 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:55.559 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.496088+0000", 2024-09-12T18:37:55.559 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00076901200000000002 2024-09-12T18:37:55.559 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.559 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.559 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:55.560 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.496166+0000", 2024-09-12T18:37:55.560 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.8491000000000005e-05 2024-09-12T18:37:55.560 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.560 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.560 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:55.560 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.496232+0000", 2024-09-12T18:37:55.560 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5400000000000004e-05 2024-09-12T18:37:55.560 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.560 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.560 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:55.560 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.497467+0000", 2024-09-12T18:37:55.560 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001235049 2024-09-12T18:37:55.561 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.561 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.561 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:55.561 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543463+0000", 2024-09-12T18:37:55.561 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.045995743999999998 2024-09-12T18:37:55.561 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.561 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.561 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:55.561 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543546+0000", 2024-09-12T18:37:55.561 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3434000000000001e-05 2024-09-12T18:37:55.561 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.562 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.562 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:55.562 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543608+0000", 2024-09-12T18:37:55.562 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1645999999999999e-05 2024-09-12T18:37:55.562 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:55.562 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:55.562 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:55.562 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.562 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.562 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:238484 5.8 5:135aca90:::benchmark_data_smithi073_23739_object106207:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:55.563 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:38.618805+0000", 2024-09-12T18:37:55.563 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 16.823460552, 2024-09-12T18:37:55.563 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051696747000000001, 2024-09-12T18:37:55.563 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:55.563 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:55.563 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:55.563 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:55.563 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:55.563 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:55.563 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 238484 2024-09-12T18:37:55.563 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.564 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:55.564 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.564 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:55.564 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.618805+0000", 2024-09-12T18:37:55.564 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:55.564 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.564 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.564 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:55.564 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.618805+0000", 2024-09-12T18:37:55.564 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:55.565 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.565 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.565 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:55.565 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.618806+0000", 2024-09-12T18:37:55.565 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1829999999999999e-06 2024-09-12T18:37:55.565 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.565 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.565 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:55.565 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.618810+0000", 2024-09-12T18:37:55.565 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8380000000000004e-06 2024-09-12T18:37:55.565 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.566 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.566 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:55.566 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.618820+0000", 2024-09-12T18:37:55.566 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0047999999999999e-05 2024-09-12T18:37:55.566 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.566 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.566 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:55.566 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.618826+0000", 2024-09-12T18:37:55.566 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7710000000000003e-06 2024-09-12T18:37:55.566 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.566 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.567 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:55.567 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.618869+0000", 2024-09-12T18:37:55.567 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3412999999999999e-05 2024-09-12T18:37:55.567 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.567 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.567 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:55.567 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.618945+0000", 2024-09-12T18:37:55.567 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5992e-05 2024-09-12T18:37:55.567 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.567 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.567 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:55.567 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.619014+0000", 2024-09-12T18:37:55.568 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9298e-05 2024-09-12T18:37:55.568 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.568 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.568 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:55.568 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.623942+0000", 2024-09-12T18:37:55.568 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0049273909999999997 2024-09-12T18:37:55.568 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.568 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.568 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:55.568 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.670424+0000", 2024-09-12T18:37:55.568 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.046482453999999999 2024-09-12T18:37:55.569 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.569 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.569 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:55.569 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.670468+0000", 2024-09-12T18:37:55.569 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3449999999999999e-05 2024-09-12T18:37:55.569 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.569 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.569 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:55.569 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.670502+0000", 2024-09-12T18:37:55.569 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3908999999999997e-05 2024-09-12T18:37:55.569 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:55.570 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:55.570 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:55.570 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.570 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.570 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:238488 5.e 5:7267a760:::benchmark_data_smithi073_23739_object106211:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:55.570 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:38.622076+0000", 2024-09-12T18:37:55.570 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 16.820189713000001, 2024-09-12T18:37:55.570 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053006515999999997, 2024-09-12T18:37:55.570 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:55.570 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:55.570 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:55.571 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:55.571 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:55.571 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:55.571 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 238488 2024-09-12T18:37:55.571 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.571 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:55.571 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.571 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:55.571 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622076+0000", 2024-09-12T18:37:55.571 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:55.571 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.572 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.572 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:55.572 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622076+0000", 2024-09-12T18:37:55.572 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:55.572 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.572 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.572 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:55.572 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622076+0000", 2024-09-12T18:37:55.572 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1900000000000002e-07 2024-09-12T18:37:55.573 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.573 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.573 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:55.573 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622080+0000", 2024-09-12T18:37:55.573 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.225e-06 2024-09-12T18:37:55.573 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.573 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.573 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:55.573 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622088+0000", 2024-09-12T18:37:55.573 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0949999999999996e-06 2024-09-12T18:37:55.573 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.574 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.574 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:55.574 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622092+0000", 2024-09-12T18:37:55.574 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5850000000000001e-06 2024-09-12T18:37:55.574 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.574 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.574 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:55.574 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622148+0000", 2024-09-12T18:37:55.574 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5587000000000002e-05 2024-09-12T18:37:55.574 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.574 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.575 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:55.575 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622283+0000", 2024-09-12T18:37:55.575 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013473900000000001 2024-09-12T18:37:55.575 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.575 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.575 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:55.575 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622404+0000", 2024-09-12T18:37:55.575 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000120865 2024-09-12T18:37:55.575 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.575 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.575 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:55.575 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.629341+0000", 2024-09-12T18:37:55.576 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0069376849999999999 2024-09-12T18:37:55.576 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.576 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.576 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:55.576 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.674829+0000", 2024-09-12T18:37:55.576 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.045488046999999997 2024-09-12T18:37:55.576 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.576 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.576 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:55.576 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.674973+0000", 2024-09-12T18:37:55.576 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000143719 2024-09-12T18:37:55.576 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.577 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.577 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:55.577 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.675082+0000", 2024-09-12T18:37:55.577 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010925 2024-09-12T18:37:55.577 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:55.577 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:55.577 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:55.577 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.577 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.577 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:238489 5.8 5:1da619cf:::benchmark_data_smithi073_23739_object106212:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:55.577 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:38.622114+0000", 2024-09-12T18:37:55.578 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 16.820151212999999, 2024-09-12T18:37:55.578 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.05040443, 2024-09-12T18:37:55.578 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:55.578 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:55.578 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:55.578 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:55.578 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:55.578 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:55.578 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 238489 2024-09-12T18:37:55.578 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.578 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:55.579 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.579 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:55.579 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622114+0000", 2024-09-12T18:37:55.579 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:55.579 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.579 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.579 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:55.579 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622114+0000", 2024-09-12T18:37:55.579 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:55.579 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.579 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.580 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:55.580 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622115+0000", 2024-09-12T18:37:55.580 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8999999999999997e-07 2024-09-12T18:37:55.580 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.580 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.580 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:55.580 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622117+0000", 2024-09-12T18:37:55.580 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.182e-06 2024-09-12T18:37:55.580 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.581 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.581 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:55.581 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622122+0000", 2024-09-12T18:37:55.581 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7350000000000004e-06 2024-09-12T18:37:55.581 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.581 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.581 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:55.581 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622126+0000", 2024-09-12T18:37:55.581 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8550000000000004e-06 2024-09-12T18:37:55.581 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.581 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.581 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:55.582 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622172+0000", 2024-09-12T18:37:55.582 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6108e-05 2024-09-12T18:37:55.582 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.582 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.582 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:55.582 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622258+0000", 2024-09-12T18:37:55.582 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6050000000000005e-05 2024-09-12T18:37:55.582 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.582 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.582 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:55.582 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622323+0000", 2024-09-12T18:37:55.583 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5501999999999997e-05 2024-09-12T18:37:55.583 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.583 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.583 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:55.583 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.626718+0000", 2024-09-12T18:37:55.583 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0043947609999999996 2024-09-12T18:37:55.583 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.583 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.583 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:55.583 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.672398+0000", 2024-09-12T18:37:55.583 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.045679768000000003 2024-09-12T18:37:55.584 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.584 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.584 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:55.584 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.672468+0000", 2024-09-12T18:37:55.584 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0094999999999999e-05 2024-09-12T18:37:55.584 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.584 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.584 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:55.584 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.672519+0000", 2024-09-12T18:37:55.585 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0884000000000003e-05 2024-09-12T18:37:55.585 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:55.585 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:55.585 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:55.585 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.585 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.585 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:238490 5.e 5:7aa44d17:::benchmark_data_smithi073_23739_object106213:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:55.585 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:38.624702+0000", 2024-09-12T18:37:55.585 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 16.817563277000001, 2024-09-12T18:37:55.585 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055637870999999998, 2024-09-12T18:37:55.585 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:55.586 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:55.586 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:55.586 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:55.586 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:55.586 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:55.586 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 238490 2024-09-12T18:37:55.586 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.586 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:55.586 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.586 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:55.586 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624702+0000", 2024-09-12T18:37:55.587 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:55.587 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.587 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.587 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:55.587 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624702+0000", 2024-09-12T18:37:55.587 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:55.587 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.587 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.587 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:55.587 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624703+0000", 2024-09-12T18:37:55.587 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1900000000000001e-07 2024-09-12T18:37:55.587 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.588 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.588 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:55.588 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624707+0000", 2024-09-12T18:37:55.588 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6100000000000002e-06 2024-09-12T18:37:55.588 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.588 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.588 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:55.588 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624715+0000", 2024-09-12T18:37:55.588 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4689999999999997e-06 2024-09-12T18:37:55.588 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.588 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.588 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:55.589 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624720+0000", 2024-09-12T18:37:55.589 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5719999999999996e-06 2024-09-12T18:37:55.589 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.589 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.589 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:55.589 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624762+0000", 2024-09-12T18:37:55.589 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2633000000000003e-05 2024-09-12T18:37:55.589 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.589 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.589 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:55.589 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624859+0000", 2024-09-12T18:37:55.589 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6667000000000001e-05 2024-09-12T18:37:55.590 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.590 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.590 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:55.590 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624927+0000", 2024-09-12T18:37:55.590 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7780000000000005e-05 2024-09-12T18:37:55.590 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.590 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.590 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:55.590 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.629361+0000", 2024-09-12T18:37:55.590 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0044346990000000003 2024-09-12T18:37:55.590 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.590 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.590 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:55.591 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.680101+0000", 2024-09-12T18:37:55.591 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.050739751999999999 2024-09-12T18:37:55.591 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.591 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.591 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:55.591 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.680223+0000", 2024-09-12T18:37:55.591 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012207 2024-09-12T18:37:55.591 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.591 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.591 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:55.591 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.680340+0000", 2024-09-12T18:37:55.591 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011680000000000001 2024-09-12T18:37:55.592 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:55.592 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:55.592 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:55.592 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.592 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.592 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:238492 5.e 5:7ec5c6d3:::benchmark_data_smithi073_23739_object106215:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:55.592 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:38.624755+0000", 2024-09-12T18:37:55.592 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 16.817510347999999, 2024-09-12T18:37:55.592 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.059045981999999997, 2024-09-12T18:37:55.592 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:55.592 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:55.593 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:55.593 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:55.593 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:55.593 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:55.593 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 238492 2024-09-12T18:37:55.593 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.593 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:55.593 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.593 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:55.593 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624755+0000", 2024-09-12T18:37:55.593 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:55.593 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.594 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.594 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:55.594 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624755+0000", 2024-09-12T18:37:55.594 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:55.594 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.594 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.594 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:55.594 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624756+0000", 2024-09-12T18:37:55.594 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2e-07 2024-09-12T18:37:55.594 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.594 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.595 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:55.595 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624758+0000", 2024-09-12T18:37:55.595 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0379999999999998e-06 2024-09-12T18:37:55.595 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.595 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.595 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:55.595 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624763+0000", 2024-09-12T18:37:55.595 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6400000000000002e-06 2024-09-12T18:37:55.595 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.595 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.596 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:55.596 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624768+0000", 2024-09-12T18:37:55.596 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9509999999999997e-06 2024-09-12T18:37:55.596 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.596 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.596 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:55.596 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.625824+0000", 2024-09-12T18:37:55.596 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0010553540000000001 2024-09-12T18:37:55.596 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.596 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.596 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:55.597 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.626059+0000", 2024-09-12T18:37:55.597 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00023545200000000001 2024-09-12T18:37:55.597 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.597 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.597 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:55.597 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.626277+0000", 2024-09-12T18:37:55.597 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021797400000000001 2024-09-12T18:37:55.597 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.597 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.598 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:55.598 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.632160+0000", 2024-09-12T18:37:55.598 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0058828020000000003 2024-09-12T18:37:55.598 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.598 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.598 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:55.598 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.683543+0000", 2024-09-12T18:37:55.598 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051383073000000001 2024-09-12T18:37:55.598 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.598 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.598 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:55.599 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.683677+0000", 2024-09-12T18:37:55.599 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000134091 2024-09-12T18:37:55.599 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.599 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.599 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:55.599 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.683801+0000", 2024-09-12T18:37:55.599 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012408699999999999 2024-09-12T18:37:55.599 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:55.599 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:55.599 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:55.600 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.600 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.600 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:238493 5.8 5:17b7de1b:::benchmark_data_smithi073_23739_object106216:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:55.600 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:38.624778+0000", 2024-09-12T18:37:55.600 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 16.817487636999999, 2024-09-12T18:37:55.600 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048129221999999999, 2024-09-12T18:37:55.600 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:55.600 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:55.600 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:55.600 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:55.601 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:55.601 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:55.601 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 238493 2024-09-12T18:37:55.601 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.601 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:55.601 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.601 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:55.601 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624778+0000", 2024-09-12T18:37:55.601 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:55.602 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.602 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.602 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:55.602 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624778+0000", 2024-09-12T18:37:55.602 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:55.602 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.602 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.602 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:55.602 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624778+0000", 2024-09-12T18:37:55.602 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.32e-07 2024-09-12T18:37:55.602 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.603 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.603 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:55.603 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624780+0000", 2024-09-12T18:37:55.603 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0530000000000001e-06 2024-09-12T18:37:55.603 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.603 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.603 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:55.603 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624787+0000", 2024-09-12T18:37:55.603 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2790000000000004e-06 2024-09-12T18:37:55.603 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.603 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.604 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:55.604 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624792+0000", 2024-09-12T18:37:55.604 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9629999999999997e-06 2024-09-12T18:37:55.604 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.604 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.604 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:55.604 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624828+0000", 2024-09-12T18:37:55.604 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6177000000000003e-05 2024-09-12T18:37:55.604 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.604 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.604 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:55.605 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624905+0000", 2024-09-12T18:37:55.605 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7671999999999998e-05 2024-09-12T18:37:55.605 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.605 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.605 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:55.605 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624972+0000", 2024-09-12T18:37:55.605 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6977000000000006e-05 2024-09-12T18:37:55.605 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.605 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.605 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:55.605 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.629376+0000", 2024-09-12T18:37:55.606 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0044033229999999998 2024-09-12T18:37:55.606 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.606 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.606 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:55.606 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.672808+0000", 2024-09-12T18:37:55.606 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.043431889000000001 2024-09-12T18:37:55.606 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.606 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.606 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:55.606 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.672865+0000", 2024-09-12T18:37:55.606 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.753e-05 2024-09-12T18:37:55.607 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:55.607 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:55.607 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:55.607 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.672907+0000", 2024-09-12T18:37:55.607 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1927e-05 2024-09-12T18:37:55.607 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:55.607 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:55.607 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:55.607 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:55.607 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:55.607 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:55.609 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:37:55.610 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:55.605+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:55.688 INFO:teuthology.orchestra.run.smithi073.stdout:moved 0 / 242 (0%) 2024-09-12T18:37:55.688 INFO:teuthology.orchestra.run.smithi073.stdout:avg 80.6667 2024-09-12T18:37:55.688 INFO:teuthology.orchestra.run.smithi073.stdout:stddev 21.8225 -> 21.8225 (expected baseline 7.33333) 2024-09-12T18:37:55.688 INFO:teuthology.orchestra.run.smithi073.stdout:min osd.0 with 50 -> 50 pgs (0.619835 -> 0.619835 * mean) 2024-09-12T18:37:55.688 INFO:teuthology.orchestra.run.smithi073.stdout:max osd.2 with 99 -> 99 pgs (1.22727 -> 1.22727 * mean) 2024-09-12T18:37:55.688 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:37:55.688 INFO:teuthology.orchestra.run.smithi073.stdout:oload 110 2024-09-12T18:37:55.689 INFO:teuthology.orchestra.run.smithi073.stdout:max_change 3 2024-09-12T18:37:55.689 INFO:teuthology.orchestra.run.smithi073.stdout:max_change_osds 4 2024-09-12T18:37:55.689 INFO:teuthology.orchestra.run.smithi073.stdout:average_utilization 0.0030 2024-09-12T18:37:55.689 INFO:teuthology.orchestra.run.smithi073.stdout:overload_utilization 0.0033 2024-09-12T18:37:55.689 INFO:teuthology.orchestra.run.smithi073.stderr:no change 2024-09-12T18:37:55.707 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-09-12T18:37:55.707 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 0.05 2024-09-12T18:37:55.709 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:55.703+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:55.739 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:55.739 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [], 2024-09-12T18:37:55.740 INFO:teuthology.orchestra.run.smithi162.stdout: "num_ops": 0 2024-09-12T18:37:55.740 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:55.755 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:37:55.810 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:55.801+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:55.854 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2024-09-12T18:37:55.854 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2024-09-12T18:37:55.873 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:55.873 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [], 2024-09-12T18:37:55.873 INFO:teuthology.orchestra.run.smithi162.stdout: "complaint_time": 30, 2024-09-12T18:37:55.873 INFO:teuthology.orchestra.run.smithi162.stdout: "num_blocked_ops": 0 2024-09-12T18:37:55.873 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:55.887 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:37:55.911 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-09-12T18:37:55.907+0000 7ff338a31640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22934) UID: 0 2024-09-12T18:37:56.012 INFO:teuthology.orchestra.run.smithi073.stdout:moved 0 / 242 (0%) 2024-09-12T18:37:56.012 INFO:teuthology.orchestra.run.smithi073.stdout:avg 80.6667 2024-09-12T18:37:56.012 INFO:teuthology.orchestra.run.smithi073.stdout:stddev 21.8225 -> 21.8225 (expected baseline 7.33333) 2024-09-12T18:37:56.012 INFO:teuthology.orchestra.run.smithi073.stdout:min osd.0 with 50 -> 50 pgs (0.619835 -> 0.619835 * mean) 2024-09-12T18:37:56.012 INFO:teuthology.orchestra.run.smithi073.stdout:max osd.2 with 99 -> 99 pgs (1.22727 -> 1.22727 * mean) 2024-09-12T18:37:56.012 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:37:56.013 INFO:teuthology.orchestra.run.smithi073.stdout:oload 1000 2024-09-12T18:37:56.013 INFO:teuthology.orchestra.run.smithi073.stdout:max_change 0.05 2024-09-12T18:37:56.013 INFO:teuthology.orchestra.run.smithi073.stdout:max_change_osds 4 2024-09-12T18:37:56.013 INFO:teuthology.orchestra.run.smithi073.stdout:average_utilization 0.0030 2024-09-12T18:37:56.013 INFO:teuthology.orchestra.run.smithi073.stdout:overload_utilization 0.0298 2024-09-12T18:37:56.013 INFO:teuthology.orchestra.run.smithi073.stderr:no change 2024-09-12T18:37:56.014 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-12T18:37:56.009+0000 7f71a92e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-12T18:37:56.019 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-09-12T18:37:56.019 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 0.05 2024-09-12T18:37:56.113 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:56.105+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:56.140 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:56.141 INFO:teuthology.orchestra.run.smithi162.stdout: "size": 20, 2024-09-12T18:37:56.141 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 600, 2024-09-12T18:37:56.141 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:37:56.141 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.141 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167364 5.7 5:ee50096a:::benchmark_data_smithi073_23739_object35087:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:56.141 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.168715+0000", 2024-09-12T18:37:56.141 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 52.966754711999997, 2024-09-12T18:37:56.141 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.068831153000000006, 2024-09-12T18:37:56.141 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:56.141 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:56.141 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:56.141 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:56.142 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:56.142 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:56.142 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167364 2024-09-12T18:37:56.142 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.142 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:56.142 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.142 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:56.142 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168715+0000", 2024-09-12T18:37:56.142 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:56.142 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.142 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.142 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:56.142 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168715+0000", 2024-09-12T18:37:56.143 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:56.143 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.143 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.143 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:56.143 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168716+0000", 2024-09-12T18:37:56.143 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0559999999999999e-06 2024-09-12T18:37:56.143 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.143 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.143 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:56.143 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168721+0000", 2024-09-12T18:37:56.143 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8019999999999999e-06 2024-09-12T18:37:56.143 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.143 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.143 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:56.144 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168731+0000", 2024-09-12T18:37:56.144 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0315e-05 2024-09-12T18:37:56.144 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.144 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.144 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:56.144 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168738+0000", 2024-09-12T18:37:56.144 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.126e-06 2024-09-12T18:37:56.144 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.144 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.144 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:56.145 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168782+0000", 2024-09-12T18:37:56.145 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.3924000000000002e-05 2024-09-12T18:37:56.145 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.145 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.145 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:56.145 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168913+0000", 2024-09-12T18:37:56.145 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000131154 2024-09-12T18:37:56.145 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.145 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.146 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:56.146 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169026+0000", 2024-09-12T18:37:56.146 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011223299999999999 2024-09-12T18:37:56.146 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.146 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.146 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:56.146 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.175404+0000", 2024-09-12T18:37:56.146 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0063780319999999996 2024-09-12T18:37:56.146 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.146 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.146 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:56.146 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237446+0000", 2024-09-12T18:37:56.146 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.062042238 2024-09-12T18:37:56.146 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.147 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.147 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:56.147 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237501+0000", 2024-09-12T18:37:56.147 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4913000000000001e-05 2024-09-12T18:37:56.147 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.147 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.147 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:56.147 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237546+0000", 2024-09-12T18:37:56.147 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.5359999999999999e-05 2024-09-12T18:37:56.147 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:56.147 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:56.147 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:56.147 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.147 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.148 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167365 5.2 5:4107875c:::benchmark_data_smithi073_23739_object35088:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:56.148 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:56.148 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 52.966705138000002, 2024-09-12T18:37:56.148 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.078544438999999994, 2024-09-12T18:37:56.148 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:56.148 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:56.148 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:56.148 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:56.148 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:56.148 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:56.149 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167365 2024-09-12T18:37:56.149 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.149 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:56.149 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.149 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:56.149 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:56.149 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:56.149 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.149 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.149 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:56.149 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:56.149 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:56.149 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.149 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.150 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:56.150 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:56.150 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.4700000000000001e-07 2024-09-12T18:37:56.150 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.150 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.150 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:56.150 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168769+0000", 2024-09-12T18:37:56.150 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.4170000000000001e-06 2024-09-12T18:37:56.150 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.150 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.150 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:56.150 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168777+0000", 2024-09-12T18:37:56.150 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1499999999999999e-06 2024-09-12T18:37:56.150 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.151 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.151 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:56.151 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168783+0000", 2024-09-12T18:37:56.151 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.0460000000000002e-06 2024-09-12T18:37:56.151 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.151 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.151 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:56.151 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168865+0000", 2024-09-12T18:37:56.151 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1953999999999995e-05 2024-09-12T18:37:56.151 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.151 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.151 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:56.151 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169003+0000", 2024-09-12T18:37:56.152 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013798200000000001 2024-09-12T18:37:56.152 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.152 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.152 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:56.152 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169065+0000", 2024-09-12T18:37:56.152 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2218000000000006e-05 2024-09-12T18:37:56.152 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.152 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.152 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:56.152 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174771+0000", 2024-09-12T18:37:56.153 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0057054819999999996 2024-09-12T18:37:56.153 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.153 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.153 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:56.153 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.247234+0000", 2024-09-12T18:37:56.153 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.072463391000000002 2024-09-12T18:37:56.153 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.153 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.153 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:56.153 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.247273+0000", 2024-09-12T18:37:56.153 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.9069000000000002e-05 2024-09-12T18:37:56.153 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.153 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.153 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:56.154 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.247309+0000", 2024-09-12T18:37:56.154 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5982999999999998e-05 2024-09-12T18:37:56.154 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:56.154 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:56.154 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:56.154 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.154 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.154 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167369 5.7 5:e64ecabd:::benchmark_data_smithi073_23739_object35092:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:56.154 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.169042+0000", 2024-09-12T18:37:56.154 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 52.966428026999999, 2024-09-12T18:37:56.154 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.069229188999999997, 2024-09-12T18:37:56.154 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:56.154 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:56.154 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:56.155 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:56.155 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:56.155 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:56.155 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167369 2024-09-12T18:37:56.155 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.155 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:56.155 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.155 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:56.155 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169042+0000", 2024-09-12T18:37:56.155 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:56.155 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.155 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.155 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:56.155 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169042+0000", 2024-09-12T18:37:56.156 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:56.156 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.156 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.156 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:56.156 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169043+0000", 2024-09-12T18:37:56.156 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.9400000000000004e-07 2024-09-12T18:37:56.156 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.156 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.156 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:56.156 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169048+0000", 2024-09-12T18:37:56.156 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8420000000000004e-06 2024-09-12T18:37:56.156 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.156 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.157 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:56.157 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169055+0000", 2024-09-12T18:37:56.157 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.7989999999999994e-06 2024-09-12T18:37:56.157 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.157 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.157 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:56.157 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169062+0000", 2024-09-12T18:37:56.157 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.5950000000000004e-06 2024-09-12T18:37:56.157 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.157 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.157 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:56.157 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173858+0000", 2024-09-12T18:37:56.157 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0047959259999999998 2024-09-12T18:37:56.158 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.158 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.158 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:56.158 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173966+0000", 2024-09-12T18:37:56.158 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000107941 2024-09-12T18:37:56.158 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.158 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.158 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:56.158 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174043+0000", 2024-09-12T18:37:56.158 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.7360000000000005e-05 2024-09-12T18:37:56.158 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.158 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.158 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:56.158 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.175711+0000", 2024-09-12T18:37:56.159 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0016680810000000001 2024-09-12T18:37:56.159 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.159 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.159 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:56.159 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.238163+0000", 2024-09-12T18:37:56.159 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.062451523000000002 2024-09-12T18:37:56.159 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.159 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.159 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:56.159 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.238222+0000", 2024-09-12T18:37:56.159 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9723999999999999e-05 2024-09-12T18:37:56.159 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.159 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.159 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:56.160 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.238271+0000", 2024-09-12T18:37:56.160 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8504000000000002e-05 2024-09-12T18:37:56.160 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:56.160 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:56.160 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:56.160 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.160 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.160 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167373 5.5 5:ad283029:::benchmark_data_smithi073_23739_object35096:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:56.160 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:56.160 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 52.963923196000003, 2024-09-12T18:37:56.160 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.066200976999999994, 2024-09-12T18:37:56.161 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:56.161 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:56.161 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:56.161 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:56.161 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:56.161 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:56.161 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167373 2024-09-12T18:37:56.161 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.161 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:56.161 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.161 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:56.161 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:56.161 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:56.161 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.162 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.162 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:56.162 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:56.162 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:56.162 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.162 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.162 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:56.162 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:56.162 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4900000000000005e-07 2024-09-12T18:37:56.162 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.162 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.162 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:56.162 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171551+0000", 2024-09-12T18:37:56.162 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.7519999999999998e-06 2024-09-12T18:37:56.163 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.163 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.163 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:56.163 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171562+0000", 2024-09-12T18:37:56.163 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0353000000000001e-05 2024-09-12T18:37:56.163 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.163 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.163 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:56.163 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171566+0000", 2024-09-12T18:37:56.163 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8269999999999997e-06 2024-09-12T18:37:56.163 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.163 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.163 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:56.164 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171622+0000", 2024-09-12T18:37:56.164 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5220999999999999e-05 2024-09-12T18:37:56.164 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.164 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.164 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:56.164 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171719+0000", 2024-09-12T18:37:56.164 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7238999999999995e-05 2024-09-12T18:37:56.164 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.164 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.164 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:56.164 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171802+0000", 2024-09-12T18:37:56.164 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.3285e-05 2024-09-12T18:37:56.164 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.164 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.165 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:56.165 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174608+0000", 2024-09-12T18:37:56.165 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028054590000000002 2024-09-12T18:37:56.165 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.165 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.165 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:56.165 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174762+0000", 2024-09-12T18:37:56.165 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015465100000000001 2024-09-12T18:37:56.165 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.165 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.165 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:56.165 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237474+0000", 2024-09-12T18:37:56.165 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.062711683000000004 2024-09-12T18:37:56.166 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.166 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.166 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:56.166 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237540+0000", 2024-09-12T18:37:56.166 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.6132999999999999e-05 2024-09-12T18:37:56.166 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.166 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.166 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:56.166 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237748+0000", 2024-09-12T18:37:56.166 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020752499999999999 2024-09-12T18:37:56.166 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:56.166 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:56.166 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:56.166 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.167 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.167 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167374 5.1 5:81e25826:::benchmark_data_smithi073_23739_object35097:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:56.167 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.173748+0000", 2024-09-12T18:37:56.167 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 52.961721748000002, 2024-09-12T18:37:56.167 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.069225245000000005, 2024-09-12T18:37:56.167 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:56.167 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:56.167 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:56.167 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:56.167 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:56.168 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:56.168 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167374 2024-09-12T18:37:56.168 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.168 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:56.168 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.168 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:56.168 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173748+0000", 2024-09-12T18:37:56.168 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:56.168 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.168 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.168 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:56.168 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173748+0000", 2024-09-12T18:37:56.168 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:56.169 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.169 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.169 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:56.169 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173749+0000", 2024-09-12T18:37:56.169 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.418e-06 2024-09-12T18:37:56.169 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.169 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.169 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:56.169 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173755+0000", 2024-09-12T18:37:56.169 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.0730000000000004e-06 2024-09-12T18:37:56.169 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.169 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.169 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:56.169 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173768+0000", 2024-09-12T18:37:56.170 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3644e-05 2024-09-12T18:37:56.170 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.170 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.170 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:56.170 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173777+0000", 2024-09-12T18:37:56.170 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4160000000000004e-06 2024-09-12T18:37:56.170 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.170 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.170 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:56.170 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173927+0000", 2024-09-12T18:37:56.170 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015065900000000001 2024-09-12T18:37:56.170 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.170 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.171 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:56.171 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174052+0000", 2024-09-12T18:37:56.171 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012460699999999999 2024-09-12T18:37:56.171 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.171 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.171 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:56.171 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174181+0000", 2024-09-12T18:37:56.171 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012919299999999999 2024-09-12T18:37:56.171 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.171 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.171 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:56.171 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.178108+0000", 2024-09-12T18:37:56.171 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0039273210000000001 2024-09-12T18:37:56.172 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.172 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.172 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:56.172 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.178118+0000", 2024-09-12T18:37:56.172 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7550000000000006e-06 2024-09-12T18:37:56.172 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.172 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.172 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:56.172 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.242865+0000", 2024-09-12T18:37:56.172 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.064746597000000003 2024-09-12T18:37:56.172 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.172 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.172 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:56.173 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.242903+0000", 2024-09-12T18:37:56.173 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.8268e-05 2024-09-12T18:37:56.173 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.173 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.173 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:56.173 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.242973+0000", 2024-09-12T18:37:56.173 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0294000000000002e-05 2024-09-12T18:37:56.173 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:56.173 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:56.173 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:56.173 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.173 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.173 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167375 5.1 5:83a09102:::benchmark_data_smithi073_23739_object35098:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:56.173 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:56.174 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 52.961670200999997, 2024-09-12T18:37:56.174 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.069437463000000005, 2024-09-12T18:37:56.174 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:56.174 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:56.174 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:56.174 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:56.174 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:56.174 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:56.174 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167375 2024-09-12T18:37:56.174 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.174 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:56.174 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.174 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:56.174 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:56.175 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:56.175 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.175 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.175 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:56.175 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:56.175 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:56.175 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.175 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.175 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:56.175 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:56.175 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1399999999999997e-07 2024-09-12T18:37:56.175 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.176 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.176 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:56.176 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173803+0000", 2024-09-12T18:37:56.176 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.7860000000000001e-06 2024-09-12T18:37:56.176 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.176 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.177 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:56.177 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173811+0000", 2024-09-12T18:37:56.177 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4610000000000008e-06 2024-09-12T18:37:56.177 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.177 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.177 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:56.177 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173817+0000", 2024-09-12T18:37:56.177 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3569999999999997e-06 2024-09-12T18:37:56.177 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.177 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.177 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:56.177 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.176070+0000", 2024-09-12T18:37:56.177 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.002253405 2024-09-12T18:37:56.178 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.178 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.178 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:56.178 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.176263+0000", 2024-09-12T18:37:56.178 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000192583 2024-09-12T18:37:56.178 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.178 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.178 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:56.178 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.176429+0000", 2024-09-12T18:37:56.178 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00016626 2024-09-12T18:37:56.178 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.178 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.178 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:56.178 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.178154+0000", 2024-09-12T18:37:56.179 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0017247009999999999 2024-09-12T18:37:56.179 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.179 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.179 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:56.179 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.182110+0000", 2024-09-12T18:37:56.179 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0039568229999999999 2024-09-12T18:37:56.179 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.179 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.179 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:56.179 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.243024+0000", 2024-09-12T18:37:56.179 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.060913249000000003 2024-09-12T18:37:56.179 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.179 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.179 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:56.180 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.243107+0000", 2024-09-12T18:37:56.180 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.3090000000000006e-05 2024-09-12T18:37:56.180 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.180 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.180 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:56.180 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.243237+0000", 2024-09-12T18:37:56.180 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013023399999999999 2024-09-12T18:37:56.180 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:56.180 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:56.180 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:56.180 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.180 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.180 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201515 5.5 5:a25bd8bb:::benchmark_data_smithi073_23739_object69238:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:56.181 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.437024+0000", 2024-09-12T18:37:56.181 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 35.698445968999998, 2024-09-12T18:37:56.181 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.040476102, 2024-09-12T18:37:56.181 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:56.181 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:56.181 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:56.181 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:56.181 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:56.181 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:56.181 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201515 2024-09-12T18:37:56.181 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.181 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:56.181 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.181 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:56.182 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437024+0000", 2024-09-12T18:37:56.182 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:56.182 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.182 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.182 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:56.182 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437024+0000", 2024-09-12T18:37:56.182 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:56.182 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.182 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.182 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:56.182 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437025+0000", 2024-09-12T18:37:56.183 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2240000000000001e-06 2024-09-12T18:37:56.183 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.183 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.183 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:56.183 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437030+0000", 2024-09-12T18:37:56.183 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.7049999999999998e-06 2024-09-12T18:37:56.183 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.183 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.183 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:56.183 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437040+0000", 2024-09-12T18:37:56.183 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0351e-05 2024-09-12T18:37:56.183 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.183 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.183 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:56.184 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437049+0000", 2024-09-12T18:37:56.184 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5750000000000001e-06 2024-09-12T18:37:56.184 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.184 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.184 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:56.184 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437574+0000", 2024-09-12T18:37:56.184 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00052566400000000001 2024-09-12T18:37:56.184 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.184 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.184 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:56.184 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437673+0000", 2024-09-12T18:37:56.184 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.8672000000000007e-05 2024-09-12T18:37:56.184 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.185 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.185 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:56.185 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437755+0000", 2024-09-12T18:37:56.185 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1705000000000005e-05 2024-09-12T18:37:56.185 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.185 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.185 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:56.185 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.439556+0000", 2024-09-12T18:37:56.185 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0018009020000000001 2024-09-12T18:37:56.185 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.185 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.185 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:56.186 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.439955+0000", 2024-09-12T18:37:56.186 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00039966900000000001 2024-09-12T18:37:56.186 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.186 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.186 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:56.186 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.477267+0000", 2024-09-12T18:37:56.186 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.037311614 2024-09-12T18:37:56.186 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.186 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.186 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:56.186 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.477368+0000", 2024-09-12T18:37:56.186 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000101495 2024-09-12T18:37:56.186 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.186 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.187 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:56.187 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.477500+0000", 2024-09-12T18:37:56.187 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000131526 2024-09-12T18:37:56.187 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:56.187 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:56.187 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:56.187 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.187 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.187 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201566 5.9 5:9ea8bdd3:::benchmark_data_smithi073_23739_object69289:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:56.187 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.487311+0000", 2024-09-12T18:37:56.187 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 35.648158422000002, 2024-09-12T18:37:56.187 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.044734547, 2024-09-12T18:37:56.187 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:56.188 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:56.188 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:56.188 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:56.188 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:56.188 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:56.188 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201566 2024-09-12T18:37:56.188 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.188 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:56.188 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.188 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:56.188 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487311+0000", 2024-09-12T18:37:56.188 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:56.188 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.188 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.189 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:56.189 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487311+0000", 2024-09-12T18:37:56.189 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:56.189 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.189 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.189 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:56.189 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487313+0000", 2024-09-12T18:37:56.189 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3060000000000001e-06 2024-09-12T18:37:56.189 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.189 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.189 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:56.190 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487318+0000", 2024-09-12T18:37:56.190 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.181e-06 2024-09-12T18:37:56.190 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.190 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.190 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:56.190 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487333+0000", 2024-09-12T18:37:56.190 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5012e-05 2024-09-12T18:37:56.190 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.190 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.190 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:56.190 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487344+0000", 2024-09-12T18:37:56.190 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0733999999999999e-05 2024-09-12T18:37:56.190 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.190 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.191 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:56.191 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487403+0000", 2024-09-12T18:37:56.191 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9858999999999997e-05 2024-09-12T18:37:56.191 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.191 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.191 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:56.191 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487600+0000", 2024-09-12T18:37:56.191 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019617899999999999 2024-09-12T18:37:56.191 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.191 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.191 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:56.192 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487769+0000", 2024-09-12T18:37:56.192 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00016919299999999999 2024-09-12T18:37:56.192 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.192 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.192 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:56.192 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492984+0000", 2024-09-12T18:37:56.192 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0052155309999999998 2024-09-12T18:37:56.192 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.193 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.193 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:56.193 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531791+0000", 2024-09-12T18:37:56.193 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.038806861999999998 2024-09-12T18:37:56.193 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.193 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.193 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:56.194 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531946+0000", 2024-09-12T18:37:56.194 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015445300000000001 2024-09-12T18:37:56.194 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.194 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.194 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:56.194 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532046+0000", 2024-09-12T18:37:56.195 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000100237 2024-09-12T18:37:56.195 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:56.195 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:56.195 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:56.195 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.195 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.196 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201569 5.9 5:9719244e:::benchmark_data_smithi073_23739_object69292:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:56.196 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.487551+0000", 2024-09-12T18:37:56.196 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 35.647919062, 2024-09-12T18:37:56.196 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.045212927, 2024-09-12T18:37:56.196 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:56.196 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:56.197 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:56.197 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:56.197 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:56.197 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:56.197 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201569 2024-09-12T18:37:56.197 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.197 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:56.198 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.198 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:56.198 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487551+0000", 2024-09-12T18:37:56.198 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:56.198 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.198 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.199 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:56.199 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487551+0000", 2024-09-12T18:37:56.199 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:56.199 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.200 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.200 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:56.200 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487552+0000", 2024-09-12T18:37:56.200 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6160000000000001e-06 2024-09-12T18:37:56.200 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.200 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.201 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:56.201 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487566+0000", 2024-09-12T18:37:56.201 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.344e-05 2024-09-12T18:37:56.201 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.201 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.201 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:56.202 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487581+0000", 2024-09-12T18:37:56.202 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5526e-05 2024-09-12T18:37:56.202 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.202 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.202 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:56.202 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487593+0000", 2024-09-12T18:37:56.203 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1443e-05 2024-09-12T18:37:56.203 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.203 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.203 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:56.203 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.489599+0000", 2024-09-12T18:37:56.203 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0020058960000000001 2024-09-12T18:37:56.204 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.204 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.204 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:56.204 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.489710+0000", 2024-09-12T18:37:56.204 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000111634 2024-09-12T18:37:56.204 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.205 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.205 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:56.205 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.489796+0000", 2024-09-12T18:37:56.206 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5235999999999995e-05 2024-09-12T18:37:56.206 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.206 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.206 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:56.206 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532140+0000", 2024-09-12T18:37:56.206 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.042344524000000001 2024-09-12T18:37:56.207 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.207 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.207 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:56.207 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532559+0000", 2024-09-12T18:37:56.207 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00041908800000000002 2024-09-12T18:37:56.207 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.208 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.208 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:56.208 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532676+0000", 2024-09-12T18:37:56.208 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011649100000000001 2024-09-12T18:37:56.208 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.209 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.209 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:56.209 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532764+0000", 2024-09-12T18:37:56.209 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8033000000000002e-05 2024-09-12T18:37:56.209 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:56.209 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:56.210 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:56.210 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.210 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.210 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201570 5.5 5:a97bff67:::benchmark_data_smithi073_23739_object69293:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:56.210 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.487618+0000", 2024-09-12T18:37:56.210 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 35.647851477000003, 2024-09-12T18:37:56.211 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.049152553000000002, 2024-09-12T18:37:56.211 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:56.211 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:56.211 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:56.211 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:56.211 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:56.212 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:56.212 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201570 2024-09-12T18:37:56.212 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.212 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:56.212 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.212 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:56.213 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487618+0000", 2024-09-12T18:37:56.213 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:56.213 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.213 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.213 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:56.213 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487618+0000", 2024-09-12T18:37:56.214 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:56.214 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.214 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.214 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:56.214 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487619+0000", 2024-09-12T18:37:56.214 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.6099999999999999e-07 2024-09-12T18:37:56.215 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.215 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.215 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:56.215 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487623+0000", 2024-09-12T18:37:56.215 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.0940000000000001e-06 2024-09-12T18:37:56.215 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.216 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.216 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:56.216 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487635+0000", 2024-09-12T18:37:56.216 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1348e-05 2024-09-12T18:37:56.216 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.216 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.217 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:56.217 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487657+0000", 2024-09-12T18:37:56.217 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2246999999999999e-05 2024-09-12T18:37:56.217 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.217 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.217 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:56.218 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490684+0000", 2024-09-12T18:37:56.218 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0030268339999999999 2024-09-12T18:37:56.218 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.218 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.218 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:56.218 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490797+0000", 2024-09-12T18:37:56.219 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011372200000000001 2024-09-12T18:37:56.219 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.219 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.219 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:56.219 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490909+0000", 2024-09-12T18:37:56.219 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000111239 2024-09-12T18:37:56.220 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.220 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.220 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:56.220 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534345+0000", 2024-09-12T18:37:56.220 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.043436648000000001 2024-09-12T18:37:56.220 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.221 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.221 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:56.221 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534711+0000", 2024-09-12T18:37:56.221 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00036576399999999998 2024-09-12T18:37:56.221 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.221 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.222 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:56.222 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536225+0000", 2024-09-12T18:37:56.222 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001513983 2024-09-12T18:37:56.222 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.222 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.222 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:56.222 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536331+0000", 2024-09-12T18:37:56.222 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010603300000000001 2024-09-12T18:37:56.222 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.222 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.222 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:56.222 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536771+0000", 2024-09-12T18:37:56.223 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00043978000000000002 2024-09-12T18:37:56.223 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:56.223 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:56.223 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:56.223 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.223 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.223 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:201572 5.3 e67/21 5:caf692c5:::benchmark_data_smithi073_23739_object69295:head v 67'12362, mlcod=67'12360)", 2024-09-12T18:37:56.223 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.490255+0000", 2024-09-12T18:37:56.223 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 35.645214977000002, 2024-09-12T18:37:56.223 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.044189501999999999, 2024-09-12T18:37:56.223 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:56.223 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:56.223 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:56.224 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:56.224 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.224 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:56.224 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490255+0000", 2024-09-12T18:37:56.224 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:56.224 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.224 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.225 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:56.225 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490255+0000", 2024-09-12T18:37:56.225 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:56.225 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.225 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.225 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:56.225 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490256+0000", 2024-09-12T18:37:56.226 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0500000000000003e-07 2024-09-12T18:37:56.226 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.226 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.226 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:56.226 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490260+0000", 2024-09-12T18:37:56.226 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8269999999999997e-06 2024-09-12T18:37:56.226 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.226 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.226 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:56.226 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490269+0000", 2024-09-12T18:37:56.226 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.6549999999999993e-06 2024-09-12T18:37:56.226 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.226 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.226 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:56.227 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490275+0000", 2024-09-12T18:37:56.227 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.46e-06 2024-09-12T18:37:56.227 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.227 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.227 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:56.227 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490328+0000", 2024-09-12T18:37:56.227 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2101999999999997e-05 2024-09-12T18:37:56.227 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.227 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.227 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:56.227 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490347+0000", 2024-09-12T18:37:56.227 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9457999999999999e-05 2024-09-12T18:37:56.227 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.228 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.228 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:56.228 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534382+0000", 2024-09-12T18:37:56.228 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.044034968000000001 2024-09-12T18:37:56.228 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.228 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.228 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:56.228 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534444+0000", 2024-09-12T18:37:56.228 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2327000000000001e-05 2024-09-12T18:37:56.228 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:56.228 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:56.228 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:56.228 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.229 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.229 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201574 5.5 5:a963f378:::benchmark_data_smithi073_23739_object69297:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:56.229 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.490449+0000", 2024-09-12T18:37:56.229 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 35.645021002, 2024-09-12T18:37:56.229 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.046749974, 2024-09-12T18:37:56.229 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:56.229 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:56.229 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:56.229 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:56.229 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:56.229 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:56.229 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201574 2024-09-12T18:37:56.229 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.229 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:56.230 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.230 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:56.230 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490449+0000", 2024-09-12T18:37:56.230 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:56.230 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.230 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.230 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:56.230 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490449+0000", 2024-09-12T18:37:56.230 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:56.230 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.230 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.230 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:56.230 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490450+0000", 2024-09-12T18:37:56.230 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.17e-06 2024-09-12T18:37:56.231 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.231 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.231 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:56.231 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490455+0000", 2024-09-12T18:37:56.231 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.7319999999999998e-06 2024-09-12T18:37:56.231 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.231 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.231 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:56.231 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490464+0000", 2024-09-12T18:37:56.231 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.4760000000000004e-06 2024-09-12T18:37:56.231 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.231 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.231 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:56.231 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490471+0000", 2024-09-12T18:37:56.232 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.5400000000000001e-06 2024-09-12T18:37:56.232 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.232 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.232 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:56.232 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492695+0000", 2024-09-12T18:37:56.232 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0022245910000000002 2024-09-12T18:37:56.232 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.232 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.232 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:56.232 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492847+0000", 2024-09-12T18:37:56.232 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015127399999999999 2024-09-12T18:37:56.232 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.233 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.233 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:56.233 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492936+0000", 2024-09-12T18:37:56.233 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8953e-05 2024-09-12T18:37:56.233 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.233 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.233 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:56.233 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534614+0000", 2024-09-12T18:37:56.233 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.041678422999999999 2024-09-12T18:37:56.233 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.233 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.234 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:56.234 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534755+0000", 2024-09-12T18:37:56.234 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000140696 2024-09-12T18:37:56.234 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.234 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.234 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:56.234 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536891+0000", 2024-09-12T18:37:56.234 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0021365799999999999 2024-09-12T18:37:56.234 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.234 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.234 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:56.234 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537001+0000", 2024-09-12T18:37:56.234 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000109459 2024-09-12T18:37:56.234 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.235 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.235 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:56.235 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537199+0000", 2024-09-12T18:37:56.235 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019808 2024-09-12T18:37:56.235 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:56.235 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:56.235 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:56.235 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.235 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.235 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201576 5.2 5:42a132e0:::benchmark_data_smithi073_23739_object69299:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:56.235 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.490661+0000", 2024-09-12T18:37:56.235 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 35.644808955000002, 2024-09-12T18:37:56.235 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.041905530000000003, 2024-09-12T18:37:56.235 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:56.236 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:56.236 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:56.236 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:56.236 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:56.236 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:56.236 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201576 2024-09-12T18:37:56.236 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.236 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:56.236 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.236 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:56.236 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490661+0000", 2024-09-12T18:37:56.236 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:56.236 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.237 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.237 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:56.237 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490661+0000", 2024-09-12T18:37:56.237 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:56.237 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.237 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.237 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:56.237 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490662+0000", 2024-09-12T18:37:56.237 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5030000000000001e-06 2024-09-12T18:37:56.237 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.237 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.237 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:56.237 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490667+0000", 2024-09-12T18:37:56.238 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4479999999999996e-06 2024-09-12T18:37:56.238 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.238 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.238 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:56.238 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490675+0000", 2024-09-12T18:37:56.238 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8529999999999992e-06 2024-09-12T18:37:56.238 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.238 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.238 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:56.238 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490680+0000", 2024-09-12T18:37:56.238 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1919999999999996e-06 2024-09-12T18:37:56.238 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.238 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.238 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:56.239 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490730+0000", 2024-09-12T18:37:56.239 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.9738999999999999e-05 2024-09-12T18:37:56.239 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.239 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.239 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:56.239 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490833+0000", 2024-09-12T18:37:56.239 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010333 2024-09-12T18:37:56.239 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.239 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.239 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:56.239 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490930+0000", 2024-09-12T18:37:56.239 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7355999999999994e-05 2024-09-12T18:37:56.239 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.240 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.240 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:56.240 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493735+0000", 2024-09-12T18:37:56.240 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028049329999999999 2024-09-12T18:37:56.240 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.240 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.240 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:56.240 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532451+0000", 2024-09-12T18:37:56.241 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.038715554999999999 2024-09-12T18:37:56.241 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.241 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.241 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:56.241 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532514+0000", 2024-09-12T18:37:56.241 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2885000000000005e-05 2024-09-12T18:37:56.241 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.241 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.241 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:56.242 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532566+0000", 2024-09-12T18:37:56.242 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2735999999999998e-05 2024-09-12T18:37:56.242 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:56.242 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:56.242 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:56.242 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.242 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.242 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201577 5.7 5:e93d4852:::benchmark_data_smithi073_23739_object69300:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:56.242 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.490721+0000", 2024-09-12T18:37:56.243 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 35.644748944, 2024-09-12T18:37:56.243 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.042097930999999998, 2024-09-12T18:37:56.243 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:56.243 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:56.243 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:56.243 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:56.243 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:56.243 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:56.244 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201577 2024-09-12T18:37:56.244 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.244 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:56.244 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.244 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:56.244 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490721+0000", 2024-09-12T18:37:56.244 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:56.244 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.245 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.245 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:56.245 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490721+0000", 2024-09-12T18:37:56.245 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:56.245 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.245 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.245 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:56.245 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490721+0000", 2024-09-12T18:37:56.246 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.1900000000000002e-07 2024-09-12T18:37:56.246 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.246 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.246 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:56.246 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490724+0000", 2024-09-12T18:37:56.246 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.6189999999999998e-06 2024-09-12T18:37:56.248 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.248 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.248 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:56.248 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490731+0000", 2024-09-12T18:37:56.248 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0129999999999996e-06 2024-09-12T18:37:56.248 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.249 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.249 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:56.249 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490736+0000", 2024-09-12T18:37:56.249 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6929999999999998e-06 2024-09-12T18:37:56.249 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.249 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.249 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:56.249 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490788+0000", 2024-09-12T18:37:56.250 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2104000000000001e-05 2024-09-12T18:37:56.250 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.250 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.250 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:56.250 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490926+0000", 2024-09-12T18:37:56.250 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013852800000000001 2024-09-12T18:37:56.250 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.250 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.251 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:56.251 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491061+0000", 2024-09-12T18:37:56.251 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013499700000000001 2024-09-12T18:37:56.251 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.251 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.251 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:56.251 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531660+0000", 2024-09-12T18:37:56.251 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.040599046999999999 2024-09-12T18:37:56.251 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.252 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.252 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:56.252 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532630+0000", 2024-09-12T18:37:56.252 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00096974300000000002 2024-09-12T18:37:56.252 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.252 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.252 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:56.252 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532708+0000", 2024-09-12T18:37:56.253 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8108000000000005e-05 2024-09-12T18:37:56.253 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.253 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.253 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:56.253 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532819+0000", 2024-09-12T18:37:56.253 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011046 2024-09-12T18:37:56.253 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:56.253 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:56.253 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:56.254 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.254 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.254 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201578 5.f 5:f19e206c:::benchmark_data_smithi073_23739_object69301:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:56.254 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.491951+0000", 2024-09-12T18:37:56.254 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 35.643518571000001, 2024-09-12T18:37:56.254 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.043303686000000001, 2024-09-12T18:37:56.254 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:56.254 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:56.255 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:56.255 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:56.255 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:56.255 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:56.255 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201578 2024-09-12T18:37:56.255 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.255 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:56.255 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.255 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:56.256 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491951+0000", 2024-09-12T18:37:56.256 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:56.256 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.256 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.256 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:56.256 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491951+0000", 2024-09-12T18:37:56.256 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:56.256 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.257 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.257 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:56.257 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491952+0000", 2024-09-12T18:37:56.257 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.221e-06 2024-09-12T18:37:56.257 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.257 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.257 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:56.257 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491957+0000", 2024-09-12T18:37:56.257 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.0529999999999997e-06 2024-09-12T18:37:56.257 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.257 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.257 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:56.258 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491970+0000", 2024-09-12T18:37:56.258 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2731000000000001e-05 2024-09-12T18:37:56.258 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.258 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.258 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:56.258 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491977+0000", 2024-09-12T18:37:56.258 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.1380000000000001e-06 2024-09-12T18:37:56.258 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.258 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.258 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:56.258 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492031+0000", 2024-09-12T18:37:56.258 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3857999999999998e-05 2024-09-12T18:37:56.258 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.258 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.259 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:56.259 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492125+0000", 2024-09-12T18:37:56.259 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.3275000000000004e-05 2024-09-12T18:37:56.259 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.259 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.259 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:56.259 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492205+0000", 2024-09-12T18:37:56.259 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.0793999999999999e-05 2024-09-12T18:37:56.259 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.259 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.259 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:56.259 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531712+0000", 2024-09-12T18:37:56.259 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.039506708000000001 2024-09-12T18:37:56.260 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.260 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.260 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:56.260 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535161+0000", 2024-09-12T18:37:56.260 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003448586 2024-09-12T18:37:56.260 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.260 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.260 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:56.260 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535202+0000", 2024-09-12T18:37:56.260 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.0945999999999997e-05 2024-09-12T18:37:56.260 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.260 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.260 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:56.261 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535255+0000", 2024-09-12T18:37:56.261 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3375999999999999e-05 2024-09-12T18:37:56.261 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:56.261 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:56.261 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:56.261 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.261 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.261 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201579 5.5 5:ac64e9fd:::benchmark_data_smithi073_23739_object69302:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:56.261 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.492711+0000", 2024-09-12T18:37:56.261 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 35.642758399999998, 2024-09-12T18:37:56.261 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.04478994, 2024-09-12T18:37:56.261 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:56.261 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:56.262 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:56.262 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:56.262 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:56.262 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:56.262 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201579 2024-09-12T18:37:56.262 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.262 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:56.262 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.262 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:56.262 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492711+0000", 2024-09-12T18:37:56.262 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:56.262 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.262 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.262 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:56.263 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492711+0000", 2024-09-12T18:37:56.263 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:56.263 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.263 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.263 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:56.263 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492713+0000", 2024-09-12T18:37:56.263 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.105e-06 2024-09-12T18:37:56.263 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.263 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.263 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:56.263 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492720+0000", 2024-09-12T18:37:56.263 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.109e-06 2024-09-12T18:37:56.263 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.263 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.264 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:56.264 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492730+0000", 2024-09-12T18:37:56.264 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.049e-05 2024-09-12T18:37:56.264 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.264 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.264 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:56.264 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492737+0000", 2024-09-12T18:37:56.264 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0960000000000003e-06 2024-09-12T18:37:56.264 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.264 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.264 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:56.264 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.494541+0000", 2024-09-12T18:37:56.264 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0018034139999999999 2024-09-12T18:37:56.265 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.265 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.265 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:56.265 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.494692+0000", 2024-09-12T18:37:56.265 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000150956 2024-09-12T18:37:56.265 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.265 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.265 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:56.265 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.494843+0000", 2024-09-12T18:37:56.265 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000151896 2024-09-12T18:37:56.265 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.265 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.265 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:56.266 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534665+0000", 2024-09-12T18:37:56.266 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.039821829000000003 2024-09-12T18:37:56.266 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.266 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.266 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:56.266 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536866+0000", 2024-09-12T18:37:56.266 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0022007839999999999 2024-09-12T18:37:56.266 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.266 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.266 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:56.266 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537212+0000", 2024-09-12T18:37:56.266 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00034636299999999998 2024-09-12T18:37:56.266 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.266 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.266 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:56.267 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537298+0000", 2024-09-12T18:37:56.267 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5970999999999994e-05 2024-09-12T18:37:56.267 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.267 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.267 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:56.267 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537501+0000", 2024-09-12T18:37:56.267 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020292699999999999 2024-09-12T18:37:56.267 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:56.267 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:56.267 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:56.267 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.267 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.267 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201581 5.7 5:e819369d:::benchmark_data_smithi073_23739_object69304:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:56.267 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.493262+0000", 2024-09-12T18:37:56.268 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 35.642208050000001, 2024-09-12T18:37:56.268 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.042091362, 2024-09-12T18:37:56.268 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:56.268 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:56.268 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:56.268 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:56.268 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:56.268 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:56.269 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201581 2024-09-12T18:37:56.269 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.269 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:56.269 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.269 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:56.269 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493262+0000", 2024-09-12T18:37:56.269 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:56.269 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.269 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.269 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:56.269 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493262+0000", 2024-09-12T18:37:56.269 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:56.269 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.269 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.270 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:56.270 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493263+0000", 2024-09-12T18:37:56.270 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.6700000000000003e-07 2024-09-12T18:37:56.270 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.270 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.270 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:56.270 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493266+0000", 2024-09-12T18:37:56.270 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.4850000000000001e-06 2024-09-12T18:37:56.270 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.270 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.270 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:56.270 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493273+0000", 2024-09-12T18:37:56.270 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2019999999999998e-06 2024-09-12T18:37:56.271 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.271 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.271 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:56.271 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493278+0000", 2024-09-12T18:37:56.271 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6210000000000003e-06 2024-09-12T18:37:56.271 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.271 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.271 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:56.271 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493330+0000", 2024-09-12T18:37:56.271 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2587000000000003e-05 2024-09-12T18:37:56.271 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.271 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.271 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:56.271 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493469+0000", 2024-09-12T18:37:56.271 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013901199999999999 2024-09-12T18:37:56.272 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.272 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.272 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:56.272 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493612+0000", 2024-09-12T18:37:56.272 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014237599999999999 2024-09-12T18:37:56.272 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.272 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.272 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:56.272 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531835+0000", 2024-09-12T18:37:56.272 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.038222735000000001 2024-09-12T18:37:56.272 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.272 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.272 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:56.273 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535265+0000", 2024-09-12T18:37:56.273 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003430064 2024-09-12T18:37:56.273 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.273 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.273 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:56.273 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535319+0000", 2024-09-12T18:37:56.273 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4375e-05 2024-09-12T18:37:56.273 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.273 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.273 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:56.273 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535353+0000", 2024-09-12T18:37:56.273 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.4137999999999997e-05 2024-09-12T18:37:56.273 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:56.273 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:56.274 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:56.274 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.274 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.274 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:201573 5.3 e67/21 5:cf4becdf:::benchmark_data_smithi073_23739_object69296:head v 67'12363, mlcod=67'12360)", 2024-09-12T18:37:56.274 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.493437+0000", 2024-09-12T18:37:56.274 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 35.642033114999997, 2024-09-12T18:37:56.274 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.041109664999999997, 2024-09-12T18:37:56.274 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:56.274 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:56.274 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:56.274 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:56.274 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.274 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:56.274 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493437+0000", 2024-09-12T18:37:56.275 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:56.275 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.275 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.275 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:56.275 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493437+0000", 2024-09-12T18:37:56.275 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:56.275 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.275 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.275 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:56.275 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493438+0000", 2024-09-12T18:37:56.275 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.125e-06 2024-09-12T18:37:56.275 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.275 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.275 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:56.276 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493444+0000", 2024-09-12T18:37:56.276 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2269999999999998e-06 2024-09-12T18:37:56.276 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.276 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.276 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:56.276 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493457+0000", 2024-09-12T18:37:56.276 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.312e-05 2024-09-12T18:37:56.276 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.276 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.276 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:56.277 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493466+0000", 2024-09-12T18:37:56.277 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.6309999999999992e-06 2024-09-12T18:37:56.277 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.277 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.277 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:56.277 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493526+0000", 2024-09-12T18:37:56.277 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.0316000000000003e-05 2024-09-12T18:37:56.277 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.277 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.277 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:56.278 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493541+0000", 2024-09-12T18:37:56.278 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4459e-05 2024-09-12T18:37:56.278 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.278 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.278 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:56.278 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534501+0000", 2024-09-12T18:37:56.278 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.040960215000000001 2024-09-12T18:37:56.278 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.278 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.278 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:56.278 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534546+0000", 2024-09-12T18:37:56.278 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.5571999999999997e-05 2024-09-12T18:37:56.278 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:56.278 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:56.279 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:56.279 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.279 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.279 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201582 5.f 5:f90f147f:::benchmark_data_smithi073_23739_object69305:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:56.279 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.493597+0000", 2024-09-12T18:37:56.279 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 35.641872583999998, 2024-09-12T18:37:56.279 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.045457567999999997, 2024-09-12T18:37:56.279 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:56.279 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:56.279 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:56.279 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:56.279 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:56.279 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:56.280 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201582 2024-09-12T18:37:56.280 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.280 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:56.280 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.280 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:56.280 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493597+0000", 2024-09-12T18:37:56.280 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:56.280 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.280 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.280 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:56.280 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493597+0000", 2024-09-12T18:37:56.280 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:56.280 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.280 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.281 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:56.281 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493598+0000", 2024-09-12T18:37:56.281 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7699999999999992e-07 2024-09-12T18:37:56.281 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.281 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.281 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:56.281 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493609+0000", 2024-09-12T18:37:56.281 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1297e-05 2024-09-12T18:37:56.281 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.281 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.281 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:56.281 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493620+0000", 2024-09-12T18:37:56.281 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0930999999999999e-05 2024-09-12T18:37:56.281 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.282 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.282 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:56.282 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493640+0000", 2024-09-12T18:37:56.282 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.0072e-05 2024-09-12T18:37:56.282 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.282 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.282 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:56.282 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531770+0000", 2024-09-12T18:37:56.282 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.038129652999999999 2024-09-12T18:37:56.282 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.282 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.282 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:56.282 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532046+0000", 2024-09-12T18:37:56.283 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027561600000000001 2024-09-12T18:37:56.283 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.283 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.283 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:56.283 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532337+0000", 2024-09-12T18:37:56.283 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00029169200000000003 2024-09-12T18:37:56.283 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.283 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.283 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:56.283 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536640+0000", 2024-09-12T18:37:56.283 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0043023499999999999 2024-09-12T18:37:56.283 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.284 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.284 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:56.284 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.538943+0000", 2024-09-12T18:37:56.284 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0023032740000000001 2024-09-12T18:37:56.284 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.284 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.284 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:56.284 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.539013+0000", 2024-09-12T18:37:56.284 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9944000000000007e-05 2024-09-12T18:37:56.284 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.284 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.284 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:56.284 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.539055+0000", 2024-09-12T18:37:56.284 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.1761999999999998e-05 2024-09-12T18:37:56.285 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:56.285 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:56.285 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:56.285 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.285 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.285 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:201583 5.d e67/21 5:b91eedec:::benchmark_data_smithi073_23739_object69306:head v 67'12761, mlcod=67'12759)", 2024-09-12T18:37:56.285 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.495034+0000", 2024-09-12T18:37:56.285 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 35.640436209000001, 2024-09-12T18:37:56.285 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.047966852999999997, 2024-09-12T18:37:56.285 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:56.285 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:56.285 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:56.285 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:56.285 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.286 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:56.286 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.495034+0000", 2024-09-12T18:37:56.286 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:56.286 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.286 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.286 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:56.286 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.495034+0000", 2024-09-12T18:37:56.286 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:56.286 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.286 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.286 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:56.286 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.495035+0000", 2024-09-12T18:37:56.286 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.023e-06 2024-09-12T18:37:56.286 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.287 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.287 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:56.287 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.495040+0000", 2024-09-12T18:37:56.287 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.9300000000000002e-06 2024-09-12T18:37:56.287 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.287 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.287 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:56.287 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531510+0000", 2024-09-12T18:37:56.287 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.036470250000000003 2024-09-12T18:37:56.287 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.287 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.287 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:56.287 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531518+0000", 2024-09-12T18:37:56.287 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8490000000000006e-06 2024-09-12T18:37:56.288 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.288 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.288 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:56.288 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534395+0000", 2024-09-12T18:37:56.288 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.002877246 2024-09-12T18:37:56.288 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.288 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.288 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:56.288 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534418+0000", 2024-09-12T18:37:56.288 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.3119e-05 2024-09-12T18:37:56.288 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.288 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.288 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:56.288 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.542930+0000", 2024-09-12T18:37:56.289 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0085121929999999995 2024-09-12T18:37:56.289 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:56.289 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:56.289 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:56.289 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.543000+0000", 2024-09-12T18:37:56.289 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0242999999999998e-05 2024-09-12T18:37:56.289 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:56.289 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:56.289 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:56.289 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:56.289 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:56.289 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:56.290 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T18:37:56.291 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'unique_pool_0' removed 2024-09-12T18:37:56.292 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:37:56.295 INFO:teuthology.orchestra.run.smithi073.stdout:moved 0 / 210 (0%) 2024-09-12T18:37:56.295 INFO:teuthology.orchestra.run.smithi073.stdout:avg 70 2024-09-12T18:37:56.295 INFO:teuthology.orchestra.run.smithi073.stdout:stddev 21.3542 -> 21.3542 (expected baseline 6.8313) 2024-09-12T18:37:56.295 INFO:teuthology.orchestra.run.smithi073.stdout:min osd.0 with 40 -> 40 pgs (0.571429 -> 0.571429 * mean) 2024-09-12T18:37:56.295 INFO:teuthology.orchestra.run.smithi073.stdout:max osd.2 with 88 -> 88 pgs (1.25714 -> 1.25714 * mean) 2024-09-12T18:37:56.295 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:37:56.295 INFO:teuthology.orchestra.run.smithi073.stdout:oload 110 2024-09-12T18:37:56.295 INFO:teuthology.orchestra.run.smithi073.stdout:max_change 0.05 2024-09-12T18:37:56.295 INFO:teuthology.orchestra.run.smithi073.stdout:max_change_osds 4 2024-09-12T18:37:56.295 INFO:teuthology.orchestra.run.smithi073.stdout:average_utilization 0.0030 2024-09-12T18:37:56.295 INFO:teuthology.orchestra.run.smithi073.stdout:overload_utilization 0.0033 2024-09-12T18:37:56.296 INFO:teuthology.orchestra.run.smithi073.stderr:no change 2024-09-12T18:37:56.296 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-09-12T18:37:56.285+0000 7f9cfefe1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 23014) UID: 0 2024-09-12T18:37:56.308 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-12T18:37:56.317 INFO:tasks.thrashosds:joining thrashosds 2024-09-12T18:37:56.318 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-09-12T18:37:56.318 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 3.0 2024-09-12T18:37:56.424 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:56.424 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2024-09-12T18:37:56.424 INFO:teuthology.orchestra.run.smithi114.stdout: "num_ops": 0 2024-09-12T18:37:56.425 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:56.438 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:37:56.554 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:56.555 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2024-09-12T18:37:56.555 INFO:teuthology.orchestra.run.smithi114.stdout: "complaint_time": 30, 2024-09-12T18:37:56.555 INFO:teuthology.orchestra.run.smithi114.stdout: "num_blocked_ops": 0 2024-09-12T18:37:56.555 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:56.570 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:37:56.638 INFO:teuthology.orchestra.run.smithi073.stdout:moved 0 / 210 (0%) 2024-09-12T18:37:56.638 INFO:teuthology.orchestra.run.smithi073.stdout:avg 70 2024-09-12T18:37:56.638 INFO:teuthology.orchestra.run.smithi073.stdout:stddev 21.3542 -> 21.3542 (expected baseline 6.8313) 2024-09-12T18:37:56.638 INFO:teuthology.orchestra.run.smithi073.stdout:min osd.0 with 40 -> 40 pgs (0.571429 -> 0.571429 * mean) 2024-09-12T18:37:56.638 INFO:teuthology.orchestra.run.smithi073.stdout:max osd.2 with 88 -> 88 pgs (1.25714 -> 1.25714 * mean) 2024-09-12T18:37:56.638 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:37:56.638 INFO:teuthology.orchestra.run.smithi073.stdout:oload 1000 2024-09-12T18:37:56.638 INFO:teuthology.orchestra.run.smithi073.stdout:max_change 3 2024-09-12T18:37:56.638 INFO:teuthology.orchestra.run.smithi073.stdout:max_change_osds 4 2024-09-12T18:37:56.639 INFO:teuthology.orchestra.run.smithi073.stdout:average_utilization 0.0030 2024-09-12T18:37:56.639 INFO:teuthology.orchestra.run.smithi073.stdout:overload_utilization 0.0298 2024-09-12T18:37:56.639 INFO:teuthology.orchestra.run.smithi073.stderr:no change 2024-09-12T18:37:56.694 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-12T18:37:56.694 INFO:teuthology.orchestra.run.smithi114.stdout: "size": 20, 2024-09-12T18:37:56.694 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 600, 2024-09-12T18:37:56.694 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [ 2024-09-12T18:37:56.694 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.695 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167352 5.a 5:5fc472d2:::benchmark_data_smithi073_23739_object35075:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:56.695 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.163066+0000", 2024-09-12T18:37:56.695 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 53.527523141000003, 2024-09-12T18:37:56.695 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.077708377999999995, 2024-09-12T18:37:56.695 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:56.695 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:56.695 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:56.695 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:56.695 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:56.696 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:56.696 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167352 2024-09-12T18:37:56.696 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.696 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:56.696 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.696 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:56.696 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163066+0000", 2024-09-12T18:37:56.696 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:56.696 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.696 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.697 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:56.697 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163066+0000", 2024-09-12T18:37:56.697 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:56.697 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.697 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.697 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:56.697 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163067+0000", 2024-09-12T18:37:56.697 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0499999999999999e-06 2024-09-12T18:37:56.697 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.697 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.697 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:56.697 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163071+0000", 2024-09-12T18:37:56.697 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4340000000000002e-06 2024-09-12T18:37:56.698 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.698 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.698 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:56.698 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163081+0000", 2024-09-12T18:37:56.698 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0304e-05 2024-09-12T18:37:56.698 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.698 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.698 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:56.698 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163090+0000", 2024-09-12T18:37:56.698 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7309999999999999e-06 2024-09-12T18:37:56.698 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.698 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.698 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:56.698 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163143+0000", 2024-09-12T18:37:56.699 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.2942000000000002e-05 2024-09-12T18:37:56.699 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.699 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.699 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:56.699 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163270+0000", 2024-09-12T18:37:56.699 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00012664100000000001 2024-09-12T18:37:56.699 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.699 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.699 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:56.699 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.163378+0000", 2024-09-12T18:37:56.699 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000107995 2024-09-12T18:37:56.699 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.699 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.699 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:56.700 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234552+0000", 2024-09-12T18:37:56.700 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.071173831000000007 2024-09-12T18:37:56.700 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.700 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.700 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:56.700 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240640+0000", 2024-09-12T18:37:56.700 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.006088909 2024-09-12T18:37:56.700 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.700 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.700 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:56.700 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240709+0000", 2024-09-12T18:37:56.700 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8393999999999996e-05 2024-09-12T18:37:56.700 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.701 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.701 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:56.701 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240774+0000", 2024-09-12T18:37:56.701 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5147000000000005e-05 2024-09-12T18:37:56.701 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:56.701 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:56.701 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:56.701 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.701 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.701 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167358 5.a 5:533f6738:::benchmark_data_smithi073_23739_object35081:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:56.701 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.165639+0000", 2024-09-12T18:37:56.701 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 53.524949864, 2024-09-12T18:37:56.701 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.075287509000000002, 2024-09-12T18:37:56.701 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:56.702 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:56.702 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:56.702 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:56.702 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:56.702 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:56.702 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167358 2024-09-12T18:37:56.702 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.702 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:56.702 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.702 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:56.702 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165639+0000", 2024-09-12T18:37:56.702 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:56.702 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.702 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.703 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:56.703 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165639+0000", 2024-09-12T18:37:56.703 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:56.703 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.703 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.703 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:56.703 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165640+0000", 2024-09-12T18:37:56.703 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1999999999999999e-06 2024-09-12T18:37:56.703 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.703 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.703 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:56.703 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165646+0000", 2024-09-12T18:37:56.703 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4550000000000003e-06 2024-09-12T18:37:56.703 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.704 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.704 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:56.704 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165658+0000", 2024-09-12T18:37:56.704 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2721999999999999e-05 2024-09-12T18:37:56.704 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.704 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.704 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:56.704 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165668+0000", 2024-09-12T18:37:56.704 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.4229999999999994e-06 2024-09-12T18:37:56.704 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.704 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.704 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:56.705 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165711+0000", 2024-09-12T18:37:56.705 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3785999999999997e-05 2024-09-12T18:37:56.705 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.705 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.705 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:56.705 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165788+0000", 2024-09-12T18:37:56.705 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6506000000000002e-05 2024-09-12T18:37:56.705 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.705 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.705 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:56.705 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165862+0000", 2024-09-12T18:37:56.705 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4012999999999998e-05 2024-09-12T18:37:56.705 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.705 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.706 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:56.706 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234718+0000", 2024-09-12T18:37:56.706 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.068856420000000002 2024-09-12T18:37:56.706 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.706 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.706 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:56.706 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240785+0000", 2024-09-12T18:37:56.706 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0060661489999999998 2024-09-12T18:37:56.706 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.706 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.706 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:56.706 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240844+0000", 2024-09-12T18:37:56.706 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9487000000000002e-05 2024-09-12T18:37:56.706 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.707 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.707 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:56.707 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240926+0000", 2024-09-12T18:37:56.707 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2348000000000005e-05 2024-09-12T18:37:56.707 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:56.707 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:56.707 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:56.707 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.707 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.707 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167361 5.a 5:56730f28:::benchmark_data_smithi073_23739_object35084:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:56.707 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.165979+0000", 2024-09-12T18:37:56.707 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 53.524609884, 2024-09-12T18:37:56.707 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.075128337000000003, 2024-09-12T18:37:56.707 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:56.708 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:56.708 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:56.708 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:56.708 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:56.708 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:56.708 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167361 2024-09-12T18:37:56.708 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.708 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:56.708 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.708 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:56.708 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165979+0000", 2024-09-12T18:37:56.708 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:56.708 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.709 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.709 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:56.709 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165979+0000", 2024-09-12T18:37:56.709 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:56.709 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.709 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.709 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:56.709 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165980+0000", 2024-09-12T18:37:56.709 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4499999999999997e-07 2024-09-12T18:37:56.709 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.709 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.709 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:56.709 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165985+0000", 2024-09-12T18:37:56.710 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.186e-06 2024-09-12T18:37:56.710 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.710 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.710 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:56.710 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.165995+0000", 2024-09-12T18:37:56.710 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0378e-05 2024-09-12T18:37:56.710 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.710 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.710 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:56.710 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.166016+0000", 2024-09-12T18:37:56.710 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1316999999999999e-05 2024-09-12T18:37:56.710 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.711 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.711 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:56.711 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.167783+0000", 2024-09-12T18:37:56.711 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017662209999999999 2024-09-12T18:37:56.711 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.711 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.711 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:56.711 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.167851+0000", 2024-09-12T18:37:56.711 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7990000000000005e-05 2024-09-12T18:37:56.711 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.711 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.711 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:56.711 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.167929+0000", 2024-09-12T18:37:56.711 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.8829e-05 2024-09-12T18:37:56.712 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.712 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.712 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:56.712 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234832+0000", 2024-09-12T18:37:56.712 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066902378999999998 2024-09-12T18:37:56.712 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.712 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.712 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:56.712 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.240941+0000", 2024-09-12T18:37:56.712 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0061087470000000003 2024-09-12T18:37:56.712 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.712 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.713 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:56.713 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241053+0000", 2024-09-12T18:37:56.713 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00011197299999999999 2024-09-12T18:37:56.713 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.713 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.713 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:56.713 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241107+0000", 2024-09-12T18:37:56.713 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.4672000000000001e-05 2024-09-12T18:37:56.713 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:56.713 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:56.713 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:56.713 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.713 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.714 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167362 5.3 5:cbd73b47:::benchmark_data_smithi073_23739_object35085:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:56.714 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:56.714 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 53.522513169, 2024-09-12T18:37:56.714 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.067202411000000004, 2024-09-12T18:37:56.714 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:56.714 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:56.714 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:56.714 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:56.714 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:56.714 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:56.714 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167362 2024-09-12T18:37:56.714 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.714 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:56.714 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.715 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:56.715 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:56.715 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:56.715 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.715 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.715 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:56.715 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:56.715 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:56.715 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.715 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.715 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:56.715 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168076+0000", 2024-09-12T18:37:56.715 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.3600000000000003e-07 2024-09-12T18:37:56.715 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.716 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.716 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:56.716 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168079+0000", 2024-09-12T18:37:56.716 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7949999999999999e-06 2024-09-12T18:37:56.716 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.716 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.716 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:56.716 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168085+0000", 2024-09-12T18:37:56.716 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2110000000000003e-06 2024-09-12T18:37:56.716 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.716 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.716 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:56.716 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168089+0000", 2024-09-12T18:37:56.717 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0840000000000002e-06 2024-09-12T18:37:56.717 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.717 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.717 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:56.717 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168121+0000", 2024-09-12T18:37:56.717 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.1489000000000003e-05 2024-09-12T18:37:56.717 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.717 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.717 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:56.717 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168186+0000", 2024-09-12T18:37:56.717 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.5313000000000003e-05 2024-09-12T18:37:56.717 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.717 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.717 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:56.718 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168242+0000", 2024-09-12T18:37:56.718 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5560999999999999e-05 2024-09-12T18:37:56.718 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.718 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.718 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:56.718 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234467+0000", 2024-09-12T18:37:56.718 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066225424000000005 2024-09-12T18:37:56.718 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.718 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.718 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:56.718 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235088+0000", 2024-09-12T18:37:56.718 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00062118999999999998 2024-09-12T18:37:56.718 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.718 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.719 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:56.719 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235197+0000", 2024-09-12T18:37:56.719 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00010825899999999999 2024-09-12T18:37:56.719 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.719 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.719 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:56.719 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235278+0000", 2024-09-12T18:37:56.719 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1448999999999999e-05 2024-09-12T18:37:56.719 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:56.719 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:56.719 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:56.719 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.719 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.720 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167366 5.a 5:58e6a467:::benchmark_data_smithi073_23739_object35089:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:56.720 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168263+0000", 2024-09-12T18:37:56.720 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 53.522325631999998, 2024-09-12T18:37:56.720 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.078184744, 2024-09-12T18:37:56.720 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:56.720 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:56.720 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:56.720 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:56.720 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:56.720 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:56.720 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167366 2024-09-12T18:37:56.720 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.720 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:56.720 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.721 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:56.721 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168263+0000", 2024-09-12T18:37:56.721 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:56.721 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.721 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.721 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:56.721 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168263+0000", 2024-09-12T18:37:56.721 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:56.721 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.721 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.721 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:56.721 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168264+0000", 2024-09-12T18:37:56.721 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5700000000000002e-07 2024-09-12T18:37:56.722 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.722 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.722 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:56.722 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168266+0000", 2024-09-12T18:37:56.722 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.1789999999999998e-06 2024-09-12T18:37:56.722 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.722 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.722 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:56.722 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168271+0000", 2024-09-12T18:37:56.722 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8160000000000001e-06 2024-09-12T18:37:56.722 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.722 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.722 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:56.722 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168275+0000", 2024-09-12T18:37:56.723 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4440000000000001e-06 2024-09-12T18:37:56.723 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.723 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.723 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:56.723 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170082+0000", 2024-09-12T18:37:56.723 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0018068800000000001 2024-09-12T18:37:56.723 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.723 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.723 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:56.723 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170154+0000", 2024-09-12T18:37:56.723 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.1575000000000005e-05 2024-09-12T18:37:56.723 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.723 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.723 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:56.724 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170216+0000", 2024-09-12T18:37:56.724 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.1989999999999994e-05 2024-09-12T18:37:56.724 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.724 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.724 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:56.724 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234933+0000", 2024-09-12T18:37:56.724 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064717514000000004 2024-09-12T18:37:56.724 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.724 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.724 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:56.724 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246226+0000", 2024-09-12T18:37:56.724 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011293151 2024-09-12T18:37:56.724 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.725 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.725 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:56.725 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246338+0000", 2024-09-12T18:37:56.725 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00011225 2024-09-12T18:37:56.725 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.725 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.725 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:56.725 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246448+0000", 2024-09-12T18:37:56.725 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000109388 2024-09-12T18:37:56.725 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:56.725 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:56.725 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:56.725 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.726 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.726 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167367 5.a 5:51778d97:::benchmark_data_smithi073_23739_object35090:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:56.726 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168388+0000", 2024-09-12T18:37:56.726 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 53.522200388000002, 2024-09-12T18:37:56.726 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.082583860999999995, 2024-09-12T18:37:56.726 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:56.726 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:56.726 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:56.726 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:56.726 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:56.726 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:56.726 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167367 2024-09-12T18:37:56.726 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.726 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:56.727 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.727 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:56.727 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168388+0000", 2024-09-12T18:37:56.727 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:56.727 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.727 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.727 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:56.727 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168388+0000", 2024-09-12T18:37:56.727 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:56.727 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.727 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.727 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:56.727 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168389+0000", 2024-09-12T18:37:56.728 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1099999999999996e-07 2024-09-12T18:37:56.728 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.728 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.728 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:56.728 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168391+0000", 2024-09-12T18:37:56.728 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.39e-06 2024-09-12T18:37:56.728 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.728 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.728 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:56.728 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168396+0000", 2024-09-12T18:37:56.728 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3460000000000004e-06 2024-09-12T18:37:56.728 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.728 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.729 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:56.729 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168399+0000", 2024-09-12T18:37:56.729 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.613e-06 2024-09-12T18:37:56.729 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.729 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.729 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:56.729 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235003+0000", 2024-09-12T18:37:56.729 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066603851000000006 2024-09-12T18:37:56.729 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.729 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.729 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:56.729 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235266+0000", 2024-09-12T18:37:56.729 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00026270999999999998 2024-09-12T18:37:56.729 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.730 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.730 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:56.730 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235510+0000", 2024-09-12T18:37:56.730 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00024394 2024-09-12T18:37:56.730 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.730 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.730 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:56.730 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246546+0000", 2024-09-12T18:37:56.730 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.011035774 2024-09-12T18:37:56.730 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.730 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.730 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:56.730 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.250808+0000", 2024-09-12T18:37:56.731 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0042622700000000003 2024-09-12T18:37:56.731 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.731 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.731 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:56.731 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.250890+0000", 2024-09-12T18:37:56.731 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.1874999999999998e-05 2024-09-12T18:37:56.731 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.731 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.731 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:56.731 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.250972+0000", 2024-09-12T18:37:56.731 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2581000000000001e-05 2024-09-12T18:37:56.731 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:56.731 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:56.732 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:56.732 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.732 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.732 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167370 5.a 5:5aab9477:::benchmark_data_smithi073_23739_object35093:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:56.732 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168603+0000", 2024-09-12T18:37:56.732 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 53.521985452999999, 2024-09-12T18:37:56.732 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.086603794999999997, 2024-09-12T18:37:56.732 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:56.732 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:56.732 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:56.732 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:56.732 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:56.732 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:56.732 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167370 2024-09-12T18:37:56.733 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.733 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:56.733 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.733 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:56.733 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168603+0000", 2024-09-12T18:37:56.733 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:56.733 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.733 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.733 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:56.733 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168603+0000", 2024-09-12T18:37:56.733 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:56.733 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.733 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.733 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:56.734 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168604+0000", 2024-09-12T18:37:56.734 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.1899999999999998e-07 2024-09-12T18:37:56.734 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.734 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.734 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:56.734 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168606+0000", 2024-09-12T18:37:56.734 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.8309999999999999e-06 2024-09-12T18:37:56.734 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.734 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.734 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:56.734 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168610+0000", 2024-09-12T18:37:56.734 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8069999999999999e-06 2024-09-12T18:37:56.734 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.735 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.735 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:56.735 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168613+0000", 2024-09-12T18:37:56.735 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.118e-06 2024-09-12T18:37:56.735 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.735 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.735 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:56.735 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241145+0000", 2024-09-12T18:37:56.735 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.072531678000000002 2024-09-12T18:37:56.735 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.735 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.735 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:56.735 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241342+0000", 2024-09-12T18:37:56.735 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00019635900000000001 2024-09-12T18:37:56.735 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.736 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.736 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:56.736 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.241483+0000", 2024-09-12T18:37:56.736 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00014161100000000001 2024-09-12T18:37:56.736 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.736 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.736 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:56.736 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255039+0000", 2024-09-12T18:37:56.736 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.013555724 2024-09-12T18:37:56.736 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.736 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.736 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:56.736 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255062+0000", 2024-09-12T18:37:56.737 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.3042000000000001e-05 2024-09-12T18:37:56.737 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.737 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.737 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:56.737 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255143+0000", 2024-09-12T18:37:56.737 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.0999000000000002e-05 2024-09-12T18:37:56.737 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.737 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.737 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:56.737 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.255207+0000", 2024-09-12T18:37:56.737 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.4207000000000004e-05 2024-09-12T18:37:56.737 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:56.737 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:56.738 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:56.738 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.738 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.738 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167352 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:56.738 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:56.738 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 53.521860799000002, 2024-09-12T18:37:56.738 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065859953999999998, 2024-09-12T18:37:56.738 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:56.738 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:56.738 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:56.738 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:56.738 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.738 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:56.738 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:56.739 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:56.739 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.739 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.739 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:56.739 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:56.739 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:56.739 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.739 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.739 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:56.739 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168728+0000", 2024-09-12T18:37:56.739 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.0800000000000001e-07 2024-09-12T18:37:56.740 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.740 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.740 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:56.740 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168730+0000", 2024-09-12T18:37:56.740 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.6530000000000001e-06 2024-09-12T18:37:56.740 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.740 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.740 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:56.740 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168734+0000", 2024-09-12T18:37:56.741 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.721e-06 2024-09-12T18:37:56.741 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.741 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.741 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:56.741 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168736+0000", 2024-09-12T18:37:56.741 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.508e-06 2024-09-12T18:37:56.741 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.741 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.741 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:56.741 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171951+0000", 2024-09-12T18:37:56.741 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.003215281 2024-09-12T18:37:56.741 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.741 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.741 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:56.742 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234520+0000", 2024-09-12T18:37:56.742 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062568676000000004 2024-09-12T18:37:56.742 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.742 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.742 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:56.742 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234588+0000", 2024-09-12T18:37:56.742 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7806999999999996e-05 2024-09-12T18:37:56.742 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:56.742 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:56.742 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:56.742 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.742 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.743 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167368 5.4 e58/21 5:29a1ec58:::benchmark_data_smithi073_23739_object35091:head v 58'10399, mlcod=58'10396)", 2024-09-12T18:37:56.743 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:56.743 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 53.521737782000002, 2024-09-12T18:37:56.743 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.066008885000000003, 2024-09-12T18:37:56.743 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:56.743 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:56.743 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:56.743 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:56.743 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.743 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:56.743 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:56.743 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:56.743 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.743 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.744 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:56.744 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:56.744 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:56.744 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.744 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.744 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:56.744 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168851+0000", 2024-09-12T18:37:56.744 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4699999999999998e-07 2024-09-12T18:37:56.744 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.744 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.744 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:56.744 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168854+0000", 2024-09-12T18:37:56.745 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.3180000000000001e-06 2024-09-12T18:37:56.745 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.745 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.745 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:56.745 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168858+0000", 2024-09-12T18:37:56.745 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2799999999999997e-06 2024-09-12T18:37:56.745 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.745 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.745 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:56.745 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168861+0000", 2024-09-12T18:37:56.745 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7650000000000002e-06 2024-09-12T18:37:56.745 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.745 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.746 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:56.746 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168895+0000", 2024-09-12T18:37:56.746 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4533999999999998e-05 2024-09-12T18:37:56.746 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.746 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.746 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:56.746 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.168906+0000", 2024-09-12T18:37:56.746 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0910000000000001e-05 2024-09-12T18:37:56.746 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.746 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.746 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:56.746 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234784+0000", 2024-09-12T18:37:56.746 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065877656000000007 2024-09-12T18:37:56.746 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.747 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.747 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:56.747 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234860+0000", 2024-09-12T18:37:56.747 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.6174999999999995e-05 2024-09-12T18:37:56.747 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:56.747 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:56.747 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:56.747 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.747 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.747 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167358 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:56.747 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.170373+0000", 2024-09-12T18:37:56.747 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 53.520215501000003, 2024-09-12T18:37:56.747 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064370201000000002, 2024-09-12T18:37:56.747 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:56.748 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:56.748 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:56.748 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:56.748 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.748 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:56.748 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170373+0000", 2024-09-12T18:37:56.748 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:56.748 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.748 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.748 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:56.748 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170373+0000", 2024-09-12T18:37:56.748 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:56.748 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.749 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.749 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:56.749 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170374+0000", 2024-09-12T18:37:56.749 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.5799999999999998e-07 2024-09-12T18:37:56.749 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.749 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.749 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:56.749 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170378+0000", 2024-09-12T18:37:56.749 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.732e-06 2024-09-12T18:37:56.749 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.749 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.749 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:56.749 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170388+0000", 2024-09-12T18:37:56.750 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.0212e-05 2024-09-12T18:37:56.750 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.750 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.750 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:56.750 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.170397+0000", 2024-09-12T18:37:56.750 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.7090000000000008e-06 2024-09-12T18:37:56.750 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.750 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.750 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:56.750 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234682+0000", 2024-09-12T18:37:56.750 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064285518999999999 2024-09-12T18:37:56.750 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.750 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.750 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:56.750 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234703+0000", 2024-09-12T18:37:56.751 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.0199000000000001e-05 2024-09-12T18:37:56.751 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.751 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.751 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:56.751 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234743+0000", 2024-09-12T18:37:56.751 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.0972e-05 2024-09-12T18:37:56.751 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:56.751 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:56.751 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:56.751 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.751 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.751 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:167372 5.c 5:398d36a7:::benchmark_data_smithi073_23739_object35095:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:56.751 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171066+0000", 2024-09-12T18:37:56.751 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 53.519522289000001, 2024-09-12T18:37:56.752 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065889534999999999, 2024-09-12T18:37:56.752 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:56.752 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:56.752 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:56.752 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:56.752 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:56.752 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:56.752 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 167372 2024-09-12T18:37:56.752 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.752 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:56.752 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.752 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:56.752 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171066+0000", 2024-09-12T18:37:56.753 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:56.753 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.753 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.753 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:56.753 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171066+0000", 2024-09-12T18:37:56.753 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:56.753 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.753 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.753 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:56.753 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171068+0000", 2024-09-12T18:37:56.753 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.186e-06 2024-09-12T18:37:56.753 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.753 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.754 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:56.754 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171072+0000", 2024-09-12T18:37:56.754 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3560000000000003e-06 2024-09-12T18:37:56.754 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.754 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.754 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:56.754 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171082+0000", 2024-09-12T18:37:56.754 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.9739999999999997e-06 2024-09-12T18:37:56.754 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.754 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.754 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:56.754 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171089+0000", 2024-09-12T18:37:56.754 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.7159999999999997e-06 2024-09-12T18:37:56.755 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.755 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.755 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:56.755 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171133+0000", 2024-09-12T18:37:56.755 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4091999999999997e-05 2024-09-12T18:37:56.755 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.755 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.755 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:56.755 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171221+0000", 2024-09-12T18:37:56.755 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.8108000000000004e-05 2024-09-12T18:37:56.755 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.755 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.755 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:56.756 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171279+0000", 2024-09-12T18:37:56.756 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.8062000000000001e-05 2024-09-12T18:37:56.756 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.756 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.756 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:56.756 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.235007+0000", 2024-09-12T18:37:56.756 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.063727849000000003 2024-09-12T18:37:56.756 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.756 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.756 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:56.756 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236790+0000", 2024-09-12T18:37:56.756 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0017829269999999999 2024-09-12T18:37:56.756 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.757 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.757 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:56.757 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236881+0000", 2024-09-12T18:37:56.757 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.1347999999999993e-05 2024-09-12T18:37:56.757 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.757 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.757 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:56.757 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236956+0000", 2024-09-12T18:37:56.757 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.4917000000000001e-05 2024-09-12T18:37:56.757 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:56.757 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:56.758 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:56.758 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.758 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.758 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167371 5.4 e58/21 5:24fea27c:::benchmark_data_smithi073_23739_object35094:head v 58'10400, mlcod=58'10397)", 2024-09-12T18:37:56.758 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171273+0000", 2024-09-12T18:37:56.758 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 53.519315714999998, 2024-09-12T18:37:56.758 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065500368000000003, 2024-09-12T18:37:56.758 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:56.758 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:56.758 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:56.758 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:56.758 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.758 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:56.759 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171273+0000", 2024-09-12T18:37:56.759 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:56.759 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.759 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.759 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:56.759 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171273+0000", 2024-09-12T18:37:56.759 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:56.759 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.759 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.759 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:56.759 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171274+0000", 2024-09-12T18:37:56.759 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.0399999999999996e-07 2024-09-12T18:37:56.759 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.759 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.760 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:56.760 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171277+0000", 2024-09-12T18:37:56.760 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8689999999999997e-06 2024-09-12T18:37:56.760 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.760 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.760 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:56.760 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171284+0000", 2024-09-12T18:37:56.760 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.2879999999999998e-06 2024-09-12T18:37:56.760 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.760 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.760 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:56.760 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171289+0000", 2024-09-12T18:37:56.760 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.9049999999999996e-06 2024-09-12T18:37:56.761 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.761 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.761 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:56.761 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171322+0000", 2024-09-12T18:37:56.761 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.3781000000000001e-05 2024-09-12T18:37:56.761 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.761 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.761 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:56.761 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171335+0000", 2024-09-12T18:37:56.761 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.2639999999999999e-05 2024-09-12T18:37:56.761 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.761 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.761 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:56.762 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236691+0000", 2024-09-12T18:37:56.762 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065355835000000001 2024-09-12T18:37:56.762 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.762 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.762 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:56.762 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236773+0000", 2024-09-12T18:37:56.762 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.2546000000000006e-05 2024-09-12T18:37:56.762 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:56.762 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:56.762 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:56.762 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.762 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.762 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167364 5.7 e58/21 5:ee50096a:::benchmark_data_smithi073_23739_object35087:head v 58'10504, mlcod=58'10502)", 2024-09-12T18:37:56.762 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171598+0000", 2024-09-12T18:37:56.763 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 53.518990596000002, 2024-09-12T18:37:56.763 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065149069000000004, 2024-09-12T18:37:56.763 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:56.763 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:56.763 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:56.763 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:56.763 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.763 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:56.763 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171598+0000", 2024-09-12T18:37:56.763 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:56.763 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.763 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.763 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:56.763 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171598+0000", 2024-09-12T18:37:56.764 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:56.764 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.764 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.764 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:56.764 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171599+0000", 2024-09-12T18:37:56.764 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6700000000000003e-07 2024-09-12T18:37:56.764 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.764 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.764 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:56.764 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171602+0000", 2024-09-12T18:37:56.764 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.841e-06 2024-09-12T18:37:56.764 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.764 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.765 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:56.765 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171608+0000", 2024-09-12T18:37:56.765 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9259999999999997e-06 2024-09-12T18:37:56.765 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.765 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.765 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:56.765 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171611+0000", 2024-09-12T18:37:56.765 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.9450000000000003e-06 2024-09-12T18:37:56.765 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.765 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.765 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:56.765 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171650+0000", 2024-09-12T18:37:56.765 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.8464000000000003e-05 2024-09-12T18:37:56.765 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.766 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.766 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:56.766 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171662+0000", 2024-09-12T18:37:56.766 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.1603999999999999e-05 2024-09-12T18:37:56.766 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.766 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.766 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:56.766 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236663+0000", 2024-09-12T18:37:56.766 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065001330999999996 2024-09-12T18:37:56.766 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.766 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.766 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:56.766 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236747+0000", 2024-09-12T18:37:56.766 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 8.4390999999999999e-05 2024-09-12T18:37:56.767 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:56.767 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:56.767 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:56.767 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.767 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.767 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167365 5.2 e58/21 5:4107875c:::benchmark_data_smithi073_23739_object35088:head v 58'10351, mlcod=58'10349)", 2024-09-12T18:37:56.767 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171733+0000", 2024-09-12T18:37:56.767 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 53.518855551000001, 2024-09-12T18:37:56.767 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.074804168000000004, 2024-09-12T18:37:56.767 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:56.767 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:56.767 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:56.767 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:56.767 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.768 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:56.768 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171733+0000", 2024-09-12T18:37:56.768 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:56.768 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.768 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.768 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:56.768 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171733+0000", 2024-09-12T18:37:56.768 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:56.768 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.768 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.768 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:56.768 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171734+0000", 2024-09-12T18:37:56.768 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.9299999999999998e-07 2024-09-12T18:37:56.769 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.769 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.769 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:56.769 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171738+0000", 2024-09-12T18:37:56.769 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.301e-06 2024-09-12T18:37:56.769 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.769 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.769 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:56.769 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171746+0000", 2024-09-12T18:37:56.769 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.554e-06 2024-09-12T18:37:56.769 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.769 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.769 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:56.770 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171751+0000", 2024-09-12T18:37:56.770 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.1880000000000001e-06 2024-09-12T18:37:56.770 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.770 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.770 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:56.770 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234659+0000", 2024-09-12T18:37:56.770 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062907807999999996 2024-09-12T18:37:56.770 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.770 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.770 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:56.770 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234708+0000", 2024-09-12T18:37:56.770 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.8992000000000001e-05 2024-09-12T18:37:56.770 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.770 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.771 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:56.771 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246457+0000", 2024-09-12T18:37:56.771 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.01174974 2024-09-12T18:37:56.771 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.771 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.771 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:56.771 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.246537+0000", 2024-09-12T18:37:56.771 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.9992000000000003e-05 2024-09-12T18:37:56.771 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:56.771 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:56.771 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:56.771 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.771 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.771 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167373 5.5 e58/49 5:ad283029:::benchmark_data_smithi073_23739_object35096:head v 58'10600, mlcod=58'10598)", 2024-09-12T18:37:56.772 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:56.772 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 53.518828067000001, 2024-09-12T18:37:56.772 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.065058240000000003, 2024-09-12T18:37:56.772 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:56.772 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:56.772 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:56.772 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:56.772 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.772 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:56.772 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:56.772 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:56.772 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.772 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.773 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:56.773 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:56.773 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:56.773 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.773 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.773 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:56.773 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171761+0000", 2024-09-12T18:37:56.773 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.2899999999999999e-07 2024-09-12T18:37:56.773 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.773 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.773 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:56.773 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171764+0000", 2024-09-12T18:37:56.773 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7310000000000002e-06 2024-09-12T18:37:56.773 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.774 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.774 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:56.774 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171769+0000", 2024-09-12T18:37:56.774 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.079e-06 2024-09-12T18:37:56.774 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.774 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.774 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:56.774 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171774+0000", 2024-09-12T18:37:56.774 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.48e-06 2024-09-12T18:37:56.774 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.774 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.774 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:56.774 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171819+0000", 2024-09-12T18:37:56.774 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.4391999999999998e-05 2024-09-12T18:37:56.775 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.775 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.775 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:56.775 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171841+0000", 2024-09-12T18:37:56.775 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.2245000000000001e-05 2024-09-12T18:37:56.775 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.775 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.775 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:56.775 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236750+0000", 2024-09-12T18:37:56.775 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.064909123999999999 2024-09-12T18:37:56.775 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.775 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.775 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:56.776 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.236819+0000", 2024-09-12T18:37:56.776 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.8860000000000001e-05 2024-09-12T18:37:56.776 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:56.776 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:56.776 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:56.776 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.776 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.776 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167361 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:56.776 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:56.776 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 53.518772161000001, 2024-09-12T18:37:56.776 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.063049426000000006, 2024-09-12T18:37:56.776 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:56.776 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:56.776 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:56.777 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:56.777 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.777 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:56.777 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:56.777 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:56.777 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.777 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.777 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:56.777 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:56.777 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:56.777 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.777 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.777 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:56.777 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171817+0000", 2024-09-12T18:37:56.778 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.9099999999999999e-07 2024-09-12T18:37:56.778 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.778 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.778 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:56.778 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171820+0000", 2024-09-12T18:37:56.778 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.5900000000000002e-06 2024-09-12T18:37:56.778 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.778 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.778 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:56.778 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171826+0000", 2024-09-12T18:37:56.778 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 6.64e-06 2024-09-12T18:37:56.778 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.778 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.779 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:56.779 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.171831+0000", 2024-09-12T18:37:56.779 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.578e-06 2024-09-12T18:37:56.779 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.779 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.779 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:56.779 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234808+0000", 2024-09-12T18:37:56.779 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062976780999999996 2024-09-12T18:37:56.779 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.779 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.779 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:56.779 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234821+0000", 2024-09-12T18:37:56.779 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3002e-05 2024-09-12T18:37:56.779 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.780 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.780 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:56.780 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234866+0000", 2024-09-12T18:37:56.780 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.5444000000000001e-05 2024-09-12T18:37:56.780 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:56.780 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:56.780 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:56.780 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.780 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.780 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop_reply(client.4480.0:167366 5.a e58/21 ondisk, result = 0)", 2024-09-12T18:37:56.780 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.172133+0000", 2024-09-12T18:37:56.780 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 53.518455332999999, 2024-09-12T18:37:56.780 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062815840999999997, 2024-09-12T18:37:56.780 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:56.781 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:56.781 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "started", 2024-09-12T18:37:56.781 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:56.781 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.781 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:56.781 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172133+0000", 2024-09-12T18:37:56.781 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:56.781 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.781 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.781 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:56.781 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172133+0000", 2024-09-12T18:37:56.781 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:56.782 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.782 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.782 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:56.782 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172134+0000", 2024-09-12T18:37:56.782 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.5000000000000003e-07 2024-09-12T18:37:56.782 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.782 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.782 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:56.782 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.172137+0000", 2024-09-12T18:37:56.782 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.6460000000000002e-06 2024-09-12T18:37:56.782 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.782 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.782 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:56.783 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234511+0000", 2024-09-12T18:37:56.783 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062374603000000001 2024-09-12T18:37:56.783 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.783 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.783 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:56.783 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234525+0000", 2024-09-12T18:37:56.783 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3396e-05 2024-09-12T18:37:56.783 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.783 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.783 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:56.783 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234909+0000", 2024-09-12T18:37:56.783 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00038405299999999998 2024-09-12T18:37:56.783 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.783 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.784 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:56.784 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234922+0000", 2024-09-12T18:37:56.784 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.3274e-05 2024-09-12T18:37:56.784 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.784 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.784 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:56.784 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234949+0000", 2024-09-12T18:37:56.784 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.7319000000000001e-05 2024-09-12T18:37:56.784 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:56.784 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:56.784 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:56.784 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.784 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.785 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_repop(client.4480.0:167369 5.7 e58/21 5:e64ecabd:::benchmark_data_smithi073_23739_object35092:head v 58'10505, mlcod=58'10502)", 2024-09-12T18:37:56.785 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:56.785 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 53.516924940999999, 2024-09-12T18:37:56.785 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.063873773999999994, 2024-09-12T18:37:56.785 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:56.785 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:56.785 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:56.785 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:56.785 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.785 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:56.785 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:56.785 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:56.785 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.785 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.786 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:56.786 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:56.786 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:56.786 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.786 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.786 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:56.786 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173664+0000", 2024-09-12T18:37:56.786 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3500000000000002e-07 2024-09-12T18:37:56.786 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.786 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.786 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:56.786 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.173668+0000", 2024-09-12T18:37:56.786 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.4000000000000001e-06 2024-09-12T18:37:56.786 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.787 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.787 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:56.787 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234583+0000", 2024-09-12T18:37:56.787 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.060914889 2024-09-12T18:37:56.787 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.787 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.787 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:56.787 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234600+0000", 2024-09-12T18:37:56.787 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.7192000000000001e-05 2024-09-12T18:37:56.787 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.787 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.787 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:56.787 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234791+0000", 2024-09-12T18:37:56.787 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00019115000000000001 2024-09-12T18:37:56.788 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.788 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.788 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:56.788 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.234834+0000", 2024-09-12T18:37:56.788 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.3296e-05 2024-09-12T18:37:56.788 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.788 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.788 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:56.788 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.237481+0000", 2024-09-12T18:37:56.788 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0026472050000000001 2024-09-12T18:37:56.788 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.788 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.788 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:56.789 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:03.237538+0000", 2024-09-12T18:37:56.789 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 5.6206999999999999e-05 2024-09-12T18:37:56.789 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:56.789 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:56.789 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:56.789 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.789 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.789 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:238478 5.c 5:38260ae8:::benchmark_data_smithi073_23739_object106201:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:56.789 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:38.617167+0000", 2024-09-12T18:37:56.789 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 18.073421523, 2024-09-12T18:37:56.789 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.062584934999999994, 2024-09-12T18:37:56.789 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:56.789 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:56.789 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:56.790 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:56.790 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:56.790 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:56.790 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 238478 2024-09-12T18:37:56.790 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.790 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:56.790 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.790 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:56.790 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.617167+0000", 2024-09-12T18:37:56.790 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:56.790 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.790 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.790 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:56.791 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.617167+0000", 2024-09-12T18:37:56.791 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:56.791 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.791 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.791 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:56.791 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.617168+0000", 2024-09-12T18:37:56.791 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 1.091e-06 2024-09-12T18:37:56.791 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.791 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.791 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:56.791 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.617173+0000", 2024-09-12T18:37:56.791 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 4.2490000000000003e-06 2024-09-12T18:37:56.791 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.791 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.792 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:56.792 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.617182+0000", 2024-09-12T18:37:56.792 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.6390000000000004e-06 2024-09-12T18:37:56.792 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.792 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.792 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:56.792 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.617189+0000", 2024-09-12T18:37:56.792 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.0119999999999999e-06 2024-09-12T18:37:56.792 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.792 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.792 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:56.792 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.617678+0000", 2024-09-12T18:37:56.792 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00048910800000000003 2024-09-12T18:37:56.792 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.793 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.793 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:56.793 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.665641+0000", 2024-09-12T18:37:56.793 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.047962481000000001 2024-09-12T18:37:56.793 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.793 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.793 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:56.793 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.665895+0000", 2024-09-12T18:37:56.793 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.00025440199999999998 2024-09-12T18:37:56.793 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.793 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.793 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:56.793 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.670817+0000", 2024-09-12T18:37:56.793 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0049221120000000002 2024-09-12T18:37:56.794 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.794 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.794 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:56.794 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.679695+0000", 2024-09-12T18:37:56.794 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0088778269999999996 2024-09-12T18:37:56.794 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.794 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.794 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:56.794 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.679726+0000", 2024-09-12T18:37:56.794 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.0830999999999997e-05 2024-09-12T18:37:56.794 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.794 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.794 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:56.794 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.679752+0000", 2024-09-12T18:37:56.795 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.6183e-05 2024-09-12T18:37:56.795 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:56.795 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:56.795 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:56.795 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.795 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.795 INFO:teuthology.orchestra.run.smithi114.stdout: "description": "osd_op(client.4480.0:238480 5.c 5:3d043cef:::benchmark_data_smithi073_23739_object106203:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:56.795 INFO:teuthology.orchestra.run.smithi114.stdout: "initiated_at": "2024-09-12T18:37:38.618189+0000", 2024-09-12T18:37:56.795 INFO:teuthology.orchestra.run.smithi114.stdout: "age": 18.072399717, 2024-09-12T18:37:56.795 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.061642400999999999, 2024-09-12T18:37:56.795 INFO:teuthology.orchestra.run.smithi114.stdout: "continuous": false, 2024-09-12T18:37:56.795 INFO:teuthology.orchestra.run.smithi114.stdout: "type_data": { 2024-09-12T18:37:56.795 INFO:teuthology.orchestra.run.smithi114.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:56.796 INFO:teuthology.orchestra.run.smithi114.stdout: "client_info": { 2024-09-12T18:37:56.796 INFO:teuthology.orchestra.run.smithi114.stdout: "client": "client.4480", 2024-09-12T18:37:56.796 INFO:teuthology.orchestra.run.smithi114.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:56.796 INFO:teuthology.orchestra.run.smithi114.stdout: "tid": 238480 2024-09-12T18:37:56.796 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.796 INFO:teuthology.orchestra.run.smithi114.stdout: "events": [ 2024-09-12T18:37:56.796 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.796 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "initiated", 2024-09-12T18:37:56.796 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.618189+0000", 2024-09-12T18:37:56.796 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:56.796 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.796 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.797 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "header_read", 2024-09-12T18:37:56.797 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.618189+0000", 2024-09-12T18:37:56.797 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0 2024-09-12T18:37:56.797 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.797 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.797 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "throttled", 2024-09-12T18:37:56.797 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.618190+0000", 2024-09-12T18:37:56.797 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 7.3e-07 2024-09-12T18:37:56.797 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.797 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.797 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "all_read", 2024-09-12T18:37:56.797 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.618193+0000", 2024-09-12T18:37:56.797 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.6349999999999999e-06 2024-09-12T18:37:56.797 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.798 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.798 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "dispatched", 2024-09-12T18:37:56.798 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.665526+0000", 2024-09-12T18:37:56.798 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.047332200999999997 2024-09-12T18:37:56.798 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.798 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.798 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "queued_for_pg", 2024-09-12T18:37:56.798 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.665561+0000", 2024-09-12T18:37:56.798 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 3.5858999999999997e-05 2024-09-12T18:37:56.798 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.798 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.798 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "reached_pg", 2024-09-12T18:37:56.798 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.670869+0000", 2024-09-12T18:37:56.798 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0053076720000000003 2024-09-12T18:37:56.799 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.799 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.799 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "started", 2024-09-12T18:37:56.799 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.671094+0000", 2024-09-12T18:37:56.799 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000225009 2024-09-12T18:37:56.799 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.799 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.799 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:56.799 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.671272+0000", 2024-09-12T18:37:56.799 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.000177725 2024-09-12T18:37:56.799 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.799 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.799 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:56.799 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.679687+0000", 2024-09-12T18:37:56.800 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 0.0084148379999999991 2024-09-12T18:37:56.800 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.800 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.800 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "op_commit", 2024-09-12T18:37:56.800 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.679787+0000", 2024-09-12T18:37:56.800 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 9.9950000000000004e-05 2024-09-12T18:37:56.800 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.800 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.800 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "commit_sent", 2024-09-12T18:37:56.800 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.679811+0000", 2024-09-12T18:37:56.800 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.4088999999999999e-05 2024-09-12T18:37:56.800 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-12T18:37:56.800 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-12T18:37:56.801 INFO:teuthology.orchestra.run.smithi114.stdout: "event": "done", 2024-09-12T18:37:56.801 INFO:teuthology.orchestra.run.smithi114.stdout: "time": "2024-09-12T18:37:38.679831+0000", 2024-09-12T18:37:56.801 INFO:teuthology.orchestra.run.smithi114.stdout: "duration": 2.0693e-05 2024-09-12T18:37:56.801 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:56.801 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:56.801 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:56.801 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-12T18:37:56.801 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-12T18:37:56.801 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-12T18:37:56.802 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:37:56.929 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:56.930 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-09-12T18:37:56.930 INFO:teuthology.orchestra.run.smithi143.stdout: "num_ops": 0 2024-09-12T18:37:56.930 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:56.945 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:37:57.068 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:57.068 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [], 2024-09-12T18:37:57.068 INFO:teuthology.orchestra.run.smithi143.stdout: "complaint_time": 30, 2024-09-12T18:37:57.068 INFO:teuthology.orchestra.run.smithi143.stdout: "num_blocked_ops": 0 2024-09-12T18:37:57.068 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:57.082 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:37:57.203 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-12T18:37:57.204 INFO:teuthology.orchestra.run.smithi143.stdout: "size": 20, 2024-09-12T18:37:57.204 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 600, 2024-09-12T18:37:57.204 INFO:teuthology.orchestra.run.smithi143.stdout: "ops": [ 2024-09-12T18:37:57.204 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.204 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121096 5.8 5:13503891:::benchmark_data_smithi073_23739_object121095:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:57.204 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:37:57.204 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 77.019362045999998, 2024-09-12T18:37:57.204 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064025391000000001, 2024-09-12T18:37:57.204 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:57.205 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:57.205 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:57.205 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:57.205 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:57.205 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:57.205 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121096 2024-09-12T18:37:57.205 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.205 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:57.205 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.205 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:57.206 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:37:57.206 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:57.206 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.206 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.206 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:57.206 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178576+0000", 2024-09-12T18:37:57.206 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:57.206 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.206 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.206 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:57.206 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178579+0000", 2024-09-12T18:37:57.207 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7369999999999998e-06 2024-09-12T18:37:57.207 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.207 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.207 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:57.207 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178846+0000", 2024-09-12T18:37:57.207 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00026752699999999999 2024-09-12T18:37:57.207 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.207 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.207 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:57.207 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178877+0000", 2024-09-12T18:37:57.207 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1081999999999998e-05 2024-09-12T18:37:57.207 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.208 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.208 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:57.208 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.178896+0000", 2024-09-12T18:37:57.208 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8522e-05 2024-09-12T18:37:57.208 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.208 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.208 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:57.208 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.192591+0000", 2024-09-12T18:37:57.208 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.013695067 2024-09-12T18:37:57.208 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.209 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.209 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:57.209 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.192944+0000", 2024-09-12T18:37:57.209 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00035273699999999999 2024-09-12T18:37:57.209 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.209 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.209 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:57.209 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.193732+0000", 2024-09-12T18:37:57.210 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00078849599999999997 2024-09-12T18:37:57.210 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.210 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.210 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:57.210 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.213583+0000", 2024-09-12T18:37:57.210 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.019851164000000001 2024-09-12T18:37:57.210 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.210 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.210 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:57.210 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242386+0000", 2024-09-12T18:37:57.210 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028802924000000001 2024-09-12T18:37:57.211 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.211 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.211 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:57.211 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242501+0000", 2024-09-12T18:37:57.211 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000114932 2024-09-12T18:37:57.211 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.211 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.211 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:57.211 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242602+0000", 2024-09-12T18:37:57.211 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000100203 2024-09-12T18:37:57.211 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:57.212 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:57.212 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:57.212 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.212 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.212 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121097 5.8 5:1b31a99e:::benchmark_data_smithi073_23739_object121096:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:57.212 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:37:57.212 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 77.003633755999999, 2024-09-12T18:37:57.212 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048475917, 2024-09-12T18:37:57.212 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:57.212 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:57.213 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:57.213 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:57.213 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:57.213 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:57.213 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121097 2024-09-12T18:37:57.213 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.213 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:57.213 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.213 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:57.213 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:37:57.213 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:57.214 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.214 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.214 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:57.214 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194304+0000", 2024-09-12T18:37:57.214 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:57.214 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.214 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.214 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:57.215 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194308+0000", 2024-09-12T18:37:57.215 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2789999999999999e-06 2024-09-12T18:37:57.215 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.215 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.215 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:57.215 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194396+0000", 2024-09-12T18:37:57.215 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8324000000000003e-05 2024-09-12T18:37:57.215 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.215 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.215 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:57.215 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194424+0000", 2024-09-12T18:37:57.216 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7565000000000001e-05 2024-09-12T18:37:57.216 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.216 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.216 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:57.216 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.194444+0000", 2024-09-12T18:37:57.216 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0363000000000001e-05 2024-09-12T18:37:57.216 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.216 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.216 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:57.216 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.206888+0000", 2024-09-12T18:37:57.216 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.012443997 2024-09-12T18:37:57.216 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.217 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.217 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:57.217 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.207138+0000", 2024-09-12T18:37:57.217 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025035900000000002 2024-09-12T18:37:57.217 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.217 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.217 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:57.217 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.207365+0000", 2024-09-12T18:37:57.217 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000226407 2024-09-12T18:37:57.217 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.217 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.218 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:57.218 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.215059+0000", 2024-09-12T18:37:57.218 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0076946860000000001 2024-09-12T18:37:57.218 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.218 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.218 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:57.218 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242619+0000", 2024-09-12T18:37:57.218 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.027559975 2024-09-12T18:37:57.218 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.218 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.218 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:57.218 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242706+0000", 2024-09-12T18:37:57.219 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6384999999999994e-05 2024-09-12T18:37:57.219 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.219 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.219 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:57.219 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.242780+0000", 2024-09-12T18:37:57.219 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.4577000000000001e-05 2024-09-12T18:37:57.219 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:57.219 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:57.219 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:57.219 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.220 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.220 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:121106 5.d 5:b4a9a221:::benchmark_data_smithi073_23739_object121105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:37:57.220 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:37:57.220 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 76.960758819999995, 2024-09-12T18:37:57.220 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.034882274999999997, 2024-09-12T18:37:57.220 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:57.220 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:57.220 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:57.220 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:57.220 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:57.221 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:57.221 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 121106 2024-09-12T18:37:57.221 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.221 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:57.221 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.221 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:57.221 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:37:57.221 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:57.221 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.221 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.221 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:57.222 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237179+0000", 2024-09-12T18:37:57.222 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:57.222 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.222 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.222 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:57.222 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237182+0000", 2024-09-12T18:37:57.222 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6019999999999998e-06 2024-09-12T18:37:57.222 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.222 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.222 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:57.222 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237257+0000", 2024-09-12T18:37:57.222 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5420999999999995e-05 2024-09-12T18:37:57.223 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.223 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.223 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:57.223 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237305+0000", 2024-09-12T18:37:57.223 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7207999999999999e-05 2024-09-12T18:37:57.223 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.223 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.223 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:57.223 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237325+0000", 2024-09-12T18:37:57.223 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0001e-05 2024-09-12T18:37:57.223 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.223 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.224 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:57.224 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237505+0000", 2024-09-12T18:37:57.224 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000180798 2024-09-12T18:37:57.224 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.224 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.224 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:57.224 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.237764+0000", 2024-09-12T18:37:57.225 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00025862299999999998 2024-09-12T18:37:57.225 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.225 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.225 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:57.225 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.238264+0000", 2024-09-12T18:37:57.225 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00050016100000000005 2024-09-12T18:37:57.225 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.225 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.225 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:57.225 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.256525+0000", 2024-09-12T18:37:57.225 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.018260508000000002 2024-09-12T18:37:57.225 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.226 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.226 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:57.226 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.271903+0000", 2024-09-12T18:37:57.226 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.015378739000000001 2024-09-12T18:37:57.226 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.226 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.226 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:57.226 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.271999+0000", 2024-09-12T18:37:57.226 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.5989000000000005e-05 2024-09-12T18:37:57.226 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.226 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.226 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:57.226 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:36:40.272062+0000", 2024-09-12T18:37:57.227 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2224999999999995e-05 2024-09-12T18:37:57.227 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:57.227 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:57.227 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:57.227 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.227 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.227 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:167368 5.4 5:29a1ec58:::benchmark_data_smithi073_23739_object35091:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:57.227 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:03.168773+0000", 2024-09-12T18:37:57.227 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 54.029164952999999, 2024-09-12T18:37:57.227 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.066578597000000003, 2024-09-12T18:37:57.227 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:57.227 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:57.228 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:57.228 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:57.228 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:57.228 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:57.228 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 167368 2024-09-12T18:37:57.228 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.228 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:57.228 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.228 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:57.228 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168773+0000", 2024-09-12T18:37:57.229 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:57.229 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.229 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.229 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:57.229 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168773+0000", 2024-09-12T18:37:57.229 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:57.229 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.229 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.229 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:57.229 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168774+0000", 2024-09-12T18:37:57.230 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.023e-06 2024-09-12T18:37:57.230 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.230 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.230 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:57.230 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168779+0000", 2024-09-12T18:37:57.230 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5800000000000002e-06 2024-09-12T18:37:57.230 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.230 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.230 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:57.230 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168789+0000", 2024-09-12T18:37:57.230 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0346999999999999e-05 2024-09-12T18:37:57.231 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.231 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.231 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:57.231 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168808+0000", 2024-09-12T18:37:57.231 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.8423e-05 2024-09-12T18:37:57.231 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.231 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.231 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:57.231 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168864+0000", 2024-09-12T18:37:57.232 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6524000000000003e-05 2024-09-12T18:37:57.232 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.232 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.232 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:57.232 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.168947+0000", 2024-09-12T18:37:57.232 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3274000000000003e-05 2024-09-12T18:37:57.232 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.232 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.232 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:57.232 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.169014+0000", 2024-09-12T18:37:57.233 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6284000000000004e-05 2024-09-12T18:37:57.233 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.233 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.233 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:57.233 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.170653+0000", 2024-09-12T18:37:57.233 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016389779999999999 2024-09-12T18:37:57.233 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.233 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.233 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:57.233 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.235279+0000", 2024-09-12T18:37:57.233 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064626464999999994 2024-09-12T18:37:57.233 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.234 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.234 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:57.234 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.235320+0000", 2024-09-12T18:37:57.234 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0377000000000003e-05 2024-09-12T18:37:57.234 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.234 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.234 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:57.234 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.235352+0000", 2024-09-12T18:37:57.234 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2322e-05 2024-09-12T18:37:57.234 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:57.234 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:57.234 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:57.234 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.235 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.235 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:167371 5.4 5:24fea27c:::benchmark_data_smithi073_23739_object35094:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:57.235 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:03.171234+0000", 2024-09-12T18:37:57.235 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 54.026703928000003, 2024-09-12T18:37:57.235 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.066048171000000003, 2024-09-12T18:37:57.235 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:57.235 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:57.235 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:57.235 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:57.235 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:57.235 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:57.235 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 167371 2024-09-12T18:37:57.235 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.236 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:57.236 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.236 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:57.236 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171234+0000", 2024-09-12T18:37:57.236 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:57.236 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.236 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.236 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:57.236 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171234+0000", 2024-09-12T18:37:57.236 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:57.236 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.236 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.236 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:57.236 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171235+0000", 2024-09-12T18:37:57.237 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.8599999999999997e-07 2024-09-12T18:37:57.237 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.237 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.237 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:57.237 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171238+0000", 2024-09-12T18:37:57.237 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.9739999999999998e-06 2024-09-12T18:37:57.237 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.237 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.237 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:57.237 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171245+0000", 2024-09-12T18:37:57.237 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6000000000000003e-06 2024-09-12T18:37:57.237 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.238 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.238 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:57.238 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171249+0000", 2024-09-12T18:37:57.238 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9960000000000004e-06 2024-09-12T18:37:57.238 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.238 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.238 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:57.238 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171288+0000", 2024-09-12T18:37:57.238 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.9119999999999998e-05 2024-09-12T18:37:57.238 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.238 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.238 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:57.238 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171359+0000", 2024-09-12T18:37:57.239 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0951000000000006e-05 2024-09-12T18:37:57.239 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.239 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.239 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:57.239 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.171425+0000", 2024-09-12T18:37:57.239 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.58e-05 2024-09-12T18:37:57.239 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.239 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.239 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:57.239 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.173093+0000", 2024-09-12T18:37:57.239 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0016683939999999999 2024-09-12T18:37:57.239 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.239 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.239 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:57.239 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.237202+0000", 2024-09-12T18:37:57.240 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.064109437000000005 2024-09-12T18:37:57.240 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.240 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.240 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:57.240 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.237249+0000", 2024-09-12T18:37:57.240 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6751e-05 2024-09-12T18:37:57.240 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.240 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.240 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:57.240 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:03.237282+0000", 2024-09-12T18:37:57.240 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3262000000000001e-05 2024-09-12T18:37:57.240 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:57.241 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:57.241 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:57.241 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.241 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.241 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:201498 5.a e67/21 5:5815d848:::benchmark_data_smithi073_23739_object69221:head v 67'12793, mlcod=67'12791)", 2024-09-12T18:37:57.241 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.430872+0000", 2024-09-12T18:37:57.241 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 36.767065950000003, 2024-09-12T18:37:57.241 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.038775280000000002, 2024-09-12T18:37:57.241 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:57.241 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:57.242 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:57.242 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:57.242 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.242 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:57.242 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430872+0000", 2024-09-12T18:37:57.242 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:57.242 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.242 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.242 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:57.242 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430872+0000", 2024-09-12T18:37:57.242 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:57.242 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.243 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.243 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:57.243 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430873+0000", 2024-09-12T18:37:57.243 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.6600000000000003e-07 2024-09-12T18:37:57.243 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.243 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.243 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:57.243 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430875+0000", 2024-09-12T18:37:57.243 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.5399999999999998e-06 2024-09-12T18:37:57.243 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.243 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.243 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:57.243 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430879+0000", 2024-09-12T18:37:57.244 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.7239999999999998e-06 2024-09-12T18:37:57.244 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.244 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.244 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:57.244 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430882+0000", 2024-09-12T18:37:57.244 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.8679999999999999e-06 2024-09-12T18:37:57.244 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.244 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.244 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:57.244 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430909+0000", 2024-09-12T18:37:57.244 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.7832999999999999e-05 2024-09-12T18:37:57.244 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.245 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.245 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:57.245 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.430922+0000", 2024-09-12T18:37:57.245 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2164000000000001e-05 2024-09-12T18:37:57.245 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.245 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.245 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:57.245 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469578+0000", 2024-09-12T18:37:57.245 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.038656469999999998 2024-09-12T18:37:57.245 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.245 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.245 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:57.245 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469648+0000", 2024-09-12T18:37:57.246 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9414999999999999e-05 2024-09-12T18:37:57.246 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:57.246 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:57.246 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:57.246 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.246 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.246 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201513 5.e 5:7be2f597:::benchmark_data_smithi073_23739_object69236:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:57.246 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.435121+0000", 2024-09-12T18:37:57.246 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 36.762817196999997, 2024-09-12T18:37:57.246 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.034945021999999999, 2024-09-12T18:37:57.246 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:57.246 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:57.246 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:57.246 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:57.247 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:57.247 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:57.247 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201513 2024-09-12T18:37:57.247 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.247 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:57.247 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.247 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:57.247 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.435121+0000", 2024-09-12T18:37:57.247 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:57.247 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.247 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.247 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:57.248 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.435121+0000", 2024-09-12T18:37:57.248 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:57.248 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.248 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.248 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:57.248 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.435122+0000", 2024-09-12T18:37:57.248 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.2440000000000001e-06 2024-09-12T18:37:57.248 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.248 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.248 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:57.248 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.435126+0000", 2024-09-12T18:37:57.248 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1559999999999997e-06 2024-09-12T18:37:57.248 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.249 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.249 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:57.249 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445086+0000", 2024-09-12T18:37:57.249 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0099592389999999999 2024-09-12T18:37:57.249 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.249 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.249 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:57.249 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445095+0000", 2024-09-12T18:37:57.249 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.2620000000000004e-06 2024-09-12T18:37:57.249 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.249 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.249 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:57.249 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445165+0000", 2024-09-12T18:37:57.249 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0257000000000002e-05 2024-09-12T18:37:57.250 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.250 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.250 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:57.250 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445311+0000", 2024-09-12T18:37:57.250 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014603899999999999 2024-09-12T18:37:57.250 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.250 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.250 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:57.250 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445445+0000", 2024-09-12T18:37:57.250 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000133654 2024-09-12T18:37:57.250 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.250 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.250 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:57.250 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469853+0000", 2024-09-12T18:37:57.251 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.024407893999999999 2024-09-12T18:37:57.251 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.251 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.251 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:57.251 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469873+0000", 2024-09-12T18:37:57.251 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0622e-05 2024-09-12T18:37:57.251 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.251 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.251 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:57.251 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.469949+0000", 2024-09-12T18:37:57.251 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5918000000000001e-05 2024-09-12T18:37:57.251 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.251 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.251 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:57.252 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470066+0000", 2024-09-12T18:37:57.252 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000116737 2024-09-12T18:37:57.252 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:57.252 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:57.252 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:57.252 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.252 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.252 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201521 5.d 5:b911ab6f:::benchmark_data_smithi073_23739_object69244:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:57.252 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445173+0000", 2024-09-12T18:37:57.252 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 36.752764753999998, 2024-09-12T18:37:57.252 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.031483274999999998, 2024-09-12T18:37:57.252 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:57.252 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:57.252 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:57.253 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:57.253 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:57.253 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:57.253 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201521 2024-09-12T18:37:57.253 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.253 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:57.253 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.253 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:57.253 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445173+0000", 2024-09-12T18:37:57.253 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:57.253 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.253 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.253 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:57.253 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445173+0000", 2024-09-12T18:37:57.254 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:57.254 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.254 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.254 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:57.254 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445174+0000", 2024-09-12T18:37:57.254 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.4299999999999998e-07 2024-09-12T18:37:57.254 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.254 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.254 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:57.254 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445176+0000", 2024-09-12T18:37:57.254 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.469e-06 2024-09-12T18:37:57.254 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.254 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.254 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:57.255 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445183+0000", 2024-09-12T18:37:57.255 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8719999999999996e-06 2024-09-12T18:37:57.255 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.255 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.255 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:57.255 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445188+0000", 2024-09-12T18:37:57.255 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7079999999999996e-06 2024-09-12T18:37:57.255 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.255 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.255 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:57.255 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445314+0000", 2024-09-12T18:37:57.255 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012627800000000001 2024-09-12T18:37:57.255 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.256 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.256 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:57.256 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445436+0000", 2024-09-12T18:37:57.256 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000122007 2024-09-12T18:37:57.256 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.256 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.256 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:57.256 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445541+0000", 2024-09-12T18:37:57.256 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000105068 2024-09-12T18:37:57.256 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.256 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.256 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:57.256 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470655+0000", 2024-09-12T18:37:57.257 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025114035 2024-09-12T18:37:57.257 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.257 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.257 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:57.257 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476570+0000", 2024-09-12T18:37:57.257 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0059143269999999996 2024-09-12T18:37:57.257 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.257 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.257 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:57.257 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476624+0000", 2024-09-12T18:37:57.257 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.4261000000000001e-05 2024-09-12T18:37:57.257 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.257 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.258 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:57.258 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476657+0000", 2024-09-12T18:37:57.258 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.2806999999999999e-05 2024-09-12T18:37:57.258 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:57.258 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:57.258 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:57.258 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.258 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.258 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201524 5.d 5:b330b18b:::benchmark_data_smithi073_23739_object69247:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:57.258 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445202+0000", 2024-09-12T18:37:57.258 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 36.752736493999997, 2024-09-12T18:37:57.258 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.034036482, 2024-09-12T18:37:57.258 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:57.258 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:57.259 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:57.259 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:57.259 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:57.259 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:57.259 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201524 2024-09-12T18:37:57.259 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.259 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:57.259 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.259 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:57.259 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445202+0000", 2024-09-12T18:37:57.259 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:57.259 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.259 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.259 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:57.259 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445202+0000", 2024-09-12T18:37:57.260 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:57.260 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.260 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.260 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:57.260 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445202+0000", 2024-09-12T18:37:57.260 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2e-07 2024-09-12T18:37:57.260 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.260 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.260 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:57.260 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445204+0000", 2024-09-12T18:37:57.260 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0490000000000002e-06 2024-09-12T18:37:57.260 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.260 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.260 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:57.261 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445210+0000", 2024-09-12T18:37:57.261 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.959e-06 2024-09-12T18:37:57.261 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.261 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.261 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:57.261 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445215+0000", 2024-09-12T18:37:57.261 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.668e-06 2024-09-12T18:37:57.261 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.261 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.261 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:57.261 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470703+0000", 2024-09-12T18:37:57.261 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.025488182000000002 2024-09-12T18:37:57.261 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.261 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.262 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:57.262 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.470911+0000", 2024-09-12T18:37:57.262 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00020755400000000001 2024-09-12T18:37:57.262 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.262 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.262 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:57.262 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.471309+0000", 2024-09-12T18:37:57.262 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00039868199999999998 2024-09-12T18:37:57.262 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.262 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.262 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:57.262 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476724+0000", 2024-09-12T18:37:57.262 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0054150589999999998 2024-09-12T18:37:57.263 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.263 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.263 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:57.263 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.479050+0000", 2024-09-12T18:37:57.263 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0023259309999999998 2024-09-12T18:37:57.263 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.263 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.263 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:57.263 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.479164+0000", 2024-09-12T18:37:57.263 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000114127 2024-09-12T18:37:57.263 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.263 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.263 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:57.263 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.479238+0000", 2024-09-12T18:37:57.263 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.3751000000000006e-05 2024-09-12T18:37:57.264 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:57.264 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:57.264 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:57.264 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.264 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.264 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "pg_backfill(progress 5.5 e 67/67 lb 5:a30f9be2:::benchmark_data_smithi073_23739_object118666:head)", 2024-09-12T18:37:57.264 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445433+0000", 2024-09-12T18:37:57.264 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 36.752505608, 2024-09-12T18:37:57.264 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.029511351000000002, 2024-09-12T18:37:57.264 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:57.264 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:57.264 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "started", 2024-09-12T18:37:57.264 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:57.265 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.265 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:57.265 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445433+0000", 2024-09-12T18:37:57.265 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:57.265 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.265 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.265 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:57.265 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445433+0000", 2024-09-12T18:37:57.265 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:57.265 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.265 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.265 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:57.265 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445433+0000", 2024-09-12T18:37:57.268 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0699999999999998e-07 2024-09-12T18:37:57.268 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.268 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.268 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:57.268 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445440+0000", 2024-09-12T18:37:57.268 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6630000000000004e-06 2024-09-12T18:37:57.268 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.268 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.268 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:57.268 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445447+0000", 2024-09-12T18:37:57.268 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5159999999999997e-06 2024-09-12T18:37:57.269 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.269 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.269 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:57.269 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445454+0000", 2024-09-12T18:37:57.269 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.267e-06 2024-09-12T18:37:57.269 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.269 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.269 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:57.269 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.474780+0000", 2024-09-12T18:37:57.269 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.029325496999999999 2024-09-12T18:37:57.269 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.269 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.270 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:57.270 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.474802+0000", 2024-09-12T18:37:57.270 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.2348999999999999e-05 2024-09-12T18:37:57.270 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.270 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.270 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:57.270 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.474944+0000", 2024-09-12T18:37:57.270 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00014165200000000001 2024-09-12T18:37:57.270 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:57.270 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:57.270 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:57.270 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.271 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.271 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:201515 5.5 e67/49 5:a25bd8bb:::benchmark_data_smithi073_23739_object69238:head v 67'12752, mlcod=67'12750)", 2024-09-12T18:37:57.271 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445471+0000", 2024-09-12T18:37:57.271 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 36.752467693, 2024-09-12T18:37:57.271 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.031081396000000001, 2024-09-12T18:37:57.271 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:57.271 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:57.271 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:57.271 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:57.271 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.271 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:57.271 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445471+0000", 2024-09-12T18:37:57.272 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:57.272 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.272 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.272 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:57.272 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445471+0000", 2024-09-12T18:37:57.272 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:57.272 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.272 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.272 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:57.272 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445471+0000", 2024-09-12T18:37:57.272 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.5400000000000002e-07 2024-09-12T18:37:57.272 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.272 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.273 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:57.273 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445475+0000", 2024-09-12T18:37:57.273 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2379999999999999e-06 2024-09-12T18:37:57.273 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.273 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.273 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:57.273 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445481+0000", 2024-09-12T18:37:57.273 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.0229999999999998e-06 2024-09-12T18:37:57.273 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.273 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.273 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:57.273 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445486+0000", 2024-09-12T18:37:57.273 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5040000000000004e-06 2024-09-12T18:37:57.273 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.274 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.274 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:57.274 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445970+0000", 2024-09-12T18:37:57.274 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00048416699999999997 2024-09-12T18:37:57.274 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.274 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.274 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:57.274 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445991+0000", 2024-09-12T18:37:57.274 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.1067999999999999e-05 2024-09-12T18:37:57.274 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.274 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.274 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:57.274 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476511+0000", 2024-09-12T18:37:57.274 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.030520629000000001 2024-09-12T18:37:57.275 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.275 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.275 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:57.275 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476552+0000", 2024-09-12T18:37:57.275 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0413000000000001e-05 2024-09-12T18:37:57.275 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:57.275 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:57.275 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:57.275 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.275 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.275 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_repop(client.4480.0:201526 5.5 e67/49 5:a3549698:::benchmark_data_smithi073_23739_object69249:head v 67'12753, mlcod=67'12750)", 2024-09-12T18:37:57.275 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.445957+0000", 2024-09-12T18:37:57.275 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 36.751980760999999, 2024-09-12T18:37:57.276 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.030732494999999999, 2024-09-12T18:37:57.276 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:57.276 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:57.276 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:57.276 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:57.276 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.276 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:57.276 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445957+0000", 2024-09-12T18:37:57.276 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:57.276 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.276 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.276 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:57.276 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445957+0000", 2024-09-12T18:37:57.276 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:57.277 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.277 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.277 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:57.277 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445958+0000", 2024-09-12T18:37:57.277 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7800000000000001e-07 2024-09-12T18:37:57.277 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.277 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.277 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:57.277 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445963+0000", 2024-09-12T18:37:57.277 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5419999999999999e-06 2024-09-12T18:37:57.277 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.277 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.277 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:57.277 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445972+0000", 2024-09-12T18:37:57.278 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.4169999999999998e-06 2024-09-12T18:37:57.278 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.278 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.278 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:57.278 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.445979+0000", 2024-09-12T18:37:57.278 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.2949999999999996e-06 2024-09-12T18:37:57.278 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.278 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.278 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:57.278 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.447710+0000", 2024-09-12T18:37:57.278 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001731067 2024-09-12T18:37:57.278 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.278 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.278 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:57.279 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.447734+0000", 2024-09-12T18:37:57.279 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.4094e-05 2024-09-12T18:37:57.279 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.279 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.279 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:57.279 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476659+0000", 2024-09-12T18:37:57.279 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.028924268999999999 2024-09-12T18:37:57.279 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.279 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.279 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:57.279 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.476690+0000", 2024-09-12T18:37:57.279 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.1232999999999997e-05 2024-09-12T18:37:57.279 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:57.280 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:57.280 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:57.280 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.280 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.280 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201583 5.d 5:b91eedec:::benchmark_data_smithi073_23739_object69306:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:57.280 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.494097+0000", 2024-09-12T18:37:57.280 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 36.703840898999999, 2024-09-12T18:37:57.280 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.049293508, 2024-09-12T18:37:57.280 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:57.280 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:57.280 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:57.280 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:57.280 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:57.280 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:57.281 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201583 2024-09-12T18:37:57.281 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.281 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:57.281 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.281 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:57.281 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494097+0000", 2024-09-12T18:37:57.281 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:57.281 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.281 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.281 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:57.281 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494097+0000", 2024-09-12T18:37:57.281 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:57.281 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.281 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.282 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:57.282 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494098+0000", 2024-09-12T18:37:57.282 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0699999999999996e-07 2024-09-12T18:37:57.282 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.282 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.282 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:57.282 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494102+0000", 2024-09-12T18:37:57.282 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.664e-06 2024-09-12T18:37:57.282 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.282 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.282 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:57.283 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494108+0000", 2024-09-12T18:37:57.283 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.3149999999999997e-06 2024-09-12T18:37:57.283 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.283 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.283 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:57.283 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494112+0000", 2024-09-12T18:37:57.283 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.0659999999999997e-06 2024-09-12T18:37:57.283 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.283 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.283 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:57.283 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494200+0000", 2024-09-12T18:37:57.283 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.7770999999999997e-05 2024-09-12T18:37:57.283 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.283 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.284 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:57.284 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494315+0000", 2024-09-12T18:37:57.284 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000115048 2024-09-12T18:37:57.284 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.284 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.284 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:57.284 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.494414+0000", 2024-09-12T18:37:57.284 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.8820999999999995e-05 2024-09-12T18:37:57.284 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.284 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.284 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:57.284 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.497199+0000", 2024-09-12T18:37:57.284 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0027854279999999999 2024-09-12T18:37:57.284 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.285 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.285 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:57.285 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543193+0000", 2024-09-12T18:37:57.285 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.045993500999999999 2024-09-12T18:37:57.285 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.285 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.285 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:57.285 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543315+0000", 2024-09-12T18:37:57.285 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012246800000000001 2024-09-12T18:37:57.285 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.285 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.285 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:57.286 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543391+0000", 2024-09-12T18:37:57.286 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5618999999999995e-05 2024-09-12T18:37:57.286 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:57.286 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:57.286 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:57.286 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.286 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.286 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:201585 5.d 5:bb6c167f:::benchmark_data_smithi073_23739_object69308:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:57.286 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:20.495295+0000", 2024-09-12T18:37:57.286 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 36.702642732000001, 2024-09-12T18:37:57.286 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048312129000000002, 2024-09-12T18:37:57.286 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:57.286 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:57.287 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:57.287 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:57.287 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:57.287 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:57.287 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 201585 2024-09-12T18:37:57.287 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.287 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:57.287 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.287 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:57.287 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495295+0000", 2024-09-12T18:37:57.287 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:57.287 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.287 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.288 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:57.288 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495295+0000", 2024-09-12T18:37:57.288 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:57.288 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.288 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.288 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:57.288 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495296+0000", 2024-09-12T18:37:57.288 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0330000000000001e-06 2024-09-12T18:37:57.288 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.288 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.288 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:57.288 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495301+0000", 2024-09-12T18:37:57.288 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7049999999999998e-06 2024-09-12T18:37:57.289 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.289 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.289 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:57.289 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495312+0000", 2024-09-12T18:37:57.289 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0791000000000001e-05 2024-09-12T18:37:57.289 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.289 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.289 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:57.289 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.495319+0000", 2024-09-12T18:37:57.289 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.8240000000000002e-06 2024-09-12T18:37:57.289 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.289 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.290 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:57.290 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.496088+0000", 2024-09-12T18:37:57.290 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00076901200000000002 2024-09-12T18:37:57.290 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.290 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.290 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:57.290 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.496166+0000", 2024-09-12T18:37:57.290 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.8491000000000005e-05 2024-09-12T18:37:57.290 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.290 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.290 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 2", 2024-09-12T18:37:57.290 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.496232+0000", 2024-09-12T18:37:57.290 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5400000000000004e-05 2024-09-12T18:37:57.290 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.290 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.291 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:57.291 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.497467+0000", 2024-09-12T18:37:57.291 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.001235049 2024-09-12T18:37:57.291 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.291 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.291 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:57.291 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543463+0000", 2024-09-12T18:37:57.291 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.045995743999999998 2024-09-12T18:37:57.291 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.291 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.291 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:57.291 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543546+0000", 2024-09-12T18:37:57.291 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.3434000000000001e-05 2024-09-12T18:37:57.291 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.291 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.292 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:57.292 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:20.543608+0000", 2024-09-12T18:37:57.292 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.1645999999999999e-05 2024-09-12T18:37:57.292 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:57.292 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:57.292 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:57.292 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.292 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.292 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:238484 5.8 5:135aca90:::benchmark_data_smithi073_23739_object106207:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:57.292 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:38.618805+0000", 2024-09-12T18:37:57.292 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 18.579133278, 2024-09-12T18:37:57.292 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051696747000000001, 2024-09-12T18:37:57.292 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:57.293 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:57.293 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:57.293 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:57.293 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:57.293 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:57.293 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 238484 2024-09-12T18:37:57.293 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.293 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:57.293 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.293 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:57.293 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.618805+0000", 2024-09-12T18:37:57.293 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:57.293 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.294 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.294 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:57.294 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.618805+0000", 2024-09-12T18:37:57.294 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:57.294 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.294 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.294 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:57.294 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.618806+0000", 2024-09-12T18:37:57.294 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.1829999999999999e-06 2024-09-12T18:37:57.294 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.294 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.294 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:57.294 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.618810+0000", 2024-09-12T18:37:57.295 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8380000000000004e-06 2024-09-12T18:37:57.295 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.295 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.295 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:57.295 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.618820+0000", 2024-09-12T18:37:57.295 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 1.0047999999999999e-05 2024-09-12T18:37:57.295 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.295 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.295 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:57.295 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.618826+0000", 2024-09-12T18:37:57.295 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.7710000000000003e-06 2024-09-12T18:37:57.295 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.295 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.296 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:57.296 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.618869+0000", 2024-09-12T18:37:57.296 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3412999999999999e-05 2024-09-12T18:37:57.296 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.296 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.296 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:57.296 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.618945+0000", 2024-09-12T18:37:57.296 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.5992e-05 2024-09-12T18:37:57.296 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.296 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.296 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:57.296 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.619014+0000", 2024-09-12T18:37:57.297 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.9298e-05 2024-09-12T18:37:57.297 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.297 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.297 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:57.297 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.623942+0000", 2024-09-12T18:37:57.297 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0049273909999999997 2024-09-12T18:37:57.297 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.297 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.297 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:57.297 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.670424+0000", 2024-09-12T18:37:57.297 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.046482453999999999 2024-09-12T18:37:57.297 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.297 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.298 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:57.298 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.670468+0000", 2024-09-12T18:37:57.298 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.3449999999999999e-05 2024-09-12T18:37:57.298 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.298 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.298 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:57.298 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.670502+0000", 2024-09-12T18:37:57.298 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.3908999999999997e-05 2024-09-12T18:37:57.298 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:57.298 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:57.298 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:57.298 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.298 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.299 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:238488 5.e 5:7267a760:::benchmark_data_smithi073_23739_object106211:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:57.299 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:38.622076+0000", 2024-09-12T18:37:57.299 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 18.575862439000002, 2024-09-12T18:37:57.299 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.053006515999999997, 2024-09-12T18:37:57.299 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:57.299 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:57.299 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:57.299 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:57.299 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:57.300 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:57.300 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 238488 2024-09-12T18:37:57.300 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.300 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:57.300 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.300 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:57.300 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622076+0000", 2024-09-12T18:37:57.300 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:57.300 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.300 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.300 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:57.300 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622076+0000", 2024-09-12T18:37:57.301 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:57.301 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.301 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.301 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:57.301 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622076+0000", 2024-09-12T18:37:57.301 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.1900000000000002e-07 2024-09-12T18:37:57.301 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.301 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.301 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:57.301 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622080+0000", 2024-09-12T18:37:57.301 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.225e-06 2024-09-12T18:37:57.301 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.301 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.301 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:57.302 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622088+0000", 2024-09-12T18:37:57.302 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.0949999999999996e-06 2024-09-12T18:37:57.302 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.302 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.302 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:57.302 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622092+0000", 2024-09-12T18:37:57.302 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5850000000000001e-06 2024-09-12T18:37:57.302 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.302 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.302 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:57.302 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622148+0000", 2024-09-12T18:37:57.302 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.5587000000000002e-05 2024-09-12T18:37:57.302 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.302 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.303 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:57.303 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622283+0000", 2024-09-12T18:37:57.303 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00013473900000000001 2024-09-12T18:37:57.303 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.303 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.303 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:57.303 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622404+0000", 2024-09-12T18:37:57.303 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000120865 2024-09-12T18:37:57.303 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.303 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.303 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:57.303 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.629341+0000", 2024-09-12T18:37:57.303 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0069376849999999999 2024-09-12T18:37:57.304 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.304 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.304 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:57.304 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.674829+0000", 2024-09-12T18:37:57.304 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.045488046999999997 2024-09-12T18:37:57.304 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.304 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.304 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:57.305 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.674973+0000", 2024-09-12T18:37:57.305 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000143719 2024-09-12T18:37:57.305 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.305 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.305 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:57.305 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.675082+0000", 2024-09-12T18:37:57.305 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00010925 2024-09-12T18:37:57.305 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:57.305 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:57.305 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:57.305 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.305 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.306 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:238489 5.8 5:1da619cf:::benchmark_data_smithi073_23739_object106212:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:57.306 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:38.622114+0000", 2024-09-12T18:37:57.306 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 18.575823938999999, 2024-09-12T18:37:57.306 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.05040443, 2024-09-12T18:37:57.306 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:57.306 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:57.306 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:57.306 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:57.306 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:57.307 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:57.307 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 238489 2024-09-12T18:37:57.307 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.307 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:57.307 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.307 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:57.307 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622114+0000", 2024-09-12T18:37:57.307 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:57.307 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.307 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.307 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:57.307 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622114+0000", 2024-09-12T18:37:57.307 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:57.308 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.308 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.308 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:57.308 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622115+0000", 2024-09-12T18:37:57.308 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.8999999999999997e-07 2024-09-12T18:37:57.308 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.308 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.308 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:57.308 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622117+0000", 2024-09-12T18:37:57.308 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.182e-06 2024-09-12T18:37:57.308 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.308 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.308 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:57.309 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622122+0000", 2024-09-12T18:37:57.309 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.7350000000000004e-06 2024-09-12T18:37:57.309 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.309 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.309 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:57.309 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622126+0000", 2024-09-12T18:37:57.309 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.8550000000000004e-06 2024-09-12T18:37:57.309 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.309 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.309 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:57.309 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622172+0000", 2024-09-12T18:37:57.309 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.6108e-05 2024-09-12T18:37:57.309 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.309 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.310 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:57.310 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622258+0000", 2024-09-12T18:37:57.310 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.6050000000000005e-05 2024-09-12T18:37:57.310 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.310 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.310 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:57.310 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.622323+0000", 2024-09-12T18:37:57.310 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.5501999999999997e-05 2024-09-12T18:37:57.310 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.310 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.310 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:57.310 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.626718+0000", 2024-09-12T18:37:57.310 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0043947609999999996 2024-09-12T18:37:57.311 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.311 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.311 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:57.311 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.672398+0000", 2024-09-12T18:37:57.311 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.045679768000000003 2024-09-12T18:37:57.311 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.311 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.311 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:57.311 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.672468+0000", 2024-09-12T18:37:57.311 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.0094999999999999e-05 2024-09-12T18:37:57.311 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.311 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.311 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:57.312 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.672519+0000", 2024-09-12T18:37:57.312 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.0884000000000003e-05 2024-09-12T18:37:57.312 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:57.312 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:57.312 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:57.312 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.312 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.312 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:238490 5.e 5:7aa44d17:::benchmark_data_smithi073_23739_object106213:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:57.312 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:38.624702+0000", 2024-09-12T18:37:57.312 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 18.573236003000002, 2024-09-12T18:37:57.312 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.055637870999999998, 2024-09-12T18:37:57.312 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:57.312 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:57.312 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:57.313 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:57.313 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:57.313 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:57.313 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 238490 2024-09-12T18:37:57.313 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.313 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:57.313 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.313 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:57.313 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624702+0000", 2024-09-12T18:37:57.313 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:57.313 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.313 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.313 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:57.314 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624702+0000", 2024-09-12T18:37:57.314 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:57.314 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.314 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.314 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:57.314 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624703+0000", 2024-09-12T18:37:57.314 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.1900000000000001e-07 2024-09-12T18:37:57.314 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.314 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.314 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:57.314 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624707+0000", 2024-09-12T18:37:57.314 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6100000000000002e-06 2024-09-12T18:37:57.314 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.315 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.315 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:57.315 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624715+0000", 2024-09-12T18:37:57.315 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 8.4689999999999997e-06 2024-09-12T18:37:57.315 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.315 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.315 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:57.315 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624720+0000", 2024-09-12T18:37:57.315 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.5719999999999996e-06 2024-09-12T18:37:57.315 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.315 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.315 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:57.315 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624762+0000", 2024-09-12T18:37:57.316 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.2633000000000003e-05 2024-09-12T18:37:57.316 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.316 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.316 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:57.316 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624859+0000", 2024-09-12T18:37:57.316 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 9.6667000000000001e-05 2024-09-12T18:37:57.316 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.316 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.316 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:57.316 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624927+0000", 2024-09-12T18:37:57.316 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.7780000000000005e-05 2024-09-12T18:37:57.316 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.316 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.317 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:57.317 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.629361+0000", 2024-09-12T18:37:57.317 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0044346990000000003 2024-09-12T18:37:57.317 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.317 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.317 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:57.317 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.680101+0000", 2024-09-12T18:37:57.317 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.050739751999999999 2024-09-12T18:37:57.317 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.317 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.317 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:57.317 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.680223+0000", 2024-09-12T18:37:57.317 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012207 2024-09-12T18:37:57.317 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.318 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.318 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:57.318 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.680340+0000", 2024-09-12T18:37:57.318 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00011680000000000001 2024-09-12T18:37:57.318 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:57.318 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:57.318 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:57.318 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.318 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.318 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:238492 5.e 5:7ec5c6d3:::benchmark_data_smithi073_23739_object106215:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:57.318 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:38.624755+0000", 2024-09-12T18:37:57.318 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 18.573183073999999, 2024-09-12T18:37:57.318 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.059045981999999997, 2024-09-12T18:37:57.319 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:57.319 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:57.319 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:57.319 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:57.319 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:57.319 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:57.319 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 238492 2024-09-12T18:37:57.319 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.319 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:57.319 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.319 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:57.319 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624755+0000", 2024-09-12T18:37:57.319 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:57.319 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.319 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.320 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:57.320 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624755+0000", 2024-09-12T18:37:57.320 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:57.320 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.320 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.320 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:57.320 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624756+0000", 2024-09-12T18:37:57.320 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.2e-07 2024-09-12T18:37:57.320 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.320 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.320 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:57.320 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624758+0000", 2024-09-12T18:37:57.321 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0379999999999998e-06 2024-09-12T18:37:57.321 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.321 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.321 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:57.321 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624763+0000", 2024-09-12T18:37:57.321 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.6400000000000002e-06 2024-09-12T18:37:57.321 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.321 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.321 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:57.321 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624768+0000", 2024-09-12T18:37:57.321 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9509999999999997e-06 2024-09-12T18:37:57.321 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.321 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.321 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:57.322 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.625824+0000", 2024-09-12T18:37:57.322 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0010553540000000001 2024-09-12T18:37:57.322 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.322 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.322 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:57.322 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.626059+0000", 2024-09-12T18:37:57.322 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00023545200000000001 2024-09-12T18:37:57.322 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.322 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.322 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:57.322 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.626277+0000", 2024-09-12T18:37:57.322 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00021797400000000001 2024-09-12T18:37:57.322 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.322 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.322 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:57.323 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.632160+0000", 2024-09-12T18:37:57.323 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0058828020000000003 2024-09-12T18:37:57.323 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.323 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.323 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:57.323 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.683543+0000", 2024-09-12T18:37:57.323 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.051383073000000001 2024-09-12T18:37:57.323 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.323 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.323 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:57.323 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.683677+0000", 2024-09-12T18:37:57.323 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.000134091 2024-09-12T18:37:57.323 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.324 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.324 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:57.324 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.683801+0000", 2024-09-12T18:37:57.324 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.00012408699999999999 2024-09-12T18:37:57.324 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:57.324 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:57.324 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:57.324 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.324 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.324 INFO:teuthology.orchestra.run.smithi143.stdout: "description": "osd_op(client.4480.0:238493 5.8 5:17b7de1b:::benchmark_data_smithi073_23739_object106216:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T18:37:57.324 INFO:teuthology.orchestra.run.smithi143.stdout: "initiated_at": "2024-09-12T18:37:38.624778+0000", 2024-09-12T18:37:57.324 INFO:teuthology.orchestra.run.smithi143.stdout: "age": 18.573160363, 2024-09-12T18:37:57.324 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.048129221999999999, 2024-09-12T18:37:57.325 INFO:teuthology.orchestra.run.smithi143.stdout: "continuous": false, 2024-09-12T18:37:57.325 INFO:teuthology.orchestra.run.smithi143.stdout: "type_data": { 2024-09-12T18:37:57.325 INFO:teuthology.orchestra.run.smithi143.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:57.325 INFO:teuthology.orchestra.run.smithi143.stdout: "client_info": { 2024-09-12T18:37:57.325 INFO:teuthology.orchestra.run.smithi143.stdout: "client": "client.4480", 2024-09-12T18:37:57.325 INFO:teuthology.orchestra.run.smithi143.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:57.325 INFO:teuthology.orchestra.run.smithi143.stdout: "tid": 238493 2024-09-12T18:37:57.325 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.325 INFO:teuthology.orchestra.run.smithi143.stdout: "events": [ 2024-09-12T18:37:57.325 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.325 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "initiated", 2024-09-12T18:37:57.325 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624778+0000", 2024-09-12T18:37:57.325 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:57.326 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.326 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.326 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "header_read", 2024-09-12T18:37:57.326 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624778+0000", 2024-09-12T18:37:57.326 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0 2024-09-12T18:37:57.326 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.326 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.326 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "throttled", 2024-09-12T18:37:57.326 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624778+0000", 2024-09-12T18:37:57.326 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.32e-07 2024-09-12T18:37:57.326 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.326 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.326 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "all_read", 2024-09-12T18:37:57.326 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624780+0000", 2024-09-12T18:37:57.326 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 2.0530000000000001e-06 2024-09-12T18:37:57.327 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.327 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.327 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "dispatched", 2024-09-12T18:37:57.327 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624787+0000", 2024-09-12T18:37:57.327 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.2790000000000004e-06 2024-09-12T18:37:57.327 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.327 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.327 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "queued_for_pg", 2024-09-12T18:37:57.327 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624792+0000", 2024-09-12T18:37:57.327 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.9629999999999997e-06 2024-09-12T18:37:57.327 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.327 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.327 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "reached_pg", 2024-09-12T18:37:57.327 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624828+0000", 2024-09-12T18:37:57.327 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 3.6177000000000003e-05 2024-09-12T18:37:57.328 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.328 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.328 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "started", 2024-09-12T18:37:57.328 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624905+0000", 2024-09-12T18:37:57.328 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 7.7671999999999998e-05 2024-09-12T18:37:57.328 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.328 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.328 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:57.328 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.624972+0000", 2024-09-12T18:37:57.328 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 6.6977000000000006e-05 2024-09-12T18:37:57.328 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.328 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.328 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "op_commit", 2024-09-12T18:37:57.329 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.629376+0000", 2024-09-12T18:37:57.329 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.0044033229999999998 2024-09-12T18:37:57.329 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.329 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.329 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:57.329 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.672808+0000", 2024-09-12T18:37:57.329 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 0.043431889000000001 2024-09-12T18:37:57.329 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.329 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.329 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "commit_sent", 2024-09-12T18:37:57.329 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.672865+0000", 2024-09-12T18:37:57.329 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 5.753e-05 2024-09-12T18:37:57.329 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-12T18:37:57.329 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-09-12T18:37:57.330 INFO:teuthology.orchestra.run.smithi143.stdout: "event": "done", 2024-09-12T18:37:57.330 INFO:teuthology.orchestra.run.smithi143.stdout: "time": "2024-09-12T18:37:38.672907+0000", 2024-09-12T18:37:57.330 INFO:teuthology.orchestra.run.smithi143.stdout: "duration": 4.1927e-05 2024-09-12T18:37:57.330 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:57.330 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:57.330 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:57.330 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-12T18:37:57.330 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-12T18:37:57.330 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-12T18:37:57.333 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is set 2024-09-12T18:37:57.333 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:37:57.467 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:57.467 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [], 2024-09-12T18:37:57.467 INFO:teuthology.orchestra.run.smithi162.stdout: "num_ops": 0 2024-09-12T18:37:57.467 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:57.483 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:37:57.608 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:57.608 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [], 2024-09-12T18:37:57.608 INFO:teuthology.orchestra.run.smithi162.stdout: "complaint_time": 30, 2024-09-12T18:37:57.608 INFO:teuthology.orchestra.run.smithi162.stdout: "num_blocked_ops": 0 2024-09-12T18:37:57.608 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:57.623 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:37:57.749 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-12T18:37:57.749 INFO:teuthology.orchestra.run.smithi162.stdout: "size": 20, 2024-09-12T18:37:57.749 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 600, 2024-09-12T18:37:57.750 INFO:teuthology.orchestra.run.smithi162.stdout: "ops": [ 2024-09-12T18:37:57.750 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.750 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167364 5.7 5:ee50096a:::benchmark_data_smithi073_23739_object35087:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:57.750 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.168715+0000", 2024-09-12T18:37:57.750 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 54.575297657999997, 2024-09-12T18:37:57.750 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.068831153000000006, 2024-09-12T18:37:57.750 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:57.750 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:57.750 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:57.750 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:57.750 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:57.750 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:57.750 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167364 2024-09-12T18:37:57.750 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.751 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:57.751 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.751 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:57.751 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168715+0000", 2024-09-12T18:37:57.751 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:57.751 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.751 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.751 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:57.751 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168715+0000", 2024-09-12T18:37:57.751 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:57.751 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.751 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.751 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:57.751 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168716+0000", 2024-09-12T18:37:57.752 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0559999999999999e-06 2024-09-12T18:37:57.752 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.752 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.752 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:57.752 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168721+0000", 2024-09-12T18:37:57.752 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8019999999999999e-06 2024-09-12T18:37:57.752 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.752 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.752 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:57.752 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168731+0000", 2024-09-12T18:37:57.752 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0315e-05 2024-09-12T18:37:57.752 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.753 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.753 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:57.753 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168738+0000", 2024-09-12T18:37:57.753 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.126e-06 2024-09-12T18:37:57.753 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.753 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.753 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:57.753 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168782+0000", 2024-09-12T18:37:57.753 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.3924000000000002e-05 2024-09-12T18:37:57.753 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.753 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.753 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:57.753 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168913+0000", 2024-09-12T18:37:57.753 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000131154 2024-09-12T18:37:57.754 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.754 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.754 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:57.754 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169026+0000", 2024-09-12T18:37:57.754 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011223299999999999 2024-09-12T18:37:57.754 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.754 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.754 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:57.754 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.175404+0000", 2024-09-12T18:37:57.754 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0063780319999999996 2024-09-12T18:37:57.754 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.754 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.754 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:57.755 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237446+0000", 2024-09-12T18:37:57.755 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.062042238 2024-09-12T18:37:57.755 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.755 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.755 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:57.755 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237501+0000", 2024-09-12T18:37:57.755 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4913000000000001e-05 2024-09-12T18:37:57.756 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.756 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.756 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:57.756 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237546+0000", 2024-09-12T18:37:57.756 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.5359999999999999e-05 2024-09-12T18:37:57.756 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:57.756 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:57.756 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:57.756 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.756 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.756 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167365 5.2 5:4107875c:::benchmark_data_smithi073_23739_object35088:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:57.756 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:57.757 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 54.575248084000002, 2024-09-12T18:37:57.757 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.078544438999999994, 2024-09-12T18:37:57.757 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:57.757 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:57.757 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:57.757 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:57.757 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:57.757 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:57.757 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167365 2024-09-12T18:37:57.758 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.758 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:57.758 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.758 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:57.758 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:57.758 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:57.758 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.758 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.758 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:57.758 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:57.758 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:57.758 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.758 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.759 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:57.759 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168765+0000", 2024-09-12T18:37:57.759 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.4700000000000001e-07 2024-09-12T18:37:57.759 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.759 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.759 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:57.759 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168769+0000", 2024-09-12T18:37:57.759 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.4170000000000001e-06 2024-09-12T18:37:57.759 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.759 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.759 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:57.759 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168777+0000", 2024-09-12T18:37:57.760 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1499999999999999e-06 2024-09-12T18:37:57.760 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.760 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.760 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:57.760 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168783+0000", 2024-09-12T18:37:57.760 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.0460000000000002e-06 2024-09-12T18:37:57.760 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.760 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.760 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:57.760 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.168865+0000", 2024-09-12T18:37:57.760 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1953999999999995e-05 2024-09-12T18:37:57.760 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.761 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.761 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:57.761 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169003+0000", 2024-09-12T18:37:57.761 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013798200000000001 2024-09-12T18:37:57.761 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.761 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.761 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:57.761 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169065+0000", 2024-09-12T18:37:57.761 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2218000000000006e-05 2024-09-12T18:37:57.761 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.761 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.761 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:57.761 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174771+0000", 2024-09-12T18:37:57.761 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0057054819999999996 2024-09-12T18:37:57.762 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.762 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.762 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:57.762 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.247234+0000", 2024-09-12T18:37:57.762 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.072463391000000002 2024-09-12T18:37:57.762 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.762 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.762 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:57.762 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.247273+0000", 2024-09-12T18:37:57.762 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.9069000000000002e-05 2024-09-12T18:37:57.762 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.762 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.762 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:57.762 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.247309+0000", 2024-09-12T18:37:57.763 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.5982999999999998e-05 2024-09-12T18:37:57.763 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:57.763 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:57.763 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:57.763 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.763 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.763 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167369 5.7 5:e64ecabd:::benchmark_data_smithi073_23739_object35092:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:57.763 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.169042+0000", 2024-09-12T18:37:57.763 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 54.574970972999999, 2024-09-12T18:37:57.763 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.069229188999999997, 2024-09-12T18:37:57.763 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:57.763 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:57.763 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:57.763 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:57.764 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:57.764 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:57.764 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167369 2024-09-12T18:37:57.764 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.764 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:57.764 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.764 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:57.764 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169042+0000", 2024-09-12T18:37:57.764 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:57.764 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.764 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.764 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:57.764 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169042+0000", 2024-09-12T18:37:57.765 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:57.765 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.765 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.765 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:57.765 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169043+0000", 2024-09-12T18:37:57.765 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.9400000000000004e-07 2024-09-12T18:37:57.765 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.765 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.765 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:57.765 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169048+0000", 2024-09-12T18:37:57.765 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8420000000000004e-06 2024-09-12T18:37:57.765 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.765 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.766 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:57.766 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169055+0000", 2024-09-12T18:37:57.766 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.7989999999999994e-06 2024-09-12T18:37:57.766 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.766 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.766 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:57.766 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.169062+0000", 2024-09-12T18:37:57.766 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.5950000000000004e-06 2024-09-12T18:37:57.766 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.766 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.767 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:57.767 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173858+0000", 2024-09-12T18:37:57.767 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0047959259999999998 2024-09-12T18:37:57.767 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.767 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.767 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:57.767 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173966+0000", 2024-09-12T18:37:57.767 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000107941 2024-09-12T18:37:57.767 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.767 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.767 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:57.767 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174043+0000", 2024-09-12T18:37:57.768 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.7360000000000005e-05 2024-09-12T18:37:57.768 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.768 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.768 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:57.768 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.175711+0000", 2024-09-12T18:37:57.768 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0016680810000000001 2024-09-12T18:37:57.768 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.768 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.768 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:57.768 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.238163+0000", 2024-09-12T18:37:57.768 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.062451523000000002 2024-09-12T18:37:57.768 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.768 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.769 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:57.769 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.238222+0000", 2024-09-12T18:37:57.769 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9723999999999999e-05 2024-09-12T18:37:57.769 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.769 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.769 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:57.769 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.238271+0000", 2024-09-12T18:37:57.769 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8504000000000002e-05 2024-09-12T18:37:57.769 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:57.769 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:57.769 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:57.769 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.769 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.769 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167373 5.5 5:ad283029:::benchmark_data_smithi073_23739_object35096:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:57.769 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:57.770 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 54.572466142000003, 2024-09-12T18:37:57.770 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.066200976999999994, 2024-09-12T18:37:57.770 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:57.770 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:57.770 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:57.770 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:57.770 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:57.770 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:57.770 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167373 2024-09-12T18:37:57.770 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.770 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:57.770 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.770 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:57.770 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:57.770 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:57.771 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.771 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.771 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:57.771 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:57.771 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:57.771 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.771 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.771 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:57.771 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171547+0000", 2024-09-12T18:37:57.771 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4900000000000005e-07 2024-09-12T18:37:57.771 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.771 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.771 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:57.771 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171551+0000", 2024-09-12T18:37:57.771 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.7519999999999998e-06 2024-09-12T18:37:57.772 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.772 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.772 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:57.772 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171562+0000", 2024-09-12T18:37:57.772 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0353000000000001e-05 2024-09-12T18:37:57.772 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.772 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.772 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:57.772 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171566+0000", 2024-09-12T18:37:57.772 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8269999999999997e-06 2024-09-12T18:37:57.772 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.772 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.772 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:57.772 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171622+0000", 2024-09-12T18:37:57.772 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.5220999999999999e-05 2024-09-12T18:37:57.773 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.773 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.773 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:57.773 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171719+0000", 2024-09-12T18:37:57.773 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7238999999999995e-05 2024-09-12T18:37:57.773 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.773 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.773 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:57.773 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.171802+0000", 2024-09-12T18:37:57.773 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.3285e-05 2024-09-12T18:37:57.773 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.773 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.773 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:57.774 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174608+0000", 2024-09-12T18:37:57.774 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028054590000000002 2024-09-12T18:37:57.774 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.774 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.774 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:57.774 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174762+0000", 2024-09-12T18:37:57.774 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015465100000000001 2024-09-12T18:37:57.774 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.774 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.774 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:57.774 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237474+0000", 2024-09-12T18:37:57.774 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.062711683000000004 2024-09-12T18:37:57.774 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.774 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.775 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:57.775 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237540+0000", 2024-09-12T18:37:57.775 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.6132999999999999e-05 2024-09-12T18:37:57.775 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.775 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.775 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:57.775 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.237748+0000", 2024-09-12T18:37:57.775 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020752499999999999 2024-09-12T18:37:57.775 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:57.775 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:57.775 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:57.775 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.775 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.776 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167374 5.1 5:81e25826:::benchmark_data_smithi073_23739_object35097:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:57.776 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.173748+0000", 2024-09-12T18:37:57.776 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 54.570264694000002, 2024-09-12T18:37:57.776 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.069225245000000005, 2024-09-12T18:37:57.776 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:57.776 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:57.776 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:57.776 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:57.776 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:57.776 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:57.776 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167374 2024-09-12T18:37:57.776 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.776 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:57.776 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.776 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:57.777 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173748+0000", 2024-09-12T18:37:57.777 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:57.777 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.777 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.777 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:57.777 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173748+0000", 2024-09-12T18:37:57.777 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:57.777 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.777 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.777 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:57.777 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173749+0000", 2024-09-12T18:37:57.777 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.418e-06 2024-09-12T18:37:57.777 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.778 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.778 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:57.778 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173755+0000", 2024-09-12T18:37:57.778 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.0730000000000004e-06 2024-09-12T18:37:57.778 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.778 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.778 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:57.778 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173768+0000", 2024-09-12T18:37:57.778 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3644e-05 2024-09-12T18:37:57.778 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.778 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.778 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:57.778 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173777+0000", 2024-09-12T18:37:57.778 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4160000000000004e-06 2024-09-12T18:37:57.779 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.779 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.779 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:57.779 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173927+0000", 2024-09-12T18:37:57.779 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015065900000000001 2024-09-12T18:37:57.779 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.779 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.779 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:57.779 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174052+0000", 2024-09-12T18:37:57.779 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012460699999999999 2024-09-12T18:37:57.779 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.779 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.779 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:57.780 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.174181+0000", 2024-09-12T18:37:57.780 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00012919299999999999 2024-09-12T18:37:57.780 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.780 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.780 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:57.780 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.178108+0000", 2024-09-12T18:37:57.780 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0039273210000000001 2024-09-12T18:37:57.780 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.780 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.780 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:57.780 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.178118+0000", 2024-09-12T18:37:57.780 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7550000000000006e-06 2024-09-12T18:37:57.780 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.780 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.781 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:57.781 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.242865+0000", 2024-09-12T18:37:57.781 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.064746597000000003 2024-09-12T18:37:57.781 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.781 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.781 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:57.781 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.242903+0000", 2024-09-12T18:37:57.781 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.8268e-05 2024-09-12T18:37:57.781 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.781 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.781 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:57.781 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.242973+0000", 2024-09-12T18:37:57.781 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0294000000000002e-05 2024-09-12T18:37:57.781 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:57.781 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:57.781 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:57.782 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.782 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.782 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:167375 5.1 5:83a09102:::benchmark_data_smithi073_23739_object35098:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:37:57.782 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:57.782 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 54.570213146999997, 2024-09-12T18:37:57.782 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.069437463000000005, 2024-09-12T18:37:57.782 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:57.782 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:57.782 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:57.782 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:57.782 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:57.782 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:57.783 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 167375 2024-09-12T18:37:57.783 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.783 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:57.783 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.783 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:57.783 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:57.783 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:57.783 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.783 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.783 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:57.783 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:57.783 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:57.784 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.784 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.784 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:57.784 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173800+0000", 2024-09-12T18:37:57.784 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1399999999999997e-07 2024-09-12T18:37:57.784 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.784 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.784 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:57.784 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173803+0000", 2024-09-12T18:37:57.784 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.7860000000000001e-06 2024-09-12T18:37:57.784 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.784 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.784 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:57.785 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173811+0000", 2024-09-12T18:37:57.785 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.4610000000000008e-06 2024-09-12T18:37:57.785 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.785 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.785 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:57.785 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.173817+0000", 2024-09-12T18:37:57.785 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3569999999999997e-06 2024-09-12T18:37:57.785 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.785 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.785 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:57.785 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.176070+0000", 2024-09-12T18:37:57.786 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.002253405 2024-09-12T18:37:57.786 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.786 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.786 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:57.786 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.176263+0000", 2024-09-12T18:37:57.786 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000192583 2024-09-12T18:37:57.786 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.786 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.786 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:57.786 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.176429+0000", 2024-09-12T18:37:57.786 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00016626 2024-09-12T18:37:57.786 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.786 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.786 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:57.787 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.178154+0000", 2024-09-12T18:37:57.787 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0017247009999999999 2024-09-12T18:37:57.787 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.787 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.787 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:57.787 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.182110+0000", 2024-09-12T18:37:57.787 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0039568229999999999 2024-09-12T18:37:57.787 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.787 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.787 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:57.787 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.243024+0000", 2024-09-12T18:37:57.787 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.060913249000000003 2024-09-12T18:37:57.787 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.787 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.788 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:57.788 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.243107+0000", 2024-09-12T18:37:57.788 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.3090000000000006e-05 2024-09-12T18:37:57.788 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.788 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.788 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:57.788 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:03.243237+0000", 2024-09-12T18:37:57.788 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013023399999999999 2024-09-12T18:37:57.788 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:57.788 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:57.788 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:57.788 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.788 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.789 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201515 5.5 5:a25bd8bb:::benchmark_data_smithi073_23739_object69238:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:57.789 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.437024+0000", 2024-09-12T18:37:57.789 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 37.306988914999998, 2024-09-12T18:37:57.789 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.040476102, 2024-09-12T18:37:57.789 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:57.789 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:57.789 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:57.789 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:57.789 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:57.789 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:57.789 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201515 2024-09-12T18:37:57.789 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.789 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:57.789 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.790 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:57.790 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437024+0000", 2024-09-12T18:37:57.790 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:57.790 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.790 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.790 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:57.790 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437024+0000", 2024-09-12T18:37:57.790 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:57.790 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.790 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.790 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:57.790 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437025+0000", 2024-09-12T18:37:57.790 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2240000000000001e-06 2024-09-12T18:37:57.790 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.791 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.791 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:57.791 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437030+0000", 2024-09-12T18:37:57.791 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.7049999999999998e-06 2024-09-12T18:37:57.791 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.791 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.791 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:57.791 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437040+0000", 2024-09-12T18:37:57.791 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0351e-05 2024-09-12T18:37:57.791 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.791 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.791 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:57.791 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437049+0000", 2024-09-12T18:37:57.791 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5750000000000001e-06 2024-09-12T18:37:57.792 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.792 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.792 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:57.792 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437574+0000", 2024-09-12T18:37:57.792 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00052566400000000001 2024-09-12T18:37:57.792 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.792 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.792 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:57.792 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437673+0000", 2024-09-12T18:37:57.792 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.8672000000000007e-05 2024-09-12T18:37:57.792 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.792 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.792 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:57.792 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.437755+0000", 2024-09-12T18:37:57.792 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.1705000000000005e-05 2024-09-12T18:37:57.793 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.793 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.793 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:57.793 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.439556+0000", 2024-09-12T18:37:57.793 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0018009020000000001 2024-09-12T18:37:57.793 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.793 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.793 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:57.793 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.439955+0000", 2024-09-12T18:37:57.793 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00039966900000000001 2024-09-12T18:37:57.793 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.793 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.793 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:57.794 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.477267+0000", 2024-09-12T18:37:57.794 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.037311614 2024-09-12T18:37:57.794 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.794 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.794 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:57.794 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.477368+0000", 2024-09-12T18:37:57.794 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000101495 2024-09-12T18:37:57.794 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.794 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.794 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:57.794 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.477500+0000", 2024-09-12T18:37:57.794 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000131526 2024-09-12T18:37:57.794 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:57.794 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:57.795 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:57.795 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.795 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.795 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201566 5.9 5:9ea8bdd3:::benchmark_data_smithi073_23739_object69289:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:57.795 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.487311+0000", 2024-09-12T18:37:57.795 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 37.256701368000002, 2024-09-12T18:37:57.795 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.044734547, 2024-09-12T18:37:57.795 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:57.795 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:57.796 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:57.796 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:57.796 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:57.796 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:57.796 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201566 2024-09-12T18:37:57.796 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.796 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:57.796 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.796 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:57.796 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487311+0000", 2024-09-12T18:37:57.796 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:57.797 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.797 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.797 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:57.797 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487311+0000", 2024-09-12T18:37:57.797 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:57.797 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.797 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.797 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:57.797 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487313+0000", 2024-09-12T18:37:57.797 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.3060000000000001e-06 2024-09-12T18:37:57.797 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.798 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.798 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:57.798 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487318+0000", 2024-09-12T18:37:57.798 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.181e-06 2024-09-12T18:37:57.798 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.798 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.798 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:57.798 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487333+0000", 2024-09-12T18:37:57.798 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5012e-05 2024-09-12T18:37:57.798 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.798 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.798 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:57.798 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487344+0000", 2024-09-12T18:37:57.798 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0733999999999999e-05 2024-09-12T18:37:57.799 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.799 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.799 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:57.799 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487403+0000", 2024-09-12T18:37:57.799 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.9858999999999997e-05 2024-09-12T18:37:57.799 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.799 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.799 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:57.799 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487600+0000", 2024-09-12T18:37:57.799 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019617899999999999 2024-09-12T18:37:57.799 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.799 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.799 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:57.799 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487769+0000", 2024-09-12T18:37:57.800 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00016919299999999999 2024-09-12T18:37:57.800 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.800 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.800 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:57.800 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492984+0000", 2024-09-12T18:37:57.800 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0052155309999999998 2024-09-12T18:37:57.800 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.800 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.800 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:57.800 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531791+0000", 2024-09-12T18:37:57.800 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.038806861999999998 2024-09-12T18:37:57.800 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.800 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.801 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:57.801 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531946+0000", 2024-09-12T18:37:57.801 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015445300000000001 2024-09-12T18:37:57.801 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.801 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.801 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:57.801 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532046+0000", 2024-09-12T18:37:57.801 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000100237 2024-09-12T18:37:57.801 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:57.801 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:57.801 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:57.801 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.802 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.802 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201569 5.9 5:9719244e:::benchmark_data_smithi073_23739_object69292:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:57.802 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.487551+0000", 2024-09-12T18:37:57.802 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 37.256462008, 2024-09-12T18:37:57.802 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.045212927, 2024-09-12T18:37:57.802 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:57.802 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:57.802 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:57.802 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:57.802 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:57.802 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:57.802 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201569 2024-09-12T18:37:57.802 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.803 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:57.803 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.803 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:57.803 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487551+0000", 2024-09-12T18:37:57.803 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:57.803 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.803 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.803 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:57.803 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487551+0000", 2024-09-12T18:37:57.803 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:57.803 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.803 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.804 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:57.804 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487552+0000", 2024-09-12T18:37:57.804 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.6160000000000001e-06 2024-09-12T18:37:57.804 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.804 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.804 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:57.804 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487566+0000", 2024-09-12T18:37:57.804 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.344e-05 2024-09-12T18:37:57.804 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.804 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.804 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:57.804 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487581+0000", 2024-09-12T18:37:57.804 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5526e-05 2024-09-12T18:37:57.805 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.805 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.805 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:57.805 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487593+0000", 2024-09-12T18:37:57.805 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1443e-05 2024-09-12T18:37:57.805 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.805 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.805 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:57.805 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.489599+0000", 2024-09-12T18:37:57.805 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0020058960000000001 2024-09-12T18:37:57.805 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.805 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.805 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:57.806 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.489710+0000", 2024-09-12T18:37:57.806 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000111634 2024-09-12T18:37:57.806 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.806 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.806 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:57.806 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.489796+0000", 2024-09-12T18:37:57.806 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5235999999999995e-05 2024-09-12T18:37:57.806 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.806 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.806 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:57.806 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532140+0000", 2024-09-12T18:37:57.806 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.042344524000000001 2024-09-12T18:37:57.807 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.807 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.807 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:57.807 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532559+0000", 2024-09-12T18:37:57.807 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00041908800000000002 2024-09-12T18:37:57.807 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.807 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.807 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:57.807 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532676+0000", 2024-09-12T18:37:57.807 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011649100000000001 2024-09-12T18:37:57.807 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.807 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.807 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:57.807 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532764+0000", 2024-09-12T18:37:57.807 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8033000000000002e-05 2024-09-12T18:37:57.808 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:57.808 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:57.808 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:57.808 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.808 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.808 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201570 5.5 5:a97bff67:::benchmark_data_smithi073_23739_object69293:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:57.808 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.487618+0000", 2024-09-12T18:37:57.808 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 37.256394423000003, 2024-09-12T18:37:57.808 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.049152553000000002, 2024-09-12T18:37:57.808 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:57.808 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:57.808 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:57.808 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:57.809 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:57.809 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:57.809 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201570 2024-09-12T18:37:57.809 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.809 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:57.809 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.809 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:57.809 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487618+0000", 2024-09-12T18:37:57.809 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:57.809 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.809 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.809 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:57.809 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487618+0000", 2024-09-12T18:37:57.810 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:57.810 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.810 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.810 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:57.810 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487619+0000", 2024-09-12T18:37:57.810 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.6099999999999999e-07 2024-09-12T18:37:57.810 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.810 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.810 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:57.810 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487623+0000", 2024-09-12T18:37:57.811 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.0940000000000001e-06 2024-09-12T18:37:57.811 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.811 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.811 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:57.811 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487635+0000", 2024-09-12T18:37:57.811 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1348e-05 2024-09-12T18:37:57.811 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.811 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.811 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:57.811 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.487657+0000", 2024-09-12T18:37:57.811 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.2246999999999999e-05 2024-09-12T18:37:57.811 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.811 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.812 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:57.812 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490684+0000", 2024-09-12T18:37:57.812 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0030268339999999999 2024-09-12T18:37:57.812 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.812 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.812 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:57.812 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490797+0000", 2024-09-12T18:37:57.812 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011372200000000001 2024-09-12T18:37:57.812 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.812 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.812 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:57.812 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490909+0000", 2024-09-12T18:37:57.812 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000111239 2024-09-12T18:37:57.812 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.813 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.813 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:57.813 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534345+0000", 2024-09-12T18:37:57.813 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.043436648000000001 2024-09-12T18:37:57.813 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.813 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.813 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:57.813 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534711+0000", 2024-09-12T18:37:57.813 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00036576399999999998 2024-09-12T18:37:57.813 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.813 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.813 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:57.813 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536225+0000", 2024-09-12T18:37:57.813 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.001513983 2024-09-12T18:37:57.814 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.814 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.814 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:57.814 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536331+0000", 2024-09-12T18:37:57.814 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010603300000000001 2024-09-12T18:37:57.814 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.814 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.814 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:57.814 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536771+0000", 2024-09-12T18:37:57.814 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00043978000000000002 2024-09-12T18:37:57.814 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:57.814 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:57.815 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:57.815 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.815 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.815 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:201572 5.3 e67/21 5:caf692c5:::benchmark_data_smithi073_23739_object69295:head v 67'12362, mlcod=67'12360)", 2024-09-12T18:37:57.815 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.490255+0000", 2024-09-12T18:37:57.815 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 37.253757923000002, 2024-09-12T18:37:57.815 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.044189501999999999, 2024-09-12T18:37:57.815 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:57.815 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:57.815 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:57.815 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:57.815 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.815 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:57.815 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490255+0000", 2024-09-12T18:37:57.816 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:57.816 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.816 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.816 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:57.816 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490255+0000", 2024-09-12T18:37:57.816 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:57.816 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.816 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.816 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:57.816 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490256+0000", 2024-09-12T18:37:57.816 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0500000000000003e-07 2024-09-12T18:37:57.816 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.816 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.817 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:57.817 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490260+0000", 2024-09-12T18:37:57.817 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.8269999999999997e-06 2024-09-12T18:37:57.817 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.817 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.817 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:57.817 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490269+0000", 2024-09-12T18:37:57.817 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.6549999999999993e-06 2024-09-12T18:37:57.817 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.817 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.817 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:57.817 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490275+0000", 2024-09-12T18:37:57.817 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.46e-06 2024-09-12T18:37:57.818 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.818 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.818 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:57.818 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490328+0000", 2024-09-12T18:37:57.818 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2101999999999997e-05 2024-09-12T18:37:57.818 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.818 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.818 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:57.818 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490347+0000", 2024-09-12T18:37:57.818 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.9457999999999999e-05 2024-09-12T18:37:57.818 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.818 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.818 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:57.818 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534382+0000", 2024-09-12T18:37:57.819 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.044034968000000001 2024-09-12T18:37:57.819 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.819 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.819 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:57.819 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534444+0000", 2024-09-12T18:37:57.819 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2327000000000001e-05 2024-09-12T18:37:57.819 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:57.819 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:57.819 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:57.819 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.819 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.819 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201574 5.5 5:a963f378:::benchmark_data_smithi073_23739_object69297:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:57.819 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.490449+0000", 2024-09-12T18:37:57.819 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 37.253563948, 2024-09-12T18:37:57.820 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.046749974, 2024-09-12T18:37:57.820 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:57.820 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:57.820 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:57.820 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:57.820 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:57.820 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:57.820 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201574 2024-09-12T18:37:57.820 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.820 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:57.820 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.820 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:57.820 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490449+0000", 2024-09-12T18:37:57.821 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:57.821 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.821 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.821 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:57.821 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490449+0000", 2024-09-12T18:37:57.821 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:57.821 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.821 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.821 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:57.821 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490450+0000", 2024-09-12T18:37:57.821 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.17e-06 2024-09-12T18:37:57.821 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.821 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.821 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:57.822 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490455+0000", 2024-09-12T18:37:57.822 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.7319999999999998e-06 2024-09-12T18:37:57.822 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.822 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.822 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:57.822 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490464+0000", 2024-09-12T18:37:57.822 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.4760000000000004e-06 2024-09-12T18:37:57.822 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.822 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.822 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:57.822 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490471+0000", 2024-09-12T18:37:57.822 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.5400000000000001e-06 2024-09-12T18:37:57.822 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.822 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.823 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:57.823 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492695+0000", 2024-09-12T18:37:57.823 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0022245910000000002 2024-09-12T18:37:57.823 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.823 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.823 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:57.823 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492847+0000", 2024-09-12T18:37:57.823 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00015127399999999999 2024-09-12T18:37:57.823 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.823 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.823 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:57.823 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492936+0000", 2024-09-12T18:37:57.823 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.8953e-05 2024-09-12T18:37:57.823 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.824 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.824 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:57.824 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534614+0000", 2024-09-12T18:37:57.824 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.041678422999999999 2024-09-12T18:37:57.824 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.824 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.824 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:57.824 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534755+0000", 2024-09-12T18:37:57.824 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000140696 2024-09-12T18:37:57.824 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.824 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.824 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:57.824 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536891+0000", 2024-09-12T18:37:57.825 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0021365799999999999 2024-09-12T18:37:57.825 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.825 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.825 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:57.825 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537001+0000", 2024-09-12T18:37:57.825 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000109459 2024-09-12T18:37:57.825 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.825 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.825 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:57.825 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537199+0000", 2024-09-12T18:37:57.825 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00019808 2024-09-12T18:37:57.825 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:57.825 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:57.825 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:57.826 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.826 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.826 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201576 5.2 5:42a132e0:::benchmark_data_smithi073_23739_object69299:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:57.826 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.490661+0000", 2024-09-12T18:37:57.826 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 37.253351901000002, 2024-09-12T18:37:57.826 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.041905530000000003, 2024-09-12T18:37:57.826 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:57.826 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:57.826 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:57.826 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:57.826 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:57.826 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:57.826 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201576 2024-09-12T18:37:57.826 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.827 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:57.827 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.827 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:57.827 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490661+0000", 2024-09-12T18:37:57.827 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:57.827 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.827 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.827 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:57.827 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490661+0000", 2024-09-12T18:37:57.827 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:57.827 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.827 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.827 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:57.828 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490662+0000", 2024-09-12T18:37:57.828 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.5030000000000001e-06 2024-09-12T18:37:57.828 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.828 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.828 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:57.828 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490667+0000", 2024-09-12T18:37:57.828 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.4479999999999996e-06 2024-09-12T18:37:57.828 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.828 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.828 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:57.828 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490675+0000", 2024-09-12T18:37:57.828 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8529999999999992e-06 2024-09-12T18:37:57.828 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.828 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.829 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:57.829 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490680+0000", 2024-09-12T18:37:57.829 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.1919999999999996e-06 2024-09-12T18:37:57.829 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.829 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.829 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:57.829 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490730+0000", 2024-09-12T18:37:57.829 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.9738999999999999e-05 2024-09-12T18:37:57.829 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.829 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.829 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:57.829 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490833+0000", 2024-09-12T18:37:57.829 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00010333 2024-09-12T18:37:57.829 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.830 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.830 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:57.830 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490930+0000", 2024-09-12T18:37:57.830 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7355999999999994e-05 2024-09-12T18:37:57.830 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.830 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.830 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:57.830 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493735+0000", 2024-09-12T18:37:57.830 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0028049329999999999 2024-09-12T18:37:57.830 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.830 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.830 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:57.830 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532451+0000", 2024-09-12T18:37:57.831 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.038715554999999999 2024-09-12T18:37:57.831 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.831 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.831 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:57.831 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532514+0000", 2024-09-12T18:37:57.831 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2885000000000005e-05 2024-09-12T18:37:57.831 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.831 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.831 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:57.831 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532566+0000", 2024-09-12T18:37:57.831 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2735999999999998e-05 2024-09-12T18:37:57.831 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:57.831 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:57.832 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:57.832 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.832 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.832 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201577 5.7 5:e93d4852:::benchmark_data_smithi073_23739_object69300:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:57.832 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.490721+0000", 2024-09-12T18:37:57.832 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 37.25329189, 2024-09-12T18:37:57.832 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.042097930999999998, 2024-09-12T18:37:57.832 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:57.832 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:57.832 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:57.832 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:57.832 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:57.832 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:57.833 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201577 2024-09-12T18:37:57.833 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.833 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:57.833 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.833 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:57.833 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490721+0000", 2024-09-12T18:37:57.833 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:57.833 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.833 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.833 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:57.833 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490721+0000", 2024-09-12T18:37:57.833 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:57.833 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.833 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.834 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:57.834 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490721+0000", 2024-09-12T18:37:57.834 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.1900000000000002e-07 2024-09-12T18:37:57.834 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.834 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.834 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:57.834 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490724+0000", 2024-09-12T18:37:57.834 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.6189999999999998e-06 2024-09-12T18:37:57.834 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.834 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.834 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:57.834 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490731+0000", 2024-09-12T18:37:57.834 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0129999999999996e-06 2024-09-12T18:37:57.834 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.835 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.835 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:57.835 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490736+0000", 2024-09-12T18:37:57.835 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6929999999999998e-06 2024-09-12T18:37:57.835 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.835 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.835 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:57.835 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490788+0000", 2024-09-12T18:37:57.835 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2104000000000001e-05 2024-09-12T18:37:57.835 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.835 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.835 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:57.835 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.490926+0000", 2024-09-12T18:37:57.836 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013852800000000001 2024-09-12T18:37:57.836 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.836 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.836 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:57.836 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491061+0000", 2024-09-12T18:37:57.836 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013499700000000001 2024-09-12T18:37:57.836 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.836 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.836 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:57.836 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531660+0000", 2024-09-12T18:37:57.836 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.040599046999999999 2024-09-12T18:37:57.836 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.837 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.837 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:57.837 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532630+0000", 2024-09-12T18:37:57.837 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00096974300000000002 2024-09-12T18:37:57.837 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.837 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.837 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:57.837 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532708+0000", 2024-09-12T18:37:57.837 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8108000000000005e-05 2024-09-12T18:37:57.837 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.837 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.837 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:57.838 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532819+0000", 2024-09-12T18:37:57.838 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00011046 2024-09-12T18:37:57.838 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:57.838 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:57.838 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:57.838 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.838 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.838 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201578 5.f 5:f19e206c:::benchmark_data_smithi073_23739_object69301:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:57.838 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.491951+0000", 2024-09-12T18:37:57.838 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 37.252061517000001, 2024-09-12T18:37:57.838 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.043303686000000001, 2024-09-12T18:37:57.838 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:57.838 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:57.839 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:57.839 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:57.839 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:57.839 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:57.839 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201578 2024-09-12T18:37:57.839 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.839 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:57.839 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.839 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:57.839 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491951+0000", 2024-09-12T18:37:57.839 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:57.839 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.839 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.840 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:57.840 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491951+0000", 2024-09-12T18:37:57.840 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:57.840 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.840 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.840 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:57.840 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491952+0000", 2024-09-12T18:37:57.840 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.221e-06 2024-09-12T18:37:57.840 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.840 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.840 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:57.840 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491957+0000", 2024-09-12T18:37:57.840 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.0529999999999997e-06 2024-09-12T18:37:57.841 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.841 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.841 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:57.841 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491970+0000", 2024-09-12T18:37:57.841 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.2731000000000001e-05 2024-09-12T18:37:57.841 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.841 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.841 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:57.841 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.491977+0000", 2024-09-12T18:37:57.841 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.1380000000000001e-06 2024-09-12T18:37:57.841 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.841 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.841 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:57.842 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492031+0000", 2024-09-12T18:37:57.842 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3857999999999998e-05 2024-09-12T18:37:57.842 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.842 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.842 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:57.842 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492125+0000", 2024-09-12T18:37:57.842 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.3275000000000004e-05 2024-09-12T18:37:57.842 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.842 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.842 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:57.842 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492205+0000", 2024-09-12T18:37:57.842 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.0793999999999999e-05 2024-09-12T18:37:57.842 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.842 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.843 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:57.843 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531712+0000", 2024-09-12T18:37:57.843 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.039506708000000001 2024-09-12T18:37:57.843 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.843 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.843 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:57.843 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535161+0000", 2024-09-12T18:37:57.843 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003448586 2024-09-12T18:37:57.843 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.843 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.843 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:57.843 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535202+0000", 2024-09-12T18:37:57.843 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.0945999999999997e-05 2024-09-12T18:37:57.844 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.844 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.844 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:57.844 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535255+0000", 2024-09-12T18:37:57.844 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.3375999999999999e-05 2024-09-12T18:37:57.844 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:57.844 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:57.844 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:57.844 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.844 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.844 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201579 5.5 5:ac64e9fd:::benchmark_data_smithi073_23739_object69302:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:57.844 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.492711+0000", 2024-09-12T18:37:57.845 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 37.251301345999998, 2024-09-12T18:37:57.845 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.04478994, 2024-09-12T18:37:57.845 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:57.845 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:57.845 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:57.845 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:57.845 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:57.845 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:57.845 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201579 2024-09-12T18:37:57.845 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.845 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:57.845 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.845 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:57.845 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492711+0000", 2024-09-12T18:37:57.846 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:57.846 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.846 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.846 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:57.846 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492711+0000", 2024-09-12T18:37:57.846 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:57.846 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.846 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.846 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:57.846 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492713+0000", 2024-09-12T18:37:57.846 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.105e-06 2024-09-12T18:37:57.846 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.846 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.847 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:57.847 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492720+0000", 2024-09-12T18:37:57.847 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.109e-06 2024-09-12T18:37:57.847 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.847 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.847 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:57.847 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492730+0000", 2024-09-12T18:37:57.847 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.049e-05 2024-09-12T18:37:57.847 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.847 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.847 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:57.847 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.492737+0000", 2024-09-12T18:37:57.847 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0960000000000003e-06 2024-09-12T18:37:57.848 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.848 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.848 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:57.848 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.494541+0000", 2024-09-12T18:37:57.848 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0018034139999999999 2024-09-12T18:37:57.848 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.848 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.848 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:57.848 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.494692+0000", 2024-09-12T18:37:57.848 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000150956 2024-09-12T18:37:57.848 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.848 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.848 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0,1", 2024-09-12T18:37:57.848 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.494843+0000", 2024-09-12T18:37:57.849 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.000151896 2024-09-12T18:37:57.849 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.849 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.849 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:57.849 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534665+0000", 2024-09-12T18:37:57.849 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.039821829000000003 2024-09-12T18:37:57.849 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.849 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.849 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:57.849 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536866+0000", 2024-09-12T18:37:57.849 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0022007839999999999 2024-09-12T18:37:57.849 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.849 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.849 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:57.850 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537212+0000", 2024-09-12T18:37:57.850 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00034636299999999998 2024-09-12T18:37:57.850 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.850 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.850 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:57.850 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537298+0000", 2024-09-12T18:37:57.850 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.5970999999999994e-05 2024-09-12T18:37:57.850 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.850 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.850 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:57.850 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.537501+0000", 2024-09-12T18:37:57.850 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00020292699999999999 2024-09-12T18:37:57.850 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:57.850 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:57.851 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:57.851 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.851 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.851 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201581 5.7 5:e819369d:::benchmark_data_smithi073_23739_object69304:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:57.851 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.493262+0000", 2024-09-12T18:37:57.851 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 37.250750996000001, 2024-09-12T18:37:57.851 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.042091362, 2024-09-12T18:37:57.851 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:57.851 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:57.851 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:57.851 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:57.851 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:57.852 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:57.852 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201581 2024-09-12T18:37:57.852 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.852 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:57.852 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.852 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:57.852 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493262+0000", 2024-09-12T18:37:57.852 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:57.852 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.852 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.852 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:57.852 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493262+0000", 2024-09-12T18:37:57.853 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:57.853 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.853 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.853 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:57.853 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493263+0000", 2024-09-12T18:37:57.853 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.6700000000000003e-07 2024-09-12T18:37:57.853 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.853 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.853 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:57.853 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493266+0000", 2024-09-12T18:37:57.853 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.4850000000000001e-06 2024-09-12T18:37:57.853 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.853 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.854 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:57.854 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493273+0000", 2024-09-12T18:37:57.854 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.2019999999999998e-06 2024-09-12T18:37:57.854 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.854 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.854 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:57.854 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493278+0000", 2024-09-12T18:37:57.854 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.6210000000000003e-06 2024-09-12T18:37:57.854 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.854 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.854 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:57.854 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493330+0000", 2024-09-12T18:37:57.854 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.2587000000000003e-05 2024-09-12T18:37:57.854 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.854 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.855 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:57.855 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493469+0000", 2024-09-12T18:37:57.855 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00013901199999999999 2024-09-12T18:37:57.855 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.855 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.855 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 0", 2024-09-12T18:37:57.855 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493612+0000", 2024-09-12T18:37:57.855 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00014237599999999999 2024-09-12T18:37:57.855 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.855 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.855 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:57.855 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531835+0000", 2024-09-12T18:37:57.855 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.038222735000000001 2024-09-12T18:37:57.856 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.856 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.856 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:57.856 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535265+0000", 2024-09-12T18:37:57.856 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.003430064 2024-09-12T18:37:57.856 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.856 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.856 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:57.856 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535319+0000", 2024-09-12T18:37:57.856 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 5.4375e-05 2024-09-12T18:37:57.856 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.856 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.856 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:57.856 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.535353+0000", 2024-09-12T18:37:57.857 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 3.4137999999999997e-05 2024-09-12T18:37:57.857 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:57.857 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:57.857 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:57.857 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.857 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.857 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:201573 5.3 e67/21 5:cf4becdf:::benchmark_data_smithi073_23739_object69296:head v 67'12363, mlcod=67'12360)", 2024-09-12T18:37:57.857 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.493437+0000", 2024-09-12T18:37:57.857 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 37.250576060999997, 2024-09-12T18:37:57.857 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.041109664999999997, 2024-09-12T18:37:57.857 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:57.857 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:57.857 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:57.857 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:57.857 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.858 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:57.858 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493437+0000", 2024-09-12T18:37:57.858 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:57.858 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.858 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.858 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:57.858 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493437+0000", 2024-09-12T18:37:57.858 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:57.858 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.858 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.858 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:57.858 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493438+0000", 2024-09-12T18:37:57.858 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.125e-06 2024-09-12T18:37:57.859 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.859 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.859 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:57.859 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493444+0000", 2024-09-12T18:37:57.859 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.2269999999999998e-06 2024-09-12T18:37:57.859 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.859 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.859 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:57.859 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493457+0000", 2024-09-12T18:37:57.859 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.312e-05 2024-09-12T18:37:57.859 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.859 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.860 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:57.860 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493466+0000", 2024-09-12T18:37:57.860 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 8.6309999999999992e-06 2024-09-12T18:37:57.860 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.860 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.860 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:57.860 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493526+0000", 2024-09-12T18:37:57.860 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.0316000000000003e-05 2024-09-12T18:37:57.860 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.860 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.860 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:57.860 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493541+0000", 2024-09-12T18:37:57.860 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.4459e-05 2024-09-12T18:37:57.860 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.861 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.861 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:57.861 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534501+0000", 2024-09-12T18:37:57.861 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.040960215000000001 2024-09-12T18:37:57.861 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.861 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.861 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:57.861 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534546+0000", 2024-09-12T18:37:57.861 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.5571999999999997e-05 2024-09-12T18:37:57.861 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:57.861 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:57.861 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:57.861 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.862 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.862 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_op(client.4480.0:201582 5.f 5:f90f147f:::benchmark_data_smithi073_23739_object69305:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:37:57.862 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.493597+0000", 2024-09-12T18:37:57.862 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 37.250415529999998, 2024-09-12T18:37:57.862 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.045457567999999997, 2024-09-12T18:37:57.862 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:57.862 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:57.862 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:57.862 INFO:teuthology.orchestra.run.smithi162.stdout: "client_info": { 2024-09-12T18:37:57.862 INFO:teuthology.orchestra.run.smithi162.stdout: "client": "client.4480", 2024-09-12T18:37:57.862 INFO:teuthology.orchestra.run.smithi162.stdout: "client_addr": "172.21.15.73:0/273985361", 2024-09-12T18:37:57.862 INFO:teuthology.orchestra.run.smithi162.stdout: "tid": 201582 2024-09-12T18:37:57.863 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.863 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:57.863 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.863 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:57.863 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493597+0000", 2024-09-12T18:37:57.863 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:57.863 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.863 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.863 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:57.863 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493597+0000", 2024-09-12T18:37:57.863 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:57.863 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.863 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.863 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:57.864 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493598+0000", 2024-09-12T18:37:57.864 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 9.7699999999999992e-07 2024-09-12T18:37:57.864 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.864 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.864 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:57.864 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493609+0000", 2024-09-12T18:37:57.864 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.1297e-05 2024-09-12T18:37:57.864 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.864 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.864 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:57.864 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493620+0000", 2024-09-12T18:37:57.864 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.0930999999999999e-05 2024-09-12T18:37:57.864 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.864 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.864 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:57.865 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.493640+0000", 2024-09-12T18:37:57.865 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.0072e-05 2024-09-12T18:37:57.865 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.865 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.865 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:57.865 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531770+0000", 2024-09-12T18:37:57.865 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.038129652999999999 2024-09-12T18:37:57.865 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.865 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.865 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:57.865 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532046+0000", 2024-09-12T18:37:57.865 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00027561600000000001 2024-09-12T18:37:57.865 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.865 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.866 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "waiting for subops from 1", 2024-09-12T18:37:57.866 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.532337+0000", 2024-09-12T18:37:57.866 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.00029169200000000003 2024-09-12T18:37:57.866 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.866 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.866 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:37:57.866 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.536640+0000", 2024-09-12T18:37:57.866 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0043023499999999999 2024-09-12T18:37:57.866 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.866 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.866 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "op_commit", 2024-09-12T18:37:57.866 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.538943+0000", 2024-09-12T18:37:57.867 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0023032740000000001 2024-09-12T18:37:57.867 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.867 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.867 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:57.867 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.539013+0000", 2024-09-12T18:37:57.867 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 6.9944000000000007e-05 2024-09-12T18:37:57.867 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.867 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.867 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:57.868 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.539055+0000", 2024-09-12T18:37:57.868 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.1761999999999998e-05 2024-09-12T18:37:57.868 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:57.868 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:57.868 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:57.868 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.868 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.868 INFO:teuthology.orchestra.run.smithi162.stdout: "description": "osd_repop(client.4480.0:201583 5.d e67/21 5:b91eedec:::benchmark_data_smithi073_23739_object69306:head v 67'12761, mlcod=67'12759)", 2024-09-12T18:37:57.868 INFO:teuthology.orchestra.run.smithi162.stdout: "initiated_at": "2024-09-12T18:37:20.495034+0000", 2024-09-12T18:37:57.868 INFO:teuthology.orchestra.run.smithi162.stdout: "age": 37.248979155000001, 2024-09-12T18:37:57.868 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.047966852999999997, 2024-09-12T18:37:57.868 INFO:teuthology.orchestra.run.smithi162.stdout: "continuous": false, 2024-09-12T18:37:57.868 INFO:teuthology.orchestra.run.smithi162.stdout: "type_data": { 2024-09-12T18:37:57.868 INFO:teuthology.orchestra.run.smithi162.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:37:57.869 INFO:teuthology.orchestra.run.smithi162.stdout: "events": [ 2024-09-12T18:37:57.869 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.869 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "initiated", 2024-09-12T18:37:57.869 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.495034+0000", 2024-09-12T18:37:57.869 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:57.869 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.869 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.869 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "header_read", 2024-09-12T18:37:57.869 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.495034+0000", 2024-09-12T18:37:57.869 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0 2024-09-12T18:37:57.869 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.869 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.870 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "throttled", 2024-09-12T18:37:57.870 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.495035+0000", 2024-09-12T18:37:57.870 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 1.023e-06 2024-09-12T18:37:57.870 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.870 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.870 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "all_read", 2024-09-12T18:37:57.870 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.495040+0000", 2024-09-12T18:37:57.870 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 4.9300000000000002e-06 2024-09-12T18:37:57.870 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.870 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.870 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "dispatched", 2024-09-12T18:37:57.870 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531510+0000", 2024-09-12T18:37:57.870 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.036470250000000003 2024-09-12T18:37:57.870 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.871 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.871 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "queued_for_pg", 2024-09-12T18:37:57.871 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.531518+0000", 2024-09-12T18:37:57.871 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.8490000000000006e-06 2024-09-12T18:37:57.871 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.871 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.871 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "reached_pg", 2024-09-12T18:37:57.871 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534395+0000", 2024-09-12T18:37:57.871 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.002877246 2024-09-12T18:37:57.871 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.871 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.871 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "started", 2024-09-12T18:37:57.871 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.534418+0000", 2024-09-12T18:37:57.872 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 2.3119e-05 2024-09-12T18:37:57.872 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.872 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.872 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "commit_sent", 2024-09-12T18:37:57.872 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.542930+0000", 2024-09-12T18:37:57.872 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 0.0085121929999999995 2024-09-12T18:37:57.872 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-12T18:37:57.872 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-09-12T18:37:57.872 INFO:teuthology.orchestra.run.smithi162.stdout: "event": "done", 2024-09-12T18:37:57.872 INFO:teuthology.orchestra.run.smithi162.stdout: "time": "2024-09-12T18:37:20.543000+0000", 2024-09-12T18:37:57.872 INFO:teuthology.orchestra.run.smithi162.stdout: "duration": 7.0242999999999998e-05 2024-09-12T18:37:57.872 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:57.872 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:57.873 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:57.873 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-12T18:37:57.873 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-12T18:37:57.873 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-12T18:37:59.334 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T18:38:00.313 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is unset 2024-09-12T18:38:00.336 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T18:38:01.323 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is unset 2024-09-12T18:38:01.658 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-12T18:38:01.806 INFO:teuthology.orchestra.run.smithi073.stdout:mon.a: {} 2024-09-12T18:38:01.806 INFO:teuthology.orchestra.run.smithi073.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T18:38:01.815 INFO:teuthology.orchestra.run.smithi073.stdout:mon.b: {} 2024-09-12T18:38:01.815 INFO:teuthology.orchestra.run.smithi073.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T18:38:01.825 INFO:teuthology.orchestra.run.smithi073.stdout:mon.c: {} 2024-09-12T18:38:01.825 INFO:teuthology.orchestra.run.smithi073.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T18:38:01.842 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-12T18:38:02.327 INFO:teuthology.orchestra.run.smithi073.stderr:reweighted osd.0 to 1 (10000) 2024-09-12T18:38:02.349 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-12T18:38:03.335 INFO:teuthology.orchestra.run.smithi073.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-12T18:38:03.359 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-12T18:38:04.344 INFO:teuthology.orchestra.run.smithi073.stderr:reweighted osd.1 to 1 (10000) 2024-09-12T18:38:04.367 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-12T18:38:05.358 INFO:teuthology.orchestra.run.smithi073.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-12T18:38:05.381 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-12T18:38:06.360 INFO:teuthology.orchestra.run.smithi073.stderr:reweighted osd.2 to 1 (10000) 2024-09-12T18:38:06.386 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-12T18:38:07.370 INFO:teuthology.orchestra.run.smithi073.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-12T18:38:07.394 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-12T18:38:07.394 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-12T18:38:07.394 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-12T18:38:07.394 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-12T18:38:07.394 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T18:38:07.394 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T18:38:07.686 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:38:07.686 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":91,"fsid":"c08d5a84-711b-44bf-bdf1-e06ecc2c7c00","created":"2024-09-12T18:35:02.695853+0000","modified":"2024-09-12T18:38:07.360408+0000","last_up_change":"2024-09-12T18:35:12.464628+0000","last_in_change":"2024-09-12T18:35:04.352525+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T18:35:12.418430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T18:35:18.665309+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T18:35:23.447845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T18:35:23.959973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f1cf24e8-6179-4666-a444-fa81ef0d7482","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6801","nonce":2710632206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6803","nonce":2710632206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6807","nonce":2710632206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6805","nonce":2710632206}]},"public_addr":"172.21.15.114:6801/2710632206","cluster_addr":"172.21.15.114:6803/2710632206","heartbeat_back_addr":"172.21.15.114:6807/2710632206","heartbeat_front_addr":"172.21.15.114:6805/2710632206","state":["exists","up"]},{"osd":1,"uuid":"3fdb0044-2820-4411-978b-4b6e94fbf0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6801","nonce":862189968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6803","nonce":862189968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6807","nonce":862189968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6805","nonce":862189968}]},"public_addr":"172.21.15.143:6801/862189968","cluster_addr":"172.21.15.143:6803/862189968","heartbeat_back_addr":"172.21.15.143:6807/862189968","heartbeat_front_addr":"172.21.15.143:6805/862189968","state":["exists","up"]},{"osd":2,"uuid":"6fb554da-561f-4aa2-b855-0e3adb98b057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6801","nonce":1397104153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6803","nonce":1397104153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6807","nonce":1397104153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6805","nonce":1397104153}]},"public_addr":"172.21.15.162:6801/1397104153","cluster_addr":"172.21.15.162:6803/1397104153","heartbeat_back_addr":"172.21.15.162:6807/1397104153","heartbeat_front_addr":"172.21.15.162:6805/1397104153","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:35:10.239320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:35:10.861760+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:35:10.355997+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"2.6","osds":[2,0]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:38:07.705 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T18:38:07.705 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T18:38:07.988 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:38:07.988 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":91,"fsid":"c08d5a84-711b-44bf-bdf1-e06ecc2c7c00","created":"2024-09-12T18:35:02.695853+0000","modified":"2024-09-12T18:38:07.360408+0000","last_up_change":"2024-09-12T18:35:12.464628+0000","last_in_change":"2024-09-12T18:35:04.352525+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T18:35:12.418430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T18:35:18.665309+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T18:35:23.447845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T18:35:23.959973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f1cf24e8-6179-4666-a444-fa81ef0d7482","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6801","nonce":2710632206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6803","nonce":2710632206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6807","nonce":2710632206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6805","nonce":2710632206}]},"public_addr":"172.21.15.114:6801/2710632206","cluster_addr":"172.21.15.114:6803/2710632206","heartbeat_back_addr":"172.21.15.114:6807/2710632206","heartbeat_front_addr":"172.21.15.114:6805/2710632206","state":["exists","up"]},{"osd":1,"uuid":"3fdb0044-2820-4411-978b-4b6e94fbf0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6801","nonce":862189968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6803","nonce":862189968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6807","nonce":862189968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6805","nonce":862189968}]},"public_addr":"172.21.15.143:6801/862189968","cluster_addr":"172.21.15.143:6803/862189968","heartbeat_back_addr":"172.21.15.143:6807/862189968","heartbeat_front_addr":"172.21.15.143:6805/862189968","state":["exists","up"]},{"osd":2,"uuid":"6fb554da-561f-4aa2-b855-0e3adb98b057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6801","nonce":1397104153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6803","nonce":1397104153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6807","nonce":1397104153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6805","nonce":1397104153}]},"public_addr":"172.21.15.162:6801/1397104153","cluster_addr":"172.21.15.162:6803/1397104153","heartbeat_back_addr":"172.21.15.162:6807/1397104153","heartbeat_front_addr":"172.21.15.162:6805/1397104153","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:35:10.239320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:35:10.861760+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:35:10.355997+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"2.6","osds":[2,0]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:38:08.006 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T18:38:08.006 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T18:38:08.007 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T18:38:08.162 INFO:teuthology.orchestra.run.smithi073.stdout:34359738407 2024-09-12T18:38:08.162 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T18:38:08.163 INFO:teuthology.orchestra.run.smithi073.stdout:38654705702 2024-09-12T18:38:08.164 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T18:38:08.168 INFO:teuthology.orchestra.run.smithi073.stdout:34359738407 2024-09-12T18:38:08.168 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T18:38:08.468 INFO:teuthology.orchestra.run.smithi073.stdout:34359738405 2024-09-12T18:38:08.487 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738407 got 34359738405 for osd.2 2024-09-12T18:38:08.520 INFO:teuthology.orchestra.run.smithi073.stdout:34359738405 2024-09-12T18:38:08.522 INFO:teuthology.orchestra.run.smithi073.stdout:38654705701 2024-09-12T18:38:08.539 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738407 got 34359738405 for osd.0 2024-09-12T18:38:08.541 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705702 got 38654705701 for osd.1 2024-09-12T18:38:09.488 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T18:38:09.541 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T18:38:09.542 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T18:38:09.813 INFO:teuthology.orchestra.run.smithi073.stdout:34359738407 2024-09-12T18:38:09.830 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738407 got 34359738407 for osd.2 2024-09-12T18:38:09.831 DEBUG:teuthology.parallel:result is None 2024-09-12T18:38:09.846 INFO:teuthology.orchestra.run.smithi073.stdout:34359738407 2024-09-12T18:38:09.855 INFO:teuthology.orchestra.run.smithi073.stdout:38654705702 2024-09-12T18:38:09.863 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738407 got 34359738407 for osd.0 2024-09-12T18:38:09.863 DEBUG:teuthology.parallel:result is None 2024-09-12T18:38:09.872 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705702 got 38654705702 for osd.1 2024-09-12T18:38:09.872 DEBUG:teuthology.parallel:result is None 2024-09-12T18:38:09.873 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-12T18:38:09.873 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:38:10.198 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:38:10.200 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T18:38:10.214 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":178,"stamp":"2024-09-12T18:38:08.425006+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":192,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":881096,"kb_used_data":3144,"kb_used_omap":4,"kb_used_meta":877883,"kb_avail":282234424,"statfs":{"total":289910292480,"available":289008050176,"internally_reserved":0,"allocated":3219456,"data_stored":2352617,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4783,"internal_metadata":898952529},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.081113"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368487+0000","last_change":"2024-09-12T18:38:03.358323+0000","last_active":"2024-09-12T18:38:07.368487+0000","last_peered":"2024-09-12T18:38:07.368487+0000","last_clean":"2024-09-12T18:38:07.368487+0000","last_became_active":"2024-09-12T18:38:03.357317+0000","last_became_peered":"2024-09-12T18:38:03.357317+0000","last_unstale":"2024-09-12T18:38:07.368487+0000","last_undegraded":"2024-09-12T18:38:07.368487+0000","last_fullsized":"2024-09-12T18:38:07.368487+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:55.315464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367135+0000","last_change":"2024-09-12T18:35:25.659760+0000","last_active":"2024-09-12T18:38:07.367135+0000","last_peered":"2024-09-12T18:38:07.367135+0000","last_clean":"2024-09-12T18:38:07.367135+0000","last_became_active":"2024-09-12T18:35:25.654920+0000","last_became_peered":"2024-09-12T18:35:25.654920+0000","last_unstale":"2024-09-12T18:38:07.367135+0000","last_undegraded":"2024-09-12T18:38:07.367135+0000","last_fullsized":"2024-09-12T18:38:07.367135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:21.519881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359587+0000","last_change":"2024-09-12T18:35:25.659460+0000","last_active":"2024-09-12T18:38:06.359587+0000","last_peered":"2024-09-12T18:38:06.359587+0000","last_clean":"2024-09-12T18:38:06.359587+0000","last_became_active":"2024-09-12T18:35:25.657782+0000","last_became_peered":"2024-09-12T18:35:25.657782+0000","last_unstale":"2024-09-12T18:38:06.359587+0000","last_undegraded":"2024-09-12T18:38:06.359587+0000","last_fullsized":"2024-09-12T18:38:06.359587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:38.544284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358249+0000","last_change":"2024-09-12T18:35:25.663617+0000","last_active":"2024-09-12T18:38:06.358249+0000","last_peered":"2024-09-12T18:38:06.358249+0000","last_clean":"2024-09-12T18:38:06.358249+0000","last_became_active":"2024-09-12T18:35:25.661977+0000","last_became_peered":"2024-09-12T18:35:25.661977+0000","last_unstale":"2024-09-12T18:38:06.358249+0000","last_undegraded":"2024-09-12T18:38:06.358249+0000","last_fullsized":"2024-09-12T18:38:06.358249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:14.748234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367138+0000","last_change":"2024-09-12T18:35:25.656566+0000","last_active":"2024-09-12T18:38:07.367138+0000","last_peered":"2024-09-12T18:38:07.367138+0000","last_clean":"2024-09-12T18:38:07.367138+0000","last_became_active":"2024-09-12T18:35:25.654898+0000","last_became_peered":"2024-09-12T18:35:25.654898+0000","last_unstale":"2024-09-12T18:38:07.367138+0000","last_undegraded":"2024-09-12T18:38:07.367138+0000","last_fullsized":"2024-09-12T18:38:07.367138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:36.113250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.357732+0000","last_change":"2024-09-12T18:38:03.366489+0000","last_active":"2024-09-12T18:38:06.357732+0000","last_peered":"2024-09-12T18:38:06.357732+0000","last_clean":"2024-09-12T18:38:06.357732+0000","last_became_active":"2024-09-12T18:38:03.364745+0000","last_became_peered":"2024-09-12T18:38:03.364745+0000","last_unstale":"2024-09-12T18:38:06.357732+0000","last_undegraded":"2024-09-12T18:38:06.357732+0000","last_fullsized":"2024-09-12T18:38:06.357732+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:42.397517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.357624+0000","last_change":"2024-09-12T18:35:25.659811+0000","last_active":"2024-09-12T18:38:06.357624+0000","last_peered":"2024-09-12T18:38:06.357624+0000","last_clean":"2024-09-12T18:38:06.357624+0000","last_became_active":"2024-09-12T18:35:25.658998+0000","last_became_peered":"2024-09-12T18:35:25.658998+0000","last_unstale":"2024-09-12T18:38:06.357624+0000","last_undegraded":"2024-09-12T18:38:06.357624+0000","last_fullsized":"2024-09-12T18:38:06.357624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.357347+0000","last_change":"2024-09-12T18:38:03.365773+0000","last_active":"2024-09-12T18:38:06.357347+0000","last_peered":"2024-09-12T18:38:06.357347+0000","last_clean":"2024-09-12T18:38:06.357347+0000","last_became_active":"2024-09-12T18:38:03.364845+0000","last_became_peered":"2024-09-12T18:38:03.364845+0000","last_unstale":"2024-09-12T18:38:06.357347+0000","last_undegraded":"2024-09-12T18:38:06.357347+0000","last_fullsized":"2024-09-12T18:38:06.357347+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:19.384528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369867+0000","last_change":"2024-09-12T18:35:25.668339+0000","last_active":"2024-09-12T18:38:07.369867+0000","last_peered":"2024-09-12T18:38:07.369867+0000","last_clean":"2024-09-12T18:38:07.369867+0000","last_became_active":"2024-09-12T18:35:25.667608+0000","last_became_peered":"2024-09-12T18:35:25.667608+0000","last_unstale":"2024-09-12T18:38:07.369867+0000","last_undegraded":"2024-09-12T18:38:07.369867+0000","last_fullsized":"2024-09-12T18:38:07.369867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:15.699745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367232+0000","last_change":"2024-09-12T18:38:03.358177+0000","last_active":"2024-09-12T18:38:07.367232+0000","last_peered":"2024-09-12T18:38:07.367232+0000","last_clean":"2024-09-12T18:38:07.367232+0000","last_became_active":"2024-09-12T18:38:03.357446+0000","last_became_peered":"2024-09-12T18:38:03.357446+0000","last_unstale":"2024-09-12T18:38:07.367232+0000","last_undegraded":"2024-09-12T18:38:07.367232+0000","last_fullsized":"2024-09-12T18:38:07.367232+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:13.110496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359515+0000","last_change":"2024-09-12T18:38:03.356440+0000","last_active":"2024-09-12T18:38:06.359515+0000","last_peered":"2024-09-12T18:38:06.359515+0000","last_clean":"2024-09-12T18:38:06.359515+0000","last_became_active":"2024-09-12T18:38:03.355561+0000","last_became_peered":"2024-09-12T18:38:03.355561+0000","last_unstale":"2024-09-12T18:38:06.359515+0000","last_undegraded":"2024-09-12T18:38:06.359515+0000","last_fullsized":"2024-09-12T18:38:06.359515+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:43.438258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366852+0000","last_change":"2024-09-12T18:35:25.649885+0000","last_active":"2024-09-12T18:38:07.366852+0000","last_peered":"2024-09-12T18:38:07.366852+0000","last_clean":"2024-09-12T18:38:07.366852+0000","last_became_active":"2024-09-12T18:35:25.649111+0000","last_became_peered":"2024-09-12T18:35:25.649111+0000","last_unstale":"2024-09-12T18:38:07.366852+0000","last_undegraded":"2024-09-12T18:38:07.366852+0000","last_fullsized":"2024-09-12T18:38:07.366852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:17.162410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366640+0000","last_change":"2024-09-12T18:38:03.349917+0000","last_active":"2024-09-12T18:38:07.366640+0000","last_peered":"2024-09-12T18:38:07.366640+0000","last_clean":"2024-09-12T18:38:07.366640+0000","last_became_active":"2024-09-12T18:38:03.349130+0000","last_became_peered":"2024-09-12T18:38:03.349130+0000","last_unstale":"2024-09-12T18:38:07.366640+0000","last_undegraded":"2024-09-12T18:38:07.366640+0000","last_fullsized":"2024-09-12T18:38:07.366640+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:45.548888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.357883+0000","last_change":"2024-09-12T18:35:25.657913+0000","last_active":"2024-09-12T18:38:06.357883+0000","last_peered":"2024-09-12T18:38:06.357883+0000","last_clean":"2024-09-12T18:38:06.357883+0000","last_became_active":"2024-09-12T18:35:25.657082+0000","last_became_peered":"2024-09-12T18:35:25.657082+0000","last_unstale":"2024-09-12T18:38:06.357883+0000","last_undegraded":"2024-09-12T18:38:06.357883+0000","last_fullsized":"2024-09-12T18:38:06.357883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:21.538633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.357675+0000","last_change":"2024-09-12T18:35:25.658763+0000","last_active":"2024-09-12T18:38:06.357675+0000","last_peered":"2024-09-12T18:38:06.357675+0000","last_clean":"2024-09-12T18:38:06.357675+0000","last_became_active":"2024-09-12T18:35:25.657508+0000","last_became_peered":"2024-09-12T18:35:25.657508+0000","last_unstale":"2024-09-12T18:38:06.357675+0000","last_undegraded":"2024-09-12T18:38:06.357675+0000","last_fullsized":"2024-09-12T18:38:06.357675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:13.170519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.357358+0000","last_change":"2024-09-12T18:35:25.653730+0000","last_active":"2024-09-12T18:38:06.357358+0000","last_peered":"2024-09-12T18:38:06.357358+0000","last_clean":"2024-09-12T18:38:06.357358+0000","last_became_active":"2024-09-12T18:35:25.651535+0000","last_became_peered":"2024-09-12T18:35:25.651535+0000","last_unstale":"2024-09-12T18:38:06.357358+0000","last_undegraded":"2024-09-12T18:38:06.357358+0000","last_fullsized":"2024-09-12T18:38:06.357358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.370149+0000","last_change":"2024-09-12T18:35:25.656513+0000","last_active":"2024-09-12T18:38:07.370149+0000","last_peered":"2024-09-12T18:38:07.370149+0000","last_clean":"2024-09-12T18:38:07.370149+0000","last_became_active":"2024-09-12T18:35:25.653440+0000","last_became_peered":"2024-09-12T18:35:25.653440+0000","last_unstale":"2024-09-12T18:38:07.370149+0000","last_undegraded":"2024-09-12T18:38:07.370149+0000","last_fullsized":"2024-09-12T18:38:07.370149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:18.693161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367487+0000","last_change":"2024-09-12T18:35:25.657991+0000","last_active":"2024-09-12T18:38:07.367487+0000","last_peered":"2024-09-12T18:38:07.367487+0000","last_clean":"2024-09-12T18:38:07.367487+0000","last_became_active":"2024-09-12T18:35:25.653934+0000","last_became_peered":"2024-09-12T18:35:25.653934+0000","last_unstale":"2024-09-12T18:38:07.367487+0000","last_undegraded":"2024-09-12T18:38:07.367487+0000","last_fullsized":"2024-09-12T18:38:07.367487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:05.418901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368965+0000","last_change":"2024-09-12T18:38:03.358270+0000","last_active":"2024-09-12T18:38:07.368965+0000","last_peered":"2024-09-12T18:38:07.368965+0000","last_clean":"2024-09-12T18:38:07.368965+0000","last_became_active":"2024-09-12T18:38:03.357363+0000","last_became_peered":"2024-09-12T18:38:03.357363+0000","last_unstale":"2024-09-12T18:38:07.368965+0000","last_undegraded":"2024-09-12T18:38:07.368965+0000","last_fullsized":"2024-09-12T18:38:07.368965+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:56.658700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358511+0000","last_change":"2024-09-12T18:35:25.661176+0000","last_active":"2024-09-12T18:38:06.358511+0000","last_peered":"2024-09-12T18:38:06.358511+0000","last_clean":"2024-09-12T18:38:06.358511+0000","last_became_active":"2024-09-12T18:35:25.659534+0000","last_became_peered":"2024-09-12T18:35:25.659534+0000","last_unstale":"2024-09-12T18:38:06.358511+0000","last_undegraded":"2024-09-12T18:38:06.358511+0000","last_fullsized":"2024-09-12T18:38:06.358511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:40.145442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358406+0000","last_change":"2024-09-12T18:35:25.650632+0000","last_active":"2024-09-12T18:38:06.358406+0000","last_peered":"2024-09-12T18:38:06.358406+0000","last_clean":"2024-09-12T18:38:06.358406+0000","last_became_active":"2024-09-12T18:35:25.649333+0000","last_became_peered":"2024-09-12T18:35:25.649333+0000","last_unstale":"2024-09-12T18:38:06.358406+0000","last_undegraded":"2024-09-12T18:38:06.358406+0000","last_fullsized":"2024-09-12T18:38:06.358406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:30.537572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366475+0000","last_change":"2024-09-12T18:35:25.648245+0000","last_active":"2024-09-12T18:38:07.366475+0000","last_peered":"2024-09-12T18:38:07.366475+0000","last_clean":"2024-09-12T18:38:07.366475+0000","last_became_active":"2024-09-12T18:35:25.646357+0000","last_became_peered":"2024-09-12T18:35:25.646357+0000","last_unstale":"2024-09-12T18:38:07.366475+0000","last_undegraded":"2024-09-12T18:38:07.366475+0000","last_fullsized":"2024-09-12T18:38:07.366475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:05.662140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367728+0000","last_change":"2024-09-12T18:35:25.661613+0000","last_active":"2024-09-12T18:38:07.367728+0000","last_peered":"2024-09-12T18:38:07.367728+0000","last_clean":"2024-09-12T18:38:07.367728+0000","last_became_active":"2024-09-12T18:35:25.658833+0000","last_became_peered":"2024-09-12T18:35:25.658833+0000","last_unstale":"2024-09-12T18:38:07.367728+0000","last_undegraded":"2024-09-12T18:38:07.367728+0000","last_fullsized":"2024-09-12T18:38:07.367728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:51.064080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366639+0000","last_change":"2024-09-12T18:35:25.657782+0000","last_active":"2024-09-12T18:38:07.366639+0000","last_peered":"2024-09-12T18:38:07.366639+0000","last_clean":"2024-09-12T18:38:07.366639+0000","last_became_active":"2024-09-12T18:35:25.655295+0000","last_became_peered":"2024-09-12T18:35:25.655295+0000","last_unstale":"2024-09-12T18:38:07.366639+0000","last_undegraded":"2024-09-12T18:38:07.366639+0000","last_fullsized":"2024-09-12T18:38:07.366639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:37.744175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368546+0000","last_change":"2024-09-12T18:35:25.654863+0000","last_active":"2024-09-12T18:38:07.368546+0000","last_peered":"2024-09-12T18:38:07.368546+0000","last_clean":"2024-09-12T18:38:07.368546+0000","last_became_active":"2024-09-12T18:35:25.650407+0000","last_became_peered":"2024-09-12T18:35:25.650407+0000","last_unstale":"2024-09-12T18:38:07.368546+0000","last_undegraded":"2024-09-12T18:38:07.368546+0000","last_fullsized":"2024-09-12T18:38:07.368546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:38.395666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369981+0000","last_change":"2024-09-12T18:35:25.662414+0000","last_active":"2024-09-12T18:38:07.369981+0000","last_peered":"2024-09-12T18:38:07.369981+0000","last_clean":"2024-09-12T18:38:07.369981+0000","last_became_active":"2024-09-12T18:35:25.660126+0000","last_became_peered":"2024-09-12T18:35:25.660126+0000","last_unstale":"2024-09-12T18:38:07.369981+0000","last_undegraded":"2024-09-12T18:38:07.369981+0000","last_fullsized":"2024-09-12T18:38:07.369981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:48.437139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359333+0000","last_change":"2024-09-12T18:35:25.661523+0000","last_active":"2024-09-12T18:38:06.359333+0000","last_peered":"2024-09-12T18:38:06.359333+0000","last_clean":"2024-09-12T18:38:06.359333+0000","last_became_active":"2024-09-12T18:35:25.659338+0000","last_became_peered":"2024-09-12T18:35:25.659338+0000","last_unstale":"2024-09-12T18:38:06.359333+0000","last_undegraded":"2024-09-12T18:38:06.359333+0000","last_fullsized":"2024-09-12T18:38:06.359333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:37.083820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367372+0000","last_change":"2024-09-12T18:35:25.662445+0000","last_active":"2024-09-12T18:38:07.367372+0000","last_peered":"2024-09-12T18:38:07.367372+0000","last_clean":"2024-09-12T18:38:07.367372+0000","last_became_active":"2024-09-12T18:35:25.659496+0000","last_became_peered":"2024-09-12T18:35:25.659496+0000","last_unstale":"2024-09-12T18:38:07.367372+0000","last_undegraded":"2024-09-12T18:38:07.367372+0000","last_fullsized":"2024-09-12T18:38:07.367372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:03.270420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368653+0000","last_change":"2024-09-12T18:38:03.357219+0000","last_active":"2024-09-12T18:38:07.368653+0000","last_peered":"2024-09-12T18:38:07.368653+0000","last_clean":"2024-09-12T18:38:07.368653+0000","last_became_active":"2024-09-12T18:38:03.356412+0000","last_became_peered":"2024-09-12T18:38:03.356412+0000","last_unstale":"2024-09-12T18:38:07.368653+0000","last_undegraded":"2024-09-12T18:38:07.368653+0000","last_fullsized":"2024-09-12T18:38:07.368653+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:53.007632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367404+0000","last_change":"2024-09-12T18:35:25.650507+0000","last_active":"2024-09-12T18:38:07.367404+0000","last_peered":"2024-09-12T18:38:07.367404+0000","last_clean":"2024-09-12T18:38:07.367404+0000","last_became_active":"2024-09-12T18:35:25.649415+0000","last_became_peered":"2024-09-12T18:35:25.649415+0000","last_unstale":"2024-09-12T18:38:07.367404+0000","last_undegraded":"2024-09-12T18:38:07.367404+0000","last_fullsized":"2024-09-12T18:38:07.367404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:23.081416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367879+0000","last_change":"2024-09-12T18:35:25.653949+0000","last_active":"2024-09-12T18:38:07.367879+0000","last_peered":"2024-09-12T18:38:07.367879+0000","last_clean":"2024-09-12T18:38:07.367879+0000","last_became_active":"2024-09-12T18:35:25.652992+0000","last_became_peered":"2024-09-12T18:35:25.652992+0000","last_unstale":"2024-09-12T18:38:07.367879+0000","last_undegraded":"2024-09-12T18:38:07.367879+0000","last_fullsized":"2024-09-12T18:38:07.367879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:47.687372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.357652+0000","last_change":"2024-09-12T18:38:03.356306+0000","last_active":"2024-09-12T18:38:06.357652+0000","last_peered":"2024-09-12T18:38:06.357652+0000","last_clean":"2024-09-12T18:38:06.357652+0000","last_became_active":"2024-09-12T18:38:03.355052+0000","last_became_peered":"2024-09-12T18:38:03.355052+0000","last_unstale":"2024-09-12T18:38:06.357652+0000","last_undegraded":"2024-09-12T18:38:06.357652+0000","last_fullsized":"2024-09-12T18:38:06.357652+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:54.986299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367305+0000","last_change":"2024-09-12T18:38:03.351904+0000","last_active":"2024-09-12T18:38:07.367305+0000","last_peered":"2024-09-12T18:38:07.367305+0000","last_clean":"2024-09-12T18:38:07.367305+0000","last_became_active":"2024-09-12T18:38:03.351112+0000","last_became_peered":"2024-09-12T18:38:03.351112+0000","last_unstale":"2024-09-12T18:38:07.367305+0000","last_undegraded":"2024-09-12T18:38:07.367305+0000","last_fullsized":"2024-09-12T18:38:07.367305+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:52.881469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":160,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359058+0000","last_change":"2024-09-12T18:35:24.657739+0000","last_active":"2024-09-12T18:38:06.359058+0000","last_peered":"2024-09-12T18:38:06.359058+0000","last_clean":"2024-09-12T18:38:06.359058+0000","last_became_active":"2024-09-12T18:35:24.656208+0000","last_became_peered":"2024-09-12T18:35:24.656208+0000","last_unstale":"2024-09-12T18:38:06.359058+0000","last_undegraded":"2024-09-12T18:38:06.359058+0000","last_fullsized":"2024-09-12T18:38:06.359058+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:50.073716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367762+0000","last_change":"2024-09-12T18:35:25.651651+0000","last_active":"2024-09-12T18:38:07.367762+0000","last_peered":"2024-09-12T18:38:07.367762+0000","last_clean":"2024-09-12T18:38:07.367762+0000","last_became_active":"2024-09-12T18:35:25.650849+0000","last_became_peered":"2024-09-12T18:35:25.650849+0000","last_unstale":"2024-09-12T18:38:07.367762+0000","last_undegraded":"2024-09-12T18:38:07.367762+0000","last_fullsized":"2024-09-12T18:38:07.367762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:18.555827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368934+0000","last_change":"2024-09-12T18:35:24.656119+0000","last_active":"2024-09-12T18:38:07.368934+0000","last_peered":"2024-09-12T18:38:07.368934+0000","last_clean":"2024-09-12T18:38:07.368934+0000","last_became_active":"2024-09-12T18:35:24.653175+0000","last_became_peered":"2024-09-12T18:35:24.653175+0000","last_unstale":"2024-09-12T18:38:07.368934+0000","last_undegraded":"2024-09-12T18:38:07.368934+0000","last_fullsized":"2024-09-12T18:38:07.368934+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:00.551165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369501+0000","last_change":"2024-09-12T18:38:03.356363+0000","last_active":"2024-09-12T18:38:07.369501+0000","last_peered":"2024-09-12T18:38:07.369501+0000","last_clean":"2024-09-12T18:38:07.369501+0000","last_became_active":"2024-09-12T18:38:03.354299+0000","last_became_peered":"2024-09-12T18:38:03.354299+0000","last_unstale":"2024-09-12T18:38:07.369501+0000","last_undegraded":"2024-09-12T18:38:07.369501+0000","last_fullsized":"2024-09-12T18:38:07.369501+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:40.267630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366478+0000","last_change":"2024-09-12T18:35:24.640096+0000","last_active":"2024-09-12T18:38:07.366478+0000","last_peered":"2024-09-12T18:38:07.366478+0000","last_clean":"2024-09-12T18:38:07.366478+0000","last_became_active":"2024-09-12T18:35:24.638230+0000","last_became_peered":"2024-09-12T18:35:24.638230+0000","last_unstale":"2024-09-12T18:38:07.366478+0000","last_undegraded":"2024-09-12T18:38:07.366478+0000","last_fullsized":"2024-09-12T18:38:07.366478+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:38.435296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369661+0000","last_change":"2024-09-12T18:38:03.354155+0000","last_active":"2024-09-12T18:38:07.369661+0000","last_peered":"2024-09-12T18:38:07.369661+0000","last_clean":"2024-09-12T18:38:07.369661+0000","last_became_active":"2024-09-12T18:38:03.352848+0000","last_became_peered":"2024-09-12T18:38:03.352848+0000","last_unstale":"2024-09-12T18:38:07.369661+0000","last_undegraded":"2024-09-12T18:38:07.369661+0000","last_fullsized":"2024-09-12T18:38:07.369661+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:36.825717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":166,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.357827+0000","last_change":"2024-09-12T18:35:24.653610+0000","last_active":"2024-09-12T18:38:06.357827+0000","last_peered":"2024-09-12T18:38:06.357827+0000","last_clean":"2024-09-12T18:38:06.357827+0000","last_became_active":"2024-09-12T18:35:24.652880+0000","last_became_peered":"2024-09-12T18:35:24.652880+0000","last_unstale":"2024-09-12T18:38:06.357827+0000","last_undegraded":"2024-09-12T18:38:06.357827+0000","last_fullsized":"2024-09-12T18:38:06.357827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:57.636251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":159,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359825+0000","last_change":"2024-09-12T18:35:24.653465+0000","last_active":"2024-09-12T18:38:06.359825+0000","last_peered":"2024-09-12T18:38:06.359825+0000","last_clean":"2024-09-12T18:38:06.359825+0000","last_became_active":"2024-09-12T18:35:24.652792+0000","last_became_peered":"2024-09-12T18:35:24.652792+0000","last_unstale":"2024-09-12T18:38:06.359825+0000","last_undegraded":"2024-09-12T18:38:06.359825+0000","last_fullsized":"2024-09-12T18:38:06.359825+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:14.588993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366949+0000","last_change":"2024-09-12T18:35:25.655426+0000","last_active":"2024-09-12T18:38:07.366949+0000","last_peered":"2024-09-12T18:38:07.366949+0000","last_clean":"2024-09-12T18:38:07.366949+0000","last_became_active":"2024-09-12T18:35:25.648186+0000","last_became_peered":"2024-09-12T18:35:25.648186+0000","last_unstale":"2024-09-12T18:38:07.366949+0000","last_undegraded":"2024-09-12T18:38:07.366949+0000","last_fullsized":"2024-09-12T18:38:07.366949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:48.802815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367913+0000","last_change":"2024-09-12T18:35:24.648439+0000","last_active":"2024-09-12T18:38:07.367913+0000","last_peered":"2024-09-12T18:38:07.367913+0000","last_clean":"2024-09-12T18:38:07.367913+0000","last_became_active":"2024-09-12T18:35:24.647629+0000","last_became_peered":"2024-09-12T18:35:24.647629+0000","last_unstale":"2024-09-12T18:38:07.367913+0000","last_undegraded":"2024-09-12T18:38:07.367913+0000","last_fullsized":"2024-09-12T18:38:07.367913+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:45.428223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366148+0000","last_change":"2024-09-12T18:35:25.652496+0000","last_active":"2024-09-12T18:38:07.366148+0000","last_peered":"2024-09-12T18:38:07.366148+0000","last_clean":"2024-09-12T18:38:07.366148+0000","last_became_active":"2024-09-12T18:35:25.651628+0000","last_became_peered":"2024-09-12T18:35:25.651628+0000","last_unstale":"2024-09-12T18:38:07.366148+0000","last_undegraded":"2024-09-12T18:38:07.366148+0000","last_fullsized":"2024-09-12T18:38:07.366148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:44.920448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":159,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358446+0000","last_change":"2024-09-12T18:35:24.654976+0000","last_active":"2024-09-12T18:38:06.358446+0000","last_peered":"2024-09-12T18:38:06.358446+0000","last_clean":"2024-09-12T18:38:06.358446+0000","last_became_active":"2024-09-12T18:35:24.654264+0000","last_became_peered":"2024-09-12T18:35:24.654264+0000","last_unstale":"2024-09-12T18:38:06.358446+0000","last_undegraded":"2024-09-12T18:38:06.358446+0000","last_fullsized":"2024-09-12T18:38:06.358446+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:00.115408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358046+0000","last_change":"2024-09-12T18:38:03.365901+0000","last_active":"2024-09-12T18:38:06.358046+0000","last_peered":"2024-09-12T18:38:06.358046+0000","last_clean":"2024-09-12T18:38:06.358046+0000","last_became_active":"2024-09-12T18:38:03.364754+0000","last_became_peered":"2024-09-12T18:38:03.364754+0000","last_unstale":"2024-09-12T18:38:06.358046+0000","last_undegraded":"2024-09-12T18:38:06.358046+0000","last_fullsized":"2024-09-12T18:38:06.358046+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:43.078837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":158,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359087+0000","last_change":"2024-09-12T18:35:24.657665+0000","last_active":"2024-09-12T18:38:06.359087+0000","last_peered":"2024-09-12T18:38:06.359087+0000","last_clean":"2024-09-12T18:38:06.359087+0000","last_became_active":"2024-09-12T18:35:24.657015+0000","last_became_peered":"2024-09-12T18:35:24.657015+0000","last_unstale":"2024-09-12T18:38:06.359087+0000","last_undegraded":"2024-09-12T18:38:06.359087+0000","last_fullsized":"2024-09-12T18:38:06.359087+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:03.171326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368567+0000","last_change":"2024-09-12T18:35:25.665275+0000","last_active":"2024-09-12T18:38:07.368567+0000","last_peered":"2024-09-12T18:38:07.368567+0000","last_clean":"2024-09-12T18:38:07.368567+0000","last_became_active":"2024-09-12T18:35:25.659511+0000","last_became_peered":"2024-09-12T18:35:25.659511+0000","last_unstale":"2024-09-12T18:38:07.368567+0000","last_undegraded":"2024-09-12T18:38:07.368567+0000","last_fullsized":"2024-09-12T18:38:07.368567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368912+0000","last_change":"2024-09-12T18:38:03.384365+0000","last_active":"2024-09-12T18:38:07.368912+0000","last_peered":"2024-09-12T18:38:07.368912+0000","last_clean":"2024-09-12T18:38:07.368912+0000","last_became_active":"2024-09-12T18:38:03.364147+0000","last_became_peered":"2024-09-12T18:38:03.364147+0000","last_unstale":"2024-09-12T18:38:07.368912+0000","last_undegraded":"2024-09-12T18:38:07.368912+0000","last_fullsized":"2024-09-12T18:38:07.368912+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:05.965891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358810+0000","last_change":"2024-09-12T18:38:03.356255+0000","last_active":"2024-09-12T18:38:06.358810+0000","last_peered":"2024-09-12T18:38:06.358810+0000","last_clean":"2024-09-12T18:38:06.358810+0000","last_became_active":"2024-09-12T18:38:03.355310+0000","last_became_peered":"2024-09-12T18:38:03.355310+0000","last_unstale":"2024-09-12T18:38:06.358810+0000","last_undegraded":"2024-09-12T18:38:06.358810+0000","last_fullsized":"2024-09-12T18:38:06.358810+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:21.097039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":158,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358549+0000","last_change":"2024-09-12T18:35:24.659019+0000","last_active":"2024-09-12T18:38:06.358549+0000","last_peered":"2024-09-12T18:38:06.358549+0000","last_clean":"2024-09-12T18:38:06.358549+0000","last_became_active":"2024-09-12T18:35:24.658423+0000","last_became_peered":"2024-09-12T18:35:24.658423+0000","last_unstale":"2024-09-12T18:38:06.358549+0000","last_undegraded":"2024-09-12T18:38:06.358549+0000","last_fullsized":"2024-09-12T18:38:06.358549+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:37.668417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359018+0000","last_change":"2024-09-12T18:35:25.662287+0000","last_active":"2024-09-12T18:38:06.359018+0000","last_peered":"2024-09-12T18:38:06.359018+0000","last_clean":"2024-09-12T18:38:06.359018+0000","last_became_active":"2024-09-12T18:35:25.660372+0000","last_became_peered":"2024-09-12T18:35:25.660372+0000","last_unstale":"2024-09-12T18:38:06.359018+0000","last_undegraded":"2024-09-12T18:38:06.359018+0000","last_fullsized":"2024-09-12T18:38:06.359018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:08.729541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366544+0000","last_change":"2024-09-12T18:35:24.648330+0000","last_active":"2024-09-12T18:38:07.366544+0000","last_peered":"2024-09-12T18:38:07.366544+0000","last_clean":"2024-09-12T18:38:07.366544+0000","last_became_active":"2024-09-12T18:35:24.647520+0000","last_became_peered":"2024-09-12T18:35:24.647520+0000","last_unstale":"2024-09-12T18:38:07.366544+0000","last_undegraded":"2024-09-12T18:38:07.366544+0000","last_fullsized":"2024-09-12T18:38:07.366544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:25.552055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359547+0000","last_change":"2024-09-12T18:35:25.658674+0000","last_active":"2024-09-12T18:38:06.359547+0000","last_peered":"2024-09-12T18:38:06.359547+0000","last_clean":"2024-09-12T18:38:06.359547+0000","last_became_active":"2024-09-12T18:35:25.657386+0000","last_became_peered":"2024-09-12T18:35:25.657386+0000","last_unstale":"2024-09-12T18:38:06.359547+0000","last_undegraded":"2024-09-12T18:38:06.359547+0000","last_fullsized":"2024-09-12T18:38:06.359547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:48.037086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366112+0000","last_change":"2024-09-12T18:35:24.646810+0000","last_active":"2024-09-12T18:38:07.366112+0000","last_peered":"2024-09-12T18:38:07.366112+0000","last_clean":"2024-09-12T18:38:07.366112+0000","last_became_active":"2024-09-12T18:35:24.646008+0000","last_became_peered":"2024-09-12T18:35:24.646008+0000","last_unstale":"2024-09-12T18:38:07.366112+0000","last_undegraded":"2024-09-12T18:38:07.366112+0000","last_fullsized":"2024-09-12T18:38:07.366112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:43.888776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369934+0000","last_change":"2024-09-12T18:35:25.667710+0000","last_active":"2024-09-12T18:38:07.369934+0000","last_peered":"2024-09-12T18:38:07.369934+0000","last_clean":"2024-09-12T18:38:07.369934+0000","last_became_active":"2024-09-12T18:35:25.666940+0000","last_became_peered":"2024-09-12T18:35:25.666940+0000","last_unstale":"2024-09-12T18:38:07.369934+0000","last_undegraded":"2024-09-12T18:38:07.369934+0000","last_fullsized":"2024-09-12T18:38:07.369934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:09.823085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":308,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358400+0000","last_change":"2024-09-12T18:35:13.489018+0000","last_active":"2024-09-12T18:38:06.358400+0000","last_peered":"2024-09-12T18:38:06.358400+0000","last_clean":"2024-09-12T18:38:06.358400+0000","last_became_active":"2024-09-12T18:35:13.488346+0000","last_became_peered":"2024-09-12T18:35:13.488346+0000","last_unstale":"2024-09-12T18:38:06.358400+0000","last_undegraded":"2024-09-12T18:38:06.358400+0000","last_fullsized":"2024-09-12T18:38:06.358400+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_clean_scrub_stamp":"2024-09-12T18:35:12.464628+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:54.864640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":172,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359336+0000","last_change":"2024-09-12T18:35:22.459694+0000","last_active":"2024-09-12T18:38:06.359336+0000","last_peered":"2024-09-12T18:38:06.359336+0000","last_clean":"2024-09-12T18:38:06.359336+0000","last_became_active":"2024-09-12T18:35:20.446796+0000","last_became_peered":"2024-09-12T18:35:20.446796+0000","last_unstale":"2024-09-12T18:38:06.359336+0000","last_undegraded":"2024-09-12T18:38:06.359336+0000","last_fullsized":"2024-09-12T18:38:06.359336+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:21.506024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016291610000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368143+0000","last_change":"2024-09-12T18:38:03.354554+0000","last_active":"2024-09-12T18:38:07.368143+0000","last_peered":"2024-09-12T18:38:07.368143+0000","last_clean":"2024-09-12T18:38:07.368143+0000","last_became_active":"2024-09-12T18:38:03.353661+0000","last_became_peered":"2024-09-12T18:38:03.353661+0000","last_unstale":"2024-09-12T18:38:07.368143+0000","last_undegraded":"2024-09-12T18:38:07.368143+0000","last_fullsized":"2024-09-12T18:38:07.368143+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:27.835210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359041+0000","last_change":"2024-09-12T18:35:25.662424+0000","last_active":"2024-09-12T18:38:06.359041+0000","last_peered":"2024-09-12T18:38:06.359041+0000","last_clean":"2024-09-12T18:38:06.359041+0000","last_became_active":"2024-09-12T18:35:25.661043+0000","last_became_peered":"2024-09-12T18:35:25.661043+0000","last_unstale":"2024-09-12T18:38:06.359041+0000","last_undegraded":"2024-09-12T18:38:06.359041+0000","last_fullsized":"2024-09-12T18:38:06.359041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:52.551802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":171,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358322+0000","last_change":"2024-09-12T18:35:22.459090+0000","last_active":"2024-09-12T18:38:06.358322+0000","last_peered":"2024-09-12T18:38:06.358322+0000","last_clean":"2024-09-12T18:38:06.358322+0000","last_became_active":"2024-09-12T18:35:20.448553+0000","last_became_peered":"2024-09-12T18:35:20.448553+0000","last_unstale":"2024-09-12T18:38:06.358322+0000","last_undegraded":"2024-09-12T18:38:06.358322+0000","last_fullsized":"2024-09-12T18:38:06.358322+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:56.834808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001030836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368423+0000","last_change":"2024-09-12T18:35:24.651597+0000","last_active":"2024-09-12T18:38:07.368423+0000","last_peered":"2024-09-12T18:38:07.368423+0000","last_clean":"2024-09-12T18:38:07.368423+0000","last_became_active":"2024-09-12T18:35:24.649940+0000","last_became_peered":"2024-09-12T18:35:24.649940+0000","last_unstale":"2024-09-12T18:38:07.368423+0000","last_undegraded":"2024-09-12T18:38:07.368423+0000","last_fullsized":"2024-09-12T18:38:07.368423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:36.822432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367752+0000","last_change":"2024-09-12T18:38:03.358588+0000","last_active":"2024-09-12T18:38:07.367752+0000","last_peered":"2024-09-12T18:38:07.367752+0000","last_clean":"2024-09-12T18:38:07.367752+0000","last_became_active":"2024-09-12T18:38:03.357664+0000","last_became_peered":"2024-09-12T18:38:03.357664+0000","last_unstale":"2024-09-12T18:38:07.367752+0000","last_undegraded":"2024-09-12T18:38:07.367752+0000","last_fullsized":"2024-09-12T18:38:07.367752+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:02.273189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368624+0000","last_change":"2024-09-12T18:35:22.464179+0000","last_active":"2024-09-12T18:38:07.368624+0000","last_peered":"2024-09-12T18:38:07.368624+0000","last_clean":"2024-09-12T18:38:07.368624+0000","last_became_active":"2024-09-12T18:35:20.442613+0000","last_became_peered":"2024-09-12T18:35:20.442613+0000","last_unstale":"2024-09-12T18:38:07.368624+0000","last_undegraded":"2024-09-12T18:38:07.368624+0000","last_fullsized":"2024-09-12T18:38:07.368624+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:17.636537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014134620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366112+0000","last_change":"2024-09-12T18:35:24.641297+0000","last_active":"2024-09-12T18:38:07.366112+0000","last_peered":"2024-09-12T18:38:07.366112+0000","last_clean":"2024-09-12T18:38:07.366112+0000","last_became_active":"2024-09-12T18:35:24.637334+0000","last_became_peered":"2024-09-12T18:35:24.637334+0000","last_unstale":"2024-09-12T18:38:07.366112+0000","last_undegraded":"2024-09-12T18:38:07.366112+0000","last_fullsized":"2024-09-12T18:38:07.366112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:50.772074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369805+0000","last_change":"2024-09-12T18:38:03.360352+0000","last_active":"2024-09-12T18:38:07.369805+0000","last_peered":"2024-09-12T18:38:07.369805+0000","last_clean":"2024-09-12T18:38:07.369805+0000","last_became_active":"2024-09-12T18:38:03.359452+0000","last_became_peered":"2024-09-12T18:38:03.359452+0000","last_unstale":"2024-09-12T18:38:07.369805+0000","last_undegraded":"2024-09-12T18:38:07.369805+0000","last_fullsized":"2024-09-12T18:38:07.369805+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:48.036394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":173,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358697+0000","last_change":"2024-09-12T18:35:22.459049+0000","last_active":"2024-09-12T18:38:06.358697+0000","last_peered":"2024-09-12T18:38:06.358697+0000","last_clean":"2024-09-12T18:38:06.358697+0000","last_became_active":"2024-09-12T18:35:20.446814+0000","last_became_peered":"2024-09-12T18:35:20.446814+0000","last_unstale":"2024-09-12T18:38:06.358697+0000","last_undegraded":"2024-09-12T18:38:06.358697+0000","last_fullsized":"2024-09-12T18:38:06.358697+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:18.033595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010716149999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":158,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359121+0000","last_change":"2024-09-12T18:35:24.658273+0000","last_active":"2024-09-12T18:38:06.359121+0000","last_peered":"2024-09-12T18:38:06.359121+0000","last_clean":"2024-09-12T18:38:06.359121+0000","last_became_active":"2024-09-12T18:35:24.657433+0000","last_became_peered":"2024-09-12T18:35:24.657433+0000","last_unstale":"2024-09-12T18:38:06.359121+0000","last_undegraded":"2024-09-12T18:38:06.359121+0000","last_fullsized":"2024-09-12T18:38:06.359121+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:48.497218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369135+0000","last_change":"2024-09-12T18:38:03.358304+0000","last_active":"2024-09-12T18:38:07.369135+0000","last_peered":"2024-09-12T18:38:07.369135+0000","last_clean":"2024-09-12T18:38:07.369135+0000","last_became_active":"2024-09-12T18:38:03.357592+0000","last_became_peered":"2024-09-12T18:38:03.357592+0000","last_unstale":"2024-09-12T18:38:07.369135+0000","last_undegraded":"2024-09-12T18:38:07.369135+0000","last_fullsized":"2024-09-12T18:38:07.369135+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:45.610260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":158,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358064+0000","last_change":"2024-09-12T18:35:24.657618+0000","last_active":"2024-09-12T18:38:06.358064+0000","last_peered":"2024-09-12T18:38:06.358064+0000","last_clean":"2024-09-12T18:38:06.358064+0000","last_became_active":"2024-09-12T18:35:24.656741+0000","last_became_peered":"2024-09-12T18:35:24.656741+0000","last_unstale":"2024-09-12T18:38:06.358064+0000","last_undegraded":"2024-09-12T18:38:06.358064+0000","last_fullsized":"2024-09-12T18:38:06.358064+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:43.113104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369480+0000","last_change":"2024-09-12T18:35:22.464180+0000","last_active":"2024-09-12T18:38:07.369480+0000","last_peered":"2024-09-12T18:38:07.369480+0000","last_clean":"2024-09-12T18:38:07.369480+0000","last_became_active":"2024-09-12T18:35:20.442566+0000","last_became_peered":"2024-09-12T18:35:20.442566+0000","last_unstale":"2024-09-12T18:38:07.369480+0000","last_undegraded":"2024-09-12T18:38:07.369480+0000","last_fullsized":"2024-09-12T18:38:07.369480+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:29.021710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001325786,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366700+0000","last_change":"2024-09-12T18:35:25.650458+0000","last_active":"2024-09-12T18:38:07.366700+0000","last_peered":"2024-09-12T18:38:07.366700+0000","last_clean":"2024-09-12T18:38:07.366700+0000","last_became_active":"2024-09-12T18:35:25.648761+0000","last_became_peered":"2024-09-12T18:35:25.648761+0000","last_unstale":"2024-09-12T18:38:07.366700+0000","last_undegraded":"2024-09-12T18:38:07.366700+0000","last_fullsized":"2024-09-12T18:38:07.366700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:53.026950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369129+0000","last_change":"2024-09-12T18:38:03.357887+0000","last_active":"2024-09-12T18:38:07.369129+0000","last_peered":"2024-09-12T18:38:07.369129+0000","last_clean":"2024-09-12T18:38:07.369129+0000","last_became_active":"2024-09-12T18:38:03.356816+0000","last_became_peered":"2024-09-12T18:38:03.356816+0000","last_unstale":"2024-09-12T18:38:07.369129+0000","last_undegraded":"2024-09-12T18:38:07.369129+0000","last_fullsized":"2024-09-12T18:38:07.369129+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:09.458196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":185,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366644+0000","last_change":"2024-09-12T18:38:03.351352+0000","last_active":"2024-09-12T18:38:07.366644+0000","last_peered":"2024-09-12T18:38:07.366644+0000","last_clean":"2024-09-12T18:38:07.366644+0000","last_became_active":"2024-09-12T18:38:03.350774+0000","last_became_peered":"2024-09-12T18:38:03.350774+0000","last_unstale":"2024-09-12T18:38:07.366644+0000","last_undegraded":"2024-09-12T18:38:07.366644+0000","last_fullsized":"2024-09-12T18:38:07.366644+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:30.555373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080163599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366902+0000","last_change":"2024-09-12T18:35:25.650717+0000","last_active":"2024-09-12T18:38:07.366902+0000","last_peered":"2024-09-12T18:38:07.366902+0000","last_clean":"2024-09-12T18:38:07.366902+0000","last_became_active":"2024-09-12T18:35:25.649147+0000","last_became_peered":"2024-09-12T18:35:25.649147+0000","last_unstale":"2024-09-12T18:38:07.366902+0000","last_undegraded":"2024-09-12T18:38:07.366902+0000","last_fullsized":"2024-09-12T18:38:07.366902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:07.365888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.370288+0000","last_change":"2024-09-12T18:35:24.657234+0000","last_active":"2024-09-12T18:38:07.370288+0000","last_peered":"2024-09-12T18:38:07.370288+0000","last_clean":"2024-09-12T18:38:07.370288+0000","last_became_active":"2024-09-12T18:35:24.655950+0000","last_became_peered":"2024-09-12T18:35:24.655950+0000","last_unstale":"2024-09-12T18:38:07.370288+0000","last_undegraded":"2024-09-12T18:38:07.370288+0000","last_fullsized":"2024-09-12T18:38:07.370288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:17.466623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359037+0000","last_change":"2024-09-12T18:37:34.258443+0000","last_active":"2024-09-12T18:38:06.359037+0000","last_peered":"2024-09-12T18:38:06.359037+0000","last_clean":"2024-09-12T18:38:06.359037+0000","last_became_active":"2024-09-12T18:37:34.254999+0000","last_became_peered":"2024-09-12T18:37:34.254999+0000","last_unstale":"2024-09-12T18:38:06.359037+0000","last_undegraded":"2024-09-12T18:38:06.359037+0000","last_fullsized":"2024-09-12T18:38:06.359037+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:23.164676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367719+0000","last_change":"2024-09-12T18:38:03.358177+0000","last_active":"2024-09-12T18:38:07.367719+0000","last_peered":"2024-09-12T18:38:07.367719+0000","last_clean":"2024-09-12T18:38:07.367719+0000","last_became_active":"2024-09-12T18:38:03.354895+0000","last_became_peered":"2024-09-12T18:38:03.354895+0000","last_unstale":"2024-09-12T18:38:07.367719+0000","last_undegraded":"2024-09-12T18:38:07.367719+0000","last_fullsized":"2024-09-12T18:38:07.367719+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:16.208815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369642+0000","last_change":"2024-09-12T18:38:03.370898+0000","last_active":"2024-09-12T18:38:07.369642+0000","last_peered":"2024-09-12T18:38:07.369642+0000","last_clean":"2024-09-12T18:38:07.369642+0000","last_became_active":"2024-09-12T18:38:03.354684+0000","last_became_peered":"2024-09-12T18:38:03.354684+0000","last_unstale":"2024-09-12T18:38:07.369642+0000","last_undegraded":"2024-09-12T18:38:07.369642+0000","last_fullsized":"2024-09-12T18:38:07.369642+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:27.684565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":171,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359956+0000","last_change":"2024-09-12T18:35:22.459767+0000","last_active":"2024-09-12T18:38:06.359956+0000","last_peered":"2024-09-12T18:38:06.359956+0000","last_clean":"2024-09-12T18:38:06.359956+0000","last_became_active":"2024-09-12T18:35:20.448521+0000","last_became_peered":"2024-09-12T18:35:20.448521+0000","last_unstale":"2024-09-12T18:38:06.359956+0000","last_undegraded":"2024-09-12T18:38:06.359956+0000","last_fullsized":"2024-09-12T18:38:06.359956+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:33.463792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017009670000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366127+0000","last_change":"2024-09-12T18:35:25.648150+0000","last_active":"2024-09-12T18:38:07.366127+0000","last_peered":"2024-09-12T18:38:07.366127+0000","last_clean":"2024-09-12T18:38:07.366127+0000","last_became_active":"2024-09-12T18:35:25.647347+0000","last_became_peered":"2024-09-12T18:35:25.647347+0000","last_unstale":"2024-09-12T18:38:07.366127+0000","last_undegraded":"2024-09-12T18:38:07.366127+0000","last_fullsized":"2024-09-12T18:38:07.366127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:48.968336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358735+0000","last_change":"2024-09-12T18:35:25.660696+0000","last_active":"2024-09-12T18:38:06.358735+0000","last_peered":"2024-09-12T18:38:06.358735+0000","last_clean":"2024-09-12T18:38:06.358735+0000","last_became_active":"2024-09-12T18:35:25.659827+0000","last_became_peered":"2024-09-12T18:35:25.659827+0000","last_unstale":"2024-09-12T18:38:06.358735+0000","last_undegraded":"2024-09-12T18:38:06.358735+0000","last_fullsized":"2024-09-12T18:38:06.358735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:15.678289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":164,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359083+0000","last_change":"2024-09-12T18:35:24.655051+0000","last_active":"2024-09-12T18:38:06.359083+0000","last_peered":"2024-09-12T18:38:06.359083+0000","last_clean":"2024-09-12T18:38:06.359083+0000","last_became_active":"2024-09-12T18:35:24.654282+0000","last_became_peered":"2024-09-12T18:35:24.654282+0000","last_unstale":"2024-09-12T18:38:06.359083+0000","last_undegraded":"2024-09-12T18:38:06.359083+0000","last_fullsized":"2024-09-12T18:38:06.359083+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:08.159799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368447+0000","last_change":"2024-09-12T18:38:03.355018+0000","last_active":"2024-09-12T18:38:07.368447+0000","last_peered":"2024-09-12T18:38:07.368447+0000","last_clean":"2024-09-12T18:38:07.368447+0000","last_became_active":"2024-09-12T18:38:03.354064+0000","last_became_peered":"2024-09-12T18:38:03.354064+0000","last_unstale":"2024-09-12T18:38:07.368447+0000","last_undegraded":"2024-09-12T18:38:07.368447+0000","last_fullsized":"2024-09-12T18:38:07.368447+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:18.297083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":163,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367123+0000","last_change":"2024-09-12T18:35:24.648658+0000","last_active":"2024-09-12T18:38:07.367123+0000","last_peered":"2024-09-12T18:38:07.367123+0000","last_clean":"2024-09-12T18:38:07.367123+0000","last_became_active":"2024-09-12T18:35:24.647826+0000","last_became_peered":"2024-09-12T18:35:24.647826+0000","last_unstale":"2024-09-12T18:38:07.367123+0000","last_undegraded":"2024-09-12T18:38:07.367123+0000","last_fullsized":"2024-09-12T18:38:07.367123+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:24.167549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359951+0000","last_change":"2024-09-12T18:38:03.366378+0000","last_active":"2024-09-12T18:38:06.359951+0000","last_peered":"2024-09-12T18:38:06.359951+0000","last_clean":"2024-09-12T18:38:06.359951+0000","last_became_active":"2024-09-12T18:38:03.364887+0000","last_became_peered":"2024-09-12T18:38:03.364887+0000","last_unstale":"2024-09-12T18:38:06.359951+0000","last_undegraded":"2024-09-12T18:38:06.359951+0000","last_fullsized":"2024-09-12T18:38:06.359951+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:54.490659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368005+0000","last_change":"2024-09-12T18:35:25.661801+0000","last_active":"2024-09-12T18:38:07.368005+0000","last_peered":"2024-09-12T18:38:07.368005+0000","last_clean":"2024-09-12T18:38:07.368005+0000","last_became_active":"2024-09-12T18:35:25.658476+0000","last_became_peered":"2024-09-12T18:35:25.658476+0000","last_unstale":"2024-09-12T18:38:07.368005+0000","last_undegraded":"2024-09-12T18:38:07.368005+0000","last_fullsized":"2024-09-12T18:38:07.368005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:58.246449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.370140+0000","last_change":"2024-09-12T18:35:24.652399+0000","last_active":"2024-09-12T18:38:07.370140+0000","last_peered":"2024-09-12T18:38:07.370140+0000","last_clean":"2024-09-12T18:38:07.370140+0000","last_became_active":"2024-09-12T18:35:24.651416+0000","last_became_peered":"2024-09-12T18:35:24.651416+0000","last_unstale":"2024-09-12T18:38:07.370140+0000","last_undegraded":"2024-09-12T18:38:07.370140+0000","last_fullsized":"2024-09-12T18:38:07.370140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:32.594978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367773+0000","last_change":"2024-09-12T18:38:03.359924+0000","last_active":"2024-09-12T18:38:07.367773+0000","last_peered":"2024-09-12T18:38:07.367773+0000","last_clean":"2024-09-12T18:38:07.367773+0000","last_became_active":"2024-09-12T18:38:03.357598+0000","last_became_peered":"2024-09-12T18:38:03.357598+0000","last_unstale":"2024-09-12T18:38:07.367773+0000","last_undegraded":"2024-09-12T18:38:07.367773+0000","last_fullsized":"2024-09-12T18:38:07.367773+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:59.501652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368603+0000","last_change":"2024-09-12T18:35:25.651217+0000","last_active":"2024-09-12T18:38:07.368603+0000","last_peered":"2024-09-12T18:38:07.368603+0000","last_clean":"2024-09-12T18:38:07.368603+0000","last_became_active":"2024-09-12T18:35:25.649544+0000","last_became_peered":"2024-09-12T18:35:25.649544+0000","last_unstale":"2024-09-12T18:38:07.368603+0000","last_undegraded":"2024-09-12T18:38:07.368603+0000","last_fullsized":"2024-09-12T18:38:07.368603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:41.601376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367616+0000","last_change":"2024-09-12T18:38:03.349281+0000","last_active":"2024-09-12T18:38:07.367616+0000","last_peered":"2024-09-12T18:38:07.367616+0000","last_clean":"2024-09-12T18:38:07.367616+0000","last_became_active":"2024-09-12T18:38:03.347483+0000","last_became_peered":"2024-09-12T18:38:03.347483+0000","last_unstale":"2024-09-12T18:38:07.367616+0000","last_undegraded":"2024-09-12T18:38:07.367616+0000","last_fullsized":"2024-09-12T18:38:07.367616+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:02.283482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369856+0000","last_change":"2024-09-12T18:35:25.661544+0000","last_active":"2024-09-12T18:38:07.369856+0000","last_peered":"2024-09-12T18:38:07.369856+0000","last_clean":"2024-09-12T18:38:07.369856+0000","last_became_active":"2024-09-12T18:35:25.656985+0000","last_became_peered":"2024-09-12T18:35:25.656985+0000","last_unstale":"2024-09-12T18:38:07.369856+0000","last_undegraded":"2024-09-12T18:38:07.369856+0000","last_fullsized":"2024-09-12T18:38:07.369856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368189+0000","last_change":"2024-09-12T18:38:03.352648+0000","last_active":"2024-09-12T18:38:07.368189+0000","last_peered":"2024-09-12T18:38:07.368189+0000","last_clean":"2024-09-12T18:38:07.368189+0000","last_became_active":"2024-09-12T18:38:03.351740+0000","last_became_peered":"2024-09-12T18:38:03.351740+0000","last_unstale":"2024-09-12T18:38:07.368189+0000","last_undegraded":"2024-09-12T18:38:07.368189+0000","last_fullsized":"2024-09-12T18:38:07.368189+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:13.765236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368265+0000","last_change":"2024-09-12T18:35:25.656712+0000","last_active":"2024-09-12T18:38:07.368265+0000","last_peered":"2024-09-12T18:38:07.368265+0000","last_clean":"2024-09-12T18:38:07.368265+0000","last_became_active":"2024-09-12T18:35:25.654473+0000","last_became_peered":"2024-09-12T18:35:25.654473+0000","last_unstale":"2024-09-12T18:38:07.368265+0000","last_undegraded":"2024-09-12T18:38:07.368265+0000","last_fullsized":"2024-09-12T18:38:07.368265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:01.464680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":161,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367676+0000","last_change":"2024-09-12T18:35:24.659935+0000","last_active":"2024-09-12T18:38:07.367676+0000","last_peered":"2024-09-12T18:38:07.367676+0000","last_clean":"2024-09-12T18:38:07.367676+0000","last_became_active":"2024-09-12T18:35:24.659111+0000","last_became_peered":"2024-09-12T18:35:24.659111+0000","last_unstale":"2024-09-12T18:38:07.367676+0000","last_undegraded":"2024-09-12T18:38:07.367676+0000","last_fullsized":"2024-09-12T18:38:07.367676+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:11.480154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367022+0000","last_change":"2024-09-12T18:38:03.351609+0000","last_active":"2024-09-12T18:38:07.367022+0000","last_peered":"2024-09-12T18:38:07.367022+0000","last_clean":"2024-09-12T18:38:07.367022+0000","last_became_active":"2024-09-12T18:38:03.350972+0000","last_became_peered":"2024-09-12T18:38:03.350972+0000","last_unstale":"2024-09-12T18:38:07.367022+0000","last_undegraded":"2024-09-12T18:38:07.367022+0000","last_fullsized":"2024-09-12T18:38:07.367022+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:15.351880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":161,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367876+0000","last_change":"2024-09-12T18:35:24.638538+0000","last_active":"2024-09-12T18:38:07.367876+0000","last_peered":"2024-09-12T18:38:07.367876+0000","last_clean":"2024-09-12T18:38:07.367876+0000","last_became_active":"2024-09-12T18:35:24.637242+0000","last_became_peered":"2024-09-12T18:35:24.637242+0000","last_unstale":"2024-09-12T18:38:07.367876+0000","last_undegraded":"2024-09-12T18:38:07.367876+0000","last_fullsized":"2024-09-12T18:38:07.367876+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:26.877441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358498+0000","last_change":"2024-09-12T18:35:25.662537+0000","last_active":"2024-09-12T18:38:06.358498+0000","last_peered":"2024-09-12T18:38:06.358498+0000","last_clean":"2024-09-12T18:38:06.358498+0000","last_became_active":"2024-09-12T18:35:25.661441+0000","last_became_peered":"2024-09-12T18:35:25.661441+0000","last_unstale":"2024-09-12T18:38:06.358498+0000","last_undegraded":"2024-09-12T18:38:06.358498+0000","last_fullsized":"2024-09-12T18:38:06.358498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:14.397867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":180,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358818+0000","last_change":"2024-09-12T18:38:03.369857+0000","last_active":"2024-09-12T18:38:06.358818+0000","last_peered":"2024-09-12T18:38:06.358818+0000","last_clean":"2024-09-12T18:38:06.358818+0000","last_became_active":"2024-09-12T18:38:03.355520+0000","last_became_peered":"2024-09-12T18:38:03.355520+0000","last_unstale":"2024-09-12T18:38:06.358818+0000","last_undegraded":"2024-09-12T18:38:06.358818+0000","last_fullsized":"2024-09-12T18:38:06.358818+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:28.637798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358482+0000","last_change":"2024-09-12T18:35:25.651406+0000","last_active":"2024-09-12T18:38:06.358482+0000","last_peered":"2024-09-12T18:38:06.358482+0000","last_clean":"2024-09-12T18:38:06.358482+0000","last_became_active":"2024-09-12T18:35:25.649728+0000","last_became_peered":"2024-09-12T18:35:25.649728+0000","last_unstale":"2024-09-12T18:38:06.358482+0000","last_undegraded":"2024-09-12T18:38:06.358482+0000","last_fullsized":"2024-09-12T18:38:06.358482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:41.773283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368047+0000","last_change":"2024-09-12T18:35:24.649153+0000","last_active":"2024-09-12T18:38:07.368047+0000","last_peered":"2024-09-12T18:38:07.368047+0000","last_clean":"2024-09-12T18:38:07.368047+0000","last_became_active":"2024-09-12T18:35:24.648512+0000","last_became_peered":"2024-09-12T18:35:24.648512+0000","last_unstale":"2024-09-12T18:38:07.368047+0000","last_undegraded":"2024-09-12T18:38:07.368047+0000","last_fullsized":"2024-09-12T18:38:07.368047+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:07.810456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366854+0000","last_change":"2024-09-12T18:35:25.656799+0000","last_active":"2024-09-12T18:38:07.366854+0000","last_peered":"2024-09-12T18:38:07.366854+0000","last_clean":"2024-09-12T18:38:07.366854+0000","last_became_active":"2024-09-12T18:35:25.654980+0000","last_became_peered":"2024-09-12T18:35:25.654980+0000","last_unstale":"2024-09-12T18:38:07.366854+0000","last_undegraded":"2024-09-12T18:38:07.366854+0000","last_fullsized":"2024-09-12T18:38:07.366854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:10.735439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":161,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.370189+0000","last_change":"2024-09-12T18:35:24.656268+0000","last_active":"2024-09-12T18:38:07.370189+0000","last_peered":"2024-09-12T18:38:07.370189+0000","last_clean":"2024-09-12T18:38:07.370189+0000","last_became_active":"2024-09-12T18:35:24.655420+0000","last_became_peered":"2024-09-12T18:35:24.655420+0000","last_unstale":"2024-09-12T18:38:07.370189+0000","last_undegraded":"2024-09-12T18:38:07.370189+0000","last_fullsized":"2024-09-12T18:38:07.370189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:04.654666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358119+0000","last_change":"2024-09-12T18:38:03.357094+0000","last_active":"2024-09-12T18:38:06.358119+0000","last_peered":"2024-09-12T18:38:06.358119+0000","last_clean":"2024-09-12T18:38:06.358119+0000","last_became_active":"2024-09-12T18:38:03.355072+0000","last_became_peered":"2024-09-12T18:38:03.355072+0000","last_unstale":"2024-09-12T18:38:06.358119+0000","last_undegraded":"2024-09-12T18:38:06.358119+0000","last_fullsized":"2024-09-12T18:38:06.358119+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:46.451497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369635+0000","last_change":"2024-09-12T18:38:03.379032+0000","last_active":"2024-09-12T18:38:07.369635+0000","last_peered":"2024-09-12T18:38:07.369635+0000","last_clean":"2024-09-12T18:38:07.369635+0000","last_became_active":"2024-09-12T18:38:03.353780+0000","last_became_peered":"2024-09-12T18:38:03.353780+0000","last_unstale":"2024-09-12T18:38:07.369635+0000","last_undegraded":"2024-09-12T18:38:07.369635+0000","last_fullsized":"2024-09-12T18:38:07.369635+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:26.800343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705702,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297412,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":296318,"kb_avail":94074428,"statfs":{"total":96636764160,"available":96332214272,"internally_reserved":0,"allocated":1097728,"data_stored":982590,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":303430086},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738407,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280776,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94091064,"statfs":{"total":96636764160,"available":96349249536,"internally_reserved":0,"allocated":1101824,"data_stored":978964,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":286390725},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738407,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302908,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":301886,"kb_avail":94068932,"statfs":{"total":96636764160,"available":96326586368,"internally_reserved":0,"allocated":1019904,"data_stored":391063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":309131718},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:38:10.218 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:38:10.557 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:38:10.560 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T18:38:10.576 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2024-09-12T18:38:10.425555+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":192,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":881096,"kb_used_data":3144,"kb_used_omap":4,"kb_used_meta":877883,"kb_avail":282234424,"statfs":{"total":289910292480,"available":289008050176,"internally_reserved":0,"allocated":3219456,"data_stored":2352617,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4783,"internal_metadata":898952529},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001362"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368487+0000","last_change":"2024-09-12T18:38:03.358323+0000","last_active":"2024-09-12T18:38:07.368487+0000","last_peered":"2024-09-12T18:38:07.368487+0000","last_clean":"2024-09-12T18:38:07.368487+0000","last_became_active":"2024-09-12T18:38:03.357317+0000","last_became_peered":"2024-09-12T18:38:03.357317+0000","last_unstale":"2024-09-12T18:38:07.368487+0000","last_undegraded":"2024-09-12T18:38:07.368487+0000","last_fullsized":"2024-09-12T18:38:07.368487+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:55.315464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367135+0000","last_change":"2024-09-12T18:35:25.659760+0000","last_active":"2024-09-12T18:38:07.367135+0000","last_peered":"2024-09-12T18:38:07.367135+0000","last_clean":"2024-09-12T18:38:07.367135+0000","last_became_active":"2024-09-12T18:35:25.654920+0000","last_became_peered":"2024-09-12T18:35:25.654920+0000","last_unstale":"2024-09-12T18:38:07.367135+0000","last_undegraded":"2024-09-12T18:38:07.367135+0000","last_fullsized":"2024-09-12T18:38:07.367135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:21.519881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359587+0000","last_change":"2024-09-12T18:35:25.659460+0000","last_active":"2024-09-12T18:38:06.359587+0000","last_peered":"2024-09-12T18:38:06.359587+0000","last_clean":"2024-09-12T18:38:06.359587+0000","last_became_active":"2024-09-12T18:35:25.657782+0000","last_became_peered":"2024-09-12T18:35:25.657782+0000","last_unstale":"2024-09-12T18:38:06.359587+0000","last_undegraded":"2024-09-12T18:38:06.359587+0000","last_fullsized":"2024-09-12T18:38:06.359587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:38.544284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358249+0000","last_change":"2024-09-12T18:35:25.663617+0000","last_active":"2024-09-12T18:38:06.358249+0000","last_peered":"2024-09-12T18:38:06.358249+0000","last_clean":"2024-09-12T18:38:06.358249+0000","last_became_active":"2024-09-12T18:35:25.661977+0000","last_became_peered":"2024-09-12T18:35:25.661977+0000","last_unstale":"2024-09-12T18:38:06.358249+0000","last_undegraded":"2024-09-12T18:38:06.358249+0000","last_fullsized":"2024-09-12T18:38:06.358249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:14.748234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367138+0000","last_change":"2024-09-12T18:35:25.656566+0000","last_active":"2024-09-12T18:38:07.367138+0000","last_peered":"2024-09-12T18:38:07.367138+0000","last_clean":"2024-09-12T18:38:07.367138+0000","last_became_active":"2024-09-12T18:35:25.654898+0000","last_became_peered":"2024-09-12T18:35:25.654898+0000","last_unstale":"2024-09-12T18:38:07.367138+0000","last_undegraded":"2024-09-12T18:38:07.367138+0000","last_fullsized":"2024-09-12T18:38:07.367138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:36.113250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.357732+0000","last_change":"2024-09-12T18:38:03.366489+0000","last_active":"2024-09-12T18:38:06.357732+0000","last_peered":"2024-09-12T18:38:06.357732+0000","last_clean":"2024-09-12T18:38:06.357732+0000","last_became_active":"2024-09-12T18:38:03.364745+0000","last_became_peered":"2024-09-12T18:38:03.364745+0000","last_unstale":"2024-09-12T18:38:06.357732+0000","last_undegraded":"2024-09-12T18:38:06.357732+0000","last_fullsized":"2024-09-12T18:38:06.357732+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:42.397517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.357624+0000","last_change":"2024-09-12T18:35:25.659811+0000","last_active":"2024-09-12T18:38:06.357624+0000","last_peered":"2024-09-12T18:38:06.357624+0000","last_clean":"2024-09-12T18:38:06.357624+0000","last_became_active":"2024-09-12T18:35:25.658998+0000","last_became_peered":"2024-09-12T18:35:25.658998+0000","last_unstale":"2024-09-12T18:38:06.357624+0000","last_undegraded":"2024-09-12T18:38:06.357624+0000","last_fullsized":"2024-09-12T18:38:06.357624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.357347+0000","last_change":"2024-09-12T18:38:03.365773+0000","last_active":"2024-09-12T18:38:06.357347+0000","last_peered":"2024-09-12T18:38:06.357347+0000","last_clean":"2024-09-12T18:38:06.357347+0000","last_became_active":"2024-09-12T18:38:03.364845+0000","last_became_peered":"2024-09-12T18:38:03.364845+0000","last_unstale":"2024-09-12T18:38:06.357347+0000","last_undegraded":"2024-09-12T18:38:06.357347+0000","last_fullsized":"2024-09-12T18:38:06.357347+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:19.384528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369867+0000","last_change":"2024-09-12T18:35:25.668339+0000","last_active":"2024-09-12T18:38:07.369867+0000","last_peered":"2024-09-12T18:38:07.369867+0000","last_clean":"2024-09-12T18:38:07.369867+0000","last_became_active":"2024-09-12T18:35:25.667608+0000","last_became_peered":"2024-09-12T18:35:25.667608+0000","last_unstale":"2024-09-12T18:38:07.369867+0000","last_undegraded":"2024-09-12T18:38:07.369867+0000","last_fullsized":"2024-09-12T18:38:07.369867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:15.699745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367232+0000","last_change":"2024-09-12T18:38:03.358177+0000","last_active":"2024-09-12T18:38:07.367232+0000","last_peered":"2024-09-12T18:38:07.367232+0000","last_clean":"2024-09-12T18:38:07.367232+0000","last_became_active":"2024-09-12T18:38:03.357446+0000","last_became_peered":"2024-09-12T18:38:03.357446+0000","last_unstale":"2024-09-12T18:38:07.367232+0000","last_undegraded":"2024-09-12T18:38:07.367232+0000","last_fullsized":"2024-09-12T18:38:07.367232+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:13.110496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359515+0000","last_change":"2024-09-12T18:38:03.356440+0000","last_active":"2024-09-12T18:38:06.359515+0000","last_peered":"2024-09-12T18:38:06.359515+0000","last_clean":"2024-09-12T18:38:06.359515+0000","last_became_active":"2024-09-12T18:38:03.355561+0000","last_became_peered":"2024-09-12T18:38:03.355561+0000","last_unstale":"2024-09-12T18:38:06.359515+0000","last_undegraded":"2024-09-12T18:38:06.359515+0000","last_fullsized":"2024-09-12T18:38:06.359515+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:43.438258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366852+0000","last_change":"2024-09-12T18:35:25.649885+0000","last_active":"2024-09-12T18:38:07.366852+0000","last_peered":"2024-09-12T18:38:07.366852+0000","last_clean":"2024-09-12T18:38:07.366852+0000","last_became_active":"2024-09-12T18:35:25.649111+0000","last_became_peered":"2024-09-12T18:35:25.649111+0000","last_unstale":"2024-09-12T18:38:07.366852+0000","last_undegraded":"2024-09-12T18:38:07.366852+0000","last_fullsized":"2024-09-12T18:38:07.366852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:17.162410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366640+0000","last_change":"2024-09-12T18:38:03.349917+0000","last_active":"2024-09-12T18:38:07.366640+0000","last_peered":"2024-09-12T18:38:07.366640+0000","last_clean":"2024-09-12T18:38:07.366640+0000","last_became_active":"2024-09-12T18:38:03.349130+0000","last_became_peered":"2024-09-12T18:38:03.349130+0000","last_unstale":"2024-09-12T18:38:07.366640+0000","last_undegraded":"2024-09-12T18:38:07.366640+0000","last_fullsized":"2024-09-12T18:38:07.366640+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:45.548888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.357883+0000","last_change":"2024-09-12T18:35:25.657913+0000","last_active":"2024-09-12T18:38:06.357883+0000","last_peered":"2024-09-12T18:38:06.357883+0000","last_clean":"2024-09-12T18:38:06.357883+0000","last_became_active":"2024-09-12T18:35:25.657082+0000","last_became_peered":"2024-09-12T18:35:25.657082+0000","last_unstale":"2024-09-12T18:38:06.357883+0000","last_undegraded":"2024-09-12T18:38:06.357883+0000","last_fullsized":"2024-09-12T18:38:06.357883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:21.538633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.357675+0000","last_change":"2024-09-12T18:35:25.658763+0000","last_active":"2024-09-12T18:38:06.357675+0000","last_peered":"2024-09-12T18:38:06.357675+0000","last_clean":"2024-09-12T18:38:06.357675+0000","last_became_active":"2024-09-12T18:35:25.657508+0000","last_became_peered":"2024-09-12T18:35:25.657508+0000","last_unstale":"2024-09-12T18:38:06.357675+0000","last_undegraded":"2024-09-12T18:38:06.357675+0000","last_fullsized":"2024-09-12T18:38:06.357675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:13.170519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.357358+0000","last_change":"2024-09-12T18:35:25.653730+0000","last_active":"2024-09-12T18:38:06.357358+0000","last_peered":"2024-09-12T18:38:06.357358+0000","last_clean":"2024-09-12T18:38:06.357358+0000","last_became_active":"2024-09-12T18:35:25.651535+0000","last_became_peered":"2024-09-12T18:35:25.651535+0000","last_unstale":"2024-09-12T18:38:06.357358+0000","last_undegraded":"2024-09-12T18:38:06.357358+0000","last_fullsized":"2024-09-12T18:38:06.357358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.370149+0000","last_change":"2024-09-12T18:35:25.656513+0000","last_active":"2024-09-12T18:38:07.370149+0000","last_peered":"2024-09-12T18:38:07.370149+0000","last_clean":"2024-09-12T18:38:07.370149+0000","last_became_active":"2024-09-12T18:35:25.653440+0000","last_became_peered":"2024-09-12T18:35:25.653440+0000","last_unstale":"2024-09-12T18:38:07.370149+0000","last_undegraded":"2024-09-12T18:38:07.370149+0000","last_fullsized":"2024-09-12T18:38:07.370149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:18.693161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367487+0000","last_change":"2024-09-12T18:35:25.657991+0000","last_active":"2024-09-12T18:38:07.367487+0000","last_peered":"2024-09-12T18:38:07.367487+0000","last_clean":"2024-09-12T18:38:07.367487+0000","last_became_active":"2024-09-12T18:35:25.653934+0000","last_became_peered":"2024-09-12T18:35:25.653934+0000","last_unstale":"2024-09-12T18:38:07.367487+0000","last_undegraded":"2024-09-12T18:38:07.367487+0000","last_fullsized":"2024-09-12T18:38:07.367487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:05.418901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368965+0000","last_change":"2024-09-12T18:38:03.358270+0000","last_active":"2024-09-12T18:38:07.368965+0000","last_peered":"2024-09-12T18:38:07.368965+0000","last_clean":"2024-09-12T18:38:07.368965+0000","last_became_active":"2024-09-12T18:38:03.357363+0000","last_became_peered":"2024-09-12T18:38:03.357363+0000","last_unstale":"2024-09-12T18:38:07.368965+0000","last_undegraded":"2024-09-12T18:38:07.368965+0000","last_fullsized":"2024-09-12T18:38:07.368965+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:56.658700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358511+0000","last_change":"2024-09-12T18:35:25.661176+0000","last_active":"2024-09-12T18:38:06.358511+0000","last_peered":"2024-09-12T18:38:06.358511+0000","last_clean":"2024-09-12T18:38:06.358511+0000","last_became_active":"2024-09-12T18:35:25.659534+0000","last_became_peered":"2024-09-12T18:35:25.659534+0000","last_unstale":"2024-09-12T18:38:06.358511+0000","last_undegraded":"2024-09-12T18:38:06.358511+0000","last_fullsized":"2024-09-12T18:38:06.358511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:40.145442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358406+0000","last_change":"2024-09-12T18:35:25.650632+0000","last_active":"2024-09-12T18:38:06.358406+0000","last_peered":"2024-09-12T18:38:06.358406+0000","last_clean":"2024-09-12T18:38:06.358406+0000","last_became_active":"2024-09-12T18:35:25.649333+0000","last_became_peered":"2024-09-12T18:35:25.649333+0000","last_unstale":"2024-09-12T18:38:06.358406+0000","last_undegraded":"2024-09-12T18:38:06.358406+0000","last_fullsized":"2024-09-12T18:38:06.358406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:30.537572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366475+0000","last_change":"2024-09-12T18:35:25.648245+0000","last_active":"2024-09-12T18:38:07.366475+0000","last_peered":"2024-09-12T18:38:07.366475+0000","last_clean":"2024-09-12T18:38:07.366475+0000","last_became_active":"2024-09-12T18:35:25.646357+0000","last_became_peered":"2024-09-12T18:35:25.646357+0000","last_unstale":"2024-09-12T18:38:07.366475+0000","last_undegraded":"2024-09-12T18:38:07.366475+0000","last_fullsized":"2024-09-12T18:38:07.366475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:05.662140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367728+0000","last_change":"2024-09-12T18:35:25.661613+0000","last_active":"2024-09-12T18:38:07.367728+0000","last_peered":"2024-09-12T18:38:07.367728+0000","last_clean":"2024-09-12T18:38:07.367728+0000","last_became_active":"2024-09-12T18:35:25.658833+0000","last_became_peered":"2024-09-12T18:35:25.658833+0000","last_unstale":"2024-09-12T18:38:07.367728+0000","last_undegraded":"2024-09-12T18:38:07.367728+0000","last_fullsized":"2024-09-12T18:38:07.367728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:51.064080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366639+0000","last_change":"2024-09-12T18:35:25.657782+0000","last_active":"2024-09-12T18:38:07.366639+0000","last_peered":"2024-09-12T18:38:07.366639+0000","last_clean":"2024-09-12T18:38:07.366639+0000","last_became_active":"2024-09-12T18:35:25.655295+0000","last_became_peered":"2024-09-12T18:35:25.655295+0000","last_unstale":"2024-09-12T18:38:07.366639+0000","last_undegraded":"2024-09-12T18:38:07.366639+0000","last_fullsized":"2024-09-12T18:38:07.366639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:37.744175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368546+0000","last_change":"2024-09-12T18:35:25.654863+0000","last_active":"2024-09-12T18:38:07.368546+0000","last_peered":"2024-09-12T18:38:07.368546+0000","last_clean":"2024-09-12T18:38:07.368546+0000","last_became_active":"2024-09-12T18:35:25.650407+0000","last_became_peered":"2024-09-12T18:35:25.650407+0000","last_unstale":"2024-09-12T18:38:07.368546+0000","last_undegraded":"2024-09-12T18:38:07.368546+0000","last_fullsized":"2024-09-12T18:38:07.368546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:38.395666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369981+0000","last_change":"2024-09-12T18:35:25.662414+0000","last_active":"2024-09-12T18:38:07.369981+0000","last_peered":"2024-09-12T18:38:07.369981+0000","last_clean":"2024-09-12T18:38:07.369981+0000","last_became_active":"2024-09-12T18:35:25.660126+0000","last_became_peered":"2024-09-12T18:35:25.660126+0000","last_unstale":"2024-09-12T18:38:07.369981+0000","last_undegraded":"2024-09-12T18:38:07.369981+0000","last_fullsized":"2024-09-12T18:38:07.369981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:48.437139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359333+0000","last_change":"2024-09-12T18:35:25.661523+0000","last_active":"2024-09-12T18:38:06.359333+0000","last_peered":"2024-09-12T18:38:06.359333+0000","last_clean":"2024-09-12T18:38:06.359333+0000","last_became_active":"2024-09-12T18:35:25.659338+0000","last_became_peered":"2024-09-12T18:35:25.659338+0000","last_unstale":"2024-09-12T18:38:06.359333+0000","last_undegraded":"2024-09-12T18:38:06.359333+0000","last_fullsized":"2024-09-12T18:38:06.359333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:37.083820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367372+0000","last_change":"2024-09-12T18:35:25.662445+0000","last_active":"2024-09-12T18:38:07.367372+0000","last_peered":"2024-09-12T18:38:07.367372+0000","last_clean":"2024-09-12T18:38:07.367372+0000","last_became_active":"2024-09-12T18:35:25.659496+0000","last_became_peered":"2024-09-12T18:35:25.659496+0000","last_unstale":"2024-09-12T18:38:07.367372+0000","last_undegraded":"2024-09-12T18:38:07.367372+0000","last_fullsized":"2024-09-12T18:38:07.367372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:03.270420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368653+0000","last_change":"2024-09-12T18:38:03.357219+0000","last_active":"2024-09-12T18:38:07.368653+0000","last_peered":"2024-09-12T18:38:07.368653+0000","last_clean":"2024-09-12T18:38:07.368653+0000","last_became_active":"2024-09-12T18:38:03.356412+0000","last_became_peered":"2024-09-12T18:38:03.356412+0000","last_unstale":"2024-09-12T18:38:07.368653+0000","last_undegraded":"2024-09-12T18:38:07.368653+0000","last_fullsized":"2024-09-12T18:38:07.368653+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:53.007632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367404+0000","last_change":"2024-09-12T18:35:25.650507+0000","last_active":"2024-09-12T18:38:07.367404+0000","last_peered":"2024-09-12T18:38:07.367404+0000","last_clean":"2024-09-12T18:38:07.367404+0000","last_became_active":"2024-09-12T18:35:25.649415+0000","last_became_peered":"2024-09-12T18:35:25.649415+0000","last_unstale":"2024-09-12T18:38:07.367404+0000","last_undegraded":"2024-09-12T18:38:07.367404+0000","last_fullsized":"2024-09-12T18:38:07.367404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:23.081416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367879+0000","last_change":"2024-09-12T18:35:25.653949+0000","last_active":"2024-09-12T18:38:07.367879+0000","last_peered":"2024-09-12T18:38:07.367879+0000","last_clean":"2024-09-12T18:38:07.367879+0000","last_became_active":"2024-09-12T18:35:25.652992+0000","last_became_peered":"2024-09-12T18:35:25.652992+0000","last_unstale":"2024-09-12T18:38:07.367879+0000","last_undegraded":"2024-09-12T18:38:07.367879+0000","last_fullsized":"2024-09-12T18:38:07.367879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:47.687372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.357652+0000","last_change":"2024-09-12T18:38:03.356306+0000","last_active":"2024-09-12T18:38:06.357652+0000","last_peered":"2024-09-12T18:38:06.357652+0000","last_clean":"2024-09-12T18:38:06.357652+0000","last_became_active":"2024-09-12T18:38:03.355052+0000","last_became_peered":"2024-09-12T18:38:03.355052+0000","last_unstale":"2024-09-12T18:38:06.357652+0000","last_undegraded":"2024-09-12T18:38:06.357652+0000","last_fullsized":"2024-09-12T18:38:06.357652+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:54.986299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367305+0000","last_change":"2024-09-12T18:38:03.351904+0000","last_active":"2024-09-12T18:38:07.367305+0000","last_peered":"2024-09-12T18:38:07.367305+0000","last_clean":"2024-09-12T18:38:07.367305+0000","last_became_active":"2024-09-12T18:38:03.351112+0000","last_became_peered":"2024-09-12T18:38:03.351112+0000","last_unstale":"2024-09-12T18:38:07.367305+0000","last_undegraded":"2024-09-12T18:38:07.367305+0000","last_fullsized":"2024-09-12T18:38:07.367305+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:52.881469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":160,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359058+0000","last_change":"2024-09-12T18:35:24.657739+0000","last_active":"2024-09-12T18:38:06.359058+0000","last_peered":"2024-09-12T18:38:06.359058+0000","last_clean":"2024-09-12T18:38:06.359058+0000","last_became_active":"2024-09-12T18:35:24.656208+0000","last_became_peered":"2024-09-12T18:35:24.656208+0000","last_unstale":"2024-09-12T18:38:06.359058+0000","last_undegraded":"2024-09-12T18:38:06.359058+0000","last_fullsized":"2024-09-12T18:38:06.359058+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:50.073716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367762+0000","last_change":"2024-09-12T18:35:25.651651+0000","last_active":"2024-09-12T18:38:07.367762+0000","last_peered":"2024-09-12T18:38:07.367762+0000","last_clean":"2024-09-12T18:38:07.367762+0000","last_became_active":"2024-09-12T18:35:25.650849+0000","last_became_peered":"2024-09-12T18:35:25.650849+0000","last_unstale":"2024-09-12T18:38:07.367762+0000","last_undegraded":"2024-09-12T18:38:07.367762+0000","last_fullsized":"2024-09-12T18:38:07.367762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:18.555827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368934+0000","last_change":"2024-09-12T18:35:24.656119+0000","last_active":"2024-09-12T18:38:07.368934+0000","last_peered":"2024-09-12T18:38:07.368934+0000","last_clean":"2024-09-12T18:38:07.368934+0000","last_became_active":"2024-09-12T18:35:24.653175+0000","last_became_peered":"2024-09-12T18:35:24.653175+0000","last_unstale":"2024-09-12T18:38:07.368934+0000","last_undegraded":"2024-09-12T18:38:07.368934+0000","last_fullsized":"2024-09-12T18:38:07.368934+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:00.551165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369501+0000","last_change":"2024-09-12T18:38:03.356363+0000","last_active":"2024-09-12T18:38:07.369501+0000","last_peered":"2024-09-12T18:38:07.369501+0000","last_clean":"2024-09-12T18:38:07.369501+0000","last_became_active":"2024-09-12T18:38:03.354299+0000","last_became_peered":"2024-09-12T18:38:03.354299+0000","last_unstale":"2024-09-12T18:38:07.369501+0000","last_undegraded":"2024-09-12T18:38:07.369501+0000","last_fullsized":"2024-09-12T18:38:07.369501+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:40.267630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366478+0000","last_change":"2024-09-12T18:35:24.640096+0000","last_active":"2024-09-12T18:38:07.366478+0000","last_peered":"2024-09-12T18:38:07.366478+0000","last_clean":"2024-09-12T18:38:07.366478+0000","last_became_active":"2024-09-12T18:35:24.638230+0000","last_became_peered":"2024-09-12T18:35:24.638230+0000","last_unstale":"2024-09-12T18:38:07.366478+0000","last_undegraded":"2024-09-12T18:38:07.366478+0000","last_fullsized":"2024-09-12T18:38:07.366478+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:38.435296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369661+0000","last_change":"2024-09-12T18:38:03.354155+0000","last_active":"2024-09-12T18:38:07.369661+0000","last_peered":"2024-09-12T18:38:07.369661+0000","last_clean":"2024-09-12T18:38:07.369661+0000","last_became_active":"2024-09-12T18:38:03.352848+0000","last_became_peered":"2024-09-12T18:38:03.352848+0000","last_unstale":"2024-09-12T18:38:07.369661+0000","last_undegraded":"2024-09-12T18:38:07.369661+0000","last_fullsized":"2024-09-12T18:38:07.369661+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:36.825717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":166,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.357827+0000","last_change":"2024-09-12T18:35:24.653610+0000","last_active":"2024-09-12T18:38:06.357827+0000","last_peered":"2024-09-12T18:38:06.357827+0000","last_clean":"2024-09-12T18:38:06.357827+0000","last_became_active":"2024-09-12T18:35:24.652880+0000","last_became_peered":"2024-09-12T18:35:24.652880+0000","last_unstale":"2024-09-12T18:38:06.357827+0000","last_undegraded":"2024-09-12T18:38:06.357827+0000","last_fullsized":"2024-09-12T18:38:06.357827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:57.636251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":159,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359825+0000","last_change":"2024-09-12T18:35:24.653465+0000","last_active":"2024-09-12T18:38:06.359825+0000","last_peered":"2024-09-12T18:38:06.359825+0000","last_clean":"2024-09-12T18:38:06.359825+0000","last_became_active":"2024-09-12T18:35:24.652792+0000","last_became_peered":"2024-09-12T18:35:24.652792+0000","last_unstale":"2024-09-12T18:38:06.359825+0000","last_undegraded":"2024-09-12T18:38:06.359825+0000","last_fullsized":"2024-09-12T18:38:06.359825+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:14.588993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366949+0000","last_change":"2024-09-12T18:35:25.655426+0000","last_active":"2024-09-12T18:38:07.366949+0000","last_peered":"2024-09-12T18:38:07.366949+0000","last_clean":"2024-09-12T18:38:07.366949+0000","last_became_active":"2024-09-12T18:35:25.648186+0000","last_became_peered":"2024-09-12T18:35:25.648186+0000","last_unstale":"2024-09-12T18:38:07.366949+0000","last_undegraded":"2024-09-12T18:38:07.366949+0000","last_fullsized":"2024-09-12T18:38:07.366949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:48.802815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367913+0000","last_change":"2024-09-12T18:35:24.648439+0000","last_active":"2024-09-12T18:38:07.367913+0000","last_peered":"2024-09-12T18:38:07.367913+0000","last_clean":"2024-09-12T18:38:07.367913+0000","last_became_active":"2024-09-12T18:35:24.647629+0000","last_became_peered":"2024-09-12T18:35:24.647629+0000","last_unstale":"2024-09-12T18:38:07.367913+0000","last_undegraded":"2024-09-12T18:38:07.367913+0000","last_fullsized":"2024-09-12T18:38:07.367913+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:45.428223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366148+0000","last_change":"2024-09-12T18:35:25.652496+0000","last_active":"2024-09-12T18:38:07.366148+0000","last_peered":"2024-09-12T18:38:07.366148+0000","last_clean":"2024-09-12T18:38:07.366148+0000","last_became_active":"2024-09-12T18:35:25.651628+0000","last_became_peered":"2024-09-12T18:35:25.651628+0000","last_unstale":"2024-09-12T18:38:07.366148+0000","last_undegraded":"2024-09-12T18:38:07.366148+0000","last_fullsized":"2024-09-12T18:38:07.366148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:44.920448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":159,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358446+0000","last_change":"2024-09-12T18:35:24.654976+0000","last_active":"2024-09-12T18:38:06.358446+0000","last_peered":"2024-09-12T18:38:06.358446+0000","last_clean":"2024-09-12T18:38:06.358446+0000","last_became_active":"2024-09-12T18:35:24.654264+0000","last_became_peered":"2024-09-12T18:35:24.654264+0000","last_unstale":"2024-09-12T18:38:06.358446+0000","last_undegraded":"2024-09-12T18:38:06.358446+0000","last_fullsized":"2024-09-12T18:38:06.358446+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:00.115408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358046+0000","last_change":"2024-09-12T18:38:03.365901+0000","last_active":"2024-09-12T18:38:06.358046+0000","last_peered":"2024-09-12T18:38:06.358046+0000","last_clean":"2024-09-12T18:38:06.358046+0000","last_became_active":"2024-09-12T18:38:03.364754+0000","last_became_peered":"2024-09-12T18:38:03.364754+0000","last_unstale":"2024-09-12T18:38:06.358046+0000","last_undegraded":"2024-09-12T18:38:06.358046+0000","last_fullsized":"2024-09-12T18:38:06.358046+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:43.078837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":158,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359087+0000","last_change":"2024-09-12T18:35:24.657665+0000","last_active":"2024-09-12T18:38:06.359087+0000","last_peered":"2024-09-12T18:38:06.359087+0000","last_clean":"2024-09-12T18:38:06.359087+0000","last_became_active":"2024-09-12T18:35:24.657015+0000","last_became_peered":"2024-09-12T18:35:24.657015+0000","last_unstale":"2024-09-12T18:38:06.359087+0000","last_undegraded":"2024-09-12T18:38:06.359087+0000","last_fullsized":"2024-09-12T18:38:06.359087+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:03.171326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368567+0000","last_change":"2024-09-12T18:35:25.665275+0000","last_active":"2024-09-12T18:38:07.368567+0000","last_peered":"2024-09-12T18:38:07.368567+0000","last_clean":"2024-09-12T18:38:07.368567+0000","last_became_active":"2024-09-12T18:35:25.659511+0000","last_became_peered":"2024-09-12T18:35:25.659511+0000","last_unstale":"2024-09-12T18:38:07.368567+0000","last_undegraded":"2024-09-12T18:38:07.368567+0000","last_fullsized":"2024-09-12T18:38:07.368567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368912+0000","last_change":"2024-09-12T18:38:03.384365+0000","last_active":"2024-09-12T18:38:07.368912+0000","last_peered":"2024-09-12T18:38:07.368912+0000","last_clean":"2024-09-12T18:38:07.368912+0000","last_became_active":"2024-09-12T18:38:03.364147+0000","last_became_peered":"2024-09-12T18:38:03.364147+0000","last_unstale":"2024-09-12T18:38:07.368912+0000","last_undegraded":"2024-09-12T18:38:07.368912+0000","last_fullsized":"2024-09-12T18:38:07.368912+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:05.965891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358810+0000","last_change":"2024-09-12T18:38:03.356255+0000","last_active":"2024-09-12T18:38:06.358810+0000","last_peered":"2024-09-12T18:38:06.358810+0000","last_clean":"2024-09-12T18:38:06.358810+0000","last_became_active":"2024-09-12T18:38:03.355310+0000","last_became_peered":"2024-09-12T18:38:03.355310+0000","last_unstale":"2024-09-12T18:38:06.358810+0000","last_undegraded":"2024-09-12T18:38:06.358810+0000","last_fullsized":"2024-09-12T18:38:06.358810+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:21.097039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":158,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358549+0000","last_change":"2024-09-12T18:35:24.659019+0000","last_active":"2024-09-12T18:38:06.358549+0000","last_peered":"2024-09-12T18:38:06.358549+0000","last_clean":"2024-09-12T18:38:06.358549+0000","last_became_active":"2024-09-12T18:35:24.658423+0000","last_became_peered":"2024-09-12T18:35:24.658423+0000","last_unstale":"2024-09-12T18:38:06.358549+0000","last_undegraded":"2024-09-12T18:38:06.358549+0000","last_fullsized":"2024-09-12T18:38:06.358549+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:37.668417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359018+0000","last_change":"2024-09-12T18:35:25.662287+0000","last_active":"2024-09-12T18:38:06.359018+0000","last_peered":"2024-09-12T18:38:06.359018+0000","last_clean":"2024-09-12T18:38:06.359018+0000","last_became_active":"2024-09-12T18:35:25.660372+0000","last_became_peered":"2024-09-12T18:35:25.660372+0000","last_unstale":"2024-09-12T18:38:06.359018+0000","last_undegraded":"2024-09-12T18:38:06.359018+0000","last_fullsized":"2024-09-12T18:38:06.359018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:08.729541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366544+0000","last_change":"2024-09-12T18:35:24.648330+0000","last_active":"2024-09-12T18:38:07.366544+0000","last_peered":"2024-09-12T18:38:07.366544+0000","last_clean":"2024-09-12T18:38:07.366544+0000","last_became_active":"2024-09-12T18:35:24.647520+0000","last_became_peered":"2024-09-12T18:35:24.647520+0000","last_unstale":"2024-09-12T18:38:07.366544+0000","last_undegraded":"2024-09-12T18:38:07.366544+0000","last_fullsized":"2024-09-12T18:38:07.366544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:25.552055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359547+0000","last_change":"2024-09-12T18:35:25.658674+0000","last_active":"2024-09-12T18:38:06.359547+0000","last_peered":"2024-09-12T18:38:06.359547+0000","last_clean":"2024-09-12T18:38:06.359547+0000","last_became_active":"2024-09-12T18:35:25.657386+0000","last_became_peered":"2024-09-12T18:35:25.657386+0000","last_unstale":"2024-09-12T18:38:06.359547+0000","last_undegraded":"2024-09-12T18:38:06.359547+0000","last_fullsized":"2024-09-12T18:38:06.359547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:48.037086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366112+0000","last_change":"2024-09-12T18:35:24.646810+0000","last_active":"2024-09-12T18:38:07.366112+0000","last_peered":"2024-09-12T18:38:07.366112+0000","last_clean":"2024-09-12T18:38:07.366112+0000","last_became_active":"2024-09-12T18:35:24.646008+0000","last_became_peered":"2024-09-12T18:35:24.646008+0000","last_unstale":"2024-09-12T18:38:07.366112+0000","last_undegraded":"2024-09-12T18:38:07.366112+0000","last_fullsized":"2024-09-12T18:38:07.366112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:43.888776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369934+0000","last_change":"2024-09-12T18:35:25.667710+0000","last_active":"2024-09-12T18:38:07.369934+0000","last_peered":"2024-09-12T18:38:07.369934+0000","last_clean":"2024-09-12T18:38:07.369934+0000","last_became_active":"2024-09-12T18:35:25.666940+0000","last_became_peered":"2024-09-12T18:35:25.666940+0000","last_unstale":"2024-09-12T18:38:07.369934+0000","last_undegraded":"2024-09-12T18:38:07.369934+0000","last_fullsized":"2024-09-12T18:38:07.369934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:09.823085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":308,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358400+0000","last_change":"2024-09-12T18:35:13.489018+0000","last_active":"2024-09-12T18:38:06.358400+0000","last_peered":"2024-09-12T18:38:06.358400+0000","last_clean":"2024-09-12T18:38:06.358400+0000","last_became_active":"2024-09-12T18:35:13.488346+0000","last_became_peered":"2024-09-12T18:35:13.488346+0000","last_unstale":"2024-09-12T18:38:06.358400+0000","last_undegraded":"2024-09-12T18:38:06.358400+0000","last_fullsized":"2024-09-12T18:38:06.358400+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_clean_scrub_stamp":"2024-09-12T18:35:12.464628+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:54.864640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":172,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359336+0000","last_change":"2024-09-12T18:35:22.459694+0000","last_active":"2024-09-12T18:38:06.359336+0000","last_peered":"2024-09-12T18:38:06.359336+0000","last_clean":"2024-09-12T18:38:06.359336+0000","last_became_active":"2024-09-12T18:35:20.446796+0000","last_became_peered":"2024-09-12T18:35:20.446796+0000","last_unstale":"2024-09-12T18:38:06.359336+0000","last_undegraded":"2024-09-12T18:38:06.359336+0000","last_fullsized":"2024-09-12T18:38:06.359336+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:21.506024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016291610000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368143+0000","last_change":"2024-09-12T18:38:03.354554+0000","last_active":"2024-09-12T18:38:07.368143+0000","last_peered":"2024-09-12T18:38:07.368143+0000","last_clean":"2024-09-12T18:38:07.368143+0000","last_became_active":"2024-09-12T18:38:03.353661+0000","last_became_peered":"2024-09-12T18:38:03.353661+0000","last_unstale":"2024-09-12T18:38:07.368143+0000","last_undegraded":"2024-09-12T18:38:07.368143+0000","last_fullsized":"2024-09-12T18:38:07.368143+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:27.835210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359041+0000","last_change":"2024-09-12T18:35:25.662424+0000","last_active":"2024-09-12T18:38:06.359041+0000","last_peered":"2024-09-12T18:38:06.359041+0000","last_clean":"2024-09-12T18:38:06.359041+0000","last_became_active":"2024-09-12T18:35:25.661043+0000","last_became_peered":"2024-09-12T18:35:25.661043+0000","last_unstale":"2024-09-12T18:38:06.359041+0000","last_undegraded":"2024-09-12T18:38:06.359041+0000","last_fullsized":"2024-09-12T18:38:06.359041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:52.551802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":171,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358322+0000","last_change":"2024-09-12T18:35:22.459090+0000","last_active":"2024-09-12T18:38:06.358322+0000","last_peered":"2024-09-12T18:38:06.358322+0000","last_clean":"2024-09-12T18:38:06.358322+0000","last_became_active":"2024-09-12T18:35:20.448553+0000","last_became_peered":"2024-09-12T18:35:20.448553+0000","last_unstale":"2024-09-12T18:38:06.358322+0000","last_undegraded":"2024-09-12T18:38:06.358322+0000","last_fullsized":"2024-09-12T18:38:06.358322+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:56.834808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001030836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368423+0000","last_change":"2024-09-12T18:35:24.651597+0000","last_active":"2024-09-12T18:38:07.368423+0000","last_peered":"2024-09-12T18:38:07.368423+0000","last_clean":"2024-09-12T18:38:07.368423+0000","last_became_active":"2024-09-12T18:35:24.649940+0000","last_became_peered":"2024-09-12T18:35:24.649940+0000","last_unstale":"2024-09-12T18:38:07.368423+0000","last_undegraded":"2024-09-12T18:38:07.368423+0000","last_fullsized":"2024-09-12T18:38:07.368423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:36.822432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367752+0000","last_change":"2024-09-12T18:38:03.358588+0000","last_active":"2024-09-12T18:38:07.367752+0000","last_peered":"2024-09-12T18:38:07.367752+0000","last_clean":"2024-09-12T18:38:07.367752+0000","last_became_active":"2024-09-12T18:38:03.357664+0000","last_became_peered":"2024-09-12T18:38:03.357664+0000","last_unstale":"2024-09-12T18:38:07.367752+0000","last_undegraded":"2024-09-12T18:38:07.367752+0000","last_fullsized":"2024-09-12T18:38:07.367752+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:02.273189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368624+0000","last_change":"2024-09-12T18:35:22.464179+0000","last_active":"2024-09-12T18:38:07.368624+0000","last_peered":"2024-09-12T18:38:07.368624+0000","last_clean":"2024-09-12T18:38:07.368624+0000","last_became_active":"2024-09-12T18:35:20.442613+0000","last_became_peered":"2024-09-12T18:35:20.442613+0000","last_unstale":"2024-09-12T18:38:07.368624+0000","last_undegraded":"2024-09-12T18:38:07.368624+0000","last_fullsized":"2024-09-12T18:38:07.368624+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:17.636537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014134620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366112+0000","last_change":"2024-09-12T18:35:24.641297+0000","last_active":"2024-09-12T18:38:07.366112+0000","last_peered":"2024-09-12T18:38:07.366112+0000","last_clean":"2024-09-12T18:38:07.366112+0000","last_became_active":"2024-09-12T18:35:24.637334+0000","last_became_peered":"2024-09-12T18:35:24.637334+0000","last_unstale":"2024-09-12T18:38:07.366112+0000","last_undegraded":"2024-09-12T18:38:07.366112+0000","last_fullsized":"2024-09-12T18:38:07.366112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:50.772074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369805+0000","last_change":"2024-09-12T18:38:03.360352+0000","last_active":"2024-09-12T18:38:07.369805+0000","last_peered":"2024-09-12T18:38:07.369805+0000","last_clean":"2024-09-12T18:38:07.369805+0000","last_became_active":"2024-09-12T18:38:03.359452+0000","last_became_peered":"2024-09-12T18:38:03.359452+0000","last_unstale":"2024-09-12T18:38:07.369805+0000","last_undegraded":"2024-09-12T18:38:07.369805+0000","last_fullsized":"2024-09-12T18:38:07.369805+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:48.036394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":173,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358697+0000","last_change":"2024-09-12T18:35:22.459049+0000","last_active":"2024-09-12T18:38:06.358697+0000","last_peered":"2024-09-12T18:38:06.358697+0000","last_clean":"2024-09-12T18:38:06.358697+0000","last_became_active":"2024-09-12T18:35:20.446814+0000","last_became_peered":"2024-09-12T18:35:20.446814+0000","last_unstale":"2024-09-12T18:38:06.358697+0000","last_undegraded":"2024-09-12T18:38:06.358697+0000","last_fullsized":"2024-09-12T18:38:06.358697+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:18.033595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010716149999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":158,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359121+0000","last_change":"2024-09-12T18:35:24.658273+0000","last_active":"2024-09-12T18:38:06.359121+0000","last_peered":"2024-09-12T18:38:06.359121+0000","last_clean":"2024-09-12T18:38:06.359121+0000","last_became_active":"2024-09-12T18:35:24.657433+0000","last_became_peered":"2024-09-12T18:35:24.657433+0000","last_unstale":"2024-09-12T18:38:06.359121+0000","last_undegraded":"2024-09-12T18:38:06.359121+0000","last_fullsized":"2024-09-12T18:38:06.359121+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:48.497218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369135+0000","last_change":"2024-09-12T18:38:03.358304+0000","last_active":"2024-09-12T18:38:07.369135+0000","last_peered":"2024-09-12T18:38:07.369135+0000","last_clean":"2024-09-12T18:38:07.369135+0000","last_became_active":"2024-09-12T18:38:03.357592+0000","last_became_peered":"2024-09-12T18:38:03.357592+0000","last_unstale":"2024-09-12T18:38:07.369135+0000","last_undegraded":"2024-09-12T18:38:07.369135+0000","last_fullsized":"2024-09-12T18:38:07.369135+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:45.610260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":158,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358064+0000","last_change":"2024-09-12T18:35:24.657618+0000","last_active":"2024-09-12T18:38:06.358064+0000","last_peered":"2024-09-12T18:38:06.358064+0000","last_clean":"2024-09-12T18:38:06.358064+0000","last_became_active":"2024-09-12T18:35:24.656741+0000","last_became_peered":"2024-09-12T18:35:24.656741+0000","last_unstale":"2024-09-12T18:38:06.358064+0000","last_undegraded":"2024-09-12T18:38:06.358064+0000","last_fullsized":"2024-09-12T18:38:06.358064+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:43.113104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369480+0000","last_change":"2024-09-12T18:35:22.464180+0000","last_active":"2024-09-12T18:38:07.369480+0000","last_peered":"2024-09-12T18:38:07.369480+0000","last_clean":"2024-09-12T18:38:07.369480+0000","last_became_active":"2024-09-12T18:35:20.442566+0000","last_became_peered":"2024-09-12T18:35:20.442566+0000","last_unstale":"2024-09-12T18:38:07.369480+0000","last_undegraded":"2024-09-12T18:38:07.369480+0000","last_fullsized":"2024-09-12T18:38:07.369480+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:29.021710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001325786,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366700+0000","last_change":"2024-09-12T18:35:25.650458+0000","last_active":"2024-09-12T18:38:07.366700+0000","last_peered":"2024-09-12T18:38:07.366700+0000","last_clean":"2024-09-12T18:38:07.366700+0000","last_became_active":"2024-09-12T18:35:25.648761+0000","last_became_peered":"2024-09-12T18:35:25.648761+0000","last_unstale":"2024-09-12T18:38:07.366700+0000","last_undegraded":"2024-09-12T18:38:07.366700+0000","last_fullsized":"2024-09-12T18:38:07.366700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:53.026950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369129+0000","last_change":"2024-09-12T18:38:03.357887+0000","last_active":"2024-09-12T18:38:07.369129+0000","last_peered":"2024-09-12T18:38:07.369129+0000","last_clean":"2024-09-12T18:38:07.369129+0000","last_became_active":"2024-09-12T18:38:03.356816+0000","last_became_peered":"2024-09-12T18:38:03.356816+0000","last_unstale":"2024-09-12T18:38:07.369129+0000","last_undegraded":"2024-09-12T18:38:07.369129+0000","last_fullsized":"2024-09-12T18:38:07.369129+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:09.458196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":185,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366644+0000","last_change":"2024-09-12T18:38:03.351352+0000","last_active":"2024-09-12T18:38:07.366644+0000","last_peered":"2024-09-12T18:38:07.366644+0000","last_clean":"2024-09-12T18:38:07.366644+0000","last_became_active":"2024-09-12T18:38:03.350774+0000","last_became_peered":"2024-09-12T18:38:03.350774+0000","last_unstale":"2024-09-12T18:38:07.366644+0000","last_undegraded":"2024-09-12T18:38:07.366644+0000","last_fullsized":"2024-09-12T18:38:07.366644+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:30.555373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080163599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366902+0000","last_change":"2024-09-12T18:35:25.650717+0000","last_active":"2024-09-12T18:38:07.366902+0000","last_peered":"2024-09-12T18:38:07.366902+0000","last_clean":"2024-09-12T18:38:07.366902+0000","last_became_active":"2024-09-12T18:35:25.649147+0000","last_became_peered":"2024-09-12T18:35:25.649147+0000","last_unstale":"2024-09-12T18:38:07.366902+0000","last_undegraded":"2024-09-12T18:38:07.366902+0000","last_fullsized":"2024-09-12T18:38:07.366902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:07.365888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.370288+0000","last_change":"2024-09-12T18:35:24.657234+0000","last_active":"2024-09-12T18:38:07.370288+0000","last_peered":"2024-09-12T18:38:07.370288+0000","last_clean":"2024-09-12T18:38:07.370288+0000","last_became_active":"2024-09-12T18:35:24.655950+0000","last_became_peered":"2024-09-12T18:35:24.655950+0000","last_unstale":"2024-09-12T18:38:07.370288+0000","last_undegraded":"2024-09-12T18:38:07.370288+0000","last_fullsized":"2024-09-12T18:38:07.370288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:17.466623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359037+0000","last_change":"2024-09-12T18:37:34.258443+0000","last_active":"2024-09-12T18:38:06.359037+0000","last_peered":"2024-09-12T18:38:06.359037+0000","last_clean":"2024-09-12T18:38:06.359037+0000","last_became_active":"2024-09-12T18:37:34.254999+0000","last_became_peered":"2024-09-12T18:37:34.254999+0000","last_unstale":"2024-09-12T18:38:06.359037+0000","last_undegraded":"2024-09-12T18:38:06.359037+0000","last_fullsized":"2024-09-12T18:38:06.359037+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:23.164676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367719+0000","last_change":"2024-09-12T18:38:03.358177+0000","last_active":"2024-09-12T18:38:07.367719+0000","last_peered":"2024-09-12T18:38:07.367719+0000","last_clean":"2024-09-12T18:38:07.367719+0000","last_became_active":"2024-09-12T18:38:03.354895+0000","last_became_peered":"2024-09-12T18:38:03.354895+0000","last_unstale":"2024-09-12T18:38:07.367719+0000","last_undegraded":"2024-09-12T18:38:07.367719+0000","last_fullsized":"2024-09-12T18:38:07.367719+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:16.208815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369642+0000","last_change":"2024-09-12T18:38:03.370898+0000","last_active":"2024-09-12T18:38:07.369642+0000","last_peered":"2024-09-12T18:38:07.369642+0000","last_clean":"2024-09-12T18:38:07.369642+0000","last_became_active":"2024-09-12T18:38:03.354684+0000","last_became_peered":"2024-09-12T18:38:03.354684+0000","last_unstale":"2024-09-12T18:38:07.369642+0000","last_undegraded":"2024-09-12T18:38:07.369642+0000","last_fullsized":"2024-09-12T18:38:07.369642+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:27.684565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":171,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359956+0000","last_change":"2024-09-12T18:35:22.459767+0000","last_active":"2024-09-12T18:38:06.359956+0000","last_peered":"2024-09-12T18:38:06.359956+0000","last_clean":"2024-09-12T18:38:06.359956+0000","last_became_active":"2024-09-12T18:35:20.448521+0000","last_became_peered":"2024-09-12T18:35:20.448521+0000","last_unstale":"2024-09-12T18:38:06.359956+0000","last_undegraded":"2024-09-12T18:38:06.359956+0000","last_fullsized":"2024-09-12T18:38:06.359956+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:33.463792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017009670000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366127+0000","last_change":"2024-09-12T18:35:25.648150+0000","last_active":"2024-09-12T18:38:07.366127+0000","last_peered":"2024-09-12T18:38:07.366127+0000","last_clean":"2024-09-12T18:38:07.366127+0000","last_became_active":"2024-09-12T18:35:25.647347+0000","last_became_peered":"2024-09-12T18:35:25.647347+0000","last_unstale":"2024-09-12T18:38:07.366127+0000","last_undegraded":"2024-09-12T18:38:07.366127+0000","last_fullsized":"2024-09-12T18:38:07.366127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:48.968336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358735+0000","last_change":"2024-09-12T18:35:25.660696+0000","last_active":"2024-09-12T18:38:06.358735+0000","last_peered":"2024-09-12T18:38:06.358735+0000","last_clean":"2024-09-12T18:38:06.358735+0000","last_became_active":"2024-09-12T18:35:25.659827+0000","last_became_peered":"2024-09-12T18:35:25.659827+0000","last_unstale":"2024-09-12T18:38:06.358735+0000","last_undegraded":"2024-09-12T18:38:06.358735+0000","last_fullsized":"2024-09-12T18:38:06.358735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:15.678289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":164,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359083+0000","last_change":"2024-09-12T18:35:24.655051+0000","last_active":"2024-09-12T18:38:06.359083+0000","last_peered":"2024-09-12T18:38:06.359083+0000","last_clean":"2024-09-12T18:38:06.359083+0000","last_became_active":"2024-09-12T18:35:24.654282+0000","last_became_peered":"2024-09-12T18:35:24.654282+0000","last_unstale":"2024-09-12T18:38:06.359083+0000","last_undegraded":"2024-09-12T18:38:06.359083+0000","last_fullsized":"2024-09-12T18:38:06.359083+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:08.159799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368447+0000","last_change":"2024-09-12T18:38:03.355018+0000","last_active":"2024-09-12T18:38:07.368447+0000","last_peered":"2024-09-12T18:38:07.368447+0000","last_clean":"2024-09-12T18:38:07.368447+0000","last_became_active":"2024-09-12T18:38:03.354064+0000","last_became_peered":"2024-09-12T18:38:03.354064+0000","last_unstale":"2024-09-12T18:38:07.368447+0000","last_undegraded":"2024-09-12T18:38:07.368447+0000","last_fullsized":"2024-09-12T18:38:07.368447+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:18.297083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":163,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367123+0000","last_change":"2024-09-12T18:35:24.648658+0000","last_active":"2024-09-12T18:38:07.367123+0000","last_peered":"2024-09-12T18:38:07.367123+0000","last_clean":"2024-09-12T18:38:07.367123+0000","last_became_active":"2024-09-12T18:35:24.647826+0000","last_became_peered":"2024-09-12T18:35:24.647826+0000","last_unstale":"2024-09-12T18:38:07.367123+0000","last_undegraded":"2024-09-12T18:38:07.367123+0000","last_fullsized":"2024-09-12T18:38:07.367123+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:24.167549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359951+0000","last_change":"2024-09-12T18:38:03.366378+0000","last_active":"2024-09-12T18:38:06.359951+0000","last_peered":"2024-09-12T18:38:06.359951+0000","last_clean":"2024-09-12T18:38:06.359951+0000","last_became_active":"2024-09-12T18:38:03.364887+0000","last_became_peered":"2024-09-12T18:38:03.364887+0000","last_unstale":"2024-09-12T18:38:06.359951+0000","last_undegraded":"2024-09-12T18:38:06.359951+0000","last_fullsized":"2024-09-12T18:38:06.359951+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:54.490659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368005+0000","last_change":"2024-09-12T18:35:25.661801+0000","last_active":"2024-09-12T18:38:07.368005+0000","last_peered":"2024-09-12T18:38:07.368005+0000","last_clean":"2024-09-12T18:38:07.368005+0000","last_became_active":"2024-09-12T18:35:25.658476+0000","last_became_peered":"2024-09-12T18:35:25.658476+0000","last_unstale":"2024-09-12T18:38:07.368005+0000","last_undegraded":"2024-09-12T18:38:07.368005+0000","last_fullsized":"2024-09-12T18:38:07.368005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:58.246449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.370140+0000","last_change":"2024-09-12T18:35:24.652399+0000","last_active":"2024-09-12T18:38:07.370140+0000","last_peered":"2024-09-12T18:38:07.370140+0000","last_clean":"2024-09-12T18:38:07.370140+0000","last_became_active":"2024-09-12T18:35:24.651416+0000","last_became_peered":"2024-09-12T18:35:24.651416+0000","last_unstale":"2024-09-12T18:38:07.370140+0000","last_undegraded":"2024-09-12T18:38:07.370140+0000","last_fullsized":"2024-09-12T18:38:07.370140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:32.594978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367773+0000","last_change":"2024-09-12T18:38:03.359924+0000","last_active":"2024-09-12T18:38:07.367773+0000","last_peered":"2024-09-12T18:38:07.367773+0000","last_clean":"2024-09-12T18:38:07.367773+0000","last_became_active":"2024-09-12T18:38:03.357598+0000","last_became_peered":"2024-09-12T18:38:03.357598+0000","last_unstale":"2024-09-12T18:38:07.367773+0000","last_undegraded":"2024-09-12T18:38:07.367773+0000","last_fullsized":"2024-09-12T18:38:07.367773+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:59.501652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368603+0000","last_change":"2024-09-12T18:35:25.651217+0000","last_active":"2024-09-12T18:38:07.368603+0000","last_peered":"2024-09-12T18:38:07.368603+0000","last_clean":"2024-09-12T18:38:07.368603+0000","last_became_active":"2024-09-12T18:35:25.649544+0000","last_became_peered":"2024-09-12T18:35:25.649544+0000","last_unstale":"2024-09-12T18:38:07.368603+0000","last_undegraded":"2024-09-12T18:38:07.368603+0000","last_fullsized":"2024-09-12T18:38:07.368603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:41.601376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367616+0000","last_change":"2024-09-12T18:38:03.349281+0000","last_active":"2024-09-12T18:38:07.367616+0000","last_peered":"2024-09-12T18:38:07.367616+0000","last_clean":"2024-09-12T18:38:07.367616+0000","last_became_active":"2024-09-12T18:38:03.347483+0000","last_became_peered":"2024-09-12T18:38:03.347483+0000","last_unstale":"2024-09-12T18:38:07.367616+0000","last_undegraded":"2024-09-12T18:38:07.367616+0000","last_fullsized":"2024-09-12T18:38:07.367616+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:02.283482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369856+0000","last_change":"2024-09-12T18:35:25.661544+0000","last_active":"2024-09-12T18:38:07.369856+0000","last_peered":"2024-09-12T18:38:07.369856+0000","last_clean":"2024-09-12T18:38:07.369856+0000","last_became_active":"2024-09-12T18:35:25.656985+0000","last_became_peered":"2024-09-12T18:35:25.656985+0000","last_unstale":"2024-09-12T18:38:07.369856+0000","last_undegraded":"2024-09-12T18:38:07.369856+0000","last_fullsized":"2024-09-12T18:38:07.369856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368189+0000","last_change":"2024-09-12T18:38:03.352648+0000","last_active":"2024-09-12T18:38:07.368189+0000","last_peered":"2024-09-12T18:38:07.368189+0000","last_clean":"2024-09-12T18:38:07.368189+0000","last_became_active":"2024-09-12T18:38:03.351740+0000","last_became_peered":"2024-09-12T18:38:03.351740+0000","last_unstale":"2024-09-12T18:38:07.368189+0000","last_undegraded":"2024-09-12T18:38:07.368189+0000","last_fullsized":"2024-09-12T18:38:07.368189+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:13.765236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368265+0000","last_change":"2024-09-12T18:35:25.656712+0000","last_active":"2024-09-12T18:38:07.368265+0000","last_peered":"2024-09-12T18:38:07.368265+0000","last_clean":"2024-09-12T18:38:07.368265+0000","last_became_active":"2024-09-12T18:35:25.654473+0000","last_became_peered":"2024-09-12T18:35:25.654473+0000","last_unstale":"2024-09-12T18:38:07.368265+0000","last_undegraded":"2024-09-12T18:38:07.368265+0000","last_fullsized":"2024-09-12T18:38:07.368265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:01.464680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":161,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367676+0000","last_change":"2024-09-12T18:35:24.659935+0000","last_active":"2024-09-12T18:38:07.367676+0000","last_peered":"2024-09-12T18:38:07.367676+0000","last_clean":"2024-09-12T18:38:07.367676+0000","last_became_active":"2024-09-12T18:35:24.659111+0000","last_became_peered":"2024-09-12T18:35:24.659111+0000","last_unstale":"2024-09-12T18:38:07.367676+0000","last_undegraded":"2024-09-12T18:38:07.367676+0000","last_fullsized":"2024-09-12T18:38:07.367676+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:11.480154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367022+0000","last_change":"2024-09-12T18:38:03.351609+0000","last_active":"2024-09-12T18:38:07.367022+0000","last_peered":"2024-09-12T18:38:07.367022+0000","last_clean":"2024-09-12T18:38:07.367022+0000","last_became_active":"2024-09-12T18:38:03.350972+0000","last_became_peered":"2024-09-12T18:38:03.350972+0000","last_unstale":"2024-09-12T18:38:07.367022+0000","last_undegraded":"2024-09-12T18:38:07.367022+0000","last_fullsized":"2024-09-12T18:38:07.367022+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:15.351880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":161,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367876+0000","last_change":"2024-09-12T18:35:24.638538+0000","last_active":"2024-09-12T18:38:07.367876+0000","last_peered":"2024-09-12T18:38:07.367876+0000","last_clean":"2024-09-12T18:38:07.367876+0000","last_became_active":"2024-09-12T18:35:24.637242+0000","last_became_peered":"2024-09-12T18:35:24.637242+0000","last_unstale":"2024-09-12T18:38:07.367876+0000","last_undegraded":"2024-09-12T18:38:07.367876+0000","last_fullsized":"2024-09-12T18:38:07.367876+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:26.877441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358498+0000","last_change":"2024-09-12T18:35:25.662537+0000","last_active":"2024-09-12T18:38:06.358498+0000","last_peered":"2024-09-12T18:38:06.358498+0000","last_clean":"2024-09-12T18:38:06.358498+0000","last_became_active":"2024-09-12T18:35:25.661441+0000","last_became_peered":"2024-09-12T18:35:25.661441+0000","last_unstale":"2024-09-12T18:38:06.358498+0000","last_undegraded":"2024-09-12T18:38:06.358498+0000","last_fullsized":"2024-09-12T18:38:06.358498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:14.397867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":180,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358818+0000","last_change":"2024-09-12T18:38:03.369857+0000","last_active":"2024-09-12T18:38:06.358818+0000","last_peered":"2024-09-12T18:38:06.358818+0000","last_clean":"2024-09-12T18:38:06.358818+0000","last_became_active":"2024-09-12T18:38:03.355520+0000","last_became_peered":"2024-09-12T18:38:03.355520+0000","last_unstale":"2024-09-12T18:38:06.358818+0000","last_undegraded":"2024-09-12T18:38:06.358818+0000","last_fullsized":"2024-09-12T18:38:06.358818+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:28.637798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358482+0000","last_change":"2024-09-12T18:35:25.651406+0000","last_active":"2024-09-12T18:38:06.358482+0000","last_peered":"2024-09-12T18:38:06.358482+0000","last_clean":"2024-09-12T18:38:06.358482+0000","last_became_active":"2024-09-12T18:35:25.649728+0000","last_became_peered":"2024-09-12T18:35:25.649728+0000","last_unstale":"2024-09-12T18:38:06.358482+0000","last_undegraded":"2024-09-12T18:38:06.358482+0000","last_fullsized":"2024-09-12T18:38:06.358482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:41.773283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368047+0000","last_change":"2024-09-12T18:35:24.649153+0000","last_active":"2024-09-12T18:38:07.368047+0000","last_peered":"2024-09-12T18:38:07.368047+0000","last_clean":"2024-09-12T18:38:07.368047+0000","last_became_active":"2024-09-12T18:35:24.648512+0000","last_became_peered":"2024-09-12T18:35:24.648512+0000","last_unstale":"2024-09-12T18:38:07.368047+0000","last_undegraded":"2024-09-12T18:38:07.368047+0000","last_fullsized":"2024-09-12T18:38:07.368047+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:07.810456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366854+0000","last_change":"2024-09-12T18:35:25.656799+0000","last_active":"2024-09-12T18:38:07.366854+0000","last_peered":"2024-09-12T18:38:07.366854+0000","last_clean":"2024-09-12T18:38:07.366854+0000","last_became_active":"2024-09-12T18:35:25.654980+0000","last_became_peered":"2024-09-12T18:35:25.654980+0000","last_unstale":"2024-09-12T18:38:07.366854+0000","last_undegraded":"2024-09-12T18:38:07.366854+0000","last_fullsized":"2024-09-12T18:38:07.366854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:10.735439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":161,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.370189+0000","last_change":"2024-09-12T18:35:24.656268+0000","last_active":"2024-09-12T18:38:07.370189+0000","last_peered":"2024-09-12T18:38:07.370189+0000","last_clean":"2024-09-12T18:38:07.370189+0000","last_became_active":"2024-09-12T18:35:24.655420+0000","last_became_peered":"2024-09-12T18:35:24.655420+0000","last_unstale":"2024-09-12T18:38:07.370189+0000","last_undegraded":"2024-09-12T18:38:07.370189+0000","last_fullsized":"2024-09-12T18:38:07.370189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:04.654666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358119+0000","last_change":"2024-09-12T18:38:03.357094+0000","last_active":"2024-09-12T18:38:06.358119+0000","last_peered":"2024-09-12T18:38:06.358119+0000","last_clean":"2024-09-12T18:38:06.358119+0000","last_became_active":"2024-09-12T18:38:03.355072+0000","last_became_peered":"2024-09-12T18:38:03.355072+0000","last_unstale":"2024-09-12T18:38:06.358119+0000","last_undegraded":"2024-09-12T18:38:06.358119+0000","last_fullsized":"2024-09-12T18:38:06.358119+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:46.451497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369635+0000","last_change":"2024-09-12T18:38:03.379032+0000","last_active":"2024-09-12T18:38:07.369635+0000","last_peered":"2024-09-12T18:38:07.369635+0000","last_clean":"2024-09-12T18:38:07.369635+0000","last_became_active":"2024-09-12T18:38:03.353780+0000","last_became_peered":"2024-09-12T18:38:03.353780+0000","last_unstale":"2024-09-12T18:38:07.369635+0000","last_undegraded":"2024-09-12T18:38:07.369635+0000","last_fullsized":"2024-09-12T18:38:07.369635+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:26.800343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705703,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297412,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":296318,"kb_avail":94074428,"statfs":{"total":96636764160,"available":96332214272,"internally_reserved":0,"allocated":1097728,"data_stored":982590,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":303430086},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738407,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280776,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94091064,"statfs":{"total":96636764160,"available":96349249536,"internally_reserved":0,"allocated":1101824,"data_stored":978964,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":286390725},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738407,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302908,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":301886,"kb_avail":94068932,"statfs":{"total":96636764160,"available":96326586368,"internally_reserved":0,"allocated":1019904,"data_stored":391063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":309131718},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:38:10.584 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-12T18:38:10.584 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-12T18:38:10.934 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T18:38:10.942 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T18:38:10.942 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:38:11.236 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:38:11.238 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T18:38:11.253 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2024-09-12T18:38:10.425555+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":192,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":881096,"kb_used_data":3144,"kb_used_omap":4,"kb_used_meta":877883,"kb_avail":282234424,"statfs":{"total":289910292480,"available":289008050176,"internally_reserved":0,"allocated":3219456,"data_stored":2352617,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4783,"internal_metadata":898952529},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001362"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368487+0000","last_change":"2024-09-12T18:38:03.358323+0000","last_active":"2024-09-12T18:38:07.368487+0000","last_peered":"2024-09-12T18:38:07.368487+0000","last_clean":"2024-09-12T18:38:07.368487+0000","last_became_active":"2024-09-12T18:38:03.357317+0000","last_became_peered":"2024-09-12T18:38:03.357317+0000","last_unstale":"2024-09-12T18:38:07.368487+0000","last_undegraded":"2024-09-12T18:38:07.368487+0000","last_fullsized":"2024-09-12T18:38:07.368487+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:55.315464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367135+0000","last_change":"2024-09-12T18:35:25.659760+0000","last_active":"2024-09-12T18:38:07.367135+0000","last_peered":"2024-09-12T18:38:07.367135+0000","last_clean":"2024-09-12T18:38:07.367135+0000","last_became_active":"2024-09-12T18:35:25.654920+0000","last_became_peered":"2024-09-12T18:35:25.654920+0000","last_unstale":"2024-09-12T18:38:07.367135+0000","last_undegraded":"2024-09-12T18:38:07.367135+0000","last_fullsized":"2024-09-12T18:38:07.367135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:21.519881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359587+0000","last_change":"2024-09-12T18:35:25.659460+0000","last_active":"2024-09-12T18:38:06.359587+0000","last_peered":"2024-09-12T18:38:06.359587+0000","last_clean":"2024-09-12T18:38:06.359587+0000","last_became_active":"2024-09-12T18:35:25.657782+0000","last_became_peered":"2024-09-12T18:35:25.657782+0000","last_unstale":"2024-09-12T18:38:06.359587+0000","last_undegraded":"2024-09-12T18:38:06.359587+0000","last_fullsized":"2024-09-12T18:38:06.359587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:38.544284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358249+0000","last_change":"2024-09-12T18:35:25.663617+0000","last_active":"2024-09-12T18:38:06.358249+0000","last_peered":"2024-09-12T18:38:06.358249+0000","last_clean":"2024-09-12T18:38:06.358249+0000","last_became_active":"2024-09-12T18:35:25.661977+0000","last_became_peered":"2024-09-12T18:35:25.661977+0000","last_unstale":"2024-09-12T18:38:06.358249+0000","last_undegraded":"2024-09-12T18:38:06.358249+0000","last_fullsized":"2024-09-12T18:38:06.358249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:14.748234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367138+0000","last_change":"2024-09-12T18:35:25.656566+0000","last_active":"2024-09-12T18:38:07.367138+0000","last_peered":"2024-09-12T18:38:07.367138+0000","last_clean":"2024-09-12T18:38:07.367138+0000","last_became_active":"2024-09-12T18:35:25.654898+0000","last_became_peered":"2024-09-12T18:35:25.654898+0000","last_unstale":"2024-09-12T18:38:07.367138+0000","last_undegraded":"2024-09-12T18:38:07.367138+0000","last_fullsized":"2024-09-12T18:38:07.367138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:36.113250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.357732+0000","last_change":"2024-09-12T18:38:03.366489+0000","last_active":"2024-09-12T18:38:06.357732+0000","last_peered":"2024-09-12T18:38:06.357732+0000","last_clean":"2024-09-12T18:38:06.357732+0000","last_became_active":"2024-09-12T18:38:03.364745+0000","last_became_peered":"2024-09-12T18:38:03.364745+0000","last_unstale":"2024-09-12T18:38:06.357732+0000","last_undegraded":"2024-09-12T18:38:06.357732+0000","last_fullsized":"2024-09-12T18:38:06.357732+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:42.397517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.357624+0000","last_change":"2024-09-12T18:35:25.659811+0000","last_active":"2024-09-12T18:38:06.357624+0000","last_peered":"2024-09-12T18:38:06.357624+0000","last_clean":"2024-09-12T18:38:06.357624+0000","last_became_active":"2024-09-12T18:35:25.658998+0000","last_became_peered":"2024-09-12T18:35:25.658998+0000","last_unstale":"2024-09-12T18:38:06.357624+0000","last_undegraded":"2024-09-12T18:38:06.357624+0000","last_fullsized":"2024-09-12T18:38:06.357624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.357347+0000","last_change":"2024-09-12T18:38:03.365773+0000","last_active":"2024-09-12T18:38:06.357347+0000","last_peered":"2024-09-12T18:38:06.357347+0000","last_clean":"2024-09-12T18:38:06.357347+0000","last_became_active":"2024-09-12T18:38:03.364845+0000","last_became_peered":"2024-09-12T18:38:03.364845+0000","last_unstale":"2024-09-12T18:38:06.357347+0000","last_undegraded":"2024-09-12T18:38:06.357347+0000","last_fullsized":"2024-09-12T18:38:06.357347+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:19.384528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369867+0000","last_change":"2024-09-12T18:35:25.668339+0000","last_active":"2024-09-12T18:38:07.369867+0000","last_peered":"2024-09-12T18:38:07.369867+0000","last_clean":"2024-09-12T18:38:07.369867+0000","last_became_active":"2024-09-12T18:35:25.667608+0000","last_became_peered":"2024-09-12T18:35:25.667608+0000","last_unstale":"2024-09-12T18:38:07.369867+0000","last_undegraded":"2024-09-12T18:38:07.369867+0000","last_fullsized":"2024-09-12T18:38:07.369867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:15.699745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367232+0000","last_change":"2024-09-12T18:38:03.358177+0000","last_active":"2024-09-12T18:38:07.367232+0000","last_peered":"2024-09-12T18:38:07.367232+0000","last_clean":"2024-09-12T18:38:07.367232+0000","last_became_active":"2024-09-12T18:38:03.357446+0000","last_became_peered":"2024-09-12T18:38:03.357446+0000","last_unstale":"2024-09-12T18:38:07.367232+0000","last_undegraded":"2024-09-12T18:38:07.367232+0000","last_fullsized":"2024-09-12T18:38:07.367232+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:13.110496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359515+0000","last_change":"2024-09-12T18:38:03.356440+0000","last_active":"2024-09-12T18:38:06.359515+0000","last_peered":"2024-09-12T18:38:06.359515+0000","last_clean":"2024-09-12T18:38:06.359515+0000","last_became_active":"2024-09-12T18:38:03.355561+0000","last_became_peered":"2024-09-12T18:38:03.355561+0000","last_unstale":"2024-09-12T18:38:06.359515+0000","last_undegraded":"2024-09-12T18:38:06.359515+0000","last_fullsized":"2024-09-12T18:38:06.359515+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:43.438258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366852+0000","last_change":"2024-09-12T18:35:25.649885+0000","last_active":"2024-09-12T18:38:07.366852+0000","last_peered":"2024-09-12T18:38:07.366852+0000","last_clean":"2024-09-12T18:38:07.366852+0000","last_became_active":"2024-09-12T18:35:25.649111+0000","last_became_peered":"2024-09-12T18:35:25.649111+0000","last_unstale":"2024-09-12T18:38:07.366852+0000","last_undegraded":"2024-09-12T18:38:07.366852+0000","last_fullsized":"2024-09-12T18:38:07.366852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:17.162410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366640+0000","last_change":"2024-09-12T18:38:03.349917+0000","last_active":"2024-09-12T18:38:07.366640+0000","last_peered":"2024-09-12T18:38:07.366640+0000","last_clean":"2024-09-12T18:38:07.366640+0000","last_became_active":"2024-09-12T18:38:03.349130+0000","last_became_peered":"2024-09-12T18:38:03.349130+0000","last_unstale":"2024-09-12T18:38:07.366640+0000","last_undegraded":"2024-09-12T18:38:07.366640+0000","last_fullsized":"2024-09-12T18:38:07.366640+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:45.548888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.357883+0000","last_change":"2024-09-12T18:35:25.657913+0000","last_active":"2024-09-12T18:38:06.357883+0000","last_peered":"2024-09-12T18:38:06.357883+0000","last_clean":"2024-09-12T18:38:06.357883+0000","last_became_active":"2024-09-12T18:35:25.657082+0000","last_became_peered":"2024-09-12T18:35:25.657082+0000","last_unstale":"2024-09-12T18:38:06.357883+0000","last_undegraded":"2024-09-12T18:38:06.357883+0000","last_fullsized":"2024-09-12T18:38:06.357883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:21.538633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.357675+0000","last_change":"2024-09-12T18:35:25.658763+0000","last_active":"2024-09-12T18:38:06.357675+0000","last_peered":"2024-09-12T18:38:06.357675+0000","last_clean":"2024-09-12T18:38:06.357675+0000","last_became_active":"2024-09-12T18:35:25.657508+0000","last_became_peered":"2024-09-12T18:35:25.657508+0000","last_unstale":"2024-09-12T18:38:06.357675+0000","last_undegraded":"2024-09-12T18:38:06.357675+0000","last_fullsized":"2024-09-12T18:38:06.357675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:13.170519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.357358+0000","last_change":"2024-09-12T18:35:25.653730+0000","last_active":"2024-09-12T18:38:06.357358+0000","last_peered":"2024-09-12T18:38:06.357358+0000","last_clean":"2024-09-12T18:38:06.357358+0000","last_became_active":"2024-09-12T18:35:25.651535+0000","last_became_peered":"2024-09-12T18:35:25.651535+0000","last_unstale":"2024-09-12T18:38:06.357358+0000","last_undegraded":"2024-09-12T18:38:06.357358+0000","last_fullsized":"2024-09-12T18:38:06.357358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.370149+0000","last_change":"2024-09-12T18:35:25.656513+0000","last_active":"2024-09-12T18:38:07.370149+0000","last_peered":"2024-09-12T18:38:07.370149+0000","last_clean":"2024-09-12T18:38:07.370149+0000","last_became_active":"2024-09-12T18:35:25.653440+0000","last_became_peered":"2024-09-12T18:35:25.653440+0000","last_unstale":"2024-09-12T18:38:07.370149+0000","last_undegraded":"2024-09-12T18:38:07.370149+0000","last_fullsized":"2024-09-12T18:38:07.370149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:18.693161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367487+0000","last_change":"2024-09-12T18:35:25.657991+0000","last_active":"2024-09-12T18:38:07.367487+0000","last_peered":"2024-09-12T18:38:07.367487+0000","last_clean":"2024-09-12T18:38:07.367487+0000","last_became_active":"2024-09-12T18:35:25.653934+0000","last_became_peered":"2024-09-12T18:35:25.653934+0000","last_unstale":"2024-09-12T18:38:07.367487+0000","last_undegraded":"2024-09-12T18:38:07.367487+0000","last_fullsized":"2024-09-12T18:38:07.367487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:05.418901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368965+0000","last_change":"2024-09-12T18:38:03.358270+0000","last_active":"2024-09-12T18:38:07.368965+0000","last_peered":"2024-09-12T18:38:07.368965+0000","last_clean":"2024-09-12T18:38:07.368965+0000","last_became_active":"2024-09-12T18:38:03.357363+0000","last_became_peered":"2024-09-12T18:38:03.357363+0000","last_unstale":"2024-09-12T18:38:07.368965+0000","last_undegraded":"2024-09-12T18:38:07.368965+0000","last_fullsized":"2024-09-12T18:38:07.368965+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:56.658700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358511+0000","last_change":"2024-09-12T18:35:25.661176+0000","last_active":"2024-09-12T18:38:06.358511+0000","last_peered":"2024-09-12T18:38:06.358511+0000","last_clean":"2024-09-12T18:38:06.358511+0000","last_became_active":"2024-09-12T18:35:25.659534+0000","last_became_peered":"2024-09-12T18:35:25.659534+0000","last_unstale":"2024-09-12T18:38:06.358511+0000","last_undegraded":"2024-09-12T18:38:06.358511+0000","last_fullsized":"2024-09-12T18:38:06.358511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:40.145442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358406+0000","last_change":"2024-09-12T18:35:25.650632+0000","last_active":"2024-09-12T18:38:06.358406+0000","last_peered":"2024-09-12T18:38:06.358406+0000","last_clean":"2024-09-12T18:38:06.358406+0000","last_became_active":"2024-09-12T18:35:25.649333+0000","last_became_peered":"2024-09-12T18:35:25.649333+0000","last_unstale":"2024-09-12T18:38:06.358406+0000","last_undegraded":"2024-09-12T18:38:06.358406+0000","last_fullsized":"2024-09-12T18:38:06.358406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:30.537572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366475+0000","last_change":"2024-09-12T18:35:25.648245+0000","last_active":"2024-09-12T18:38:07.366475+0000","last_peered":"2024-09-12T18:38:07.366475+0000","last_clean":"2024-09-12T18:38:07.366475+0000","last_became_active":"2024-09-12T18:35:25.646357+0000","last_became_peered":"2024-09-12T18:35:25.646357+0000","last_unstale":"2024-09-12T18:38:07.366475+0000","last_undegraded":"2024-09-12T18:38:07.366475+0000","last_fullsized":"2024-09-12T18:38:07.366475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:05.662140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367728+0000","last_change":"2024-09-12T18:35:25.661613+0000","last_active":"2024-09-12T18:38:07.367728+0000","last_peered":"2024-09-12T18:38:07.367728+0000","last_clean":"2024-09-12T18:38:07.367728+0000","last_became_active":"2024-09-12T18:35:25.658833+0000","last_became_peered":"2024-09-12T18:35:25.658833+0000","last_unstale":"2024-09-12T18:38:07.367728+0000","last_undegraded":"2024-09-12T18:38:07.367728+0000","last_fullsized":"2024-09-12T18:38:07.367728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:51.064080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366639+0000","last_change":"2024-09-12T18:35:25.657782+0000","last_active":"2024-09-12T18:38:07.366639+0000","last_peered":"2024-09-12T18:38:07.366639+0000","last_clean":"2024-09-12T18:38:07.366639+0000","last_became_active":"2024-09-12T18:35:25.655295+0000","last_became_peered":"2024-09-12T18:35:25.655295+0000","last_unstale":"2024-09-12T18:38:07.366639+0000","last_undegraded":"2024-09-12T18:38:07.366639+0000","last_fullsized":"2024-09-12T18:38:07.366639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:37.744175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368546+0000","last_change":"2024-09-12T18:35:25.654863+0000","last_active":"2024-09-12T18:38:07.368546+0000","last_peered":"2024-09-12T18:38:07.368546+0000","last_clean":"2024-09-12T18:38:07.368546+0000","last_became_active":"2024-09-12T18:35:25.650407+0000","last_became_peered":"2024-09-12T18:35:25.650407+0000","last_unstale":"2024-09-12T18:38:07.368546+0000","last_undegraded":"2024-09-12T18:38:07.368546+0000","last_fullsized":"2024-09-12T18:38:07.368546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:38.395666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369981+0000","last_change":"2024-09-12T18:35:25.662414+0000","last_active":"2024-09-12T18:38:07.369981+0000","last_peered":"2024-09-12T18:38:07.369981+0000","last_clean":"2024-09-12T18:38:07.369981+0000","last_became_active":"2024-09-12T18:35:25.660126+0000","last_became_peered":"2024-09-12T18:35:25.660126+0000","last_unstale":"2024-09-12T18:38:07.369981+0000","last_undegraded":"2024-09-12T18:38:07.369981+0000","last_fullsized":"2024-09-12T18:38:07.369981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:48.437139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359333+0000","last_change":"2024-09-12T18:35:25.661523+0000","last_active":"2024-09-12T18:38:06.359333+0000","last_peered":"2024-09-12T18:38:06.359333+0000","last_clean":"2024-09-12T18:38:06.359333+0000","last_became_active":"2024-09-12T18:35:25.659338+0000","last_became_peered":"2024-09-12T18:35:25.659338+0000","last_unstale":"2024-09-12T18:38:06.359333+0000","last_undegraded":"2024-09-12T18:38:06.359333+0000","last_fullsized":"2024-09-12T18:38:06.359333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:37.083820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367372+0000","last_change":"2024-09-12T18:35:25.662445+0000","last_active":"2024-09-12T18:38:07.367372+0000","last_peered":"2024-09-12T18:38:07.367372+0000","last_clean":"2024-09-12T18:38:07.367372+0000","last_became_active":"2024-09-12T18:35:25.659496+0000","last_became_peered":"2024-09-12T18:35:25.659496+0000","last_unstale":"2024-09-12T18:38:07.367372+0000","last_undegraded":"2024-09-12T18:38:07.367372+0000","last_fullsized":"2024-09-12T18:38:07.367372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:03.270420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368653+0000","last_change":"2024-09-12T18:38:03.357219+0000","last_active":"2024-09-12T18:38:07.368653+0000","last_peered":"2024-09-12T18:38:07.368653+0000","last_clean":"2024-09-12T18:38:07.368653+0000","last_became_active":"2024-09-12T18:38:03.356412+0000","last_became_peered":"2024-09-12T18:38:03.356412+0000","last_unstale":"2024-09-12T18:38:07.368653+0000","last_undegraded":"2024-09-12T18:38:07.368653+0000","last_fullsized":"2024-09-12T18:38:07.368653+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:53.007632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367404+0000","last_change":"2024-09-12T18:35:25.650507+0000","last_active":"2024-09-12T18:38:07.367404+0000","last_peered":"2024-09-12T18:38:07.367404+0000","last_clean":"2024-09-12T18:38:07.367404+0000","last_became_active":"2024-09-12T18:35:25.649415+0000","last_became_peered":"2024-09-12T18:35:25.649415+0000","last_unstale":"2024-09-12T18:38:07.367404+0000","last_undegraded":"2024-09-12T18:38:07.367404+0000","last_fullsized":"2024-09-12T18:38:07.367404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:23.081416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367879+0000","last_change":"2024-09-12T18:35:25.653949+0000","last_active":"2024-09-12T18:38:07.367879+0000","last_peered":"2024-09-12T18:38:07.367879+0000","last_clean":"2024-09-12T18:38:07.367879+0000","last_became_active":"2024-09-12T18:35:25.652992+0000","last_became_peered":"2024-09-12T18:35:25.652992+0000","last_unstale":"2024-09-12T18:38:07.367879+0000","last_undegraded":"2024-09-12T18:38:07.367879+0000","last_fullsized":"2024-09-12T18:38:07.367879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:47.687372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.357652+0000","last_change":"2024-09-12T18:38:03.356306+0000","last_active":"2024-09-12T18:38:06.357652+0000","last_peered":"2024-09-12T18:38:06.357652+0000","last_clean":"2024-09-12T18:38:06.357652+0000","last_became_active":"2024-09-12T18:38:03.355052+0000","last_became_peered":"2024-09-12T18:38:03.355052+0000","last_unstale":"2024-09-12T18:38:06.357652+0000","last_undegraded":"2024-09-12T18:38:06.357652+0000","last_fullsized":"2024-09-12T18:38:06.357652+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:54.986299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367305+0000","last_change":"2024-09-12T18:38:03.351904+0000","last_active":"2024-09-12T18:38:07.367305+0000","last_peered":"2024-09-12T18:38:07.367305+0000","last_clean":"2024-09-12T18:38:07.367305+0000","last_became_active":"2024-09-12T18:38:03.351112+0000","last_became_peered":"2024-09-12T18:38:03.351112+0000","last_unstale":"2024-09-12T18:38:07.367305+0000","last_undegraded":"2024-09-12T18:38:07.367305+0000","last_fullsized":"2024-09-12T18:38:07.367305+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:52.881469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":160,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359058+0000","last_change":"2024-09-12T18:35:24.657739+0000","last_active":"2024-09-12T18:38:06.359058+0000","last_peered":"2024-09-12T18:38:06.359058+0000","last_clean":"2024-09-12T18:38:06.359058+0000","last_became_active":"2024-09-12T18:35:24.656208+0000","last_became_peered":"2024-09-12T18:35:24.656208+0000","last_unstale":"2024-09-12T18:38:06.359058+0000","last_undegraded":"2024-09-12T18:38:06.359058+0000","last_fullsized":"2024-09-12T18:38:06.359058+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:50.073716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367762+0000","last_change":"2024-09-12T18:35:25.651651+0000","last_active":"2024-09-12T18:38:07.367762+0000","last_peered":"2024-09-12T18:38:07.367762+0000","last_clean":"2024-09-12T18:38:07.367762+0000","last_became_active":"2024-09-12T18:35:25.650849+0000","last_became_peered":"2024-09-12T18:35:25.650849+0000","last_unstale":"2024-09-12T18:38:07.367762+0000","last_undegraded":"2024-09-12T18:38:07.367762+0000","last_fullsized":"2024-09-12T18:38:07.367762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:18.555827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368934+0000","last_change":"2024-09-12T18:35:24.656119+0000","last_active":"2024-09-12T18:38:07.368934+0000","last_peered":"2024-09-12T18:38:07.368934+0000","last_clean":"2024-09-12T18:38:07.368934+0000","last_became_active":"2024-09-12T18:35:24.653175+0000","last_became_peered":"2024-09-12T18:35:24.653175+0000","last_unstale":"2024-09-12T18:38:07.368934+0000","last_undegraded":"2024-09-12T18:38:07.368934+0000","last_fullsized":"2024-09-12T18:38:07.368934+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:00.551165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369501+0000","last_change":"2024-09-12T18:38:03.356363+0000","last_active":"2024-09-12T18:38:07.369501+0000","last_peered":"2024-09-12T18:38:07.369501+0000","last_clean":"2024-09-12T18:38:07.369501+0000","last_became_active":"2024-09-12T18:38:03.354299+0000","last_became_peered":"2024-09-12T18:38:03.354299+0000","last_unstale":"2024-09-12T18:38:07.369501+0000","last_undegraded":"2024-09-12T18:38:07.369501+0000","last_fullsized":"2024-09-12T18:38:07.369501+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:40.267630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366478+0000","last_change":"2024-09-12T18:35:24.640096+0000","last_active":"2024-09-12T18:38:07.366478+0000","last_peered":"2024-09-12T18:38:07.366478+0000","last_clean":"2024-09-12T18:38:07.366478+0000","last_became_active":"2024-09-12T18:35:24.638230+0000","last_became_peered":"2024-09-12T18:35:24.638230+0000","last_unstale":"2024-09-12T18:38:07.366478+0000","last_undegraded":"2024-09-12T18:38:07.366478+0000","last_fullsized":"2024-09-12T18:38:07.366478+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:38.435296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369661+0000","last_change":"2024-09-12T18:38:03.354155+0000","last_active":"2024-09-12T18:38:07.369661+0000","last_peered":"2024-09-12T18:38:07.369661+0000","last_clean":"2024-09-12T18:38:07.369661+0000","last_became_active":"2024-09-12T18:38:03.352848+0000","last_became_peered":"2024-09-12T18:38:03.352848+0000","last_unstale":"2024-09-12T18:38:07.369661+0000","last_undegraded":"2024-09-12T18:38:07.369661+0000","last_fullsized":"2024-09-12T18:38:07.369661+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:36.825717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":166,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.357827+0000","last_change":"2024-09-12T18:35:24.653610+0000","last_active":"2024-09-12T18:38:06.357827+0000","last_peered":"2024-09-12T18:38:06.357827+0000","last_clean":"2024-09-12T18:38:06.357827+0000","last_became_active":"2024-09-12T18:35:24.652880+0000","last_became_peered":"2024-09-12T18:35:24.652880+0000","last_unstale":"2024-09-12T18:38:06.357827+0000","last_undegraded":"2024-09-12T18:38:06.357827+0000","last_fullsized":"2024-09-12T18:38:06.357827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:57.636251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":159,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359825+0000","last_change":"2024-09-12T18:35:24.653465+0000","last_active":"2024-09-12T18:38:06.359825+0000","last_peered":"2024-09-12T18:38:06.359825+0000","last_clean":"2024-09-12T18:38:06.359825+0000","last_became_active":"2024-09-12T18:35:24.652792+0000","last_became_peered":"2024-09-12T18:35:24.652792+0000","last_unstale":"2024-09-12T18:38:06.359825+0000","last_undegraded":"2024-09-12T18:38:06.359825+0000","last_fullsized":"2024-09-12T18:38:06.359825+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:14.588993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366949+0000","last_change":"2024-09-12T18:35:25.655426+0000","last_active":"2024-09-12T18:38:07.366949+0000","last_peered":"2024-09-12T18:38:07.366949+0000","last_clean":"2024-09-12T18:38:07.366949+0000","last_became_active":"2024-09-12T18:35:25.648186+0000","last_became_peered":"2024-09-12T18:35:25.648186+0000","last_unstale":"2024-09-12T18:38:07.366949+0000","last_undegraded":"2024-09-12T18:38:07.366949+0000","last_fullsized":"2024-09-12T18:38:07.366949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:48.802815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367913+0000","last_change":"2024-09-12T18:35:24.648439+0000","last_active":"2024-09-12T18:38:07.367913+0000","last_peered":"2024-09-12T18:38:07.367913+0000","last_clean":"2024-09-12T18:38:07.367913+0000","last_became_active":"2024-09-12T18:35:24.647629+0000","last_became_peered":"2024-09-12T18:35:24.647629+0000","last_unstale":"2024-09-12T18:38:07.367913+0000","last_undegraded":"2024-09-12T18:38:07.367913+0000","last_fullsized":"2024-09-12T18:38:07.367913+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:45.428223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366148+0000","last_change":"2024-09-12T18:35:25.652496+0000","last_active":"2024-09-12T18:38:07.366148+0000","last_peered":"2024-09-12T18:38:07.366148+0000","last_clean":"2024-09-12T18:38:07.366148+0000","last_became_active":"2024-09-12T18:35:25.651628+0000","last_became_peered":"2024-09-12T18:35:25.651628+0000","last_unstale":"2024-09-12T18:38:07.366148+0000","last_undegraded":"2024-09-12T18:38:07.366148+0000","last_fullsized":"2024-09-12T18:38:07.366148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:44.920448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":159,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358446+0000","last_change":"2024-09-12T18:35:24.654976+0000","last_active":"2024-09-12T18:38:06.358446+0000","last_peered":"2024-09-12T18:38:06.358446+0000","last_clean":"2024-09-12T18:38:06.358446+0000","last_became_active":"2024-09-12T18:35:24.654264+0000","last_became_peered":"2024-09-12T18:35:24.654264+0000","last_unstale":"2024-09-12T18:38:06.358446+0000","last_undegraded":"2024-09-12T18:38:06.358446+0000","last_fullsized":"2024-09-12T18:38:06.358446+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:00.115408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358046+0000","last_change":"2024-09-12T18:38:03.365901+0000","last_active":"2024-09-12T18:38:06.358046+0000","last_peered":"2024-09-12T18:38:06.358046+0000","last_clean":"2024-09-12T18:38:06.358046+0000","last_became_active":"2024-09-12T18:38:03.364754+0000","last_became_peered":"2024-09-12T18:38:03.364754+0000","last_unstale":"2024-09-12T18:38:06.358046+0000","last_undegraded":"2024-09-12T18:38:06.358046+0000","last_fullsized":"2024-09-12T18:38:06.358046+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:43.078837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":158,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359087+0000","last_change":"2024-09-12T18:35:24.657665+0000","last_active":"2024-09-12T18:38:06.359087+0000","last_peered":"2024-09-12T18:38:06.359087+0000","last_clean":"2024-09-12T18:38:06.359087+0000","last_became_active":"2024-09-12T18:35:24.657015+0000","last_became_peered":"2024-09-12T18:35:24.657015+0000","last_unstale":"2024-09-12T18:38:06.359087+0000","last_undegraded":"2024-09-12T18:38:06.359087+0000","last_fullsized":"2024-09-12T18:38:06.359087+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:03.171326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368567+0000","last_change":"2024-09-12T18:35:25.665275+0000","last_active":"2024-09-12T18:38:07.368567+0000","last_peered":"2024-09-12T18:38:07.368567+0000","last_clean":"2024-09-12T18:38:07.368567+0000","last_became_active":"2024-09-12T18:35:25.659511+0000","last_became_peered":"2024-09-12T18:35:25.659511+0000","last_unstale":"2024-09-12T18:38:07.368567+0000","last_undegraded":"2024-09-12T18:38:07.368567+0000","last_fullsized":"2024-09-12T18:38:07.368567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368912+0000","last_change":"2024-09-12T18:38:03.384365+0000","last_active":"2024-09-12T18:38:07.368912+0000","last_peered":"2024-09-12T18:38:07.368912+0000","last_clean":"2024-09-12T18:38:07.368912+0000","last_became_active":"2024-09-12T18:38:03.364147+0000","last_became_peered":"2024-09-12T18:38:03.364147+0000","last_unstale":"2024-09-12T18:38:07.368912+0000","last_undegraded":"2024-09-12T18:38:07.368912+0000","last_fullsized":"2024-09-12T18:38:07.368912+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:05.965891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358810+0000","last_change":"2024-09-12T18:38:03.356255+0000","last_active":"2024-09-12T18:38:06.358810+0000","last_peered":"2024-09-12T18:38:06.358810+0000","last_clean":"2024-09-12T18:38:06.358810+0000","last_became_active":"2024-09-12T18:38:03.355310+0000","last_became_peered":"2024-09-12T18:38:03.355310+0000","last_unstale":"2024-09-12T18:38:06.358810+0000","last_undegraded":"2024-09-12T18:38:06.358810+0000","last_fullsized":"2024-09-12T18:38:06.358810+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:21.097039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":158,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358549+0000","last_change":"2024-09-12T18:35:24.659019+0000","last_active":"2024-09-12T18:38:06.358549+0000","last_peered":"2024-09-12T18:38:06.358549+0000","last_clean":"2024-09-12T18:38:06.358549+0000","last_became_active":"2024-09-12T18:35:24.658423+0000","last_became_peered":"2024-09-12T18:35:24.658423+0000","last_unstale":"2024-09-12T18:38:06.358549+0000","last_undegraded":"2024-09-12T18:38:06.358549+0000","last_fullsized":"2024-09-12T18:38:06.358549+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:37.668417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359018+0000","last_change":"2024-09-12T18:35:25.662287+0000","last_active":"2024-09-12T18:38:06.359018+0000","last_peered":"2024-09-12T18:38:06.359018+0000","last_clean":"2024-09-12T18:38:06.359018+0000","last_became_active":"2024-09-12T18:35:25.660372+0000","last_became_peered":"2024-09-12T18:35:25.660372+0000","last_unstale":"2024-09-12T18:38:06.359018+0000","last_undegraded":"2024-09-12T18:38:06.359018+0000","last_fullsized":"2024-09-12T18:38:06.359018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:08.729541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366544+0000","last_change":"2024-09-12T18:35:24.648330+0000","last_active":"2024-09-12T18:38:07.366544+0000","last_peered":"2024-09-12T18:38:07.366544+0000","last_clean":"2024-09-12T18:38:07.366544+0000","last_became_active":"2024-09-12T18:35:24.647520+0000","last_became_peered":"2024-09-12T18:35:24.647520+0000","last_unstale":"2024-09-12T18:38:07.366544+0000","last_undegraded":"2024-09-12T18:38:07.366544+0000","last_fullsized":"2024-09-12T18:38:07.366544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:25.552055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359547+0000","last_change":"2024-09-12T18:35:25.658674+0000","last_active":"2024-09-12T18:38:06.359547+0000","last_peered":"2024-09-12T18:38:06.359547+0000","last_clean":"2024-09-12T18:38:06.359547+0000","last_became_active":"2024-09-12T18:35:25.657386+0000","last_became_peered":"2024-09-12T18:35:25.657386+0000","last_unstale":"2024-09-12T18:38:06.359547+0000","last_undegraded":"2024-09-12T18:38:06.359547+0000","last_fullsized":"2024-09-12T18:38:06.359547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:48.037086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366112+0000","last_change":"2024-09-12T18:35:24.646810+0000","last_active":"2024-09-12T18:38:07.366112+0000","last_peered":"2024-09-12T18:38:07.366112+0000","last_clean":"2024-09-12T18:38:07.366112+0000","last_became_active":"2024-09-12T18:35:24.646008+0000","last_became_peered":"2024-09-12T18:35:24.646008+0000","last_unstale":"2024-09-12T18:38:07.366112+0000","last_undegraded":"2024-09-12T18:38:07.366112+0000","last_fullsized":"2024-09-12T18:38:07.366112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:43.888776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369934+0000","last_change":"2024-09-12T18:35:25.667710+0000","last_active":"2024-09-12T18:38:07.369934+0000","last_peered":"2024-09-12T18:38:07.369934+0000","last_clean":"2024-09-12T18:38:07.369934+0000","last_became_active":"2024-09-12T18:35:25.666940+0000","last_became_peered":"2024-09-12T18:35:25.666940+0000","last_unstale":"2024-09-12T18:38:07.369934+0000","last_undegraded":"2024-09-12T18:38:07.369934+0000","last_fullsized":"2024-09-12T18:38:07.369934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:09.823085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":308,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358400+0000","last_change":"2024-09-12T18:35:13.489018+0000","last_active":"2024-09-12T18:38:06.358400+0000","last_peered":"2024-09-12T18:38:06.358400+0000","last_clean":"2024-09-12T18:38:06.358400+0000","last_became_active":"2024-09-12T18:35:13.488346+0000","last_became_peered":"2024-09-12T18:35:13.488346+0000","last_unstale":"2024-09-12T18:38:06.358400+0000","last_undegraded":"2024-09-12T18:38:06.358400+0000","last_fullsized":"2024-09-12T18:38:06.358400+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_clean_scrub_stamp":"2024-09-12T18:35:12.464628+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:54.864640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":172,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359336+0000","last_change":"2024-09-12T18:35:22.459694+0000","last_active":"2024-09-12T18:38:06.359336+0000","last_peered":"2024-09-12T18:38:06.359336+0000","last_clean":"2024-09-12T18:38:06.359336+0000","last_became_active":"2024-09-12T18:35:20.446796+0000","last_became_peered":"2024-09-12T18:35:20.446796+0000","last_unstale":"2024-09-12T18:38:06.359336+0000","last_undegraded":"2024-09-12T18:38:06.359336+0000","last_fullsized":"2024-09-12T18:38:06.359336+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:21.506024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016291610000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368143+0000","last_change":"2024-09-12T18:38:03.354554+0000","last_active":"2024-09-12T18:38:07.368143+0000","last_peered":"2024-09-12T18:38:07.368143+0000","last_clean":"2024-09-12T18:38:07.368143+0000","last_became_active":"2024-09-12T18:38:03.353661+0000","last_became_peered":"2024-09-12T18:38:03.353661+0000","last_unstale":"2024-09-12T18:38:07.368143+0000","last_undegraded":"2024-09-12T18:38:07.368143+0000","last_fullsized":"2024-09-12T18:38:07.368143+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:27.835210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359041+0000","last_change":"2024-09-12T18:35:25.662424+0000","last_active":"2024-09-12T18:38:06.359041+0000","last_peered":"2024-09-12T18:38:06.359041+0000","last_clean":"2024-09-12T18:38:06.359041+0000","last_became_active":"2024-09-12T18:35:25.661043+0000","last_became_peered":"2024-09-12T18:35:25.661043+0000","last_unstale":"2024-09-12T18:38:06.359041+0000","last_undegraded":"2024-09-12T18:38:06.359041+0000","last_fullsized":"2024-09-12T18:38:06.359041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:52.551802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":171,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358322+0000","last_change":"2024-09-12T18:35:22.459090+0000","last_active":"2024-09-12T18:38:06.358322+0000","last_peered":"2024-09-12T18:38:06.358322+0000","last_clean":"2024-09-12T18:38:06.358322+0000","last_became_active":"2024-09-12T18:35:20.448553+0000","last_became_peered":"2024-09-12T18:35:20.448553+0000","last_unstale":"2024-09-12T18:38:06.358322+0000","last_undegraded":"2024-09-12T18:38:06.358322+0000","last_fullsized":"2024-09-12T18:38:06.358322+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:56.834808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001030836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368423+0000","last_change":"2024-09-12T18:35:24.651597+0000","last_active":"2024-09-12T18:38:07.368423+0000","last_peered":"2024-09-12T18:38:07.368423+0000","last_clean":"2024-09-12T18:38:07.368423+0000","last_became_active":"2024-09-12T18:35:24.649940+0000","last_became_peered":"2024-09-12T18:35:24.649940+0000","last_unstale":"2024-09-12T18:38:07.368423+0000","last_undegraded":"2024-09-12T18:38:07.368423+0000","last_fullsized":"2024-09-12T18:38:07.368423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:36.822432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367752+0000","last_change":"2024-09-12T18:38:03.358588+0000","last_active":"2024-09-12T18:38:07.367752+0000","last_peered":"2024-09-12T18:38:07.367752+0000","last_clean":"2024-09-12T18:38:07.367752+0000","last_became_active":"2024-09-12T18:38:03.357664+0000","last_became_peered":"2024-09-12T18:38:03.357664+0000","last_unstale":"2024-09-12T18:38:07.367752+0000","last_undegraded":"2024-09-12T18:38:07.367752+0000","last_fullsized":"2024-09-12T18:38:07.367752+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:02.273189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368624+0000","last_change":"2024-09-12T18:35:22.464179+0000","last_active":"2024-09-12T18:38:07.368624+0000","last_peered":"2024-09-12T18:38:07.368624+0000","last_clean":"2024-09-12T18:38:07.368624+0000","last_became_active":"2024-09-12T18:35:20.442613+0000","last_became_peered":"2024-09-12T18:35:20.442613+0000","last_unstale":"2024-09-12T18:38:07.368624+0000","last_undegraded":"2024-09-12T18:38:07.368624+0000","last_fullsized":"2024-09-12T18:38:07.368624+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:17.636537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014134620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366112+0000","last_change":"2024-09-12T18:35:24.641297+0000","last_active":"2024-09-12T18:38:07.366112+0000","last_peered":"2024-09-12T18:38:07.366112+0000","last_clean":"2024-09-12T18:38:07.366112+0000","last_became_active":"2024-09-12T18:35:24.637334+0000","last_became_peered":"2024-09-12T18:35:24.637334+0000","last_unstale":"2024-09-12T18:38:07.366112+0000","last_undegraded":"2024-09-12T18:38:07.366112+0000","last_fullsized":"2024-09-12T18:38:07.366112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:50.772074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369805+0000","last_change":"2024-09-12T18:38:03.360352+0000","last_active":"2024-09-12T18:38:07.369805+0000","last_peered":"2024-09-12T18:38:07.369805+0000","last_clean":"2024-09-12T18:38:07.369805+0000","last_became_active":"2024-09-12T18:38:03.359452+0000","last_became_peered":"2024-09-12T18:38:03.359452+0000","last_unstale":"2024-09-12T18:38:07.369805+0000","last_undegraded":"2024-09-12T18:38:07.369805+0000","last_fullsized":"2024-09-12T18:38:07.369805+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:48.036394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":173,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358697+0000","last_change":"2024-09-12T18:35:22.459049+0000","last_active":"2024-09-12T18:38:06.358697+0000","last_peered":"2024-09-12T18:38:06.358697+0000","last_clean":"2024-09-12T18:38:06.358697+0000","last_became_active":"2024-09-12T18:35:20.446814+0000","last_became_peered":"2024-09-12T18:35:20.446814+0000","last_unstale":"2024-09-12T18:38:06.358697+0000","last_undegraded":"2024-09-12T18:38:06.358697+0000","last_fullsized":"2024-09-12T18:38:06.358697+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:18.033595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010716149999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":158,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359121+0000","last_change":"2024-09-12T18:35:24.658273+0000","last_active":"2024-09-12T18:38:06.359121+0000","last_peered":"2024-09-12T18:38:06.359121+0000","last_clean":"2024-09-12T18:38:06.359121+0000","last_became_active":"2024-09-12T18:35:24.657433+0000","last_became_peered":"2024-09-12T18:35:24.657433+0000","last_unstale":"2024-09-12T18:38:06.359121+0000","last_undegraded":"2024-09-12T18:38:06.359121+0000","last_fullsized":"2024-09-12T18:38:06.359121+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:48.497218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369135+0000","last_change":"2024-09-12T18:38:03.358304+0000","last_active":"2024-09-12T18:38:07.369135+0000","last_peered":"2024-09-12T18:38:07.369135+0000","last_clean":"2024-09-12T18:38:07.369135+0000","last_became_active":"2024-09-12T18:38:03.357592+0000","last_became_peered":"2024-09-12T18:38:03.357592+0000","last_unstale":"2024-09-12T18:38:07.369135+0000","last_undegraded":"2024-09-12T18:38:07.369135+0000","last_fullsized":"2024-09-12T18:38:07.369135+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:45.610260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":158,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358064+0000","last_change":"2024-09-12T18:35:24.657618+0000","last_active":"2024-09-12T18:38:06.358064+0000","last_peered":"2024-09-12T18:38:06.358064+0000","last_clean":"2024-09-12T18:38:06.358064+0000","last_became_active":"2024-09-12T18:35:24.656741+0000","last_became_peered":"2024-09-12T18:35:24.656741+0000","last_unstale":"2024-09-12T18:38:06.358064+0000","last_undegraded":"2024-09-12T18:38:06.358064+0000","last_fullsized":"2024-09-12T18:38:06.358064+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:43.113104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369480+0000","last_change":"2024-09-12T18:35:22.464180+0000","last_active":"2024-09-12T18:38:07.369480+0000","last_peered":"2024-09-12T18:38:07.369480+0000","last_clean":"2024-09-12T18:38:07.369480+0000","last_became_active":"2024-09-12T18:35:20.442566+0000","last_became_peered":"2024-09-12T18:35:20.442566+0000","last_unstale":"2024-09-12T18:38:07.369480+0000","last_undegraded":"2024-09-12T18:38:07.369480+0000","last_fullsized":"2024-09-12T18:38:07.369480+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:29.021710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001325786,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366700+0000","last_change":"2024-09-12T18:35:25.650458+0000","last_active":"2024-09-12T18:38:07.366700+0000","last_peered":"2024-09-12T18:38:07.366700+0000","last_clean":"2024-09-12T18:38:07.366700+0000","last_became_active":"2024-09-12T18:35:25.648761+0000","last_became_peered":"2024-09-12T18:35:25.648761+0000","last_unstale":"2024-09-12T18:38:07.366700+0000","last_undegraded":"2024-09-12T18:38:07.366700+0000","last_fullsized":"2024-09-12T18:38:07.366700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:53.026950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369129+0000","last_change":"2024-09-12T18:38:03.357887+0000","last_active":"2024-09-12T18:38:07.369129+0000","last_peered":"2024-09-12T18:38:07.369129+0000","last_clean":"2024-09-12T18:38:07.369129+0000","last_became_active":"2024-09-12T18:38:03.356816+0000","last_became_peered":"2024-09-12T18:38:03.356816+0000","last_unstale":"2024-09-12T18:38:07.369129+0000","last_undegraded":"2024-09-12T18:38:07.369129+0000","last_fullsized":"2024-09-12T18:38:07.369129+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:09.458196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":185,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366644+0000","last_change":"2024-09-12T18:38:03.351352+0000","last_active":"2024-09-12T18:38:07.366644+0000","last_peered":"2024-09-12T18:38:07.366644+0000","last_clean":"2024-09-12T18:38:07.366644+0000","last_became_active":"2024-09-12T18:38:03.350774+0000","last_became_peered":"2024-09-12T18:38:03.350774+0000","last_unstale":"2024-09-12T18:38:07.366644+0000","last_undegraded":"2024-09-12T18:38:07.366644+0000","last_fullsized":"2024-09-12T18:38:07.366644+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:30.555373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080163599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366902+0000","last_change":"2024-09-12T18:35:25.650717+0000","last_active":"2024-09-12T18:38:07.366902+0000","last_peered":"2024-09-12T18:38:07.366902+0000","last_clean":"2024-09-12T18:38:07.366902+0000","last_became_active":"2024-09-12T18:35:25.649147+0000","last_became_peered":"2024-09-12T18:35:25.649147+0000","last_unstale":"2024-09-12T18:38:07.366902+0000","last_undegraded":"2024-09-12T18:38:07.366902+0000","last_fullsized":"2024-09-12T18:38:07.366902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:07.365888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.370288+0000","last_change":"2024-09-12T18:35:24.657234+0000","last_active":"2024-09-12T18:38:07.370288+0000","last_peered":"2024-09-12T18:38:07.370288+0000","last_clean":"2024-09-12T18:38:07.370288+0000","last_became_active":"2024-09-12T18:35:24.655950+0000","last_became_peered":"2024-09-12T18:35:24.655950+0000","last_unstale":"2024-09-12T18:38:07.370288+0000","last_undegraded":"2024-09-12T18:38:07.370288+0000","last_fullsized":"2024-09-12T18:38:07.370288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:17.466623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359037+0000","last_change":"2024-09-12T18:37:34.258443+0000","last_active":"2024-09-12T18:38:06.359037+0000","last_peered":"2024-09-12T18:38:06.359037+0000","last_clean":"2024-09-12T18:38:06.359037+0000","last_became_active":"2024-09-12T18:37:34.254999+0000","last_became_peered":"2024-09-12T18:37:34.254999+0000","last_unstale":"2024-09-12T18:38:06.359037+0000","last_undegraded":"2024-09-12T18:38:06.359037+0000","last_fullsized":"2024-09-12T18:38:06.359037+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:23.164676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367719+0000","last_change":"2024-09-12T18:38:03.358177+0000","last_active":"2024-09-12T18:38:07.367719+0000","last_peered":"2024-09-12T18:38:07.367719+0000","last_clean":"2024-09-12T18:38:07.367719+0000","last_became_active":"2024-09-12T18:38:03.354895+0000","last_became_peered":"2024-09-12T18:38:03.354895+0000","last_unstale":"2024-09-12T18:38:07.367719+0000","last_undegraded":"2024-09-12T18:38:07.367719+0000","last_fullsized":"2024-09-12T18:38:07.367719+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:16.208815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369642+0000","last_change":"2024-09-12T18:38:03.370898+0000","last_active":"2024-09-12T18:38:07.369642+0000","last_peered":"2024-09-12T18:38:07.369642+0000","last_clean":"2024-09-12T18:38:07.369642+0000","last_became_active":"2024-09-12T18:38:03.354684+0000","last_became_peered":"2024-09-12T18:38:03.354684+0000","last_unstale":"2024-09-12T18:38:07.369642+0000","last_undegraded":"2024-09-12T18:38:07.369642+0000","last_fullsized":"2024-09-12T18:38:07.369642+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:27.684565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":171,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359956+0000","last_change":"2024-09-12T18:35:22.459767+0000","last_active":"2024-09-12T18:38:06.359956+0000","last_peered":"2024-09-12T18:38:06.359956+0000","last_clean":"2024-09-12T18:38:06.359956+0000","last_became_active":"2024-09-12T18:35:20.448521+0000","last_became_peered":"2024-09-12T18:35:20.448521+0000","last_unstale":"2024-09-12T18:38:06.359956+0000","last_undegraded":"2024-09-12T18:38:06.359956+0000","last_fullsized":"2024-09-12T18:38:06.359956+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:33.463792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017009670000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366127+0000","last_change":"2024-09-12T18:35:25.648150+0000","last_active":"2024-09-12T18:38:07.366127+0000","last_peered":"2024-09-12T18:38:07.366127+0000","last_clean":"2024-09-12T18:38:07.366127+0000","last_became_active":"2024-09-12T18:35:25.647347+0000","last_became_peered":"2024-09-12T18:35:25.647347+0000","last_unstale":"2024-09-12T18:38:07.366127+0000","last_undegraded":"2024-09-12T18:38:07.366127+0000","last_fullsized":"2024-09-12T18:38:07.366127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:48.968336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358735+0000","last_change":"2024-09-12T18:35:25.660696+0000","last_active":"2024-09-12T18:38:06.358735+0000","last_peered":"2024-09-12T18:38:06.358735+0000","last_clean":"2024-09-12T18:38:06.358735+0000","last_became_active":"2024-09-12T18:35:25.659827+0000","last_became_peered":"2024-09-12T18:35:25.659827+0000","last_unstale":"2024-09-12T18:38:06.358735+0000","last_undegraded":"2024-09-12T18:38:06.358735+0000","last_fullsized":"2024-09-12T18:38:06.358735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:15.678289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":164,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359083+0000","last_change":"2024-09-12T18:35:24.655051+0000","last_active":"2024-09-12T18:38:06.359083+0000","last_peered":"2024-09-12T18:38:06.359083+0000","last_clean":"2024-09-12T18:38:06.359083+0000","last_became_active":"2024-09-12T18:35:24.654282+0000","last_became_peered":"2024-09-12T18:35:24.654282+0000","last_unstale":"2024-09-12T18:38:06.359083+0000","last_undegraded":"2024-09-12T18:38:06.359083+0000","last_fullsized":"2024-09-12T18:38:06.359083+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:08.159799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368447+0000","last_change":"2024-09-12T18:38:03.355018+0000","last_active":"2024-09-12T18:38:07.368447+0000","last_peered":"2024-09-12T18:38:07.368447+0000","last_clean":"2024-09-12T18:38:07.368447+0000","last_became_active":"2024-09-12T18:38:03.354064+0000","last_became_peered":"2024-09-12T18:38:03.354064+0000","last_unstale":"2024-09-12T18:38:07.368447+0000","last_undegraded":"2024-09-12T18:38:07.368447+0000","last_fullsized":"2024-09-12T18:38:07.368447+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:18.297083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":163,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367123+0000","last_change":"2024-09-12T18:35:24.648658+0000","last_active":"2024-09-12T18:38:07.367123+0000","last_peered":"2024-09-12T18:38:07.367123+0000","last_clean":"2024-09-12T18:38:07.367123+0000","last_became_active":"2024-09-12T18:35:24.647826+0000","last_became_peered":"2024-09-12T18:35:24.647826+0000","last_unstale":"2024-09-12T18:38:07.367123+0000","last_undegraded":"2024-09-12T18:38:07.367123+0000","last_fullsized":"2024-09-12T18:38:07.367123+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:24.167549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359951+0000","last_change":"2024-09-12T18:38:03.366378+0000","last_active":"2024-09-12T18:38:06.359951+0000","last_peered":"2024-09-12T18:38:06.359951+0000","last_clean":"2024-09-12T18:38:06.359951+0000","last_became_active":"2024-09-12T18:38:03.364887+0000","last_became_peered":"2024-09-12T18:38:03.364887+0000","last_unstale":"2024-09-12T18:38:06.359951+0000","last_undegraded":"2024-09-12T18:38:06.359951+0000","last_fullsized":"2024-09-12T18:38:06.359951+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:54.490659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368005+0000","last_change":"2024-09-12T18:35:25.661801+0000","last_active":"2024-09-12T18:38:07.368005+0000","last_peered":"2024-09-12T18:38:07.368005+0000","last_clean":"2024-09-12T18:38:07.368005+0000","last_became_active":"2024-09-12T18:35:25.658476+0000","last_became_peered":"2024-09-12T18:35:25.658476+0000","last_unstale":"2024-09-12T18:38:07.368005+0000","last_undegraded":"2024-09-12T18:38:07.368005+0000","last_fullsized":"2024-09-12T18:38:07.368005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:58.246449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.370140+0000","last_change":"2024-09-12T18:35:24.652399+0000","last_active":"2024-09-12T18:38:07.370140+0000","last_peered":"2024-09-12T18:38:07.370140+0000","last_clean":"2024-09-12T18:38:07.370140+0000","last_became_active":"2024-09-12T18:35:24.651416+0000","last_became_peered":"2024-09-12T18:35:24.651416+0000","last_unstale":"2024-09-12T18:38:07.370140+0000","last_undegraded":"2024-09-12T18:38:07.370140+0000","last_fullsized":"2024-09-12T18:38:07.370140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:32.594978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367773+0000","last_change":"2024-09-12T18:38:03.359924+0000","last_active":"2024-09-12T18:38:07.367773+0000","last_peered":"2024-09-12T18:38:07.367773+0000","last_clean":"2024-09-12T18:38:07.367773+0000","last_became_active":"2024-09-12T18:38:03.357598+0000","last_became_peered":"2024-09-12T18:38:03.357598+0000","last_unstale":"2024-09-12T18:38:07.367773+0000","last_undegraded":"2024-09-12T18:38:07.367773+0000","last_fullsized":"2024-09-12T18:38:07.367773+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:59.501652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368603+0000","last_change":"2024-09-12T18:35:25.651217+0000","last_active":"2024-09-12T18:38:07.368603+0000","last_peered":"2024-09-12T18:38:07.368603+0000","last_clean":"2024-09-12T18:38:07.368603+0000","last_became_active":"2024-09-12T18:35:25.649544+0000","last_became_peered":"2024-09-12T18:35:25.649544+0000","last_unstale":"2024-09-12T18:38:07.368603+0000","last_undegraded":"2024-09-12T18:38:07.368603+0000","last_fullsized":"2024-09-12T18:38:07.368603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:41.601376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367616+0000","last_change":"2024-09-12T18:38:03.349281+0000","last_active":"2024-09-12T18:38:07.367616+0000","last_peered":"2024-09-12T18:38:07.367616+0000","last_clean":"2024-09-12T18:38:07.367616+0000","last_became_active":"2024-09-12T18:38:03.347483+0000","last_became_peered":"2024-09-12T18:38:03.347483+0000","last_unstale":"2024-09-12T18:38:07.367616+0000","last_undegraded":"2024-09-12T18:38:07.367616+0000","last_fullsized":"2024-09-12T18:38:07.367616+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:02.283482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369856+0000","last_change":"2024-09-12T18:35:25.661544+0000","last_active":"2024-09-12T18:38:07.369856+0000","last_peered":"2024-09-12T18:38:07.369856+0000","last_clean":"2024-09-12T18:38:07.369856+0000","last_became_active":"2024-09-12T18:35:25.656985+0000","last_became_peered":"2024-09-12T18:35:25.656985+0000","last_unstale":"2024-09-12T18:38:07.369856+0000","last_undegraded":"2024-09-12T18:38:07.369856+0000","last_fullsized":"2024-09-12T18:38:07.369856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368189+0000","last_change":"2024-09-12T18:38:03.352648+0000","last_active":"2024-09-12T18:38:07.368189+0000","last_peered":"2024-09-12T18:38:07.368189+0000","last_clean":"2024-09-12T18:38:07.368189+0000","last_became_active":"2024-09-12T18:38:03.351740+0000","last_became_peered":"2024-09-12T18:38:03.351740+0000","last_unstale":"2024-09-12T18:38:07.368189+0000","last_undegraded":"2024-09-12T18:38:07.368189+0000","last_fullsized":"2024-09-12T18:38:07.368189+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:13.765236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368265+0000","last_change":"2024-09-12T18:35:25.656712+0000","last_active":"2024-09-12T18:38:07.368265+0000","last_peered":"2024-09-12T18:38:07.368265+0000","last_clean":"2024-09-12T18:38:07.368265+0000","last_became_active":"2024-09-12T18:35:25.654473+0000","last_became_peered":"2024-09-12T18:35:25.654473+0000","last_unstale":"2024-09-12T18:38:07.368265+0000","last_undegraded":"2024-09-12T18:38:07.368265+0000","last_fullsized":"2024-09-12T18:38:07.368265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:01.464680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":161,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367676+0000","last_change":"2024-09-12T18:35:24.659935+0000","last_active":"2024-09-12T18:38:07.367676+0000","last_peered":"2024-09-12T18:38:07.367676+0000","last_clean":"2024-09-12T18:38:07.367676+0000","last_became_active":"2024-09-12T18:35:24.659111+0000","last_became_peered":"2024-09-12T18:35:24.659111+0000","last_unstale":"2024-09-12T18:38:07.367676+0000","last_undegraded":"2024-09-12T18:38:07.367676+0000","last_fullsized":"2024-09-12T18:38:07.367676+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:11.480154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367022+0000","last_change":"2024-09-12T18:38:03.351609+0000","last_active":"2024-09-12T18:38:07.367022+0000","last_peered":"2024-09-12T18:38:07.367022+0000","last_clean":"2024-09-12T18:38:07.367022+0000","last_became_active":"2024-09-12T18:38:03.350972+0000","last_became_peered":"2024-09-12T18:38:03.350972+0000","last_unstale":"2024-09-12T18:38:07.367022+0000","last_undegraded":"2024-09-12T18:38:07.367022+0000","last_fullsized":"2024-09-12T18:38:07.367022+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:15.351880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":161,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367876+0000","last_change":"2024-09-12T18:35:24.638538+0000","last_active":"2024-09-12T18:38:07.367876+0000","last_peered":"2024-09-12T18:38:07.367876+0000","last_clean":"2024-09-12T18:38:07.367876+0000","last_became_active":"2024-09-12T18:35:24.637242+0000","last_became_peered":"2024-09-12T18:35:24.637242+0000","last_unstale":"2024-09-12T18:38:07.367876+0000","last_undegraded":"2024-09-12T18:38:07.367876+0000","last_fullsized":"2024-09-12T18:38:07.367876+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:26.877441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358498+0000","last_change":"2024-09-12T18:35:25.662537+0000","last_active":"2024-09-12T18:38:06.358498+0000","last_peered":"2024-09-12T18:38:06.358498+0000","last_clean":"2024-09-12T18:38:06.358498+0000","last_became_active":"2024-09-12T18:35:25.661441+0000","last_became_peered":"2024-09-12T18:35:25.661441+0000","last_unstale":"2024-09-12T18:38:06.358498+0000","last_undegraded":"2024-09-12T18:38:06.358498+0000","last_fullsized":"2024-09-12T18:38:06.358498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:14.397867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":180,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358818+0000","last_change":"2024-09-12T18:38:03.369857+0000","last_active":"2024-09-12T18:38:06.358818+0000","last_peered":"2024-09-12T18:38:06.358818+0000","last_clean":"2024-09-12T18:38:06.358818+0000","last_became_active":"2024-09-12T18:38:03.355520+0000","last_became_peered":"2024-09-12T18:38:03.355520+0000","last_unstale":"2024-09-12T18:38:06.358818+0000","last_undegraded":"2024-09-12T18:38:06.358818+0000","last_fullsized":"2024-09-12T18:38:06.358818+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:28.637798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358482+0000","last_change":"2024-09-12T18:35:25.651406+0000","last_active":"2024-09-12T18:38:06.358482+0000","last_peered":"2024-09-12T18:38:06.358482+0000","last_clean":"2024-09-12T18:38:06.358482+0000","last_became_active":"2024-09-12T18:35:25.649728+0000","last_became_peered":"2024-09-12T18:35:25.649728+0000","last_unstale":"2024-09-12T18:38:06.358482+0000","last_undegraded":"2024-09-12T18:38:06.358482+0000","last_fullsized":"2024-09-12T18:38:06.358482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:41.773283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368047+0000","last_change":"2024-09-12T18:35:24.649153+0000","last_active":"2024-09-12T18:38:07.368047+0000","last_peered":"2024-09-12T18:38:07.368047+0000","last_clean":"2024-09-12T18:38:07.368047+0000","last_became_active":"2024-09-12T18:35:24.648512+0000","last_became_peered":"2024-09-12T18:35:24.648512+0000","last_unstale":"2024-09-12T18:38:07.368047+0000","last_undegraded":"2024-09-12T18:38:07.368047+0000","last_fullsized":"2024-09-12T18:38:07.368047+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:07.810456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366854+0000","last_change":"2024-09-12T18:35:25.656799+0000","last_active":"2024-09-12T18:38:07.366854+0000","last_peered":"2024-09-12T18:38:07.366854+0000","last_clean":"2024-09-12T18:38:07.366854+0000","last_became_active":"2024-09-12T18:35:25.654980+0000","last_became_peered":"2024-09-12T18:35:25.654980+0000","last_unstale":"2024-09-12T18:38:07.366854+0000","last_undegraded":"2024-09-12T18:38:07.366854+0000","last_fullsized":"2024-09-12T18:38:07.366854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:10.735439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":161,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.370189+0000","last_change":"2024-09-12T18:35:24.656268+0000","last_active":"2024-09-12T18:38:07.370189+0000","last_peered":"2024-09-12T18:38:07.370189+0000","last_clean":"2024-09-12T18:38:07.370189+0000","last_became_active":"2024-09-12T18:35:24.655420+0000","last_became_peered":"2024-09-12T18:35:24.655420+0000","last_unstale":"2024-09-12T18:38:07.370189+0000","last_undegraded":"2024-09-12T18:38:07.370189+0000","last_fullsized":"2024-09-12T18:38:07.370189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:04.654666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358119+0000","last_change":"2024-09-12T18:38:03.357094+0000","last_active":"2024-09-12T18:38:06.358119+0000","last_peered":"2024-09-12T18:38:06.358119+0000","last_clean":"2024-09-12T18:38:06.358119+0000","last_became_active":"2024-09-12T18:38:03.355072+0000","last_became_peered":"2024-09-12T18:38:03.355072+0000","last_unstale":"2024-09-12T18:38:06.358119+0000","last_undegraded":"2024-09-12T18:38:06.358119+0000","last_fullsized":"2024-09-12T18:38:06.358119+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:46.451497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369635+0000","last_change":"2024-09-12T18:38:03.379032+0000","last_active":"2024-09-12T18:38:07.369635+0000","last_peered":"2024-09-12T18:38:07.369635+0000","last_clean":"2024-09-12T18:38:07.369635+0000","last_became_active":"2024-09-12T18:38:03.353780+0000","last_became_peered":"2024-09-12T18:38:03.353780+0000","last_unstale":"2024-09-12T18:38:07.369635+0000","last_undegraded":"2024-09-12T18:38:07.369635+0000","last_fullsized":"2024-09-12T18:38:07.369635+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:26.800343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705703,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297412,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":296318,"kb_avail":94074428,"statfs":{"total":96636764160,"available":96332214272,"internally_reserved":0,"allocated":1097728,"data_stored":982590,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":303430086},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738407,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280776,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94091064,"statfs":{"total":96636764160,"available":96349249536,"internally_reserved":0,"allocated":1101824,"data_stored":978964,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":286390725},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738407,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302908,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":301886,"kb_avail":94068932,"statfs":{"total":96636764160,"available":96326586368,"internally_reserved":0,"allocated":1019904,"data_stored":391063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":309131718},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:38:11.258 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:38:11.588 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:38:11.590 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T18:38:11.606 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2024-09-12T18:38:10.425555+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":192,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":881096,"kb_used_data":3144,"kb_used_omap":4,"kb_used_meta":877883,"kb_avail":282234424,"statfs":{"total":289910292480,"available":289008050176,"internally_reserved":0,"allocated":3219456,"data_stored":2352617,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4783,"internal_metadata":898952529},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001362"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368487+0000","last_change":"2024-09-12T18:38:03.358323+0000","last_active":"2024-09-12T18:38:07.368487+0000","last_peered":"2024-09-12T18:38:07.368487+0000","last_clean":"2024-09-12T18:38:07.368487+0000","last_became_active":"2024-09-12T18:38:03.357317+0000","last_became_peered":"2024-09-12T18:38:03.357317+0000","last_unstale":"2024-09-12T18:38:07.368487+0000","last_undegraded":"2024-09-12T18:38:07.368487+0000","last_fullsized":"2024-09-12T18:38:07.368487+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:55.315464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367135+0000","last_change":"2024-09-12T18:35:25.659760+0000","last_active":"2024-09-12T18:38:07.367135+0000","last_peered":"2024-09-12T18:38:07.367135+0000","last_clean":"2024-09-12T18:38:07.367135+0000","last_became_active":"2024-09-12T18:35:25.654920+0000","last_became_peered":"2024-09-12T18:35:25.654920+0000","last_unstale":"2024-09-12T18:38:07.367135+0000","last_undegraded":"2024-09-12T18:38:07.367135+0000","last_fullsized":"2024-09-12T18:38:07.367135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:21.519881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359587+0000","last_change":"2024-09-12T18:35:25.659460+0000","last_active":"2024-09-12T18:38:06.359587+0000","last_peered":"2024-09-12T18:38:06.359587+0000","last_clean":"2024-09-12T18:38:06.359587+0000","last_became_active":"2024-09-12T18:35:25.657782+0000","last_became_peered":"2024-09-12T18:35:25.657782+0000","last_unstale":"2024-09-12T18:38:06.359587+0000","last_undegraded":"2024-09-12T18:38:06.359587+0000","last_fullsized":"2024-09-12T18:38:06.359587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:38.544284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358249+0000","last_change":"2024-09-12T18:35:25.663617+0000","last_active":"2024-09-12T18:38:06.358249+0000","last_peered":"2024-09-12T18:38:06.358249+0000","last_clean":"2024-09-12T18:38:06.358249+0000","last_became_active":"2024-09-12T18:35:25.661977+0000","last_became_peered":"2024-09-12T18:35:25.661977+0000","last_unstale":"2024-09-12T18:38:06.358249+0000","last_undegraded":"2024-09-12T18:38:06.358249+0000","last_fullsized":"2024-09-12T18:38:06.358249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:14.748234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367138+0000","last_change":"2024-09-12T18:35:25.656566+0000","last_active":"2024-09-12T18:38:07.367138+0000","last_peered":"2024-09-12T18:38:07.367138+0000","last_clean":"2024-09-12T18:38:07.367138+0000","last_became_active":"2024-09-12T18:35:25.654898+0000","last_became_peered":"2024-09-12T18:35:25.654898+0000","last_unstale":"2024-09-12T18:38:07.367138+0000","last_undegraded":"2024-09-12T18:38:07.367138+0000","last_fullsized":"2024-09-12T18:38:07.367138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:36.113250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.357732+0000","last_change":"2024-09-12T18:38:03.366489+0000","last_active":"2024-09-12T18:38:06.357732+0000","last_peered":"2024-09-12T18:38:06.357732+0000","last_clean":"2024-09-12T18:38:06.357732+0000","last_became_active":"2024-09-12T18:38:03.364745+0000","last_became_peered":"2024-09-12T18:38:03.364745+0000","last_unstale":"2024-09-12T18:38:06.357732+0000","last_undegraded":"2024-09-12T18:38:06.357732+0000","last_fullsized":"2024-09-12T18:38:06.357732+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:42.397517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.357624+0000","last_change":"2024-09-12T18:35:25.659811+0000","last_active":"2024-09-12T18:38:06.357624+0000","last_peered":"2024-09-12T18:38:06.357624+0000","last_clean":"2024-09-12T18:38:06.357624+0000","last_became_active":"2024-09-12T18:35:25.658998+0000","last_became_peered":"2024-09-12T18:35:25.658998+0000","last_unstale":"2024-09-12T18:38:06.357624+0000","last_undegraded":"2024-09-12T18:38:06.357624+0000","last_fullsized":"2024-09-12T18:38:06.357624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.357347+0000","last_change":"2024-09-12T18:38:03.365773+0000","last_active":"2024-09-12T18:38:06.357347+0000","last_peered":"2024-09-12T18:38:06.357347+0000","last_clean":"2024-09-12T18:38:06.357347+0000","last_became_active":"2024-09-12T18:38:03.364845+0000","last_became_peered":"2024-09-12T18:38:03.364845+0000","last_unstale":"2024-09-12T18:38:06.357347+0000","last_undegraded":"2024-09-12T18:38:06.357347+0000","last_fullsized":"2024-09-12T18:38:06.357347+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:19.384528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369867+0000","last_change":"2024-09-12T18:35:25.668339+0000","last_active":"2024-09-12T18:38:07.369867+0000","last_peered":"2024-09-12T18:38:07.369867+0000","last_clean":"2024-09-12T18:38:07.369867+0000","last_became_active":"2024-09-12T18:35:25.667608+0000","last_became_peered":"2024-09-12T18:35:25.667608+0000","last_unstale":"2024-09-12T18:38:07.369867+0000","last_undegraded":"2024-09-12T18:38:07.369867+0000","last_fullsized":"2024-09-12T18:38:07.369867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:15.699745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367232+0000","last_change":"2024-09-12T18:38:03.358177+0000","last_active":"2024-09-12T18:38:07.367232+0000","last_peered":"2024-09-12T18:38:07.367232+0000","last_clean":"2024-09-12T18:38:07.367232+0000","last_became_active":"2024-09-12T18:38:03.357446+0000","last_became_peered":"2024-09-12T18:38:03.357446+0000","last_unstale":"2024-09-12T18:38:07.367232+0000","last_undegraded":"2024-09-12T18:38:07.367232+0000","last_fullsized":"2024-09-12T18:38:07.367232+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:13.110496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359515+0000","last_change":"2024-09-12T18:38:03.356440+0000","last_active":"2024-09-12T18:38:06.359515+0000","last_peered":"2024-09-12T18:38:06.359515+0000","last_clean":"2024-09-12T18:38:06.359515+0000","last_became_active":"2024-09-12T18:38:03.355561+0000","last_became_peered":"2024-09-12T18:38:03.355561+0000","last_unstale":"2024-09-12T18:38:06.359515+0000","last_undegraded":"2024-09-12T18:38:06.359515+0000","last_fullsized":"2024-09-12T18:38:06.359515+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:43.438258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366852+0000","last_change":"2024-09-12T18:35:25.649885+0000","last_active":"2024-09-12T18:38:07.366852+0000","last_peered":"2024-09-12T18:38:07.366852+0000","last_clean":"2024-09-12T18:38:07.366852+0000","last_became_active":"2024-09-12T18:35:25.649111+0000","last_became_peered":"2024-09-12T18:35:25.649111+0000","last_unstale":"2024-09-12T18:38:07.366852+0000","last_undegraded":"2024-09-12T18:38:07.366852+0000","last_fullsized":"2024-09-12T18:38:07.366852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:17.162410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366640+0000","last_change":"2024-09-12T18:38:03.349917+0000","last_active":"2024-09-12T18:38:07.366640+0000","last_peered":"2024-09-12T18:38:07.366640+0000","last_clean":"2024-09-12T18:38:07.366640+0000","last_became_active":"2024-09-12T18:38:03.349130+0000","last_became_peered":"2024-09-12T18:38:03.349130+0000","last_unstale":"2024-09-12T18:38:07.366640+0000","last_undegraded":"2024-09-12T18:38:07.366640+0000","last_fullsized":"2024-09-12T18:38:07.366640+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:45.548888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.357883+0000","last_change":"2024-09-12T18:35:25.657913+0000","last_active":"2024-09-12T18:38:06.357883+0000","last_peered":"2024-09-12T18:38:06.357883+0000","last_clean":"2024-09-12T18:38:06.357883+0000","last_became_active":"2024-09-12T18:35:25.657082+0000","last_became_peered":"2024-09-12T18:35:25.657082+0000","last_unstale":"2024-09-12T18:38:06.357883+0000","last_undegraded":"2024-09-12T18:38:06.357883+0000","last_fullsized":"2024-09-12T18:38:06.357883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:21.538633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.357675+0000","last_change":"2024-09-12T18:35:25.658763+0000","last_active":"2024-09-12T18:38:06.357675+0000","last_peered":"2024-09-12T18:38:06.357675+0000","last_clean":"2024-09-12T18:38:06.357675+0000","last_became_active":"2024-09-12T18:35:25.657508+0000","last_became_peered":"2024-09-12T18:35:25.657508+0000","last_unstale":"2024-09-12T18:38:06.357675+0000","last_undegraded":"2024-09-12T18:38:06.357675+0000","last_fullsized":"2024-09-12T18:38:06.357675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:13.170519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.357358+0000","last_change":"2024-09-12T18:35:25.653730+0000","last_active":"2024-09-12T18:38:06.357358+0000","last_peered":"2024-09-12T18:38:06.357358+0000","last_clean":"2024-09-12T18:38:06.357358+0000","last_became_active":"2024-09-12T18:35:25.651535+0000","last_became_peered":"2024-09-12T18:35:25.651535+0000","last_unstale":"2024-09-12T18:38:06.357358+0000","last_undegraded":"2024-09-12T18:38:06.357358+0000","last_fullsized":"2024-09-12T18:38:06.357358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.370149+0000","last_change":"2024-09-12T18:35:25.656513+0000","last_active":"2024-09-12T18:38:07.370149+0000","last_peered":"2024-09-12T18:38:07.370149+0000","last_clean":"2024-09-12T18:38:07.370149+0000","last_became_active":"2024-09-12T18:35:25.653440+0000","last_became_peered":"2024-09-12T18:35:25.653440+0000","last_unstale":"2024-09-12T18:38:07.370149+0000","last_undegraded":"2024-09-12T18:38:07.370149+0000","last_fullsized":"2024-09-12T18:38:07.370149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:18.693161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367487+0000","last_change":"2024-09-12T18:35:25.657991+0000","last_active":"2024-09-12T18:38:07.367487+0000","last_peered":"2024-09-12T18:38:07.367487+0000","last_clean":"2024-09-12T18:38:07.367487+0000","last_became_active":"2024-09-12T18:35:25.653934+0000","last_became_peered":"2024-09-12T18:35:25.653934+0000","last_unstale":"2024-09-12T18:38:07.367487+0000","last_undegraded":"2024-09-12T18:38:07.367487+0000","last_fullsized":"2024-09-12T18:38:07.367487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:05.418901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368965+0000","last_change":"2024-09-12T18:38:03.358270+0000","last_active":"2024-09-12T18:38:07.368965+0000","last_peered":"2024-09-12T18:38:07.368965+0000","last_clean":"2024-09-12T18:38:07.368965+0000","last_became_active":"2024-09-12T18:38:03.357363+0000","last_became_peered":"2024-09-12T18:38:03.357363+0000","last_unstale":"2024-09-12T18:38:07.368965+0000","last_undegraded":"2024-09-12T18:38:07.368965+0000","last_fullsized":"2024-09-12T18:38:07.368965+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:56.658700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358511+0000","last_change":"2024-09-12T18:35:25.661176+0000","last_active":"2024-09-12T18:38:06.358511+0000","last_peered":"2024-09-12T18:38:06.358511+0000","last_clean":"2024-09-12T18:38:06.358511+0000","last_became_active":"2024-09-12T18:35:25.659534+0000","last_became_peered":"2024-09-12T18:35:25.659534+0000","last_unstale":"2024-09-12T18:38:06.358511+0000","last_undegraded":"2024-09-12T18:38:06.358511+0000","last_fullsized":"2024-09-12T18:38:06.358511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:40.145442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358406+0000","last_change":"2024-09-12T18:35:25.650632+0000","last_active":"2024-09-12T18:38:06.358406+0000","last_peered":"2024-09-12T18:38:06.358406+0000","last_clean":"2024-09-12T18:38:06.358406+0000","last_became_active":"2024-09-12T18:35:25.649333+0000","last_became_peered":"2024-09-12T18:35:25.649333+0000","last_unstale":"2024-09-12T18:38:06.358406+0000","last_undegraded":"2024-09-12T18:38:06.358406+0000","last_fullsized":"2024-09-12T18:38:06.358406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:30.537572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366475+0000","last_change":"2024-09-12T18:35:25.648245+0000","last_active":"2024-09-12T18:38:07.366475+0000","last_peered":"2024-09-12T18:38:07.366475+0000","last_clean":"2024-09-12T18:38:07.366475+0000","last_became_active":"2024-09-12T18:35:25.646357+0000","last_became_peered":"2024-09-12T18:35:25.646357+0000","last_unstale":"2024-09-12T18:38:07.366475+0000","last_undegraded":"2024-09-12T18:38:07.366475+0000","last_fullsized":"2024-09-12T18:38:07.366475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:05.662140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367728+0000","last_change":"2024-09-12T18:35:25.661613+0000","last_active":"2024-09-12T18:38:07.367728+0000","last_peered":"2024-09-12T18:38:07.367728+0000","last_clean":"2024-09-12T18:38:07.367728+0000","last_became_active":"2024-09-12T18:35:25.658833+0000","last_became_peered":"2024-09-12T18:35:25.658833+0000","last_unstale":"2024-09-12T18:38:07.367728+0000","last_undegraded":"2024-09-12T18:38:07.367728+0000","last_fullsized":"2024-09-12T18:38:07.367728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:51.064080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366639+0000","last_change":"2024-09-12T18:35:25.657782+0000","last_active":"2024-09-12T18:38:07.366639+0000","last_peered":"2024-09-12T18:38:07.366639+0000","last_clean":"2024-09-12T18:38:07.366639+0000","last_became_active":"2024-09-12T18:35:25.655295+0000","last_became_peered":"2024-09-12T18:35:25.655295+0000","last_unstale":"2024-09-12T18:38:07.366639+0000","last_undegraded":"2024-09-12T18:38:07.366639+0000","last_fullsized":"2024-09-12T18:38:07.366639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:37.744175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368546+0000","last_change":"2024-09-12T18:35:25.654863+0000","last_active":"2024-09-12T18:38:07.368546+0000","last_peered":"2024-09-12T18:38:07.368546+0000","last_clean":"2024-09-12T18:38:07.368546+0000","last_became_active":"2024-09-12T18:35:25.650407+0000","last_became_peered":"2024-09-12T18:35:25.650407+0000","last_unstale":"2024-09-12T18:38:07.368546+0000","last_undegraded":"2024-09-12T18:38:07.368546+0000","last_fullsized":"2024-09-12T18:38:07.368546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:38.395666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369981+0000","last_change":"2024-09-12T18:35:25.662414+0000","last_active":"2024-09-12T18:38:07.369981+0000","last_peered":"2024-09-12T18:38:07.369981+0000","last_clean":"2024-09-12T18:38:07.369981+0000","last_became_active":"2024-09-12T18:35:25.660126+0000","last_became_peered":"2024-09-12T18:35:25.660126+0000","last_unstale":"2024-09-12T18:38:07.369981+0000","last_undegraded":"2024-09-12T18:38:07.369981+0000","last_fullsized":"2024-09-12T18:38:07.369981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:48.437139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359333+0000","last_change":"2024-09-12T18:35:25.661523+0000","last_active":"2024-09-12T18:38:06.359333+0000","last_peered":"2024-09-12T18:38:06.359333+0000","last_clean":"2024-09-12T18:38:06.359333+0000","last_became_active":"2024-09-12T18:35:25.659338+0000","last_became_peered":"2024-09-12T18:35:25.659338+0000","last_unstale":"2024-09-12T18:38:06.359333+0000","last_undegraded":"2024-09-12T18:38:06.359333+0000","last_fullsized":"2024-09-12T18:38:06.359333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:37.083820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367372+0000","last_change":"2024-09-12T18:35:25.662445+0000","last_active":"2024-09-12T18:38:07.367372+0000","last_peered":"2024-09-12T18:38:07.367372+0000","last_clean":"2024-09-12T18:38:07.367372+0000","last_became_active":"2024-09-12T18:35:25.659496+0000","last_became_peered":"2024-09-12T18:35:25.659496+0000","last_unstale":"2024-09-12T18:38:07.367372+0000","last_undegraded":"2024-09-12T18:38:07.367372+0000","last_fullsized":"2024-09-12T18:38:07.367372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:03.270420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368653+0000","last_change":"2024-09-12T18:38:03.357219+0000","last_active":"2024-09-12T18:38:07.368653+0000","last_peered":"2024-09-12T18:38:07.368653+0000","last_clean":"2024-09-12T18:38:07.368653+0000","last_became_active":"2024-09-12T18:38:03.356412+0000","last_became_peered":"2024-09-12T18:38:03.356412+0000","last_unstale":"2024-09-12T18:38:07.368653+0000","last_undegraded":"2024-09-12T18:38:07.368653+0000","last_fullsized":"2024-09-12T18:38:07.368653+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:53.007632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367404+0000","last_change":"2024-09-12T18:35:25.650507+0000","last_active":"2024-09-12T18:38:07.367404+0000","last_peered":"2024-09-12T18:38:07.367404+0000","last_clean":"2024-09-12T18:38:07.367404+0000","last_became_active":"2024-09-12T18:35:25.649415+0000","last_became_peered":"2024-09-12T18:35:25.649415+0000","last_unstale":"2024-09-12T18:38:07.367404+0000","last_undegraded":"2024-09-12T18:38:07.367404+0000","last_fullsized":"2024-09-12T18:38:07.367404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:23.081416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367879+0000","last_change":"2024-09-12T18:35:25.653949+0000","last_active":"2024-09-12T18:38:07.367879+0000","last_peered":"2024-09-12T18:38:07.367879+0000","last_clean":"2024-09-12T18:38:07.367879+0000","last_became_active":"2024-09-12T18:35:25.652992+0000","last_became_peered":"2024-09-12T18:35:25.652992+0000","last_unstale":"2024-09-12T18:38:07.367879+0000","last_undegraded":"2024-09-12T18:38:07.367879+0000","last_fullsized":"2024-09-12T18:38:07.367879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:47.687372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.357652+0000","last_change":"2024-09-12T18:38:03.356306+0000","last_active":"2024-09-12T18:38:06.357652+0000","last_peered":"2024-09-12T18:38:06.357652+0000","last_clean":"2024-09-12T18:38:06.357652+0000","last_became_active":"2024-09-12T18:38:03.355052+0000","last_became_peered":"2024-09-12T18:38:03.355052+0000","last_unstale":"2024-09-12T18:38:06.357652+0000","last_undegraded":"2024-09-12T18:38:06.357652+0000","last_fullsized":"2024-09-12T18:38:06.357652+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:54.986299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367305+0000","last_change":"2024-09-12T18:38:03.351904+0000","last_active":"2024-09-12T18:38:07.367305+0000","last_peered":"2024-09-12T18:38:07.367305+0000","last_clean":"2024-09-12T18:38:07.367305+0000","last_became_active":"2024-09-12T18:38:03.351112+0000","last_became_peered":"2024-09-12T18:38:03.351112+0000","last_unstale":"2024-09-12T18:38:07.367305+0000","last_undegraded":"2024-09-12T18:38:07.367305+0000","last_fullsized":"2024-09-12T18:38:07.367305+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:52.881469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":160,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359058+0000","last_change":"2024-09-12T18:35:24.657739+0000","last_active":"2024-09-12T18:38:06.359058+0000","last_peered":"2024-09-12T18:38:06.359058+0000","last_clean":"2024-09-12T18:38:06.359058+0000","last_became_active":"2024-09-12T18:35:24.656208+0000","last_became_peered":"2024-09-12T18:35:24.656208+0000","last_unstale":"2024-09-12T18:38:06.359058+0000","last_undegraded":"2024-09-12T18:38:06.359058+0000","last_fullsized":"2024-09-12T18:38:06.359058+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:50.073716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367762+0000","last_change":"2024-09-12T18:35:25.651651+0000","last_active":"2024-09-12T18:38:07.367762+0000","last_peered":"2024-09-12T18:38:07.367762+0000","last_clean":"2024-09-12T18:38:07.367762+0000","last_became_active":"2024-09-12T18:35:25.650849+0000","last_became_peered":"2024-09-12T18:35:25.650849+0000","last_unstale":"2024-09-12T18:38:07.367762+0000","last_undegraded":"2024-09-12T18:38:07.367762+0000","last_fullsized":"2024-09-12T18:38:07.367762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:18.555827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368934+0000","last_change":"2024-09-12T18:35:24.656119+0000","last_active":"2024-09-12T18:38:07.368934+0000","last_peered":"2024-09-12T18:38:07.368934+0000","last_clean":"2024-09-12T18:38:07.368934+0000","last_became_active":"2024-09-12T18:35:24.653175+0000","last_became_peered":"2024-09-12T18:35:24.653175+0000","last_unstale":"2024-09-12T18:38:07.368934+0000","last_undegraded":"2024-09-12T18:38:07.368934+0000","last_fullsized":"2024-09-12T18:38:07.368934+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:00.551165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369501+0000","last_change":"2024-09-12T18:38:03.356363+0000","last_active":"2024-09-12T18:38:07.369501+0000","last_peered":"2024-09-12T18:38:07.369501+0000","last_clean":"2024-09-12T18:38:07.369501+0000","last_became_active":"2024-09-12T18:38:03.354299+0000","last_became_peered":"2024-09-12T18:38:03.354299+0000","last_unstale":"2024-09-12T18:38:07.369501+0000","last_undegraded":"2024-09-12T18:38:07.369501+0000","last_fullsized":"2024-09-12T18:38:07.369501+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:40.267630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366478+0000","last_change":"2024-09-12T18:35:24.640096+0000","last_active":"2024-09-12T18:38:07.366478+0000","last_peered":"2024-09-12T18:38:07.366478+0000","last_clean":"2024-09-12T18:38:07.366478+0000","last_became_active":"2024-09-12T18:35:24.638230+0000","last_became_peered":"2024-09-12T18:35:24.638230+0000","last_unstale":"2024-09-12T18:38:07.366478+0000","last_undegraded":"2024-09-12T18:38:07.366478+0000","last_fullsized":"2024-09-12T18:38:07.366478+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:38.435296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369661+0000","last_change":"2024-09-12T18:38:03.354155+0000","last_active":"2024-09-12T18:38:07.369661+0000","last_peered":"2024-09-12T18:38:07.369661+0000","last_clean":"2024-09-12T18:38:07.369661+0000","last_became_active":"2024-09-12T18:38:03.352848+0000","last_became_peered":"2024-09-12T18:38:03.352848+0000","last_unstale":"2024-09-12T18:38:07.369661+0000","last_undegraded":"2024-09-12T18:38:07.369661+0000","last_fullsized":"2024-09-12T18:38:07.369661+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:36.825717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":166,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.357827+0000","last_change":"2024-09-12T18:35:24.653610+0000","last_active":"2024-09-12T18:38:06.357827+0000","last_peered":"2024-09-12T18:38:06.357827+0000","last_clean":"2024-09-12T18:38:06.357827+0000","last_became_active":"2024-09-12T18:35:24.652880+0000","last_became_peered":"2024-09-12T18:35:24.652880+0000","last_unstale":"2024-09-12T18:38:06.357827+0000","last_undegraded":"2024-09-12T18:38:06.357827+0000","last_fullsized":"2024-09-12T18:38:06.357827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:57.636251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":159,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359825+0000","last_change":"2024-09-12T18:35:24.653465+0000","last_active":"2024-09-12T18:38:06.359825+0000","last_peered":"2024-09-12T18:38:06.359825+0000","last_clean":"2024-09-12T18:38:06.359825+0000","last_became_active":"2024-09-12T18:35:24.652792+0000","last_became_peered":"2024-09-12T18:35:24.652792+0000","last_unstale":"2024-09-12T18:38:06.359825+0000","last_undegraded":"2024-09-12T18:38:06.359825+0000","last_fullsized":"2024-09-12T18:38:06.359825+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:14.588993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366949+0000","last_change":"2024-09-12T18:35:25.655426+0000","last_active":"2024-09-12T18:38:07.366949+0000","last_peered":"2024-09-12T18:38:07.366949+0000","last_clean":"2024-09-12T18:38:07.366949+0000","last_became_active":"2024-09-12T18:35:25.648186+0000","last_became_peered":"2024-09-12T18:35:25.648186+0000","last_unstale":"2024-09-12T18:38:07.366949+0000","last_undegraded":"2024-09-12T18:38:07.366949+0000","last_fullsized":"2024-09-12T18:38:07.366949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:48.802815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367913+0000","last_change":"2024-09-12T18:35:24.648439+0000","last_active":"2024-09-12T18:38:07.367913+0000","last_peered":"2024-09-12T18:38:07.367913+0000","last_clean":"2024-09-12T18:38:07.367913+0000","last_became_active":"2024-09-12T18:35:24.647629+0000","last_became_peered":"2024-09-12T18:35:24.647629+0000","last_unstale":"2024-09-12T18:38:07.367913+0000","last_undegraded":"2024-09-12T18:38:07.367913+0000","last_fullsized":"2024-09-12T18:38:07.367913+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:45.428223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366148+0000","last_change":"2024-09-12T18:35:25.652496+0000","last_active":"2024-09-12T18:38:07.366148+0000","last_peered":"2024-09-12T18:38:07.366148+0000","last_clean":"2024-09-12T18:38:07.366148+0000","last_became_active":"2024-09-12T18:35:25.651628+0000","last_became_peered":"2024-09-12T18:35:25.651628+0000","last_unstale":"2024-09-12T18:38:07.366148+0000","last_undegraded":"2024-09-12T18:38:07.366148+0000","last_fullsized":"2024-09-12T18:38:07.366148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:44.920448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":159,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358446+0000","last_change":"2024-09-12T18:35:24.654976+0000","last_active":"2024-09-12T18:38:06.358446+0000","last_peered":"2024-09-12T18:38:06.358446+0000","last_clean":"2024-09-12T18:38:06.358446+0000","last_became_active":"2024-09-12T18:35:24.654264+0000","last_became_peered":"2024-09-12T18:35:24.654264+0000","last_unstale":"2024-09-12T18:38:06.358446+0000","last_undegraded":"2024-09-12T18:38:06.358446+0000","last_fullsized":"2024-09-12T18:38:06.358446+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:00.115408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358046+0000","last_change":"2024-09-12T18:38:03.365901+0000","last_active":"2024-09-12T18:38:06.358046+0000","last_peered":"2024-09-12T18:38:06.358046+0000","last_clean":"2024-09-12T18:38:06.358046+0000","last_became_active":"2024-09-12T18:38:03.364754+0000","last_became_peered":"2024-09-12T18:38:03.364754+0000","last_unstale":"2024-09-12T18:38:06.358046+0000","last_undegraded":"2024-09-12T18:38:06.358046+0000","last_fullsized":"2024-09-12T18:38:06.358046+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:43.078837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":158,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359087+0000","last_change":"2024-09-12T18:35:24.657665+0000","last_active":"2024-09-12T18:38:06.359087+0000","last_peered":"2024-09-12T18:38:06.359087+0000","last_clean":"2024-09-12T18:38:06.359087+0000","last_became_active":"2024-09-12T18:35:24.657015+0000","last_became_peered":"2024-09-12T18:35:24.657015+0000","last_unstale":"2024-09-12T18:38:06.359087+0000","last_undegraded":"2024-09-12T18:38:06.359087+0000","last_fullsized":"2024-09-12T18:38:06.359087+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:03.171326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368567+0000","last_change":"2024-09-12T18:35:25.665275+0000","last_active":"2024-09-12T18:38:07.368567+0000","last_peered":"2024-09-12T18:38:07.368567+0000","last_clean":"2024-09-12T18:38:07.368567+0000","last_became_active":"2024-09-12T18:35:25.659511+0000","last_became_peered":"2024-09-12T18:35:25.659511+0000","last_unstale":"2024-09-12T18:38:07.368567+0000","last_undegraded":"2024-09-12T18:38:07.368567+0000","last_fullsized":"2024-09-12T18:38:07.368567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368912+0000","last_change":"2024-09-12T18:38:03.384365+0000","last_active":"2024-09-12T18:38:07.368912+0000","last_peered":"2024-09-12T18:38:07.368912+0000","last_clean":"2024-09-12T18:38:07.368912+0000","last_became_active":"2024-09-12T18:38:03.364147+0000","last_became_peered":"2024-09-12T18:38:03.364147+0000","last_unstale":"2024-09-12T18:38:07.368912+0000","last_undegraded":"2024-09-12T18:38:07.368912+0000","last_fullsized":"2024-09-12T18:38:07.368912+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:05.965891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358810+0000","last_change":"2024-09-12T18:38:03.356255+0000","last_active":"2024-09-12T18:38:06.358810+0000","last_peered":"2024-09-12T18:38:06.358810+0000","last_clean":"2024-09-12T18:38:06.358810+0000","last_became_active":"2024-09-12T18:38:03.355310+0000","last_became_peered":"2024-09-12T18:38:03.355310+0000","last_unstale":"2024-09-12T18:38:06.358810+0000","last_undegraded":"2024-09-12T18:38:06.358810+0000","last_fullsized":"2024-09-12T18:38:06.358810+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:21.097039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":158,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358549+0000","last_change":"2024-09-12T18:35:24.659019+0000","last_active":"2024-09-12T18:38:06.358549+0000","last_peered":"2024-09-12T18:38:06.358549+0000","last_clean":"2024-09-12T18:38:06.358549+0000","last_became_active":"2024-09-12T18:35:24.658423+0000","last_became_peered":"2024-09-12T18:35:24.658423+0000","last_unstale":"2024-09-12T18:38:06.358549+0000","last_undegraded":"2024-09-12T18:38:06.358549+0000","last_fullsized":"2024-09-12T18:38:06.358549+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:37.668417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359018+0000","last_change":"2024-09-12T18:35:25.662287+0000","last_active":"2024-09-12T18:38:06.359018+0000","last_peered":"2024-09-12T18:38:06.359018+0000","last_clean":"2024-09-12T18:38:06.359018+0000","last_became_active":"2024-09-12T18:35:25.660372+0000","last_became_peered":"2024-09-12T18:35:25.660372+0000","last_unstale":"2024-09-12T18:38:06.359018+0000","last_undegraded":"2024-09-12T18:38:06.359018+0000","last_fullsized":"2024-09-12T18:38:06.359018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:08.729541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366544+0000","last_change":"2024-09-12T18:35:24.648330+0000","last_active":"2024-09-12T18:38:07.366544+0000","last_peered":"2024-09-12T18:38:07.366544+0000","last_clean":"2024-09-12T18:38:07.366544+0000","last_became_active":"2024-09-12T18:35:24.647520+0000","last_became_peered":"2024-09-12T18:35:24.647520+0000","last_unstale":"2024-09-12T18:38:07.366544+0000","last_undegraded":"2024-09-12T18:38:07.366544+0000","last_fullsized":"2024-09-12T18:38:07.366544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:25.552055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359547+0000","last_change":"2024-09-12T18:35:25.658674+0000","last_active":"2024-09-12T18:38:06.359547+0000","last_peered":"2024-09-12T18:38:06.359547+0000","last_clean":"2024-09-12T18:38:06.359547+0000","last_became_active":"2024-09-12T18:35:25.657386+0000","last_became_peered":"2024-09-12T18:35:25.657386+0000","last_unstale":"2024-09-12T18:38:06.359547+0000","last_undegraded":"2024-09-12T18:38:06.359547+0000","last_fullsized":"2024-09-12T18:38:06.359547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:48.037086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366112+0000","last_change":"2024-09-12T18:35:24.646810+0000","last_active":"2024-09-12T18:38:07.366112+0000","last_peered":"2024-09-12T18:38:07.366112+0000","last_clean":"2024-09-12T18:38:07.366112+0000","last_became_active":"2024-09-12T18:35:24.646008+0000","last_became_peered":"2024-09-12T18:35:24.646008+0000","last_unstale":"2024-09-12T18:38:07.366112+0000","last_undegraded":"2024-09-12T18:38:07.366112+0000","last_fullsized":"2024-09-12T18:38:07.366112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:43.888776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369934+0000","last_change":"2024-09-12T18:35:25.667710+0000","last_active":"2024-09-12T18:38:07.369934+0000","last_peered":"2024-09-12T18:38:07.369934+0000","last_clean":"2024-09-12T18:38:07.369934+0000","last_became_active":"2024-09-12T18:35:25.666940+0000","last_became_peered":"2024-09-12T18:35:25.666940+0000","last_unstale":"2024-09-12T18:38:07.369934+0000","last_undegraded":"2024-09-12T18:38:07.369934+0000","last_fullsized":"2024-09-12T18:38:07.369934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:09.823085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":308,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358400+0000","last_change":"2024-09-12T18:35:13.489018+0000","last_active":"2024-09-12T18:38:06.358400+0000","last_peered":"2024-09-12T18:38:06.358400+0000","last_clean":"2024-09-12T18:38:06.358400+0000","last_became_active":"2024-09-12T18:35:13.488346+0000","last_became_peered":"2024-09-12T18:35:13.488346+0000","last_unstale":"2024-09-12T18:38:06.358400+0000","last_undegraded":"2024-09-12T18:38:06.358400+0000","last_fullsized":"2024-09-12T18:38:06.358400+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_clean_scrub_stamp":"2024-09-12T18:35:12.464628+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:54.864640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":172,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359336+0000","last_change":"2024-09-12T18:35:22.459694+0000","last_active":"2024-09-12T18:38:06.359336+0000","last_peered":"2024-09-12T18:38:06.359336+0000","last_clean":"2024-09-12T18:38:06.359336+0000","last_became_active":"2024-09-12T18:35:20.446796+0000","last_became_peered":"2024-09-12T18:35:20.446796+0000","last_unstale":"2024-09-12T18:38:06.359336+0000","last_undegraded":"2024-09-12T18:38:06.359336+0000","last_fullsized":"2024-09-12T18:38:06.359336+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:21.506024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016291610000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368143+0000","last_change":"2024-09-12T18:38:03.354554+0000","last_active":"2024-09-12T18:38:07.368143+0000","last_peered":"2024-09-12T18:38:07.368143+0000","last_clean":"2024-09-12T18:38:07.368143+0000","last_became_active":"2024-09-12T18:38:03.353661+0000","last_became_peered":"2024-09-12T18:38:03.353661+0000","last_unstale":"2024-09-12T18:38:07.368143+0000","last_undegraded":"2024-09-12T18:38:07.368143+0000","last_fullsized":"2024-09-12T18:38:07.368143+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:27.835210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359041+0000","last_change":"2024-09-12T18:35:25.662424+0000","last_active":"2024-09-12T18:38:06.359041+0000","last_peered":"2024-09-12T18:38:06.359041+0000","last_clean":"2024-09-12T18:38:06.359041+0000","last_became_active":"2024-09-12T18:35:25.661043+0000","last_became_peered":"2024-09-12T18:35:25.661043+0000","last_unstale":"2024-09-12T18:38:06.359041+0000","last_undegraded":"2024-09-12T18:38:06.359041+0000","last_fullsized":"2024-09-12T18:38:06.359041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:52.551802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":171,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358322+0000","last_change":"2024-09-12T18:35:22.459090+0000","last_active":"2024-09-12T18:38:06.358322+0000","last_peered":"2024-09-12T18:38:06.358322+0000","last_clean":"2024-09-12T18:38:06.358322+0000","last_became_active":"2024-09-12T18:35:20.448553+0000","last_became_peered":"2024-09-12T18:35:20.448553+0000","last_unstale":"2024-09-12T18:38:06.358322+0000","last_undegraded":"2024-09-12T18:38:06.358322+0000","last_fullsized":"2024-09-12T18:38:06.358322+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:56.834808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001030836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368423+0000","last_change":"2024-09-12T18:35:24.651597+0000","last_active":"2024-09-12T18:38:07.368423+0000","last_peered":"2024-09-12T18:38:07.368423+0000","last_clean":"2024-09-12T18:38:07.368423+0000","last_became_active":"2024-09-12T18:35:24.649940+0000","last_became_peered":"2024-09-12T18:35:24.649940+0000","last_unstale":"2024-09-12T18:38:07.368423+0000","last_undegraded":"2024-09-12T18:38:07.368423+0000","last_fullsized":"2024-09-12T18:38:07.368423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:36.822432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367752+0000","last_change":"2024-09-12T18:38:03.358588+0000","last_active":"2024-09-12T18:38:07.367752+0000","last_peered":"2024-09-12T18:38:07.367752+0000","last_clean":"2024-09-12T18:38:07.367752+0000","last_became_active":"2024-09-12T18:38:03.357664+0000","last_became_peered":"2024-09-12T18:38:03.357664+0000","last_unstale":"2024-09-12T18:38:07.367752+0000","last_undegraded":"2024-09-12T18:38:07.367752+0000","last_fullsized":"2024-09-12T18:38:07.367752+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:02.273189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368624+0000","last_change":"2024-09-12T18:35:22.464179+0000","last_active":"2024-09-12T18:38:07.368624+0000","last_peered":"2024-09-12T18:38:07.368624+0000","last_clean":"2024-09-12T18:38:07.368624+0000","last_became_active":"2024-09-12T18:35:20.442613+0000","last_became_peered":"2024-09-12T18:35:20.442613+0000","last_unstale":"2024-09-12T18:38:07.368624+0000","last_undegraded":"2024-09-12T18:38:07.368624+0000","last_fullsized":"2024-09-12T18:38:07.368624+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:17.636537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014134620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366112+0000","last_change":"2024-09-12T18:35:24.641297+0000","last_active":"2024-09-12T18:38:07.366112+0000","last_peered":"2024-09-12T18:38:07.366112+0000","last_clean":"2024-09-12T18:38:07.366112+0000","last_became_active":"2024-09-12T18:35:24.637334+0000","last_became_peered":"2024-09-12T18:35:24.637334+0000","last_unstale":"2024-09-12T18:38:07.366112+0000","last_undegraded":"2024-09-12T18:38:07.366112+0000","last_fullsized":"2024-09-12T18:38:07.366112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:50.772074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369805+0000","last_change":"2024-09-12T18:38:03.360352+0000","last_active":"2024-09-12T18:38:07.369805+0000","last_peered":"2024-09-12T18:38:07.369805+0000","last_clean":"2024-09-12T18:38:07.369805+0000","last_became_active":"2024-09-12T18:38:03.359452+0000","last_became_peered":"2024-09-12T18:38:03.359452+0000","last_unstale":"2024-09-12T18:38:07.369805+0000","last_undegraded":"2024-09-12T18:38:07.369805+0000","last_fullsized":"2024-09-12T18:38:07.369805+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:48.036394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":173,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358697+0000","last_change":"2024-09-12T18:35:22.459049+0000","last_active":"2024-09-12T18:38:06.358697+0000","last_peered":"2024-09-12T18:38:06.358697+0000","last_clean":"2024-09-12T18:38:06.358697+0000","last_became_active":"2024-09-12T18:35:20.446814+0000","last_became_peered":"2024-09-12T18:35:20.446814+0000","last_unstale":"2024-09-12T18:38:06.358697+0000","last_undegraded":"2024-09-12T18:38:06.358697+0000","last_fullsized":"2024-09-12T18:38:06.358697+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:18.033595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010716149999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":158,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359121+0000","last_change":"2024-09-12T18:35:24.658273+0000","last_active":"2024-09-12T18:38:06.359121+0000","last_peered":"2024-09-12T18:38:06.359121+0000","last_clean":"2024-09-12T18:38:06.359121+0000","last_became_active":"2024-09-12T18:35:24.657433+0000","last_became_peered":"2024-09-12T18:35:24.657433+0000","last_unstale":"2024-09-12T18:38:06.359121+0000","last_undegraded":"2024-09-12T18:38:06.359121+0000","last_fullsized":"2024-09-12T18:38:06.359121+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:48.497218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369135+0000","last_change":"2024-09-12T18:38:03.358304+0000","last_active":"2024-09-12T18:38:07.369135+0000","last_peered":"2024-09-12T18:38:07.369135+0000","last_clean":"2024-09-12T18:38:07.369135+0000","last_became_active":"2024-09-12T18:38:03.357592+0000","last_became_peered":"2024-09-12T18:38:03.357592+0000","last_unstale":"2024-09-12T18:38:07.369135+0000","last_undegraded":"2024-09-12T18:38:07.369135+0000","last_fullsized":"2024-09-12T18:38:07.369135+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:45.610260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":158,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358064+0000","last_change":"2024-09-12T18:35:24.657618+0000","last_active":"2024-09-12T18:38:06.358064+0000","last_peered":"2024-09-12T18:38:06.358064+0000","last_clean":"2024-09-12T18:38:06.358064+0000","last_became_active":"2024-09-12T18:35:24.656741+0000","last_became_peered":"2024-09-12T18:35:24.656741+0000","last_unstale":"2024-09-12T18:38:06.358064+0000","last_undegraded":"2024-09-12T18:38:06.358064+0000","last_fullsized":"2024-09-12T18:38:06.358064+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:43.113104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369480+0000","last_change":"2024-09-12T18:35:22.464180+0000","last_active":"2024-09-12T18:38:07.369480+0000","last_peered":"2024-09-12T18:38:07.369480+0000","last_clean":"2024-09-12T18:38:07.369480+0000","last_became_active":"2024-09-12T18:35:20.442566+0000","last_became_peered":"2024-09-12T18:35:20.442566+0000","last_unstale":"2024-09-12T18:38:07.369480+0000","last_undegraded":"2024-09-12T18:38:07.369480+0000","last_fullsized":"2024-09-12T18:38:07.369480+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:29.021710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001325786,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366700+0000","last_change":"2024-09-12T18:35:25.650458+0000","last_active":"2024-09-12T18:38:07.366700+0000","last_peered":"2024-09-12T18:38:07.366700+0000","last_clean":"2024-09-12T18:38:07.366700+0000","last_became_active":"2024-09-12T18:35:25.648761+0000","last_became_peered":"2024-09-12T18:35:25.648761+0000","last_unstale":"2024-09-12T18:38:07.366700+0000","last_undegraded":"2024-09-12T18:38:07.366700+0000","last_fullsized":"2024-09-12T18:38:07.366700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:53.026950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369129+0000","last_change":"2024-09-12T18:38:03.357887+0000","last_active":"2024-09-12T18:38:07.369129+0000","last_peered":"2024-09-12T18:38:07.369129+0000","last_clean":"2024-09-12T18:38:07.369129+0000","last_became_active":"2024-09-12T18:38:03.356816+0000","last_became_peered":"2024-09-12T18:38:03.356816+0000","last_unstale":"2024-09-12T18:38:07.369129+0000","last_undegraded":"2024-09-12T18:38:07.369129+0000","last_fullsized":"2024-09-12T18:38:07.369129+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:09.458196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":185,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366644+0000","last_change":"2024-09-12T18:38:03.351352+0000","last_active":"2024-09-12T18:38:07.366644+0000","last_peered":"2024-09-12T18:38:07.366644+0000","last_clean":"2024-09-12T18:38:07.366644+0000","last_became_active":"2024-09-12T18:38:03.350774+0000","last_became_peered":"2024-09-12T18:38:03.350774+0000","last_unstale":"2024-09-12T18:38:07.366644+0000","last_undegraded":"2024-09-12T18:38:07.366644+0000","last_fullsized":"2024-09-12T18:38:07.366644+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:30.555373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080163599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366902+0000","last_change":"2024-09-12T18:35:25.650717+0000","last_active":"2024-09-12T18:38:07.366902+0000","last_peered":"2024-09-12T18:38:07.366902+0000","last_clean":"2024-09-12T18:38:07.366902+0000","last_became_active":"2024-09-12T18:35:25.649147+0000","last_became_peered":"2024-09-12T18:35:25.649147+0000","last_unstale":"2024-09-12T18:38:07.366902+0000","last_undegraded":"2024-09-12T18:38:07.366902+0000","last_fullsized":"2024-09-12T18:38:07.366902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:07.365888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.370288+0000","last_change":"2024-09-12T18:35:24.657234+0000","last_active":"2024-09-12T18:38:07.370288+0000","last_peered":"2024-09-12T18:38:07.370288+0000","last_clean":"2024-09-12T18:38:07.370288+0000","last_became_active":"2024-09-12T18:35:24.655950+0000","last_became_peered":"2024-09-12T18:35:24.655950+0000","last_unstale":"2024-09-12T18:38:07.370288+0000","last_undegraded":"2024-09-12T18:38:07.370288+0000","last_fullsized":"2024-09-12T18:38:07.370288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:17.466623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359037+0000","last_change":"2024-09-12T18:37:34.258443+0000","last_active":"2024-09-12T18:38:06.359037+0000","last_peered":"2024-09-12T18:38:06.359037+0000","last_clean":"2024-09-12T18:38:06.359037+0000","last_became_active":"2024-09-12T18:37:34.254999+0000","last_became_peered":"2024-09-12T18:37:34.254999+0000","last_unstale":"2024-09-12T18:38:06.359037+0000","last_undegraded":"2024-09-12T18:38:06.359037+0000","last_fullsized":"2024-09-12T18:38:06.359037+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:23.164676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367719+0000","last_change":"2024-09-12T18:38:03.358177+0000","last_active":"2024-09-12T18:38:07.367719+0000","last_peered":"2024-09-12T18:38:07.367719+0000","last_clean":"2024-09-12T18:38:07.367719+0000","last_became_active":"2024-09-12T18:38:03.354895+0000","last_became_peered":"2024-09-12T18:38:03.354895+0000","last_unstale":"2024-09-12T18:38:07.367719+0000","last_undegraded":"2024-09-12T18:38:07.367719+0000","last_fullsized":"2024-09-12T18:38:07.367719+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:16.208815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369642+0000","last_change":"2024-09-12T18:38:03.370898+0000","last_active":"2024-09-12T18:38:07.369642+0000","last_peered":"2024-09-12T18:38:07.369642+0000","last_clean":"2024-09-12T18:38:07.369642+0000","last_became_active":"2024-09-12T18:38:03.354684+0000","last_became_peered":"2024-09-12T18:38:03.354684+0000","last_unstale":"2024-09-12T18:38:07.369642+0000","last_undegraded":"2024-09-12T18:38:07.369642+0000","last_fullsized":"2024-09-12T18:38:07.369642+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:27.684565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":171,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359956+0000","last_change":"2024-09-12T18:35:22.459767+0000","last_active":"2024-09-12T18:38:06.359956+0000","last_peered":"2024-09-12T18:38:06.359956+0000","last_clean":"2024-09-12T18:38:06.359956+0000","last_became_active":"2024-09-12T18:35:20.448521+0000","last_became_peered":"2024-09-12T18:35:20.448521+0000","last_unstale":"2024-09-12T18:38:06.359956+0000","last_undegraded":"2024-09-12T18:38:06.359956+0000","last_fullsized":"2024-09-12T18:38:06.359956+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:33.463792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017009670000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366127+0000","last_change":"2024-09-12T18:35:25.648150+0000","last_active":"2024-09-12T18:38:07.366127+0000","last_peered":"2024-09-12T18:38:07.366127+0000","last_clean":"2024-09-12T18:38:07.366127+0000","last_became_active":"2024-09-12T18:35:25.647347+0000","last_became_peered":"2024-09-12T18:35:25.647347+0000","last_unstale":"2024-09-12T18:38:07.366127+0000","last_undegraded":"2024-09-12T18:38:07.366127+0000","last_fullsized":"2024-09-12T18:38:07.366127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:48.968336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358735+0000","last_change":"2024-09-12T18:35:25.660696+0000","last_active":"2024-09-12T18:38:06.358735+0000","last_peered":"2024-09-12T18:38:06.358735+0000","last_clean":"2024-09-12T18:38:06.358735+0000","last_became_active":"2024-09-12T18:35:25.659827+0000","last_became_peered":"2024-09-12T18:35:25.659827+0000","last_unstale":"2024-09-12T18:38:06.358735+0000","last_undegraded":"2024-09-12T18:38:06.358735+0000","last_fullsized":"2024-09-12T18:38:06.358735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:15.678289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":164,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359083+0000","last_change":"2024-09-12T18:35:24.655051+0000","last_active":"2024-09-12T18:38:06.359083+0000","last_peered":"2024-09-12T18:38:06.359083+0000","last_clean":"2024-09-12T18:38:06.359083+0000","last_became_active":"2024-09-12T18:35:24.654282+0000","last_became_peered":"2024-09-12T18:35:24.654282+0000","last_unstale":"2024-09-12T18:38:06.359083+0000","last_undegraded":"2024-09-12T18:38:06.359083+0000","last_fullsized":"2024-09-12T18:38:06.359083+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:08.159799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368447+0000","last_change":"2024-09-12T18:38:03.355018+0000","last_active":"2024-09-12T18:38:07.368447+0000","last_peered":"2024-09-12T18:38:07.368447+0000","last_clean":"2024-09-12T18:38:07.368447+0000","last_became_active":"2024-09-12T18:38:03.354064+0000","last_became_peered":"2024-09-12T18:38:03.354064+0000","last_unstale":"2024-09-12T18:38:07.368447+0000","last_undegraded":"2024-09-12T18:38:07.368447+0000","last_fullsized":"2024-09-12T18:38:07.368447+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:18.297083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":163,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367123+0000","last_change":"2024-09-12T18:35:24.648658+0000","last_active":"2024-09-12T18:38:07.367123+0000","last_peered":"2024-09-12T18:38:07.367123+0000","last_clean":"2024-09-12T18:38:07.367123+0000","last_became_active":"2024-09-12T18:35:24.647826+0000","last_became_peered":"2024-09-12T18:35:24.647826+0000","last_unstale":"2024-09-12T18:38:07.367123+0000","last_undegraded":"2024-09-12T18:38:07.367123+0000","last_fullsized":"2024-09-12T18:38:07.367123+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:24.167549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359951+0000","last_change":"2024-09-12T18:38:03.366378+0000","last_active":"2024-09-12T18:38:06.359951+0000","last_peered":"2024-09-12T18:38:06.359951+0000","last_clean":"2024-09-12T18:38:06.359951+0000","last_became_active":"2024-09-12T18:38:03.364887+0000","last_became_peered":"2024-09-12T18:38:03.364887+0000","last_unstale":"2024-09-12T18:38:06.359951+0000","last_undegraded":"2024-09-12T18:38:06.359951+0000","last_fullsized":"2024-09-12T18:38:06.359951+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:54.490659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368005+0000","last_change":"2024-09-12T18:35:25.661801+0000","last_active":"2024-09-12T18:38:07.368005+0000","last_peered":"2024-09-12T18:38:07.368005+0000","last_clean":"2024-09-12T18:38:07.368005+0000","last_became_active":"2024-09-12T18:35:25.658476+0000","last_became_peered":"2024-09-12T18:35:25.658476+0000","last_unstale":"2024-09-12T18:38:07.368005+0000","last_undegraded":"2024-09-12T18:38:07.368005+0000","last_fullsized":"2024-09-12T18:38:07.368005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:58.246449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.370140+0000","last_change":"2024-09-12T18:35:24.652399+0000","last_active":"2024-09-12T18:38:07.370140+0000","last_peered":"2024-09-12T18:38:07.370140+0000","last_clean":"2024-09-12T18:38:07.370140+0000","last_became_active":"2024-09-12T18:35:24.651416+0000","last_became_peered":"2024-09-12T18:35:24.651416+0000","last_unstale":"2024-09-12T18:38:07.370140+0000","last_undegraded":"2024-09-12T18:38:07.370140+0000","last_fullsized":"2024-09-12T18:38:07.370140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:32.594978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367773+0000","last_change":"2024-09-12T18:38:03.359924+0000","last_active":"2024-09-12T18:38:07.367773+0000","last_peered":"2024-09-12T18:38:07.367773+0000","last_clean":"2024-09-12T18:38:07.367773+0000","last_became_active":"2024-09-12T18:38:03.357598+0000","last_became_peered":"2024-09-12T18:38:03.357598+0000","last_unstale":"2024-09-12T18:38:07.367773+0000","last_undegraded":"2024-09-12T18:38:07.367773+0000","last_fullsized":"2024-09-12T18:38:07.367773+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:59.501652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368603+0000","last_change":"2024-09-12T18:35:25.651217+0000","last_active":"2024-09-12T18:38:07.368603+0000","last_peered":"2024-09-12T18:38:07.368603+0000","last_clean":"2024-09-12T18:38:07.368603+0000","last_became_active":"2024-09-12T18:35:25.649544+0000","last_became_peered":"2024-09-12T18:35:25.649544+0000","last_unstale":"2024-09-12T18:38:07.368603+0000","last_undegraded":"2024-09-12T18:38:07.368603+0000","last_fullsized":"2024-09-12T18:38:07.368603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:41.601376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367616+0000","last_change":"2024-09-12T18:38:03.349281+0000","last_active":"2024-09-12T18:38:07.367616+0000","last_peered":"2024-09-12T18:38:07.367616+0000","last_clean":"2024-09-12T18:38:07.367616+0000","last_became_active":"2024-09-12T18:38:03.347483+0000","last_became_peered":"2024-09-12T18:38:03.347483+0000","last_unstale":"2024-09-12T18:38:07.367616+0000","last_undegraded":"2024-09-12T18:38:07.367616+0000","last_fullsized":"2024-09-12T18:38:07.367616+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:02.283482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369856+0000","last_change":"2024-09-12T18:35:25.661544+0000","last_active":"2024-09-12T18:38:07.369856+0000","last_peered":"2024-09-12T18:38:07.369856+0000","last_clean":"2024-09-12T18:38:07.369856+0000","last_became_active":"2024-09-12T18:35:25.656985+0000","last_became_peered":"2024-09-12T18:35:25.656985+0000","last_unstale":"2024-09-12T18:38:07.369856+0000","last_undegraded":"2024-09-12T18:38:07.369856+0000","last_fullsized":"2024-09-12T18:38:07.369856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368189+0000","last_change":"2024-09-12T18:38:03.352648+0000","last_active":"2024-09-12T18:38:07.368189+0000","last_peered":"2024-09-12T18:38:07.368189+0000","last_clean":"2024-09-12T18:38:07.368189+0000","last_became_active":"2024-09-12T18:38:03.351740+0000","last_became_peered":"2024-09-12T18:38:03.351740+0000","last_unstale":"2024-09-12T18:38:07.368189+0000","last_undegraded":"2024-09-12T18:38:07.368189+0000","last_fullsized":"2024-09-12T18:38:07.368189+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:13.765236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368265+0000","last_change":"2024-09-12T18:35:25.656712+0000","last_active":"2024-09-12T18:38:07.368265+0000","last_peered":"2024-09-12T18:38:07.368265+0000","last_clean":"2024-09-12T18:38:07.368265+0000","last_became_active":"2024-09-12T18:35:25.654473+0000","last_became_peered":"2024-09-12T18:35:25.654473+0000","last_unstale":"2024-09-12T18:38:07.368265+0000","last_undegraded":"2024-09-12T18:38:07.368265+0000","last_fullsized":"2024-09-12T18:38:07.368265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:01.464680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":161,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367676+0000","last_change":"2024-09-12T18:35:24.659935+0000","last_active":"2024-09-12T18:38:07.367676+0000","last_peered":"2024-09-12T18:38:07.367676+0000","last_clean":"2024-09-12T18:38:07.367676+0000","last_became_active":"2024-09-12T18:35:24.659111+0000","last_became_peered":"2024-09-12T18:35:24.659111+0000","last_unstale":"2024-09-12T18:38:07.367676+0000","last_undegraded":"2024-09-12T18:38:07.367676+0000","last_fullsized":"2024-09-12T18:38:07.367676+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:11.480154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367022+0000","last_change":"2024-09-12T18:38:03.351609+0000","last_active":"2024-09-12T18:38:07.367022+0000","last_peered":"2024-09-12T18:38:07.367022+0000","last_clean":"2024-09-12T18:38:07.367022+0000","last_became_active":"2024-09-12T18:38:03.350972+0000","last_became_peered":"2024-09-12T18:38:03.350972+0000","last_unstale":"2024-09-12T18:38:07.367022+0000","last_undegraded":"2024-09-12T18:38:07.367022+0000","last_fullsized":"2024-09-12T18:38:07.367022+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:15.351880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":161,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367876+0000","last_change":"2024-09-12T18:35:24.638538+0000","last_active":"2024-09-12T18:38:07.367876+0000","last_peered":"2024-09-12T18:38:07.367876+0000","last_clean":"2024-09-12T18:38:07.367876+0000","last_became_active":"2024-09-12T18:35:24.637242+0000","last_became_peered":"2024-09-12T18:35:24.637242+0000","last_unstale":"2024-09-12T18:38:07.367876+0000","last_undegraded":"2024-09-12T18:38:07.367876+0000","last_fullsized":"2024-09-12T18:38:07.367876+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:26.877441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358498+0000","last_change":"2024-09-12T18:35:25.662537+0000","last_active":"2024-09-12T18:38:06.358498+0000","last_peered":"2024-09-12T18:38:06.358498+0000","last_clean":"2024-09-12T18:38:06.358498+0000","last_became_active":"2024-09-12T18:35:25.661441+0000","last_became_peered":"2024-09-12T18:35:25.661441+0000","last_unstale":"2024-09-12T18:38:06.358498+0000","last_undegraded":"2024-09-12T18:38:06.358498+0000","last_fullsized":"2024-09-12T18:38:06.358498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:14.397867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":180,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358818+0000","last_change":"2024-09-12T18:38:03.369857+0000","last_active":"2024-09-12T18:38:06.358818+0000","last_peered":"2024-09-12T18:38:06.358818+0000","last_clean":"2024-09-12T18:38:06.358818+0000","last_became_active":"2024-09-12T18:38:03.355520+0000","last_became_peered":"2024-09-12T18:38:03.355520+0000","last_unstale":"2024-09-12T18:38:06.358818+0000","last_undegraded":"2024-09-12T18:38:06.358818+0000","last_fullsized":"2024-09-12T18:38:06.358818+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:28.637798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358482+0000","last_change":"2024-09-12T18:35:25.651406+0000","last_active":"2024-09-12T18:38:06.358482+0000","last_peered":"2024-09-12T18:38:06.358482+0000","last_clean":"2024-09-12T18:38:06.358482+0000","last_became_active":"2024-09-12T18:35:25.649728+0000","last_became_peered":"2024-09-12T18:35:25.649728+0000","last_unstale":"2024-09-12T18:38:06.358482+0000","last_undegraded":"2024-09-12T18:38:06.358482+0000","last_fullsized":"2024-09-12T18:38:06.358482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:41.773283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368047+0000","last_change":"2024-09-12T18:35:24.649153+0000","last_active":"2024-09-12T18:38:07.368047+0000","last_peered":"2024-09-12T18:38:07.368047+0000","last_clean":"2024-09-12T18:38:07.368047+0000","last_became_active":"2024-09-12T18:35:24.648512+0000","last_became_peered":"2024-09-12T18:35:24.648512+0000","last_unstale":"2024-09-12T18:38:07.368047+0000","last_undegraded":"2024-09-12T18:38:07.368047+0000","last_fullsized":"2024-09-12T18:38:07.368047+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:07.810456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366854+0000","last_change":"2024-09-12T18:35:25.656799+0000","last_active":"2024-09-12T18:38:07.366854+0000","last_peered":"2024-09-12T18:38:07.366854+0000","last_clean":"2024-09-12T18:38:07.366854+0000","last_became_active":"2024-09-12T18:35:25.654980+0000","last_became_peered":"2024-09-12T18:35:25.654980+0000","last_unstale":"2024-09-12T18:38:07.366854+0000","last_undegraded":"2024-09-12T18:38:07.366854+0000","last_fullsized":"2024-09-12T18:38:07.366854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:10.735439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":161,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.370189+0000","last_change":"2024-09-12T18:35:24.656268+0000","last_active":"2024-09-12T18:38:07.370189+0000","last_peered":"2024-09-12T18:38:07.370189+0000","last_clean":"2024-09-12T18:38:07.370189+0000","last_became_active":"2024-09-12T18:35:24.655420+0000","last_became_peered":"2024-09-12T18:35:24.655420+0000","last_unstale":"2024-09-12T18:38:07.370189+0000","last_undegraded":"2024-09-12T18:38:07.370189+0000","last_fullsized":"2024-09-12T18:38:07.370189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:04.654666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358119+0000","last_change":"2024-09-12T18:38:03.357094+0000","last_active":"2024-09-12T18:38:06.358119+0000","last_peered":"2024-09-12T18:38:06.358119+0000","last_clean":"2024-09-12T18:38:06.358119+0000","last_became_active":"2024-09-12T18:38:03.355072+0000","last_became_peered":"2024-09-12T18:38:03.355072+0000","last_unstale":"2024-09-12T18:38:06.358119+0000","last_undegraded":"2024-09-12T18:38:06.358119+0000","last_fullsized":"2024-09-12T18:38:06.358119+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:46.451497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369635+0000","last_change":"2024-09-12T18:38:03.379032+0000","last_active":"2024-09-12T18:38:07.369635+0000","last_peered":"2024-09-12T18:38:07.369635+0000","last_clean":"2024-09-12T18:38:07.369635+0000","last_became_active":"2024-09-12T18:38:03.353780+0000","last_became_peered":"2024-09-12T18:38:03.353780+0000","last_unstale":"2024-09-12T18:38:07.369635+0000","last_undegraded":"2024-09-12T18:38:07.369635+0000","last_fullsized":"2024-09-12T18:38:07.369635+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:26.800343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705703,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297412,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":296318,"kb_avail":94074428,"statfs":{"total":96636764160,"available":96332214272,"internally_reserved":0,"allocated":1097728,"data_stored":982590,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":303430086},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738407,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280776,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94091064,"statfs":{"total":96636764160,"available":96349249536,"internally_reserved":0,"allocated":1101824,"data_stored":978964,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":286390725},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738407,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302908,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":301886,"kb_avail":94068932,"statfs":{"total":96636764160,"available":96326586368,"internally_reserved":0,"allocated":1019904,"data_stored":391063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":309131718},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:38:11.610 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T18:38:11.610 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:38:11.956 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:38:11.958 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T18:38:11.974 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2024-09-12T18:38:10.425555+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":192,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":881096,"kb_used_data":3144,"kb_used_omap":4,"kb_used_meta":877883,"kb_avail":282234424,"statfs":{"total":289910292480,"available":289008050176,"internally_reserved":0,"allocated":3219456,"data_stored":2352617,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4783,"internal_metadata":898952529},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001362"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368487+0000","last_change":"2024-09-12T18:38:03.358323+0000","last_active":"2024-09-12T18:38:07.368487+0000","last_peered":"2024-09-12T18:38:07.368487+0000","last_clean":"2024-09-12T18:38:07.368487+0000","last_became_active":"2024-09-12T18:38:03.357317+0000","last_became_peered":"2024-09-12T18:38:03.357317+0000","last_unstale":"2024-09-12T18:38:07.368487+0000","last_undegraded":"2024-09-12T18:38:07.368487+0000","last_fullsized":"2024-09-12T18:38:07.368487+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:55.315464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367135+0000","last_change":"2024-09-12T18:35:25.659760+0000","last_active":"2024-09-12T18:38:07.367135+0000","last_peered":"2024-09-12T18:38:07.367135+0000","last_clean":"2024-09-12T18:38:07.367135+0000","last_became_active":"2024-09-12T18:35:25.654920+0000","last_became_peered":"2024-09-12T18:35:25.654920+0000","last_unstale":"2024-09-12T18:38:07.367135+0000","last_undegraded":"2024-09-12T18:38:07.367135+0000","last_fullsized":"2024-09-12T18:38:07.367135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:21.519881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359587+0000","last_change":"2024-09-12T18:35:25.659460+0000","last_active":"2024-09-12T18:38:06.359587+0000","last_peered":"2024-09-12T18:38:06.359587+0000","last_clean":"2024-09-12T18:38:06.359587+0000","last_became_active":"2024-09-12T18:35:25.657782+0000","last_became_peered":"2024-09-12T18:35:25.657782+0000","last_unstale":"2024-09-12T18:38:06.359587+0000","last_undegraded":"2024-09-12T18:38:06.359587+0000","last_fullsized":"2024-09-12T18:38:06.359587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:38.544284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358249+0000","last_change":"2024-09-12T18:35:25.663617+0000","last_active":"2024-09-12T18:38:06.358249+0000","last_peered":"2024-09-12T18:38:06.358249+0000","last_clean":"2024-09-12T18:38:06.358249+0000","last_became_active":"2024-09-12T18:35:25.661977+0000","last_became_peered":"2024-09-12T18:35:25.661977+0000","last_unstale":"2024-09-12T18:38:06.358249+0000","last_undegraded":"2024-09-12T18:38:06.358249+0000","last_fullsized":"2024-09-12T18:38:06.358249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:14.748234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367138+0000","last_change":"2024-09-12T18:35:25.656566+0000","last_active":"2024-09-12T18:38:07.367138+0000","last_peered":"2024-09-12T18:38:07.367138+0000","last_clean":"2024-09-12T18:38:07.367138+0000","last_became_active":"2024-09-12T18:35:25.654898+0000","last_became_peered":"2024-09-12T18:35:25.654898+0000","last_unstale":"2024-09-12T18:38:07.367138+0000","last_undegraded":"2024-09-12T18:38:07.367138+0000","last_fullsized":"2024-09-12T18:38:07.367138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:36.113250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.357732+0000","last_change":"2024-09-12T18:38:03.366489+0000","last_active":"2024-09-12T18:38:06.357732+0000","last_peered":"2024-09-12T18:38:06.357732+0000","last_clean":"2024-09-12T18:38:06.357732+0000","last_became_active":"2024-09-12T18:38:03.364745+0000","last_became_peered":"2024-09-12T18:38:03.364745+0000","last_unstale":"2024-09-12T18:38:06.357732+0000","last_undegraded":"2024-09-12T18:38:06.357732+0000","last_fullsized":"2024-09-12T18:38:06.357732+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:42.397517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.357624+0000","last_change":"2024-09-12T18:35:25.659811+0000","last_active":"2024-09-12T18:38:06.357624+0000","last_peered":"2024-09-12T18:38:06.357624+0000","last_clean":"2024-09-12T18:38:06.357624+0000","last_became_active":"2024-09-12T18:35:25.658998+0000","last_became_peered":"2024-09-12T18:35:25.658998+0000","last_unstale":"2024-09-12T18:38:06.357624+0000","last_undegraded":"2024-09-12T18:38:06.357624+0000","last_fullsized":"2024-09-12T18:38:06.357624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.357347+0000","last_change":"2024-09-12T18:38:03.365773+0000","last_active":"2024-09-12T18:38:06.357347+0000","last_peered":"2024-09-12T18:38:06.357347+0000","last_clean":"2024-09-12T18:38:06.357347+0000","last_became_active":"2024-09-12T18:38:03.364845+0000","last_became_peered":"2024-09-12T18:38:03.364845+0000","last_unstale":"2024-09-12T18:38:06.357347+0000","last_undegraded":"2024-09-12T18:38:06.357347+0000","last_fullsized":"2024-09-12T18:38:06.357347+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:19.384528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369867+0000","last_change":"2024-09-12T18:35:25.668339+0000","last_active":"2024-09-12T18:38:07.369867+0000","last_peered":"2024-09-12T18:38:07.369867+0000","last_clean":"2024-09-12T18:38:07.369867+0000","last_became_active":"2024-09-12T18:35:25.667608+0000","last_became_peered":"2024-09-12T18:35:25.667608+0000","last_unstale":"2024-09-12T18:38:07.369867+0000","last_undegraded":"2024-09-12T18:38:07.369867+0000","last_fullsized":"2024-09-12T18:38:07.369867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:15.699745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367232+0000","last_change":"2024-09-12T18:38:03.358177+0000","last_active":"2024-09-12T18:38:07.367232+0000","last_peered":"2024-09-12T18:38:07.367232+0000","last_clean":"2024-09-12T18:38:07.367232+0000","last_became_active":"2024-09-12T18:38:03.357446+0000","last_became_peered":"2024-09-12T18:38:03.357446+0000","last_unstale":"2024-09-12T18:38:07.367232+0000","last_undegraded":"2024-09-12T18:38:07.367232+0000","last_fullsized":"2024-09-12T18:38:07.367232+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:13.110496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359515+0000","last_change":"2024-09-12T18:38:03.356440+0000","last_active":"2024-09-12T18:38:06.359515+0000","last_peered":"2024-09-12T18:38:06.359515+0000","last_clean":"2024-09-12T18:38:06.359515+0000","last_became_active":"2024-09-12T18:38:03.355561+0000","last_became_peered":"2024-09-12T18:38:03.355561+0000","last_unstale":"2024-09-12T18:38:06.359515+0000","last_undegraded":"2024-09-12T18:38:06.359515+0000","last_fullsized":"2024-09-12T18:38:06.359515+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:43.438258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366852+0000","last_change":"2024-09-12T18:35:25.649885+0000","last_active":"2024-09-12T18:38:07.366852+0000","last_peered":"2024-09-12T18:38:07.366852+0000","last_clean":"2024-09-12T18:38:07.366852+0000","last_became_active":"2024-09-12T18:35:25.649111+0000","last_became_peered":"2024-09-12T18:35:25.649111+0000","last_unstale":"2024-09-12T18:38:07.366852+0000","last_undegraded":"2024-09-12T18:38:07.366852+0000","last_fullsized":"2024-09-12T18:38:07.366852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:17.162410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366640+0000","last_change":"2024-09-12T18:38:03.349917+0000","last_active":"2024-09-12T18:38:07.366640+0000","last_peered":"2024-09-12T18:38:07.366640+0000","last_clean":"2024-09-12T18:38:07.366640+0000","last_became_active":"2024-09-12T18:38:03.349130+0000","last_became_peered":"2024-09-12T18:38:03.349130+0000","last_unstale":"2024-09-12T18:38:07.366640+0000","last_undegraded":"2024-09-12T18:38:07.366640+0000","last_fullsized":"2024-09-12T18:38:07.366640+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:45.548888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.357883+0000","last_change":"2024-09-12T18:35:25.657913+0000","last_active":"2024-09-12T18:38:06.357883+0000","last_peered":"2024-09-12T18:38:06.357883+0000","last_clean":"2024-09-12T18:38:06.357883+0000","last_became_active":"2024-09-12T18:35:25.657082+0000","last_became_peered":"2024-09-12T18:35:25.657082+0000","last_unstale":"2024-09-12T18:38:06.357883+0000","last_undegraded":"2024-09-12T18:38:06.357883+0000","last_fullsized":"2024-09-12T18:38:06.357883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:21.538633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.357675+0000","last_change":"2024-09-12T18:35:25.658763+0000","last_active":"2024-09-12T18:38:06.357675+0000","last_peered":"2024-09-12T18:38:06.357675+0000","last_clean":"2024-09-12T18:38:06.357675+0000","last_became_active":"2024-09-12T18:35:25.657508+0000","last_became_peered":"2024-09-12T18:35:25.657508+0000","last_unstale":"2024-09-12T18:38:06.357675+0000","last_undegraded":"2024-09-12T18:38:06.357675+0000","last_fullsized":"2024-09-12T18:38:06.357675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:13.170519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.357358+0000","last_change":"2024-09-12T18:35:25.653730+0000","last_active":"2024-09-12T18:38:06.357358+0000","last_peered":"2024-09-12T18:38:06.357358+0000","last_clean":"2024-09-12T18:38:06.357358+0000","last_became_active":"2024-09-12T18:35:25.651535+0000","last_became_peered":"2024-09-12T18:35:25.651535+0000","last_unstale":"2024-09-12T18:38:06.357358+0000","last_undegraded":"2024-09-12T18:38:06.357358+0000","last_fullsized":"2024-09-12T18:38:06.357358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.370149+0000","last_change":"2024-09-12T18:35:25.656513+0000","last_active":"2024-09-12T18:38:07.370149+0000","last_peered":"2024-09-12T18:38:07.370149+0000","last_clean":"2024-09-12T18:38:07.370149+0000","last_became_active":"2024-09-12T18:35:25.653440+0000","last_became_peered":"2024-09-12T18:35:25.653440+0000","last_unstale":"2024-09-12T18:38:07.370149+0000","last_undegraded":"2024-09-12T18:38:07.370149+0000","last_fullsized":"2024-09-12T18:38:07.370149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:18.693161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367487+0000","last_change":"2024-09-12T18:35:25.657991+0000","last_active":"2024-09-12T18:38:07.367487+0000","last_peered":"2024-09-12T18:38:07.367487+0000","last_clean":"2024-09-12T18:38:07.367487+0000","last_became_active":"2024-09-12T18:35:25.653934+0000","last_became_peered":"2024-09-12T18:35:25.653934+0000","last_unstale":"2024-09-12T18:38:07.367487+0000","last_undegraded":"2024-09-12T18:38:07.367487+0000","last_fullsized":"2024-09-12T18:38:07.367487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:05.418901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368965+0000","last_change":"2024-09-12T18:38:03.358270+0000","last_active":"2024-09-12T18:38:07.368965+0000","last_peered":"2024-09-12T18:38:07.368965+0000","last_clean":"2024-09-12T18:38:07.368965+0000","last_became_active":"2024-09-12T18:38:03.357363+0000","last_became_peered":"2024-09-12T18:38:03.357363+0000","last_unstale":"2024-09-12T18:38:07.368965+0000","last_undegraded":"2024-09-12T18:38:07.368965+0000","last_fullsized":"2024-09-12T18:38:07.368965+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:56.658700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358511+0000","last_change":"2024-09-12T18:35:25.661176+0000","last_active":"2024-09-12T18:38:06.358511+0000","last_peered":"2024-09-12T18:38:06.358511+0000","last_clean":"2024-09-12T18:38:06.358511+0000","last_became_active":"2024-09-12T18:35:25.659534+0000","last_became_peered":"2024-09-12T18:35:25.659534+0000","last_unstale":"2024-09-12T18:38:06.358511+0000","last_undegraded":"2024-09-12T18:38:06.358511+0000","last_fullsized":"2024-09-12T18:38:06.358511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:40.145442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358406+0000","last_change":"2024-09-12T18:35:25.650632+0000","last_active":"2024-09-12T18:38:06.358406+0000","last_peered":"2024-09-12T18:38:06.358406+0000","last_clean":"2024-09-12T18:38:06.358406+0000","last_became_active":"2024-09-12T18:35:25.649333+0000","last_became_peered":"2024-09-12T18:35:25.649333+0000","last_unstale":"2024-09-12T18:38:06.358406+0000","last_undegraded":"2024-09-12T18:38:06.358406+0000","last_fullsized":"2024-09-12T18:38:06.358406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:30.537572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366475+0000","last_change":"2024-09-12T18:35:25.648245+0000","last_active":"2024-09-12T18:38:07.366475+0000","last_peered":"2024-09-12T18:38:07.366475+0000","last_clean":"2024-09-12T18:38:07.366475+0000","last_became_active":"2024-09-12T18:35:25.646357+0000","last_became_peered":"2024-09-12T18:35:25.646357+0000","last_unstale":"2024-09-12T18:38:07.366475+0000","last_undegraded":"2024-09-12T18:38:07.366475+0000","last_fullsized":"2024-09-12T18:38:07.366475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:05.662140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367728+0000","last_change":"2024-09-12T18:35:25.661613+0000","last_active":"2024-09-12T18:38:07.367728+0000","last_peered":"2024-09-12T18:38:07.367728+0000","last_clean":"2024-09-12T18:38:07.367728+0000","last_became_active":"2024-09-12T18:35:25.658833+0000","last_became_peered":"2024-09-12T18:35:25.658833+0000","last_unstale":"2024-09-12T18:38:07.367728+0000","last_undegraded":"2024-09-12T18:38:07.367728+0000","last_fullsized":"2024-09-12T18:38:07.367728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:51.064080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366639+0000","last_change":"2024-09-12T18:35:25.657782+0000","last_active":"2024-09-12T18:38:07.366639+0000","last_peered":"2024-09-12T18:38:07.366639+0000","last_clean":"2024-09-12T18:38:07.366639+0000","last_became_active":"2024-09-12T18:35:25.655295+0000","last_became_peered":"2024-09-12T18:35:25.655295+0000","last_unstale":"2024-09-12T18:38:07.366639+0000","last_undegraded":"2024-09-12T18:38:07.366639+0000","last_fullsized":"2024-09-12T18:38:07.366639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:37.744175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368546+0000","last_change":"2024-09-12T18:35:25.654863+0000","last_active":"2024-09-12T18:38:07.368546+0000","last_peered":"2024-09-12T18:38:07.368546+0000","last_clean":"2024-09-12T18:38:07.368546+0000","last_became_active":"2024-09-12T18:35:25.650407+0000","last_became_peered":"2024-09-12T18:35:25.650407+0000","last_unstale":"2024-09-12T18:38:07.368546+0000","last_undegraded":"2024-09-12T18:38:07.368546+0000","last_fullsized":"2024-09-12T18:38:07.368546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:38.395666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369981+0000","last_change":"2024-09-12T18:35:25.662414+0000","last_active":"2024-09-12T18:38:07.369981+0000","last_peered":"2024-09-12T18:38:07.369981+0000","last_clean":"2024-09-12T18:38:07.369981+0000","last_became_active":"2024-09-12T18:35:25.660126+0000","last_became_peered":"2024-09-12T18:35:25.660126+0000","last_unstale":"2024-09-12T18:38:07.369981+0000","last_undegraded":"2024-09-12T18:38:07.369981+0000","last_fullsized":"2024-09-12T18:38:07.369981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:48.437139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359333+0000","last_change":"2024-09-12T18:35:25.661523+0000","last_active":"2024-09-12T18:38:06.359333+0000","last_peered":"2024-09-12T18:38:06.359333+0000","last_clean":"2024-09-12T18:38:06.359333+0000","last_became_active":"2024-09-12T18:35:25.659338+0000","last_became_peered":"2024-09-12T18:35:25.659338+0000","last_unstale":"2024-09-12T18:38:06.359333+0000","last_undegraded":"2024-09-12T18:38:06.359333+0000","last_fullsized":"2024-09-12T18:38:06.359333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:37.083820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367372+0000","last_change":"2024-09-12T18:35:25.662445+0000","last_active":"2024-09-12T18:38:07.367372+0000","last_peered":"2024-09-12T18:38:07.367372+0000","last_clean":"2024-09-12T18:38:07.367372+0000","last_became_active":"2024-09-12T18:35:25.659496+0000","last_became_peered":"2024-09-12T18:35:25.659496+0000","last_unstale":"2024-09-12T18:38:07.367372+0000","last_undegraded":"2024-09-12T18:38:07.367372+0000","last_fullsized":"2024-09-12T18:38:07.367372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:03.270420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368653+0000","last_change":"2024-09-12T18:38:03.357219+0000","last_active":"2024-09-12T18:38:07.368653+0000","last_peered":"2024-09-12T18:38:07.368653+0000","last_clean":"2024-09-12T18:38:07.368653+0000","last_became_active":"2024-09-12T18:38:03.356412+0000","last_became_peered":"2024-09-12T18:38:03.356412+0000","last_unstale":"2024-09-12T18:38:07.368653+0000","last_undegraded":"2024-09-12T18:38:07.368653+0000","last_fullsized":"2024-09-12T18:38:07.368653+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:53.007632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367404+0000","last_change":"2024-09-12T18:35:25.650507+0000","last_active":"2024-09-12T18:38:07.367404+0000","last_peered":"2024-09-12T18:38:07.367404+0000","last_clean":"2024-09-12T18:38:07.367404+0000","last_became_active":"2024-09-12T18:35:25.649415+0000","last_became_peered":"2024-09-12T18:35:25.649415+0000","last_unstale":"2024-09-12T18:38:07.367404+0000","last_undegraded":"2024-09-12T18:38:07.367404+0000","last_fullsized":"2024-09-12T18:38:07.367404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:23.081416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367879+0000","last_change":"2024-09-12T18:35:25.653949+0000","last_active":"2024-09-12T18:38:07.367879+0000","last_peered":"2024-09-12T18:38:07.367879+0000","last_clean":"2024-09-12T18:38:07.367879+0000","last_became_active":"2024-09-12T18:35:25.652992+0000","last_became_peered":"2024-09-12T18:35:25.652992+0000","last_unstale":"2024-09-12T18:38:07.367879+0000","last_undegraded":"2024-09-12T18:38:07.367879+0000","last_fullsized":"2024-09-12T18:38:07.367879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:47.687372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.357652+0000","last_change":"2024-09-12T18:38:03.356306+0000","last_active":"2024-09-12T18:38:06.357652+0000","last_peered":"2024-09-12T18:38:06.357652+0000","last_clean":"2024-09-12T18:38:06.357652+0000","last_became_active":"2024-09-12T18:38:03.355052+0000","last_became_peered":"2024-09-12T18:38:03.355052+0000","last_unstale":"2024-09-12T18:38:06.357652+0000","last_undegraded":"2024-09-12T18:38:06.357652+0000","last_fullsized":"2024-09-12T18:38:06.357652+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:54.986299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367305+0000","last_change":"2024-09-12T18:38:03.351904+0000","last_active":"2024-09-12T18:38:07.367305+0000","last_peered":"2024-09-12T18:38:07.367305+0000","last_clean":"2024-09-12T18:38:07.367305+0000","last_became_active":"2024-09-12T18:38:03.351112+0000","last_became_peered":"2024-09-12T18:38:03.351112+0000","last_unstale":"2024-09-12T18:38:07.367305+0000","last_undegraded":"2024-09-12T18:38:07.367305+0000","last_fullsized":"2024-09-12T18:38:07.367305+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:52.881469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":160,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359058+0000","last_change":"2024-09-12T18:35:24.657739+0000","last_active":"2024-09-12T18:38:06.359058+0000","last_peered":"2024-09-12T18:38:06.359058+0000","last_clean":"2024-09-12T18:38:06.359058+0000","last_became_active":"2024-09-12T18:35:24.656208+0000","last_became_peered":"2024-09-12T18:35:24.656208+0000","last_unstale":"2024-09-12T18:38:06.359058+0000","last_undegraded":"2024-09-12T18:38:06.359058+0000","last_fullsized":"2024-09-12T18:38:06.359058+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:50.073716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367762+0000","last_change":"2024-09-12T18:35:25.651651+0000","last_active":"2024-09-12T18:38:07.367762+0000","last_peered":"2024-09-12T18:38:07.367762+0000","last_clean":"2024-09-12T18:38:07.367762+0000","last_became_active":"2024-09-12T18:35:25.650849+0000","last_became_peered":"2024-09-12T18:35:25.650849+0000","last_unstale":"2024-09-12T18:38:07.367762+0000","last_undegraded":"2024-09-12T18:38:07.367762+0000","last_fullsized":"2024-09-12T18:38:07.367762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:18.555827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368934+0000","last_change":"2024-09-12T18:35:24.656119+0000","last_active":"2024-09-12T18:38:07.368934+0000","last_peered":"2024-09-12T18:38:07.368934+0000","last_clean":"2024-09-12T18:38:07.368934+0000","last_became_active":"2024-09-12T18:35:24.653175+0000","last_became_peered":"2024-09-12T18:35:24.653175+0000","last_unstale":"2024-09-12T18:38:07.368934+0000","last_undegraded":"2024-09-12T18:38:07.368934+0000","last_fullsized":"2024-09-12T18:38:07.368934+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:00.551165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369501+0000","last_change":"2024-09-12T18:38:03.356363+0000","last_active":"2024-09-12T18:38:07.369501+0000","last_peered":"2024-09-12T18:38:07.369501+0000","last_clean":"2024-09-12T18:38:07.369501+0000","last_became_active":"2024-09-12T18:38:03.354299+0000","last_became_peered":"2024-09-12T18:38:03.354299+0000","last_unstale":"2024-09-12T18:38:07.369501+0000","last_undegraded":"2024-09-12T18:38:07.369501+0000","last_fullsized":"2024-09-12T18:38:07.369501+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:40.267630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366478+0000","last_change":"2024-09-12T18:35:24.640096+0000","last_active":"2024-09-12T18:38:07.366478+0000","last_peered":"2024-09-12T18:38:07.366478+0000","last_clean":"2024-09-12T18:38:07.366478+0000","last_became_active":"2024-09-12T18:35:24.638230+0000","last_became_peered":"2024-09-12T18:35:24.638230+0000","last_unstale":"2024-09-12T18:38:07.366478+0000","last_undegraded":"2024-09-12T18:38:07.366478+0000","last_fullsized":"2024-09-12T18:38:07.366478+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:38.435296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369661+0000","last_change":"2024-09-12T18:38:03.354155+0000","last_active":"2024-09-12T18:38:07.369661+0000","last_peered":"2024-09-12T18:38:07.369661+0000","last_clean":"2024-09-12T18:38:07.369661+0000","last_became_active":"2024-09-12T18:38:03.352848+0000","last_became_peered":"2024-09-12T18:38:03.352848+0000","last_unstale":"2024-09-12T18:38:07.369661+0000","last_undegraded":"2024-09-12T18:38:07.369661+0000","last_fullsized":"2024-09-12T18:38:07.369661+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:36.825717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":166,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.357827+0000","last_change":"2024-09-12T18:35:24.653610+0000","last_active":"2024-09-12T18:38:06.357827+0000","last_peered":"2024-09-12T18:38:06.357827+0000","last_clean":"2024-09-12T18:38:06.357827+0000","last_became_active":"2024-09-12T18:35:24.652880+0000","last_became_peered":"2024-09-12T18:35:24.652880+0000","last_unstale":"2024-09-12T18:38:06.357827+0000","last_undegraded":"2024-09-12T18:38:06.357827+0000","last_fullsized":"2024-09-12T18:38:06.357827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:57.636251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":159,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359825+0000","last_change":"2024-09-12T18:35:24.653465+0000","last_active":"2024-09-12T18:38:06.359825+0000","last_peered":"2024-09-12T18:38:06.359825+0000","last_clean":"2024-09-12T18:38:06.359825+0000","last_became_active":"2024-09-12T18:35:24.652792+0000","last_became_peered":"2024-09-12T18:35:24.652792+0000","last_unstale":"2024-09-12T18:38:06.359825+0000","last_undegraded":"2024-09-12T18:38:06.359825+0000","last_fullsized":"2024-09-12T18:38:06.359825+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:14.588993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366949+0000","last_change":"2024-09-12T18:35:25.655426+0000","last_active":"2024-09-12T18:38:07.366949+0000","last_peered":"2024-09-12T18:38:07.366949+0000","last_clean":"2024-09-12T18:38:07.366949+0000","last_became_active":"2024-09-12T18:35:25.648186+0000","last_became_peered":"2024-09-12T18:35:25.648186+0000","last_unstale":"2024-09-12T18:38:07.366949+0000","last_undegraded":"2024-09-12T18:38:07.366949+0000","last_fullsized":"2024-09-12T18:38:07.366949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:48.802815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367913+0000","last_change":"2024-09-12T18:35:24.648439+0000","last_active":"2024-09-12T18:38:07.367913+0000","last_peered":"2024-09-12T18:38:07.367913+0000","last_clean":"2024-09-12T18:38:07.367913+0000","last_became_active":"2024-09-12T18:35:24.647629+0000","last_became_peered":"2024-09-12T18:35:24.647629+0000","last_unstale":"2024-09-12T18:38:07.367913+0000","last_undegraded":"2024-09-12T18:38:07.367913+0000","last_fullsized":"2024-09-12T18:38:07.367913+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:45.428223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366148+0000","last_change":"2024-09-12T18:35:25.652496+0000","last_active":"2024-09-12T18:38:07.366148+0000","last_peered":"2024-09-12T18:38:07.366148+0000","last_clean":"2024-09-12T18:38:07.366148+0000","last_became_active":"2024-09-12T18:35:25.651628+0000","last_became_peered":"2024-09-12T18:35:25.651628+0000","last_unstale":"2024-09-12T18:38:07.366148+0000","last_undegraded":"2024-09-12T18:38:07.366148+0000","last_fullsized":"2024-09-12T18:38:07.366148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:44.920448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":159,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358446+0000","last_change":"2024-09-12T18:35:24.654976+0000","last_active":"2024-09-12T18:38:06.358446+0000","last_peered":"2024-09-12T18:38:06.358446+0000","last_clean":"2024-09-12T18:38:06.358446+0000","last_became_active":"2024-09-12T18:35:24.654264+0000","last_became_peered":"2024-09-12T18:35:24.654264+0000","last_unstale":"2024-09-12T18:38:06.358446+0000","last_undegraded":"2024-09-12T18:38:06.358446+0000","last_fullsized":"2024-09-12T18:38:06.358446+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:00.115408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358046+0000","last_change":"2024-09-12T18:38:03.365901+0000","last_active":"2024-09-12T18:38:06.358046+0000","last_peered":"2024-09-12T18:38:06.358046+0000","last_clean":"2024-09-12T18:38:06.358046+0000","last_became_active":"2024-09-12T18:38:03.364754+0000","last_became_peered":"2024-09-12T18:38:03.364754+0000","last_unstale":"2024-09-12T18:38:06.358046+0000","last_undegraded":"2024-09-12T18:38:06.358046+0000","last_fullsized":"2024-09-12T18:38:06.358046+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:43.078837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":158,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359087+0000","last_change":"2024-09-12T18:35:24.657665+0000","last_active":"2024-09-12T18:38:06.359087+0000","last_peered":"2024-09-12T18:38:06.359087+0000","last_clean":"2024-09-12T18:38:06.359087+0000","last_became_active":"2024-09-12T18:35:24.657015+0000","last_became_peered":"2024-09-12T18:35:24.657015+0000","last_unstale":"2024-09-12T18:38:06.359087+0000","last_undegraded":"2024-09-12T18:38:06.359087+0000","last_fullsized":"2024-09-12T18:38:06.359087+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:03.171326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368567+0000","last_change":"2024-09-12T18:35:25.665275+0000","last_active":"2024-09-12T18:38:07.368567+0000","last_peered":"2024-09-12T18:38:07.368567+0000","last_clean":"2024-09-12T18:38:07.368567+0000","last_became_active":"2024-09-12T18:35:25.659511+0000","last_became_peered":"2024-09-12T18:35:25.659511+0000","last_unstale":"2024-09-12T18:38:07.368567+0000","last_undegraded":"2024-09-12T18:38:07.368567+0000","last_fullsized":"2024-09-12T18:38:07.368567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368912+0000","last_change":"2024-09-12T18:38:03.384365+0000","last_active":"2024-09-12T18:38:07.368912+0000","last_peered":"2024-09-12T18:38:07.368912+0000","last_clean":"2024-09-12T18:38:07.368912+0000","last_became_active":"2024-09-12T18:38:03.364147+0000","last_became_peered":"2024-09-12T18:38:03.364147+0000","last_unstale":"2024-09-12T18:38:07.368912+0000","last_undegraded":"2024-09-12T18:38:07.368912+0000","last_fullsized":"2024-09-12T18:38:07.368912+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:05.965891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358810+0000","last_change":"2024-09-12T18:38:03.356255+0000","last_active":"2024-09-12T18:38:06.358810+0000","last_peered":"2024-09-12T18:38:06.358810+0000","last_clean":"2024-09-12T18:38:06.358810+0000","last_became_active":"2024-09-12T18:38:03.355310+0000","last_became_peered":"2024-09-12T18:38:03.355310+0000","last_unstale":"2024-09-12T18:38:06.358810+0000","last_undegraded":"2024-09-12T18:38:06.358810+0000","last_fullsized":"2024-09-12T18:38:06.358810+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:21.097039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":158,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358549+0000","last_change":"2024-09-12T18:35:24.659019+0000","last_active":"2024-09-12T18:38:06.358549+0000","last_peered":"2024-09-12T18:38:06.358549+0000","last_clean":"2024-09-12T18:38:06.358549+0000","last_became_active":"2024-09-12T18:35:24.658423+0000","last_became_peered":"2024-09-12T18:35:24.658423+0000","last_unstale":"2024-09-12T18:38:06.358549+0000","last_undegraded":"2024-09-12T18:38:06.358549+0000","last_fullsized":"2024-09-12T18:38:06.358549+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:37.668417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359018+0000","last_change":"2024-09-12T18:35:25.662287+0000","last_active":"2024-09-12T18:38:06.359018+0000","last_peered":"2024-09-12T18:38:06.359018+0000","last_clean":"2024-09-12T18:38:06.359018+0000","last_became_active":"2024-09-12T18:35:25.660372+0000","last_became_peered":"2024-09-12T18:35:25.660372+0000","last_unstale":"2024-09-12T18:38:06.359018+0000","last_undegraded":"2024-09-12T18:38:06.359018+0000","last_fullsized":"2024-09-12T18:38:06.359018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:08.729541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366544+0000","last_change":"2024-09-12T18:35:24.648330+0000","last_active":"2024-09-12T18:38:07.366544+0000","last_peered":"2024-09-12T18:38:07.366544+0000","last_clean":"2024-09-12T18:38:07.366544+0000","last_became_active":"2024-09-12T18:35:24.647520+0000","last_became_peered":"2024-09-12T18:35:24.647520+0000","last_unstale":"2024-09-12T18:38:07.366544+0000","last_undegraded":"2024-09-12T18:38:07.366544+0000","last_fullsized":"2024-09-12T18:38:07.366544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:25.552055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359547+0000","last_change":"2024-09-12T18:35:25.658674+0000","last_active":"2024-09-12T18:38:06.359547+0000","last_peered":"2024-09-12T18:38:06.359547+0000","last_clean":"2024-09-12T18:38:06.359547+0000","last_became_active":"2024-09-12T18:35:25.657386+0000","last_became_peered":"2024-09-12T18:35:25.657386+0000","last_unstale":"2024-09-12T18:38:06.359547+0000","last_undegraded":"2024-09-12T18:38:06.359547+0000","last_fullsized":"2024-09-12T18:38:06.359547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:48.037086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366112+0000","last_change":"2024-09-12T18:35:24.646810+0000","last_active":"2024-09-12T18:38:07.366112+0000","last_peered":"2024-09-12T18:38:07.366112+0000","last_clean":"2024-09-12T18:38:07.366112+0000","last_became_active":"2024-09-12T18:35:24.646008+0000","last_became_peered":"2024-09-12T18:35:24.646008+0000","last_unstale":"2024-09-12T18:38:07.366112+0000","last_undegraded":"2024-09-12T18:38:07.366112+0000","last_fullsized":"2024-09-12T18:38:07.366112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:43.888776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369934+0000","last_change":"2024-09-12T18:35:25.667710+0000","last_active":"2024-09-12T18:38:07.369934+0000","last_peered":"2024-09-12T18:38:07.369934+0000","last_clean":"2024-09-12T18:38:07.369934+0000","last_became_active":"2024-09-12T18:35:25.666940+0000","last_became_peered":"2024-09-12T18:35:25.666940+0000","last_unstale":"2024-09-12T18:38:07.369934+0000","last_undegraded":"2024-09-12T18:38:07.369934+0000","last_fullsized":"2024-09-12T18:38:07.369934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:09.823085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":308,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358400+0000","last_change":"2024-09-12T18:35:13.489018+0000","last_active":"2024-09-12T18:38:06.358400+0000","last_peered":"2024-09-12T18:38:06.358400+0000","last_clean":"2024-09-12T18:38:06.358400+0000","last_became_active":"2024-09-12T18:35:13.488346+0000","last_became_peered":"2024-09-12T18:35:13.488346+0000","last_unstale":"2024-09-12T18:38:06.358400+0000","last_undegraded":"2024-09-12T18:38:06.358400+0000","last_fullsized":"2024-09-12T18:38:06.358400+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_clean_scrub_stamp":"2024-09-12T18:35:12.464628+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:54.864640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":172,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359336+0000","last_change":"2024-09-12T18:35:22.459694+0000","last_active":"2024-09-12T18:38:06.359336+0000","last_peered":"2024-09-12T18:38:06.359336+0000","last_clean":"2024-09-12T18:38:06.359336+0000","last_became_active":"2024-09-12T18:35:20.446796+0000","last_became_peered":"2024-09-12T18:35:20.446796+0000","last_unstale":"2024-09-12T18:38:06.359336+0000","last_undegraded":"2024-09-12T18:38:06.359336+0000","last_fullsized":"2024-09-12T18:38:06.359336+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:21.506024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016291610000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368143+0000","last_change":"2024-09-12T18:38:03.354554+0000","last_active":"2024-09-12T18:38:07.368143+0000","last_peered":"2024-09-12T18:38:07.368143+0000","last_clean":"2024-09-12T18:38:07.368143+0000","last_became_active":"2024-09-12T18:38:03.353661+0000","last_became_peered":"2024-09-12T18:38:03.353661+0000","last_unstale":"2024-09-12T18:38:07.368143+0000","last_undegraded":"2024-09-12T18:38:07.368143+0000","last_fullsized":"2024-09-12T18:38:07.368143+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:27.835210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359041+0000","last_change":"2024-09-12T18:35:25.662424+0000","last_active":"2024-09-12T18:38:06.359041+0000","last_peered":"2024-09-12T18:38:06.359041+0000","last_clean":"2024-09-12T18:38:06.359041+0000","last_became_active":"2024-09-12T18:35:25.661043+0000","last_became_peered":"2024-09-12T18:35:25.661043+0000","last_unstale":"2024-09-12T18:38:06.359041+0000","last_undegraded":"2024-09-12T18:38:06.359041+0000","last_fullsized":"2024-09-12T18:38:06.359041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:52.551802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":171,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358322+0000","last_change":"2024-09-12T18:35:22.459090+0000","last_active":"2024-09-12T18:38:06.358322+0000","last_peered":"2024-09-12T18:38:06.358322+0000","last_clean":"2024-09-12T18:38:06.358322+0000","last_became_active":"2024-09-12T18:35:20.448553+0000","last_became_peered":"2024-09-12T18:35:20.448553+0000","last_unstale":"2024-09-12T18:38:06.358322+0000","last_undegraded":"2024-09-12T18:38:06.358322+0000","last_fullsized":"2024-09-12T18:38:06.358322+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:56.834808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001030836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368423+0000","last_change":"2024-09-12T18:35:24.651597+0000","last_active":"2024-09-12T18:38:07.368423+0000","last_peered":"2024-09-12T18:38:07.368423+0000","last_clean":"2024-09-12T18:38:07.368423+0000","last_became_active":"2024-09-12T18:35:24.649940+0000","last_became_peered":"2024-09-12T18:35:24.649940+0000","last_unstale":"2024-09-12T18:38:07.368423+0000","last_undegraded":"2024-09-12T18:38:07.368423+0000","last_fullsized":"2024-09-12T18:38:07.368423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:36.822432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367752+0000","last_change":"2024-09-12T18:38:03.358588+0000","last_active":"2024-09-12T18:38:07.367752+0000","last_peered":"2024-09-12T18:38:07.367752+0000","last_clean":"2024-09-12T18:38:07.367752+0000","last_became_active":"2024-09-12T18:38:03.357664+0000","last_became_peered":"2024-09-12T18:38:03.357664+0000","last_unstale":"2024-09-12T18:38:07.367752+0000","last_undegraded":"2024-09-12T18:38:07.367752+0000","last_fullsized":"2024-09-12T18:38:07.367752+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:02.273189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368624+0000","last_change":"2024-09-12T18:35:22.464179+0000","last_active":"2024-09-12T18:38:07.368624+0000","last_peered":"2024-09-12T18:38:07.368624+0000","last_clean":"2024-09-12T18:38:07.368624+0000","last_became_active":"2024-09-12T18:35:20.442613+0000","last_became_peered":"2024-09-12T18:35:20.442613+0000","last_unstale":"2024-09-12T18:38:07.368624+0000","last_undegraded":"2024-09-12T18:38:07.368624+0000","last_fullsized":"2024-09-12T18:38:07.368624+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:17.636537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014134620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366112+0000","last_change":"2024-09-12T18:35:24.641297+0000","last_active":"2024-09-12T18:38:07.366112+0000","last_peered":"2024-09-12T18:38:07.366112+0000","last_clean":"2024-09-12T18:38:07.366112+0000","last_became_active":"2024-09-12T18:35:24.637334+0000","last_became_peered":"2024-09-12T18:35:24.637334+0000","last_unstale":"2024-09-12T18:38:07.366112+0000","last_undegraded":"2024-09-12T18:38:07.366112+0000","last_fullsized":"2024-09-12T18:38:07.366112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:50.772074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369805+0000","last_change":"2024-09-12T18:38:03.360352+0000","last_active":"2024-09-12T18:38:07.369805+0000","last_peered":"2024-09-12T18:38:07.369805+0000","last_clean":"2024-09-12T18:38:07.369805+0000","last_became_active":"2024-09-12T18:38:03.359452+0000","last_became_peered":"2024-09-12T18:38:03.359452+0000","last_unstale":"2024-09-12T18:38:07.369805+0000","last_undegraded":"2024-09-12T18:38:07.369805+0000","last_fullsized":"2024-09-12T18:38:07.369805+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:48.036394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":173,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358697+0000","last_change":"2024-09-12T18:35:22.459049+0000","last_active":"2024-09-12T18:38:06.358697+0000","last_peered":"2024-09-12T18:38:06.358697+0000","last_clean":"2024-09-12T18:38:06.358697+0000","last_became_active":"2024-09-12T18:35:20.446814+0000","last_became_peered":"2024-09-12T18:35:20.446814+0000","last_unstale":"2024-09-12T18:38:06.358697+0000","last_undegraded":"2024-09-12T18:38:06.358697+0000","last_fullsized":"2024-09-12T18:38:06.358697+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:18.033595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010716149999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":158,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359121+0000","last_change":"2024-09-12T18:35:24.658273+0000","last_active":"2024-09-12T18:38:06.359121+0000","last_peered":"2024-09-12T18:38:06.359121+0000","last_clean":"2024-09-12T18:38:06.359121+0000","last_became_active":"2024-09-12T18:35:24.657433+0000","last_became_peered":"2024-09-12T18:35:24.657433+0000","last_unstale":"2024-09-12T18:38:06.359121+0000","last_undegraded":"2024-09-12T18:38:06.359121+0000","last_fullsized":"2024-09-12T18:38:06.359121+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:48.497218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369135+0000","last_change":"2024-09-12T18:38:03.358304+0000","last_active":"2024-09-12T18:38:07.369135+0000","last_peered":"2024-09-12T18:38:07.369135+0000","last_clean":"2024-09-12T18:38:07.369135+0000","last_became_active":"2024-09-12T18:38:03.357592+0000","last_became_peered":"2024-09-12T18:38:03.357592+0000","last_unstale":"2024-09-12T18:38:07.369135+0000","last_undegraded":"2024-09-12T18:38:07.369135+0000","last_fullsized":"2024-09-12T18:38:07.369135+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:45.610260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":158,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358064+0000","last_change":"2024-09-12T18:35:24.657618+0000","last_active":"2024-09-12T18:38:06.358064+0000","last_peered":"2024-09-12T18:38:06.358064+0000","last_clean":"2024-09-12T18:38:06.358064+0000","last_became_active":"2024-09-12T18:35:24.656741+0000","last_became_peered":"2024-09-12T18:35:24.656741+0000","last_unstale":"2024-09-12T18:38:06.358064+0000","last_undegraded":"2024-09-12T18:38:06.358064+0000","last_fullsized":"2024-09-12T18:38:06.358064+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:43.113104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369480+0000","last_change":"2024-09-12T18:35:22.464180+0000","last_active":"2024-09-12T18:38:07.369480+0000","last_peered":"2024-09-12T18:38:07.369480+0000","last_clean":"2024-09-12T18:38:07.369480+0000","last_became_active":"2024-09-12T18:35:20.442566+0000","last_became_peered":"2024-09-12T18:35:20.442566+0000","last_unstale":"2024-09-12T18:38:07.369480+0000","last_undegraded":"2024-09-12T18:38:07.369480+0000","last_fullsized":"2024-09-12T18:38:07.369480+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:29.021710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001325786,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366700+0000","last_change":"2024-09-12T18:35:25.650458+0000","last_active":"2024-09-12T18:38:07.366700+0000","last_peered":"2024-09-12T18:38:07.366700+0000","last_clean":"2024-09-12T18:38:07.366700+0000","last_became_active":"2024-09-12T18:35:25.648761+0000","last_became_peered":"2024-09-12T18:35:25.648761+0000","last_unstale":"2024-09-12T18:38:07.366700+0000","last_undegraded":"2024-09-12T18:38:07.366700+0000","last_fullsized":"2024-09-12T18:38:07.366700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:53.026950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369129+0000","last_change":"2024-09-12T18:38:03.357887+0000","last_active":"2024-09-12T18:38:07.369129+0000","last_peered":"2024-09-12T18:38:07.369129+0000","last_clean":"2024-09-12T18:38:07.369129+0000","last_became_active":"2024-09-12T18:38:03.356816+0000","last_became_peered":"2024-09-12T18:38:03.356816+0000","last_unstale":"2024-09-12T18:38:07.369129+0000","last_undegraded":"2024-09-12T18:38:07.369129+0000","last_fullsized":"2024-09-12T18:38:07.369129+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:09.458196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":185,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366644+0000","last_change":"2024-09-12T18:38:03.351352+0000","last_active":"2024-09-12T18:38:07.366644+0000","last_peered":"2024-09-12T18:38:07.366644+0000","last_clean":"2024-09-12T18:38:07.366644+0000","last_became_active":"2024-09-12T18:38:03.350774+0000","last_became_peered":"2024-09-12T18:38:03.350774+0000","last_unstale":"2024-09-12T18:38:07.366644+0000","last_undegraded":"2024-09-12T18:38:07.366644+0000","last_fullsized":"2024-09-12T18:38:07.366644+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:30.555373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080163599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366902+0000","last_change":"2024-09-12T18:35:25.650717+0000","last_active":"2024-09-12T18:38:07.366902+0000","last_peered":"2024-09-12T18:38:07.366902+0000","last_clean":"2024-09-12T18:38:07.366902+0000","last_became_active":"2024-09-12T18:35:25.649147+0000","last_became_peered":"2024-09-12T18:35:25.649147+0000","last_unstale":"2024-09-12T18:38:07.366902+0000","last_undegraded":"2024-09-12T18:38:07.366902+0000","last_fullsized":"2024-09-12T18:38:07.366902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:07.365888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.370288+0000","last_change":"2024-09-12T18:35:24.657234+0000","last_active":"2024-09-12T18:38:07.370288+0000","last_peered":"2024-09-12T18:38:07.370288+0000","last_clean":"2024-09-12T18:38:07.370288+0000","last_became_active":"2024-09-12T18:35:24.655950+0000","last_became_peered":"2024-09-12T18:35:24.655950+0000","last_unstale":"2024-09-12T18:38:07.370288+0000","last_undegraded":"2024-09-12T18:38:07.370288+0000","last_fullsized":"2024-09-12T18:38:07.370288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:17.466623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359037+0000","last_change":"2024-09-12T18:37:34.258443+0000","last_active":"2024-09-12T18:38:06.359037+0000","last_peered":"2024-09-12T18:38:06.359037+0000","last_clean":"2024-09-12T18:38:06.359037+0000","last_became_active":"2024-09-12T18:37:34.254999+0000","last_became_peered":"2024-09-12T18:37:34.254999+0000","last_unstale":"2024-09-12T18:38:06.359037+0000","last_undegraded":"2024-09-12T18:38:06.359037+0000","last_fullsized":"2024-09-12T18:38:06.359037+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:23.164676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367719+0000","last_change":"2024-09-12T18:38:03.358177+0000","last_active":"2024-09-12T18:38:07.367719+0000","last_peered":"2024-09-12T18:38:07.367719+0000","last_clean":"2024-09-12T18:38:07.367719+0000","last_became_active":"2024-09-12T18:38:03.354895+0000","last_became_peered":"2024-09-12T18:38:03.354895+0000","last_unstale":"2024-09-12T18:38:07.367719+0000","last_undegraded":"2024-09-12T18:38:07.367719+0000","last_fullsized":"2024-09-12T18:38:07.367719+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:16.208815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369642+0000","last_change":"2024-09-12T18:38:03.370898+0000","last_active":"2024-09-12T18:38:07.369642+0000","last_peered":"2024-09-12T18:38:07.369642+0000","last_clean":"2024-09-12T18:38:07.369642+0000","last_became_active":"2024-09-12T18:38:03.354684+0000","last_became_peered":"2024-09-12T18:38:03.354684+0000","last_unstale":"2024-09-12T18:38:07.369642+0000","last_undegraded":"2024-09-12T18:38:07.369642+0000","last_fullsized":"2024-09-12T18:38:07.369642+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:27.684565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":171,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359956+0000","last_change":"2024-09-12T18:35:22.459767+0000","last_active":"2024-09-12T18:38:06.359956+0000","last_peered":"2024-09-12T18:38:06.359956+0000","last_clean":"2024-09-12T18:38:06.359956+0000","last_became_active":"2024-09-12T18:35:20.448521+0000","last_became_peered":"2024-09-12T18:35:20.448521+0000","last_unstale":"2024-09-12T18:38:06.359956+0000","last_undegraded":"2024-09-12T18:38:06.359956+0000","last_fullsized":"2024-09-12T18:38:06.359956+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:33.463792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017009670000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366127+0000","last_change":"2024-09-12T18:35:25.648150+0000","last_active":"2024-09-12T18:38:07.366127+0000","last_peered":"2024-09-12T18:38:07.366127+0000","last_clean":"2024-09-12T18:38:07.366127+0000","last_became_active":"2024-09-12T18:35:25.647347+0000","last_became_peered":"2024-09-12T18:35:25.647347+0000","last_unstale":"2024-09-12T18:38:07.366127+0000","last_undegraded":"2024-09-12T18:38:07.366127+0000","last_fullsized":"2024-09-12T18:38:07.366127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:48.968336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358735+0000","last_change":"2024-09-12T18:35:25.660696+0000","last_active":"2024-09-12T18:38:06.358735+0000","last_peered":"2024-09-12T18:38:06.358735+0000","last_clean":"2024-09-12T18:38:06.358735+0000","last_became_active":"2024-09-12T18:35:25.659827+0000","last_became_peered":"2024-09-12T18:35:25.659827+0000","last_unstale":"2024-09-12T18:38:06.358735+0000","last_undegraded":"2024-09-12T18:38:06.358735+0000","last_fullsized":"2024-09-12T18:38:06.358735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:15.678289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":164,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359083+0000","last_change":"2024-09-12T18:35:24.655051+0000","last_active":"2024-09-12T18:38:06.359083+0000","last_peered":"2024-09-12T18:38:06.359083+0000","last_clean":"2024-09-12T18:38:06.359083+0000","last_became_active":"2024-09-12T18:35:24.654282+0000","last_became_peered":"2024-09-12T18:35:24.654282+0000","last_unstale":"2024-09-12T18:38:06.359083+0000","last_undegraded":"2024-09-12T18:38:06.359083+0000","last_fullsized":"2024-09-12T18:38:06.359083+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:08.159799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368447+0000","last_change":"2024-09-12T18:38:03.355018+0000","last_active":"2024-09-12T18:38:07.368447+0000","last_peered":"2024-09-12T18:38:07.368447+0000","last_clean":"2024-09-12T18:38:07.368447+0000","last_became_active":"2024-09-12T18:38:03.354064+0000","last_became_peered":"2024-09-12T18:38:03.354064+0000","last_unstale":"2024-09-12T18:38:07.368447+0000","last_undegraded":"2024-09-12T18:38:07.368447+0000","last_fullsized":"2024-09-12T18:38:07.368447+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:18.297083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":163,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367123+0000","last_change":"2024-09-12T18:35:24.648658+0000","last_active":"2024-09-12T18:38:07.367123+0000","last_peered":"2024-09-12T18:38:07.367123+0000","last_clean":"2024-09-12T18:38:07.367123+0000","last_became_active":"2024-09-12T18:35:24.647826+0000","last_became_peered":"2024-09-12T18:35:24.647826+0000","last_unstale":"2024-09-12T18:38:07.367123+0000","last_undegraded":"2024-09-12T18:38:07.367123+0000","last_fullsized":"2024-09-12T18:38:07.367123+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:24.167549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.359951+0000","last_change":"2024-09-12T18:38:03.366378+0000","last_active":"2024-09-12T18:38:06.359951+0000","last_peered":"2024-09-12T18:38:06.359951+0000","last_clean":"2024-09-12T18:38:06.359951+0000","last_became_active":"2024-09-12T18:38:03.364887+0000","last_became_peered":"2024-09-12T18:38:03.364887+0000","last_unstale":"2024-09-12T18:38:06.359951+0000","last_undegraded":"2024-09-12T18:38:06.359951+0000","last_fullsized":"2024-09-12T18:38:06.359951+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:54.490659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368005+0000","last_change":"2024-09-12T18:35:25.661801+0000","last_active":"2024-09-12T18:38:07.368005+0000","last_peered":"2024-09-12T18:38:07.368005+0000","last_clean":"2024-09-12T18:38:07.368005+0000","last_became_active":"2024-09-12T18:35:25.658476+0000","last_became_peered":"2024-09-12T18:35:25.658476+0000","last_unstale":"2024-09-12T18:38:07.368005+0000","last_undegraded":"2024-09-12T18:38:07.368005+0000","last_fullsized":"2024-09-12T18:38:07.368005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:58.246449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.370140+0000","last_change":"2024-09-12T18:35:24.652399+0000","last_active":"2024-09-12T18:38:07.370140+0000","last_peered":"2024-09-12T18:38:07.370140+0000","last_clean":"2024-09-12T18:38:07.370140+0000","last_became_active":"2024-09-12T18:35:24.651416+0000","last_became_peered":"2024-09-12T18:35:24.651416+0000","last_unstale":"2024-09-12T18:38:07.370140+0000","last_undegraded":"2024-09-12T18:38:07.370140+0000","last_fullsized":"2024-09-12T18:38:07.370140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:32.594978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367773+0000","last_change":"2024-09-12T18:38:03.359924+0000","last_active":"2024-09-12T18:38:07.367773+0000","last_peered":"2024-09-12T18:38:07.367773+0000","last_clean":"2024-09-12T18:38:07.367773+0000","last_became_active":"2024-09-12T18:38:03.357598+0000","last_became_peered":"2024-09-12T18:38:03.357598+0000","last_unstale":"2024-09-12T18:38:07.367773+0000","last_undegraded":"2024-09-12T18:38:07.367773+0000","last_fullsized":"2024-09-12T18:38:07.367773+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:59.501652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368603+0000","last_change":"2024-09-12T18:35:25.651217+0000","last_active":"2024-09-12T18:38:07.368603+0000","last_peered":"2024-09-12T18:38:07.368603+0000","last_clean":"2024-09-12T18:38:07.368603+0000","last_became_active":"2024-09-12T18:35:25.649544+0000","last_became_peered":"2024-09-12T18:35:25.649544+0000","last_unstale":"2024-09-12T18:38:07.368603+0000","last_undegraded":"2024-09-12T18:38:07.368603+0000","last_fullsized":"2024-09-12T18:38:07.368603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:41.601376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367616+0000","last_change":"2024-09-12T18:38:03.349281+0000","last_active":"2024-09-12T18:38:07.367616+0000","last_peered":"2024-09-12T18:38:07.367616+0000","last_clean":"2024-09-12T18:38:07.367616+0000","last_became_active":"2024-09-12T18:38:03.347483+0000","last_became_peered":"2024-09-12T18:38:03.347483+0000","last_unstale":"2024-09-12T18:38:07.367616+0000","last_undegraded":"2024-09-12T18:38:07.367616+0000","last_fullsized":"2024-09-12T18:38:07.367616+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:02.283482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369856+0000","last_change":"2024-09-12T18:35:25.661544+0000","last_active":"2024-09-12T18:38:07.369856+0000","last_peered":"2024-09-12T18:38:07.369856+0000","last_clean":"2024-09-12T18:38:07.369856+0000","last_became_active":"2024-09-12T18:35:25.656985+0000","last_became_peered":"2024-09-12T18:35:25.656985+0000","last_unstale":"2024-09-12T18:38:07.369856+0000","last_undegraded":"2024-09-12T18:38:07.369856+0000","last_fullsized":"2024-09-12T18:38:07.369856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368189+0000","last_change":"2024-09-12T18:38:03.352648+0000","last_active":"2024-09-12T18:38:07.368189+0000","last_peered":"2024-09-12T18:38:07.368189+0000","last_clean":"2024-09-12T18:38:07.368189+0000","last_became_active":"2024-09-12T18:38:03.351740+0000","last_became_peered":"2024-09-12T18:38:03.351740+0000","last_unstale":"2024-09-12T18:38:07.368189+0000","last_undegraded":"2024-09-12T18:38:07.368189+0000","last_fullsized":"2024-09-12T18:38:07.368189+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:13.765236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368265+0000","last_change":"2024-09-12T18:35:25.656712+0000","last_active":"2024-09-12T18:38:07.368265+0000","last_peered":"2024-09-12T18:38:07.368265+0000","last_clean":"2024-09-12T18:38:07.368265+0000","last_became_active":"2024-09-12T18:35:25.654473+0000","last_became_peered":"2024-09-12T18:35:25.654473+0000","last_unstale":"2024-09-12T18:38:07.368265+0000","last_undegraded":"2024-09-12T18:38:07.368265+0000","last_fullsized":"2024-09-12T18:38:07.368265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:01.464680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":161,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367676+0000","last_change":"2024-09-12T18:35:24.659935+0000","last_active":"2024-09-12T18:38:07.367676+0000","last_peered":"2024-09-12T18:38:07.367676+0000","last_clean":"2024-09-12T18:38:07.367676+0000","last_became_active":"2024-09-12T18:35:24.659111+0000","last_became_peered":"2024-09-12T18:35:24.659111+0000","last_unstale":"2024-09-12T18:38:07.367676+0000","last_undegraded":"2024-09-12T18:38:07.367676+0000","last_fullsized":"2024-09-12T18:38:07.367676+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:11.480154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367022+0000","last_change":"2024-09-12T18:38:03.351609+0000","last_active":"2024-09-12T18:38:07.367022+0000","last_peered":"2024-09-12T18:38:07.367022+0000","last_clean":"2024-09-12T18:38:07.367022+0000","last_became_active":"2024-09-12T18:38:03.350972+0000","last_became_peered":"2024-09-12T18:38:03.350972+0000","last_unstale":"2024-09-12T18:38:07.367022+0000","last_undegraded":"2024-09-12T18:38:07.367022+0000","last_fullsized":"2024-09-12T18:38:07.367022+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:15.351880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":161,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367876+0000","last_change":"2024-09-12T18:35:24.638538+0000","last_active":"2024-09-12T18:38:07.367876+0000","last_peered":"2024-09-12T18:38:07.367876+0000","last_clean":"2024-09-12T18:38:07.367876+0000","last_became_active":"2024-09-12T18:35:24.637242+0000","last_became_peered":"2024-09-12T18:35:24.637242+0000","last_unstale":"2024-09-12T18:38:07.367876+0000","last_undegraded":"2024-09-12T18:38:07.367876+0000","last_fullsized":"2024-09-12T18:38:07.367876+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:26.877441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358498+0000","last_change":"2024-09-12T18:35:25.662537+0000","last_active":"2024-09-12T18:38:06.358498+0000","last_peered":"2024-09-12T18:38:06.358498+0000","last_clean":"2024-09-12T18:38:06.358498+0000","last_became_active":"2024-09-12T18:35:25.661441+0000","last_became_peered":"2024-09-12T18:35:25.661441+0000","last_unstale":"2024-09-12T18:38:06.358498+0000","last_undegraded":"2024-09-12T18:38:06.358498+0000","last_fullsized":"2024-09-12T18:38:06.358498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:14.397867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":180,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358818+0000","last_change":"2024-09-12T18:38:03.369857+0000","last_active":"2024-09-12T18:38:06.358818+0000","last_peered":"2024-09-12T18:38:06.358818+0000","last_clean":"2024-09-12T18:38:06.358818+0000","last_became_active":"2024-09-12T18:38:03.355520+0000","last_became_peered":"2024-09-12T18:38:03.355520+0000","last_unstale":"2024-09-12T18:38:06.358818+0000","last_undegraded":"2024-09-12T18:38:06.358818+0000","last_fullsized":"2024-09-12T18:38:06.358818+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:28.637798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358482+0000","last_change":"2024-09-12T18:35:25.651406+0000","last_active":"2024-09-12T18:38:06.358482+0000","last_peered":"2024-09-12T18:38:06.358482+0000","last_clean":"2024-09-12T18:38:06.358482+0000","last_became_active":"2024-09-12T18:35:25.649728+0000","last_became_peered":"2024-09-12T18:35:25.649728+0000","last_unstale":"2024-09-12T18:38:06.358482+0000","last_undegraded":"2024-09-12T18:38:06.358482+0000","last_fullsized":"2024-09-12T18:38:06.358482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:41.773283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368047+0000","last_change":"2024-09-12T18:35:24.649153+0000","last_active":"2024-09-12T18:38:07.368047+0000","last_peered":"2024-09-12T18:38:07.368047+0000","last_clean":"2024-09-12T18:38:07.368047+0000","last_became_active":"2024-09-12T18:35:24.648512+0000","last_became_peered":"2024-09-12T18:35:24.648512+0000","last_unstale":"2024-09-12T18:38:07.368047+0000","last_undegraded":"2024-09-12T18:38:07.368047+0000","last_fullsized":"2024-09-12T18:38:07.368047+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:07.810456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366854+0000","last_change":"2024-09-12T18:35:25.656799+0000","last_active":"2024-09-12T18:38:07.366854+0000","last_peered":"2024-09-12T18:38:07.366854+0000","last_clean":"2024-09-12T18:38:07.366854+0000","last_became_active":"2024-09-12T18:35:25.654980+0000","last_became_peered":"2024-09-12T18:35:25.654980+0000","last_unstale":"2024-09-12T18:38:07.366854+0000","last_undegraded":"2024-09-12T18:38:07.366854+0000","last_fullsized":"2024-09-12T18:38:07.366854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:10.735439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":161,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.370189+0000","last_change":"2024-09-12T18:35:24.656268+0000","last_active":"2024-09-12T18:38:07.370189+0000","last_peered":"2024-09-12T18:38:07.370189+0000","last_clean":"2024-09-12T18:38:07.370189+0000","last_became_active":"2024-09-12T18:35:24.655420+0000","last_became_peered":"2024-09-12T18:35:24.655420+0000","last_unstale":"2024-09-12T18:38:07.370189+0000","last_undegraded":"2024-09-12T18:38:07.370189+0000","last_fullsized":"2024-09-12T18:38:07.370189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:04.654666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T18:38:06.358119+0000","last_change":"2024-09-12T18:38:03.357094+0000","last_active":"2024-09-12T18:38:06.358119+0000","last_peered":"2024-09-12T18:38:06.358119+0000","last_clean":"2024-09-12T18:38:06.358119+0000","last_became_active":"2024-09-12T18:38:03.355072+0000","last_became_peered":"2024-09-12T18:38:03.355072+0000","last_unstale":"2024-09-12T18:38:06.358119+0000","last_undegraded":"2024-09-12T18:38:06.358119+0000","last_fullsized":"2024-09-12T18:38:06.358119+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:46.451497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369635+0000","last_change":"2024-09-12T18:38:03.379032+0000","last_active":"2024-09-12T18:38:07.369635+0000","last_peered":"2024-09-12T18:38:07.369635+0000","last_clean":"2024-09-12T18:38:07.369635+0000","last_became_active":"2024-09-12T18:38:03.353780+0000","last_became_peered":"2024-09-12T18:38:03.353780+0000","last_unstale":"2024-09-12T18:38:07.369635+0000","last_undegraded":"2024-09-12T18:38:07.369635+0000","last_fullsized":"2024-09-12T18:38:07.369635+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:26.800343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705703,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297412,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":296318,"kb_avail":94074428,"statfs":{"total":96636764160,"available":96332214272,"internally_reserved":0,"allocated":1097728,"data_stored":982590,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":303430086},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738407,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280776,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94091064,"statfs":{"total":96636764160,"available":96349249536,"internally_reserved":0,"allocated":1101824,"data_stored":978964,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":286390725},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738407,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302908,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":301886,"kb_avail":94068932,"statfs":{"total":96636764160,"available":96326586368,"internally_reserved":0,"allocated":1019904,"data_stored":391063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":309131718},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:38:11.978 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T18:38:12.309 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:38:12.309 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":91,"fsid":"c08d5a84-711b-44bf-bdf1-e06ecc2c7c00","created":"2024-09-12T18:35:02.695853+0000","modified":"2024-09-12T18:38:07.360408+0000","last_up_change":"2024-09-12T18:35:12.464628+0000","last_in_change":"2024-09-12T18:35:04.352525+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T18:35:12.418430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T18:35:18.665309+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T18:35:23.447845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T18:35:23.959973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f1cf24e8-6179-4666-a444-fa81ef0d7482","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6801","nonce":2710632206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6803","nonce":2710632206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6807","nonce":2710632206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6805","nonce":2710632206}]},"public_addr":"172.21.15.114:6801/2710632206","cluster_addr":"172.21.15.114:6803/2710632206","heartbeat_back_addr":"172.21.15.114:6807/2710632206","heartbeat_front_addr":"172.21.15.114:6805/2710632206","state":["exists","up"]},{"osd":1,"uuid":"3fdb0044-2820-4411-978b-4b6e94fbf0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6801","nonce":862189968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6803","nonce":862189968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6807","nonce":862189968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6805","nonce":862189968}]},"public_addr":"172.21.15.143:6801/862189968","cluster_addr":"172.21.15.143:6803/862189968","heartbeat_back_addr":"172.21.15.143:6807/862189968","heartbeat_front_addr":"172.21.15.143:6805/862189968","state":["exists","up"]},{"osd":2,"uuid":"6fb554da-561f-4aa2-b855-0e3adb98b057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6801","nonce":1397104153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6803","nonce":1397104153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6807","nonce":1397104153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6805","nonce":1397104153}]},"public_addr":"172.21.15.162:6801/1397104153","cluster_addr":"172.21.15.162:6803/1397104153","heartbeat_back_addr":"172.21.15.162:6807/1397104153","heartbeat_front_addr":"172.21.15.162:6805/1397104153","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:35:10.239320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:35:10.861760+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:35:10.355997+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"2.6","osds":[2,0]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:38:13.327 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T18:38:13.327 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:38:13.491 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T18:38:13.491 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:38:13.491 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T18:38:13.509 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T18:38:13.782 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T18:38:13.800 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T18:38:13.800 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:38:13.934 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T18:38:13.934 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:38:13.934 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T18:38:13.950 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T18:38:14.234 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T18:38:14.251 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T18:38:14.252 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:38:14.403 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T18:38:14.403 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:38:14.403 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T18:38:14.421 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T18:38:14.698 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T18:38:14.715 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:38:15.009 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:38:15.012 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T18:38:15.026 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":181,"stamp":"2024-09-12T18:38:14.426906+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":192,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":881104,"kb_used_data":3152,"kb_used_omap":4,"kb_used_meta":877883,"kb_avail":282234416,"statfs":{"total":289910292480,"available":289008041984,"internally_reserved":0,"allocated":3227648,"data_stored":2356878,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4783,"internal_metadata":898952529},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.072634"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368487+0000","last_change":"2024-09-12T18:38:03.358323+0000","last_active":"2024-09-12T18:38:07.368487+0000","last_peered":"2024-09-12T18:38:07.368487+0000","last_clean":"2024-09-12T18:38:07.368487+0000","last_became_active":"2024-09-12T18:38:03.357317+0000","last_became_peered":"2024-09-12T18:38:03.357317+0000","last_unstale":"2024-09-12T18:38:07.368487+0000","last_undegraded":"2024-09-12T18:38:07.368487+0000","last_fullsized":"2024-09-12T18:38:07.368487+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:55.315464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367135+0000","last_change":"2024-09-12T18:35:25.659760+0000","last_active":"2024-09-12T18:38:07.367135+0000","last_peered":"2024-09-12T18:38:07.367135+0000","last_clean":"2024-09-12T18:38:07.367135+0000","last_became_active":"2024-09-12T18:35:25.654920+0000","last_became_peered":"2024-09-12T18:35:25.654920+0000","last_unstale":"2024-09-12T18:38:07.367135+0000","last_undegraded":"2024-09-12T18:38:07.367135+0000","last_fullsized":"2024-09-12T18:38:07.367135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:21.519881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.280256+0000","last_change":"2024-09-12T18:35:25.659460+0000","last_active":"2024-09-12T18:38:09.280256+0000","last_peered":"2024-09-12T18:38:09.280256+0000","last_clean":"2024-09-12T18:38:09.280256+0000","last_became_active":"2024-09-12T18:35:25.657782+0000","last_became_peered":"2024-09-12T18:35:25.657782+0000","last_unstale":"2024-09-12T18:38:09.280256+0000","last_undegraded":"2024-09-12T18:38:09.280256+0000","last_fullsized":"2024-09-12T18:38:09.280256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:38.544284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.279092+0000","last_change":"2024-09-12T18:35:25.663617+0000","last_active":"2024-09-12T18:38:09.279092+0000","last_peered":"2024-09-12T18:38:09.279092+0000","last_clean":"2024-09-12T18:38:09.279092+0000","last_became_active":"2024-09-12T18:35:25.661977+0000","last_became_peered":"2024-09-12T18:35:25.661977+0000","last_unstale":"2024-09-12T18:38:09.279092+0000","last_undegraded":"2024-09-12T18:38:09.279092+0000","last_fullsized":"2024-09-12T18:38:09.279092+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:14.748234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367138+0000","last_change":"2024-09-12T18:35:25.656566+0000","last_active":"2024-09-12T18:38:07.367138+0000","last_peered":"2024-09-12T18:38:07.367138+0000","last_clean":"2024-09-12T18:38:07.367138+0000","last_became_active":"2024-09-12T18:35:25.654898+0000","last_became_peered":"2024-09-12T18:35:25.654898+0000","last_unstale":"2024-09-12T18:38:07.367138+0000","last_undegraded":"2024-09-12T18:38:07.367138+0000","last_fullsized":"2024-09-12T18:38:07.367138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:36.113250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.278540+0000","last_change":"2024-09-12T18:38:03.366489+0000","last_active":"2024-09-12T18:38:09.278540+0000","last_peered":"2024-09-12T18:38:09.278540+0000","last_clean":"2024-09-12T18:38:09.278540+0000","last_became_active":"2024-09-12T18:38:03.364745+0000","last_became_peered":"2024-09-12T18:38:03.364745+0000","last_unstale":"2024-09-12T18:38:09.278540+0000","last_undegraded":"2024-09-12T18:38:09.278540+0000","last_fullsized":"2024-09-12T18:38:09.278540+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:42.397517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.278245+0000","last_change":"2024-09-12T18:35:25.659811+0000","last_active":"2024-09-12T18:38:09.278245+0000","last_peered":"2024-09-12T18:38:09.278245+0000","last_clean":"2024-09-12T18:38:09.278245+0000","last_became_active":"2024-09-12T18:35:25.658998+0000","last_became_peered":"2024-09-12T18:35:25.658998+0000","last_unstale":"2024-09-12T18:38:09.278245+0000","last_undegraded":"2024-09-12T18:38:09.278245+0000","last_fullsized":"2024-09-12T18:38:09.278245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.277950+0000","last_change":"2024-09-12T18:38:03.365773+0000","last_active":"2024-09-12T18:38:09.277950+0000","last_peered":"2024-09-12T18:38:09.277950+0000","last_clean":"2024-09-12T18:38:09.277950+0000","last_became_active":"2024-09-12T18:38:03.364845+0000","last_became_peered":"2024-09-12T18:38:03.364845+0000","last_unstale":"2024-09-12T18:38:09.277950+0000","last_undegraded":"2024-09-12T18:38:09.277950+0000","last_fullsized":"2024-09-12T18:38:09.277950+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:19.384528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369867+0000","last_change":"2024-09-12T18:35:25.668339+0000","last_active":"2024-09-12T18:38:07.369867+0000","last_peered":"2024-09-12T18:38:07.369867+0000","last_clean":"2024-09-12T18:38:07.369867+0000","last_became_active":"2024-09-12T18:35:25.667608+0000","last_became_peered":"2024-09-12T18:35:25.667608+0000","last_unstale":"2024-09-12T18:38:07.369867+0000","last_undegraded":"2024-09-12T18:38:07.369867+0000","last_fullsized":"2024-09-12T18:38:07.369867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:15.699745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367232+0000","last_change":"2024-09-12T18:38:03.358177+0000","last_active":"2024-09-12T18:38:07.367232+0000","last_peered":"2024-09-12T18:38:07.367232+0000","last_clean":"2024-09-12T18:38:07.367232+0000","last_became_active":"2024-09-12T18:38:03.357446+0000","last_became_peered":"2024-09-12T18:38:03.357446+0000","last_unstale":"2024-09-12T18:38:07.367232+0000","last_undegraded":"2024-09-12T18:38:07.367232+0000","last_fullsized":"2024-09-12T18:38:07.367232+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:13.110496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.280163+0000","last_change":"2024-09-12T18:38:03.356440+0000","last_active":"2024-09-12T18:38:09.280163+0000","last_peered":"2024-09-12T18:38:09.280163+0000","last_clean":"2024-09-12T18:38:09.280163+0000","last_became_active":"2024-09-12T18:38:03.355561+0000","last_became_peered":"2024-09-12T18:38:03.355561+0000","last_unstale":"2024-09-12T18:38:09.280163+0000","last_undegraded":"2024-09-12T18:38:09.280163+0000","last_fullsized":"2024-09-12T18:38:09.280163+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:43.438258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366852+0000","last_change":"2024-09-12T18:35:25.649885+0000","last_active":"2024-09-12T18:38:07.366852+0000","last_peered":"2024-09-12T18:38:07.366852+0000","last_clean":"2024-09-12T18:38:07.366852+0000","last_became_active":"2024-09-12T18:35:25.649111+0000","last_became_peered":"2024-09-12T18:35:25.649111+0000","last_unstale":"2024-09-12T18:38:07.366852+0000","last_undegraded":"2024-09-12T18:38:07.366852+0000","last_fullsized":"2024-09-12T18:38:07.366852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:17.162410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366640+0000","last_change":"2024-09-12T18:38:03.349917+0000","last_active":"2024-09-12T18:38:07.366640+0000","last_peered":"2024-09-12T18:38:07.366640+0000","last_clean":"2024-09-12T18:38:07.366640+0000","last_became_active":"2024-09-12T18:38:03.349130+0000","last_became_peered":"2024-09-12T18:38:03.349130+0000","last_unstale":"2024-09-12T18:38:07.366640+0000","last_undegraded":"2024-09-12T18:38:07.366640+0000","last_fullsized":"2024-09-12T18:38:07.366640+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:45.548888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.278555+0000","last_change":"2024-09-12T18:35:25.657913+0000","last_active":"2024-09-12T18:38:09.278555+0000","last_peered":"2024-09-12T18:38:09.278555+0000","last_clean":"2024-09-12T18:38:09.278555+0000","last_became_active":"2024-09-12T18:35:25.657082+0000","last_became_peered":"2024-09-12T18:35:25.657082+0000","last_unstale":"2024-09-12T18:38:09.278555+0000","last_undegraded":"2024-09-12T18:38:09.278555+0000","last_fullsized":"2024-09-12T18:38:09.278555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:21.538633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.278281+0000","last_change":"2024-09-12T18:35:25.658763+0000","last_active":"2024-09-12T18:38:09.278281+0000","last_peered":"2024-09-12T18:38:09.278281+0000","last_clean":"2024-09-12T18:38:09.278281+0000","last_became_active":"2024-09-12T18:35:25.657508+0000","last_became_peered":"2024-09-12T18:35:25.657508+0000","last_unstale":"2024-09-12T18:38:09.278281+0000","last_undegraded":"2024-09-12T18:38:09.278281+0000","last_fullsized":"2024-09-12T18:38:09.278281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:13.170519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.277942+0000","last_change":"2024-09-12T18:35:25.653730+0000","last_active":"2024-09-12T18:38:09.277942+0000","last_peered":"2024-09-12T18:38:09.277942+0000","last_clean":"2024-09-12T18:38:09.277942+0000","last_became_active":"2024-09-12T18:35:25.651535+0000","last_became_peered":"2024-09-12T18:35:25.651535+0000","last_unstale":"2024-09-12T18:38:09.277942+0000","last_undegraded":"2024-09-12T18:38:09.277942+0000","last_fullsized":"2024-09-12T18:38:09.277942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.370149+0000","last_change":"2024-09-12T18:35:25.656513+0000","last_active":"2024-09-12T18:38:07.370149+0000","last_peered":"2024-09-12T18:38:07.370149+0000","last_clean":"2024-09-12T18:38:07.370149+0000","last_became_active":"2024-09-12T18:35:25.653440+0000","last_became_peered":"2024-09-12T18:35:25.653440+0000","last_unstale":"2024-09-12T18:38:07.370149+0000","last_undegraded":"2024-09-12T18:38:07.370149+0000","last_fullsized":"2024-09-12T18:38:07.370149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:18.693161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367487+0000","last_change":"2024-09-12T18:35:25.657991+0000","last_active":"2024-09-12T18:38:07.367487+0000","last_peered":"2024-09-12T18:38:07.367487+0000","last_clean":"2024-09-12T18:38:07.367487+0000","last_became_active":"2024-09-12T18:35:25.653934+0000","last_became_peered":"2024-09-12T18:35:25.653934+0000","last_unstale":"2024-09-12T18:38:07.367487+0000","last_undegraded":"2024-09-12T18:38:07.367487+0000","last_fullsized":"2024-09-12T18:38:07.367487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:05.418901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368965+0000","last_change":"2024-09-12T18:38:03.358270+0000","last_active":"2024-09-12T18:38:07.368965+0000","last_peered":"2024-09-12T18:38:07.368965+0000","last_clean":"2024-09-12T18:38:07.368965+0000","last_became_active":"2024-09-12T18:38:03.357363+0000","last_became_peered":"2024-09-12T18:38:03.357363+0000","last_unstale":"2024-09-12T18:38:07.368965+0000","last_undegraded":"2024-09-12T18:38:07.368965+0000","last_fullsized":"2024-09-12T18:38:07.368965+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:56.658700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.279283+0000","last_change":"2024-09-12T18:35:25.661176+0000","last_active":"2024-09-12T18:38:09.279283+0000","last_peered":"2024-09-12T18:38:09.279283+0000","last_clean":"2024-09-12T18:38:09.279283+0000","last_became_active":"2024-09-12T18:35:25.659534+0000","last_became_peered":"2024-09-12T18:35:25.659534+0000","last_unstale":"2024-09-12T18:38:09.279283+0000","last_undegraded":"2024-09-12T18:38:09.279283+0000","last_fullsized":"2024-09-12T18:38:09.279283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:40.145442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.278976+0000","last_change":"2024-09-12T18:35:25.650632+0000","last_active":"2024-09-12T18:38:09.278976+0000","last_peered":"2024-09-12T18:38:09.278976+0000","last_clean":"2024-09-12T18:38:09.278976+0000","last_became_active":"2024-09-12T18:35:25.649333+0000","last_became_peered":"2024-09-12T18:35:25.649333+0000","last_unstale":"2024-09-12T18:38:09.278976+0000","last_undegraded":"2024-09-12T18:38:09.278976+0000","last_fullsized":"2024-09-12T18:38:09.278976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:30.537572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366475+0000","last_change":"2024-09-12T18:35:25.648245+0000","last_active":"2024-09-12T18:38:07.366475+0000","last_peered":"2024-09-12T18:38:07.366475+0000","last_clean":"2024-09-12T18:38:07.366475+0000","last_became_active":"2024-09-12T18:35:25.646357+0000","last_became_peered":"2024-09-12T18:35:25.646357+0000","last_unstale":"2024-09-12T18:38:07.366475+0000","last_undegraded":"2024-09-12T18:38:07.366475+0000","last_fullsized":"2024-09-12T18:38:07.366475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:05.662140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367728+0000","last_change":"2024-09-12T18:35:25.661613+0000","last_active":"2024-09-12T18:38:07.367728+0000","last_peered":"2024-09-12T18:38:07.367728+0000","last_clean":"2024-09-12T18:38:07.367728+0000","last_became_active":"2024-09-12T18:35:25.658833+0000","last_became_peered":"2024-09-12T18:35:25.658833+0000","last_unstale":"2024-09-12T18:38:07.367728+0000","last_undegraded":"2024-09-12T18:38:07.367728+0000","last_fullsized":"2024-09-12T18:38:07.367728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:51.064080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366639+0000","last_change":"2024-09-12T18:35:25.657782+0000","last_active":"2024-09-12T18:38:07.366639+0000","last_peered":"2024-09-12T18:38:07.366639+0000","last_clean":"2024-09-12T18:38:07.366639+0000","last_became_active":"2024-09-12T18:35:25.655295+0000","last_became_peered":"2024-09-12T18:35:25.655295+0000","last_unstale":"2024-09-12T18:38:07.366639+0000","last_undegraded":"2024-09-12T18:38:07.366639+0000","last_fullsized":"2024-09-12T18:38:07.366639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:37.744175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368546+0000","last_change":"2024-09-12T18:35:25.654863+0000","last_active":"2024-09-12T18:38:07.368546+0000","last_peered":"2024-09-12T18:38:07.368546+0000","last_clean":"2024-09-12T18:38:07.368546+0000","last_became_active":"2024-09-12T18:35:25.650407+0000","last_became_peered":"2024-09-12T18:35:25.650407+0000","last_unstale":"2024-09-12T18:38:07.368546+0000","last_undegraded":"2024-09-12T18:38:07.368546+0000","last_fullsized":"2024-09-12T18:38:07.368546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:38.395666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369981+0000","last_change":"2024-09-12T18:35:25.662414+0000","last_active":"2024-09-12T18:38:07.369981+0000","last_peered":"2024-09-12T18:38:07.369981+0000","last_clean":"2024-09-12T18:38:07.369981+0000","last_became_active":"2024-09-12T18:35:25.660126+0000","last_became_peered":"2024-09-12T18:35:25.660126+0000","last_unstale":"2024-09-12T18:38:07.369981+0000","last_undegraded":"2024-09-12T18:38:07.369981+0000","last_fullsized":"2024-09-12T18:38:07.369981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:48.437139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.280014+0000","last_change":"2024-09-12T18:35:25.661523+0000","last_active":"2024-09-12T18:38:09.280014+0000","last_peered":"2024-09-12T18:38:09.280014+0000","last_clean":"2024-09-12T18:38:09.280014+0000","last_became_active":"2024-09-12T18:35:25.659338+0000","last_became_peered":"2024-09-12T18:35:25.659338+0000","last_unstale":"2024-09-12T18:38:09.280014+0000","last_undegraded":"2024-09-12T18:38:09.280014+0000","last_fullsized":"2024-09-12T18:38:09.280014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:37.083820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367372+0000","last_change":"2024-09-12T18:35:25.662445+0000","last_active":"2024-09-12T18:38:07.367372+0000","last_peered":"2024-09-12T18:38:07.367372+0000","last_clean":"2024-09-12T18:38:07.367372+0000","last_became_active":"2024-09-12T18:35:25.659496+0000","last_became_peered":"2024-09-12T18:35:25.659496+0000","last_unstale":"2024-09-12T18:38:07.367372+0000","last_undegraded":"2024-09-12T18:38:07.367372+0000","last_fullsized":"2024-09-12T18:38:07.367372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:03.270420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368653+0000","last_change":"2024-09-12T18:38:03.357219+0000","last_active":"2024-09-12T18:38:07.368653+0000","last_peered":"2024-09-12T18:38:07.368653+0000","last_clean":"2024-09-12T18:38:07.368653+0000","last_became_active":"2024-09-12T18:38:03.356412+0000","last_became_peered":"2024-09-12T18:38:03.356412+0000","last_unstale":"2024-09-12T18:38:07.368653+0000","last_undegraded":"2024-09-12T18:38:07.368653+0000","last_fullsized":"2024-09-12T18:38:07.368653+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:53.007632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367404+0000","last_change":"2024-09-12T18:35:25.650507+0000","last_active":"2024-09-12T18:38:07.367404+0000","last_peered":"2024-09-12T18:38:07.367404+0000","last_clean":"2024-09-12T18:38:07.367404+0000","last_became_active":"2024-09-12T18:35:25.649415+0000","last_became_peered":"2024-09-12T18:35:25.649415+0000","last_unstale":"2024-09-12T18:38:07.367404+0000","last_undegraded":"2024-09-12T18:38:07.367404+0000","last_fullsized":"2024-09-12T18:38:07.367404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:23.081416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367879+0000","last_change":"2024-09-12T18:35:25.653949+0000","last_active":"2024-09-12T18:38:07.367879+0000","last_peered":"2024-09-12T18:38:07.367879+0000","last_clean":"2024-09-12T18:38:07.367879+0000","last_became_active":"2024-09-12T18:35:25.652992+0000","last_became_peered":"2024-09-12T18:35:25.652992+0000","last_unstale":"2024-09-12T18:38:07.367879+0000","last_undegraded":"2024-09-12T18:38:07.367879+0000","last_fullsized":"2024-09-12T18:38:07.367879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:47.687372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.278107+0000","last_change":"2024-09-12T18:38:03.356306+0000","last_active":"2024-09-12T18:38:09.278107+0000","last_peered":"2024-09-12T18:38:09.278107+0000","last_clean":"2024-09-12T18:38:09.278107+0000","last_became_active":"2024-09-12T18:38:03.355052+0000","last_became_peered":"2024-09-12T18:38:03.355052+0000","last_unstale":"2024-09-12T18:38:09.278107+0000","last_undegraded":"2024-09-12T18:38:09.278107+0000","last_fullsized":"2024-09-12T18:38:09.278107+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:54.986299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367305+0000","last_change":"2024-09-12T18:38:03.351904+0000","last_active":"2024-09-12T18:38:07.367305+0000","last_peered":"2024-09-12T18:38:07.367305+0000","last_clean":"2024-09-12T18:38:07.367305+0000","last_became_active":"2024-09-12T18:38:03.351112+0000","last_became_peered":"2024-09-12T18:38:03.351112+0000","last_unstale":"2024-09-12T18:38:07.367305+0000","last_undegraded":"2024-09-12T18:38:07.367305+0000","last_fullsized":"2024-09-12T18:38:07.367305+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:52.881469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.279734+0000","last_change":"2024-09-12T18:35:24.657739+0000","last_active":"2024-09-12T18:38:09.279734+0000","last_peered":"2024-09-12T18:38:09.279734+0000","last_clean":"2024-09-12T18:38:09.279734+0000","last_became_active":"2024-09-12T18:35:24.656208+0000","last_became_peered":"2024-09-12T18:35:24.656208+0000","last_unstale":"2024-09-12T18:38:09.279734+0000","last_undegraded":"2024-09-12T18:38:09.279734+0000","last_fullsized":"2024-09-12T18:38:09.279734+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:50.073716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367762+0000","last_change":"2024-09-12T18:35:25.651651+0000","last_active":"2024-09-12T18:38:07.367762+0000","last_peered":"2024-09-12T18:38:07.367762+0000","last_clean":"2024-09-12T18:38:07.367762+0000","last_became_active":"2024-09-12T18:35:25.650849+0000","last_became_peered":"2024-09-12T18:35:25.650849+0000","last_unstale":"2024-09-12T18:38:07.367762+0000","last_undegraded":"2024-09-12T18:38:07.367762+0000","last_fullsized":"2024-09-12T18:38:07.367762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:18.555827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368934+0000","last_change":"2024-09-12T18:35:24.656119+0000","last_active":"2024-09-12T18:38:07.368934+0000","last_peered":"2024-09-12T18:38:07.368934+0000","last_clean":"2024-09-12T18:38:07.368934+0000","last_became_active":"2024-09-12T18:35:24.653175+0000","last_became_peered":"2024-09-12T18:35:24.653175+0000","last_unstale":"2024-09-12T18:38:07.368934+0000","last_undegraded":"2024-09-12T18:38:07.368934+0000","last_fullsized":"2024-09-12T18:38:07.368934+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:00.551165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369501+0000","last_change":"2024-09-12T18:38:03.356363+0000","last_active":"2024-09-12T18:38:07.369501+0000","last_peered":"2024-09-12T18:38:07.369501+0000","last_clean":"2024-09-12T18:38:07.369501+0000","last_became_active":"2024-09-12T18:38:03.354299+0000","last_became_peered":"2024-09-12T18:38:03.354299+0000","last_unstale":"2024-09-12T18:38:07.369501+0000","last_undegraded":"2024-09-12T18:38:07.369501+0000","last_fullsized":"2024-09-12T18:38:07.369501+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:40.267630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366478+0000","last_change":"2024-09-12T18:35:24.640096+0000","last_active":"2024-09-12T18:38:07.366478+0000","last_peered":"2024-09-12T18:38:07.366478+0000","last_clean":"2024-09-12T18:38:07.366478+0000","last_became_active":"2024-09-12T18:35:24.638230+0000","last_became_peered":"2024-09-12T18:35:24.638230+0000","last_unstale":"2024-09-12T18:38:07.366478+0000","last_undegraded":"2024-09-12T18:38:07.366478+0000","last_fullsized":"2024-09-12T18:38:07.366478+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:38.435296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369661+0000","last_change":"2024-09-12T18:38:03.354155+0000","last_active":"2024-09-12T18:38:07.369661+0000","last_peered":"2024-09-12T18:38:07.369661+0000","last_clean":"2024-09-12T18:38:07.369661+0000","last_became_active":"2024-09-12T18:38:03.352848+0000","last_became_peered":"2024-09-12T18:38:03.352848+0000","last_unstale":"2024-09-12T18:38:07.369661+0000","last_undegraded":"2024-09-12T18:38:07.369661+0000","last_fullsized":"2024-09-12T18:38:07.369661+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:36.825717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.278374+0000","last_change":"2024-09-12T18:35:24.653610+0000","last_active":"2024-09-12T18:38:09.278374+0000","last_peered":"2024-09-12T18:38:09.278374+0000","last_clean":"2024-09-12T18:38:09.278374+0000","last_became_active":"2024-09-12T18:35:24.652880+0000","last_became_peered":"2024-09-12T18:35:24.652880+0000","last_unstale":"2024-09-12T18:38:09.278374+0000","last_undegraded":"2024-09-12T18:38:09.278374+0000","last_fullsized":"2024-09-12T18:38:09.278374+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:57.636251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":161,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.280650+0000","last_change":"2024-09-12T18:35:24.653465+0000","last_active":"2024-09-12T18:38:09.280650+0000","last_peered":"2024-09-12T18:38:09.280650+0000","last_clean":"2024-09-12T18:38:09.280650+0000","last_became_active":"2024-09-12T18:35:24.652792+0000","last_became_peered":"2024-09-12T18:35:24.652792+0000","last_unstale":"2024-09-12T18:38:09.280650+0000","last_undegraded":"2024-09-12T18:38:09.280650+0000","last_fullsized":"2024-09-12T18:38:09.280650+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:14.588993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366949+0000","last_change":"2024-09-12T18:35:25.655426+0000","last_active":"2024-09-12T18:38:07.366949+0000","last_peered":"2024-09-12T18:38:07.366949+0000","last_clean":"2024-09-12T18:38:07.366949+0000","last_became_active":"2024-09-12T18:35:25.648186+0000","last_became_peered":"2024-09-12T18:35:25.648186+0000","last_unstale":"2024-09-12T18:38:07.366949+0000","last_undegraded":"2024-09-12T18:38:07.366949+0000","last_fullsized":"2024-09-12T18:38:07.366949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:48.802815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367913+0000","last_change":"2024-09-12T18:35:24.648439+0000","last_active":"2024-09-12T18:38:07.367913+0000","last_peered":"2024-09-12T18:38:07.367913+0000","last_clean":"2024-09-12T18:38:07.367913+0000","last_became_active":"2024-09-12T18:35:24.647629+0000","last_became_peered":"2024-09-12T18:35:24.647629+0000","last_unstale":"2024-09-12T18:38:07.367913+0000","last_undegraded":"2024-09-12T18:38:07.367913+0000","last_fullsized":"2024-09-12T18:38:07.367913+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:45.428223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366148+0000","last_change":"2024-09-12T18:35:25.652496+0000","last_active":"2024-09-12T18:38:07.366148+0000","last_peered":"2024-09-12T18:38:07.366148+0000","last_clean":"2024-09-12T18:38:07.366148+0000","last_became_active":"2024-09-12T18:35:25.651628+0000","last_became_peered":"2024-09-12T18:35:25.651628+0000","last_unstale":"2024-09-12T18:38:07.366148+0000","last_undegraded":"2024-09-12T18:38:07.366148+0000","last_fullsized":"2024-09-12T18:38:07.366148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:44.920448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":161,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.279519+0000","last_change":"2024-09-12T18:35:24.654976+0000","last_active":"2024-09-12T18:38:09.279519+0000","last_peered":"2024-09-12T18:38:09.279519+0000","last_clean":"2024-09-12T18:38:09.279519+0000","last_became_active":"2024-09-12T18:35:24.654264+0000","last_became_peered":"2024-09-12T18:35:24.654264+0000","last_unstale":"2024-09-12T18:38:09.279519+0000","last_undegraded":"2024-09-12T18:38:09.279519+0000","last_fullsized":"2024-09-12T18:38:09.279519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:00.115408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.278842+0000","last_change":"2024-09-12T18:38:03.365901+0000","last_active":"2024-09-12T18:38:09.278842+0000","last_peered":"2024-09-12T18:38:09.278842+0000","last_clean":"2024-09-12T18:38:09.278842+0000","last_became_active":"2024-09-12T18:38:03.364754+0000","last_became_peered":"2024-09-12T18:38:03.364754+0000","last_unstale":"2024-09-12T18:38:09.278842+0000","last_undegraded":"2024-09-12T18:38:09.278842+0000","last_fullsized":"2024-09-12T18:38:09.278842+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:43.078837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.279814+0000","last_change":"2024-09-12T18:35:24.657665+0000","last_active":"2024-09-12T18:38:09.279814+0000","last_peered":"2024-09-12T18:38:09.279814+0000","last_clean":"2024-09-12T18:38:09.279814+0000","last_became_active":"2024-09-12T18:35:24.657015+0000","last_became_peered":"2024-09-12T18:35:24.657015+0000","last_unstale":"2024-09-12T18:38:09.279814+0000","last_undegraded":"2024-09-12T18:38:09.279814+0000","last_fullsized":"2024-09-12T18:38:09.279814+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:03.171326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368567+0000","last_change":"2024-09-12T18:35:25.665275+0000","last_active":"2024-09-12T18:38:07.368567+0000","last_peered":"2024-09-12T18:38:07.368567+0000","last_clean":"2024-09-12T18:38:07.368567+0000","last_became_active":"2024-09-12T18:35:25.659511+0000","last_became_peered":"2024-09-12T18:35:25.659511+0000","last_unstale":"2024-09-12T18:38:07.368567+0000","last_undegraded":"2024-09-12T18:38:07.368567+0000","last_fullsized":"2024-09-12T18:38:07.368567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368912+0000","last_change":"2024-09-12T18:38:03.384365+0000","last_active":"2024-09-12T18:38:07.368912+0000","last_peered":"2024-09-12T18:38:07.368912+0000","last_clean":"2024-09-12T18:38:07.368912+0000","last_became_active":"2024-09-12T18:38:03.364147+0000","last_became_peered":"2024-09-12T18:38:03.364147+0000","last_unstale":"2024-09-12T18:38:07.368912+0000","last_undegraded":"2024-09-12T18:38:07.368912+0000","last_fullsized":"2024-09-12T18:38:07.368912+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:05.965891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.279387+0000","last_change":"2024-09-12T18:38:03.356255+0000","last_active":"2024-09-12T18:38:09.279387+0000","last_peered":"2024-09-12T18:38:09.279387+0000","last_clean":"2024-09-12T18:38:09.279387+0000","last_became_active":"2024-09-12T18:38:03.355310+0000","last_became_peered":"2024-09-12T18:38:03.355310+0000","last_unstale":"2024-09-12T18:38:09.279387+0000","last_undegraded":"2024-09-12T18:38:09.279387+0000","last_fullsized":"2024-09-12T18:38:09.279387+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:21.097039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.279162+0000","last_change":"2024-09-12T18:35:24.659019+0000","last_active":"2024-09-12T18:38:09.279162+0000","last_peered":"2024-09-12T18:38:09.279162+0000","last_clean":"2024-09-12T18:38:09.279162+0000","last_became_active":"2024-09-12T18:35:24.658423+0000","last_became_peered":"2024-09-12T18:35:24.658423+0000","last_unstale":"2024-09-12T18:38:09.279162+0000","last_undegraded":"2024-09-12T18:38:09.279162+0000","last_fullsized":"2024-09-12T18:38:09.279162+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:37.668417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.279733+0000","last_change":"2024-09-12T18:35:25.662287+0000","last_active":"2024-09-12T18:38:09.279733+0000","last_peered":"2024-09-12T18:38:09.279733+0000","last_clean":"2024-09-12T18:38:09.279733+0000","last_became_active":"2024-09-12T18:35:25.660372+0000","last_became_peered":"2024-09-12T18:35:25.660372+0000","last_unstale":"2024-09-12T18:38:09.279733+0000","last_undegraded":"2024-09-12T18:38:09.279733+0000","last_fullsized":"2024-09-12T18:38:09.279733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:08.729541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366544+0000","last_change":"2024-09-12T18:35:24.648330+0000","last_active":"2024-09-12T18:38:07.366544+0000","last_peered":"2024-09-12T18:38:07.366544+0000","last_clean":"2024-09-12T18:38:07.366544+0000","last_became_active":"2024-09-12T18:35:24.647520+0000","last_became_peered":"2024-09-12T18:35:24.647520+0000","last_unstale":"2024-09-12T18:38:07.366544+0000","last_undegraded":"2024-09-12T18:38:07.366544+0000","last_fullsized":"2024-09-12T18:38:07.366544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:25.552055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.280029+0000","last_change":"2024-09-12T18:35:25.658674+0000","last_active":"2024-09-12T18:38:09.280029+0000","last_peered":"2024-09-12T18:38:09.280029+0000","last_clean":"2024-09-12T18:38:09.280029+0000","last_became_active":"2024-09-12T18:35:25.657386+0000","last_became_peered":"2024-09-12T18:35:25.657386+0000","last_unstale":"2024-09-12T18:38:09.280029+0000","last_undegraded":"2024-09-12T18:38:09.280029+0000","last_fullsized":"2024-09-12T18:38:09.280029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:48.037086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366112+0000","last_change":"2024-09-12T18:35:24.646810+0000","last_active":"2024-09-12T18:38:07.366112+0000","last_peered":"2024-09-12T18:38:07.366112+0000","last_clean":"2024-09-12T18:38:07.366112+0000","last_became_active":"2024-09-12T18:35:24.646008+0000","last_became_peered":"2024-09-12T18:35:24.646008+0000","last_unstale":"2024-09-12T18:38:07.366112+0000","last_undegraded":"2024-09-12T18:38:07.366112+0000","last_fullsized":"2024-09-12T18:38:07.366112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:43.888776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369934+0000","last_change":"2024-09-12T18:35:25.667710+0000","last_active":"2024-09-12T18:38:07.369934+0000","last_peered":"2024-09-12T18:38:07.369934+0000","last_clean":"2024-09-12T18:38:07.369934+0000","last_became_active":"2024-09-12T18:35:25.666940+0000","last_became_peered":"2024-09-12T18:35:25.666940+0000","last_unstale":"2024-09-12T18:38:07.369934+0000","last_undegraded":"2024-09-12T18:38:07.369934+0000","last_fullsized":"2024-09-12T18:38:07.369934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:09.823085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":310,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.278732+0000","last_change":"2024-09-12T18:35:13.489018+0000","last_active":"2024-09-12T18:38:09.278732+0000","last_peered":"2024-09-12T18:38:09.278732+0000","last_clean":"2024-09-12T18:38:09.278732+0000","last_became_active":"2024-09-12T18:35:13.488346+0000","last_became_peered":"2024-09-12T18:35:13.488346+0000","last_unstale":"2024-09-12T18:38:09.278732+0000","last_undegraded":"2024-09-12T18:38:09.278732+0000","last_fullsized":"2024-09-12T18:38:09.278732+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:12.464628+0000","last_clean_scrub_stamp":"2024-09-12T18:35:12.464628+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:54.864640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":174,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.277597+0000","last_change":"2024-09-12T18:35:22.459694+0000","last_active":"2024-09-12T18:38:09.277597+0000","last_peered":"2024-09-12T18:38:09.277597+0000","last_clean":"2024-09-12T18:38:09.277597+0000","last_became_active":"2024-09-12T18:35:20.446796+0000","last_became_peered":"2024-09-12T18:35:20.446796+0000","last_unstale":"2024-09-12T18:38:09.277597+0000","last_undegraded":"2024-09-12T18:38:09.277597+0000","last_fullsized":"2024-09-12T18:38:09.277597+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:21.506024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016291610000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368143+0000","last_change":"2024-09-12T18:38:03.354554+0000","last_active":"2024-09-12T18:38:07.368143+0000","last_peered":"2024-09-12T18:38:07.368143+0000","last_clean":"2024-09-12T18:38:07.368143+0000","last_became_active":"2024-09-12T18:38:03.353661+0000","last_became_peered":"2024-09-12T18:38:03.353661+0000","last_unstale":"2024-09-12T18:38:07.368143+0000","last_undegraded":"2024-09-12T18:38:07.368143+0000","last_fullsized":"2024-09-12T18:38:07.368143+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:27.835210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.279792+0000","last_change":"2024-09-12T18:35:25.662424+0000","last_active":"2024-09-12T18:38:09.279792+0000","last_peered":"2024-09-12T18:38:09.279792+0000","last_clean":"2024-09-12T18:38:09.279792+0000","last_became_active":"2024-09-12T18:35:25.661043+0000","last_became_peered":"2024-09-12T18:35:25.661043+0000","last_unstale":"2024-09-12T18:38:09.279792+0000","last_undegraded":"2024-09-12T18:38:09.279792+0000","last_fullsized":"2024-09-12T18:38:09.279792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:52.551802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.277510+0000","last_change":"2024-09-12T18:35:22.459090+0000","last_active":"2024-09-12T18:38:09.277510+0000","last_peered":"2024-09-12T18:38:09.277510+0000","last_clean":"2024-09-12T18:38:09.277510+0000","last_became_active":"2024-09-12T18:35:20.448553+0000","last_became_peered":"2024-09-12T18:35:20.448553+0000","last_unstale":"2024-09-12T18:38:09.277510+0000","last_undegraded":"2024-09-12T18:38:09.277510+0000","last_fullsized":"2024-09-12T18:38:09.277510+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:56.834808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001030836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368423+0000","last_change":"2024-09-12T18:35:24.651597+0000","last_active":"2024-09-12T18:38:07.368423+0000","last_peered":"2024-09-12T18:38:07.368423+0000","last_clean":"2024-09-12T18:38:07.368423+0000","last_became_active":"2024-09-12T18:35:24.649940+0000","last_became_peered":"2024-09-12T18:35:24.649940+0000","last_unstale":"2024-09-12T18:38:07.368423+0000","last_undegraded":"2024-09-12T18:38:07.368423+0000","last_fullsized":"2024-09-12T18:38:07.368423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:36.822432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367752+0000","last_change":"2024-09-12T18:38:03.358588+0000","last_active":"2024-09-12T18:38:07.367752+0000","last_peered":"2024-09-12T18:38:07.367752+0000","last_clean":"2024-09-12T18:38:07.367752+0000","last_became_active":"2024-09-12T18:38:03.357664+0000","last_became_peered":"2024-09-12T18:38:03.357664+0000","last_unstale":"2024-09-12T18:38:07.367752+0000","last_undegraded":"2024-09-12T18:38:07.367752+0000","last_fullsized":"2024-09-12T18:38:07.367752+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:02.273189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368624+0000","last_change":"2024-09-12T18:35:22.464179+0000","last_active":"2024-09-12T18:38:07.368624+0000","last_peered":"2024-09-12T18:38:07.368624+0000","last_clean":"2024-09-12T18:38:07.368624+0000","last_became_active":"2024-09-12T18:35:20.442613+0000","last_became_peered":"2024-09-12T18:35:20.442613+0000","last_unstale":"2024-09-12T18:38:07.368624+0000","last_undegraded":"2024-09-12T18:38:07.368624+0000","last_fullsized":"2024-09-12T18:38:07.368624+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:17.636537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014134620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366112+0000","last_change":"2024-09-12T18:35:24.641297+0000","last_active":"2024-09-12T18:38:07.366112+0000","last_peered":"2024-09-12T18:38:07.366112+0000","last_clean":"2024-09-12T18:38:07.366112+0000","last_became_active":"2024-09-12T18:35:24.637334+0000","last_became_peered":"2024-09-12T18:35:24.637334+0000","last_unstale":"2024-09-12T18:38:07.366112+0000","last_undegraded":"2024-09-12T18:38:07.366112+0000","last_fullsized":"2024-09-12T18:38:07.366112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:50.772074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369805+0000","last_change":"2024-09-12T18:38:03.360352+0000","last_active":"2024-09-12T18:38:07.369805+0000","last_peered":"2024-09-12T18:38:07.369805+0000","last_clean":"2024-09-12T18:38:07.369805+0000","last_became_active":"2024-09-12T18:38:03.359452+0000","last_became_peered":"2024-09-12T18:38:03.359452+0000","last_unstale":"2024-09-12T18:38:07.369805+0000","last_undegraded":"2024-09-12T18:38:07.369805+0000","last_fullsized":"2024-09-12T18:38:07.369805+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:48.036394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":175,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.277597+0000","last_change":"2024-09-12T18:35:22.459049+0000","last_active":"2024-09-12T18:38:09.277597+0000","last_peered":"2024-09-12T18:38:09.277597+0000","last_clean":"2024-09-12T18:38:09.277597+0000","last_became_active":"2024-09-12T18:35:20.446814+0000","last_became_peered":"2024-09-12T18:35:20.446814+0000","last_unstale":"2024-09-12T18:38:09.277597+0000","last_undegraded":"2024-09-12T18:38:09.277597+0000","last_fullsized":"2024-09-12T18:38:09.277597+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:18.033595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010716149999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.279758+0000","last_change":"2024-09-12T18:35:24.658273+0000","last_active":"2024-09-12T18:38:09.279758+0000","last_peered":"2024-09-12T18:38:09.279758+0000","last_clean":"2024-09-12T18:38:09.279758+0000","last_became_active":"2024-09-12T18:35:24.657433+0000","last_became_peered":"2024-09-12T18:35:24.657433+0000","last_unstale":"2024-09-12T18:38:09.279758+0000","last_undegraded":"2024-09-12T18:38:09.279758+0000","last_fullsized":"2024-09-12T18:38:09.279758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:48.497218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369135+0000","last_change":"2024-09-12T18:38:03.358304+0000","last_active":"2024-09-12T18:38:07.369135+0000","last_peered":"2024-09-12T18:38:07.369135+0000","last_clean":"2024-09-12T18:38:07.369135+0000","last_became_active":"2024-09-12T18:38:03.357592+0000","last_became_peered":"2024-09-12T18:38:03.357592+0000","last_unstale":"2024-09-12T18:38:07.369135+0000","last_undegraded":"2024-09-12T18:38:07.369135+0000","last_fullsized":"2024-09-12T18:38:07.369135+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:45.610260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.279236+0000","last_change":"2024-09-12T18:35:24.657618+0000","last_active":"2024-09-12T18:38:09.279236+0000","last_peered":"2024-09-12T18:38:09.279236+0000","last_clean":"2024-09-12T18:38:09.279236+0000","last_became_active":"2024-09-12T18:35:24.656741+0000","last_became_peered":"2024-09-12T18:35:24.656741+0000","last_unstale":"2024-09-12T18:38:09.279236+0000","last_undegraded":"2024-09-12T18:38:09.279236+0000","last_fullsized":"2024-09-12T18:38:09.279236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:43.113104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369480+0000","last_change":"2024-09-12T18:35:22.464180+0000","last_active":"2024-09-12T18:38:07.369480+0000","last_peered":"2024-09-12T18:38:07.369480+0000","last_clean":"2024-09-12T18:38:07.369480+0000","last_became_active":"2024-09-12T18:35:20.442566+0000","last_became_peered":"2024-09-12T18:35:20.442566+0000","last_unstale":"2024-09-12T18:38:07.369480+0000","last_undegraded":"2024-09-12T18:38:07.369480+0000","last_fullsized":"2024-09-12T18:38:07.369480+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:29.021710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001325786,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366700+0000","last_change":"2024-09-12T18:35:25.650458+0000","last_active":"2024-09-12T18:38:07.366700+0000","last_peered":"2024-09-12T18:38:07.366700+0000","last_clean":"2024-09-12T18:38:07.366700+0000","last_became_active":"2024-09-12T18:35:25.648761+0000","last_became_peered":"2024-09-12T18:35:25.648761+0000","last_unstale":"2024-09-12T18:38:07.366700+0000","last_undegraded":"2024-09-12T18:38:07.366700+0000","last_fullsized":"2024-09-12T18:38:07.366700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:53.026950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369129+0000","last_change":"2024-09-12T18:38:03.357887+0000","last_active":"2024-09-12T18:38:07.369129+0000","last_peered":"2024-09-12T18:38:07.369129+0000","last_clean":"2024-09-12T18:38:07.369129+0000","last_became_active":"2024-09-12T18:38:03.356816+0000","last_became_peered":"2024-09-12T18:38:03.356816+0000","last_unstale":"2024-09-12T18:38:07.369129+0000","last_undegraded":"2024-09-12T18:38:07.369129+0000","last_fullsized":"2024-09-12T18:38:07.369129+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:09.458196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":185,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366644+0000","last_change":"2024-09-12T18:38:03.351352+0000","last_active":"2024-09-12T18:38:07.366644+0000","last_peered":"2024-09-12T18:38:07.366644+0000","last_clean":"2024-09-12T18:38:07.366644+0000","last_became_active":"2024-09-12T18:38:03.350774+0000","last_became_peered":"2024-09-12T18:38:03.350774+0000","last_unstale":"2024-09-12T18:38:07.366644+0000","last_undegraded":"2024-09-12T18:38:07.366644+0000","last_fullsized":"2024-09-12T18:38:07.366644+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:30.555373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080163599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366902+0000","last_change":"2024-09-12T18:35:25.650717+0000","last_active":"2024-09-12T18:38:07.366902+0000","last_peered":"2024-09-12T18:38:07.366902+0000","last_clean":"2024-09-12T18:38:07.366902+0000","last_became_active":"2024-09-12T18:35:25.649147+0000","last_became_peered":"2024-09-12T18:35:25.649147+0000","last_unstale":"2024-09-12T18:38:07.366902+0000","last_undegraded":"2024-09-12T18:38:07.366902+0000","last_fullsized":"2024-09-12T18:38:07.366902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:07.365888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.370288+0000","last_change":"2024-09-12T18:35:24.657234+0000","last_active":"2024-09-12T18:38:07.370288+0000","last_peered":"2024-09-12T18:38:07.370288+0000","last_clean":"2024-09-12T18:38:07.370288+0000","last_became_active":"2024-09-12T18:35:24.655950+0000","last_became_peered":"2024-09-12T18:35:24.655950+0000","last_unstale":"2024-09-12T18:38:07.370288+0000","last_undegraded":"2024-09-12T18:38:07.370288+0000","last_fullsized":"2024-09-12T18:38:07.370288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:17.466623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.279577+0000","last_change":"2024-09-12T18:37:34.258443+0000","last_active":"2024-09-12T18:38:09.279577+0000","last_peered":"2024-09-12T18:38:09.279577+0000","last_clean":"2024-09-12T18:38:09.279577+0000","last_became_active":"2024-09-12T18:37:34.254999+0000","last_became_peered":"2024-09-12T18:37:34.254999+0000","last_unstale":"2024-09-12T18:38:09.279577+0000","last_undegraded":"2024-09-12T18:38:09.279577+0000","last_fullsized":"2024-09-12T18:38:09.279577+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:23.164676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367719+0000","last_change":"2024-09-12T18:38:03.358177+0000","last_active":"2024-09-12T18:38:07.367719+0000","last_peered":"2024-09-12T18:38:07.367719+0000","last_clean":"2024-09-12T18:38:07.367719+0000","last_became_active":"2024-09-12T18:38:03.354895+0000","last_became_peered":"2024-09-12T18:38:03.354895+0000","last_unstale":"2024-09-12T18:38:07.367719+0000","last_undegraded":"2024-09-12T18:38:07.367719+0000","last_fullsized":"2024-09-12T18:38:07.367719+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:16.208815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369642+0000","last_change":"2024-09-12T18:38:03.370898+0000","last_active":"2024-09-12T18:38:07.369642+0000","last_peered":"2024-09-12T18:38:07.369642+0000","last_clean":"2024-09-12T18:38:07.369642+0000","last_became_active":"2024-09-12T18:38:03.354684+0000","last_became_peered":"2024-09-12T18:38:03.354684+0000","last_unstale":"2024-09-12T18:38:07.369642+0000","last_undegraded":"2024-09-12T18:38:07.369642+0000","last_fullsized":"2024-09-12T18:38:07.369642+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:27.684565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.277644+0000","last_change":"2024-09-12T18:35:22.459767+0000","last_active":"2024-09-12T18:38:09.277644+0000","last_peered":"2024-09-12T18:38:09.277644+0000","last_clean":"2024-09-12T18:38:09.277644+0000","last_became_active":"2024-09-12T18:35:20.448521+0000","last_became_peered":"2024-09-12T18:35:20.448521+0000","last_unstale":"2024-09-12T18:38:09.277644+0000","last_undegraded":"2024-09-12T18:38:09.277644+0000","last_fullsized":"2024-09-12T18:38:09.277644+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:19.425963+0000","last_clean_scrub_stamp":"2024-09-12T18:35:19.425963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:33.463792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017009670000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366127+0000","last_change":"2024-09-12T18:35:25.648150+0000","last_active":"2024-09-12T18:38:07.366127+0000","last_peered":"2024-09-12T18:38:07.366127+0000","last_clean":"2024-09-12T18:38:07.366127+0000","last_became_active":"2024-09-12T18:35:25.647347+0000","last_became_peered":"2024-09-12T18:35:25.647347+0000","last_unstale":"2024-09-12T18:38:07.366127+0000","last_undegraded":"2024-09-12T18:38:07.366127+0000","last_fullsized":"2024-09-12T18:38:07.366127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:48.968336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.279243+0000","last_change":"2024-09-12T18:35:25.660696+0000","last_active":"2024-09-12T18:38:09.279243+0000","last_peered":"2024-09-12T18:38:09.279243+0000","last_clean":"2024-09-12T18:38:09.279243+0000","last_became_active":"2024-09-12T18:35:25.659827+0000","last_became_peered":"2024-09-12T18:35:25.659827+0000","last_unstale":"2024-09-12T18:38:09.279243+0000","last_undegraded":"2024-09-12T18:38:09.279243+0000","last_fullsized":"2024-09-12T18:38:09.279243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:15.678289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.279648+0000","last_change":"2024-09-12T18:35:24.655051+0000","last_active":"2024-09-12T18:38:09.279648+0000","last_peered":"2024-09-12T18:38:09.279648+0000","last_clean":"2024-09-12T18:38:09.279648+0000","last_became_active":"2024-09-12T18:35:24.654282+0000","last_became_peered":"2024-09-12T18:35:24.654282+0000","last_unstale":"2024-09-12T18:38:09.279648+0000","last_undegraded":"2024-09-12T18:38:09.279648+0000","last_fullsized":"2024-09-12T18:38:09.279648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:08.159799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368447+0000","last_change":"2024-09-12T18:38:03.355018+0000","last_active":"2024-09-12T18:38:07.368447+0000","last_peered":"2024-09-12T18:38:07.368447+0000","last_clean":"2024-09-12T18:38:07.368447+0000","last_became_active":"2024-09-12T18:38:03.354064+0000","last_became_peered":"2024-09-12T18:38:03.354064+0000","last_unstale":"2024-09-12T18:38:07.368447+0000","last_undegraded":"2024-09-12T18:38:07.368447+0000","last_fullsized":"2024-09-12T18:38:07.368447+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:18.297083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":163,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367123+0000","last_change":"2024-09-12T18:35:24.648658+0000","last_active":"2024-09-12T18:38:07.367123+0000","last_peered":"2024-09-12T18:38:07.367123+0000","last_clean":"2024-09-12T18:38:07.367123+0000","last_became_active":"2024-09-12T18:35:24.647826+0000","last_became_peered":"2024-09-12T18:35:24.647826+0000","last_unstale":"2024-09-12T18:38:07.367123+0000","last_undegraded":"2024-09-12T18:38:07.367123+0000","last_fullsized":"2024-09-12T18:38:07.367123+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:24.167549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":172,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.280371+0000","last_change":"2024-09-12T18:38:03.366378+0000","last_active":"2024-09-12T18:38:09.280371+0000","last_peered":"2024-09-12T18:38:09.280371+0000","last_clean":"2024-09-12T18:38:09.280371+0000","last_became_active":"2024-09-12T18:38:03.364887+0000","last_became_peered":"2024-09-12T18:38:03.364887+0000","last_unstale":"2024-09-12T18:38:09.280371+0000","last_undegraded":"2024-09-12T18:38:09.280371+0000","last_fullsized":"2024-09-12T18:38:09.280371+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:54.490659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368005+0000","last_change":"2024-09-12T18:35:25.661801+0000","last_active":"2024-09-12T18:38:07.368005+0000","last_peered":"2024-09-12T18:38:07.368005+0000","last_clean":"2024-09-12T18:38:07.368005+0000","last_became_active":"2024-09-12T18:35:25.658476+0000","last_became_peered":"2024-09-12T18:35:25.658476+0000","last_unstale":"2024-09-12T18:38:07.368005+0000","last_undegraded":"2024-09-12T18:38:07.368005+0000","last_fullsized":"2024-09-12T18:38:07.368005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:58.246449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.370140+0000","last_change":"2024-09-12T18:35:24.652399+0000","last_active":"2024-09-12T18:38:07.370140+0000","last_peered":"2024-09-12T18:38:07.370140+0000","last_clean":"2024-09-12T18:38:07.370140+0000","last_became_active":"2024-09-12T18:35:24.651416+0000","last_became_peered":"2024-09-12T18:35:24.651416+0000","last_unstale":"2024-09-12T18:38:07.370140+0000","last_undegraded":"2024-09-12T18:38:07.370140+0000","last_fullsized":"2024-09-12T18:38:07.370140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:32.594978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367773+0000","last_change":"2024-09-12T18:38:03.359924+0000","last_active":"2024-09-12T18:38:07.367773+0000","last_peered":"2024-09-12T18:38:07.367773+0000","last_clean":"2024-09-12T18:38:07.367773+0000","last_became_active":"2024-09-12T18:38:03.357598+0000","last_became_peered":"2024-09-12T18:38:03.357598+0000","last_unstale":"2024-09-12T18:38:07.367773+0000","last_undegraded":"2024-09-12T18:38:07.367773+0000","last_fullsized":"2024-09-12T18:38:07.367773+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:59.501652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368603+0000","last_change":"2024-09-12T18:35:25.651217+0000","last_active":"2024-09-12T18:38:07.368603+0000","last_peered":"2024-09-12T18:38:07.368603+0000","last_clean":"2024-09-12T18:38:07.368603+0000","last_became_active":"2024-09-12T18:35:25.649544+0000","last_became_peered":"2024-09-12T18:35:25.649544+0000","last_unstale":"2024-09-12T18:38:07.368603+0000","last_undegraded":"2024-09-12T18:38:07.368603+0000","last_fullsized":"2024-09-12T18:38:07.368603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:41.601376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367616+0000","last_change":"2024-09-12T18:38:03.349281+0000","last_active":"2024-09-12T18:38:07.367616+0000","last_peered":"2024-09-12T18:38:07.367616+0000","last_clean":"2024-09-12T18:38:07.367616+0000","last_became_active":"2024-09-12T18:38:03.347483+0000","last_became_peered":"2024-09-12T18:38:03.347483+0000","last_unstale":"2024-09-12T18:38:07.367616+0000","last_undegraded":"2024-09-12T18:38:07.367616+0000","last_fullsized":"2024-09-12T18:38:07.367616+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:02.283482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369856+0000","last_change":"2024-09-12T18:35:25.661544+0000","last_active":"2024-09-12T18:38:07.369856+0000","last_peered":"2024-09-12T18:38:07.369856+0000","last_clean":"2024-09-12T18:38:07.369856+0000","last_became_active":"2024-09-12T18:35:25.656985+0000","last_became_peered":"2024-09-12T18:35:25.656985+0000","last_unstale":"2024-09-12T18:38:07.369856+0000","last_undegraded":"2024-09-12T18:38:07.369856+0000","last_fullsized":"2024-09-12T18:38:07.369856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368189+0000","last_change":"2024-09-12T18:38:03.352648+0000","last_active":"2024-09-12T18:38:07.368189+0000","last_peered":"2024-09-12T18:38:07.368189+0000","last_clean":"2024-09-12T18:38:07.368189+0000","last_became_active":"2024-09-12T18:38:03.351740+0000","last_became_peered":"2024-09-12T18:38:03.351740+0000","last_unstale":"2024-09-12T18:38:07.368189+0000","last_undegraded":"2024-09-12T18:38:07.368189+0000","last_fullsized":"2024-09-12T18:38:07.368189+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:13.765236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368265+0000","last_change":"2024-09-12T18:35:25.656712+0000","last_active":"2024-09-12T18:38:07.368265+0000","last_peered":"2024-09-12T18:38:07.368265+0000","last_clean":"2024-09-12T18:38:07.368265+0000","last_became_active":"2024-09-12T18:35:25.654473+0000","last_became_peered":"2024-09-12T18:35:25.654473+0000","last_unstale":"2024-09-12T18:38:07.368265+0000","last_undegraded":"2024-09-12T18:38:07.368265+0000","last_fullsized":"2024-09-12T18:38:07.368265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:01.464680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":161,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367676+0000","last_change":"2024-09-12T18:35:24.659935+0000","last_active":"2024-09-12T18:38:07.367676+0000","last_peered":"2024-09-12T18:38:07.367676+0000","last_clean":"2024-09-12T18:38:07.367676+0000","last_became_active":"2024-09-12T18:35:24.659111+0000","last_became_peered":"2024-09-12T18:35:24.659111+0000","last_unstale":"2024-09-12T18:38:07.367676+0000","last_undegraded":"2024-09-12T18:38:07.367676+0000","last_fullsized":"2024-09-12T18:38:07.367676+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:11.480154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367022+0000","last_change":"2024-09-12T18:38:03.351609+0000","last_active":"2024-09-12T18:38:07.367022+0000","last_peered":"2024-09-12T18:38:07.367022+0000","last_clean":"2024-09-12T18:38:07.367022+0000","last_became_active":"2024-09-12T18:38:03.350972+0000","last_became_peered":"2024-09-12T18:38:03.350972+0000","last_unstale":"2024-09-12T18:38:07.367022+0000","last_undegraded":"2024-09-12T18:38:07.367022+0000","last_fullsized":"2024-09-12T18:38:07.367022+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:15.351880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":161,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367876+0000","last_change":"2024-09-12T18:35:24.638538+0000","last_active":"2024-09-12T18:38:07.367876+0000","last_peered":"2024-09-12T18:38:07.367876+0000","last_clean":"2024-09-12T18:38:07.367876+0000","last_became_active":"2024-09-12T18:35:24.637242+0000","last_became_peered":"2024-09-12T18:35:24.637242+0000","last_unstale":"2024-09-12T18:38:07.367876+0000","last_undegraded":"2024-09-12T18:38:07.367876+0000","last_fullsized":"2024-09-12T18:38:07.367876+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:26.877441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.278988+0000","last_change":"2024-09-12T18:35:25.662537+0000","last_active":"2024-09-12T18:38:09.278988+0000","last_peered":"2024-09-12T18:38:09.278988+0000","last_clean":"2024-09-12T18:38:09.278988+0000","last_became_active":"2024-09-12T18:35:25.661441+0000","last_became_peered":"2024-09-12T18:35:25.661441+0000","last_unstale":"2024-09-12T18:38:09.278988+0000","last_undegraded":"2024-09-12T18:38:09.278988+0000","last_fullsized":"2024-09-12T18:38:09.278988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:14.397867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":182,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.279511+0000","last_change":"2024-09-12T18:38:03.369857+0000","last_active":"2024-09-12T18:38:09.279511+0000","last_peered":"2024-09-12T18:38:09.279511+0000","last_clean":"2024-09-12T18:38:09.279511+0000","last_became_active":"2024-09-12T18:38:03.355520+0000","last_became_peered":"2024-09-12T18:38:03.355520+0000","last_unstale":"2024-09-12T18:38:09.279511+0000","last_undegraded":"2024-09-12T18:38:09.279511+0000","last_fullsized":"2024-09-12T18:38:09.279511+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:28.637798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.279099+0000","last_change":"2024-09-12T18:35:25.651406+0000","last_active":"2024-09-12T18:38:09.279099+0000","last_peered":"2024-09-12T18:38:09.279099+0000","last_clean":"2024-09-12T18:38:09.279099+0000","last_became_active":"2024-09-12T18:35:25.649728+0000","last_became_peered":"2024-09-12T18:35:25.649728+0000","last_unstale":"2024-09-12T18:38:09.279099+0000","last_undegraded":"2024-09-12T18:38:09.279099+0000","last_fullsized":"2024-09-12T18:38:09.279099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:41.773283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368047+0000","last_change":"2024-09-12T18:35:24.649153+0000","last_active":"2024-09-12T18:38:07.368047+0000","last_peered":"2024-09-12T18:38:07.368047+0000","last_clean":"2024-09-12T18:38:07.368047+0000","last_became_active":"2024-09-12T18:35:24.648512+0000","last_became_peered":"2024-09-12T18:35:24.648512+0000","last_unstale":"2024-09-12T18:38:07.368047+0000","last_undegraded":"2024-09-12T18:38:07.368047+0000","last_fullsized":"2024-09-12T18:38:07.368047+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:07.810456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366854+0000","last_change":"2024-09-12T18:35:25.656799+0000","last_active":"2024-09-12T18:38:07.366854+0000","last_peered":"2024-09-12T18:38:07.366854+0000","last_clean":"2024-09-12T18:38:07.366854+0000","last_became_active":"2024-09-12T18:35:25.654980+0000","last_became_peered":"2024-09-12T18:35:25.654980+0000","last_unstale":"2024-09-12T18:38:07.366854+0000","last_undegraded":"2024-09-12T18:38:07.366854+0000","last_fullsized":"2024-09-12T18:38:07.366854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:10.735439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":161,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.370189+0000","last_change":"2024-09-12T18:35:24.656268+0000","last_active":"2024-09-12T18:38:07.370189+0000","last_peered":"2024-09-12T18:38:07.370189+0000","last_clean":"2024-09-12T18:38:07.370189+0000","last_became_active":"2024-09-12T18:35:24.655420+0000","last_became_peered":"2024-09-12T18:35:24.655420+0000","last_unstale":"2024-09-12T18:38:07.370189+0000","last_undegraded":"2024-09-12T18:38:07.370189+0000","last_fullsized":"2024-09-12T18:38:07.370189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:04.654666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.278410+0000","last_change":"2024-09-12T18:38:03.357094+0000","last_active":"2024-09-12T18:38:09.278410+0000","last_peered":"2024-09-12T18:38:09.278410+0000","last_clean":"2024-09-12T18:38:09.278410+0000","last_became_active":"2024-09-12T18:38:03.355072+0000","last_became_peered":"2024-09-12T18:38:03.355072+0000","last_unstale":"2024-09-12T18:38:09.278410+0000","last_undegraded":"2024-09-12T18:38:09.278410+0000","last_fullsized":"2024-09-12T18:38:09.278410+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:46.451497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369635+0000","last_change":"2024-09-12T18:38:03.379032+0000","last_active":"2024-09-12T18:38:07.369635+0000","last_peered":"2024-09-12T18:38:07.369635+0000","last_clean":"2024-09-12T18:38:07.369635+0000","last_became_active":"2024-09-12T18:38:03.353780+0000","last_became_peered":"2024-09-12T18:38:03.353780+0000","last_unstale":"2024-09-12T18:38:07.369635+0000","last_undegraded":"2024-09-12T18:38:07.369635+0000","last_fullsized":"2024-09-12T18:38:07.369635+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:23.596638+0000","last_clean_scrub_stamp":"2024-09-12T18:35:23.596638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:26.800343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705704,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297412,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":296318,"kb_avail":94074428,"statfs":{"total":96636764160,"available":96332214272,"internally_reserved":0,"allocated":1097728,"data_stored":982590,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":303430086},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738408,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280784,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94091056,"statfs":{"total":96636764160,"available":96349241344,"internally_reserved":0,"allocated":1110016,"data_stored":983225,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":286390725},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738408,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302908,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":301886,"kb_avail":94068932,"statfs":{"total":96636764160,"available":96326586368,"internally_reserved":0,"allocated":1019904,"data_stored":391063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":309131718},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:38:15.034 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.035 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.035 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.035 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.035 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.035 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.035 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.035 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.036 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.036 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.036 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.036 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.036 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.036 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.036 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.036 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.036 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.037 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.037 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.037 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.037 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.037 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.037 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.037 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.037 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.038 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.038 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.038 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.038 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.038 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.038 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.038 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.038 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.038 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T18:35:23.596638+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.039 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.039 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-12T18:35:23.596638+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.039 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.039 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T18:35:23.596638+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.039 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.039 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T18:35:23.596638+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.039 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T18:35:23.596638+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.039 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.039 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-12T18:35:23.596638+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.039 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.040 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T18:35:23.596638+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.040 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.040 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T18:35:23.596638+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.040 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.040 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T18:35:23.596638+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.040 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.040 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T18:35:23.596638+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.040 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.041 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T18:35:23.596638+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.041 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.041 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T18:35:23.596638+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.041 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.041 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T18:35:12.464628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.041 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T18:35:19.425963+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.041 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-12T18:35:23.596638+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.041 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.041 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T18:35:19.425963+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.042 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-12T18:35:23.596638+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.042 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.042 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-12T18:35:19.425963+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.042 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-12T18:35:23.596638+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.042 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.042 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T18:35:19.425963+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.042 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-12T18:35:23.596638+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.042 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.042 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T18:35:23.596638+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.043 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-12T18:35:19.425963+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.043 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.043 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T18:35:23.596638+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.043 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T18:35:19.425963+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.043 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.043 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T18:35:23.596638+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.043 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-12T18:35:19.425963+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.043 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.044 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-12T18:35:23.596638+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.044 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T18:35:19.425963+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.044 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.044 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.044 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T18:35:23.596638+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.044 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.044 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T18:35:23.596638+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.044 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T18:35:23.596638+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.044 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.045 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T18:35:23.596638+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.045 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.045 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.045 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T18:35:23.596638+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.045 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.045 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T18:35:23.596638+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.045 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.045 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T18:35:23.596638+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.045 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.046 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T18:35:23.596638+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.046 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.046 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T18:35:23.596638+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.046 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.046 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T18:35:23.596638+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.046 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.046 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T18:35:23.596638+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.046 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.047 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T18:35:23.596638+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:15.047 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T18:38:35.048 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:38:35.367 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:38:35.369 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T18:38:35.384 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":191,"stamp":"2024-09-12T18:38:34.434086+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":192,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":180,"ondisk_log_size":180,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":881088,"kb_used_data":3152,"kb_used_omap":4,"kb_used_meta":877883,"kb_avail":282234432,"statfs":{"total":289910292480,"available":289008058368,"internally_reserved":0,"allocated":3227648,"data_stored":2356878,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4783,"internal_metadata":898952529},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004595"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368487+0000","last_change":"2024-09-12T18:38:03.358323+0000","last_active":"2024-09-12T18:38:07.368487+0000","last_peered":"2024-09-12T18:38:07.368487+0000","last_clean":"2024-09-12T18:38:07.368487+0000","last_became_active":"2024-09-12T18:38:03.357317+0000","last_became_peered":"2024-09-12T18:38:03.357317+0000","last_unstale":"2024-09-12T18:38:07.368487+0000","last_undegraded":"2024-09-12T18:38:07.368487+0000","last_fullsized":"2024-09-12T18:38:07.368487+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:55.315464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367135+0000","last_change":"2024-09-12T18:35:25.659760+0000","last_active":"2024-09-12T18:38:07.367135+0000","last_peered":"2024-09-12T18:38:07.367135+0000","last_clean":"2024-09-12T18:38:07.367135+0000","last_became_active":"2024-09-12T18:35:25.654920+0000","last_became_peered":"2024-09-12T18:35:25.654920+0000","last_unstale":"2024-09-12T18:38:07.367135+0000","last_undegraded":"2024-09-12T18:38:07.367135+0000","last_fullsized":"2024-09-12T18:38:07.367135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:21.519881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.280256+0000","last_change":"2024-09-12T18:35:25.659460+0000","last_active":"2024-09-12T18:38:09.280256+0000","last_peered":"2024-09-12T18:38:09.280256+0000","last_clean":"2024-09-12T18:38:09.280256+0000","last_became_active":"2024-09-12T18:35:25.657782+0000","last_became_peered":"2024-09-12T18:35:25.657782+0000","last_unstale":"2024-09-12T18:38:09.280256+0000","last_undegraded":"2024-09-12T18:38:09.280256+0000","last_fullsized":"2024-09-12T18:38:09.280256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:38.544284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.279092+0000","last_change":"2024-09-12T18:35:25.663617+0000","last_active":"2024-09-12T18:38:09.279092+0000","last_peered":"2024-09-12T18:38:09.279092+0000","last_clean":"2024-09-12T18:38:09.279092+0000","last_became_active":"2024-09-12T18:35:25.661977+0000","last_became_peered":"2024-09-12T18:35:25.661977+0000","last_unstale":"2024-09-12T18:38:09.279092+0000","last_undegraded":"2024-09-12T18:38:09.279092+0000","last_fullsized":"2024-09-12T18:38:09.279092+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:14.748234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367138+0000","last_change":"2024-09-12T18:35:25.656566+0000","last_active":"2024-09-12T18:38:07.367138+0000","last_peered":"2024-09-12T18:38:07.367138+0000","last_clean":"2024-09-12T18:38:07.367138+0000","last_became_active":"2024-09-12T18:35:25.654898+0000","last_became_peered":"2024-09-12T18:35:25.654898+0000","last_unstale":"2024-09-12T18:38:07.367138+0000","last_undegraded":"2024-09-12T18:38:07.367138+0000","last_fullsized":"2024-09-12T18:38:07.367138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:36.113250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.278540+0000","last_change":"2024-09-12T18:38:03.366489+0000","last_active":"2024-09-12T18:38:09.278540+0000","last_peered":"2024-09-12T18:38:09.278540+0000","last_clean":"2024-09-12T18:38:09.278540+0000","last_became_active":"2024-09-12T18:38:03.364745+0000","last_became_peered":"2024-09-12T18:38:03.364745+0000","last_unstale":"2024-09-12T18:38:09.278540+0000","last_undegraded":"2024-09-12T18:38:09.278540+0000","last_fullsized":"2024-09-12T18:38:09.278540+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:42.397517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.278245+0000","last_change":"2024-09-12T18:35:25.659811+0000","last_active":"2024-09-12T18:38:09.278245+0000","last_peered":"2024-09-12T18:38:09.278245+0000","last_clean":"2024-09-12T18:38:09.278245+0000","last_became_active":"2024-09-12T18:35:25.658998+0000","last_became_peered":"2024-09-12T18:35:25.658998+0000","last_unstale":"2024-09-12T18:38:09.278245+0000","last_undegraded":"2024-09-12T18:38:09.278245+0000","last_fullsized":"2024-09-12T18:38:09.278245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.277950+0000","last_change":"2024-09-12T18:38:03.365773+0000","last_active":"2024-09-12T18:38:09.277950+0000","last_peered":"2024-09-12T18:38:09.277950+0000","last_clean":"2024-09-12T18:38:09.277950+0000","last_became_active":"2024-09-12T18:38:03.364845+0000","last_became_peered":"2024-09-12T18:38:03.364845+0000","last_unstale":"2024-09-12T18:38:09.277950+0000","last_undegraded":"2024-09-12T18:38:09.277950+0000","last_fullsized":"2024-09-12T18:38:09.277950+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:19.384528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369867+0000","last_change":"2024-09-12T18:35:25.668339+0000","last_active":"2024-09-12T18:38:07.369867+0000","last_peered":"2024-09-12T18:38:07.369867+0000","last_clean":"2024-09-12T18:38:07.369867+0000","last_became_active":"2024-09-12T18:35:25.667608+0000","last_became_peered":"2024-09-12T18:35:25.667608+0000","last_unstale":"2024-09-12T18:38:07.369867+0000","last_undegraded":"2024-09-12T18:38:07.369867+0000","last_fullsized":"2024-09-12T18:38:07.369867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:15.699745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367232+0000","last_change":"2024-09-12T18:38:03.358177+0000","last_active":"2024-09-12T18:38:07.367232+0000","last_peered":"2024-09-12T18:38:07.367232+0000","last_clean":"2024-09-12T18:38:07.367232+0000","last_became_active":"2024-09-12T18:38:03.357446+0000","last_became_peered":"2024-09-12T18:38:03.357446+0000","last_unstale":"2024-09-12T18:38:07.367232+0000","last_undegraded":"2024-09-12T18:38:07.367232+0000","last_fullsized":"2024-09-12T18:38:07.367232+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:13.110496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.280163+0000","last_change":"2024-09-12T18:38:03.356440+0000","last_active":"2024-09-12T18:38:09.280163+0000","last_peered":"2024-09-12T18:38:09.280163+0000","last_clean":"2024-09-12T18:38:09.280163+0000","last_became_active":"2024-09-12T18:38:03.355561+0000","last_became_peered":"2024-09-12T18:38:03.355561+0000","last_unstale":"2024-09-12T18:38:09.280163+0000","last_undegraded":"2024-09-12T18:38:09.280163+0000","last_fullsized":"2024-09-12T18:38:09.280163+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:43.438258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366852+0000","last_change":"2024-09-12T18:35:25.649885+0000","last_active":"2024-09-12T18:38:07.366852+0000","last_peered":"2024-09-12T18:38:07.366852+0000","last_clean":"2024-09-12T18:38:07.366852+0000","last_became_active":"2024-09-12T18:35:25.649111+0000","last_became_peered":"2024-09-12T18:35:25.649111+0000","last_unstale":"2024-09-12T18:38:07.366852+0000","last_undegraded":"2024-09-12T18:38:07.366852+0000","last_fullsized":"2024-09-12T18:38:07.366852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:17.162410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366640+0000","last_change":"2024-09-12T18:38:03.349917+0000","last_active":"2024-09-12T18:38:07.366640+0000","last_peered":"2024-09-12T18:38:07.366640+0000","last_clean":"2024-09-12T18:38:07.366640+0000","last_became_active":"2024-09-12T18:38:03.349130+0000","last_became_peered":"2024-09-12T18:38:03.349130+0000","last_unstale":"2024-09-12T18:38:07.366640+0000","last_undegraded":"2024-09-12T18:38:07.366640+0000","last_fullsized":"2024-09-12T18:38:07.366640+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:45.548888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.278555+0000","last_change":"2024-09-12T18:35:25.657913+0000","last_active":"2024-09-12T18:38:09.278555+0000","last_peered":"2024-09-12T18:38:09.278555+0000","last_clean":"2024-09-12T18:38:09.278555+0000","last_became_active":"2024-09-12T18:35:25.657082+0000","last_became_peered":"2024-09-12T18:35:25.657082+0000","last_unstale":"2024-09-12T18:38:09.278555+0000","last_undegraded":"2024-09-12T18:38:09.278555+0000","last_fullsized":"2024-09-12T18:38:09.278555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:21.538633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.278281+0000","last_change":"2024-09-12T18:35:25.658763+0000","last_active":"2024-09-12T18:38:09.278281+0000","last_peered":"2024-09-12T18:38:09.278281+0000","last_clean":"2024-09-12T18:38:09.278281+0000","last_became_active":"2024-09-12T18:35:25.657508+0000","last_became_peered":"2024-09-12T18:35:25.657508+0000","last_unstale":"2024-09-12T18:38:09.278281+0000","last_undegraded":"2024-09-12T18:38:09.278281+0000","last_fullsized":"2024-09-12T18:38:09.278281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:13.170519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.277942+0000","last_change":"2024-09-12T18:35:25.653730+0000","last_active":"2024-09-12T18:38:09.277942+0000","last_peered":"2024-09-12T18:38:09.277942+0000","last_clean":"2024-09-12T18:38:09.277942+0000","last_became_active":"2024-09-12T18:35:25.651535+0000","last_became_peered":"2024-09-12T18:35:25.651535+0000","last_unstale":"2024-09-12T18:38:09.277942+0000","last_undegraded":"2024-09-12T18:38:09.277942+0000","last_fullsized":"2024-09-12T18:38:09.277942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:26.078712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.370149+0000","last_change":"2024-09-12T18:35:25.656513+0000","last_active":"2024-09-12T18:38:07.370149+0000","last_peered":"2024-09-12T18:38:07.370149+0000","last_clean":"2024-09-12T18:38:07.370149+0000","last_became_active":"2024-09-12T18:35:25.653440+0000","last_became_peered":"2024-09-12T18:35:25.653440+0000","last_unstale":"2024-09-12T18:38:07.370149+0000","last_undegraded":"2024-09-12T18:38:07.370149+0000","last_fullsized":"2024-09-12T18:38:07.370149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:18.693161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367487+0000","last_change":"2024-09-12T18:35:25.657991+0000","last_active":"2024-09-12T18:38:07.367487+0000","last_peered":"2024-09-12T18:38:07.367487+0000","last_clean":"2024-09-12T18:38:07.367487+0000","last_became_active":"2024-09-12T18:35:25.653934+0000","last_became_peered":"2024-09-12T18:35:25.653934+0000","last_unstale":"2024-09-12T18:38:07.367487+0000","last_undegraded":"2024-09-12T18:38:07.367487+0000","last_fullsized":"2024-09-12T18:38:07.367487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:05.418901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368965+0000","last_change":"2024-09-12T18:38:03.358270+0000","last_active":"2024-09-12T18:38:07.368965+0000","last_peered":"2024-09-12T18:38:07.368965+0000","last_clean":"2024-09-12T18:38:07.368965+0000","last_became_active":"2024-09-12T18:38:03.357363+0000","last_became_peered":"2024-09-12T18:38:03.357363+0000","last_unstale":"2024-09-12T18:38:07.368965+0000","last_undegraded":"2024-09-12T18:38:07.368965+0000","last_fullsized":"2024-09-12T18:38:07.368965+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:56.658700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.279283+0000","last_change":"2024-09-12T18:35:25.661176+0000","last_active":"2024-09-12T18:38:09.279283+0000","last_peered":"2024-09-12T18:38:09.279283+0000","last_clean":"2024-09-12T18:38:09.279283+0000","last_became_active":"2024-09-12T18:35:25.659534+0000","last_became_peered":"2024-09-12T18:35:25.659534+0000","last_unstale":"2024-09-12T18:38:09.279283+0000","last_undegraded":"2024-09-12T18:38:09.279283+0000","last_fullsized":"2024-09-12T18:38:09.279283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:40.145442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.278976+0000","last_change":"2024-09-12T18:35:25.650632+0000","last_active":"2024-09-12T18:38:09.278976+0000","last_peered":"2024-09-12T18:38:09.278976+0000","last_clean":"2024-09-12T18:38:09.278976+0000","last_became_active":"2024-09-12T18:35:25.649333+0000","last_became_peered":"2024-09-12T18:35:25.649333+0000","last_unstale":"2024-09-12T18:38:09.278976+0000","last_undegraded":"2024-09-12T18:38:09.278976+0000","last_fullsized":"2024-09-12T18:38:09.278976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:30.537572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366475+0000","last_change":"2024-09-12T18:35:25.648245+0000","last_active":"2024-09-12T18:38:07.366475+0000","last_peered":"2024-09-12T18:38:07.366475+0000","last_clean":"2024-09-12T18:38:07.366475+0000","last_became_active":"2024-09-12T18:35:25.646357+0000","last_became_peered":"2024-09-12T18:35:25.646357+0000","last_unstale":"2024-09-12T18:38:07.366475+0000","last_undegraded":"2024-09-12T18:38:07.366475+0000","last_fullsized":"2024-09-12T18:38:07.366475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:05.662140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367728+0000","last_change":"2024-09-12T18:35:25.661613+0000","last_active":"2024-09-12T18:38:07.367728+0000","last_peered":"2024-09-12T18:38:07.367728+0000","last_clean":"2024-09-12T18:38:07.367728+0000","last_became_active":"2024-09-12T18:35:25.658833+0000","last_became_peered":"2024-09-12T18:35:25.658833+0000","last_unstale":"2024-09-12T18:38:07.367728+0000","last_undegraded":"2024-09-12T18:38:07.367728+0000","last_fullsized":"2024-09-12T18:38:07.367728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:51.064080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.366639+0000","last_change":"2024-09-12T18:35:25.657782+0000","last_active":"2024-09-12T18:38:07.366639+0000","last_peered":"2024-09-12T18:38:07.366639+0000","last_clean":"2024-09-12T18:38:07.366639+0000","last_became_active":"2024-09-12T18:35:25.655295+0000","last_became_peered":"2024-09-12T18:35:25.655295+0000","last_unstale":"2024-09-12T18:38:07.366639+0000","last_undegraded":"2024-09-12T18:38:07.366639+0000","last_fullsized":"2024-09-12T18:38:07.366639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:37.744175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368546+0000","last_change":"2024-09-12T18:35:25.654863+0000","last_active":"2024-09-12T18:38:07.368546+0000","last_peered":"2024-09-12T18:38:07.368546+0000","last_clean":"2024-09-12T18:38:07.368546+0000","last_became_active":"2024-09-12T18:35:25.650407+0000","last_became_peered":"2024-09-12T18:35:25.650407+0000","last_unstale":"2024-09-12T18:38:07.368546+0000","last_undegraded":"2024-09-12T18:38:07.368546+0000","last_fullsized":"2024-09-12T18:38:07.368546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:38.395666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369981+0000","last_change":"2024-09-12T18:35:25.662414+0000","last_active":"2024-09-12T18:38:07.369981+0000","last_peered":"2024-09-12T18:38:07.369981+0000","last_clean":"2024-09-12T18:38:07.369981+0000","last_became_active":"2024-09-12T18:35:25.660126+0000","last_became_peered":"2024-09-12T18:35:25.660126+0000","last_unstale":"2024-09-12T18:38:07.369981+0000","last_undegraded":"2024-09-12T18:38:07.369981+0000","last_fullsized":"2024-09-12T18:38:07.369981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:48.437139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.280014+0000","last_change":"2024-09-12T18:35:25.661523+0000","last_active":"2024-09-12T18:38:09.280014+0000","last_peered":"2024-09-12T18:38:09.280014+0000","last_clean":"2024-09-12T18:38:09.280014+0000","last_became_active":"2024-09-12T18:35:25.659338+0000","last_became_peered":"2024-09-12T18:35:25.659338+0000","last_unstale":"2024-09-12T18:38:09.280014+0000","last_undegraded":"2024-09-12T18:38:09.280014+0000","last_fullsized":"2024-09-12T18:38:09.280014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:37.083820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367372+0000","last_change":"2024-09-12T18:35:25.662445+0000","last_active":"2024-09-12T18:38:07.367372+0000","last_peered":"2024-09-12T18:38:07.367372+0000","last_clean":"2024-09-12T18:38:07.367372+0000","last_became_active":"2024-09-12T18:35:25.659496+0000","last_became_peered":"2024-09-12T18:35:25.659496+0000","last_unstale":"2024-09-12T18:38:07.367372+0000","last_undegraded":"2024-09-12T18:38:07.367372+0000","last_fullsized":"2024-09-12T18:38:07.367372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:03.270420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368653+0000","last_change":"2024-09-12T18:38:03.357219+0000","last_active":"2024-09-12T18:38:07.368653+0000","last_peered":"2024-09-12T18:38:07.368653+0000","last_clean":"2024-09-12T18:38:07.368653+0000","last_became_active":"2024-09-12T18:38:03.356412+0000","last_became_peered":"2024-09-12T18:38:03.356412+0000","last_unstale":"2024-09-12T18:38:07.368653+0000","last_undegraded":"2024-09-12T18:38:07.368653+0000","last_fullsized":"2024-09-12T18:38:07.368653+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:53.007632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367404+0000","last_change":"2024-09-12T18:35:25.650507+0000","last_active":"2024-09-12T18:38:07.367404+0000","last_peered":"2024-09-12T18:38:07.367404+0000","last_clean":"2024-09-12T18:38:07.367404+0000","last_became_active":"2024-09-12T18:35:25.649415+0000","last_became_peered":"2024-09-12T18:35:25.649415+0000","last_unstale":"2024-09-12T18:38:07.367404+0000","last_undegraded":"2024-09-12T18:38:07.367404+0000","last_fullsized":"2024-09-12T18:38:07.367404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:23.081416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367879+0000","last_change":"2024-09-12T18:35:25.653949+0000","last_active":"2024-09-12T18:38:07.367879+0000","last_peered":"2024-09-12T18:38:07.367879+0000","last_clean":"2024-09-12T18:38:07.367879+0000","last_became_active":"2024-09-12T18:35:25.652992+0000","last_became_peered":"2024-09-12T18:35:25.652992+0000","last_unstale":"2024-09-12T18:38:07.367879+0000","last_undegraded":"2024-09-12T18:38:07.367879+0000","last_fullsized":"2024-09-12T18:38:07.367879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:47.687372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.278107+0000","last_change":"2024-09-12T18:38:03.356306+0000","last_active":"2024-09-12T18:38:09.278107+0000","last_peered":"2024-09-12T18:38:09.278107+0000","last_clean":"2024-09-12T18:38:09.278107+0000","last_became_active":"2024-09-12T18:38:03.355052+0000","last_became_peered":"2024-09-12T18:38:03.355052+0000","last_unstale":"2024-09-12T18:38:09.278107+0000","last_undegraded":"2024-09-12T18:38:09.278107+0000","last_fullsized":"2024-09-12T18:38:09.278107+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:54.986299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":178,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:30.461083+0000","last_change":"2024-09-12T18:38:30.461083+0000","last_active":"2024-09-12T18:38:30.461083+0000","last_peered":"2024-09-12T18:38:30.461083+0000","last_clean":"2024-09-12T18:38:30.461083+0000","last_became_active":"2024-09-12T18:38:03.351112+0000","last_became_peered":"2024-09-12T18:38:03.351112+0000","last_unstale":"2024-09-12T18:38:30.461083+0000","last_undegraded":"2024-09-12T18:38:30.461083+0000","last_fullsized":"2024-09-12T18:38:30.461083+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:30.460854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:30.460854+0000","last_clean_scrub_stamp":"2024-09-12T18:38:30.460854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:13.061935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"91'4","reported_seq":172,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:27.922735+0000","last_change":"2024-09-12T18:38:27.922735+0000","last_active":"2024-09-12T18:38:27.922735+0000","last_peered":"2024-09-12T18:38:27.922735+0000","last_clean":"2024-09-12T18:38:27.922735+0000","last_became_active":"2024-09-12T18:35:24.656208+0000","last_became_peered":"2024-09-12T18:35:24.656208+0000","last_unstale":"2024-09-12T18:38:27.922735+0000","last_undegraded":"2024-09-12T18:38:27.922735+0000","last_fullsized":"2024-09-12T18:38:27.922735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'4","last_scrub_stamp":"2024-09-12T18:38:27.922544+0000","last_deep_scrub":"91'4","last_deep_scrub_stamp":"2024-09-12T18:38:27.922544+0000","last_clean_scrub_stamp":"2024-09-12T18:38:27.922544+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:17.404089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:31.451665+0000","last_change":"2024-09-12T18:38:31.451665+0000","last_active":"2024-09-12T18:38:31.451665+0000","last_peered":"2024-09-12T18:38:31.451665+0000","last_clean":"2024-09-12T18:38:31.451665+0000","last_became_active":"2024-09-12T18:35:25.650849+0000","last_became_peered":"2024-09-12T18:35:25.650849+0000","last_unstale":"2024-09-12T18:38:31.451665+0000","last_undegraded":"2024-09-12T18:38:31.451665+0000","last_fullsized":"2024-09-12T18:38:31.451665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:31.451483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:31.451483+0000","last_clean_scrub_stamp":"2024-09-12T18:38:31.451483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:54.990616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:22.838878+0000","last_change":"2024-09-12T18:38:22.838878+0000","last_active":"2024-09-12T18:38:22.838878+0000","last_peered":"2024-09-12T18:38:22.838878+0000","last_clean":"2024-09-12T18:38:22.838878+0000","last_became_active":"2024-09-12T18:35:24.653175+0000","last_became_peered":"2024-09-12T18:35:24.653175+0000","last_unstale":"2024-09-12T18:38:22.838878+0000","last_undegraded":"2024-09-12T18:38:22.838878+0000","last_fullsized":"2024-09-12T18:38:22.838878+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:22.838700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:22.838700+0000","last_clean_scrub_stamp":"2024-09-12T18:38:22.838700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:19.971248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369501+0000","last_change":"2024-09-12T18:38:03.356363+0000","last_active":"2024-09-12T18:38:07.369501+0000","last_peered":"2024-09-12T18:38:07.369501+0000","last_clean":"2024-09-12T18:38:07.369501+0000","last_became_active":"2024-09-12T18:38:03.354299+0000","last_became_peered":"2024-09-12T18:38:03.354299+0000","last_unstale":"2024-09-12T18:38:07.369501+0000","last_undegraded":"2024-09-12T18:38:07.369501+0000","last_fullsized":"2024-09-12T18:38:07.369501+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:40.267630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:18.425352+0000","last_change":"2024-09-12T18:38:18.425352+0000","last_active":"2024-09-12T18:38:18.425352+0000","last_peered":"2024-09-12T18:38:18.425352+0000","last_clean":"2024-09-12T18:38:18.425352+0000","last_became_active":"2024-09-12T18:35:24.638230+0000","last_became_peered":"2024-09-12T18:35:24.638230+0000","last_unstale":"2024-09-12T18:38:18.425352+0000","last_undegraded":"2024-09-12T18:38:18.425352+0000","last_fullsized":"2024-09-12T18:38:18.425352+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:18.425173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:18.425173+0000","last_clean_scrub_stamp":"2024-09-12T18:38:18.425173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:59.363225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369661+0000","last_change":"2024-09-12T18:38:03.354155+0000","last_active":"2024-09-12T18:38:07.369661+0000","last_peered":"2024-09-12T18:38:07.369661+0000","last_clean":"2024-09-12T18:38:07.369661+0000","last_became_active":"2024-09-12T18:38:03.352848+0000","last_became_peered":"2024-09-12T18:38:03.352848+0000","last_unstale":"2024-09-12T18:38:07.369661+0000","last_undegraded":"2024-09-12T18:38:07.369661+0000","last_fullsized":"2024-09-12T18:38:07.369661+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:36.825717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"91'12","reported_seq":180,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:26.967784+0000","last_change":"2024-09-12T18:38:26.967784+0000","last_active":"2024-09-12T18:38:26.967784+0000","last_peered":"2024-09-12T18:38:26.967784+0000","last_clean":"2024-09-12T18:38:26.967784+0000","last_became_active":"2024-09-12T18:35:24.652880+0000","last_became_peered":"2024-09-12T18:35:24.652880+0000","last_unstale":"2024-09-12T18:38:26.967784+0000","last_undegraded":"2024-09-12T18:38:26.967784+0000","last_fullsized":"2024-09-12T18:38:26.967784+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'12","last_scrub_stamp":"2024-09-12T18:38:26.967536+0000","last_deep_scrub":"91'12","last_deep_scrub_stamp":"2024-09-12T18:38:26.967536+0000","last_clean_scrub_stamp":"2024-09-12T18:38:26.967536+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:30.754499+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"91'2","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:25.998829+0000","last_change":"2024-09-12T18:38:25.998829+0000","last_active":"2024-09-12T18:38:25.998829+0000","last_peered":"2024-09-12T18:38:25.998829+0000","last_clean":"2024-09-12T18:38:25.998829+0000","last_became_active":"2024-09-12T18:35:24.652792+0000","last_became_peered":"2024-09-12T18:35:24.652792+0000","last_unstale":"2024-09-12T18:38:25.998829+0000","last_undegraded":"2024-09-12T18:38:25.998829+0000","last_fullsized":"2024-09-12T18:38:25.998829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2024-09-12T18:38:25.998647+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2024-09-12T18:38:25.998647+0000","last_clean_scrub_stamp":"2024-09-12T18:38:25.998647+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:02.832804+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:28.476822+0000","last_change":"2024-09-12T18:38:28.476822+0000","last_active":"2024-09-12T18:38:28.476822+0000","last_peered":"2024-09-12T18:38:28.476822+0000","last_clean":"2024-09-12T18:38:28.476822+0000","last_became_active":"2024-09-12T18:35:25.648186+0000","last_became_peered":"2024-09-12T18:35:25.648186+0000","last_unstale":"2024-09-12T18:38:28.476822+0000","last_undegraded":"2024-09-12T18:38:28.476822+0000","last_fullsized":"2024-09-12T18:38:28.476822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:28.476612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:28.476612+0000","last_clean_scrub_stamp":"2024-09-12T18:38:28.476612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:35:58.565120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"91'3","reported_seq":171,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:16.436792+0000","last_change":"2024-09-12T18:38:16.436792+0000","last_active":"2024-09-12T18:38:16.436792+0000","last_peered":"2024-09-12T18:38:16.436792+0000","last_clean":"2024-09-12T18:38:16.436792+0000","last_became_active":"2024-09-12T18:35:24.647629+0000","last_became_peered":"2024-09-12T18:35:24.647629+0000","last_unstale":"2024-09-12T18:38:16.436792+0000","last_undegraded":"2024-09-12T18:38:16.436792+0000","last_fullsized":"2024-09-12T18:38:16.436792+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-09-12T18:38:16.436607+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-09-12T18:38:16.436607+0000","last_clean_scrub_stamp":"2024-09-12T18:38:16.436607+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:38.233429+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:27.491405+0000","last_change":"2024-09-12T18:38:27.491405+0000","last_active":"2024-09-12T18:38:27.491405+0000","last_peered":"2024-09-12T18:38:27.491405+0000","last_clean":"2024-09-12T18:38:27.491405+0000","last_became_active":"2024-09-12T18:35:25.651628+0000","last_became_peered":"2024-09-12T18:35:25.651628+0000","last_unstale":"2024-09-12T18:38:27.491405+0000","last_undegraded":"2024-09-12T18:38:27.491405+0000","last_fullsized":"2024-09-12T18:38:27.491405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:27.491200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:27.491200+0000","last_clean_scrub_stamp":"2024-09-12T18:38:27.491200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:43.970943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"91'2","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:25.017906+0000","last_change":"2024-09-12T18:38:25.017906+0000","last_active":"2024-09-12T18:38:25.017906+0000","last_peered":"2024-09-12T18:38:25.017906+0000","last_clean":"2024-09-12T18:38:25.017906+0000","last_became_active":"2024-09-12T18:35:24.654264+0000","last_became_peered":"2024-09-12T18:35:24.654264+0000","last_unstale":"2024-09-12T18:38:25.017906+0000","last_undegraded":"2024-09-12T18:38:25.017906+0000","last_fullsized":"2024-09-12T18:38:25.017906+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2024-09-12T18:38:25.017729+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2024-09-12T18:38:25.017729+0000","last_clean_scrub_stamp":"2024-09-12T18:38:25.017729+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:01.448156+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.278842+0000","last_change":"2024-09-12T18:38:03.365901+0000","last_active":"2024-09-12T18:38:09.278842+0000","last_peered":"2024-09-12T18:38:09.278842+0000","last_clean":"2024-09-12T18:38:09.278842+0000","last_became_active":"2024-09-12T18:38:03.364754+0000","last_became_peered":"2024-09-12T18:38:03.364754+0000","last_unstale":"2024-09-12T18:38:09.278842+0000","last_undegraded":"2024-09-12T18:38:09.278842+0000","last_fullsized":"2024-09-12T18:38:09.278842+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:43.078837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:23.976416+0000","last_change":"2024-09-12T18:38:23.976416+0000","last_active":"2024-09-12T18:38:23.976416+0000","last_peered":"2024-09-12T18:38:23.976416+0000","last_clean":"2024-09-12T18:38:23.976416+0000","last_became_active":"2024-09-12T18:35:24.657015+0000","last_became_peered":"2024-09-12T18:35:24.657015+0000","last_unstale":"2024-09-12T18:38:23.976416+0000","last_undegraded":"2024-09-12T18:38:23.976416+0000","last_fullsized":"2024-09-12T18:38:23.976416+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:23.976218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:23.976218+0000","last_clean_scrub_stamp":"2024-09-12T18:38:23.976218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:04.600584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:30.862366+0000","last_change":"2024-09-12T18:38:30.862366+0000","last_active":"2024-09-12T18:38:30.862366+0000","last_peered":"2024-09-12T18:38:30.862366+0000","last_clean":"2024-09-12T18:38:30.862366+0000","last_became_active":"2024-09-12T18:35:25.659511+0000","last_became_peered":"2024-09-12T18:35:25.659511+0000","last_unstale":"2024-09-12T18:38:30.862366+0000","last_undegraded":"2024-09-12T18:38:30.862366+0000","last_fullsized":"2024-09-12T18:38:30.862366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:30.862185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:30.862185+0000","last_clean_scrub_stamp":"2024-09-12T18:38:30.862185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:31.983235+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"91'3","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:21.834936+0000","last_change":"2024-09-12T18:38:21.834936+0000","last_active":"2024-09-12T18:38:21.834936+0000","last_peered":"2024-09-12T18:38:21.834936+0000","last_clean":"2024-09-12T18:38:21.834936+0000","last_became_active":"2024-09-12T18:38:03.364147+0000","last_became_peered":"2024-09-12T18:38:03.364147+0000","last_unstale":"2024-09-12T18:38:21.834936+0000","last_undegraded":"2024-09-12T18:38:21.834936+0000","last_fullsized":"2024-09-12T18:38:21.834936+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-09-12T18:38:21.834762+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-09-12T18:38:21.834762+0000","last_clean_scrub_stamp":"2024-09-12T18:38:21.834762+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:50.155191+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.279387+0000","last_change":"2024-09-12T18:38:03.356255+0000","last_active":"2024-09-12T18:38:09.279387+0000","last_peered":"2024-09-12T18:38:09.279387+0000","last_clean":"2024-09-12T18:38:09.279387+0000","last_became_active":"2024-09-12T18:38:03.355310+0000","last_became_peered":"2024-09-12T18:38:03.355310+0000","last_unstale":"2024-09-12T18:38:09.279387+0000","last_undegraded":"2024-09-12T18:38:09.279387+0000","last_fullsized":"2024-09-12T18:38:09.279387+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:21.097039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:20.987182+0000","last_change":"2024-09-12T18:38:20.987182+0000","last_active":"2024-09-12T18:38:20.987182+0000","last_peered":"2024-09-12T18:38:20.987182+0000","last_clean":"2024-09-12T18:38:20.987182+0000","last_became_active":"2024-09-12T18:35:24.658423+0000","last_became_peered":"2024-09-12T18:35:24.658423+0000","last_unstale":"2024-09-12T18:38:20.987182+0000","last_undegraded":"2024-09-12T18:38:20.987182+0000","last_fullsized":"2024-09-12T18:38:20.987182+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:20.986970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:20.986970+0000","last_clean_scrub_stamp":"2024-09-12T18:38:20.986970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:44.685119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.279733+0000","last_change":"2024-09-12T18:35:25.662287+0000","last_active":"2024-09-12T18:38:09.279733+0000","last_peered":"2024-09-12T18:38:09.279733+0000","last_clean":"2024-09-12T18:38:09.279733+0000","last_became_active":"2024-09-12T18:35:25.660372+0000","last_became_peered":"2024-09-12T18:35:25.660372+0000","last_unstale":"2024-09-12T18:38:09.279733+0000","last_undegraded":"2024-09-12T18:38:09.279733+0000","last_fullsized":"2024-09-12T18:38:09.279733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:08.729541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:15.449099+0000","last_change":"2024-09-12T18:38:15.449099+0000","last_active":"2024-09-12T18:38:15.449099+0000","last_peered":"2024-09-12T18:38:15.449099+0000","last_clean":"2024-09-12T18:38:15.449099+0000","last_became_active":"2024-09-12T18:35:24.647520+0000","last_became_peered":"2024-09-12T18:35:24.647520+0000","last_unstale":"2024-09-12T18:38:15.449099+0000","last_undegraded":"2024-09-12T18:38:15.449099+0000","last_fullsized":"2024-09-12T18:38:15.449099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:15.448900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:15.448900+0000","last_clean_scrub_stamp":"2024-09-12T18:38:15.448900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:34.948207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.280029+0000","last_change":"2024-09-12T18:35:25.658674+0000","last_active":"2024-09-12T18:38:09.280029+0000","last_peered":"2024-09-12T18:38:09.280029+0000","last_clean":"2024-09-12T18:38:09.280029+0000","last_became_active":"2024-09-12T18:35:25.657386+0000","last_became_peered":"2024-09-12T18:35:25.657386+0000","last_unstale":"2024-09-12T18:38:09.280029+0000","last_undegraded":"2024-09-12T18:38:09.280029+0000","last_fullsized":"2024-09-12T18:38:09.280029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:48.037086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:20.462439+0000","last_change":"2024-09-12T18:38:20.462439+0000","last_active":"2024-09-12T18:38:20.462439+0000","last_peered":"2024-09-12T18:38:20.462439+0000","last_clean":"2024-09-12T18:38:20.462439+0000","last_became_active":"2024-09-12T18:35:24.646008+0000","last_became_peered":"2024-09-12T18:35:24.646008+0000","last_unstale":"2024-09-12T18:38:20.462439+0000","last_undegraded":"2024-09-12T18:38:20.462439+0000","last_fullsized":"2024-09-12T18:38:20.462439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:20.462258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:20.462258+0000","last_clean_scrub_stamp":"2024-09-12T18:38:20.462258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:51.867050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369934+0000","last_change":"2024-09-12T18:35:25.667710+0000","last_active":"2024-09-12T18:38:07.369934+0000","last_peered":"2024-09-12T18:38:07.369934+0000","last_clean":"2024-09-12T18:38:07.369934+0000","last_became_active":"2024-09-12T18:35:25.666940+0000","last_became_peered":"2024-09-12T18:35:25.666940+0000","last_unstale":"2024-09-12T18:38:07.369934+0000","last_undegraded":"2024-09-12T18:38:07.369934+0000","last_fullsized":"2024-09-12T18:38:07.369934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:09.823085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"91'114","reported_seq":320,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:15.185352+0000","last_change":"2024-09-12T18:38:15.185352+0000","last_active":"2024-09-12T18:38:15.185352+0000","last_peered":"2024-09-12T18:38:15.185352+0000","last_clean":"2024-09-12T18:38:15.185352+0000","last_became_active":"2024-09-12T18:35:13.488346+0000","last_became_peered":"2024-09-12T18:35:13.488346+0000","last_unstale":"2024-09-12T18:38:15.185352+0000","last_undegraded":"2024-09-12T18:38:15.185352+0000","last_fullsized":"2024-09-12T18:38:15.185352+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'114","last_scrub_stamp":"2024-09-12T18:38:15.185153+0000","last_deep_scrub":"91'114","last_deep_scrub_stamp":"2024-09-12T18:38:15.185153+0000","last_clean_scrub_stamp":"2024-09-12T18:38:15.185153+0000","objects_scrubbed":2,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:10.417497+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"91'2","reported_seq":183,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:22.011028+0000","last_change":"2024-09-12T18:38:22.011028+0000","last_active":"2024-09-12T18:38:22.011028+0000","last_peered":"2024-09-12T18:38:22.011028+0000","last_clean":"2024-09-12T18:38:22.011028+0000","last_became_active":"2024-09-12T18:35:20.446796+0000","last_became_peered":"2024-09-12T18:35:20.446796+0000","last_unstale":"2024-09-12T18:38:22.011028+0000","last_undegraded":"2024-09-12T18:38:22.011028+0000","last_fullsized":"2024-09-12T18:38:22.011028+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2024-09-12T18:38:22.010848+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2024-09-12T18:38:22.010848+0000","last_clean_scrub_stamp":"2024-09-12T18:38:22.010848+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:28.609391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0016291610000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:18.847114+0000","last_change":"2024-09-12T18:38:18.847114+0000","last_active":"2024-09-12T18:38:18.847114+0000","last_peered":"2024-09-12T18:38:18.847114+0000","last_clean":"2024-09-12T18:38:18.847114+0000","last_became_active":"2024-09-12T18:38:03.353661+0000","last_became_peered":"2024-09-12T18:38:03.353661+0000","last_unstale":"2024-09-12T18:38:18.847114+0000","last_undegraded":"2024-09-12T18:38:18.847114+0000","last_fullsized":"2024-09-12T18:38:18.847114+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:18.846939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:18.846939+0000","last_clean_scrub_stamp":"2024-09-12T18:38:18.846939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:01.582641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.279792+0000","last_change":"2024-09-12T18:35:25.662424+0000","last_active":"2024-09-12T18:38:09.279792+0000","last_peered":"2024-09-12T18:38:09.279792+0000","last_clean":"2024-09-12T18:38:09.279792+0000","last_became_active":"2024-09-12T18:35:25.661043+0000","last_became_peered":"2024-09-12T18:35:25.661043+0000","last_unstale":"2024-09-12T18:38:09.279792+0000","last_undegraded":"2024-09-12T18:38:09.279792+0000","last_fullsized":"2024-09-12T18:38:09.279792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:52.551802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":181,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:17.113101+0000","last_change":"2024-09-12T18:38:17.113101+0000","last_active":"2024-09-12T18:38:17.113101+0000","last_peered":"2024-09-12T18:38:17.113101+0000","last_clean":"2024-09-12T18:38:17.113101+0000","last_became_active":"2024-09-12T18:35:20.448553+0000","last_became_peered":"2024-09-12T18:35:20.448553+0000","last_unstale":"2024-09-12T18:38:17.113101+0000","last_undegraded":"2024-09-12T18:38:17.113101+0000","last_fullsized":"2024-09-12T18:38:17.113101+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:17.112919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:17.112919+0000","last_clean_scrub_stamp":"2024-09-12T18:38:17.112919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:08.129973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001030836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:16.841417+0000","last_change":"2024-09-12T18:38:16.841417+0000","last_active":"2024-09-12T18:38:16.841417+0000","last_peered":"2024-09-12T18:38:16.841417+0000","last_clean":"2024-09-12T18:38:16.841417+0000","last_became_active":"2024-09-12T18:35:24.649940+0000","last_became_peered":"2024-09-12T18:35:24.649940+0000","last_unstale":"2024-09-12T18:38:16.841417+0000","last_undegraded":"2024-09-12T18:38:16.841417+0000","last_fullsized":"2024-09-12T18:38:16.841417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:16.841237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:16.841237+0000","last_clean_scrub_stamp":"2024-09-12T18:38:16.841237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:34.563251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":178,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:26.503786+0000","last_change":"2024-09-12T18:38:26.503786+0000","last_active":"2024-09-12T18:38:26.503786+0000","last_peered":"2024-09-12T18:38:26.503786+0000","last_clean":"2024-09-12T18:38:26.503786+0000","last_became_active":"2024-09-12T18:38:03.357664+0000","last_became_peered":"2024-09-12T18:38:03.357664+0000","last_unstale":"2024-09-12T18:38:26.503786+0000","last_undegraded":"2024-09-12T18:38:26.503786+0000","last_fullsized":"2024-09-12T18:38:26.503786+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:26.503603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:26.503603+0000","last_clean_scrub_stamp":"2024-09-12T18:38:26.503603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:02.405409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":181,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:13.814673+0000","last_change":"2024-09-12T18:38:13.814673+0000","last_active":"2024-09-12T18:38:13.814673+0000","last_peered":"2024-09-12T18:38:13.814673+0000","last_clean":"2024-09-12T18:38:13.814673+0000","last_became_active":"2024-09-12T18:35:20.442613+0000","last_became_peered":"2024-09-12T18:35:20.442613+0000","last_unstale":"2024-09-12T18:38:13.814673+0000","last_undegraded":"2024-09-12T18:38:13.814673+0000","last_fullsized":"2024-09-12T18:38:13.814673+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:13.814490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:13.814490+0000","last_clean_scrub_stamp":"2024-09-12T18:38:13.814490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:22.097264+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0014134620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:17.455041+0000","last_change":"2024-09-12T18:38:17.455041+0000","last_active":"2024-09-12T18:38:17.455041+0000","last_peered":"2024-09-12T18:38:17.455041+0000","last_clean":"2024-09-12T18:38:17.455041+0000","last_became_active":"2024-09-12T18:35:24.637334+0000","last_became_peered":"2024-09-12T18:35:24.637334+0000","last_unstale":"2024-09-12T18:38:17.455041+0000","last_undegraded":"2024-09-12T18:38:17.455041+0000","last_fullsized":"2024-09-12T18:38:17.455041+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:17.454840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:17.454840+0000","last_clean_scrub_stamp":"2024-09-12T18:38:17.454840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:10:57.149775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:29.851254+0000","last_change":"2024-09-12T18:38:29.851254+0000","last_active":"2024-09-12T18:38:29.851254+0000","last_peered":"2024-09-12T18:38:29.851254+0000","last_clean":"2024-09-12T18:38:29.851254+0000","last_became_active":"2024-09-12T18:38:03.359452+0000","last_became_peered":"2024-09-12T18:38:03.359452+0000","last_unstale":"2024-09-12T18:38:29.851254+0000","last_undegraded":"2024-09-12T18:38:29.851254+0000","last_fullsized":"2024-09-12T18:38:29.851254+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:29.851075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:29.851075+0000","last_clean_scrub_stamp":"2024-09-12T18:38:29.851075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:30.600668+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"91'3","reported_seq":184,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:16.160693+0000","last_change":"2024-09-12T18:38:16.160693+0000","last_active":"2024-09-12T18:38:16.160693+0000","last_peered":"2024-09-12T18:38:16.160693+0000","last_clean":"2024-09-12T18:38:16.160693+0000","last_became_active":"2024-09-12T18:35:20.446814+0000","last_became_peered":"2024-09-12T18:35:20.446814+0000","last_unstale":"2024-09-12T18:38:16.160693+0000","last_undegraded":"2024-09-12T18:38:16.160693+0000","last_fullsized":"2024-09-12T18:38:16.160693+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-09-12T18:38:16.160518+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-09-12T18:38:16.160518+0000","last_clean_scrub_stamp":"2024-09-12T18:38:16.160518+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:32.488019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010716149999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:20.003168+0000","last_change":"2024-09-12T18:38:20.003168+0000","last_active":"2024-09-12T18:38:20.003168+0000","last_peered":"2024-09-12T18:38:20.003168+0000","last_clean":"2024-09-12T18:38:20.003168+0000","last_became_active":"2024-09-12T18:35:24.657433+0000","last_became_peered":"2024-09-12T18:35:24.657433+0000","last_unstale":"2024-09-12T18:38:20.003168+0000","last_undegraded":"2024-09-12T18:38:20.003168+0000","last_fullsized":"2024-09-12T18:38:20.003168+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:20.003003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:20.003003+0000","last_clean_scrub_stamp":"2024-09-12T18:38:20.003003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:39.434187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:27.870494+0000","last_change":"2024-09-12T18:38:27.870494+0000","last_active":"2024-09-12T18:38:27.870494+0000","last_peered":"2024-09-12T18:38:27.870494+0000","last_clean":"2024-09-12T18:38:27.870494+0000","last_became_active":"2024-09-12T18:38:03.357592+0000","last_became_peered":"2024-09-12T18:38:03.357592+0000","last_unstale":"2024-09-12T18:38:27.870494+0000","last_undegraded":"2024-09-12T18:38:27.870494+0000","last_fullsized":"2024-09-12T18:38:27.870494+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:27.870320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:27.870320+0000","last_clean_scrub_stamp":"2024-09-12T18:38:27.870320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:26.098204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:22.974189+0000","last_change":"2024-09-12T18:38:22.974189+0000","last_active":"2024-09-12T18:38:22.974189+0000","last_peered":"2024-09-12T18:38:22.974189+0000","last_clean":"2024-09-12T18:38:22.974189+0000","last_became_active":"2024-09-12T18:35:24.656741+0000","last_became_peered":"2024-09-12T18:35:24.656741+0000","last_unstale":"2024-09-12T18:38:22.974189+0000","last_undegraded":"2024-09-12T18:38:22.974189+0000","last_fullsized":"2024-09-12T18:38:22.974189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:22.974017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:22.974017+0000","last_clean_scrub_stamp":"2024-09-12T18:38:22.974017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:19.281429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":181,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:14.828194+0000","last_change":"2024-09-12T18:38:14.828194+0000","last_active":"2024-09-12T18:38:14.828194+0000","last_peered":"2024-09-12T18:38:14.828194+0000","last_clean":"2024-09-12T18:38:14.828194+0000","last_became_active":"2024-09-12T18:35:20.442566+0000","last_became_peered":"2024-09-12T18:35:20.442566+0000","last_unstale":"2024-09-12T18:38:14.828194+0000","last_undegraded":"2024-09-12T18:38:14.828194+0000","last_fullsized":"2024-09-12T18:38:14.828194+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:14.828014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:14.828014+0000","last_clean_scrub_stamp":"2024-09-12T18:38:14.828014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:27.349359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001325786,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:29.495129+0000","last_change":"2024-09-12T18:38:29.495129+0000","last_active":"2024-09-12T18:38:29.495129+0000","last_peered":"2024-09-12T18:38:29.495129+0000","last_clean":"2024-09-12T18:38:29.495129+0000","last_became_active":"2024-09-12T18:35:25.648761+0000","last_became_peered":"2024-09-12T18:35:25.648761+0000","last_unstale":"2024-09-12T18:38:29.495129+0000","last_undegraded":"2024-09-12T18:38:29.495129+0000","last_fullsized":"2024-09-12T18:38:29.495129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:29.494932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:29.494932+0000","last_clean_scrub_stamp":"2024-09-12T18:38:29.494932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:21.380263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:15.791611+0000","last_change":"2024-09-12T18:38:15.791611+0000","last_active":"2024-09-12T18:38:15.791611+0000","last_peered":"2024-09-12T18:38:15.791611+0000","last_clean":"2024-09-12T18:38:15.791611+0000","last_became_active":"2024-09-12T18:38:03.356816+0000","last_became_peered":"2024-09-12T18:38:03.356816+0000","last_unstale":"2024-09-12T18:38:15.791611+0000","last_undegraded":"2024-09-12T18:38:15.791611+0000","last_fullsized":"2024-09-12T18:38:15.791611+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:15.791433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:15.791433+0000","last_clean_scrub_stamp":"2024-09-12T18:38:15.791433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:57.710017+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":193,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:14.417715+0000","last_change":"2024-09-12T18:38:14.417715+0000","last_active":"2024-09-12T18:38:14.417715+0000","last_peered":"2024-09-12T18:38:14.417715+0000","last_clean":"2024-09-12T18:38:14.417715+0000","last_became_active":"2024-09-12T18:38:03.350774+0000","last_became_peered":"2024-09-12T18:38:03.350774+0000","last_unstale":"2024-09-12T18:38:14.417715+0000","last_undegraded":"2024-09-12T18:38:14.417715+0000","last_fullsized":"2024-09-12T18:38:14.417715+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:14.417534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:14.417534+0000","last_clean_scrub_stamp":"2024-09-12T18:38:14.417534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:26.780036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00080163599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:25.539698+0000","last_change":"2024-09-12T18:38:25.539698+0000","last_active":"2024-09-12T18:38:25.539698+0000","last_peered":"2024-09-12T18:38:25.539698+0000","last_clean":"2024-09-12T18:38:25.539698+0000","last_became_active":"2024-09-12T18:35:25.649147+0000","last_became_peered":"2024-09-12T18:35:25.649147+0000","last_unstale":"2024-09-12T18:38:25.539698+0000","last_undegraded":"2024-09-12T18:38:25.539698+0000","last_fullsized":"2024-09-12T18:38:25.539698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:25.539439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:25.539439+0000","last_clean_scrub_stamp":"2024-09-12T18:38:25.539439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:30.348562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"91'3","reported_seq":171,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:19.814525+0000","last_change":"2024-09-12T18:38:19.814525+0000","last_active":"2024-09-12T18:38:19.814525+0000","last_peered":"2024-09-12T18:38:19.814525+0000","last_clean":"2024-09-12T18:38:19.814525+0000","last_became_active":"2024-09-12T18:35:24.655950+0000","last_became_peered":"2024-09-12T18:35:24.655950+0000","last_unstale":"2024-09-12T18:38:19.814525+0000","last_undegraded":"2024-09-12T18:38:19.814525+0000","last_fullsized":"2024-09-12T18:38:19.814525+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-09-12T18:38:19.814345+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-09-12T18:38:19.814345+0000","last_clean_scrub_stamp":"2024-09-12T18:38:19.814345+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:23.553058+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":58,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:19.050364+0000","last_change":"2024-09-12T18:38:19.050364+0000","last_active":"2024-09-12T18:38:19.050364+0000","last_peered":"2024-09-12T18:38:19.050364+0000","last_clean":"2024-09-12T18:38:19.050364+0000","last_became_active":"2024-09-12T18:37:34.254999+0000","last_became_peered":"2024-09-12T18:37:34.254999+0000","last_unstale":"2024-09-12T18:38:19.050364+0000","last_undegraded":"2024-09-12T18:38:19.050364+0000","last_fullsized":"2024-09-12T18:38:19.050364+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:19.050173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:19.050173+0000","last_clean_scrub_stamp":"2024-09-12T18:38:19.050173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:25.174685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:26.894907+0000","last_change":"2024-09-12T18:38:26.894907+0000","last_active":"2024-09-12T18:38:26.894907+0000","last_peered":"2024-09-12T18:38:26.894907+0000","last_clean":"2024-09-12T18:38:26.894907+0000","last_became_active":"2024-09-12T18:38:03.354895+0000","last_became_peered":"2024-09-12T18:38:03.354895+0000","last_unstale":"2024-09-12T18:38:26.894907+0000","last_undegraded":"2024-09-12T18:38:26.894907+0000","last_fullsized":"2024-09-12T18:38:26.894907+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:26.894733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:26.894733+0000","last_clean_scrub_stamp":"2024-09-12T18:38:26.894733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:57.496991+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"91'2","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:17.883222+0000","last_change":"2024-09-12T18:38:17.883222+0000","last_active":"2024-09-12T18:38:17.883222+0000","last_peered":"2024-09-12T18:38:17.883222+0000","last_clean":"2024-09-12T18:38:17.883222+0000","last_became_active":"2024-09-12T18:38:03.354684+0000","last_became_peered":"2024-09-12T18:38:03.354684+0000","last_unstale":"2024-09-12T18:38:17.883222+0000","last_undegraded":"2024-09-12T18:38:17.883222+0000","last_fullsized":"2024-09-12T18:38:17.883222+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2024-09-12T18:38:17.883042+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2024-09-12T18:38:17.883042+0000","last_clean_scrub_stamp":"2024-09-12T18:38:17.883042+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:47.656032+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":181,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:18.067264+0000","last_change":"2024-09-12T18:38:18.067264+0000","last_active":"2024-09-12T18:38:18.067264+0000","last_peered":"2024-09-12T18:38:18.067264+0000","last_clean":"2024-09-12T18:38:18.067264+0000","last_became_active":"2024-09-12T18:35:20.448521+0000","last_became_peered":"2024-09-12T18:35:20.448521+0000","last_unstale":"2024-09-12T18:38:18.067264+0000","last_undegraded":"2024-09-12T18:38:18.067264+0000","last_fullsized":"2024-09-12T18:38:18.067264+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:18.067093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:18.067093+0000","last_clean_scrub_stamp":"2024-09-12T18:38:18.067093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:26.127179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017009670000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:24.572135+0000","last_change":"2024-09-12T18:38:24.572135+0000","last_active":"2024-09-12T18:38:24.572135+0000","last_peered":"2024-09-12T18:38:24.572135+0000","last_clean":"2024-09-12T18:38:24.572135+0000","last_became_active":"2024-09-12T18:35:25.647347+0000","last_became_peered":"2024-09-12T18:35:25.647347+0000","last_unstale":"2024-09-12T18:38:24.572135+0000","last_undegraded":"2024-09-12T18:38:24.572135+0000","last_fullsized":"2024-09-12T18:38:24.572135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:24.571959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:24.571959+0000","last_clean_scrub_stamp":"2024-09-12T18:38:24.571959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:36.759025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.279243+0000","last_change":"2024-09-12T18:35:25.660696+0000","last_active":"2024-09-12T18:38:09.279243+0000","last_peered":"2024-09-12T18:38:09.279243+0000","last_clean":"2024-09-12T18:38:09.279243+0000","last_became_active":"2024-09-12T18:35:25.659827+0000","last_became_peered":"2024-09-12T18:35:25.659827+0000","last_unstale":"2024-09-12T18:38:09.279243+0000","last_undegraded":"2024-09-12T18:38:09.279243+0000","last_fullsized":"2024-09-12T18:38:09.279243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:15.678289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"91'10","reported_seq":178,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:28.960772+0000","last_change":"2024-09-12T18:38:28.960772+0000","last_active":"2024-09-12T18:38:28.960772+0000","last_peered":"2024-09-12T18:38:28.960772+0000","last_clean":"2024-09-12T18:38:28.960772+0000","last_became_active":"2024-09-12T18:35:24.654282+0000","last_became_peered":"2024-09-12T18:35:24.654282+0000","last_unstale":"2024-09-12T18:38:28.960772+0000","last_undegraded":"2024-09-12T18:38:28.960772+0000","last_fullsized":"2024-09-12T18:38:28.960772+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'10","last_scrub_stamp":"2024-09-12T18:38:28.960583+0000","last_deep_scrub":"91'10","last_deep_scrub_stamp":"2024-09-12T18:38:28.960583+0000","last_clean_scrub_stamp":"2024-09-12T18:38:28.960583+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:32.457138+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368447+0000","last_change":"2024-09-12T18:38:03.355018+0000","last_active":"2024-09-12T18:38:07.368447+0000","last_peered":"2024-09-12T18:38:07.368447+0000","last_clean":"2024-09-12T18:38:07.368447+0000","last_became_active":"2024-09-12T18:38:03.354064+0000","last_became_peered":"2024-09-12T18:38:03.354064+0000","last_unstale":"2024-09-12T18:38:07.368447+0000","last_undegraded":"2024-09-12T18:38:07.368447+0000","last_fullsized":"2024-09-12T18:38:07.368447+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:18.297083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"91'5","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:19.460433+0000","last_change":"2024-09-12T18:38:19.460433+0000","last_active":"2024-09-12T18:38:19.460433+0000","last_peered":"2024-09-12T18:38:19.460433+0000","last_clean":"2024-09-12T18:38:19.460433+0000","last_became_active":"2024-09-12T18:35:24.647826+0000","last_became_peered":"2024-09-12T18:35:24.647826+0000","last_unstale":"2024-09-12T18:38:19.460433+0000","last_undegraded":"2024-09-12T18:38:19.460433+0000","last_fullsized":"2024-09-12T18:38:19.460433+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'5","last_scrub_stamp":"2024-09-12T18:38:19.460194+0000","last_deep_scrub":"91'5","last_deep_scrub_stamp":"2024-09-12T18:38:19.460194+0000","last_clean_scrub_stamp":"2024-09-12T18:38:19.460194+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:21.339924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":180,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:29.943578+0000","last_change":"2024-09-12T18:38:29.943578+0000","last_active":"2024-09-12T18:38:29.943578+0000","last_peered":"2024-09-12T18:38:29.943578+0000","last_clean":"2024-09-12T18:38:29.943578+0000","last_became_active":"2024-09-12T18:38:03.364887+0000","last_became_peered":"2024-09-12T18:38:03.364887+0000","last_unstale":"2024-09-12T18:38:29.943578+0000","last_undegraded":"2024-09-12T18:38:29.943578+0000","last_fullsized":"2024-09-12T18:38:29.943578+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:29.943403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:29.943403+0000","last_clean_scrub_stamp":"2024-09-12T18:38:29.943403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:33.290355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368005+0000","last_change":"2024-09-12T18:35:25.661801+0000","last_active":"2024-09-12T18:38:07.368005+0000","last_peered":"2024-09-12T18:38:07.368005+0000","last_clean":"2024-09-12T18:38:07.368005+0000","last_became_active":"2024-09-12T18:35:25.658476+0000","last_became_peered":"2024-09-12T18:35:25.658476+0000","last_unstale":"2024-09-12T18:38:07.368005+0000","last_undegraded":"2024-09-12T18:38:07.368005+0000","last_fullsized":"2024-09-12T18:38:07.368005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:58.246449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:23.852782+0000","last_change":"2024-09-12T18:38:23.852782+0000","last_active":"2024-09-12T18:38:23.852782+0000","last_peered":"2024-09-12T18:38:23.852782+0000","last_clean":"2024-09-12T18:38:23.852782+0000","last_became_active":"2024-09-12T18:35:24.651416+0000","last_became_peered":"2024-09-12T18:35:24.651416+0000","last_unstale":"2024-09-12T18:38:23.852782+0000","last_undegraded":"2024-09-12T18:38:23.852782+0000","last_fullsized":"2024-09-12T18:38:23.852782+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:23.852597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:23.852597+0000","last_clean_scrub_stamp":"2024-09-12T18:38:23.852597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:23.496269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.367773+0000","last_change":"2024-09-12T18:38:03.359924+0000","last_active":"2024-09-12T18:38:07.367773+0000","last_peered":"2024-09-12T18:38:07.367773+0000","last_clean":"2024-09-12T18:38:07.367773+0000","last_became_active":"2024-09-12T18:38:03.357598+0000","last_became_peered":"2024-09-12T18:38:03.357598+0000","last_unstale":"2024-09-12T18:38:07.367773+0000","last_undegraded":"2024-09-12T18:38:07.367773+0000","last_fullsized":"2024-09-12T18:38:07.367773+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:59.501652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368603+0000","last_change":"2024-09-12T18:35:25.651217+0000","last_active":"2024-09-12T18:38:07.368603+0000","last_peered":"2024-09-12T18:38:07.368603+0000","last_clean":"2024-09-12T18:38:07.368603+0000","last_became_active":"2024-09-12T18:35:25.649544+0000","last_became_peered":"2024-09-12T18:35:25.649544+0000","last_unstale":"2024-09-12T18:38:07.368603+0000","last_undegraded":"2024-09-12T18:38:07.368603+0000","last_fullsized":"2024-09-12T18:38:07.368603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:41.601376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:20.856468+0000","last_change":"2024-09-12T18:38:20.856468+0000","last_active":"2024-09-12T18:38:20.856468+0000","last_peered":"2024-09-12T18:38:20.856468+0000","last_clean":"2024-09-12T18:38:20.856468+0000","last_became_active":"2024-09-12T18:38:03.347483+0000","last_became_peered":"2024-09-12T18:38:03.347483+0000","last_unstale":"2024-09-12T18:38:20.856468+0000","last_undegraded":"2024-09-12T18:38:20.856468+0000","last_fullsized":"2024-09-12T18:38:20.856468+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:20.856292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:20.856292+0000","last_clean_scrub_stamp":"2024-09-12T18:38:20.856292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:36.586909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.369856+0000","last_change":"2024-09-12T18:35:25.661544+0000","last_active":"2024-09-12T18:38:07.369856+0000","last_peered":"2024-09-12T18:38:07.369856+0000","last_clean":"2024-09-12T18:38:07.369856+0000","last_became_active":"2024-09-12T18:35:25.656985+0000","last_became_peered":"2024-09-12T18:35:25.656985+0000","last_unstale":"2024-09-12T18:38:07.369856+0000","last_undegraded":"2024-09-12T18:38:07.369856+0000","last_fullsized":"2024-09-12T18:38:07.369856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:51.736866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:24.880473+0000","last_change":"2024-09-12T18:38:24.880473+0000","last_active":"2024-09-12T18:38:24.880473+0000","last_peered":"2024-09-12T18:38:24.880473+0000","last_clean":"2024-09-12T18:38:24.880473+0000","last_became_active":"2024-09-12T18:38:03.351740+0000","last_became_peered":"2024-09-12T18:38:03.351740+0000","last_unstale":"2024-09-12T18:38:24.880473+0000","last_undegraded":"2024-09-12T18:38:24.880473+0000","last_fullsized":"2024-09-12T18:38:24.880473+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:24.880293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:24.880293+0000","last_clean_scrub_stamp":"2024-09-12T18:38:24.880293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:05.086041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:07.368265+0000","last_change":"2024-09-12T18:35:25.656712+0000","last_active":"2024-09-12T18:38:07.368265+0000","last_peered":"2024-09-12T18:38:07.368265+0000","last_clean":"2024-09-12T18:38:07.368265+0000","last_became_active":"2024-09-12T18:35:25.654473+0000","last_became_peered":"2024-09-12T18:35:25.654473+0000","last_unstale":"2024-09-12T18:38:07.368265+0000","last_undegraded":"2024-09-12T18:38:07.368265+0000","last_fullsized":"2024-09-12T18:38:07.368265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:01.464680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":169,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:21.506119+0000","last_change":"2024-09-12T18:38:21.506119+0000","last_active":"2024-09-12T18:38:21.506119+0000","last_peered":"2024-09-12T18:38:21.506119+0000","last_clean":"2024-09-12T18:38:21.506119+0000","last_became_active":"2024-09-12T18:35:24.659111+0000","last_became_peered":"2024-09-12T18:35:24.659111+0000","last_unstale":"2024-09-12T18:38:21.506119+0000","last_undegraded":"2024-09-12T18:38:21.506119+0000","last_fullsized":"2024-09-12T18:38:21.506119+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-09-12T18:38:21.505936+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-09-12T18:38:21.505936+0000","last_clean_scrub_stamp":"2024-09-12T18:38:21.505936+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:03.774289+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":178,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:32.406644+0000","last_change":"2024-09-12T18:38:32.406644+0000","last_active":"2024-09-12T18:38:32.406644+0000","last_peered":"2024-09-12T18:38:32.406644+0000","last_clean":"2024-09-12T18:38:32.406644+0000","last_became_active":"2024-09-12T18:38:03.350972+0000","last_became_peered":"2024-09-12T18:38:03.350972+0000","last_unstale":"2024-09-12T18:38:32.406644+0000","last_undegraded":"2024-09-12T18:38:32.406644+0000","last_fullsized":"2024-09-12T18:38:32.406644+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:32.406439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:32.406439+0000","last_clean_scrub_stamp":"2024-09-12T18:38:32.406439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:38.640933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":169,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:22.518989+0000","last_change":"2024-09-12T18:38:22.518989+0000","last_active":"2024-09-12T18:38:22.518989+0000","last_peered":"2024-09-12T18:38:22.518989+0000","last_clean":"2024-09-12T18:38:22.518989+0000","last_became_active":"2024-09-12T18:35:24.637242+0000","last_became_peered":"2024-09-12T18:35:24.637242+0000","last_unstale":"2024-09-12T18:38:22.518989+0000","last_undegraded":"2024-09-12T18:38:22.518989+0000","last_fullsized":"2024-09-12T18:38:22.518989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-09-12T18:38:22.518797+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-09-12T18:38:22.518797+0000","last_clean_scrub_stamp":"2024-09-12T18:38:22.518797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:24.831152+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.278988+0000","last_change":"2024-09-12T18:35:25.662537+0000","last_active":"2024-09-12T18:38:09.278988+0000","last_peered":"2024-09-12T18:38:09.278988+0000","last_clean":"2024-09-12T18:38:09.278988+0000","last_became_active":"2024-09-12T18:35:25.661441+0000","last_became_peered":"2024-09-12T18:35:25.661441+0000","last_unstale":"2024-09-12T18:38:09.278988+0000","last_undegraded":"2024-09-12T18:38:09.278988+0000","last_fullsized":"2024-09-12T18:38:09.278988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:14.397867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"91'3","reported_seq":191,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:30.989911+0000","last_change":"2024-09-12T18:38:30.989911+0000","last_active":"2024-09-12T18:38:30.989911+0000","last_peered":"2024-09-12T18:38:30.989911+0000","last_clean":"2024-09-12T18:38:30.989911+0000","last_became_active":"2024-09-12T18:38:03.355520+0000","last_became_peered":"2024-09-12T18:38:03.355520+0000","last_unstale":"2024-09-12T18:38:30.989911+0000","last_undegraded":"2024-09-12T18:38:30.989911+0000","last_fullsized":"2024-09-12T18:38:30.989911+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-09-12T18:38:30.989726+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-09-12T18:38:30.989726+0000","last_clean_scrub_stamp":"2024-09-12T18:38:30.989726+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:42.396744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.279099+0000","last_change":"2024-09-12T18:35:25.651406+0000","last_active":"2024-09-12T18:38:09.279099+0000","last_peered":"2024-09-12T18:38:09.279099+0000","last_clean":"2024-09-12T18:38:09.279099+0000","last_became_active":"2024-09-12T18:35:25.649728+0000","last_became_peered":"2024-09-12T18:35:25.649728+0000","last_unstale":"2024-09-12T18:38:09.279099+0000","last_undegraded":"2024-09-12T18:38:09.279099+0000","last_fullsized":"2024-09-12T18:38:09.279099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:41.773283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"91'3","reported_seq":171,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:23.555593+0000","last_change":"2024-09-12T18:38:23.555593+0000","last_active":"2024-09-12T18:38:23.555593+0000","last_peered":"2024-09-12T18:38:23.555593+0000","last_clean":"2024-09-12T18:38:23.555593+0000","last_became_active":"2024-09-12T18:35:24.648512+0000","last_became_peered":"2024-09-12T18:35:24.648512+0000","last_unstale":"2024-09-12T18:38:23.555593+0000","last_undegraded":"2024-09-12T18:38:23.555593+0000","last_fullsized":"2024-09-12T18:38:23.555593+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-09-12T18:38:23.555349+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-09-12T18:38:23.555349+0000","last_clean_scrub_stamp":"2024-09-12T18:38:23.555349+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:20.367735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:33.403555+0000","last_change":"2024-09-12T18:38:33.403555+0000","last_active":"2024-09-12T18:38:33.403555+0000","last_peered":"2024-09-12T18:38:33.403555+0000","last_clean":"2024-09-12T18:38:33.403555+0000","last_became_active":"2024-09-12T18:35:25.654980+0000","last_became_peered":"2024-09-12T18:35:25.654980+0000","last_unstale":"2024-09-12T18:38:33.403555+0000","last_undegraded":"2024-09-12T18:38:33.403555+0000","last_fullsized":"2024-09-12T18:38:33.403555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:33.403375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:33.403375+0000","last_clean_scrub_stamp":"2024-09-12T18:38:33.403375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:51.344863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":169,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:25.861274+0000","last_change":"2024-09-12T18:38:25.861274+0000","last_active":"2024-09-12T18:38:25.861274+0000","last_peered":"2024-09-12T18:38:25.861274+0000","last_clean":"2024-09-12T18:38:25.861274+0000","last_became_active":"2024-09-12T18:35:24.655420+0000","last_became_peered":"2024-09-12T18:35:24.655420+0000","last_unstale":"2024-09-12T18:38:25.861274+0000","last_undegraded":"2024-09-12T18:38:25.861274+0000","last_fullsized":"2024-09-12T18:38:25.861274+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-09-12T18:38:25.861095+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-09-12T18:38:25.861095+0000","last_clean_scrub_stamp":"2024-09-12T18:38:25.861095+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:47.957392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.278410+0000","last_change":"2024-09-12T18:38:03.357094+0000","last_active":"2024-09-12T18:38:09.278410+0000","last_peered":"2024-09-12T18:38:09.278410+0000","last_clean":"2024-09-12T18:38:09.278410+0000","last_became_active":"2024-09-12T18:38:03.355072+0000","last_became_peered":"2024-09-12T18:38:03.355072+0000","last_unstale":"2024-09-12T18:38:09.278410+0000","last_undegraded":"2024-09-12T18:38:09.278410+0000","last_fullsized":"2024-09-12T18:38:09.278410+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:46.451497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:28.864448+0000","last_change":"2024-09-12T18:38:28.864448+0000","last_active":"2024-09-12T18:38:28.864448+0000","last_peered":"2024-09-12T18:38:28.864448+0000","last_clean":"2024-09-12T18:38:28.864448+0000","last_became_active":"2024-09-12T18:38:03.353780+0000","last_became_peered":"2024-09-12T18:38:03.353780+0000","last_unstale":"2024-09-12T18:38:28.864448+0000","last_undegraded":"2024-09-12T18:38:28.864448+0000","last_fullsized":"2024-09-12T18:38:28.864448+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'6","last_scrub_stamp":"2024-09-12T18:38:28.864265+0000","last_deep_scrub":"91'6","last_deep_scrub_stamp":"2024-09-12T18:38:28.864265+0000","last_clean_scrub_stamp":"2024-09-12T18:38:28.864265+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:11.764660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705708,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297408,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":296318,"kb_avail":94074432,"statfs":{"total":96636764160,"available":96332218368,"internally_reserved":0,"allocated":1097728,"data_stored":982590,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":303430086},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738412,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280780,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94091060,"statfs":{"total":96636764160,"available":96349245440,"internally_reserved":0,"allocated":1110016,"data_stored":983225,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":286390725},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738412,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302900,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":301886,"kb_avail":94068940,"statfs":{"total":96636764160,"available":96326594560,"internally_reserved":0,"allocated":1019904,"data_stored":391063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":309131718},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:38:35.440 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.441 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.441 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.441 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.441 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.441 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.441 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.441 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.442 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.442 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.442 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.442 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.442 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.442 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.442 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.442 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.442 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.443 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.443 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.443 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.443 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.443 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.443 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.443 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.444 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.444 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.444 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.444 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.444 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.444 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.444 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.444 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.445 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.445 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.445 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.445 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.445 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.445 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.445 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.446 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.446 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.446 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.446 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.446 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.446 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.447 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.447 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.447 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.447 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.447 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:35.447 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T18:38:55.448 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:38:55.767 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:38:55.769 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T18:38:55.784 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":201,"stamp":"2024-09-12T18:38:54.441184+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":192,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":180,"ondisk_log_size":180,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":868608,"kb_used_data":3152,"kb_used_omap":4,"kb_used_meta":865403,"kb_avail":282246912,"statfs":{"total":289910292480,"available":289020837888,"internally_reserved":0,"allocated":3227648,"data_stored":2356878,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4783,"internal_metadata":886173009},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004353"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":178,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:46.373372+0000","last_change":"2024-09-12T18:38:46.373372+0000","last_active":"2024-09-12T18:38:46.373372+0000","last_peered":"2024-09-12T18:38:46.373372+0000","last_clean":"2024-09-12T18:38:46.373372+0000","last_became_active":"2024-09-12T18:38:03.357317+0000","last_became_peered":"2024-09-12T18:38:03.357317+0000","last_unstale":"2024-09-12T18:38:46.373372+0000","last_undegraded":"2024-09-12T18:38:46.373372+0000","last_fullsized":"2024-09-12T18:38:46.373372+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:46.373199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:46.373199+0000","last_clean_scrub_stamp":"2024-09-12T18:38:46.373199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:24.766492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:47.384844+0000","last_change":"2024-09-12T18:38:47.384844+0000","last_active":"2024-09-12T18:38:47.384844+0000","last_peered":"2024-09-12T18:38:47.384844+0000","last_clean":"2024-09-12T18:38:47.384844+0000","last_became_active":"2024-09-12T18:35:25.654920+0000","last_became_peered":"2024-09-12T18:35:25.654920+0000","last_unstale":"2024-09-12T18:38:47.384844+0000","last_undegraded":"2024-09-12T18:38:47.384844+0000","last_fullsized":"2024-09-12T18:38:47.384844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:47.384670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:47.384670+0000","last_clean_scrub_stamp":"2024-09-12T18:38:47.384670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:19.321982+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.280256+0000","last_change":"2024-09-12T18:35:25.659460+0000","last_active":"2024-09-12T18:38:09.280256+0000","last_peered":"2024-09-12T18:38:09.280256+0000","last_clean":"2024-09-12T18:38:09.280256+0000","last_became_active":"2024-09-12T18:35:25.657782+0000","last_became_peered":"2024-09-12T18:35:25.657782+0000","last_unstale":"2024-09-12T18:38:09.280256+0000","last_undegraded":"2024-09-12T18:38:09.280256+0000","last_fullsized":"2024-09-12T18:38:09.280256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:38.544284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:09.279092+0000","last_change":"2024-09-12T18:35:25.663617+0000","last_active":"2024-09-12T18:38:09.279092+0000","last_peered":"2024-09-12T18:38:09.279092+0000","last_clean":"2024-09-12T18:38:09.279092+0000","last_became_active":"2024-09-12T18:35:25.661977+0000","last_became_peered":"2024-09-12T18:35:25.661977+0000","last_unstale":"2024-09-12T18:38:09.279092+0000","last_undegraded":"2024-09-12T18:38:09.279092+0000","last_fullsized":"2024-09-12T18:38:09.279092+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:35:24.607229+0000","last_clean_scrub_stamp":"2024-09-12T18:35:24.607229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:14.748234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:44.297721+0000","last_change":"2024-09-12T18:38:44.297721+0000","last_active":"2024-09-12T18:38:44.297721+0000","last_peered":"2024-09-12T18:38:44.297721+0000","last_clean":"2024-09-12T18:38:44.297721+0000","last_became_active":"2024-09-12T18:35:25.654898+0000","last_became_peered":"2024-09-12T18:35:25.654898+0000","last_unstale":"2024-09-12T18:38:44.297721+0000","last_undegraded":"2024-09-12T18:38:44.297721+0000","last_fullsized":"2024-09-12T18:38:44.297721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:44.297523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:44.297523+0000","last_clean_scrub_stamp":"2024-09-12T18:38:44.297523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:39.030741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":178,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:51.036212+0000","last_change":"2024-09-12T18:38:51.036212+0000","last_active":"2024-09-12T18:38:51.036212+0000","last_peered":"2024-09-12T18:38:51.036212+0000","last_clean":"2024-09-12T18:38:51.036212+0000","last_became_active":"2024-09-12T18:38:03.364745+0000","last_became_peered":"2024-09-12T18:38:03.364745+0000","last_unstale":"2024-09-12T18:38:51.036212+0000","last_undegraded":"2024-09-12T18:38:51.036212+0000","last_fullsized":"2024-09-12T18:38:51.036212+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:51.036034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:51.036034+0000","last_clean_scrub_stamp":"2024-09-12T18:38:51.036034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:56.563475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:50.081519+0000","last_change":"2024-09-12T18:38:50.081519+0000","last_active":"2024-09-12T18:38:50.081519+0000","last_peered":"2024-09-12T18:38:50.081519+0000","last_clean":"2024-09-12T18:38:50.081519+0000","last_became_active":"2024-09-12T18:35:25.658998+0000","last_became_peered":"2024-09-12T18:35:25.658998+0000","last_unstale":"2024-09-12T18:38:50.081519+0000","last_undegraded":"2024-09-12T18:38:50.081519+0000","last_fullsized":"2024-09-12T18:38:50.081519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:50.081338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:50.081338+0000","last_clean_scrub_stamp":"2024-09-12T18:38:50.081338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:10.924113+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":178,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:48.109022+0000","last_change":"2024-09-12T18:38:48.109022+0000","last_active":"2024-09-12T18:38:48.109022+0000","last_peered":"2024-09-12T18:38:48.109022+0000","last_clean":"2024-09-12T18:38:48.109022+0000","last_became_active":"2024-09-12T18:38:03.364845+0000","last_became_peered":"2024-09-12T18:38:03.364845+0000","last_unstale":"2024-09-12T18:38:48.109022+0000","last_undegraded":"2024-09-12T18:38:48.109022+0000","last_fullsized":"2024-09-12T18:38:48.109022+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:48.108793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:48.108793+0000","last_clean_scrub_stamp":"2024-09-12T18:38:48.108793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:02.763376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:44.764248+0000","last_change":"2024-09-12T18:38:44.764248+0000","last_active":"2024-09-12T18:38:44.764248+0000","last_peered":"2024-09-12T18:38:44.764248+0000","last_clean":"2024-09-12T18:38:44.764248+0000","last_became_active":"2024-09-12T18:35:25.667608+0000","last_became_peered":"2024-09-12T18:35:25.667608+0000","last_unstale":"2024-09-12T18:38:44.764248+0000","last_undegraded":"2024-09-12T18:38:44.764248+0000","last_fullsized":"2024-09-12T18:38:44.764248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:44.764067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:44.764067+0000","last_clean_scrub_stamp":"2024-09-12T18:38:44.764067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:59.543066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":178,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:45.334988+0000","last_change":"2024-09-12T18:38:45.334988+0000","last_active":"2024-09-12T18:38:45.334988+0000","last_peered":"2024-09-12T18:38:45.334988+0000","last_clean":"2024-09-12T18:38:45.334988+0000","last_became_active":"2024-09-12T18:38:03.357446+0000","last_became_peered":"2024-09-12T18:38:03.357446+0000","last_unstale":"2024-09-12T18:38:45.334988+0000","last_undegraded":"2024-09-12T18:38:45.334988+0000","last_fullsized":"2024-09-12T18:38:45.334988+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:45.334782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:45.334782+0000","last_clean_scrub_stamp":"2024-09-12T18:38:45.334782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:02.759051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":178,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:49.059733+0000","last_change":"2024-09-12T18:38:49.059733+0000","last_active":"2024-09-12T18:38:49.059733+0000","last_peered":"2024-09-12T18:38:49.059733+0000","last_clean":"2024-09-12T18:38:49.059733+0000","last_became_active":"2024-09-12T18:38:03.355561+0000","last_became_peered":"2024-09-12T18:38:03.355561+0000","last_unstale":"2024-09-12T18:38:49.059733+0000","last_undegraded":"2024-09-12T18:38:49.059733+0000","last_fullsized":"2024-09-12T18:38:49.059733+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:49.059561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:49.059561+0000","last_clean_scrub_stamp":"2024-09-12T18:38:49.059561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:55.421623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:43.272160+0000","last_change":"2024-09-12T18:38:43.272160+0000","last_active":"2024-09-12T18:38:43.272160+0000","last_peered":"2024-09-12T18:38:43.272160+0000","last_clean":"2024-09-12T18:38:43.272160+0000","last_became_active":"2024-09-12T18:35:25.649111+0000","last_became_peered":"2024-09-12T18:35:25.649111+0000","last_unstale":"2024-09-12T18:38:43.272160+0000","last_undegraded":"2024-09-12T18:38:43.272160+0000","last_fullsized":"2024-09-12T18:38:43.272160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:43.271978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:43.271978+0000","last_clean_scrub_stamp":"2024-09-12T18:38:43.271978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:45.376399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":178,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:42.310978+0000","last_change":"2024-09-12T18:38:42.310978+0000","last_active":"2024-09-12T18:38:42.310978+0000","last_peered":"2024-09-12T18:38:42.310978+0000","last_clean":"2024-09-12T18:38:42.310978+0000","last_became_active":"2024-09-12T18:38:03.349130+0000","last_became_peered":"2024-09-12T18:38:03.349130+0000","last_unstale":"2024-09-12T18:38:42.310978+0000","last_undegraded":"2024-09-12T18:38:42.310978+0000","last_fullsized":"2024-09-12T18:38:42.310978+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:42.310773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:42.310773+0000","last_clean_scrub_stamp":"2024-09-12T18:38:42.310773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:53.594848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:47.077511+0000","last_change":"2024-09-12T18:38:47.077511+0000","last_active":"2024-09-12T18:38:47.077511+0000","last_peered":"2024-09-12T18:38:47.077511+0000","last_clean":"2024-09-12T18:38:47.077511+0000","last_became_active":"2024-09-12T18:35:25.657082+0000","last_became_peered":"2024-09-12T18:35:25.657082+0000","last_unstale":"2024-09-12T18:38:47.077511+0000","last_undegraded":"2024-09-12T18:38:47.077511+0000","last_fullsized":"2024-09-12T18:38:47.077511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:47.077335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:47.077335+0000","last_clean_scrub_stamp":"2024-09-12T18:38:47.077335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:29.771152+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:46.076727+0000","last_change":"2024-09-12T18:38:46.076727+0000","last_active":"2024-09-12T18:38:46.076727+0000","last_peered":"2024-09-12T18:38:46.076727+0000","last_clean":"2024-09-12T18:38:46.076727+0000","last_became_active":"2024-09-12T18:35:25.657508+0000","last_became_peered":"2024-09-12T18:35:25.657508+0000","last_unstale":"2024-09-12T18:38:46.076727+0000","last_undegraded":"2024-09-12T18:38:46.076727+0000","last_fullsized":"2024-09-12T18:38:46.076727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:46.076523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:46.076523+0000","last_clean_scrub_stamp":"2024-09-12T18:38:46.076523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:00.142903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:44.052240+0000","last_change":"2024-09-12T18:38:44.052240+0000","last_active":"2024-09-12T18:38:44.052240+0000","last_peered":"2024-09-12T18:38:44.052240+0000","last_clean":"2024-09-12T18:38:44.052240+0000","last_became_active":"2024-09-12T18:35:25.651535+0000","last_became_peered":"2024-09-12T18:35:25.651535+0000","last_unstale":"2024-09-12T18:38:44.052240+0000","last_undegraded":"2024-09-12T18:38:44.052240+0000","last_fullsized":"2024-09-12T18:38:44.052240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:44.052063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:44.052063+0000","last_clean_scrub_stamp":"2024-09-12T18:38:44.052063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:35.509838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:43.802558+0000","last_change":"2024-09-12T18:38:43.802558+0000","last_active":"2024-09-12T18:38:43.802558+0000","last_peered":"2024-09-12T18:38:43.802558+0000","last_clean":"2024-09-12T18:38:43.802558+0000","last_became_active":"2024-09-12T18:35:25.653440+0000","last_became_peered":"2024-09-12T18:35:25.653440+0000","last_unstale":"2024-09-12T18:38:43.802558+0000","last_undegraded":"2024-09-12T18:38:43.802558+0000","last_fullsized":"2024-09-12T18:38:43.802558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:43.802380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:43.802380+0000","last_clean_scrub_stamp":"2024-09-12T18:38:43.802380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:45.178223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:41.328846+0000","last_change":"2024-09-12T18:38:41.328846+0000","last_active":"2024-09-12T18:38:41.328846+0000","last_peered":"2024-09-12T18:38:41.328846+0000","last_clean":"2024-09-12T18:38:41.328846+0000","last_became_active":"2024-09-12T18:35:25.653934+0000","last_became_peered":"2024-09-12T18:35:25.653934+0000","last_unstale":"2024-09-12T18:38:41.328846+0000","last_undegraded":"2024-09-12T18:38:41.328846+0000","last_fullsized":"2024-09-12T18:38:41.328846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:41.328632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:41.328632+0000","last_clean_scrub_stamp":"2024-09-12T18:38:41.328632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:25.746626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:42.807263+0000","last_change":"2024-09-12T18:38:42.807263+0000","last_active":"2024-09-12T18:38:42.807263+0000","last_peered":"2024-09-12T18:38:42.807263+0000","last_clean":"2024-09-12T18:38:42.807263+0000","last_became_active":"2024-09-12T18:38:03.357363+0000","last_became_peered":"2024-09-12T18:38:03.357363+0000","last_unstale":"2024-09-12T18:38:42.807263+0000","last_undegraded":"2024-09-12T18:38:42.807263+0000","last_fullsized":"2024-09-12T18:38:42.807263+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:42.807088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:42.807088+0000","last_clean_scrub_stamp":"2024-09-12T18:38:42.807088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:22.310424+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:45.072125+0000","last_change":"2024-09-12T18:38:45.072125+0000","last_active":"2024-09-12T18:38:45.072125+0000","last_peered":"2024-09-12T18:38:45.072125+0000","last_clean":"2024-09-12T18:38:45.072125+0000","last_became_active":"2024-09-12T18:35:25.659534+0000","last_became_peered":"2024-09-12T18:35:25.659534+0000","last_unstale":"2024-09-12T18:38:45.072125+0000","last_undegraded":"2024-09-12T18:38:45.072125+0000","last_fullsized":"2024-09-12T18:38:45.072125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:45.071946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:45.071946+0000","last_clean_scrub_stamp":"2024-09-12T18:38:45.071946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:29:47.936738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:43.053200+0000","last_change":"2024-09-12T18:38:43.053200+0000","last_active":"2024-09-12T18:38:43.053200+0000","last_peered":"2024-09-12T18:38:43.053200+0000","last_clean":"2024-09-12T18:38:43.053200+0000","last_became_active":"2024-09-12T18:35:25.649333+0000","last_became_peered":"2024-09-12T18:35:25.649333+0000","last_unstale":"2024-09-12T18:38:43.053200+0000","last_undegraded":"2024-09-12T18:38:43.053200+0000","last_fullsized":"2024-09-12T18:38:43.053200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:43.053017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:43.053017+0000","last_clean_scrub_stamp":"2024-09-12T18:38:43.053017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:46.441483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:39.342647+0000","last_change":"2024-09-12T18:38:39.342647+0000","last_active":"2024-09-12T18:38:39.342647+0000","last_peered":"2024-09-12T18:38:39.342647+0000","last_clean":"2024-09-12T18:38:39.342647+0000","last_became_active":"2024-09-12T18:35:25.646357+0000","last_became_peered":"2024-09-12T18:35:25.646357+0000","last_unstale":"2024-09-12T18:38:39.342647+0000","last_undegraded":"2024-09-12T18:38:39.342647+0000","last_fullsized":"2024-09-12T18:38:39.342647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:39.342473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:39.342473+0000","last_clean_scrub_stamp":"2024-09-12T18:38:39.342473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:31.032867+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:41.808817+0000","last_change":"2024-09-12T18:38:41.808817+0000","last_active":"2024-09-12T18:38:41.808817+0000","last_peered":"2024-09-12T18:38:41.808817+0000","last_clean":"2024-09-12T18:38:41.808817+0000","last_became_active":"2024-09-12T18:35:25.658833+0000","last_became_peered":"2024-09-12T18:35:25.658833+0000","last_unstale":"2024-09-12T18:38:41.808817+0000","last_undegraded":"2024-09-12T18:38:41.808817+0000","last_fullsized":"2024-09-12T18:38:41.808817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:41.808642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:41.808642+0000","last_clean_scrub_stamp":"2024-09-12T18:38:41.808642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:37.366441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:40.368186+0000","last_change":"2024-09-12T18:38:40.368186+0000","last_active":"2024-09-12T18:38:40.368186+0000","last_peered":"2024-09-12T18:38:40.368186+0000","last_clean":"2024-09-12T18:38:40.368186+0000","last_became_active":"2024-09-12T18:35:25.655295+0000","last_became_peered":"2024-09-12T18:35:25.655295+0000","last_unstale":"2024-09-12T18:38:40.368186+0000","last_undegraded":"2024-09-12T18:38:40.368186+0000","last_fullsized":"2024-09-12T18:38:40.368186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:40.367985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:40.367985+0000","last_clean_scrub_stamp":"2024-09-12T18:38:40.367985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:29:54.697491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:38.313112+0000","last_change":"2024-09-12T18:38:38.313112+0000","last_active":"2024-09-12T18:38:38.313112+0000","last_peered":"2024-09-12T18:38:38.313112+0000","last_clean":"2024-09-12T18:38:38.313112+0000","last_became_active":"2024-09-12T18:35:25.650407+0000","last_became_peered":"2024-09-12T18:35:25.650407+0000","last_unstale":"2024-09-12T18:38:38.313112+0000","last_undegraded":"2024-09-12T18:38:38.313112+0000","last_fullsized":"2024-09-12T18:38:38.313112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:38.312936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:38.312936+0000","last_clean_scrub_stamp":"2024-09-12T18:38:38.312936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:22.524731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:40.803035+0000","last_change":"2024-09-12T18:38:40.803035+0000","last_active":"2024-09-12T18:38:40.803035+0000","last_peered":"2024-09-12T18:38:40.803035+0000","last_clean":"2024-09-12T18:38:40.803035+0000","last_became_active":"2024-09-12T18:35:25.660126+0000","last_became_peered":"2024-09-12T18:35:25.660126+0000","last_unstale":"2024-09-12T18:38:40.803035+0000","last_undegraded":"2024-09-12T18:38:40.803035+0000","last_fullsized":"2024-09-12T18:38:40.803035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:40.802855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:40.802855+0000","last_clean_scrub_stamp":"2024-09-12T18:38:40.802855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:04.501003+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:42.039939+0000","last_change":"2024-09-12T18:38:42.039939+0000","last_active":"2024-09-12T18:38:42.039939+0000","last_peered":"2024-09-12T18:38:42.039939+0000","last_clean":"2024-09-12T18:38:42.039939+0000","last_became_active":"2024-09-12T18:35:25.659338+0000","last_became_peered":"2024-09-12T18:35:25.659338+0000","last_unstale":"2024-09-12T18:38:42.039939+0000","last_undegraded":"2024-09-12T18:38:42.039939+0000","last_fullsized":"2024-09-12T18:38:42.039939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:42.039740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:42.039740+0000","last_clean_scrub_stamp":"2024-09-12T18:38:42.039740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:04.298718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:37.322681+0000","last_change":"2024-09-12T18:38:37.322681+0000","last_active":"2024-09-12T18:38:37.322681+0000","last_peered":"2024-09-12T18:38:37.322681+0000","last_clean":"2024-09-12T18:38:37.322681+0000","last_became_active":"2024-09-12T18:35:25.659496+0000","last_became_peered":"2024-09-12T18:35:25.659496+0000","last_unstale":"2024-09-12T18:38:37.322681+0000","last_undegraded":"2024-09-12T18:38:37.322681+0000","last_fullsized":"2024-09-12T18:38:37.322681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:37.322502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:37.322502+0000","last_clean_scrub_stamp":"2024-09-12T18:38:37.322502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:20.193829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:39.779875+0000","last_change":"2024-09-12T18:38:39.779875+0000","last_active":"2024-09-12T18:38:39.779875+0000","last_peered":"2024-09-12T18:38:39.779875+0000","last_clean":"2024-09-12T18:38:39.779875+0000","last_became_active":"2024-09-12T18:38:03.356412+0000","last_became_peered":"2024-09-12T18:38:03.356412+0000","last_unstale":"2024-09-12T18:38:39.779875+0000","last_undegraded":"2024-09-12T18:38:39.779875+0000","last_fullsized":"2024-09-12T18:38:39.779875+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:39.779703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:39.779703+0000","last_clean_scrub_stamp":"2024-09-12T18:38:39.779703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:59.210888+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:36.371658+0000","last_change":"2024-09-12T18:38:36.371658+0000","last_active":"2024-09-12T18:38:36.371658+0000","last_peered":"2024-09-12T18:38:36.371658+0000","last_clean":"2024-09-12T18:38:36.371658+0000","last_became_active":"2024-09-12T18:35:25.649415+0000","last_became_peered":"2024-09-12T18:35:25.649415+0000","last_unstale":"2024-09-12T18:38:36.371658+0000","last_undegraded":"2024-09-12T18:38:36.371658+0000","last_fullsized":"2024-09-12T18:38:36.371658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:36.371475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:36.371475+0000","last_clean_scrub_stamp":"2024-09-12T18:38:36.371475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:42.955426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:38.809575+0000","last_change":"2024-09-12T18:38:38.809575+0000","last_active":"2024-09-12T18:38:38.809575+0000","last_peered":"2024-09-12T18:38:38.809575+0000","last_clean":"2024-09-12T18:38:38.809575+0000","last_became_active":"2024-09-12T18:35:25.652992+0000","last_became_peered":"2024-09-12T18:35:25.652992+0000","last_unstale":"2024-09-12T18:38:38.809575+0000","last_undegraded":"2024-09-12T18:38:38.809575+0000","last_fullsized":"2024-09-12T18:38:38.809575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:38.809406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:38.809406+0000","last_clean_scrub_stamp":"2024-09-12T18:38:38.809406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:01.750781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":178,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:41.026606+0000","last_change":"2024-09-12T18:38:41.026606+0000","last_active":"2024-09-12T18:38:41.026606+0000","last_peered":"2024-09-12T18:38:41.026606+0000","last_clean":"2024-09-12T18:38:41.026606+0000","last_became_active":"2024-09-12T18:38:03.355052+0000","last_became_peered":"2024-09-12T18:38:03.355052+0000","last_unstale":"2024-09-12T18:38:41.026606+0000","last_undegraded":"2024-09-12T18:38:41.026606+0000","last_fullsized":"2024-09-12T18:38:41.026606+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:41.026426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:41.026426+0000","last_clean_scrub_stamp":"2024-09-12T18:38:41.026426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:18.155210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":178,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:30.461083+0000","last_change":"2024-09-12T18:38:30.461083+0000","last_active":"2024-09-12T18:38:30.461083+0000","last_peered":"2024-09-12T18:38:30.461083+0000","last_clean":"2024-09-12T18:38:30.461083+0000","last_became_active":"2024-09-12T18:38:03.351112+0000","last_became_peered":"2024-09-12T18:38:03.351112+0000","last_unstale":"2024-09-12T18:38:30.461083+0000","last_undegraded":"2024-09-12T18:38:30.461083+0000","last_fullsized":"2024-09-12T18:38:30.461083+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:30.460854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:30.460854+0000","last_clean_scrub_stamp":"2024-09-12T18:38:30.460854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:13.061935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"91'4","reported_seq":172,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:27.922735+0000","last_change":"2024-09-12T18:38:27.922735+0000","last_active":"2024-09-12T18:38:27.922735+0000","last_peered":"2024-09-12T18:38:27.922735+0000","last_clean":"2024-09-12T18:38:27.922735+0000","last_became_active":"2024-09-12T18:35:24.656208+0000","last_became_peered":"2024-09-12T18:35:24.656208+0000","last_unstale":"2024-09-12T18:38:27.922735+0000","last_undegraded":"2024-09-12T18:38:27.922735+0000","last_fullsized":"2024-09-12T18:38:27.922735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'4","last_scrub_stamp":"2024-09-12T18:38:27.922544+0000","last_deep_scrub":"91'4","last_deep_scrub_stamp":"2024-09-12T18:38:27.922544+0000","last_clean_scrub_stamp":"2024-09-12T18:38:27.922544+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:17.404089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:31.451665+0000","last_change":"2024-09-12T18:38:31.451665+0000","last_active":"2024-09-12T18:38:31.451665+0000","last_peered":"2024-09-12T18:38:31.451665+0000","last_clean":"2024-09-12T18:38:31.451665+0000","last_became_active":"2024-09-12T18:35:25.650849+0000","last_became_peered":"2024-09-12T18:35:25.650849+0000","last_unstale":"2024-09-12T18:38:31.451665+0000","last_undegraded":"2024-09-12T18:38:31.451665+0000","last_fullsized":"2024-09-12T18:38:31.451665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:31.451483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:31.451483+0000","last_clean_scrub_stamp":"2024-09-12T18:38:31.451483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:54.990616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:22.838878+0000","last_change":"2024-09-12T18:38:22.838878+0000","last_active":"2024-09-12T18:38:22.838878+0000","last_peered":"2024-09-12T18:38:22.838878+0000","last_clean":"2024-09-12T18:38:22.838878+0000","last_became_active":"2024-09-12T18:35:24.653175+0000","last_became_peered":"2024-09-12T18:35:24.653175+0000","last_unstale":"2024-09-12T18:38:22.838878+0000","last_undegraded":"2024-09-12T18:38:22.838878+0000","last_fullsized":"2024-09-12T18:38:22.838878+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:22.838700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:22.838700+0000","last_clean_scrub_stamp":"2024-09-12T18:38:22.838700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:19.971248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:35.859328+0000","last_change":"2024-09-12T18:38:35.859328+0000","last_active":"2024-09-12T18:38:35.859328+0000","last_peered":"2024-09-12T18:38:35.859328+0000","last_clean":"2024-09-12T18:38:35.859328+0000","last_became_active":"2024-09-12T18:38:03.354299+0000","last_became_peered":"2024-09-12T18:38:03.354299+0000","last_unstale":"2024-09-12T18:38:35.859328+0000","last_undegraded":"2024-09-12T18:38:35.859328+0000","last_fullsized":"2024-09-12T18:38:35.859328+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:35.859174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:35.859174+0000","last_clean_scrub_stamp":"2024-09-12T18:38:35.859174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:49.874184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:18.425352+0000","last_change":"2024-09-12T18:38:18.425352+0000","last_active":"2024-09-12T18:38:18.425352+0000","last_peered":"2024-09-12T18:38:18.425352+0000","last_clean":"2024-09-12T18:38:18.425352+0000","last_became_active":"2024-09-12T18:35:24.638230+0000","last_became_peered":"2024-09-12T18:35:24.638230+0000","last_unstale":"2024-09-12T18:38:18.425352+0000","last_undegraded":"2024-09-12T18:38:18.425352+0000","last_fullsized":"2024-09-12T18:38:18.425352+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:18.425173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:18.425173+0000","last_clean_scrub_stamp":"2024-09-12T18:38:18.425173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:59.363225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:37.827085+0000","last_change":"2024-09-12T18:38:37.827085+0000","last_active":"2024-09-12T18:38:37.827085+0000","last_peered":"2024-09-12T18:38:37.827085+0000","last_clean":"2024-09-12T18:38:37.827085+0000","last_became_active":"2024-09-12T18:38:03.352848+0000","last_became_peered":"2024-09-12T18:38:03.352848+0000","last_unstale":"2024-09-12T18:38:37.827085+0000","last_undegraded":"2024-09-12T18:38:37.827085+0000","last_fullsized":"2024-09-12T18:38:37.827085+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:37.826912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:37.826912+0000","last_clean_scrub_stamp":"2024-09-12T18:38:37.826912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:45.886998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"91'12","reported_seq":180,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:26.967784+0000","last_change":"2024-09-12T18:38:26.967784+0000","last_active":"2024-09-12T18:38:26.967784+0000","last_peered":"2024-09-12T18:38:26.967784+0000","last_clean":"2024-09-12T18:38:26.967784+0000","last_became_active":"2024-09-12T18:35:24.652880+0000","last_became_peered":"2024-09-12T18:35:24.652880+0000","last_unstale":"2024-09-12T18:38:26.967784+0000","last_undegraded":"2024-09-12T18:38:26.967784+0000","last_fullsized":"2024-09-12T18:38:26.967784+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'12","last_scrub_stamp":"2024-09-12T18:38:26.967536+0000","last_deep_scrub":"91'12","last_deep_scrub_stamp":"2024-09-12T18:38:26.967536+0000","last_clean_scrub_stamp":"2024-09-12T18:38:26.967536+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:30.754499+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"91'2","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:25.998829+0000","last_change":"2024-09-12T18:38:25.998829+0000","last_active":"2024-09-12T18:38:25.998829+0000","last_peered":"2024-09-12T18:38:25.998829+0000","last_clean":"2024-09-12T18:38:25.998829+0000","last_became_active":"2024-09-12T18:35:24.652792+0000","last_became_peered":"2024-09-12T18:35:24.652792+0000","last_unstale":"2024-09-12T18:38:25.998829+0000","last_undegraded":"2024-09-12T18:38:25.998829+0000","last_fullsized":"2024-09-12T18:38:25.998829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2024-09-12T18:38:25.998647+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2024-09-12T18:38:25.998647+0000","last_clean_scrub_stamp":"2024-09-12T18:38:25.998647+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:02.832804+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:28.476822+0000","last_change":"2024-09-12T18:38:28.476822+0000","last_active":"2024-09-12T18:38:28.476822+0000","last_peered":"2024-09-12T18:38:28.476822+0000","last_clean":"2024-09-12T18:38:28.476822+0000","last_became_active":"2024-09-12T18:35:25.648186+0000","last_became_peered":"2024-09-12T18:35:25.648186+0000","last_unstale":"2024-09-12T18:38:28.476822+0000","last_undegraded":"2024-09-12T18:38:28.476822+0000","last_fullsized":"2024-09-12T18:38:28.476822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:28.476612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:28.476612+0000","last_clean_scrub_stamp":"2024-09-12T18:38:28.476612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:35:58.565120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"91'3","reported_seq":171,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:16.436792+0000","last_change":"2024-09-12T18:38:16.436792+0000","last_active":"2024-09-12T18:38:16.436792+0000","last_peered":"2024-09-12T18:38:16.436792+0000","last_clean":"2024-09-12T18:38:16.436792+0000","last_became_active":"2024-09-12T18:35:24.647629+0000","last_became_peered":"2024-09-12T18:35:24.647629+0000","last_unstale":"2024-09-12T18:38:16.436792+0000","last_undegraded":"2024-09-12T18:38:16.436792+0000","last_fullsized":"2024-09-12T18:38:16.436792+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-09-12T18:38:16.436607+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-09-12T18:38:16.436607+0000","last_clean_scrub_stamp":"2024-09-12T18:38:16.436607+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:38.233429+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:27.491405+0000","last_change":"2024-09-12T18:38:27.491405+0000","last_active":"2024-09-12T18:38:27.491405+0000","last_peered":"2024-09-12T18:38:27.491405+0000","last_clean":"2024-09-12T18:38:27.491405+0000","last_became_active":"2024-09-12T18:35:25.651628+0000","last_became_peered":"2024-09-12T18:35:25.651628+0000","last_unstale":"2024-09-12T18:38:27.491405+0000","last_undegraded":"2024-09-12T18:38:27.491405+0000","last_fullsized":"2024-09-12T18:38:27.491405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:27.491200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:27.491200+0000","last_clean_scrub_stamp":"2024-09-12T18:38:27.491200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:43.970943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"91'2","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:25.017906+0000","last_change":"2024-09-12T18:38:25.017906+0000","last_active":"2024-09-12T18:38:25.017906+0000","last_peered":"2024-09-12T18:38:25.017906+0000","last_clean":"2024-09-12T18:38:25.017906+0000","last_became_active":"2024-09-12T18:35:24.654264+0000","last_became_peered":"2024-09-12T18:35:24.654264+0000","last_unstale":"2024-09-12T18:38:25.017906+0000","last_undegraded":"2024-09-12T18:38:25.017906+0000","last_fullsized":"2024-09-12T18:38:25.017906+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2024-09-12T18:38:25.017729+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2024-09-12T18:38:25.017729+0000","last_clean_scrub_stamp":"2024-09-12T18:38:25.017729+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:01.448156+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":178,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:32.939952+0000","last_change":"2024-09-12T18:38:32.939952+0000","last_active":"2024-09-12T18:38:32.939952+0000","last_peered":"2024-09-12T18:38:32.939952+0000","last_clean":"2024-09-12T18:38:32.939952+0000","last_became_active":"2024-09-12T18:38:03.364754+0000","last_became_peered":"2024-09-12T18:38:03.364754+0000","last_unstale":"2024-09-12T18:38:32.939952+0000","last_undegraded":"2024-09-12T18:38:32.939952+0000","last_fullsized":"2024-09-12T18:38:32.939952+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:32.939779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:32.939779+0000","last_clean_scrub_stamp":"2024-09-12T18:38:32.939779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:51.995209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:23.976416+0000","last_change":"2024-09-12T18:38:23.976416+0000","last_active":"2024-09-12T18:38:23.976416+0000","last_peered":"2024-09-12T18:38:23.976416+0000","last_clean":"2024-09-12T18:38:23.976416+0000","last_became_active":"2024-09-12T18:35:24.657015+0000","last_became_peered":"2024-09-12T18:35:24.657015+0000","last_unstale":"2024-09-12T18:38:23.976416+0000","last_undegraded":"2024-09-12T18:38:23.976416+0000","last_fullsized":"2024-09-12T18:38:23.976416+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:23.976218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:23.976218+0000","last_clean_scrub_stamp":"2024-09-12T18:38:23.976218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:04.600584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:30.862366+0000","last_change":"2024-09-12T18:38:30.862366+0000","last_active":"2024-09-12T18:38:30.862366+0000","last_peered":"2024-09-12T18:38:30.862366+0000","last_clean":"2024-09-12T18:38:30.862366+0000","last_became_active":"2024-09-12T18:35:25.659511+0000","last_became_peered":"2024-09-12T18:35:25.659511+0000","last_unstale":"2024-09-12T18:38:30.862366+0000","last_undegraded":"2024-09-12T18:38:30.862366+0000","last_fullsized":"2024-09-12T18:38:30.862366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:30.862185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:30.862185+0000","last_clean_scrub_stamp":"2024-09-12T18:38:30.862185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:31.983235+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"91'3","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:21.834936+0000","last_change":"2024-09-12T18:38:21.834936+0000","last_active":"2024-09-12T18:38:21.834936+0000","last_peered":"2024-09-12T18:38:21.834936+0000","last_clean":"2024-09-12T18:38:21.834936+0000","last_became_active":"2024-09-12T18:38:03.364147+0000","last_became_peered":"2024-09-12T18:38:03.364147+0000","last_unstale":"2024-09-12T18:38:21.834936+0000","last_undegraded":"2024-09-12T18:38:21.834936+0000","last_fullsized":"2024-09-12T18:38:21.834936+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-09-12T18:38:21.834762+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-09-12T18:38:21.834762+0000","last_clean_scrub_stamp":"2024-09-12T18:38:21.834762+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:50.155191+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":178,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:33.919892+0000","last_change":"2024-09-12T18:38:33.919892+0000","last_active":"2024-09-12T18:38:33.919892+0000","last_peered":"2024-09-12T18:38:33.919892+0000","last_clean":"2024-09-12T18:38:33.919892+0000","last_became_active":"2024-09-12T18:38:03.355310+0000","last_became_peered":"2024-09-12T18:38:03.355310+0000","last_unstale":"2024-09-12T18:38:33.919892+0000","last_undegraded":"2024-09-12T18:38:33.919892+0000","last_fullsized":"2024-09-12T18:38:33.919892+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:33.919711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:33.919711+0000","last_clean_scrub_stamp":"2024-09-12T18:38:33.919711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:28.178012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:20.987182+0000","last_change":"2024-09-12T18:38:20.987182+0000","last_active":"2024-09-12T18:38:20.987182+0000","last_peered":"2024-09-12T18:38:20.987182+0000","last_clean":"2024-09-12T18:38:20.987182+0000","last_became_active":"2024-09-12T18:35:24.658423+0000","last_became_peered":"2024-09-12T18:35:24.658423+0000","last_unstale":"2024-09-12T18:38:20.987182+0000","last_undegraded":"2024-09-12T18:38:20.987182+0000","last_fullsized":"2024-09-12T18:38:20.987182+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:20.986970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:20.986970+0000","last_clean_scrub_stamp":"2024-09-12T18:38:20.986970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:44.685119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:34.948985+0000","last_change":"2024-09-12T18:38:34.948985+0000","last_active":"2024-09-12T18:38:34.948985+0000","last_peered":"2024-09-12T18:38:34.948985+0000","last_clean":"2024-09-12T18:38:34.948985+0000","last_became_active":"2024-09-12T18:35:25.660372+0000","last_became_peered":"2024-09-12T18:35:25.660372+0000","last_unstale":"2024-09-12T18:38:34.948985+0000","last_undegraded":"2024-09-12T18:38:34.948985+0000","last_fullsized":"2024-09-12T18:38:34.948985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:34.948762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:34.948762+0000","last_clean_scrub_stamp":"2024-09-12T18:38:34.948762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:24.764862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:15.449099+0000","last_change":"2024-09-12T18:38:15.449099+0000","last_active":"2024-09-12T18:38:15.449099+0000","last_peered":"2024-09-12T18:38:15.449099+0000","last_clean":"2024-09-12T18:38:15.449099+0000","last_became_active":"2024-09-12T18:35:24.647520+0000","last_became_peered":"2024-09-12T18:35:24.647520+0000","last_unstale":"2024-09-12T18:38:15.449099+0000","last_undegraded":"2024-09-12T18:38:15.449099+0000","last_fullsized":"2024-09-12T18:38:15.449099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:15.448900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:15.448900+0000","last_clean_scrub_stamp":"2024-09-12T18:38:15.448900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:34.948207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:35.962131+0000","last_change":"2024-09-12T18:38:35.962131+0000","last_active":"2024-09-12T18:38:35.962131+0000","last_peered":"2024-09-12T18:38:35.962131+0000","last_clean":"2024-09-12T18:38:35.962131+0000","last_became_active":"2024-09-12T18:35:25.657386+0000","last_became_peered":"2024-09-12T18:35:25.657386+0000","last_unstale":"2024-09-12T18:38:35.962131+0000","last_undegraded":"2024-09-12T18:38:35.962131+0000","last_fullsized":"2024-09-12T18:38:35.962131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:35.961953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:35.961953+0000","last_clean_scrub_stamp":"2024-09-12T18:38:35.961953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:50.442665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:20.462439+0000","last_change":"2024-09-12T18:38:20.462439+0000","last_active":"2024-09-12T18:38:20.462439+0000","last_peered":"2024-09-12T18:38:20.462439+0000","last_clean":"2024-09-12T18:38:20.462439+0000","last_became_active":"2024-09-12T18:35:24.646008+0000","last_became_peered":"2024-09-12T18:35:24.646008+0000","last_unstale":"2024-09-12T18:38:20.462439+0000","last_undegraded":"2024-09-12T18:38:20.462439+0000","last_fullsized":"2024-09-12T18:38:20.462439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:20.462258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:20.462258+0000","last_clean_scrub_stamp":"2024-09-12T18:38:20.462258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:51.867050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:31.870583+0000","last_change":"2024-09-12T18:38:31.870583+0000","last_active":"2024-09-12T18:38:31.870583+0000","last_peered":"2024-09-12T18:38:31.870583+0000","last_clean":"2024-09-12T18:38:31.870583+0000","last_became_active":"2024-09-12T18:35:25.666940+0000","last_became_peered":"2024-09-12T18:35:25.666940+0000","last_unstale":"2024-09-12T18:38:31.870583+0000","last_undegraded":"2024-09-12T18:38:31.870583+0000","last_fullsized":"2024-09-12T18:38:31.870583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:31.870398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:31.870398+0000","last_clean_scrub_stamp":"2024-09-12T18:38:31.870398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:02.764418+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"91'114","reported_seq":320,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:15.185352+0000","last_change":"2024-09-12T18:38:15.185352+0000","last_active":"2024-09-12T18:38:15.185352+0000","last_peered":"2024-09-12T18:38:15.185352+0000","last_clean":"2024-09-12T18:38:15.185352+0000","last_became_active":"2024-09-12T18:35:13.488346+0000","last_became_peered":"2024-09-12T18:35:13.488346+0000","last_unstale":"2024-09-12T18:38:15.185352+0000","last_undegraded":"2024-09-12T18:38:15.185352+0000","last_fullsized":"2024-09-12T18:38:15.185352+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'114","last_scrub_stamp":"2024-09-12T18:38:15.185153+0000","last_deep_scrub":"91'114","last_deep_scrub_stamp":"2024-09-12T18:38:15.185153+0000","last_clean_scrub_stamp":"2024-09-12T18:38:15.185153+0000","objects_scrubbed":2,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:10.417497+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"91'2","reported_seq":183,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:22.011028+0000","last_change":"2024-09-12T18:38:22.011028+0000","last_active":"2024-09-12T18:38:22.011028+0000","last_peered":"2024-09-12T18:38:22.011028+0000","last_clean":"2024-09-12T18:38:22.011028+0000","last_became_active":"2024-09-12T18:35:20.446796+0000","last_became_peered":"2024-09-12T18:35:20.446796+0000","last_unstale":"2024-09-12T18:38:22.011028+0000","last_undegraded":"2024-09-12T18:38:22.011028+0000","last_fullsized":"2024-09-12T18:38:22.011028+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2024-09-12T18:38:22.010848+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2024-09-12T18:38:22.010848+0000","last_clean_scrub_stamp":"2024-09-12T18:38:22.010848+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:28.609391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0016291610000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:18.847114+0000","last_change":"2024-09-12T18:38:18.847114+0000","last_active":"2024-09-12T18:38:18.847114+0000","last_peered":"2024-09-12T18:38:18.847114+0000","last_clean":"2024-09-12T18:38:18.847114+0000","last_became_active":"2024-09-12T18:38:03.353661+0000","last_became_peered":"2024-09-12T18:38:03.353661+0000","last_unstale":"2024-09-12T18:38:18.847114+0000","last_undegraded":"2024-09-12T18:38:18.847114+0000","last_fullsized":"2024-09-12T18:38:18.847114+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:18.846939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:18.846939+0000","last_clean_scrub_stamp":"2024-09-12T18:38:18.846939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:01.582641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:31.943523+0000","last_change":"2024-09-12T18:38:31.943523+0000","last_active":"2024-09-12T18:38:31.943523+0000","last_peered":"2024-09-12T18:38:31.943523+0000","last_clean":"2024-09-12T18:38:31.943523+0000","last_became_active":"2024-09-12T18:35:25.661043+0000","last_became_peered":"2024-09-12T18:35:25.661043+0000","last_unstale":"2024-09-12T18:38:31.943523+0000","last_undegraded":"2024-09-12T18:38:31.943523+0000","last_fullsized":"2024-09-12T18:38:31.943523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:31.943308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:31.943308+0000","last_clean_scrub_stamp":"2024-09-12T18:38:31.943308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:29.830430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":181,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:17.113101+0000","last_change":"2024-09-12T18:38:17.113101+0000","last_active":"2024-09-12T18:38:17.113101+0000","last_peered":"2024-09-12T18:38:17.113101+0000","last_clean":"2024-09-12T18:38:17.113101+0000","last_became_active":"2024-09-12T18:35:20.448553+0000","last_became_peered":"2024-09-12T18:35:20.448553+0000","last_unstale":"2024-09-12T18:38:17.113101+0000","last_undegraded":"2024-09-12T18:38:17.113101+0000","last_fullsized":"2024-09-12T18:38:17.113101+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:17.112919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:17.112919+0000","last_clean_scrub_stamp":"2024-09-12T18:38:17.112919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:08.129973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001030836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:16.841417+0000","last_change":"2024-09-12T18:38:16.841417+0000","last_active":"2024-09-12T18:38:16.841417+0000","last_peered":"2024-09-12T18:38:16.841417+0000","last_clean":"2024-09-12T18:38:16.841417+0000","last_became_active":"2024-09-12T18:35:24.649940+0000","last_became_peered":"2024-09-12T18:35:24.649940+0000","last_unstale":"2024-09-12T18:38:16.841417+0000","last_undegraded":"2024-09-12T18:38:16.841417+0000","last_fullsized":"2024-09-12T18:38:16.841417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:16.841237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:16.841237+0000","last_clean_scrub_stamp":"2024-09-12T18:38:16.841237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:34.563251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":178,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:26.503786+0000","last_change":"2024-09-12T18:38:26.503786+0000","last_active":"2024-09-12T18:38:26.503786+0000","last_peered":"2024-09-12T18:38:26.503786+0000","last_clean":"2024-09-12T18:38:26.503786+0000","last_became_active":"2024-09-12T18:38:03.357664+0000","last_became_peered":"2024-09-12T18:38:03.357664+0000","last_unstale":"2024-09-12T18:38:26.503786+0000","last_undegraded":"2024-09-12T18:38:26.503786+0000","last_fullsized":"2024-09-12T18:38:26.503786+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:26.503603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:26.503603+0000","last_clean_scrub_stamp":"2024-09-12T18:38:26.503603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:02.405409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":181,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:13.814673+0000","last_change":"2024-09-12T18:38:13.814673+0000","last_active":"2024-09-12T18:38:13.814673+0000","last_peered":"2024-09-12T18:38:13.814673+0000","last_clean":"2024-09-12T18:38:13.814673+0000","last_became_active":"2024-09-12T18:35:20.442613+0000","last_became_peered":"2024-09-12T18:35:20.442613+0000","last_unstale":"2024-09-12T18:38:13.814673+0000","last_undegraded":"2024-09-12T18:38:13.814673+0000","last_fullsized":"2024-09-12T18:38:13.814673+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:13.814490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:13.814490+0000","last_clean_scrub_stamp":"2024-09-12T18:38:13.814490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:22.097264+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0014134620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:17.455041+0000","last_change":"2024-09-12T18:38:17.455041+0000","last_active":"2024-09-12T18:38:17.455041+0000","last_peered":"2024-09-12T18:38:17.455041+0000","last_clean":"2024-09-12T18:38:17.455041+0000","last_became_active":"2024-09-12T18:35:24.637334+0000","last_became_peered":"2024-09-12T18:35:24.637334+0000","last_unstale":"2024-09-12T18:38:17.455041+0000","last_undegraded":"2024-09-12T18:38:17.455041+0000","last_fullsized":"2024-09-12T18:38:17.455041+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:17.454840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:17.454840+0000","last_clean_scrub_stamp":"2024-09-12T18:38:17.454840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:10:57.149775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:29.851254+0000","last_change":"2024-09-12T18:38:29.851254+0000","last_active":"2024-09-12T18:38:29.851254+0000","last_peered":"2024-09-12T18:38:29.851254+0000","last_clean":"2024-09-12T18:38:29.851254+0000","last_became_active":"2024-09-12T18:38:03.359452+0000","last_became_peered":"2024-09-12T18:38:03.359452+0000","last_unstale":"2024-09-12T18:38:29.851254+0000","last_undegraded":"2024-09-12T18:38:29.851254+0000","last_fullsized":"2024-09-12T18:38:29.851254+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:29.851075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:29.851075+0000","last_clean_scrub_stamp":"2024-09-12T18:38:29.851075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:30.600668+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"91'3","reported_seq":184,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:16.160693+0000","last_change":"2024-09-12T18:38:16.160693+0000","last_active":"2024-09-12T18:38:16.160693+0000","last_peered":"2024-09-12T18:38:16.160693+0000","last_clean":"2024-09-12T18:38:16.160693+0000","last_became_active":"2024-09-12T18:35:20.446814+0000","last_became_peered":"2024-09-12T18:35:20.446814+0000","last_unstale":"2024-09-12T18:38:16.160693+0000","last_undegraded":"2024-09-12T18:38:16.160693+0000","last_fullsized":"2024-09-12T18:38:16.160693+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-09-12T18:38:16.160518+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-09-12T18:38:16.160518+0000","last_clean_scrub_stamp":"2024-09-12T18:38:16.160518+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:32.488019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010716149999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:20.003168+0000","last_change":"2024-09-12T18:38:20.003168+0000","last_active":"2024-09-12T18:38:20.003168+0000","last_peered":"2024-09-12T18:38:20.003168+0000","last_clean":"2024-09-12T18:38:20.003168+0000","last_became_active":"2024-09-12T18:35:24.657433+0000","last_became_peered":"2024-09-12T18:35:24.657433+0000","last_unstale":"2024-09-12T18:38:20.003168+0000","last_undegraded":"2024-09-12T18:38:20.003168+0000","last_fullsized":"2024-09-12T18:38:20.003168+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:20.003003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:20.003003+0000","last_clean_scrub_stamp":"2024-09-12T18:38:20.003003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:39.434187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:27.870494+0000","last_change":"2024-09-12T18:38:27.870494+0000","last_active":"2024-09-12T18:38:27.870494+0000","last_peered":"2024-09-12T18:38:27.870494+0000","last_clean":"2024-09-12T18:38:27.870494+0000","last_became_active":"2024-09-12T18:38:03.357592+0000","last_became_peered":"2024-09-12T18:38:03.357592+0000","last_unstale":"2024-09-12T18:38:27.870494+0000","last_undegraded":"2024-09-12T18:38:27.870494+0000","last_fullsized":"2024-09-12T18:38:27.870494+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:27.870320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:27.870320+0000","last_clean_scrub_stamp":"2024-09-12T18:38:27.870320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:26.098204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:22.974189+0000","last_change":"2024-09-12T18:38:22.974189+0000","last_active":"2024-09-12T18:38:22.974189+0000","last_peered":"2024-09-12T18:38:22.974189+0000","last_clean":"2024-09-12T18:38:22.974189+0000","last_became_active":"2024-09-12T18:35:24.656741+0000","last_became_peered":"2024-09-12T18:35:24.656741+0000","last_unstale":"2024-09-12T18:38:22.974189+0000","last_undegraded":"2024-09-12T18:38:22.974189+0000","last_fullsized":"2024-09-12T18:38:22.974189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:22.974017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:22.974017+0000","last_clean_scrub_stamp":"2024-09-12T18:38:22.974017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:19.281429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":181,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:14.828194+0000","last_change":"2024-09-12T18:38:14.828194+0000","last_active":"2024-09-12T18:38:14.828194+0000","last_peered":"2024-09-12T18:38:14.828194+0000","last_clean":"2024-09-12T18:38:14.828194+0000","last_became_active":"2024-09-12T18:35:20.442566+0000","last_became_peered":"2024-09-12T18:35:20.442566+0000","last_unstale":"2024-09-12T18:38:14.828194+0000","last_undegraded":"2024-09-12T18:38:14.828194+0000","last_fullsized":"2024-09-12T18:38:14.828194+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:14.828014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:14.828014+0000","last_clean_scrub_stamp":"2024-09-12T18:38:14.828014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:27.349359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001325786,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:29.495129+0000","last_change":"2024-09-12T18:38:29.495129+0000","last_active":"2024-09-12T18:38:29.495129+0000","last_peered":"2024-09-12T18:38:29.495129+0000","last_clean":"2024-09-12T18:38:29.495129+0000","last_became_active":"2024-09-12T18:35:25.648761+0000","last_became_peered":"2024-09-12T18:35:25.648761+0000","last_unstale":"2024-09-12T18:38:29.495129+0000","last_undegraded":"2024-09-12T18:38:29.495129+0000","last_fullsized":"2024-09-12T18:38:29.495129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:29.494932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:29.494932+0000","last_clean_scrub_stamp":"2024-09-12T18:38:29.494932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:21.380263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:15.791611+0000","last_change":"2024-09-12T18:38:15.791611+0000","last_active":"2024-09-12T18:38:15.791611+0000","last_peered":"2024-09-12T18:38:15.791611+0000","last_clean":"2024-09-12T18:38:15.791611+0000","last_became_active":"2024-09-12T18:38:03.356816+0000","last_became_peered":"2024-09-12T18:38:03.356816+0000","last_unstale":"2024-09-12T18:38:15.791611+0000","last_undegraded":"2024-09-12T18:38:15.791611+0000","last_fullsized":"2024-09-12T18:38:15.791611+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:15.791433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:15.791433+0000","last_clean_scrub_stamp":"2024-09-12T18:38:15.791433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:57.710017+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":193,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:14.417715+0000","last_change":"2024-09-12T18:38:14.417715+0000","last_active":"2024-09-12T18:38:14.417715+0000","last_peered":"2024-09-12T18:38:14.417715+0000","last_clean":"2024-09-12T18:38:14.417715+0000","last_became_active":"2024-09-12T18:38:03.350774+0000","last_became_peered":"2024-09-12T18:38:03.350774+0000","last_unstale":"2024-09-12T18:38:14.417715+0000","last_undegraded":"2024-09-12T18:38:14.417715+0000","last_fullsized":"2024-09-12T18:38:14.417715+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:14.417534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:14.417534+0000","last_clean_scrub_stamp":"2024-09-12T18:38:14.417534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:26.780036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00080163599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:25.539698+0000","last_change":"2024-09-12T18:38:25.539698+0000","last_active":"2024-09-12T18:38:25.539698+0000","last_peered":"2024-09-12T18:38:25.539698+0000","last_clean":"2024-09-12T18:38:25.539698+0000","last_became_active":"2024-09-12T18:35:25.649147+0000","last_became_peered":"2024-09-12T18:35:25.649147+0000","last_unstale":"2024-09-12T18:38:25.539698+0000","last_undegraded":"2024-09-12T18:38:25.539698+0000","last_fullsized":"2024-09-12T18:38:25.539698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:25.539439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:25.539439+0000","last_clean_scrub_stamp":"2024-09-12T18:38:25.539439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:30.348562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"91'3","reported_seq":171,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:19.814525+0000","last_change":"2024-09-12T18:38:19.814525+0000","last_active":"2024-09-12T18:38:19.814525+0000","last_peered":"2024-09-12T18:38:19.814525+0000","last_clean":"2024-09-12T18:38:19.814525+0000","last_became_active":"2024-09-12T18:35:24.655950+0000","last_became_peered":"2024-09-12T18:35:24.655950+0000","last_unstale":"2024-09-12T18:38:19.814525+0000","last_undegraded":"2024-09-12T18:38:19.814525+0000","last_fullsized":"2024-09-12T18:38:19.814525+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-09-12T18:38:19.814345+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-09-12T18:38:19.814345+0000","last_clean_scrub_stamp":"2024-09-12T18:38:19.814345+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:23.553058+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":58,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:19.050364+0000","last_change":"2024-09-12T18:38:19.050364+0000","last_active":"2024-09-12T18:38:19.050364+0000","last_peered":"2024-09-12T18:38:19.050364+0000","last_clean":"2024-09-12T18:38:19.050364+0000","last_became_active":"2024-09-12T18:37:34.254999+0000","last_became_peered":"2024-09-12T18:37:34.254999+0000","last_unstale":"2024-09-12T18:38:19.050364+0000","last_undegraded":"2024-09-12T18:38:19.050364+0000","last_fullsized":"2024-09-12T18:38:19.050364+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:19.050173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:19.050173+0000","last_clean_scrub_stamp":"2024-09-12T18:38:19.050173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:25.174685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:26.894907+0000","last_change":"2024-09-12T18:38:26.894907+0000","last_active":"2024-09-12T18:38:26.894907+0000","last_peered":"2024-09-12T18:38:26.894907+0000","last_clean":"2024-09-12T18:38:26.894907+0000","last_became_active":"2024-09-12T18:38:03.354895+0000","last_became_peered":"2024-09-12T18:38:03.354895+0000","last_unstale":"2024-09-12T18:38:26.894907+0000","last_undegraded":"2024-09-12T18:38:26.894907+0000","last_fullsized":"2024-09-12T18:38:26.894907+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:26.894733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:26.894733+0000","last_clean_scrub_stamp":"2024-09-12T18:38:26.894733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:57.496991+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"91'2","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:17.883222+0000","last_change":"2024-09-12T18:38:17.883222+0000","last_active":"2024-09-12T18:38:17.883222+0000","last_peered":"2024-09-12T18:38:17.883222+0000","last_clean":"2024-09-12T18:38:17.883222+0000","last_became_active":"2024-09-12T18:38:03.354684+0000","last_became_peered":"2024-09-12T18:38:03.354684+0000","last_unstale":"2024-09-12T18:38:17.883222+0000","last_undegraded":"2024-09-12T18:38:17.883222+0000","last_fullsized":"2024-09-12T18:38:17.883222+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2024-09-12T18:38:17.883042+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2024-09-12T18:38:17.883042+0000","last_clean_scrub_stamp":"2024-09-12T18:38:17.883042+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:47.656032+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":181,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:18.067264+0000","last_change":"2024-09-12T18:38:18.067264+0000","last_active":"2024-09-12T18:38:18.067264+0000","last_peered":"2024-09-12T18:38:18.067264+0000","last_clean":"2024-09-12T18:38:18.067264+0000","last_became_active":"2024-09-12T18:35:20.448521+0000","last_became_peered":"2024-09-12T18:35:20.448521+0000","last_unstale":"2024-09-12T18:38:18.067264+0000","last_undegraded":"2024-09-12T18:38:18.067264+0000","last_fullsized":"2024-09-12T18:38:18.067264+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:18.067093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:18.067093+0000","last_clean_scrub_stamp":"2024-09-12T18:38:18.067093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:26.127179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017009670000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:24.572135+0000","last_change":"2024-09-12T18:38:24.572135+0000","last_active":"2024-09-12T18:38:24.572135+0000","last_peered":"2024-09-12T18:38:24.572135+0000","last_clean":"2024-09-12T18:38:24.572135+0000","last_became_active":"2024-09-12T18:35:25.647347+0000","last_became_peered":"2024-09-12T18:35:25.647347+0000","last_unstale":"2024-09-12T18:38:24.572135+0000","last_undegraded":"2024-09-12T18:38:24.572135+0000","last_fullsized":"2024-09-12T18:38:24.572135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:24.571959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:24.571959+0000","last_clean_scrub_stamp":"2024-09-12T18:38:24.571959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:36.759025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:36.969905+0000","last_change":"2024-09-12T18:38:36.969905+0000","last_active":"2024-09-12T18:38:36.969905+0000","last_peered":"2024-09-12T18:38:36.969905+0000","last_clean":"2024-09-12T18:38:36.969905+0000","last_became_active":"2024-09-12T18:35:25.659827+0000","last_became_peered":"2024-09-12T18:35:25.659827+0000","last_unstale":"2024-09-12T18:38:36.969905+0000","last_undegraded":"2024-09-12T18:38:36.969905+0000","last_fullsized":"2024-09-12T18:38:36.969905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:36.969736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:36.969736+0000","last_clean_scrub_stamp":"2024-09-12T18:38:36.969736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:27.697680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"91'10","reported_seq":178,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:28.960772+0000","last_change":"2024-09-12T18:38:28.960772+0000","last_active":"2024-09-12T18:38:28.960772+0000","last_peered":"2024-09-12T18:38:28.960772+0000","last_clean":"2024-09-12T18:38:28.960772+0000","last_became_active":"2024-09-12T18:35:24.654282+0000","last_became_peered":"2024-09-12T18:35:24.654282+0000","last_unstale":"2024-09-12T18:38:28.960772+0000","last_undegraded":"2024-09-12T18:38:28.960772+0000","last_fullsized":"2024-09-12T18:38:28.960772+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'10","last_scrub_stamp":"2024-09-12T18:38:28.960583+0000","last_deep_scrub":"91'10","last_deep_scrub_stamp":"2024-09-12T18:38:28.960583+0000","last_clean_scrub_stamp":"2024-09-12T18:38:28.960583+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:32.457138+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:34.850831+0000","last_change":"2024-09-12T18:38:34.850831+0000","last_active":"2024-09-12T18:38:34.850831+0000","last_peered":"2024-09-12T18:38:34.850831+0000","last_clean":"2024-09-12T18:38:34.850831+0000","last_became_active":"2024-09-12T18:38:03.354064+0000","last_became_peered":"2024-09-12T18:38:03.354064+0000","last_unstale":"2024-09-12T18:38:34.850831+0000","last_undegraded":"2024-09-12T18:38:34.850831+0000","last_fullsized":"2024-09-12T18:38:34.850831+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:34.850644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:34.850644+0000","last_clean_scrub_stamp":"2024-09-12T18:38:34.850644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:20.545246+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"91'5","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:19.460433+0000","last_change":"2024-09-12T18:38:19.460433+0000","last_active":"2024-09-12T18:38:19.460433+0000","last_peered":"2024-09-12T18:38:19.460433+0000","last_clean":"2024-09-12T18:38:19.460433+0000","last_became_active":"2024-09-12T18:35:24.647826+0000","last_became_peered":"2024-09-12T18:35:24.647826+0000","last_unstale":"2024-09-12T18:38:19.460433+0000","last_undegraded":"2024-09-12T18:38:19.460433+0000","last_fullsized":"2024-09-12T18:38:19.460433+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'5","last_scrub_stamp":"2024-09-12T18:38:19.460194+0000","last_deep_scrub":"91'5","last_deep_scrub_stamp":"2024-09-12T18:38:19.460194+0000","last_clean_scrub_stamp":"2024-09-12T18:38:19.460194+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:21.339924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":180,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:29.943578+0000","last_change":"2024-09-12T18:38:29.943578+0000","last_active":"2024-09-12T18:38:29.943578+0000","last_peered":"2024-09-12T18:38:29.943578+0000","last_clean":"2024-09-12T18:38:29.943578+0000","last_became_active":"2024-09-12T18:38:03.364887+0000","last_became_peered":"2024-09-12T18:38:03.364887+0000","last_unstale":"2024-09-12T18:38:29.943578+0000","last_undegraded":"2024-09-12T18:38:29.943578+0000","last_fullsized":"2024-09-12T18:38:29.943578+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:29.943403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:29.943403+0000","last_clean_scrub_stamp":"2024-09-12T18:38:29.943403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:33.290355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:33.844415+0000","last_change":"2024-09-12T18:38:33.844415+0000","last_active":"2024-09-12T18:38:33.844415+0000","last_peered":"2024-09-12T18:38:33.844415+0000","last_clean":"2024-09-12T18:38:33.844415+0000","last_became_active":"2024-09-12T18:35:25.658476+0000","last_became_peered":"2024-09-12T18:35:25.658476+0000","last_unstale":"2024-09-12T18:38:33.844415+0000","last_undegraded":"2024-09-12T18:38:33.844415+0000","last_fullsized":"2024-09-12T18:38:33.844415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:33.844242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:33.844242+0000","last_clean_scrub_stamp":"2024-09-12T18:38:33.844242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:38.885402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:23.852782+0000","last_change":"2024-09-12T18:38:23.852782+0000","last_active":"2024-09-12T18:38:23.852782+0000","last_peered":"2024-09-12T18:38:23.852782+0000","last_clean":"2024-09-12T18:38:23.852782+0000","last_became_active":"2024-09-12T18:35:24.651416+0000","last_became_peered":"2024-09-12T18:35:24.651416+0000","last_unstale":"2024-09-12T18:38:23.852782+0000","last_undegraded":"2024-09-12T18:38:23.852782+0000","last_fullsized":"2024-09-12T18:38:23.852782+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:23.852597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:23.852597+0000","last_clean_scrub_stamp":"2024-09-12T18:38:23.852597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:23.496269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:32.893291+0000","last_change":"2024-09-12T18:38:32.893291+0000","last_active":"2024-09-12T18:38:32.893291+0000","last_peered":"2024-09-12T18:38:32.893291+0000","last_clean":"2024-09-12T18:38:32.893291+0000","last_became_active":"2024-09-12T18:38:03.357598+0000","last_became_peered":"2024-09-12T18:38:03.357598+0000","last_unstale":"2024-09-12T18:38:32.893291+0000","last_undegraded":"2024-09-12T18:38:32.893291+0000","last_fullsized":"2024-09-12T18:38:32.893291+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:32.893114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:32.893114+0000","last_clean_scrub_stamp":"2024-09-12T18:38:32.893114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:50.683402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:35.402221+0000","last_change":"2024-09-12T18:38:35.402221+0000","last_active":"2024-09-12T18:38:35.402221+0000","last_peered":"2024-09-12T18:38:35.402221+0000","last_clean":"2024-09-12T18:38:35.402221+0000","last_became_active":"2024-09-12T18:35:25.649544+0000","last_became_peered":"2024-09-12T18:35:25.649544+0000","last_unstale":"2024-09-12T18:38:35.402221+0000","last_undegraded":"2024-09-12T18:38:35.402221+0000","last_fullsized":"2024-09-12T18:38:35.402221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:35.402050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:35.402050+0000","last_clean_scrub_stamp":"2024-09-12T18:38:35.402050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:11.214401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:20.856468+0000","last_change":"2024-09-12T18:38:20.856468+0000","last_active":"2024-09-12T18:38:20.856468+0000","last_peered":"2024-09-12T18:38:20.856468+0000","last_clean":"2024-09-12T18:38:20.856468+0000","last_became_active":"2024-09-12T18:38:03.347483+0000","last_became_peered":"2024-09-12T18:38:03.347483+0000","last_unstale":"2024-09-12T18:38:20.856468+0000","last_undegraded":"2024-09-12T18:38:20.856468+0000","last_fullsized":"2024-09-12T18:38:20.856468+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:20.856292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:20.856292+0000","last_clean_scrub_stamp":"2024-09-12T18:38:20.856292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:36.586909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:36.831764+0000","last_change":"2024-09-12T18:38:36.831764+0000","last_active":"2024-09-12T18:38:36.831764+0000","last_peered":"2024-09-12T18:38:36.831764+0000","last_clean":"2024-09-12T18:38:36.831764+0000","last_became_active":"2024-09-12T18:35:25.656985+0000","last_became_peered":"2024-09-12T18:35:25.656985+0000","last_unstale":"2024-09-12T18:38:36.831764+0000","last_undegraded":"2024-09-12T18:38:36.831764+0000","last_fullsized":"2024-09-12T18:38:36.831764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:36.831586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:36.831586+0000","last_clean_scrub_stamp":"2024-09-12T18:38:36.831586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:27.848640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:24.880473+0000","last_change":"2024-09-12T18:38:24.880473+0000","last_active":"2024-09-12T18:38:24.880473+0000","last_peered":"2024-09-12T18:38:24.880473+0000","last_clean":"2024-09-12T18:38:24.880473+0000","last_became_active":"2024-09-12T18:38:03.351740+0000","last_became_peered":"2024-09-12T18:38:03.351740+0000","last_unstale":"2024-09-12T18:38:24.880473+0000","last_undegraded":"2024-09-12T18:38:24.880473+0000","last_fullsized":"2024-09-12T18:38:24.880473+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:24.880293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:24.880293+0000","last_clean_scrub_stamp":"2024-09-12T18:38:24.880293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:05.086041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:34.364865+0000","last_change":"2024-09-12T18:38:34.364865+0000","last_active":"2024-09-12T18:38:34.364865+0000","last_peered":"2024-09-12T18:38:34.364865+0000","last_clean":"2024-09-12T18:38:34.364865+0000","last_became_active":"2024-09-12T18:35:25.654473+0000","last_became_peered":"2024-09-12T18:35:25.654473+0000","last_unstale":"2024-09-12T18:38:34.364865+0000","last_undegraded":"2024-09-12T18:38:34.364865+0000","last_fullsized":"2024-09-12T18:38:34.364865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:34.364683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:34.364683+0000","last_clean_scrub_stamp":"2024-09-12T18:38:34.364683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:31.188319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":169,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:21.506119+0000","last_change":"2024-09-12T18:38:21.506119+0000","last_active":"2024-09-12T18:38:21.506119+0000","last_peered":"2024-09-12T18:38:21.506119+0000","last_clean":"2024-09-12T18:38:21.506119+0000","last_became_active":"2024-09-12T18:35:24.659111+0000","last_became_peered":"2024-09-12T18:35:24.659111+0000","last_unstale":"2024-09-12T18:38:21.506119+0000","last_undegraded":"2024-09-12T18:38:21.506119+0000","last_fullsized":"2024-09-12T18:38:21.506119+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-09-12T18:38:21.505936+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-09-12T18:38:21.505936+0000","last_clean_scrub_stamp":"2024-09-12T18:38:21.505936+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:03.774289+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":178,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:32.406644+0000","last_change":"2024-09-12T18:38:32.406644+0000","last_active":"2024-09-12T18:38:32.406644+0000","last_peered":"2024-09-12T18:38:32.406644+0000","last_clean":"2024-09-12T18:38:32.406644+0000","last_became_active":"2024-09-12T18:38:03.350972+0000","last_became_peered":"2024-09-12T18:38:03.350972+0000","last_unstale":"2024-09-12T18:38:32.406644+0000","last_undegraded":"2024-09-12T18:38:32.406644+0000","last_fullsized":"2024-09-12T18:38:32.406644+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:32.406439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:32.406439+0000","last_clean_scrub_stamp":"2024-09-12T18:38:32.406439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:38.640933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":169,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:22.518989+0000","last_change":"2024-09-12T18:38:22.518989+0000","last_active":"2024-09-12T18:38:22.518989+0000","last_peered":"2024-09-12T18:38:22.518989+0000","last_clean":"2024-09-12T18:38:22.518989+0000","last_became_active":"2024-09-12T18:35:24.637242+0000","last_became_peered":"2024-09-12T18:35:24.637242+0000","last_unstale":"2024-09-12T18:38:22.518989+0000","last_undegraded":"2024-09-12T18:38:22.518989+0000","last_fullsized":"2024-09-12T18:38:22.518989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-09-12T18:38:22.518797+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-09-12T18:38:22.518797+0000","last_clean_scrub_stamp":"2024-09-12T18:38:22.518797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:24.831152+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:39.038045+0000","last_change":"2024-09-12T18:38:39.038045+0000","last_active":"2024-09-12T18:38:39.038045+0000","last_peered":"2024-09-12T18:38:39.038045+0000","last_clean":"2024-09-12T18:38:39.038045+0000","last_became_active":"2024-09-12T18:35:25.661441+0000","last_became_peered":"2024-09-12T18:35:25.661441+0000","last_unstale":"2024-09-12T18:38:39.038045+0000","last_undegraded":"2024-09-12T18:38:39.038045+0000","last_fullsized":"2024-09-12T18:38:39.038045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:39.037870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:39.037870+0000","last_clean_scrub_stamp":"2024-09-12T18:38:39.037870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:45.661314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"91'3","reported_seq":191,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:30.989911+0000","last_change":"2024-09-12T18:38:30.989911+0000","last_active":"2024-09-12T18:38:30.989911+0000","last_peered":"2024-09-12T18:38:30.989911+0000","last_clean":"2024-09-12T18:38:30.989911+0000","last_became_active":"2024-09-12T18:38:03.355520+0000","last_became_peered":"2024-09-12T18:38:03.355520+0000","last_unstale":"2024-09-12T18:38:30.989911+0000","last_undegraded":"2024-09-12T18:38:30.989911+0000","last_fullsized":"2024-09-12T18:38:30.989911+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-09-12T18:38:30.989726+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-09-12T18:38:30.989726+0000","last_clean_scrub_stamp":"2024-09-12T18:38:30.989726+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:42.396744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:40.053468+0000","last_change":"2024-09-12T18:38:40.053468+0000","last_active":"2024-09-12T18:38:40.053468+0000","last_peered":"2024-09-12T18:38:40.053468+0000","last_clean":"2024-09-12T18:38:40.053468+0000","last_became_active":"2024-09-12T18:35:25.649728+0000","last_became_peered":"2024-09-12T18:35:25.649728+0000","last_unstale":"2024-09-12T18:38:40.053468+0000","last_undegraded":"2024-09-12T18:38:40.053468+0000","last_fullsized":"2024-09-12T18:38:40.053468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:40.053298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:40.053298+0000","last_clean_scrub_stamp":"2024-09-12T18:38:40.053298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:50.463685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"91'3","reported_seq":171,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:23.555593+0000","last_change":"2024-09-12T18:38:23.555593+0000","last_active":"2024-09-12T18:38:23.555593+0000","last_peered":"2024-09-12T18:38:23.555593+0000","last_clean":"2024-09-12T18:38:23.555593+0000","last_became_active":"2024-09-12T18:35:24.648512+0000","last_became_peered":"2024-09-12T18:35:24.648512+0000","last_unstale":"2024-09-12T18:38:23.555593+0000","last_undegraded":"2024-09-12T18:38:23.555593+0000","last_fullsized":"2024-09-12T18:38:23.555593+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-09-12T18:38:23.555349+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-09-12T18:38:23.555349+0000","last_clean_scrub_stamp":"2024-09-12T18:38:23.555349+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:20.367735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:33.403555+0000","last_change":"2024-09-12T18:38:33.403555+0000","last_active":"2024-09-12T18:38:33.403555+0000","last_peered":"2024-09-12T18:38:33.403555+0000","last_clean":"2024-09-12T18:38:33.403555+0000","last_became_active":"2024-09-12T18:35:25.654980+0000","last_became_peered":"2024-09-12T18:35:25.654980+0000","last_unstale":"2024-09-12T18:38:33.403555+0000","last_undegraded":"2024-09-12T18:38:33.403555+0000","last_fullsized":"2024-09-12T18:38:33.403555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:33.403375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:33.403375+0000","last_clean_scrub_stamp":"2024-09-12T18:38:33.403375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:51.344863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":169,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:25.861274+0000","last_change":"2024-09-12T18:38:25.861274+0000","last_active":"2024-09-12T18:38:25.861274+0000","last_peered":"2024-09-12T18:38:25.861274+0000","last_clean":"2024-09-12T18:38:25.861274+0000","last_became_active":"2024-09-12T18:35:24.655420+0000","last_became_peered":"2024-09-12T18:35:24.655420+0000","last_unstale":"2024-09-12T18:38:25.861274+0000","last_undegraded":"2024-09-12T18:38:25.861274+0000","last_fullsized":"2024-09-12T18:38:25.861274+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-09-12T18:38:25.861095+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-09-12T18:38:25.861095+0000","last_clean_scrub_stamp":"2024-09-12T18:38:25.861095+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:47.957392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":178,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:37.988321+0000","last_change":"2024-09-12T18:38:37.988321+0000","last_active":"2024-09-12T18:38:37.988321+0000","last_peered":"2024-09-12T18:38:37.988321+0000","last_clean":"2024-09-12T18:38:37.988321+0000","last_became_active":"2024-09-12T18:38:03.355072+0000","last_became_peered":"2024-09-12T18:38:03.355072+0000","last_unstale":"2024-09-12T18:38:37.988321+0000","last_undegraded":"2024-09-12T18:38:37.988321+0000","last_fullsized":"2024-09-12T18:38:37.988321+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:37.988148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:37.988148+0000","last_clean_scrub_stamp":"2024-09-12T18:38:37.988148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:38.890619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:28.864448+0000","last_change":"2024-09-12T18:38:28.864448+0000","last_active":"2024-09-12T18:38:28.864448+0000","last_peered":"2024-09-12T18:38:28.864448+0000","last_clean":"2024-09-12T18:38:28.864448+0000","last_became_active":"2024-09-12T18:38:03.353780+0000","last_became_peered":"2024-09-12T18:38:03.353780+0000","last_unstale":"2024-09-12T18:38:28.864448+0000","last_undegraded":"2024-09-12T18:38:28.864448+0000","last_fullsized":"2024-09-12T18:38:28.864448+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'6","last_scrub_stamp":"2024-09-12T18:38:28.864265+0000","last_deep_scrub":"91'6","last_deep_scrub_stamp":"2024-09-12T18:38:28.864265+0000","last_clean_scrub_stamp":"2024-09-12T18:38:28.864265+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:11.764660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705712,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280768,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94091072,"statfs":{"total":96636764160,"available":96349257728,"internally_reserved":0,"allocated":1097728,"data_stored":982590,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":286390726},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738416,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284940,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":94086900,"statfs":{"total":96636764160,"available":96344985600,"internally_reserved":0,"allocated":1110016,"data_stored":983225,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":290650565},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738416,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302900,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":301886,"kb_avail":94068940,"statfs":{"total":96636764160,"available":96326594560,"internally_reserved":0,"allocated":1019904,"data_stored":391063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":309131718},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:38:55.789 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:55.789 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T18:35:24.607229+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=35, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=38, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:38:55.790 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T18:39:15.792 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:39:16.114 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:39:16.116 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T18:39:16.131 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":211,"stamp":"2024-09-12T18:39:14.448127+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":192,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":180,"ondisk_log_size":180,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":868608,"kb_used_data":3152,"kb_used_omap":4,"kb_used_meta":865403,"kb_avail":282246912,"statfs":{"total":289910292480,"available":289020837888,"internally_reserved":0,"allocated":3227648,"data_stored":2356878,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4783,"internal_metadata":886173009},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004295"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":178,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:46.373372+0000","last_change":"2024-09-12T18:38:46.373372+0000","last_active":"2024-09-12T18:38:46.373372+0000","last_peered":"2024-09-12T18:38:46.373372+0000","last_clean":"2024-09-12T18:38:46.373372+0000","last_became_active":"2024-09-12T18:38:03.357317+0000","last_became_peered":"2024-09-12T18:38:03.357317+0000","last_unstale":"2024-09-12T18:38:46.373372+0000","last_undegraded":"2024-09-12T18:38:46.373372+0000","last_fullsized":"2024-09-12T18:38:46.373372+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:46.373199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:46.373199+0000","last_clean_scrub_stamp":"2024-09-12T18:38:46.373199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:24.766492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:47.384844+0000","last_change":"2024-09-12T18:38:47.384844+0000","last_active":"2024-09-12T18:38:47.384844+0000","last_peered":"2024-09-12T18:38:47.384844+0000","last_clean":"2024-09-12T18:38:47.384844+0000","last_became_active":"2024-09-12T18:35:25.654920+0000","last_became_peered":"2024-09-12T18:35:25.654920+0000","last_unstale":"2024-09-12T18:38:47.384844+0000","last_undegraded":"2024-09-12T18:38:47.384844+0000","last_fullsized":"2024-09-12T18:38:47.384844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:47.384670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:47.384670+0000","last_clean_scrub_stamp":"2024-09-12T18:38:47.384670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:19.321982+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:53.045258+0000","last_change":"2024-09-12T18:38:53.045258+0000","last_active":"2024-09-12T18:38:53.045258+0000","last_peered":"2024-09-12T18:38:53.045258+0000","last_clean":"2024-09-12T18:38:53.045258+0000","last_became_active":"2024-09-12T18:35:25.657782+0000","last_became_peered":"2024-09-12T18:35:25.657782+0000","last_unstale":"2024-09-12T18:38:53.045258+0000","last_undegraded":"2024-09-12T18:38:53.045258+0000","last_fullsized":"2024-09-12T18:38:53.045258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:53.045085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:53.045085+0000","last_clean_scrub_stamp":"2024-09-12T18:38:53.045085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:15.616342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:52.015686+0000","last_change":"2024-09-12T18:38:52.015686+0000","last_active":"2024-09-12T18:38:52.015686+0000","last_peered":"2024-09-12T18:38:52.015686+0000","last_clean":"2024-09-12T18:38:52.015686+0000","last_became_active":"2024-09-12T18:35:25.661977+0000","last_became_peered":"2024-09-12T18:35:25.661977+0000","last_unstale":"2024-09-12T18:38:52.015686+0000","last_undegraded":"2024-09-12T18:38:52.015686+0000","last_fullsized":"2024-09-12T18:38:52.015686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:52.015515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:52.015515+0000","last_clean_scrub_stamp":"2024-09-12T18:38:52.015515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:43.512160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:44.297721+0000","last_change":"2024-09-12T18:38:44.297721+0000","last_active":"2024-09-12T18:38:44.297721+0000","last_peered":"2024-09-12T18:38:44.297721+0000","last_clean":"2024-09-12T18:38:44.297721+0000","last_became_active":"2024-09-12T18:35:25.654898+0000","last_became_peered":"2024-09-12T18:35:25.654898+0000","last_unstale":"2024-09-12T18:38:44.297721+0000","last_undegraded":"2024-09-12T18:38:44.297721+0000","last_fullsized":"2024-09-12T18:38:44.297721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:44.297523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:44.297523+0000","last_clean_scrub_stamp":"2024-09-12T18:38:44.297523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:39.030741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":178,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:51.036212+0000","last_change":"2024-09-12T18:38:51.036212+0000","last_active":"2024-09-12T18:38:51.036212+0000","last_peered":"2024-09-12T18:38:51.036212+0000","last_clean":"2024-09-12T18:38:51.036212+0000","last_became_active":"2024-09-12T18:38:03.364745+0000","last_became_peered":"2024-09-12T18:38:03.364745+0000","last_unstale":"2024-09-12T18:38:51.036212+0000","last_undegraded":"2024-09-12T18:38:51.036212+0000","last_fullsized":"2024-09-12T18:38:51.036212+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:51.036034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:51.036034+0000","last_clean_scrub_stamp":"2024-09-12T18:38:51.036034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:56.563475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:50.081519+0000","last_change":"2024-09-12T18:38:50.081519+0000","last_active":"2024-09-12T18:38:50.081519+0000","last_peered":"2024-09-12T18:38:50.081519+0000","last_clean":"2024-09-12T18:38:50.081519+0000","last_became_active":"2024-09-12T18:35:25.658998+0000","last_became_peered":"2024-09-12T18:35:25.658998+0000","last_unstale":"2024-09-12T18:38:50.081519+0000","last_undegraded":"2024-09-12T18:38:50.081519+0000","last_fullsized":"2024-09-12T18:38:50.081519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:50.081338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:50.081338+0000","last_clean_scrub_stamp":"2024-09-12T18:38:50.081338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:10.924113+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":178,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:48.109022+0000","last_change":"2024-09-12T18:38:48.109022+0000","last_active":"2024-09-12T18:38:48.109022+0000","last_peered":"2024-09-12T18:38:48.109022+0000","last_clean":"2024-09-12T18:38:48.109022+0000","last_became_active":"2024-09-12T18:38:03.364845+0000","last_became_peered":"2024-09-12T18:38:03.364845+0000","last_unstale":"2024-09-12T18:38:48.109022+0000","last_undegraded":"2024-09-12T18:38:48.109022+0000","last_fullsized":"2024-09-12T18:38:48.109022+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:48.108793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:48.108793+0000","last_clean_scrub_stamp":"2024-09-12T18:38:48.108793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:02.763376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:44.764248+0000","last_change":"2024-09-12T18:38:44.764248+0000","last_active":"2024-09-12T18:38:44.764248+0000","last_peered":"2024-09-12T18:38:44.764248+0000","last_clean":"2024-09-12T18:38:44.764248+0000","last_became_active":"2024-09-12T18:35:25.667608+0000","last_became_peered":"2024-09-12T18:35:25.667608+0000","last_unstale":"2024-09-12T18:38:44.764248+0000","last_undegraded":"2024-09-12T18:38:44.764248+0000","last_fullsized":"2024-09-12T18:38:44.764248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:44.764067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:44.764067+0000","last_clean_scrub_stamp":"2024-09-12T18:38:44.764067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:59.543066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":178,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:45.334988+0000","last_change":"2024-09-12T18:38:45.334988+0000","last_active":"2024-09-12T18:38:45.334988+0000","last_peered":"2024-09-12T18:38:45.334988+0000","last_clean":"2024-09-12T18:38:45.334988+0000","last_became_active":"2024-09-12T18:38:03.357446+0000","last_became_peered":"2024-09-12T18:38:03.357446+0000","last_unstale":"2024-09-12T18:38:45.334988+0000","last_undegraded":"2024-09-12T18:38:45.334988+0000","last_fullsized":"2024-09-12T18:38:45.334988+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:45.334782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:45.334782+0000","last_clean_scrub_stamp":"2024-09-12T18:38:45.334782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:02.759051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":178,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:49.059733+0000","last_change":"2024-09-12T18:38:49.059733+0000","last_active":"2024-09-12T18:38:49.059733+0000","last_peered":"2024-09-12T18:38:49.059733+0000","last_clean":"2024-09-12T18:38:49.059733+0000","last_became_active":"2024-09-12T18:38:03.355561+0000","last_became_peered":"2024-09-12T18:38:03.355561+0000","last_unstale":"2024-09-12T18:38:49.059733+0000","last_undegraded":"2024-09-12T18:38:49.059733+0000","last_fullsized":"2024-09-12T18:38:49.059733+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:49.059561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:49.059561+0000","last_clean_scrub_stamp":"2024-09-12T18:38:49.059561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:55.421623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:43.272160+0000","last_change":"2024-09-12T18:38:43.272160+0000","last_active":"2024-09-12T18:38:43.272160+0000","last_peered":"2024-09-12T18:38:43.272160+0000","last_clean":"2024-09-12T18:38:43.272160+0000","last_became_active":"2024-09-12T18:35:25.649111+0000","last_became_peered":"2024-09-12T18:35:25.649111+0000","last_unstale":"2024-09-12T18:38:43.272160+0000","last_undegraded":"2024-09-12T18:38:43.272160+0000","last_fullsized":"2024-09-12T18:38:43.272160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:43.271978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:43.271978+0000","last_clean_scrub_stamp":"2024-09-12T18:38:43.271978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:45.376399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":178,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:42.310978+0000","last_change":"2024-09-12T18:38:42.310978+0000","last_active":"2024-09-12T18:38:42.310978+0000","last_peered":"2024-09-12T18:38:42.310978+0000","last_clean":"2024-09-12T18:38:42.310978+0000","last_became_active":"2024-09-12T18:38:03.349130+0000","last_became_peered":"2024-09-12T18:38:03.349130+0000","last_unstale":"2024-09-12T18:38:42.310978+0000","last_undegraded":"2024-09-12T18:38:42.310978+0000","last_fullsized":"2024-09-12T18:38:42.310978+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:42.310773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:42.310773+0000","last_clean_scrub_stamp":"2024-09-12T18:38:42.310773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:53.594848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:47.077511+0000","last_change":"2024-09-12T18:38:47.077511+0000","last_active":"2024-09-12T18:38:47.077511+0000","last_peered":"2024-09-12T18:38:47.077511+0000","last_clean":"2024-09-12T18:38:47.077511+0000","last_became_active":"2024-09-12T18:35:25.657082+0000","last_became_peered":"2024-09-12T18:35:25.657082+0000","last_unstale":"2024-09-12T18:38:47.077511+0000","last_undegraded":"2024-09-12T18:38:47.077511+0000","last_fullsized":"2024-09-12T18:38:47.077511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:47.077335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:47.077335+0000","last_clean_scrub_stamp":"2024-09-12T18:38:47.077335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:29.771152+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:46.076727+0000","last_change":"2024-09-12T18:38:46.076727+0000","last_active":"2024-09-12T18:38:46.076727+0000","last_peered":"2024-09-12T18:38:46.076727+0000","last_clean":"2024-09-12T18:38:46.076727+0000","last_became_active":"2024-09-12T18:35:25.657508+0000","last_became_peered":"2024-09-12T18:35:25.657508+0000","last_unstale":"2024-09-12T18:38:46.076727+0000","last_undegraded":"2024-09-12T18:38:46.076727+0000","last_fullsized":"2024-09-12T18:38:46.076727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:46.076523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:46.076523+0000","last_clean_scrub_stamp":"2024-09-12T18:38:46.076523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:00.142903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:44.052240+0000","last_change":"2024-09-12T18:38:44.052240+0000","last_active":"2024-09-12T18:38:44.052240+0000","last_peered":"2024-09-12T18:38:44.052240+0000","last_clean":"2024-09-12T18:38:44.052240+0000","last_became_active":"2024-09-12T18:35:25.651535+0000","last_became_peered":"2024-09-12T18:35:25.651535+0000","last_unstale":"2024-09-12T18:38:44.052240+0000","last_undegraded":"2024-09-12T18:38:44.052240+0000","last_fullsized":"2024-09-12T18:38:44.052240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:44.052063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:44.052063+0000","last_clean_scrub_stamp":"2024-09-12T18:38:44.052063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:35.509838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:43.802558+0000","last_change":"2024-09-12T18:38:43.802558+0000","last_active":"2024-09-12T18:38:43.802558+0000","last_peered":"2024-09-12T18:38:43.802558+0000","last_clean":"2024-09-12T18:38:43.802558+0000","last_became_active":"2024-09-12T18:35:25.653440+0000","last_became_peered":"2024-09-12T18:35:25.653440+0000","last_unstale":"2024-09-12T18:38:43.802558+0000","last_undegraded":"2024-09-12T18:38:43.802558+0000","last_fullsized":"2024-09-12T18:38:43.802558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:43.802380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:43.802380+0000","last_clean_scrub_stamp":"2024-09-12T18:38:43.802380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:45.178223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:41.328846+0000","last_change":"2024-09-12T18:38:41.328846+0000","last_active":"2024-09-12T18:38:41.328846+0000","last_peered":"2024-09-12T18:38:41.328846+0000","last_clean":"2024-09-12T18:38:41.328846+0000","last_became_active":"2024-09-12T18:35:25.653934+0000","last_became_peered":"2024-09-12T18:35:25.653934+0000","last_unstale":"2024-09-12T18:38:41.328846+0000","last_undegraded":"2024-09-12T18:38:41.328846+0000","last_fullsized":"2024-09-12T18:38:41.328846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:41.328632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:41.328632+0000","last_clean_scrub_stamp":"2024-09-12T18:38:41.328632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:25.746626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:42.807263+0000","last_change":"2024-09-12T18:38:42.807263+0000","last_active":"2024-09-12T18:38:42.807263+0000","last_peered":"2024-09-12T18:38:42.807263+0000","last_clean":"2024-09-12T18:38:42.807263+0000","last_became_active":"2024-09-12T18:38:03.357363+0000","last_became_peered":"2024-09-12T18:38:03.357363+0000","last_unstale":"2024-09-12T18:38:42.807263+0000","last_undegraded":"2024-09-12T18:38:42.807263+0000","last_fullsized":"2024-09-12T18:38:42.807263+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:42.807088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:42.807088+0000","last_clean_scrub_stamp":"2024-09-12T18:38:42.807088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:22.310424+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:45.072125+0000","last_change":"2024-09-12T18:38:45.072125+0000","last_active":"2024-09-12T18:38:45.072125+0000","last_peered":"2024-09-12T18:38:45.072125+0000","last_clean":"2024-09-12T18:38:45.072125+0000","last_became_active":"2024-09-12T18:35:25.659534+0000","last_became_peered":"2024-09-12T18:35:25.659534+0000","last_unstale":"2024-09-12T18:38:45.072125+0000","last_undegraded":"2024-09-12T18:38:45.072125+0000","last_fullsized":"2024-09-12T18:38:45.072125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:45.071946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:45.071946+0000","last_clean_scrub_stamp":"2024-09-12T18:38:45.071946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:29:47.936738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:43.053200+0000","last_change":"2024-09-12T18:38:43.053200+0000","last_active":"2024-09-12T18:38:43.053200+0000","last_peered":"2024-09-12T18:38:43.053200+0000","last_clean":"2024-09-12T18:38:43.053200+0000","last_became_active":"2024-09-12T18:35:25.649333+0000","last_became_peered":"2024-09-12T18:35:25.649333+0000","last_unstale":"2024-09-12T18:38:43.053200+0000","last_undegraded":"2024-09-12T18:38:43.053200+0000","last_fullsized":"2024-09-12T18:38:43.053200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:43.053017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:43.053017+0000","last_clean_scrub_stamp":"2024-09-12T18:38:43.053017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:46.441483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:39.342647+0000","last_change":"2024-09-12T18:38:39.342647+0000","last_active":"2024-09-12T18:38:39.342647+0000","last_peered":"2024-09-12T18:38:39.342647+0000","last_clean":"2024-09-12T18:38:39.342647+0000","last_became_active":"2024-09-12T18:35:25.646357+0000","last_became_peered":"2024-09-12T18:35:25.646357+0000","last_unstale":"2024-09-12T18:38:39.342647+0000","last_undegraded":"2024-09-12T18:38:39.342647+0000","last_fullsized":"2024-09-12T18:38:39.342647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:39.342473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:39.342473+0000","last_clean_scrub_stamp":"2024-09-12T18:38:39.342473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:31.032867+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:41.808817+0000","last_change":"2024-09-12T18:38:41.808817+0000","last_active":"2024-09-12T18:38:41.808817+0000","last_peered":"2024-09-12T18:38:41.808817+0000","last_clean":"2024-09-12T18:38:41.808817+0000","last_became_active":"2024-09-12T18:35:25.658833+0000","last_became_peered":"2024-09-12T18:35:25.658833+0000","last_unstale":"2024-09-12T18:38:41.808817+0000","last_undegraded":"2024-09-12T18:38:41.808817+0000","last_fullsized":"2024-09-12T18:38:41.808817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:41.808642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:41.808642+0000","last_clean_scrub_stamp":"2024-09-12T18:38:41.808642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:37.366441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:40.368186+0000","last_change":"2024-09-12T18:38:40.368186+0000","last_active":"2024-09-12T18:38:40.368186+0000","last_peered":"2024-09-12T18:38:40.368186+0000","last_clean":"2024-09-12T18:38:40.368186+0000","last_became_active":"2024-09-12T18:35:25.655295+0000","last_became_peered":"2024-09-12T18:35:25.655295+0000","last_unstale":"2024-09-12T18:38:40.368186+0000","last_undegraded":"2024-09-12T18:38:40.368186+0000","last_fullsized":"2024-09-12T18:38:40.368186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:40.367985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:40.367985+0000","last_clean_scrub_stamp":"2024-09-12T18:38:40.367985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:29:54.697491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:38.313112+0000","last_change":"2024-09-12T18:38:38.313112+0000","last_active":"2024-09-12T18:38:38.313112+0000","last_peered":"2024-09-12T18:38:38.313112+0000","last_clean":"2024-09-12T18:38:38.313112+0000","last_became_active":"2024-09-12T18:35:25.650407+0000","last_became_peered":"2024-09-12T18:35:25.650407+0000","last_unstale":"2024-09-12T18:38:38.313112+0000","last_undegraded":"2024-09-12T18:38:38.313112+0000","last_fullsized":"2024-09-12T18:38:38.313112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:38.312936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:38.312936+0000","last_clean_scrub_stamp":"2024-09-12T18:38:38.312936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:22.524731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:40.803035+0000","last_change":"2024-09-12T18:38:40.803035+0000","last_active":"2024-09-12T18:38:40.803035+0000","last_peered":"2024-09-12T18:38:40.803035+0000","last_clean":"2024-09-12T18:38:40.803035+0000","last_became_active":"2024-09-12T18:35:25.660126+0000","last_became_peered":"2024-09-12T18:35:25.660126+0000","last_unstale":"2024-09-12T18:38:40.803035+0000","last_undegraded":"2024-09-12T18:38:40.803035+0000","last_fullsized":"2024-09-12T18:38:40.803035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:40.802855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:40.802855+0000","last_clean_scrub_stamp":"2024-09-12T18:38:40.802855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:04.501003+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:42.039939+0000","last_change":"2024-09-12T18:38:42.039939+0000","last_active":"2024-09-12T18:38:42.039939+0000","last_peered":"2024-09-12T18:38:42.039939+0000","last_clean":"2024-09-12T18:38:42.039939+0000","last_became_active":"2024-09-12T18:35:25.659338+0000","last_became_peered":"2024-09-12T18:35:25.659338+0000","last_unstale":"2024-09-12T18:38:42.039939+0000","last_undegraded":"2024-09-12T18:38:42.039939+0000","last_fullsized":"2024-09-12T18:38:42.039939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:42.039740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:42.039740+0000","last_clean_scrub_stamp":"2024-09-12T18:38:42.039740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:04.298718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:37.322681+0000","last_change":"2024-09-12T18:38:37.322681+0000","last_active":"2024-09-12T18:38:37.322681+0000","last_peered":"2024-09-12T18:38:37.322681+0000","last_clean":"2024-09-12T18:38:37.322681+0000","last_became_active":"2024-09-12T18:35:25.659496+0000","last_became_peered":"2024-09-12T18:35:25.659496+0000","last_unstale":"2024-09-12T18:38:37.322681+0000","last_undegraded":"2024-09-12T18:38:37.322681+0000","last_fullsized":"2024-09-12T18:38:37.322681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:37.322502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:37.322502+0000","last_clean_scrub_stamp":"2024-09-12T18:38:37.322502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:20.193829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:39.779875+0000","last_change":"2024-09-12T18:38:39.779875+0000","last_active":"2024-09-12T18:38:39.779875+0000","last_peered":"2024-09-12T18:38:39.779875+0000","last_clean":"2024-09-12T18:38:39.779875+0000","last_became_active":"2024-09-12T18:38:03.356412+0000","last_became_peered":"2024-09-12T18:38:03.356412+0000","last_unstale":"2024-09-12T18:38:39.779875+0000","last_undegraded":"2024-09-12T18:38:39.779875+0000","last_fullsized":"2024-09-12T18:38:39.779875+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:39.779703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:39.779703+0000","last_clean_scrub_stamp":"2024-09-12T18:38:39.779703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:59.210888+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:36.371658+0000","last_change":"2024-09-12T18:38:36.371658+0000","last_active":"2024-09-12T18:38:36.371658+0000","last_peered":"2024-09-12T18:38:36.371658+0000","last_clean":"2024-09-12T18:38:36.371658+0000","last_became_active":"2024-09-12T18:35:25.649415+0000","last_became_peered":"2024-09-12T18:35:25.649415+0000","last_unstale":"2024-09-12T18:38:36.371658+0000","last_undegraded":"2024-09-12T18:38:36.371658+0000","last_fullsized":"2024-09-12T18:38:36.371658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:36.371475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:36.371475+0000","last_clean_scrub_stamp":"2024-09-12T18:38:36.371475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:42.955426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:38.809575+0000","last_change":"2024-09-12T18:38:38.809575+0000","last_active":"2024-09-12T18:38:38.809575+0000","last_peered":"2024-09-12T18:38:38.809575+0000","last_clean":"2024-09-12T18:38:38.809575+0000","last_became_active":"2024-09-12T18:35:25.652992+0000","last_became_peered":"2024-09-12T18:35:25.652992+0000","last_unstale":"2024-09-12T18:38:38.809575+0000","last_undegraded":"2024-09-12T18:38:38.809575+0000","last_fullsized":"2024-09-12T18:38:38.809575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:38.809406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:38.809406+0000","last_clean_scrub_stamp":"2024-09-12T18:38:38.809406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:01.750781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":178,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:41.026606+0000","last_change":"2024-09-12T18:38:41.026606+0000","last_active":"2024-09-12T18:38:41.026606+0000","last_peered":"2024-09-12T18:38:41.026606+0000","last_clean":"2024-09-12T18:38:41.026606+0000","last_became_active":"2024-09-12T18:38:03.355052+0000","last_became_peered":"2024-09-12T18:38:03.355052+0000","last_unstale":"2024-09-12T18:38:41.026606+0000","last_undegraded":"2024-09-12T18:38:41.026606+0000","last_fullsized":"2024-09-12T18:38:41.026606+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:41.026426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:41.026426+0000","last_clean_scrub_stamp":"2024-09-12T18:38:41.026426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:18.155210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":178,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:30.461083+0000","last_change":"2024-09-12T18:38:30.461083+0000","last_active":"2024-09-12T18:38:30.461083+0000","last_peered":"2024-09-12T18:38:30.461083+0000","last_clean":"2024-09-12T18:38:30.461083+0000","last_became_active":"2024-09-12T18:38:03.351112+0000","last_became_peered":"2024-09-12T18:38:03.351112+0000","last_unstale":"2024-09-12T18:38:30.461083+0000","last_undegraded":"2024-09-12T18:38:30.461083+0000","last_fullsized":"2024-09-12T18:38:30.461083+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:30.460854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:30.460854+0000","last_clean_scrub_stamp":"2024-09-12T18:38:30.460854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:13.061935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"91'4","reported_seq":172,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:27.922735+0000","last_change":"2024-09-12T18:38:27.922735+0000","last_active":"2024-09-12T18:38:27.922735+0000","last_peered":"2024-09-12T18:38:27.922735+0000","last_clean":"2024-09-12T18:38:27.922735+0000","last_became_active":"2024-09-12T18:35:24.656208+0000","last_became_peered":"2024-09-12T18:35:24.656208+0000","last_unstale":"2024-09-12T18:38:27.922735+0000","last_undegraded":"2024-09-12T18:38:27.922735+0000","last_fullsized":"2024-09-12T18:38:27.922735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'4","last_scrub_stamp":"2024-09-12T18:38:27.922544+0000","last_deep_scrub":"91'4","last_deep_scrub_stamp":"2024-09-12T18:38:27.922544+0000","last_clean_scrub_stamp":"2024-09-12T18:38:27.922544+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:17.404089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:31.451665+0000","last_change":"2024-09-12T18:38:31.451665+0000","last_active":"2024-09-12T18:38:31.451665+0000","last_peered":"2024-09-12T18:38:31.451665+0000","last_clean":"2024-09-12T18:38:31.451665+0000","last_became_active":"2024-09-12T18:35:25.650849+0000","last_became_peered":"2024-09-12T18:35:25.650849+0000","last_unstale":"2024-09-12T18:38:31.451665+0000","last_undegraded":"2024-09-12T18:38:31.451665+0000","last_fullsized":"2024-09-12T18:38:31.451665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:31.451483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:31.451483+0000","last_clean_scrub_stamp":"2024-09-12T18:38:31.451483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:54.990616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:22.838878+0000","last_change":"2024-09-12T18:38:22.838878+0000","last_active":"2024-09-12T18:38:22.838878+0000","last_peered":"2024-09-12T18:38:22.838878+0000","last_clean":"2024-09-12T18:38:22.838878+0000","last_became_active":"2024-09-12T18:35:24.653175+0000","last_became_peered":"2024-09-12T18:35:24.653175+0000","last_unstale":"2024-09-12T18:38:22.838878+0000","last_undegraded":"2024-09-12T18:38:22.838878+0000","last_fullsized":"2024-09-12T18:38:22.838878+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:22.838700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:22.838700+0000","last_clean_scrub_stamp":"2024-09-12T18:38:22.838700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:19.971248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:35.859328+0000","last_change":"2024-09-12T18:38:35.859328+0000","last_active":"2024-09-12T18:38:35.859328+0000","last_peered":"2024-09-12T18:38:35.859328+0000","last_clean":"2024-09-12T18:38:35.859328+0000","last_became_active":"2024-09-12T18:38:03.354299+0000","last_became_peered":"2024-09-12T18:38:03.354299+0000","last_unstale":"2024-09-12T18:38:35.859328+0000","last_undegraded":"2024-09-12T18:38:35.859328+0000","last_fullsized":"2024-09-12T18:38:35.859328+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:35.859174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:35.859174+0000","last_clean_scrub_stamp":"2024-09-12T18:38:35.859174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:49.874184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:18.425352+0000","last_change":"2024-09-12T18:38:18.425352+0000","last_active":"2024-09-12T18:38:18.425352+0000","last_peered":"2024-09-12T18:38:18.425352+0000","last_clean":"2024-09-12T18:38:18.425352+0000","last_became_active":"2024-09-12T18:35:24.638230+0000","last_became_peered":"2024-09-12T18:35:24.638230+0000","last_unstale":"2024-09-12T18:38:18.425352+0000","last_undegraded":"2024-09-12T18:38:18.425352+0000","last_fullsized":"2024-09-12T18:38:18.425352+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:18.425173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:18.425173+0000","last_clean_scrub_stamp":"2024-09-12T18:38:18.425173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:59.363225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:37.827085+0000","last_change":"2024-09-12T18:38:37.827085+0000","last_active":"2024-09-12T18:38:37.827085+0000","last_peered":"2024-09-12T18:38:37.827085+0000","last_clean":"2024-09-12T18:38:37.827085+0000","last_became_active":"2024-09-12T18:38:03.352848+0000","last_became_peered":"2024-09-12T18:38:03.352848+0000","last_unstale":"2024-09-12T18:38:37.827085+0000","last_undegraded":"2024-09-12T18:38:37.827085+0000","last_fullsized":"2024-09-12T18:38:37.827085+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:37.826912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:37.826912+0000","last_clean_scrub_stamp":"2024-09-12T18:38:37.826912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:45.886998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"91'12","reported_seq":180,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:26.967784+0000","last_change":"2024-09-12T18:38:26.967784+0000","last_active":"2024-09-12T18:38:26.967784+0000","last_peered":"2024-09-12T18:38:26.967784+0000","last_clean":"2024-09-12T18:38:26.967784+0000","last_became_active":"2024-09-12T18:35:24.652880+0000","last_became_peered":"2024-09-12T18:35:24.652880+0000","last_unstale":"2024-09-12T18:38:26.967784+0000","last_undegraded":"2024-09-12T18:38:26.967784+0000","last_fullsized":"2024-09-12T18:38:26.967784+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'12","last_scrub_stamp":"2024-09-12T18:38:26.967536+0000","last_deep_scrub":"91'12","last_deep_scrub_stamp":"2024-09-12T18:38:26.967536+0000","last_clean_scrub_stamp":"2024-09-12T18:38:26.967536+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:30.754499+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"91'2","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:25.998829+0000","last_change":"2024-09-12T18:38:25.998829+0000","last_active":"2024-09-12T18:38:25.998829+0000","last_peered":"2024-09-12T18:38:25.998829+0000","last_clean":"2024-09-12T18:38:25.998829+0000","last_became_active":"2024-09-12T18:35:24.652792+0000","last_became_peered":"2024-09-12T18:35:24.652792+0000","last_unstale":"2024-09-12T18:38:25.998829+0000","last_undegraded":"2024-09-12T18:38:25.998829+0000","last_fullsized":"2024-09-12T18:38:25.998829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2024-09-12T18:38:25.998647+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2024-09-12T18:38:25.998647+0000","last_clean_scrub_stamp":"2024-09-12T18:38:25.998647+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:02.832804+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:28.476822+0000","last_change":"2024-09-12T18:38:28.476822+0000","last_active":"2024-09-12T18:38:28.476822+0000","last_peered":"2024-09-12T18:38:28.476822+0000","last_clean":"2024-09-12T18:38:28.476822+0000","last_became_active":"2024-09-12T18:35:25.648186+0000","last_became_peered":"2024-09-12T18:35:25.648186+0000","last_unstale":"2024-09-12T18:38:28.476822+0000","last_undegraded":"2024-09-12T18:38:28.476822+0000","last_fullsized":"2024-09-12T18:38:28.476822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:28.476612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:28.476612+0000","last_clean_scrub_stamp":"2024-09-12T18:38:28.476612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:35:58.565120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"91'3","reported_seq":171,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:16.436792+0000","last_change":"2024-09-12T18:38:16.436792+0000","last_active":"2024-09-12T18:38:16.436792+0000","last_peered":"2024-09-12T18:38:16.436792+0000","last_clean":"2024-09-12T18:38:16.436792+0000","last_became_active":"2024-09-12T18:35:24.647629+0000","last_became_peered":"2024-09-12T18:35:24.647629+0000","last_unstale":"2024-09-12T18:38:16.436792+0000","last_undegraded":"2024-09-12T18:38:16.436792+0000","last_fullsized":"2024-09-12T18:38:16.436792+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-09-12T18:38:16.436607+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-09-12T18:38:16.436607+0000","last_clean_scrub_stamp":"2024-09-12T18:38:16.436607+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:38.233429+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:27.491405+0000","last_change":"2024-09-12T18:38:27.491405+0000","last_active":"2024-09-12T18:38:27.491405+0000","last_peered":"2024-09-12T18:38:27.491405+0000","last_clean":"2024-09-12T18:38:27.491405+0000","last_became_active":"2024-09-12T18:35:25.651628+0000","last_became_peered":"2024-09-12T18:35:25.651628+0000","last_unstale":"2024-09-12T18:38:27.491405+0000","last_undegraded":"2024-09-12T18:38:27.491405+0000","last_fullsized":"2024-09-12T18:38:27.491405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:27.491200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:27.491200+0000","last_clean_scrub_stamp":"2024-09-12T18:38:27.491200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:43.970943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"91'2","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:25.017906+0000","last_change":"2024-09-12T18:38:25.017906+0000","last_active":"2024-09-12T18:38:25.017906+0000","last_peered":"2024-09-12T18:38:25.017906+0000","last_clean":"2024-09-12T18:38:25.017906+0000","last_became_active":"2024-09-12T18:35:24.654264+0000","last_became_peered":"2024-09-12T18:35:24.654264+0000","last_unstale":"2024-09-12T18:38:25.017906+0000","last_undegraded":"2024-09-12T18:38:25.017906+0000","last_fullsized":"2024-09-12T18:38:25.017906+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2024-09-12T18:38:25.017729+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2024-09-12T18:38:25.017729+0000","last_clean_scrub_stamp":"2024-09-12T18:38:25.017729+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:01.448156+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":178,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:32.939952+0000","last_change":"2024-09-12T18:38:32.939952+0000","last_active":"2024-09-12T18:38:32.939952+0000","last_peered":"2024-09-12T18:38:32.939952+0000","last_clean":"2024-09-12T18:38:32.939952+0000","last_became_active":"2024-09-12T18:38:03.364754+0000","last_became_peered":"2024-09-12T18:38:03.364754+0000","last_unstale":"2024-09-12T18:38:32.939952+0000","last_undegraded":"2024-09-12T18:38:32.939952+0000","last_fullsized":"2024-09-12T18:38:32.939952+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:32.939779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:32.939779+0000","last_clean_scrub_stamp":"2024-09-12T18:38:32.939779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:51.995209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:23.976416+0000","last_change":"2024-09-12T18:38:23.976416+0000","last_active":"2024-09-12T18:38:23.976416+0000","last_peered":"2024-09-12T18:38:23.976416+0000","last_clean":"2024-09-12T18:38:23.976416+0000","last_became_active":"2024-09-12T18:35:24.657015+0000","last_became_peered":"2024-09-12T18:35:24.657015+0000","last_unstale":"2024-09-12T18:38:23.976416+0000","last_undegraded":"2024-09-12T18:38:23.976416+0000","last_fullsized":"2024-09-12T18:38:23.976416+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:23.976218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:23.976218+0000","last_clean_scrub_stamp":"2024-09-12T18:38:23.976218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:04.600584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:30.862366+0000","last_change":"2024-09-12T18:38:30.862366+0000","last_active":"2024-09-12T18:38:30.862366+0000","last_peered":"2024-09-12T18:38:30.862366+0000","last_clean":"2024-09-12T18:38:30.862366+0000","last_became_active":"2024-09-12T18:35:25.659511+0000","last_became_peered":"2024-09-12T18:35:25.659511+0000","last_unstale":"2024-09-12T18:38:30.862366+0000","last_undegraded":"2024-09-12T18:38:30.862366+0000","last_fullsized":"2024-09-12T18:38:30.862366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:30.862185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:30.862185+0000","last_clean_scrub_stamp":"2024-09-12T18:38:30.862185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:31.983235+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"91'3","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:21.834936+0000","last_change":"2024-09-12T18:38:21.834936+0000","last_active":"2024-09-12T18:38:21.834936+0000","last_peered":"2024-09-12T18:38:21.834936+0000","last_clean":"2024-09-12T18:38:21.834936+0000","last_became_active":"2024-09-12T18:38:03.364147+0000","last_became_peered":"2024-09-12T18:38:03.364147+0000","last_unstale":"2024-09-12T18:38:21.834936+0000","last_undegraded":"2024-09-12T18:38:21.834936+0000","last_fullsized":"2024-09-12T18:38:21.834936+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-09-12T18:38:21.834762+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-09-12T18:38:21.834762+0000","last_clean_scrub_stamp":"2024-09-12T18:38:21.834762+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:50.155191+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":178,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:33.919892+0000","last_change":"2024-09-12T18:38:33.919892+0000","last_active":"2024-09-12T18:38:33.919892+0000","last_peered":"2024-09-12T18:38:33.919892+0000","last_clean":"2024-09-12T18:38:33.919892+0000","last_became_active":"2024-09-12T18:38:03.355310+0000","last_became_peered":"2024-09-12T18:38:03.355310+0000","last_unstale":"2024-09-12T18:38:33.919892+0000","last_undegraded":"2024-09-12T18:38:33.919892+0000","last_fullsized":"2024-09-12T18:38:33.919892+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:33.919711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:33.919711+0000","last_clean_scrub_stamp":"2024-09-12T18:38:33.919711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:28.178012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:20.987182+0000","last_change":"2024-09-12T18:38:20.987182+0000","last_active":"2024-09-12T18:38:20.987182+0000","last_peered":"2024-09-12T18:38:20.987182+0000","last_clean":"2024-09-12T18:38:20.987182+0000","last_became_active":"2024-09-12T18:35:24.658423+0000","last_became_peered":"2024-09-12T18:35:24.658423+0000","last_unstale":"2024-09-12T18:38:20.987182+0000","last_undegraded":"2024-09-12T18:38:20.987182+0000","last_fullsized":"2024-09-12T18:38:20.987182+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:20.986970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:20.986970+0000","last_clean_scrub_stamp":"2024-09-12T18:38:20.986970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:44.685119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:34.948985+0000","last_change":"2024-09-12T18:38:34.948985+0000","last_active":"2024-09-12T18:38:34.948985+0000","last_peered":"2024-09-12T18:38:34.948985+0000","last_clean":"2024-09-12T18:38:34.948985+0000","last_became_active":"2024-09-12T18:35:25.660372+0000","last_became_peered":"2024-09-12T18:35:25.660372+0000","last_unstale":"2024-09-12T18:38:34.948985+0000","last_undegraded":"2024-09-12T18:38:34.948985+0000","last_fullsized":"2024-09-12T18:38:34.948985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:34.948762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:34.948762+0000","last_clean_scrub_stamp":"2024-09-12T18:38:34.948762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:24.764862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:15.449099+0000","last_change":"2024-09-12T18:38:15.449099+0000","last_active":"2024-09-12T18:38:15.449099+0000","last_peered":"2024-09-12T18:38:15.449099+0000","last_clean":"2024-09-12T18:38:15.449099+0000","last_became_active":"2024-09-12T18:35:24.647520+0000","last_became_peered":"2024-09-12T18:35:24.647520+0000","last_unstale":"2024-09-12T18:38:15.449099+0000","last_undegraded":"2024-09-12T18:38:15.449099+0000","last_fullsized":"2024-09-12T18:38:15.449099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:15.448900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:15.448900+0000","last_clean_scrub_stamp":"2024-09-12T18:38:15.448900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:34.948207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:35.962131+0000","last_change":"2024-09-12T18:38:35.962131+0000","last_active":"2024-09-12T18:38:35.962131+0000","last_peered":"2024-09-12T18:38:35.962131+0000","last_clean":"2024-09-12T18:38:35.962131+0000","last_became_active":"2024-09-12T18:35:25.657386+0000","last_became_peered":"2024-09-12T18:35:25.657386+0000","last_unstale":"2024-09-12T18:38:35.962131+0000","last_undegraded":"2024-09-12T18:38:35.962131+0000","last_fullsized":"2024-09-12T18:38:35.962131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:35.961953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:35.961953+0000","last_clean_scrub_stamp":"2024-09-12T18:38:35.961953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:50.442665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:20.462439+0000","last_change":"2024-09-12T18:38:20.462439+0000","last_active":"2024-09-12T18:38:20.462439+0000","last_peered":"2024-09-12T18:38:20.462439+0000","last_clean":"2024-09-12T18:38:20.462439+0000","last_became_active":"2024-09-12T18:35:24.646008+0000","last_became_peered":"2024-09-12T18:35:24.646008+0000","last_unstale":"2024-09-12T18:38:20.462439+0000","last_undegraded":"2024-09-12T18:38:20.462439+0000","last_fullsized":"2024-09-12T18:38:20.462439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:20.462258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:20.462258+0000","last_clean_scrub_stamp":"2024-09-12T18:38:20.462258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:51.867050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:31.870583+0000","last_change":"2024-09-12T18:38:31.870583+0000","last_active":"2024-09-12T18:38:31.870583+0000","last_peered":"2024-09-12T18:38:31.870583+0000","last_clean":"2024-09-12T18:38:31.870583+0000","last_became_active":"2024-09-12T18:35:25.666940+0000","last_became_peered":"2024-09-12T18:35:25.666940+0000","last_unstale":"2024-09-12T18:38:31.870583+0000","last_undegraded":"2024-09-12T18:38:31.870583+0000","last_fullsized":"2024-09-12T18:38:31.870583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:31.870398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:31.870398+0000","last_clean_scrub_stamp":"2024-09-12T18:38:31.870398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:02.764418+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"91'114","reported_seq":320,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:15.185352+0000","last_change":"2024-09-12T18:38:15.185352+0000","last_active":"2024-09-12T18:38:15.185352+0000","last_peered":"2024-09-12T18:38:15.185352+0000","last_clean":"2024-09-12T18:38:15.185352+0000","last_became_active":"2024-09-12T18:35:13.488346+0000","last_became_peered":"2024-09-12T18:35:13.488346+0000","last_unstale":"2024-09-12T18:38:15.185352+0000","last_undegraded":"2024-09-12T18:38:15.185352+0000","last_fullsized":"2024-09-12T18:38:15.185352+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'114","last_scrub_stamp":"2024-09-12T18:38:15.185153+0000","last_deep_scrub":"91'114","last_deep_scrub_stamp":"2024-09-12T18:38:15.185153+0000","last_clean_scrub_stamp":"2024-09-12T18:38:15.185153+0000","objects_scrubbed":2,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:10.417497+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"91'2","reported_seq":183,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:22.011028+0000","last_change":"2024-09-12T18:38:22.011028+0000","last_active":"2024-09-12T18:38:22.011028+0000","last_peered":"2024-09-12T18:38:22.011028+0000","last_clean":"2024-09-12T18:38:22.011028+0000","last_became_active":"2024-09-12T18:35:20.446796+0000","last_became_peered":"2024-09-12T18:35:20.446796+0000","last_unstale":"2024-09-12T18:38:22.011028+0000","last_undegraded":"2024-09-12T18:38:22.011028+0000","last_fullsized":"2024-09-12T18:38:22.011028+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2024-09-12T18:38:22.010848+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2024-09-12T18:38:22.010848+0000","last_clean_scrub_stamp":"2024-09-12T18:38:22.010848+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:28.609391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0016291610000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:18.847114+0000","last_change":"2024-09-12T18:38:18.847114+0000","last_active":"2024-09-12T18:38:18.847114+0000","last_peered":"2024-09-12T18:38:18.847114+0000","last_clean":"2024-09-12T18:38:18.847114+0000","last_became_active":"2024-09-12T18:38:03.353661+0000","last_became_peered":"2024-09-12T18:38:03.353661+0000","last_unstale":"2024-09-12T18:38:18.847114+0000","last_undegraded":"2024-09-12T18:38:18.847114+0000","last_fullsized":"2024-09-12T18:38:18.847114+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:18.846939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:18.846939+0000","last_clean_scrub_stamp":"2024-09-12T18:38:18.846939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:01.582641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:31.943523+0000","last_change":"2024-09-12T18:38:31.943523+0000","last_active":"2024-09-12T18:38:31.943523+0000","last_peered":"2024-09-12T18:38:31.943523+0000","last_clean":"2024-09-12T18:38:31.943523+0000","last_became_active":"2024-09-12T18:35:25.661043+0000","last_became_peered":"2024-09-12T18:35:25.661043+0000","last_unstale":"2024-09-12T18:38:31.943523+0000","last_undegraded":"2024-09-12T18:38:31.943523+0000","last_fullsized":"2024-09-12T18:38:31.943523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:31.943308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:31.943308+0000","last_clean_scrub_stamp":"2024-09-12T18:38:31.943308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:29.830430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":181,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:17.113101+0000","last_change":"2024-09-12T18:38:17.113101+0000","last_active":"2024-09-12T18:38:17.113101+0000","last_peered":"2024-09-12T18:38:17.113101+0000","last_clean":"2024-09-12T18:38:17.113101+0000","last_became_active":"2024-09-12T18:35:20.448553+0000","last_became_peered":"2024-09-12T18:35:20.448553+0000","last_unstale":"2024-09-12T18:38:17.113101+0000","last_undegraded":"2024-09-12T18:38:17.113101+0000","last_fullsized":"2024-09-12T18:38:17.113101+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:17.112919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:17.112919+0000","last_clean_scrub_stamp":"2024-09-12T18:38:17.112919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:08.129973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001030836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:16.841417+0000","last_change":"2024-09-12T18:38:16.841417+0000","last_active":"2024-09-12T18:38:16.841417+0000","last_peered":"2024-09-12T18:38:16.841417+0000","last_clean":"2024-09-12T18:38:16.841417+0000","last_became_active":"2024-09-12T18:35:24.649940+0000","last_became_peered":"2024-09-12T18:35:24.649940+0000","last_unstale":"2024-09-12T18:38:16.841417+0000","last_undegraded":"2024-09-12T18:38:16.841417+0000","last_fullsized":"2024-09-12T18:38:16.841417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:16.841237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:16.841237+0000","last_clean_scrub_stamp":"2024-09-12T18:38:16.841237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:34.563251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":178,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:26.503786+0000","last_change":"2024-09-12T18:38:26.503786+0000","last_active":"2024-09-12T18:38:26.503786+0000","last_peered":"2024-09-12T18:38:26.503786+0000","last_clean":"2024-09-12T18:38:26.503786+0000","last_became_active":"2024-09-12T18:38:03.357664+0000","last_became_peered":"2024-09-12T18:38:03.357664+0000","last_unstale":"2024-09-12T18:38:26.503786+0000","last_undegraded":"2024-09-12T18:38:26.503786+0000","last_fullsized":"2024-09-12T18:38:26.503786+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:26.503603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:26.503603+0000","last_clean_scrub_stamp":"2024-09-12T18:38:26.503603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:02.405409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":181,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:13.814673+0000","last_change":"2024-09-12T18:38:13.814673+0000","last_active":"2024-09-12T18:38:13.814673+0000","last_peered":"2024-09-12T18:38:13.814673+0000","last_clean":"2024-09-12T18:38:13.814673+0000","last_became_active":"2024-09-12T18:35:20.442613+0000","last_became_peered":"2024-09-12T18:35:20.442613+0000","last_unstale":"2024-09-12T18:38:13.814673+0000","last_undegraded":"2024-09-12T18:38:13.814673+0000","last_fullsized":"2024-09-12T18:38:13.814673+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:13.814490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:13.814490+0000","last_clean_scrub_stamp":"2024-09-12T18:38:13.814490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:22.097264+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0014134620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:17.455041+0000","last_change":"2024-09-12T18:38:17.455041+0000","last_active":"2024-09-12T18:38:17.455041+0000","last_peered":"2024-09-12T18:38:17.455041+0000","last_clean":"2024-09-12T18:38:17.455041+0000","last_became_active":"2024-09-12T18:35:24.637334+0000","last_became_peered":"2024-09-12T18:35:24.637334+0000","last_unstale":"2024-09-12T18:38:17.455041+0000","last_undegraded":"2024-09-12T18:38:17.455041+0000","last_fullsized":"2024-09-12T18:38:17.455041+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:17.454840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:17.454840+0000","last_clean_scrub_stamp":"2024-09-12T18:38:17.454840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:10:57.149775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:29.851254+0000","last_change":"2024-09-12T18:38:29.851254+0000","last_active":"2024-09-12T18:38:29.851254+0000","last_peered":"2024-09-12T18:38:29.851254+0000","last_clean":"2024-09-12T18:38:29.851254+0000","last_became_active":"2024-09-12T18:38:03.359452+0000","last_became_peered":"2024-09-12T18:38:03.359452+0000","last_unstale":"2024-09-12T18:38:29.851254+0000","last_undegraded":"2024-09-12T18:38:29.851254+0000","last_fullsized":"2024-09-12T18:38:29.851254+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:29.851075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:29.851075+0000","last_clean_scrub_stamp":"2024-09-12T18:38:29.851075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:30.600668+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"91'3","reported_seq":184,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:16.160693+0000","last_change":"2024-09-12T18:38:16.160693+0000","last_active":"2024-09-12T18:38:16.160693+0000","last_peered":"2024-09-12T18:38:16.160693+0000","last_clean":"2024-09-12T18:38:16.160693+0000","last_became_active":"2024-09-12T18:35:20.446814+0000","last_became_peered":"2024-09-12T18:35:20.446814+0000","last_unstale":"2024-09-12T18:38:16.160693+0000","last_undegraded":"2024-09-12T18:38:16.160693+0000","last_fullsized":"2024-09-12T18:38:16.160693+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-09-12T18:38:16.160518+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-09-12T18:38:16.160518+0000","last_clean_scrub_stamp":"2024-09-12T18:38:16.160518+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:32.488019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010716149999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:20.003168+0000","last_change":"2024-09-12T18:38:20.003168+0000","last_active":"2024-09-12T18:38:20.003168+0000","last_peered":"2024-09-12T18:38:20.003168+0000","last_clean":"2024-09-12T18:38:20.003168+0000","last_became_active":"2024-09-12T18:35:24.657433+0000","last_became_peered":"2024-09-12T18:35:24.657433+0000","last_unstale":"2024-09-12T18:38:20.003168+0000","last_undegraded":"2024-09-12T18:38:20.003168+0000","last_fullsized":"2024-09-12T18:38:20.003168+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:20.003003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:20.003003+0000","last_clean_scrub_stamp":"2024-09-12T18:38:20.003003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:39.434187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:27.870494+0000","last_change":"2024-09-12T18:38:27.870494+0000","last_active":"2024-09-12T18:38:27.870494+0000","last_peered":"2024-09-12T18:38:27.870494+0000","last_clean":"2024-09-12T18:38:27.870494+0000","last_became_active":"2024-09-12T18:38:03.357592+0000","last_became_peered":"2024-09-12T18:38:03.357592+0000","last_unstale":"2024-09-12T18:38:27.870494+0000","last_undegraded":"2024-09-12T18:38:27.870494+0000","last_fullsized":"2024-09-12T18:38:27.870494+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:27.870320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:27.870320+0000","last_clean_scrub_stamp":"2024-09-12T18:38:27.870320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:26.098204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:22.974189+0000","last_change":"2024-09-12T18:38:22.974189+0000","last_active":"2024-09-12T18:38:22.974189+0000","last_peered":"2024-09-12T18:38:22.974189+0000","last_clean":"2024-09-12T18:38:22.974189+0000","last_became_active":"2024-09-12T18:35:24.656741+0000","last_became_peered":"2024-09-12T18:35:24.656741+0000","last_unstale":"2024-09-12T18:38:22.974189+0000","last_undegraded":"2024-09-12T18:38:22.974189+0000","last_fullsized":"2024-09-12T18:38:22.974189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:22.974017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:22.974017+0000","last_clean_scrub_stamp":"2024-09-12T18:38:22.974017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:19.281429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":181,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:14.828194+0000","last_change":"2024-09-12T18:38:14.828194+0000","last_active":"2024-09-12T18:38:14.828194+0000","last_peered":"2024-09-12T18:38:14.828194+0000","last_clean":"2024-09-12T18:38:14.828194+0000","last_became_active":"2024-09-12T18:35:20.442566+0000","last_became_peered":"2024-09-12T18:35:20.442566+0000","last_unstale":"2024-09-12T18:38:14.828194+0000","last_undegraded":"2024-09-12T18:38:14.828194+0000","last_fullsized":"2024-09-12T18:38:14.828194+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:14.828014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:14.828014+0000","last_clean_scrub_stamp":"2024-09-12T18:38:14.828014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:27.349359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001325786,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:29.495129+0000","last_change":"2024-09-12T18:38:29.495129+0000","last_active":"2024-09-12T18:38:29.495129+0000","last_peered":"2024-09-12T18:38:29.495129+0000","last_clean":"2024-09-12T18:38:29.495129+0000","last_became_active":"2024-09-12T18:35:25.648761+0000","last_became_peered":"2024-09-12T18:35:25.648761+0000","last_unstale":"2024-09-12T18:38:29.495129+0000","last_undegraded":"2024-09-12T18:38:29.495129+0000","last_fullsized":"2024-09-12T18:38:29.495129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:29.494932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:29.494932+0000","last_clean_scrub_stamp":"2024-09-12T18:38:29.494932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:21.380263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:15.791611+0000","last_change":"2024-09-12T18:38:15.791611+0000","last_active":"2024-09-12T18:38:15.791611+0000","last_peered":"2024-09-12T18:38:15.791611+0000","last_clean":"2024-09-12T18:38:15.791611+0000","last_became_active":"2024-09-12T18:38:03.356816+0000","last_became_peered":"2024-09-12T18:38:03.356816+0000","last_unstale":"2024-09-12T18:38:15.791611+0000","last_undegraded":"2024-09-12T18:38:15.791611+0000","last_fullsized":"2024-09-12T18:38:15.791611+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:15.791433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:15.791433+0000","last_clean_scrub_stamp":"2024-09-12T18:38:15.791433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:57.710017+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":193,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:14.417715+0000","last_change":"2024-09-12T18:38:14.417715+0000","last_active":"2024-09-12T18:38:14.417715+0000","last_peered":"2024-09-12T18:38:14.417715+0000","last_clean":"2024-09-12T18:38:14.417715+0000","last_became_active":"2024-09-12T18:38:03.350774+0000","last_became_peered":"2024-09-12T18:38:03.350774+0000","last_unstale":"2024-09-12T18:38:14.417715+0000","last_undegraded":"2024-09-12T18:38:14.417715+0000","last_fullsized":"2024-09-12T18:38:14.417715+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:14.417534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:14.417534+0000","last_clean_scrub_stamp":"2024-09-12T18:38:14.417534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:26.780036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00080163599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:25.539698+0000","last_change":"2024-09-12T18:38:25.539698+0000","last_active":"2024-09-12T18:38:25.539698+0000","last_peered":"2024-09-12T18:38:25.539698+0000","last_clean":"2024-09-12T18:38:25.539698+0000","last_became_active":"2024-09-12T18:35:25.649147+0000","last_became_peered":"2024-09-12T18:35:25.649147+0000","last_unstale":"2024-09-12T18:38:25.539698+0000","last_undegraded":"2024-09-12T18:38:25.539698+0000","last_fullsized":"2024-09-12T18:38:25.539698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:25.539439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:25.539439+0000","last_clean_scrub_stamp":"2024-09-12T18:38:25.539439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:30.348562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"91'3","reported_seq":171,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:19.814525+0000","last_change":"2024-09-12T18:38:19.814525+0000","last_active":"2024-09-12T18:38:19.814525+0000","last_peered":"2024-09-12T18:38:19.814525+0000","last_clean":"2024-09-12T18:38:19.814525+0000","last_became_active":"2024-09-12T18:35:24.655950+0000","last_became_peered":"2024-09-12T18:35:24.655950+0000","last_unstale":"2024-09-12T18:38:19.814525+0000","last_undegraded":"2024-09-12T18:38:19.814525+0000","last_fullsized":"2024-09-12T18:38:19.814525+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-09-12T18:38:19.814345+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-09-12T18:38:19.814345+0000","last_clean_scrub_stamp":"2024-09-12T18:38:19.814345+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:23.553058+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":58,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:19.050364+0000","last_change":"2024-09-12T18:38:19.050364+0000","last_active":"2024-09-12T18:38:19.050364+0000","last_peered":"2024-09-12T18:38:19.050364+0000","last_clean":"2024-09-12T18:38:19.050364+0000","last_became_active":"2024-09-12T18:37:34.254999+0000","last_became_peered":"2024-09-12T18:37:34.254999+0000","last_unstale":"2024-09-12T18:38:19.050364+0000","last_undegraded":"2024-09-12T18:38:19.050364+0000","last_fullsized":"2024-09-12T18:38:19.050364+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:19.050173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:19.050173+0000","last_clean_scrub_stamp":"2024-09-12T18:38:19.050173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:25.174685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:26.894907+0000","last_change":"2024-09-12T18:38:26.894907+0000","last_active":"2024-09-12T18:38:26.894907+0000","last_peered":"2024-09-12T18:38:26.894907+0000","last_clean":"2024-09-12T18:38:26.894907+0000","last_became_active":"2024-09-12T18:38:03.354895+0000","last_became_peered":"2024-09-12T18:38:03.354895+0000","last_unstale":"2024-09-12T18:38:26.894907+0000","last_undegraded":"2024-09-12T18:38:26.894907+0000","last_fullsized":"2024-09-12T18:38:26.894907+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:26.894733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:26.894733+0000","last_clean_scrub_stamp":"2024-09-12T18:38:26.894733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:57.496991+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"91'2","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:17.883222+0000","last_change":"2024-09-12T18:38:17.883222+0000","last_active":"2024-09-12T18:38:17.883222+0000","last_peered":"2024-09-12T18:38:17.883222+0000","last_clean":"2024-09-12T18:38:17.883222+0000","last_became_active":"2024-09-12T18:38:03.354684+0000","last_became_peered":"2024-09-12T18:38:03.354684+0000","last_unstale":"2024-09-12T18:38:17.883222+0000","last_undegraded":"2024-09-12T18:38:17.883222+0000","last_fullsized":"2024-09-12T18:38:17.883222+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2024-09-12T18:38:17.883042+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2024-09-12T18:38:17.883042+0000","last_clean_scrub_stamp":"2024-09-12T18:38:17.883042+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:47.656032+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":181,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:18.067264+0000","last_change":"2024-09-12T18:38:18.067264+0000","last_active":"2024-09-12T18:38:18.067264+0000","last_peered":"2024-09-12T18:38:18.067264+0000","last_clean":"2024-09-12T18:38:18.067264+0000","last_became_active":"2024-09-12T18:35:20.448521+0000","last_became_peered":"2024-09-12T18:35:20.448521+0000","last_unstale":"2024-09-12T18:38:18.067264+0000","last_undegraded":"2024-09-12T18:38:18.067264+0000","last_fullsized":"2024-09-12T18:38:18.067264+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:18.067093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:18.067093+0000","last_clean_scrub_stamp":"2024-09-12T18:38:18.067093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:26.127179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017009670000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:24.572135+0000","last_change":"2024-09-12T18:38:24.572135+0000","last_active":"2024-09-12T18:38:24.572135+0000","last_peered":"2024-09-12T18:38:24.572135+0000","last_clean":"2024-09-12T18:38:24.572135+0000","last_became_active":"2024-09-12T18:35:25.647347+0000","last_became_peered":"2024-09-12T18:35:25.647347+0000","last_unstale":"2024-09-12T18:38:24.572135+0000","last_undegraded":"2024-09-12T18:38:24.572135+0000","last_fullsized":"2024-09-12T18:38:24.572135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:24.571959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:24.571959+0000","last_clean_scrub_stamp":"2024-09-12T18:38:24.571959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:36.759025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:36.969905+0000","last_change":"2024-09-12T18:38:36.969905+0000","last_active":"2024-09-12T18:38:36.969905+0000","last_peered":"2024-09-12T18:38:36.969905+0000","last_clean":"2024-09-12T18:38:36.969905+0000","last_became_active":"2024-09-12T18:35:25.659827+0000","last_became_peered":"2024-09-12T18:35:25.659827+0000","last_unstale":"2024-09-12T18:38:36.969905+0000","last_undegraded":"2024-09-12T18:38:36.969905+0000","last_fullsized":"2024-09-12T18:38:36.969905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:36.969736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:36.969736+0000","last_clean_scrub_stamp":"2024-09-12T18:38:36.969736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:27.697680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"91'10","reported_seq":178,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:28.960772+0000","last_change":"2024-09-12T18:38:28.960772+0000","last_active":"2024-09-12T18:38:28.960772+0000","last_peered":"2024-09-12T18:38:28.960772+0000","last_clean":"2024-09-12T18:38:28.960772+0000","last_became_active":"2024-09-12T18:35:24.654282+0000","last_became_peered":"2024-09-12T18:35:24.654282+0000","last_unstale":"2024-09-12T18:38:28.960772+0000","last_undegraded":"2024-09-12T18:38:28.960772+0000","last_fullsized":"2024-09-12T18:38:28.960772+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'10","last_scrub_stamp":"2024-09-12T18:38:28.960583+0000","last_deep_scrub":"91'10","last_deep_scrub_stamp":"2024-09-12T18:38:28.960583+0000","last_clean_scrub_stamp":"2024-09-12T18:38:28.960583+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:32.457138+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:34.850831+0000","last_change":"2024-09-12T18:38:34.850831+0000","last_active":"2024-09-12T18:38:34.850831+0000","last_peered":"2024-09-12T18:38:34.850831+0000","last_clean":"2024-09-12T18:38:34.850831+0000","last_became_active":"2024-09-12T18:38:03.354064+0000","last_became_peered":"2024-09-12T18:38:03.354064+0000","last_unstale":"2024-09-12T18:38:34.850831+0000","last_undegraded":"2024-09-12T18:38:34.850831+0000","last_fullsized":"2024-09-12T18:38:34.850831+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:34.850644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:34.850644+0000","last_clean_scrub_stamp":"2024-09-12T18:38:34.850644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:20.545246+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"91'5","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:19.460433+0000","last_change":"2024-09-12T18:38:19.460433+0000","last_active":"2024-09-12T18:38:19.460433+0000","last_peered":"2024-09-12T18:38:19.460433+0000","last_clean":"2024-09-12T18:38:19.460433+0000","last_became_active":"2024-09-12T18:35:24.647826+0000","last_became_peered":"2024-09-12T18:35:24.647826+0000","last_unstale":"2024-09-12T18:38:19.460433+0000","last_undegraded":"2024-09-12T18:38:19.460433+0000","last_fullsized":"2024-09-12T18:38:19.460433+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'5","last_scrub_stamp":"2024-09-12T18:38:19.460194+0000","last_deep_scrub":"91'5","last_deep_scrub_stamp":"2024-09-12T18:38:19.460194+0000","last_clean_scrub_stamp":"2024-09-12T18:38:19.460194+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:21.339924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":180,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:29.943578+0000","last_change":"2024-09-12T18:38:29.943578+0000","last_active":"2024-09-12T18:38:29.943578+0000","last_peered":"2024-09-12T18:38:29.943578+0000","last_clean":"2024-09-12T18:38:29.943578+0000","last_became_active":"2024-09-12T18:38:03.364887+0000","last_became_peered":"2024-09-12T18:38:03.364887+0000","last_unstale":"2024-09-12T18:38:29.943578+0000","last_undegraded":"2024-09-12T18:38:29.943578+0000","last_fullsized":"2024-09-12T18:38:29.943578+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:29.943403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:29.943403+0000","last_clean_scrub_stamp":"2024-09-12T18:38:29.943403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:33.290355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:33.844415+0000","last_change":"2024-09-12T18:38:33.844415+0000","last_active":"2024-09-12T18:38:33.844415+0000","last_peered":"2024-09-12T18:38:33.844415+0000","last_clean":"2024-09-12T18:38:33.844415+0000","last_became_active":"2024-09-12T18:35:25.658476+0000","last_became_peered":"2024-09-12T18:35:25.658476+0000","last_unstale":"2024-09-12T18:38:33.844415+0000","last_undegraded":"2024-09-12T18:38:33.844415+0000","last_fullsized":"2024-09-12T18:38:33.844415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:33.844242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:33.844242+0000","last_clean_scrub_stamp":"2024-09-12T18:38:33.844242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:38.885402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:23.852782+0000","last_change":"2024-09-12T18:38:23.852782+0000","last_active":"2024-09-12T18:38:23.852782+0000","last_peered":"2024-09-12T18:38:23.852782+0000","last_clean":"2024-09-12T18:38:23.852782+0000","last_became_active":"2024-09-12T18:35:24.651416+0000","last_became_peered":"2024-09-12T18:35:24.651416+0000","last_unstale":"2024-09-12T18:38:23.852782+0000","last_undegraded":"2024-09-12T18:38:23.852782+0000","last_fullsized":"2024-09-12T18:38:23.852782+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:23.852597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:23.852597+0000","last_clean_scrub_stamp":"2024-09-12T18:38:23.852597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:23.496269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:32.893291+0000","last_change":"2024-09-12T18:38:32.893291+0000","last_active":"2024-09-12T18:38:32.893291+0000","last_peered":"2024-09-12T18:38:32.893291+0000","last_clean":"2024-09-12T18:38:32.893291+0000","last_became_active":"2024-09-12T18:38:03.357598+0000","last_became_peered":"2024-09-12T18:38:03.357598+0000","last_unstale":"2024-09-12T18:38:32.893291+0000","last_undegraded":"2024-09-12T18:38:32.893291+0000","last_fullsized":"2024-09-12T18:38:32.893291+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:32.893114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:32.893114+0000","last_clean_scrub_stamp":"2024-09-12T18:38:32.893114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:50.683402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:35.402221+0000","last_change":"2024-09-12T18:38:35.402221+0000","last_active":"2024-09-12T18:38:35.402221+0000","last_peered":"2024-09-12T18:38:35.402221+0000","last_clean":"2024-09-12T18:38:35.402221+0000","last_became_active":"2024-09-12T18:35:25.649544+0000","last_became_peered":"2024-09-12T18:35:25.649544+0000","last_unstale":"2024-09-12T18:38:35.402221+0000","last_undegraded":"2024-09-12T18:38:35.402221+0000","last_fullsized":"2024-09-12T18:38:35.402221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:35.402050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:35.402050+0000","last_clean_scrub_stamp":"2024-09-12T18:38:35.402050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:11.214401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:20.856468+0000","last_change":"2024-09-12T18:38:20.856468+0000","last_active":"2024-09-12T18:38:20.856468+0000","last_peered":"2024-09-12T18:38:20.856468+0000","last_clean":"2024-09-12T18:38:20.856468+0000","last_became_active":"2024-09-12T18:38:03.347483+0000","last_became_peered":"2024-09-12T18:38:03.347483+0000","last_unstale":"2024-09-12T18:38:20.856468+0000","last_undegraded":"2024-09-12T18:38:20.856468+0000","last_fullsized":"2024-09-12T18:38:20.856468+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:20.856292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:20.856292+0000","last_clean_scrub_stamp":"2024-09-12T18:38:20.856292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:36.586909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:36.831764+0000","last_change":"2024-09-12T18:38:36.831764+0000","last_active":"2024-09-12T18:38:36.831764+0000","last_peered":"2024-09-12T18:38:36.831764+0000","last_clean":"2024-09-12T18:38:36.831764+0000","last_became_active":"2024-09-12T18:35:25.656985+0000","last_became_peered":"2024-09-12T18:35:25.656985+0000","last_unstale":"2024-09-12T18:38:36.831764+0000","last_undegraded":"2024-09-12T18:38:36.831764+0000","last_fullsized":"2024-09-12T18:38:36.831764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:36.831586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:36.831586+0000","last_clean_scrub_stamp":"2024-09-12T18:38:36.831586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:27.848640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:24.880473+0000","last_change":"2024-09-12T18:38:24.880473+0000","last_active":"2024-09-12T18:38:24.880473+0000","last_peered":"2024-09-12T18:38:24.880473+0000","last_clean":"2024-09-12T18:38:24.880473+0000","last_became_active":"2024-09-12T18:38:03.351740+0000","last_became_peered":"2024-09-12T18:38:03.351740+0000","last_unstale":"2024-09-12T18:38:24.880473+0000","last_undegraded":"2024-09-12T18:38:24.880473+0000","last_fullsized":"2024-09-12T18:38:24.880473+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:24.880293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:24.880293+0000","last_clean_scrub_stamp":"2024-09-12T18:38:24.880293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:05.086041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:34.364865+0000","last_change":"2024-09-12T18:38:34.364865+0000","last_active":"2024-09-12T18:38:34.364865+0000","last_peered":"2024-09-12T18:38:34.364865+0000","last_clean":"2024-09-12T18:38:34.364865+0000","last_became_active":"2024-09-12T18:35:25.654473+0000","last_became_peered":"2024-09-12T18:35:25.654473+0000","last_unstale":"2024-09-12T18:38:34.364865+0000","last_undegraded":"2024-09-12T18:38:34.364865+0000","last_fullsized":"2024-09-12T18:38:34.364865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:34.364683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:34.364683+0000","last_clean_scrub_stamp":"2024-09-12T18:38:34.364683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:31.188319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":169,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:21.506119+0000","last_change":"2024-09-12T18:38:21.506119+0000","last_active":"2024-09-12T18:38:21.506119+0000","last_peered":"2024-09-12T18:38:21.506119+0000","last_clean":"2024-09-12T18:38:21.506119+0000","last_became_active":"2024-09-12T18:35:24.659111+0000","last_became_peered":"2024-09-12T18:35:24.659111+0000","last_unstale":"2024-09-12T18:38:21.506119+0000","last_undegraded":"2024-09-12T18:38:21.506119+0000","last_fullsized":"2024-09-12T18:38:21.506119+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-09-12T18:38:21.505936+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-09-12T18:38:21.505936+0000","last_clean_scrub_stamp":"2024-09-12T18:38:21.505936+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:03.774289+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":178,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:32.406644+0000","last_change":"2024-09-12T18:38:32.406644+0000","last_active":"2024-09-12T18:38:32.406644+0000","last_peered":"2024-09-12T18:38:32.406644+0000","last_clean":"2024-09-12T18:38:32.406644+0000","last_became_active":"2024-09-12T18:38:03.350972+0000","last_became_peered":"2024-09-12T18:38:03.350972+0000","last_unstale":"2024-09-12T18:38:32.406644+0000","last_undegraded":"2024-09-12T18:38:32.406644+0000","last_fullsized":"2024-09-12T18:38:32.406644+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:32.406439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:32.406439+0000","last_clean_scrub_stamp":"2024-09-12T18:38:32.406439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:38.640933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":169,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:22.518989+0000","last_change":"2024-09-12T18:38:22.518989+0000","last_active":"2024-09-12T18:38:22.518989+0000","last_peered":"2024-09-12T18:38:22.518989+0000","last_clean":"2024-09-12T18:38:22.518989+0000","last_became_active":"2024-09-12T18:35:24.637242+0000","last_became_peered":"2024-09-12T18:35:24.637242+0000","last_unstale":"2024-09-12T18:38:22.518989+0000","last_undegraded":"2024-09-12T18:38:22.518989+0000","last_fullsized":"2024-09-12T18:38:22.518989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-09-12T18:38:22.518797+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-09-12T18:38:22.518797+0000","last_clean_scrub_stamp":"2024-09-12T18:38:22.518797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:24.831152+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:39.038045+0000","last_change":"2024-09-12T18:38:39.038045+0000","last_active":"2024-09-12T18:38:39.038045+0000","last_peered":"2024-09-12T18:38:39.038045+0000","last_clean":"2024-09-12T18:38:39.038045+0000","last_became_active":"2024-09-12T18:35:25.661441+0000","last_became_peered":"2024-09-12T18:35:25.661441+0000","last_unstale":"2024-09-12T18:38:39.038045+0000","last_undegraded":"2024-09-12T18:38:39.038045+0000","last_fullsized":"2024-09-12T18:38:39.038045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:39.037870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:39.037870+0000","last_clean_scrub_stamp":"2024-09-12T18:38:39.037870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:45.661314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"91'3","reported_seq":191,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:30.989911+0000","last_change":"2024-09-12T18:38:30.989911+0000","last_active":"2024-09-12T18:38:30.989911+0000","last_peered":"2024-09-12T18:38:30.989911+0000","last_clean":"2024-09-12T18:38:30.989911+0000","last_became_active":"2024-09-12T18:38:03.355520+0000","last_became_peered":"2024-09-12T18:38:03.355520+0000","last_unstale":"2024-09-12T18:38:30.989911+0000","last_undegraded":"2024-09-12T18:38:30.989911+0000","last_fullsized":"2024-09-12T18:38:30.989911+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-09-12T18:38:30.989726+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-09-12T18:38:30.989726+0000","last_clean_scrub_stamp":"2024-09-12T18:38:30.989726+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:42.396744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:40.053468+0000","last_change":"2024-09-12T18:38:40.053468+0000","last_active":"2024-09-12T18:38:40.053468+0000","last_peered":"2024-09-12T18:38:40.053468+0000","last_clean":"2024-09-12T18:38:40.053468+0000","last_became_active":"2024-09-12T18:35:25.649728+0000","last_became_peered":"2024-09-12T18:35:25.649728+0000","last_unstale":"2024-09-12T18:38:40.053468+0000","last_undegraded":"2024-09-12T18:38:40.053468+0000","last_fullsized":"2024-09-12T18:38:40.053468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:40.053298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:40.053298+0000","last_clean_scrub_stamp":"2024-09-12T18:38:40.053298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:50.463685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"91'3","reported_seq":171,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:23.555593+0000","last_change":"2024-09-12T18:38:23.555593+0000","last_active":"2024-09-12T18:38:23.555593+0000","last_peered":"2024-09-12T18:38:23.555593+0000","last_clean":"2024-09-12T18:38:23.555593+0000","last_became_active":"2024-09-12T18:35:24.648512+0000","last_became_peered":"2024-09-12T18:35:24.648512+0000","last_unstale":"2024-09-12T18:38:23.555593+0000","last_undegraded":"2024-09-12T18:38:23.555593+0000","last_fullsized":"2024-09-12T18:38:23.555593+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-09-12T18:38:23.555349+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-09-12T18:38:23.555349+0000","last_clean_scrub_stamp":"2024-09-12T18:38:23.555349+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:20.367735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:33.403555+0000","last_change":"2024-09-12T18:38:33.403555+0000","last_active":"2024-09-12T18:38:33.403555+0000","last_peered":"2024-09-12T18:38:33.403555+0000","last_clean":"2024-09-12T18:38:33.403555+0000","last_became_active":"2024-09-12T18:35:25.654980+0000","last_became_peered":"2024-09-12T18:35:25.654980+0000","last_unstale":"2024-09-12T18:38:33.403555+0000","last_undegraded":"2024-09-12T18:38:33.403555+0000","last_fullsized":"2024-09-12T18:38:33.403555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:33.403375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:33.403375+0000","last_clean_scrub_stamp":"2024-09-12T18:38:33.403375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:51.344863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":169,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:25.861274+0000","last_change":"2024-09-12T18:38:25.861274+0000","last_active":"2024-09-12T18:38:25.861274+0000","last_peered":"2024-09-12T18:38:25.861274+0000","last_clean":"2024-09-12T18:38:25.861274+0000","last_became_active":"2024-09-12T18:35:24.655420+0000","last_became_peered":"2024-09-12T18:35:24.655420+0000","last_unstale":"2024-09-12T18:38:25.861274+0000","last_undegraded":"2024-09-12T18:38:25.861274+0000","last_fullsized":"2024-09-12T18:38:25.861274+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-09-12T18:38:25.861095+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-09-12T18:38:25.861095+0000","last_clean_scrub_stamp":"2024-09-12T18:38:25.861095+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:47.957392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":178,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:37.988321+0000","last_change":"2024-09-12T18:38:37.988321+0000","last_active":"2024-09-12T18:38:37.988321+0000","last_peered":"2024-09-12T18:38:37.988321+0000","last_clean":"2024-09-12T18:38:37.988321+0000","last_became_active":"2024-09-12T18:38:03.355072+0000","last_became_peered":"2024-09-12T18:38:03.355072+0000","last_unstale":"2024-09-12T18:38:37.988321+0000","last_undegraded":"2024-09-12T18:38:37.988321+0000","last_fullsized":"2024-09-12T18:38:37.988321+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:38:37.988148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:38:37.988148+0000","last_clean_scrub_stamp":"2024-09-12T18:38:37.988148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:38.890619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T18:38:28.864448+0000","last_change":"2024-09-12T18:38:28.864448+0000","last_active":"2024-09-12T18:38:28.864448+0000","last_peered":"2024-09-12T18:38:28.864448+0000","last_clean":"2024-09-12T18:38:28.864448+0000","last_became_active":"2024-09-12T18:38:03.353780+0000","last_became_peered":"2024-09-12T18:38:03.353780+0000","last_unstale":"2024-09-12T18:38:28.864448+0000","last_undegraded":"2024-09-12T18:38:28.864448+0000","last_fullsized":"2024-09-12T18:38:28.864448+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'6","last_scrub_stamp":"2024-09-12T18:38:28.864265+0000","last_deep_scrub":"91'6","last_deep_scrub_stamp":"2024-09-12T18:38:28.864265+0000","last_clean_scrub_stamp":"2024-09-12T18:38:28.864265+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:11.764660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69444,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705716,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280768,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94091072,"statfs":{"total":96636764160,"available":96349257728,"internally_reserved":0,"allocated":1097728,"data_stored":982590,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":286390726},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738420,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284940,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":94086900,"statfs":{"total":96636764160,"available":96344985600,"internally_reserved":0,"allocated":1110016,"data_stored":983225,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":290650565},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738420,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302900,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":301886,"kb_avail":94068940,"statfs":{"total":96636764160,"available":96326594560,"internally_reserved":0,"allocated":1019904,"data_stored":391063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":309131718},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34722,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:39:16.138 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T18:39:16.501 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T18:39:16.502 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T18:39:16.841 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:39:16.841 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"btime":"2024-09-12T18:35:27:637181+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T18:35:25.000900+0000","modified":"2024-09-12T18:35:26.979639+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4211":{"gid":4211,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.73:6803/322019923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":322019923},{"type":"v1","addr":"172.21.15.73:6803","nonce":322019923}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4211,"qdb_cluster":[4211]},"id":1}]} 2024-09-12T18:39:16.841 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 5 2024-09-12T18:39:16.861 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T18:39:17.170 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:39:17.170 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"btime":"2024-09-12T18:35:27:637181+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T18:35:25.000900+0000","modified":"2024-09-12T18:35:26.979639+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4211":{"gid":4211,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.73:6803/322019923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":322019923},{"type":"v1","addr":"172.21.15.73:6803","nonce":322019923}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4211,"qdb_cluster":[4211]},"id":1}]} 2024-09-12T18:39:17.170 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 5 2024-09-12T18:39:17.187 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T18:39:17.462 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T18:39:17.462 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":91,"fsid":"c08d5a84-711b-44bf-bdf1-e06ecc2c7c00","created":"2024-09-12T18:35:02.695853+0000","modified":"2024-09-12T18:38:07.360408+0000","last_up_change":"2024-09-12T18:35:12.464628+0000","last_in_change":"2024-09-12T18:35:04.352525+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T18:35:12.418430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T18:35:18.665309+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T18:35:23.447845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T18:35:23.959973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f1cf24e8-6179-4666-a444-fa81ef0d7482","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6801","nonce":2710632206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6803","nonce":2710632206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6807","nonce":2710632206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2710632206},{"type":"v1","addr":"172.21.15.114:6805","nonce":2710632206}]},"public_addr":"172.21.15.114:6801/2710632206","cluster_addr":"172.21.15.114:6803/2710632206","heartbeat_back_addr":"172.21.15.114:6807/2710632206","heartbeat_front_addr":"172.21.15.114:6805/2710632206","state":["exists","up"]},{"osd":1,"uuid":"3fdb0044-2820-4411-978b-4b6e94fbf0b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6801","nonce":862189968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6803","nonce":862189968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6807","nonce":862189968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":862189968},{"type":"v1","addr":"172.21.15.143:6805","nonce":862189968}]},"public_addr":"172.21.15.143:6801/862189968","cluster_addr":"172.21.15.143:6803/862189968","heartbeat_back_addr":"172.21.15.143:6807/862189968","heartbeat_front_addr":"172.21.15.143:6805/862189968","state":["exists","up"]},{"osd":2,"uuid":"6fb554da-561f-4aa2-b855-0e3adb98b057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6801","nonce":1397104153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6803","nonce":1397104153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6807","nonce":1397104153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1397104153},{"type":"v1","addr":"172.21.15.162:6805","nonce":1397104153}]},"public_addr":"172.21.15.162:6801/1397104153","cluster_addr":"172.21.15.162:6803/1397104153","heartbeat_back_addr":"172.21.15.162:6807/1397104153","heartbeat_front_addr":"172.21.15.162:6805/1397104153","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:35:10.239320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:35:10.861760+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:35:10.355997+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"2.6","osds":[2,0]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:39:17.481 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T18:39:17.798 INFO:teuthology.orchestra.run.smithi073.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T18:39:17.800 INFO:tasks.ceph.mds.a.smithi073.stderr: -1563> 2024-09-12T18:35:27.598+0000 7f8b55ae6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T18:39:17.817 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T18:39:17.830 INFO:tasks.ceph.mds.a.smithi073.stdout:starting mds.a at 2024-09-12T18:39:18.824 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T18:39:19.805 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' removed 2024-09-12T18:39:19.830 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T18:39:20.821 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' removed 2024-09-12T18:39:20.843 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T18:39:20.843 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T18:39:20.843 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:39:20.854 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T18:39:20.854 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T18:39:20.854 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T18:39:20.854 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:39:26.300 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-12T18:39:26.956 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T18:39:26.956 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T18:39:26.957 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:39:27.043 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T18:39:27.044 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T18:39:27.044 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:39:27.143 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T18:39:27.143 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T18:39:27.143 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T18:39:27.143 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:39:27.174 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T18:39:27.174 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T18:39:27.174 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:39:27.243 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T18:39:27.243 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T18:39:27.243 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T18:39:27.243 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:39:27.304 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T18:39:27.305 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T18:39:27.305 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:39:27.371 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T18:39:27.371 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T18:39:27.371 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:39:27.434 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T18:39:27.434 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T18:39:27.434 DEBUG:teuthology.orchestra.run.smithi073:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v SLOW_OPS | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-09-12T18:39:27.494 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi114.front.sepia.ceph.com 2024-09-12T18:39:27.494 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T18:39:27.716 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi143.front.sepia.ceph.com 2024-09-12T18:39:27.716 DEBUG:teuthology.orchestra.run.smithi143:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T18:39:27.966 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi162.front.sepia.ceph.com 2024-09-12T18:39:27.966 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T18:39:28.184 INFO:tasks.ceph:Archiving mon data... 2024-09-12T18:39:28.185 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901181/data/mon.a.tgz 2024-09-12T18:39:28.185 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-09-12T18:39:28.192 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.JakAwnvBn7 2024-09-12T18:39:28.193 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.JakAwnvBn7 2024-09-12T18:39:28.324 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.JakAwnvBn7 2024-09-12T18:39:28.388 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.JakAwnvBn7 is 377KB 2024-09-12T18:39:28.449 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.JakAwnvBn7 2024-09-12T18:39:28.455 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901181/data/mon.b.tgz 2024-09-12T18:39:28.455 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-09-12T18:39:28.503 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.GU6iA16ymC 2024-09-12T18:39:28.504 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.GU6iA16ymC 2024-09-12T18:39:28.667 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.GU6iA16ymC 2024-09-12T18:39:28.731 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.GU6iA16ymC is 531KB 2024-09-12T18:39:28.794 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.GU6iA16ymC 2024-09-12T18:39:28.799 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901181/data/mon.c.tgz 2024-09-12T18:39:28.799 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-09-12T18:39:28.847 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.1up8F3d4bx 2024-09-12T18:39:28.848 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.1up8F3d4bx 2024-09-12T18:39:29.019 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.1up8F3d4bx 2024-09-12T18:39:29.084 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.1up8F3d4bx is 531KB 2024-09-12T18:39:29.146 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.1up8F3d4bx 2024-09-12T18:39:29.151 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T18:39:29.152 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T18:39:29.197 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T18:39:29.199 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T18:39:29.202 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T18:39:29.256 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T18:39:29.261 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T18:39:29.266 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T18:39:29.272 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T18:39:29.272 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T18:39:29.273 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/crash to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901181/remote/smithi073/crash 2024-09-12T18:39:29.274 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T18:39:29.311 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/lib/ceph/crash to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901181/remote/smithi114/crash 2024-09-12T18:39:29.312 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T18:39:29.325 DEBUG:teuthology.misc:Transferring archived files from smithi143:/var/lib/ceph/crash to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901181/remote/smithi143/crash 2024-09-12T18:39:29.326 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T18:39:29.339 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/crash to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901181/remote/smithi162/crash 2024-09-12T18:39:29.340 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T18:39:29.354 INFO:tasks.ceph:Compressing logs... 2024-09-12T18:39:29.354 DEBUG:teuthology.orchestra.run.smithi073:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T18:39:29.357 DEBUG:teuthology.orchestra.run.smithi114:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T18:39:29.377 DEBUG:teuthology.orchestra.run.smithi143:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T18:39:29.387 DEBUG:teuthology.orchestra.run.smithi162:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T18:39:29.388 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23797.log 2024-09-12T18:39:29.388 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25829.log 2024-09-12T18:39:29.392 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.23797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25501.log 2024-09-12T18:39:29.392 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23797.log.gz 2024-09-12T18:39:29.392 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23066.log 2024-09-12T18:39:29.392 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.25829.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25829.log.gz 2024-09-12T18:39:29.392 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.25501.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25501.log.gz 2024-09-12T18:39:29.392 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T18:39:29.392 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22157.log 2024-09-12T18:39:29.392 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.23066.log: /var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26813.log 2024-09-12T18:39:29.392 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23066.log.gz 2024-09-12T18:39:29.392 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.22157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27600.log 2024-09-12T18:39:29.392 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22157.log.gz 2024-09-12T18:39:29.392 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.26813.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.26813.log.gz 2024-09-12T18:39:29.393 INFO:teuthology.orchestra.run.smithi073.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.28686.log 2024-09-12T18:39:29.402 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28790.log 2024-09-12T18:39:29.402 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.27600.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27600.log.gz 2024-09-12T18:39:29.402 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22134.log 2024-09-12T18:39:29.402 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28686.log.gz 2024-09-12T18:39:29.402 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28790.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.28790.log.gz 2024-09-12T18:39:29.402 INFO:teuthology.orchestra.run.smithi073.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.22728.log 2024-09-12T18:39:29.402 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.22134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28088.log 2024-09-12T18:39:29.402 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22134.log.gz 2024-09-12T18:39:29.402 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.22728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26513.log 2024-09-12T18:39:29.402 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22728.log.gz 2024-09-12T18:39:29.403 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27259.log 2024-09-12T18:39:29.403 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28088.log.gz 2024-09-12T18:39:29.403 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.26513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22993.log 2024-09-12T18:39:29.403 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26513.log.gz 2024-09-12T18:39:29.403 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.27259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27709.log 2024-09-12T18:39:29.403 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27259.log.gz 2024-09-12T18:39:29.403 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.22993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26399.log 2024-09-12T18:39:29.403 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22993.log.gz 2024-09-12T18:39:29.403 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.27709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28971.log 2024-09-12T18:39:29.403 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27709.log.gz 2024-09-12T18:39:29.403 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.26399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25694.log 2024-09-12T18:39:29.403 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26399.log.gz 2024-09-12T18:39:29.403 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27652.log 2024-09-12T18:39:29.404 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28971.log.gz 2024-09-12T18:39:29.404 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.25694.log: 93.3% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T18:39:29.404 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27430.log 2024-09-12T18:39:29.404 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25694.log.gz 2024-09-12T18:39:29.404 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.27652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23942.log 2024-09-12T18:39:29.404 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27652.log.gz 2024-09-12T18:39:29.404 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.27430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25969.log 2024-09-12T18:39:29.404 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27430.log.gz 2024-09-12T18:39:29.404 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.23942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28140.log 2024-09-12T18:39:29.404 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23942.log.gz 2024-09-12T18:39:29.404 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.25969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23885.log 2024-09-12T18:39:29.404 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25969.log.gz 2024-09-12T18:39:29.405 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24279.log 2024-09-12T18:39:29.405 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28140.log.gz 2024-09-12T18:39:29.405 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.23885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24082.log 2024-09-12T18:39:29.405 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23885.log.gz 2024-09-12T18:39:29.405 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.24279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22676.log 2024-09-12T18:39:29.405 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24279.log.gz 2024-09-12T18:39:29.405 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.24082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24605.log 2024-09-12T18:39:29.405 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24082.log.gz 2024-09-12T18:39:29.405 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.22676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27792.log 2024-09-12T18:39:29.405 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22676.log.gz 2024-09-12T18:39:29.405 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.24605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26026.log 2024-09-12T18:39:29.405 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24605.log.gz 2024-09-12T18:39:29.405 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.27792.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27792.log.gz 2024-09-12T18:39:29.405 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27676.log 2024-09-12T18:39:29.406 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.26026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22477.log 2024-09-12T18:39:29.406 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26026.log.gz 2024-09-12T18:39:29.406 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.27676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28660.log 2024-09-12T18:39:29.406 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27676.log.gz 2024-09-12T18:39:29.406 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.22477.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22477.log.gz 2024-09-12T18:39:29.406 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25580.log 2024-09-12T18:39:29.406 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24331.log 2024-09-12T18:39:29.406 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28660.log.gz 2024-09-12T18:39:29.414 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T18:39:29.429 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22966.log 2024-09-12T18:39:29.429 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22990.log 2024-09-12T18:39:29.430 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.22966.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22966.log.gz 2024-09-12T18:39:29.430 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T18:39:29.430 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.22990.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22990.log.gz 2024-09-12T18:39:29.430 INFO:teuthology.orchestra.run.smithi162.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.22942.log 2024-09-12T18:39:29.430 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.22942.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22942.log.gz 2024-09-12T18:39:29.449 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.25580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22994.log 2024-09-12T18:39:29.449 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25580.log.gz 2024-09-12T18:39:29.449 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.24331.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24331.log.gz 2024-09-12T18:39:29.449 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24357.log 2024-09-12T18:39:29.449 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.22994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27404.log 2024-09-12T18:39:29.449 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22994.log.gz 2024-09-12T18:39:29.449 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23968.log 2024-09-12T18:39:29.450 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.24357.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24357.log.gz 2024-09-12T18:39:29.450 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.27404.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27404.log.gz 2024-09-12T18:39:29.450 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27060.log 2024-09-12T18:39:29.450 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.23968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23909.log 2024-09-12T18:39:29.450 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23968.log.gz 2024-09-12T18:39:29.450 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29023.log 2024-09-12T18:39:29.450 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.27060.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27060.log.gz 2024-09-12T18:39:29.450 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.23909.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23909.log.gz 2024-09-12T18:39:29.450 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25087.log 2024-09-12T18:39:29.450 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.29023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28459.log 2024-09-12T18:39:29.450 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29023.log.gz 2024-09-12T18:39:29.450 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28192.log 2024-09-12T18:39:29.451 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.25087.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25087.log.gz 2024-09-12T18:39:29.451 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28459.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.28459.log.gz 2024-09-12T18:39:29.451 INFO:teuthology.orchestra.run.smithi073.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.24491.log 2024-09-12T18:39:29.451 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26082.log 2024-09-12T18:39:29.451 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28192.log.gz 2024-09-12T18:39:29.451 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.24491.log: /var/log/ceph/ceph-client.admin.25610.log 2024-09-12T18:39:29.451 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24491.log.gz 2024-09-12T18:39:29.451 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.26082.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26082.log.gz 2024-09-12T18:39:29.451 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25248.log 2024-09-12T18:39:29.451 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.25610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23563.log 2024-09-12T18:39:29.451 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25610.log.gz 2024-09-12T18:39:29.451 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.25248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28764.log 2024-09-12T18:39:29.451 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25248.log.gz 2024-09-12T18:39:29.452 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.23563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24247.log 2024-09-12T18:39:29.452 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23563.log.gz 2024-09-12T18:39:29.452 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25663.log 2024-09-12T18:39:29.452 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28764.log.gz 2024-09-12T18:39:29.452 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.24247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23073.log 2024-09-12T18:39:29.452 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24247.log.gz 2024-09-12T18:39:29.452 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.25663.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.25663.log.gz /var/log/ceph/ceph-client.admin.27957.log 2024-09-12T18:39:29.452 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-12T18:39:29.452 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.23073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25942.log 2024-09-12T18:39:29.452 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23073.log.gz 2024-09-12T18:39:29.452 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.27957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26517.log 2024-09-12T18:39:29.452 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27957.log.gz 2024-09-12T18:39:29.452 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.25942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25497.log 2024-09-12T18:39:29.453 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25942.log.gz 2024-09-12T18:39:29.453 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.26517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28114.log 2024-09-12T18:39:29.453 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26517.log.gz 2024-09-12T18:39:29.453 INFO:teuthology.orchestra.run.smithi073.stderr:gzip/var/log/ceph/ceph-client.admin.25497.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.26957.log 2024-09-12T18:39:29.453 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25497.log.gz 2024-09-12T18:39:29.453 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28114.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28114.log.gz 2024-09-12T18:39:29.453 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27953.log 2024-09-12T18:39:29.453 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.26957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22858.log 2024-09-12T18:39:29.453 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26957.log.gz 2024-09-12T18:39:29.453 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.27953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28374.log 2024-09-12T18:39:29.453 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27953.log.gz 2024-09-12T18:39:29.453 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.22858.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22858.log.gz -5 2024-09-12T18:39:29.453 INFO:teuthology.orchestra.run.smithi073.stderr: --verbose -- /var/log/ceph/ceph.tmp-client.admin.21736.log 2024-09-12T18:39:29.454 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28374.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T18:39:29.454 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28374.log.gz 2024-09-12T18:39:29.454 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5/var/log/ceph/ceph.tmp-client.admin.21736.log: --verbose -- /var/log/ceph/ceph-client.admin.24629.log 2024-09-12T18:39:29.454 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21736.log.gz 2024-09-12T18:39:29.454 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25745.log 2024-09-12T18:39:29.454 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.24629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26521.log 2024-09-12T18:39:29.454 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24629.log.gz 2024-09-12T18:39:29.454 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.25745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24833.log 2024-09-12T18:39:29.454 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25745.log.gz 2024-09-12T18:39:29.454 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.26521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25445.log 2024-09-12T18:39:29.455 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26521.log.gz 2024-09-12T18:39:29.455 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.24833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27228.log 2024-09-12T18:39:29.455 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24833.log.gz 2024-09-12T18:39:29.455 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26844.log 2024-09-12T18:39:29.455 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.25445.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25445.log.gz 2024-09-12T18:39:29.455 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.27228.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27228.log.gz 2024-09-12T18:39:29.455 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22620.log 2024-09-12T18:39:29.455 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.26844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26688.log 2024-09-12T18:39:29.455 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26844.log.gz 2024-09-12T18:39:29.456 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.22620.log: /var/log/ceph/ceph-client.admin.29109.log 2024-09-12T18:39:29.456 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22620.log.gz 2024-09-12T18:39:29.456 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.26688.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26688.log.gz 2024-09-12T18:39:29.456 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24283.log 2024-09-12T18:39:29.456 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.29109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26732.log 2024-09-12T18:39:29.456 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29109.log.gz 2024-09-12T18:39:29.456 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27341.log 2024-09-12T18:39:29.456 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.24283.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24283.log.gz 2024-09-12T18:39:29.457 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.26732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29075.log 2024-09-12T18:39:29.457 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26732.log.gz 2024-09-12T18:39:29.457 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.27341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22533.log 2024-09-12T18:39:29.457 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27341.log.gz 2024-09-12T18:39:29.457 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.29075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28244.log 2024-09-12T18:39:29.457 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29075.log.gz 2024-09-12T18:39:29.457 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.22533.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22533.log.gz 2024-09-12T18:39:29.457 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27285.log 2024-09-12T18:39:29.457 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27093.log 2024-09-12T18:39:29.457 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28244.log.gz 2024-09-12T18:39:29.458 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.27285.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.27285.log.gz /var/log/ceph/ceph-client.admin.25117.log 2024-09-12T18:39:29.458 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-12T18:39:29.458 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28304.log 2024-09-12T18:39:29.458 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.27093.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27093.log.gz 2024-09-12T18:39:29.458 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.25117.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25117.log.gz 2024-09-12T18:39:29.458 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28997.log 2024-09-12T18:39:29.458 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5/var/log/ceph/ceph-client.admin.28304.log: --verbose -- /var/log/ceph/ceph-client.admin.23300.log 2024-09-12T18:39:29.458 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28304.log.gz 2024-09-12T18:39:29.458 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24195.log 2024-09-12T18:39:29.458 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28997.log.gz 2024-09-12T18:39:29.458 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.23300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23074.log 2024-09-12T18:39:29.458 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23300.log.gz 2024-09-12T18:39:29.458 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.24195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29172.log 2024-09-12T18:39:29.459 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24195.log.gz 2024-09-12T18:39:29.459 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.23074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28005.log 2024-09-12T18:39:29.459 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23074.log.gz 2024-09-12T18:39:29.459 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.29172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27849.log 2024-09-12T18:39:29.459 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29172.log.gz 2024-09-12T18:39:29.459 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25163.log 2024-09-12T18:39:29.459 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28005.log.gz 2024-09-12T18:39:29.459 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.27849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22996.log 2024-09-12T18:39:29.459 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27849.log.gz 2024-09-12T18:39:29.459 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.25163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25796.log 2024-09-12T18:39:29.459 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25163.log.gz 2024-09-12T18:39:29.459 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21938.log 2024-09-12T18:39:29.459 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.22996.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22996.log.gz 2024-09-12T18:39:29.459 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.25796.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25796.log.gz 2024-09-12T18:39:29.460 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28218.log 2024-09-12T18:39:29.460 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.21938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26684.log 2024-09-12T18:39:29.460 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21938.log.gz 2024-09-12T18:39:29.460 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25004.log 2024-09-12T18:39:29.460 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28218.log.gz 2024-09-12T18:39:29.460 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.26684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24025.log 2024-09-12T18:39:29.460 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26684.log.gz 2024-09-12T18:39:29.460 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.25004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23326.log 2024-09-12T18:39:29.460 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25004.log.gz 2024-09-12T18:39:29.460 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.24025.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.25331.log -- replaced with /var/log/ceph/ceph-client.admin.24025.log.gz 2024-09-12T18:39:29.460 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-12T18:39:29.460 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.23326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.23739.log 2024-09-12T18:39:29.460 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23326.log.gz 2024-09-12T18:39:29.461 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.25331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22910.log 2024-09-12T18:39:29.461 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25331.log.gz 2024-09-12T18:39:29.461 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.23739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22332.log 0.0% 2024-09-12T18:39:29.461 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.0.23739.log.gz 2024-09-12T18:39:29.461 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.22910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27005.log 2024-09-12T18:39:29.461 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22910.log.gz 2024-09-12T18:39:29.461 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.22332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27316.log 2024-09-12T18:39:29.461 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22332.log.gz 2024-09-12T18:39:29.461 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.27005.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.27005.log.gz /var/log/ceph/ceph-client.admin.29049.log 2024-09-12T18:39:29.461 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-12T18:39:29.461 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25772.log 2024-09-12T18:39:29.461 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.27316.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27316.log.gz 2024-09-12T18:39:29.461 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.29049.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29049.log.gz 2024-09-12T18:39:29.461 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23854.log 2024-09-12T18:39:29.462 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24916.log/var/log/ceph/ceph-client.admin.25772.log: 2024-09-12T18:39:29.462 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25772.log.gz 2024-09-12T18:39:29.462 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.23854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27899.log 2024-09-12T18:39:29.462 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23854.log.gz 2024-09-12T18:39:29.462 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.24916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24802.log 2024-09-12T18:39:29.462 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24916.log.gz 2024-09-12T18:39:29.462 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.27899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28031.log 2024-09-12T18:39:29.462 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27899.log.gz 2024-09-12T18:39:29.462 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.24802.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.24802.log.gz 2024-09-12T18:39:29.462 INFO:teuthology.orchestra.run.smithi073.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.25547.log 2024-09-12T18:39:29.462 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28608.log 2024-09-12T18:39:29.462 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28031.log.gz 2024-09-12T18:39:29.462 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.25547.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25547.log.gz 2024-09-12T18:39:29.462 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27036.log 2024-09-12T18:39:29.463 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27563.log 2024-09-12T18:39:29.463 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28608.log.gz 2024-09-12T18:39:29.463 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.27036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25362.log 2024-09-12T18:39:29.463 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27036.log.gz 2024-09-12T18:39:29.463 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.27563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25719.log 2024-09-12T18:39:29.463 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27563.log.gz 2024-09-12T18:39:29.463 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.25362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26285.log 2024-09-12T18:39:29.463 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25362.log.gz 2024-09-12T18:39:29.463 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.25719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26171.log 2024-09-12T18:39:29.463 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25719.log.gz 2024-09-12T18:39:29.464 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.26285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28270.log 2024-09-12T18:39:29.464 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26285.log.gz 2024-09-12T18:39:29.464 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.26171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24947.log 2024-09-12T18:39:29.464 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26171.log.gz 2024-09-12T18:39:29.464 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26342.log 2024-09-12T18:39:29.464 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28270.log.gz 2024-09-12T18:39:29.464 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.24947.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.24947.log.gz --verbose -- /var/log/ceph/ceph-client.admin.26253.log 2024-09-12T18:39:29.464 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-12T18:39:29.464 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28582.log 2024-09-12T18:39:29.464 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.26342.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26342.log.gz 2024-09-12T18:39:29.464 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.26253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27875.log 2024-09-12T18:39:29.464 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26253.log.gz 2024-09-12T18:39:29.464 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26902.log 2024-09-12T18:39:29.465 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28582.log.gz 2024-09-12T18:39:29.465 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.27875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26373.log 2024-09-12T18:39:29.465 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27875.log.gz 2024-09-12T18:39:29.465 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.26902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25222.log 2024-09-12T18:39:29.465 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26902.log.gz 2024-09-12T18:39:29.465 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.26373.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.26373.log.gz 2024-09-12T18:39:29.465 INFO:teuthology.orchestra.run.smithi073.stderr: /var/log/ceph/ceph-client.admin.23455.log 2024-09-12T18:39:29.465 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.25222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22832.log 2024-09-12T18:39:29.465 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25222.log.gz 2024-09-12T18:39:29.465 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.23455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29146.log 2024-09-12T18:39:29.465 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23455.log.gz 2024-09-12T18:39:29.465 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.22832.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.22832.log.gz --verbose 2024-09-12T18:39:29.465 INFO:teuthology.orchestra.run.smithi073.stderr: -- /var/log/ceph/ceph-client.admin.23248.log 2024-09-12T18:39:29.466 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.29146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28382.log 2024-09-12T18:39:29.466 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29146.log.gz 2024-09-12T18:39:29.466 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.23248.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T18:39:29.466 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23248.log.gz 2024-09-12T18:39:29.466 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26114.log 2024-09-12T18:39:29.466 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28382.log.gz 2024-09-12T18:39:29.466 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25113.log 2024-09-12T18:39:29.466 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.26114.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26114.log.gz 2024-09-12T18:39:29.466 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24573.log 2024-09-12T18:39:29.466 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24517.log 2024-09-12T18:39:29.466 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.25113.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25113.log.gz 2024-09-12T18:39:29.466 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.24573.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T18:39:29.466 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24573.log.gz 2024-09-12T18:39:29.467 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.24517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22650.log 2024-09-12T18:39:29.467 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24517.log.gz 2024-09-12T18:39:29.467 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25055.log 2024-09-12T18:39:29.467 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.22650.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22650.log.gz 2024-09-12T18:39:29.467 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26430.log 2024-09-12T18:39:29.467 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23972.log 2024-09-12T18:39:29.467 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.25055.log: /var/log/ceph/ceph-client.admin.26430.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25055.log.gz 2024-09-12T18:39:29.467 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26430.log.gz 2024-09-12T18:39:29.467 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26487.log 2024-09-12T18:39:29.467 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27595.log 2024-09-12T18:39:29.467 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.23972.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23972.log.gz 2024-09-12T18:39:29.467 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.26487.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26487.log.gz 2024-09-12T18:39:29.467 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28057.log 2024-09-12T18:39:29.467 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24858.log 2024-09-12T18:39:29.468 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.27595.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27595.log.gz 2024-09-12T18:39:29.468 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28057.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28057.log.gz 2024-09-12T18:39:29.468 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25606.log 2024-09-12T18:39:29.468 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.24858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28556.log 2024-09-12T18:39:29.468 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24858.log.gz 2024-09-12T18:39:29.468 INFO:teuthology.orchestra.run.smithi073.stderr: 93.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T18:39:29.468 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.25606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26627.log 2024-09-12T18:39:29.468 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25606.log.gz 2024-09-12T18:39:29.468 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28556.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.28556.log.gz 2024-09-12T18:39:29.468 INFO:teuthology.orchestra.run.smithi073.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.24776.log 2024-09-12T18:39:29.468 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23507.log 2024-09-12T18:39:29.469 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.26627.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26627.log.gz 2024-09-12T18:39:29.469 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.24776.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24776.log.gz 2024-09-12T18:39:29.469 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22936.log 2024-09-12T18:39:29.469 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.23507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24973.log 2024-09-12T18:39:29.469 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23507.log.gz 2024-09-12T18:39:29.469 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.22936.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22936.log.gz 2024-09-12T18:39:29.469 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28452.log 2024-09-12T18:39:29.469 INFO:teuthology.orchestra.run.smithi073.stderr:gzip/var/log/ceph/ceph-client.admin.24973.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.24222.log 2024-09-12T18:39:29.469 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24973.log.gz 2024-09-12T18:39:29.469 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28452.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28452.log.gz 2024-09-12T18:39:29.469 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28166.log 2024-09-12T18:39:29.469 INFO:teuthology.orchestra.run.smithi073.stderr:gzip/var/log/ceph/ceph-client.admin.24222.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.28712.log 2024-09-12T18:39:29.469 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24222.log.gz 2024-09-12T18:39:29.470 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28166.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28166.log.gz 2024-09-12T18:39:29.470 INFO:teuthology.orchestra.run.smithi073.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.23352.log 2024-09-12T18:39:29.470 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23533.log 2024-09-12T18:39:29.470 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28712.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28712.log.gz 2024-09-12T18:39:29.470 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.23352.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23352.log.gz 2024-09-12T18:39:29.470 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24139.log 2024-09-12T18:39:29.471 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T18:39:29.503 INFO:teuthology.orchestra.run.smithi073.stderr:gzip/var/log/ceph/ceph-client.admin.23533.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.25196.log 2024-09-12T18:39:29.503 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23533.log.gz 2024-09-12T18:39:29.503 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.24139.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24139.log.gz 2024-09-12T18:39:29.503 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T18:39:29.503 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.25196.log: -- /var/log/ceph/ceph-client.admin.28460.log 2024-09-12T18:39:29.503 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25196.log.gz 2024-09-12T18:39:29.504 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24164.log 2024-09-12T18:39:29.504 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28460.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28460.log.gz 2024-09-12T18:39:29.504 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24108.log 2024-09-12T18:39:29.504 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25917.log 2024-09-12T18:39:29.504 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.24164.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24164.log.gz 2024-09-12T18:39:29.504 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.24108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23144.log 2024-09-12T18:39:29.504 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24108.log.gz 2024-09-12T18:39:29.504 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.25917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24719.log 2024-09-12T18:39:29.504 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25917.log.gz 2024-09-12T18:39:29.504 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.23144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24466.log 2024-09-12T18:39:29.504 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23144.log.gz 2024-09-12T18:39:29.504 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.24719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27487.log 2024-09-12T18:39:29.505 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24719.log.gz 2024-09-12T18:39:29.505 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.24466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26871.log 2024-09-12T18:39:29.505 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24466.log.gz 2024-09-12T18:39:29.505 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.27487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22962.log 2024-09-12T18:39:29.505 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27487.log.gz 2024-09-12T18:39:29.505 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.26871.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26871.log.gz 2024-09-12T18:39:29.505 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22277.log 2024-09-12T18:39:29.505 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23600.log 2024-09-12T18:39:29.505 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.22962.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22962.log.gz 2024-09-12T18:39:29.505 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.22277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23602.log 2024-09-12T18:39:29.505 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22277.log.gz 2024-09-12T18:39:29.505 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.23600.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.23600.log.gz --verbose 2024-09-12T18:39:29.506 INFO:teuthology.orchestra.run.smithi073.stderr: -- /var/log/ceph/ceph-client.admin.27174.log 2024-09-12T18:39:29.506 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.23602.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23602.log.gz 2024-09-12T18:39:29.506 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22806.log 2024-09-12T18:39:29.506 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26757.log 2024-09-12T18:39:29.506 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.27174.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27174.log.gz 2024-09-12T18:39:29.506 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.22806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28842.log 2024-09-12T18:39:29.506 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22806.log.gz 2024-09-12T18:39:29.507 INFO:teuthology.orchestra.run.smithi073.stderr:gzip/var/log/ceph/ceph-client.admin.26757.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.24440.log 2024-09-12T18:39:29.507 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26757.log.gz 2024-09-12T18:39:29.507 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28842.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28842.log.gz 2024-09-12T18:39:29.507 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T18:39:29.507 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27513.log 2024-09-12T18:39:29.507 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.24440.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24440.log.gz 2024-09-12T18:39:29.507 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23601.log 2024-09-12T18:39:29.507 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.27513.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27513.log.gz 2024-09-12T18:39:29.508 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25419.log 2024-09-12T18:39:29.508 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.23601.log: /var/log/ceph/ceph-mds.a.log 2024-09-12T18:39:29.508 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.25419.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23601.log.gz 2024-09-12T18:39:29.508 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25419.log.gz 2024-09-12T18:39:29.508 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25305.log 2024-09-12T18:39:29.508 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26289.log 2024-09-12T18:39:29.508 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.25305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28868.log 2024-09-12T18:39:29.508 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25305.log.gz 2024-09-12T18:39:29.508 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.26289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25274.log 2024-09-12T18:39:29.509 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26289.log.gz 2024-09-12T18:39:29.509 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26454.log 2024-09-12T18:39:29.509 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28868.log.gz 2024-09-12T18:39:29.509 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.25274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26202.log 2024-09-12T18:39:29.509 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25274.log.gz 95.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T18:39:29.509 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-12T18:39:29.509 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.26454.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26454.log.gz 2024-09-12T18:39:29.509 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28816.log 2024-09-12T18:39:29.509 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.26202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22382.log 2024-09-12T18:39:29.509 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26202.log.gz 2024-09-12T18:39:29.509 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26145.log 2024-09-12T18:39:29.510 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28816.log.gz 2024-09-12T18:39:29.510 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.22382.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.22382.log.gz --verbose 2024-09-12T18:39:29.510 INFO:teuthology.orchestra.run.smithi073.stderr: -- /var/log/ceph/ceph-client.admin.23680.log 2024-09-12T18:39:29.510 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24383.log/var/log/ceph/ceph-client.admin.26145.log: 2024-09-12T18:39:29.510 INFO:teuthology.orchestra.run.smithi073.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-12T18:39:29.510 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26145.log.gz 2024-09-12T18:39:29.510 INFO:teuthology.orchestra.run.smithi073.stderr:gzip/var/log/ceph/ceph-client.admin.23680.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.22754.log 2024-09-12T18:39:29.510 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23680.log.gz 2024-09-12T18:39:29.510 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.24383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27107.log 2024-09-12T18:39:29.510 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24383.log.gz 2024-09-12T18:39:29.510 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.22754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23274.log 2024-09-12T18:39:29.510 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22754.log.gz 2024-09-12T18:39:29.510 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.27107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23706.log 2024-09-12T18:39:29.510 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27107.log.gz 2024-09-12T18:39:29.511 INFO:teuthology.orchestra.run.smithi073.stderr:gzip/var/log/ceph/ceph-client.admin.23274.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.22505.log 2024-09-12T18:39:29.511 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23274.log.gz 2024-09-12T18:39:29.511 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.23706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22884.log 2024-09-12T18:39:29.511 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23706.log.gz 2024-09-12T18:39:29.511 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.22505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26596.log 2024-09-12T18:39:29.511 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22505.log.gz 2024-09-12T18:39:29.511 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25471.log 2024-09-12T18:39:29.511 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.22884.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22884.log.gz 2024-09-12T18:39:29.511 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.26596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25886.log 2024-09-12T18:39:29.511 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26596.log.gz 2024-09-12T18:39:29.511 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5/var/log/ceph/ceph-client.admin.25471.log: --verbose -- /var/log/ceph/ceph-client.admin.22702.log 2024-09-12T18:39:29.511 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25471.log.gz 2024-09-12T18:39:29.511 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.25886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24407.log 2024-09-12T18:39:29.512 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25886.log.gz 2024-09-12T18:39:29.512 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.22702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27735.log 2024-09-12T18:39:29.512 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22702.log.gz 2024-09-12T18:39:29.512 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.24407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25029.log 2024-09-12T18:39:29.512 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24407.log.gz 2024-09-12T18:39:29.512 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.27735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22568.log 2024-09-12T18:39:29.512 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27735.log.gz 2024-09-12T18:39:29.512 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.25029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26653.log 2024-09-12T18:39:29.512 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25029.log.gz 2024-09-12T18:39:29.512 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.22568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23148.log 2024-09-12T18:39:29.512 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22568.log.gz 2024-09-12T18:39:29.512 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.26653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27925.log 2024-09-12T18:39:29.512 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26653.log.gz 2024-09-12T18:39:29.513 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.23148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24051.log 2024-09-12T18:39:29.513 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23148.log.gz 2024-09-12T18:39:29.513 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.27925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24890.log 2024-09-12T18:39:29.513 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27925.log.gz 2024-09-12T18:39:29.513 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.24051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24665.log 2024-09-12T18:39:29.513 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24051.log.gz 2024-09-12T18:39:29.513 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.24890.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T18:39:29.513 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24890.log.gz 2024-09-12T18:39:29.513 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.24665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25854.log 2024-09-12T18:39:29.513 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24665.log.gz 2024-09-12T18:39:29.513 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26228.log 2024-09-12T18:39:29.513 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.25854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27537.log 2024-09-12T18:39:29.513 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25854.log.gz 2024-09-12T18:39:29.513 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.26228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26781.log 2024-09-12T18:39:29.514 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26228.log.gz 2024-09-12T18:39:29.514 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.27537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26928.log 2024-09-12T18:39:29.514 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27537.log.gz 2024-09-12T18:39:29.514 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.26781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28947.log 2024-09-12T18:39:29.514 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26781.log.gz 2024-09-12T18:39:29.514 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.26928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28920.log 2024-09-12T18:39:29.514 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26928.log.gz 2024-09-12T18:39:29.514 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23481.log 2024-09-12T18:39:29.514 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28947.log.gz 2024-09-12T18:39:29.514 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23378.log 2024-09-12T18:39:29.514 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28920.log.gz 2024-09-12T18:39:29.515 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.23481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23404.log 0.0% 2024-09-12T18:39:29.515 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.23481.log.gz 2024-09-12T18:39:29.515 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.23378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27121.log 2024-09-12T18:39:29.515 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23378.log.gz 2024-09-12T18:39:29.515 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.23404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27201.log 2024-09-12T18:39:29.515 INFO:teuthology.orchestra.run.smithi073.stderr: 49.1% -- replaced with /var/log/ceph/ceph-client.admin.23404.log.gz 2024-09-12T18:39:29.515 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.27121.log: /var/log/ceph/ceph-client.admin.23828.log 2024-09-12T18:39:29.515 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27121.log.gz 2024-09-12T18:39:29.515 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.27201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22451.log 2024-09-12T18:39:29.515 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27201.log.gz 2024-09-12T18:39:29.515 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.23828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24548.log 2024-09-12T18:39:29.515 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23828.log.gz 2024-09-12T18:39:29.515 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.22451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23222.log 2024-09-12T18:39:29.516 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22451.log.gz 2024-09-12T18:39:29.516 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.24548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24666.log 2024-09-12T18:39:29.516 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24548.log.gz 2024-09-12T18:39:29.516 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.23222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28634.log 2024-09-12T18:39:29.516 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23222.log.gz 2024-09-12T18:39:29.516 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.24666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22405.log 2024-09-12T18:39:29.516 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24666.log.gz 2024-09-12T18:39:29.516 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22594.log 2024-09-12T18:39:29.516 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28634.log.gz 2024-09-12T18:39:29.516 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.22405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23737.log 2024-09-12T18:39:29.516 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22405.log.gz 2024-09-12T18:39:29.516 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.22594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26057.log 2024-09-12T18:39:29.516 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22594.log.gz 2024-09-12T18:39:29.517 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.23737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28301.log 2024-09-12T18:39:29.517 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23737.log.gz 2024-09-12T18:39:29.517 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.26057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28738.log 2024-09-12T18:39:29.517 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26057.log.gz 2024-09-12T18:39:29.517 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27461.log 2024-09-12T18:39:29.517 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28301.log.gz 2024-09-12T18:39:29.517 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28303.log 2024-09-12T18:39:29.517 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28738.log.gz 2024-09-12T18:39:29.517 INFO:teuthology.orchestra.run.smithi073.stderr:gzip/var/log/ceph/ceph-client.admin.27461.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.23152.log 2024-09-12T18:39:29.517 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27461.log.gz 2024-09-12T18:39:29.517 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25388.log 2024-09-12T18:39:29.517 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28303.log.gz 2024-09-12T18:39:29.517 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.23152.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23152.log.gz 2024-09-12T18:39:29.518 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22357.log 2024-09-12T18:39:29.518 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.25388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28381.log 2024-09-12T18:39:29.518 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25388.log.gz 2024-09-12T18:39:29.518 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.22357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22780.log 2024-09-12T18:39:29.518 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22357.log.gz 2024-09-12T18:39:29.518 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27823.log 2024-09-12T18:39:29.518 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28381.log.gz 2024-09-12T18:39:29.518 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.22780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27766.log 2024-09-12T18:39:29.518 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22780.log.gz 2024-09-12T18:39:29.518 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.27823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26000.log 2024-09-12T18:39:29.518 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27823.log.gz 2024-09-12T18:39:29.518 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.27766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27373.log 2024-09-12T18:39:29.518 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27766.log.gz 2024-09-12T18:39:29.518 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.26000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28530.log 2024-09-12T18:39:29.519 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26000.log.gz 2024-09-12T18:39:29.519 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.27373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26958.log 2024-09-12T18:39:29.519 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27373.log.gz 2024-09-12T18:39:29.519 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28894.log 2024-09-12T18:39:29.519 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28530.log.gz 2024-09-12T18:39:29.519 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.26958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24723.log 2024-09-12T18:39:29.519 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26958.log.gz 2024-09-12T18:39:29.519 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28894.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28894.log.gz 2024-09-12T18:39:29.519 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.24723.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24723.log.gz 2024-09-12T18:39:29.520 INFO:teuthology.orchestra.run.smithi073.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T18:39:29.557 INFO:teuthology.orchestra.run.smithi073.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T18:39:29.618 INFO:teuthology.orchestra.run.smithi073.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T18:39:29.655 INFO:teuthology.orchestra.run.smithi073.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T18:39:29.657 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-12T18:39:29.657 INFO:teuthology.orchestra.run.smithi073.stderr:real 0m0.298s 2024-09-12T18:39:29.657 INFO:teuthology.orchestra.run.smithi073.stderr:user 0m0.739s 2024-09-12T18:39:29.657 INFO:teuthology.orchestra.run.smithi073.stderr:sys 0m0.111s 2024-09-12T18:39:31.301 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-12T18:39:54.963 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-osd.0.log: 93.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T18:39:54.963 INFO:teuthology.orchestra.run.smithi114.stderr: 2024-09-12T18:39:54.963 INFO:teuthology.orchestra.run.smithi114.stderr:real 0m25.585s 2024-09-12T18:39:54.964 INFO:teuthology.orchestra.run.smithi114.stderr:user 0m24.651s 2024-09-12T18:39:54.964 INFO:teuthology.orchestra.run.smithi114.stderr:sys 0m0.833s 2024-09-12T18:40:02.761 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-osd.1.log: 92.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T18:40:02.762 INFO:teuthology.orchestra.run.smithi143.stderr: 2024-09-12T18:40:02.763 INFO:teuthology.orchestra.run.smithi143.stderr:real 0m33.375s 2024-09-12T18:40:02.763 INFO:teuthology.orchestra.run.smithi143.stderr:user 0m32.309s 2024-09-12T18:40:02.763 INFO:teuthology.orchestra.run.smithi143.stderr:sys 0m1.060s 2024-09-12T18:40:03.812 INFO:teuthology.orchestra.run.smithi162.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T18:40:03.813 INFO:teuthology.orchestra.run.smithi162.stderr: 2024-09-12T18:40:03.813 INFO:teuthology.orchestra.run.smithi162.stderr:real 0m34.410s 2024-09-12T18:40:03.813 INFO:teuthology.orchestra.run.smithi162.stderr:user 0m33.331s 2024-09-12T18:40:03.814 INFO:teuthology.orchestra.run.smithi162.stderr:sys 0m1.076s 2024-09-12T18:40:03.814 INFO:tasks.ceph:Archiving logs... 2024-09-12T18:40:03.814 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/log/ceph to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901181/remote/smithi073/log 2024-09-12T18:40:03.815 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T18:40:04.104 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/log/ceph to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901181/remote/smithi114/log 2024-09-12T18:40:04.104 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T18:40:07.387 DEBUG:teuthology.misc:Transferring archived files from smithi143:/var/log/ceph to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901181/remote/smithi143/log 2024-09-12T18:40:07.388 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T18:40:12.009 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/log/ceph to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901181/remote/smithi162/log 2024-09-12T18:40:12.010 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T18:40:17.108 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T18:40:17.117 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T18:40:17.118 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T18:40:17.121 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T18:40:17.123 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T18:40:17.125 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T18:40:17.240 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T18:40:17.249 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T18:40:17.249 DEBUG:teuthology.orchestra.run.smithi073:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T18:40:17.252 DEBUG:teuthology.orchestra.run.smithi114:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T18:40:17.255 DEBUG:teuthology.orchestra.run.smithi143:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T18:40:17.257 DEBUG:teuthology.orchestra.run.smithi162:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T18:40:17.264 INFO:teuthology.orchestra.run.smithi073.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T18:40:17.264 INFO:teuthology.orchestra.run.smithi073.stdout:============================================================================== 2024-09-12T18:40:17.264 INFO:teuthology.orchestra.run.smithi073.stdout:*hv01.front.sepi 67.205.162.81 3 u 12 64 377 0.114 -1.594 0.869 2024-09-12T18:40:17.264 INFO:teuthology.orchestra.run.smithi073.stdout:+hv02.front.sepi 63.231.80.2 3 u 8 64 377 0.096 -1.829 0.967 2024-09-12T18:40:17.264 INFO:teuthology.orchestra.run.smithi073.stdout:+hv03.front.sepi 74.6.168.72 3 u 6 64 377 0.133 +0.236 0.859 2024-09-12T18:40:17.264 INFO:teuthology.orchestra.run.smithi073.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:40:17.266 INFO:teuthology.orchestra.run.smithi114.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T18:40:17.266 INFO:teuthology.orchestra.run.smithi114.stdout:============================================================================== 2024-09-12T18:40:17.266 INFO:teuthology.orchestra.run.smithi114.stdout:*hv01.front.sepi 67.205.162.81 3 u 10 64 377 0.109 -1.390 0.541 2024-09-12T18:40:17.266 INFO:teuthology.orchestra.run.smithi114.stdout:+hv02.front.sepi 63.231.80.2 3 u 6 64 377 0.085 -1.649 0.566 2024-09-12T18:40:17.266 INFO:teuthology.orchestra.run.smithi114.stdout:+hv03.front.sepi 74.6.168.72 3 u 2 64 377 0.103 +0.467 0.506 2024-09-12T18:40:17.266 INFO:teuthology.orchestra.run.smithi114.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:40:17.268 INFO:teuthology.orchestra.run.smithi143.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T18:40:17.268 INFO:teuthology.orchestra.run.smithi143.stdout:============================================================================== 2024-09-12T18:40:17.268 INFO:teuthology.orchestra.run.smithi143.stdout:*hv01.front.sepi 67.205.162.81 3 u 9 64 377 0.046 -1.795 1.808 2024-09-12T18:40:17.268 INFO:teuthology.orchestra.run.smithi143.stdout:+hv02.front.sepi 63.231.80.2 3 u 11 64 377 0.054 -1.759 1.717 2024-09-12T18:40:17.268 INFO:teuthology.orchestra.run.smithi143.stdout:+hv03.front.sepi 74.6.168.72 3 u 3 64 377 0.070 +0.278 1.752 2024-09-12T18:40:17.268 INFO:teuthology.orchestra.run.smithi143.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:40:17.272 INFO:teuthology.orchestra.run.smithi162.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T18:40:17.272 INFO:teuthology.orchestra.run.smithi162.stdout:============================================================================== 2024-09-12T18:40:17.272 INFO:teuthology.orchestra.run.smithi162.stdout:+hv01.front.sepi 67.205.162.81 3 u 11 64 377 0.061 -1.801 1.154 2024-09-12T18:40:17.272 INFO:teuthology.orchestra.run.smithi162.stdout:+hv02.front.sepi 63.231.80.2 3 u 13 64 377 0.072 -1.848 1.093 2024-09-12T18:40:17.272 INFO:teuthology.orchestra.run.smithi162.stdout:*hv03.front.sepi 74.6.168.72 3 u 14 64 377 0.081 -0.149 1.083 2024-09-12T18:40:17.272 INFO:teuthology.orchestra.run.smithi162.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:40:17.273 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T18:40:17.282 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T18:40:17.282 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T18:40:17.306 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T18:40:17.340 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T18:40:17.377 INFO:teuthology.task.internal:Duration was 938.427610 seconds 2024-09-12T18:40:17.377 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T18:40:17.413 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T18:40:17.414 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T18:40:17.417 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T18:40:17.420 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T18:40:17.422 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T18:40:17.461 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T18:40:17.461 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi073.front.sepia.ceph.com 2024-09-12T18:40:17.461 DEBUG:teuthology.orchestra.run.smithi073:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T18:40:17.504 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi114.front.sepia.ceph.com 2024-09-12T18:40:17.504 DEBUG:teuthology.orchestra.run.smithi114:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T18:40:17.514 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi143.front.sepia.ceph.com 2024-09-12T18:40:17.514 DEBUG:teuthology.orchestra.run.smithi143:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T18:40:17.524 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi162.front.sepia.ceph.com 2024-09-12T18:40:17.524 DEBUG:teuthology.orchestra.run.smithi162:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T18:40:17.535 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T18:40:17.535 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T18:40:17.552 DEBUG:teuthology.orchestra.run.smithi114:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T18:40:17.560 DEBUG:teuthology.orchestra.run.smithi143:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T18:40:17.569 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T18:40:17.608 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T18:40:17.609 DEBUG:teuthology.orchestra.run.smithi073:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T18:40:17.620 DEBUG:teuthology.orchestra.run.smithi114:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T18:40:17.628 DEBUG:teuthology.orchestra.run.smithi143:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T18:40:17.638 DEBUG:teuthology.orchestra.run.smithi162:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T18:40:17.708 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T18:40:17.719 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T18:40:17.719 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T18:40:17.730 DEBUG:teuthology.orchestra.run.smithi114:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T18:40:17.741 DEBUG:teuthology.orchestra.run.smithi143:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T18:40:17.752 DEBUG:teuthology.orchestra.run.smithi162:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T18:40:17.766 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T18:40:17.776 DEBUG:teuthology.orchestra.run.smithi073:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:40:17.780 DEBUG:teuthology.orchestra.run.smithi114:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:40:17.785 DEBUG:teuthology.orchestra.run.smithi143:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:40:17.788 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = core 2024-09-12T18:40:17.793 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern = core 2024-09-12T18:40:17.798 DEBUG:teuthology.orchestra.run.smithi162:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:40:17.807 INFO:teuthology.orchestra.run.smithi143.stdout:kernel.core_pattern = core 2024-09-12T18:40:17.820 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = core 2024-09-12T18:40:17.882 DEBUG:teuthology.orchestra.run.smithi073:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:40:17.887 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:40:17.887 DEBUG:teuthology.orchestra.run.smithi114:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:40:17.927 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:40:17.927 DEBUG:teuthology.orchestra.run.smithi143:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:40:17.932 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:40:17.932 DEBUG:teuthology.orchestra.run.smithi162:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:40:17.937 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:40:17.938 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T18:40:17.950 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T18:40:17.951 DEBUG:teuthology.misc:Transferring archived files from smithi073:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901181/remote/smithi073 2024-09-12T18:40:17.951 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T18:40:17.974 DEBUG:teuthology.misc:Transferring archived files from smithi114:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901181/remote/smithi114 2024-09-12T18:40:17.974 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T18:40:17.997 DEBUG:teuthology.misc:Transferring archived files from smithi143:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901181/remote/smithi143 2024-09-12T18:40:17.997 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T18:40:18.018 DEBUG:teuthology.misc:Transferring archived files from smithi162:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901181/remote/smithi162 2024-09-12T18:40:18.018 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T18:40:18.040 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T18:40:18.040 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T18:40:18.043 DEBUG:teuthology.orchestra.run.smithi114:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T18:40:18.045 DEBUG:teuthology.orchestra.run.smithi143:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T18:40:18.062 DEBUG:teuthology.orchestra.run.smithi162:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T18:40:18.086 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T18:40:18.097 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T18:40:18.097 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T18:40:18.150 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T18:40:18.150 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T18:40:18.153 DEBUG:teuthology.orchestra.run.smithi114:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T18:40:18.155 DEBUG:teuthology.orchestra.run.smithi143:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T18:40:18.157 INFO:teuthology.orchestra.run.smithi073.stdout: 658466 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 18:40 /home/ubuntu/cephtest 2024-09-12T18:40:18.158 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T18:40:18.162 INFO:teuthology.orchestra.run.smithi114.stdout: 658636 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 18:40 /home/ubuntu/cephtest 2024-09-12T18:40:18.165 INFO:teuthology.orchestra.run.smithi143.stdout: 658463 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 18:40 /home/ubuntu/cephtest 2024-09-12T18:40:18.165 INFO:teuthology.orchestra.run.smithi162.stdout: 658462 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 18:40 /home/ubuntu/cephtest 2024-09-12T18:40:18.167 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T18:40:18.199 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T18:40:18.268 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-snappy powercycle/default supported-distros/ubuntu_latest tasks/admin_socket_objecter_requests thrashosds-health} duration: 938.4276099205017 flavor: default owner: scheduled_bhubbard@teuthology success: true 2024-09-12T18:40:18.268 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T18:40:18.349 INFO:teuthology.run:pass